About me

Welcome! I am an Assistant Professor in the Computer Science and Engineering department of J.B. Speed School of Engineering at the University of Louisville. I received my PhD in Information Sciences and Technology from the Pennsylvania State University in 2023, Bachelor’s and Master’s degrees from Tsinghua University.

My research interests span the areas of computer vision, machine learning, human-computer interaction, and robotics. My research employs a hybrid approach integrating data-driven learning and human-centered design to address major human-centric challenges.

PhD student positions available

I have fully-funded Ph.D. student positions starting from Fall 2024. Feel free to contact me regarding PhD applications, internships, and visiting students/scholars.

CSE@UofL Ph.D. Program (Application deadline: May 1st 2024 for Fall semester)

Publications

NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation
Rui Yu*, Jiachen Liu*, Zihan Zhou, Sharon X. Huang
IEEE International Conference on Robotics and Automation (ICRA), 2024.
[paper]

BubbleCam: Engaging Privacy in Remote Sighted Assistance
Jingyi Xie*, Rui Yu*, He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll
ACM Conference on Human Factors in Computing Systems (CHI), 2024.
[paper]

Be Real in Scale: Swing for True Scale in Dual Camera Mode
Rui Yu, Jian Wang, Sizhuo Ma, Sharon X. Huang, Guru Krishnan, Yicheng Wu
IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2023.
[paper][code]

Are Two Heads Better than One? Investigating Remote Sighted Assistance with Paired Volunteers
Jingyi Xie, Rui Yu, Kaiming Cui, Sooyeon Lee, John M. Carroll, Syed Masum Billah
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2023.
[paper]

Cascade Transformers for End-to-End Person Search
Rui Yu, Dawei Du, Rodney LaLonde, Daniel Davila, Christopher Funk, Anthony Hoogs, Brian Clipp
IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper][code]

Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps
Jingyi Xie*, Rui Yu*, Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M. Carroll (*Equal contribution)
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2022.
[paper][video]

Opportunities for Human-AI Collaboration in Remote Sighted Assistance
Sooyeon Lee*, Rui Yu*, Jingyi Xie, Syed Masum Billah, John M. Carroll (*Equal contribution)
ACM International Conference on Intelligent User Interfaces (IUI), 2022.
[paper][video][PSU News]

Towards Robust Human Trajectory Prediction in Raw Videos
Rui Yu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021.
[paper][code]

Data-Driven Distributed State Estimation and Behavior Modeling in Sensor Networks
Rui Yu, Zhenyuan Yuan, Minghui Zhu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.
[paper]

Deep-Person: Learning Discriminative Deep Features for Person Re-Identification
Xiang Bai, Mingkun Yang, Tengteng Huang, Zhiyong Dou, Rui Yu, Yongchao Xu
Pattern Recognition (PR), 2020.
[paper][code]

Hard-Aware Point-to-Set Deep Metric for Person Re-identification
Rui Yu, Zhiyong Dou, Song Bai, Zhaoxiang Zhang, Yongchao Xu, Xiang Bai
European Conference on Computer Vision (ECCV), 2018.
[paper]

Divide and Fuse: A Re-ranking Approach for Person Re-identification
Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai
British Machine Vision Conference (BMVC), 2017.
[paper]

Teaching

  • CSE 419. Introduction to Algorithms (Fall 23, Spring 24)
  • CSE 619. Design and Analysis of Computer Algorithms (Fall 23, Spring 24)

Services

  • Conference Session Chair
    • Chair for IROS 2021 Session “Visual Tracking II”
  • Conference Program Committee Member / Reviewer
    • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, 2024
    • IEEE International Conference on Robotics and Automation (ICRA), 2024
    • ACM Conference on Human Factors in Computing Systems (CHI), 2024
    • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
    • AAAI Conference on Artificial Intelligence (AAAI), 2019, 2020, 2021
    • International Conference on Pattern Recognition (ICPR), 2018, 2020
  • Journal Reviewer
    • International Journal of Computer Vision (IJCV)
    • IEEE Transactions on Image Processing (TIP)
    • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
    • Pattern Recognition (PR)
    • Computer Vision and Image Understanding (CVIU)
    • Pattern Recognition Letters (PRL)
    • Journal of Visual Communication and Image Representation (JVCI)
    • Science China Information Sciences (SCIS)
    • Computerized Medical Imaging and Graphics (CMIG)