About me

Welcome! I am an Assistant Professor in the Department of Computer Science and Engineering at the University of Louisville. I received my PhD in Information Sciences and Technology from the Pennsylvania State University in 2023, Bachelor’s and Master’s degrees from Tsinghua University.

My research interests span the areas of computer vision, machine learning, human-computer interaction, and robotics. My research employs a hybrid approach integrating data-driven learning and human-centered design to address major human-centric challenges.

To Prospective Students

I am seeking motivated students interested in computer vision and/or human-computer interaction research. If you are a student at the UofL or in the Louisville area and wish to explore research opportunities, please email me.

Selected Publications

NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation
Rui Yu*, Jiachen Liu* (eq. contrib.), Zihan Zhou, Sharon X. Huang
IEEE International Conference on Robotics and Automation (ICRA), 2024.
[paper]

BubbleCam: Engaging Privacy in Remote Sighted Assistance
Jingyi Xie*, Rui Yu* (eq. contrib.), He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll
ACM Conference on Human Factors in Computing Systems (CHI), 2024.
[paper]

WIA-LD2ND: Wavelet-based Image Alignment for Self-supervised Low-Dose CT Denoising
Haoyu Zhao, Guyu Liang, Zhou Zhao, Bo Du, Yongchao Xu, Rui Yu
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024.
[paper]

Be Real in Scale: Swing for True Scale in Dual Camera Mode
Rui Yu, Jian Wang, Sizhuo Ma, Sharon X. Huang, Guru Krishnan, Yicheng Wu
IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2023.
[paper][code]

Are Two Heads Better than One? Investigating Remote Sighted Assistance with Paired Volunteers
Jingyi Xie, Rui Yu, Kaiming Cui, Sooyeon Lee, John M. Carroll, Syed Masum Billah
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2023.
[paper]

Cascade Transformers for End-to-End Person Search
Rui Yu, Dawei Du, Rodney LaLonde, Daniel Davila, Christopher Funk, Anthony Hoogs, Brian Clipp
IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper][code]

Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps
Jingyi Xie*, Rui Yu* (eq. contrib.), Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M. Carroll
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2022.
[paper][video]

Opportunities for Human-AI Collaboration in Remote Sighted Assistance
Sooyeon Lee*, Rui Yu* (eq. contrib.), Jingyi Xie, Syed Masum Billah, John M. Carroll
ACM International Conference on Intelligent User Interfaces (IUI), 2022.
[paper][video][PSU News]

Towards Robust Human Trajectory Prediction in Raw Videos
Rui Yu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021.
[paper][code]

Data-Driven Distributed State Estimation and Behavior Modeling in Sensor Networks
Rui Yu, Zhenyuan Yuan, Minghui Zhu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.
[paper]

Deep-Person: Learning Discriminative Deep Features for Person Re-Identification
Xiang Bai, Mingkun Yang, Tengteng Huang, Zhiyong Dou, Rui Yu, Yongchao Xu
Pattern Recognition (PR), 2020.
[paper][code]

Hard-Aware Point-to-Set Deep Metric for Person Re-identification
Rui Yu, Zhiyong Dou, Song Bai, Zhaoxiang Zhang, Yongchao Xu, Xiang Bai
European Conference on Computer Vision (ECCV), 2018.
[paper]

Divide and Fuse: A Re-ranking Approach for Person Re-identification
Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai
British Machine Vision Conference (BMVC), 2017.
[paper]

Teaching

  • CSE 419. Introduction to Algorithms
  • CSE 619. Design and Analysis of Computer Algorithms

Services

  • Conference Session Chair
    • Chair for IROS 2021 Session “Visual Tracking II”
  • Conference Program Committee Member / Reviewer
    • IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, 2024
    • European Conference on Computer Vision (ECCV), 2024
    • IEEE International Conference on Robotics and Automation (ICRA), 2024
    • ACM Conference on Human Factors in Computing Systems (CHI), 2024
    • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
    • AAAI Conference on Artificial Intelligence (AAAI), 2019, 2020, 2021
    • International Conference on Pattern Recognition (ICPR), 2018, 2020
  • Journal Reviewer
    • International Journal of Computer Vision (IJCV)
    • IEEE Transactions on Image Processing (TIP)
    • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
    • Pattern Recognition (PR)
    • Computer Vision and Image Understanding (CVIU)
    • Pattern Recognition Letters (PRL)
    • Journal of Visual Communication and Image Representation (JVCI)
    • Science China Information Sciences (SCIS)
    • Computerized Medical Imaging and Graphics (CMIG)