Publications

Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View
Zitong Zhang, Suranjan Gautam, Rui Yu
IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
[paper to appear]

Describe, Adapt and Combine: Empowering CLIP Encoders for Open-set 3D Object Retrieval
Zhichuan Wang, Yang Zhou, Zhe Liu, Rui Yu, Song Bai, Yulong Wang, Xinwei He, Xiang Bai
IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
[paper to appear]

Towards In-the-wild 3D Plane Reconstruction from a Single Image
Jiachen Liu*, Rui Yu*, Sili Chen, Sharon X. Huang, Hengkai Guo
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. 🌟Highlight Paper
[paper][code] (*equal contribution)

PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutes
Bin Tan, Rui Yu, Yujun Shen, Nan Xue
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. 🌟Highlight Paper
[paper][project]

Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models
Jingyi Xie, Rui Yu, He Zhang, Syed Masum Billah, Sooyeon Lee, John M. Carroll
ACM Conference on Human Factors in Computing Systems (CHI), 2025.
[paper][data]

Noise-Robust Tuning of SAM for Domain Generalized Ultrasound Image Segmentation
Zhikai Wei, Chao Wu, Hanyu Du, Rui Yu, Bo Du, Yongchao Xu
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025.
[paper to appear]

Fairness-Aware Graph Representation Learning with Limited Demographic Information
Zichong Wang, Zhipeng Yin, Liping Yang, Jun Zhuang, Rui Yu, Qingzhao Kong, Wenbin Zhang
European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), 2025.
[paper to appear]

Computer-Aided Layout Generation for Building Design: A Review
Jiachen Liu, Yuan Xue, Haomiao Ni, Rui Yu, Zihan Zhou, Sharon X. Huang
Computational Visual Media (CVMJ), 2025.
[paper][project]

Graph Fairness via Authentic Counterfactuals: Tackling Structural and Causal Challenges
Zichong Wang, Zhipeng Yin, Fang Liu, Zhen Liu, Christine Lisetti, Rui Yu, Shaowei Wang, Jun Li, Sukumar Ganapati, Shuigeng Zhou, Wenbin Zhang
ACM SIGKDD Explorations, 2025.
[paper]

Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation System
He Zhang, Nicholas J. Falletta, Jingyi Xie, Rui Yu, Sooyeon Lee, Syed Masum Billah, John M. Carroll
ACM International Conference on Supporting Group Work (GROUP), 2025.
[extended abstract]

NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation
Rui Yu*, Jiachen Liu*, Zihan Zhou, Sharon X. Huang
IEEE International Conference on Robotics and Automation (ICRA), 2024.
[paper] (*equal contribution)

BubbleCam: Engaging Privacy in Remote Sighted Assistance
Jingyi Xie*, Rui Yu*, He Zhang, Sooyeon Lee, Syed Masum Billah, John M. Carroll
ACM Conference on Human Factors in Computing Systems (CHI), 2024.
[paper] (*equal contribution)

WIA-LD2ND: Wavelet-based Image Alignment for Self-supervised Low-Dose CT Denoising
Haoyu Zhao, Guyu Liang, Zhou Zhao, Bo Du, Yongchao Xu, Rui Yu
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024.
[paper]

MoreStyle: Relax Low-frequency Constraint of Fourier-based Image Reconstruction in Generalizable Medical Image Segmentation
Haoyu Zhao, Wenhui Dong, Rui Yu, Zhou Zhao, Du Bo, Yongchao Xu
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024.
[paper]

Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image
Zerui Zhang, Zhichao Sun, Zelong Liu, Bo Du, Rui Yu, Zhou Zhao, Yongchao Xu
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024.
[paper][code]

Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM Era
Rui Yu*, Sooyeon Lee*, Jingyi Xie, Syed Masum Billah, John M. Carroll
Future Internet, 2024. (Extended version of IUI'22)
[paper] (*equal contribution)

Be Real in Scale: Swing for True Scale in Dual Camera Mode
Rui Yu, Jian Wang, Sizhuo Ma, Sharon X. Huang, Guru Krishnan, Yicheng Wu
IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2023.
[paper][code]

Are Two Heads Better than One? Investigating Remote Sighted Assistance with Paired Volunteers
Jingyi Xie, Rui Yu, Kaiming Cui, Sooyeon Lee, John M. Carroll, Syed Masum Billah
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2023.
[paper]

Cascade Transformers for End-to-End Person Search
Rui Yu, Dawei Du, Rodney LaLonde, Daniel Davila, Christopher Funk, Anthony Hoogs, Brian Clipp
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper][code]

Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps
Jingyi Xie*, Rui Yu*, Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M. Carroll
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2022.
[paper][video] (*equal contribution)

Opportunities for Human-AI Collaboration in Remote Sighted Assistance
Sooyeon Lee*, Rui Yu*, Jingyi Xie, Syed Masum Billah, John M. Carroll
ACM International Conference on Intelligent User Interfaces (IUI), 2022.
[paper][video][PSU News] (*equal contribution)

Towards Robust Human Trajectory Prediction in Raw Videos
Rui Yu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021.
[paper][code]

Data-Driven Distributed State Estimation and Behavior Modeling in Sensor Networks
Rui Yu, Zhenyuan Yuan, Minghui Zhu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.
[paper]

Deep-Person: Learning Discriminative Deep Features for Person Re-Identification
Xiang Bai, Mingkun Yang, Tengteng Huang, Zhiyong Dou, Rui Yu, Yongchao Xu
Pattern Recognition (PR), 2020.
[paper][code]

Hard-Aware Point-to-Set Deep Metric for Person Re-identification
Rui Yu, Zhiyong Dou, Song Bai, Zhaoxiang Zhang, Yongchao Xu, Xiang Bai
European Conference on Computer Vision (ECCV), 2018.
[paper]

Divide and Fuse: A Re-ranking Approach for Person Re-identification
Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai
British Machine Vision Conference (BMVC), 2017.
[paper]