New Scientist Article
Haoyu Xiong
I am a second-year PhD student at MIT EECS. I am advised by Prof. Antonio Torralba and Prof. Yilun Du as part of the MIT Computer Science & Artificial Intelligence Laboratory (CSAIL).
I work at the intersection of Robotics and Machine Learning. I care about full-stack Robot Manipulation. Before joining MIT, I was fortunate to work with Prof. Shuran Song at Stanford University and Prof. Deepak Pathak at Carnegie Mellon University.
G. Scholar Github LinkedIn Twitter
unscramble
Research opportunities [...]
Highlights
News
- Excited to be joining Amazon FAR (Frontier AI & Robotics) in SF as a research intern.
- We will organize the workshop on Diffusion for Robot Learning at RSS 2026.
- Vision in Action was accepted to CoRL 2025 — see you in Seoul!
- Co-organized the workshop on Mobile Manipulation at RSS 2025.
- Wrapped up a wonderful visit at REAL at Stanford University. Thank you, Shuran!
- Our Door Opening Project was highlighted in Nature AI & robotics briefing and "Images of the Month" of Nature.
- Our Door Opening Project was featured by New Scientist.
- RoboTube was selected as an Oral Presentation (6.5%) at CoRL 2022
Blog
- Simple Mobile: A tutorial for setting up a mobile bimanual robot for research with minimal effort.
Research
RAX: Scaling Online Exploration for Robot Agents
Runhan Huang*, Xiangcheng Zhang*, Haoyu Chen, Yitong Li, Yen-Jen Wang, Bohan Lyu, Haoyu Xiong, Yangzhen Wu, Chuye Hong, Haotian Ye, Yixuan Wang, Travis Manderson, Stefano Ermon, Dawn Song, Pieter Abbeel, Qianqian Wang, Antonio Torralba, Weirui Ye, Yilun Du
Webpage
B-spline Policy: Accelerating Manipulation Policies via B-spline Action Representations
Xiaoshen Han*, Haoyu Xiong*, Haonan Chen, Chaoqi Liu, Antonio Torralba, Yuke Zhu, Yilun Du
Webpage
OpenTouch: Bringing Full-Hand Touch to Real-World Interaction
Yuxin Ray Song, Jinzhou Li, Rao Fu, Devin Murphy, Kaichen Zhou, Rishi Shiv, Yaqi Li, Haoyu Xiong, Crystal Elaine Owens, Yilun Du, Yiyue Luo, Xianyi Cheng, Antonio Torralba, Wojciech Matusik, Paul Pu Liang
Webpage
EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World
EgoVerse team
RSS 2026
Webpage
Vision in Action: Learning Active Perception from Human Demonstrations
Haoyu Xiong, Xiaomeng Xu, Jimmy Wu, Yifan Hou, Jeannette Bohg, Shuran Song
CoRL 2025
Webpage
Adaptive Mobile Manipulation for Articulated Objects In the Open World
Haoyu Xiong, Russell Mendonca, Kenny Shaw, Deepak Pathak
Webpage
Bimanual Dexterity for Complex Tasks
Kenneth Shaw, Yulong Li, Jiahui Yang, Mohan Kumar Srirama, Ray Liu, Haoyu Xiong, Russell Mendonca, Deepak Pathak
CoRL 2024
Webpage
SPIN: Simultaneous Perception, Interaction and Navigation
Shagun Uppal, Ananye Agarwal, Haoyu Xiong, Kenneth Shaw, Deepak Pathak
CVPR 2024
Webpage
RoboTube: Learning Household Manipulation from Human Videos with Simulated Twin Environments
Haoyu Xiong, Haoyuan Fu, Jieyi Zhang, Chen Bao, Qiang Zhang, Yongxi Huang, Wenqiang Xu, Animesh Garg, Huazhe Xu, Cewu Lu
CORL 2022 Oral(6.5%)
Webpage
Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos
Haoyu Xiong, Quanzhou Li, Yun-Chun Chen, Homanga Bharadhwaj, Samrath Sinha, Animesh Garg
IROS 2021
RSS 2021 Workshop Spotlight Talk
Website