Haoyu Xiong

Hi! My name is Haoyu Xiong. I am a graduate student researcher (MSR) studying AI and robotics in the Robotics Institute of the School of Computer Science at Carnegie Mellon University. I am fortunate to be advised by prof. Deepak Pathak

Follow me on Twitter !

Email  /  CV  /  Scholar  /  Github  /  Linkedin  / 

profile photo
News

[Mar. 2024] Open-world Mobile Manipulation was highlighted in "Images of the Month" of Nautre alongside other scientific phenomena such as NASA’s space shuttle, solar flare, neon nerve cells.
[Feb. 2024] Open-world Mobile Manipulation was featured by Nautre AI & robotics briefing and New Scientist .
[Dec. 2023] Invited Talk @ Stanford Interactive Perception and Robot Learning Lab on "In Pursuit of Open-World Robotic Agents".
[Dec. 2022] Invited Talk @ Stanford Vision and Learning lab on RoboTube.
[Sep. 2022] Our paper RoboTube has been accepted for an oral presentation for CoRL 2022!
[Aug. 2022] Joined CMU RI as a graduate student.
[Apr. 2022] Invited Talk @ Tsinghua University on Robot Learning from Videos.

Research
Adaptive Mobile Manipulation for Articulated Objects In the Open World
Haoyu Xiong, Russell Mendonca, Kenny Shaw, Deepak Pathak.
Under Review
Robots in the open-ended real world such as homes has been a long-standing challenge. However, in current research, robots are often studied in tabletop lab settings. We provide a full-stack approach for open-world mobile manipulation of everyday tasks.

website
RoboTube: Learning Household Manipulation from Human Videos with Simulated Twin Environments
Haoyu Xiong, Haoyuan Fu, Jieyi Zhang, Chen Bao, Qiang Zhang, Yongxi Huang, Wenqiang Xu, Animesh Garg, Huazhe Xu, Cewu Lu
Dataset, baselines, and simulated twin environments for robot learning from human videos.
RoboTube aims to lower the barrier to robot learning from videos research for beginners while facilitating reproducible research in the community.
🎉 Oral(6.5%) Conference on Robot Learning (CoRL), 2022
robotube.org / paper

Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos
Haoyu Xiong, Quanzhou Li, Yun-Chun Chen, Homanga Bharadhwaj, Samrath Sinha,
Animesh Garg
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
🎉 Spotlight Talk, RSS 2021 Workshop on Visual Learning and Reasoning for Robotics
website / video / pdf / live talk

Professional Service

Reviewer: ICRA 22', 23', RA-L 23', ICLR 24', CVPR 24'


template