DexBeyond: Scaling Dexterous Manipulation Through Iterative Hand-Object Interaction Generation
2026 · arXiv submission pending moderation
Embodied intelligence · Computer vision
Yi Zuo 左谊
I research embodied intelligence and computer vision, including dexterous manipulation, image and video editing, and video generation.
I am a second-year PhD student in the “Tong Program” (通计划), on a combined master’s–PhD track jointly hosted by Xidian University’s Key Laboratory of Intelligent Perception and Image Understanding, Ministry of Education (IPIU Lab), and the Beijing Institute for General Artificial Intelligence (BIGAI). I expect to graduate in December 2028.
At Xidian, I am supervised by Prof. Licheng Jiao and Prof. Fang Liu. My collaborating advisors at BIGAI are Qing Li and Baoxiong Jia.
Publications
2023–2026
Edit-Your-Interest: Efficient Video Editing via Feature Most-Similar Propagation
Pattern Recognition, 2026
Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editing
IEEE Transactions on Multimedia, 2026
Robust Instance-based Semi-supervised Learning Change Detection for Remote Sensing Image
IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2024
The Robust Semantic Segmentation UNCV2023 Challenge Results
ICCV Workshops, 2023 · pp. 4618–4628
Education
2025 — 2028
Xidian University & BIGAI
PhD in Computer Science and Technology · Joint training, Tong Program
Supervisors: Prof. Fang Liu and Baoxiong Jia
March 2025 – December 2028 (expected)
2022 — 2025
Xidian University
Master’s studies in Computer Science and Technology · School of Artificial Intelligence
Supervisor: Prof. Licheng Jiao
September 2022 – June 2025
2018 — 2022
Xidian University
Bachelor’s degree in Management · Electronic Commerce, School of Economics and Management
September 2018 – June 2022
Projects
Embodied intelligence & vision
2026 World Humanoid Robot Games
Dexterous manipulation: nail fastening and precision powder weighing.
Result: Advanced to the finals.
Task details & my contributions
- Nail fastening: Control the robot to pick up a nail, insert it into a wooden block, and use a hammer to drive it fully into the wood.
- Powder weighing: Pick up a spoon and transfer powder from a bowl into a container on an electronic scale, keeping spillage at or below 1 g and the powder in the container within 19.5–20.5 g.
My contributions: Algorithm design, testing, and deployment for both nail fastening and powder weighing.
Finals: A robotic hand malfunction occurred during the finals.
Silk Road Journey （文旅资源修复与生成·丝路逸旅）
AI for mural restoration and cultural digital asset generation.
Shaanxi “AI+” Key Product ↗ · CCTV · 开门大吉 ↗
Project details & my contributions
A cultural heritage and tourism platform supporting mural damage detection and intelligent restoration, cultural and tourism knowledge Q&A and smart guided tours, artifact line drawings and professional drafting, and cultural digital asset generation.
My contributions: Intelligent restoration and completion of damaged murals, along with character motion transfer and generation.
CareNurse at SenseTime
2021 SenseTime Future Star Award · Only 20 recipients each year.
Contactless health monitoring and intelligent assistive care.
Project details & my contributions
Helped build an intelligent nursing system for patients with limited mobility or speech. The system supports contactless monitoring of physiological indicators, abnormality alerts, expression-based calls for help, and remote care.
My contributions: Built the project architecture and integrated physiological monitoring, anomaly detection, and face recognition algorithms; contributed to data collection, customer-specific features, deployment, and maintenance.
Project lead · 2022–2023
Eye-controlled intelligent wheelchair
An assistive wheelchair combining gaze-based control with LiDAR-based indoor autonomous navigation. Eye movements also let users select voice messages and music.
My contributions
Led the technical roadmap and third-generation upgrade, added autonomous navigation, and migrated the control software from C# to Python on Ubuntu.
Drone team deputy lead · Visual algorithms
RoboMaster
A student robotics project involving autonomous visual recognition, ground-target detection, and multi-sensor localization for competition drones.
My contributions
Developed the visual algorithms and drone technical roadmap, connected perception with electronic control, and coordinated team planning and project milestones.
Books
Intelligent Robotics （智能机器人导论）
My contribution: Wrote the chapter “Autonomous Intelligent Vehicles” (自动驾驶智能汽车).
Awards & service
- 2024National Scholarship, Ministry of Education of China.
- 2023First place, ICCV MUAD Semantic Segmentation Challenge and YouTube-VOS Challenge, Track 1.
- 2023Runner-up, CVPR UG²+ Challenge and EPIC-Kitchens Hand-Object Segmentation and Semi-Supervised Video Object Segmentation tracks.
- 2022First place, ECCV AIM Instagram Filter Removal Challenge.
- 2021SenseTime Future Star Award.
All awards, scholarships & service
Scholarships
- Nov 2024：National Scholarship, the Chinese Ministry of Education.
- Nov 2023：First-class Scholarship, Xidian University.
- Nov 2023：Langchao Scholarship, Xidian University.
- Sep 2022：Freshman First-class Scholarship, Xidian University.
- January 2021：National Encouragement Scholarship of China Ministry of Education.
- Sep 2020：First-class Scholarship, Xidian University.
- Sep 2020：National Inspiration Scholarship, Xidian University.
- Sep 2020：Xiaomi Scholarship, Xidian University.
- June 2020：Qian Yonggui Scholarship of Xidian University - Science and Technology Talents.
- Sep 2019：Third-class Scholarship, Xidian University.
Competitions
First place
- ICCV2023 MUAD Uncertainty Estimation for Semantic Segmentation Challenge.
- ECCV2022 AIM 2022 Challenge on Instagram Filter Removal.
- ICCV2023 The 5th Large-scale Video Object Segmentation Challenge - Track 1: Video Object Segmentation.
- 2020 Artificial Intelligence Creative Competition of China University Computer Competition (C4-AI)
Second place
- The 7th China International “Internet+” Innovation and Entrepreneurship Competition for University Students.
- ROBOMASTER 2020 Robot Master Challenge of the National College Robot Competition.
- CVPR2023 6th UG2+ Challenge Runner-Up.
- CVPR2023 EPIC-Kitchens Dataset Challenges Hand-Object Segmentation Track.
- CVPR2023 EPIC-Kitchens Dataset Challenges Semi-Supervised Video Object Segmentation.
Third place
- CVPR2023 OmniLabel Challenge 2023 Tracks B.
- CVPR2023 OmniLabel Challenge 2023 Tracks A.
- CVPR2022 THE Visual Inductive Priors for Data-Efficient Computer Vision 2022 Image Classification Challenge.
Other awards
- Nov 2021：Second Prize of China International "Internet plus" Undergraduate Innovation and Entrepreneurship Competition.
- Sep 2021：First Prize of Shaanxi Province in China International "Internet plus" Undergraduate Innovation and Entrepreneurship Competition.
- Apr 2021：Mathematical Modeling Thesis for American College Students, Finalist Award.
- Dec 2020: National College Student Data Modeling Competition, First Prize in Shaanxi Province.
- Sep 2020：Third Prize in the CESIM Rush Hour National Business Simulation Competition.
- May 2019：Second Prize in Northwest Division of China University Computer Design Competition.
Honors
- June 2020：Science and Technology Talents of Xidian University.
- Jan 2022：The SenseTime Future Star Award of 2021 Year.
Services
- From June 2022: Class monitor, master’s cohort at the School of Artificial Intelligence.
- June 2019 - Sep 2020：Director of the Learning Department of the Student Union in Xidian University.
- June 2019 - Sep 2020：Vice Minister of the Activities Department of the Science and Technology Association in Xidian University.
- May 2019 - June 2020: The production team leader of Xidian's official WeChat tweet.