Yiming Xie 谢一鸣


xie.yim@northeastern.edu
ymxyimingxie@gmail.com
Ph.D. student, Northeastern University
Boston, MA, U.S.
RésuméGoogle Scholar
GitHubTwitter

Latest News

  • [Mar 11, 2024] Awarded the Apple Scholars Fellowship
  • [Jan 15, 2024] one paper accepted to ICLR'24
  • [Jul 13, 2023] one paper accepted to ICCV'23
  • [Mar 2, 2022] one paper accepted to CVPR'22
  • [Jul 22, 2021] one paper accepted to ICCV'21

About Me


I am currently a Ph.D. candidate at Khoury College of Computer Sciences, Northeastern University supervised by Prof. Huaizu Jiang. I received my Bachelor's degree in 2019 from Zhejiang University(ZJU), advised by Prof. Xiaowei Zhou. I am a recipient of the 2024 Apple Scholars in AI/ML PhD fellowship.

Research



SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency
Yiming Xie*, Chun-Han Yao*, Vikram Voleti, Huaizu Jiang^, Varun Jampani^.
(* equal contribution) (^ equal advising)
arXiv, 2024.
[PDF][Code][Website][Huggingface][Blog]


SMooDi: Stylized Motion Diffusion Model
Lei Zhong, Yiming Xie, Varun Jampani, Deqing Sun, Huaizu Jiang.
The European Conference on Computer Vision (ECCV), 2024.
[PDF][Code][Website]


HOI-Diff: Text-Driven Synthesis of 3D Human-Object Interactions using Diffusion Models
Xiaogang Peng*, Yiming Xie*, Zizhao Wu, Varun Jampani, Deqing Sun, Huaizu Jiang. (* equal contribution)
arXiv, 2023.
[PDF][Code][Website]


OmniControl: Control Any Joint at Any Time for Human Motion Generation
Yiming Xie, Varun Jampani, Lei Zhong, Deqing Sun, Huaizu Jiang.
International Conference on Learning Representations (ICLR), 2024.
[PDF][Code][Website]


Pixel-Aligned Recurrent Queries for Multi-View 3D Object Detection
Yiming Xie, Huaizu Jiang, Georgia Gkioxari*, Julian Straub*. (* equal advising)
International Conference on Computer Vision (ICCV), 2023.
[PDF][Code][Website]


PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videos
Yiming Xie, Matheus Gadelha, Fengting Yang, Xiaowei Zhou*, Huaizu Jiang*.
(* equal advising)
Computer Vision and Pattern Recognition (CVPR), 2022.
[PDF][Code][Website]


You Don’t Only Look Once: Constructing Spatial-Temporal Memory for Integrated 3D Object Detection and Tracking
Yiming Xie*, Jiaming Sun*, Siyu Zhang, Linghao Chen, Guofeng Zhang, Hujun Bao, Xiaowei Zhou. (* equal contribution)
International Conference on Computer Vision (ICCV), 2021.
[PDF][Code][Website]


NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video
Yiming Xie*, Jiaming Sun*, Linghao Chen, Hujun Bao, Xiaowei Zhou.
(* equal contribution)
Computer Vision and Pattern Recognition (CVPR), 2021.
Oral Presentation and Best Paper Candidate
[PDF][Code][Website]

Shape Prior Guided Instance Disparity Estimation for 3D Object Detection
Linghao Chen*, Jiaming Sun*, Yiming Xie, Siyu Zhang, Qing Shuai, Qinhong Jiang, Guofeng Zhang, Hujun Bao, Xiaowei Zhou. (* equal contribution)
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.
[PDF][Code]

Stereo 3D Object Detection via Shape Prior GuidedInstance Disparity Estimation
Jiaming Sun*, Linghao Chen*, Yiming Xie, Siyu Zhang, Qinhong Jiang, Xiaowei Zhou, Hujun Bao. (* equal contribution)
Computer Vision and Pattern Recognition (CVPR), 2020.
[PDF][Code]

Experience


3D Team, Stability AI
Part-Time Research Intern
Feb. 2024 - Aug. 2024
Work with Varun Jampani, Chun-Han Yao, Vikram Voleti


Reality Labs Research, Meta
Research Scientist Intern & Part-Time Student Researcher
May 2022 - Dec. 2022
Work with Julian Straub, Georgia Gkioxari, Minh Phuoc Vo


3D Vision Group, Zhejiang University
Research Assistant
Mar. 2021 - Aug. 2021
Work with Xiaowei Zhou


3D&AR Group, SenseTime
Research Intern
Nov. 2018 - Feb. 2021
Work with Jiaming Sun

Talks & Presentations


  • [08/2024] SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency.
      @ GAMES
  • [08/2024] SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency.
      @ BAAI
  • [08/2021] NeuralRecon: Real-Time 3D Reconstruction from Monocular Video.
      @ CSIG-3DV
  • [04/2021] Real-Time 3D Reconstruction from Monocular Video.
      @ AI Time
  • [06/2020] PatchMatch in Multi-View Stereo.
      @ ZJU-3DV Group

Teaching Assistant


  • [Spring 2022/2023] CS 7150: Deep Learning