Junyi Zhang

Junyi Zhang 章俊一

Hi! I am a first-year CS PhD student at UC Berkeley, advised by Prof. Trevor Darrell. Currently, I also work with Dr. Deqing Sun, Dr. Varun Jampani, and Prof. Ming-Hsuan Yang. I obtained my B.Eng. (Honors) degree in Computer Science from Shanghai Jiao Tong University (SJTU), where I worked with Prof. Yong-Lu Li as an undergraduate researcher, supervised by Prof. Cewu Lu. Previously, I was a research intern at Microsoft Research Asia (MSRA), mentored by Dr. Shizhao Sun and Dr. Jian-Guang Lou.

My research interests mainly lie in computer vision, deep generative models, and representation learning.

Email / CV / Google Scholar / Twitter / Github

News

[2024.10] Very excited to share our latest work, Monst3r, check out the interactive 4D results 🔥!
[2024.06] I graduated from SJTU with Honor Degree, Outstanding Graduates of Shanghai, and Best Bachelor Thesis! 🥳
[2024.03] Code for Telling Left from Right is released on GitHub.
[2024.02] 🎉 Our work Telling Left from Right is accepted by CVPR 2024! 🎉
[2023.11] Our work Telling Left from Right is on arXiv!
[2023.09] 🎉 Our work A Tale of Two Features is accepted to NeurIPS 2023! 🎉
[2023.08] Code for LayoutDiffusion is released on GitHub.
[2023.07] 🎉 Our work LayoutDiffusion is accepted to ICCV 2023! 🎉
[2023.06] Code for A Tale of Two Features is released on GitHub.
[2023.05] Our work A Tale of Two Features is on arXiv!
[2023.04] Our work Pangea is on arXiv!
[2023.03] Our work LayoutDiffusion is on arXiv!

Publications

	MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion Junyi Zhang, Charles Herrmann+, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun, Ming-Hsuan Yang Under review, 2024 code / project page / arXiv
	Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence Junyi Zhang, Charles Herrmann, Junhwa Hur, Eric Chen, Varun Jampani, Deqing Sun, Ming-Hsuan Yang CVPR, 2024 code / project page / arXiv / poster
	From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding Yong-Lu Li, Xiaoqian Wu, Xinpeng Liu, Zehao Wang, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Xudong Lu, Jingru Tan, Cewu Lu CVPR, 2024 code / project page / arXiv
	A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence Junyi Zhang, Charles Herrmann, Junhwa Hur, Luisa F. Polanía, Varun Jampani, Deqing Sun, Ming-Hsuan Yang NeurIPS, 2023 code / project page / arXiv / poster
	LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models Junyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang ICCV, 2023 code & project page / arXiv / poster
	Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection Xiaoqian Wu, Yong-Lu Li, Xinpeng Liu, Junyi Zhang, Yuzhe Wu, Cewu Lu ECCV, 2022 code / arXiv

Course Projects

	InteractFusion: Synthesizing Interactive Motions with Noise-Decoupled Diffusion Models Junyi Zhang and Hongchi Xia (course report only) Advisor: Dr. Xinpeng Liu and Prof. Yong-Lu Li CS3327: Virtual Reality and Augmented Display SJTU, March 2023 Course Report
	DiffStyle: Leverage Diffusion Prior to One-for-All Style Transfer Junyi Zhang CS3310: Computer Graphics SJTU, Dec. 2022 Github / bilibili (in Chinese)

Experience

	University of California, Merced 2023.06 ~ 2023.10 Merced, CA, USA Visiting student Supervisor: Prof. Ming-Hsuan Yang
	Google Research 2023.03 ~ present Cambridge, MA, USA Remote Collaborator Supervisor: Dr. Deqing Sun, Dr. Varun Jampani, and Prof. Ming-Hsuan Yang
	Microsoft Research Asia 2022.07 ~ 2022.12 Beijing, China Research intern Supervisor: Dr. Shizhao Sun and Dr. Jian-Guang Lou
	Shanghai Jiao Tong University 2020.09 ~ 2024.06 Shanghai, China First year GPA: 3.85 (rank 1/73) Final GPA: 3.92 (rank 8/108) B.Eng. in Computer Science and Technology (Honor), Zhiyuan Honors Program

Honors

Best Bachelor Thesis (top 1%, ranked 1/200+ in CS department), SJTU, 2024

Outstanding Graduates of Shanghai (top 3%), SJTU, 2024

Zhiyuan Outstanding Scholarship (top 5% in honors program), SJTU, 2024

SenseTime Scholarship (30 undergraduate AI researchers nationwide), SenseTime, 2023

Chandler-Chi Family Scholarship (top 5%), SJTU, 2023

Microsoft Research "Stars of Tomorrow" Certificate (top 10% interns), MSRA, 2022

Huawei Fellowship (top 1% in honors program), SJTU, 2022

Fujian Young Talent Merit Scholarship (50 winners in the whole province), Communist Youth League Fujian Committee, 2022

National Scholarship (top 0.2% nationwide), Ministry of Education of the People's Republic of China, 2021

Merit Scholarship, A Level (top 1%), SJTU, 2021

Merit Student Award (top 5%), SJTU, 2021

Zhiyuan Honors Scholarship (top 5%), SJTU, 2021, 2022, 2023

Meritorious Winner (top 7%), ICM, 2021

Misc.

I am a cinephile. My favorite directors include Martin Scorsese, Theodoros Angelopoulos, Leos Carax, Jean-Luc Godard, Paul Thomas Anderson, and many more. You can find a list of some of my favorite films here. I was the VP of the student group '800 Movie Theater' and hosted several salons and weekend theater events. I also write reviews on films, books, and games on Douban.