Leon Liangyu Chen

Hi! 👋 I'm Leon, a first-year Computer Science Ph.D. student at Stanford University.

Before Ph.D., I did my undergrad and worked at Nanyang Technological University, advised by Prof. Ziwei Liu. I've also worked with Prof. Alan Yuille and Dr. Zongwei Zhou at Johns Hopkins University.

My research interests are scalable and data-efficient machine learning frameworks for multimodal reasoning 🤔. I develop data collection pipelines, data mixtures, and models for interactive or assistive AI systems.

I'm always excited to connect with others who share similar interests or ambitions. Whether you're interested in exploring potential collaborations or just want to chat, I'm all ears! See the link at the bottom to schedule a meeting.

Email / Google Scholar / Semantic Scholar / Github / Linkedin

Follow @cliangyu_

Publications (Selected Publications)

	Open Thoughts Open Thoughts Team Code / Datasets / Blog / Bibtex
	BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature Alejandro Lozano, Min Woo Sun, James Burgess, Liangyu Chen, Jeffrey J Nirschl, Jeffrey Gu, Ivan Lopez, Josiah Aklilu, Austin Wolfgang Katzer, Collin Chiu, Anita Rau, Xiaohan Wang, Yuhui Zhang, Alfred Seunghoon Song, Robert Tibshirani, Serena Yeung-Levy Computer Vision and Pattern Recognition (CVPR)*, 2025 Paper / Code / Bibtex
	Diversify and Conquer: Diversity-Centric Data Selection with Iterative Refinement Simon Yu, Liangyu Chen, Sara Ahmadian, Marzieh Fadaee arXiv preprint, 2024 Paper / Code / Bibtex
	MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations Yubo Ma, Yuhang Zang, Liangyu Chen, Meiqi Chen, Yizhu Jiao, Xinze Li, Xinyuan Lu, Ziyu Liu, Yan Ma, Xiaoyi Dong, Pan Zhang, Liangming Pan, Yu-Gang Jiang, Jiaqi Wang, Yixin Cao, Aixin Sun Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2024 (Spotlight) Paper / Project Page / Code / Bibtex
	MMInA: Benchmarking Multihop Multimodal Internet Agents Ziniu Zhang, Shulin Tian, Liangyu Chen, Ziwei Liu Association for Computational Linguistics (ACL) Findings*, 2025 Paper / Project Page / Dataset / Code / Demo / Bibtex
	Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order Taishi Nakamura, Mayank Mishra, Simone Tedeschi, ..., Liangyu Chen, ..., Matthew Blumberg, Victor May, Huu Nguyen, Sampo Pyysalo (49 authors) International Conference on Computational Linguistics (COLING) Industry Track*, 2025 Paper / Model / Bibtex
	Benchmarking and Analyzing Generative Data for Visual Recognition Bo Li, Haotian Liu, Liangyu Chen, Yong Jae Lee, Chunyuan Li, Ziwei Liu IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025 Paper / Code / Bibtex
	MIMIC-IT: Multi-Modal In-Context Instruction Tuning Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Fanyi Pu, Jingkang Yang, Chunyuan Li, Ziwei Liu IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)*, 2025 Paper / Project Page / Dataset / Code / Demo / Bibtex
	Otter: A Multi-Modal Model with In-Context Instruction Tuning Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Jingkang Yang, Ziwei Liu arXiv preprint, 2023 Paper / Code / Demo / Bibtex
	Large Language Models are Visual Reasoning Coordinators Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu Neural Information Processing Systems (NeurIPS), 2023 ICLR Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023 Paper / Code / Talk (English) / Talk (中文) / Bibtex
	Panoptic Video Scene Graph Generation Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Wayne Zhang, Kaiyang Zhou, Chen Change Loy, Ziwei Liu Computer Vision and Pattern Recognition (CVPR), 2023 Paper / Bibtex
	Making Your First Choice: To Address Cold Start Problem in Vision Active Learning Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, Zongwei Zhou Medical Imaging with Deep Learning (MIDL), 2023 Radiological Society of North America (RSNA), Abstracts, 2024 NeurIPS Workshop on Human in the Loop Learning, 2022 Paper / Code / Poster / Slides / Talk (English) / Talk (中文) / Bibtex
	Automatic Calcification Morphology and Distribution Classification for Breast Mammograms with Multi-task Graph Convolutional Neural Network Hao Du, Melissa Min-Szu Yao, Siqi Liu, Liangyu Chen, Wing P. Chan, Mengling Feng Journal of Biomedical and Health Informatics (JBHI), 2023 Paper / Bibtex
	Baconian: A Unified Open-source Framework for Model-Based Reinforcement Learning Linsen Dong, Guanyu Gao, Xinyi Zhang, Liangyu Chen, Yonggang Wen arXiv preprint, 2020 Paper / Code / Docs / Demo / Bibtex

Service

Reviewer for The Visual Computer, IET Computer Vision, IJCV, TMLR, NeurIPS 2025/23, ICLR 2025, COLM 2025, AAAI 2025, ECCV 2024, CVPR 2024, MLHC 2025, ICCV CVAMD 2023, CVPR CVinW 2023, ICML IMLH 2023/22, NeurIPS GenAI4Health 2024.

I host virtual office hours for anyone who wants to share thoughts on CV/ML research, reading (either scientific or not), or any other topics of interest. Please schedule via my calendar.

Last update: Oct 2024 Template