Liangyu Chen    陈亮宇

Hi! 👋 I'm Liangyu, pronounced as Lee-ahng-yu. I'm a first-year Computer Science Ph.D. student at Stanford University.

Before Ph.D., I did my undergrad and worked at Nanyang Technological University, advised by Prof. Ziwei Liu. I've also worked with Prof. Alan Yuille and Dr. Zongwei Zhou at Johns Hopkins University.

My research interest lies in scalable and data-efficient machine learning frameworks for multimodal reasoning 🤔. I develop data collection pipelines, representations, and models for interactive or assistive AI systems.

I'm always excited to connect with others who share similar interests or ambitions. Whether you're interested in exploring potential collaborations or just want to chat, I'm all ears! See the link at the bottom to schedule a meeting.

Email  /  Google Scholar  /  Semantic Scholar  /  Github  /  Linkedin

profile photo
Publications

Diversify and Conquer: Diversity-Centric Data Selection with Iterative Refinement
Simon Yu*, Liangyu Chen*, Sara Ahmadian, Marzieh Fadaee
arXiv preprint, 2024


MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations
Yubo Ma*, Yuhang Zang*, Liangyu Chen, Meiqi Chen, Yizhu Jiao, Xinze Li, Xinyuan Lu, Ziyu Liu, Yan Ma, Xiaoyi Dong, Pan Zhang, Liangming Pan, Yu-Gang Jiang, Jiaqi Wang, Yixin Cao, Aixin Sun
Neural Information Processing Systems (NeurIPS) Datasets and Benchmarks Track, 2024 (Spotlight)


MMInA: Benchmarking Multihop Multimodal Internet Agents
Ziniu Zhang*, Shulin Tian*, Liangyu Chen*, Ziwei Liu
arXiv preprint, 2024


Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Taishi Nakamura*, Mayank Mishra*, Simone Tedeschi*, ..., Liangyu Chen, ..., Matthew Blumberg, Victor May, Huu Nguyen, Sampo Pyysalo (49 authors)
arXiv preprint, 2024


Benchmarking and Analyzing Generative Data for Visual Recognition
Bo Li, Haotian Liu, Liangyu Chen, Yong Jae Lee, Chunyuan Li, Ziwei Liu
arXiv preprint, 2023


MIMIC-IT: Multi-Modal In-Context Instruction Tuning
Bo Li*, Yuanhan Zhang*, Liangyu Chen*, Jinghao Wang*, Fanyi Pu*, Jingkang Yang, Chunyuan Li, Ziwei Liu
arXiv preprint, 2023


Otter: A Multi-Modal Model with In-Context Instruction Tuning
Bo Li*, Yuanhan Zhang*, Liangyu Chen*, Jinghao Wang*, Jingkang Yang, Ziwei Liu
arXiv preprint, 2023


Large Language Models are Visual Reasoning Coordinators
Liangyu Chen*, Bo Li*, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu
Neural Information Processing Systems (NeurIPS), 2023
ICLR Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023


Panoptic Video Scene Graph Generation
Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Wayne Zhang, Kaiyang Zhou, Chen Change Loy, Ziwei Liu
Computer Vision and Pattern Recognition (CVPR), 2023


Making Your First Choice: To Address Cold Start Problem in Vision Active Learning
Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, Zongwei Zhou
Medical Imaging with Deep Learning (MIDL), 2023
NeurIPS Workshop on Human in the Loop Learning, 2022


Automatic Calcification Morphology and Distribution Classification for Breast Mammograms with Multi-task Graph Convolutional Neural Network
Hao Du, Melissa Min-Szu Yao, Siqi Liu, Liangyu Chen, Wing P. Chan, Mengling Feng
Journal of Biomedical and Health Informatics (JBHI), 2023


Baconian: A Unified Open-source Framework for Model-Based Reinforcement Learning
Linsen Dong, Guanyu Gao, Xinyi Zhang, Liangyu Chen, Yonggang Wen
arXiv preprint, 2020


Service
  • Reviewer for The Visual Computer, IET Computer Vision, IJCV, TMLR, NeurIPS 2023, ICLR 2025, AAAI 2025, ECCV 2024, CVPR 2024, ICCV CVAMD 2023, CVPR CVinW 2023, ICML IMLH 2023/22, NeurIPS GenAI4Health 2024.


  • I host virtual office hours for anyone who wants to share thoughts on CV/ML research, reading (either scientific or not), or any other topics of interest. Please schedule via my calendar.


    Last update: May 2024      Template