Liangyu Chen    陈亮宇

Hi! 👋 I'm Liangyu, pronounced as Lee-ahng-yu. I work at MMLab, Nanyang Technological University, as a research engineer advised by Prof. Ziwei Liu. I've also worked with Prof. Alan Yuille and Dr. Zongwei Zhou at Johns Hopkins University.

My research interest lies in scalable and data-efficient machine learning frameworks for multimodal reasoning 🤔. I develop data collection pipelines, representations, and models for interactive or assistive AI systems.

I'm always excited to connect with others who share similar interests or ambitions. Whether you're interested in exploring potential collaborations or just want to chat, I'm all ears! See the link at the bottom to schedule a meeting.

I am starting in Fall as a computer science PhD student at Stanford.

Email  /  Google Scholar  /  Semantic Scholar  /  Github  /  Linkedin

profile photo

MMInA: Benchmarking Multihop Multimodal Internet Agents
Ziniu Zhang*, Shulin Tian*, Liangyu Chen*, Ziwei Liu
arXiv preprint, 2024

Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order
Taishi Nakamura*, Mayank Mishra*, Simone Tedeschi*, ..., Liangyu Chen, ..., Matthew Blumberg, Victor May, Huu Nguyen, Sampo Pyysalo (49 authors)
arXiv preprint, 2024

Benchmarking and Analyzing Generative Data for Visual Recognition
Bo Li, Haotian Liu, Liangyu Chen, Yong Jae Lee, Chunyuan Li, Ziwei Liu
arXiv preprint, 2023

MIMIC-IT: Multi-Modal In-Context Instruction Tuning
Bo Li*, Yuanhan Zhang*, Liangyu Chen*, Jinghao Wang*, Fanyi Pu*, Jingkang Yang, Chunyuan Li, Ziwei Liu
arXiv preprint, 2023

Otter: A Multi-Modal Model with In-Context Instruction Tuning
Bo Li*, Yuanhan Zhang*, Liangyu Chen*, Jinghao Wang*, Jingkang Yang, Ziwei Liu
arXiv preprint, 2023

Large Language Models are Visual Reasoning Coordinators
Liangyu Chen*, Bo Li*, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu
Neural Information Processing Systems (NeurIPS), 2023
ICLR Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023

Panoptic Video Scene Graph Generation
Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Wayne Zhang, Kaiyang Zhou, Chen Change Loy, Ziwei Liu
Computer Vision and Pattern Recognition (CVPR), 2023

Making Your First Choice: To Address Cold Start Problem in Vision Active Learning
Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, Zongwei Zhou
Medical Imaging with Deep Learning (MIDL), 2023
NeurIPS Workshop on Human in the Loop Learning, 2022

Automatic Calcification Morphology and Distribution Classification for Breast Mammograms with Multi-task Graph Convolutional Neural Network
Hao Du, Melissa Min-Szu Yao, Siqi Liu, Liangyu Chen, Wing P. Chan, Mengling Feng
Journal of Biomedical and Health Informatics (JBHI), 2023

Baconian: A Unified Open-source Framework for Model-Based Reinforcement Learning
Linsen Dong, Guanyu Gao, Xinyi Zhang, Liangyu Chen, Yonggang Wen
arXiv preprint, 2020

  • Reviewer for The Visual Computer, IET Computer Vision, NeurIPS 2023, ECCV 2024, CVPR 2024, ICCV CVAMD 2023, CVPR CVinW 2023, ICML IMLH 2023/22.

  • I host virtual office hours for anyone who wants to share thoughts on CV/ML research, reading (either scientific or not), or any other topics of interest. Please schedule via my calendar.

    Last update: May 2024      Template