Liangyu Chen

Liangyu Chen 陈亮宇

Hi! 👋 I'm Liangyu, pronounced as Lee-ahng-yu. I work at MMLab, Nanyang Technological University, as a research engineer advised by Prof. Ziwei Liu. I've also worked with Prof. Alan Yuille and Dr. Zongwei Zhou at Johns Hopkins University.

My research interest lies in scalable and data-efficient machine learning frameworks for multimodal reasoning 🤔. I develop data collection pipelines, representations, and models for interactive or assistive AI systems.

I'm always excited to connect with others who share similar interests or ambitions. Whether you're interested in exploring potential collaborations or just want to chat, I'm all ears! See the link at the bottom to schedule a meeting.

I am starting in Fall as a computer science PhD student at Stanford.

Email / Google Scholar / Semantic Scholar / Github / Linkedin

Follow @cliangyu_

Publications

	MMInA: Benchmarking Multihop Multimodal Internet Agents Ziniu Zhang, Shulin Tian, Liangyu Chen, Ziwei Liu arXiv preprint*, 2024 Paper / Project Page / Dataset / Code / Demo / Bibtex
	Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order Taishi Nakamura, Mayank Mishra, Simone Tedeschi, ..., Liangyu Chen, ..., Matthew Blumberg, Victor May, Huu Nguyen, Sampo Pyysalo (49 authors) arXiv preprint*, 2024 Paper / Model / Bibtex
	Benchmarking and Analyzing Generative Data for Visual Recognition Bo Li, Haotian Liu, Liangyu Chen, Yong Jae Lee, Chunyuan Li, Ziwei Liu arXiv preprint, 2023 Paper / Code / Bibtex
	MIMIC-IT: Multi-Modal In-Context Instruction Tuning Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Fanyi Pu, Jingkang Yang, Chunyuan Li, Ziwei Liu arXiv preprint*, 2023 Paper / Project Page / Dataset / Code / Demo / Bibtex
	Otter: A Multi-Modal Model with In-Context Instruction Tuning Bo Li, Yuanhan Zhang, Liangyu Chen, Jinghao Wang, Jingkang Yang, Ziwei Liu arXiv preprint, 2023 Paper / Code / Demo / Bibtex
	Large Language Models are Visual Reasoning Coordinators Liangyu Chen, Bo Li, Sheng Shen, Jingkang Yang, Chunyuan Li, Kurt Keutzer, Trevor Darrell, Ziwei Liu Neural Information Processing Systems (NeurIPS), 2023 ICLR Workshop on Mathematical and Empirical Understanding of Foundation Models, 2023 Paper / Code / Talk (English) / Talk (中文) / Bibtex
	Panoptic Video Scene Graph Generation Jingkang Yang, Wenxuan Peng, Xiangtai Li, Zujin Guo, Liangyu Chen, Bo Li, Zheng Ma, Wayne Zhang, Kaiyang Zhou, Chen Change Loy, Ziwei Liu Computer Vision and Pattern Recognition (CVPR), 2023 Paper / Bibtex
	Making Your First Choice: To Address Cold Start Problem in Vision Active Learning Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, Zongwei Zhou Medical Imaging with Deep Learning (MIDL), 2023 NeurIPS Workshop on Human in the Loop Learning, 2022 Paper / Code / Poster / Slides / Talk (English) / Talk (中文) / Bibtex
	Automatic Calcification Morphology and Distribution Classification for Breast Mammograms with Multi-task Graph Convolutional Neural Network Hao Du, Melissa Min-Szu Yao, Siqi Liu, Liangyu Chen, Wing P. Chan, Mengling Feng Journal of Biomedical and Health Informatics (JBHI), 2023 Paper / Bibtex
	Baconian: A Unified Open-source Framework for Model-Based Reinforcement Learning Linsen Dong, Guanyu Gao, Xinyi Zhang, Liangyu Chen, Yonggang Wen arXiv preprint, 2020 Paper / Code / Docs / Demo / Bibtex

Service

Reviewer for The Visual Computer, IET Computer Vision, NeurIPS 2023, ECCV 2024, CVPR 2024, ICCV CVAMD 2023, CVPR CVinW 2023, ICML IMLH 2023/22.

I host virtual office hours for anyone who wants to share thoughts on CV/ML research, reading (either scientific or not), or any other topics of interest. Please schedule via my calendar.

Last update: May 2024 Template