Hi, I am Dongping Chen (陈东平), a final-year undergraduate at HUST.

At present, I have the privilege of being a visiting student to University of Washington, where I work with Professors Ranjay Krishna and Senior PhD Jieyu Zhang. Prior to this, my academic journey has also been enriched by a collaboration with Lichao Sun at Lehigh University and Yao Wan, Pan Zhou at HUST. I am also leading an undergrad research lab at HUST, and very lucky to have the opportunity to work with my labmates.

My research interests are deeply rooted in the latest advancements in multimodal perception, LLM-based Agents and Trustworthy AI.

💡 Research Interest

• Multimodal Perception: T2I/T2V models, multimodal large language model (MLLM), etc.
• LLM-based Agents: tool usage, efficiency and utility.
• Trustworthy AI: safety, truthfulness, fairness, etc.

🔥 News

• 2024.10:  🎉🎉 Four papers have been accepted by NeurIPSW 2024!
• 2024.08:  🎉🎉 HonestLLM has been accepted by NeurIPS 2024!
• 2024.08:  🥳🥳 I start my intern with Senior PhD. Jieyu and Prof. Ranjay Krishna in University of Washington.
• 2024.06:  🎉🎉 Self-Cognition has been accepted by ICMLW 2024! Congratulations to Jiawen.
• 2024.06:  🥳🥳 Our MLLM-as-a-Judge is selected as ICML 2024 Oral!
• 2024.05:  🎉🎉 AVLLM has been accepted by ACL 2024 Findings! Congratulations to Huichi.
• 2024.05:  🎉🎉 MLLM-as-a-Judge has been accepted by ICML 2024! Congratulations to Ruoxi, Shilin, Yaochen, Yinuo, Huichi, Qihui!
• 2024.03:  🎉🎉 LLM-as-a-Coauthor has been accepted by NAACL 2024 Findings! Congratulations to Qihui, Chujie and Yue!

📝 Publications

• indicates equal contribution. † indicates corresponding author.

NeurIPS 2024

The Best of Both Worlds: Toward an Honest and Helpful Large Language Model [PDF] [Github] [Website]

Chujie Gao *, Siyuan Wu *, Yue Huang *, Dongping Chen *, Qihui Zhang *, Zhengyan Fu, Yao Wan†, Xiangliang Zhang, Lichao Sun

ICML 2024 Oral

MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark [PDF] [Github] [Website]

Dongping Chen *, Ruoxi Chen *, Shilin Zhang *, Yinuo Liu *, Yaochen Wang *, Huichi Zhou *, Qihui Zhang *, Yao Wan†, Pan Zhou†, Lichao Sun

NAACL 2024 Findings

LLM-as-a-Coauthor: The Challenges of Detecting LLM-Human Mixcase [PDF] [Github] [Website]

Qihui Zhang *, Chujie Gao *, Dongping Chen *, Yue Huang, Yixin Huang, Zhenyang Sun, Shilin Zhang, Weiye Li, Zhengyan Fu, Yao Wan, Lichao Sun†

• Evaluating the Validity of Word-level Adversarial Attacks with Large Language Models Huichi Zhou *, Zhaoyang Wang *, Hongtao Wang†, Dongping Chen, Wenhan Mu, Fangyuan Zhang
• Self-Cognition in Large Language Models: An Exploratory Study Dongping Chen *, Jiawen Shi *, Yao Wan†, Pan Zhou†, Neil Zhenqiang Gong, Lichao Sun
• UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models Yue Huang *, Siyuan Wu *, Chujie Gao, Dongping Chen, Qihui Zhang, Yao Wan†, Tianyi Zhou, Xiangliang Zhang, Jianfeng Gao, Chaowei Xiao, Lichao Sun
• The Impact of Large Language Models in Academia: from Writing to Speaking Mingmeng Geng, Caixi Chen, Yanru Wu, Dongping Chen, Yao Wan, Pan Zhou, Roberto Trotta
• Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge Jiayi Ye *, Yanbo Wang *, Yue Huang *, Dongping Chen, Qihui Zhang, Nuno Moniz, Tian Gao, Werner Geyer, Chao Huang, Pin-Yu Chen, Nitesh V Chawla, Xiangliang Zhang†

🍀 In Submission

Preprint

Interleaved Scene Graph for Interleaved Text-and-Image Generation Assessment [PDF] [Github] [Website]

Dongping Chen *, Ruoxi Chen *, Shu Pu *, Zhaoyi Liu *, Yanru Wu *, Caixi Chen *, Benlin Liu, Yue Huang, Yao Wan, Pan Zhou, Ranjay Krishna†

NeurIPSW 2024

GUI-World: A Dataset for GUI-oriented Multimodal LLM-based Agents [PDF] [Github] [Website]

Dongping Chen *, Yue Huang *, Siyuan Wu, Jingyu Tang, Liuyi Chen, Yilin Bai, Zhigang He, Chenlong Wang, Huichi Zhou, Yiqiang Li, Tianshuo Zhou, Yue Yu, Chujie Gao, Qihui Zhang, Yi Gui, Zhen Li, Yao Wan†, Pan Zhou†, Jianfeng Gao, Lichao Sun

• ObscurePrompt: Jailbreaking Large Language Models via Obscure Input Yue Huang *, Jingyu Tang *, Dongping Chen, Bingda Tang, Yao Wan, Lichao Sun, Xiangliang Zhang†

📖 Educations

• 2024.08 - 2025.01 (expected), Visiting Scholar, University of Washington.
• 2021.09 - 2025.06 (expected), BEng., Huazhong University of Science and Technology.

💬 Talks

• 2024.07, Oral Presentation of MLLM-as-a-Judge at ICML 2024. [video]

💻 Services

• 2025, Reviewer for ICLR 2025, ICASSP 2025
• 2024, Reviewer for ICML Workshops 2024, NeurIPS Workshops 2024