avatar

Xinyu Zhao

Ph.D. Student
University of North Carolina Chapel Hill
xinyu (at) cs.unc.edu


About Me

Hello! I am Xinyu Zhao, a PhD candidate at UNITES @ UNC CS advised by Prof. Tianlong Chen. My research interests include (A) improving scaling efficiency (via MoE, merging) in LLM and Multimodal LLM, and (B) building trustworthy LLM agent system for general and healthcare application.

News

Publications

    (*: equal contribution. ^: equal supervision )
  1. ICML
    Does AI Reviewer See the Full Picture? Attacking and Defending Multimodal Peer Review
    Xinyu Zhao*, Rana Shahroz*, Zhen Xu, Zhen Tan, Tianlong Chen^
    International Conference on Machine Learning (ICML), 2026.
    BibTex

  2. ACL
    Learning Flexible Large Multimodal Models with Arbitrary Modality Combinations
    Xinyu Zhao*, Kangqi Ni*, Jie Peng, Ang Li, Tianlong Chen^
    Findings of the Association for Computational Linguistics: (ACL), 2026.
    BibTex

  3. ACL
    Demystify the Role of Memory in Machine Learning Engineering Agents
    Xinyu Zhao*, Junpeng Wang, Yuzhong Chen, Menghai Pan,Chin-Chia Michael Yeh, Jiarui Sun, Yan Zheng,Mahashweta Das, Tianlong Chen
    Findings of the Association for Computational Linguistics: (ACL), 2026.
    BibTex

  4. ICCV
    Towards Stabilized and Efficient Diffusion Transformers through Long-Skip-Connections with Spectral Constraints
    Guanjie Chen*, Xinyu Zhao*, Yucheng Zhou, Xiaoye Qu, Tianlong Chen, Yu Cheng
    IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
    PDF BibTex

  5. NAACL
    GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewing
    Jinhao Duan*, Xinyu Zhao*, Zhuoxuan Zhang*, Eunhye Ko, Lily Boddy, Chenan Wang, Tianhao Li, Alexander Rasgon, Junyuan Hong, Min Kyung Lee, Chenxi Yuan, Qi Long, Ying Ding, Tianlong Chen, Kaidi Xu
    Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2025.
    PDF BibTex

  6. AIiH
    SARHAchat: An LLM-Based Chatbot for Sexual and Reproductive Health Counseling
    Jiaye Yang*, Xinyu Zhao*, Tianlong Chen, Kandyce Brennan
    International Conference on Artificial Intelligence in Healthcare (AIiH), 2025.
    PDF BibTex

  7. JAMIA
    SDoH-GPT: Using Large Language Models to Extract Social Determinants of Health
    Bernardo Consoli, Xizhi Wu, Song Wang, Xinyu Zhao, Yanshan Wang, Justin Rousseau, Tom Hartvigsen, Li Shen, Huanmei Wu, Yifan Peng, Qi Long, Tianlong Chen, Ying Ding
    Journal of the American Medical Informatics Association (JAMIA).
    PDF BibTex

  8. NeurIPS
    Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild
    Xinyu Zhao*, Guoheng Sun*, Ruisi Cai*, Yukun Zhou*, Pingzhi Li*, Peihao Wang*, Bowen Tan, Yexiao He, Li Chen, Yi Liang, Beidi Chen, Binhang Yuan, Hongyi Wang^, Ang Li^, Zhangyang Wang^, Tianlong Chen^
    Conference on Neural Information Processing Systems (NeurIPS) Dataset and Benchmark Track, 2024.
    PDF Code BibTex

  9. ICML
    MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts
    Guanjie Chen*, Xinyu Zhao*, Tianlong Chen, Yu Cheng
    International Conference on Machine Learning (ICML), 2024.
    PDF Code BibTex

  10. ICLR
    Sparse MoE with Language Guided Routing for Multilingual Machine Translation
    Xinyu Zhao, Xuxi Chen, Yu Cheng, Tianlong Chen
    International Conference on Learning Representations (ICLR), 2024.
    PDF Code BibTex

Services

Conference Reviewers

Tutorials and Workshops