Publications

2026

  1. SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
    Xiangyi Li, Yimin Liu, Wenbo Chen, Jianhong Tu, Dawn Song, and others
    2026
    Preprint
    PDF
  2. AgentBeats: Agentifying Agent Assessment for Openness, Standardization, and Reproducibility
    Xiaoyuan Liu, Jianhong Tu, Yuqi Chen, Siyuan Xie, Sihan Ren, Tianneng Shi, Gal Gantar, Evan Sandoval, Donghyun Lee, Daniel Miao, Peter J. Gilbert, Nick Hynes, Mauro Staver, Warren He, David Marn, Andrew Low, Xi Zhang, Elron Bandel, Michal Shmueli-Scheuer, Siva Reddy, Alexandre Drouin, Alexandre Lacoste, Ramayya Krishnan, Elham Tabassi, Yu Su, Victor Barres, Chenguang Wang, Wenbo Guo, and Dawn Song
    2026
    Preprint
    PDF
  3. Agents’ Last Exam
    Yiyou Sun, Xinyang Han, Weichen Zhang, Jianhong Tu, Dawn Song, and others
    2026
    Preprint
    PDF
  4. FaultLoc: Evaluating Coding Agents for Fault Localization
    Jianhong Tu, Shubham Gaur, Rathik Murtinty, Zhun Wang, Tianneng Shi, Dawn Song, and Chenguang Wang
    In Second Workshop on Agents in the Wild: Safety, Security, and Beyond (AIWILD), ICML, 2026
  5. 2025yuancompmmeval.png
    A Comprehensive Survey of Evaluating Multimodal Foundation Models: Hierarchical Perspective and Extensive Applications
    Ye Yuan, Junyu Luo, Guancheng Wan, Jinsheng Huang, Chengwu Liu, Junwei Yang, Yifang Qin, Zhiping Xiao, Qingqing Long, Meng Xiao, Yiqiao Jin, Jianhong Tu, Yuqi Chen, Wei Ju, Zhongwei Wan, Yusheng Zhao, Xiao Luo, Yiwei Fu, Yizhou Sun, Wei Wang, Chenguang Wang, and Ming Zhang
    2026
    Under review at ARR 2026
    PDF
  6. CyberCycle: A Scalable Real-World Benchmark for AI Agents’ End-to-End Cybersecurity Capabilities
    Tianneng Shi, Robin Rheem, Dongwei Jiang, Francisco De La Riega, Mona Wang, Zhun Wang, Jingzhi Jiang, Alexander Cheung, Sean Tai, Jonah Cha, Jianhong Tu, Gabriel Han, Chenguang Wang, Wenbo Guo, Jingxuan He, and Dawn Song
    In Proceedings of the International Conference on Machine Learning, 2026
  7. FICO: Evaluating Vision-Language Models under Visual Fidelity and Compression at Scale
    Jianhong Tu, Kyle Montgomery, Nicholas Crispino, Chenguang Wang, and Dawn Song
    In Proceedings of the Annual Meeting of the Association for Computational Linguistics, 2026

2025

  1. 2025jianhongmlan.png
    MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Models
    Jianhong Tu, Zhuohao Ni, Nicholas Crispino, Zihao Yu, Michael Bendersky, Beliz Gunel, Ruoxi Jia, Xin Liu, Lingjuan Lyu, Dawn Song, and Chenguang Wang
    In Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM), Aug 2025
    PDF
  2. 2025kylecontextscaling.png
    Predicting Task Performance with Context-aware Scaling Laws
    Kyle Montgomery, David Park, Jianhong Tu, Michael Bendersky, Beliz Gunel, Dawn Song, and Chenguang Wang
    In Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM), Aug 2025
    PDF

2024

  1. 2024hengentau.jpg
    ⭐ Failure in a population: Tauopathy disrupts homeostatic set-points in emergent dynamics despite stability in the constituent neurons
    James N. McGregor, Clayton A. Farris, Sahara Ensley, Aidan Schneider, Leandro J. Fosque, Chao Wang, Elizabeth I. Tilden, Yuqi Liu, Jianhong Tu, Halla Elmore, Keenan D. Ronayne, Ralf Wessel, Eva L. Dyer, Kiran Bhaskaran-Nair, David M. Holtzman, and Keith B. Hengen
    Neuron, Aug 2024
    Cover Paper