Yuntao Du

杜云涛

Associate Researcher

Joint SDU-NTU Centre for Artificial Intelligence Research & School of Software
Shandong University
Jinan, China

Email: yuntaodu@sdu.edu.cn


About

Currently, I am working as an Associate Researcher in the Joint SDU-NTU Centre for Artificial Intelligence Research at Shandong University. Before that, I was a research scientist at the Beijing Institute for General Artificial Intelligence (BIGAI) from 2023~2025. I got a Ph.D degree from Nanjing University in June 2023. I was a member of IIP Group, led by professor Chongjun Wang. Before that, I received my B.Sc. degree from Northeastern University in June 2018.

I have published more than thirty papers in top conferences and journals, including ICML, NeurIPS, ICLR, CVPR, ECCV, and TMLR. Google Scholar total citation number is 800, and one paper is selected as "paper digest most influential papers" in CIKM 2021.

I am working on multimodal understanding, reasoning, and new knowledge learning. In particular, I'm interested in building models/agents that can generalize well and learn continously in various reasoning and multimodal tasks. Some of my research topic could be found below:

I am looking for self-motivated undergraduate and graduate student, If instreted, you are welcome contact me.

I am open to collerate with the field of academia and industry, If instreted, you are welcome contact me.

News

Preprint

  • RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solving. [PDF]

    Huacan Wang, Ziyi Ni, Shuo Zhang, Shuo Lu, Sen Hu, Ziyang He, Chen Hu, Jiaye Lin, Yifu Guo, Yuntao Du📧, Pin Ly📧

  • Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models. [PDF]

    Yifan Jia*, Kailin Jiang*, Yuyang Liang, Qihan Ren, Yi Xin, Rui Yang, Fenze Feng, Mingcai Chen, Hengyang Lu, Haozhe Wang, Xiaoye Qu, Dongrui Liu, Lizhen Cui, Yuntao Du📧

  • When Large Multimodal Models Confront Evolving Knowledge: Challenges and Pathways. [PDF]

    Kailin Jiang*, Yuntao Du*, Yukai Ding, Yuchen Ren, Ning Jiang, Zhi Gao, Zilong Zheng, Lei Liu, Bin Li, Qing Li.

  • Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey. [PDF]

    Yi Xin, Siqi Luo, Haodi Zhou, Junlong Du, Xiaohong Liu, Yue Fan, Qing Li, Yuntao Du*

Selected Publications

[Google Scholar]

  • Test-Time Selective Adaptation for Uni-Modal Distribution Shift in Multi-Modal Data. [PDF]

    MingCai Chen, Baoming Zhang, Zongbo Han, Yuntao Du*, Wenyu Jiang, Yanmeng Wang, Shuai Feng, Bingkun BAO

    ICML 2025 (CCF A, Equal Corresponding Author)

  • MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge. [PDF] [WebPage]

    Yuntao Du, Kailin Jiang, Zhi Gao, Chenrui Shi, Zilong Zheng, Siyuan Qi, Qing Li

    ICLR 2025 (清华A类)

  • Robust Logit Adjustment for Learning with Long-Tailed Noisy Data. [PDF]

    MingCai Chen, Yuntao Du, Wenyu Jiang, Baoming Zhang, Shuai Feng, Yi Xin, Chongjun Wang

    AAAI 2025 (CCF A)

  • V-PETL Bench: A Unified Visual Parameter-Efficient Transfer Learning Benchmark. [PDF] [WebPage]

    Yi Xin*, Siqi Luo*, Xuyang Liu*, Yuntao Du*, Haodi Zhou, Xinyu Cheng, Christina Luoluo Lee, Junlong Du, Haozhe Wang, MingCai Chen, Ting Liu, Guimin Hu, Zhongwei Wan, Rongchao Zhang, Aoxue Li, Mingyang Yi, Xiaohong Liu

    NeurIPS 2024 (CCF A, Equal first author)

  • VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding. [PDF] [WebPage] [机器之心中文报道]

    Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li

    ECCV 2024 (CCF B)

  • Multi-source Fully Test-Time Adaptation. [PDF]

    Yuntao Du, Siqi Luo, Yi Xin, MingCai Chen, Shuai Feng, Mujie Zhang, Chongjun Wang

    Neural Network 2024 (JCR Q1, CCF B)

  • CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update. [PDF] [WebPage]

    Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

    CVPR 2024 (CCF A)

  • Generation, augmentation, and alignment: A pseudo-source domain based method for source-free domain adaptation [PDF]

    Yuntao Du, Haiyang Yang, Mingcai Chen, Juan Jiang, Hongtao Luo, and Chongjun Wang.

    Machine Learning (MLJ) 2023 (JCR Q1, CCF B)

  • DSCR: Dual View based Symmetric Consistency Regularization for Semi-Supervised Domain Adaptation [PDF]

    Yuntao Du, Juan Jiang, Hongtao Luo, Haiyang Yang, Mingcai Chen, and Chongjun Wang.

    Transactions on Machine Learning Research (TMLR) 2023

  • Two Wrongs Don’t Make a Right: Combating Confirmation Bias in Learning with Label Noise [PDF]

    Mingcai Chen, Hao Cheng, Yuntao Du , Ming Xu, Wenyu Jiang, Chongjun Wang

    AAAI 2023 (CCF A)

  • InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation [PDF]

    Yuntao Du*, Hongtao Luo*, Haiyang Yang, Juan Jiang, and Chongjun Wang

    ECML-PKDD 2022 (CCF B)

  • Semi-Supervised Learning with Multi-Head Co-Training [PDF] [Code]

    Mingcai Chen, Yuntao Du , Yi zhang, Shuwei Qian, and Chongjun Wang

    AAAI 2022 (CCF A)

  • AdaRNN: Adaptive Learning and Forecasting of Time Series [PDF] [Code] (引用超300, Rank 4th in CIKM 2021)

    Yuntao Du , Jindong Wang, Wenjie Feng, Sinno Pan, Tao Qin, Renjun Xu and Chongjun Wang

    CIKM 2021 (CCF B)

  • Adversarial Separation Network for Cross-Network Node Classification [PDF] [Code]

    Xiaowen Zhang *, Yuntao Du *, Rongbiao Xie and Chongjun Wang

    CIKM 2021 (CCF B, Euqal first author)

  • Homogeneous Online Transfer Learning with Online Distribution Discrepancy Minimization [PDF] [Code]

    Yuntao Du, Zhiwen Tan, Qian Chen, Yi Zhang, Chongjun Wang.

    ECAI 2020 (CCF B)

Honors & Awards

  • Outstanding Undergraduate Student Award, from NJU, China, May 2023
  • Student travel grant, CIKM 2021
  • First class scholarship of Yingcai, from NJU, October 2019,2020,2021,2022
  • Outstanding Undergraduate Student Award, from NEU, China, May 2018
  • Meritorious Winner, in MCM/ICM 2017, March 2017

Work Experience

  • [05/2020 - 10/2020] Research Intern, Machine Learning Group, MSRA

Professional Activities

  • Journal Reviewer

  • IEEE Transactions on Neural Networks and Learning Systems (TNNLS)

  • Transactions on Machine Learning Research (TMLR)

  • Knowledge-Based Systems

  • Conference Reviewer

  • The Conference on Neural Information Processing Systems (NeurIPS) 2024

  • International Conference on Learning Representations (ICLR) 2024

  • IEEE International Conference on Computer Vision (ICCV) 2023, 2021

  • European Conference on Computer Vision (ECCV) 2024, 2022

  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022, 2023

  • AAAI Conference on Artificial Intelligence (AAAI) 2022, 2023, 2024

  • ACM International Conference on Multimedia (ACM MM) 2021, 2023


© Yuntao Du | Last updated: 15/9/2024