Yuntao Du

杜云涛

Research Scientist

Machine Learning Lab
BIGAI
Beijing, China

Email: duyuntao@bigai.ai

About

Currently I am working as a research scientist at Beijing Institute for General Artificial Intelligence (BIGAI). I got Ph.D degree from Nanjing University in June 2023. I was a member of IIP Group, led by professor Chongjun Wang. Before that, I received my B.Sc. degree from Northeastern University in June 2018.

I am working to multimodal understanding, reasoning, and new knowledge learning. In particular, I'm interested in building models/agents that cat generalize well and learn continously in various reasoning and multimodal tasks. Some of my research topic could be found below:

Multi-modal learning: visio and language, video and language
Continue learning: knowledge editing, parameter-efficient tuning
Transfer learning: Domain adaptation, fine-tuning

News

2024.11 One paper got accepted by Neurocomputing 2024
2024.09 One paper got accepted by NeurIPS 2024
2024.08 One paper got accepted by Neural Network
2024.07 One paper got accepted by ECCV 2024
2024.03 One paper got accepted by ICLR 2024 workshop
2024.03 One paper got accepted by CVPR 2024
2024.02 Our survey on parameter efficient fine-tuning for vision is on arvix. Here is the github link
2023.10 One paper got accepted by Machine Learning Journal
2023.03 One paper got accepted by Transactions on Machine Learning Research (TMLR)
2023.01 One paper got accepted by SDM 2023
2022.12 One paper got accepted by AAAI 2023
2022.06 One paper got accepted by ECML-PKDD 2022
2021.12 One paper got accepted by AAAI 2022

Preprint

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey. [PDF]

Yi Xin, Siqi Luo, Haodi Zhou, Junlong Du, Xiaohong Liu, Yue Fan, Qing Li, Yuntao Du*

Selected Publications

[Google Scholar]

V-PETL Bench: A Unified Visual Parameter-Efficient Transfer Learning Benchmark.
Yi Xin*, Siqi Luo*, Xuyang Liu*, Yuntao Du*, Haodi Zhou, Xinyu Cheng, Christina Luoluo Lee, Junlong Du, Haozhe Wang, MingCai Chen, Ting Liu, Guimin Hu, Zhongwei Wan, Rongchao Zhang, Aoxue Li, Mingyang Yi, Xiaohong Liu

The Annual Conference on Neural Information Processing Systems (NeurIPS) 2024 [PDF][WebPage]
VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding.
Yue Fan, Xiaojian Ma, Rujie Wu, Yuntao Du, Jiaqi Li, Zhi Gao, Qing Li

The European Conference on Computer Vision (ECCV) 2024 [PDF][中文报道]
Multi-source Fully Test-Time Adaptation.
Yuntao Du, Siqi Luo, Yi Xin, MingCai Chen, Shuai Feng, Mujie Zhang, Chongjun Wang

Neural Network [PDF]

The Twelfth International Conference on Learning Representations (PML4LRS workshop @ ICLR ) 2024 [PDF]
CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update.
Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 [PDF]
Generation, augmentation, and alignment: A pseudo-source domain based method for source-free domain adaptation

Yuntao Du, Haiyang Yang, Mingcai Chen, Juan Jiang, Hongtao Luo, and Chongjun Wang.

Machine Learning (MLJ) 2023 [PDF]
DSCR: Dual View based Symmetric Consistency Regularization for Semi-Supervised Domain Adaptation

Yuntao Du, Juan Jiang, Hongtao Luo, Haiyang Yang, Mingcai Chen, and Chongjun Wang.

Transactions on Machine Learning Research (TMLR) 2023 [PDF]
Two Wrongs Don’t Make a Right: Combating Confirmation Bias in Learning with Label Noise

Mingcai Chen, Hao Cheng, Yuntao Du , Ming Xu, Wenyu Jiang, Chongjun Wang

AAAI conference on aitificial intelligence (AAAI) 2023 [PDF]
InCo: Intermediate Prototype Contrast for Unsupervised Domain Adaptation

Yuntao Du*, Hongtao Luo*, Haiyang Yang, Juan Jiang, and Chongjun Wang

European Conference on Machine Learning (ECML-PKDD) 2022 [PDF]
Semi-Supervised Learning with Multi-Head Co-Training

Mingcai Chen, Yuntao Du , Yi zhang, Shuwei Qian, and Chongjun Wang

AAAI conference on aitificial intelligence (AAAI) 2022 [PDF]
AdaRNN: Adaptive Learning and Forecasting of Time Series

Yuntao Du , Jindong Wang, Wenjie Feng, Sinno Pan, Tao Qin, Renjun Xu and Chongjun Wang

International Conference on Information and Knowledge Management (CIKM) 2021 [PDF] [Code](引用超200)
Adversarial Separation Network for Cross-Network Node Classification

Xiaowen Zhang *, Yuntao Du *, Rongbiao Xie and Chongjun Wang (*, euqal contribution)

International Conference on Information and Knowledge Management (CIKM) 2021 [PDF] [Code]
Cross-domain error minimization for unsupervised domain adaptation

Yuntao Du, Yinghao Chen *, Fengli Cui *, Xiaowen Zhang, Chongjun Wang. (*, euqal contribution)

International Conference on Database Systems for Advanced Applications (DASFAA) 2021 [PDF] [Code]
Homogeneous Online Transfer Learning with Online Distribution Discrepancy Minimization

Yuntao Du, Zhiwen Tan, Qian Chen, Yi Zhang, Chongjun Wang.

European Conference on Artificial Intelligence (ECAI) 2020 [PDF] [Code]

Honors & Awards

Outstanding Undergraduate Student Award, from NJU, China, May 2023

Student travel grant, CIKM 2021

First class scholarship of Yingcai, from NJU, October 2019,2020,2021,2022

Outstanding Undergraduate Student Award, from NEU, China, May 2018

Meritorious Winner, in MCM/ICM 2017, March 2017

Work Experience

[05/2020 - 10/2020] Research Intern, Machine Learning Group, MSRA

Professional Activities

Journal Reviewer
IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
Transactions on Machine Learning Research (TMLR)
Knowledge-Based Systems

Conference Reviewer

International Conference on Learning Representations (ICLR), 2024

IEEE International Conference on Computer Vision (ICCV), 2023, 2021

European Conference on Computer Vision (ECCV), 2024, 2022

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022, 2023

AAAI Conference on Artificial Intelligence (AAAI) 2022, 2023, 2024

ACM International Conference on Multimedia (ACM MM) 2021, 2023