Jiawei Fan works for Intel Labs China as an AI researcher, supervised by Anbang Yao. He aims to construct a novel distillation method to contribute to omni-scale high-performance intelligent vision systems. Previously, he was an intern at MEGVII and obtained the Outstanding Intern award as he designed a high-performance parameter-free regularization method for action recognition.

He obtained master degree of computer science in Beijing University of Posts and Telecommunications (BUPT), supervised by Meina Song. Before that, he obtained first-class honorable degree of Bachelor of Science and Engineering. when he graduated from joint program of Beijing University of Posts and Telecommunications (BUPT) and Queen Mary University of London (QMUL).

🔥 News

• 2024.09:   A first-author paper on exploring KD method for transferring the scalability of pre-trained ViTs to various architectures has been accepted to NeurIPS 2024.
• 2023.09:   A first-author paper on efficient knowledge distillation for semantic segmentation has been accepted to NeurIPS 2023.
• 2022.12:   A first co-author paper on Video SSL has been accepted as a Best Paper Award Honorable Mentioned to ACCV 2022.
• 2022.07:   A first-author paper on high-performance parameter-free regularization method for action recognition has been accepted to ACM MM 2022.
• 2022.03:   A first-author paper on few-shot learning has been accepted to ICPR 2022.
• 2021.05:   Rank 7th in the 3rd Person in Context workshop in CVPR 2021.

📝 Publications

(* Equal contribution, # Corresponding author)

Selected Publications

NeurIPS 2024

ScaleKD: Strong Vision Transformer Could Be Excellent Teachers

Jiawei Fan, Chao Li, Xiaolong Liu, Anbang Yao#

Code | Project

• It is the first work to explore how to transfer the scalable property of pre-trained large vision transformer models to smaller target models.
• ScaleKD could be used as a more efficient alternative to the time-intensive pre-training paradigm for any target student model on large-scale datasets.

NeurIPS 2023

Augmentation-free Dense Contrastive Distillation for Efficient Semantic Segmentation

Jiawei Fan, Chao Li, Xiaolong Liu, Meina Song, Anbang Yao#

Code

• Af-DCD is a new augmentation-free dense contrastive distillation framework for efficient semantic segmentation.

• DTR: An Information Bottleneck Based Regularization Framework for Video Action Recognition, Jiawei Fan*, Yu Zhao*#, Xie Yu, Lihua Ma, Junqi Liu, Fangqiu Yi, Boxun Li, Proceedings of the 30th ACM International Conference on Multimedia (ACM-MM 2022).
• TCVM: Temporal Contrasting Video Montage Framework for Self-supervised Video Representation Learning, Fengrui Tian*, Jiawei Fan*, Xie Yu, Shaoyi Du#, Meina Song, Yu Zhao, Proceedings of the Asian Conference on Computer Vision (ACCV 2022). (Oral and Best Paper Award Honorable Mentioned)
• Episodic Projection Network for Out-of-Distribution Detection in Few-shot Learning., Jiawei Fan, Zhonghong Ou#, Xie Yu, Junwei Yang, Shigeng Wang, Xiaoyang Kang, Hongxing Zhang, Meina Song, 26th International Conference on Pattern Recognition (ICPR 2022).

📖 Educations

• 2020.09 - 2023.06, Master at Beijing University of Posts and Telecommunications.
• 2016.09 - 2020.06, Bachelor at Beijing University of Posts and Telecommunications and Queen Marry University of London.

🎖 Honors and Awards

• 2023.11 Intel Labs China DRA Award.
• 2022.12 Best Paper Honorable Mentioned in ACCV 2022.
• 2022.04 MEGVII Outstanding Interns.
• 2021.10 First Class Scholarship of 2021.
• 2021.05 Win 7th in the 3rd Person in Context workshop in CVPR 2021.
• 2021.01 First Prize in Graduate Innovation and Entrepreneurship Competition.
• 2020.10 First Class Scholarship of 2020.
• 2020.06 BUPT Star of Youth. (10 students per year)
• 2020.02 M Prize in Mathematical Contest in Modeling.
• 2019.10 Tongding Enterprise Scholarship of 2019. (1 student per department)
• 2019.01 First Prize in Graduate Innovation and Entrepreneurship Competition. (as an undergraduate student)
• 2018.10 Hengtong Enterprise Scholarship of 2018.
• 2017.10 National Encouragement Scholarship of 2017.

💬 Academic service

Reviewer: ICLR 2025, NeurIPS 2024, AISTAT 2025, ACCV 2022.

💻 Experieces

• 2022.07 - now, Intel Labs, China. Researcher, supervised by Anbang Yao.
• 2021.12 - 2022.07, MEGVII Inc, China. Research Intern, supervised by Yu Zhao.
• 2021.04 - 2021.10, Peking University, China. Visit Student, supervised by Yang Liu.
• 2019.09 - 2019.11, ByteDance Inc, China. Data Engineer Intern.