I am a associate researcher with the Wangxuan Institute of Computer Technology, Peking University, and work with Prof. Dongyan Zhao. I received my PhD through the joint program between the Nanyang Technological University and Beijing University of Posts and Telecommunications, advised by Prof. Zonghai Hu and Prof. Erik Cambria.

My research interests include large language model, multimodal post-training & agent, scientific reasoning, and model efficiency.

🔥 I am seeking self-motivated students to collaborate on topics in LLM-related research. If you’re interested in my research directions, please feel free to reach out.

📝 Selected Publications

✉: corresponding author

🧑‍ Benchmark Dataset and Evaluation

• KDD 2026SciChart: Visual Question Answering and Reasoning for Scientific Spectral Chart [CCF-A]
  Tan Yue, Rui Mao, Xuzhao Shi, Zilong Song, Siyuan Xu, Yu Yan, Ziyuan Liao, Zonghai Hu, Dongyan Zhao
• ACL 2026 (Findings)Curriculum Learning based Hierarchical Scoring and Analysis Framework for Question Answering Task Evaluation [CCF-A]
  Qiong Wu, Tan Yue✉, Jianxin Liang, Zhen Li, Kai He, Shuai Zhao, Dongyan Zhao✉
• ACL 2025QAEval: Mixture of Evaluators for Question-Answering Task Evaluation [CCF-A]
  Tan Yue, Rui Mao, Xuzhao Shi, Shuo Zhan, Zuhao Yang, Dongyan Zhao
• ACMMM 2025AnaFig: A Human-Aligned Dataset for Scientific Figure Analysis [CCF-A]
  Tan Yue, Xuzhao Shi, Rui Mao, Zilong Song, Zonghai Hu, Dongyan Zhao
• EMNLP 2025F2TEval: Human-Aligned Multi-Dimensional Evaluation for Figure-to-Text Task [CCF-B]
  Tan Yue, Rui Mao, Zilong Song, Zonghai Hu, Dongyan Zhao
• COLING 2024SarcNet: A Multilingual Multimodal Sarcasm Detection Dataset [CCF-B, Oral]
  Tan Yue, Xuzhao Shi, Rui Mao, Zonghai Hu, Erik Cambria

🧑‍ Multimodal Post-Training & Agent

• IEEE Transactions on Affective Computing (2026)InterARM: Interpretable Affective Reasoning Model for Multimodal Sarcasm Detection [CCF-B, SCI-Q1]
  Tan Yue, Rui Mao, Xuzhao Shi, Erik Cambria

• CVPR 2026SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration [CCF-A]
  Zhongyu Yang, Zuhao Yang, Shuo Zhan, Tan Yue, Wei Pang, Yingfang Yuan

• Information Fusion (2023)KnowleNet: Knowledge Fusion Network for Multimodal Sarcasm Detection [CAAI-A, SCI-Q1]
  Tan Yue, Rui Mao, Heng Wang, Zonghai Hu, Erik Cambria

• ICLR 2023Revisit Finetuning strategy for Few-Shot Learning to Transfer the Emdeddings [CCF-A]
  Heng Wang, Tan Yue, Xiang Ye, Zihang He, Bohan Li, Yong Li

🧑‍ Model Efficiency

• AAAI 2026MARS: Multimodal Adaptive Reasoning Model for Avoiding Overthinking [CCF-A]
  Tan Yue, Qiong Wu, Dongyan Zhao

• WWW 2026We May Not Need Much Visual Encoding of Web Data for Question Answering [CCF-A]
  Tan Yue, Qiong Wu, Dongyan Zhao

💻 Academic Projects

• National Natural Science Foundation of China Young Scientists Fund (C).
  Research on Lightweight Scientific Reasoning by Multimodal Learning. (￥300K, 2026.01-2028.12, PI)
• China Postdoctoral Science Foundation.
  Research and Applications of Multimodal Lightweight Scientific Reasoning with General-Specialized Learning Paradigm. (￥80K, 2025.07-2027.06, PI)
• Key Research and Development Project of Industry–University Collaboration.
  Post-Training and Inference Acceleration for Financial Foundation Models. (￥1.00M, 2026.08-2027.01, PI)
• Key Research and Development Project of Industry–University Collaboration.
  Reinforcement Learning for Multimodal Complex Reasoning. (￥1.03M, 2025.05-2026.04, PI)

🏆 Selected Honors and Awards

• 2025 Peking University Outstanding Postdoctoral Fellow Award. (Top 5%)
  
• 2024 Peking University Boya Postdoctoral Fellowship.
  
• 2024 Beijing Outstanding Graduate (PhD).
• 2023 National Scholarship (PhD).
• 2022 The 8th China Internet + National College Students Innovation and Entrepreneurship Competition. Third prize.
• 2022 The 8th China Internet + National College Students Innovation and Entrepreneurship Competition. Third prize.
• 2021 The 7th China Internet + National College Students Innovation and Entrepreneurship Competition. Second prize.
• 2020 The 6th China Internet + National College Students Innovation and Entrepreneurship Competition. Third prize.
• 2019 The 2nd AIIA Cup National Artificial Intelligence Competition. National Championship
  

💬 Academic Service

• Communication-based evaluation expert for National Natural Science Foundation of China (NSFC) Projects.
• Conference Senior Area Chair (SAC): LREC 2026.
• Conference Program Committee Member: NeurIPS, CVPR, ACMMM, AAAI, ACL, KDD, COLING, EMNLP, ECCV, IJCAI, etc.
• Top-tier Journals Reviewer: Information Fusion, IEEE Transactions on Affective Computing, Knowledge-Based Systems, etc.

📖 Patents

• A Method and System for Question Answering Task Evaluation Based on a Mixture-of-Experts Architecture.
  (一种基于混合专家结构的问答任务评估方法及系统)
  Chinese Invention Patent, 2026, ZL202510833775.5
  Dongyan Zhao, Tan Yue, Zilong Song, Xuzhao Shi

• A Multimodal Fine-Grained Paper Classification Method and System by Regularization Ensemble Learning.
  (基于正则化集成学习的多模态细粒度论文分类方法和系统)
  Chinese Invention Patent, 2024, ZL202310834148.4
  Zonghai Hu, Tan Yue, Yuanyang Yang, Yuan Jiang, Zijiao Fan, Xuzhao Shi, Jiedong Qin

• A method and device for fine-grained multi-label annotation of paper by pre-trained encoder.
  (基于预训练编码器的论文细粒度化多标签标注方法及装置)
  Chinese Invention Patent, 2023, ZL202211198214.5
  Zonghai Hu, Tan Yue, Jiedong Qin, Xuzhao Shi, Zijiao Fan, Yuanyang Yang, Yuan Jiang

• A method and device for fine-grained paper classification by multimodal hierarchical fusion network
  (基于多模态分层融合网络的细粒度化论文分类方法及装置)
  Chinese Invention Patent, 2022, ZL202111567384.1
  Zonghai Hu, Tan Yue, Jiedong Qin, Xuzhao Shi, Zijiao Fan

• An intelligent analysis method and device for insurance document.
  (保险行业文档智能化解析方法和装置)
  Chinese Invention Patent, 2021, ZL202011621201.5
  Tan Yue, Zonghai Hu