I am a second year graduate student at Renmin University of China, under the supervision of Wayne Xin Zhao, who runs the AI Box Lab. My major research interest lies in natural language processing (NLP), with focuses on large language models, pre-trained language models, and text generation.

Selected Publications

Here, I have selected several of my favorite work, and the complete publication can be found in Publication.

* denotes equal contribution

Preprint

Not All Metrics Are Guilty: Improving NLG Evaluation with LLM Paraphrasing [paper]

Tianyi Tang, Hongyuan Lu, Yuchen Eleanor Jiang, Haoyang Huang, Dongdong Zhang, Wayne Xin Zhao, Furu Wei

Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting [paper]

Haoyang Huang*, Tianyi Tang*, Dongdong Zhang, Wayne Xin Zhao, Ting Song, Yan Xia, Furu Wei

A Survey of Large Language Models [paper]

Wayne Xin Zhao, Kun Zhou*, Junyi Li*, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, Peiyu Liu, Jian-Yun Nie, Ji-Rong Wen.

Pre-trained Language Models for Text Generation: A Survey [paper]

Junyi Li*, Tianyi Tang*, Wayne Xin Zhao, Jian-Yun Nie, Ji-Rong Wen

2023

Learning to Imagine: Visually-Augmented Natural Language Generation (ACL 2023) [paper]

Tianyi Tang, Yushuo Chen, Yifan Du, Junyi Li, Wayne Xin Zhao, Ji-Rong Wen

MVP: Multi-task Supervised Pre-training for Natural Language Generation (Findings of ACL 2023) [paper]

Tianyi Tang, Junyi Li, Wayne Xin Zhao, Ji-Rong Wen

2022

Context-Tuning: Learning Contextualized Prompts for Natural Language Generation (COLING 2022) [paper]

Tianyi Tang, Junyi Li, Wayne Xin Zhao, Ji-Rong Wen

TextBox 2.0: A Text Generation Library with Pre-trained Language Models (EMNLP 2022 System Demonstrations) [paper]

Tianyi Tang*, Junyi Li*, Zhipeng Chen*, Yiwen Hu, Zhuohao Yu, Wenxun Dai, Wayne Xin Zhao, Jian-Yun Nie and Ji-Rong Wen

Open Source Projects

Most of my research work is open-source. Here are some of my preferred projects.

• TextBox  

  TextBox is an up-to-date text generation library based on Python and PyTorch focusing on building a unified and standardized pipeline for applying pre-trained language models to text generation.

• MVP

  MVP is a pre-trained language model specially designed for natural language generation tasks. MVP is supervised pre-trained (instruction tuned) using labeled datasets. We can have merged it into Hugging Face.

Education

• M.E., Renmin University of China, School of Artificial Intelligence

  2021 - present, advisor: Prof. Wayne Xin Zhao

• B.E., Renmin University of China, School of Information

  2017 - 2021

Experience

• Research Intern, Microsoft Research Asia

  2023.02 - present, Natural Language Computing (NLC) group, with Haoyang Huang and Dongdong Zhang

Service

• PC Reviewer: ACL 2023, EMNLP 2023

Awards

• 2021 Outstanding Graduates, Beijing Municipal Education Commission
• 2021 Outstanding Graduation Project, Beijing Municipal Education Commission
• 2021 Nomination Star of the Graduates (20 students per year), Renmin University of China
• 2019 Gold Medal in Collegiate Computer System & Programming Contest (CCSP), China Computer Federation (CCF)
• 2019 Silver Medal in the ICPC Asia Regional Contest (Shanghai Site), the ICPC International Collegiate Programming Contest
• 2019 National Scholarship, Ministry of Education of China
• 2018 Silver Medal in the ICPC Asia-East Continent Final (Xi’an Site), the ACM International Collegiate Programming Contest
• 2018 Silver Medal in the ACM-ICPC Asia Regional Contest (Nanjing Site), the ACM International Collegiate Programming Contest
• 2018 First Prize in China Undergraduate Mathematical Contest in Modeling (Beijing Site), China Society for Industrial and Applied Mathematics
• 2018 Meritorious Winner in Mathmatical Conest in Modeling, Consortium for Mathematics and its Applications (COMAP)
• 2017 Bronze Medal in the ACM-ICPC Asia Regional Contest (EC-Final), the ACM International Collegiate Programming Contest
• 2017 Silver Medal in the ACM-ICPC Asia Regional Contest (Xi’an Site), the ACM International Collegiate Programming Contest
• 2016 Bronze Medal in China National Olympiad in Informatics (NOI), China Computer Federation (CCF)
• 2016 First Prize in China National Olympiad in Informatics in Provinces (NOIP), China Computer Federation (CCF)
• 2018, 2019, 2020, 2022 Merit Student, Renmin University of China
• 2018, 2019, 2020, 2022 Outstanding Student Cadre, Renmin University of China
• 2018, 2019, 2020, 2022 Outstanding Communist Youth League Member, Renmin University of China