Haowei Lin(林昊苇)

haowei.jpg

E-mail: linhaowei (at) pku (dot) edu (dot) cn

I am currently embarking on my first year as a Ph.D. student at the Institute for Artificial Intelligence, Peking University, co-advised by Prof. Jianzhu Ma and Prof. Yitao Liang.

I received my Bachelor’s degree in Artificial Intelligence from Peking University, where I was fortunate to work with Prof. Bing Liu on OOD detection, continual learning, and NLP.

My primary research focus is in the field of machine learning, with a passionate commitment to developing advanced AI systems aimed at augmenting human capabilities in real-world scenarios. Currently, I am working on the development of AI-assisted drug design systems and open-world agents.

News

Mar 6, 2024 I will present our new paper Selecting Large Language Model to Fine-tune via Rectified Scaling Law at ICLR 2024 in ME-FoMo workshop. This paper recieved surprisingly positive scores (8, 9, 9) and was selected as an oral presentation. See you in Vienna!
Jan 16, 2024 Our paper on continual learning has been accepted at ICLR 2024! We propose a theoretically principled and empirically effective method for CL. Feel free to explore our code and paper. This research was conducted during my undergraduate studies under the guidance of Prof. Bing Liu.
Oct 10, 2023 One short paper on OOD Detection is accepted to EMNLP’23.
Aug 8, 2023 Talk on “Continual Learning of Language Models” at group seminar, Peking University. [slides]
Feb 18, 2023 Our paper studying the continual pre-training of LMs is accepted by ICLR 2023! An extensible PyTorch-based codebase for this task is also launched. (with more than 15 SoTA baselines)

Publications

(*: Equal Contribution)

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation
Zihao Wang, Anji Liu, Haowei Lin, Jiaqi Li, Xiaojian Ma, Yitao Liang
In arxiv.
pdf page
Selecting Large Language Model to Fine-tune via Rectified Scaling Law
Haowei Lin*, Baizhou Huang*, Haotian Ye*, Qinyue Chen, Zihao Wang, Sujian Li, Jianzhu Ma, Xiaojun Wan, James Zou, Yitao Liang
In arxiv (will be an oral presentation in ME-FoMo 2024).
pdf
Class Incremental Learning via Likelihood Ratio Based Task Prediction
Haowei Lin, Yijia Shao, Weinan Qian, Ningxin Pan, Yiduo Guo, Bing Liu
In ICLR 2024.
pdf code
Continual Pre-training of Language Models
Zixuan Ke*, Yijia Shao*, Haowei Lin*, Tatsuya Konishi, Gyuhak Kim, Bing Liu
In ICLR 2023.
pdf code poster
MCU: A Task-centric Framework for Open-ended Agent Evaluation in Minecraft
Haowei Lin, Zihao Wang, Jianzhu Ma, Yitao Liang
In ALOE 2023.
pdf code
JARVIS-1: Open-world Multi-task Agents with Memory-Augmented Multimodal Language Models
Zihao Wang, Shaofei Cai, Anji Liu, Yonggang Jin, Jinbing Hou, Bowei Zhang, Haowei Lin, Zhaofeng He, Zilong Zheng, Yaodong Yang, Xiaojian Ma, Yitao Liang
In arxiv.
pdf code page
FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score
Haowei Lin, Yuntian Gu
In EMNLP 2023.
pdf code
Adapting a Language Model While Preserving its General Knowledge
Zixuan Ke, Yijia Shao, Haowei Lin, Hu Xu, Lei Shu, Bing Liu
In EMNLP 2022.
pdf code poster
Continual Training of Language Models for Few-Shot Learning
Zixuan Ke, Haowei Lin, Yijia Shao, Hu Xu, Lei Shu, Bing Liu
In EMNLP 2022.
pdf code poster
CMG: A Class-Mixed Generation Approach to Out-of-Distribution Detection
Mengyu Wang*, Yijia Shao*, Haowei Lin, Wenpeng Hu, Bing Liu
In ECML-PKDD 2022.
pdf code

Selected Awards

  • Outstanding Reviewer, ICML2022.
  • National Scholarship (top 1%), 2022.
  • The First Prize of Peking University Scholarship (top 2%), 2020.
  • Merit student pacesetter (top 2%), 2020.
  • Huatai Science and Technology Scholarship, 2021.
  • The First Prize of the 12th and 13th National College Students’ Mathematics Competition, 2020 & 2021.
  • Morality Scholarship sponsored by Zhongying Tang, 2019-2023.