Haowei Lin(林昊苇)

haowei.jpg

E-mail: linhaowei (at) pku (dot) edu (dot) cn

I am currently a second year Ph.D. student at the Institute for Artificial Intelligence, Peking University, co-advised by Prof. Jianzhu Ma and Prof. Yitao Liang.

I received my Bachelor’s degree in Artificial Intelligence from Yuanpei College, Peking University, where I was fortunate to work with Prof. Bing Liu on OOD detection, continual learning, and NLP.

I am passionate about designing next-generation AI systems that deeply integrate into daily lives. My primary research focus is in the field of machine learning, with specific interests in:

  • Exploring generative foundation models across different domains (vision, language, sequential decision making, molecules).
  • Developing advanced AI systems (e.g., drug design systems, open-world agents) aimed at augmenting human capabilities in real-world scenarios.

I am a member of Team CraftJarvis, which is dedicated to creating generalist agents for open-world environments. Outside of my professional interests, I enjoy engaging in music-related activities, including singing, playing the guitar, and participating in choirs. Additionally, I share videos related to singing and research on Bilibili. If you’d like to chat with me about research or anything, please feel free to reach out via email!

News

Sep 26, 2024 TFG and OmniJARVIS have been accepted at NeurIPS 2024! In TFG, we present a unified training-free guidance method for diffusion models, evaluated across 16 tasks spanning image, audio, and geometry domains. OmniJARVIS, developed in collaboration with Team CraftJARVIS, is an end-to-end VLA (Vision-Language-Action) agent for open-world Minecraft.
May 3, 2024 I will present our new paper Selecting Large Language Model to Fine-tune via Rectified Scaling Law at ICLR 2024 in ME-FoMo workshop. This paper is selected as an oral presentation and is recently accepted by ICML 2024. See you in Vienna!
Jan 16, 2024 Our paper on continual learning has been accepted at ICLR 2024! We propose a theoretically principled and empirically effective method for CL. Feel free to explore our code and paper. This research was conducted during my undergraduate studies under the guidance of Prof. Bing Liu.
Oct 10, 2023 One short paper on OOD Detection is accepted to EMNLP’23.
Aug 8, 2023 Talk on “Continual Learning of Language Models” at group seminar, Peking University. [slides]

Selected Publications

For a complete list of publications, please refer to my Google Scholar page.

(*: Equal Contribution)

Group retrosynthetic planning as neurosymbolic programming
Xuefeng Zhang, Haowei Lin, Muhan Zhang, Yuan Zhou, and Jianzhu Ma
In Nature Communications 2024.
TFG: Unified Training-Free Guidance for Diffusion Models
Haotian Ye*, Haowei Lin*, Jiaqi Han*, Minkai Xu, Sheng Liu, Yitao Liang, Jianzhu Ma, James Zou, Stefano Ermon
In NeurIPS 2024 (Spotlight).
pdf
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents
Zihao Wang, Shaofei Cai, Zhancun Mu, Haowei Lin, Ceyao Zhang, Xuejie Liu, Qing Li, Anji Liu, Xiaojian Ma, Yitao Liang
In NeurIPS 2024.
Selecting Large Language Model to Fine-tune via Rectified Scaling Law
Haowei Lin*, Baizhou Huang*, Haotian Ye*, Qinyue Chen, Zihao Wang, Sujian Li, Jianzhu Ma, Xiaojun Wan, James Zou, Yitao Liang
In ICML 2024 (also an oral presentation in ME-FoMo 2024).
Class Incremental Learning via Likelihood Ratio Based Task Prediction
Haowei Lin, Yijia Shao, Weinan Qian, Ningxin Pan, Yiduo Guo, Bing Liu
In ICLR 2024.
Continual Pre-training of Language Models
Zixuan Ke*, Yijia Shao*, Haowei Lin*, Tatsuya Konishi, Gyuhak Kim, Bing Liu
In ICLR 2023.
FLatS: Principled Out-of-Distribution Detection with Feature-Based Likelihood Ratio Score
Haowei Lin, Yuntian Gu
In EMNLP 2023.
Continual Training of Language Models for Few-Shot Learning
Zixuan Ke, Haowei Lin, Yijia Shao, Hu Xu, Lei Shu, Bing Liu
In EMNLP 2022.

Selected Awards

  • Outstanding Reviewer, ICML2022.
  • National Scholarship (top 1%), 2022.
  • The First Prize of Peking University Scholarship (top 2%), 2020.
  • Merit student pacesetter (top 2%), 2020.
  • Huatai Science and Technology Scholarship, 2021.
  • The First Prize of the 12th and 13th National College Students’ Mathematics Competition, 2020 & 2021.
  • Morality Scholarship sponsored by Zhongying Tang, 2019-2023.