Hao Peng
3314 SC
201 North Goodwin Avenue
Urbana, IL 61801
I am an Assistant Professor at the Department of Computer Science of the University of Illinois at Urbana-Champaign (UIUC).
I received my Ph.D. from the University of Washington, with Noah Smith, and my Bachelors Degree from Peking University. I spent one year at the Allen Institute for Artificial Intelligence as a Young Investigator, and time at Microsoft Research, Google, and DeepMind as an intern.
My research interest broadly spans natural language processing and machine learning. My current interests primarily include making language AI more efficient and accessible, and evaluating and improving large language models’ reasoning capabilities, factuality, and trustworthiness, and their applications in the scientific domain.
Outside of work, I cater to the whims of a trio of furry overlords: Meera, Loki, and Sylvie. When they release me from their service, I cycle in the summer, and (backcountry) ski in the winter.
news
Apr 16, 2024 | I will give a talk at the Midwest Speech and Language Days at UMich. |
---|---|
Apr 12, 2024 | I will give a talk at UChicago and TTIC. |
Apr 11, 2024 | I will give a talk at the Argonne National Laboratory. |
Apr 2, 2024 | Check out Eurus, our state-of-the-art opensource LLMs! |
Feb 15, 2024 | Pretrained LLMs can be adapted to handle 128K-long context with surprisingly small amount of continual pretraining. Check out our new preprint! |
recent publications
- PLUM: Preference Learning Plus Test Cases Yields Better Code Language ModelsarXiv preprint, 2024
- Source-Aware Training Enables Knowledge Attribution in Language ModelsIn Proceedings of the Conference on Language Modeling (COLM), 2024