🐨 Me
I obtained my Master Degree at Shanghai Jiao Tong University, under the supervise of Prof. Fan Cheng, major in computer science. Before that, I received my B.S. degree in IEEE honor class at SJTU, major in computer science. I used to be a research intern at SJTU interpretable ML lab, guided by Prof. Quanshi Zhang during my undergraduate study.
In 2021.10~2022, I worked as a research intern in Microsoft Research Asia (MSRA) DKI group guided by Haoyu Dong. I worked on some interesting research topics related to semi-structured tabular data, such as table pre-training, table question answering.
In 2023, I worked as a research assistant in XLang Lab @HKUNLP advised by Prof. Tao Yu. Currently I am doing AI research at GAIR Lab advised by Pengfei Liu, and am affiliated with Shanghai AI Laboratory. I also have the fortune to work with Qian Liu at Sea AI Lab, who is an excellent collaborator!🤗
🔥 News
- 2024.01: 🎉🎉 Our Lemur paper(Agent Model) got accepted by ICLR'24 (Spotlight, 5%).
- 2023.10: 🔥🔥 We've built OpenAgents, an open platform for language agents in the wild!
- 2023.10: 🙋🙋 We have released Lemur-70B, an agentic language model based on LLama-2!
- 2023.04: 🔥🔥 New preprint applying symbolic tasks in instruction tuning
- 2022.10: 🎉🎉 Our TaCube paper(Table QA) got accepted by EMNLP'22 (Oral Presentation).
🥑 Projects
Host your own ChatGPT Plus locally!
- Data Agent: code interpreter augmented with data tools
- Plugins Agent: 200+ plugins for daily life
- Web Agent: autonomous web browsing
📝 Publications
Dissecting Human and LLM Preferences
Junlong Li, Fan Zhou, Shichao Sun, Yikai Zhang, Hai Zhao, Pengfei Liu
(2024, Preprint) | [📄 PDF] | [🛠 Code] | [🌐 Page] |
OpenAgents: An Open Platform for Language Agents in the Wild
Tianbao Xie*, Fan Zhou*, Zhoujun Cheng*, Peng Shi*, Luoxuan Weng*, Yitao Liu*, Toh Jing Hua, Junning Zhao, Qian Liu, Che Liu, Leo Z. Liu, Yiheng Xu, Hongjin Su, Dongchan Shin, Caiming Xiong, Tao Yu, (*=equal contribution)
ICLR 2024, LLM Agents Workshop | [📄 PDF] | [🛠 Code] | [📓 Blog] |
Lemur: Harmonizing Natural Language and Code for Language Agents
Yiheng Xu*, Hongjin Su*, Chen Xing*, Boyu Mi, Qian Liu, Weijia Shi, Binyuan Hui, Fan Zhou, Yitao Liu, Tianbao Xie, Zhoujun Cheng, Siheng Zhao, Lingpeng Kong, Bailin Wang, Caiming Xiong, Tao Yu, (*=equal contribution)
ICLR 2024, Spotlight | [📄 PDF] | [🛠 Code] | [🤗 hf models] | [📓 Blog] |
From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning
Qian Liu*, Fan Zhou*, Zhengbao Jiang, Longxu Dou, Min Lin, (*=equal contribution)
(2023, Preprint) | [📄 PDF] | [🛠 Code] | [🤗 hf datasets & models] |
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems
Fan Zhou*, Haoyu Dong*, Qian Liu, Zhoujun Cheng, Shi Han, Dongmei Zhang, (*=equal contribution)
NeurIPS 2022, 2nd MATH-AI Workshop | [📄 PDF]
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data
Fan Zhou, Mengkang Hu, Haoyu Dong, Zhoujun Cheng, Fan Cheng, Shi Han, Dongmei Zhang
EMNLP 2022, Oral | [📄 PDF] | [🛠 Code]
Table Pre-training: A Survey on Model Architectures, Pretraining Objectives, and Downstream Tasks
Haoyu Dong, Zhoujun Cheng, Xinyi He, Mengyu Zhou, Anda Zhou, Fan Zhou, Ao Liu, Shi Han, Dongmei Zhang
IJCAI 2022(survey track) | [📄 PDF]
Exploring Image Regions Not Well Encoded by an INN
Zenan Ling, Fan Zhou, Meng Wei, Quanshi Zhang
AISTATS 2022 | [📄 PDF]
Quantification and Analysis of Layer-wise and Pixel-wise Information Discarding
Haotian Ma, Hao Zhang, Fan Zhou, Quanshi Zhang
ICML 2022 | [📄 PDF] | [🛠 Code]
📖 Service
- Workshop Reviewer: Instruction Workshop @ NeurIPS 2023
- Conference Reviewer: COLING 2024
🎖 Honors and Awards
- MSRA Stars of Tomorrow (Award of Excellent Intern), 2022
- Outstanding Graduates of SJTU, 2021
- SJTU Academic Scholarship, 2017~2020
- Shanghai City Scholarship(≈top 5%), 2018
📖 Educations
- 2021.09 - 2024.03, M.S.@SJTU, Computer Science & Engineering
- 2017.09 - 2021.06, B.S.@SJTU, IEEE honor class, Computer Science.