Weilei He

I'm a research intern student supervised by Prof. Yi R. (May) Fung at Hong Kong University of Science and Technology. I received my bachelor's degree from Wuhan University, supervised by Prof. Chunxia Xiao. Previously, I was fortunate to work with Prof. Huaxiu Yao at University of North Carolina at Chapel Hill. Also, I've had the privilege of being supervised by Prof. Ying Wei at Nanyang Technological University.

I will join University of California, Riverside as a PhD student this fall.

Email / CV / Scholar / Twitter / Github

Research

My research interest focuses on trustworthy AI, multimodal learning and LLM alignment. Specially, I am interested in the application of LLMs in multiple areas(e.g. Computer Vision). My publications are listed below.

	Empowering Reliable Visual-Centric Instruction Following in MLLMs Weilei He, Feng Ju, Zhiyuan Fan, Rui Min, Minhao Cheng, Yi R. Fung ACL-Findings 2026 \| PDF \| Code

	Cream: Consistency Regularized Self-Rewarding Language Models Zhaoyang Wang, Weilei He, Zhiyuan Liang, Xuchao Zhang, Chetan Bansal, Ying Wei, Weitong Zhang, Huaxiu Yao ICLR 2025 \| PDF
	HighlightRemover: Spatially Valid Pixel Learning for Image Specular Highlight Removal Ling Zhang, Yidong Ma, Zhi Jiang, Weilei He, Zhongyun Bao, Gang Fu, Wenjun Xu, Chunxia Xiao ACM Multimedia 2024 \| PDF
	Foreground Harmonization and Shadow Generation for Composite Image Jing Zhou, Ziqi Yu, Zhongyun Bao, Gang Fu, Weilei He, Chao Liang, Chunxia Xiao ACM Multimedia 2024 \| PDF
	CFDiffusion: Controllable Foreground Relighting in Image Compositing via Diffusion Model Ziqi Yu, Jing Zhou, Zhongyun Bao, Gang Fu, Weilei He, Chao Liang, Chunxia Xiao ACM Multimedia 2024 \| PDF

Misc

I started my vocal training at the age of 5 and continued until I was 12. At the same time, I learned playing saxophone for 5 years. When I was a child, I won many great awards for vocal and saxophone performance. I joined the Renwen Philharmonic Chamber Choir when I was in college. As a bass, I sang and performed classic works from many musicians including Bach, Mozart, Brahms. And as a conductor, I led the Choir of School of Computer Science from the last place to the first place in the competitions.

In addition to music, I also developed some skills in basketball. As a small forward, I won the Wuhan University Basketball Championship with the School of Computer Science basketball team.

Also, I've been a fan of Real Madrid FC since I was a child. In the middle school, I used to play as a right wing back.

Website template from here.