Rongjie Huang (黄融杰) is the final year’s graduate student at College of Computer Science and Software, Zhejiang University, supervised by Prof. Zhou Zhao. I also obtained Bachelor’s degree at Zhejiang University. During my graduate study, I was lucky to collaborate with the CMU Speech Team led by Prof. Shinji Watanabe, and Audio Research Team at Zhejiang University. I was grateful to intern or collaborate at TikTok, Shanghai AI Lab, Tencent Seattle Lab, Alibaba Qwen, with Yi Ren, Jinglin Liu, Chunlei Zhang and Dong Yu.

My research interest includes Multi-Modal Generative AI, Multi-Modal Language Processing, and AI4Science. I have published first-author papers at the top international AI conferences such as NeurIPS/ICLR/ICML/ACL/IJCAI. I developed a few well-known Speech/NLP algorithms including:

• AudioGPT, UniAudio, Make-A-Voice: Multitask, Multilingual LLMs
• Make-An-Audio, GenerSpeech: Zero-shot text-guided synthesis
• FastDiff 1/2, ProDiff: AIGC diffusion models
• TranSpeech, and AV-TranSpeech: Multimodal Translation

In 2024, I lead or participate in the following research topics:

• Speech/NLP: multimodal generation and translation
• Large Language Models (LLMs): Audio/Visual
• Diffusion models: Image/Audio/3D

🔥 News