I am a master's student in Computer Science at Zhejiang University, working with Prof. Zhou Zhao in the Audio Research Team. I am also an AI Algorithm Intern at ByteDance Commercial AI Group.

My research focuses on Multimodal Generative AI, spanning Speech, Spatial Audio, and Singing Voice Synthesis. Currently, I am working on Controllable Speech Generation and Expressive Audio Generation.

Previously, I received my bachelor's degree in Artificial Intelligence from the Turing Honors Program at Zhejiang University, jointly offered by the College of Computer Science and Technology and Chu Kochen Honors College.

I welcome academic collaborations. Feel free to reach out at panch@zju.edu.cn.

Homepage · Google Scholar · DBLP · ORCID · LinkedIn

• 2026.08 — Three papers accepted to EMNLP 2026.
• 2026.08 — Released SwanTale for unified multi-speaker speech and audio generation.
• 2026.06 — Released SwanVoice for expressive long-form speech synthesis.
• 2026.05 — Two papers accepted to ICML 2026.
• 2026.04 — SwanBench-Speech accepted to ACL 2026.
• 2025.09 — MRSAudio accepted to NeurIPS 2025.

# denotes co-first authors. My name is shown in bold; contributor roles are stated separately.

• SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks · Technical Report, 2026
  Yu Zhang#, Ruiqi Li#, Changhao Pan#, et al.
  Unified expressive speech and audio generation with instruction-based control and zero-shot voice conditioning. Demo · Hugging Face Paper

• SwanVoice: Expressive Long-Form Zero-Shot Speech Synthesis for Both Monologue and Dialogue · Technical Report, 2026
  Ruiqi Li#, Yu Zhang#, Changhao Pan#, et al.
  Expressive long-form monologue and dialogue synthesis with one to four speakers. Demo · Hugging Face Paper

• Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios · ACL 2026
  Changhao Pan, Rui Yang, Han Wang, et al.
  SwanBench-Speech evaluates long-form speech generation across diverse scenarios, quality dimensions, and model behaviors. Project

• Audio Editing in the Era of Foundation Models: A Survey · AACL-IJCNLP 2026
  Changhao Pan#, Yifei Fan#, Fan Zhuo#, Yifu Chen, Wenxiang Guo, Yu Zhang, et al.
  A survey of foundation-model-based editing across speech, music, and general audio. Project · Resources

• VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching · Preprint, 2026
  Wenxiang Guo, Changhao Pan, Ziyue Jiang, Zhou Zhao, Fei Wu. Demo

• SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness · ACL 2026
  Jingyu Lu, Yuhan Wang, Fan Zhuo, Xize Cheng, Changhao Pan, et al.

• Multimodal Duplex Interaction Agent · Technical Report, 2026
  Orantqing, Shengpeng Ji, Junlong Tong, Jialong Zuo, Dongjie Fu, Di Cao, Yangzhuo Li, Shangda Wu, Franz, Evan, Theron Veyra, Changhao Pan, et al. Project (Gander)

• A Survey of Full-Duplex Spoken Dialogue Systems: Architectural Hierarchy, Interaction Ontology, and Decision State Machine · EMNLP 2026
  Jingyu Lu, Yuhan Wang, Jianming Luo, Yifu Chen, Tianle Liang, Shengpeng Ji, Ziyue Jiang, Xiaoda Yang, Yu Zhang, Xize Cheng, Chenyuhao Wen, Changhao Pan, et al. Resources

• MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
  Wenxiang Guo#, Changhao Pan#, Zhiyuan Zhu#, Xintong Hu#, et al.
  A 500-hour multimodal recorded spatial audio dataset covering speech, singing, music, and daily life. Demo & Dataset

• Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer · ICML 2026
  Ke Lei#, Yu Zhang#, Changhao Pan#, et al.
  SwanSphere enables streaming spatial audio generation from panoramic video and text prompts. Demo

• A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference · ACM MM 2025
  Changhao Pan#, Wenxiang Guo#, Yu Zhang#, et al.

• ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting · ACM MM 2025
  Yu Zhang#, Wenxiang Guo#, Changhao Pan#, et al. Demo · Code

• SwanWeave: One-Stage Multi-Task Instruction-Guided 3D Spatial Audio Editing · EMNLP 2026
  Ke Lei, Chenyuhao Wen, Yu Zhang, Wenxiang Guo, Changhao Pan, et al. Demo · Code

• CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation · EMNLP 2026
  Zhiyuan Zhu, Han Wang, Wenxiang Guo, Yu Zhang, Changhao Pan, et al.

• ASAudio: A Survey of Advanced Spatial Audio Research · AACL-IJCNLP 2025
  Zhiyuan Zhu, Yu Zhang, Wenxiang Guo, Changhao Pan, Zhou Zhao.

• Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding · Preprint, 2026
  Zhiyuan Zhu, Yixuan Chen, Yiwen Shao, Wenxiang Guo, Changhao Pan, Yu Zhang, et al.

• GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024 (Spotlight)
  Yu Zhang#, Changhao Pan#, Wenxiang Guo#, et al.
  A multilingual singing corpus with technique annotations, realistic music scores, and benchmarks for singing tasks. Demo · Code & Dataset

• Versatile Framework for Song Generation with Prompt-based Control · EMNLP 2025 (Findings)
  Yu Zhang#, Wenxiang Guo#, Changhao Pan#, et al.
  VersBand generates aligned vocals and accompaniment with prompt-based control. Demo

• Synthetic Singers: A Review of Deep-Learning-based Singing Voice Synthesis Approaches · AACL-IJCNLP 2025 (Oral)
  Changhao Pan, Dongyu Yao, Yu Zhang, et al. Resources

• STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation · ACL 2025 (Findings)
  Wenxiang Guo#, Yu Zhang#, Changhao Pan#, et al. Demo · Code

• TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis · ACL 2025 (Findings)
  Yu Zhang#, Wenxiang Guo#, Changhao Pan#, et al. Demo · Code

• TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control · EMNLP 2024
  Yu Zhang, Ziyue Jiang, Ruiqi Li, Changhao Pan, et al. Demo · Code

• TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
  Wenxiang Guo, Yu Zhang, Changhao Pan, et al. Demo · Code

• ALIVE: Animate Your World with Lifelike Audio-Video Generation · Technical Report, 2026
  Ying Guo, Qijun Gan, Yifu Zhang, et al. Contributor: Changhao Pan.

• TMD-Bench: A Multi-Level Evaluation Paradigm for Music-Dance Co-Generation · ICML 2026
  Xiaoda Yang#, Majun Zhang#, Changhao Pan, et al.

• ImVideoEdit: Image-learning Video Editing via 2D Spatial Difference Attention Blocks · Preprint, 2026
  Jiayang Xu, Fan Zhuo, Majun Zhang, Changhao Pan, et al.

• 2025.08–Present — AI Algorithm Intern, ByteDance Commercial AI Group, Hangzhou. Mentors: Ruiqi Li and Yu Zhang.
• 2023.09–2024.06 — Research Assistant, Audio Research Team, Zhejiang University. Advisor: Prof. Zhou Zhao.

Earlier work: Interactive Table Synthesis with Natural Language, Yanwei Huang, Yunfan Zhou, Ran Chen, Changhao Pan, Xinhuan Shu, Di Weng, Yingcai Wu. IEEE TVCG, 2023.

• 2025.09–2028.06 (expected) — Master's degree in Computer Science, Zhejiang University.
• 2021.09–2025.06 — Bachelor's degree in Artificial Intelligence, Turing Honors Program, Zhejiang University. GPA: 4.85/5.0; Rank: 1/79.

• Zhejiang Provincial Outstanding Graduate (Undergraduate), 2025.
• Chu Kochen Scholarship, 2024 — Zhejiang University's highest scholarship.
• National Scholarship, 2022, 2023, and 2024 — three consecutive years.
• CCF Outstanding Undergraduate Students Award, 2024.
• Top-10 Outstanding Undergraduate Students, College of Computer Science and Technology, 2024.
• Top-10 Outstanding Students, Chu Kochen Honors College, 2023.
• BaoGang Elite Scholarship, 2023.

• Conference Reviewer: NeurIPS 2025 & 2026; ACL 2025 & 2026; AAAI 2026; ACM MM 2026.
• Additional Reviewing Assistance: CVPR 2025; EMNLP 2025; ACM MM 2025.