Faster Video Diffusion with Trainable Sparse Attention
Peiyuan Zhang*, Yongqi Chen*, Haofeng Huang*, Zhengzhong Liu, Ion Stoica, Eric Xing, Hao Zhang. (2025). "Faster Video Diffusion with Trainable Sparse Attention." NeurIPS 2025.
CV
Education
- Ph.D in Version Control Theory, GitHub University, 2018 (expected)
- M.S. in Jekyll, GitHub University, 2014
- B.S. in GitHub, GitHub University, 2012
Work experience
- Spring 2024: Academic Pages Collaborator
- GitHub University
- Duties includes: Updates and improvements to template
- Supervisor: The Users
- Fall 2015: Research Assistant
- GitHub University
- Duties included: Merging pull requests
- Supervisor: Professor Hub
- Summer 2015: Research Assistant
- GitHub University
- Duties included: Tagging issues
- Supervisor: Professor Git
Skills
- Skill 1
- Skill 2
- Sub-skill 2.1
- Sub-skill 2.2
- Sub-skill 2.3
- Skill 3
Publications
Fast Video Generation with Sliding Tile Attention
Peiyuan Zhang, Yongqi Chen, Runlong Su, Hangliang Ding, Ion Stoica, Zhengzhong Liu, Hao Zhang. (2025). "Fast Video Generation with Sliding Tile Attention." ICML 2025.
Attn-QAT: 4-Bit Attention With Quantization-Aware Training
Peiyuan Zhang*, Matthew Noto*, Wenxuan Tan*, Chengquan Jiang, Will Lin, Wei Zhou, Hao Zhang. (2025). "Attn-QAT: 4-Bit Attention With Quantization-Aware Training." Preprint.
Long Context Transfer from Language to Vision
Peiyuan Zhang*, Kaichen Zhang*, Bo Li*, Guangtao Zeng, Jingkang Yang, Yuanhan Zhang, Ziyue Wang, Haoran Tan, Chunyuan Li, Ziwei Liu. (2024). "Long Context Transfer from Language to Vision." TMLR.
One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
Guangtao Zeng*, Peiyuan Zhang*, Wei Lu. (2023). "One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning." ACL 2023 Long Paper.
Better Few-Shot Relation Extraction with Label Prompt Dropout
Peiyuan Zhang, Wei Lu. (2022). "Better Few-Shot Relation Extraction with Label Prompt Dropout." EMNLP 2022 Long Paper.
Talks
Conference Proceeding talk 3 on Relevant Topic in Your Field
Conference proceedings talk at Testing Institute of America 2014 Annual Conference, Los Angeles, CA, USA
Talk 2 on Relevant Topic in Your Field
Talk at London School of Testing, London, UK
Tutorial 1 on Relevant Topic in Your Field
Tutorial at UC-Berkeley Institute for Testing Science, Berkeley, CA, USA
Talk 1 on Relevant Topic in Your Field
Talk at UC San Francisco, Department of Testing, San Francisco, CA, USA
Teaching
Service and leadership
- Currently signed in to 43 different slack teams