default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDKaiyue Wen
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
2020 – today
- 2025
[c11]Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin:
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models. ACL (1) 2025: 5005-5018- [c10]Shengguang Wu, Fan-Yun Sun, Kaiyue Wen, Nick Haber:
Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images. ACL (1) 2025: 30284-30297 - [c9]Kaiyue Wen, Zhiyuan Li, Jason S. Wang, David Leo Wright Hall, Percy Liang, Tengyu Ma:
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View. ICLR 2025 - [c8]Kaiyue Wen, Xingyu Dang, Kaifeng Lyu:
RNNs are not Transformers (Yet): The Key Bottleneck on In-Context Retrieval. ICLR 2025 - [c7]Kaiyue Wen, Huaqing Zhang, Hongzhou Lin, Jingzhao Zhang:
From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency. ICLR 2025 - [i18]Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin:
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models. CoRR abs/2501.11873 (2025) - [i17]Amirhesam Abedsoltan, Huaqing Zhang, Kaiyue Wen, Hongzhou Lin, Jingzhao Zhang, Mikhail Belkin:
Task Generalization With AutoRegressive Compositional Structure: Can Learning From D Tasks Generalize to DT Tasks? CoRR abs/2502.08991 (2025) - [i16]Shengguang Wu, Fan-Yun Sun, Kaiyue Wen, Nick Haber:
Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images. CoRR abs/2502.13928 (2025) - [i15]Jacob Mitchell Springer, Sachin Goyal, Kaiyue Wen, Tanishq Kumar, Xiang Yue, Sadhika Malladi, Graham Neubig, Aditi Raghunathan:
Overtrained Language Models Are Harder to Fine-Tune. CoRR abs/2503.19206 (2025) - [i14]Xingyu Dang, Christina Baek, Kaiyue Wen, Zico Kolter, Aditi Raghunathan:
Weight Ensembling Improves Reasoning in Language Models. CoRR abs/2504.10478 (2025) - [i13]Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, Junyang Lin:
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free. CoRR abs/2505.06708 (2025) - [i12]Songlin Yang, Yikang Shen, Kaiyue Wen, Shawn Tan, Mayank Mishra, Liliang Ren, Rameswar Panda, Yoon Kim:
PaTH Attention: Position Encoding via Accumulating Householder Transformations. CoRR abs/2505.16381 (2025) - [i11]Jiazheng Li, Hong Lu, Kaiyue Wen, Zaiwen Yang, Jiaxuan Gao, Hongzhou Lin, Yi Wu, Jingzhao Zhang:
QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentation. CoRR abs/2507.13266 (2025) - 2024
- [i10]Kaiyue Wen, Xingyu Dang, Kaifeng Lyu:
RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval. CoRR abs/2402.18510 (2024) - [i9]Kaiyue Wen, Zhiyuan Li, Jason S. Wang, David Hall, Percy Liang, Tengyu Ma:
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective. CoRR abs/2410.05192 (2024) - [i8]Kaiyue Wen, Huaqing Zhang, Hongzhou Lin, Jingzhao Zhang:
From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency. CoRR abs/2410.05459 (2024) - 2023
- [c6]Kaiyue Wen, Tengyu Ma, Zhiyuan Li:
How Sharpness-Aware Minimization Minimizes Sharpness? ICLR 2023 - [c5]Kaiyue Wen, Jiaye Teng, Jingzhao Zhang:
Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models. ICLR 2023 - [c4]Kaiyue Wen, Zhiyuan Li, Tengyu Ma:
Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization. NeurIPS 2023 - [c3]Kaiyue Wen, Yuchen Li, Bingbin Liu, Andrej Risteski:
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars. NeurIPS 2023 - [i7]Haozhe Jiang, Kaiyue Wen, Yilei Chen:
Practically Solving LPN in High Noise Regimes Faster Using Neural Networks. CoRR abs/2303.07987 (2023) - [i6]Kaiyue Wen, Zhiyuan Li
, Tengyu Ma:
Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization. CoRR abs/2307.11007 (2023) - [i5]Kaiyue Wen, Yuchen Li, Bingbin Liu, Andrej Risteski:
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars. CoRR abs/2312.01429 (2023) - [i4]Haozhe Jiang, Kaiyue Wen, Yilei Chen:
Practically Solving LPN in High Noise Regimes Faster Using Neural Networks. IACR Cryptol. ePrint Arch. 2023: 372 (2023) - 2022
- [c2]Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, Lei Hou, Zhiyuan Liu, Juanzi Li:
Finding Skill Neurons in Pre-trained Transformer-based Language Models. EMNLP 2022: 11132-11152 - [c1]Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou:
On Transferability of Prompt Tuning for Natural Language Processing. NAACL-HLT 2022: 3949-3969 - [i3]Kaiyue Wen, Jiaye Teng, Jingzhao Zhang:
Realistic Deep Learning May Not Fit Benignly. CoRR abs/2206.00501 (2022) - [i2]Kaiyue Wen, Tengyu Ma, Zhiyuan Li:
How Does Sharpness-Aware Minimization Minimize Sharpness? CoRR abs/2211.05729 (2022) - [i1]Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, Lei Hou, Zhiyuan Liu, Juanzi Li:
Finding Skill Neurons in Pre-trained Transformer-based Language Models. CoRR abs/2211.07349 (2022)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from 
to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the 
of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from 
, 
, and 
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from 
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2025-08-27 20:29 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by:
