Spectra: Rethinking Optimizers for LLMs under Spectral Anisotropy
Published in In the proceedings of Proceedings of the 43rd International Conference on Machine Learning (ICML), 2026
Use Google Scholar for full citation
Recommended citation: Zhendong Huang, Hengjie Cao, Fang Dong, Ruijun Huang, Mengyi Chen, Yifeng Yang, Xin Zhang, Anrui Chen, Mingzhi Dong, Yujiang Wang, Jinlong Hou, Qin Lv, Robert Dick, Yuan Cheng, Fan Yang, Tun Lu, Li Shang, "Spectra: Rethinking Optimizers for LLMs under Spectral Anisotropy." In the proceedings of Proceedings of the 43rd International Conference on Machine Learning (ICML), 2026.