Publications

Congjie He, Yeqi Huang, Pei Mu, Ziming Miao, Jilong Xue, Lingxiao Ma, Fan Yang, Luo Mai (2025). WaferLLM: Large Language Model Inference at Wafer Scale. OSDI 2025.

Code OSDI 2025 GitHub

Yinsicheng Jiang, Yao Fu, Yeqi Huang, Ping Nie, Zhan Lu, Leyang Xue, Congjie He, Man-Kit Sit, Jilong Xue, Li Dong, Ziming Miao, Dayou Du, Tairan Xu, Kai Zou, Edoardo Ponti, Luo Mai (2024). MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems. arXiv.

PDF DOI ArXiv

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai (2024). (OSDI 2024) ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models.

PDF DOI OSDI