Research
01
Foundation models · Federated learning · Edge AI
Federated Foundation Models at the Edge
My ongoing work explores how pretrained foundation models, including
large language models and mixture-of-experts architectures, can be
collaboratively trained, adapted, and deployed across distributed edge
clients without centralizing their local data.
Related publications
Server-Side Sparse Assignment for Federated Mixture-of-Experts
X. Zheng and A. Yener
Accepted to IEEE Information Theory Workshop, 2026
This work studies federated mixture-of-experts learning under partial
expert visibility, where resource-constrained clients can access only a
subset of experts. S3-MoE estimates client-specific expert relevance on
the server and uses an exploit–explore strategy to assign effective
sparse expert subsets.
Z. Luo, J. Cai, C. Le Denmat, S. Nair, F. Nourzad,
R. K. Sudha, Q. Wu, J. Zhang, S. Lee, Z. Li, P. Qiu,
S. Shah, R. Sharma, S. Srinivasan, Y. Xia,
X. Zheng, Z. Liu, B. Ying, K. Chowdhury,
G. Joshi, Y. Liang, R. Nowak, S. Parthasarathy, S. Prakash,
B. Ravindran, S. Shakkottai, N. B. Shroff, S. Srinivasan,
H. Yang, A. Yener, and J. Liu
ACM SIGCOMM Workshop on Networks for AI Computing, 2026
Z. Luo et al., including X. Zheng
Long paper accepted for poster presentation at the NeurIPS Workshop
on Collaborative, Open, and Decentralized Training of Foundation
Models (CODEC-FM), 2026
This follow-on long paper extends the earlier NAIC systems position
into a unified architecture and research roadmap for geo-distributed
LLM pretraining and fine-tuning across heterogeneous infrastructure.
Learning What to Load: Finite-Profile Stability of Task-Conditioned Resident Experts
X. Zheng and A. Yener
Accepted as a poster at DeepMath 2026
Research
02
Distribution shifts · Robust optimization
Performative and evolving federated learning
Deployed models can alter the data they later observe. This line of
work studies robust federated optimization and decentralized
learning over changing interaction graphs when model deployment,
network evolution, and data shifts are tightly coupled.
Research
03
Personalization · Secure aggregation
Private peer-to-peer collaboration without a central server
Personalized agents learn whom to collaborate with while keeping
individual models private. The work combines directed
collaboration graphs, clustering, and Shamir secret sharing for
practical secure aggregation in peer-to-peer networks.