Publications (2023 — present)

Recent work from the AI-OWLS / OptimaLab group at Rice CS, in reverse chronological order.

One Model, Two Roles: Emergent Specialization in a Shared Recurrent Transformer. Jucheng Shen, Wenyi (Barbara) Su, Anastasios Kyrillidis. Preprint, arXiv:2605.17811, 2026. [arXiv] · [code] · [blog]
AdaPaD: Adaptive Parallel Deflation for PEFT with Self-Correcting Rank Discovery. Wenyi (Barbara) Su, Fangshuo Liao, Anastasios Kyrillidis. Preprint, arXiv:2605.10741, 2026. [arXiv] · [code] · [blog]
GHOST: Grouped Hidden-state Output-aware Selection and Truncation. Michael Menezes, Anastasios Kyrillidis. International Conference on Machine Learning (ICML), 2026. [arXiv] · [code] · [blog]
Stochastic Self-Stabilization at the Edge of Stability. Fangshuo Liao, Afroditi Kolomvaki, Anastasios Kyrillidis. Preprint, arXiv:2604.21016, 2026. [arXiv] · [blog]
Multiplicative Gaussian Input Noise for Two-Layer ReLU Networks. Afroditi Kolomvaki, Fangshuo Liao, Evan Dramko, Ziyun Guang, Anastasios Kyrillidis. Preprint, arXiv:2602.17423, 2026. [arXiv] · [blog]

Provable Model-Parallel Distributed Principal Component Analysis with Parallel Deflation. Fangshuo Liao, Wenyi (Barbara) Su, Anastasios Kyrillidis. Conference on Parsimony and Learning (CPAL), 2025. [OpenReview] · [blog]
Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation. Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed H. Awadallah, Anastasios Kyrillidis, Robert Sim. AAAI, 2025.

Provable Accelerated Convergence of Nesterov’s Momentum for Deep ReLU Neural Networks. Fangshuo Liao, Anastasios Kyrillidis. Algorithmic Learning Theory (ALT), 2024 (PMLR v237). [PMLR] · [blog]
On the Error-Propagation of Inexact Deflation for Principal Component Analysis. Fangshuo Liao, Junhyung Lyle Kim, Cruz Barnum, Anastasios Kyrillidis. International Conference on Machine Learning (ICML), 2024.
Fast FixMatch: Faster Semi-Supervised Learning with Curriculum Batch Size. John Chen, Chen Dun, Anastasios Kyrillidis. IEEE International Symposium on Information Theory (ISIT), 2024.
A Catalyst Framework for the Quantum Linear System Problem via the Proximal Point Algorithm. Junhyung Lyle Kim, Nai-Hui Chia, Anastasios Kyrillidis. Preprint, arXiv:2406.13879, 2024. [arXiv]

FedJETs: Efficient Just-In-Time Personalization with Federated Mixture of Experts. Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed H. Awadallah, Robert Sim, Anastasios Kyrillidis. Preprint, arXiv:2306.08586, 2023. [arXiv]

For older publications (pre-2023) and a more complete list, see akyrillidis.github.io.