Signature



One model, two roles: emergent specialization in a shared recurrent Transformer
May 2026 We published a new blog post on our AI-OWLS page, summarising our recent arXiv preprint with Jucheng Shen and Barbara Su on whether a shared-weight recurrent Transformer can develop multiple internal roles on its own.
From PCA to LoRA: why fine-tuning could have been parallel all along
May 2026 We published a new blog post on our AI-OWLS page, summarising our recent arXiv preprint with Barbara Su and Fangshuo (Jasper) Liao on parallel rank-one deflation for low-rank fine-tuning.
GHOST: pruning Mamba2 by what each channel actually does
May 2026 We published a new blog post on our AI-OWLS page, summarising our ICML 2026 paper with Michael Menezes on state pruning for Mamba2 selective state-space models.
How a little Gaussian dust changes how a network learns
May 2026 We published a new blog post on our AI-OWLS page, summarising our recent paper with Afroditi Kolomvaki, Fangshuo (Jasper) Liao, Evan Dramko, and Ziyun Guang on training two-layer ReLU networks under multiplicative Gaussian input noise.
Why Stochastic Gradient Descent Stops Just Short of the Edge
Apr 2026 We published a new blog post on our AI-OWLS page, summarising our recent paper with Fangshuo (Jasper) Liao and Afroditi Kolomvaki on the Edge of Stochastic Stability.
Provable Acceleration of Nesterov's Momentum for Deep ReLU Networks
Apr 2026 We published a new blog post on our AI-OWLS page, summarising our ALT 2024 paper with Fangshuo (Jasper) Liao on provable accelerated convergence of Nesterov’s momentum for deep ReLU neural networks.
Spectral vs. Combinatorial for Max-3-Cut
Apr 2026 We published a new blog post on our explore-quantum page, comparing spectral and combinatorial construction heuristics for Max-3-Cut.
Randomized Rank-2 for Max-3-Cut — When Two Eigenvectors Beat One
Apr 2026 We published a new blog post on our explore-quantum page, introducing a 3-phase spectral pipeline for Max-3-Cut that outperforms simulated annealing on half of the graph families tested.
Rank-1 as a Building Block for Million-Node Max-3-Cut
Apr 2026 We published a new blog post on our explore-quantum page, describing how three algorithmic insights make rank-1 spectral methods practical at extreme scale for Max-3-Cut.
What Can 15 Obsolete GPUs Do for Combinatorial Optimization?
Mar 2026 We published a follow-up blog post on our explore-quantum page, describing our GPU-parallel implementation of the low-rank Max-K-Cut solver.
Exploiting Low-Rank Structure in Max-K-Cut Problems
Mar 2026 We published a new blog post on our explore-quantum page, describing our work on exploiting low-rank structure in Max-K-Cut problems.
Major update
May 2024 Several updates happened in the past months: 1 paper was accepted at ICLR 2024 on adaptive step size for federated learning; 1 paper was accepted at ICML 2024 on the first work on how error propagates in deflation PCA; 1 paper was accepted at ISIT 2024 on a fast algorithm for FixMatch; and 1 paper was accepted at ICRA 2024. This constitutes the update of OptimaLab for the past 5 months. More details are in the Publications webpage or Google Scholar.
Major update
Jan 2024 Several updates happened in the past months: 1 paper was accepted at ICRC with the best poster award (Congrats, David Quiroga); 1 paper was accepted at ALT 2024; 1 paper was accepted at CPAL 2024; 1 paper accepted at NeurIPS 2023; 1 paper accepted at ICCV 2023; 1 paper accepted at ACML 2023; 1 journal accepted at the International Union of Crystallography Journal; and 1 journal paper accepted at the Machine Learning Journal (Springer). This constitutes the update of OptimaLab for the past 5 months. More details are in the Publications webpage or Google Scholar.
Major update
Apr 2023 OptimaLab has received an Amazon Research Award (ARA) and a Microsoft Research Award! Thank you sponsors!
Major update
Apr 2023 3 papers accepted at AISTATS 2023; 1 paper accepted at ICASSP; 1 paper accepted at ICRA; 2 journal publications on GIST and fast quantum tomography: This constitutes the update of OptimaLab the past 5 months. More details in the Publications webpage or Google Scholar.
Journal on neural network training accepted at Transactions on Machine Learning Research (TMLR)
Aug 2022 Fangshuo (Jasper) Liao has led the effort to prove why and when one can achieve this by iteratively creating, training, and combining randomly selected subnetworks in deep learning. The journal is accepted at the Transactions on Machine Learning Research (TMLR) - details below.
Two papers accepted at UAI 2022
Distributed factored gradient descent for QST is accepted at L-CSS/CDC
Rice joins forces on deep learning + biosciences (Nature Communications)
Jun 2022 Through a collaborative effort among several departments within Rice, there is now available an overview paper on current progress and open challenges for applying deep learning across the biosciences. More details in the article that follows:
IST paper is accepted at VLDB 2022
Two papers accepted at L4DC 2022
Two papers accepted at ICASSP 2022
REX - Revisiting Budgeted Training with an Improved Schedule is accepted at MLSys 2022
PipeGCN - Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication is accepted at ICLR 2022
Feb 2022 Our paper on PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication is accepted at the Tenth International Conference on Learning Representations (ICLR 2022).
Mitigating deep double descent by concatenating inputs is accepted at CIKM 2021
More...