Research & Publications

Research & publications

My research program and its full publication record in one place: a research overview, then the grouped catalogue across 8 CV subsections covering 40 outputs. Many results are also available as interactive demonstrations.

Filter

Catalogue

40 outputs grouped across 8 CV subsections.

Research overview

My research program sits at the intersection of mathematical statistics, machine learning, and scientific applications. I design methods that are theoretically justified, computationally scalable, and practically valuable. The full publication catalogue follows below; many of these results are available as interactive demonstrations.

Statistical theory

Model selection, oracle inequalities, penalisation, minimal penalties, missing-data methodology, and non-asymptotic analysis for heterogeneous and high-dimensional models.

Mixture-of-experts models

Approximation theory, parameter estimation, identifiability, scalable optimisation, sparse modelling, and uncertainty-aware inference for mixture-of-experts and related conditional mixture models.

Bayesian computation

Bayesian synthetic likelihood, surrogate posteriors, MCMC, variational methods, uncertainty quantification, and principled probabilistic inference under computational and modelling constraints.

AI for science

Applications in systems biology, genomics, transcriptomics, proteomics, and scientific machine learning, with a focus on interpretable and trustworthy methods for real scientific discovery.

Scalability and robustness in scientific statistical machine learning

Revisiting Incremental Stochastic Majorization-Minimization Algorithms with Applications to Mixture of Experts

TrungKhang Tran; TrungTin Nguyen; Gersende Fort; Tung Doan; Hien Duy Nguyen; Binh T Nguyen; Florence Forbes; Christopher Drovandi
Preprint
2026 · arXiv preprint arXiv:2601.19811

Fast Model Selection and Stable Optimization for Softmax-Gated Multinomial-Logistic Mixture of Experts Models

TrungKhang Tran; TrungTin Nguyen; Md Abul Bashar; Nhat Ho; Richi Nayak; Christopher Drovandi
Preprint
2026 · arXiv preprint arXiv:2602.07997

Bayesian Parameter Balancing Enables Robust and Consistent Estimation of Kinetic Parameter Uncertainty

TrungTin Nguyen; Binh H. Ho; Michael Pan; Jennifer A. Flegg; Michael J. McDonald; Christopher Drovandi
Preprint
2026 · bioRxiv

StructSAM: Structure- and Spectrum-Preserving Token Merging for Segment Anything Models

Duy M. H. Nguyen; Tuan A. Tran; Duong Nguyen; Siwei Xie; Trung Q. Nguyen; Mai T. N. Truong; Daniel Palenicek; An T. Le; Michael Barz; Eric Hannus; TrungTin Nguyen; Tuan Dam; Tran Le; Ngan Le; Minh Vu; Khoa Doan; Vien Ngo; Pengtao Xie; James Zou; Daniel Sonntag; Jan Peters; Mathias Niepert
Workshop
2026 · ICML 2026 Workshop on AdaptFM: Resource-Adaptive Foundation Model Inference

Lambda-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies

Minh Long Nguyen; Thanh Long Vu; Christopher Drovandi; Leah F. South; TrungTin Nguyen
Workshop
2026 · ICML 2026 Workshop on Hypothesis Testing

StructSAM: Structure- and Spectrum-Preserving Token Merging for Segment Anything Models

Duy M. H. Nguyen; Tuan A. Tran; Duong Nguyen; Siwei Xie; Trung Q. Nguyen; Mai T. N. Truong; Daniel Palenicek; An T. Le; Michael Barz; Eric Hannus; TrungTin Nguyen; Tuan Dam; Tran Le; Ngan Le; Minh Vu; Khoa Doan; Vien Ngo; Pengtao Xie; James Zou; Daniel Sonntag; Jan Peters; Mathias Niepert
Preprint
2026 · arXiv preprint arXiv:2603.07307

Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency Without Model Sweeps

Do Tien Hai; Trung Nguyen Mai; TrungTin Nguyen; Nhat Ho; Binh T Nguyen; Christopher Drovandi
Conference
2026 · Proceedings of The 29th International Conference on Artificial Intelligence and Statistics, AISTATS 2026 Spotlight Acceptance rate 2.5% over 2102 submissions.

Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures

Tuan Thai; TrungTin Nguyen; Dat Do; Nhat Ho; Christopher Drovandi
Preprint
2025 · arXiv preprint arXiv:2505.13052

Accelerating Transformers with Spectrum-Preserving Token Merging

Hoai-Chau Tran; Duy MH Nguyen; Manh-Duy Nguyen; TrungTin Nguyen; Ngan Hoang Le; Pengtao Xie; Daniel Sonntag; James Zou; Binh T. Nguyen; Mathias Niepert
Conference
2024 · Advances in Neural Information Processing Systems, NeurIPS 2024 Acceptance rate 25.8% over 15671 submissions.

HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts

Truong Giang Do; Khiem Le; Quang Pham; TrungTin Nguyen; Thanh-Nam Doan; Binh T. Nguyen; Chenghao Liu; Savitha Ramasamy; Xiaoli Li; Steven Hoi
Conference
2023 · Proceedings of the 2023 Empirical Methods in Natural Language Processing, EMNLP 2023 Main Acceptance rate 14% over 1041 submissions.

Model selection

A non-asymptotic risk bound for model selection in high-dimensional mixture of experts via joint rank and variable selection

TrungTin Nguyen; Dung Ngoc Nguyen; Hien Duy Nguyen; Faicel Chamroukhi
Conference
2023 · Australasian Joint Conference on Artificial Intelligence 2023, AJCAI 2023 Long Oral Presentation Acceptance rate 11% over 213 submissions.

Model selection by penalization in mixture of experts models with a non-asymptotic approach

TrungTin Nguyen; Faicel Chamroukhi; Hien Duy Nguyen; Florence Forbes
Conference
2022 · JDS 2022 - 53èmes Journées de Statistique de la Société Française de Statistique (SFdS)

Model Selection and Approximation in High-dimensional Mixtures of Experts Models: From Theory to Practice

TrungTin Nguyen
Thesis
2021 · PhD Thesis, Normandie Université

An l1-oracle inequality for the Lasso in high-dimensional mixtures of experts models

TrungTin Nguyen; Hien D Nguyen; Faicel Chamroukhi; Geoffrey J. McLachlan
Preprint
2020 · arXiv preprint arXiv:2009.10622

Approximation capabilities and convergence rates of the mixture of experts models

Approximation rates for finite mixtures of location-scale models

Hien Duy Nguyen; TrungTin Nguyen; Jacob Westerhout; Xin Guo
Preprint
2025 · arXiv preprint arXiv:2508.10612

Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts

Huy Nguyen; TrungTin Nguyen; Khai Nguyen; Nhat Ho
Conference
2024 · Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, AISTATS 2024 Acceptance rate 27.6% over 1980 submissions.

A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts

Huy Nguyen; Pedram Akbarian; TrungTin Nguyen; Nhat Ho
Conference
2024 · Proceedings of the 41st International Conference on Machine Learning, ICML 2024 Acceptance rate 27.5% over 9473 submissions.

Demystifying Softmax Gating Function in Gaussian Mixture of Experts

Huy Nguyen; TrungTin Nguyen; Nhat Ho
Conference
2023 · Advances in Neural Information Processing Systems, NeurIPS 2023 Spotlight Acceptance rate 3.6% over 12343 submissions.

Approximation of probability density functions via location-scale finite mixtures in Lebesgue spaces

TrungTin Nguyen; Faicel Chamroukhi; Hien D. Nguyen; Geoffrey J. McLachlan
Journal
2022 · Communications in Statistics - Theory and Methods

Approximations of conditional probability density functions in Lebesgue spaces via mixture of experts models

Hien Duy Nguyen; TrungTin Nguyen; Faicel Chamroukhi; Geoffrey J. McLachlan
Journal
2021 · Journal of Statistical Distributions and Applications

Deep neural networks

FACET: A Fragment-Aware Conformer Ensemble Transformer

Duy M. H. Nguyen; Trung Q. Nguyen; Ha T. H. Le; Mai Thanh Nhat Truong; TrungTin Nguyen; Nhat Ho; Khoa D. Doan; Duy Duong-Tran; Li Shen; Daniel Sonntag; James Zou; Mathias Niepert; Hyojin Kim; Jonathan E. Allen
Conference
2026 · The Fourteenth International Conference on Learning Representations, ICLR 2026 Acceptance rate 28% over close to 19000 submissions.

From Fragments to Geometry: A Unified Graph Transformer for Molecular Representation from Conformer Ensembles

Duy Minh Ho Nguyen; Trung Quoc Nguyen; Ha Thi Hong Le; Mai Thanh Nhat Truong; TrungTin Nguyen; Nhat Ho; Khoa D. Doan; Duy Duong-Tran; Li Shen; Daniel Sonntag; James Zou; Mathias Niepert; Hyojin Kim; Jonathan E. Allen
Workshop
2025 · ICML 2025 Generative AI and Biology (GenBio) Workshop

ExGra-Med: Extended Context Graph Alignment for Medical Vision-Language Models

Duy M. H. Nguyen; Nghiem T. Diep; Trung Q. Nguyen; Hoang-Bao Le; Tai Nguyen; Tien Nguyen; TrungTin Nguyen; Nhat Ho; Pengtao Xie; Roger Wattenhofer; James Zou; Daniel Sonntag; Mathias Niepert
Conference
2025 · NeurIPS 2025 (Advances in Neural Information Processing Systems 38)

Enriched Instruction-Following Graph Alignment for Efficient Medical Vision-Language Models

Duy M. H. Nguyen; Nghiem T. Diep; Trung Q. Nguyen; Hoang-Bao Le; Tai Nguyen; Tien Nguyen; TrungTin Nguyen; Nhat Ho; Pengtao Xie; Roger Wattenhofer; Daniel Sonntag; James Zou; Mathias Niepert
Workshop
2025 · ICML 2025 Workshop on Multi-modal Foundation Models and Large Language Models for Life Sciences

CompeteSMoE--Effective Training of Sparse Mixture of Experts via Competition

Quang Pham; Giang Do; Huy Nguyen; TrungTin Nguyen; Chenghao Liu; Mina Sartipi; Binh T. Nguyen; Savitha Ramasamy; Xiaoli Li; Steven Hoi; Nhat Ho
Preprint
2024 · arXiv preprint arXiv:2402.02526

Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks

Duy Minh Ho Nguyen; Nina Lukashina; Tai Nguyen; An Thai Le; TrungTin Nguyen; Nhat Ho; Jan Peters; Daniel Sonntag; Viktor Zaverkin; Mathias Niepert
Conference
2024 · Proceedings of the 41st International Conference on Machine Learning, ICML 2024 Acceptance rate 27.5% over 9473 submissions.

Simulation-based inference

Bayesian Likelihood Free Inference using Mixtures of Experts

Hien Duy Nguyen; TrungTin Nguyen; Florence Forbes
Conference
2024 · International Joint Conference on Neural Networks, IJCNN 2024 Acceptance rate 52% over 3272 submissions.

Mixture of expert posterior surrogates for approximate Bayesian computation

Florence Forbes; Hien Duy Nguyen; TrungTin Nguyen; Julyan Arbel
Conference
2022 · JDS 2022 - 53èmes Journées de Statistique de la Société Française de Statistique (SFdS)

Approximate Bayesian computation with surrogate posteriors

Julyan Arbel; Florence Forbes; Hien Duy Nguyen; TrungTin Nguyen
Conference
2021 · ISBA 2021 - World Meeting of the International Society for Bayesian Analysis

Asymptotic statistics

On the Asymptotic Distribution of the Minimum Empirical Risk

Jacob Westerhout; TrungTin Nguyen; Xin Guo; Hien Duy Nguyen
Conference
2024 · Proceedings of the 41st International Conference on Machine Learning, ICML 2024 Acceptance rate 27.5% over 9473 submissions.

Bayesian nonparametrics

Bayesian nonparametric mixture of experts for high-dimensional inverse problems

TrungTin Nguyen; Florence Forbes; Julyan Arbel
Conference
2022 · BNP13 – 13th Conference on Bayesian Nonparametrics

Missing data

A Unified Framework for Variable Selection in Model-Based Clustering with Missing Not at Random

Binh H Ho; Long Nguyen Chi; TrungTin Nguyen; Binh T Nguyen; Van Ha Hoang; Christopher Drovandi
Conference
2025 · Advances in Neural Information Processing Systems, NeurIPS 2025 Acceptance rate 24.52% over 21575 submissions.