Omics data are high-dimensional, heterogeneous and often incomplete, so how many sub-populations there are, and which variables define them, is itself the scientific question.
Dendrograms of mixing measures233 maize genotypes, leaf proteomics
Dendrograms of mixing measures for softmax-gated Gaussian mixture of experts: consistency without model sweeps
Method. Fit one over-specified softmax-gated mixture of experts and merge its experts along a dendrogram of the mixing measure: a consistent, sweep-free choice of the number of experts, with finite-sample rates for parameter estimation.
Insight. For 233 maize genotypes, predicting water use from leaf-protein abundances measured under water deficit (973 proteins, screened to 10), the dendrogram selects two experts, read as two broad genotype-phenotype response regimes, where AIC picks 18 and BIC and ICL pick one. In simulations it stays correct under ε-contamination, while AIC, BIC and ICL over-select as the sample grows.
Impact. One over-fitted model, instead of a sweep over model sizes, gives both the number of experts and an interpretable hierarchy of genotype groups: a practical summary of heterogeneity in omics-assisted trait prediction.
Bayesian order selectionRice Diversity Panel; maize leaf proteome
Voronoi-calibrated order selection for Bayesian softmax-gated mixtures of experts
Method. A post-processor (V-MTM) for Bayesian softmax-gated Gaussian mixtures of experts: fit one deliberately over-specified model, then merge and truncate its experts with a Voronoi loss to recover the number of experts, with an order-recovery guarantee, instead of fitting and comparing a model for every candidate order.
Insight. On the Rice Diversity Panel (373 accessions; flowering time and plant height from four genotype principal components) it selects six experts (90% credible set 5 to 7) where variational inference, BIC and ICL all select one; the experts recover the panel’s five classical subpopulations almost one-to-one (adjusted Rand index 0.754), and five-fold held-out predictive density is worst at one expert. On a maize leaf proteome measured under well-watered and water-deficit treatments (248 genotypes, 954 proteins) it selects two experts that reproduce the withheld treatment (adjusted Rand index 0.913 with five principal components), a case the paper notes is easy.
Impact. Choosing the number of experts from a single posterior fit, with its uncertainty, makes mixtures of experts practical for population-structured biological data, and the same question sets the size of sparse expert layers in modern deep learning.
Incremental stochastic MMMaize proteomics; Communities and Crime
Revisiting incremental stochastic majorization-minimization algorithms with applications to mixture of experts
Method. An incremental stochastic majorization-minimization algorithm for high-volume or streaming data that generalizes incremental stochastic EM, needs no explicit latent-variable representation and provably converges to stationary points; it fits softmax-gated mixture-of-experts regression, for which no stochastic EM algorithm is available.
Insight. On 233 maize genotypes under water deficit (973 leaf proteins, Lasso-screened to 11 inputs) it has the lowest test error, MSE 0.116 against 0.132-0.133 for SGD, Adam, AdamW, RMSProp and Sophia. On the Communities and Crime data (1,994 U.S. communities, violent-crime rate) the incremental variants give the best MSE, MAPE and NRMSE.
Impact. Processing one observation per iteration, with convergence guarantees, makes mixture-of-experts regression practical where batch algorithms that revisit the full dataset are too slow.
MM training and dendrogram selectionProtein-protein interactions (DIP)
Fast model selection and stable optimization for softmax-gated multinomial-logistic mixture of experts models
Method. A batch minorization-maximization algorithm with closed-form updates and guaranteed monotone ascent for softmax-gated multinomial-logistic mixtures of experts, finite-sample rates, and dendrograms of mixing measures that choose the number of experts from a single fit.
Insight. On protein-protein interaction prediction (protein pairs from the DIP database, described by amino-acid composition), the dendrogram picks three experts, where ICL picks two (F1 0.66) and AIC and BIC pick four for only marginal gains. The three-expert model reaches F1 0.80 (recall 0.88), ahead of naive Bayes, random forest, SVM, logistic regression and a three-hidden-layer MLP (F1 0.72-0.77).
Impact. Stable training and single-fit model selection give compact, interpretable mixture-of-experts classifiers for heterogeneous biological prediction tasks.
Variable selection under MNARArabidopsis thaliana transcriptome
A unified framework for variable selection in model-based clustering with missing not at random
Method. A penalized Gaussian-mixture clustering with a data-driven penalty for variable selection and an MNARz mechanism that models the dependence between missingness and the latent class, with proven selection and asymptotic consistency.
Insight. On the 1,267-gene Arabidopsis thaliana transcriptome (27 conditions from seven projects), it finds 18 clusters and keeps four projects as the core clustering variables, agreeing with earlier analyses on the role of iron signalling, while showing that two projects previously selected as drivers are, once missingness is modelled, explained by the core four.
Impact. Clustering with variable selection that stays reliable when whether a value is missing depends on the hidden group, a common situation in transcriptomics.