I'm a Senior ML researcher and engineer who values simple, scalable solutions to hard problems affecting innovation. At Orbital, I build atomistic foundation models and post-train LLMs for accelerated materials discovery and hardware engineering, applied to carbon capture and data center cooling. I'm also the core maintainer of Orb, our open-source SoTA forcefield model.
I did my PhD in Machine Learning at the University of Edinburgh, advised by Michael Gutmann, focusing on probabilistic modelling with missing data. I also hold a BEng in Software Engineering from the University of Southampton.
We show that missing data increases the complexity of the posterior distribution of the latent variables in VAEs. To mitigate the increased posterior complexity we introduce two strategies based on (i) finite and (ii) imputation-based variational-mixtures.
We link a structured latent space in VAEs, a commonly desired property, to poor conditional sampling performance of Metropolis-within-Gibbs (MWG). To mitigate the issues of MWG we introduce two original methods for conditional sampling of VAEs: AC-MWG and LAIR.
We propose a new method for statistical model estimation from incomplete data, called variational Gibbs inference (VGI). Whilst being general-pupose, the proposed method outperforms existing VAE and normalising flow specific methods.
We propose an unsupervised representation learning method for a job title similarity model using noisy skill labels. We show that it is highly effective for tasks such as text ranking and job normalization.