-
FlowMM: Generating Materials with Riemannian Flow Matching
Authors:
Benjamin Kurt Miller,
Ricky T. Q. Chen,
Anuroop Sriram,
Brandon M Wood
Abstract:
Crystalline materials are a fundamental component in next-generation technologies, yet modeling their distribution presents unique computational challenges. Of the plausible arrangements of atoms in a periodic lattice only a vanishingly small percentage are thermodynamically stable, which is a key indicator of the materials that can be experimentally realized. Two fundamental tasks in this area ar…
▽ More
Crystalline materials are a fundamental component in next-generation technologies, yet modeling their distribution presents unique computational challenges. Of the plausible arrangements of atoms in a periodic lattice only a vanishingly small percentage are thermodynamically stable, which is a key indicator of the materials that can be experimentally realized. Two fundamental tasks in this area are to (a) predict the stable crystal structure of a known composition of elements and (b) propose novel compositions along with their stable structures. We present FlowMM, a pair of generative models that achieve state-of-the-art performance on both tasks while being more efficient and more flexible than competing methods. We generalize Riemannian Flow Matching to suit the symmetries inherent to crystals: translation, rotation, permutation, and periodic boundary conditions. Our framework enables the freedom to choose the flow base distributions, drastically simplifying the problem of learning crystal structures compared with diffusion models. In addition to standard benchmarks, we validate FlowMM's generated structures with quantum chemistry calculations, demonstrating that it is about 3x more efficient, in terms of integration steps, at finding stable materials compared to previous open methods.
△ Less
Submitted 7 June, 2024;
originally announced June 2024.
-
Generative Coarse-Graining of Molecular Conformations
Authors:
Wujie Wang,
Minkai Xu,
Chen Cai,
Benjamin Kurt Miller,
Tess Smidt,
Yusu Wang,
Jian Tang,
Rafael Gómez-Bombarelli
Abstract:
Coarse-graining (CG) of molecular simulations simplifies the particle representation by grouping selected atoms into pseudo-beads and drastically accelerates simulation. However, such CG procedure induces information losses, which makes accurate backmapping, i.e., restoring fine-grained (FG) coordinates from CG coordinates, a long-standing challenge. Inspired by the recent progress in generative m…
▽ More
Coarse-graining (CG) of molecular simulations simplifies the particle representation by grouping selected atoms into pseudo-beads and drastically accelerates simulation. However, such CG procedure induces information losses, which makes accurate backmapping, i.e., restoring fine-grained (FG) coordinates from CG coordinates, a long-standing challenge. Inspired by the recent progress in generative models and equivariant networks, we propose a novel model that rigorously embeds the vital probabilistic nature and geometric consistency requirements of the backmapping transformation. Our model encodes the FG uncertainties into an invariant latent space and decodes them back to FG geometries via equivariant convolutions. To standardize the evaluation of this domain, we provide three comprehensive benchmarks based on molecular dynamics trajectories. Experiments show that our approach always recovers more realistic structures and outperforms existing data-driven methods with a significant margin.
△ Less
Submitted 16 June, 2022; v1 submitted 28 January, 2022;
originally announced January 2022.
-
Relevance of Rotationally Equivariant Convolutions for Predicting Molecular Properties
Authors:
Benjamin Kurt Miller,
Mario Geiger,
Tess E. Smidt,
Frank Noé
Abstract:
Equivariant neural networks (ENNs) are graph neural networks embedded in $\mathbb{R}^3$ and are well suited for predicting molecular properties. The ENN library e3nn has customizable convolutions, which can be designed to depend only on distances between points, or also on angular features, making them rotationally invariant, or equivariant, respectively. This paper studies the practical value of…
▽ More
Equivariant neural networks (ENNs) are graph neural networks embedded in $\mathbb{R}^3$ and are well suited for predicting molecular properties. The ENN library e3nn has customizable convolutions, which can be designed to depend only on distances between points, or also on angular features, making them rotationally invariant, or equivariant, respectively. This paper studies the practical value of including angular dependencies for molecular property prediction directly via an ablation study with \texttt{e3nn} and the QM9 data set. We find that, for fixed network depth and parameter count, adding angular features decreased test error by an average of 23%. Meanwhile, increasing network depth decreased test error by only 4% on average, implying that rotationally equivariant layers are comparatively parameter efficient. We present an explanation of the accuracy improvement on the dipole moment, the target which benefited most from the introduction of angular features.
△ Less
Submitted 24 November, 2020; v1 submitted 19 August, 2020;
originally announced August 2020.
-
Finding Symmetry Breaking Order Parameters with Euclidean Neural Networks
Authors:
Tess E. Smidt,
Mario Geiger,
Benjamin Kurt Miller
Abstract:
Curie's principle states that "when effects show certain asymmetry, this asymmetry must be found in the causes that gave rise to them". We demonstrate that symmetry equivariant neural networks uphold Curie's principle and can be used to articulate many symmetry-relevant scientific questions into simple optimization problems. We prove these properties mathematically and demonstrate them numerically…
▽ More
Curie's principle states that "when effects show certain asymmetry, this asymmetry must be found in the causes that gave rise to them". We demonstrate that symmetry equivariant neural networks uphold Curie's principle and can be used to articulate many symmetry-relevant scientific questions into simple optimization problems. We prove these properties mathematically and demonstrate them numerically by training a Euclidean symmetry equivariant neural network to learn symmetry-breaking input to deform a square into a rectangle and to generate octahedra tilting patterns in perovskites.
△ Less
Submitted 26 October, 2020; v1 submitted 4 July, 2020;
originally announced July 2020.
-
Chemical Kinetics for Operando Electron Microscopy of Catalysts: 3D Modeling of Gas and Temperature Distributions During Catalytic Reactions
Authors:
Joshua L. Vincent,
Jarod W. Vance,
Jayse T. Langdon,
Benjamin K. Miller,
Peter A. Crozier
Abstract:
$\textit{In situ}$ environmental transmission electron microscopy (ETEM) is a powerful tool for observing structural modifications taking place in heterogeneous catalysts under reaction conditions. However, to strengthen the link between catalyst structure and functionality, an $\textit{operando}…
▽ More
$\textit{In situ}$ environmental transmission electron microscopy (ETEM) is a powerful tool for observing structural modifications taking place in heterogeneous catalysts under reaction conditions. However, to strengthen the link between catalyst structure and functionality, an $\textit{operando}$ measurement must be performed in which reaction kinetics and catalyst structure are simultaneously determined. To determine chemical kinetics for gas-phase catalysis, it is necessary to develop a reliable chemical engineering model to describe catalysis as well as heat and mass transport processes within the ETEM cell. Here, we establish a finite element model to determine the gas and temperature profiles during catalysis in an open-cell operando ETEM experiment. The model is applied to a $SiO_2$-supported Ru catalyst performing CO oxidation. Good agreement is achieved between simulated compositions and those measured experimentally across a temperature range of 25 - 350 °C. In general, for lower conversions, the simulations show that the temperature and gas are relatively homogeneous within the hot zone of the TEM holder where the catalyst is located. The uniformity of gas and temperature indicates that the ETEM reactor system behavior approximates that of a continuously stirred tank reactor. The large degree of gas-phase uniformity also allows one to estimate the catalytic conversion of reactants in the cell to within 10 percent using electron energy-loss spectroscopy. Moreover, the findings indicate that for reactant conversions below 30 percent, one can reliably evaluate the steady-state reaction rate of catalyst nanoparticles that are imaged on the TEM grid.
△ Less
Submitted 14 July, 2020; v1 submitted 23 March, 2020;
originally announced March 2020.
