-
Machine Learning for First Principles Calculations of Material Properties for Ferromagnetic Materials
Authors:
Markus Eisenbach,
Mariia Karabin,
Massimiliano Lupo Pasini,
Junqi Yin
Abstract:
The investigation of finite temperature properties using Monte-Carlo (MC) methods requires a large number of evaluations of the system's Hamiltonian to sample the phase space needed to obtain physical observables as function of temperature. DFT calculations can provide accurate evaluations of the energies, but they are too computationally expensive for routine simulations. To circumvent this probl…
▽ More
The investigation of finite temperature properties using Monte-Carlo (MC) methods requires a large number of evaluations of the system's Hamiltonian to sample the phase space needed to obtain physical observables as function of temperature. DFT calculations can provide accurate evaluations of the energies, but they are too computationally expensive for routine simulations. To circumvent this problem, machine-learning (ML) based surrogate models have been developed and implemented on high-performance computing (HPC) architectures. In this paper, we describe two ML methods (linear mixing model and HydraGNN) as surrogates for first principles density functional theory (DFT) calculations with classical MC simulations. These two surrogate models are used to learn the dependence of target physical properties from complex compositions and interactions of their constituents. We present the predictive performance of these two surrogate models with respect to their complexity while avoiding the danger of overfitting the model. An important aspect of our approach is the periodic retraining with newly generated first principles data based on the progressive exploration of the system's phase space by the MC simulation. The numerical results show that HydraGNN model attains superior predictive performance compared to the linear mixing model for magnetic alloy materials.
△ Less
Submitted 29 July, 2022; v1 submitted 20 July, 2022;
originally announced July 2022.
-
Ab initio Approaches to High Entropy Alloys: A Comparison of CPA, SQS, and Supercell Methods
Authors:
Mariia Karabin,
Wasim Mondal,
Andreas Ostlin,
Wai-Ga D. Ho,
Vladimir Dobrosavljevic,
Ka-Ming Tam,
Hanna Terletska,
Liviu Chioncel,
Yang Wang,
Markus Eisenbach
Abstract:
We present a comparative study of different modeling approaches to the electronic properties of the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy. Common to our modeling is the methodology to compute the one-particle Green's function in the framework of density functional theory. We demonstrate that the special quasi-random structure…
▽ More
We present a comparative study of different modeling approaches to the electronic properties of the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy. Common to our modeling is the methodology to compute the one-particle Green's function in the framework of density functional theory. We demonstrate that the special quasi-random structures modeling and the supercell, i.e. the locally self-consistent multiple-scatering methods provide very similar results for the ground state properties such as the spectral function (density of states) and the equilibrium lattice parameter. To reconcile the multiple-scattering single-site coherent potential approximation with the real space supercell methods, we included the effect of screening of the net charges of the alloy components. Based on the analysis of the total energy and spectral functions computed within the density functional theory, we found no signature for the long-range or local magnetic moments formation in the $\textrm{Hf}_{0.05}\textrm{Nb}_{0.05}\textrm{Ta}_{0.8}\textrm{Ti}_{0.05}\textrm{Zr}_{0.05}$ high entropy alloy, instead we find possible superconductivity below $\sim 9$K.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
-
Machine Learning the Effective Hamiltonian in High Entropy Alloys
Authors:
Xianglin Liu,
Jiaxin Zhang,
Markus Eisenbach,
Yang Wang
Abstract:
The development of machine learning sheds new light on the problem of statistical thermodynamics in multicomponent alloys. However, a data-driven approach to construct the effective Hamiltonian requires sufficiently large data sets, which is expensive to calculate with conventional density functional theory (DFT). To solve this problem, we propose to use the atomic local energy as the target varia…
▽ More
The development of machine learning sheds new light on the problem of statistical thermodynamics in multicomponent alloys. However, a data-driven approach to construct the effective Hamiltonian requires sufficiently large data sets, which is expensive to calculate with conventional density functional theory (DFT). To solve this problem, we propose to use the atomic local energy as the target variable, and harness the power of the linear-scaling DFT to accelerate the data generating process. Using the large amounts of DFT data sets, various complex models are devised and applied to learn the effective Hamiltonians of a range of refractory high entropy alloys (HEAs). The testing $R^2$ scores of the effective pair interaction model are higher than 0.99, demonstrating that the pair interactions within the 6-th coordination shell provide an excellent description of the atomic local energies for all the four HEAs. This model is further improved by including nonlinear and multi-site interactions. In particular, the deep neural networks (DNNs) built directly in the local configuration space (therefore no hand-crafted features) are employed to model the effective Hamiltonian. The results demonstrate that neural networks are promising for the modeling of effective Hamiltonian due to its excellent representation power.
△ Less
Submitted 31 December, 2019;
originally announced December 2019.
-
Fast and stable deep-learning predictions of material properties for solid solution alloys
Authors:
Massimiliano Lupo Pasini,
Ying Wai Li,
Junqi Yin,
Jiaxin Zhang,
Kipton Barros,
Markus Eisenbach
Abstract:
We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between different physical properties in alloy systems to improve the prediction accuracy of neural network (NN) models. We use multitasking NN models to simultaneously predic…
▽ More
We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between different physical properties in alloy systems to improve the prediction accuracy of neural network (NN) models. We use multitasking NN models to simultaneously predict the total energy, charge density and magnetic moment. These physical properties mutually serve as constraints during the training of the multitasking NN, resulting in more reliable DL models because multiple physics properties are correctly learned by a single model. Two binary alloys, copper-gold (CuAu) and iron-platinum (FePt), were studied. Our results show that once the multitasking NN's are trained, they can estimate the material properties for a specific configuration hundreds of times faster than first-principles density functional theory calculations while retaining comparable accuracy. We used a simple measure based on the root-mean-squared errors (RMSE) to quantify the quality of the NN models, and found that the inclusion of charge density and magnetic moment as physical constraints leads to more stable models that exhibit improved accuracy and reduced uncertainty for the energy predictions.
△ Less
Submitted 6 November, 2020; v1 submitted 18 December, 2019;
originally announced December 2019.
-
Robust data-driven approach for predicting the configurational energy of high entropy alloys
Authors:
Jiaxin Zhang,
Xianglin Liu,
Sirui Bi,
Junqi Yin,
Guannan Zhang,
Markus Eisenbach
Abstract:
High entropy alloys (HEAs) have been increasingly attractive as promising next-generation materials due to their various excellent properties. It's necessary to essentially characterize the degree of chemical ordering and identify order-disorder transitions through efficient simulation and modeling of thermodynamics. In this study, a robust data-driven framework based on Bayesian approaches is pro…
▽ More
High entropy alloys (HEAs) have been increasingly attractive as promising next-generation materials due to their various excellent properties. It's necessary to essentially characterize the degree of chemical ordering and identify order-disorder transitions through efficient simulation and modeling of thermodynamics. In this study, a robust data-driven framework based on Bayesian approaches is proposed and demonstrated on the accurate and efficient prediction of configurational energy of high entropy alloys. The proposed effective pair interaction (EPI) model with ensemble sampling is used to map the configuration and its corresponding energy. Given limited data calculated by first-principles calculations, Bayesian regularized regression not only offers an accurate and stable prediction but also effectively quantifies the uncertainties associated with EPI parameters. Compared with the arbitrary determination of model complexity, we further conduct a physical feature selection to identify the truncation of coordination shells in EPI model using Bayesian information criterion. The results achieve efficient and robust performance in predicting the configurational energy, particularly given small data. The developed methodology is applied to study a series of refractory HEAs, i.e. NbMoTaW, NbMoTaWV and NbMoTaWTi where it is demonstrated how dataset size affects the confidence we can place in statistical estimates of configurational energy when data are sparse.
△ Less
Submitted 9 August, 2019;
originally announced August 2019.
-
Machine learning modeling of high entropy alloy: the role of short-range order
Authors:
Xianglin Liu,
Jiaxin Zhang,
Markus Eisenbach,
Yang Wang
Abstract:
The development of machine learning sheds new light on the traditionally complicated problem of thermodynamics in multicomponent alloys. Successful application of such a method, however, strongly depends on the quality of the data and model. Here we propose a scheme to improve the representativeness of the data by utilizing the short-range order (SRO) parameters to survey the configuration space.…
▽ More
The development of machine learning sheds new light on the traditionally complicated problem of thermodynamics in multicomponent alloys. Successful application of such a method, however, strongly depends on the quality of the data and model. Here we propose a scheme to improve the representativeness of the data by utilizing the short-range order (SRO) parameters to survey the configuration space. Using the improved data, a pair interaction model is trained for the NbMoTaW high entropy alloy using linear regression. Benefiting from the physics incorporated into the model, the learned effective Hamiltonian demonstrates excellent predictability over the whole configuration space. By including pair interactions within the 6th nearest-neighbor shell, this model achieves an $R^2$ testing score of 0.997 and root mean square error of 0.43 meV. We further perform a detailed analysis on the effects of training data, testing data, and model parameters. The results reveal the vital importance of representative data and physical model. On the other hand, we also examined the performance neural networks, which is found to demonstrate a strong tendency to overfit the data.
△ Less
Submitted 7 June, 2019;
originally announced June 2019.
-
Histogram-Free Multicanonical Monte Carlo Sampling to Calculate the Density of States
Authors:
Alfred C. K. Farris,
Ying Wai Li,
Markus Eisenbach
Abstract:
We report a new multicanonical Monte Carlo algorithm to obtain the density of states for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain a closed-form expression for the density of states expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multic…
▽ More
We report a new multicanonical Monte Carlo algorithm to obtain the density of states for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain a closed-form expression for the density of states expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multicanonical sampling and Wang-Landau sampling. This is enabled by storing the visited states directly and avoiding the explicit collection of a histogram. This practice also has the advantage of avoiding undesirable artificial errors caused by the discretization and binning of continuous state variables. Our results show that this scheme is capable of obtaining converged results with a much reduced number of Monte Carlo steps, leading to a significant speedup over existing algorithms.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Combined Molecular and Spin Dynamics Simulation of BCC Iron with Vacancy Defects
Authors:
Mark Mudrick,
Markus Eisenbach,
Dilina Perera,
David P. Landau
Abstract:
Utilizing an atomistic computational model which handles both translational and spin degrees of freedom, combined molecular and spin dynamics simulations have been performed to investigate the effect of vacancy defects on spin wave excitations in ferromagnetic iron. Fourier transforms of space and time-displaced correlation functions yield the dynamic structure factor, providing characteristic fre…
▽ More
Utilizing an atomistic computational model which handles both translational and spin degrees of freedom, combined molecular and spin dynamics simulations have been performed to investigate the effect of vacancy defects on spin wave excitations in ferromagnetic iron. Fourier transforms of space and time-displaced correlation functions yield the dynamic structure factor, providing characteristic frequencies and lifetimes of the spin wave modes. Comparison of the system with a 5% vacancy concentration with pure lattice data shows a decrease in frequency as well as a decrease in lifetime for all transverse spin wave excitations observed. Additionally, a rugged spin wave line shape for low-q spin waves indicates the presence of multiple localized excitations near defect sites resulting in reduced excitation lifetimes due to increased magnon-magnon scattering. We observe further evidence of increased magnon-magnon scattering as the peaks in the longitudinal spin wave spectrum become less distinct.
△ Less
Submitted 6 March, 2018;
originally announced March 2018.
-
A histogram-free multicanonical Monte Carlo algorithm for the basis expansion of density of states
Authors:
Ying Wai Li,
Markus Eisenbach
Abstract:
We report a new multicanonical Monte Carlo (MC) algorithm to obtain the density of states (DOS) for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain an analytical form for the DOS expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multicanonical…
▽ More
We report a new multicanonical Monte Carlo (MC) algorithm to obtain the density of states (DOS) for physical systems with continuous state variables in statistical mechanics. Our algorithm is able to obtain an analytical form for the DOS expressed in a chosen basis set, instead of a numerical array of finite resolution as in previous variants of this class of MC methods such as the multicanonical (MUCA) sampling and Wang-Landau (WL) sampling. This is enabled by storing the visited states directly in a data set and avoiding the explicit collection of a histogram. This practice also has the advantage of avoiding undesirable artificial errors caused by the discretization and binning of continuous state variables. Our results show that this scheme is capable of obtaining converged results with a much reduced number of Monte Carlo steps, leading to a significant speedup over existing algorithms.
△ Less
Submitted 21 July, 2017;
originally announced July 2017.
-
Exploring Replica-Exchange Wang-Landau sampling in higher-dimensional parameter space
Authors:
Alexandra Valentim,
Julio C. S. Rocha,
Shan-Ho Tsai,
Ying Wai Li,
Markus Eisenbach,
Carlos E. Fiore,
David P. Landau
Abstract:
We considered a higher-dimensional extension for the replica-exchange Wang-Landau algorithm to perform a random walk in the energy and magnetization space of the two-dimensional Ising model. This hybrid scheme combines the advantages of Wang-Landau and Replica-Exchange algorithms, and the one-dimensional version of this approach has been shown to be very efficient and to scale well, up to several…
▽ More
We considered a higher-dimensional extension for the replica-exchange Wang-Landau algorithm to perform a random walk in the energy and magnetization space of the two-dimensional Ising model. This hybrid scheme combines the advantages of Wang-Landau and Replica-Exchange algorithms, and the one-dimensional version of this approach has been shown to be very efficient and to scale well, up to several thousands of computing cores. This approach allows us to split the parameter space of the system to be simulated into several pieces and still perform a random walk over the entire parameter range, ensuring the ergodicity of the simulation. Previous work, in which a similar scheme of parallel simulation was implemented without using replica exchange and with a different way to combine the result from the pieces, led to discontinuities in the final density of states over the entire range of parameters. From our simulations, it appears that the replica-exchange Wang-Landau algorithm is able to overcome this difficulty, allowing exploration of higher parameter phase space by keeping track of the joint density of states.
△ Less
Submitted 11 August, 2015;
originally announced August 2015.
-
Replica-exchange Wang-Landau sampling: Pushing the limits of Monte Carlo simulations in materials sciences
Authors:
Dilina Perera,
Ying Wai Li,
Markus Eisenbach,
Thomas Vogel,
David P. Landau
Abstract:
We describe the study of thermodynamics of materials using replica-exchange Wang-Landau (REWL) sampling, a generic framework for massively parallel implementations of the Wang-Landau Monte Carlo method. To evaluate the performance and scalability of the method, we investigate the magnetic phase transition in body-centered cubic (bcc) iron using the classical Heisenberg model parametrized with firs…
▽ More
We describe the study of thermodynamics of materials using replica-exchange Wang-Landau (REWL) sampling, a generic framework for massively parallel implementations of the Wang-Landau Monte Carlo method. To evaluate the performance and scalability of the method, we investigate the magnetic phase transition in body-centered cubic (bcc) iron using the classical Heisenberg model parametrized with first principles calculations. We demonstrate that our framework leads to a significant speedup without compromising the accuracy and precision and facilitates the study of much larger systems than is possible with its serial counterpart.
△ Less
Submitted 15 November, 2014;
originally announced November 2014.
