-
Model orthogonalization and Bayesian forecast mixing via Principal Component Analysis
Authors:
Pablo Giuliani,
Kyle Godbey,
Vojtech Kejzlar,
Witold Nazarewicz
Abstract:
One can improve predictability in the unknown domain by combining forecasts of imperfect complex computational models using a Bayesian statistical machine learning framework. In many cases, however, the models used in the mixing process are similar. In addition to contaminating the model space, the existence of such similar, or even redundant, models during the multimodeling process can result in…
▽ More
One can improve predictability in the unknown domain by combining forecasts of imperfect complex computational models using a Bayesian statistical machine learning framework. In many cases, however, the models used in the mixing process are similar. In addition to contaminating the model space, the existence of such similar, or even redundant, models during the multimodeling process can result in misinterpretation of results and deterioration of predictive performance. In this work we describe a method based on the Principal Component Analysis that eliminates model redundancy. We show that by adding model orthogonalization to the proposed Bayesian Model Combination framework, one can arrive at better prediction accuracy and reach excellent uncertainty quantification performance.
△ Less
Submitted 20 August, 2024; v1 submitted 17 May, 2024;
originally announced May 2024.
-
A Bayesian mixture model approach to quantifying the empirical nuclear saturation point
Authors:
C. Drischler,
P. G. Giuliani,
S. Bezoui,
J. Piekarewicz,
F. Viens
Abstract:
The equation of state (EOS) in the limit of infinite symmetric nuclear matter exhibits an equilibrium density, $n_0 \approx 0.16 \, \mathrm{fm}^{-3}$, at which the pressure vanishes and the energy per particle attains its minimum, $E_0 \approx -16 \, \mathrm{MeV}$. Although not directly measurable, the nuclear saturation point $(n_0,E_0)$ can be extrapolated by density functional theory (DFT), pro…
▽ More
The equation of state (EOS) in the limit of infinite symmetric nuclear matter exhibits an equilibrium density, $n_0 \approx 0.16 \, \mathrm{fm}^{-3}$, at which the pressure vanishes and the energy per particle attains its minimum, $E_0 \approx -16 \, \mathrm{MeV}$. Although not directly measurable, the nuclear saturation point $(n_0,E_0)$ can be extrapolated by density functional theory (DFT), providing tight constraints for microscopic interactions derived from chiral effective field theory (EFT). However, when considering several DFT predictions for $(n_0,E_0)$ together, a discrepancy between model classes emerges at high confidence levels that each model prediction's uncertainty cannot explain. How can we leverage these DFT constraints to rigorously benchmark nuclear saturation properties of chiral interactions? To address this question, we present a Bayesian mixture model that combines multiple DFT predictions for $(n_0,E_0)$ using an efficient conjugate prior approach. The inferred posterior distribution for the saturation point's mean and covariance matrix follows a Normal-inverse-Wishart class, resulting in posterior predictives in the form of correlated, bivariate $t$-distributions. The DFT uncertainty reports are then used to mix these posteriors using an ordinary Monte Carlo approach. At the 95% credibility level, we estimate $n_0 \approx 0.157 \pm 0.010 \, \mathrm{fm}^{-3}$ and $E_0 \approx -15.97 \pm 0.40 \, \mathrm{MeV}$ for the marginal (univariate) $t$-distributions. Combined with chiral EFT calculations of the pure neutron matter EOS, we obtain bivariate normal distributions for the nuclear symmetry energy and its slope parameter evaluated at $n_0$: $S_v \approx 32.0 \pm 1.1 \, \mathrm{MeV}$ and $L\approx 52.6\pm 8.1 \, \mathrm{MeV}$ (95%), respectively. Our Bayesian framework is publicly available, so practitioners can readily use and extend our results.
△ Less
Submitted 4 May, 2024;
originally announced May 2024.
-
ROSE: A reduced-order scattering emulator for optical models
Authors:
Daniel Odell,
Pablo Giuliani,
Kyle Beyer,
Manuel Catacora-Rios,
Moses Y. -H. Chan,
Edgard Bonilla,
Richard J. Furnstahl,
Kyle Godbey,
Filomena M. Nunes
Abstract:
A new generation of phenomenological optical potentials requires robust calibration and uncertainty quantification, motivating the use of Bayesian statistical methods. These Bayesian methods usually require calculating observables for thousands or even millions of parameter sets, making fast and accurate emulators highly desirable or even essential. Emulating scattering across different energies o…
▽ More
A new generation of phenomenological optical potentials requires robust calibration and uncertainty quantification, motivating the use of Bayesian statistical methods. These Bayesian methods usually require calculating observables for thousands or even millions of parameter sets, making fast and accurate emulators highly desirable or even essential. Emulating scattering across different energies or with interactions such as optical potentials is challenging because of the non-affine parameter dependence, meaning the parameters do not all factorize from individual operators. Here we introduce and demonstrate the Reduced Order Scattering Emulator (ROSE) framework, a reduced basis emulator that can handle non-affine problems. ROSE is fully extensible and works within the publicly available BAND Framework software suite for calibration, model mixing, and experimental design. As a demonstration problem, we use ROSE to calibrate a realistic nucleon-target scattering model through the calculation of elastic cross sections. This problem shows the practical value of the ROSE framework for Bayesian uncertainty quantification with controlled trade-offs between emulator speed and accuracy as compared to high-fidelity solvers. Planned extensions of ROSE are discussed.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Bayes goes fast: Uncertainty Quantification for a Covariant Energy Density Functional emulated by the Reduced Basis Method
Authors:
Pablo Giuliani,
Kyle Godbey,
Edgard Bonilla,
Frederi Viens,
Jorge Piekarewicz
Abstract:
A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM) - a set of dimensionality reductio…
▽ More
A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the calibration is enabled by the emulation of the high-fidelity model through the implementation of a reduced basis method (RBM) - a set of dimensionality reduction techniques that can speed up demanding calculations involving partial differential equations by several orders of magnitude. The RBM emulator we build - using only 100 evaluations of the high-fidelity model - is able to accurately reproduce the model calculations in tens of milliseconds on a personal computer, an increase in speed of nearly a factor of 3,300 when compared to the original solver. Besides the analysis of the posterior distribution of parameters, we present predictions with properly estimated uncertainties for observables not included in the fit, specifically the neutron skin thickness of 208Pb and 48Ca, as reported by PREX and CREX collaborations. The straightforward implementation and outstanding performance of the RBM makes it an ideal tool for assisting the nuclear theory community in providing reliable estimates with properly quantified uncertainties of physical observables. Such uncertainty quantification tools will become essential given the expected abundance of data from the recently inaugurated and future experimental and observational facilities.
△ Less
Submitted 26 September, 2022;
originally announced September 2022.
-
Training and Projecting: A Reduced Basis Method Emulator for Many-Body Physics
Authors:
Edgard Bonilla,
Pablo Giuliani,
Kyle Godbey,
Dean Lee
Abstract:
We present the reduced basis method as a tool for developing emulators for equations with tunable parameters within the context of the nuclear many-body problem. The method uses a basis expansion informed by a set of solutions for a few values of the model parameters and then projects the equations over a well-chosen low-dimensional subspace. We connect some of the results in the eigenvector conti…
▽ More
We present the reduced basis method as a tool for developing emulators for equations with tunable parameters within the context of the nuclear many-body problem. The method uses a basis expansion informed by a set of solutions for a few values of the model parameters and then projects the equations over a well-chosen low-dimensional subspace. We connect some of the results in the eigenvector continuation literature to the formalism of reduced basis methods and show how these methods can be applied to a broad set of problems. As we illustrate, the possible success of the formalism on such problems can be diagnosed beforehand by a principal component analysis. We apply the reduced basis method to the one-dimensional Gross-Pitaevskii equation with a harmonic trapping potential and to nuclear density functional theory for $^{48}$Ca, achieving speed-ups of more than x150 in both cases when compared to traditional solvers. The outstanding performance of the approach, together with its straightforward implementation, show promise for its application to the emulation of computationally demanding calculations, including uncertainty quantification.
△ Less
Submitted 29 September, 2022; v1 submitted 10 March, 2022;
originally announced March 2022.
-
Bias-Variance Trade-off and Model Selection for Proton Radius Extractions
Authors:
Douglas W. Higinbotham,
Pablo Giuliani,
Randall E. McClellan,
Simon Sirca,
Xuefei Yan
Abstract:
Intuitively, a scientist might assume that a more complex regression model will necessarily yield a better predictive model of experimental data. Herein, we disprove this notion in the context of extracting the proton charge radius from charge form factor data. Using a Monte Carlo study, we show that a simpler regression model can in certain cases be the better predictive model. This is especially…
▽ More
Intuitively, a scientist might assume that a more complex regression model will necessarily yield a better predictive model of experimental data. Herein, we disprove this notion in the context of extracting the proton charge radius from charge form factor data. Using a Monte Carlo study, we show that a simpler regression model can in certain cases be the better predictive model. This is especially true with noisy data where the complex model will fit the noise instead of the physical signal. Thus, in order to select the appropriate regression model to employ, a clear technique should be used such as the Akaike information criterion or Bayesian information criterion, and ideally selected previous to seeing the results. Also, to ensure a reasonable fit, the scientist should also make regression quality plots, such as residual plots, and not just rely on a single criterion such as reduced chi2. When we apply these techniques to low four-momentum transfer cross section data, we find a proton radius that is consistent with the muonic Lamb shift results. While presented for the case of proton radius extraction, these concepts are applicable in general and can be used to illustrate the necessity of balancing bias and variance when building a regression model and validating results, ideas that are at the heart of modern machine learning algorithms.
△ Less
Submitted 3 April, 2019; v1 submitted 12 December, 2018;
originally announced December 2018.
-
Intermittency in plasma turbulence
Authors:
V. Carbone,
P. Giuliani,
L. Sorriso-Valvo,
P. Veltri,
R. Bruno,
E. Martines,
V. Antoni
Abstract:
Intermittency in fluid turbulence can be evidentiated through the analysis of Probability Distribution Functions (PDF) of velocity fluctuations, which display a strong non-gaussian behavior at small scales. In this paper we investigate the occurrence of intermittency in plasma turbulence by studying the departure from the gaussian distribution of PDF for both velocity and magnetic fluctuations.…
▽ More
Intermittency in fluid turbulence can be evidentiated through the analysis of Probability Distribution Functions (PDF) of velocity fluctuations, which display a strong non-gaussian behavior at small scales. In this paper we investigate the occurrence of intermittency in plasma turbulence by studying the departure from the gaussian distribution of PDF for both velocity and magnetic fluctuations. We use data coming from two different experiments, namely in situ satellite observations of the inner solar wind and turbulent fluctuations in a magnetically confined fusion plasma. Moreover we investigate also time intermittency observed in a simplified shell model which mimics 3D MHD equations. We found that the departure from a gaussian distribution is the main characteristic of all cases. The scaling behaviour of PDFs are then investigated by using two different models built up in the past years, in order to capture the essence of intermittency in turbulence.
△ Less
Submitted 30 January, 2001;
originally announced January 2001.
