-
Gaussian-Based Parametric Bijections For Automatic Projection Filters
Authors:
Muhammad F. Emzir,
Zheng Zhao,
Lahouari Cheded,
Simo Särkkä
Abstract:
The automatic projection filter is a recently developed numerical method for projection filtering that leverages sparse-grid integration and automatic differentiation. However, its accuracy is highly sensitive to the accuracy of the cumulant-generating function computed via the sparse-grid integration, which in turn is also sensitive to the choice of the bijection from the canonical hypercube to t…
▽ More
The automatic projection filter is a recently developed numerical method for projection filtering that leverages sparse-grid integration and automatic differentiation. However, its accuracy is highly sensitive to the accuracy of the cumulant-generating function computed via the sparse-grid integration, which in turn is also sensitive to the choice of the bijection from the canonical hypercube to the state space. In this paper, we propose two new adaptive parametric bijections for the automatic projection filter. The first bijection relies on the minimization of Kullback--Leibler divergence, whereas the second method employs the sparse-grid Gauss--Hermite quadrature. The two new bijections allow the sparse-grid nodes to adaptively move within the high-density region of the state space, resulting in a substantially improved approximation while using only a small number of quadrature nodes. The practical applicability of the methodology is illustrated in three simulated nonlinear filtering problems.
△ Less
Submitted 21 September, 2023; v1 submitted 30 March, 2023;
originally announced March 2023.
-
Multidimensional Projection Filters via Automatic Differentiation and Sparse-Grid Integration
Authors:
Muhammad Fuady Emzir,
Zheng Zhao,
Simo Särkkä
Abstract:
The projection filter is a technique for approximating the solutions of optimal filtering problems. In projection filters, the Kushner--Stratonovich stochastic partial differential equation that governs the propagation of the optimal filtering density is projected to a manifold of parametric densities, resulting in a finite-dimensional stochastic differential equation. Despite the fact that projec…
▽ More
The projection filter is a technique for approximating the solutions of optimal filtering problems. In projection filters, the Kushner--Stratonovich stochastic partial differential equation that governs the propagation of the optimal filtering density is projected to a manifold of parametric densities, resulting in a finite-dimensional stochastic differential equation. Despite the fact that projection filters are capable of representing complicated probability densities, their current implementations are limited to Gaussian family or unidimensional filtering applications. This work considers a combination of numerical integration and automatic differentiation to construct projection filter algorithms for more generic problems. Specifically, we provide a detailed exposition of this combination for the manifold of the exponential family, and show how to apply the projection filter to multidimensional cases. We demonstrate numerically that based on comparison to a finite-difference solution to the Kushner--Stratonovich equation and a bootstrap particle filter with systematic resampling, the proposed algorithm retains an accurate approximation of the filtering density while requiring a comparatively low number of quadrature points. Due to the sparse-grid integration and automatic differentiation used to calculate the expected values of the natural statistics and the Fisher metric, the proposed filtering algorithms are highly scalable. They therefore are suitable to many applications in which the number of dimensions exceeds the practical limit of particle filters, but where the Gaussian-approximations are deemed unsatisfactory.
△ Less
Submitted 14 September, 2022; v1 submitted 16 December, 2021;
originally announced December 2021.
-
Deep State-Space Gaussian Processes
Authors:
Zheng Zhao,
Muhammad Emzir,
Simo Särkkä
Abstract:
This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic diffe…
▽ More
This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of Gaussian processes in the hierarchy. The idea of the state-space approach is to represent the DGP as a non-linear hierarchical system of linear stochastic differential equations (SDEs), where each SDE corresponds to a conditional GP. The DGP regression problem then becomes a state estimation problem, and we can estimate the state efficiently with sequential methods by using the Markov property of the state-space DGP. The computational complexity scales linearly with respect to the number of measurements. Based on this, we formulate state-space MAP as well as Bayesian filtering and smoothing solutions to the DGP regression problem. We demonstrate the performance of the proposed models and methods on synthetic non-stationary signals and apply the state-space DGP to detection of the gravitational waves from LIGO measurements.
△ Less
Submitted 6 September, 2021; v1 submitted 11 August, 2020;
originally announced August 2020.
-
Stability Analysis of Quantum Systems: a Lyapunov Criterion and an Invariance Principle
Authors:
Muhammad F. Emzir,
Matthew J. Woolley,
Ian R. Petersen
Abstract:
In this article, we propose a Lyapunov stability approach to analyze the convergence of the density operator of a quantum system. In analog to the classical probability measure for Markovian processes, we show that the set of invariant density operators is both closed and convex. We then show how to analyze the stability of this set via a candidate Lyapunov operator. We complete our analysis of th…
▽ More
In this article, we propose a Lyapunov stability approach to analyze the convergence of the density operator of a quantum system. In analog to the classical probability measure for Markovian processes, we show that the set of invariant density operators is both closed and convex. We then show how to analyze the stability of this set via a candidate Lyapunov operator. We complete our analysis of the set of invariant density operators by introducing an analog of the Barbashin-Krasovskii-La Salle theorem on the dynamics of quantum systems.
△ Less
Submitted 1 August, 2020;
originally announced August 2020.
-
Non-Stationary Multi-layered Gaussian Priors for Bayesian Inversion
Authors:
Muhammad Emzir,
Sari Lasanen,
Zenith Purisha,
Lassi Roininen,
Simo Särkkä
Abstract:
In this article, we study Bayesian inverse problems with multi-layered Gaussian priors. We first describe the conditionally Gaussian layers in terms of a system of stochastic partial differential equations. We build the computational inference method using a finite-dimensional Galerkin method. We show that the proposed approximation has a convergence-in-probability property to the solution of the…
▽ More
In this article, we study Bayesian inverse problems with multi-layered Gaussian priors. We first describe the conditionally Gaussian layers in terms of a system of stochastic partial differential equations. We build the computational inference method using a finite-dimensional Galerkin method. We show that the proposed approximation has a convergence-in-probability property to the solution of the original multi-layered model. We then carry out Bayesian inference using the preconditioned Crank--Nicolson algorithm which is modified to work with multi-layered Gaussian fields. We show via numerical experiments in signal deconvolution and computerized X-ray tomography problems that the proposed method can offer both smoothing and edge preservation at the same time.
△ Less
Submitted 28 June, 2020;
originally announced June 2020.
-
Enhancing Industrial X-ray Tomography by Data-Centric Statistical Methods
Authors:
Jarkko Suuronen,
Muhammad Emzir,
Sari Lasanen,
Simo Särkkä,
Lassi Roininen
Abstract:
X-ray tomography has applications in various industrial fields such as sawmill industry, oil and gas industry, chemical engineering, and geotechnical engineering. In this article, we study Bayesian methods for the X-ray tomography reconstruction. In Bayesian methods, the inverse problem of tomographic reconstruction is solved with help of a statistical prior distribution which encodes the possible…
▽ More
X-ray tomography has applications in various industrial fields such as sawmill industry, oil and gas industry, chemical engineering, and geotechnical engineering. In this article, we study Bayesian methods for the X-ray tomography reconstruction. In Bayesian methods, the inverse problem of tomographic reconstruction is solved with help of a statistical prior distribution which encodes the possible internal structures by assigning probabilities for smoothness and edge distribution of the object. We compare Gaussian random field priors, that favour smoothness, to non-Gaussian total variation, Besov, and Cauchy priors which promote sharp edges and high-contrast and low-contrast areas in the object. We also present computational schemes for solving the resulting high-dimensional Bayesian inverse problem with 100,000-1,000,000 unknowns. In particular, we study the applicability of a no-U-turn variant of Hamiltonian Monte Carlo methods and of a more classical adaptive Metropolis-within-Gibbs algorithm for this purpose. These methods also enable full uncertainty quantification of the reconstructions. For faster computations, we use maximum a posteriori estimates with limited-memory BFGS optimisation algorithm. As the first industrial application, we consider sawmill industry X-ray log tomography. The logs have knots, rotten parts, and even possibly metallic pieces, making them good examples for non-Gaussian priors. Secondly, we study drill-core rock sample tomography, an example from oil and gas industry. We show that Cauchy priors produce smaller number of artefacts than other choices, especially with sparse high-noise measurements, and choosing Hamiltonian Monte Carlo enables systematic uncertainty quantification.
△ Less
Submitted 8 March, 2020;
originally announced March 2020.
-
Multispectral Photon-Counting for Medical Imaging and Beam Characterization
Authors:
E. Brücken,
S. Bharthuar,
M. Emzir,
M. Golovleva,
A. Gädda,
R. Hostettler,
J. Härkönen,
S. Kirschenmann,
V. Litichevskyi,
P. Luukka,
L. Martikainen,
T. Naaranoja,
I. Nincă,
J. Ott,
H. Petrow,
Z. Purisha,
T. Siiskonen,
S. Särkkä,
J. Tikkanen,
T. Tuuva,
A. Winkler
Abstract:
We present the current status of our project of developing a photon counting detector for medical imaging. An example motivation lays in producing a monitoring and dosimetry device for boron neutron capture therapy, currently not commercially available. Our approach combines in-house developed detectors based on cadmium telluride or thick silicon with readout chip technology developed for particle…
▽ More
We present the current status of our project of developing a photon counting detector for medical imaging. An example motivation lays in producing a monitoring and dosimetry device for boron neutron capture therapy, currently not commercially available. Our approach combines in-house developed detectors based on cadmium telluride or thick silicon with readout chip technology developed for particle physics experiments at CERN. Here we describe the manufacturing process of our sensors as well as the processing steps for the assembly of first prototypes. The prototypes use currently the PSI46digV2.1-r readout chip. The accompanying readout electronics chain that was used for first measurements will also be discussed. Finally we present an advanced algorithm developed by us for image reconstruction using such photon counting detectors with focus on boron neutron capture therapy. This work is conducted within a consortium of Finnish research groups from Helsinki Institute of Physics, Aalto University, Lappeenranta-Lahti University of Technology LUT and Radiation and Nuclear Safety Authority (STUK) under the RADDESS program of Academy of Finland. Keywords: Solid state detectors, X-ray detectors, Gamma detectors, Neutron detectors, Instrumentation for hadron therapy, Medical-image reconstruction methods and algorithms.
△ Less
Submitted 20 February, 2020; v1 submitted 8 January, 2020;
originally announced January 2020.
-
Lyapunov Stability Analysis for Invariant States of Quantum Systems
Authors:
Muhammad F. Emzir,
Ian R. Petersen,
Matthew J. Woolley
Abstract:
In this article, we propose a Lyapunov stability approach to analyze the convergence of the density operator of a quantum system. In contrast to many previously studied convergence analysis methods for invariant density operators which use weak convergence, in this article we analyze the convergence of density operators by considering the set of density operators as a subset of Banach space. We sh…
▽ More
In this article, we propose a Lyapunov stability approach to analyze the convergence of the density operator of a quantum system. In contrast to many previously studied convergence analysis methods for invariant density operators which use weak convergence, in this article we analyze the convergence of density operators by considering the set of density operators as a subset of Banach space. We show that the set of invariant density operators is both closed and convex, which implies the impossibility of having multiple isolated invariant density operators. We then show how to analyze the stability of this set via a candidate Lyapunov operator.
△ Less
Submitted 26 January, 2018; v1 submitted 23 July, 2017;
originally announced July 2017.
-
On Physical Realizability of Nonlinear Quantum Stochastic Differential Equations
Authors:
Muhammad F. Emzir,
Matthew J. Woolley,
Ian R. Petersen
Abstract:
In this article we study physical realizability for a class of nonlinear quantum stochastic differential equations (QSDEs). Physical realizability is a property in which a QSDE corresponds to the dynamics of an open quantum system. We derive a sufficient and necessary condition for a nonlinear QSDE to be physically realizable.
In this article we study physical realizability for a class of nonlinear quantum stochastic differential equations (QSDEs). Physical realizability is a property in which a QSDE corresponds to the dynamics of an open quantum system. We derive a sufficient and necessary condition for a nonlinear QSDE to be physically realizable.
△ Less
Submitted 22 February, 2018; v1 submitted 23 December, 2016;
originally announced December 2016.
-
Quartz-superconductor quantum electromechanical system
Authors:
M. J. Woolley,
M. F. Emzir,
G. J. Milburn,
M. Jerger,
M. Goryachev,
M. E. Tobar,
A. Fedorov
Abstract:
We propose and analyse a quantum electromechanical system composed of a monolithic quartz bulk acoustic wave (BAW) oscillator coupled to a superconducting transmon qubit via an intermediate LC electrical circuit. Monolithic quartz oscillators offer unprecedentedly high effective masses and quality factors for the investigation of mechanical oscillators in the quantum regime. Ground-state cooling o…
▽ More
We propose and analyse a quantum electromechanical system composed of a monolithic quartz bulk acoustic wave (BAW) oscillator coupled to a superconducting transmon qubit via an intermediate LC electrical circuit. Monolithic quartz oscillators offer unprecedentedly high effective masses and quality factors for the investigation of mechanical oscillators in the quantum regime. Ground-state cooling of such mechanical modes via resonant piezoelectric coupling to an LC circuit, which is itself sideband cooled via coupling to a transmon qubit, is shown to be feasible. The fluorescence spectrum of the qubit, containing motional sideband contributions due to the couplings to the oscillator modes, is obtained and the imprint of the electromechanical steady-state on the spectrum is determined. This allows the qubit to function both as a cooling resource for, and transducer of, the mechanical oscillator. The results described are relevant to any hybrid quantum system composed of a qubit coupled to two (coupled or uncoupled) thermal oscillator modes.
△ Less
Submitted 6 April, 2016;
originally announced April 2016.
-
A Quantum Extended Kalman Filter
Authors:
Muhammad F. Emzir,
Matthew J. Woolley,
Ian R. Petersen
Abstract:
A stochastic filter uses a series of measurements over time to produce estimates of unknown variables based on a dynamic model. For a quantum system, such an algorithm is provided by a quantum filter, which is also known as a stochastic master equation (SME). For a linear quantum system subject to linear measurements and Gaussian noise, the quantum filter reduces to a quantum Kalman filter. In thi…
▽ More
A stochastic filter uses a series of measurements over time to produce estimates of unknown variables based on a dynamic model. For a quantum system, such an algorithm is provided by a quantum filter, which is also known as a stochastic master equation (SME). For a linear quantum system subject to linear measurements and Gaussian noise, the quantum filter reduces to a quantum Kalman filter. In this article, we introduce a quantum extended Kalman filter (quantum EKF), which applies a commutative approximation and a time-varying linearization to non-commutative quantum stochastic differential equations (QSDEs). We will show that there are conditions under which a filter similar to the classical EKF can be implemented for quantum systems. The boundedness of estimation errors and the filtering problems with `state-dependent' covariances for process and measurement noises are also discussed. We demonstrate the effectiveness of the quantum EKF by applying it to systems which involve multiple modes, nonlinear Hamiltonians and simultaneous jump-diffusive measurements.
△ Less
Submitted 6 March, 2016;
originally announced March 2016.
-
Quantum filtering for multiple diffusive and Poissonian measurements
Authors:
Muhammad F. Emzir,
Matthew J. Woolley,
Ian R. Petersen
Abstract:
We provide a rigorous derivation of a quantum filter for the case of multiple measurements being made on a quantum system. We consider a class of measurement processes which are functions of bosonic field operators, including combinations of diffusive and Poissonian processes. This covers the standard cases from quantum optics, where homodyne detection may be described as a diffusive process and p…
▽ More
We provide a rigorous derivation of a quantum filter for the case of multiple measurements being made on a quantum system. We consider a class of measurement processes which are functions of bosonic field operators, including combinations of diffusive and Poissonian processes. This covers the standard cases from quantum optics, where homodyne detection may be described as a diffusive process and photon counting may be described as a Poissonian process. We obtain a necessary and sufficient condition for any pair of such measurements taken at different output channels to satisfy a commutation relationship. Then, we derive a general, multiple measurement quantum filter as an extension of a single-measurement quantum filter. As an application we explicitly obtain the quantum filter corresponding to homodyne detection and photon counting at the output ports of a beam splitter, correcting an earlier result.
△ Less
Submitted 16 March, 2015;
originally announced March 2015.
