-
Data-Driven Abstractions via Binary-Tree Gaussian Processes for Formal Verification
Authors:
Oliver Schön,
Shammakh Naseer,
Ben Wooding,
Sadegh Soudjani
Abstract:
To advance formal verification of stochastic systems against temporal logic requirements for handling unknown dynamics, researchers have been designing data-driven approaches inspired by breakthroughs in the underlying machine learning techniques. As one promising research direction, abstraction-based solutions based on Gaussian process (GP) regression have become popular for their ability to lear…
▽ More
To advance formal verification of stochastic systems against temporal logic requirements for handling unknown dynamics, researchers have been designing data-driven approaches inspired by breakthroughs in the underlying machine learning techniques. As one promising research direction, abstraction-based solutions based on Gaussian process (GP) regression have become popular for their ability to learn a representation of the latent system from data with a quantified error. Results obtained based on this model are then translated to the true system via various methods. In a recent publication, GPs using a so-called binary-tree kernel have demonstrated a polynomial speedup w.r.t. the size of the data compared to their vanilla version, outcompeting all existing sparse GP approximations. Incidentally, the resulting binary-tree Gaussian process (BTGP) is characteristic for its piecewise-constant posterior mean and covariance functions, naturally abstracting the input space into discrete partitions. In this paper, we leverage this natural abstraction of the BTGP for formal verification, eliminating the need for cumbersome abstraction and error quantification procedures. We show that the BTGP allows us to construct an interval Markov chain model of the unknown system with a speedup that is polynomial w.r.t. the size of the abstraction compared to alternative approaches. We provide a delocalized error quantification via a unified formula even when the true dynamics do not live in the function space of the BTGP. This allows us to compute upper and lower bounds on the probability of satisfying reachability specifications that are robust to both aleatoric and epistemic uncertainties.
△ Less
Submitted 15 July, 2024;
originally announced July 2024.
-
PRoTECT: Parallelized Construction of Safety Barrier Certificates for Nonlinear Polynomial Systems
Authors:
Ben Wooding,
Viacheslav Horbanov,
Abolfazl Lavaei
Abstract:
We develop an open-source software tool, called PRoTECT, for the parallelized construction of safety barrier certificates (BCs) for nonlinear polynomial systems. This tool employs sum-of-squares (SOS) optimization programs to systematically search for polynomial-type BCs, while aiming to verify safety properties over four classes of dynamical systems: (i) discrete-time stochastic systems, (ii) dis…
▽ More
We develop an open-source software tool, called PRoTECT, for the parallelized construction of safety barrier certificates (BCs) for nonlinear polynomial systems. This tool employs sum-of-squares (SOS) optimization programs to systematically search for polynomial-type BCs, while aiming to verify safety properties over four classes of dynamical systems: (i) discrete-time stochastic systems, (ii) discrete-time deterministic systems, (iii) continuous-time stochastic systems, and (iv) continuous-time deterministic systems. PRoTECT is implemented in Python as an application programming interface (API), offering users the flexibility to interact either through its user-friendly graphic user interface (GUI) or via function calls from other Python programs. PRoTECT leverages parallelism across different barrier degrees to efficiently search for a feasible BC.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
IMPaCT: Interval MDP Parallel Construction for Controller Synthesis of Large-Scale Stochastic Systems
Authors:
Ben Wooding,
Abolfazl Lavaei
Abstract:
This paper is concerned with developing a software tool, called IMPaCT, for the parallelized verification and controller synthesis of large-scale stochastic systems using interval Markov chains (IMCs) and interval Markov decision processes (IMDPs), respectively. The tool serves to (i) construct IMCs/IMDPs as finite abstractions of underlying original systems, and (ii) leverage interval iteration a…
▽ More
This paper is concerned with developing a software tool, called IMPaCT, for the parallelized verification and controller synthesis of large-scale stochastic systems using interval Markov chains (IMCs) and interval Markov decision processes (IMDPs), respectively. The tool serves to (i) construct IMCs/IMDPs as finite abstractions of underlying original systems, and (ii) leverage interval iteration algorithms for formal verification and controller synthesis over infinite-horizon properties, including safety, reachability, and reach-avoid, while offering convergence guarantees. IMPaCT is developed in C++ and designed using AdaptiveCpp, an independent open-source implementation of SYCL, for adaptive parallelism over CPUs and GPUs of all hardware vendors, including Intel and NVIDIA. IMPaCT stands as the first software tool for the parallel construction of IMCs/IMDPs, empowered with the capability to leverage high-performance computing platforms and cloud computing services. Specifically, parallelism offered by IMPaCT effectively addresses the challenges arising from the state-explosion problem inherent in discretization-based techniques applied to large-scale stochastic systems. We benchmark IMPaCT on several physical case studies, adopted from the ARCH tool competition for stochastic models, including a 2-dimensional robot, a 3-dimensional autonomous vehicle, a 5-dimensional room temperature system, and a 7-dimensional building automation system. To show the scalability of our tool, we also employ IMPaCT for the formal analysis of a 14-dimensional case study.
△ Less
Submitted 21 February, 2024; v1 submitted 7 January, 2024;
originally announced January 2024.
-
Formal Control of New England 39-Bus Test System: An Assume-Guarantee Approach
Authors:
Ben Wooding,
Abolfazl Lavaei,
Sadegh Soudjani
Abstract:
This work is concerned with an assume-guarantee approach to compositionally control a New England 39-bus Test System (NETS). The proposed scheme is based on the new notion of robust simulation functions with disturbance refinement alongside the composition of multiple subsystems to tackle the difficulties associated with scalability, also known as the curse of dimensionality. In our proposed setti…
▽ More
This work is concerned with an assume-guarantee approach to compositionally control a New England 39-bus Test System (NETS). The proposed scheme is based on the new notion of robust simulation functions with disturbance refinement alongside the composition of multiple subsystems to tackle the difficulties associated with scalability, also known as the curse of dimensionality. In our proposed setting, we approximate concrete subsystems with abstractions that have lower dimensions (a.k.a. reduced-order models) while providing mathematical guarantees on controller synthesis through the quantification of an upper bound on the closeness between output trajectories of original systems and their abstractions. We propose two control methods to provide guarantees for NETS: one using the principle of interconnected synchronous machines and another considering the power flows in the network between neighbouring subsystems.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
A LOOK at Outbursts of Comet C/2014 UN$_{271}$ (Bernardinelli-Bernstein) Near 20 au
Authors:
Michael S. P. Kelley,
Rosita Kokotanekova,
Carrie E. Holt,
Silvia Protopapa,
Dennis Bodewits,
Matthew M. Knight,
Tim Lister,
Helen Usher,
Joseph Chatelain,
Edward Gomez,
Sarah Greenstreet,
Tony Angel,
Ben Wooding
Abstract:
Cometary activity may be driven by ices with very low sublimation temperatures, such as carbon monoxide ice, which can sublimate at distances well beyond 20 au. This point is emphasized by the discovery of Oort cloud comet C/2014 UN$_{271}$ (Bernardinelli-Bernstein), and its observed activity out to $\sim$26 au. Through observations of this comet's optical brightness and behavior, we can potential…
▽ More
Cometary activity may be driven by ices with very low sublimation temperatures, such as carbon monoxide ice, which can sublimate at distances well beyond 20 au. This point is emphasized by the discovery of Oort cloud comet C/2014 UN$_{271}$ (Bernardinelli-Bernstein), and its observed activity out to $\sim$26 au. Through observations of this comet's optical brightness and behavior, we can potentially discern the drivers of activity in the outer solar system. We present a study of the activity of comet Bernardinelli-Bernstein with broad-band optical photometry taken at 19-20 au from the Sun (2021 June to 2022 February) as part of the LCO Outbursting Objects Key (LOOK) Project. Our analysis shows that the comet's optical brightness during this period was initially dominated by cometary outbursts, stochastic events that ejected $\sim10^7$ to $\sim10^8$ kg of material on short (< 1 day) timescales. We present evidence for three such outbursts occurring in 2021 June and September. The nominal nuclear volumes excavated by these events are similar to the 10-100 m pit-shaped voids on the surfaces of short-period comet nuclei, as imaged by spacecraft. Two out of three Oort cloud comets observed at large pre-perihelion distances exhibit outburst behavior near 20 au, suggesting such events may be common in this population. In addition, quiescent CO-driven activity may account for the brightness of the comet in 2022 January to February, but that variations in the cometary active area (i.e., the amount of sublimating ice) with heliocentric distance are also possible.
△ Less
Submitted 29 June, 2022;
originally announced June 2022.
-
Data-Driven Abstraction-Based Control Synthesis
Authors:
Milad Kazemi,
Rupak Majumdar,
Mahmoud Salamati,
Sadegh Soudjani,
Ben Wooding
Abstract:
This paper studies formal synthesis of controllers for continuous-space systems with unknown dynamics to satisfy requirements expressed as linear temporal logic formulas. Formal abstraction-based synthesis schemes rely on a precise mathematical model of the system to build a finite abstract model, which is then used to design a controller. The abstraction-based schemes are not applicable when the…
▽ More
This paper studies formal synthesis of controllers for continuous-space systems with unknown dynamics to satisfy requirements expressed as linear temporal logic formulas. Formal abstraction-based synthesis schemes rely on a precise mathematical model of the system to build a finite abstract model, which is then used to design a controller. The abstraction-based schemes are not applicable when the dynamics of the system are unknown. We propose a data-driven approach that computes the growth bound of the system using a finite number of trajectories. The growth bound together with the sampled trajectories are then used to construct the abstraction and synthesise a controller.
Our approach casts the computation of the growth bound as a robust convex optimisation program (RCP). Since the unknown dynamics appear in the optimisation, we formulate a scenario convex program (SCP) corresponding to the RCP using a finite number of sampled trajectories. We establish a sample complexity result that gives a lower bound for the number of sampled trajectories to guarantee the correctness of the growth bound computed from the SCP with a given confidence. We also provide a sample complexity result for the satisfaction of the specification on the system in closed loop with the designed controller for a given confidence. Our results are founded on estimating a bound on the Lipschitz constant of the system and provide guarantees on satisfaction of both finite and infinite-horizon specifications. We show that our data-driven approach can be readily used as a model-free abstraction refinement scheme by modifying the formulation of the growth bound and providing similar sample complexity results. The performance of our approach is shown on three case studies.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
-
Physical Characterization of Main-Belt Comet (248370) 2005 QN173
Authors:
Henry H. Hsieh,
Colin O. Chandler,
Larry Denneau,
Alan Fitzsimmons,
Nicolas Erasmus,
Michael S. P. Kelley,
Matthew M. Knight,
Tim A. Lister,
Jana Pittichova,
Scott S. Sheppard,
Audrey Thirouin,
Chadwick A. Trujillo,
Helen Usher,
Edward Gomez,
Joey Chatelain,
Sarah Greenstreet,
Tony Angel,
Richard Miles,
Paul Roche,
Ben Wooding
Abstract:
We report results from new and archival observations of the newly discovered active asteroid (248370) 2005 QN_137, which has been determined to be a likely main-belt comet based on a subsequent discovery that it is recurrently active near perihelion. From archival data analysis, we estimate g'-, r'-, i'-, and z'-band absolute magnitudes for the nucleus of H_g=16.62+/-0.13, H_r=16.12+/-0.10, H_i=16…
▽ More
We report results from new and archival observations of the newly discovered active asteroid (248370) 2005 QN_137, which has been determined to be a likely main-belt comet based on a subsequent discovery that it is recurrently active near perihelion. From archival data analysis, we estimate g'-, r'-, i'-, and z'-band absolute magnitudes for the nucleus of H_g=16.62+/-0.13, H_r=16.12+/-0.10, H_i=16.05+/-0.11, and H_z=15.93+/-0.08, corresponding to nucleus colors of g'-r'=0.50+/-0.16, r'-i'=0.07+/-0.15, and i'-z'=0.12+/-0.14, an equivalent V-band absolute magnitude of H_V=16.32+/-0.08, and a nucleus radius of r_n=1.6+/-0.2 km (using a V-band albedo of p_V=0.054+/-0.012). Meanwhile, we find mean near-nucleus coma colors when 248370 was active of g'-r'=0.47+/-0.03, r'-i'=0.10+/-0.04, and i'-z'=0.05+/-0.05, and similar mean dust tail colors, suggesting that no significant gas coma is present. We find approximate ratios between the scattering cross-sections of near-nucleus dust (within 5000 km of the nucleus) and the nucleus of A_d/A_n=0.7+/-0.3 on 2016 July 22, and 1.8<A_d/A_n<2.9 in 2021 July and August. During the 2021 observation period, the coma declined in intrinsic brightness by ~0.35 mag (or ~25%) in 37 days, while the surface brightness of the dust tail remained effectively constant over the same period. Constraints derived from the sunward extent of the coma suggest that terminal velocities of ejected dust grains are extremely slow (~1 m/s for 1 micron particles), indicating that the observed dust emission may have been aided by rapid rotation of the nucleus lowering the effective escape velocity.
△ Less
Submitted 29 September, 2021;
originally announced September 2021.
-
Formal Controller Synthesis for Frequency Regulation Utilising Electric Vehicles
Authors:
Ben Wooding,
Vahid Vahidinasab,
Sadegh Soudjani
Abstract:
In this paper, we propose a formal controller synthesis approach for integrating a population of plug-in electric vehicles in frequency regulation of power systems. This approach is the first application of formal methods to the smart grids in particular to the frequency regulation of power systems. We design and simulate a novel symbolic controller for the Great Britain power system. The proposed…
▽ More
In this paper, we propose a formal controller synthesis approach for integrating a population of plug-in electric vehicles in frequency regulation of power systems. This approach is the first application of formal methods to the smart grids in particular to the frequency regulation of power systems. We design and simulate a novel symbolic controller for the Great Britain power system. The proposed controller enhances the frequency response behaviour of the system when encountered with a large outage event. The symbolic controller guarantees the settlement of the after-event's frequency in the specified safe interval and ensures other requirements on the frequency are met.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.