-
REMuS-GNN: A Rotation-Equivariant Model for Simulating Continuum Dynamics
Authors:
Mario Lino,
Stati Fotiadis,
Anil A. Bharath,
Chris Cantwell
Abstract:
Numerical simulation is an essential tool in many areas of science and engineering, but its performance often limits application in practice or when used to explore large parameter spaces. On the other hand, surrogate deep learning models, while accelerating simulations, often exhibit poor accuracy and ability to generalise. In order to improve these two factors, we introduce REMuS-GNN, a rotation…
▽ More
Numerical simulation is an essential tool in many areas of science and engineering, but its performance often limits application in practice or when used to explore large parameter spaces. On the other hand, surrogate deep learning models, while accelerating simulations, often exhibit poor accuracy and ability to generalise. In order to improve these two factors, we introduce REMuS-GNN, a rotation-equivariant multi-scale model for simulating continuum dynamical systems encompassing a range of length scales. REMuS-GNN is designed to predict an output vector field from an input vector field on a physical domain discretised into an unstructured set of nodes. Equivariance to rotations of the domain is a desirable inductive bias that allows the network to learn the underlying physics more efficiently, leading to improved accuracy and generalisation compared with similar architectures that lack such symmetry. We demonstrate and evaluate this method on the incompressible flow around elliptical cylinders.
△ Less
Submitted 5 May, 2022;
originally announced May 2022.
-
Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks
Authors:
Mario Lino,
Stathi Fotiadis,
Anil A. Bharath,
Chris Cantwell
Abstract:
Numerical simulators are essential tools in the study of natural fluid-systems, but their performance often limits application in practice. Recent machine-learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to i…
▽ More
Numerical simulators are essential tools in the study of natural fluid-systems, but their performance often limits application in practice. Recent machine-learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to infer unsteady continuum mechanics in problems encompassing a range of length scales and complex boundary geometries. We demonstrate this method on advection problems and incompressible fluid dynamics, both fundamental phenomena in oceanic and atmospheric processes. Our results show good extrapolation to new domain geometries and parameters for long-term temporal simulations. Simulations obtained with MultiScaleGNN are between two and four orders of magnitude faster than those on which it was trained.
△ Less
Submitted 5 May, 2022;
originally announced May 2022.
-
Building a Quantum Engineering Undergraduate Program
Authors:
Abraham Asfaw,
Alexandre Blais,
Kenneth R. Brown,
Jonathan Candelaria,
Christopher Cantwell,
Lincoln D. Carr,
Joshua Combes,
Dripto M. Debroy,
John M. Donohue,
Sophia E. Economou,
Emily Edwards,
Michael F. J. Fox,
Steven M. Girvin,
Alan Ho,
Hilary M. Hurst,
Zubin Jacob,
Blake R. Johnson,
Ezekiel Johnston-Halperin,
Robert Joynt,
Eliot Kapit,
Judith Klein-Seetharaman,
Martin Laforest,
H. J. Lewandowski,
Theresa W. Lynn,
Corey Rae H. McRae
, et al. (12 additional authors not shown)
Abstract:
The rapidly growing quantum information science and engineering (QISE) industry will require both quantum-aware and quantum-proficient engineers at the bachelor's level. We provide a roadmap for building a quantum engineering education program to satisfy this need. For quantum-aware engineers, we describe how to design a first quantum engineering course accessible to all STEM students. For the edu…
▽ More
The rapidly growing quantum information science and engineering (QISE) industry will require both quantum-aware and quantum-proficient engineers at the bachelor's level. We provide a roadmap for building a quantum engineering education program to satisfy this need. For quantum-aware engineers, we describe how to design a first quantum engineering course accessible to all STEM students. For the education and training of quantum-proficient engineers, we detail both a quantum engineering minor accessible to all STEM majors, and a quantum track directly integrated into individual engineering majors. We propose that such programs typically require only three or four newly developed courses that complement existing engineering and science classes available on most larger campuses. We describe a conceptual quantum information science course for implementation at any post-secondary institution, including community colleges and military schools. QISE presents extraordinary opportunities to work towards rectifying issues of inclusivity and equity that continue to be pervasive within engineering. We present a plan to do so and describe how quantum engineering education presents an excellent set of education research opportunities. Finally, we outline a hands-on training plan on quantum hardware, a key component of any quantum engineering program, with a variety of technologies including optics, atoms and ions, cryogenic and solid-state technologies, nanofabrication, and control and readout electronics. Our recommendations provide a flexible framework that can be tailored for academic institutions ranging from teaching and undergraduate-focused two- and four-year colleges to research-intensive universities.
△ Less
Submitted 3 August, 2021;
originally announced August 2021.
-
Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks
Authors:
Mario Lino,
Chris Cantwell,
Anil A. Bharath,
Stathi Fotiadis
Abstract:
Continuum mechanics simulators, numerically solving one or more partial differential equations, are essential tools in many areas of science and engineering, but their performance often limits application in practice. Recent modern machine learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we intr…
▽ More
Continuum mechanics simulators, numerically solving one or more partial differential equations, are essential tools in many areas of science and engineering, but their performance often limits application in practice. Recent modern machine learning approaches have demonstrated their ability to accelerate spatio-temporal predictions, although, with only moderate accuracy in comparison. Here we introduce MultiScaleGNN, a novel multi-scale graph neural network model for learning to infer unsteady continuum mechanics. MultiScaleGNN represents the physical domain as an unstructured set of nodes, and it constructs one or more graphs, each of them encoding different scales of spatial resolution. Successive learnt message passing between these graphs improves the ability of GNNs to capture and forecast the system state in problems encompassing a range of length scales. Using graph representations, MultiScaleGNN can impose periodic boundary conditions as an inductive bias on the edges in the graphs, and achieve independence to the nodes' positions. We demonstrate this method on advection problems and incompressible fluid dynamics. Our results show that the proposed model can generalise from uniform advection fields to high-gradient fields on complex domains at test time and infer long-term Navier-Stokes solutions within a range of Reynolds numbers. Simulations obtained with MultiScaleGNN are between two and four orders of magnitude faster than the ones on which it was trained.
△ Less
Submitted 9 June, 2021;
originally announced June 2021.
-
Simulating Surface Wave Dynamics with Convolutional Networks
Authors:
Mario Lino,
Chris Cantwell,
Stathi Fotiadis,
Eduardo Pignatelli,
Anil Bharath
Abstract:
We investigate the performance of fully convolutional networks to simulate the motion and interaction of surface waves in open and closed complex geometries. We focus on a U-Net architecture and analyse how well it generalises to geometric configurations not seen during training. We demonstrate that a modified U-Net architecture is capable of accurately predicting the height distribution of waves…
▽ More
We investigate the performance of fully convolutional networks to simulate the motion and interaction of surface waves in open and closed complex geometries. We focus on a U-Net architecture and analyse how well it generalises to geometric configurations not seen during training. We demonstrate that a modified U-Net architecture is capable of accurately predicting the height distribution of waves on a liquid surface within curved and multi-faceted open and closed geometries, when only simple box and right-angled corner geometries were seen during training. We also consider a separate and independent 3D CNN for performing time-interpolation on the predictions produced by our U-Net. This allows generating simulations with a smaller time-step size than the one the U-Net has been trained for.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Nektar++: enhancing the capability and application of high-fidelity spectral/$hp$ element methods
Authors:
David Moxey,
Chris D. Cantwell,
Yan Bao,
Andrea Cassinelli,
Giacomo Castiglioni,
Sehun Chun,
Emilia Juda,
Ehsan Kazemi,
Kilian Lackhove,
Julian Marcon,
Gianmarco Mengaldo,
Douglas Serson,
Michael Turner,
Hui Xu,
Joaquim Peiró,
Robert M. Kirby,
Spencer J. Sherwin
Abstract:
Nektar++ is an open-source framework that provides a flexible, high-performance and scalable platform for the development of solvers for partial differential equations using the high-order spectral/$hp$ element method. In particular, Nektar++ aims to overcome the complex implementation challenges that are often associated with high-order methods, thereby allowing them to be more readily used in a…
▽ More
Nektar++ is an open-source framework that provides a flexible, high-performance and scalable platform for the development of solvers for partial differential equations using the high-order spectral/$hp$ element method. In particular, Nektar++ aims to overcome the complex implementation challenges that are often associated with high-order methods, thereby allowing them to be more readily used in a wide range of application areas. In this paper, we present the algorithmic, implementation and application developments associated with our Nektar++ version 5.0 release. We describe some of the key software and performance developments, including our strategies on parallel I/O, on in situ processing, the use of collective operations for exploiting current and emerging hardware, and interfaces to enable multi-solver coupling. Furthermore, we provide details on a newly developed Python interface that enables a more rapid introduction for new users unfamiliar with spectral/$hp$ element methods, C++ and/or Nektar++. This release also incorporates a number of numerical method developments - in particular: the method of moving frames, which provides an additional approach for the simulation of equations on embedded curvilinear manifolds and domains; a means of handling spatially variable polynomial order; and a novel technique for quasi-3D simulations to permit spatially-varying perturbations to the geometry in the homogeneous direction. Finally, we demonstrate the new application-level features provided in this release, namely: a facility for generating high-order curvilinear meshes called NekMesh; a novel new AcousticSolver for aeroacoustic problems; our development of a 'thick' strip model for the modelling of fluid-structure interaction problems in the context of vortex-induced vibrations. We conclude by commenting some directions for future code development and expansion.
△ Less
Submitted 26 November, 2019; v1 submitted 8 June, 2019;
originally announced June 2019.
-
Approximating the solution to wave propagation using deep neural networks
Authors:
Wilhelm E. Sorteberg,
Stef Garasto,
Alison S. Pouplin,
Chris D. Cantwell,
Anil A. Bharath
Abstract:
Humans gain an implicit understanding of physical laws through observing and interacting with the world. Endowing an autonomous agent with an understanding of physical laws through experience and observation is seldom practical: we should seek alternatives. Fortunately, many of the laws of behaviour of the physical world can be derived from prior knowledge of dynamical systems, expressed through t…
▽ More
Humans gain an implicit understanding of physical laws through observing and interacting with the world. Endowing an autonomous agent with an understanding of physical laws through experience and observation is seldom practical: we should seek alternatives. Fortunately, many of the laws of behaviour of the physical world can be derived from prior knowledge of dynamical systems, expressed through the use of partial differential equations. In this work, we suggest a neural network capable of understanding a specific physical phenomenon: wave propagation in a two-dimensional medium. We define `understanding' in this context as the ability to predict the future evolution of the spatial patterns of rendered wave amplitude from a relatively small set of initial observations. The inherent complexity of the wave equations -- together with the existence of reflections and interference -- makes the prediction problem non-trivial. A network capable of making approximate predictions also unlocks the opportunity to speed-up numerical simulations for wave propagation. To this aim, we created a novel dataset of simulated wave motion and built a predictive deep neural network comprising of three main blocks: an encoder, a propagator made by 3 LSTMs, and a decoder. Results show reasonable predictions for as long as 80 time steps into the future on a dataset not seen during training. Furthermore, the network is able to generalize to an initial condition that is qualitatively different from those seen during training.
△ Less
Submitted 4 December, 2018;
originally announced December 2018.
-
Combined CG-HDG Method for Elliptic Problems: Performance Model
Authors:
Martin Vymazal,
David Moxey,
Chris Cantwell,
Spencer Sherwin,
Robert M. Kirby
Abstract:
We combine continuous and discontinuous Galerkin methods in the setting of a model diffusion problem. Starting from a hybrid discontinuous formulation, we replace element interiors by more general subsets of the computational domain - groups of elements that support a piecewise-polynomial continuous expansion. This step allows us to identify a~new weak formulation of Dirichlet boundary condition i…
▽ More
We combine continuous and discontinuous Galerkin methods in the setting of a model diffusion problem. Starting from a hybrid discontinuous formulation, we replace element interiors by more general subsets of the computational domain - groups of elements that support a piecewise-polynomial continuous expansion. This step allows us to identify a~new weak formulation of Dirichlet boundary condition in the continuous framework. We examine the expected performance of a Galerkin solver that would use continuous Galerkin method with weak Dirichlet boundary conditions in each mesh partition and connect partitions weakly using trace variable as in HDG method.
△ Less
Submitted 23 November, 2018;
originally announced November 2018.
-
Spectral/hp element methods: recent developments, applications, and perspectives
Authors:
Hui Xu,
Chris D. Cantwell,
Carlos Monteserin,
Claes Eskilsson,
Allan P. Engsig-Karup,
Spencer J. Sherwin
Abstract:
The spectral/hp element method combines the geometric flexibility of the classical h-type finite element technique with the desirable numerical properties of spectral methods, employing high-degree piecewise polynomial basis functions on coarse finite element-type meshes. The spatial approximation is based upon orthogonal polynomials, such as Legendre or Chebychev polynomials, modified to accommod…
▽ More
The spectral/hp element method combines the geometric flexibility of the classical h-type finite element technique with the desirable numerical properties of spectral methods, employing high-degree piecewise polynomial basis functions on coarse finite element-type meshes. The spatial approximation is based upon orthogonal polynomials, such as Legendre or Chebychev polynomials, modified to accommodate C0-continuous expansions. Computationally and theoretically, by increasing the polynomial order p, high-precision solutions and fast convergence can be obtained and, in particular, under certain regularity assumptions an exponential reduction in approximation error between numerical and exact solutions can be achieved. This method has now been applied in many simulation studies of both fundamental and practical engineering flows. This paper briefly describes the formulation of the spectral/hp element method and provides an overview of its application to computational fluid dynamics. In particular, it focuses on the use the spectral/hp element method in transitional flows and ocean engineering. Finally, some of the major challenges to be overcome in order to use the spectral/hp element method in more complex science and engineering applications are discussed.
△ Less
Submitted 19 February, 2018;
originally announced February 2018.
-
Computational study of subcritical response in flow past a circular cylinder
Authors:
Christopher D. Cantwell,
Dwight Barkley
Abstract:
Flow past a circular cylinder is investigated in the subcritical regime, below the onset of Benard-von Karman vortex shedding at Re_c ~ 47. The transient response of infinitesimal perturbations is computed. The domain requirements for obtaining converged results is discussed at length. It is shown that energy amplification occurs as low as Re=2.2. Throughout much of the subcritical regime the maxi…
▽ More
Flow past a circular cylinder is investigated in the subcritical regime, below the onset of Benard-von Karman vortex shedding at Re_c ~ 47. The transient response of infinitesimal perturbations is computed. The domain requirements for obtaining converged results is discussed at length. It is shown that energy amplification occurs as low as Re=2.2. Throughout much of the subcritical regime the maximum energy amplification increases approximately exponentially in the square of Re reaching 6800 at Re_c$. The spatiotemporal structure of the optimal transient dynamics is shown to be transitory Benard-von Karman vortex streets. At Re ~ 42 the long-time structure switches from exponentially increasing downstream to exponentially decaying downstream. Three-dimensional computations show that two-dimensional structures dominate the energy growth except at short times.
△ Less
Submitted 3 April, 2013;
originally announced April 2013.