-
Application of hybrid classical-quantum annealing technology to the 3D Bin-Packing Problem
Authors:
Mohsen Rahmani,
Nitish Umang,
Mason Christensen
Abstract:
In this paper, we study the use of hybrid classical-quantum annealing technology to solve a critical business optimization problem that is a form of multiproduct multi-bin packing in three dimensions with support constraints and case orientations along all three axes. We developed an exact mathematical model based on mixed-integer programming (MIP) to solve the problem, using fewer variables than…
▽ More
In this paper, we study the use of hybrid classical-quantum annealing technology to solve a critical business optimization problem that is a form of multiproduct multi-bin packing in three dimensions with support constraints and case orientations along all three axes. We developed an exact mathematical model based on mixed-integer programming (MIP) to solve the problem, using fewer variables than previously existing models. Furthermore, to ensure the stability of the cases within bins, the model employs a novel formulation to represent the support constraints. We then compared and analyzed the solution performance of the classical solver Gurobi and D-Wave's constrained quadratic model (CQM) solver on the MIP model, both with and without support constraints. Results from the computational studies offer valuable insights into how the hybrid classical-quantum solver compares against widely used purely classical solvers on computationally hard problems, such as the problem of interest. This comparison examines aspects such as the optimality gap and volume utilization across different computational time limits.
△ Less
Submitted 27 August, 2024;
originally announced August 2024.
-
Evidence chain for time-reversal symmetry-breaking kagome superconductivity
Authors:
Hanbin Deng,
Guowei Liu,
Z. Guguchia,
Tianyu Yang,
Jinjin Liu,
Zhiwei Wang,
Yaofeng Xie,
Sen Shao,
Haiyang Ma,
William Liège,
Frédéric Bourdarot,
Xiao-Yu Yan,
Hailang Qin,
C. Mielke III,
R. Khasanov,
H. Luetkens,
Xianxin Wu,
Guoqing Chang,
Jianpeng Liu,
Morten Holm Christensen,
Andreas Kreisel,
Brian Møller Andersen,
Wen Huang,
Yue Zhao,
Philippe Bourges
, et al. (3 additional authors not shown)
Abstract:
Superconductivity and magnetism are antagonistic quantum matter, while their intertwining has long been considered in frustrated-lattice systems1-3. In this work, we utilize scanning tunneling microscopy and muon spin resonance to discover time-reversal symmetry-breaking superconductivity in kagome metal Cs(V,Ta)3Sb5, where the Cooper pairing exhibits magnetism and is modulated by it. In the magne…
▽ More
Superconductivity and magnetism are antagonistic quantum matter, while their intertwining has long been considered in frustrated-lattice systems1-3. In this work, we utilize scanning tunneling microscopy and muon spin resonance to discover time-reversal symmetry-breaking superconductivity in kagome metal Cs(V,Ta)3Sb5, where the Cooper pairing exhibits magnetism and is modulated by it. In the magnetic channel, we observe spontaneous internal magnetism in a full-gap superconducting state. Under perturbations of inverse magnetic fields, we detect a time-reversal asymmetrical interference of Bogoliubov quasi-particles at a circular vector. At this vector, the pairing gap spontaneously modulates, which is distinct from pair density waves occurring at a point vector and consistent with the theoretical proposal of unusual interference effect under time-reversal symmetry-breaking. The correlation between internal magnetism, Bogoliubov quasi-particles, and pairing modulation provides a chain of experimental clues for time-reversal symmetry-breaking kagome superconductivity.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Provable Privacy Advantages of Decentralized Federated Learning via Distributed Optimization
Authors:
Wenrui Yu,
Qiongxiu Li,
Milan Lopuhaä-Zwakenberg,
Mads Græsbøll Christensen,
Richard Heusdens
Abstract:
Federated learning (FL) emerged as a paradigm designed to improve data privacy by enabling data to reside at its source, thus embedding privacy as a core consideration in FL architectures, whether centralized or decentralized. Contrasting with recent findings by Pasquini et al., which suggest that decentralized FL does not empirically offer any additional privacy or security benefits over centrali…
▽ More
Federated learning (FL) emerged as a paradigm designed to improve data privacy by enabling data to reside at its source, thus embedding privacy as a core consideration in FL architectures, whether centralized or decentralized. Contrasting with recent findings by Pasquini et al., which suggest that decentralized FL does not empirically offer any additional privacy or security benefits over centralized models, our study provides compelling evidence to the contrary. We demonstrate that decentralized FL, when deploying distributed optimization, provides enhanced privacy protection - both theoretically and empirically - compared to centralized approaches. The challenge of quantifying privacy loss through iterative processes has traditionally constrained the theoretical exploration of FL protocols. We overcome this by conducting a pioneering in-depth information-theoretical privacy analysis for both frameworks. Our analysis, considering both eavesdropping and passive adversary models, successfully establishes bounds on privacy leakage. We show information theoretically that the privacy loss in decentralized FL is upper bounded by the loss in centralized FL. Compared to the centralized case where local gradients of individual participants are directly revealed, a key distinction of optimization-based decentralized FL is that the relevant information includes differences of local gradients over successive iterations and the aggregated sum of different nodes' gradients over the network. This information complicates the adversary's attempt to infer private data. To bridge our theoretical insights with practical applications, we present detailed case studies involving logistic regression and deep neural networks. These examples demonstrate that while privacy leakage remains comparable in simpler models, complex models like deep neural networks exhibit lower privacy risks under decentralized FL.
△ Less
Submitted 12 July, 2024;
originally announced July 2024.
-
Incorporating circuit theory into a dynamic model for crowd-sourced observations of migratory birds
Authors:
Michael F. Christensen,
Peter D. Hoff
Abstract:
While the overarching pattern of biannual avian migration is well understood, there are significant questions pertaining to this phenomenon that invite further study. Necessary to any analysis of these questions is an understanding of how a given species' spatial distribution evolves in time. While studies of animal movement are often conducted using telemetry data, the collection of such data can…
▽ More
While the overarching pattern of biannual avian migration is well understood, there are significant questions pertaining to this phenomenon that invite further study. Necessary to any analysis of these questions is an understanding of how a given species' spatial distribution evolves in time. While studies of animal movement are often conducted using telemetry data, the collection of such data can be time- and resource-intensive, frequently resulting in small sample sizes. Ecological surveys of animal populations are also indicative of species distribution trends, but may be constrained to a limited spatial domain. Within this article we utilize crowd-sourced observations from the eBird database to model the abundance of migratory bird species in space and time. While crowd-sourced observations are individually less reliable than those produced by experts, the sheer size and spatial coverage of the eBird database make it attractive for use in this setting. We introduce a hidden Markov model for observed bird counts utilizing a novel transition structure developed using principles from circuit theory. After illustrating model properties we fit it to observations of Baltimore orioles and yellow-rumped warblers within the eastern United States and discuss insight it provides into the migratory patterns for these species.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
A dimension reduction approach to edge weight estimation for use in spatial models
Authors:
Michael F. Christensen,
Jo Eidsvik
Abstract:
Models for areal data are traditionally defined using the neighborhood structure of the regions on which data are observed. The unweighted adjacency matrix of a graph is commonly used to characterize the relationships between locations, resulting in the implicit assumption that all pairs of neighboring regions interact similarly, an assumption which may not be true in practice. It has been shown t…
▽ More
Models for areal data are traditionally defined using the neighborhood structure of the regions on which data are observed. The unweighted adjacency matrix of a graph is commonly used to characterize the relationships between locations, resulting in the implicit assumption that all pairs of neighboring regions interact similarly, an assumption which may not be true in practice. It has been shown that more complex spatial relationships between graph nodes may be represented when edge weights are allowed to vary. Christensen and Hoff (2023) introduced a covariance model for data observed on graphs which is more flexible than traditional alternatives, parameterizing covariance as a function of an unknown edge weights matrix. A potential issue with their approach is that each edge weight is treated as a unique parameter, resulting in increasingly challenging parameter estimation as graph size increases. Within this article we propose a framework for estimating edge weight matrices that reduces their effective dimension via a basis function representation of of the edge weights. We show that this method may be used to enhance the performance and flexibility of covariance models parameterized by such matrices in a series of illustrations, simulations and data examples.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
The Link between Gulf Stream Precipitation and European Blocking in General Circulation Models and the Role of Horizontal Resolution
Authors:
Kristian Strommen,
Simon L. L. Michel,
Hannah M. Christensen
Abstract:
Past studies show that coupled model biases in European blocking and North Atlantic eddy-driven jet variability decrease as one increases the horizontal resolution in the atmospheric and oceanic model components. This has commonly been argued to be related to an alleviation of sea surface temperature (SST) biases due to increased oceanic resolution in particular, with a physical pathway via change…
▽ More
Past studies show that coupled model biases in European blocking and North Atlantic eddy-driven jet variability decrease as one increases the horizontal resolution in the atmospheric and oceanic model components. This has commonly been argued to be related to an alleviation of sea surface temperature (SST) biases due to increased oceanic resolution in particular, with a physical pathway via changes to surface baroclinicity. On the other hand, many studies have now highlighted the key role of diabatic processes in the Gulf Stream region on blocking formation and maintenance. Here, following recent work by Schemm, we leverage a large multi-model ensemble to show that Gulf Stream precipitation variability in coupled models is tightly linked to the simulated frequency of European blocking and northern jet excursions. Furthermore, the reduced biases in blocking and jet variability are consistent with greater precipitation variability as a result of increased atmospheric horizontal resolution. By contrast, typical North Atlantic SST biases are found to share only a weak or negligible relationship with blocking and jet biases. Finally, while previous studies have used a comparison between coupled models and models run with prescribed SSTs to argue for the role of ocean resolution, we emphasise here that models run with prescribed SSTs experience greatly reduced precipitation variability due to their excessive thermal damping, making it unclear if such a comparison is meaningful. Instead, we speculate that most of the reduction in coupled model biases may actually be due to increased atmospheric resolution.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Defining error accumulation in ML atmospheric simulators
Authors:
Raghul Parthipan,
Mohit Anand,
Hannah M. Christensen,
J. Scott Hosking,
Damon J. Wischik
Abstract:
Machine learning (ML) has recently shown significant promise in modelling atmospheric systems, such as the weather. Many of these ML models are autoregressive, and error accumulation in their forecasts is a key problem. However, there is no clear definition of what `error accumulation' actually entails. In this paper, we propose a definition and an associated metric to measure it. Our definition d…
▽ More
Machine learning (ML) has recently shown significant promise in modelling atmospheric systems, such as the weather. Many of these ML models are autoregressive, and error accumulation in their forecasts is a key problem. However, there is no clear definition of what `error accumulation' actually entails. In this paper, we propose a definition and an associated metric to measure it. Our definition distinguishes between errors which are due to model deficiencies, which we may hope to fix, and those due to the intrinsic properties of atmospheric systems (chaos, unobserved variables), which are not fixable. We illustrate the usefulness of this definition by proposing a simple regularization loss penalty inspired by it. This approach shows performance improvements (according to RMSE and spread/skill) in a selection of atmospheric systems, including the real-world weather prediction task.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Atom Number Fluctuations in Bose Gases -- Statistical analysis of parameter estimation
Authors:
Toke Vibel,
Mikkel Berg Christensen,
Rasmus Malthe Fiil Andersen,
Laurits Nikolaj Stokholm,
Krzysztof Pawłowski,
Kazimierz Rzążewski,
Mick Althoff Kristensen,
Jan Joachim Arlt
Abstract:
The investigation of the fluctuations in interacting quantum systems at finite temperatures showcases the ongoing challenges in understanding complex quantum systems. Recently, atom number fluctuations in weakly interacting Bose-Einstein condensates were observed, motivating an investigation of the thermal component of partially condensed Bose gases. Here, we present a combined analysis of both co…
▽ More
The investigation of the fluctuations in interacting quantum systems at finite temperatures showcases the ongoing challenges in understanding complex quantum systems. Recently, atom number fluctuations in weakly interacting Bose-Einstein condensates were observed, motivating an investigation of the thermal component of partially condensed Bose gases. Here, we present a combined analysis of both components, revealing the presence of fluctuations in the thermal component. This analysis includes a comprehensive statistical evaluation of uncertainties in the preparation and parameter estimation of partially condensed Bose gases. Using Monte Carlo simulations of optical density profiles, we estimate the noise contributions to the atom number and temperature estimation of the condensed and thermal cloud, which is generally applicable in the field of ultracold atoms. Furthermore, we investigate the specific noise contributions in the analysis of atom number fluctuations and show that preparation noise in the total atom number leads to an important technical noise contribution. Subtracting all known noise contributions from the variance of the atom number in the BEC and thermal component allows us to improve the estimate of the fundamental peak fluctuations.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Generating candidates in global optimization algorithms using complementary energy landscapes
Authors:
Andreas Møller Slavensky,
Mads-Peter V. Christensen,
Bjørk Hammer
Abstract:
Global optimization of atomistic structure rely on the generation of new candidate structures in order to drive the exploration of the potential energy surface (PES) in search for the global minimum energy (GM) structure. In this work, we discuss a type of structure generation, which locally optimizes structures in complementary energy (CE) landscapes. These landscapes are formulated temporarily d…
▽ More
Global optimization of atomistic structure rely on the generation of new candidate structures in order to drive the exploration of the potential energy surface (PES) in search for the global minimum energy (GM) structure. In this work, we discuss a type of structure generation, which locally optimizes structures in complementary energy (CE) landscapes. These landscapes are formulated temporarily during the searches as machine learned potentials (MLPs) using local atomistic environments sampled from collected data. The CE landscapes are deliberately incomplete MLPs that rather than mimicking every aspect of the true PES are sought to become much smoother, having only few local minima. This means that local optimization in the CE landscapes may facilitate identification of new funnels in the true PES. We discuss how to construct the CE landscapes and we test their influence on global optimization of a reduced rutile SnO2(110)-(4x1) surface, and an olivine (Mg2SiO4)4 cluster for which we report a new global minimum energy structure.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Machine Learning for Stochastic Parametrisation
Authors:
Hannah M. Christensen,
Salah Kouhen,
Greta Miller,
Raghul Parthipan
Abstract:
Atmospheric models used for weather and climate prediction are traditionally formulated in a deterministic manner. In other words, given a particular state of the resolved scale variables, the most likely forcing from the sub-grid scale processes is estimated and used to predict the evolution of the large-scale flow. However, the lack of scale-separation in the atmosphere means that this approach…
▽ More
Atmospheric models used for weather and climate prediction are traditionally formulated in a deterministic manner. In other words, given a particular state of the resolved scale variables, the most likely forcing from the sub-grid scale processes is estimated and used to predict the evolution of the large-scale flow. However, the lack of scale-separation in the atmosphere means that this approach is a large source of error in forecasts. Over recent years, an alternative paradigm has developed: the use of stochastic techniques to characterise uncertainty in small-scale processes. These techniques are now widely used across weather, sub-seasonal, seasonal, and climate timescales. In parallel, recent years have also seen significant progress in replacing parametrisation schemes using machine learning (ML). This has the potential to both speed up and improve our numerical models. However, the focus to date has largely been on deterministic approaches. In this position paper, we bring together these two key developments, and discuss the potential for data-driven approaches for stochastic parametrisation. We highlight early studies in this area, and draw attention to the novel challenges that remain.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Multi-Blade detector with VMM3a-ASIC-based readout: installation and commissioning at the reflectometer Amor at PSI
Authors:
F. Piscitelli,
F. Ghazi Moradi,
F. S. Alves,
M. J. Christensen,
J. Hrivnak,
A. Johansson,
K. Fissum,
C. C. Lai,
A. Monera Martinez,
D. Pfeiffer,
E. Shahu,
J. Stahn,
P. O. Svensson
Abstract:
The Multi-Blade (MB) Boron-10-based neutron detector is the chosen technology for three instruments at the European Spallation Source (ESS): the two ESS reflectometers, ESTIA and FREIA, and the Test Beam Line. A fourth MB detector has been built, installed and commissioned for the user operation of the reflectometer Amor at PSI (Switzerland). Amor can be considered a downscaled version of the ESS…
▽ More
The Multi-Blade (MB) Boron-10-based neutron detector is the chosen technology for three instruments at the European Spallation Source (ESS): the two ESS reflectometers, ESTIA and FREIA, and the Test Beam Line. A fourth MB detector has been built, installed and commissioned for the user operation of the reflectometer Amor at PSI (Switzerland). Amor can be considered a downscaled version of the ESS reflectometer ESTIA. They are based on the same Selene guide concept, optimized for performing focusing reflectometry on small samples. The experience gained at Amor is invaluable for the future deployment of the MB detector at the ESS. This manuscript describes the MB detector construction and installation at Amor along with the readout electronics chain based on the VMM3a ASIC. The readout chain deployed at Amor is equivalent of that of the ESS, including the readout master module (RMM), event-formation-units (EFUs), Kafka, FileWriter and live visualisation tools.
△ Less
Submitted 18 March, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Spatial calibration of high-density absorption imaging
Authors:
Toke Vibel,
Mikkel Berg Christensen,
Mick Althoff Kristensen,
Jeppe Juhl Thuesen,
Laurits Nikolaj Stokholm,
Carrie Ann Weidner,
Jan Joachim Arlt
Abstract:
The accurate determination of atom numbers is an ubiquitous problem in the field of ultracold atoms. For modest atom numbers, absolute calibration techniques are available, however, for large numbers and high densities, the available techniques neglect many-body scattering processes. Here, a spatial calibration technique for time-of-flight absorption images of ultracold atomic clouds is presented.…
▽ More
The accurate determination of atom numbers is an ubiquitous problem in the field of ultracold atoms. For modest atom numbers, absolute calibration techniques are available, however, for large numbers and high densities, the available techniques neglect many-body scattering processes. Here, a spatial calibration technique for time-of-flight absorption images of ultracold atomic clouds is presented. The calibration is obtained from radially averaged absorption images and we provide a practical guide to the calibration process. It is shown that the calibration coefficient scales linearly with optical density and depends on the absorbed photon number for the experimental conditions explored here. This allows for the direct inclusion of a spatially dependent calibration in the image analysis. For typical ultracold atom clouds the spatial calibration technique leads to corrections in the detected atom number up to $\approx\! 12\,\%$ and temperature up to $\approx \!14\,\%$ in comparison to previous calibration techniques. The technique presented here addresses a major difficulty in absorption imaging of ultracold atomic clouds and prompts further theoretical work to understand the scattering processes in ultracold dense clouds of atoms for accurate atom number calibration.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
In-depth investigations of size and occupancies in cobalt ferrite nanoparticles by joint Rietveld refinements of X-ray and neutron powder diffraction data
Authors:
K. Henry,
J. V. Ahlburg,
H. L. Andersen,
C. Granados-Miralles,
M. Stingaciu,
M. Saura-Múzquiz,
M. Christensen
Abstract:
Powder X-ray diffraction (PXRD) and neutron powder diffraction (NPD) have been used to investigate the crystal structure of CoFe2O4 nanoparticles prepared via different hydrothermal synthesis routes, with particular attention given to accurately determining the spinel inversion degrees. The study is divided into four parts. In the first part, the investigations focus on the influence of using diff…
▽ More
Powder X-ray diffraction (PXRD) and neutron powder diffraction (NPD) have been used to investigate the crystal structure of CoFe2O4 nanoparticles prepared via different hydrothermal synthesis routes, with particular attention given to accurately determining the spinel inversion degrees. The study is divided into four parts. In the first part, the investigations focus on the influence of using different diffraction pattern combinations (NPD, Cu-source PXRD and Co-source PXRD) for the structural modelling. It is found that combining PXRD data from a Co source with NPD data offers a robust structural model. The second part of the study evaluates the reproducibility of the employed multipattern Rietveld refinement procedure using different data sets collected on the same sample, as well as on equivalently prepared samples. The refinement procedure gives reproducible results and reveals that the synthesis method is likewise reproducible since only minor differences are noted between the samples. The third part focuses on the structural consequences of (i) the employed heating rate (achieved using three different hydrothermal reactor types) and (ii) changing the cobalt salt in the precursors [aqueous salt solutions of Co(CH3COOH)2, Co(NO3)2 and CoCl2] in the synthesis. It is found that increasing the heating rate causes a change in the crystal structure (unit cell and crystallite sizes) while the Co/Fe occupancy and magnetic parameters remain similar in all cases. Also, changing the type of cobalt salt does not alter the final crystal/magnetic structure of the CoFe2O4 nanoparticles. The last part of this study is a consideration of the chemicals and parameters used in the synthesis of the different samples.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Approaching Ferrite-Based Exchange-Coupled Nanocomposites as Permanent Magnets
Authors:
Cecilia Granados-Miralles,
Matilde Saura-Múzquiz,
Henrik L. Andersen,
Adrián Quesada,
Jakob V. Ahlburg,
Ann-Christin Dippel,
Emmanuel Canévet,
Mogens Christensen
Abstract:
During the past decade, CoFe2O4 (hard)/Co-Fe alloy (soft) magnetic nanocomposites have been routinely prepared by partial reduction of CoFe2O4 nanoparticles. Monoxide (i.e., FeO or CoO) has often been detected as a byproduct of the reduction, although it remains unclear whether the formation of this phase occurs during the reduction itself or at a later stage. Here, a novel reaction cell was desig…
▽ More
During the past decade, CoFe2O4 (hard)/Co-Fe alloy (soft) magnetic nanocomposites have been routinely prepared by partial reduction of CoFe2O4 nanoparticles. Monoxide (i.e., FeO or CoO) has often been detected as a byproduct of the reduction, although it remains unclear whether the formation of this phase occurs during the reduction itself or at a later stage. Here, a novel reaction cell was designed to monitor the reduction in situ using synchrotron powder X-ray diffraction (PXRD). Sequential Rietveld refinements of the in situ data yielded time-resolved information on the sample composition and confirmed that the monoxide is generated as an intermediate phase. The macroscopic magnetic properties of samples at different reduction stages were measured by means of vibrating sample magnetometry (VSM), revealing a magnetic softening with increasing soft phase content, which was too pronounced to be exclusively explained by the introduction of soft material in the system. The elemental compositions of the constituent phases were obtained from joint Rietveld refinements of ex situ high-resolution PXRD and neutron powder diffraction (NPD) data. It was found that the alloy has a tendency to emerge in a Co-rich form, inducing a Co deficiency on the remaining spinel phase, which can explain the early softening of the magnetic material.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Expanding the tunability and applicability of exchange-coupled/decoupled magnetic nanocomposites
Authors:
Cecilia Granados-Miralles,
Adrián Quesada,
Matilde Saura-Múzquiz,
Henrik L. Andersen,
José F. Fernández,
Mogens Christensen
Abstract:
CoFe2O4/Co-Fe magnetic composites are usually prepared through partial reduction of CoFe2O4, which often yields monoxides (i.e., FeO, CoO) as secondary phases. Since these compounds are paramagnetic at ambient conditions, the presence of a small amount of monoxide is generally downplayed in the literature, and the possible effects on the magnetic properties are simply ignored. However, the present…
▽ More
CoFe2O4/Co-Fe magnetic composites are usually prepared through partial reduction of CoFe2O4, which often yields monoxides (i.e., FeO, CoO) as secondary phases. Since these compounds are paramagnetic at ambient conditions, the presence of a small amount of monoxide is generally downplayed in the literature, and the possible effects on the magnetic properties are simply ignored. However, the present study shows that even a low concentration of monoxide results in decoupling of the soft and hard magnetic phases, which inevitably leads to a deterioration of the magnetic properties. Additionally, it is confirmed that a partial reduction of CoFe2O4 is a suitable method to produce CoFe2O4/Co-Fe nanocomposites, provided that the treatment is well controlled with respect to duration, temperature and flow of reductant. A monoxide-free nanocomposite was produced and its magnetic properties evaluated both at room and low temperature. Our model system exemplifies the potential of exchange-coupling (and decoupling) as a tool to tune the magnetic properties of a material within a relatively wide range of values, thus widening its spectrum of potential applications.
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Multimodal Foundation Models For Echocardiogram Interpretation
Authors:
Matthew Christensen,
Milos Vukadinovic,
Neal Yuan,
David Ouyang
Abstract:
Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however current general-purpose foundation models do not perform well in this context because their training corpus have limited medical text and images. To address this c…
▽ More
Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however current general-purpose foundation models do not perform well in this context because their training corpus have limited medical text and images. To address this challenge and account for the range of cardiac physiology, we leverage 1,032,975 cardiac ultrasound videos and corresponding expert interpretations to develop EchoCLIP, a multimodal foundation model for echocardiography. EchoCLIP displays strong zero-shot (not explicitly trained) performance in cardiac function assessment (external validation left ventricular ejection fraction mean absolute error (MAE) of 7.1%) and identification of implanted intracardiac devices (areas under the curve (AUC) between 0.84 and 0.98 for pacemakers and artificial heart valves). We also developed a long-context variant (EchoCLIP-R) with a custom echocardiography report text tokenizer which can accurately identify unique patients across multiple videos (AUC of 0.86), identify clinical changes such as orthotopic heart transplants (AUC of 0.79) or cardiac surgery (AUC 0.77), and enable robust image-to-text search (mean cross-modal retrieval rank in the top 1% of candidate text reports). These emergent capabilities can be used for preliminary assessment and summarization of echocardiographic findings.
△ Less
Submitted 2 September, 2023; v1 submitted 29 August, 2023;
originally announced August 2023.
-
Simulated analogues II: a new methodology for non-parametric matching of models to observations
Authors:
Rami Al-Belmpeisi,
Vito Tuhtan,
Mikkel Bregning Christensen,
Rajika L Kuruwita,
Troels Haugbølle
Abstract:
Star formation is a multi-scale problem, and only global simulations that account for the connection from the molecular cloud scale gas flow to the accreting protostar can reflect the observed complexity of protostellar systems. Star-forming regions are characterised by supersonic turbulence and as a result, it is not possible to simultaneously design models that account for the larger environment…
▽ More
Star formation is a multi-scale problem, and only global simulations that account for the connection from the molecular cloud scale gas flow to the accreting protostar can reflect the observed complexity of protostellar systems. Star-forming regions are characterised by supersonic turbulence and as a result, it is not possible to simultaneously design models that account for the larger environment and in detail reproduce observed stellar systems. Instead, the stellar inventories can be matched statistically, and best matches found that approximate specific observations. Observationally, a combination of single-dish telescopes and interferometers are now able to resolve the nearest protostellar objects on all scales from the protostellar core to the inner 10 AU. We present a new non-parametric methodology which uses high-resolution simulations and post-processing methods to match simulations and observations using deep learning. Our goal is to perform a down-selection from large data sets of synthetic images to a ranked list of best-matching candidates with respect to the observation. This is particularly useful for binary and multiple stellar systems that form in turbulent environments. The objective is to accelerate the rate at which we can do such comparisons, remove biases from hand-picking matches, and contribute to identifying the underlying physical processes that drive the creation and evolution of observed protostellar systems.
△ Less
Submitted 27 July, 2023;
originally announced July 2023.
-
Simulated Analogues I: apparent and physical evolution of young binary protostellar systems
Authors:
Vito Tuhtan,
Rami Al-Belmpeisi,
Mikkel Bregning Christensen,
Rajika L Kuruwita,
Troels Haugbølle
Abstract:
Protostellar binaries harbour complex environment morphologies. Observations represent a snapshot in time, and projection and optical depth effects impair our ability to interpret them. Careful comparison with high-resolution models that include the larger star-forming region can help isolate the driving physical processes and give observations context in the time domain. We carry out zoom-in simu…
▽ More
Protostellar binaries harbour complex environment morphologies. Observations represent a snapshot in time, and projection and optical depth effects impair our ability to interpret them. Careful comparison with high-resolution models that include the larger star-forming region can help isolate the driving physical processes and give observations context in the time domain. We carry out zoom-in simulations with AU-scale resolution, and for the first time ever we follow the evolution until a circumbinary disk is formed. We investigate the gas dynamics around the young stars and extract disk sizes. Using radiative transfer, we obtain evolutionary tracers of the binary systems. We find that the centrifugal radius in prestellar cores is a poor estimator of the resulting disk size due to angular momentum transport at all scales. For binaries, the disk sizes are regulated periodically by the binary orbit, having larger radii close to the apastron. The bolometric temperature differs systematically between edge-on and face-on views and shows a high frequency time dependence correlated with the binary orbit and a low frequency time dependence with larger episodic accretion events. These oscillations can bring the system appearance to change rapidly from class 0 to class I and for short time periods even bring it to class II. The highly complex structure in early stages, as well as the binary orbit itself, affects the classical interpretation of protostellar classes and direct translation to evolutionary stages has to be done with caution and include other evolutionary indicators such as the extent of envelope material.
△ Less
Submitted 27 July, 2023;
originally announced July 2023.
-
Unconventional superconductivity protected from disorder on the kagome lattice
Authors:
Sofie Castro Holbæk,
Morten H. Christensen,
Andreas Kreisel,
Brian M. Andersen
Abstract:
Motivated by the recent discovery of superconductivity in the kagome $A$V$_3$Sb$_5$ ($A$: K, Rb, Cs) metals, we perform a theoretical study of the symmetry-allowed superconducting orders on the two-dimensional kagome lattice with focus on their response to disorder. We uncover a qualitative difference between the robustness of intraband spin-singlet (even-parity) and spin-triplet (odd-parity) unco…
▽ More
Motivated by the recent discovery of superconductivity in the kagome $A$V$_3$Sb$_5$ ($A$: K, Rb, Cs) metals, we perform a theoretical study of the symmetry-allowed superconducting orders on the two-dimensional kagome lattice with focus on their response to disorder. We uncover a qualitative difference between the robustness of intraband spin-singlet (even-parity) and spin-triplet (odd-parity) unconventional superconductivity to atomic-scale nonmagnetic disorder. Due to the particular sublattice character of the electronic states on the kagome lattice, disorder in spin-singlet superconducting phases is only weakly pair-breaking despite the fact that the gap structure features sign changes. By contrast, spin-triplet condensates remain fragile to disorder on the kagome lattice. We demonstrate these effects in terms of the absence of impurity bound states and an associated weak disorder-induced $T_c$-suppression for spin-singlet order. We also discuss the consequences for quasi-particle interference and their inherent tendency for momentum-space anisotropy due to sublattice effects on the kagome lattice. For unconventional kagome superconductors, our results imply that any allowed spin-singlet order, including for example $d+id$-wave superconductivity, exhibits a disorder-response qualitatively similar to standard conventional $s$-wave superconductors.
△ Less
Submitted 26 October, 2023; v1 submitted 24 July, 2023;
originally announced July 2023.
-
Superconductivity from Orbital-Selective Electron-Phonon Coupling in $A\mathrm{V}_3\mathrm{Sb}_5$
Authors:
Ethan T. Ritz,
Henrik S. Røising,
Morten H. Christensen,
Turan Birol,
Brian M. Andersen,
Rafael M. Fernandes
Abstract:
Recent experiments have shown that the phase diagrams of the kagome superconductors $A\mathrm{V}_3\mathrm{Sb}_5$ are strongly impacted by changes in the $c$-axis lattice parameter. Here, we show that $c$-axis deformations impact primarily the Sb apical bonds and thus the overlap between their $p_z$ orbitals. Changes in the latter, in turn, substantially affect low-energy electronic states with sig…
▽ More
Recent experiments have shown that the phase diagrams of the kagome superconductors $A\mathrm{V}_3\mathrm{Sb}_5$ are strongly impacted by changes in the $c$-axis lattice parameter. Here, we show that $c$-axis deformations impact primarily the Sb apical bonds and thus the overlap between their $p_z$ orbitals. Changes in the latter, in turn, substantially affect low-energy electronic states with significant Sb character, most notably the central electron pocket and the van Hove singularities located above the Fermi level. Based on the orbital-selective character of $c$-axis strain, we argue that these electronic states experience a non-negligible attractive electron-phonon pairing interaction mediated by fluctuations in the apical Sb bonds. We thus propose a multi-band model for superconductivity in $A\mathrm{V}_3\mathrm{Sb}_5$ that includes both the Sb pocket and the V-derived van Hove singularities. Upon comparing the theoretical phase diagram with the experimentally observed vanishing of the $T_c$ dome across a Lifshitz transition of the Sb pocket, we propose that either an $s^{+-}$ or an $s^{++}$ state is realized in $A\mathrm{V}_3\mathrm{Sb}_5$.
△ Less
Submitted 26 September, 2023; v1 submitted 28 April, 2023;
originally announced April 2023.
-
Vax-Culture: A Dataset for Studying Vaccine Discourse on Twitter
Authors:
Mohammad Reza Zarei,
Michael Christensen,
Sarah Everts,
Majid Komeili
Abstract:
Vaccine hesitancy continues to be a main challenge for public health officials during the COVID-19 pandemic. As this hesitancy undermines vaccine campaigns, many researchers have sought to identify its root causes, finding that the increasing volume of anti-vaccine misinformation on social media platforms is a key element of this problem. We explored Twitter as a source of misleading content with…
▽ More
Vaccine hesitancy continues to be a main challenge for public health officials during the COVID-19 pandemic. As this hesitancy undermines vaccine campaigns, many researchers have sought to identify its root causes, finding that the increasing volume of anti-vaccine misinformation on social media platforms is a key element of this problem. We explored Twitter as a source of misleading content with the goal of extracting overlapping cultural and political beliefs that motivate the spread of vaccine misinformation. To do this, we have collected a data set of vaccine-related Tweets and annotated them with the help of a team of annotators with a background in communications and journalism. Ultimately we hope this can lead to effective and targeted public health communication strategies for reaching individuals with anti-vaccine beliefs. Moreover, this information helps with developing Machine Learning models to automatically detect vaccine misinformation posts and combat their negative impacts. In this paper, we present Vax-Culture, a novel Twitter COVID-19 dataset consisting of 6373 vaccine-related tweets accompanied by an extensive set of human-provided annotations including vaccine-hesitancy stance, indication of any misinformation in tweets, the entities criticized and supported in each tweet and the communicated message of each tweet. Moreover, we define five baseline tasks including four classification and one sequence generation tasks, and report the results of a set of recent transformer-based models for them. The dataset and code are publicly available at https://github.com/mrzarei5/Vax-Culture.
△ Less
Submitted 11 June, 2023; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Frequency bin-wise single channel speech presence probability estimation using multiple DNNs
Authors:
Shuai Tao,
Himavanth Reddy,
Jesper Rindom Jensen,
Mads Græsbøll Christensen
Abstract:
In this work, we propose a frequency bin-wise method to estimate the single-channel speech presence probability (SPP) with multiple deep neural networks (DNNs) in the short-time Fourier transform domain. Since all frequency bins are typically considered simultaneously as input features for conventional DNN-based SPP estimators, high model complexity is inevitable. To reduce the model complexity an…
▽ More
In this work, we propose a frequency bin-wise method to estimate the single-channel speech presence probability (SPP) with multiple deep neural networks (DNNs) in the short-time Fourier transform domain. Since all frequency bins are typically considered simultaneously as input features for conventional DNN-based SPP estimators, high model complexity is inevitable. To reduce the model complexity and the requirements on the training data, we take a single frequency bin and some of its neighboring frequency bins into account to train separate gate recurrent units. In addition, the noisy speech and the a posteriori probability SPP representation are used to train our model. The experiments were performed on the Deep Noise Suppression challenge dataset. The experimental results show that the speech detection accuracy can be improved when we employ the frequency bin-wise model. Finally, we also demonstrate that our proposed method outperforms most of the state-of-the-art SPP estimation methods in terms of speech detection accuracy and model complexity.
△ Less
Submitted 23 February, 2023;
originally announced February 2023.
-
Occupational Disorder as the Origin of Flattening of the Acoustic Phonon Branches in the Clathrate Ba$_{8}$Ga$_{16}$Ge$_{30}$
Authors:
Susmita Roy,
Tyler C. Sterling,
Daniel Parshall,
Eric Toberer,
Mogens Christensen,
Devashibhai T. Adroja,
Dmitry Reznik
Abstract:
In the search for high-performance thermoelectrics, materials such as clathrates have drawn attention due to having both glass-like low phonon thermal conductivity and crystal-like high electrical conductivity. Ba$_{8}$Ga$_{16}$Ge$_{30}$ (BGG) has a loosely bound guest Ba atom trapped inside rigid Ga/Ge cage structures. Avoided crossings between acoustic phonons and the flat guest atom branches ha…
▽ More
In the search for high-performance thermoelectrics, materials such as clathrates have drawn attention due to having both glass-like low phonon thermal conductivity and crystal-like high electrical conductivity. Ba$_{8}$Ga$_{16}$Ge$_{30}$ (BGG) has a loosely bound guest Ba atom trapped inside rigid Ga/Ge cage structures. Avoided crossings between acoustic phonons and the flat guest atom branches have been proposed to be the source of the low lattice thermal conductivity of BGG. Ga/Ge site disorder with Ga and Ge exchanging places in different unit cells has also been reported. We used time-of-flight neutron scattering to measure the complete phonon spectrum in a large single crystal of BGG and compared these results with predictions of density functional theory to elucidate the effect of the disorder on heat-carrying phonons. Experimental results agreed much better with the calculation assuming the disorder than with the calculation assuming the ordered configuration. Although atomic masses of Ga and Ge are nearly identical, we found that disorder strongly reduces phonon group velocities, which significantly reduces thermal conductivity. Our work points at a new path towards optimizing thermoelectrics.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
-
Competing magnetic fluctuations and orders in a multiorbital model of doped SrCo$_2$As$_2$
Authors:
Ana-Marija Nedić,
Morten H. Christensen,
Y. Lee,
Bing Li,
Benjamin G. Ueland,
Rafael M. Fernandes,
Robert J. McQueeney,
Liqin Ke,
Peter P. Orth
Abstract:
We revisit the intriguing magnetic behavior of the paradigmatic itinerant frustrated magnet $\rm{Sr}\rm{Co}_2\rm{As}_2$, which shows strong and competing magnetic fluctuations yet does not develop long-range magnetic order. By calculating the static spin susceptibility $χ(\mathbf{q})$ within a realistic sixteen orbital Hubbard-Hund model, we determine the leading instability to be ferromagnetic (F…
▽ More
We revisit the intriguing magnetic behavior of the paradigmatic itinerant frustrated magnet $\rm{Sr}\rm{Co}_2\rm{As}_2$, which shows strong and competing magnetic fluctuations yet does not develop long-range magnetic order. By calculating the static spin susceptibility $χ(\mathbf{q})$ within a realistic sixteen orbital Hubbard-Hund model, we determine the leading instability to be ferromagnetic (FM). We then explore the effect of doping and calculate the critical Hubbard interaction strength $U_c$ that is required for the development of magnetic order. We find that $U_c$ decreases under electron doping and with increasing Hund's coupling $J$, but increases rapidly under hole doping. This suggests that magnetic order could possibly emerge under electron doping but not under hole doping, which agrees with experimental findings. We map out the leading magnetic instability as a function of doping and Hund's coupling and find several antiferromagnetic phases in addition to FM. We also quantify the degree of itinerant frustration in the model and resolve the contributions of different orbitals to the magnetic susceptibility. Finally, we discuss the dynamic spin susceptibility, $χ(\mathbf{q}, ω)$, at finite frequencies, where we recover the anisotropy of the peaks at $\mathbf{Q}_π= (π, 0)$ and $(0, π)$ observed by inelastic neutron scattering that is associated with the phenomenon of itinerant magnetic frustration. By comparing results between theory and experiment, we conclude that the essential experimental features of doped SrCo$_2$As$_2$ are well captured by a Hubbard-Hund multiorbital model if one considers a small shift of the chemical potential towards hole doping.
△ Less
Submitted 26 December, 2022; v1 submitted 14 December, 2022;
originally announced December 2022.
-
A Two-Stage Deep Representation Learning-Based Speech Enhancement Method Using Variational Autoencoder and Adversarial Training
Authors:
Yang Xiang,
Jesper Lisby Højvang,
Morten Højfeldt Rasmussen,
Mads Græsbøll Christensen
Abstract:
This paper focuses on leveraging deep representation learning (DRL) for speech enhancement (SE). In general, the performance of the deep neural network (DNN) is heavily dependent on the learning of data representation. However, the DRL's importance is often ignored in many DNN-based SE algorithms. To obtain a higher quality enhanced speech, we propose a two-stage DRL-based SE method through advers…
▽ More
This paper focuses on leveraging deep representation learning (DRL) for speech enhancement (SE). In general, the performance of the deep neural network (DNN) is heavily dependent on the learning of data representation. However, the DRL's importance is often ignored in many DNN-based SE algorithms. To obtain a higher quality enhanced speech, we propose a two-stage DRL-based SE method through adversarial training. In the first stage, we disentangle different latent variables because disentangled representations can help DNN generate a better enhanced speech. Specifically, we use the $β$-variational autoencoder (VAE) algorithm to obtain the speech and noise posterior estimations and related representations from the observed signal. However, since the posteriors and representations are intractable and we can only apply a conditional assumption to estimate them, it is difficult to ensure that these estimations are always pretty accurate, which may potentially degrade the final accuracy of the signal estimation. To further improve the quality of enhanced speech, in the second stage, we introduce adversarial training to reduce the effect of the inaccurate posterior towards signal reconstruction and improve the signal estimation accuracy, making our algorithm more robust for the potentially inaccurate posterior estimations. As a result, better SE performance can be achieved. The experimental results indicate that the proposed strategy can help similar DNN-based SE algorithms achieve higher short-time objective intelligibility (STOI), perceptual evaluation of speech quality (PESQ), and scale-invariant signal-to-distortion ratio (SI-SDR) scores. Moreover, the proposed algorithm can also outperform recent competitive SE algorithms.
△ Less
Submitted 27 September, 2023; v1 submitted 16 November, 2022;
originally announced November 2022.
-
Joint Multivariate and Functional Modeling for Plant Traits and Reflectances
Authors:
Philip A. White,
Michael F. Christensen,
Henry Frye,
Alan E. Gelfand,
John A. Silander Jr
Abstract:
The investigation of leaf-level traits in response to varying environmental conditions has immense importance for understanding plant ecology. Remote sensing technology enables measurement of the reflectance of plants to make inferences about underlying traits along environmental gradients. While much focus has been placed on understanding how reflectance and traits are related at the leaf-level,…
▽ More
The investigation of leaf-level traits in response to varying environmental conditions has immense importance for understanding plant ecology. Remote sensing technology enables measurement of the reflectance of plants to make inferences about underlying traits along environmental gradients. While much focus has been placed on understanding how reflectance and traits are related at the leaf-level, the challenge of modelling the dependence of this relationship along environmental gradients has limited this line of inquiry. Here, we take up the problem of jointly modeling traits and reflectance given environment. Our objective is to assess not only response to environmental regressors but also dependence between trait levels and the reflectance spectrum in the context of this regression. This leads to joint modeling of a response vector of traits with reflectance arising as a functional response over the wavelength spectrum. To conduct this investigation, we employ a dataset from a global biodiversity hotspot, the Greater Cape Floristic Region in South Africa.
△ Less
Submitted 1 October, 2022;
originally announced October 2022.
-
Privacy-Preserving Distributed Expectation Maximization for Gaussian Mixture Model using Subspace Perturbation
Authors:
Qiongxiu Li,
Jaron Skovsted Gundersen,
Katrine Tjell,
Rafal Wisniewski,
Mads Græsbøll Christensen
Abstract:
Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does not always guarantee privacy-preservation as the intermediate updates may also reveal sensitive information. In this paper, we give an explicit information-theore…
▽ More
Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does not always guarantee privacy-preservation as the intermediate updates may also reveal sensitive information. In this paper, we give an explicit information-theoretical analysis of a federated expectation maximization algorithm for Gaussian mixture model and prove that the intermediate updates can cause severe privacy leakage. To address the privacy issue, we propose a fully decentralized privacy-preserving solution, which is able to securely compute the updates in each maximization step. Additionally, we consider two different types of security attacks: the honest-but-curious and eavesdropping adversary models. Numerical validation shows that the proposed approach has superior performance compared to the existing approach in terms of both the accuracy and privacy level.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Superconductivity from repulsive interactions on the kagome lattice
Authors:
Astrid T. Rømer,
Shinibali Bhattacharyya,
Roser Valentí,
Morten H. Christensen,
Brian M. Andersen
Abstract:
The discovery of superconductivity in layered vanadium-based kagome metals $A$V$_3$Sb$_5$ ($A$: K, Rb, Cs) has added a new family of materials to the growing class of possible unconventional superconductors. However, the nature of the superconducting pairing in these materials remains elusive. We present a microscopic theoretical study of the leading superconducting instabilities on the kagome lat…
▽ More
The discovery of superconductivity in layered vanadium-based kagome metals $A$V$_3$Sb$_5$ ($A$: K, Rb, Cs) has added a new family of materials to the growing class of possible unconventional superconductors. However, the nature of the superconducting pairing in these materials remains elusive. We present a microscopic theoretical study of the leading superconducting instabilities on the kagome lattice based on spin- and charge-fluctuation mediated Cooper pairing. The applied methodology includes effects of both on-site and nearest-neighbor repulsive Coulomb interactions. Near the upper van Hove filling -- relevant for the $A$V$_3$Sb$_5$ materials -- we find a rich phase diagram with several pairing symmetries being nearly degenerate. In particular, while a substantial fraction of the phase diagram is occupied by a spin-singlet order parameter transforming as a two-dimensional irreducible representation of the point group, several nodal spin-triplet pairing states remain competitive. We compute the band and interaction parameter-dependence of the hierarchy of the leading superconducting instabilities, and determine the detailed momentum dependence of the resulting preferred gap structures. Crucially, for moderate values of the interaction parameters, the individual pairing states depend strongly on momentum and exhibit multiple nodes on the Fermi surface. We discuss the properties of these superconducting gap structures in light of recent experimental developments of the $A$V$_3$Sb$_5$ materials.
△ Less
Submitted 29 August, 2022;
originally announced August 2022.
-
Loop currents in $A$V$_3$Sb$_5$ kagome metals: multipolar and toroidal magnetic orders
Authors:
Morten H. Christensen,
Turan Birol,
Brian M. Andersen,
Rafael M. Fernandes
Abstract:
Experiments in the recently discovered vanadium-based kagome metals have suggested that their charge-ordered state displays not only bond distortions, characteristic of a ``real" charge density-wave (rCDW), but also time-reversal symmetry-breaking, typical of loop currents described by an ``imaginary" charge density-wave (iCDW). Here, we combine density-functional theory, group-theory, and phenome…
▽ More
Experiments in the recently discovered vanadium-based kagome metals have suggested that their charge-ordered state displays not only bond distortions, characteristic of a ``real" charge density-wave (rCDW), but also time-reversal symmetry-breaking, typical of loop currents described by an ``imaginary" charge density-wave (iCDW). Here, we combine density-functional theory, group-theory, and phenomenological modeling to investigate the complex charge-ordered states that arise from interactions between the low-energy van Hove singularities present in the electronic structure of $A$V$_3$Sb$_5$. We find two broad classes of mixed iCDW-rCDW configurations: triple-$\mathbf{Q}$ iCDW, triple-$\mathbf{Q}$ rCDW order, dubbed $3\mathbf{Q}$-$3\mathbf{Q}$, and double-$\mathbf{Q}$ iCDW, single-$\mathbf{Q}$ rCDW order, dubbed $2\mathbf{Q}$-$1\mathbf{Q}$. Moreover, we identify seven different types of iCDW order, stemming from the different vanadium-orbital and kagome-sublattice structures of the two pairs of van Hove singularities present above and below the Fermi level. While the $2\mathbf{Q}$-$1\mathbf{Q}$ states trigger an orthorhombic distortion that breaks the threefold rotational symmetry of the kagome lattice, the $3\mathbf{Q}$-$3\mathbf{Q}$ states induce various types of subsidiary uniform magnetic orders, from conventional ferromagnetism to magnetic octupolar, magnetic toroidal, and even magnetic monopolar order. We show that these exotic orders display unique magneto-striction, magneto-electric, and magneto-electric-striction properties that can be probed experimentally to identify which iCDW state is realized in these compounds. We briefly discuss the impact of an out-of-plane modulation of the charge order and the interplay between these complex charge-ordered states and superconductivity.
△ Less
Submitted 14 October, 2022; v1 submitted 26 July, 2022;
originally announced July 2022.
-
A flexible and interpretable spatial covariance model for data on graphs
Authors:
Michael F. Christensen,
Peter D. Hoff
Abstract:
Spatial models for areal data are often constructed such that all pairs of adjacent regions are assumed to have near-identical spatial autocorrelation. In practice, data can exhibit dependence structures more complicated than can be represented under this assumption. In this article we develop a new model for spatially correlated data observed on graphs, which can flexibly represented many types o…
▽ More
Spatial models for areal data are often constructed such that all pairs of adjacent regions are assumed to have near-identical spatial autocorrelation. In practice, data can exhibit dependence structures more complicated than can be represented under this assumption. In this article we develop a new model for spatially correlated data observed on graphs, which can flexibly represented many types of spatial dependence patterns while retaining aspects of the original graph geometry. Our method implies an embedding of the graph into Euclidean space wherein covariance can be modeled using traditional covariance functions, such as those from the Matérn family. We parameterize our model using a class of graph metrics compatible with such covariance functions, and which characterize distance in terms of network flow, a property useful for understanding proximity in many ecological settings. By estimating the parameters underlying these metrics, we recover the "intrinsic distances" between graph nodes, which assist in the interpretation of the estimated covariance and allow us to better understand the relationship between the observed process and spatial domain. We compare our model to existing methods for spatially dependent graph data, primarily conditional autoregressive models and their variants, and illustrate advantages of our method over traditional approaches. We fit our model to bird abundance data for several species in North Carolina, and show how it provides insight into the interactions between species-specific spatial distributions and geography.
△ Less
Submitted 2 July, 2024; v1 submitted 21 July, 2022;
originally announced July 2022.
-
Deep Learning Discovery of Demographic Biomarkers in Echocardiography
Authors:
Grant Duffy,
Shoa L. Clarke,
Matthew Christensen,
Bryan He,
Neal Yuan,
Susan Cheng,
David Ouyang
Abstract:
Deep learning has been shown to accurately assess 'hidden' phenotypes and predict biomarkers from medical imaging beyond traditional clinician interpretation of medical imaging. Given the black box nature of artificial intelligence (AI) models, caution should be exercised in applying models to healthcare as prediction tasks might be short-cut by differences in demographics across disease and patie…
▽ More
Deep learning has been shown to accurately assess 'hidden' phenotypes and predict biomarkers from medical imaging beyond traditional clinician interpretation of medical imaging. Given the black box nature of artificial intelligence (AI) models, caution should be exercised in applying models to healthcare as prediction tasks might be short-cut by differences in demographics across disease and patient populations. Using large echocardiography datasets from two healthcare systems, we test whether it is possible to predict age, race, and sex from cardiac ultrasound images using deep learning algorithms and assess the impact of varying confounding variables. We trained video-based convolutional neural networks to predict age, sex, and race. We found that deep learning models were able to identify age and sex, while unable to reliably predict race. Without considering confounding differences between categories, the AI model predicted sex with an AUC of 0.85 (95% CI 0.84 - 0.86), age with a mean absolute error of 9.12 years (95% CI 9.00 - 9.25), and race with AUCs ranging from 0.63 - 0.71. When predicting race, we show that tuning the proportion of a confounding variable (sex) in the training data significantly impacts model AUC (ranging from 0.57 to 0.84), while in training a sex prediction model, tuning a confounder (race) did not substantially change AUC (0.81 - 0.83). This suggests a significant proportion of the model's performance on predicting race could come from confounding features being detected by AI. Further work remains to identify the particular imaging features that associate with demographic information and to better understand the risks of demographic identification in medical AI as it pertains to potentially perpetuating bias and disparities.
△ Less
Submitted 13 July, 2022;
originally announced July 2022.
-
A deep representation learning speech enhancement method using $β$-VAE
Authors:
Yang Xiang,
Jesper Lisby Højvang,
Morten Højfeldt Rasmussen,
Mads Græsbøll Christensen
Abstract:
In previous work, we proposed a variational autoencoder-based (VAE) Bayesian permutation training speech enhancement (SE) method (PVAE) which indicated that the SE performance of the traditional deep neural network-based (DNN) method could be improved by deep representation learning (DRL). Based on our previous work, we in this paper propose to use $β$-VAE to further improve PVAE's ability of repr…
▽ More
In previous work, we proposed a variational autoencoder-based (VAE) Bayesian permutation training speech enhancement (SE) method (PVAE) which indicated that the SE performance of the traditional deep neural network-based (DNN) method could be improved by deep representation learning (DRL). Based on our previous work, we in this paper propose to use $β$-VAE to further improve PVAE's ability of representation learning. More specifically, our $β$-VAE can improve PVAE's capacity of disentangling different latent variables from the observed signal without the trade-off problem between disentanglement and signal reconstruction. This trade-off problem widely exists in previous $β$-VAE algorithms. Unlike the previous $β$-VAE algorithms, the proposed $β$-VAE strategy can also be used to optimize the DNN's structure. This means that the proposed method can not only improve PVAE's SE performance but also reduce the number of PVAE training parameters. The experimental results show that the proposed method can acquire better speech and noise latent representation than PVAE. Meanwhile, it also obtains a higher scale-invariant signal-to-distortion ratio, speech quality, and speech intelligibility.
△ Less
Submitted 11 May, 2022;
originally announced May 2022.
-
Hot-lines topology and the fate of the spin resonance mode in three-dimensional unconventional superconductors
Authors:
Fei Chen,
Rafael M. Fernandes,
Morten H. Christensen
Abstract:
In the quasi-two-dimensional (quasi-2D) copper- and iron-based superconductors, the onset of superconductivity is accompanied by a prominent peak in the magnetic spectrum at momenta close to the wave-vector of the nearby antiferromagnetic state. Such a peak is well described in terms of a spin resonance mode, i.e., a spin-1 exciton theoretically predicted for quasi-2D superconductors with a sign-c…
▽ More
In the quasi-two-dimensional (quasi-2D) copper- and iron-based superconductors, the onset of superconductivity is accompanied by a prominent peak in the magnetic spectrum at momenta close to the wave-vector of the nearby antiferromagnetic state. Such a peak is well described in terms of a spin resonance mode, i.e., a spin-1 exciton theoretically predicted for quasi-2D superconductors with a sign-changing gap. The same theories, however, indicate that such a resonance mode should be absent in a three-dimensional (3D) system with a spherical Fermi surface. This raises the question of the fate of the spin resonance mode in layered unconventional superconductors that are not strongly anisotropic, such as certain heavy-fermion compounds and potentially the newly discovered nickelate superconductor NdNiO$_2$. Here, we use the random-phase-approximation to calculate the dynamical spin susceptibility of 3D superconductors with a $d_{x^2-y^2}$-wave gap symmetry and corrugated cylindrical-like Fermi surfaces. By varying the out-of-plane hopping anisotropy $t_z/t$, we demonstrate that the appearance of a spin resonance mode is determined by the topology of the hot lines -- i.e. lines on the Fermi surface that are connected by the magnetic wave-vector. For an in-plane antiferromagnetic wave-vector, the hot lines undergo a topological transition from open lines to closed loops at a critical $t_z/t$ value. The closed hot lines cross the nodal superconducting lines, making the spin resonance mode overdamped and incoherent. In contrast, for an out-of-plane antiferromagnetic wave-vector, the hot lines remain open and the spin resonance mode remains sharp. We discuss the experimental implications of our results for the out-of-plane dispersion of the spin resonance mode and, more generally, for inelastic neutron scattering experiments on unconventional superconductors.
△ Less
Submitted 20 July, 2022; v1 submitted 26 April, 2022;
originally announced April 2022.
-
Using Probabilistic Machine Learning to Better Model Temporal Patterns in Parameterizations: a case study with the Lorenz 96 model
Authors:
Raghul Parthipan,
Hannah M. Christensen,
J. Scott Hosking,
Damon J. Wischik
Abstract:
The modelling of small-scale processes is a major source of error in climate models, hindering the accuracy of low-cost models which must approximate such processes through parameterization. Red noise is essential to many operational parameterization schemes, helping model temporal correlations. We show how to build on the successes of red noise by combining the known benefits of stochasticity wit…
▽ More
The modelling of small-scale processes is a major source of error in climate models, hindering the accuracy of low-cost models which must approximate such processes through parameterization. Red noise is essential to many operational parameterization schemes, helping model temporal correlations. We show how to build on the successes of red noise by combining the known benefits of stochasticity with machine learning. This is done using a physically-informed recurrent neural network within a probabilistic framework. Our model is competitive and often superior to both a bespoke baseline and an existing probabilistic machine learning approach (GAN) when applied to the Lorenz 96 atmospheric simulation. This is due to its superior ability to model temporal patterns compared to standard first-order autoregressive schemes. It also generalises to unseen scenarios. We evaluate across a number of metrics from the literature, and also discuss the benefits of using the probabilistic metric of hold-out likelihood.
△ Less
Submitted 12 September, 2022; v1 submitted 28 March, 2022;
originally announced March 2022.
-
Tunable nodal kagome superconductivity in charge ordered RbV3Sb5
Authors:
Z. Guguchia,
C. Mielke III,
D. Das,
R. Gupta,
J. -X. Yin,
H. Liu,
Q. Yin,
M. H. Christensen,
Z. Tu,
C. Gong,
N. Shumiya,
Ts. Gamsakhurdashvili,
M. Elender,
Pengcheng Dai,
A. Amato,
Y. Shi,
H. C. Lei,
R. M. Fernandes,
M. Z. Hasan,
H. Luetkens,
R. Khasanov
Abstract:
Unconventional superconductors often feature competing orders, small superfluid density, and nodal electronic pairing. While unusual superconductivity has been proposed in the kagome metals AV3Sb5, key spectroscopic evidence has remained elusive. Here we utilize pressure-tuned (up to 1.85 GPa) and ultra-low temperature (down to 18 mK) muon spin spectroscopy to uncover the unconventional nature of…
▽ More
Unconventional superconductors often feature competing orders, small superfluid density, and nodal electronic pairing. While unusual superconductivity has been proposed in the kagome metals AV3Sb5, key spectroscopic evidence has remained elusive. Here we utilize pressure-tuned (up to 1.85 GPa) and ultra-low temperature (down to 18 mK) muon spin spectroscopy to uncover the unconventional nature of superconductivity in RbV3Sb5. At ambient pressure, we detect an enhancement of the width of the internal magnetic field distribution sensed by the muon ensemble, indicative of time-reversal symmetry breaking charge order. Remarkably, the superconducting state displays nodal energy gap and a reduced superfluid density, which can be attributed to the competition with the novel charge order. Upon applying pressure, the charge-order transitions are suppressed, the superfluid density increases, and the superconducting state progressively evolves from nodal to nodeless. Once charge order is eliminated, we find a superconducting pairing state that is not only fully gapped, but also spontaneously breaks time-reversal symmetry. Our results point to unprecedented tunable nodal kagome superconductivity competing with time-reversal symmetry-breaking charge order and offer unique insights into the nature of the pairing state.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
-
A Bayesian Permutation training deep representation learning method for speech enhancement with variational autoencoder
Authors:
Yang Xiang,
Jesper Lisby Højvang,
Morten Højfeldt Rasmussen,
Mads Græsbøll Christensen
Abstract:
Recently, variational autoencoder (VAE), a deep representation learning (DRL) model, has been used to perform speech enhancement (SE). However, to the best of our knowledge, current VAE-based SE methods only apply VAE to the model speech signal, while noise is modeled using the traditional non-negative matrix factorization (NMF) model. One of the most important reasons for using NMF is that these…
▽ More
Recently, variational autoencoder (VAE), a deep representation learning (DRL) model, has been used to perform speech enhancement (SE). However, to the best of our knowledge, current VAE-based SE methods only apply VAE to the model speech signal, while noise is modeled using the traditional non-negative matrix factorization (NMF) model. One of the most important reasons for using NMF is that these VAE-based methods cannot disentangle the speech and noise latent variables from the observed signal. Based on Bayesian theory, this paper derives a novel variational lower bound for VAE, which ensures that VAE can be trained in supervision, and can disentangle speech and noise latent variables from the observed signal. This means that the proposed method can apply the VAE to model both speech and noise signals, which is totally different from the previous VAE-based SE works. More specifically, the proposed DRL method can learn to impose speech and noise signal priors to different sets of latent variables for SE. The experimental results show that the proposed method can not only disentangle speech and noise latent variables from the observed signal but also obtain a higher scale-invariant signal-to-distortion ratio and speech quality score than the similar deep neural network-based (DNN) SE method.
△ Less
Submitted 24 January, 2022;
originally announced January 2022.
-
Rate-capability of the VMM3a Front End in the RD51 Scalable Readout System
Authors:
D. Pfeiffer,
L. Scharenberg,
P. Schwäbig,
S. Alcock,
F. Brunbauer,
M. J. Christensen,
K. Desch,
K. Flöthner,
F. Garcia,
R. Hall-Wilton,
M. Hracek,
G. Iakovidis,
D. Janssens,
J. Kaminski,
M. Lupberger,
H. Muller,
E. Oliveri,
L. Ropelewski,
A. Rusu,
J. Samarati,
M. van Stenis,
A. Utrobicic,
R. Veenhof
Abstract:
The VMM3a is an Application Specific Integrated Circuit (ASIC), specifically developed for the readout of gaseous detectors. Originally developed within the ATLAS New Small Wheel (NSW) upgrade, it has been successfully integrated into the Scalable Readout System (SRS) of the RD51 collaboration. This allows, to use the VMM3a also in small laboratory set-ups and mid-scale experiments, which make use…
▽ More
The VMM3a is an Application Specific Integrated Circuit (ASIC), specifically developed for the readout of gaseous detectors. Originally developed within the ATLAS New Small Wheel (NSW) upgrade, it has been successfully integrated into the Scalable Readout System (SRS) of the RD51 collaboration. This allows, to use the VMM3a also in small laboratory set-ups and mid-scale experiments, which make use of Micro-Pattern Gaseous Detectors (MPGDs). As part of the integration of the VMM3a into the SRS, the readout and data transfer scheme was optimised to reach a high rate-capability of the entire readout system and profit from the VMM3a's high single-channel rate-capability of 3.6 Mhits/s. The optimisation focused mainly on the handling of the data output stream of the VMM3a, but also on the development of a trigger-logic between the front-end cards and the DAQ computer. In this article, two firmware implementations of the non-ATLAS continuous readout mode are presented, as well as the implementation of the trigger-logic. Afterwards, a short overview on X-ray imaging results is presented, to illustrate the high rate-capability rom an application point-of-view.
△ Less
Submitted 2 February, 2022; v1 submitted 21 September, 2021;
originally announced September 2021.
-
The Fractal Nature of Clouds in Global Storm-Resolving Models
Authors:
Hannah M. Christensen,
Oliver G. A. Driver
Abstract:
Clouds in observations are fractals: they show self-similarity across scales ranging from one to 1000 km. This includes individual storms and large-scale cloud structures typical of organised convection. It is not known whether global storm-resolving models reproduce the observed fractal scaling laws for clouds and organised convection. We compute the fractal dimension of clouds using Himawari sat…
▽ More
Clouds in observations are fractals: they show self-similarity across scales ranging from one to 1000 km. This includes individual storms and large-scale cloud structures typical of organised convection. It is not known whether global storm-resolving models reproduce the observed fractal scaling laws for clouds and organised convection. We compute the fractal dimension of clouds using Himawari satellite data and compare this to global storm-resolving model simulations completed as part of the DYAMOND intercomparison project. We find cloud fields in these simulations are indeed fractal, and reproduce the observed fractal dimension to within 10\%. We find the fractal dimension is sensitive to the choice of boundary layer parametrisation scheme used in each model simulation, and not to the convection parametrisation as might have been expected. The fractal dimension is independent of cloud area distributions, providing a complementary metric to assess the multi-scale structure of convection and convective organisation in model simulations.
△ Less
Submitted 19 August, 2021;
originally announced August 2021.
-
Dynamical vortices in electron-phonon superconductors
Authors:
Morten H. Christensen,
Andrey V. Chubukov
Abstract:
We analyze the structure of an $s-$wave superconducting gap in systems with electron-phonon attraction and electron-electron repulsion. Earlier works have found that superconductivity develops despite strong repulsion, but the gap, $Δ(ω_m)$, necessarily changes sign along the Matsubara axis. We analyze the sign-changing gap function from a topological perspective using the knowledge that a nodal p…
▽ More
We analyze the structure of an $s-$wave superconducting gap in systems with electron-phonon attraction and electron-electron repulsion. Earlier works have found that superconductivity develops despite strong repulsion, but the gap, $Δ(ω_m)$, necessarily changes sign along the Matsubara axis. We analyze the sign-changing gap function from a topological perspective using the knowledge that a nodal point of $Δ(ω_m)$ is the center of dynamical vortex. We consider two models with different cutoffs for the repulsive interaction and trace the vortex positions along the Matsubara axis and in the upper frequency half plane upon changing the relative strength of the attractive and repulsive parts of the interaction. We discuss how the presence of dynamical vortices affects the gap structure along the real axis, detectable in ARPES experiments.
△ Less
Submitted 16 July, 2021;
originally announced July 2021.
-
Theory of the charge-density wave in $A$V$_3$Sb$_5$ kagome metals
Authors:
Morten H. Christensen,
Turan Birol,
Brian M. Andersen,
Rafael M. Fernandes
Abstract:
The family of metallic kagome compounds $A$V$_3$Sb$_5$ ($A$=K, Rb, Cs) was recently discovered to exhibit both superconductivity and charge order. The nature of the charge-density wave (CDW) phase is presently unsettled, which complicates the interpretation of the superconducting ground state. In this paper, we use group-theory and density-functional theory (DFT) to derive and solve a phenomenolog…
▽ More
The family of metallic kagome compounds $A$V$_3$Sb$_5$ ($A$=K, Rb, Cs) was recently discovered to exhibit both superconductivity and charge order. The nature of the charge-density wave (CDW) phase is presently unsettled, which complicates the interpretation of the superconducting ground state. In this paper, we use group-theory and density-functional theory (DFT) to derive and solve a phenomenological Landau model for this CDW state. The DFT results reveal three unstable phonon modes with the same in-plane momentum but different out-of-plane momenta, whose frequencies depend strongly on the electronic temperature. This is indicative of an electronically-driven CDW, stabilized by features of the in-plane electronic dispersion. Motivated by the DFT analysis, we construct a Landau free-energy expansion for coupled CDW order parameters with wave-vectors at the $M$ and $L$ points of the hexagonal Brillouin zone. We find an unusual trilinear term coupling these different order parameters, which can promote the simultaneous condensation of both CDWs even if the two modes are not nearly-degenerate. We classify the different types of coupled multi-$\bf{Q}$ CDW orders, focusing on those that break the sixfold rotational symmetry and lead to a unit-cell doubling along all three crystallographic directions, as suggested by experiments. We determine a region in parameter space, characterized by large nonlinear Landau coefficients, where these phases - dubbed staggered tri-hexagonal and staggered Star-of-David - are the leading instabilities of the system. Finally, we discuss the implications of our results for the kagome metals.
△ Less
Submitted 12 July, 2021; v1 submitted 9 July, 2021;
originally announced July 2021.
-
Revealing the competition between charge-density wave and superconductivity in CsV$_3$Sb$_5$ through uniaxial strain
Authors:
Tiema Qian,
Morten H. Christensen,
Chaowei Hu,
Amartyajyoti Saha,
Brian M. Andersen,
Rafael M. Fernandes,
Turan Birol,
Ni Ni
Abstract:
In this paper we report the impact of uniaxial strain $\varepsilon$ applied along the crystalline $a$ axis on the newly discovered kagome superconductor CsV$_3$Sb$_5$. At ambient conditions, CsV$_3$Sb$_5$ shows a charge-density wave (CDW) transition at $T_{\rm CDW}=94.5$ K and superconducts below $T_C = 3.34$ K. In our study, when the uniaxial strain $\varepsilon$ is varied from $-0.90\%$ to…
▽ More
In this paper we report the impact of uniaxial strain $\varepsilon$ applied along the crystalline $a$ axis on the newly discovered kagome superconductor CsV$_3$Sb$_5$. At ambient conditions, CsV$_3$Sb$_5$ shows a charge-density wave (CDW) transition at $T_{\rm CDW}=94.5$ K and superconducts below $T_C = 3.34$ K. In our study, when the uniaxial strain $\varepsilon$ is varied from $-0.90\%$ to $0.90\%$, $T_C$ monotonically increases by $\sim 33\%$ from 3.0 K to 4.0 K, giving rise to the empirical relation $T_C (\varepsilon)=3.4+0.56\varepsilon+0.12\varepsilon^2$. On the other hand, for $\varepsilon$ changing from $-0.76\%$ to $1.26\%$, $T_{\rm CDW}$ decreases monotonically by $\sim 10\%$ from 97.5 K to 87.5 K with $T_{\rm CDW}(\varepsilon)=94.5-4.72\varepsilon-0.60\varepsilon^2$. The opposite response of $T_C$ and $T_{\rm CDW}$ to the uniaxial strain suggests strong competition between these two orders. Comparison with hydrostatic pressure measurements indicate that it is the change in the $c$-axis that is responsible for these behaviors of the CDW and superconducting transitions, and that the explicit breaking of the sixfold rotational symmetry by strain has a negligible effect. Combined with our first-principles calculations and phenomenological analysis, we conclude that the enhancement in $T_C$ with decreasing $c$ is caused primarily by the suppression of $T_{\rm CDW}$, rather than strain-induced modifications in the bare superconducting parameters. We propose that the sensitivity of $T_{\rm CDW}$ with respect to the changes in the $c$-axis arises from the impact of the latter on the trilinear coupling between the $M_1^+$ and $L_2^-$ phonon modes associated with the CDW. Overall, our work reveals that the $c$-axis lattice parameter, which can be controlled by both pressure and uniaxial strain, is a powerful tuning knob for the phase diagram of CsV$_3$Sb$_5$.
△ Less
Submitted 12 July, 2021; v1 submitted 9 July, 2021;
originally announced July 2021.
-
Communication efficient privacy-preserving distributed optimization using adaptive differential quantization
Authors:
Qiongxiu Li,
Richard Heusdens,
Mads Græsbøll Christensen
Abstract:
Privacy issues and communication cost are both major concerns in distributed optimization. There is often a trade-off between them because the encryption methods required for privacy-preservation often incur expensive communication bandwidth. To address this issue, we, in this paper, propose a quantization-based approach to achieve both communication efficient and privacy-preserving solutions in t…
▽ More
Privacy issues and communication cost are both major concerns in distributed optimization. There is often a trade-off between them because the encryption methods required for privacy-preservation often incur expensive communication bandwidth. To address this issue, we, in this paper, propose a quantization-based approach to achieve both communication efficient and privacy-preserving solutions in the context of distributed optimization. By deploying an adaptive differential quantization scheme, we allow each node in the network to achieve its optimum solution with a low communication cost while keeping its private data unrevealed. Additionally, the proposed approach is general and can be applied in various distributed optimization methods, such as the primal-dual method of multipliers (PDMM) and the alternating direction method of multipliers (ADMM). Moveover, we consider two widely used adversary models: passive and eavesdropping. Finally, we investigate the properties of the proposed approach using different applications and demonstrate its superior performance in terms of several parameters including accuracy, privacy, and communication cost.
△ Less
Submitted 29 May, 2021;
originally announced May 2021.
-
2022 Roadmap on Neuromorphic Computing and Engineering
Authors:
Dennis V. Christensen,
Regina Dittmann,
Bernabé Linares-Barranco,
Abu Sebastian,
Manuel Le Gallo,
Andrea Redaelli,
Stefan Slesazeck,
Thomas Mikolajick,
Sabina Spiga,
Stephan Menzel,
Ilia Valov,
Gianluca Milano,
Carlo Ricciardi,
Shi-Jun Liang,
Feng Miao,
Mario Lanza,
Tyler J. Quill,
Scott T. Keene,
Alberto Salleo,
Julie Grollier,
Danijela Marković,
Alice Mizrahi,
Peng Yao,
J. Joshua Yang,
Giacomo Indiveri
, et al. (34 additional authors not shown)
Abstract:
Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exas…
▽ More
Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exascale with 1018 calculations each second. Even though these future computers will be incredibly powerful, if they are based on von Neumann type architectures, they will consume between 20 and 30 megawatts of power and will not have intrinsic physically built-in capabilities to learn or deal with complex data as our brain does. These needs can be addressed by neuromorphic computing systems which are inspired by the biological concepts of the human brain. This new generation of computers has the potential to be used for the storage and processing of large amounts of digital information with much lower power consumption than conventional processors. Among their potential future applications, an important niche is moving the control from data centers to edge devices.
The aim of this Roadmap is to present a snapshot of the present state of neuromorphic technology and provide an opinion on the challenges and opportunities that the future holds in the major areas of neuromorphic technology, namely materials, devices, neuromorphic circuits, neuromorphic algorithms, applications, and ethics. The Roadmap is a collection of perspectives where leading researchers in the neuromorphic community provide their own view about the current state and the future challenges. We hope that this Roadmap will be a useful resource to readers outside this field, for those who are just entering the field, and for those who are well established in the neuromorphic community.
https://doi.org/10.1088/2634-4386/ac4a83
△ Less
Submitted 13 January, 2022; v1 submitted 12 May, 2021;
originally announced May 2021.
-
Speech Decomposition Based on a Hybrid Speech Model and Optimal Segmentation
Authors:
Alfredo Esquivel Jaramillo,
Jesper Kjær Nielsen,
Mads Græsbøll Christensen
Abstract:
In a hybrid speech model, both voiced and unvoiced components can coexist in a segment. Often, the voiced speech is regarded as the deterministic component, and the unvoiced speech and additive noise are the stochastic components. Typically, the speech signal is considered stationary within fixed segments of 20-40 ms, but the degree of stationarity varies over time. For decomposing noisy speech in…
▽ More
In a hybrid speech model, both voiced and unvoiced components can coexist in a segment. Often, the voiced speech is regarded as the deterministic component, and the unvoiced speech and additive noise are the stochastic components. Typically, the speech signal is considered stationary within fixed segments of 20-40 ms, but the degree of stationarity varies over time. For decomposing noisy speech into its voiced and unvoiced components, a fixed segmentation may be too crude, and we here propose to adapt the segment length according to the signal local characteristics. The segmentation relies on parameter estimates of a hybrid speech model and the maximum a posteriori (MAP) and log-likelihood criteria as rules for model selection among the possible segment lengths, for voiced and unvoiced speech, respectively. Given the optimal segmentation markers and the estimated statistics, both components are estimated using linear filtering. A codebook-based approach differentiates between unvoiced speech and noise. A better extraction of the components is possible by taking into account the adaptive segmentation, compared to a fixed one. Also, a lower distortion for voiced speech and higher segSNR for both components is possible, as compared to other decomposition methods.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Partitioned Graph Convolution Using Adversarial and Regression Networks for Road Travel Speed Prediction
Authors:
Jakob Meldgaard Kjær,
Lasse Kristensen,
Mads Alberg Christensen
Abstract:
Access to quality travel time information for roads in a road network has become increasingly important with the rising demand for real-time travel time estimation for paths within road networks. In the context of the Danish road network (DRN) dataset used in this paper, the data coverage is sparse and skewed towards arterial roads, with a coverage of 23.88% across 850,980 road segments, which mak…
▽ More
Access to quality travel time information for roads in a road network has become increasingly important with the rising demand for real-time travel time estimation for paths within road networks. In the context of the Danish road network (DRN) dataset used in this paper, the data coverage is sparse and skewed towards arterial roads, with a coverage of 23.88% across 850,980 road segments, which makes travel time estimation difficult. Existing solutions for graph-based data processing often neglect the size of the graph, which is an apparent problem for road networks with a large amount of connected road segments. To this end, we propose a framework for predicting road segment travel speed histograms for dataless edges, based on a latent representation generated by an adversarially regularized convolutional network. We apply a partitioning algorithm to divide the graph into dense subgraphs, and then train a model for each subgraph to predict speed histograms for the nodes. The framework achieves an accuracy of 71.5% intersection and 78.5% correlation on predicting travel speed histograms using the DRN dataset. Furthermore, experiments show that partitioning the dataset into clusters increases the performance of the framework. Specifically, partitioning the road network dataset into 100 clusters, with approximately 500 road segments in each cluster, achieves a better performance than when using 10 and 20 clusters.
△ Less
Submitted 26 February, 2021;
originally announced March 2021.
-
Strong-coupling expansion of multi-band interacting models: mapping onto the transverse-field $J_1$-$J_2$ Ising model
Authors:
Xiaoyu Wang,
Morten. H. Christensen,
Erez Berg,
Rafael M. Fernandes
Abstract:
We investigate a class of two-dimensional two-band microscopic models in which the inter-band repulsive interactions play the dominant role. We first demonstrate three different schemes of constraining the ratios between the three types of inter-band interactions -- density-density, spin exchange, and pair-hopping -- that render the model free of the fermionic sign-problem for any filling and, con…
▽ More
We investigate a class of two-dimensional two-band microscopic models in which the inter-band repulsive interactions play the dominant role. We first demonstrate three different schemes of constraining the ratios between the three types of inter-band interactions -- density-density, spin exchange, and pair-hopping -- that render the model free of the fermionic sign-problem for any filling and, consequently, amenable to efficient Quantum Monte Carlo simulations. We then study the behavior of these sign-problem-free models in the strong-coupling regime. In the cases where spin-rotational invariance is preserved or lowered to a planar symmetry, the strong-coupling ground state is a quantum paramagnet. However, in the case where there is only a residual Ising symmetry, the strong-coupling expansion maps onto the transverse-field $J_1$-$J_2$ Ising model, whose pseudospins are associated with local inter-band magnetic order. We show that by varying the band structure parameters within a reasonable range of values, a variety of ground states and quantum critical points can be accessed in the strong-coupling regime, some of which are not realized in the weak-coupling regime. We compare these results with the case of the single-band Hubbard model, where only intra-band repulsion is present, and whose strong-coupling behavior is captured by a simple Heisenberg model.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Spatial Functional Data Modeling of Plant Reflectances
Authors:
Philip A. White,
Henry Frye,
Michael F. Christensen,
Alan E. Gelfand,
John A. Silander Jr
Abstract:
Plant reflectance spectra - the profile of light reflected by leaves across different wavelengths - supply the spectral signature for a species at a spatial location to enable estimation of functional and taxonomic diversity for plants. We consider leaf spectra as "responses" to be explained spatially. These spectra/reflectances are functions over a wavelength band that respond to the environment.…
▽ More
Plant reflectance spectra - the profile of light reflected by leaves across different wavelengths - supply the spectral signature for a species at a spatial location to enable estimation of functional and taxonomic diversity for plants. We consider leaf spectra as "responses" to be explained spatially. These spectra/reflectances are functions over a wavelength band that respond to the environment.
Our motivating data are gathered for several families from the Cape Floristic Region (CFR) in South Africa and lead us to develop rich novel spatial models that can explain spectra for genera within families. Wavelength responses for an individual leaf are viewed as a function of wavelength, leading to functional data modeling. Local environmental features become covariates. We introduce wavelength - covariate interaction since the response to environmental regressors may vary with wavelength, so may variance. Formal spatial modeling enables prediction of reflectances for genera at unobserved locations with known environmental features. We incorporate spatial dependence, wavelength dependence, and space-wavelength interaction (in the spirit of space-time interaction). We implement out-of-sample validation to select a best model, discovering that the model features listed above are all informative for the functional data analysis. We then supply interpretation of the results under the selected model.
△ Less
Submitted 25 March, 2021; v1 submitted 5 February, 2021;
originally announced February 2021.
-
Prediction of Double-Weyl Points in the Iron-Based Superconductor CaKFe$_4$As$_4$
Authors:
N. Heinsdorf,
M. H. Christensen,
M. Iraola,
S. Zhang,
F. Yang,
T. Birol,
C. D. Batista,
R. Valentí,
R. M. Fernandes
Abstract:
Employing a combination of symmetry analysis, low-energy modeling, and ab initio simulations, we predict the presence of magnetic-field-induced Weyl points close to the Fermi level in CaKFe$_4$As$_4$. Depending on the relative strengths of the magnetic field and of the spin-orbit coupling, the Weyl fermions can carry a topological charge of $\pm1$ or $\pm2$, making CaKFe$_4$As$_4$ a rare realizati…
▽ More
Employing a combination of symmetry analysis, low-energy modeling, and ab initio simulations, we predict the presence of magnetic-field-induced Weyl points close to the Fermi level in CaKFe$_4$As$_4$. Depending on the relative strengths of the magnetic field and of the spin-orbit coupling, the Weyl fermions can carry a topological charge of $\pm1$ or $\pm2$, making CaKFe$_4$As$_4$ a rare realization of a double-Weyl semimetal. We further predict experimental manifestations of these Weyl points, both in bulk properties, such as the anomalous Hall effect, and in surface properties, such as the emergence of prominent Fermi arcs. Because CaKFe$_4$As$_4$ displays unconventional fully-gapped superconductivity below 30 K, our findings open a novel route to investigate the interplay between superconductivity and Weyl fermions.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Topological Superconductivity Induced by Magnetic Texture Crystals
Authors:
Daniel Steffensen,
Morten H. Christensen,
Brian M. Andersen,
Panagiotis Kotetes
Abstract:
We present a detailed investigation of the topological phases and Majorana fermion (MF) excitations that arise from the bulk interplay between (un)conventional one/two-band spin-singlet superconductivity and a number of magnetic texture crystals. The latter define inhomogeneous magnetization profiles which consist of a periodically-repeating primitive cell. Here we focus on magnetic texture crysta…
▽ More
We present a detailed investigation of the topological phases and Majorana fermion (MF) excitations that arise from the bulk interplay between (un)conventional one/two-band spin-singlet superconductivity and a number of magnetic texture crystals. The latter define inhomogeneous magnetization profiles which consist of a periodically-repeating primitive cell. Here we focus on magnetic texture crystals with a primitive cell of the helix, whirl, and skyrmion types, which feature distinct symmetry properties. We identify a multitude of accessible topological phases which harbor flat, uni- or bi-directional, (quasi-)helical, or chiral MF edge modes. This rich variety originates from the interplay between topological phases with gapped and nodal bulk energy spectra. The types of the emerging topological superconducting phases and the features of the arising MFs are solely determined by the properties and compatibility of the so-called magnetic and pairing point/space groups. Our analysis is general and does not rely on specific parameters of the models employed here to exemplify the topological scenarios which become accessible. Therefore, our results can be extended to systems with multiple bands, are relevant for a wide range of layered materials and hybrid devices, and provide predictions for strong, weak and crystalline topological phases.
△ Less
Submitted 19 March, 2022; v1 submitted 17 December, 2020;
originally announced December 2020.
-
Evolution of nematic fluctuations in CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ with spin-vortex crystal magnetic order
Authors:
Anna E. Böhmer,
Fei Chen,
William R. Meier,
Mingyu Xu,
Gil Drachuck,
Michael Merz,
Paul W. Wiecki,
Sergey L. Bud'ko,
Vladislav Borisov,
Roser Valentí,
Morten H. Christensen,
Rafael M. Fernandes,
Christoph Meingast,
Paul C. Canfield
Abstract:
The CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ superconductors resemble the archetypal 122-type iron-based materials but have a crystal structure with distinctly lower symmetry. This family hosts one of the few examples of the so-called spin-vortex crystal magnetic order, a non-collinear magnetic configuration that preserves tetragonal symmetry, in contrast to the orthorhombic collinear stripe-type mag…
▽ More
The CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ superconductors resemble the archetypal 122-type iron-based materials but have a crystal structure with distinctly lower symmetry. This family hosts one of the few examples of the so-called spin-vortex crystal magnetic order, a non-collinear magnetic configuration that preserves tetragonal symmetry, in contrast to the orthorhombic collinear stripe-type magnetic configuration common to the 122-type systems. Thus, nematic order is completely absent from its phase diagram. To investigate the evolution of nematic fluctuations in such a case, we present elastoresistance and elastic modulus measurements in CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ ($x = 0-0.05$) combined with phenomenological modeling and density functional theory. We find clear experimental signatures of considerable nematic fluctuations, including softening of the Young's modulus $Y_{[110]}$ and a Curie-Weiss type divergence of the B2g elastoresistance coefficient in CaK(Fe$_{0.951}$Ni$_{0.049}$)$_4$As$_4$. Overall, nematic fluctuations within this series bear strong similarities to the hole-doped Ba$_{1-x}$K$_x$Fe$_2$As$_2$ series, including a substitution-induced sign change. Our theoretical analysis addresses the effect of the specific crystal symmetry of the 1144-type structure in determining its magnetic ground state and on the nematic fluctuations.
△ Less
Submitted 26 November, 2020;
originally announced November 2020.