Showing 1–50 of 66 results for author: Brunner, D

Pilot-Based SFO Estimation for Bistatic Integrated Sensing and Communication

Authors: Lucas Giroto de Oliveira, Yueheng Li, Silvio Mandelli, David Brunner, Marcus Henninger, Xiang Wan, Tie Jun Cui, Thomas Zwick, Benjamin Nuss

Abstract: Enabling bistatic radar sensing within the context of integrated sensing and communication (ISAC) for future sixth generation mobile networks demands strict synchronization accuracy, which is particularly challenging to be achieved with over-the-air synchronization. Existing algorithms handle time and frequency offsets adequately, but provide insufficiently accurate sampling frequency offset (SFO)… ▽ More Enabling bistatic radar sensing within the context of integrated sensing and communication (ISAC) for future sixth generation mobile networks demands strict synchronization accuracy, which is particularly challenging to be achieved with over-the-air synchronization. Existing algorithms handle time and frequency offsets adequately, but provide insufficiently accurate sampling frequency offset (SFO) estimates that result in degradation of obtained radar images in the form of signal-to-noise ratio loss and migration of range and Doppler shift. This article introduces an SFO estimation algorithm named tilt inference of time offset (TITO) for orthogonal frequency-division multiplexing (OFDM)-based ISAC. Using available pilot subcarriers, TITO obtains channel impulse response estimates and extracts information on the SFO-induced delay migration to a dominant reference path with constant range, Doppler shift, and angle between transmit and receive ISAC nodes. TITO then adaptively selects the delay estimates that are only negligibly impaired by SFO-induced intersymbol interference, ultimately employing them to estimate the SFO. Assuming a scenario without a direct line-of-sight (LoS) between the aforementioned transmitting and receiving ISAC nodes, a system concept with a relay reflective intelligent surface (RIS) is used to create the aforementioned reference path is proposed. Besides a mathematical derivation of accuracy bounds, simulation and measurements at 26.2 GHz are presented to demonstrate TITO's superiority over existing methods in terms of SFO estimation accuracy and robustness. △ Less

Submitted 10 July, 2024; originally announced July 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Training of Physical Neural Networks

Authors: Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright, Peter L. McMahon, Clara C. Wanjura, Yuhang Li, Anas Skalli, Natalia G. Berloff, Tatsuhiro Onodera, Ilker Oguz, Francesco Morichetti, Philipp del Hougne, Manuel Le Gallo, Abu Sebastian, Azalia Mirhoseini, Cheng Zhang, Danijela Marković, Daniel Brunner, Christophe Moser, Sylvain Gigan, Florian Marquardt, Aydogan Ozcan, Julie Grollier, Andrea J. Liu , et al. (3 additional authors not shown)

Abstract: Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also… ▽ More Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also have them perform inference locally and privately on edge devices, such as smartphones or sensors? Research over the past few years has shown that the answer to all these questions is likely "yes, with enough research": PNNs could one day radically change what is possible and practical for AI systems. To do this will however require rethinking both how AI models work, and how they are trained - primarily by considering the problems through the constraints of the underlying hardware physics. To train PNNs at large scale, many methods including backpropagation-based and backpropagation-free approaches are now being explored. These methods have various trade-offs, and so far no method has been shown to scale to the same scale and performance as the backpropagation algorithm widely used in deep learning today. However, this is rapidly changing, and a diverse ecosystem of training techniques provides clues for how PNNs may one day be utilized to create both more efficient realizations of current-scale AI models, and to enable unprecedented-scale models. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 29 pages, 4 figures

Nonlinear integrated optical resonators for optical fibre data recovery

Authors: Ivan K. Boikov, Daniel Brunner, Alfredo De Rossi

Abstract: We apply in simulation a reservoir computer based on evanescently coupled GaAs microrings for real-time compensation of a nonlinear distortion of a 50 Gbaud 16-QAM signal with the launch power up to 12 dBでしべるm in a standard single-mode optical fibre. We clearly evidence the crucial role of fast nonlinear response in enabling all-optical signal recovery in real time. With our system we are able to redu… ▽ More We apply in simulation a reservoir computer based on evanescently coupled GaAs microrings for real-time compensation of a nonlinear distortion of a 50 Gbaud 16-QAM signal with the launch power up to 12 dBでしべるm in a standard single-mode optical fibre. We clearly evidence the crucial role of fast nonlinear response in enabling all-optical signal recovery in real time. With our system we are able to reduce the signal error rate below the forward error correction limit for a 20 km fibre and 12 dBでしべるm launch power. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: 13 pages, 5 figures

Bistatic OFDM-based ISAC with Over-the-Air Synchronization: System Concept and Performance Analysis

Authors: David Brunner, Lucas Giroto de Oliveira, Charlotte Muth, Silvio Mandelli, Marcus Henninger, Axel Diewald, Yueheng Li, Mohamad Basim Alabd, Laurent Schmalen, Thomas Zwick, Benjamin Nuss

Abstract: Integrated sensing and communication (ISAC) has been defined as one goal for 6G mobile communication systems. In this context, this article introduces a bistatic ISAC system based on orthogonal frequency-division multiplexing (OFDM). While the bistatic architecture brings advantages such as not demanding full duplex operation with respect to the monostatic one, the need for synchronizing transmitt… ▽ More Integrated sensing and communication (ISAC) has been defined as one goal for 6G mobile communication systems. In this context, this article introduces a bistatic ISAC system based on orthogonal frequency-division multiplexing (OFDM). While the bistatic architecture brings advantages such as not demanding full duplex operation with respect to the monostatic one, the need for synchronizing transmitter and receiver is imposed. In this context, this article introuces a bistatic ISAC signal processing framework where an incoming OFDM-based ISAC signal undergoes over-the-air synchronization based on preamble symbols and pilots. Afterwards, bistatic radar processing is performed using either only pilot subcarriers or the full OFDM frame. The latter approach requires estimation of the originally transmitted frame based on communication processing and therefore error-free communication, which can be achieved via appropriate channel coding. The performance and limitations of the introduced system based on both aforementioned approaches are assessed via an analysis of the impact of residual synchronization mismatches and data decoding failures on both communication and radar performances. Finally, the performed analyses are validated by proof-of-concept measurement results. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Combining Compositional Data Sets Introduces Error in Covariance Network Reconstruction

Authors: James D. Brunner, Aaron J. Robinson, Patrick S. G. Chain

Abstract: Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inf… ▽ More Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inference techniques. We quantify the challenges of cross-kingdom network inference from both a theoretical and practical viewpoint using synthetic and real-world microbiome data. We detail the theoretical issue presented by combining compositional data sets drawn from the same environment, e.g. 16S and ITS sequencing of a single set of samples, and survey common network inference techniques for their ability to handle this error. We then test these techniques for the accuracy and usefulness of their intra- and inter-kingdom associations by inferring networks from a set of simulated samples for which a ground-truth set of associations is known. We show that while two methods mitigate the error of cross-kingdom inference, there is little difference between techniques for key practical applications including identification of strong correlations and identification of possible keystone taxa (i.e. hub nodes in the network). Furthermore, we identify a signature of the error caused transkingdom network inference and demonstrate that it appears in networks constructed using real-world environmental microbiome data. △ Less

Submitted 12 April, 2024; v1 submitted 7 November, 2023; originally announced November 2023.

Comments: 18 pages, 10 figures, 1 table

Automatic Anonymization of Swiss Federal Supreme Court Rulings

Authors: Joel Niklaus, Robin Mamié, Matthias Stürmer, Daniel Brunner, Marcel Gygli

Abstract: Releasing court decisions to the public relies on proper anonymization to protect all involved parties, where necessary. The Swiss Federal Supreme Court relies on an existing system that combines different traditional computational methods with human experts. In this work, we enhance the existing anonymization software using a large dataset annotated with entities to be anonymized. We compared BER… ▽ More Releasing court decisions to the public relies on proper anonymization to protect all involved parties, where necessary. The Swiss Federal Supreme Court relies on an existing system that combines different traditional computational methods with human experts. In this work, we enhance the existing anonymization software using a large dataset annotated with entities to be anonymized. We compared BERT-based models with models pre-trained on in-domain data. Our results show that using in-domain data to pre-train the models further improves the F1-score by more than 5\% compared to existing models. Our work demonstrates that combining existing anonymization methods, such as regular expressions, with machine learning can further reduce manual labor and enhance automatic suggestions. △ Less

Submitted 31 October, 2023; v1 submitted 6 October, 2023; originally announced October 2023.

Comments: Accepted to NLLP @ EMNLP 2023

MSC Class: 68T50 ACM Class: I.2

The SPARC Toroidal Field Model Coil Program

Authors: Zachary Hartwig, Rui Vieira, Darby Dunn, Theodore Golfinopoulos, Brian LaBombard, Christopher Lammi, Phil Michael, Susan Agabian, David Arsenault, Raheem Barnett, Mike Barry, Larry Bartoszek, William Beck, David Bellofatto, Daniel Brunner, William Burke, Jason Burrows, William Byford, Charles Cauley, Sarah Chamberlain, David Chavarria, JL Cheng, James Chicarello, Karen Cote, Corinne Cotta , et al. (75 additional authors not shown)

Abstract: The SPARC Toroidal Field Model Coil (TFMC) Program was a three-year effort between 2018 and 2021 that developed novel Rare Earth Yttrium Barium Copper Oxide (REBCO) superconductor technologies and then successfully utilized these technologies to design, build, and test a first-in-class, high-field (~20 T), representative-scale (~3 m) superconducting toroidal field coil. With the principal objectiv… ▽ More The SPARC Toroidal Field Model Coil (TFMC) Program was a three-year effort between 2018 and 2021 that developed novel Rare Earth Yttrium Barium Copper Oxide (REBCO) superconductor technologies and then successfully utilized these technologies to design, build, and test a first-in-class, high-field (~20 T), representative-scale (~3 m) superconducting toroidal field coil. With the principal objective of demonstrating mature, large-scale, REBCO magnets, the project was executed jointly by the MIT Plasma Science and Fusion Center (PSFC) and Commonwealth Fusion Systems (CFS). The TFMC achieved its programmatic goal of experimentally demonstrating a large-scale high-field REBCO magnet, achieving 20.1 T peak field-on-conductor with 40.5 kA of terminal current, 815 kN/m of Lorentz loading on the REBCO stacks, and almost 1 GPa of mechanical stress accommodated by the structural case. Fifteen internal demountable pancake-to-pancake joints operated in the 0.5 to 2.0 nOhm range at 20 K and in magnetic fields up to 12 T. The DC and AC electromagnetic performance of the magnet, predicted by new advances in high-fidelity computational models, was confirmed in two test campaigns while the massively parallel, single-pass, pressure-vessel style coolant scheme capable of large heat removal was validated. The REBCO current lead and feeder system was experimentally qualified up to 50 kA, and the crycooler based cryogenic system provided 600 W of cooling power at 20 K with mass flow rates up to 70 g/s at a maximum design pressure of 20 bar-a for the test campaigns. Finally, the feasibility of using passive, self-protection against a quench in a fusion-scale NI TF coil was experimentally assessed with an intentional open-circuit quench at 31.5 kA terminal current. △ Less

Submitted 18 August, 2023; originally announced August 2023.

Comments: 17 pages 9 figures, overview paper and the first of a six-part series of papers covering the TFMC Program

Direct coupling of nonlinear integrated cavities for all-optical reservoir computing

Authors: Ivan Boikov, Daniel Brunner, Alfredo De Rossi

Abstract: We consider theoretically a network of directly coupled optical microcavities to implement a space-multiplexed optical neural network in an integrated nanophotonic circuit. Nonlinear photonic network integrations based on direct coupling ensures a highly dense integration, reducing the chip footprint by several orders of magnitude compared to other implementations. Different nonlinear effects inhe… ▽ More We consider theoretically a network of directly coupled optical microcavities to implement a space-multiplexed optical neural network in an integrated nanophotonic circuit. Nonlinear photonic network integrations based on direct coupling ensures a highly dense integration, reducing the chip footprint by several orders of magnitude compared to other implementations. Different nonlinear effects inherent to such microcavities are studied when used for realizing an all-optical autonomous computing substrate, here based on the reservoir computing concept. We provide an in-depth analysis of the impact of basic microcavity parameters on computational metrics of the system, namely, the dimensionality and the consistency. Importantly, we find that differences between frequencies and bandwidths of supermodes formed by the direct coupling is the determining factor of the reservoir's dimensionality and its scalability. The network's dimensionality can be improved with frequency-shifting nonlinear effects such as the Kerr effect, while two-photon absorption has an opposite effect. Finally, we demonstrate in simulation that the proposed reservoir is capable of solving the Mackey-Glass prediction and the optical signal recovery tasks at GHz timescale. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Inferring microbial interactions with their environment from genomic and metagenomic data

Authors: James D. Brunner, Laverne A. Gallegos-Graves, Marie E. Kroeger

Abstract: Microbial communities assemble through a complex set of interactions between microbes and their environment, and the resulting metabolic impact on the host ecosystem can be profound. Microbial activity is known to impact human health, plant growth, water quality, and soil carbon storage which has lead to the development of many approaches and products meant to manipulate the microbiome. In order t… ▽ More Microbial communities assemble through a complex set of interactions between microbes and their environment, and the resulting metabolic impact on the host ecosystem can be profound. Microbial activity is known to impact human health, plant growth, water quality, and soil carbon storage which has lead to the development of many approaches and products meant to manipulate the microbiome. In order to understand, predict, and improve microbial community engineering, genome-scale modeling techniques have been developed to translate genomic data into inferred microbial dynamics. However, these techniques rely heavily on simulation to draw conclusions which may vary with unknown parameters or initial conditions, rather than more robust qualitative analysis. To better understand microbial community dynamics using genome-scale modeling, we provide a tool to investigate the network of interactions between microbes and environmental metabolites over time. Using our previously developed algorithm for simulating microbial communities from genome-scale metabolic models (GSMs), we infer the set of microbe-metabolite interactions within a microbial community in a particular environment. Because these interactions depend on the available environmental metabolites, we refer to the networks that we infer as \emph{metabolically contextualized}, and so name our tool MetConSIN: \underline{Met}abolically \underline{Con}textualized \underline{S}pecies \underline{I}nteraction \underline{N}etworks. △ Less

Submitted 8 November, 2023; v1 submitted 5 July, 2023; originally announced July 2023.

Comments: 27 pages, 10 figure, 4 tables

Bistatic OFDM-based Joint Radar-Communication: Synchronization, Data Communication and Sensing

Authors: Lucas Giroto de Oliveira, David Brunner, Axel Diewald, Charlotte Muth, Laurent Schmalen, Thomas Zwick, Benjamin Nuss

Abstract: This article introduces a bistatic joint radar-communication (RadCom) system based on orthogonal frequency-division multiplexing (OFDM). In this context, the adopted OFDM frame structure is described and system model encompassing time, frequency, and sampling synchronization mismatches between the transmitter and receiver of the bistatic system is outlined. Next, the signal processing approaches f… ▽ More This article introduces a bistatic joint radar-communication (RadCom) system based on orthogonal frequency-division multiplexing (OFDM). In this context, the adopted OFDM frame structure is described and system model encompassing time, frequency, and sampling synchronization mismatches between the transmitter and receiver of the bistatic system is outlined. Next, the signal processing approaches for synchronization and communication are discussed, and radar sensing processing approaches using either only pilots or a reconstructed OFDM frame based on the estimated receive communication data are presented. Finally, proof-of-concept measurement results are presented to validate the investigated system and a trade-off between frame size and the performance of the aforementioned processing steps is observed. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: Accepted for presentation at the focused session "Joint Communication and Radar Sensing - a step towards 6G'' of the EuMW 2023

Linear Optical Random Projections Without Holography

Authors: Ruben Ohana, Daniel Hesslow, Daniel Brunner, Sylvain Gigan, Kilian Müller

Abstract: We introduce a novel method to perform linear optical random projections without the need for holography. Our method consists of a computationally trivial combination of multiple intensity measurements to mitigate the information loss usually associated with the absolute-square non-linearity imposed by optical intensity measurements. Both experimental and numerical findings demonstrate that the re… ▽ More We introduce a novel method to perform linear optical random projections without the need for holography. Our method consists of a computationally trivial combination of multiple intensity measurements to mitigate the information loss usually associated with the absolute-square non-linearity imposed by optical intensity measurements. Both experimental and numerical findings demonstrate that the resulting matrix consists of real-valued, independent, and identically distributed (i.i.d.) Gaussian random entries. Our optical setup is simple and robust, as it does not require interference between two beams. We demonstrate the practical applicability of our method by performing dimensionality reduction on high-dimensional data, a common task in randomized numerical linear algebra with relevant applications in machine learning. △ Less

Submitted 22 May, 2023; originally announced May 2023.

Comments: 7 pages, 4 figures

Journal ref: Opt. Express 31, 25881-25888 (2023)

Convergence and scaling of Boolean-weight optimization for hardware reservoirs

Authors: Louis Andreoli, Stéphane Chrétien, Xavier Porte, Daniel Brunner

Abstract: Hardware implementation of neural network are an essential step to implement next generation efficient and powerful artificial intelligence solutions. Besides the realization of a parallel, efficient and scalable hardware architecture, the optimization of the system's extremely large parameter space with sampling-efficient approaches is essential. Here, we analytically derive the scaling laws… ▽ More Hardware implementation of neural network are an essential step to implement next generation efficient and powerful artificial intelligence solutions. Besides the realization of a parallel, efficient and scalable hardware architecture, the optimization of the system's extremely large parameter space with sampling-efficient approaches is essential. Here, we analytically derive the scaling laws for highly efficient Coordinate Descent applied to optimizing the readout layer of a random recurrently connection neural network, a reservoir. We demonstrate that the convergence is exponential and scales linear with the network's number of neurons. Our results perfectly reproduce the convergence and scaling of a large-scale photonic reservoir implemented in a proof-of-concept experiment. Our work therefore provides a solid foundation for such optimization in hardware networks, and identifies future directions that are promising for optimizing convergence speed during learning leveraging measures of a neural network's amplitude statistics and the weight update rule. △ Less

Submitted 13 May, 2023; originally announced May 2023.

Comments: Submitted to ECML-PKDD workshop Deep Learning meets Neuromorphic Hardware

Roadmap on Deep Learning for Microscopy

Authors: Giovanni Volpe, Carolina Wählby, Lei Tian, Michael Hecht, Artur Yakimovich, Kristina Monakhova, Laura Waller, Ivo F. Sbalzarini, Christopher A. Metzler, Mingyang Xie, Kevin Zhang, Isaac C. D. Lenton, Halina Rubinsztein-Dunlop, Daniel Brunner, Bijie Bai, Aydogan Ozcan, Daniel Midtvedt, Hao Wang, Nataša Sladoje, Joakim Lindblad, Jason T. Smith, Marien Ochoa, Margarida Barroso, Xavier Intes, Tong Qiu , et al. (50 additional authors not shown)

Abstract: Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the… ▽ More Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Deterministic and stochastic coarsening control in optically-addressed spatial light modulators subject to optical feedback

Authors: Vladimir V. Semenov, Xavier Porte, Laurent Larger, Daniel Brunner

Abstract: Phase separation accompanied by further domain growth and coarsening is a phenomenon common to a broad variety of dynamical systems. In this connection, controlling such processes represents a relevant interdisciplinary problem. Using methods of numerical modelling, we demonstrate two approaches for the coarsening control in bistable systems based on the example of a spatially-extended model descr… ▽ More Phase separation accompanied by further domain growth and coarsening is a phenomenon common to a broad variety of dynamical systems. In this connection, controlling such processes represents a relevant interdisciplinary problem. Using methods of numerical modelling, we demonstrate two approaches for the coarsening control in bistable systems based on the example of a spatially-extended model describing an optically-addressed spatial light modulator with two color illumination subject to optical feedback. The first method implies varying system parameters such that the system evolves as the pitchfork or saddle-node normal forms. The second method leverages noise whose intensity is used as an additional system parameter. Both, deterministic and stochastic schemes allow to control the direction and speed of the fronts separating spatial domains. The considered stochastic control represents a particular case of the noise-sustained front propagation in bistable systems and involves the properties of the optical system under study. In contrast, the proposed deterministic control technique can be applied to bistable systems of different nature. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: 9 pages, 7 figures

Low-threshold lasing of optically pumped micropillar lasers with Al$_{0.2}$Ga$_{0.8}$As/Al$_{0.9}$Ga$_{0.1}$As distributed Bragg reflectors

Authors: Ching-Wen Shih, Imad Limame, Sebastian Krüger, Chirag C. Palekar, Aris Koulas-Simos, Daniel Brunner, Stephan Reitzenstein

Abstract: We report on the design, realization and characterization of optically pumped micropillar lasers with low-absorbing Al$_{0.2}$Ga$_{0.8}$As/Al$_{0.9}$Ga$_{0.1}$As dielectric Bragg reflectors (DBRs) instead of commonly used GaAs/AlGaAs DBRs. A layer of (In, Ga)As quantum dots (QDs) is embedded in the GaAs $λらむだ$-cavity of as an active medium. We experimentally study the lasing characteristics of the fa… ▽ More We report on the design, realization and characterization of optically pumped micropillar lasers with low-absorbing Al$_{0.2}$Ga$_{0.8}$As/Al$_{0.9}$Ga$_{0.1}$As dielectric Bragg reflectors (DBRs) instead of commonly used GaAs/AlGaAs DBRs. A layer of (In, Ga)As quantum dots (QDs) is embedded in the GaAs $λらむだ$-cavity of as an active medium. We experimentally study the lasing characteristics of the fabricated micropillars by means of low-temperature photoluminescence with varying pump laser's wavelength between 532 nm and 899 nm. The incorporation of 20% Al content in the DBRs opens an optical pumping window from 700 nm to 820 nm, where the excitation laser light can effectively reach the GaAs cavity above its bandgap, while remaining transparent to the DBRs. This results in a substantially improved pump efficiency, a low lasing threshold, and a high thermal stability. Pump laser wavelengths outside of the engineered spectral window lead to low pump efficiency due to strong absorption by the top DBR, or inefficient excitation of pump-level excitons, respectively. The superiority of the absorption-free modified DBRs is demonstrated by simply switching the pump laser wavelength from 671 nm to 708 nm, which crosses the DBRs absorption edge and drastically reduces the lasing threshold by more than an order of magnitude from (363.5 $\pm$ 18.5) $μみゅー$W to (12.8 $\pm$ 0.3) $μみゅー$W. △ Less

Submitted 14 March, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Additive 3D photonic integration that is CMOS compatible

Authors: Adria Grabulosa, Johnny Moughames, Xavier Porte, Muamer Kadic, Daniel Brunner

Abstract: Today, continued miniaturization in electronic integrated circuits (ICs) appears to have reached its fundamental limit. At the same time, energy consumption due by communication becomes the dominant limitation in high performance electronic ICs for computing, and modern computing concepts such a neural networks further amplify the challenge. Photonic communication is a promising strategy to addres… ▽ More Today, continued miniaturization in electronic integrated circuits (ICs) appears to have reached its fundamental limit. At the same time, energy consumption due by communication becomes the dominant limitation in high performance electronic ICs for computing, and modern computing concepts such a neural networks further amplify the challenge. Photonic communication is a promising strategy to address the second, while adding a third dimension to the predominantly two dimensional integrated circuits appears the most promising future strategy for further IC architecture improvement. Crucial for efficient electronic-photonic co-integration is CMOS compatibility. Here, we review our latest results obtained in the FEMTO-ST RENATECH facilities on using additive photo-induced polymerization of a standard photo-resin for truly 3D photonic integration according to these principles. Based on one- and two-photon polymerization and combined with direct-laser writing, we 3D-printed air- and polymer-cladded photonic waveguides. An important application of such circuits are the interconnects of optical neural networks, where 3D integration enables scalability in terms of network size versus its geometric dimensions. In particular via \emph{flash}-TPP, a fabrication process combining blanket one- and high-resolution two-photon polymerization, we demonstrated polymer-cladded step-index waveguides with up to 6~mm length, low insertion ($\sim$0.26~dB) and propagation ($\sim$1.3~dB/mm) losses, realized broadband and low loss ($\sim$0.06~dB splitting losses) adiabatic 1 to M couplers as well as tightly confining air-cladded waveguides for denser integration. By stably printing such integrated photonic circuits on standard semiconductor samples, we show the concept's CMOS compatibility. With this, we lay out a promising, future avenue for scalable integration of hybrid photonic and electronic components. △ Less

Submitted 3 January, 2023; originally announced January 2023.

Metabolic Model-based Ecological Modeling for Probiotic Design

Authors: James D. Brunner, Nicholas Chia

Abstract: The microbial community composition in the human gut has a profound effect on human health. This observation has lead to extensive use of microbiome therapies, including over-the-counter ``probiotic" treatments intended to alter the composition of the microbiome. Despite so much promise and commercial interest, the factors that contribute to the success or failure of microbiome-targeted treatments… ▽ More The microbial community composition in the human gut has a profound effect on human health. This observation has lead to extensive use of microbiome therapies, including over-the-counter ``probiotic" treatments intended to alter the composition of the microbiome. Despite so much promise and commercial interest, the factors that contribute to the success or failure of microbiome-targeted treatments remain unclear. We investigate the biotic interactions that lead to successful engraftment of a novel bacterial strain introduced to the microbiome as in probiotic treatments. We use pairwise genome-scale metabolic modeling with a generalized resource allocation constraint to build a network of interactions between 818 species with well developed models available in the AGORA database. We create induced sub-graphs using the taxa present in samples from three experimental engraftment studies and assess the likelihood of invader engraftment based on network structure. To do so, we use a set of dynamical models designed to reflect connect network topology to growth dynamics. We show that a generalized Lotka-Volterra model has strong ability to predict if a particular invader or probiotic will successfully engraft into an individual's microbiome. Furthermore, we show that the mechanistic nature of the model is useful for revealing which microbe-microbe interactions potentially drive engraftment. △ Less

Submitted 6 October, 2022; originally announced October 2022.

Comments: 18 pages, 6 figures

(3+1)D-printed adiabatic 1-to-N broadband couplers

Authors: Adrià Grabulosa, Xavier Porte, Erik Jung, Johnny Moughames, Muamer Kadic, Daniel Brunner

Abstract: We report single-mode 3D optical couplers leveraging adiabatic power transfer towards up to 4 output ports. We use the CMOS compatible additive (3+1)D \emph{flash}-TPP printing for fast and scalable fabrication. Coupling optical losses of such devices are reduced below $\sim$~0.06~dB by tailoring the coupling and waveguides geometry, and we demonstrate almost octave-spanning broadband functionalit… ▽ More We report single-mode 3D optical couplers leveraging adiabatic power transfer towards up to 4 output ports. We use the CMOS compatible additive (3+1)D \emph{flash}-TPP printing for fast and scalable fabrication. Coupling optical losses of such devices are reduced below $\sim$~0.06~dB by tailoring the coupling and waveguides geometry, and we demonstrate almost octave-spanning broadband functionality from 520~nm to 980~nm. △ Less

Submitted 20 August, 2022; originally announced August 2022.

Injection locking and coupling the emitters of large VCSEL arrays via diffraction in an external cavity

Authors: Moritz Pflüger, Daniel Brunner, Tobias Heuser, James A. Lott, Stephan Reitzenstein, Ingo Fischer

Abstract: Networks of optically coupled semiconductor lasers are of high interest for fundamental investigations and for enabling numerous technological applications in material processing, lighting and information processing. Still, experimental realizations of large networks of such elements employing a scalable concepts have so far been been lacking. Here, we present a network 22 of the vertical-cavity s… ▽ More Networks of optically coupled semiconductor lasers are of high interest for fundamental investigations and for enabling numerous technological applications in material processing, lighting and information processing. Still, experimental realizations of large networks of such elements employing a scalable concepts have so far been been lacking. Here, we present a network 22 of the vertical-cavity surface-emitting lasers in a $5 \times 5$ square lattice array via. Crucially, the array allows individual control over each laser's pump current, which we leverage spectrally align the array. Leveraging diffractive coupling through an external cavity, 22 lasers are mutually injection locked, and, furthermore, we demonstrate their simultaneous phase locking to an external injection laser. The VCSEL network is a promising platform for experimental investigations of complex systems and has direct applications as a photonic neural network. The scalability of the concept opens future possibilities for systems comprising many more individual lasers. △ Less

Submitted 20 August, 2022; originally announced August 2022.

Noise mitigation strategies in physical feedforward neural networks

Authors: Nadezhda Semenova, Daniel Brunner

Abstract: Physical neural networks are promising candidates for next generation artificial intelligence hardware. In such architectures, neurons and connections are physically realized and do not leverage digital concepts with their practically infinite signal-to-noise ratio to encode, transduce and transform information. They therefore are prone to noise with a variety of statistical and architectural prop… ▽ More Physical neural networks are promising candidates for next generation artificial intelligence hardware. In such architectures, neurons and connections are physically realized and do not leverage digital concepts with their practically infinite signal-to-noise ratio to encode, transduce and transform information. They therefore are prone to noise with a variety of statistical and architectural properties, and effective strategies leveraging network-inherent assets to mitigate noise in an hardware-efficient manner are important in the pursuit of next generation neural network hardware. Based on analytical derivations, we here introduce and analyse a variety of different noise-mitigation approaches. We analytically show that intra-layer connections in which the connection matrix's squared mean exceeds the mean of its square fully suppresses uncorrelated noise. We go beyond and develop two synergistic strategies for noise that is uncorrelated and correlated across populations of neurons. First, we introduce the concept of ghost neurons, where each group of neurons perturbed by correlated noise has a negative connection to a single neuron, yet without receiving any input information. Secondly, we show that pooling of neuron populations is an efficient approach to suppress uncorrelated noise. As such, we developed a general noise mitigation strategy leveraging the statistical properties of the different noise terms most relevant in analogue hardware. Finally, we demonstrate the effectiveness of this combined approach for trained neural network classifying the MNIST handwritten digits, for which we achieve a 4-fold improvement of the output signal-to-noise ratio and increase the classification accuracy almost to the level of the noise-free network. △ Less

Submitted 18 May, 2022; v1 submitted 20 April, 2022; originally announced April 2022.

Computational metrics and parameters of an injection-locked large area semiconductor laser for neural network computing

Authors: Anas Skalli, Xavier Porte, Nasibeh Haghighi, Stephan Reitzenstein, James A. Lott, D. Brunner

Abstract: Artificial neural networks have become a staple computing technique in many fields. Yet, they present fundamental differences with classical computing hardware in the way they process information. Photonic implementations of neural network architectures potentially offer fundamental advantages over their electronic counterparts in terms of speed, processing parallelism, scalability and energy effi… ▽ More Artificial neural networks have become a staple computing technique in many fields. Yet, they present fundamental differences with classical computing hardware in the way they process information. Photonic implementations of neural network architectures potentially offer fundamental advantages over their electronic counterparts in terms of speed, processing parallelism, scalability and energy efficiency. Scalable and high performance photonic neural networks (PNNs) have been demonstrated, yet they remain scarce. In this work, we study the performance of such a scalable, fully parallel and autonomous PNN based on a large area vertical-cavity surface-emitting laser (LA-VCSEL). We show how the performance varies with different physical parameters, namely, injection wavelength, injection power, and bias current. Furthermore, we link these physical parameters to the general computational measures of consistency and dimensionality. We present a general method of gauging dimensionality in high dimensional nonlinear systems subject to noise, which could be applied to many systems in the context of neuromorphic computing. Our work will inform future implementations of spatially multiplexed VCSEL PNNs. △ Less

Submitted 16 December, 2021; originally announced December 2021.

Photonic neuromorphic computing using vertical cavity semiconductor lasers

Authors: Anas Skalli, Joshua Robertson, Dafydd Owen-Newns, Matej Hejda, Xavier Porte, Stephan Reitzenstein, Antonio Hurtado, D. Brunner

Abstract: Photonic realizations of neural network computing hardware are a promising approach to enable future scalability of neuromorphic computing. In this review we provide an overview on vertical-cavity surface-emitting lasers (VCSELs) and how these high-performance electro-optical components either implement or are combined with additional photonic hardware to demonstrate points (i-iii). In the neurmor… ▽ More Photonic realizations of neural network computing hardware are a promising approach to enable future scalability of neuromorphic computing. In this review we provide an overview on vertical-cavity surface-emitting lasers (VCSELs) and how these high-performance electro-optical components either implement or are combined with additional photonic hardware to demonstrate points (i-iii). In the neurmorphic photonics' context, VCSELs are of exceptional interest as they are compatible with CMOS fabrication, readily achieve 30\% wall-plug efficiency and >30~GHz modulation bandwidth and hence are highly energy efficient and ultra-fast. Crucially, they react highly nonlinear to optical injection as well as to electrical modulation, making them highly suitable as all-optical as well as electro-optical photonic neurons. Their optical cavities are wavelength-limited, and standard semiconductor growth and lithography enables non-classical cavity configurations and geometries. This enables excitable VCSELs (i.e. spiking VCSELs) to finely control their temporal and spatial coherence, to unlock Terahertz bandwidths through spin-flip effects, and even to leverage cavity quantum electrodynamics to further boost their efficiency. Finally, as VCSEL arrays they are compatible with standard 2D photonic integration, but their emission vertical to the substrate makes them ideally suited for scalable integrated networks leveraging 3D photonic waveguides. Here, we discuss the implementation of spatially as well as temporally multiplexed VCSEL neural networks and reservoirs, computation on the basis of excitable VCSELs as photonic spiking neurons, as well as concepts and advances in the fabrication of VCSELs and microlasers. △ Less

Submitted 15 December, 2021; originally announced December 2021.

Combining one and two photon polymerization for accelerated high performance (3+1)D photonic integration

Authors: Adria Grabulosa, Johnny Moughames, Xavier Porte, Daniel Brunner

Abstract: Dense and efficient circuits with component sizes approaching the physical limit is the hallmark of high performance integration. However, current fabrication technology is mostly constraint to 2D lithography, and thermal energy dissipation induced by switching electronic signal lines presents a fundamental challenge for truly 3D electronic integration. Photonics reduces this problem, and direct l… ▽ More Dense and efficient circuits with component sizes approaching the physical limit is the hallmark of high performance integration. However, current fabrication technology is mostly constraint to 2D lithography, and thermal energy dissipation induced by switching electronic signal lines presents a fundamental challenge for truly 3D electronic integration. Photonics reduces this problem, and direct laser writing of a photoresin is a promising high-resolution tool for 3D photonic integration. Here, we combine one and two-photon polymerization (TPP) for waveguide integration for the first time, dramatically accelerating the fabrication process and increasing optical confinement. 3D additive printing is based on femtosecond TPP, while blanket irradiation with a UV lamp induces one-photon polymerization (OPP) throughout the entire 3D chip. We locally and dynamically adjust writing conditions to implement (3+1)D \emph{flash}-TPP: waveguide cores are printed with a small distance between neighboring writing voxels to ensure smooth interfaces, mechanical support structures are printed at maximal distance between the voxels to speed up the process. Finally, the entire chip's \emph{passive} volume not part of waveguide cores or mechanical support is polymerized in a single instance by UV blanket irradiation. This decouples fabrication time from the passive volume's size. We succeed in printing vertical single-mode waveguides of 6~mm length that reach up to NA = 0.16. Noteworthy, we achieve exceptionally low -0.26 dBでしべる injection and very low propagation losses of -1.36 dBでしべる/mm, which is within one order of magnitude of standard integrated silicon photonics. Finally, the optical performance of our waveguides does not deteriorate during 120 days within our measurement uncertainty. △ Less

Submitted 14 December, 2021; originally announced December 2021.

Tutorial: Photonic Neural Networks in Delay Systems

Authors: D. Brunner, B. Penkovsky, B. A. Marquez, M. Jaquot, I. Fischer, L. Larger

Abstract: Photonic delay systems have revolutionized the hardware implementation of Recurrent Neural Networks and Reservoir Computing in particular. The fundamental principles of Reservoir Computing strongly benefit a realization in such complex analog systems. Especially delay systems, potentially providing large numbers of degrees of freedom even in simple architectures, can efficiently be exploited for i… ▽ More Photonic delay systems have revolutionized the hardware implementation of Recurrent Neural Networks and Reservoir Computing in particular. The fundamental principles of Reservoir Computing strongly benefit a realization in such complex analog systems. Especially delay systems, potentially providing large numbers of degrees of freedom even in simple architectures, can efficiently be exploited for information processing. The numerous demonstrations of their performance led to a revival of photonic Artificial Neural Network. Today, an astonishing variety of physical substrates, implementation techniques as well as network architectures based on this approach have been successfully employed. Important fundamental aspects of analog hardware Artificial Neural Networks have been investigated, and multiple high-performance applications have been demonstrated. Here, we introduce and explain the most relevant aspects of Artificial Neural Networks and delay systems, the seminal experimental demonstrations of Reservoir Computing in photonic delay systems, plus the most recent and advanced realizations. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Journal ref: Journal of Applied Physics 124, 152004 (2018)

Two-color optically-addressed spatial light modulator as generic spatio-temporal systems

Authors: Vladimir Semenov, Xavier Porte, Ibrahim Abdulhalim, Laurent Larger, Daniel Brunner

Abstract: Nonlinear spatio-temporal systems are the basis for countless physical phenomena in such diverse fields as ecology, optics, electronics and neuroscience. The canonical approach to unify models originating from different fields is the normal form description, which determines the generic dynamical aspects and different bifurcation scenarios. Realizing different types of dynamical systems via one ex… ▽ More Nonlinear spatio-temporal systems are the basis for countless physical phenomena in such diverse fields as ecology, optics, electronics and neuroscience. The canonical approach to unify models originating from different fields is the normal form description, which determines the generic dynamical aspects and different bifurcation scenarios. Realizing different types of dynamical systems via one experimental platform that enables continuous transition between normal forms through tuning accessible system parameters is therefore highly relevant. Here, we show that a transmissive, optically-addressed spatial light modulator under coherent optical illumination and optical feedback coupling allows tuning between pitchfork, transcritical and saddle-node bifurcations of steady states. We demonstrate this by analytically deriving the system's normal form equations and confirm these results via extensive numerical simulations. Our model describes a nematic liquid crystal device using nano-dimensional dichalcogenide (a-As$_2$S$_3$) glassy thin-films as photo sensors and alignment layers, and we use device parameters obtained from experimental characterization. Optical coupling, for example using diffraction, holography or integrated unitary maps allow implementing a variety of system topologies of technological relevance for neural networks and potentially XY-Hamiltonian models with ultra low energy consumption. △ Less

Submitted 5 November, 2021; v1 submitted 2 November, 2021; originally announced November 2021.

Nonlinear photonic dynamical systems for unconventional computing

Authors: Daniel Brunner, Laurent Larger, Miguel C. Soriano

Abstract: Driven by the remarkable breakthroughs during the past decade, photonics neural networks have experienced a revival. Here, we provide a general overview of progress over the past decade, and sketch a roadmap of important future developments. We focus on photonic implementations of the reservoir computing machine learning paradigm, which offers a conceptually simple approach that is amenable to har… ▽ More Driven by the remarkable breakthroughs during the past decade, photonics neural networks have experienced a revival. Here, we provide a general overview of progress over the past decade, and sketch a roadmap of important future developments. We focus on photonic implementations of the reservoir computing machine learning paradigm, which offers a conceptually simple approach that is amenable to hardware implementations. In particular, we provide an overview of photonic reservoir computing implemented via either spatio temporal or delay dynamical systems. Going beyond reservoir computing, we discuss recent advances and future challenges of photonic implementations of deep neural networks, of the quest for learning methods that are hardware-friendly as well as realizing autonomous photonic neural networks, i.e. with minimal digital electronic auxiliary hardware. △ Less

Submitted 19 July, 2021; originally announced July 2021.

Direct (3+1)D laser writing of graded-index optical elements

Authors: Xavier Porte, Niyazi Ulas Dinc, Johnny Moughames, Giulia Panusa, Caroline Juliano, Muamer Kadic, Christophe Moser, Daniel Brunner, Demetri Psaltis

Abstract: We propose single-step additive fabrication of graded-index optical elements by introducing the light exposure as the additional dimension to three-dimensional (3D) laser writing, hence (3+1)D writing. We use a commercial printer and photoresist to realize the proposed single step fabrication method that can be swiftly adopted for research and engineering. After presenting the characterization of… ▽ More We propose single-step additive fabrication of graded-index optical elements by introducing the light exposure as the additional dimension to three-dimensional (3D) laser writing, hence (3+1)D writing. We use a commercial printer and photoresist to realize the proposed single step fabrication method that can be swiftly adopted for research and engineering. After presenting the characterization of the graded-index profiles via basic structures, we demonstrate two different optical devices: volume holograms that are superimposed using angular and peristrophic multiplexing, and optical waveguides with well-defined refractive index profiles. In the latter, we precisely control the propagating modes via tuning the (3+1)D-printed waveguide parameters and report step-index and graded-index core-cladding transitions. △ Less

Submitted 21 September, 2021; v1 submitted 3 June, 2021; originally announced June 2021.

Prospects and applications of photonic neural networks

Authors: Chaoran Huang, Volker J. Sorger, Mario Miscuglio, Mohammed Al-Qadasi, Avilash Mukherjee, Sudip Shekhar, Lukas Chrostowski, Lutz Lampe, Mitchell Nichols, Mable P. Fok, Daniel Brunner, Alexander N. Tait, Thomas Ferreira de Lima, Bicky A. Marquez, Paul R. Prucnal, Bhavin J. Shastri

Abstract: Neural networks have enabled applications in artificial intelligence through machine learning, and neuromorphic computing. Software implementations of neural networks on conventional computers that have separate memory and processor (and that operate sequentially) are limited in speed and energy efficiency. Neuromorphic engineering aims to build processors in which hardware mimics neurons and syna… ▽ More Neural networks have enabled applications in artificial intelligence through machine learning, and neuromorphic computing. Software implementations of neural networks on conventional computers that have separate memory and processor (and that operate sequentially) are limited in speed and energy efficiency. Neuromorphic engineering aims to build processors in which hardware mimics neurons and synapses in the brain for distributed and parallel processing. Neuromorphic engineering enabled by photonics (optical physics) can offer sub-nanosecond latencies and high bandwidth with low energies to extend the domain of artificial intelligence and neuromorphic computing applications to machine learning acceleration, nonlinear programming, intelligent signal processing, etc. Photonic neural networks have been demonstrated on integrated platforms and free-space optics depending on the class of applications being targeted. Here, we discuss the prospects and demonstrated applications of these photonic neural networks. △ Less

Submitted 20 May, 2021; originally announced May 2021.

Understanding and mitigating noise in trained deep neural networks

Authors: Nadezhda Semenova, Laurent Larger, Daniel Brunner

Abstract: Deep neural networks unlocked a vast range of new applications by solving tasks of which many were previously deemed as reserved to higher human intelligence. One of the developments enabling this success was a boost in computing power provided by special purpose hardware, such as graphic or tensor processing units. However, these do not leverage fundamental features of neural networks like parall… ▽ More Deep neural networks unlocked a vast range of new applications by solving tasks of which many were previously deemed as reserved to higher human intelligence. One of the developments enabling this success was a boost in computing power provided by special purpose hardware, such as graphic or tensor processing units. However, these do not leverage fundamental features of neural networks like parallelism and analog state variables. Instead, they emulate neural networks relying on binary computing, which results in unsustainable energy consumption and comparatively low speed. Fully parallel and analogue hardware promises to overcome these challenges, yet the impact of analogue neuron noise and its propagation, i.e. accumulation, threatens rendering such approaches inept. Here, we determine for the first time the propagation of noise in deep neural networks comprising noisy nonlinear neurons in trained fully connected layers. We study additive and multiplicative as well as correlated and uncorrelated noise, and develop analytical methods that predict the noise level in any layer of symmetric deep neural networks or deep neural networks trained with back propagation. We find that noise accumulation is generally bound, and adding additional network layers does not worsen the signal to noise ratio beyond a limit. Most importantly, noise accumulation can be suppressed entirely when neuron activation functions have a slope smaller than unity. We therefore developed the framework for noise in fully connected deep neural networks implemented in analog systems, and identify criteria allowing engineers to design noise-resilient novel neural network hardware. △ Less

Submitted 16 December, 2021; v1 submitted 12 March, 2021; originally announced March 2021.

Journal ref: Neural Networks 146, 151 (2022)

Optical pumping of quantum dot micropillar lasers

Authors: L. Andreoli, X. Porte, T. Heuser, J. Grosse, B. Moeglen-Paget, L. Furfaro, S. Reitzenstein, D. Brunner

Abstract: Arrays of quantum dot micropillar lasers are an attractive technology platform for various applications in the wider field of nanophotonics. Of particular interest is the potential efficiency enhancement as consequence of cavity quantum electrodynamics effects which makes them prime candidates for next generation photonic neurons in neural network hardware. However, in particular for optical pumpi… ▽ More Arrays of quantum dot micropillar lasers are an attractive technology platform for various applications in the wider field of nanophotonics. Of particular interest is the potential efficiency enhancement as consequence of cavity quantum electrodynamics effects which makes them prime candidates for next generation photonic neurons in neural network hardware. However, in particular for optical pumping their power-conversion efficiency can be very low. Here we perform an in-depth experimental analysis of quantum dot microlasers and investigate their input-output relationship over a wide range of optical pumping conditions. We find that the current energy efficiency limitation is caused by disadvantageous optical pumping concepts and by a low exciton conversion efficiency. Our results indicate that for non-resonant pumping into the GaAs matrix (wetting layer), 3.4% (0.6%) of the optical pump is converted into lasing-relevant excitons, and of those only 2% (0.75%) provide gain to the lasing transition. Based on our findings we propose to improve the pumping efficiency by orders of magnitude by increasing the aluminium content of the AlGaAs/GaAs mirror pairs in the upper Bragg reflector. △ Less

Submitted 4 March, 2021; v1 submitted 15 February, 2021; originally announced February 2021.

Journal ref: Optics Express 29, 9084-9097 (2021)

A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser

Authors: Xavier Porte, Anas Skalli, Nasibeh Haghighi, Stephan Reitzenstein, James A. Lott, Daniel Brunner

Abstract: Neural networks are one of the disruptive computing concepts of our time. However, they fundamentally differ from classical, algorithmic computing in a number of fundamental aspects. These differences result in equally fundamental, severe and relevant challenges for neural network computing using current computing substrates. Neural networks urge for parallelism across the entire processor and for… ▽ More Neural networks are one of the disruptive computing concepts of our time. However, they fundamentally differ from classical, algorithmic computing in a number of fundamental aspects. These differences result in equally fundamental, severe and relevant challenges for neural network computing using current computing substrates. Neural networks urge for parallelism across the entire processor and for a co-location of memory and arithmetic, i.e. beyond von Neumann architectures. Parallelism in particular made photonics a highly promising platform, yet until now scalable and integratable concepts are scarce. Here, we demonstrate for the first time how a fully parallel and fully implemented photonic neural network can be realized using spatially distributed modes of an efficient and fast semiconductor laser. Importantly, all neural network connections are realized in hardware, and our processor produces results without pre- or post-processing. 130+ nodes are implemented in a large-area vertical cavity surface emitting laser, input and output weights are realized via the complex transmission matrix of a multimode fiber and a digital micro-mirror array, respectively. We train the readout weights to perform 2-bit header recognition, a 2-bit XOR and 2-bit digital analog conversion, and obtain < 0.9 10^-3 and 2.9 10^-2 error rates for digit recognition and XOR, respectively. Finally, the digital analog conversion can be realized with a standard deviation of only 5.4 10^-2. Our system is scalable to much larger sizes and to bandwidths in excess of 20 GHz. △ Less

Submitted 21 December, 2020; originally announced December 2020.

Comments: 16 pages, 4 figures

Experimental Evaluation of Vibration Influence on a Resonant MEMS Scanning System for Automotive Lidars

Authors: Han Woong Yoo, Rene Riegler, David Brunner, Stephan Albert, Thomas Thurner, Georg Schitter

Abstract: This paper demonstrates a vibration test for a resonant MEMS scanning system in operation to evaluate the vibration immunity for automotive lidar applications. The MEMS mirror has a reinforcement structure on the backside of the mirror, causing vibration coupling by a mismatch between the center of mass and the rotation axis. An analysis of energy variation is proposed, showing direction dependenc… ▽ More This paper demonstrates a vibration test for a resonant MEMS scanning system in operation to evaluate the vibration immunity for automotive lidar applications. The MEMS mirror has a reinforcement structure on the backside of the mirror, causing vibration coupling by a mismatch between the center of mass and the rotation axis. An analysis of energy variation is proposed, showing direction dependency of vibration coupling. Vibration influences are evaluated by transient vibration response and vibration frequency sweep using a single tone vibration for translational y- and z- axis. The measurement results demonstrate standard deviation (STD) amplitude and frequency errors are up to 1.64 % and 0.26 %, respectively, for 2 grms single tone vibrations on y axis. The simulation results also show a good agreement with both measurements, proving the proposed vibration coupling mechanism of the MEMS mirror. The phased locked loop (PLL) improves the STD amplitude and frequency errors to 0.91 % and 0.15 % for y axis vibration, corresponding to 44.4 % and 43.0 % reduction, respectively, showing the benefit of a controlled MEMS mirror for reliable automotive MEMS lidars. △ Less

Submitted 13 April, 2021; v1 submitted 16 October, 2020; originally announced October 2020.

Comments: 9 pages, 11 figures, to be published in IEEE Transactions on Industrial Electronics

Journal ref: IEEE Transactions on Industrial Electronics, 2021

Optical Neural Networks: The 3D connection

Authors: Niyazi Ulas Dinc, Demetri Psaltis, Daniel Brunner

Abstract: We motivate a new canonical strategy for integrating photonic neural networks (NNs) by leveraging 3D printing. Our believe is that a NN's parallel and dense connectivity is not scalable without 3D integration. 3D additive fabrication complemented with photonic signal transduction can dramatically augment the current capabilities of 2D CMOS and integrated photonics. Here we review some of our recen… ▽ More We motivate a new canonical strategy for integrating photonic neural networks (NNs) by leveraging 3D printing. Our believe is that a NN's parallel and dense connectivity is not scalable without 3D integration. 3D additive fabrication complemented with photonic signal transduction can dramatically augment the current capabilities of 2D CMOS and integrated photonics. Here we review some of our recent advances made towards such a breakthrough architecture. △ Less

Submitted 28 August, 2020; originally announced August 2020.

Journal ref: Photoniques 104, 34 (2020)

Developing of a photonic hardware platform for brain-inspired computing based on $5\times5$ VCSEL arrays

Authors: T. Heuser, M. Pflüger, I. Fischer, J. A. Lott, D. Brunner, S. Reitzenstein

Abstract: Brain-inspired computing concepts like artificial neural networks have become promising alternatives to classical von Neumann computer architectures. Photonic neural networks target the realizations of neurons, network connections and potentially learning in photonic substrates. Here, we report the development of a nanophotonic hardware platform of fast and energy-efficient photonic neurons via ar… ▽ More Brain-inspired computing concepts like artificial neural networks have become promising alternatives to classical von Neumann computer architectures. Photonic neural networks target the realizations of neurons, network connections and potentially learning in photonic substrates. Here, we report the development of a nanophotonic hardware platform of fast and energy-efficient photonic neurons via arrays of high-quality vertical cavity surface emitting lasers (VCSELs). The developed $5\times5$ VCSEL arrays provide high optical injection locking efficiency through homogeneous fabrication combined with individual control over the laser wavelengths. Injection locking is crucial for the reliable processing of information in VCSEL-based photonic neurons, and we demonstrate the suitability of the VCSEL arrays by injection locking measurements and current-induced spectral fine-tuning. We find that our investigated array can readily be tuned to the required spectral homogeneity, and as such show that VCSEL arrays based on our technology can act as highly energy efficient and ultra-fast photonic neurons for next generation photonic neural networks. Combined with fully parallel photonic networks our substrates are promising for ultra-fast operation reaching 10s of GHz bandwidths, and we show that a nonlinear transformation based on our lasers will consume only about 100 fJ per VCSEL, which is highly competitive, compared to other platforms. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Confidence in the dynamic spread of epidemics under biased sampling conditions

Authors: James D. Brunner, Nicholas Chia

Abstract: The interpretation of sampling data plays a crucial role in policy response to the spread of a disease during an epidemic, such as the COVID-19 epidemic of 2020. However, this is a non-trivial endeavor due to the complexity of real world conditions and limits to the availability of diagnostic tests, which necessitate a bias in testing favoring symptomatic individuals. A thorough understanding of s… ▽ More The interpretation of sampling data plays a crucial role in policy response to the spread of a disease during an epidemic, such as the COVID-19 epidemic of 2020. However, this is a non-trivial endeavor due to the complexity of real world conditions and limits to the availability of diagnostic tests, which necessitate a bias in testing favoring symptomatic individuals. A thorough understanding of sampling confidence and bias is necessary in order make accurate conclusions. In this manuscript, we provide a stochastic model of sampling for assessing confidence in disease metrics such as trend detection, peak detection, and disease spread estimation. Our model simulates testing for a disease in an epidemic with known dynamics, allowing us to use Monte-Carlo sampling to assess metric confidence. This model can provide realistic simulated data which can be used in the design and calibration of data analysis and prediction methods. As an example, we use this method to show that trends in the disease may be identified using under $10000$ biased samples each day, and an estimate of disease spread can be made with additional $1000-2000$ unbiased samples each day. We also demonstrate that the model can be used to assess more advanced metrics by finding the precision and recall of a strategy for finding peaks in the dynamics. △ Less

Submitted 28 July, 2020; v1 submitted 4 June, 2020; originally announced June 2020.

Comments: 11 figures, 2 tables, 15 pages

MSC Class: 92-10; 62D05

Comparison between mirror Langmuir probe and gas puff imaging measurements of intermittent fluctuations in the Alcator C-Mod scrape-off layer

Authors: R. Kube, A. Theodorsen, O. E. Garcia, D. Brunner, B. LaBombard, J. L. Terry

Abstract: Statistical properties of the scrape-off layer (SOL) plasma fluctuations are studied in ohmically heated plasmas in the Alcator C-Mod tokamak. For the first time, plasma fluctuations as well as parameters that describe the fluctuations are compared across measurements from a mirror Langmuir probe (MLP) and from gas-puff imaging (GPI) that sample the same plasma discharge. This comparison is comple… ▽ More Statistical properties of the scrape-off layer (SOL) plasma fluctuations are studied in ohmically heated plasmas in the Alcator C-Mod tokamak. For the first time, plasma fluctuations as well as parameters that describe the fluctuations are compared across measurements from a mirror Langmuir probe (MLP) and from gas-puff imaging (GPI) that sample the same plasma discharge. This comparison is complemented by an analysis of line emission time-series data, synthesized from the MLP electron density and temperature measurements. The fluctuations observed by the MLP and GPI typically display relative fluctuation amplitudes of order unity together with positively skewed and flattened probability density functions. Such data time series are well described by an established stochastic framework which model the data as a superposition of uncorrelated, two-sided exponential pulses. The most important parameter of the process is the intermittency parameter, γがんま = τたうd / τたうw where τたうd denotes the duration time of a single pulse and τたうw gives the average waiting time between consecutive pulses. Here we show, using a new deconvolution method, that these parameters can be consistently estimated from different statistics of the data. We also show that the statistical properties of the data sampled by the MLP and GPI diagnostic are very similar. Finally, a comparison of the GPI signal to the synthetic line-emission time series suggests that the measured emission intensity can not be explained solely by a simplified model which neglects neutral particle dynamics. △ Less

Submitted 5 May, 2020; originally announced May 2020.

On classes of reaction networks and their associated polynomial dynamical systems

Authors: David F. Anderson, James D. Brunner, Gheorghe Craciun, Matthew D. Johnston

Abstract: In the study of reaction networks and the polynomial dynamical systems that they generate, special classes of networks with important properties have been identified. These include reversible, weakly reversible}, and, more recently, endotactic networks. While some inclusions between these network types are clear, such as the fact that all reversible networks are weakly reversible, other relationsh… ▽ More In the study of reaction networks and the polynomial dynamical systems that they generate, special classes of networks with important properties have been identified. These include reversible, weakly reversible}, and, more recently, endotactic networks. While some inclusions between these network types are clear, such as the fact that all reversible networks are weakly reversible, other relationships are more complicated. Adding to this complexity is the possibility that inclusions be at the level of the dynamical systems generated by the networks rather than at the level of the networks themselves. We completely characterize the inclusions between reversible, weakly reversible, endotactic, and strongly endotactic network, as well as other less well studied network types. In particular, we show that every strongly endotactic network in two dimensions can be generated by an extremally weakly reversible network. We also introduce a new class of source-only networks, which is a computationally convenient property for networks to have, and show how this class relates to the above mentioned network types. △ Less

Submitted 14 July, 2020; v1 submitted 14 April, 2020; originally announced April 2020.

Comments: 24 pages, 8 figures

MSC Class: 34C20; 37N25; 80A30; 92C42; 92C45

Human action recognition with a large-scale brain-inspired photonic computer

Authors: Piotr Antonik, Nicolas Marsal, Daniel Brunner, Damien Rontani

Abstract: The recognition of human actions in video streams is a challenging task in computer vision, with cardinal applications in e.g. brain-computer interface and surveillance. Deep learning has shown remarkable results recently, but can be found hard to use in practice, as its training requires large datasets and special purpose, energy-consuming hardware. In this work, we propose a scalable photonic ne… ▽ More The recognition of human actions in video streams is a challenging task in computer vision, with cardinal applications in e.g. brain-computer interface and surveillance. Deep learning has shown remarkable results recently, but can be found hard to use in practice, as its training requires large datasets and special purpose, energy-consuming hardware. In this work, we propose a scalable photonic neuro-inspired architecture based on the reservoir computing paradigm, capable of recognising video-based human actions with state-of-the-art accuracy. Our experimental optical setup comprises off-the-shelf components, and implements a large parallel recurrent neural network that is easy to train and can be scaled up to hundreds of thousands of nodes. This work paves the way towards simply reconfigurable and energy-efficient photonic information processing systems for real-time video processing. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: Authors' version before final reviews (12 pages, 4 figures)

Journal ref: Nat Mach Intell 1, 530-537 (2019)

Bayesian optimisation of large-scale photonic reservoir computers

Authors: Piotr Antonik, Nicolas Marsal, Daniel Brunner, Damien Rontani

Abstract: Introduction. Reservoir computing is a growing paradigm for simplified training of recurrent neural networks, with a high potential for hardware implementations. Numerous experiments in optics and electronics yield comparable performance to digital state-of-the-art algorithms. Many of the most recent works in the field focus on large-scale photonic systems, with tens of thousands of physical nodes… ▽ More Introduction. Reservoir computing is a growing paradigm for simplified training of recurrent neural networks, with a high potential for hardware implementations. Numerous experiments in optics and electronics yield comparable performance to digital state-of-the-art algorithms. Many of the most recent works in the field focus on large-scale photonic systems, with tens of thousands of physical nodes and arbitrary interconnections. While this trend significantly expands the potential applications of photonic reservoir computing, it also complicates the optimisation of the high number of hyper-parameters of the system. Methods. In this work, we propose the use of Bayesian optimisation for efficient exploration of the hyper-parameter space in a minimum number of iteration. Results. We test this approach on a previously reported large-scale experimental system, compare it to the commonly used grid search, and report notable improvements in performance and the number of experimental iterations required to optimise the hyper-parameters. Conclusion. Bayesian optimisation thus has the potential to become the standard method for tuning the hyper-parameters in photonic reservoir computing. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: 10 pages, 5 figures

Noise-enhanced spatial-photonic Ising machine

Authors: Davide Pierangeli, Giulia Marcucci, Daniel Brunner, Claudio Conti

Abstract: Ising machines are novel computing devices for the energy minimization of Ising models. These combinatorial optimization problems are of paramount importance for science and technology, but remain difficult to tackle on large scale by conventional electronics. Recently, various photonics-based Ising machines demonstrated ultra-fast computing of Ising ground state by data processing through multipl… ▽ More Ising machines are novel computing devices for the energy minimization of Ising models. These combinatorial optimization problems are of paramount importance for science and technology, but remain difficult to tackle on large scale by conventional electronics. Recently, various photonics-based Ising machines demonstrated ultra-fast computing of Ising ground state by data processing through multiple temporal or spatial optical channels. Experimental noise acts as a detrimental effect in many of these devices. On the contrary, we here demonstrate that an optimal noise level enhances the performance of spatial-photonic Ising machines on frustrated spin problems. By controlling the error rate at the detection, we introduce a noisy-feedback mechanism in an Ising machine based on spatial light modulation. We investigate the device performance on systems with hundreds of individually-addressable spins with all-to-all couplings and we found an increased success probability at a specific noise level. The optimal noise amplitude depends on graph properties and size, thus indicating an additional tunable parameter helpful in exploring complex energy landscapes and in avoiding trapping into local minima. The result points out noise as a resource for optical computing. This concept, which also holds in different nanophotonic neural networks, may be crucial in developing novel hardware with optics-enabled parallel architecture for large-scale optimizations. △ Less

Submitted 5 April, 2020; originally announced April 2020.

Comments: 7 pages, 4 figures

Boolean learning under noise-perturbations in hardware neural networks

Authors: Louis Andreoli, Xavier Porte, Stéphane Chrétien, Maxime Jacquot, Laurent Larger, Daniel Brunner

Abstract: A high efficiency hardware integration of neural networks benefits from realizing nonlinearity, network connectivity and learning fully in a physical substrate. Multiple systems have recently implemented some or all of these operations, yet the focus was placed on addressing technological challenges. Fundamental questions regarding learning in hardware neural networks remain largely unexplored. No… ▽ More A high efficiency hardware integration of neural networks benefits from realizing nonlinearity, network connectivity and learning fully in a physical substrate. Multiple systems have recently implemented some or all of these operations, yet the focus was placed on addressing technological challenges. Fundamental questions regarding learning in hardware neural networks remain largely unexplored. Noise in particular is unavoidable in such architectures, and here we investigate its interaction with a learning algorithm using an opto-electronic recurrent neural network. We find that noise strongly modifies the system's path during convergence, and surprisingly fully decorrelates the final readout weight matrices. This highlights the importance of understanding architecture, noise and learning algorithm as interacting players, and therefore identifies the need for mathematical tools for noisy, analogue system optimization. △ Less

Submitted 25 June, 2021; v1 submitted 27 March, 2020; originally announced March 2020.

Comments: 8 pages, 5 figures

Journal ref: Nanophotonics (published online ahead of print), 20200171 (2020)

Minimizing the number of optimizations for efficient community dynamic flux balance analysis

Authors: James D. Brunner, Nicholas Chia

Abstract: Dynamic flux balance analysis uses a quasi-steady state assumption to calculate an organism's metabolic activity at each time-step of a dynamic simulation, using the well-known technique of flux balance analysis. For microbial communities, this calculation is especially costly and involves solving a linear constrained optimization problem for each member of the community at each time step. However… ▽ More Dynamic flux balance analysis uses a quasi-steady state assumption to calculate an organism's metabolic activity at each time-step of a dynamic simulation, using the well-known technique of flux balance analysis. For microbial communities, this calculation is especially costly and involves solving a linear constrained optimization problem for each member of the community at each time step. However, this is unnecessary and inefficient, as prior solutions can be used to inform future time steps. Here, we show that a basis for the space of internal fluxes can be chosen for each microbe in a community and this basis can be used to simulate forward by solving a relatively inexpensive system of linear equations at most time steps. We can use this solution as long as the resulting metabolic activity remains within the optimization problem's constraints (i.e. the solution to the linear system of equations remains a feasible to the linear program). As the solution becomes infeasible, it first becomes a feasible but degenerate solution to the optimization problem, and we can solve a different but related optimization problem to choose an appropriate basis to continue forward simulation. We demonstrate the efficiency and robustness of our method by comparing with currently used methods on a four species community, and show that our method requires at least $91\%$ fewer optimizations to be solved. For reproducibility, we prototyped the method using Python. Source code is available at \verb|https://github.com/jdbrunner/surfin_fba|. △ Less

Submitted 28 July, 2020; v1 submitted 7 March, 2020; originally announced March 2020.

Comments: 9 figures

MSC Class: 92-08; 92D25

Three dimensional waveguide-interconnects for scalable integration of photonic neural networks

Authors: Johnny Moughames, Xavier Porte, Michael Thiel, Gwenn Ulliac, Maxime Jacquot, Laurent Larger, Muamer Kadic, Daniel Brunner

Abstract: Photonic waveguides are prime candidates for integrated and parallel photonic interconnects. Such interconnects correspond to large-scale vector matrix products, which are at the heart of neural network computation. However, parallel interconnect circuits realized in two dimensions, for example by lithography, are strongly limited in size due to disadvantageous scaling. We use three dimensional (3… ▽ More Photonic waveguides are prime candidates for integrated and parallel photonic interconnects. Such interconnects correspond to large-scale vector matrix products, which are at the heart of neural network computation. However, parallel interconnect circuits realized in two dimensions, for example by lithography, are strongly limited in size due to disadvantageous scaling. We use three dimensional (3D) printed photonic waveguides to overcome this limitation. 3D optical-couplers with fractal topology efficiently connect large numbers of input and output channels, and we show that the substrate's footprint area scales linearly. Going beyond simple couplers, we introduce functional circuits for discrete spatial filters identical to those used in deep convolutional neural networks. △ Less

Submitted 9 January, 2020; v1 submitted 17 December, 2019; originally announced December 2019.

Comments: 7 pages, 6 figures

Journal ref: Optica 7, 640-646 (2020)

Advancing Fourier: space-time concepts in ultrafast optics, imaging and photonic neural networks

Authors: Luc Froehly, Francois Courvoisier, Daniel Brunner, Laurent Larger, Fabrice Devaux, Eric Lantz, John M. Dudley, Maxime Jacquot

Abstract: The concepts of Fourier optics were established in France in the 1940s by Pierre-Michel Duffieux, and laid the foundations of an extensive series of activities in the French research community that have touched on nearly every aspect of contemporary optics and photonics. In this paper, we review a selection of results where applications of the Fourier transform and transfer functions in optics hav… ▽ More The concepts of Fourier optics were established in France in the 1940s by Pierre-Michel Duffieux, and laid the foundations of an extensive series of activities in the French research community that have touched on nearly every aspect of contemporary optics and photonics. In this paper, we review a selection of results where applications of the Fourier transform and transfer functions in optics have been applied to yield significant advances in unexpected areas of optics, including the spatial shaping of complex laser beams in amplitude and in phase, real-time ultrafast measurements, novel ghost imaging techniques, and the development of parallel processing methodologies for photonic artificial intelligence. △ Less

Submitted 4 November, 2019; originally announced November 2019.

Journal ref: Luc Froehly, et al., J. Opt. Soc. Am. A 36, C69-C77 (2019)

Reservoir-size dependent learning in analogue neural networks

Authors: Xavier Porte, Louis Andreoli, Maxime Jacquot, Laurent Larger, Daniel Brunner

Abstract: The implementation of artificial neural networks in hardware substrates is a major interdisciplinary enterprise. Well suited candidates for physical implementations must combine nonlinear neurons with dedicated and efficient hardware solutions for both connectivity and training. Reservoir computing addresses the problems related with the network connectivity and training in an elegant and efficien… ▽ More The implementation of artificial neural networks in hardware substrates is a major interdisciplinary enterprise. Well suited candidates for physical implementations must combine nonlinear neurons with dedicated and efficient hardware solutions for both connectivity and training. Reservoir computing addresses the problems related with the network connectivity and training in an elegant and efficient way. However, important questions regarding impact of reservoir size and learning routines on the convergence-speed during learning remain unaddressed. Here, we study in detail the learning process of a recently demonstrated photonic neural network based on a reservoir. We use a greedy algorithm to train our neural network for the task of chaotic signals prediction and analyze the learning-error landscape. Our results unveil fundamental properties of the system's optimization hyperspace. Particularly, we determine the convergence speed of learning as a function of reservoir size and find exceptional, close to linear scaling. This linear dependence, together with our parallel diffractive coupling, represent optimal scaling conditions for our photonic neural network scheme. △ Less

Submitted 23 July, 2019; originally announced August 2019.

Fundamental aspects of noise in analog-hardware neural networks

Authors: Nadezhda Semenova, Xavier Porte, Louis Andreoli, Maxime Jacquot, Laurent Larger, Daniel Brunner

Abstract: We study and analyze the fundamental aspects of noise propagation in recurrent as well as deep, multi-layer networks. The main focus of our study are neural networks in analogue hardware, yet the methodology provides insight for networks in general. The system under study consists of noisy linear nodes, and we investigate the signal-to-noise ratio at the network's outputs which is the upper limit… ▽ More We study and analyze the fundamental aspects of noise propagation in recurrent as well as deep, multi-layer networks. The main focus of our study are neural networks in analogue hardware, yet the methodology provides insight for networks in general. The system under study consists of noisy linear nodes, and we investigate the signal-to-noise ratio at the network's outputs which is the upper limit to such a system's computing accuracy. We consider additive and multiplicative noise which can be purely local as well as correlated across populations of neurons. This covers the chief internal-perturbations of hardware networks and noise amplitudes were obtained from a physically implemented recurrent neural network and therefore correspond to a real-world system. Analytic solutions agree exceptionally well with numerical data, enabling clear identification of the most critical components and aspects for noise management. Focusing on linear nodes isolates the impact of network connections and allows us to derive strategies for mitigating noise. Our work is the starting point in addressing this aspect of analogue neural networks, and our results identify notoriously sensitive points while simultaneously highlighting the robustness of such computational systems. △ Less

Submitted 21 July, 2019; originally announced July 2019.

Journal ref: Chaos 29, 103128 (2019)

Diffractive coupling for photonic networks: how big can we go?

Authors: Sheler Maktoobi, Luc Froehly, Louis Andreoli, Xavier Porte, Maxime Jacquot, Laurent Larger, Daniel Brunner

Abstract: Photonic networks are considered a promising substrate for high-performance future computing systems. Compared to electronics, photonics has significant advantages for a fully parallel implementation of networks. A promising approach for parallel large-scale photonic networks is realizing the connections using diffraction. Here, we characterize the scalability of such diffractive coupling in great… ▽ More Photonic networks are considered a promising substrate for high-performance future computing systems. Compared to electronics, photonics has significant advantages for a fully parallel implementation of networks. A promising approach for parallel large-scale photonic networks is realizing the connections using diffraction. Here, we characterize the scalability of such diffractive coupling in great detail. Based on experiments, analytically obtained bounds and numerical simulations considering real-world optical imaging setups, we find that the concept in principle enables networks hosting over a million optical emitters. This would be a breakthrough in multiple areas, illustrating a clear path toward future, large scale photonic networks. △ Less

Submitted 12 July, 2019; originally announced July 2019.

Journal ref: IEEE Journal of Selected Topics in Quantum Electronics 26, 1 (2020)

Metabolite mediated modeling of microbial community dynamics captures emergent behavior more effectively than species-species modeling

Authors: James D. Brunner, Nicholas Chia

Abstract: Personalized models of the gut microbiome are valuable for disease prevention and treatment. For this, one requires a mathematical model that predicts microbial community composition and the emergent behavior of microbial communities. We seek a modeling strategy that can capture emergent behavior when built from sets of universal individual interactions. Our investigation reveals that species-meta… ▽ More Personalized models of the gut microbiome are valuable for disease prevention and treatment. For this, one requires a mathematical model that predicts microbial community composition and the emergent behavior of microbial communities. We seek a modeling strategy that can capture emergent behavior when built from sets of universal individual interactions. Our investigation reveals that species-metabolite interaction modeling is better able to capture emergent behavior in community composition dynamics than direct species-species modeling. Using publicly available data, we examine the ability of species-species models and species-metabolite models to predict trio growth experiments from the outcomes of pair growth experiments. We compare quadratic species-species interaction models and quadratic species-metabolite interaction models, and conclude that only species-metabolite models have the necessary complexity to to explain a wide variety of interdependent growth outcomes. We also show that general species-species interaction models cannot match patterns observed in community growth dynamics, whereas species-metabolite models can. We conclude that species-metabolite modeling will be important in the development of accurate, clinically useful models of microbial communities. △ Less

Submitted 19 August, 2019; v1 submitted 9 July, 2019; originally announced July 2019.

Comments: 23 pages, 8 Figures

MSC Class: 92D25

Coupled nonlinear delay systems as deep convolutional neural networks

Authors: Bogdan Penkovsky, Xavier Porte, Maxime Jacquot, Laurent Larger, Daniel Brunner

Abstract: Neural networks are currently transforming the field of computer algorithms, yet their emulation on current computing substrates is highly inefficient. Reservoir computing was successfully implemented on a large variety of substrates and gave new insight in overcoming this implementation bottleneck. Despite its success, the approach lags behind the state of the art in deep learning. We therefore e… ▽ More Neural networks are currently transforming the field of computer algorithms, yet their emulation on current computing substrates is highly inefficient. Reservoir computing was successfully implemented on a large variety of substrates and gave new insight in overcoming this implementation bottleneck. Despite its success, the approach lags behind the state of the art in deep learning. We therefore extend time-delay reservoirs to deep networks and demonstrate that these conceptually correspond to deep convolutional neural networks. Convolution is intrinsically realized on a substrate level by generic drive-response properties of dynamical systems. The resulting novelty is avoiding vector-matrix products between layers, which cause low efficiency in today's substrates. Compared to singleton time-delay reservoirs, our deep network achieves accuracy improvements by at least an order of magnitude in Mackey-Glass and Lorenz timeseries prediction. △ Less

Submitted 5 July, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

Journal ref: Phys. Rev. Lett. 123, 054101 (2019)

High-resolution disruption halo current measurements using Langmuir probes in Alcator C-Mod

Authors: RA Tinguely, RS Granetz, A Berg, AQ Kuang, D Brunner, B LaBombard

Abstract: Halo currents generated during disruptions on Alcator C-Mod have been measured with Langmuir "rail" probes. These rail probes are embedded in a lower outboard divertor module in a closely-spaced vertical (poloidal) array. The dense array provides detailed resolution of the spatial dependence (~1 cm spacing) of the halo current distribution in the plasma scrape-off region with high time resolution… ▽ More Halo currents generated during disruptions on Alcator C-Mod have been measured with Langmuir "rail" probes. These rail probes are embedded in a lower outboard divertor module in a closely-spaced vertical (poloidal) array. The dense array provides detailed resolution of the spatial dependence (~1 cm spacing) of the halo current distribution in the plasma scrape-off region with high time resolution (400 kHzきろへるつ digitization rate). As the plasma limits on the outboard divertor plate, the contact point is clearly discernible in the halo current data (as an inversion of current) and moves vertically down the divertor plate on many disruptions. These data are consistent with filament reconstructions of the plasma boundary, from which the edge safety factor of the disrupting plasma can be calculated. Additionally, the halo current "footprint" on the divertor plate is obtained and related to the halo flux width. The voltage driving halo current and the effective resistance of the plasma region through which the halo current flows to reach the probes are also investigated. Estimations of the sheath resistance and halo region resistivity and temperature are given. This information could prove useful for modeling halo current dynamics. △ Less

Submitted 7 October, 2018; originally announced October 2018.