Showing 1–24 of 24 results for author: Cherukara, M J

Extending the Takagi-Taupin equations for x-ray nanobeam Bragg coherent diffraction

Authors: T. Zhou, M. J. Cherukara, S. Kandel, M. Allain, N. Hua, O. Shpyrko, Y. Takamura, Z. Cai, S. O. Hruszkewycz, M. V. Holt

Abstract: We present a new approach for simulating x-ray nanobeam Bragg coherent diffraction patterns based on the Takagi-Taupin equations. Compared to conventional methods, the current approach can be universally applied to any weakly strained system including semi-infinite crystals that diffract dynamically. It addresses issues such as the curved wavefront and re-divergence of the focused incident beam. W… ▽ More We present a new approach for simulating x-ray nanobeam Bragg coherent diffraction patterns based on the Takagi-Taupin equations. Compared to conventional methods, the current approach can be universally applied to any weakly strained system including semi-infinite crystals that diffract dynamically. It addresses issues such as the curved wavefront and re-divergence of the focused incident beam. We show excellent agreement against experimental data on a strained La0.7Sr0.3MnO3 thin film on SrTiO3 substrate, and a path to extracting physical information using automatic differentiation. △ Less

Submitted 10 July, 2024; originally announced July 2024.

Deep Learning of Structural Morphology Imaged by Scanning X-ray Diffraction Microscopy

Authors: Aileen Luo, Tao Zhou, Martin V. Holt, Andrej Singer, Mathew J. Cherukara

Abstract: Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the l… ▽ More Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the local strain tensor - corresponding to dilation and two potential rigid body rotations of the unit cell. All three components are in principle resolvable through a spatially mapped sample tilt series however traditional data analysis is computationally expensive and prone to artifacts. In this study, we implement NanobeamNN, a convolutional neural network specifically tailored to the analysis of scanning probe X-ray microscopy data. NanobeamNN learns lattice strain and rotation angles from simulated diffraction of a focused X-ray nanobeam by an epitaxial thin film and can directly make reasonable predictions on experimental data without the need for additional fine-tuning. We demonstrate that this approach represents a significant advancement in computational speed over conventional methods, as well as a potential improvement in accuracy over the current standard. △ Less

Submitted 24 June, 2024; v1 submitted 11 June, 2024; originally announced June 2024.

Predicting ptychography probe positions using single-shot phase retrieval neural network

Authors: Ming Du, Tao Zhou, Junjing Deng, Daniel J. Ching, Steven Henke, Mathew J. Cherukara

Abstract: Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization appro… ▽ More Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of $10^2$ pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential. △ Less

Submitted 31 May, 2024; originally announced May 2024.

MSC Class: 94A08 ACM Class: I.4.0

Three-dimensional Hard X-ray Ptychographic Reflectometry Imaging on Extended Mesoscopic Surface Structures

Authors: Peco Myint, Ashish Tripathi, Michael J. Wojcik, Junjing Deng, Mathew J. Cherukara, Nicholas Schwarz, Suresh Narayanan, Jin Wang, Miaoqi Chu, Zhang Jiang

Abstract: Many nano and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function-structure… ▽ More Many nano and quantum devices, with their sizes often spanning from millimeters down to sub-nanometer, have intricate low-dimensional, non-uniform, or hierarchical structures on surfaces and interfaces. Since their functionalities are dependent on these structures, high-resolution surface-sensitive characterization becomes imperative to gain a comprehensive understanding of the function-structure relationship. We thus developed hard X-ray ptychographic reflectometry imaging, a new technique that merges the high-resolution two-dimensional imaging capabilities of hard X-ray ptychography for extended objects, with the high-resolution depth profiling capabilities of X-ray reflectivity for layered structures. The synergy of these two methods fully leverages both amplitude and phase information from ptychography reconstruction to not only reveal surface topography and localized structures such as shapes and electron densities, but also yields statistical details such as interfacial roughness that is not readily accessible through coherent imaging solely. The hard X-ray ptychographic reflectometry imaging is well-suited for three-dimensional imaging of mesoscopic samples, particularly those comprising planar or layered nanostructures on opaque supports, and could also offer a high-resolution surface metrology and defect analysis on semiconductor devices such as integrated nanocircuits and lithographic photomasks for microchip fabrications. △ Less

Submitted 9 February, 2024; originally announced February 2024.

Comments: 43 pages, 11 figures

Opportunities for Retrieval and Tool Augmented Large Language Models in Scientific Facilities

Authors: Michael H. Prince, Henry Chan, Aikaterini Vriza, Tao Zhou, Varuni K. Sastry, Matthew T. Dearing, Ross J. Harder, Rama K. Vasudevan, Mathew J. Cherukara

Abstract: Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scient… ▽ More Upgrades to advanced scientific user facilities such as next-generation x-ray light sources, nanoscience centers, and neutron facilities are revolutionizing our understanding of materials across the spectrum of the physical sciences, from life sciences to microelectronics. However, these facility and instrument upgrades come with a significant increase in complexity. Driven by more exacting scientific needs, instruments and experiments become more intricate each year. This increased operational complexity makes it ever more challenging for domain scientists to design experiments that effectively leverage the capabilities of and operate on these advanced instruments. Large language models (LLMs) can perform complex information retrieval, assist in knowledge-intensive tasks across applications, and provide guidance on tool usage. Using x-ray light sources, leadership computing, and nanoscience centers as representative examples, we describe preliminary experiments with a Context-Aware Language Model for Science (CALMS) to assist scientists with instrument operations and complex experimentation. With the ability to retrieve relevant information from facility documentation, CALMS can answer simple questions on scientific capabilities and other operational procedures. With the ability to interface with software tools and experimental hardware, CALMS can conversationally operate scientific instruments. By making information more accessible and acting on user needs, LLMs could expand and diversify scientific facilities' users and accelerate scientific output. △ Less

Submitted 3 December, 2023; originally announced December 2023.

Data-driven discovery of dynamics from time-resolved coherent scattering

Authors: Nina Andrejevic, Tao Zhou, Qingteng Zhang, Suresh Narayanan, Mathew J. Cherukara, Maria K. Y. Chan

Abstract: Coherent X-ray scattering (CXS) techniques are capable of interrogating dynamics of nano- to mesoscale materials systems at time scales spanning several orders of magnitude. However, obtaining accurate theoretical descriptions of complex dynamics is often limited by one or more factors -- the ability to visualize dynamics in real space, computational cost of high-fidelity simulations, and effectiv… ▽ More Coherent X-ray scattering (CXS) techniques are capable of interrogating dynamics of nano- to mesoscale materials systems at time scales spanning several orders of magnitude. However, obtaining accurate theoretical descriptions of complex dynamics is often limited by one or more factors -- the ability to visualize dynamics in real space, computational cost of high-fidelity simulations, and effectiveness of approximate or phenomenological models. In this work, we develop a data-driven framework to uncover mechanistic models of dynamics directly from time-resolved CXS measurements without solving the phase reconstruction problem for the entire time series of diffraction patterns. Our approach uses neural differential equations to parameterize unknown real-space dynamics and implements a computational scattering forward model to relate real-space predictions to reciprocal-space observations. This method is shown to recover the dynamics of several computational model systems under various simulated conditions of measurement resolution and noise. Moreover, the trained model enables estimation of long-term dynamics well beyond the maximum observation time, which can be used to inform and refine experimental parameters in practice. Finally, we demonstrate an experimental proof-of-concept by applying our framework to recover the probe trajectory from a ptychographic scan. Our proposed framework bridges the wide existing gap between approximate models and complex data. △ Less

Submitted 30 November, 2023; v1 submitted 23 November, 2023; originally announced November 2023.

AI-enabled Lorentz microscopy for quantitative imaging of nanoscale magnetic spin textures

Authors: Arthur R. C. McCray, Tao Zhou, Saugat Kandel, Amanda Petford-Long, Mathew J. Cherukara, Charudatta Phatak

Abstract: The manipulation and control of nanoscale magnetic spin textures is of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the n… ▽ More The manipulation and control of nanoscale magnetic spin textures is of rising interest as they are potential foundational units in next-generation computing paradigms. Achieving this requires a quantitative understanding of the spin texture behavior under external stimuli using in situ experiments. Lorentz transmission electron microscopy (LTEM) enables real-space imaging of spin textures at the nanoscale, but quantitative characterization of in situ data is extremely challenging. Here, we present an AI-enabled phase-retrieval method based on integrating a generative deep image prior with an image formation forward model for LTEM. Our approach uses a single out-of-focus image for phase retrieval and achieves significantly higher accuracy and robustness to noise compared to existing methods. Furthermore, our method is capable of isolating sample heterogeneities from magnetic contrast, as shown by application to simulated and experimental data. This approach allows quantitative phase reconstruction of in situ data and can also enable near real-time quantitative magnetic imaging. △ Less

Submitted 18 July, 2023; originally announced July 2023.

AI-assisted Automated Workflow for Real-time X-ray Ptychography Data Analysis via Federated Resources

Authors: Anakha V Babu, Tekin Bicer, Saugat Kandel, Tao Zhou, Daniel J. Ching, Steven Henke, Siniša Veseli, Ryan Chard, Antonino Miceli, Mathew Joseph Cherukara

Abstract: We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlappin… ▽ More We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlapping scan positions. This acquisition method can enable nanoscale imaging with x-rays and electrons, but this often requires very large experimental datasets and commensurately high turnaround times, which can limit experimental capabilities such as real-time experimental steering and low-latency monitoring. In this work, we introduce a software system that can automate ptychography data analysis tasks. We accelerate the data analysis pipeline by using a modified version of PtychoNN -- an ML-based approach to solve phase retrieval problem that shows two orders of magnitude speedup compared to traditional iterative methods. Further, our system coordinates and overlaps different data analysis tasks to minimize synchronization overhead between different stages of the workflow. We evaluate our workflow system with real-world experimental workloads from the 26ID beamline at Advanced Photon Source and ThetaGPU cluster at Argonne Leadership Computing Resources. △ Less

Submitted 9 April, 2023; originally announced April 2023.

Comments: 7 pages, 1 figure, to be published in High Performance Computing for Imaging Conference, Electronic Imaging (HPCI 2023)

Elucidation of Relaxation Dynamics Beyond Equilibrium Through AI-informed X-ray Photon Correlation Spectroscopy

Authors: James P. Horwath, Xiao-Min Lin, Hongrui He, Qingteng Zhang, Eric M. Dufresne, Miaoqi Chu, Subramanian K. R. S. Sankaranarayanan, Wei Chen, Suresh Narayanan, Mathew J. Cherukara

Abstract: Understanding and interpreting dynamics of functional materials \textit{in situ} is a grand challenge in physics and materials science due to the difficulty of experimentally probing materials at varied length and time scales. X-ray photon correlation spectroscopy (XPCS) is uniquely well-suited for characterizing materials dynamics over wide-ranging time scales, however spatial and temporal hetero… ▽ More Understanding and interpreting dynamics of functional materials \textit{in situ} is a grand challenge in physics and materials science due to the difficulty of experimentally probing materials at varied length and time scales. X-ray photon correlation spectroscopy (XPCS) is uniquely well-suited for characterizing materials dynamics over wide-ranging time scales, however spatial and temporal heterogeneity in material behavior can make interpretation of experimental XPCS data difficult. In this work we have developed an unsupervised deep learning (DL) framework for automated classification and interpretation of relaxation dynamics from experimental data without requiring any prior physical knowledge of the system behavior. We demonstrate how this method can be used to rapidly explore large datasets to identify samples of interest, and we apply this approach to directly correlate bulk properties of a model system to microscopic dynamics. Importantly, this DL framework is material and process agnostic, marking a concrete step towards autonomous materials discovery. △ Less

Submitted 7 December, 2022; originally announced December 2022.

Multislice forward modeling of Coherent Surface Scattering Imaging on surface and interfacial structures

Authors: Peco Myint, Miaoqi Chu, Ashish Tripathi, Michael J. Wojcik, Jian Zhou, Mathew J. Cherukara, Suresh Narayanan, Jin Wang, Zhang Jiang

Abstract: To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle x-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent Su… ▽ More To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle x-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent Surface Scattering Imaging (CSSI) is a powerful yet non-invasive technique similar to Coherent X-ray Diffractive Imaging (CDI) but performed at small angles and grazing-incidence reflection geometry. A challenge with CSSI is that conventional CDI reconstruction techniques cannot be directly applied to CSSI because the Fourier-transform-based forward models cannot reproduce the dynamical scattering phenomenon near the critical angle of total external reflection of the substrate-supported samples. To overcome this challenge, we have developed a multislice forward model which can successfully simulate the dynamical or multi-beam scattering generated from surface structures and the underlying substrate. The forward model is also demonstrated to be able to reconstruct an elongated 3D pattern from a single shot scattering image in the CSSI geometry through fast-performing CUDA-assisted PyTorch optimization with automatic differentiation. △ Less

Submitted 17 November, 2022; originally announced December 2022.

Comments: 12 pages, 4 figures, 1 table

Deep learning at the edge enables real-time streaming ptychographic imaging

Authors: Anakha V Babu, Tao Zhou, Saugat Kandel, Tekin Bicer, Zhengchun Liu, William Judge, Daniel J. Ching, Yi Jiang, Sinisa Veseli, Steven Henke, Ryan Chard, Yudong Yao, Ekaterina Sirazitdinova, Geetika Gupta, Martin V. Holt, Ian T. Foster, Antonino Miceli, Mathew J. Cherukara

Abstract: Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials charact… ▽ More Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials characterization. However, associated significant increases in data and compute needs mean that conventional approaches no longer suffice for recovering sample images in real-time from high-speed coherent imaging experiments. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHzきろへるつ. The proposed AI-enabled workflow eliminates the sampling constraints imposed by traditional ptychography, allowing low dose imaging using orders of magnitude less data than required by traditional methods. △ Less

Submitted 19 September, 2022; originally announced September 2022.

A lightweight, user-configurable detector ASIC digital architecture with on-chip data compression for MHz X-ray coherent diffraction imaging

Authors: Sebastian Strempfer, Tao Zhou, Kazutomo Yoshii, Mike Hammer, Anakha Babu, Dawid Bycul, John Weizeorick, Mathew J. Cherukara, Antonino Miceli

Abstract: Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionality from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable… ▽ More Today, most X-ray pixel detectors used at light sources transmit raw pixel data off the detector ASIC. With the availability of more advanced ASIC technology nodes for scientific application, more digital functionality from the computing domains (e.g., compression) can be integrated directly into a detector ASIC to increase data velocity. In this paper, we describe a lightweight, user-configurable detector ASIC digital architecture with on-chip compression which can be implemented in \SI{130}{\nm} technologies in a reasonable area on the ASIC periphery. In addition, we present a design to efficiently handle the variable data from the stream of parallel compressors. The architecture includes user-selectable lossy and lossless compression blocks. The impact of lossy compression algorithms is evaluated on simulated and experimental X-ray ptychography datasets. This architecture is a practical approach to increase pixel detector frame rates towards the continuous \SI{1}{\MHz} regime for not only coherent imaging techniques such as ptychography, but also for other diffraction techniques at X-ray light sources. △ Less

Submitted 29 July, 2022; originally announced August 2022.

Real-time X-ray Phase-contrast Imaging Using SPINNet -- A Speckle-based Phase-contrast Imaging Neural Network

Authors: Zhi Qiao, Xianbo Shi, Yudong Yao, Michael J. Wojcik, Luca Rebuffi, Mathew J. Cherukara, Lahsen Assoufid

Abstract: X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, their computational cost has hindered their wider adoption. By exploiting the power of deep learning… ▽ More X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, their computational cost has hindered their wider adoption. By exploiting the power of deep learning, we developed a new speckle-based phase-contrast imaging neural network (SPINNet) that boosts the phase retrieval speed by at least two orders of magnitude compared to existing methods. To achieve this performance, we combined SPINNet with a novel coded-mask-based technique, an enhanced version of the speckle-based method. Using this scheme, we demonstrate a simultaneous reconstruction of absorption and phase images on the order of 100 ms, where a traditional correlation-based analysis would take several minutes even with a cluster. In addition to significant improvement in speed, our experimental results show that the imaging resolution and phase retrieval quality of SPINNet outperform existing single-shot speckle-based methods. Furthermore, we successfully demonstrate its application in 3D X-ray phase-contrast tomography. Our result shows that SPINNet could enable many applications requiring high-resolution and fast data acquisition and processing, such as in-situ and in-operando 2D and 3D phase-contrast imaging and real-time at-wavelength metrology and wavefront sensing. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Comments: 13 pages, 8 figures

High-Performance Ptychographic Reconstruction with Federated Facilities

Authors: Tekin Bicer, Xiaodong Yu, Daniel J. Ching, Ryan Chard, Mathew J. Cherukara, Bogdan Nicolae, Rajkumar Kettimuthu, Ian T. Foster

Abstract: Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even week… ▽ More Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities; under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user-defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra-high-resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 19 pages, 5 figures, to be published in Smoky Mountains Computational Sciences and Engineering Conference (SMC 2021)

AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imaging

Authors: Yudong Yao, Henry Chan, Subramanian Sankaranarayanan, Prasanna Balaprakash, Ross J. Harder, Mathew J. Cherukara

Abstract: The problem of phase retrieval, or the algorithmic recovery of lost phase information from measured intensity alone, underlies various imaging methods from astronomy to nanoscale imaging. Traditional methods of phase retrieval are iterative in nature, and are therefore computationally expensive and time consuming. More recently, deep learning (DL) models have been developed to either provide learn… ▽ More The problem of phase retrieval, or the algorithmic recovery of lost phase information from measured intensity alone, underlies various imaging methods from astronomy to nanoscale imaging. Traditional methods of phase retrieval are iterative in nature, and are therefore computationally expensive and time consuming. More recently, deep learning (DL) models have been developed to either provide learned priors to iterative phase retrieval or in some cases completely replace phase retrieval with networks that learn to recover the lost phase information from measured intensity alone. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on hundreds of or even thousands of experimental datasets. Using a 3D nanoscale X-ray imaging modality (Bragg Coherent Diffraction Imaging or BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the physics of the imaging technique into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data from reciprocal space to real space in a single shot without ever being shown real space images. Once trained, AutoPhaseNN is about one hundred times faster than traditional iterative phase retrieval methods while providing comparable image quality. △ Less

Submitted 4 April, 2022; v1 submitted 28 September, 2021; originally announced September 2021.

MSC Class: 68T07; 00A79

Proton distribution visualization in perovskite nickelate devices utilizing nanofocused X-rays

Authors: Ivan A. Zaluzhnyy, Peter O. Sprau, Richard Tran, Qi Wang, Hai-Tian Zhang, Zhen Zhang, Tae Joon Park, Nelson Hua, Boyan Stoychev, Mathew J. Cherukara, Martin V. Holt, Evgeny Nazarertski, Xiaojing Huang, Hanfei Yan, Ajith Pattammattel, Yong S. Chu, Shyue Ping Ong, Shriram Ramanathan, Oleg G. Shpyrko, Alex Frano

Abstract: We use a 30-nm x-ray beam to study the spatially resolved properties of a SmNiO$_3$-based nanodevice that is doped with protons. The x-ray absorption spectra supported by density-functional theory (DFT) simulations show partial reduction of nickel valence in the region with high proton concentration, which leads to the insulating behavior. Concurrently, x-ray diffraction reveals only a small latti… ▽ More We use a 30-nm x-ray beam to study the spatially resolved properties of a SmNiO$_3$-based nanodevice that is doped with protons. The x-ray absorption spectra supported by density-functional theory (DFT) simulations show partial reduction of nickel valence in the region with high proton concentration, which leads to the insulating behavior. Concurrently, x-ray diffraction reveals only a small lattice distortion in the doped regions. Together, our results directly show that the knob which proton doping modifies is the electronic valency, and not the crystal lattice. The studies are relevant to on-going efforts to disentangle structural and electronic effects across metal-insulator phase transitions in correlated oxides. △ Less

Submitted 13 August, 2021; originally announced August 2021.

Journal ref: Phys. Rev. Materials 5, 095003 (2021)

Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning

Authors: Henry Chan, Youssef S. G. Nashed, Saugat Kandel, Stephan Hruszkewycz, Subramanian Sankaranarayanan, Ross J. Harder, Mathew J. Cherukara

Abstract: Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we us… ▽ More Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time-consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programming framework trained to predict 3D structure and strain solely from input 3D X-ray coherent scattering data. Our networks are designed to be "physics-aware" in multiple aspects; in that the physics of x-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods, with negligible loss in accuracy. Our integrated machine learning and differential programming solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas. △ Less

Submitted 16 June, 2020; originally announced June 2020.

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Authors: Mathew J. Cherukara, Tao Zhou, Youssef Nashed, Pablo Enfedaque, Alex Hexemer, Ross J. Harder, Martin V. Holt

Abstract: Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, w… ▽ More Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Screening of Therapeutic Agents for COVID-19 using Machine Learning and Ensemble Docking Simulations

Authors: Rohit Batra, Henry Chan, Ganesh Kamath, Rampi Ramprasad, Mathew J. Cherukara, Subramanian Sankaranarayanan

Abstract: The world has witnessed unprecedented human and economic loss from the COVID-19 disease, caused by the novel coronavirus SARS-CoV-2. Extensive research is being conducted across the globe to identify therapeutic agents against the SARS-CoV-2. Here, we use a powerful and efficient computational strategy by combining machine learning (ML) based models and high-fidelity ensemble docking simulations t… ▽ More The world has witnessed unprecedented human and economic loss from the COVID-19 disease, caused by the novel coronavirus SARS-CoV-2. Extensive research is being conducted across the globe to identify therapeutic agents against the SARS-CoV-2. Here, we use a powerful and efficient computational strategy by combining machine learning (ML) based models and high-fidelity ensemble docking simulations to enable rapid screening of possible therapeutic molecules (or ligands). Our screening is based on the binding affinity to either the isolated SARS-CoV-2 S-protein at its host receptor region or to the Sprotein-human ACE2 interface complex, thereby potentially limiting and/or disrupting the host-virus interactions. We first apply our screening strategy to two drug datasets (CureFFI and DrugCentral) to identify hundreds of ligands that bind strongly to the aforementioned two systems. Candidate ligands were then validated by all atom docking simulations. The validated ML models were subsequently used to screen a large bio-molecule dataset (with nearly a million entries) to provide a rank-ordered list of ~19,000 potentially useful compounds for further validation. Overall, this work not only expands our knowledge of small-molecule treatment against COVID-19, but also provides an efficient pathway to perform high-throughput computational drug screening by combining quick ML surrogate models with expensive high-fidelity simulations, for accelerating the therapeutic cure of diseases. △ Less

Submitted 7 April, 2020; originally announced April 2020.

A coarse-grained deep neural network model for liquid water

Authors: Tarak K Patra, Troy D. Loeffler, Henry Chan, Mathew J. Cherukara, Badri Narayanan, Subramanian K. R. S. Sankaranarayanan

Abstract: We introduce a coarse-grained deep neural network model (CG-DNN) for liquid water that utilizes 50 rotational and translational invariant coordinates, and is trained exclusively against energies of ~30,000 bulk water configurations. Our CG-DNN potential accurately predicts both the energies and molecular forces of water; within 0.9 meV/molecule and 54 meV/angstrom of a reference (coarse-grained bo… ▽ More We introduce a coarse-grained deep neural network model (CG-DNN) for liquid water that utilizes 50 rotational and translational invariant coordinates, and is trained exclusively against energies of ~30,000 bulk water configurations. Our CG-DNN potential accurately predicts both the energies and molecular forces of water; within 0.9 meV/molecule and 54 meV/angstrom of a reference (coarse-grained bond-order potential) model. The CG-DNN water model also provides good prediction of several structural, thermodynamic, and temperature dependent properties of liquid water, with values close to that obtained from the reference model. More importantly, CG-DNN captures the well-known density anomaly of liquid water observed in experiments. Our work lays the groundwork for a scheme where existing empirical water models can be utilized to develop fully flexible neural network framework that can subsequently be trained against sparse data from high-fidelity albeit expensive beyond-DFT calculations. △ Less

Submitted 14 October, 2019; v1 submitted 1 October, 2019; originally announced October 2019.

Time-resolved x-ray microscopy for materials science

Authors: Haidan Wen, Mathew J. Cherukara, Martin V. Holt

Abstract: X-ray microscopy has been an indispensable tool to image nanoscale properties for materials research. One of its recent advances is to extend microscopic studies to the time domain for visualizing the dynamics of nanoscale phenomena. Large-scale x-ray facilities have been the powerhouse of time-resolved x-ray microscopy. Their upgrades including a significant reduction of the x-ray emittance at st… ▽ More X-ray microscopy has been an indispensable tool to image nanoscale properties for materials research. One of its recent advances is to extend microscopic studies to the time domain for visualizing the dynamics of nanoscale phenomena. Large-scale x-ray facilities have been the powerhouse of time-resolved x-ray microscopy. Their upgrades including a significant reduction of the x-ray emittance at storage rings and fully coherent ultrashort x-ray pulses at free electron lasers, will lead to new developments in instrumentation and open new scientific opportunities for x-ray imaging of nanoscale dynamics with the simultaneous attainment of unprecedentedly high spatial and temporal resolutions. This review presents recent progress in and the outlook for time-resolved x-ray microscopy in the context of ultrafast nanoscale imaging and its applications to condensed matter physics and materials science. △ Less

Submitted 9 November, 2018; originally announced November 2018.

Real-time coherent diffraction inversion using deep generative networks

Authors: Mathew J. Cherukara, Youssef S. G. Nashed, Ross J. Harder

Abstract: Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furth… ▽ More Phase retrieval, or the process of recovering phase information in reciprocal space to reconstruct images from measured intensity alone, is the underlying basis to a variety of imaging applications including coherent diffraction imaging (CDI). Typical phase retrieval algorithms are iterative in nature, and hence, are time-consuming and computationally expensive, precluding real-time imaging. Furthermore, iterative phase retrieval algorithms struggle to converge to the correct solution especially in the presence of strong phase structures. In this work, we demonstrate the training and testing of CDI NN, a pair of deep deconvolutional networks trained to predict structure and phase in real space of a 2D object from its corresponding far-field diffraction intensities alone. Once trained, CDI NN can invert a diffraction pattern to an image within a few milliseconds of compute time on a standard desktop machine, opening the door to real-time imaging. △ Less

Submitted 7 June, 2018; originally announced June 2018.

Journal ref: Scientific Reports (2018) 8:16520

Anisotropic nano-scale resolution in 3D Bragg coherent diffraction imaging

Authors: Mathew J. Cherukara, Wonsuk Cha, Ross J. Harder

Abstract: We demonstrate that the resolution of three-dimensional (3D) real-space images obtained from Bragg x-ray coherent diffraction measurements is direction dependent. We propose and demonstrate the effectiveness of a metric to determine the spatial resolution of images that accounts for the direc- tional dependence. The measured direction dependent resolution of ~ 4-9nm is about 2 times higher than th… ▽ More We demonstrate that the resolution of three-dimensional (3D) real-space images obtained from Bragg x-ray coherent diffraction measurements is direction dependent. We propose and demonstrate the effectiveness of a metric to determine the spatial resolution of images that accounts for the direc- tional dependence. The measured direction dependent resolution of ~ 4-9nm is about 2 times higher than the best previously obtained 3D measurements. Finally, we quantify the relationship between the resolution of recovered real-space images and dosage, and discuss its implications in the light of next generation synchrotrons. △ Less

Submitted 7 June, 2018; originally announced June 2018.

Journal ref: Appl. Phys. Lett. 113, 203101 (2018)

Ice grains grow by dissolution, ripening and grain boundary migration

Authors: Henry Chan, Mathew J Cherukara, Badri Narayanan, Chris J Benmore, Stephen Gray, Subramanian KRS Sankaranarayanan

Abstract: Despite the exponential growth in computing resources and the availability of a myriad of different theoretical water models, an accurate, yet computationally efficient molecular level description of mesoscopic grain growth remains a grand challenge. The underlying phase transitions and dynamical processes in deeply supercooled systems are often rendered inaccessible due to limitations imposed by… ▽ More Despite the exponential growth in computing resources and the availability of a myriad of different theoretical water models, an accurate, yet computationally efficient molecular level description of mesoscopic grain growth remains a grand challenge. The underlying phase transitions and dynamical processes in deeply supercooled systems are often rendered inaccessible due to limitations imposed by system sizes and timescales, which is further compounded by their sluggish kinetics. Here, we introduce a machine-learned, bond-order-based potential model (BOP) that more accurately describes the anomalous behavior, as well as structural and thermodynamical properties of both liquid water and ice, with at least two orders of magnitude cheaper computational cost than existing atomistic water models. In a significant departure from conventional force-field fitting, we use a multilevel evolutionary strategy that trains the BOP model against not just energetics but temperature dependent properties inferred from on-the-fly molecular dynamics simulations as well. We use the BOP model to probe the homogeneous ice nucleation and growth process by performing molecular dynamics on multi-million molecule systems for up to microsecond time scales. These massively parallel, long-time simulations naturally capture the competition between cubic, hexagonal, and stacking disordered ice phases during nucleation and early stages of growth leading to the formation of nanometer sized grains. Subsequently, we elucidate the hitherto elusive mechanism of grain coarsening of the crystallized mixed ice phases, which occur through grain dissolution and Ostwald ripening followed by grain boundary migration. △ Less

Submitted 1 December, 2016; originally announced December 2016.