-
Improved Three-Dimensional Reconstructions in Electron Ptychography through Defocus Series Measurements
Authors:
Marcel Schloz,
Thomas C. Pekin,
Hamish G. Brown,
Dana O. Byrne,
Bryan D. Esser,
Emmanuel Terzoudis-Lumsden,
Takashi Taniguchi,
Kenji Watanabe,
Scott D. Findlay,
Benedikt Haas,
Jim Ciston,
Christoph T. Koch
Abstract:
A detailed analysis of ptychography for 3D phase reconstructions of thick specimens is performed. We introduce multi-focus ptychography, which incorporates a 4D-STEM defocus series to enhance the quality of 3D reconstructions along the beam direction through a higher overdetermination ratio. This method is compared with established multi-slice ptychography techniques, such as conventional ptychogr…
▽ More
A detailed analysis of ptychography for 3D phase reconstructions of thick specimens is performed. We introduce multi-focus ptychography, which incorporates a 4D-STEM defocus series to enhance the quality of 3D reconstructions along the beam direction through a higher overdetermination ratio. This method is compared with established multi-slice ptychography techniques, such as conventional ptychography, regularized ptychography, and multi-mode ptychography. Additionally, we contrast multi-focus ptychography with an alternative method that uses virtual optical sectioning through a reconstructed scattering matrix ($\mathcal{S}$-matrix), which offers more precise 3D structure information compared to conventional ptychography. Our findings from multiple 3D reconstructions based on simulated and experimental data demonstrate that multi-focus ptychography surpasses other techniques, particularly in accurately reconstructing the surfaces and interface regions of thick specimens.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
The 4D Camera: an 87 kHz direct electron detector for scanning/transmission electron microscopy
Authors:
Peter Ercius,
Ian J. Johnson,
Philipp Pelz,
Benjamin H. Savitzky,
Lauren Hughes,
Hamish G. Brown,
Steven E. Zeltmann,
Shang-Lin Hsu,
Cassio C. S. Pedroso,
Bruce E. Cohen,
Ramamoorthy Ramesh,
David Paul,
John M. Joseph,
Thorsten Stezelberger,
Cory Czarnik,
Matthew Lent,
Erin Fong,
Jim Ciston,
Mary C. Scott,
Colin Ophus,
Andrew M. Minor,
and Peter Denes
Abstract:
We describe the development, operation, and application of the 4D Camera -- a 576 by 576 pixel active pixel sensor for scanning/transmission electron microscopy which operates at 87,000 Hz. The detector generates data at approximately 480 Gbit/s which is captured by dedicated receiver computers with a parallelized software infrastructure that has been implemented to process the resulting 10 - 700…
▽ More
We describe the development, operation, and application of the 4D Camera -- a 576 by 576 pixel active pixel sensor for scanning/transmission electron microscopy which operates at 87,000 Hz. The detector generates data at approximately 480 Gbit/s which is captured by dedicated receiver computers with a parallelized software infrastructure that has been implemented to process the resulting 10 - 700 Gigabyte-sized raw datasets. The back illuminated detector provides the ability to detect single electron events at accelerating voltages from 30 - 300 keV. Through electron counting, the resulting sparse data sets are reduced in size by 10 - 300x compared to the raw data, and open-source sparsity-based processing algorithms offer rapid data analysis. The high frame rate allows for large and complex 4D-STEM experiments to be accomplished with typical STEM scanning parameters.
△ Less
Submitted 19 May, 2023;
originally announced May 2023.
-
Fast unified reconstruction algorithm for conventional, phase-contrast and diffraction tomography
Authors:
Timur E. Gureyev,
Hamish G. Brown,
Harry M. Quiney,
Leslie J. Allen
Abstract:
A unified method for three-dimensional reconstruction of objects from transmission images collected at multiple illumination directions is described. The method may be applicable to experimental conditions relevant to absorption-based, phase-contrast or diffraction imaging using X-rays, electrons and other forms of penetrating radiation or matter waves. Both the phase retrieval (also known as cont…
▽ More
A unified method for three-dimensional reconstruction of objects from transmission images collected at multiple illumination directions is described. The method may be applicable to experimental conditions relevant to absorption-based, phase-contrast or diffraction imaging using X-rays, electrons and other forms of penetrating radiation or matter waves. Both the phase retrieval (also known as contrast transfer function correction) and the effect of Ewald sphere curvature (in the cases with a shallow depth of field and significant in-object diffraction) are incorporated in the proposed algorithm and can be taken into account. Multiple scattering is not treated explicitly, but can be mitigated as a result of angular averaging that constitutes an essential feature of the method. The corresponding numerical algorithm is based on three-dimensional gridding which allows for fast computational implementation, including a straightforward parallelization. The algorithm can be used with any scanning geometry involving plane-wave illumination. A software code implementing the proposed algorithm has been developed, tested on simulated and experimental image data and made publicly available.
△ Less
Submitted 7 July, 2022; v1 submitted 18 June, 2022;
originally announced June 2022.
-
Reconstructing the Scattering Matrix from Scanning Electron Diffraction Measurements Alone
Authors:
Philipp M Pelz,
Hamish G Brown,
Jim Ciston,
Scott D Findlay,
Yaqian Zhang,
Mary Scott,
Colin Ophus
Abstract:
Three-dimensional phase contrast imaging of multiply-scattering samples in X-ray and electron microscopy is extremely challenging, due to small numerical apertures, the unavailability of wavefront shaping optics, and the highly nonlinear inversion required from intensity-only measurements. In this work, we present a new algorithm using the scattering matrix formalism to solve the scattering from a…
▽ More
Three-dimensional phase contrast imaging of multiply-scattering samples in X-ray and electron microscopy is extremely challenging, due to small numerical apertures, the unavailability of wavefront shaping optics, and the highly nonlinear inversion required from intensity-only measurements. In this work, we present a new algorithm using the scattering matrix formalism to solve the scattering from a non-crystalline medium from scanning diffraction measurements, and recover the illumination aberrations. Our method will enable 3D imaging and materials characterization at high resolution for a wide range of materials.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.
-
py4DSTEM: a software package for multimodal analysis of four-dimensional scanning transmission electron microscopy datasets
Authors:
Benjamin H Savitzky,
Lauren A Hughes,
Steven E Zeltmann,
Hamish G Brown,
Shiteng Zhao,
Philipp M Pelz,
Edward S Barnard,
Jennifer Donohue,
Luis Rangel DaCosta,
Thomas C. Pekin,
Ellis Kennedy,
Matthew T Janish,
Matthew M Schneider,
Patrick Herring,
Chirranjeevi Gopal,
Abraham Anapolsky,
Peter Ercius,
Mary Scott,
Jim Ciston,
Andrew M Minor,
Colin Ophus
Abstract:
Scanning transmission electron microscopy (STEM) allows for imaging, diffraction, and spectroscopy of materials on length scales ranging from microns to atoms. By using a high-speed, direct electron detector, it is now possible to record a full 2D image of the diffracted electron beam at each probe position, typically a 2D grid of probe positions. These 4D-STEM datasets are rich in information, in…
▽ More
Scanning transmission electron microscopy (STEM) allows for imaging, diffraction, and spectroscopy of materials on length scales ranging from microns to atoms. By using a high-speed, direct electron detector, it is now possible to record a full 2D image of the diffracted electron beam at each probe position, typically a 2D grid of probe positions. These 4D-STEM datasets are rich in information, including signatures of the local structure, orientation, deformation, electromagnetic fields and other sample-dependent properties. However, extracting this information requires complex analysis pipelines, from data wrangling to calibration to analysis to visualization, all while maintaining robustness against imaging distortions and artifacts. In this paper, we present py4DSTEM, an analysis toolkit for measuring material properties from 4D-STEM datasets, written in the Python language and released with an open source license. We describe the algorithmic steps for dataset calibration and various 4D-STEM property measurements in detail, and present results from several experimental datasets. We have also implemented a simple and universal file format appropriate for electron microscopy data in py4DSTEM, which uses the open source HDF5 standard. We hope this tool will benefit the research community, helps to move the developing standards for data and computational methods in electron microscopy, and invite the community to contribute to this ongoing, fully open-source project.
△ Less
Submitted 20 March, 2020;
originally announced March 2020.
-
A linear-scaling algorithm for rapid computation of inelastic transitions in the presence of multiple electron scattering
Authors:
Hamish G. Brown,
Jim Ciston,
Colin Ophus
Abstract:
Strong multiple scattering of the probe in scanning transmission electron microscopy (STEM) means image simulations are usually required for quantitative interpretation and analysis of elemental maps produced by electron energy-loss spectroscopy (EELS). These simulations require a full quantum-mechanical treatment of multiple scattering of the electron beam, both before and after a core-level inel…
▽ More
Strong multiple scattering of the probe in scanning transmission electron microscopy (STEM) means image simulations are usually required for quantitative interpretation and analysis of elemental maps produced by electron energy-loss spectroscopy (EELS). These simulations require a full quantum-mechanical treatment of multiple scattering of the electron beam, both before and after a core-level inelastic transition. Current algorithms scale quadratically and can take up to a week to calculate on desktop machines even for simple crystal unit cells and do not scale well to the nano-scale heterogeneous systems that are often of interest to materials science researchers. We introduce an algorithm with linear scaling that typically results in an order of magnitude reduction in compute time for these calculations without introducing additional error and discuss approximations that further improve computational scaling for larger scale objects with modest penalties in calculation error. We demonstrate these speed-ups by calculating the atomic resolution STEM-EELS map using the L-edge transition of Fe, for of a nanoparticle 80 Å in diameter in 16 hours, a calculation that would have taken at least 80 days using a conventional multislice approach.
△ Less
Submitted 20 August, 2019;
originally announced August 2019.
-
Probing the limits of the rigid-intensity-shift model in differential phase contrast scanning transmission electron microscopy
Authors:
L. Clark,
H. G. Brown,
D. M. Paganin,
M. J. Morgan,
T. Matsumoto,
N. Shibata,
T. C. Petersen,
S. D. Findlay
Abstract:
The rigid-intensity-shift model of differential phase contrast scanning transmission electron microscopy (DPC-STEM) imaging assumes that the phase gradient imposed on the probe by the sample causes the diffraction pattern intensity to shift rigidly by an amount proportional to that phase gradient. This behaviour is seldom realised exactly in practice. Through a combination of experimental results,…
▽ More
The rigid-intensity-shift model of differential phase contrast scanning transmission electron microscopy (DPC-STEM) imaging assumes that the phase gradient imposed on the probe by the sample causes the diffraction pattern intensity to shift rigidly by an amount proportional to that phase gradient. This behaviour is seldom realised exactly in practice. Through a combination of experimental results, analytical modelling and numerical calculations, we explore the breakdown of the rigid-intensity-shift behaviour and how this depends on the magnitude of the phase gradient and the relative scale of features in the phase profile and the probe size. We present guidelines as to when the rigid-intensity-shift model can be applied for quantitative phase reconstruction using segmented detectors, and propose probe-shaping strategies to further improve the accuracy.
△ Less
Submitted 18 January, 2018;
originally announced January 2018.
