-
Optimizing Charge Transport Simulation for Deep Learning Enhanced Spatial Resolution of the MÖNCH Detector
Authors:
X. Xie,
R. Barten,
A. Bergamaschi,
B. Braham,
M. Brückner,
M. Carulla,
R. Dinapoli,
S. Ebner,
K. Ferjaoui,
E. Fröjdh,
D. Greiffenberg,
S. Hasanaj,
J. Heymes,
V. Hinger,
T. King,
P. Kozlowski,
C. Lopez-Cuenca,
D. Mezza,
K. Moustakas,
A. Mozzanica,
K. A. Paton,
C. Ruder,
B. Schmitt,
P. Sieberer,
D. Thattil
, et al. (1 additional authors not shown)
Abstract:
Deep learning has the potential to significantly enhance the spatial resolution of hybrid detectors for electrons, as demonstrated for electron microscopy using 200 keV electrons with the MÖNCH 25 μm pitch charge integration pixel detector. The deep learning models have been trained using both simulation data, which are more straightforward to generate with varied parameters, and measurement data,…
▽ More
Deep learning has the potential to significantly enhance the spatial resolution of hybrid detectors for electrons, as demonstrated for electron microscopy using 200 keV electrons with the MÖNCH 25 μm pitch charge integration pixel detector. The deep learning models have been trained using both simulation data, which are more straightforward to generate with varied parameters, and measurement data, which are more cumbersome to acquire due to the required specialized setup of the electron microscope. However, challenges arise when comparing simulation-based deep learning models to measurement-based models for electrons, as the spatial resolution achieved through simulations is notably inferior to that from measurements. Discrepancies are also observed when directly comparing X-ray simulations with measurements, particularly in the spectral output of single pixels. These observations collectively suggest that current simulations require optimization.
To address this, a Monte Carlo simulation was conducted to model the dynamics of charge carriers within the silicon sensor, aiming to refine charge transport modeling. The simulation encompasses the initial generation of the charge cloud, charge cloud drift, charge diffusion and repulsion, and electronic noise. The simulation results were validated with measurements from the MÖNCH detector for X-rays, and consistencies between the simulation and the measurements were significantly improved by accounting for the charge repulsion.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Core: Robust Factual Precision Scoring with Informative Sub-Claim Identification
Authors:
Zhengping Jiang,
Jingyu Zhang,
Nathaniel Weir,
Seth Ebner,
Miriam Wanner,
Kate Sanders,
Daniel Khashabi,
Anqi Liu,
Benjamin Van Durme
Abstract:
Hallucinations -- the generation of untrue claims -- pose a challenge to the application of large language models (LLMs) [1] thereby motivating the development of metrics to evaluate factual precision. We observe that popular metrics using the Decompose-Then-Verify framework, such as FActScore [2], can be manipulated by adding obvious or repetitive claims to artificially inflate scores. We expand…
▽ More
Hallucinations -- the generation of untrue claims -- pose a challenge to the application of large language models (LLMs) [1] thereby motivating the development of metrics to evaluate factual precision. We observe that popular metrics using the Decompose-Then-Verify framework, such as FActScore [2], can be manipulated by adding obvious or repetitive claims to artificially inflate scores. We expand the FActScore dataset to design and analyze factual precision metrics, demonstrating that models can be trained to achieve high scores under existing metrics through exploiting the issues we identify. This motivates our new customizable plug-and-play subclaim selection component called Core, which filters down individual subclaims according to their uniqueness and informativeness. Metrics augmented by Core are substantially more robust as shown in head-to-head comparisons. We release an evaluation framework supporting the modular use of Core (https://github.com/zipJiang/Core) and various decomposition strategies, and we suggest its adoption by the LLM community.
[1] Hong et al., "The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models", arXiv:2404.05904v2 [cs.CL].
[2] Min et al., "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation", arXiv:2305.14251v2 [cs.CL].
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
A Closer Look at Claim Decomposition
Authors:
Miriam Wanner,
Seth Ebner,
Zhengping Jiang,
Mark Dredze,
Benjamin Van Durme
Abstract:
As generated text becomes more commonplace, it is increasingly important to evaluate how well-supported such text is by external knowledge sources. Many approaches for evaluating textual support rely on some method for decomposing text into its individual subclaims which are scored against a trusted reference. We investigate how various methods of claim decomposition -- especially LLM-based method…
▽ More
As generated text becomes more commonplace, it is increasingly important to evaluate how well-supported such text is by external knowledge sources. Many approaches for evaluating textual support rely on some method for decomposing text into its individual subclaims which are scored against a trusted reference. We investigate how various methods of claim decomposition -- especially LLM-based methods -- affect the result of an evaluation approach such as the recently proposed FActScore, finding that it is sensitive to the decomposition method used. This sensitivity arises because such metrics attribute overall textual support to the model that generated the text even though error can also come from the metric's decomposition step. To measure decomposition quality, we introduce an adaptation of FActScore, which we call DecompScore. We then propose an LLM-based approach to generating decompositions inspired by Bertrand Russell's theory of logical atomism and neo-Davidsonian semantics and demonstrate its improved decomposition quality over previous methods.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Characterization of iLGADs using soft X-rays
Authors:
Antonio Liguori,
Rebecca Barten,
Filippo Baruffaldi,
Anna Bergamaschi,
Giacomo Borghi,
Maurizio Boscardin,
Martin Brückner,
Tim Alexander Butcher,
Maria Carulla,
Matteo Centis Vignali,
Roberto Dinapoli,
Simon Ebner,
Francesco Ficorella,
Erik Fröjdh,
Dominic Greiffenberg,
Omar Hammad Ali,
Shqipe Hasanaj,
Julian Heymes,
Viktoria Hinger,
Thomas King,
Pawel Kozlowski,
Carlos Lopez-Cuenca,
Davide Mezza,
Konstantinos Moustakas,
Aldo Mozzanica
, et al. (9 additional authors not shown)
Abstract:
Experiments at synchrotron radiation sources and X-ray Free-Electron Lasers in the soft X-ray energy range ($250$eV--$2$keV) stand to benefit from the adaptation of the hybrid silicon detector technology for low energy photons. Inverse Low Gain Avalanche Diode (iLGAD) sensors provide an internal gain, enhancing the signal-to-noise ratio and allowing single photon detection below $1$keV using hybri…
▽ More
Experiments at synchrotron radiation sources and X-ray Free-Electron Lasers in the soft X-ray energy range ($250$eV--$2$keV) stand to benefit from the adaptation of the hybrid silicon detector technology for low energy photons. Inverse Low Gain Avalanche Diode (iLGAD) sensors provide an internal gain, enhancing the signal-to-noise ratio and allowing single photon detection below $1$keV using hybrid detectors. In addition, an optimization of the entrance window of these sensors enhances their quantum efficiency (QE). In this work, the QE and the gain of a batch of different iLGAD diodes with optimized entrance windows were characterized using soft X-rays at the Surface/Interface:Microscopy beamline of the Swiss Light Source synchrotron. Above $250$eV, the QE is larger than $55\%$ for all sensor variations, while the charge collection efficiency is close to $100\%$. The average gain depends on the gain layer design of the iLGADs and increases with photon energy. A fitting procedure is introduced to extract the multiplication factor as a function of the absorption depth of X-ray photons inside the sensors. In particular, the multiplication factors for electron- and hole-triggered avalanches are estimated, corresponding to photon absorption beyond or before the gain layer, respectively.
△ Less
Submitted 23 October, 2023;
originally announced October 2023.
-
Disentangling the Evolution of Electrons and Holes in photoexcited ZnO nanoparticles
Authors:
Christopher J. Milne,
Natalia Nagornova,
Thomas Pope,
Hui-Yuan Chen,
Thomas Rossi,
Jakub Szlachetko,
Wojciech Gawelda,
Alexander Britz,
Tim B. van Drie,
Leonardo Sala,
Simon Ebner,
Tetsuo Katayama,
Stephen H. Southworth,
Gilles Doumy,
Anne Marie March,
C. Stefan Lehmann,
Melanie Mucke,
Denys Iablonskyi,
Yoshiaki Kumagai,
Gregor Knopp,
Koji Motomura,
Tadashi Togashi,
Shigeki Owada,
Makina Yabashi,
Martin M. Nielsen
, et al. (5 additional authors not shown)
Abstract:
The evolution of charge carriers in photoexcited room temperature ZnO nanoparticles in solution is investigated using ultrafast ultraviolet photoluminescence spectroscopy, ultrafast Zn K-edge absorption spectroscopy and ab-initio molecular dynamics (MD) simulations. The photoluminescence is excited at 4.66 eV, well above the band edge, and shows that electron cooling in the conduction band and exc…
▽ More
The evolution of charge carriers in photoexcited room temperature ZnO nanoparticles in solution is investigated using ultrafast ultraviolet photoluminescence spectroscopy, ultrafast Zn K-edge absorption spectroscopy and ab-initio molecular dynamics (MD) simulations. The photoluminescence is excited at 4.66 eV, well above the band edge, and shows that electron cooling in the conduction band and exciton formation occur in <500 fs, in excellent agreement with theoretical predictions. The X-ray absorption measurements, obtained upon excitation close to the band edge at 3.49 eV, are sensitive to the migration and trapping of holes. They reveal that the 2 ps transient largely reproduces the previously reported transient obtained at 100 ps time delay in synchrotron studies. In addition, the X-ray absorption signal is found to rise in ~1.4 ps, which we attribute to the diffusion of holes through the lattice prior to their trapping at singly-charged oxygen vacancies. Indeed, the MD simulations show that impulsive trapping of holes induces an ultrafast expansion of the cage of Zn atoms in <200 fs, followed by an oscillatory response at a frequency of ~100 cm-1, which corresponds to a phonon mode of the system involving the Zn sub-lattice.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
An Augmentation Strategy for Visually Rich Documents
Authors:
Jing Xie,
James B. Wendt,
Yichao Zhou,
Seth Ebner,
Sandeep Tata
Abstract:
Many business workflows require extracting important fields from form-like documents (e.g. bank statements, bills of lading, purchase orders, etc.). Recent techniques for automating this task work well only when trained with large datasets. In this work we propose a novel data augmentation technique to improve performance when training data is scarce, e.g. 10-250 documents. Our technique, which we…
▽ More
Many business workflows require extracting important fields from form-like documents (e.g. bank statements, bills of lading, purchase orders, etc.). Recent techniques for automating this task work well only when trained with large datasets. In this work we propose a novel data augmentation technique to improve performance when training data is scarce, e.g. 10-250 documents. Our technique, which we call FieldSwap, works by swapping out the key phrases of a source field with the key phrases of a target field to generate new synthetic examples of the target field for use in training. We demonstrate that this approach can yield 1-7 F1 point improvements in extraction performance.
△ Less
Submitted 22 December, 2022; v1 submitted 20 December, 2022;
originally announced December 2022.
-
Development of LGAD sensors with a thin entrance window for soft X-ray detection
Authors:
Jiaguo Zhang,
Rebecca Barten,
Filippo Baruffaldi,
Anna Bergamaschi,
Giacomo Borghi,
Maurizio Boscardin,
Martin Brueckner,
Maria Carulla,
Matteo Centis Vignali,
Roberto Dinapoli,
Simon Ebner,
Francesco Ficorella,
Erik Froejdh,
Dominic Greiffenberg,
Omar Hammad Ali,
Julian Heymes,
Shqipe Hasanaj,
Viktoria Hinger,
Thomas King,
Pawel Kozlowski,
Carlos Lopez-Cuenca,
Davide Mezza,
Konstantinos Moustakas,
Aldo Mozzanica,
Giovanni Paternoster
, et al. (4 additional authors not shown)
Abstract:
We show the developments carried out to improve the silicon sensor technology for the detection of soft X-rays with hybrid X-ray detectors. An optimization of the entrance window technology is required to improve the quantum efficiency. The LGAD technology can be used to amplify the signal generated by the X-rays and to increase the signal-to-noise ratio, making single photon resolution in the sof…
▽ More
We show the developments carried out to improve the silicon sensor technology for the detection of soft X-rays with hybrid X-ray detectors. An optimization of the entrance window technology is required to improve the quantum efficiency. The LGAD technology can be used to amplify the signal generated by the X-rays and to increase the signal-to-noise ratio, making single photon resolution in the soft X-ray energy range possible. In this paper, we report first results obtained from an LGAD sensor production with an optimized thin entrance window. Single photon detection of soft X-rays down to 452~eV has been demonstrated from measurements, with a signal-to-noise ratio better than 20.
△ Less
Submitted 24 October, 2022;
originally announced October 2022.
-
Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction
Authors:
Mahsa Yarmohammadi,
Shijie Wu,
Marc Marone,
Haoran Xu,
Seth Ebner,
Guanghui Qin,
Yunmo Chen,
Jialiang Guo,
Craig Harman,
Kenton Murray,
Aaron Steven White,
Mark Dredze,
Benjamin Van Durme
Abstract:
Zero-shot cross-lingual information extraction (IE) describes the construction of an IE model for some target language, given existing annotations exclusively in some other language, typically English. While the advance of pretrained multilingual encoders suggests an easy optimism of "train on English, run on any language", we find through a thorough exploration and extension of techniques that a…
▽ More
Zero-shot cross-lingual information extraction (IE) describes the construction of an IE model for some target language, given existing annotations exclusively in some other language, typically English. While the advance of pretrained multilingual encoders suggests an easy optimism of "train on English, run on any language", we find through a thorough exploration and extension of techniques that a combination of approaches, both new and old, leads to better performance than any one cross-lingual strategy in particular. We explore techniques including data projection and self-training, and how different pretrained encoders impact them. We use English-to-Arabic IE as our initial example, demonstrating strong performance in this setting for event extraction, named entity recognition, part-of-speech tagging, and dependency parsing. We then apply data projection and self-training to three tasks across eight target languages. Because no single set of techniques performs the best across all tasks, we encourage practitioners to explore various configurations of the techniques described in this work when seeking to improve on zero-shot training.
△ Less
Submitted 14 September, 2021;
originally announced September 2021.
-
Gradual Fine-Tuning for Low-Resource Domain Adaptation
Authors:
Haoran Xu,
Seth Ebner,
Mahsa Yarmohammadi,
Aaron Steven White,
Benjamin Van Durme,
Kenton Murray
Abstract:
Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We demonstrate that gradually fine-tuning in a multi-stage process can yield substantial further gains and can be applied without modifying the model or learning object…
▽ More
Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We demonstrate that gradually fine-tuning in a multi-stage process can yield substantial further gains and can be applied without modifying the model or learning objective.
△ Less
Submitted 1 September, 2021; v1 submitted 3 March, 2021;
originally announced March 2021.
-
Strain Wave Pathway to Semiconductor-to-Metal Transition revealed by time resolved X-ray powder diffraction
Authors:
C. Mariette,
M. Lorenc,
H. Cailleau,
E. Collet,
L. Guérin,
A. Volte,
E. Trzop,
R. Bertoni,
X. Dong,
B. Lépine,
O Hernandez,
E. Janod,
L. Cario,
V. Ta Phuoc,
S. Ohkoshi,
H. Tokoro,
L. Patthey,
A. Babic,
I. Usov,
D. Ozerov,
L. Sala,
S. Ebner,
P. Böhler,
A Keller,
A. Oggenfuss
, et al. (20 additional authors not shown)
Abstract:
Thanks to the remarkable developments of ultrafast science, one of today's challenges is to modify material state by controlling with a light pulse the coherent motions that connect two different phases. Here we show how strain waves, launched by electronic and structural precursor phenomena, determine a macroscopic transformation pathway for the semiconducting-to-metal transition with large volum…
▽ More
Thanks to the remarkable developments of ultrafast science, one of today's challenges is to modify material state by controlling with a light pulse the coherent motions that connect two different phases. Here we show how strain waves, launched by electronic and structural precursor phenomena, determine a macroscopic transformation pathway for the semiconducting-to-metal transition with large volume change in bistable Ti$_3$O$_5$ nanocrystals. Femtosecond powder X-ray diffraction allowed us to quantify the structural deformations associated with the photoinduced phase transition on relevant time scales. We monitored the early intra-cell distortions around absorbing metal dimers, but also long range crystalline deformations dynamically governed by acoustic waves launched at the laser-exposed Ti$_3$O$_5$ surface. We rationalize these observations with a simplified elastic model, demonstrating that a macroscopic transformation occurs concomitantly with the propagating acoustic wavefront on the picosecond timescale, several decades earlier than the subsequent thermal processes governed by heat diffusion.
△ Less
Submitted 20 February, 2020; v1 submitted 19 February, 2020;
originally announced February 2020.
-
Reading the Manual: Event Extraction as Definition Comprehension
Authors:
Yunmo Chen,
Tongfei Chen,
Seth Ebner,
Aaron Steven White,
Benjamin Van Durme
Abstract:
We ask whether text understanding has progressed to where we may extract event information through incremental refinement of bleached statements derived from annotation manuals. Such a capability would allow for the trivial construction and extension of an extraction framework by intended end-users through declarations such as, "Some person was born in some location at some time." We introduce an…
▽ More
We ask whether text understanding has progressed to where we may extract event information through incremental refinement of bleached statements derived from annotation manuals. Such a capability would allow for the trivial construction and extension of an extraction framework by intended end-users through declarations such as, "Some person was born in some location at some time." We introduce an example of a model that employs such statements, with experiments illustrating we can extract events under closed ontologies and generalize to unseen event types simply by reading new definitions.
△ Less
Submitted 22 October, 2020; v1 submitted 3 December, 2019;
originally announced December 2019.
-
Multi-Sentence Argument Linking
Authors:
Seth Ebner,
Patrick Xia,
Ryan Culkin,
Kyle Rawlins,
Benjamin Van Durme
Abstract:
We present a novel document-level model for finding argument spans that fill an event's roles, connecting related ideas in sentence-level semantic role labeling and coreference resolution. Because existing datasets for cross-sentence linking are small, development of our neural model is supported through the creation of a new resource, Roles Across Multiple Sentences (RAMS), which contains 9,124 a…
▽ More
We present a novel document-level model for finding argument spans that fill an event's roles, connecting related ideas in sentence-level semantic role labeling and coreference resolution. Because existing datasets for cross-sentence linking are small, development of our neural model is supported through the creation of a new resource, Roles Across Multiple Sentences (RAMS), which contains 9,124 annotated events across 139 types. We demonstrate strong performance of our model on RAMS and other event-related datasets.
△ Less
Submitted 8 May, 2020; v1 submitted 9 November, 2019;
originally announced November 2019.
-
An Exact No Free Lunch Theorem for Community Detection
Authors:
Arya D. McCarthy,
Tongfei Chen,
Seth Ebner
Abstract:
A precondition for a No Free Lunch theorem is evaluation with a loss function which does not assume a priori superiority of some outputs over others. A previous result for community detection by Peel et al. (2017) relies on a mismatch between the loss function and the problem domain. The loss function computes an expectation over only a subset of the universe of possible outputs; thus, it is only…
▽ More
A precondition for a No Free Lunch theorem is evaluation with a loss function which does not assume a priori superiority of some outputs over others. A previous result for community detection by Peel et al. (2017) relies on a mismatch between the loss function and the problem domain. The loss function computes an expectation over only a subset of the universe of possible outputs; thus, it is only asymptotically appropriate with respect to the problem size. By using the correct random model for the problem domain, we provide a stronger, exact No Free Lunch theorem for community detection. The claim generalizes to other set-partitioning tasks including core/periphery separation, $k$-clustering, and graph partitioning. Finally, we review the literature of proposed evaluation functions and identify functions which (perhaps with slight modifications) are compatible with an exact No Free Lunch theorem.
△ Less
Submitted 24 March, 2019;
originally announced March 2019.
