-
From Modular to End-to-End Speaker Diarization
Authors:
Federico Landini
Abstract:
Speaker diarization is usually referred to as the task that determines ``who spoke when'' in a recording. Until a few years ago, all competitive approaches were modular. Systems based on this framework reached state-of-the-art performance in most scenarios but had major difficulties dealing with overlapped speech. More recently, the advent of end-to-end models, capable of dealing with all aspects…
▽ More
Speaker diarization is usually referred to as the task that determines ``who spoke when'' in a recording. Until a few years ago, all competitive approaches were modular. Systems based on this framework reached state-of-the-art performance in most scenarios but had major difficulties dealing with overlapped speech. More recently, the advent of end-to-end models, capable of dealing with all aspects of speaker diarization with a single model and better performing regarding overlapped speech, has brought high levels of attention.
This thesis is framed during a period of co-existence of these two trends. We describe a system based on a Bayesian hidden Markov model used to cluster x-vectors (speaker embeddings obtained with a neural network), known as VBx, which has shown remarkable performance on different datasets and challenges. We comment on its advantages and limitations and evaluate results on different relevant corpora. Then, we move towards end-to-end neural diarization (EEND) methods. Due to the need for large training sets for training these models and the lack of manually annotated diarization data in sufficient quantities, the compromise solution consists in generating training data artificially. We describe an approach for generating synthetic data which resembles real conversations in terms of speaker turns and overlaps. We show how this method generating ``simulated conversations'' allows for better performance than using a previously proposed method for creating ``simulated mixtures'' when training the popular EEND with encoder-decoder attractors (EEND-EDA). We also propose a new EEND-based model, which we call DiaPer, and show that it can perform better than EEND-EDA, especially when dealing with many speakers and handling overlapped speech. Finally, we compare both VBx-based and DiaPer systems on a wide variety of corpora and comment on the advantages of each technique.
△ Less
Submitted 27 June, 2024;
originally announced July 2024.
-
Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio
Authors:
Lin Zhang,
Xin Wang,
Erica Cooper,
Mireia Diez,
Federico Landini,
Nicholas Evans,
Junichi Yamagishi
Abstract:
This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a benchmark model, namely the Counte…
▽ More
This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a benchmark model, namely the Countermeasure-Condition Clustering (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diarization using three labeling schemes. We then utilize spoof localization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per audio file and an oracle number of spoofing methods are considered. Our code is available at https://github.com/nii-yamagishilab/PartialSpoof.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Do End-to-End Neural Diarization Attractors Need to Encode Speaker Characteristic Information?
Authors:
Lin Zhang,
Themos Stafylakis,
Federico Landini,
Mireia Diez,
Anna Silnova,
Lukáš Burget
Abstract:
In this paper, we apply the variational information bottleneck approach to end-to-end neural diarization with encoder-decoder attractors (EEND-EDA). This allows us to investigate what information is essential for the model. EEND-EDA utilizes attractors, vector representations of speakers in a conversation. Our analysis shows that, attractors do not necessarily have to contain speaker characteristi…
▽ More
In this paper, we apply the variational information bottleneck approach to end-to-end neural diarization with encoder-decoder attractors (EEND-EDA). This allows us to investigate what information is essential for the model. EEND-EDA utilizes attractors, vector representations of speakers in a conversation. Our analysis shows that, attractors do not necessarily have to contain speaker characteristic information. On the other hand, giving the attractors more freedom to allow them to encode some extra (possibly speaker-specific) information leads to small but consistent diarization performance improvements. Despite architectural differences in EEND systems, the notion of attractors and frame embeddings is common to most of them and not specific to EEND-EDA. We believe that the main conclusions of this work can apply to other variants of EEND. Thus, we hope this paper will be a valuable contribution to guide the community to make more informed decisions when designing new systems.
△ Less
Submitted 20 June, 2024; v1 submitted 29 February, 2024;
originally announced February 2024.
-
Study of solar brightness profiles in the 18-26 GHz frequency range with INAF radio telescopes II. Evidence for coronal emission
Authors:
M. Marongiu,
A. Pellizzoni,
S. Righini,
S. Mulas,
R. Nesti,
A. Burtovoi,
M. Romoli,
G. Serra,
G. Valente,
E. Egron,
G. Murtas,
M. N. Iacolina,
A. Melis,
S. L. Guglielmino,
S. Loru,
P. Zucca,
A. Zanichelli,
M. Bachetti,
A. Bemporad,
F. Buffa,
R. Concu,
G. L. Deiana,
C. Karakotia,
A. Ladu,
A. Maccaferri
, et al. (21 additional authors not shown)
Abstract:
One of the most important objectives of solar physics is the physical understanding of the solar atmosphere, the structure of which is also described in terms of the density (N) and temperature (T) distributions of the atmospheric matter. Several multi-frequency analyses show that the characteristics of these distributions are still debated, especially for the outer coronal emission.
We aim to c…
▽ More
One of the most important objectives of solar physics is the physical understanding of the solar atmosphere, the structure of which is also described in terms of the density (N) and temperature (T) distributions of the atmospheric matter. Several multi-frequency analyses show that the characteristics of these distributions are still debated, especially for the outer coronal emission.
We aim to constrain the T and N distributions of the solar atmosphere through observations in the centimetric radio domain. We employ single-dish observations from two of the INAF radio telescopes at the K-band frequencies (18 - 26 GHz). We investigate the origin of the significant brightness temperature ($T_B$) level that we detected up to the upper corona ($\sim 800$ Mm of altitude with respect to the photospheric solar surface).
To probe the physical origin of the atmospheric emission and to constrain instrumental biases, we reproduced the solar signal by convolving specific 2D antenna beam models. The analysis of the solar atmosphere is performed by adopting a physical model that assumes the thermal bremsstrahlung as the emission mechanism, with specific T and N distributions. The modelled $T_B$ profiles are compared with those observed by averaging solar maps obtained during the minimum of solar activity (2018 - 2020).
The T and N distributions are compatible (within $25\%$ of uncertainty) with the model up to $\sim 60$ Mm and $\sim 100$ Mm of altitude, respectively. The analysis of the role of the antenna beam pattern on our solar maps proves the physical nature of the atmospheric emission in our images up to the coronal tails seen in our $T_B$ profiles. The challenging analysis of the coronal radio emission at higher altitudes, together with the data from satellite instruments will require further multi-frequency measurements.
△ Less
Submitted 10 February, 2024;
originally announced February 2024.
-
DiaPer: End-to-End Neural Diarization with Perceiver-Based Attractors
Authors:
Federico Landini,
Mireia Diez,
Themos Stafylakis,
Lukáš Burget
Abstract:
Until recently, the field of speaker diarization was dominated by cascaded systems. Due to their limitations, mainly regarding overlapped speech and cumbersome pipelines, end-to-end models have gained great popularity lately. One of the most successful models is end-to-end neural diarization with encoder-decoder based attractors (EEND-EDA). In this work, we replace the EDA module with a Perceiver-…
▽ More
Until recently, the field of speaker diarization was dominated by cascaded systems. Due to their limitations, mainly regarding overlapped speech and cumbersome pipelines, end-to-end models have gained great popularity lately. One of the most successful models is end-to-end neural diarization with encoder-decoder based attractors (EEND-EDA). In this work, we replace the EDA module with a Perceiver-based one and show its advantages over EEND-EDA; namely obtaining better performance on the largely studied Callhome dataset, finding the quantity of speakers in a conversation more accurately, and faster inference time. Furthermore, when exhaustively compared with other methods, our model, DiaPer, reaches remarkable performance with a very lightweight design. Besides, we perform comparisons with other works and a cascaded baseline across more than ten public wide-band datasets. Together with this publication, we release the code of DiaPer as well as models trained on public and free data.
△ Less
Submitted 1 June, 2024; v1 submitted 7 December, 2023;
originally announced December 2023.
-
Eruptive events with exceptionally bright emission in HI Ly-alpha observed by the Metis coronagraph
Authors:
G. Russano,
V. Andretta,
Y. De Leo,
L. Teriaca,
M. Uslenghi,
S. Giordano,
D. Telloni,
P. Heinzel,
S. Jej či č,
L. Abbo,
A. Bemporad,
A. Burtovoi,
G. E. Capuano,
F. Frassati,
S. Guglielmino,
G. Jerse,
F. Landini,
A. Liberatore,
G. Nicolini,
M. Pancrazzi,
P. Romano,
C. Sasso,
R. Susino,
L. Zangrilli,
V. Da Deppo
, et al. (7 additional authors not shown)
Abstract:
Metis, the coronagraph on board Solar Orbiter, provides for the first time coronagraphic imaging in the ultraviolet HI Ly-alpha line and, simultaneously, in polarized visible light, thus providing a host of information on the properties of CMEs and solar eruptions like their overall dynamics, time evolution, mass content, and outflow propagation velocity in the expanding corona. We analyzed in thi…
▽ More
Metis, the coronagraph on board Solar Orbiter, provides for the first time coronagraphic imaging in the ultraviolet HI Ly-alpha line and, simultaneously, in polarized visible light, thus providing a host of information on the properties of CMEs and solar eruptions like their overall dynamics, time evolution, mass content, and outflow propagation velocity in the expanding corona. We analyzed in this work six CMEs observed by Metis between April and October 2021, which are characterized by a very strong HI Ly-alpha emission. We studied in particular the morphology, kinematics, and the temporal and radial evolution of the emission of such events, focusing on the brightest UV features. The kinematics of the eruptive events under consideration were studied by determining the height-time profiles of the brightest parts on the Metis plane of the sky. Furthermore, the 3D position in the heliosphere of the CMEs were determined by employing co-temporal images from two other coronagraphs: LASCO/C2 onboard SOHO, and COR2 onboard STEREO-A. Finally, the radiometrically calibrated Metis images of the bright UV features were analyzed to provide estimates of their volume and density. From the kinematics and radiometric analyses, we obtained indications of the temperatures of the bright UV cores of these events. The analysis of these strong UV-emitting features associated with coronal mass ejections demonstrates the capabilities of the current constellation of space coronagraphs, Metis, LASCO/C2, and COR2, in providing a complete characterization of the structure and dynamics of eruptive events in their propagation phase from their inception up to several solar radii. Furthermore, we show how the unique capabilities of the Metis instrument to observe these events in both HI Ly-alpha line and polarized VL radiation allow plasma diagnostics on the thermal state of these events.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Discriminative Training of VBx Diarization
Authors:
Dominik Klement,
Mireia Diez,
Federico Landini,
Lukáš Burget,
Anna Silnova,
Marc Delcroix,
Naohiro Tawara
Abstract:
Bayesian HMM clustering of x-vector sequences (VBx) has become a widely adopted diarization baseline model in publications and challenges. It uses an HMM to model speaker turns, a generatively trained probabilistic linear discriminant analysis (PLDA) for speaker distribution modeling, and Bayesian inference to estimate the assignment of x-vectors to speakers. This paper presents a new framework fo…
▽ More
Bayesian HMM clustering of x-vector sequences (VBx) has become a widely adopted diarization baseline model in publications and challenges. It uses an HMM to model speaker turns, a generatively trained probabilistic linear discriminant analysis (PLDA) for speaker distribution modeling, and Bayesian inference to estimate the assignment of x-vectors to speakers. This paper presents a new framework for updating the VBx parameters using discriminative training, which directly optimizes a predefined loss. We also propose a new loss that better correlates with the diarization error rate compared to binary cross-entropy $\unicode{x2013}$ the default choice for diarization end-to-end systems. Proof-of-concept results across three datasets (AMI, CALLHOME, and DIHARD II) demonstrate the method's capability of automatically finding hyperparameters, achieving comparable performance to those found by extensive grid search, which typically requires additional hyperparameter behavior knowledge. Moreover, we show that discriminative fine-tuning of PLDA can further improve the model's performance. We release the source code with this publication.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
DiaCorrect: Error Correction Back-end For Speaker Diarization
Authors:
Jiangyu Han,
Federico Landini,
Johan Rohdin,
Mireia Diez,
Lukas Burget,
Yuhang Cao,
Heng Lu,
Jan Cernocky
Abstract:
In this work, we propose an error correction framework, named DiaCorrect, to refine the output of a diarization system in a simple yet effective way. This method is inspired by error correction techniques in automatic speech recognition. Our model consists of two parallel convolutional encoders and a transform-based decoder. By exploiting the interactions between the input recording and the initia…
▽ More
In this work, we propose an error correction framework, named DiaCorrect, to refine the output of a diarization system in a simple yet effective way. This method is inspired by error correction techniques in automatic speech recognition. Our model consists of two parallel convolutional encoders and a transform-based decoder. By exploiting the interactions between the input recording and the initial system's outputs, DiaCorrect can automatically correct the initial speaker activities to minimize the diarization errors. Experiments on 2-speaker telephony data show that the proposed DiaCorrect can effectively improve the initial model's results. Our source code is publicly available at https://github.com/BUTSpeechFIT/diacorrect.
△ Less
Submitted 15 September, 2023;
originally announced September 2023.
-
Particle monitoring capability of the Solar Orbiter Metis coronagraph through the increasing phase of solar cycle 25
Authors:
Catia Grimani,
Vincenzo Andretta,
Ester Antonucci,
Paolo Chioetto,
Vania Da Deppo,
Michele Fabi,
Samuel Gissot,
Giovanna Jerse,
Mauro Messerotti,
Giampiero Naletto,
Maurizio Pancrazzi,
Andrea Persici,
Christina Plainaki,
Marco Romoli,
Federico Sabbatini,
Daniele Spadaro,
Marco Stangalini,
Daniele Telloni,
Luca Teriaca,
Michela Uslenghi,
Mattia Villani,
Lucia Abbo,
Aleksandr Burtovoi,
Federica Frassati,
Federico Landini
, et al. (4 additional authors not shown)
Abstract:
Context. Galactic cosmic rays (GCRs) and solar particles with energies greater than tens of MeV penetrate spacecraft and instruments hosted aboard space missions. The Solar Orbiter Metis coronagraph is aimed at observing the solar corona in both visible (VL) and ultraviolet (UV) light. Particle tracks are observed in the Metis images of the corona. An algorithm has been implemented in the Metis pr…
▽ More
Context. Galactic cosmic rays (GCRs) and solar particles with energies greater than tens of MeV penetrate spacecraft and instruments hosted aboard space missions. The Solar Orbiter Metis coronagraph is aimed at observing the solar corona in both visible (VL) and ultraviolet (UV) light. Particle tracks are observed in the Metis images of the corona. An algorithm has been implemented in the Metis processing electronics to detect the VL image pixels crossed by cosmic rays. This algorithm was initially enabled for the VL instrument only, since the process of separating the particle tracks in the UV images has proven to be very challenging.
Aims. We study the impact of the overall bulk of particles of galactic and solar origin on the Metis coronagraph images. We discuss the effects of the increasing solar activity after the Solar Orbiter mission launch on the secondary particle production in the spacecraft.
Methods. We compared Monte Carlo simulations of GCRs crossing or interacting in the Metis VL CMOS sensor to observations gathered in 2020 and 2022. We also evaluated the impact of solar energetic particle events of different intensities on the Metis images.
Results. The study of the role of abundant and rare cosmic rays in firing pixels in the Metis VL images of the corona allows us to estimate the efficiency of the algorithm applied for cosmic-ray track removal from the images and to demonstrate that the instrument performance had remained unchanged during the first two years of the Solar Orbiter operations. The outcome of this work can be used to estimate the Solar Orbiter instrument's deep charging and the order of magnitude for energetic particles crossing the images of Metis and other instruments such as STIX and EUI.
△ Less
Submitted 24 July, 2023; v1 submitted 21 July, 2023;
originally announced July 2023.
-
Coronal Heating Rate in the Slow Solar Wind
Authors:
Daniele Telloni,
Marco Romoli,
Marco Velli,
Gary P. Zank,
Laxman Adhikari,
Cooper Downs,
Aleksandr Burtovoi,
Roberto Susino,
Daniele Spadaro,
Lingling Zhao,
Alessandro Liberatore,
Chen Shi,
Yara De Leo,
Lucia Abbo,
Federica Frassati,
Giovanna Jerse,
Federico Landini,
Gianalfredo Nicolini,
Maurizio Pancrazzi,
Giuliana Russano,
Clementina Sasso,
Vincenzo Andretta,
Vania Da Deppo,
Silvano Fineschi,
Catia Grimani
, et al. (37 additional authors not shown)
Abstract:
This Letter reports the first observational estimate of the heating rate in the slowly expanding solar corona. The analysis exploits the simultaneous remote and local observations of the same coronal plasma volume with the Solar Orbiter/Metis and the Parker Solar Probe instruments, respectively, and relies on the basic solar wind magnetohydrodynamic equations. As expected, energy losses are a mino…
▽ More
This Letter reports the first observational estimate of the heating rate in the slowly expanding solar corona. The analysis exploits the simultaneous remote and local observations of the same coronal plasma volume with the Solar Orbiter/Metis and the Parker Solar Probe instruments, respectively, and relies on the basic solar wind magnetohydrodynamic equations. As expected, energy losses are a minor fraction of the solar wind energy flux, since most of the energy dissipation that feeds the heating and acceleration of the coronal flow occurs much closer to the Sun than the heights probed in the present study, which range from 6.3 to 13.3 solar radii. The energy deposited to the supersonic wind is then used to explain the observed slight residual wind acceleration and to maintain the plasma in a non-adiabatic state. As derived in the Wentzel-Kramers-Brillouin limit, the present energy transfer rate estimates provide a lower limit, which can be very useful in refining the turbulence-based modeling of coronal heating and subsequent solar wind acceleration.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
-
Multi-Stream Extension of Variational Bayesian HMM Clustering (MS-VBx) for Combined End-to-End and Vector Clustering-based Diarization
Authors:
Marc Delcroix,
Naohiro Tawara,
Mireia Diez,
Federico Landini,
Anna Silnova,
Atsunori Ogawa,
Tomohiro Nakatani,
Lukas Burget,
Shoko Araki
Abstract:
Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers within an audio chunk and uses VC to associate these activities with speaker identities across different chunks. EEND-VC generates thus multiple streams of embeddi…
▽ More
Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers within an audio chunk and uses VC to associate these activities with speaker identities across different chunks. EEND-VC generates thus multiple streams of embeddings, one for each speaker in a chunk. We can cluster these embeddings using constrained agglomerative hierarchical clustering (cAHC), ensuring embeddings from the same chunk belong to different clusters. This paper introduces an alternative clustering approach, a multi-stream extension of the successful Bayesian HMM clustering of x-vectors (VBx), called MS-VBx. Experiments on three datasets demonstrate that MS-VBx outperforms cAHC in diarization and speaker counting performance.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
Does Turbulence along the Coronal Current Sheet Drive Ion Cyclotron Waves?
Authors:
Daniele Telloni,
Gary P. Zank,
Laxman Adhikari,
Lingling Zhao,
Roberto Susino,
Ester Antonucci,
Silvano Fineschi,
Marco Stangalini,
Catia Grimani,
Luca Sorriso-Valvo,
Daniel Verscharen,
Raffaele Marino,
Silvio Giordano,
Raffaella D'Amicis,
Denise Perrone,
Francesco Carbone,
Alessandro Liberatore,
Roberto Bruno,
Gaetano Zimbardo,
Marco Romoli,
Vincenzo Andretta,
Vania Da Deppo,
Petr Heinzel,
John D. Moses,
Giampiero Naletto
, et al. (10 additional authors not shown)
Abstract:
Evidence for the presence of ion cyclotron waves, driven by turbulence, at the boundaries of the current sheet is reported in this paper. By exploiting the full potential of the joint observations performed by Parker Solar Probe and the Metis coronagraph on board Solar Orbiter, local measurements of the solar wind can be linked with the large-scale structures of the solar corona. The results sugge…
▽ More
Evidence for the presence of ion cyclotron waves, driven by turbulence, at the boundaries of the current sheet is reported in this paper. By exploiting the full potential of the joint observations performed by Parker Solar Probe and the Metis coronagraph on board Solar Orbiter, local measurements of the solar wind can be linked with the large-scale structures of the solar corona. The results suggest that the dynamics of the current sheet layers generates turbulence, which in turn creates a sufficiently strong temperature anisotropy to make the solar-wind plasma unstable to anisotropy-driven instabilities such as the Alfvén ion-cyclotron, mirror-mode, and firehose instabilities. The study of the polarization state of high-frequency magnetic fluctuations reveals that ion cyclotron waves are indeed present along the current sheet, thus linking the magnetic topology of the remotely imaged coronal source regions with the wave bursts observed in situ. The present results may allow improvement of state-of-the-art models based on the ion cyclotron mechanism, providing new insights into the processes involved in coronal heating.
△ Less
Submitted 21 February, 2023;
originally announced February 2023.
-
Slow wind belt in the quiet solar corona
Authors:
E. Antonucci,
C. Downs,
G. E. Capuano,
D. Spadaro,
R. Susino,
D. Telloni,
V. Andretta,
V. Da Deppo,
Y. De Leo,
S. Fineschi,
F. Frassetto,
F. Landini,
G. Naletto,
G. Nicolini,
M. Pancrazzi,
M. Romoli,
M. Stangalini,
L. Teriaca,
M. Uslenghi
Abstract:
The slow solar wind belt in the quiet corona, observed with the Metis coronagraph on board Solar Orbiter on May 15, 2020, during the activity minimum of the cycle 24, in a field of view extending from 3.8 $R_\odot$ to 7.0 $R_\odot$, is formed by a slow and dense wind stream running along the coronal current sheet, accelerating in the radial direction and reaching at 6.8 $R_\odot$ a speed within 15…
▽ More
The slow solar wind belt in the quiet corona, observed with the Metis coronagraph on board Solar Orbiter on May 15, 2020, during the activity minimum of the cycle 24, in a field of view extending from 3.8 $R_\odot$ to 7.0 $R_\odot$, is formed by a slow and dense wind stream running along the coronal current sheet, accelerating in the radial direction and reaching at 6.8 $R_\odot$ a speed within 150 km s$^{-1}$ and 190 km s$^{-1}$, depending on the assumptions on the velocity distribution of the neutral hydrogen atoms in the coronal plasma. The slow stream is separated by thin regions of high velocity shear from faster streams, almost symmetric relative to the current sheet, with peak velocity within 175 km s$^{-1}$ and 230 km s$^{-1}$ at the same coronal level. The density-velocity structure of the slow wind zone is discussed in terms of the expansion factor of the open magnetic field lines that is known to be related to the speed of the quasi-steady solar wind, and in relation to the presence of a web of quasi separatrix layers, S-web, the potential sites of reconnection that release coronal plasma into the wind. The parameters characterizing the coronal magnetic field lines are derived from 3D MHD model calculations. The S-web is found to coincide with the latitudinal region where the slow wind is observed in the outer corona and is surrounded by thin layers of open field lines expanding in a non-monotonic way.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
In-flight validation of Metis Visible-light Polarimeter Coronagraph on board Solar Orbiter
Authors:
A. Liberatore,
S. Fineschi,
M. Casti,
G. Capobianco,
L. Abbo,
V. Andretta,
V. Da Deppo,
M. Fabi,
F. Frassati,
G. Jerse,
F. Landini,
D. Moses,
G. Naletto,
G. Nicolini,
M. Pancrazzi,
M. Romoli,
G. Russano,
C. Sasso,
D. Spadaro,
M. Stangalini,
R. Susino,
D. Telloni,
L. Teriaca,
M. Uslenghi
Abstract:
Context. The Metis coronagraph is one of the remote-sensing instruments of the ESA/NASA Solar Orbiter mission. Metis is aimed at the study of the solar atmosphere and solar wind by simultaneously acquiring images of the solar corona at two different wavelengths; visible-light (VL) within a band ranging from 580 nm to 640 nm, and in the HI Ly-alpha 121.6 +/- 10 nm ultraviolet (UV) light. The visibl…
▽ More
Context. The Metis coronagraph is one of the remote-sensing instruments of the ESA/NASA Solar Orbiter mission. Metis is aimed at the study of the solar atmosphere and solar wind by simultaneously acquiring images of the solar corona at two different wavelengths; visible-light (VL) within a band ranging from 580 nm to 640 nm, and in the HI Ly-alpha 121.6 +/- 10 nm ultraviolet (UV) light. The visible-light channel includes a polarimeter with electro-optically modulating Liquid Crystal Variable Retarders (LCVRs) to measure the linearly polarized brightness of the K-corona to derive the electron density.
Aims. In this paper, we present the first in-flight validation results of the Metis polarimetric channel together with a comparison to the on-ground calibrations. It is the validation of the first use in deep space (with hard radiation environment) of an electro-optical device: a liquid crystal-based polarimeter.
Methods. We used the orientation of the K-corona's linear polarization vector during the spacecraft roll maneuvers for the in-flight calibration.
Results. The first in-flight validation of the Metis coronagraph on-board Solar Orbiter shows a good agreement with the on-ground measurements. It confirms the expected visible-light channel polarimetric performance. A final comparison between the first pB obtained by Metis with the polarized brightness (pB) obtained by the space-based coronagraph LASCO and the ground-based coronagraph KCor shows the consistency of the Metis calibrated results.
△ Less
Submitted 14 February, 2023;
originally announced February 2023.
-
Connecting Solar Orbiter remote-sensing observations and Parker Solar Probe in-situ measurements with a numerical MHD reconstruction of the Parker spiral
Authors:
Ruggero Biondo,
Alessandro Bemporad,
Paolo Pagano,
Daniele Telloni,
Fabio Reale,
Marco Romoli,
Vincenzo Andretta,
Ester Antonucci,
Vania Da Deppo,
Yara De Leo,
Silvano Fineschi,
Petr Heinzel,
Daniel Moses,
Giampiero Naletto,
Gianalfredo Nicolini,
Daniele Spadaro,
Marco Stangalini,
Luca Teriaca,
Federico Landini,
Clementina Sasso,
Roberto Susino,
Giovanna Jerse,
Michela Uslenghi,
Maurizio Pancrazzi
Abstract:
As a key feature, NASA's Parker Solar Probe (PSP) and ESA-NASA's Solar Orbiter (SO) missions cooperate to trace solar wind and transients from their sources on the Sun to the inner interplanetary space. The goal of this work is to accurately reconstruct the interplanetary Parker spiral and the connection between coronal features observed remotely by the Metis coronagraph on-board SO and those dete…
▽ More
As a key feature, NASA's Parker Solar Probe (PSP) and ESA-NASA's Solar Orbiter (SO) missions cooperate to trace solar wind and transients from their sources on the Sun to the inner interplanetary space. The goal of this work is to accurately reconstruct the interplanetary Parker spiral and the connection between coronal features observed remotely by the Metis coronagraph on-board SO and those detected in situ by PSP at the time of the first PSP-SO quadrature of January 2021. We use the Reverse In-situ and MHD Approach (RIMAP), a hybrid analytical-numerical method performing data-driven reconstructions of the Parker spiral. RIMAP solves the MHD equations on the equatorial plane with the PLUTO code, using the measurements collected by PSP between 0.1 and 0.2 AU as boundary conditions. Our reconstruction connects density and wind speed measurements provided by Metis (3-6 solar radii) to those acquired by PSP (21.5 solar radii) along a single streamline. The capability of our MHD model to connect the inner corona observed by Metis and the super Alfvénic wind measured by PSP, not only confirms the research pathways provided by multi-spacecraft observations, but also the validity and accuracy of RIMAP reconstructions as a possible test bench to verify models of transient phenomena propagating across the heliosphere, such as coronal mass ejections, solar energetic particles and solar wind switchbacks.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
Multi-Speaker and Wide-Band Simulated Conversations as Training Data for End-to-End Neural Diarization
Authors:
Federico Landini,
Mireia Diez,
Alicia Lozano-Diez,
Lukáš Burget
Abstract:
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them require (so far non-existing) large amounts of annotated data for training. The compromise solution consists in generating synthetic data and the recently proposed…
▽ More
End-to-end diarization presents an attractive alternative to standard cascaded diarization systems because a single system can handle all aspects of the task at once. Many flavors of end-to-end models have been proposed but all of them require (so far non-existing) large amounts of annotated data for training. The compromise solution consists in generating synthetic data and the recently proposed simulated conversations (SC) have shown remarkable improvements over the original simulated mixtures (SM). In this work, we create SC with multiple speakers per conversation and show that they allow for substantially better performance than SM, also reducing the dependence on a fine-tuning stage. We also create SC with wide-band public audio sources and present an analysis on several evaluation sets. Together with this publication, we release the recipes for generating such data and models trained on public sets as well as the implementation to efficiently handle multiple speakers per conversation and an auxiliary voice activity detection loss.
△ Less
Submitted 24 February, 2023; v1 submitted 12 November, 2022;
originally announced November 2022.
-
Observation of Magnetic Switchback in the Solar Corona
Authors:
Daniele Telloni,
Gary P. Zank,
Marco Stangalini,
Cooper Downs,
Haoming Liang,
Masaru Nakanotani,
Vincenzo Andretta,
Ester Antonucci,
Luca Sorriso-Valvo,
Laxman Adhikari,
Lingling Zhao,
Raffaele Marino,
Roberto Susino,
Catia Grimani,
Michele Fabi,
Raffaella D'Amicis,
Denise Perrone,
Roberto Bruno,
Francesco Carbone,
Salvatore Mancuso,
Marco Romoli,
Vania Da Deppo,
Silvano Fineschi,
Petr Heinzel,
John D. Moses
, et al. (27 additional authors not shown)
Abstract:
Switchbacks are sudden, large radial deflections of the solar wind magnetic field, widely revealed in interplanetary space by the Parker Solar Probe. The switchbacks' formation mechanism and sources are still unresolved, although candidate mechanisms include Alfvénic turbulence, shear-driven Kelvin-Helmholtz instabilities, interchange reconnection, and geometrical effects related to the Parker spi…
▽ More
Switchbacks are sudden, large radial deflections of the solar wind magnetic field, widely revealed in interplanetary space by the Parker Solar Probe. The switchbacks' formation mechanism and sources are still unresolved, although candidate mechanisms include Alfvénic turbulence, shear-driven Kelvin-Helmholtz instabilities, interchange reconnection, and geometrical effects related to the Parker spiral. This Letter presents observations from the Metis coronagraph onboard Solar Orbiter of a single large propagating S-shaped vortex, interpreted as first evidence of a switchback in the solar corona. It originated above an active region with the related loop system bounded by open-field regions to the East and West. Observations, modeling, and theory provide strong arguments in favor of the interchange reconnection origin of switchbacks. Metis measurements suggest that the initiation of the switchback may also be an indicator of the origin of slow solar wind.
△ Less
Submitted 9 June, 2022; v1 submitted 7 June, 2022;
originally announced June 2022.
-
From Simulated Mixtures to Simulated Conversations as Training Data for End-to-End Neural Diarization
Authors:
Federico Landini,
Alicia Lozano-Diez,
Mireia Diez,
Lukáš Burget
Abstract:
End-to-end neural diarization (EEND) is nowadays one of the most prominent research topics in speaker diarization. EEND presents an attractive alternative to standard cascaded diarization systems since a single system is trained at once to deal with the whole diarization problem. Several EEND variants and approaches are being proposed, however, all these models require large amounts of annotated d…
▽ More
End-to-end neural diarization (EEND) is nowadays one of the most prominent research topics in speaker diarization. EEND presents an attractive alternative to standard cascaded diarization systems since a single system is trained at once to deal with the whole diarization problem. Several EEND variants and approaches are being proposed, however, all these models require large amounts of annotated data for training but available annotated data are scarce. Thus, EEND works have used mostly simulated mixtures for training. However, simulated mixtures do not resemble real conversations in many aspects. In this work we present an alternative method for creating synthetic conversations that resemble real ones by using statistics about distributions of pauses and overlaps estimated on genuine conversations. Furthermore, we analyze the effect of the source of the statistics, different augmentations and amounts of data. We demonstrate that our approach performs substantially better than the original one, while reducing the dependence on the fine-tuning stage. Experiments are carried out on 2-speaker telephone conversations of Callhome and DIHARD 3. Together with this publication, we release our implementations of EEND and the method for creating simulated conversations.
△ Less
Submitted 25 June, 2022; v1 submitted 2 April, 2022;
originally announced April 2022.
-
A Coronal Mass Ejection followed by a prominence eruption and a plasma blob as observed by Solar Orbiter
Authors:
A. Bemporad,
V. Andretta,
R. Susino,
S. Mancuso,
D. Spadaro,
M. Mierla,
D. Berghmans,
E. D'Huys,
A. N. Zhukov,
D. -C. Talpeanu,
R. Colaninno,
P. Hess,
J. Koza,
S. Jejcic,
P. Heinzel,
E. Antonucci,
V. Da Deppo,
S. Fineschi,
F. Frassati,
G. Jerse,
F. Landini,
G. Naletto,
G. Nicolini,
M. Pancrazzi,
M. Romoli
, et al. (4 additional authors not shown)
Abstract:
On February 12, 2021 two subsequent eruptions occurred above the West limb, as seen along the Sun-Earth line. The first event was a typical slow Coronal Mass Ejection (CME), followed $\sim 7$ hours later by a smaller and collimated prominence eruption, originating Southward with respect to the CME, followed by a plasma blob. These events were observed not only by SOHO and STEREO-A missions, but al…
▽ More
On February 12, 2021 two subsequent eruptions occurred above the West limb, as seen along the Sun-Earth line. The first event was a typical slow Coronal Mass Ejection (CME), followed $\sim 7$ hours later by a smaller and collimated prominence eruption, originating Southward with respect to the CME, followed by a plasma blob. These events were observed not only by SOHO and STEREO-A missions, but also by the suite of remote sensing instruments on-board Solar Orbiter (SolO). This work shows how data acquired by the Full Sun Imager (FSI), Metis coronagraph, and Heliospheric Imager (SoloHI) from the SolO perspective can be combined to study the eruptions and the different source regions. Moreover, we show how Metis data can be analyzed to provide new information about solar eruptions.
Different 3D reconstruction methods were applied to the data acquired by different spacecraft including remote sensing instruments on-board SolO. Images acquired by both Metis channels in the Visible Light (VL) and H I Lyman$-α$ line (UV) were combined to derive physical information on the expanding plasma. The polarization ratio technique was also applied for the first time to the Metis images acquired in the VL channel. The two eruptions were followed in 3D from their source region to their expansion in the intermediate corona. Thanks to the combination of VL and UV Metis data, the formation of a post-CME Current Sheet (CS) was followed for the first time in the intermediate corona. The plasma temperature gradient across a post-CME blob propagating along the CS was also measured for the first time. Application of the polarization ratio technique to Metis data shows that, thanks to the combination of four different polarization measurements, the errors are reduced by $\sim 5-7$\%, thus better constraining the 3D distribution of plasma.
△ Less
Submitted 21 February, 2022;
originally announced February 2022.
-
Measuring the F-corona intensity through time correlation of total and polarized visible light images
Authors:
A. Burtovoi,
G. Naletto,
S. Dolei,
D. Spadaro,
M. Romoli,
F. Landini,
Y. De Leo
Abstract:
We present a new correlation method for deriving the F-corona intensity distribution, which is based on the analysis of the evolution of the total and polarized visible light (VL) images. We studied the one-month variation profiles of the total and polarized brightness acquired with Large Angle Spectrometric COronagraph (LASCO-C2) and found that in some regions they are highly correlated. Assuming…
▽ More
We present a new correlation method for deriving the F-corona intensity distribution, which is based on the analysis of the evolution of the total and polarized visible light (VL) images. We studied the one-month variation profiles of the total and polarized brightness acquired with Large Angle Spectrometric COronagraph (LASCO-C2) and found that in some regions they are highly correlated. Assuming that the F-corona does not vary significantly on a timescale of one month, we estimated its intensity in the high-correlation regions and reconstructed the corresponding intensity maps both during the solar-minimum and solar-maximum periods. Systematic uncertainties were estimated by performing dedicated simulations. We compared the resulting F-corona images with those determined using the inversion technique and found that the correlation method provides a smoother intensity distribution. We also obtained that the F-corona images calculated for consecutive months show no significant variation. Finally, we note that this method can be applied to the future high-cadence VL observations carried out with the Metis/Solar Orbiter coronagraph.
△ Less
Submitted 22 December, 2021;
originally announced December 2021.
-
Exploring the Solar Wind from its Source on the Corona into the Inner Heliosphere during the First Solar Orbiter - Parker Solar Probe Quadrature
Authors:
Daniele Telloni,
Vincenzo Andretta,
Ester Antonucci,
Alessandro Bemporad,
Giuseppe E. Capuano,
Silvano Fineschi,
Silvio Giordano,
Shadia Habbal,
Denise Perrone,
Rui F. Pinto,
Luca Sorriso-Valvo,
Daniele Spadaro,
Roberto Susino,
Lloyd D. Woodham,
Gary P. Zank,
Marco Romoli,
Stuart D. Bale,
Justin C. Kasper,
Frédéric Auchère,
Roberto Bruno,
Gerardo Capobianco,
Anthony W. Case,
Chiara Casini,
Marta Casti,
Paolo Chioetto
, et al. (46 additional authors not shown)
Abstract:
This Letter addresses the first Solar Orbiter (SO) -- Parker Solar Probe (PSP) quadrature, occurring on January 18, 2021, to investigate the evolution of solar wind from the extended corona to the inner heliosphere. Assuming ballistic propagation, the same plasma volume observed remotely in corona at altitudes between 3.5 and 6.3 solar radii above the solar limb with the Metis coronagraph on SO ca…
▽ More
This Letter addresses the first Solar Orbiter (SO) -- Parker Solar Probe (PSP) quadrature, occurring on January 18, 2021, to investigate the evolution of solar wind from the extended corona to the inner heliosphere. Assuming ballistic propagation, the same plasma volume observed remotely in corona at altitudes between 3.5 and 6.3 solar radii above the solar limb with the Metis coronagraph on SO can be tracked to PSP, orbiting at 0.1 au, thus allowing the local properties of the solar wind to be linked to the coronal source region from where it originated. Thanks to the close approach of PSP to the Sun and the simultaneous Metis observation of the solar corona, the flow-aligned magnetic field and the bulk kinetic energy flux density can be empirically inferred along the coronal current sheet with an unprecedented accuracy, allowing in particular estimation of the Alfvén radius at 8.7 solar radii during the time of this event. This is thus the very first study of the same solar wind plasma as it expands from the sub-Alfvénic solar corona to just above the Alfvén surface.
△ Less
Submitted 21 October, 2021;
originally announced October 2021.
-
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Authors:
Kristen Grauman,
Andrew Westbury,
Eugene Byrne,
Zachary Chavis,
Antonino Furnari,
Rohit Girdhar,
Jackson Hamburger,
Hao Jiang,
Miao Liu,
Xingyu Liu,
Miguel Martin,
Tushar Nagarajan,
Ilija Radosavovic,
Santhosh Kumar Ramakrishnan,
Fiona Ryan,
Jayant Sharma,
Michael Wray,
Mengmeng Xu,
Eric Zhongcong Xu,
Chen Zhao,
Siddhant Bansal,
Dhruv Batra,
Vincent Cartillier,
Sean Crane,
Tien Do
, et al. (60 additional authors not shown)
Abstract:
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera wearers from 74 worldwide locations and 9 different countries. The approach to collection is designed to uphold rigorous privacy and ethics standards with cons…
▽ More
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera wearers from 74 worldwide locations and 9 different countries. The approach to collection is designed to uphold rigorous privacy and ethics standards with consenting participants and robust de-identification procedures where relevant. Ego4D dramatically expands the volume of diverse egocentric video footage publicly available to the research community. Portions of the video are accompanied by audio, 3D meshes of the environment, eye gaze, stereo, and/or synchronized videos from multiple egocentric cameras at the same event. Furthermore, we present a host of new benchmark challenges centered around understanding the first-person visual experience in the past (querying an episodic memory), present (analyzing hand-object manipulation, audio-visual conversation, and social interactions), and future (forecasting activities). By publicly sharing this massive annotated dataset and benchmark suite, we aim to push the frontier of first-person perception. Project page: https://ego4d-data.org/
△ Less
Submitted 11 March, 2022; v1 submitted 13 October, 2021;
originally announced October 2021.
-
Effects of the chromospheric Lyα line profile shape on the determination of the solar wind HI outflow velocity using the Doppler dimming technique
Authors:
G. E. Capuano,
S. Dolei,
D. Spadaro,
S. L. Guglielmino,
P. Romano,
R. Ventura,
V. Andretta,
A. Bemporad,
C. Sasso,
R. Susino,
V. Da Deppo,
F. Frassetto,
S. M. Giordano,
F. Landini,
G. Nicolini,
M. Pancrazzi,
M. Romoli,
L. Zangrilli
Abstract:
The determination of solar wind outflow velocity is fundamental in order to probe the mechanisms of wind acceleration in the corona. We aim to study, via the Doppler dimming technique, the effects that the chromospheric Lyα line profile shape causes on the determination of the outflow speed of coronal HI atoms. The Doppler dimming technique takes into account the decrease of coronal Lyα radiation…
▽ More
The determination of solar wind outflow velocity is fundamental in order to probe the mechanisms of wind acceleration in the corona. We aim to study, via the Doppler dimming technique, the effects that the chromospheric Lyα line profile shape causes on the determination of the outflow speed of coronal HI atoms. The Doppler dimming technique takes into account the decrease of coronal Lyα radiation in regions where HI atoms flow out in the solar wind. Starting from UV observations (UVCS/SOHO) of the coronal Lyα line and simultaneous measurements of pB (LASCO/SOHO and Mk3/MLSO), we studied the effect of the pumping chromospheric Lyα line profile through measurements from SOHO/SUMER, UVSP/SMM and LPSP/OSO-8, taken from representative on-disk regions and as a function of time during the solar activity cycle. In particular, we considered the effect of four chromospheric line parameters: line width, depth of the central reversal, asymmetry and distance of the peaks. We find that the range of variability of these parameters is of about 50% for the width, 69% for the depth of the central reversal, 35% for the asymmetry, and 50% for the distance of the peaks. Then, we find that the variability of the pumping Lyα profile affects the estimates of the coronal HI velocity by about 9-12%. Therefore, this uncertainty is smaller than other physical quantities uncertainties, and a constant in time and unique shape of the Lyα profile over the solar disk can be adopted in order to estimate the solar wind outflow velocity.
△ Less
Submitted 12 August, 2021;
originally announced August 2021.
-
First light observations of the solar wind in the outer corona with the Metis coronagraph
Authors:
M. Romoli,
E. Antonucci,
V. Andretta,
G. E. Capuano,
V. Da Deppo,
Y. De Leo,
C. Downs,
S. Fineschi,
P. Heinzel,
F. Landini,
A. Liberatore,
G. Naletto,
G. Nicolini,
M. Pancrazzi,
C. Sasso,
D. Spadaro,
R. Susino,
D. Telloni,
L. Teriaca,
M. Uslenghi,
Y. M. Wang,
A. Bemporad,
G. Capobianco,
M. Casti,
M. Fabi
, et al. (43 additional authors not shown)
Abstract:
The investigation of the wind in the solar corona initiated with the observations of the resonantly scattered UV emission of the coronal plasma obtained with UVCS-SOHO, designed to measure the wind outflow speed by applying the Doppler dimming diagnostics. Metis on Solar Orbiter complements the UVCS spectroscopic observations, performed during solar activity cycle 23, by simultaneously imaging the…
▽ More
The investigation of the wind in the solar corona initiated with the observations of the resonantly scattered UV emission of the coronal plasma obtained with UVCS-SOHO, designed to measure the wind outflow speed by applying the Doppler dimming diagnostics. Metis on Solar Orbiter complements the UVCS spectroscopic observations, performed during solar activity cycle 23, by simultaneously imaging the polarized visible light and the HI Ly-alpha corona in order to obtain high-spatial and temporal resolution maps of the outward velocity of the continuously expanding solar atmosphere. The Metis observations, on May 15, 2020, provide the first HI Ly-alpha images of the extended corona and the first instantaneous map of the speed of the coronal plasma outflows during the minimum of solar activity and allow us to identify the layer where the slow wind flow is observed. The polarized visible light (580-640 nm), and the UV HI Ly-alpha (121.6 nm) coronal emissions, obtained with the two Metis channels, are combined in order to measure the dimming of the UV emission relative to a static corona. This effect is caused by the outward motion of the coronal plasma along the direction of incidence of the chromospheric photons on the coronal neutral hydrogen. The plasma outflow velocity is then derived as a function of the measured Doppler dimming. The static corona UV emission is simulated on the basis of the plasma electron density inferred from the polarized visible light. This study leads to the identification, in the velocity maps of the solar corona, of the high-density layer about +/-10 deg wide, centered on the extension of a quiet equatorial streamer present at the East limb where the slowest wind flows at about (160 +/- 18) km/s from 4 Rs to 6 Rs. Beyond the boundaries of the high-density layer, the wind velocity rapidly increases, marking the transition between slow and fast wind in the corona.
△ Less
Submitted 24 June, 2021;
originally announced June 2021.
-
Cosmic-ray flux predictions and observations for and with Metis on board Solar Orbiter
Authors:
C. Grimani,
V. Andretta,
P. Chioetto,
V. Da Deppo,
M. Fabi,
S. Gissot,
G. Naletto,
A. Persici,
C. Plainaki,
M. Romoli,
F. Sabbatini,
D. Spadaro,
M. Stangalini,
D. Telloni,
M. Uslenghi,
E. Antonucci,
A. Bemporad,
G. Capobianco,
G. Capuano,
M. Casti,
Y. De Leo,
S. Fineschi,
F. Frassati,
F. Frassetto,
P. Heinzel
, et al. (19 additional authors not shown)
Abstract:
The Metis coronagraph is one of the remote sensing instruments hosted on board the ESA/NASA Solar Orbiter mission. Metis is devoted to carry out the first simultaneous imaging of the solar corona in both visible light (VL) and ultraviolet (UV). High-energy particles penetrate spacecraft materials and may limit the performance of on-board instruments. A study of galactic cosmic-ray (GCR) tracks obs…
▽ More
The Metis coronagraph is one of the remote sensing instruments hosted on board the ESA/NASA Solar Orbiter mission. Metis is devoted to carry out the first simultaneous imaging of the solar corona in both visible light (VL) and ultraviolet (UV). High-energy particles penetrate spacecraft materials and may limit the performance of on-board instruments. A study of galactic cosmic-ray (GCR) tracks observed in the first VL images gathered by Metis during the commissioning phase for a total of 60 seconds of exposure time is presented here. A similar analysis is planned for the UV channel. A prediction of the GCR flux up to hundreds of GeV is made here for the first part of the Solar Orbiter mission to study the Metis coronagraph performance. GCR model predictions are compared to observations gathered on board Solar Orbiter by the EPD/HET experiment in the range 10 MeV-100 MeV in the summer 2020 and with previous measurements. Estimated cosmic-ray fluxes above 70 MeV n$^{-1}$ have been also parameterized and used for Monte Carlo simulations aiming at reproducing the cosmic-ray track observations in the Metis coronagraph VL images. The same parameterizations can also be used to study the performance of other detectors. By comparing observations of cosmic-ray tracks in the Metis VL images with FLUKA Monte Carlo simulations of cosmic-ray interactions in the VL detector, it is found that cosmic rays fire a fraction of the order of 10$^{-4}$ of the whole image pixel sample. Therefore, cosmic rays do not affect sensibly the quality of Metis VL images. It is also found that the overall efficiency for cosmic-ray identification in the Metis VL images is approximately equal to the contribution of Z$>$2 particles. As a result, the Metis coronagraph may play the role of a proton monitor for long-term GCR variations during the overall mission duration.
△ Less
Submitted 11 June, 2021; v1 submitted 28 April, 2021;
originally announced April 2021.
-
Progress on the Astrometric Gravitation Probe design
Authors:
Mario Gai,
Alberto Vecchiato,
Alberto Riva,
Mario Gilberto Lattanzi,
Federico Landini,
Beatrice Bucciarelli,
Deborah Busonero,
Mariateresa Crosta,
Shilong Liao,
Hao Luo,
Giovanni Mana,
Marco Pisani,
Zhaoxiang Qi,
Carlo Paolo Sasso,
Zhenghong Tang,
Yu Yong
Abstract:
The Astrometric Gravitation Probe mission is a modern version of the 1919 Dyson-Eddington-Davidson experiment, based on a space-borne telescope with a permanent built-in eclipse, provided by a coronagraphic system. The expected improvement on experimental bounds to General Relativity and competing gravitation theories is by at least two orders of magnitude. The measurement principle is reviewed, i…
▽ More
The Astrometric Gravitation Probe mission is a modern version of the 1919 Dyson-Eddington-Davidson experiment, based on a space-borne telescope with a permanent built-in eclipse, provided by a coronagraphic system. The expected improvement on experimental bounds to General Relativity and competing gravitation theories is by at least two orders of magnitude. The measurement principle is reviewed, in particular the principle of Fizeau-like combination of a set of individual inverted coronagraphs simultaneously feeding a common high resolution telescope. Also, the payload has a dual field of view property, in order to support simultaneous observations of stellar fields either very close, or far away, from the Sun, i.e. fields affected by either high or low light bending. We discuss a set of solutions introduced in the optical design to improve on technical feasibility and robustness of the optical performance against perturbations, in particular induced by manufacturing and alignment tolerances, and launch stresses.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
The ASTRA project: a doorway to future astrometry
Authors:
Mario Gai,
Zhaoxiang Qi,
Mario G. Lattanzi,
Beatrice Bucciarelli,
Deborah Busonero,
Mariateresa Crosta,
Federico Landini,
Shilong Liao,
Hao Luo,
Giovanni Mana,
Rene A. Méndez,
Marco Pisani,
Alberto Riva,
Claudia San Martin Luque,
Carlo P. Sasso,
Zhenghong Tang,
Alberto Vecchiato,
Yu Yong
Abstract:
Astrometric Science and Technology Roadmap for Astrophysics (ASTRA) is a bilateral cooperation between China and Italy with the goal of consolidating astrometric measurement concepts and technologies. In particular, the objectives include critical analysis of the Gaia methodology and performance, as well as principle demonstration experiments aimed at future innovative astrometric applications req…
▽ More
Astrometric Science and Technology Roadmap for Astrophysics (ASTRA) is a bilateral cooperation between China and Italy with the goal of consolidating astrometric measurement concepts and technologies. In particular, the objectives include critical analysis of the Gaia methodology and performance, as well as principle demonstration experiments aimed at future innovative astrometric applications requiring high precision over large angular separations (one to 180 degrees). Such measurement technologies will be the building blocks for future instrumentation focused on the "great questions" of modern cosmology, like General Relativity validity (including Dark Matter and Dark Energy behavior), formation and evolution of structure like proto-galaxies, and planetary systems formation in bio compatibles environments. We describe three principle demonstration tests designed to address some of the potential showstoppers for high astrometric precision experiments. The three tests are focused on the key concepts of multiple fields telescopes, astrometric metrology and very fine sub-pixel precision (goal: <1/2000 pixel) in white light.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
RAFTER: Ring Astrometric Field Telescope for Exo-planets and Relativity
Authors:
Alberto Riva,
Mario Gai,
Alberto Vecchiato,
Deborah Busonero,
Mario G. Lattanzi,
Federico Landini,
Zhaoxiang Qi,
Zhenghong Tang
Abstract:
High precision astrometry aims at source position determination to a very small fraction of the diffraction image size, in high SNR regime. One of the key limitations to such goal is the optical response variation of the telescope over a sizeable FOV, required to ensure bright reference objects to any selected target. The issue translates into severe calibration constraints, and/or the need for co…
▽ More
High precision astrometry aims at source position determination to a very small fraction of the diffraction image size, in high SNR regime. One of the key limitations to such goal is the optical response variation of the telescope over a sizeable FOV, required to ensure bright reference objects to any selected target. The issue translates into severe calibration constraints, and/or the need for complex telescope and focal plane metrology. We propose an innovative system approach derived from the established TMA telescope concept, extended to achieve high filling factor of an annular field of view around the optical axis of the telescope. The proposed design is a very compact, 1 m class telescope compatible with modern CCD and CMOS detectors (EFL = 15 m). We describe the concept implementation guidelines and the optical performance of the current optical design. The diffraction limited FOV exceeds 1.25 square degrees, and the detector occupies the best 0.25 square degree with 66 devices.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard tasks
Authors:
Federico Landini,
Ján Profant,
Mireia Diez,
Lukáš Burget
Abstract:
The recently proposed VBx diarization method uses a Bayesian hidden Markov model to find speaker clusters in a sequence of x-vectors. In this work we perform an extensive comparison of performance of the VBx diarization with other approaches in the literature and we show that VBx achieves superior performance on three of the most popular datasets for evaluating diarization: CALLHOME, AMI and DIHAR…
▽ More
The recently proposed VBx diarization method uses a Bayesian hidden Markov model to find speaker clusters in a sequence of x-vectors. In this work we perform an extensive comparison of performance of the VBx diarization with other approaches in the literature and we show that VBx achieves superior performance on three of the most popular datasets for evaluating diarization: CALLHOME, AMI and DIHARDII datasets. Further, we present for the first time the derivation and update formulae for the VBx model, focusing on the efficiency and simplicity of this model as compared to the previous and more complex BHMM model working on frame-by-frame standard Cepstral features. Together with this publication, we release the recipe for training the x-vector extractors used in our experiments on both wide and narrowband data, and the VBx recipes that attain state-of-the-art performance on all three datasets. Besides, we point out the lack of a standardized evaluation protocol for AMI dataset and we propose a new protocol for both Beamformed and Mix-Headset audios based on the official AMI partitions and transcriptions.
△ Less
Submitted 29 December, 2020;
originally announced December 2020.
-
Simulations of stray light from the surface scattering of the Solar Corona Imager primary mirror
Authors:
Jianchao Xue,
Marco Romoli,
Federico Landini,
Cristian Baccani,
Hui Li,
Yunqi Wang,
Bo Chen
Abstract:
The Solar Corona Imager is an internally occulted coronagraph on board the ASO-S mission, which has the advantage of imaging the inner corona in H I {Lyman-\textalpha} (Ly-alpha) and white-light (WL) wavebands. However, scattering of solar disk light by the primary mirror (M1) becomes the main source of stray light. To study the methods of stray light suppression, three scattering models are used…
▽ More
The Solar Corona Imager is an internally occulted coronagraph on board the ASO-S mission, which has the advantage of imaging the inner corona in H I {Lyman-\textalpha} (Ly-alpha) and white-light (WL) wavebands. However, scattering of solar disk light by the primary mirror (M1) becomes the main source of stray light. To study the methods of stray light suppression, three scattering models are used to model M1 scattering in Zemax OpticStudio. The ratio of coronal emission to predicted stray light decrease along field of view in both channels. The stray light in Ly-alpha channel is generally lower than coronal emission, but the stray light in WL channel tends to be one order of magnitude higher than coronal signal at 2.5 Rsun. Optimized parameter combinations that suppress the stray light to required level are obtained, which put some limitations on the M1 manufacture. Besides, K-correlation model is recommended to simulate surface scattering.
△ Less
Submitted 14 December, 2020;
originally announced December 2020.
-
Analysis of the BUT Diarization System for VoxConverse Challenge
Authors:
Federico Landini,
Ondřej Glembek,
Pavel Matějka,
Johan Rohdin,
Lukáš Burget,
Mireia Diez,
Anna Silnova
Abstract:
This paper describes the system developed by the BUT team for the fourth track of the VoxCeleb Speaker Recognition Challenge, focusing on diarization on the VoxConverse dataset. The system consists of signal pre-processing, voice activity detection, speaker embedding extraction, an initial agglomerative hierarchical clustering followed by diarization using a Bayesian hidden Markov model, a reclust…
▽ More
This paper describes the system developed by the BUT team for the fourth track of the VoxCeleb Speaker Recognition Challenge, focusing on diarization on the VoxConverse dataset. The system consists of signal pre-processing, voice activity detection, speaker embedding extraction, an initial agglomerative hierarchical clustering followed by diarization using a Bayesian hidden Markov model, a reclustering step based on per-speaker global embeddings and overlapped speech detection and handling. We provide comparisons for each of the steps and share the implementation of the most relevant modules of our system. Our system scored second in the challenge in terms of the primary metric (diarization error rate) and first according to the secondary metric (Jaccard error rate).
△ Less
Submitted 9 February, 2021; v1 submitted 22 October, 2020;
originally announced October 2020.
-
The Solar Orbiter Science Activity Plan: translating solar and heliospheric physics questions into action
Authors:
I. Zouganelis,
A. De Groof,
A. P. Walsh,
D. R. Williams,
D. Mueller,
O. C. St Cyr,
F. Auchere,
D. Berghmans,
A. Fludra,
T. S. Horbury,
R. A. Howard,
S. Krucker,
M. Maksimovic,
C. J. Owen,
J. Rodriiguez-Pacheco,
M. Romoli,
S. K. Solanki,
C. Watson,
L. Sanchez,
J. Lefort,
P. Osuna,
H. R. Gilbert,
T. Nieves-Chinchilla,
L. Abbo,
O. Alexandrova
, et al. (160 additional authors not shown)
Abstract:
Solar Orbiter is the first space mission observing the solar plasma both in situ and remotely, from a close distance, in and out of the ecliptic. The ultimate goal is to understand how the Sun produces and controls the heliosphere, filling the Solar System and driving the planetary environments. With six remote-sensing and four in-situ instrument suites, the coordination and planning of the operat…
▽ More
Solar Orbiter is the first space mission observing the solar plasma both in situ and remotely, from a close distance, in and out of the ecliptic. The ultimate goal is to understand how the Sun produces and controls the heliosphere, filling the Solar System and driving the planetary environments. With six remote-sensing and four in-situ instrument suites, the coordination and planning of the operations are essential to address the following four top-level science questions: (1) What drives the solar wind and where does the coronal magnetic field originate? (2) How do solar transients drive heliospheric variability? (3) How do solar eruptions produce energetic particle radiation that fills the heliosphere? (4) How does the solar dynamo work and drive connections between the Sun and the heliosphere? Maximising the mission's science return requires considering the characteristics of each orbit, including the relative position of the spacecraft to Earth (affecting downlink rates), trajectory events (such as gravitational assist manoeuvres), and the phase of the solar activity cycle. Furthermore, since each orbit's science telemetry will be downloaded over the course of the following orbit, science operations must be planned at mission level, rather than at the level of individual orbits. It is important to explore the way in which those science questions are translated into an actual plan of observations that fits into the mission, thus ensuring that no opportunities are missed. First, the overarching goals are broken down into specific, answerable questions along with the required observations and the so-called Science Activity Plan (SAP) is developed to achieve this. The SAP groups objectives that require similar observations into Solar Orbiter Observing Plans (SOOPs), resulting in a strategic, top-level view of the optimal opportunities for science observations during the mission lifetime.
△ Less
Submitted 22 September, 2020;
originally announced September 2020.
-
BUT System for the Second DIHARD Speech Diarization Challenge
Authors:
Federico Landini,
Shuai Wang,
Mireia Diez,
Lukáš Burget,
Pavel Matějka,
Kateřina Žmolíková,
Ladislav Mošner,
Anna Silnova,
Oldřich Plchot,
Ondřej Novotný,
Hossein Zeinali,
Johan Rohdin
Abstract:
This paper describes the winning systems developed by the BUT team for the four tracks of the Second DIHARD Speech Diarization Challenge. For tracks 1 and 2 the systems were mainly based on performing agglomerative hierarchical clustering (AHC) of x-vectors, followed by another x-vector clustering based on Bayes hidden Markov model and variational Bayes inference. We provide a comparison of the im…
▽ More
This paper describes the winning systems developed by the BUT team for the four tracks of the Second DIHARD Speech Diarization Challenge. For tracks 1 and 2 the systems were mainly based on performing agglomerative hierarchical clustering (AHC) of x-vectors, followed by another x-vector clustering based on Bayes hidden Markov model and variational Bayes inference. We provide a comparison of the improvement given by each step and share the implementation of the core of the system. For tracks 3 and 4 with recordings from the Fifth CHiME Challenge, we explored different approaches for doing multi-channel diarization and our best performance was obtained when applying AHC on the fusion of per channel probabilistic linear discriminant analysis scores.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
Metis: the Solar Orbiter visible light and ultraviolet coronal imager
Authors:
Ester Antonucci,
Marco Romoli,
Vincenzo Andretta,
Silvano Fineschi,
Petr Heinzel,
J. Daniel Moses,
Giampiero Naletto,
Gianalfredo Nicolini,
Daniele Spadaro,
Luca Teriaca,
Arkadiusz Berlicki,
Gerardo Capobianco,
Giuseppe Crescenzio,
Vania Da Deppo,
Mauro Focardi,
Fabio Frassetto,
Klaus Heerlein,
Federico Landini,
Enrico Magli,
Andrea Marco Malvezzi,
Giuseppe Massone,
Radek Melich,
Piergiorgio Nicolosi,
Giancarlo Noci,
Maurizio Pancrazzi
, et al. (78 additional authors not shown)
Abstract:
Metis is the first solar coronagraph designed for a space mission capable of performing simultaneous imaging of the off-limb solar corona in both visible and UV light. The observations obtained with Metis aboard the Solar Orbiter ESA-NASA observatory will enable us to diagnose, with unprecedented temporal coverage and spatial resolution, the structures and dynamics of the full corona from 1.7…
▽ More
Metis is the first solar coronagraph designed for a space mission capable of performing simultaneous imaging of the off-limb solar corona in both visible and UV light. The observations obtained with Metis aboard the Solar Orbiter ESA-NASA observatory will enable us to diagnose, with unprecedented temporal coverage and spatial resolution, the structures and dynamics of the full corona from 1.7 $R_\odot$ to about 9 $R_\odot$. Due to the uniqueness of the Solar Orbiter mission profile, Metis will be able to observe the solar corona from a close vantage point (down to 0.28 AU), achieving out-of-ecliptic views with the increase of the orbit inclination over time. Moreover, observations near perihelion, during the phase of lower rotational velocity of the solar surface relative to the spacecraft, will allow longer-term studies of the coronal features. Thanks to a novel occultation design and a combination of a UV interference coating of the mirrors and a spectral bandpass filter, Metis images the solar corona simultaneously in the visible light band, between 580 and 640 nm, and in the UV H I Lyman-α line at 121.6 nm. The coronal images in both the UV Lyman-α and polarised visible light are obtained at high spatial resolution with a spatial scale down to about 2000 km and 15000 km at perihelion, in the cases of the visible and UV light, respectively. A temporal resolution down to 1 second can be achieved when observing coronal fluctuations in visible light. The Metis measurements will allow for complete characterisation of the main physical parameters and dynamics of the electron and neutral hydrogen/proton plasma components of the corona in the region where the solar wind undergoes acceleration and where the onset and initial propagation of coronal mass ejections take place, thus significantly improving our understanding of the region connecting the Sun to the heliosphere.
△ Less
Submitted 14 November, 2019;
originally announced November 2019.
-
BUT System Description for DIHARD Speech Diarization Challenge 2019
Authors:
Federico Landini,
Shuai Wang,
Mireia Diez,
Lukáš Burget,
Pavel Matějka,
Kateřina Žmolíková,
Ladislav Mošner,
Oldřich Plchot,
Ondřej Novotný,
Hossein Zeinali,
Johan Rohdin
Abstract:
This paper describes the systems developed by the BUT team for the four tracks of the second DIHARD speech diarization challenge. For tracks 1 and 2 the systems were based on performing agglomerative hierarchical clustering (AHC) over x-vectors, followed by the Bayesian Hidden Markov Model (HMM) with eigenvoice priors applied at x-vector level followed by the same approach applied at frame level.…
▽ More
This paper describes the systems developed by the BUT team for the four tracks of the second DIHARD speech diarization challenge. For tracks 1 and 2 the systems were based on performing agglomerative hierarchical clustering (AHC) over x-vectors, followed by the Bayesian Hidden Markov Model (HMM) with eigenvoice priors applied at x-vector level followed by the same approach applied at frame level. For tracks 3 and 4, the systems were based on performing AHC using x-vectors extracted on all channels.
△ Less
Submitted 19 October, 2019;
originally announced October 2019.
-
Comparing extrapolations of the coronal magnetic field structure at 2.5 solar radii with multi-viewpoint coronagraphic observations
Authors:
C. Sasso,
R. F. Pinto,
V. Andretta,
R. A. Howard,
A. Vourlidas,
A. Bemporad,
S. Dolei,
D. Spadaro,
R. Susino,
E. Antonucci,
L. Abbo,
V. Da Deppo,
S. Fineschi,
F. Frassetto,
F. Landini,
G. Naletto,
G. Nicolini,
P. Nicolosi,
M. Pancrazzi,
M. Romoli,
D. Telloni,
R. Ventura
Abstract:
The magnetic field shapes the structure of the solar corona but we still know little about the interrelationships between the coronal magnetic field configurations and the resulting quasi-stationary structures observed in coronagraphic images (as streamers, plumes, coronal holes). One way to obtain information on the large-scale structure of the coronal magnetic field is to extrapolate it from pho…
▽ More
The magnetic field shapes the structure of the solar corona but we still know little about the interrelationships between the coronal magnetic field configurations and the resulting quasi-stationary structures observed in coronagraphic images (as streamers, plumes, coronal holes). One way to obtain information on the large-scale structure of the coronal magnetic field is to extrapolate it from photospheric data and compare the results with coronagraphic images. Our aim is to verify if this comparison can be a fast method to check systematically the reliability of the many methods available to reconstruct the coronal magnetic field. Coronal fields are usually extrapolated from photospheric measurements typically in a region close to the central meridian on the solar disk and then compared with coronagraphic images at the limbs, acquired at least 7 days before or after to account for solar rotation, implicitly assuming that no significant changes occurred in the corona during that period. In this work, we combine images from three coronagraphs (SOHO/LASCO-C2 and the two STEREO/SECCHI-COR1) observing the Sun from different viewing angles to build Carrington maps covering the entire corona to reduce the effect of temporal evolution to ~ 5 days. We then compare the position of the observed streamers in these Carrington maps with that of the neutral lines obtained from four different magnetic field extrapolations, to evaluate the performances of the latter in the solar corona. Our results show that the location of coronal streamers can provide important indications to discriminate between different magnetic field extrapolations.
△ Less
Submitted 22 May, 2019;
originally announced May 2019.
-
Morphology and density of post-CME current sheets
Authors:
B. Vršnak,
G. Poletto,
E. Vujić,
A. Vourlidas,
Y. -K. Ko,
J. C. Raymond,
A. Ciaravella,
T. Žic,
D. F. Webb,
A. Bemporad,
F. Landini,
G. Schettino,
C. Jacobs,
S. T. Suess
Abstract:
Eruption of a coronal mass ejection (CME) drags and "opens" the coronal magnetic field, presumably leading to the formation of a large-scale current sheet and the field relaxation by magnetic reconnection. We analyze physical characteristics of ray-like coronal features formed in the aftermath of CMEs, to check if the interpretation of this phenomenon in terms of reconnecting current sheet is co…
▽ More
Eruption of a coronal mass ejection (CME) drags and "opens" the coronal magnetic field, presumably leading to the formation of a large-scale current sheet and the field relaxation by magnetic reconnection. We analyze physical characteristics of ray-like coronal features formed in the aftermath of CMEs, to check if the interpretation of this phenomenon in terms of reconnecting current sheet is consistent with the observations. The study is focused on measurements of the ray width, density excess, and coronal velocity field as a function of the radial distance. The morphology of rays indicates that they occur as a consequence of Petschek-like reconnection in the large scale current sheet formed in the wake of CME. The hypothesis is supported by the flow pattern, often showing outflows along the ray, and sometimes also inflows into the ray. The inferred inflow velocities range from 3 to 30 km s$^{-1}$, consistent with the narrow opening-angle of rays, adding up to a few degrees. The density of rays is an order of magnitude larger than in the ambient corona. The density-excess measurements are compared with the results of the analytical model in which the Petschek-like reconnection geometry is applied to the vertical current sheet, taking into account the decrease of the external coronal density and magnetic field with height. The model results are consistent with the observations, revealing that the main cause of the density excess in rays is a transport of the dense plasma from lower to larger heights by the reconnection outflow.
△ Less
Submitted 23 February, 2009;
originally announced February 2009.