-
A lifted Bregman strategy for training unfolded proximal neural network Gaussian denoisers
Authors:
Xiaoyu Wang,
Martin Benning,
Audrey Repetti
Abstract:
Unfolded proximal neural networks (PNNs) form a family of methods that combines deep learning and proximal optimization approaches. They consist in designing a neural network for a specific task by unrolling a proximal algorithm for a fixed number of iterations, where linearities can be learned from prior training procedure. PNNs have shown to be more robust than traditional deep learning approach…
▽ More
Unfolded proximal neural networks (PNNs) form a family of methods that combines deep learning and proximal optimization approaches. They consist in designing a neural network for a specific task by unrolling a proximal algorithm for a fixed number of iterations, where linearities can be learned from prior training procedure. PNNs have shown to be more robust than traditional deep learning approaches while reaching at least as good performances, in particular in computational imaging. However, training PNNs still depends on the efficiency of available training algorithms. In this work, we propose a lifted training formulation based on Bregman distances for unfolded PNNs. Leveraging the deterministic mini-batch block-coordinate forward-backward method, we design a bespoke computational strategy beyond traditional back-propagation methods for solving the resulting learning problem efficiently. We assess the behaviour of the proposed training approach for PNNs through numerical simulations on image denoising, considering a denoising PNN whose structure is based on dual proximal-gradient iterations.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
Learning truly monotone operators with applications to nonlinear inverse problems
Authors:
Younes Belkouchi,
Jean-Christophe Pesquet,
Audrey Repetti,
Hugues Talbot
Abstract:
This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone inclusion problems, commonly encountered in image processing tasks. The Forward-Backward-Forward (FBF) algorithm is employed to address these problems, offering a solu…
▽ More
This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone inclusion problems, commonly encountered in image processing tasks. The Forward-Backward-Forward (FBF) algorithm is employed to address these problems, offering a solution even when the Lipschitz constant of the neural network is unknown. Notably, the FBF algorithm provides convergence guarantees under the condition that the learned operator is monotone. Building on plug-and-play methodologies, our objective is to apply these newly learned operators to solving non-linear inverse problems. To achieve this, we initially formulate the problem as a variational inclusion problem. Subsequently, we train a monotone neural network to approximate an operator that may not inherently be monotone. Leveraging the FBF algorithm, we then show simulation examples where the non-linear inverse problem is successfully solved.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
A multilevel framework for accelerating uSARA in radio-interferometric imaging
Authors:
Guillaume Lauga,
Audrey Repetti,
Elisa Riccietti,
Nelly Pustelnik,
Paulo Gonçalves,
Yves Wiaux
Abstract:
This paper presents a multilevel algorithm specifically designed for radio-interferometric imaging in astronomy. The proposed algorithm is used to solve the uSARA (unconstrained Sparsity Averaging Reweighting Analysis) formulation of this image restoration problem. Multilevel algorithms rely on a hierarchy of approximations of the objective function to accelerate its optimization. In contrast to t…
▽ More
This paper presents a multilevel algorithm specifically designed for radio-interferometric imaging in astronomy. The proposed algorithm is used to solve the uSARA (unconstrained Sparsity Averaging Reweighting Analysis) formulation of this image restoration problem. Multilevel algorithms rely on a hierarchy of approximations of the objective function to accelerate its optimization. In contrast to the usual multilevel approaches where this hierarchy is derived in the parameter space, here we construct the hierarchy of approximations in the observation space. The proposed approach is compared to a reweighted forward-backward procedure, which is the backbone iteration scheme for solving the uSARA problem.
△ Less
Submitted 20 March, 2024;
originally announced March 2024.
-
Unfolded proximal neural networks for robust image Gaussian denoising
Authors:
Hoang Trieu Vy Le,
Audrey Repetti,
Nelly Pustelnik
Abstract:
A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used, enabling to handle non-smooth functions and linear operators. Recently, these algorithms have been paired with deep learning strategies, to further improve the est…
▽ More
A common approach to solve inverse imaging problems relies on finding a maximum a posteriori (MAP) estimate of the original unknown image, by solving a minimization problem. In thiscontext, iterative proximal algorithms are widely used, enabling to handle non-smooth functions and linear operators. Recently, these algorithms have been paired with deep learning strategies, to further improve the estimate quality. In particular, proximal neural networks (PNNs) have been introduced, obtained by unrolling a proximal algorithm as for finding a MAP estimate, but over a fixed number of iterations, with learned linear operators and parameters. As PNNs are based on optimization theory, they are very flexible, and can be adapted to any image restoration task, as soon as a proximal algorithm can solve it. They further have much lighter architectures than traditional networks. In this article we propose a unified framework to build PNNs for the Gaussian denoising task, based on both the dual-FB and the primal-dual Chambolle-Pock algorithms. We further show that accelerated inertial versions of these algorithms enable skip connections in the associated NN layers. We propose different learning strategies for our PNN framework, and investigate their robustness (Lipschitz property) and denoising efficiency. Finally, we assess the robustness of our PNNs when plugged in a forward-backward algorithm for an image deblurring problem.
△ Less
Submitted 21 August, 2024; v1 submitted 6 August, 2023;
originally announced August 2023.
-
A new non-convex framework to improve asymptotical knowledge on generic stochastic gradient descent
Authors:
Jean-Baptiste Fest,
Audrey Repetti,
Emilie Chouzenoux
Abstract:
Stochastic gradient optimization methods are broadly used to minimize non-convex smooth objective functions, for instance when training deep neural networks. However, theoretical guarantees on the asymptotic behaviour of these methods remain scarce. Especially, ensuring almost-sure convergence of the iterates to a stationary point is quite challenging. In this work, we introduce a new Kurdyka-Loja…
▽ More
Stochastic gradient optimization methods are broadly used to minimize non-convex smooth objective functions, for instance when training deep neural networks. However, theoretical guarantees on the asymptotic behaviour of these methods remain scarce. Especially, ensuring almost-sure convergence of the iterates to a stationary point is quite challenging. In this work, we introduce a new Kurdyka-Lojasiewicz theoretical framework to analyze asymptotic behavior of stochastic gradient descent (SGD) schemes when minimizing non-convex smooth objectives. In particular, our framework provides new almost-sure convergence results, on iterates generated by any SGD method satisfying mild conditional descent conditions. We illustrate the proposed framework by means of several toy simulation examples. We illustrate the role of the considered theoretical assumptions, and investigate how SGD iterates are impacted whether these assumptions are either fully or partially satisfied.
△ Less
Submitted 13 July, 2023;
originally announced July 2023.
-
A primal-dual data-driven method for computational optical imaging with a photonic lantern
Authors:
Carlos Santos Garcia,
Mathilde Larchevêque,
Solal O'Sullivan,
Martin Van Waerebeke,
Robert R. Thomson,
Audrey Repetti,
Jean-Christophe Pesquet
Abstract:
Optical fibres aim to image in-vivo biological processes. In this context, high spatial resolution and stability to fibre movements are key to enable decision-making processes (e.g., for microendoscopy). Recently, a single-pixel imaging technique based on a multicore fibre photonic lantern has been designed, named computational optical imaging using a lantern (COIL). A proximal algorithm based on…
▽ More
Optical fibres aim to image in-vivo biological processes. In this context, high spatial resolution and stability to fibre movements are key to enable decision-making processes (e.g., for microendoscopy). Recently, a single-pixel imaging technique based on a multicore fibre photonic lantern has been designed, named computational optical imaging using a lantern (COIL). A proximal algorithm based on a sparsity prior, dubbed SARA-COIL, has been further proposed to solve the associated inverse problem, to enable image reconstructions for high resolution COIL microendoscopy. In this work, we develop a data-driven approach for COIL. We replace the sparsity prior in the proximal algorithm by a learned denoiser, leading to a plug-and-play (PnP) algorithm. The resulting PnP method, based on a proximal primal-dual algorithm, enables to solve the Morozov formulation of the inverse problem. We use recent results in learning theory to train a network with desirable Lipschitz properties, and we show that the resulting primal-dual PnP algorithm converges to a solution to a monotone inclusion problem. Our simulations highlight that the proposed data-driven approach improves the reconstruction quality over variational SARA-COIL method on both simulated and real data.
△ Less
Submitted 17 April, 2024; v1 submitted 20 June, 2023;
originally announced June 2023.
-
A Data-Driven Approach for Bayesian Uncertainty Quantification in Imaging
Authors:
Michael Tang,
Audrey Repetti
Abstract:
Uncertainty quantification in image restoration is a prominent challenge, mainly due to the high dimensionality of the encountered problems. Recently, a Bayesian uncertainty quantification by optimization (BUQO) has been proposed to formulate hypothesis testing as a minimization problem. The objective is to determine whether a structure appearing in a maximum a posteriori estimate is true or is a…
▽ More
Uncertainty quantification in image restoration is a prominent challenge, mainly due to the high dimensionality of the encountered problems. Recently, a Bayesian uncertainty quantification by optimization (BUQO) has been proposed to formulate hypothesis testing as a minimization problem. The objective is to determine whether a structure appearing in a maximum a posteriori estimate is true or is a reconstruction artifact due to the ill-posedness or ill-conditioness of the problem. In this context, the mathematical definition of having a ``fake structure" is crucial, and highly depends on the type of structure of interest. This definition can be interpreted as an inpainting of a neighborhood of the structure, but only simple techniques have been proposed in the literature so far, due to the complexity of the problem. In this work, we propose a data-driven method using a simple convolutional neural network to perform the inpainting task, leading to a novel plug-and-play BUQO algorithm. Compared to previous works, the proposed approach has the advantage that it can be used for a wide class of structures, without needing to adapt the inpainting operator to the area of interest. In addition, we show through simulations on magnetic resonance imaging, that compared to the original BUQO's hand-crafted inpainting procedure, the proposed approach provides greater qualitative output images. Python code will be made available for reproducibility upon acceptance of the article.
△ Less
Submitted 21 April, 2023;
originally announced April 2023.
-
A Kurdyka-Lojasiewicz property for stochastic optimization algorithms in a non-convex setting
Authors:
Emilie Chouzenoux,
Jean-Baptiste Fest,
Audrey Repetti
Abstract:
Stochastic differentiable approximation schemes are widely used for solving high dimensional problems. Most of existing methods satisfy some desirable properties, including conditional descent inequalities, and almost sure (a.s.) convergence guarantees on the objective function, or on the involved gradient. However, for non-convex objective functions, a.s. convergence of the iterates, i.e., the st…
▽ More
Stochastic differentiable approximation schemes are widely used for solving high dimensional problems. Most of existing methods satisfy some desirable properties, including conditional descent inequalities, and almost sure (a.s.) convergence guarantees on the objective function, or on the involved gradient. However, for non-convex objective functions, a.s. convergence of the iterates, i.e., the stochastic process, to a critical point is usually not guaranteed, and remains an important challenge. In this article, we develop a framework to bridge the gap between descent-type inequalities and a.s. convergence of the associated stochastic process. Leveraging a novel Kurdyka-Lojasiewicz property, we show convergence guarantees of stochastic processes under mild assumptions on the objective function. We also provide examples of stochastic algorithms benefiting from the proposed framework and derive a.s. convergence guarantees on the iterates.
△ Less
Submitted 23 March, 2023; v1 submitted 13 February, 2023;
originally announced February 2023.
-
Uncertainty Quantification in CT pulmonary angiography
Authors:
Adwaye M Rambojun,
Hend Komber,
Jennifer Rossdale,
Jay Suntharalingam,
Jonathan C L Rodrigues,
Matthias J Ehrhardt,
Audrey Repetti
Abstract:
Computed tomography (CT) imaging of the thorax is widely used for the detection and monitoring of pulmonary embolism (PE). However, CT images can contain artifacts due to the acquisition or the processes involved in image reconstruction. Radiologists often have to distinguish between such artifacts and actual PEs. Our main contribution comes in the form of a scalable hypothesis testing method for…
▽ More
Computed tomography (CT) imaging of the thorax is widely used for the detection and monitoring of pulmonary embolism (PE). However, CT images can contain artifacts due to the acquisition or the processes involved in image reconstruction. Radiologists often have to distinguish between such artifacts and actual PEs. Our main contribution comes in the form of a scalable hypothesis testing method for CT, to enable quantifying uncertainty of possible PEs. In particular, we introduce a Bayesian Framework to quantify the uncertainty of an observed compact structure that can be identified as a PE. We assess the ability of the method to operate under high noise environments and with insufficient data.
△ Less
Submitted 6 January, 2023;
originally announced January 2023.
-
A Variational Inequality Model for Learning Neural Networks
Authors:
Patrick L. Combettes,
Jean-Christophe Pesquet,
Audrey Repetti
Abstract:
Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent training procedure consists of minimizing highly non-convex objectives based on data sets of huge dimension. In this context, current methodologies are not guara…
▽ More
Neural networks have become ubiquitous tools for solving signal and image processing problems, and they often outperform standard approaches. Nevertheless, training neural networks is a challenging task in many applications. The prevalent training procedure consists of minimizing highly non-convex objectives based on data sets of huge dimension. In this context, current methodologies are not guaranteed to produce global solutions. We present an alternative approach which foregoes the optimization framework and adopts a variational inequality formalism. The associated algorithm guarantees convergence of the iterates to a true solution of the variational inequality and it possesses an efficient block-iterative structure. A numerical application is presented.
△ Less
Submitted 26 October, 2022;
originally announced October 2022.
-
A Distributed Block-Split Gibbs Sampler with Hypergraph Structure for High-Dimensional Inverse Problems
Authors:
Pierre-Antoine Thouvenin,
Audrey Repetti,
Pierre Chainais
Abstract:
Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods hardly scale to high dimensional problems, they have recently been paired with optimization techniques, such as proximal and splitting approaches, to address this…
▽ More
Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods hardly scale to high dimensional problems, they have recently been paired with optimization techniques, such as proximal and splitting approaches, to address this issue. Such approaches pave the way to distributed samplers, splitting computations to make inference more scalable and faster. We introduce a distributed Split Gibbs sampler (SGS) to efficiently solve such problems involving distributions with multiple smooth and non-smooth functions composed with linear operators. The proposed approach leverages a recent approximate augmentation technique reminiscent of primal-dual optimization methods. It is further combined with a block-coordinate approach to split the primal and dual variables into blocks, leading to a distributed block-coordinate SGS. The resulting algorithm exploits the hypergraph structure of the involved linear operators to efficiently distribute the variables over multiple workers under controlled communication costs. It accommodates several distributed architectures, such as the Single Program Multiple Data and client-server architectures. Experiments on a large image deblurring problem show the performance of the proposed approach to produce high quality estimates with credibility intervals in a small amount of time. Supplementary material to reproduce the experiments is available online.
△ Less
Submitted 26 November, 2023; v1 submitted 5 October, 2022;
originally announced October 2022.
-
Cygnus A jointly calibrated and imaged via non-convex optimisation from VLA data
Authors:
Arwa Dabbech,
Audrey Repetti,
Rick A. Perley,
Oleg M. Smirnov,
Yves Wiaux
Abstract:
Radio interferometric (RI) data are noisy under-sampled spatial Fourier components of the unknown radio sky affected by direction-dependent antenna gains. Failure to model these antenna gains accurately results in a radio sky estimate with limited fidelity and resolution. The RI inverse problem has been recently addressed via a joint calibration and imaging approach which consists in solving a non…
▽ More
Radio interferometric (RI) data are noisy under-sampled spatial Fourier components of the unknown radio sky affected by direction-dependent antenna gains. Failure to model these antenna gains accurately results in a radio sky estimate with limited fidelity and resolution. The RI inverse problem has been recently addressed via a joint calibration and imaging approach which consists in solving a non-convex minimisation task, involving suitable priors for the DDEs, namely temporal and spatial smoothness, and sparsity for the unknown radio map via an $\ell_1$-norm prior, in the context of realistic RI simulations. Building on these developments, we propose to promote sparsity of the radio map via a log-sum prior, enforcing sparsity more strongly than the $\ell_1$-norm. The resulting minimisation task is addressed via a sequence of non-convex minimisation tasks composed of re-weighted $\ell_1$ image priors, which are solved approximately. We demonstrate the efficiency of the approach on RI observations of the celebrated radio galaxy Cygnus~A obtained with the Karl G. Jansky Very Large Array at X, C, and S bands. More precisely, we showcase that the approach enhances data fidelity significantly while achieving high resolution high dynamic range radio maps, confirming the suitability of the priors considered for the unknown DDEs and radio image. As a clear qualitative indication of the high fidelity achieved by the data and the proposed approach, we report the detection of three background sources in the vicinity of Cyg~A, at S band.
△ Less
Submitted 12 May, 2021; v1 submitted 29 January, 2021;
originally announced February 2021.
-
A practical preconditioner for wide-field continuum imaging of radio interferometric data
Authors:
Hertzog L. Bester,
Audrey Repetti,
Simon Perkins,
Oleg M. Smirnov,
Jonathan S. Kenyon
Abstract:
The celebrated CLEAN algorithm has been the cornerstone of deconvolution algorithms in radio interferometry almost since its conception in the 1970s. For all its faults, CLEAN is remarkably fast, robust to calibration artefacts and in its ability to model point sources. We demonstrate how the same assumptions that afford CLEAN its speed can be used to accelerate more sophisticated deconvolution al…
▽ More
The celebrated CLEAN algorithm has been the cornerstone of deconvolution algorithms in radio interferometry almost since its conception in the 1970s. For all its faults, CLEAN is remarkably fast, robust to calibration artefacts and in its ability to model point sources. We demonstrate how the same assumptions that afford CLEAN its speed can be used to accelerate more sophisticated deconvolution algorithms.
△ Less
Submitted 20 January, 2021;
originally announced January 2021.
-
Learning Maximally Monotone Operators for Image Recovery
Authors:
Jean-Christophe Pesquet,
Audrey Repetti,
Matthieu Terris,
Yves Wiaux
Abstract:
We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by adding a regularization function to a data fit term, which is subsequently minimized by using iterative optimization algorithms. Recently, several works have prop…
▽ More
We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by adding a regularization function to a data fit term, which is subsequently minimized by using iterative optimization algorithms. Recently, several works have proposed to replace the operator related to the regularization by a more sophisticated denoiser. These approaches, known as plug-and-play (PnP) methods, have shown excellent performance. Although it has been noticed that, under some Lipschitz properties on the denoisers, the convergence of the resulting algorithm is guaranteed, little is known about characterizing the asymptotically delivered solution. In the current article, we propose to address this limitation. More specifically, instead of employing a functional regularization, we perform an operator regularization, where a maximally monotone operator (MMO) is learned in a supervised manner. This formulation is flexible as it allows the solution to be characterized through a broad range of variational inequalities, and it includes convex regularizations as special cases. From an algorithmic standpoint, the proposed approach consists in replacing the resolvent of the MMO by a neural network (NN). We present a universal approximation theorem proving that nonexpansive NNs are suitable models for the resolvent of a wide class of MMOs. The proposed approach thus provides a sound theoretical framework for analyzing the asymptotic behavior of first-order PnP algorithms. In addition, we propose a numerical strategy to train NNs corresponding to resolvents of MMOs. We apply our approach to image restoration problems and demonstrate its validity in terms of both convergence and quality.
△ Less
Submitted 21 April, 2021; v1 submitted 24 December, 2020;
originally announced December 2020.
-
The LOFAR Two Meter Sky Survey: Deep Fields, I -- Direction-dependent calibration and imaging
Authors:
C. Tasse,
T. Shimwell,
M. J. Hardcastle,
S. P. O'Sullivan,
R. van Weeren,
P. N. Best,
L. Bester,
B. Hugo,
O. Smirnov,
J. Sabater,
G. Calistro-Rivera,
F. de Gasperin,
L. K. Morabito,
H. Röttgering,
W. L. Williams,
M. Bonato,
M. Bondi,
A. Botteon,
M. Brüggen,
G. Brunetti,
K. T. Chyży,
M. A. Garrett,
G. Gürkan,
M. J. Jarvis,
R. Kondapally
, et al. (7 additional authors not shown)
Abstract:
The Low Frequency Array (LOFAR) is an ideal instrument to conduct deep extragalactic surveys. It has a large field of view and is sensitive to large scale and compact emission. It is, however, very challenging to synthesize thermal noise limited maps at full resolution, mainly because of the complexity of the low-frequency sky and the direction dependent effects (phased array beams and ionosphere)…
▽ More
The Low Frequency Array (LOFAR) is an ideal instrument to conduct deep extragalactic surveys. It has a large field of view and is sensitive to large scale and compact emission. It is, however, very challenging to synthesize thermal noise limited maps at full resolution, mainly because of the complexity of the low-frequency sky and the direction dependent effects (phased array beams and ionosphere). In this first paper of a series we present a new calibration and imaging pipeline that aims at producing high fidelity, high dynamic range images with LOFAR High Band Antenna data, while being computationally efficient and robust against the absorption of unmodeled radio emission. We apply this calibration and imaging strategy to synthesize deep images of the Bootes and LH fields at 150 MHz, totaling $\sim80$ and $\sim100$ hours of integration respectively and reaching unprecedented noise levels at these low frequencies of $\lesssim30$ and $\lesssim23$ $μ$Jy/beam in the inner $\sim3$ deg$^2$. This approach is also being used to reduce the LoTSS-wide data for the second data release.
△ Less
Submitted 19 November, 2020; v1 submitted 16 November, 2020;
originally announced November 2020.
-
Parallel faceted imaging in radio interferometry via proximal splitting (Faceted HyperSARA): I. Algorithm and simulations
Authors:
Pierre-Antoine Thouvenin,
Abdullah Abdulaziz,
Arwa Dabbech,
Audrey Repetti,
Yves Wiaux
Abstract:
Upcoming radio interferometers are aiming to image the sky at new levels of resolution and sensitivity, with wide-band image cubes reaching close to the Petabyte scale for SKA. Modern proximal optimization algorithms have shown a potential to significantly outperform CLEAN thanks to their ability to inject complex image models to regularize the inverse problem for image formation from visibility d…
▽ More
Upcoming radio interferometers are aiming to image the sky at new levels of resolution and sensitivity, with wide-band image cubes reaching close to the Petabyte scale for SKA. Modern proximal optimization algorithms have shown a potential to significantly outperform CLEAN thanks to their ability to inject complex image models to regularize the inverse problem for image formation from visibility data. They were also shown to be parallelizable over large data volumes thanks to a splitting functionality enabling the decomposition of the data into blocks, for parallel processing of block-specific data-fidelity terms involved in the objective function. Focusing on intensity imaging, the splitting functionality is further exploited in this work to decompose the image cube into spatio-spectral facets, and enable parallel processing of facet-specific regularization terms in the objective function, leading to the "Faceted HyperSARA" algorithm. Reliable heuristics enabling an automatic setting of the regularization parameters involved in the objective are also introduced, based on estimates of the noise level, transferred from the visibility domain to the domains where the regularization is applied. Simulation results based on a MATLAB implementation and involving synthetic image cubes and data close to Gigabyte size confirm that faceting can provide a major increase in parallelization capability when compared to the non-faceted approach (HyperSARA).
△ Less
Submitted 21 August, 2023; v1 submitted 16 March, 2020;
originally announced March 2020.
-
Variable Metric Forward-Backward Algorithm for Composite Minimization Problems
Authors:
Audrey Repetti,
Yves Wiaux
Abstract:
We present a forward-backward-based algorithm to minimize a sum of a differentiable function and a nonsmooth function, both being possibly nonconvex. The main contribution of this work is to consider the challenging case where the nonsmooth function corresponds to a sum of non-convex functions, resulting from composition between a strictly increasing, concave, differentiable function and a convex…
▽ More
We present a forward-backward-based algorithm to minimize a sum of a differentiable function and a nonsmooth function, both being possibly nonconvex. The main contribution of this work is to consider the challenging case where the nonsmooth function corresponds to a sum of non-convex functions, resulting from composition between a strictly increasing, concave, differentiable function and a convex nonsmooth function. The proposed variable metric Composite Function Forward-Backward algorithm (C2FB) circumvents the explicit, and often challenging, computation of the proximity operator of the composite functions through a majorize-minimize approach. Precisely, each composite function is majorized using a linear approximation of the differentiable function, which allows one to apply the proximity step only to the sum of the nonsmooth functions. We prove the convergence of the algorithm iterates to a critical point of the objective function leveraging the Kurdyka-Łojasiewicz inequality. The convergence is guaranteed even if the proximity operators are computed inexactly, considering relative errors. We show that the proposed approach is a generalization of reweighting methods, with convergence guarantees. In particular, applied to the log-sum function, our algorithm reduces to a generalized version of the celebrated reweighted $\ell_1$ method. Finally, we show through simulations on an image processing problem that the proposed C2FB algorithm necessitates less iterations to converge and leads to better critical points compared with traditional reweighting methods and classic forward-backward algorithms.
△ Less
Submitted 31 January, 2021; v1 submitted 26 July, 2019;
originally announced July 2019.
-
Polca SARA - Full polarization, direction-dependent calibration and sparse imaging for radio interferometry
Authors:
Jasleen Birdi,
Audrey Repetti,
Yves Wiaux
Abstract:
New generation of radio interferometers are envisaged to produce high quality, high dynamic range Stokes images of the observed sky from the corresponding under-sampled Fourier domain measurements. In practice, these measurements are contaminated by the instrumental and atmospheric effects that are well represented by Jones matrices, and are most often varying with observation direction and time.…
▽ More
New generation of radio interferometers are envisaged to produce high quality, high dynamic range Stokes images of the observed sky from the corresponding under-sampled Fourier domain measurements. In practice, these measurements are contaminated by the instrumental and atmospheric effects that are well represented by Jones matrices, and are most often varying with observation direction and time. These effects, usually unknown, act as a limiting factor in achieving the required imaging performance and thus, their calibration is crucial. To address this issue, we develop a global algorithm, named Polca SARA, aiming to perform full polarization, direction-dependent calibration and sparse imaging by employing a non-convex optimization technique. In contrast with the existing approaches, the proposed method offers global convergence guarantees and flexibility to incorporate sophisticated priors to regularize the imaging as well as the calibration problem. Thus, we adapt a polarimetric imaging specific method, enforcing the physical polarization constraint along with a sparsity prior for the sought images. We perform extensive simulation studies of the proposed algorithm. While indicating the superior performance of polarization constraint based imaging, the obtained results also highlight the importance of calibrating for direction-dependent effects as well as for off-diagonal terms (denoting polarization leakage) in the associated Jones matrices, without inclusion of which the imaging quality deteriorates.
△ Less
Submitted 1 April, 2019;
originally announced April 2019.
-
Compressive optical imaging with a photonic lantern
Authors:
Debaditya Choudhury,
Duncan K. McNicholl,
Audrey RepettI,
Itandehui Gris-Sánchez,
Tim A. Birks,
Yves Wiaux,
Robert R. Thomson
Abstract:
The thin and flexible nature of optical fibres often makes them the ideal technology to view biological processes in-vivo, but current microendoscopic approaches are limited in spatial resolution. Here, we demonstrate a new route to high resolution microendoscopy using a multicore fibre (MCF) with an adiabatic multimode-to-singlemode photonic lantern transition formed at the distal end by tapering…
▽ More
The thin and flexible nature of optical fibres often makes them the ideal technology to view biological processes in-vivo, but current microendoscopic approaches are limited in spatial resolution. Here, we demonstrate a new route to high resolution microendoscopy using a multicore fibre (MCF) with an adiabatic multimode-to-singlemode photonic lantern transition formed at the distal end by tapering. We show that distinct multimode patterns of light can be projected from the output of the lantern by individually exciting the single-mode MCF cores, and that these patterns are highly stable to fibre movement. This capability is then exploited to demonstrate a form of single-pixel imaging, where a single pixel detector is used to detect the fraction of light transmitted through the object for each multimode pattern. A custom compressive imaging algorithm we call SARA-COIL is used to reconstruct the object using only the pre-measured multimode patterns themselves and the detector signals.
△ Less
Submitted 1 March, 2019;
originally announced March 2019.
-
Computational time-of-flight diffuse optical tomography
Authors:
Ashley Lyons,
Francesco Tonolini,
Alessandro Boccolini,
Audrey Repetti,
Robert Henderson,
Yves Wiaux,
Daniele Faccio
Abstract:
Imaging through a strongly diffusive medium remains an outstanding challenge in particular in association with applications in biological and medical imaging. Here we propose a method based on a single-photon time-of-flight camera that allows, in combination with computational processing of the spatial and full temporal photon distribution data, to image an object embedded inside a strongly diffus…
▽ More
Imaging through a strongly diffusive medium remains an outstanding challenge in particular in association with applications in biological and medical imaging. Here we propose a method based on a single-photon time-of-flight camera that allows, in combination with computational processing of the spatial and full temporal photon distribution data, to image an object embedded inside a strongly diffusive medium over more than 80 transport mean free paths. The technique is contactless and requires one second acquisition times thus allowing Hz frame rate imaging. The imaging depth corresponds to several cm of human tissue and allows one to perform deep-body imaging, here demonstrated as a proof-of-principle.
△ Less
Submitted 13 February, 2020; v1 submitted 3 August, 2018;
originally announced August 2018.
-
Greedy Approximate Projection for Magnetic Resonance Fingerprinting with Partial Volumes
Authors:
Roberto Duarte,
Audrey Repetti,
Pedro A. Gómez,
Mike Davies,
Yves Wiaux
Abstract:
In quantitative Magnetic Resonance Imaging, traditional methods suffer from the so-called Partial Volume Effect (PVE) due to spatial resolution limitations. As a consequence of PVE, the parameters of the voxels containing more than one tissue are not correctly estimated. Magnetic Resonance Fingerprinting (MRF) is not an exception. The existing methods addressing PVE are neither scalable nor accura…
▽ More
In quantitative Magnetic Resonance Imaging, traditional methods suffer from the so-called Partial Volume Effect (PVE) due to spatial resolution limitations. As a consequence of PVE, the parameters of the voxels containing more than one tissue are not correctly estimated. Magnetic Resonance Fingerprinting (MRF) is not an exception. The existing methods addressing PVE are neither scalable nor accurate. We propose to formulate the recovery of multiple tissues per voxel as a nonconvex constrained least-squares minimisation problem. To solve this problem, we develop a memory efficient, greedy approximate projected gradient descent algorithm, dubbed GAP-MRF. Our method adaptively finds the regions of interest on the manifold of fingerprints defined by the MRF sequence. We generalise our method to compensate for phase errors appearing in the model, using an alternating minimisation approach. We show, through simulations on synthetic data with PVE, that our algorithm outperforms state-of-the-art methods. Our approach is validated on the EUROSPIN phantom and on in vivo datasets.
△ Less
Submitted 28 November, 2018; v1 submitted 18 July, 2018;
originally announced July 2018.
-
Scalable Bayesian uncertainty quantification in imaging inverse problems via convex optimization
Authors:
Audrey Repetti,
Marcelo Pereyra,
Yves Wiaux
Abstract:
We propose a Bayesian uncertainty quantification method for large-scale imaging inverse problems. Our method applies to all Bayesian models that are log-concave, where maximum-a-posteriori (MAP) estimation is a convex optimization problem. The method is a framework to analyse the confidence in specific structures observed in MAP estimates (e.g., lesions in medical imaging, celestial sources in ast…
▽ More
We propose a Bayesian uncertainty quantification method for large-scale imaging inverse problems. Our method applies to all Bayesian models that are log-concave, where maximum-a-posteriori (MAP) estimation is a convex optimization problem. The method is a framework to analyse the confidence in specific structures observed in MAP estimates (e.g., lesions in medical imaging, celestial sources in astronomical imaging), to enable using them as evidence to inform decisions and conclusions. Precisely, following Bayesian decision theory, we seek to assert the structures under scrutiny by performing a Bayesian hypothesis test that proceeds as follows: firstly, it postulates that the structures are not present in the true image, and then seeks to use the data and prior knowledge to reject this null hypothesis with high probability. Computing such tests for imaging problems is generally very difficult because of the high dimensionality involved. A main feature of this work is to leverage probability concentration phenomena and the underlying convex geometry to formulate the Bayesian hypothesis test as a convex problem, that we then efficiently solve by using scalable optimization algorithms. This allows scaling to high-resolution and high-sensitivity imaging problems that are computationally unaffordable for other Bayesian computation approaches. We illustrate our methodology, dubbed BUQO (Bayesian Uncertainty Quantification by Optimization), on a range of challenging Fourier imaging problems arising in astronomy and medicine.
△ Less
Submitted 6 November, 2018; v1 submitted 2 March, 2018;
originally announced March 2018.
-
Fast Fiber Orientation Estimation in Diffusion MRI from kq-Space Sampling and Anatomical Priors
Authors:
Marica Pesce,
Audrey Repetti,
Anna Auría,
Alessandro Daducci,
Jean-Philippe Thiran,
Yves Wiaux
Abstract:
High spatio-angular resolution diffusion MRI (dMRI) has been shown to provide accurate identification of complex neuronal fiber configurations, albeit, at the cost of long acquisition times. We propose a method to recover intra-voxel fiber configurations at high spatio-angular resolution relying on a 3D kq-space under-sampling scheme to enable accelerated acquisitions. Simulations and real data an…
▽ More
High spatio-angular resolution diffusion MRI (dMRI) has been shown to provide accurate identification of complex neuronal fiber configurations, albeit, at the cost of long acquisition times. We propose a method to recover intra-voxel fiber configurations at high spatio-angular resolution relying on a 3D kq-space under-sampling scheme to enable accelerated acquisitions. Simulations and real data analysis suggest that accurate FOD mapping can be achieved from severe kq-space under-sampling regimes potentially enabling high spatio-angular resolution dMRI in the clinical setting.
△ Less
Submitted 5 December, 2021; v1 submitted 8 February, 2018;
originally announced February 2018.
-
Sparse interferometric Stokes imaging under polarization constraint (Polarized SARA)
Authors:
Jasleen Birdi,
Audrey Repetti,
Yves Wiaux
Abstract:
We develop a novel algorithm for sparse Stokes parameters imaging in radio interferometry under the polarization constraint. The latter is a physical non-linear relation between the Stokes parameters, imposing that the polarization intensity is a lower bound on the total intensity. To solve the joint inverse Stokes imaging problem including this bound, we leverage epigraphical projection technique…
▽ More
We develop a novel algorithm for sparse Stokes parameters imaging in radio interferometry under the polarization constraint. The latter is a physical non-linear relation between the Stokes parameters, imposing that the polarization intensity is a lower bound on the total intensity. To solve the joint inverse Stokes imaging problem including this bound, we leverage epigraphical projection techniques in convex optimization and design a primal-dual method offering a highly flexible and parallelizable structure. In addition, we propose to regularize each Stokes parameter map through an average sparsity prior in the context of a reweighted analysis approach (SARA). The resulting approach is dubbed Polarized SARA. We demonstrate on simulated observations of M87 with the Event Horizon Telescope that imposing the polarization constraint leads to superior image quality. The results also confirm that the performance of the average sparsity prior surpasses the alternative state-of-the-art priors for polarimetric imaging.
△ Less
Submitted 8 January, 2018;
originally announced January 2018.
-
Non-convex optimization for self-calibration of direction-dependent effects in radio interferometric imaging
Authors:
Audrey Repetti,
Jasleen Birdi,
Arwa Dabbech,
Yves Wiaux
Abstract:
Radio interferometric imaging aims to estimate an unknown sky intensity image from degraded observations, acquired through an antenna array. In the theoretical case of a perfectly calibrated array, it has been shown that solving the corresponding imaging problem by iterative algorithms based on convex optimization and compressive sensing theory can be competitive with classical algorithms such as…
▽ More
Radio interferometric imaging aims to estimate an unknown sky intensity image from degraded observations, acquired through an antenna array. In the theoretical case of a perfectly calibrated array, it has been shown that solving the corresponding imaging problem by iterative algorithms based on convex optimization and compressive sensing theory can be competitive with classical algorithms such as CLEAN. However, in practice, antenna-based gains are unknown and have to be calibrated. Future radio telescopes, such as the SKA, aim at improving imaging resolution and sensitivity by orders of magnitude. At this precision level, the direction-dependency of the gains must be accounted for, and radio interferometric imaging can be understood as a blind deconvolution problem. In this context, the underlying minimization problem is non-convex, and adapted techniques have to be designed. In this work, leveraging recent developments in non-convex optimization, we propose the first joint calibration and imaging method in radio interferometry, with proven convergence guarantees. Our approach, based on a block-coordinate forward-backward algorithm, jointly accounts for visibilities and suitable priors on both the image and the direction-dependent effects (DDEs). As demonstrated in recent works, sparsity remains the prior of choice for the image, while DDEs are modelled as smooth functions of the sky, i.e. spatially band-limited. Finally, we show through simulations the efficiency of our method, for the reconstruction of both images of point sources and complex extended sources. MATLAB code is available on GitHub.
△ Less
Submitted 24 July, 2017; v1 submitted 13 January, 2017;
originally announced January 2017.
-
A regularized tri-linear approach for optical interferometric imaging
Authors:
Jasleen Birdi,
Audrey Repetti,
Yves Wiaux
Abstract:
In the context of optical interferometry, only undersampled power spectrum and bispectrum data are accessible. It poses an ill-posed inverse problem for image recovery. Recently, a tri-linear model was proposed for monochromatic imaging, leading to an alternated minimization problem. In that work, only a positivity constraint was considered, and the problem was solved by an approximated Gauss-Seid…
▽ More
In the context of optical interferometry, only undersampled power spectrum and bispectrum data are accessible. It poses an ill-posed inverse problem for image recovery. Recently, a tri-linear model was proposed for monochromatic imaging, leading to an alternated minimization problem. In that work, only a positivity constraint was considered, and the problem was solved by an approximated Gauss-Seidel method. In this paper, we propose to improve the approach on three fundamental aspects. Firstly, we define the estimated image as a solution of a regularized minimization problem, promoting sparsity in a fixed dictionary using either an $\ell_1$ or a weighted-$\ell_1$ regularization term. Secondly, we solve the resultant non-convex minimization problem using a block-coordinate forward-backward algorithm. This algorithm is able to deal both with smooth and non-smooth functions, and benefits from convergence guarantees even in a non-convex context. Finally, we generalize our model and algorithm to the hyperspectral case, promoting a joint sparsity prior through an $\ell_{2,1}$ regularization term. We present simulation results, both for monochromatic and hyperspectral cases, to validate the proposed approach.
△ Less
Submitted 10 July, 2017; v1 submitted 2 September, 2016;
originally announced September 2016.
-
Scalable splitting algorithms for big-data interferometric imaging in the SKA era
Authors:
Alexandru Onose,
Rafael E. Carrillo,
Audrey Repetti,
Jason D. McEwen,
Jean-Philippe Thiran,
Jean-Christophe Pesquet,
Yves Wiaux
Abstract:
In the context of next generation radio telescopes, like the Square Kilometre Array, the efficient processing of large-scale datasets is extremely important. Convex optimisation tasks under the compressive sensing framework have recently emerged and provide both enhanced image reconstruction quality and scalability to increasingly larger data sets. We focus herein mainly on scalability and propose…
▽ More
In the context of next generation radio telescopes, like the Square Kilometre Array, the efficient processing of large-scale datasets is extremely important. Convex optimisation tasks under the compressive sensing framework have recently emerged and provide both enhanced image reconstruction quality and scalability to increasingly larger data sets. We focus herein mainly on scalability and propose two new convex optimisation algorithmic structures able to solve the convex optimisation tasks arising in radio-interferometric imaging. They rely on proximal splitting and forward-backward iterations and can be seen, by analogy with the CLEAN major-minor cycle, as running sophisticated CLEAN-like iterations in parallel in multiple data, prior, and image spaces. Both methods support any convex regularisation function, in particular the well studied l1 priors promoting image sparsity in an adequate domain. Tailored for big-data, they employ parallel and distributed computations to achieve scalability, in terms of memory and computational requirements. One of them also exploits randomisation, over data blocks at each iteration, offering further flexibility. We present simulation results showing the feasibility of the proposed methods as well as their advantages compared to state-of-the-art algorithmic solvers. Our Matlab code is available online on GitHub.
△ Less
Submitted 9 August, 2016; v1 submitted 15 January, 2016;
originally announced January 2016.
-
Euclid in a Taxicab: Sparse Blind Deconvolution with Smoothed l1/l2 Regularization
Authors:
Audrey Repetti,
Mai Quyen Pham,
Laurent Duval,
Emilie Chouzenoux,
Jean-Christophe Pesquet
Abstract:
The l1/l2 ratio regularization function has shown good performance for retrieving sparse signals in a number of recent works, in the context of blind deconvolution. Indeed, it benefits from a scale invariance property much desirable in the blind context. However, the l1/l2 function raises some difficulties when solving the nonconvex and nonsmooth minimization problems resulting from the use of suc…
▽ More
The l1/l2 ratio regularization function has shown good performance for retrieving sparse signals in a number of recent works, in the context of blind deconvolution. Indeed, it benefits from a scale invariance property much desirable in the blind context. However, the l1/l2 function raises some difficulties when solving the nonconvex and nonsmooth minimization problems resulting from the use of such a penalty term in current restoration methods. In this paper, we propose a new penalty based on a smooth approximation to the l1/l2 function. In addition, we develop a proximal-based algorithm to solve variational problems involving this function and we derive theoretical convergence results. We demonstrate the effectiveness of our method through a comparison with a recent alternating optimization strategy dealing with the exact l1/l2 term, on an application to seismic data blind deconvolution.
△ Less
Submitted 8 November, 2014; v1 submitted 21 July, 2014;
originally announced July 2014.
-
A Class of Randomized Primal-Dual Algorithms for Distributed Optimization
Authors:
Jean-Christophe Pesquet,
Audrey Repetti
Abstract:
Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide array of monotone inclusion problems. These methods rely on a sweep of blocks of variables which are activated at each iteration according to a random rule, an…
▽ More
Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide array of monotone inclusion problems. These methods rely on a sweep of blocks of variables which are activated at each iteration according to a random rule, and they allow stochastic errors in the evaluation of the involved operators. Then, this framework is employed to derive block-coordinate primal-dual proximal algorithms for solving composite convex variational problems. The resulting algorithm implementations may be useful for reducing computational complexity and memory requirements. Furthermore, we show that the proposed approach can be used to develop novel asynchronous distributed primal-dual algorithms in a multi-agent context.
△ Less
Submitted 25 October, 2014; v1 submitted 24 June, 2014;
originally announced June 2014.
