-
DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Dataset
Authors:
Jiawei Du,
I-Ming Lin,
I-Hsiang Chiu,
Xuanjun Chen,
Haibin Wu,
Wenze Ren,
Yu Tsao,
Hung-yi Lee,
Jyh-Shing Roger Jang
Abstract:
Mainstream zero-shot TTS production systems like Voicebox and Seed-TTS achieve human parity speech by leveraging Flow-matching and Diffusion models, respectively. Unfortunately, human-level audio synthesis leads to identity misuse and information security issues. Currently, many antispoofing models have been developed against deepfake audio. However, the efficacy of current state-of-the-art anti-s…
▽ More
Mainstream zero-shot TTS production systems like Voicebox and Seed-TTS achieve human parity speech by leveraging Flow-matching and Diffusion models, respectively. Unfortunately, human-level audio synthesis leads to identity misuse and information security issues. Currently, many antispoofing models have been developed against deepfake audio. However, the efficacy of current state-of-the-art anti-spoofing models in countering audio synthesized by diffusion and flowmatching based TTS systems remains unknown. In this paper, we proposed the Diffusion and Flow-matching based Audio Deepfake (DFADD) dataset. The DFADD dataset collected the deepfake audio based on advanced diffusion and flowmatching TTS models. Additionally, we reveal that current anti-spoofing models lack sufficient robustness against highly human-like audio generated by diffusion and flow-matching TTS systems. The proposed DFADD dataset addresses this gap and provides a valuable resource for developing more resilient anti-spoofing models.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
EMO-Codec: An In-Depth Look at Emotion Preservation capacity of Legacy and Neural Codec Models With Subjective and Objective Evaluations
Authors:
Wenze Ren,
Yi-Cheng Lin,
Huang-Cheng Chou,
Haibin Wu,
Yi-Chiao Wu,
Chi-Chun Lee,
Hung-yi Lee,
Yu Tsao
Abstract:
The neural codec model reduces speech data transmission delay and serves as the foundational tokenizer for speech language models (speech LMs). Preserving emotional information in codecs is crucial for effective communication and context understanding. However, there is a lack of studies on emotion loss in existing codecs. This paper evaluates neural and legacy codecs using subjective and objectiv…
▽ More
The neural codec model reduces speech data transmission delay and serves as the foundational tokenizer for speech language models (speech LMs). Preserving emotional information in codecs is crucial for effective communication and context understanding. However, there is a lack of studies on emotion loss in existing codecs. This paper evaluates neural and legacy codecs using subjective and objective methods on emotion datasets like IEMOCAP. Our study identifies which codecs best preserve emotional information under various bitrate scenarios. We found that training codec models with both English and Chinese data had limited success in retaining emotional information in Chinese. Additionally, resynthesizing speech through these codecs degrades the performance of speech emotion recognition (SER), particularly for emotions like sadness, depression, fear, and disgust. Human listening tests confirmed these findings. This work guides future speech technology developments to ensure new codecs maintain the integrity of emotional information in speech.
△ Less
Submitted 30 July, 2024; v1 submitted 22 July, 2024;
originally announced July 2024.
-
Zonotope-based Symbolic Controller Synthesis for Linear Temporal Logic Specifications
Authors:
Wei Ren,
Raphael M. Jungers,
Dimos V. Dimarogonas
Abstract:
This paper studies the controller synthesis problem for nonlinear control systems under linear temporal logic (LTL) specifications using zonotope techniques. A local-to-global control strategy is proposed for the desired specification expressed as an LTL formula. First, a novel approach is developed to divide the state space into finite zonotopes and constrained zonotopes, which are called cells a…
▽ More
This paper studies the controller synthesis problem for nonlinear control systems under linear temporal logic (LTL) specifications using zonotope techniques. A local-to-global control strategy is proposed for the desired specification expressed as an LTL formula. First, a novel approach is developed to divide the state space into finite zonotopes and constrained zonotopes, which are called cells and allowed to intersect with the neighbor cells. Second, from the intersection relation, a graph among all cells is generated to verify the realization of the accepting path for the LTL formula. The realization verification determines if there is a need for the control design, and also results in finite local LTL formulas. Third, once the accepting path is realized, a novel abstraction-based method is derived for the controller design. In particular, we only focus on the cells from the realization verification and approximate each cell thanks to properties of zonotopes. Based on local symbolic models and local LTL formulas, an iterative synthesis algorithm is proposed to design all local abstract controllers, whose existence and combination establish the global controller for the LTL formula. Finally, the proposed framework is illustrated via a path planning problem of mobile robots.
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
DI-Retinex: Digital-Imaging Retinex Theory for Low-Light Image Enhancement
Authors:
Shangquan Sun,
Wenqi Ren,
Jingyang Peng,
Fenglong Song,
Xiaochun Cao
Abstract:
Many existing methods for low-light image enhancement (LLIE) based on Retinex theory ignore important factors that affect the validity of this theory in digital imaging, such as noise, quantization error, non-linearity, and dynamic range overflow. In this paper, we propose a new expression called Digital-Imaging Retinex theory (DI-Retinex) through theoretical and experimental analysis of Retinex t…
▽ More
Many existing methods for low-light image enhancement (LLIE) based on Retinex theory ignore important factors that affect the validity of this theory in digital imaging, such as noise, quantization error, non-linearity, and dynamic range overflow. In this paper, we propose a new expression called Digital-Imaging Retinex theory (DI-Retinex) through theoretical and experimental analysis of Retinex theory in digital imaging. Our new expression includes an offset term in the enhancement model, which allows for pixel-wise brightness contrast adjustment with a non-linear mapping function. In addition, to solve the lowlight enhancement problem in an unsupervised manner, we propose an image-adaptive masked reverse degradation loss in Gamma space. We also design a variance suppression loss for regulating the additional offset term. Extensive experiments show that our proposed method outperforms all existing unsupervised methods in terms of visual quality, model size, and speed. Our algorithm can also assist downstream face detectors in low-light, as it shows the most performance gain after the low-light enhancement compared to other methods.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Segmentation Guided Sparse Transformer for Under-Display Camera Image Restoration
Authors:
Jingyun Xue,
Tao Wang,
Jun Wang,
Kaihao Zhang,
Wenhan Luo,
Wenqi Ren,
Zikun Liu,
Hyunhee Park,
Xiaochun Cao
Abstract:
Under-Display Camera (UDC) is an emerging technology that achieves full-screen display via hiding the camera under the display panel. However, the current implementation of UDC causes serious degradation. The incident light required for camera imaging undergoes attenuation and diffraction when passing through the display panel, leading to various artifacts in UDC imaging. Presently, the prevailing…
▽ More
Under-Display Camera (UDC) is an emerging technology that achieves full-screen display via hiding the camera under the display panel. However, the current implementation of UDC causes serious degradation. The incident light required for camera imaging undergoes attenuation and diffraction when passing through the display panel, leading to various artifacts in UDC imaging. Presently, the prevailing UDC image restoration methods predominantly utilize convolutional neural network architectures, whereas Transformer-based methods have exhibited superior performance in the majority of image restoration tasks. This is attributed to the Transformer's capability to sample global features for the local reconstruction of images, thereby achieving high-quality image restoration. In this paper, we observe that when using the Vision Transformer for UDC degraded image restoration, the global attention samples a large amount of redundant information and noise. Furthermore, compared to the ordinary Transformer employing dense attention, the Transformer utilizing sparse attention can alleviate the adverse impact of redundant information and noise. Building upon this discovery, we propose a Segmentation Guided Sparse Transformer method (SGSFormer) for the task of restoring high-quality images from UDC degraded images. Specifically, we utilize sparse self-attention to filter out redundant information and noise, directing the model's attention to focus on the features more relevant to the degraded regions in need of reconstruction. Moreover, we integrate the instance segmentation map as prior information to guide the sparse self-attention in filtering and focusing on the correct regions.
△ Less
Submitted 9 March, 2024;
originally announced March 2024.
-
Emulation-based Stabilization for Networked Control Systems with Stochastic Channels
Authors:
Wei Ren,
Wei Wang,
Zhuo-Rui Pan,
Xi-Ming Sun,
Andrew R. Teel,
Dragan Nesic
Abstract:
This paper studies the stabilization problem of networked control systems (NCSs) with random packet dropouts caused by stochastic channels. To describe the effects of stochastic channels on the information transmission, the transmission times are assumed to be deterministic, whereas the packet transmission is assumed to be random. We first propose a stochastic scheduling protocol to model random p…
▽ More
This paper studies the stabilization problem of networked control systems (NCSs) with random packet dropouts caused by stochastic channels. To describe the effects of stochastic channels on the information transmission, the transmission times are assumed to be deterministic, whereas the packet transmission is assumed to be random. We first propose a stochastic scheduling protocol to model random packet dropouts, and address the properties of the proposed stochastic scheduling protocol. The proposed scheduling protocol provides a unified modelling framework for a general class of random packet dropouts due to different stochastic channels. Next, the proposed scheduling protocol is embedded into the closed-loop system, which leads to a stochastic hybrid model for NCSs with random packet dropouts. Based on this stochastic hybrid model, we follow the emulation approach to establish sufficient conditions to guarantee uniform global asymptotical stability in probability. In particular, an upper bound on the maximally allowable transmission interval is derived explicitly for all stochastic protocols satisfying Lyapunov conditions that guarantee uniform global asymptotic stability in probability. Finally, two numerical examples are presented to demonstrate the derived results.
△ Less
Submitted 21 January, 2024;
originally announced January 2024.
-
Multiple Control Functionals for Interconnected Time-Delay Systems
Authors:
Zhuo-Rui Pan,
Wei Ren,
Xi-Ming Sun
Abstract:
Safety is essential for autonomous systems, in particular for interconnected systems in which the interactions among subsystems are involved. Motivated by the recent interest in cyber-physical and interconnected autonomous systems, we address the safe stabilization problem of interconnected systems with time delays. We propose multiple control Lyapunov and barrier functionals for the stabilization…
▽ More
Safety is essential for autonomous systems, in particular for interconnected systems in which the interactions among subsystems are involved. Motivated by the recent interest in cyber-physical and interconnected autonomous systems, we address the safe stabilization problem of interconnected systems with time delays. We propose multiple control Lyapunov and barrier functionals for the stabilization and safety control problems, respectively. In order to investigate the safe stabilization control problem, the proposed multiple control functionals are combined together via two methods: the optimization-based method and the sliding mode based method. The resulting controllers can be of either explicit or implicit forms, both of which ensure the safe stabilization objective of the whole system. The derived results are illustrated via a reach-avoid problem of multi-robot systems.
△ Less
Submitted 30 November, 2023;
originally announced December 2023.
-
Motion Control of Two Mobile Robots under Allowable Collisions
Authors:
Li Tan,
Wei Ren,
Xi-Ming Sun,
Junlin Xiong
Abstract:
This letter investigates the motion control problem of two mobile robots under allowable collisions. Here, the allowable collisions mean that the collisions do not damage the mobile robots. The occurrence of the collisions is discussed and the effects of the collisions on the mobile robots are analyzed to develop a hybrid model of each mobile robot under allowable collisions. Based on the effects…
▽ More
This letter investigates the motion control problem of two mobile robots under allowable collisions. Here, the allowable collisions mean that the collisions do not damage the mobile robots. The occurrence of the collisions is discussed and the effects of the collisions on the mobile robots are analyzed to develop a hybrid model of each mobile robot under allowable collisions. Based on the effects of the collisions, we show the necessity of redesigning the motion control strategy for mobile robots. Furthermore, impulsive control techniques are applied to redesign the motion control strategy to guarantee the task accomplishment for each mobile robot. Finally, an example is used to illustrate the redesigned motion control strategy.
△ Less
Submitted 26 April, 2024; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Deep Complex U-Net with Conformer for Audio-Visual Speech Enhancement
Authors:
Shafique Ahmed,
Chia-Wei Chen,
Wenze Ren,
Chin-Jou Li,
Ernie Chu,
Jun-Cheng Chen,
Amir Hussain,
Hsin-Min Wang,
Yu Tsao,
Jen-Cheng Hou
Abstract:
Recent studies have increasingly acknowledged the advantages of incorporating visual data into speech enhancement (SE) systems. In this paper, we introduce a novel audio-visual SE approach, termed DCUC-Net (deep complex U-Net with conformer network). The proposed DCUC-Net leverages complex domain features and a stack of conformer blocks. The encoder and decoder of DCUC-Net are designed using a com…
▽ More
Recent studies have increasingly acknowledged the advantages of incorporating visual data into speech enhancement (SE) systems. In this paper, we introduce a novel audio-visual SE approach, termed DCUC-Net (deep complex U-Net with conformer network). The proposed DCUC-Net leverages complex domain features and a stack of conformer blocks. The encoder and decoder of DCUC-Net are designed using a complex U-Net-based framework. The audio and visual signals are processed using a complex encoder and a ResNet-18 model, respectively. These processed signals are then fused using the conformer blocks and transformed into enhanced speech waveforms via a complex decoder. The conformer blocks consist of a combination of self-attention mechanisms and convolutional operations, enabling DCUC-Net to effectively capture both global and local audio-visual dependencies. Our experimental results demonstrate the effectiveness of DCUC-Net, as it outperforms the baseline model from the COG-MHEAR AVSE Challenge 2023 by a notable margin of 0.14 in terms of PESQ. Additionally, the proposed DCUC-Net performs comparably to a state-of-the-art model and outperforms all other compared models on the Taiwan Mandarin speech with video (TMSV) dataset.
△ Less
Submitted 8 October, 2023; v1 submitted 20 September, 2023;
originally announced September 2023.
-
Minimal-time Deadbeat Consensus and Individual Disagreement Degree Prediction for High-order Linear Multi-agent Systems
Authors:
Fu-Long Hu,
Hai-Tao Zhang,
Bowen Xu,
Zhe Hu,
Wei Ren
Abstract:
In this paper, a Hankel matrix-based fully distributed algorithm is proposed to address a minimal-time deadbeat consensus prediction problem for discrete-time high-order multi-agent systems (MASs). Therein, each agent can predict the consensus value with the minimum number of observable historical outputs of its own. Accordingly, compared to most existing algorithms only yielding asymptotic conver…
▽ More
In this paper, a Hankel matrix-based fully distributed algorithm is proposed to address a minimal-time deadbeat consensus prediction problem for discrete-time high-order multi-agent systems (MASs). Therein, each agent can predict the consensus value with the minimum number of observable historical outputs of its own. Accordingly, compared to most existing algorithms only yielding asymptotic convergence, the present method can attain deadbeat consensus instead. Moreover, based on the consensus value prediction, instant individual disagreement degree value of MASs can be calculated in advance as well. Sufficient conditions are derived to guarantee both the minimal-time deadbeat consensus and the instant individual disagreement degree prediction. Finally, both the effectiveness and superiority of the proposed deadbeat consensus algorithm are substantiated by numerical simulations.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Safe Stabilization for Stochastic Time-Delay Systems
Authors:
Zhuo-Rui Pan,
Wei Ren,
Xi-Ming Sun
Abstract:
This paper addresses the safe stabilization problem of stochastic nonlinear time-delay systems. Based on theKrasovskii approach, we first propose a stochastic control Lyapunov-Krasovskii functional to guarantee the stabilization objective and a stochastic control barrier-Krasovskii functional to ensure the safety objective. Both functionals are developed respectively for each control objectives fo…
▽ More
This paper addresses the safe stabilization problem of stochastic nonlinear time-delay systems. Based on theKrasovskii approach, we first propose a stochastic control Lyapunov-Krasovskii functional to guarantee the stabilization objective and a stochastic control barrier-Krasovskii functional to ensure the safety objective. Both functionals are developed respectively for each control objectives for the first time. Since the optimization problem is not easy to be resolved for stochastic time-delay systems, we derive a sliding mode based approach to combine the proposed two functionals and to mediate stabilization and safety objectives, which allows to achieve the stabilization objective under the safety requirement. The proposed approach is illustrated via a numerical example.
△ Less
Submitted 3 November, 2023; v1 submitted 20 November, 2022;
originally announced November 2022.
-
Ghost translation
Authors:
Wenhan Ren,
Xiaoyu Nie,
Tao Peng,
Marlan O. Scully
Abstract:
Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulat…
▽ More
Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulation database assists the network in achieving signal translation ability. The experimental single-pixel detector's signal will be `translated' into a 2D image in an end-to-end manner. High-quality images with no background noise can be retrieved at a sampling ratio as low as 2%. The illumination patterns can be either well-designed speckle patterns for sub-Nyquist imaging or random speckle patterns. Moreover, our method is robust to noise interference. This translation mechanism opens a new direction for DNN-assisted ghost imaging and can be used in various computational imaging scenarios.
△ Less
Submitted 29 September, 2022;
originally announced September 2022.
-
Razumikhin and Krasovskii Approaches for Safe Stabilization
Authors:
Wei Ren,
Raphael M. Jungers,
Dimos V. Dimarogonas
Abstract:
This paper studies the stabilization and safety problems of nonlinear time-delay systems. Following both Razumikhin and Krasovskii approaches, we propose novel control Lyapunov functions/functionals for the stabilization problem and novel control barrier functions/functionals for the safety problem. The proposed control Lyapunov and barrier functions/functionals extend the existing ones from the d…
▽ More
This paper studies the stabilization and safety problems of nonlinear time-delay systems. Following both Razumikhin and Krasovskii approaches, we propose novel control Lyapunov functions/functionals for the stabilization problem and novel control barrier functions/functionals for the safety problem. The proposed control Lyapunov and barrier functions/functionals extend the existing ones from the delay-free case to the time-delay case, and allow for designing the stabilizing and safety controllers in closed-form. Since analytical solutions to time-delay optimal control problems are hard to be achieved, a sliding mode control based approach is developed to merge the proposed control Lyapunov and barrier functions/functionals. Based on the sliding surface functional, a feedback control law is established to investigate the stabilization and safety objectives simultaneously. In particular, the properties of the sliding surface functional are analyzed, and further how to construct the sliding surface functional is discussed. Finally, the proposed approaches are illustrated via two numerical examples from the connected cruise control problem of automotive systems and the synchronization problem of multi-agent systems.
△ Less
Submitted 28 June, 2022; v1 submitted 26 April, 2022;
originally announced April 2022.
-
Optimal Resource Scheduling and Allocation under Allowable Over-Scheduling
Authors:
Wei Ren,
Eleftherios Vlahakis,
Nikolaos Athanasopoulos,
Raphael M. Jungers
Abstract:
This paper studies optimal scheduling and resource allocation under allowable over-scheduling. Formulating an optimisation problem where over-scheduling is embedded, we derive an optimal solution that can be implemented by means of a new additive increase multiplicative decrease (AIMD) algorithm. After describing the AIMD-like scheduling mechanism as a switching system, we show convergence of the…
▽ More
This paper studies optimal scheduling and resource allocation under allowable over-scheduling. Formulating an optimisation problem where over-scheduling is embedded, we derive an optimal solution that can be implemented by means of a new additive increase multiplicative decrease (AIMD) algorithm. After describing the AIMD-like scheduling mechanism as a switching system, we show convergence of the scheme, based on the joint spectral radius of symmetric matrices, and propose two methods for fitting an optimal AIMD tuning to the optimal solution derived. Finally, we demonstrate the overall optimal design strategy via an illustrative example.
△ Less
Submitted 31 March, 2022;
originally announced April 2022.
-
Memory-augmented Deep Unfolding Network for Guided Image Super-resolution
Authors:
Man Zhou,
Keyu Yan,
Jinshan Pan,
Wenqi Ren,
Qi Xie,
Xiangyong Cao
Abstract:
Guided image super-resolution (GISR) aims to obtain a high-resolution (HR) target image by enhancing the spatial resolution of a low-resolution (LR) target image under the guidance of a HR image. However, previous model-based methods mainly takes the entire image as a whole, and assume the prior distribution between the HR target image and the HR guidance image, simply ignoring many non-local comm…
▽ More
Guided image super-resolution (GISR) aims to obtain a high-resolution (HR) target image by enhancing the spatial resolution of a low-resolution (LR) target image under the guidance of a HR image. However, previous model-based methods mainly takes the entire image as a whole, and assume the prior distribution between the HR target image and the HR guidance image, simply ignoring many non-local common characteristics between them. To alleviate this issue, we firstly propose a maximal a posterior (MAP) estimation model for GISR with two types of prior on the HR target image, i.e., local implicit prior and global implicit prior. The local implicit prior aims to model the complex relationship between the HR target image and the HR guidance image from a local perspective, and the global implicit prior considers the non-local auto-regression property between the two images from a global perspective. Secondly, we design a novel alternating optimization algorithm to solve this model for GISR. The algorithm is in a concise framework that facilitates to be replicated into commonly used deep network structures. Thirdly, to reduce the information loss across iterative stages, the persistent memory mechanism is introduced to augment the information representation by exploiting the Long short-term memory unit (LSTM) in the image and feature spaces. In this way, a deep network with certain interpretation and high representation ability is built. Extensive experimental results validate the superiority of our method on a variety of GISR tasks, including Pan-sharpening, depth image super-resolution, and MR image super-resolution.
△ Less
Submitted 12 February, 2022;
originally announced March 2022.
-
Event-Triggered Tracking Control of Networked Multi-Agent Systems
Authors:
Wei Ren,
Dimos V. Dimarogonas
Abstract:
This paper studies the tracking control problem of networked multi-agent systems under both multiple networks and event-triggered mechanisms. Multiple networks are to connect multiple agents and reference systems with decentralized controllers to guarantee their information transmission, whereas the event-triggered mechanisms are to reduce the information transmission via the networks. In this pap…
▽ More
This paper studies the tracking control problem of networked multi-agent systems under both multiple networks and event-triggered mechanisms. Multiple networks are to connect multiple agents and reference systems with decentralized controllers to guarantee their information transmission, whereas the event-triggered mechanisms are to reduce the information transmission via the networks. In this paper, each agent has a network to communicate with its controller and reference system, and all networks are independent and asynchronous and have local event-triggered mechanisms, which are based on local measurements and determine whether the local measurements need to be transmitted via the corresponding network. To address this scenario, we first implement the emulation-based approach to develop a novel hybrid model for the tracking control of networked multi-agent systems. Next, sufficient conditions are derived and decentralized event-triggered mechanisms are designed to guarantee the desired tracking performance. Furthermore, the proposed approach is applied to derive novel results for the event-triggered observer design problem of networked multi-agent systems. Finally, two numerical examples are presented to illustrate the validity of the developed results.
△ Less
Submitted 2 June, 2022; v1 submitted 22 February, 2022;
originally announced February 2022.
-
Lyapunov Conditions for Input-to-State Stability of Hybrid Systems with Memory
Authors:
Wei Ren,
Junlin Xiong
Abstract:
This paper studies input-to-state stability for hybrid systems with memory, which models hybrid dynamics affected by time delays. Using both Lyapunov-Razumikhin functions and Lyapunov-Krasovskii functionals, Lyapunov-based sufficient conditions are established for input-to-state stability. In addition, further extensions and relaxations are proposed for special cases, such as the stable flow/jump…
▽ More
This paper studies input-to-state stability for hybrid systems with memory, which models hybrid dynamics affected by time delays. Using both Lyapunov-Razumikhin functions and Lyapunov-Krasovskii functionals, Lyapunov-based sufficient conditions are established for input-to-state stability. In addition, further extensions and relaxations are proposed for special cases, such as the stable flow/jump cases and the cases that Lyapunov functions do not decrease strictly during flow/jumps. Finally, two examples are used to illustrate the developed results.
△ Less
Submitted 30 January, 2022;
originally announced January 2022.
-
Deep-learned speckle pattern and its application to ghost imaging
Authors:
Xiaoyu Nie,
Haotian Song,
Wenhan Ren,
Xingchen Zhao,
Zhedong Zhang,
Tao Peng,
Marlan O. Scully
Abstract:
In this paper, we present a method for speckle pattern design using deep learning. The speckle patterns possess unique features after experiencing convolutions in Speckle-Net, our well-designed framework for speckle pattern generation. We then apply our method to the computational ghost imaging system. The standard deep learning-assisted ghost imaging methods use the network to recognize the recon…
▽ More
In this paper, we present a method for speckle pattern design using deep learning. The speckle patterns possess unique features after experiencing convolutions in Speckle-Net, our well-designed framework for speckle pattern generation. We then apply our method to the computational ghost imaging system. The standard deep learning-assisted ghost imaging methods use the network to recognize the reconstructed objects or imaging algorithms. In contrast, this innovative application optimizes the illuminating speckle patterns via Speckle-Net with specific sampling ratios. Our method, therefore, outperforms the other techniques for ghost imaging, particularly its ability to retrieve high-quality images with extremely low sampling ratios. It opens a new route towards nontrivial speckle generation by referring to a standard loss function on specified objectives with the modified deep neural network. It also has great potential for applications in the fields of dynamic speckle illumination microscopy, structured illumination microscopy, x-ray imaging, photo-acoustic imaging, and optical lattices.
△ Less
Submitted 27 December, 2021; v1 submitted 25 December, 2021;
originally announced December 2021.
-
Event-Triggered Tracking Control of Networked and Quantized Control Systems
Authors:
Wei Ren,
Dimos V. Dimarogonas,
Raphael Jungers
Abstract:
This paper studies the tracking control problem of networked and quantized control systems under both multiple networks and event-triggered mechanisms. Multiple networks are to connect the plant and reference system with decentralized controllers to guarantee their information transmission, whereas event-triggered mechanisms are to reduce the information transmission via multiple networks. In this…
▽ More
This paper studies the tracking control problem of networked and quantized control systems under both multiple networks and event-triggered mechanisms. Multiple networks are to connect the plant and reference system with decentralized controllers to guarantee their information transmission, whereas event-triggered mechanisms are to reduce the information transmission via multiple networks. In this paper, all networks are independent and asynchronous and have local event-triggered mechanisms, which are based on local measurements and determine whether the local measurements need to be transmitted. We first implement an emulation-based approach to develop a novel hybrid model for tracking control of networked and quantized control systems. Next, sufficient conditions are derived and decentralized event-triggered mechanisms are designed to ensure the tracking performance. Finally, a numerical example is given to illustrate the obtained results.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Reachability-based Control Synthesis under Signal Temporal Logic Specifications
Authors:
Wei Ren,
Raphael Jungers
Abstract:
In this paper, we investigate the controller design problem for linear disturbed systems under signal temporal logic (STL) specifications imposing both spatial and temporal constraints on system behavior. We first implement zonotope-based techniques to partition the state space into finite cells, then propose an evaluation mechanism to rearrange the time constraints of the STL specification, and f…
▽ More
In this paper, we investigate the controller design problem for linear disturbed systems under signal temporal logic (STL) specifications imposing both spatial and temporal constraints on system behavior. We first implement zonotope-based techniques to partition the state space into finite cells, then propose an evaluation mechanism to rearrange the time constraints of the STL specification, and finally decompose the global STL formula into finite local STL formulas. In this way, each cell has a local control design problem, which is further formulated into a local optimization problem. To deal with each local optimization problem, we take advantage of the properties of zonotopes and reachability analysis to design local controller consisting of feedforward and feedback parts. By solving all local optimization problems, all local controllers are combined to guarantee the global STL specification. Finally, a numerical example is presented to illustrate the derived results.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Deep learning facilitates fully automated brain image registration of optoacoustic tomography and magnetic resonance imaging
Authors:
Yexing Hu,
Berkan Lafci,
Artur Luzgin,
Hao Wang,
Jan Klohs,
Xose Luis Dean-Ben,
Ruiqing Ni,
Daniel Razansky,
Wuwei Ren
Abstract:
Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers excellent soft-tissue contrast and high-resolution brain anatomy. Nevertheless, registration of multi-modal images remains challenging, chiefly due to the entir…
▽ More
Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers excellent soft-tissue contrast and high-resolution brain anatomy. Nevertheless, registration of multi-modal images remains challenging, chiefly due to the entirely different image contrast rendered by these modalities. Previously reported registration algorithms mostly relied on manual user-dependent brain segmentation, which compromised data interpretation and accurate quantification. Here we propose a fully automated registration method for MSOT-MRI multimodal imaging empowered by deep learning. The automated workflow includes neural network-based image segmentation to generate suitable masks, which are subsequently registered using an additional neural network. Performance of the algorithm is showcased with datasets acquired by cross-sectional MSOT and high-field MRI preclinical scanners. The automated registration method is further validated with manual and half-automated registration, demonstrating its robustness and accuracy.
△ Less
Submitted 4 September, 2021;
originally announced September 2021.
-
Zonotope-based Controller Synthesis for LTL Specifications
Authors:
Wei Ren,
Julien Calbert,
Raphael Jungers
Abstract:
This paper studies the controller synthesis problem for Linear Temporal Logic (LTL) specifications using (constrained) zonotope techniques. First, we implement (constrained) zonotope techniques to partition the state space and further to verify whether the LTL specification can be satisfied. Once the LTL specification can be satisfied, the next step is to design a controller to guarantee the satis…
▽ More
This paper studies the controller synthesis problem for Linear Temporal Logic (LTL) specifications using (constrained) zonotope techniques. First, we implement (constrained) zonotope techniques to partition the state space and further to verify whether the LTL specification can be satisfied. Once the LTL specification can be satisfied, the next step is to design a controller to guarantee the satisfaction of the LTL specification for dynamic systems. Based on the verification of the LTL specification, an abstraction-based control design approach is proposed in this paper: a novel abstraction construction is developed first, then finite local abstract controllers are designed to achieve the LTL specification, and finally the designed abstract controllers are combined and refined as the controller for the original system. The proposed control strategy is illustrated via a numerical example from autonomous robots.
△ Less
Submitted 15 November, 2021; v1 submitted 2 August, 2021;
originally announced August 2021.
-
A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging
Authors:
Jingang Zhang,
Runmu Su,
Wenqi Ren,
Qiang Fu,
Felix Heide,
Yunfeng Nie
Abstract:
Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspectral images are expensive and complicated. Therefore, many alternative spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from lo…
▽ More
Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspectral images are expensive and complicated. Therefore, many alternative spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from lower-cost, more available RGB images. We present a thorough investigation of these state-of-the-art spectral reconstruction methods from the widespread RGB images. A systematic study and comparison of more than 25 methods has revealed that most of the data-driven deep learning methods are superior to prior-based methods in terms of reconstruction accuracy and quality despite lower speeds. This comprehensive review can serve as a fruitful reference source for peer researchers, thus further inspiring future development directions in related domains.
△ Less
Submitted 13 July, 2022; v1 submitted 30 June, 2021;
originally announced June 2021.
-
A Lightweight Privacy-Preserving Scheme Using Label-based Pixel Block Mixing for Image Classification in Deep Learning
Authors:
Yuexin Xiang,
Tiantian Li,
Wei Ren,
Tianqing Zhu,
Kim-Kwang Raymond Choo
Abstract:
To ensure the privacy of sensitive data used in the training of deep learning models, a number of privacy-preserving methods have been designed by the research community. However, existing schemes are generally designed to work with textual data, or are not efficient when a large number of images is used for training. Hence, in this paper we propose a lightweight and efficient approach to preserve…
▽ More
To ensure the privacy of sensitive data used in the training of deep learning models, a number of privacy-preserving methods have been designed by the research community. However, existing schemes are generally designed to work with textual data, or are not efficient when a large number of images is used for training. Hence, in this paper we propose a lightweight and efficient approach to preserve image privacy while maintaining the availability of the training set. Specifically, we design the pixel block mixing algorithm for image classification privacy preservation in deep learning. To evaluate its utility, we use the mixed training set to train the ResNet50, VGG16, InceptionV3 and DenseNet121 models on the WIKI dataset and the CNBC face dataset. Experimental findings on the testing set show that our scheme preserves image privacy while maintaining the availability of the training set in the deep learning models. Additionally, the experimental results demonstrate that we achieve good performance for the VGG16 model on the WIKI dataset and both ResNet50 and DenseNet121 on the CNBC dataset. The pixel block algorithm achieves fairly high efficiency in the mixing of the images, and it is computationally challenging for the attackers to restore the mixed training set to the original training set. Moreover, data augmentation can be applied to the mixed training set to improve the training's effectiveness.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
Razumikhin-type Control Lyapunov and Barrier Functions for Time-Delay Systems
Authors:
Wei Ren
Abstract:
This paper studies the stabilization and safety problems of nonlinear time-delay systems, where time delays exist in system state and affect the controller design. Following the Razumikhin approach, we propose a novel control Lyapunov-Razumikhin function to facilitate the controller design and to achieve the stabilization objective. To ensure the safety objective, we propose a Razumikhin-type cont…
▽ More
This paper studies the stabilization and safety problems of nonlinear time-delay systems, where time delays exist in system state and affect the controller design. Following the Razumikhin approach, we propose a novel control Lyapunov-Razumikhin function to facilitate the controller design and to achieve the stabilization objective. To ensure the safety objective, we propose a Razumikhin-type control barrier function for time-delay systems for the first time. Furthermore, the proposed Razumikhin-type control Lyapunov and barrier functions are merged such that the stabilization and safety control design can be combined to address the stabilization and safety simultaneously, which further extends the control design from the delay-free case into the time-delay case. Finally, the proposed approach is illustrated via a numerical example.
△ Less
Submitted 25 September, 2021; v1 submitted 12 May, 2021;
originally announced May 2021.
-
Progressive residual learning for single image dehazing
Authors:
Yudong Liang,
Bin Wang,
Jiaying Liu,
Deyu Li,
Yuhua Qian,
Wenqi Ren
Abstract:
The recent physical model-free dehazing methods have achieved state-of-the-art performances. However, without the guidance of physical models, the performances degrade rapidly when applied to real scenarios due to the unavailable or insufficient data problems. On the other hand, the physical model-based methods have better interpretability but suffer from multi-objective optimizations of parameter…
▽ More
The recent physical model-free dehazing methods have achieved state-of-the-art performances. However, without the guidance of physical models, the performances degrade rapidly when applied to real scenarios due to the unavailable or insufficient data problems. On the other hand, the physical model-based methods have better interpretability but suffer from multi-objective optimizations of parameters, which may lead to sub-optimal dehazing results. In this paper, a progressive residual learning strategy has been proposed to combine the physical model-free dehazing process with reformulated scattering model-based dehazing operations, which enjoys the merits of dehazing methods in both categories. Specifically, the global atmosphere light and transmission maps are interactively optimized with the aid of accurate residual information and preliminary dehazed restorations from the initial physical model-free dehazing process. The proposed method performs favorably against the state-of-the-art methods on public dehazing benchmarks with better model interpretability and adaptivity for complex hazy data.
△ Less
Submitted 14 March, 2021;
originally announced March 2021.
-
Stability and $\mathcal{H}_{\infty}$ Performance Analysis of Stochastic Linear Networked and Quantized Control Systems
Authors:
Wei Ren,
Junlin Xiong
Abstract:
This paper studies the stability and $\mathcal{H}_{\infty}$ performance analysis problem for linear networked and quantized control systems with both communication delays random packet losses. To deal with the network-induced uncertainties and random packet dropouts, a novel discrete-time stochastic system model is developed for continuous-time networked control systems, and further overapproximat…
▽ More
This paper studies the stability and $\mathcal{H}_{\infty}$ performance analysis problem for linear networked and quantized control systems with both communication delays random packet losses. To deal with the network-induced uncertainties and random packet dropouts, a novel discrete-time stochastic system model is developed for continuous-time networked control systems, and further overapproximated via a polytopic system with norm-bounded uncertainty. Based on the overapproximated system model, sufficient conditions are established for linear networked and quantized control systems in different cases to guarantee input-to-state stability and $\mathcal{H}_{\infty}$ performance with respect to the network-induced errors. Finally, a numerical example is presented to illustrated the developed results.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
A Differential-Cascaded Paradigm for Control of Nonlinear Systems
Authors:
Hanlei Wang,
Wei Ren,
Chien Chern Cheah
Abstract:
This paper focuses on developing a new paradigm motivated by investigating the consensus problem of networked Lagrangian systems with time-varying delay and switching topologies. We present adaptive controllers with piecewise continuous or arbitrary times differentiable control torques for realizing consensus of Lagrangian systems, extending the results in the literature. This specific study motiv…
▽ More
This paper focuses on developing a new paradigm motivated by investigating the consensus problem of networked Lagrangian systems with time-varying delay and switching topologies. We present adaptive controllers with piecewise continuous or arbitrary times differentiable control torques for realizing consensus of Lagrangian systems, extending the results in the literature. This specific study motivates the formulation of a new paradigm referred to as forwardstepping, which is shown to be a systematic tool for solving various nonlinear control problems. One distinctive point associated with forwardstepping is that the order of the reference dynamics is typically specified to be equal to or higher than that of the original nonlinear system, and the reference dynamics and the nonlinear system are governed by a differential/dynamic-cascaded structure. The order invariance or increment of the specified reference dynamics with respect to the nonlinear system and their differential/dynamic-cascaded structure expands significantly the design freedom and thus facilitates the seeking of solutions to many nonlinear control problems which would otherwise often be intractable.
△ Less
Submitted 28 December, 2020;
originally announced December 2020.
-
Compressive Circular Polarization Snapshot Spectral Imaging
Authors:
Jianglan Ning,
Zhilong Xu,
Dan Wu,
Rui Zhang,
Yuanyuan Wang,
Yingge Xie,
Wei Zhao,
Xu Ma,
Wenyi Ren
Abstract:
A compressive sensing based circular polarization snapshot spectral imaging system is proposed in this paper to acquire two-dimensional spatial, one-dimensional circular polarization (the right and left circular polarization), and one-dimensional spectral information, simultaneously. Using snapshot can collect the entire four-dimensional datacube in a single integration period. The dispersion pris…
▽ More
A compressive sensing based circular polarization snapshot spectral imaging system is proposed in this paper to acquire two-dimensional spatial, one-dimensional circular polarization (the right and left circular polarization), and one-dimensional spectral information, simultaneously. Using snapshot can collect the entire four-dimensional datacube in a single integration period. The dispersion prism in the coded aperture snapshot spectral imager is replaced by the combination of an Amici prism and a Wollaston prism to implement the spectral shifting along two orthogonal directions, which greatly improves the spectral resolution of the image. The right and left circular polarization components of objects are extracted by the assemble with an achromatic quarter wave-plate and a Wollaston prism. The encoding and reconstruction are illustrated comprehensively. The feasibility is verified by the simulation. It provides us an alternative approach for circular polarization spectral imaging such as defogging, underwater imaging, and so on.
△ Less
Submitted 17 December, 2020; v1 submitted 29 November, 2020;
originally announced November 2020.
-
Symbolic Abstractions for Nonlinear Control Systems via Feedback Refinement Relation
Authors:
Wei Ren,
Dimos V. Dimarogonas
Abstract:
This paper studies the construction of symbolic abstractions for nonlinear control systems via feedback refinement relation. Both the delay-free and time-delay cases are addressed. For the delay-free case, to reduce the computational complexity, we propose a new approximation approach for the state and input sets based on a static quantizer, and then a novel symbolic model is constructed such that…
▽ More
This paper studies the construction of symbolic abstractions for nonlinear control systems via feedback refinement relation. Both the delay-free and time-delay cases are addressed. For the delay-free case, to reduce the computational complexity, we propose a new approximation approach for the state and input sets based on a static quantizer, and then a novel symbolic model is constructed such that the original system and the symbolic model satisfy the feedback refinement relation. For the time-delay case, both static and dynamic quantizers are combined to approximate the state and input sets. This leads to a novel dynamic symbolic model for time-delay control systems, and a feedback refinement relation is established between the original system and the symbolic model. Finally, a numerical example is presented to illustrate the obtained results.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
Dynamic Quantization based Symbolic Abstractions for Nonlinear Control Systems
Authors:
Wei Ren,
Dimos V. Dimarogonas
Abstract:
This paper studies the construction of dynamic symbolic abstractions for nonlinear control systems via dynamic quantization. Since computational complexity is a fundamental problem in the use of discrete abstractions, a dynamic quantizer with a time-varying quantization parameter is first applied to deal with this problem. Due to the dynamic quantizer, a dynamic approximation approach is proposed…
▽ More
This paper studies the construction of dynamic symbolic abstractions for nonlinear control systems via dynamic quantization. Since computational complexity is a fundamental problem in the use of discrete abstractions, a dynamic quantizer with a time-varying quantization parameter is first applied to deal with this problem. Due to the dynamic quantizer, a dynamic approximation approach is proposed for the state and input sets. Based on the dynamic approximation, dynamic symbolic abstractions are constructed for nonlinear control systems, and an approximate bisimulation relation is guaranteed for the original system and the constructed dynamic symbolic abstraction. Finally, the obtained results are illustrated through a numerical example from path planning of mobile robots.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
Logarithmic Quantization based Symbolic Abstractions for Nonlinear Control Systems
Authors:
Wei Ren,
Dimos V. Dimarogonas
Abstract:
This paper studies symbolic abstractions for nonlinear control systems using logarithmic quantization. With a logarithmic quantizer, we approximate the state and input sets, and then construct a novel discrete abstraction for nonlinear control systems. A feedback refinement relation between the constructed discrete abstraction and the original system is established. Using the constructed discrete…
▽ More
This paper studies symbolic abstractions for nonlinear control systems using logarithmic quantization. With a logarithmic quantizer, we approximate the state and input sets, and then construct a novel discrete abstraction for nonlinear control systems. A feedback refinement relation between the constructed discrete abstraction and the original system is established. Using the constructed discrete abstraction, the safety controller synthesis problem is studied. With the discrete abstraction and the abstract specification, the existence of a safety controller is investigated, and the algorithm is proposed to compute the abstract controller. Finally, a numerical example is given to illustrate the obtained results.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
Single Image Super-Resolution via a Holistic Attention Network
Authors:
Ben Niu,
Weilei Wen,
Wenqi Ren,
Xiangde Zhang,
Lianping Yang,
Shuzhen Wang,
Kaihao Zhang,
Xiaochun Cao,
Haifeng Shen
Abstract:
Informative features play a crucial role in the single image super-resolution task. Channel attention has been demonstrated to be effective for preserving information-rich features in each layer. However, channel attention treats each convolution layer as a separate process that misses the correlation among different layers. To address this problem, we propose a new holistic attention network (HAN…
▽ More
Informative features play a crucial role in the single image super-resolution task. Channel attention has been demonstrated to be effective for preserving information-rich features in each layer. However, channel attention treats each convolution layer as a separate process that misses the correlation among different layers. To address this problem, we propose a new holistic attention network (HAN), which consists of a layer attention module (LAM) and a channel-spatial attention module (CSAM), to model the holistic interdependencies among layers, channels, and positions. Specifically, the proposed LAM adaptively emphasizes hierarchical features by considering correlations among layers. Meanwhile, CSAM learns the confidence at all the positions of each channel to selectively capture more informative features. Extensive experiments demonstrate that the proposed HAN performs favorably against the state-of-the-art single image super-resolution approaches.
△ Less
Submitted 20 August, 2020;
originally announced August 2020.
-
Face Super-Resolution Guided by 3D Facial Priors
Authors:
Xiaobin Hu,
Wenqi Ren,
John LaMaster,
Xiaochun Cao,
Xiaoming Li,
Zechao Li,
Bjoern Menze,
Wei Liu
Abstract:
State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge. However, most of these methods do not well exploit facial structures and identity information, and struggle to deal with facial images that exhibit large pose variations. In this paper, we propose a no…
▽ More
State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge. However, most of these methods do not well exploit facial structures and identity information, and struggle to deal with facial images that exhibit large pose variations. In this paper, we propose a novel face super-resolution method that explicitly incorporates 3D facial priors which grasp the sharp facial structures. Our work is the first to explore 3D morphable knowledge based on the fusion of parametric descriptions of face attributes (e.g., identity, facial expression, texture, illumination, and face pose). Furthermore, the priors can easily be incorporated into any network and are extremely efficient in improving the performance and accelerating the convergence speed. Firstly, a 3D face rendering branch is set up to obtain 3D priors of salient facial structures and identity knowledge. Secondly, the Spatial Attention Module is used to better exploit this hierarchical information (i.e., intensity similarity, 3D facial structure, and identity content) for the super-resolution problem. Extensive experiments demonstrate that the proposed 3D priors achieve superior face super-resolution results over the state-of-the-arts.
△ Less
Submitted 18 July, 2020;
originally announced July 2020.
-
Feedback Graph Attention Convolutional Network for Medical Image Enhancement
Authors:
Xiaobin Hu,
Yanyang Yan,
Wenqi Ren,
Hongwei Li,
Yu Zhao,
Amirhossein Bayat,
Bjoern Menze
Abstract:
Artifacts, blur and noise are the common distortions degrading MRI images during the acquisition process, and deep neural networks have been demonstrated to help in improving image quality. To well exploit global structural information and texture details, we propose a novel biomedical image enhancement network, named Feedback Graph Attention Convolutional Network (FB-GACN). As a key innovation, w…
▽ More
Artifacts, blur and noise are the common distortions degrading MRI images during the acquisition process, and deep neural networks have been demonstrated to help in improving image quality. To well exploit global structural information and texture details, we propose a novel biomedical image enhancement network, named Feedback Graph Attention Convolutional Network (FB-GACN). As a key innovation, we consider the global structure of an image by building a graph network from image sub-regions that we consider to be node features, linking them non-locally according to their similarity. The proposed model consists of three main parts: 1) The parallel graph similarity branch and content branch, where the graph similarity branch aims at exploiting the similarity and symmetry across different image sub-regions in low-resolution feature space and provides additional priors for the content branch to enhance texture details. 2) A feedback mechanism with a recurrent structure to refine low-level representations with high-level information and generate powerful high-level texture details by handling the feedback connections. 3) A reconstruction to remove the artifacts and recover super-resolution images by using the estimated sub-region correlation priors obtained from the graph similarity branch. We evaluate our method on two image enhancement tasks: i) cross-protocol super resolution of diffusion MRI; ii) artifact removal of FLAIR MR images. Experimental results demonstrate that the proposed algorithm outperforms the state-of-the-art methods.
△ Less
Submitted 13 April, 2021; v1 submitted 24 June, 2020;
originally announced June 2020.
-
DCNAS: Densely Connected Neural Architecture Search for Semantic Image Segmentation
Authors:
Xiong Zhang,
Hongmin Xu,
Hong Mo,
Jianchao Tan,
Cheng Yang,
Lei Wang,
Wenqi Ren
Abstract:
Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on proxy task to meet the achievable computational demands. To allow as wide as possible network architectures and avoid the gap between target and proxy dataset,…
▽ More
Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on proxy task to meet the achievable computational demands. To allow as wide as possible network architectures and avoid the gap between target and proxy dataset, we propose a Densely Connected NAS (DCNAS) framework, which directly searches the optimal network structures for the multi-scale representations of visual information, over a large-scale target dataset. Specifically, by connecting cells with each other using learnable weights, we introduce a densely connected search space to cover an abundance of mainstream network designs. Moreover, by combining both path-level and channel-level sampling strategies, we design a fusion module to reduce the memory consumption of ample search space. We demonstrate that the architecture obtained from our DCNAS algorithm achieves state-of-the-art performances on public semantic image segmentation benchmarks, including 84.3% on Cityscapes, and 86.9% on PASCAL VOC 2012. We also retain leading performances when evaluating the architecture on the more challenging ADE20K and Pascal Context dataset.
△ Less
Submitted 27 March, 2021; v1 submitted 26 March, 2020;
originally announced March 2020.
-
Stability of Multi-Dimensional Switched Systems with an Application to Open Multi-Agent Systems
Authors:
Mengqi Xue,
Yang Tang,
Wei Ren,
Feng Qian
Abstract:
A multi-dimensional switched system or multi-mode multi-dimensional ($M^3D$) system extends the classic switched system by allowing different subsystem dimensions. The stability problem of the $M^3D$ system, whose state transitions at switching instants can be discontinuous due to the dimension-varying feature, is studied. The discontinuous state transition is formulated by an affine map that capt…
▽ More
A multi-dimensional switched system or multi-mode multi-dimensional ($M^3D$) system extends the classic switched system by allowing different subsystem dimensions. The stability problem of the $M^3D$ system, whose state transitions at switching instants can be discontinuous due to the dimension-varying feature, is studied. The discontinuous state transition is formulated by an affine map that captures both the dimension variations and the state impulses, with no extra constraint imposed. In the presence of unstable subsystems, the general criteria featuring a series of Lyapunov-like conditions for the practical and asymptotic stability properties of the $M^3D$ system are provided under the proposed slow/fast transition-dependent average dwell time framework. Then, by considering linear subsystems, we propose a class of parametric multiple Lyapunov functions to verify the obtained Lyapunov-like stability conditions and explicitly reveal a connection between the practical/asymptotic stability property and the non-vanishing/vanishing property of the impulsive effects in the state transition process. Further, the obtained stability results for the $M^3D$ system are applied to the consensus problem of the open multi-agent system (MAS), whose network topology can be switching and size-varying due to the migrations of agents. It shows that through a proper transformation, the seeking of the (practical) consensus performance of the open MAS with disconnected digraphs boils down to that of the (practical) stability property of an $M^3D$ system with unstable subsystems.
△ Less
Submitted 7 October, 2022; v1 submitted 2 January, 2020;
originally announced January 2020.
-
Tracking Control of Nonlinear Networked and Quantized Control Systems with Communication Delays
Authors:
Wei Ren,
Junlin Xiong
Abstract:
This paper studies the tracking control problem of nonlinear networked and quantized control systems (NQCSs) with communication delays. The desired trajectory is generated by a reference system. The communication network is to guarantee the information transmission among the plant, the reference system and the controller. The communication network also brings about some undesired issues like time-…
▽ More
This paper studies the tracking control problem of nonlinear networked and quantized control systems (NQCSs) with communication delays. The desired trajectory is generated by a reference system. The communication network is to guarantee the information transmission among the plant, the reference system and the controller. The communication network also brings about some undesired issues like time-varying transmission intervals, time-varying transmission delays, packet dropouts, scheduling and quantization effects, which lead to non-vanishing network-induced errors and affect the tracking performances. As a result, we develop a general hybrid system model for NQCSs with all aforementioned issues. Based on the Lyapunov approach, sufficient conditions are established to guarantee the stability of the tracking error with respect to the non-vanishing network-induced errors. The obtained conditions lead to a tradeoff between the maximally allowable transmission interval and the maximally allowable delay. Furthermore, the existence of Lyapunov functions satisfying the obtained conditions is studied. For specific time-scheduling protocols (e.g., Round-Robin protocol and Try-Once-Discard protocol) and quantizers (e.g., zoom quantizer and box quantizer), Lyapunov functions are constructed explicitly. Finally, a numerical example is presented to demonstrate the developed theory.
△ Less
Submitted 20 October, 2019;
originally announced October 2019.
-
Robust reconstruction of fluorescence molecular tomography with an optimized illumination pattern
Authors:
Yan Liu,
Wuwei Ren,
Habib Ammari
Abstract:
Fluorescence molecular tomography (FMT) is an emerging powerful tool for biomedical research. There are two factors that influence FMT reconstruction most effectively. The first one is the regularization techniques. Traditional methods such as Tikhonov regularization suffer from low resolution and poor signal to noise ratio. Therefore sparse regularization techniques have been introduced to improv…
▽ More
Fluorescence molecular tomography (FMT) is an emerging powerful tool for biomedical research. There are two factors that influence FMT reconstruction most effectively. The first one is the regularization techniques. Traditional methods such as Tikhonov regularization suffer from low resolution and poor signal to noise ratio. Therefore sparse regularization techniques have been introduced to improve the reconstruction quality. The second factor is the illumination pattern. A better illumination pattern ensures the quantity and quality of the information content of the data set thus leading to better reconstructions. In this work, we take advantage of the discrete formulation of the forward problem to give a rigorous definition of an illumination pattern as well as the admissible set of patterns. We add restrictions in the admissible set as different types of regularizers to a discrepancy functional, generating another inverse problem with the illumination pattern as unknown. Both inverse problems of reconstructing the fluorescence distribution and finding the optimal illumination pattern are solved by fast efficient iterative algorithms. Numerical experiments have shown that with a suitable choice of the regularization parameters the two-step approach converges to an optimal illumination pattern quickly and the reconstruction result is improved significantly, regardless of the initial illumination setting.
△ Less
Submitted 3 October, 2019;
originally announced October 2019.
-
Study of dynamical system based obstacle avoidance via manipulating orthogonal coordinates
Authors:
Weiya Ren
Abstract:
In this paper, we consider the general problem of obstacle avoidance based on dynamical system. The modulation matrix is developed by introducing orthogonal coordinates, which makes the modulation matrix more reasonable. The new trajectory's direction can be represented by the linear combination of orthogonal coordinates. A orthogonal coordinates manipulating approach is proposed by introducing ro…
▽ More
In this paper, we consider the general problem of obstacle avoidance based on dynamical system. The modulation matrix is developed by introducing orthogonal coordinates, which makes the modulation matrix more reasonable. The new trajectory's direction can be represented by the linear combination of orthogonal coordinates. A orthogonal coordinates manipulating approach is proposed by introducing rotating matrix to solve the local minimal problem and provide more reasonable motions in 3-D or higher dimension space. The proposed method also provide a solution for patrolling around a convex shape. Experimental results on several designed dynamical systems demonstrate the effectiveness of the proposed approach.
△ Less
Submitted 16 February, 2019; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Fixed-time consensus of multiple double-integrator systems under directed topologies: A motion-planning approach
Authors:
Yongfang Liu,
Yu Zhao,
Wei Ren,
Guanrong Chen
Abstract:
This paper investigates the fixed-time consensus problem under directed topologies. By using a motion-planning approach, a class of distributed fixed-time algorithms are developed for a multi-agent system with double-integrator dynamics. In the context of the fixed-time consensus, we focus on both directed fixed and switching topologies. Under the directed fixed topology, a novel class of distribu…
▽ More
This paper investigates the fixed-time consensus problem under directed topologies. By using a motion-planning approach, a class of distributed fixed-time algorithms are developed for a multi-agent system with double-integrator dynamics. In the context of the fixed-time consensus, we focus on both directed fixed and switching topologies. Under the directed fixed topology, a novel class of distributed algorithms are designed, which guarantee the consensus of the multi-agent system with a fixed settling time if the topology has a directed spanning tree. Under the directed periodically switching topologies, the fixedtime consensus is solved via the proposed algorithms if the topologies jointly have a directed spanning tree. In particular, the fixed settling time can be off-line pre-assigned according to task requirements. Compared with the existing results, to our best knowledge, it is the first time to solve the fixed-time consensus problem for double-integrator systems under directed topologies. Finally, a numerical example is given to illustrate the effectiveness of the analytical results.
△ Less
Submitted 31 May, 2016;
originally announced May 2016.
-
Dynamic Modularity Approach to Adaptive Inner/Outer Loop Control of Robotic Systems
Authors:
Hanlei Wang,
Wei Ren,
Chien Chern Cheah,
Yongchun Xie,
Shangke Lyu
Abstract:
Modern applications of robotics typically involve a robot control system with an inner PI (proportional-integral) or PID (proportional-integral-derivative) control loop and an outer user-specified control loop. The existing outer loop controllers, however, do not take into consideration the dynamic effects of robots and their effectiveness relies on the ad hoc assumption that the inner PI or PID c…
▽ More
Modern applications of robotics typically involve a robot control system with an inner PI (proportional-integral) or PID (proportional-integral-derivative) control loop and an outer user-specified control loop. The existing outer loop controllers, however, do not take into consideration the dynamic effects of robots and their effectiveness relies on the ad hoc assumption that the inner PI or PID control loop is fast enough, and other torque-based control algorithms cannot be implemented in robotics with closed architecture. This paper investigates the adaptive control of robotic systems with an inner/outer loop structure, taking into full account the effects of the dynamics and the system uncertainties, and both the task-space control and joint-space control are considered. We propose a dynamic modularity approach to resolve this issue, and a class of adaptive outer loop control schemes is proposed and their role is to dynamically generate the joint velocity (or position) command for the low-level joint servoing loop. Without relying on the ad hoc assumption that the joint servoing is fast enough or the modification of the low-level joint controller structure, we rigorously show that the proposed outer loop controllers can ensure the stability and convergence of the closed-loop system. We also propose the outer loop versions of several standard joint-space direct/composite adaptive controllers for rigid or flexible-joint robots, and a promising conclusion may be that most torque-based adaptive controllers for robots can be designed to fit the inner/outer loop structure by using the new definition of the joint velocity (or position) command. Simulation results are provided to show the performance of various adaptive outer loop controllers, using a three-DOF (degree-of-freedom) manipulator, and experiment results using the UR10 robotic system are also presented.
△ Less
Submitted 7 January, 2017; v1 submitted 17 March, 2016;
originally announced March 2016.
-
On Convergence Rate of Leader-Following Consensus of Linear Multi-Agent Systems with Communication Noises
Authors:
Long Cheng,
Yunpeng Wang,
Wei Ren,
Zeng-Guang Hou,
Min Tan
Abstract:
This note further studies the previously proposed consensus protocol for linear multi-agent systems with communication noises in [15], [16]. Each agent is allowed to have its own time-varying gain to attenuate the effect of communication noises. Therefore, the common assumption in most references that all agents have the same noise-attenuation gain is not necessary. It has been proved that if all…
▽ More
This note further studies the previously proposed consensus protocol for linear multi-agent systems with communication noises in [15], [16]. Each agent is allowed to have its own time-varying gain to attenuate the effect of communication noises. Therefore, the common assumption in most references that all agents have the same noise-attenuation gain is not necessary. It has been proved that if all noise-attenuation gains are infinitesimal of the same order, then the mean square leader-following consensus can be reached. Furthermore, the convergence rate of the multi-agent system has been investigated. If the noise-attenuation gains belong to a class of functions which are bounded above and below by $t^{-β}$ $(β\in(0,1))$ asymptotically, then the states of all follower agents are convergent in mean square to the leader's state with the rate characterized by a function bounded above by $t^{-β}$ asymptotically.
△ Less
Submitted 27 August, 2015;
originally announced August 2015.
-
Containment Control of Multi-Agent Systems with Dynamic Leaders Based on a $PI^n$-Type Approach
Authors:
Yunpeng Wang,
Long Cheng,
Wei Ren,
Zeng-Guang Hou,
Min Tan
Abstract:
This paper studies the containment control problem of multi-agent systems with multiple dynamic leaders in both the discrete-time domain and the continuous-time domain. The leaders' motions are described by $(n-1)$-order polynomial trajectories. This setting makes practical sense because given some critical points, the leaders' trajectories are usually planned by the polynomial interpolations. In…
▽ More
This paper studies the containment control problem of multi-agent systems with multiple dynamic leaders in both the discrete-time domain and the continuous-time domain. The leaders' motions are described by $(n-1)$-order polynomial trajectories. This setting makes practical sense because given some critical points, the leaders' trajectories are usually planned by the polynomial interpolations. In order to drive all followers into the convex hull spanned by the leaders, a $PI^n$-type ($P$ and $I$ are short for {\it Proportion} and {\it Integration}, respectively; $I^n$ implies that the algorithm includes high-order integral terms) containment algorithm is proposed. It is theoretically proved that the $PI^n$-type containment algorithm is able to solve the containment problem of multi-agent systems where the followers are described by any order integral dynamics. Compared with the previous results on the multi-agent systems with dynamic leaders, the distinguished features of this paper are that: (1) the containment problem is studied not only in the continuous-time domain but also in the discrete-time domain while most existing results only work in the continuous-time domain; (2) to deal with the leaders with the $(n-1)$-order polynomial trajectories, existing results require the follower's dynamics to be $n$-order integral while the followers considered in this paper can be described by any-order integral; and (3) the "sign" function is not employed in the proposed algorithm, which avoids the chattering phenomenon. Furthermore, in order to illustrate the practical value of the proposed approach, an application, the containment control of multiple mobile robots is studied. Finally, two simulation examples are given to demonstrate the effectiveness of the proposed algorithm.
△ Less
Submitted 27 August, 2015; v1 submitted 16 November, 2014;
originally announced November 2014.
-
Cooperative Control of Linear Multi-Agent Systems via Distributed Output Regulation and Transient Synchronization
Authors:
Georg Seyboth,
Wei Ren,
Frank Allgöwer
Abstract:
A wide range of multi-agent coordination problems including reference tracking and disturbance rejection requirements can be formulated as a cooperative output regulation problem. The general framework captures typical problems such as output synchronization, leader-follower synchronization, and many more. In the present paper, we propose a novel distributed regulator for groups of identical and n…
▽ More
A wide range of multi-agent coordination problems including reference tracking and disturbance rejection requirements can be formulated as a cooperative output regulation problem. The general framework captures typical problems such as output synchronization, leader-follower synchronization, and many more. In the present paper, we propose a novel distributed regulator for groups of identical and non-identical linear agents. We consider global external signals affecting all agents and local external signals affecting only individual agents in the group. Both signal types may contain references and disturbances. Our main contribution is a novel coupling among the agents based on their transient state components or estimates thereof in the output feedback case. This coupling achieves transient synchronization in order to improve the cooperative behavior of the group in transient phases and guarantee a desired decay rate of the synchronization error. This leads to a cooperative reaction of the group on local disturbances acting on individual agents. The effectiveness of the proposed distributed regulator is illustrated by a vehicle platooning example and a coordination example for a group of four non-identical 3-DoF helicopter models.
△ Less
Submitted 31 May, 2014;
originally announced June 2014.
-
Containment Control of Linear Multi-Agent Systems with Multiple Leaders of Bounded Inputs Using Distributed Continuous Controllers
Authors:
Zhongkui Li,
Zhisheng Duan,
Wei Ren,
Gang Feng
Abstract:
This paper considers the containment control problem for multi-agent systems with general linear dynamics and multiple leaders whose control inputs are possibly nonzero and time varying. Based on the relative states of neighboring agents, a distributed static continuous controller is designed, under which the containment error is uniformly ultimately bounded and the upper bound of the containment…
▽ More
This paper considers the containment control problem for multi-agent systems with general linear dynamics and multiple leaders whose control inputs are possibly nonzero and time varying. Based on the relative states of neighboring agents, a distributed static continuous controller is designed, under which the containment error is uniformly ultimately bounded and the upper bound of the containment error can be made arbitrarily small, if the subgraph associated with the followers is undirected and for each follower there exists at least one leader that has a directed path to that follower. It is noted that the design of the static controller requires the knowledge of the eigenvalues of the Laplacian matrix and the upper bounds of the leaders' control inputs. In order to remove these requirements, a distributed adaptive continuous controller is further proposed, which can be designed and implemented by each follower in a fully distributed fashion. Extensions to the case where only local output information is available are discussed.
△ Less
Submitted 28 December, 2013;
originally announced December 2013.
-
Designing Fully Distributed Consensus Protocols for Linear Multi-agent Systems with Directed Graphs
Authors:
Zhongkui Li,
Guanghui Wen,
Zhisheng Duan,
Wei Ren
Abstract:
This paper addresses the distributed consensus protocol design problem for multi-agent systems with general linear dynamics and directed communication graphs. Existing works usually design consensus protocols using the smallest real part of the nonzero eigenvalues of the Laplacian matrix associated with the communication graph, which however is global information. In this paper, based on only the…
▽ More
This paper addresses the distributed consensus protocol design problem for multi-agent systems with general linear dynamics and directed communication graphs. Existing works usually design consensus protocols using the smallest real part of the nonzero eigenvalues of the Laplacian matrix associated with the communication graph, which however is global information. In this paper, based on only the agent dynamics and the relative states of neighboring agents, a distributed adaptive consensus protocol is designed to achieve leader-follower consensus for any communication graph containing a directed spanning tree with the leader as the root node. The proposed adaptive protocol is independent of any global information of the communication graph and thereby is fully distributed. Extensions to the case with multiple leaders are further studied.
△ Less
Submitted 20 August, 2014; v1 submitted 27 December, 2013;
originally announced December 2013.
-
Finite-time Consensus for Multi-agent Networks with Unknown Inherent Nonlinear Dynamics
Authors:
Yongcan Cao,
Wei Ren
Abstract:
This paper focuses on analyzing the finite-time convergence of a nonlinear consensus algorithm for multi-agent networks with unknown inherent nonlinear dynamics. Due to the existence of the unknown inherent nonlinear dynamics, the stability analysis and the finite-time convergence analysis of the closed-loop system under the proposed consensus algorithm are more challenging than those under the we…
▽ More
This paper focuses on analyzing the finite-time convergence of a nonlinear consensus algorithm for multi-agent networks with unknown inherent nonlinear dynamics. Due to the existence of the unknown inherent nonlinear dynamics, the stability analysis and the finite-time convergence analysis of the closed-loop system under the proposed consensus algorithm are more challenging than those under the well-studied consensus algorithms for known linear systems. For this purpose, we propose a novel stability tool based on a generalized comparison lemma. With the aid of the novel stability tool, it is shown that the proposed nonlinear consensus algorithm can guarantee finite-time convergence if the directed switching interaction graph has a directed spanning tree at each time interval. Specifically, the finite-time convergence is shown by comparing the closed-loop system under the proposed consensus algorithm with some well-designed closed-loop system whose stability properties are easier to obtain. Moreover, the stability and the finite-time convergence of the closed-loop system using the proposed consensus algorithm under a (general) directed switching interaction graph can even be guaranteed by the stability and the finite-time convergence of some special well-designed nonlinear closed-loop system under some special directed switching interaction graph, where each agent has at most one neighbor whose state is either the maximum of those states that are smaller than its own state or the minimum of those states that are larger than its own state. This provides a stimulating example for the potential applications of the proposed novel stability tool in the stability analysis of linear/nonlinear closed-loop systems by making use of known results in linear/nonlinear systems. For illustration of the theoretical result, we provide a simulation example.
△ Less
Submitted 19 February, 2013;
originally announced February 2013.
-
Distributed Consensus of Linear Multi-Agent Systems with Adaptive Dynamic Protocols
Authors:
Zhongkui Li,
Xiangdong Liu,
Wei Ren,
Lihua Xie
Abstract:
This paper considers the distributed consensus problem of multi-agent systems with general continuous-time linear dynamics. Two distributed adaptive dynamic consensus protocols are proposed, based on the relative output information of neighboring agents. One protocol assigns an adaptive coupling weight to each edge in the communication graph while the other uses an adaptive coupling weight for eac…
▽ More
This paper considers the distributed consensus problem of multi-agent systems with general continuous-time linear dynamics. Two distributed adaptive dynamic consensus protocols are proposed, based on the relative output information of neighboring agents. One protocol assigns an adaptive coupling weight to each edge in the communication graph while the other uses an adaptive coupling weight for each node. These two adaptive protocols are designed to ensure that consensus is reached in a fully distributed fashion for any undirected connected communication graphs without using any global information. A sufficient condition for the existence of these adaptive protocols is that each agent is stabilizable and detectable. The cases with leader-follower and switching communication graphs are also studied.
△ Less
Submitted 22 September, 2011; v1 submitted 17 September, 2011;
originally announced September 2011.
-
Consensus of Multi-Agent Systems with General Linear and Lipschitz Nonlinear Dynamics Using Distributed Adaptive Protocols
Authors:
Zhongkui Li,
Wei Ren,
Xiangdong Liu,
Mengyin Fu
Abstract:
This paper considers the distributed consensus problems for multi-agent systems with general linear and Lipschitz nonlinear dynamics. Distributed relative-state consensus protocols with an adaptive law for adjusting the coupling weights between neighboring agents are designed for both the linear and nonlinear cases, under which consensus is reached for all undirected connected communication graphs…
▽ More
This paper considers the distributed consensus problems for multi-agent systems with general linear and Lipschitz nonlinear dynamics. Distributed relative-state consensus protocols with an adaptive law for adjusting the coupling weights between neighboring agents are designed for both the linear and nonlinear cases, under which consensus is reached for all undirected connected communication graphs. Extensions to the case with a leader-follower communication graph are further studied. In contrast to the existing results in the literature, the adaptive consensus protocols here can be implemented by each agent in a fully distributed fashion without using any global information.
△ Less
Submitted 17 September, 2011;
originally announced September 2011.