Showing 1–30 of 30 results for author: Wen, F

Power System Fault Diagnosis with Quantum Computing and Efficient Gate Decomposition

Authors: Xiang Fei, Huan Zhao, Xiyuan Zhou, Junhua Zhao, Ting Shu, Fushuan Wen

Abstract: Power system fault diagnosis is crucial for identifying the location and causes of faults and providing decision-making support for power dispatchers. However, most classical methods suffer from significant time-consuming, memory overhead, and computational complexity issues as the scale of the power system concerned increases. With rapid development of quantum computing technology, the combinator… ▽ More Power system fault diagnosis is crucial for identifying the location and causes of faults and providing decision-making support for power dispatchers. However, most classical methods suffer from significant time-consuming, memory overhead, and computational complexity issues as the scale of the power system concerned increases. With rapid development of quantum computing technology, the combinatorial optimization method based on quantum computing has shown certain advantages in computational time over existing methods. Given this background, this paper proposes a quantum computing based power system fault diagnosis method with the Quantum Approximate Optimization Algorithm (QAOA). The proposed method reformulates the fault diagnosis problem as a Hamiltonian by using Ising model, which completely preserves the coupling relationship between faulty components and various operations of protective relays and circuit breakers. Additionally, to enhance problem-solving efficiency under current equipment limitations, the symmetric equivalent decomposition method of multi-z-rotation gate is proposed. Furthermore, the small probability characteristics of power system events is utilized to reduce the number of qubits. Simulation results based on the test system show that the proposed methods can achieve the same optimal results with a faster speed compared with the classical higher-order solver provided by D-Wave. △ Less

Submitted 18 January, 2024; originally announced January 2024.

Applying Large Language Models to Power Systems: Potential Security Threats

Authors: Jiaqi Ruan, Gaoqi Liang, Huan Zhao, Guolong Liu, Xianzhuo Sun, Jing Qiu, Zhao Xu, Fushuan Wen, Zhao Yang Dong

Abstract: Applying large language models (LLMs) to modern power systems presents a promising avenue for enhancing decision-making and operational efficiency. However, this action may also incur potential security threats, which have not been fully recognized so far. To this end, this article analyzes potential threats incurred by applying LLMs to power systems, emphasizing the need for urgent research and d… ▽ More Applying large language models (LLMs) to modern power systems presents a promising avenue for enhancing decision-making and operational efficiency. However, this action may also incur potential security threats, which have not been fully recognized so far. To this end, this article analyzes potential threats incurred by applying LLMs to power systems, emphasizing the need for urgent research and development of countermeasures. △ Less

Submitted 24 January, 2024; v1 submitted 22 November, 2023; originally announced November 2023.

Integrated Sensing and Channel Estimation by Exploiting Dual Timescales for Delay-Doppler Alignment Modulation

Authors: Zhiqiang Xiao, Yong Zeng, Fuxi Wen, Zaichen Zhang, Derrick Wing Kwan Ng

Abstract: For integrated sensing and communication (ISAC) systems, the channel information essential for communication and sensing tasks fluctuates across different timescales. Specifically, wireless sensing primarily focuses on acquiring path state information (PSI) (e.g., delay, angle, and Doppler) of individual multi-path components to sense the environment, which usually evolves much more slowly than th… ▽ More For integrated sensing and communication (ISAC) systems, the channel information essential for communication and sensing tasks fluctuates across different timescales. Specifically, wireless sensing primarily focuses on acquiring path state information (PSI) (e.g., delay, angle, and Doppler) of individual multi-path components to sense the environment, which usually evolves much more slowly than the composite channel state information (CSI) required for communications. Typically, the CSI is approximately unchanged during the channel coherence time, which characterizes the statistical properties of wireless communication channels. However, this concept is less appropriate for describing that for wireless sensing. To this end, in this paper, we introduce a new timescale to study the variation of the PSI from a channel geometric perspective, termed path invariant time, during which the PSI largely remains constant. Our analysis indicates that the path invariant time considerably exceeds the channel coherence time. Thus, capitalizing on these dual timescales of the wireless channel, in this paper, we propose a novel ISAC framework exploiting the recently proposed delay-Doppler alignment modulation (DDAM) technique. Different from most existing studies on DDAM that assume the availability of perfect PSI, in this work, we propose a novel algorithm, termed as adaptive simultaneously orthogonal matching pursuit with support refinement (ASOMP-SR), for joint environment sensing and PSI estimation. We also analyze the performance of DDAM with imperfectly sensed PSI.Simulation results unveil that the proposed DDAM-based ISAC can achieve superior spectral efficiency and a reduced peak-to-average power ratio (PAPR) compared to standard orthogonal frequency division multiplexing (OFDM). △ Less

Submitted 17 October, 2023; originally announced October 2023.

A Two-Stage Training Framework for Joint Speech Compression and Enhancement

Authors: Jiayi Huang, Zeyu Yan, Wenbin Jiang, Fei Wen

Abstract: This paper considers the joint compression and enhancement problem for speech signal in the presence of noise. Recently, the SoundStream codec, which relies on end-to-end joint training of an encoder-decoder pair and a residual vector quantizer by a combination of adversarial and reconstruction losses,has shown very promising performance, especially in subjective perception quality. In this work,… ▽ More This paper considers the joint compression and enhancement problem for speech signal in the presence of noise. Recently, the SoundStream codec, which relies on end-to-end joint training of an encoder-decoder pair and a residual vector quantizer by a combination of adversarial and reconstruction losses,has shown very promising performance, especially in subjective perception quality. In this work, we provide a theoretical result to show that, to simultaneously achieve low distortion and high perception in the presence of noise, there exist an optimal two-stage optimization procedure for the joint compression and enhancement problem. This procedure firstly optimizes an encoder-decoder pair using only distortion loss and then fixes the encoder to optimize a perceptual decoder using perception loss. Based on this result, we construct a two-stage training framework for joint compression and enhancement of noisy speech signal. Unlike existing training methods which are heuristic, the proposed two-stage training method has a theoretical foundation. Finally, experimental results for various noise and bit-rate conditions are provided. The results demonstrate that a codec trained by the proposed framework can outperform SoundStream and other representative codecs in terms of both objective and subjective evaluation metrics. Code is available at \textit{https://github.com/jscscloris/SEStream}. △ Less

Submitted 8 September, 2023; originally announced September 2023.

Sparsity-Aware Optimal Transport for Unsupervised Restoration Learning

Authors: Fei Wen, Wei Wang, Wenxian Yu

Abstract: Recent studies show that, without any prior model, the unsupervised restoration learning problem can be optimally formulated as an optimal transport (OT) problem, which has shown promising performance on denoising tasks to approach the performance of supervised methods. However, it still significantly lags behind state-of-the-art supervised methods on complex restoration tasks such as super-resolu… ▽ More Recent studies show that, without any prior model, the unsupervised restoration learning problem can be optimally formulated as an optimal transport (OT) problem, which has shown promising performance on denoising tasks to approach the performance of supervised methods. However, it still significantly lags behind state-of-the-art supervised methods on complex restoration tasks such as super-resolution, deraining, and dehazing. In this paper, we exploit the sparsity of degradation in the OT framework to significantly boost its performance on these tasks. First, we disclose an observation that the degradation in these tasks is quite sparse in the frequency domain, and then propose a sparsity-aware optimal transport (SOT) criterion for unsupervised restoration learning. Further, we provide an analytic example to illustrate that exploiting the sparsity helps to reduce the ambiguity in finding an inverse map for restoration. Experiments on real-world super-resolution, deraining, and dehazing demonstrate that SOT can improve the PSNR of OT by about 2.6 dBでしべる, 2.7 dBでしべる and 1.3 dBでしべる, respectively, while achieving the best perception scores among the compared supervised and unsupervised methods. Particularly, on the three tasks, SOT significantly outperforms existing unsupervised methods and approaches the performance of state-of-the-art supervised methods. △ Less

Submitted 29 April, 2023; originally announced May 2023.

Comments: 15 pages, 9 figures

Vision Aided Environment Semantics Extraction and Its Application in mmWave Beam Selection

Authors: Feiyang Wen, Weihua Xu, Feifei Gao, Chengkang Pan, Guangyi Liu

Abstract: In this letter, we propose a novel mmWave beam selection method based on the environment semantics extracted from user-side camera images. Specifically, we first define the environment semantics as the spatial distribution of the scatterers that affect the wireless propagation channels and utilize the keypoint detection technique to extract them from the input images. Then, we design a deep neural… ▽ More In this letter, we propose a novel mmWave beam selection method based on the environment semantics extracted from user-side camera images. Specifically, we first define the environment semantics as the spatial distribution of the scatterers that affect the wireless propagation channels and utilize the keypoint detection technique to extract them from the input images. Then, we design a deep neural network with the environment semantics as the input that can output the optimal beam pairs at the mobile station (MS) and the base station (BS). Compared with the existing beam selection approaches that directly use images as the input, the proposed semantic-based method can explicitly obtain the environmental features that account for the propagation of wireless signals, thus reducing the storage and computational burden. Simulation results show that the proposed method can precisely estimate the location of the scatterers and outperform the existing works based on computer vision or light detection and ranging (LIDAR). △ Less

Submitted 22 April, 2023; v1 submitted 21 January, 2023; originally announced January 2023.

Cyber-physical interdependent restoration scheduling for active distribution network via ad hoc wireless communication

Authors: Chongyu Wang, Mingyu Yan, Kaiyuan Pang, Fushuan Wen, Fei Teng

Abstract: This paper proposes a post-disaster cyber-physical interdependent restoration scheduling (CPIRS) framework for active distribution networks (ADN) where the simultaneous damages on cyber and physical networks are considered. The ad hoc wireless device-to-device (D2D) communication is leveraged, for the first time, to establish cyber networks instantly after the disaster to support ADN restoration.… ▽ More This paper proposes a post-disaster cyber-physical interdependent restoration scheduling (CPIRS) framework for active distribution networks (ADN) where the simultaneous damages on cyber and physical networks are considered. The ad hoc wireless device-to-device (D2D) communication is leveraged, for the first time, to establish cyber networks instantly after the disaster to support ADN restoration. The repair and operation crew dispatching, the remote-controlled network reconfiguration and the system operation with DERs can be effectively coordinated under the cyber-physical interactions. The uncertain outputs of renewable energy resources (RESs) are represented by budget-constrained polyhedral uncertainty sets. Through implementing linearization techniques on disjunctive expressions, a monolithic mixed-integer linear programming (MILP) based two-stage robust optimization model is formulated and subsequently solved by a customized column-and-constraint generation (C&CG) algorithm. Numerical results on the IEEE 123-node distribution system demonstrate the effectiveness and superiorities of the proposed CPIRS method for ADN. △ Less

Submitted 5 November, 2022; originally announced November 2022.

An Iterative 5G Positioning and Synchronization Algorithm in NLOS Environments with Multi-Bounce Paths

Authors: Zhixing Li, Fan Jiang, Henk Wymeersch, Fuxi Wen

Abstract: 5G positioning is a very promising area that presents many opportunities and challenges. Many existing techniques rely on multiple anchor nodes and line-of-sight (LOS) paths, or single reference node and single-bounce non-LOS (NLOS) paths. However, in dense multipath environments, identifying the LOS or single-bounce assumptions is challenging. The multi-bounce paths will make the positioning accu… ▽ More 5G positioning is a very promising area that presents many opportunities and challenges. Many existing techniques rely on multiple anchor nodes and line-of-sight (LOS) paths, or single reference node and single-bounce non-LOS (NLOS) paths. However, in dense multipath environments, identifying the LOS or single-bounce assumptions is challenging. The multi-bounce paths will make the positioning accuracy deteriorate significantly. We propose a robust 5G positioning algorithm in NLOS multipath environments. The corresponding positioning problem is formulated as an iterative and weighted least squares problem, and different weights are utilized to mitigate the effects of multi-bounce paths. Numerical simulations are carried out to evaluate the performance of the proposed algorithm. Compared with the benchmark positioning algorithms only using the single-bounce paths, similar positioning accuracy is achieved for the proposed algorithm. △ Less

Submitted 4 September, 2022; originally announced September 2022.

Journal ref: IEEE Wireless Communications Letters 2023

Optimally Controllable Perceptual Lossy Compression

Authors: Zeyu Yan, Fei Wen, Peilin Liu

Abstract: Recent studies in lossy compression show that distortion and perceptual quality are at odds with each other, which put forward the tradeoff between distortion and perception (D-P). Intuitively, to attain different perceptual quality, different decoders have to be trained. In this paper, we present a nontrivial finding that only two decoders are sufficient for optimally achieving arbitrary (an infi… ▽ More Recent studies in lossy compression show that distortion and perceptual quality are at odds with each other, which put forward the tradeoff between distortion and perception (D-P). Intuitively, to attain different perceptual quality, different decoders have to be trained. In this paper, we present a nontrivial finding that only two decoders are sufficient for optimally achieving arbitrary (an infinite number of different) D-P tradeoff. We prove that arbitrary points of the D-P tradeoff bound can be achieved by a simple linear interpolation between the outputs of a minimum MSE decoder and a specifically constructed perfect perceptual decoder. Meanwhile, the perceptual quality (in terms of the squared Wasserstein-2 distance metric) can be quantitatively controlled by the interpolation factor. Furthermore, to construct a perfect perceptual decoder, we propose two theoretically optimal training frameworks. The new frameworks are different from the distortion-plus-adversarial loss based heuristic framework widely used in existing methods, which are not only theoretically optimal but also can yield state-of-the-art performance in practical perceptual decoding. Finally, we validate our theoretical finding and demonstrate the superiority of our frameworks via experiments. Code is available at: https://github.com/ZeyuYan/Controllable-Perceptual-Compression △ Less

Submitted 20 June, 2022; originally announced June 2022.

Comments: ICML 2022

Beamspace Multidimensional ESPRIT Approaches for Simultaneous Localization and Communications

Authors: Fan Jiang, Fuxi Wen, Yu Ge, Meifang Zhu, Henk Wymeersch, Fredrik Tufvesson

Abstract: Modern wireless communication systems operating at high carrier frequencies are characterized by a high dimensionality of the underlying parameter space (including channel gains, angles, delays, and possibly Doppler shifts). Estimating these parameters is valuable for communication purposes, but also for localization and sensing, making channel estimation a critical component in any joint communic… ▽ More Modern wireless communication systems operating at high carrier frequencies are characterized by a high dimensionality of the underlying parameter space (including channel gains, angles, delays, and possibly Doppler shifts). Estimating these parameters is valuable for communication purposes, but also for localization and sensing, making channel estimation a critical component in any joint communication and localization or sensing application. The high dimensionality make it difficult to use search-based methods such as maximum likelihood. Search-free methods such as ESPRIT provide an attractive alternative, but require a complex decomposition step in both the tensor and matrix version of ESPRIT. To mitigate this, we propose, develop, and analyze a reduced complexity beamspace ESPRIT method. Complexity is reduced both by beampace processing as well as low-complex implementation of the singular value decomposition. A novel perturbation analysis provides important insights for both channel estimation and localization performance. The proposed method is compared to the tensor ESPRIT method, in terms of channel estimation, communication, localization, and sensing performance, further validating the perturbation analysis. △ Less

Submitted 14 November, 2021; originally announced November 2021.

Comments: 17 pages, 7 figures

Masks Fusion with Multi-Target Learning For Speech Enhancement

Authors: Liangchen Zhou, Wenbin Jiang, Jingyan Xu, Fei Wen, Peilin Liu

Abstract: Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of noisy speech in an order to suppress the noise. This work proposes a multi-mask fusion method for speech enhancement. It simultaneously estimates two complement… ▽ More Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of noisy speech in an order to suppress the noise. This work proposes a multi-mask fusion method for speech enhancement. It simultaneously estimates two complementary masks, e.g., ideal ratio mask (IRM) and target binary mask (TBM), and then fuse them to obtain a refined mask for speech enhancement. The advantage of the new method is twofold. First, simultaneously estimating multiple complementary masks brings benefit endowed by multi-target learning. Second, multi-mask fusion can exploit the complementarity of multiple masks to boost the performance of speech enhancement. Experimental results show that the proposed method can achieve significant PESQ improvement and reduce the recognition error rate of back-end over traditional masking-based methods. Code is available at https://github.com/lc-zhou/mask-fusion. △ Less

Submitted 27 September, 2021; v1 submitted 23 September, 2021; originally announced September 2021.

Optimal Transport for Unsupervised Denoising Learning

Authors: Wei Wang, Fei Wen, Zeyu Yan, Peilin Liu

Abstract: Recently, much progress has been made in unsupervised denoising learning. However, existing methods more or less rely on some assumptions on the signal and/or degradation model, which limits their practical performance. How to construct an optimal criterion for unsupervised denoising learning without any prior knowledge on the degradation model is still an open question. Toward answering this ques… ▽ More Recently, much progress has been made in unsupervised denoising learning. However, existing methods more or less rely on some assumptions on the signal and/or degradation model, which limits their practical performance. How to construct an optimal criterion for unsupervised denoising learning without any prior knowledge on the degradation model is still an open question. Toward answering this question, this work proposes a criterion for unsupervised denoising learning based on the optimal transport theory. This criterion has favorable properties, e.g., approximately maximal preservation of the information of the signal, whilst achieving perceptual reconstruction. Furthermore, though a relaxed unconstrained formulation is used in practical implementation, we prove that the relaxed formulation in theory has the same solution as the original constrained formulation. Experiments on synthetic and real-world data, including realistic photographic, microscopy, depth, and raw depth images, demonstrate that the proposed method even compares favorably with supervised methods, e.g., approaching the PSNR of supervised methods while having better perceptual quality. Particularly, for spatially correlated noise and realistic microscopy images, the proposed method not only achieves better perceptual quality but also has higher PSNR than supervised methods. Besides, it shows remarkable superiority in harsh practical conditions with complex noise, e.g., raw depth images. Code is available at https://github.com/wangweiSJTU/OTUR. △ Less

Submitted 28 April, 2022; v1 submitted 3 August, 2021; originally announced August 2021.

Comments: Published in IEEE TPAMI, DOI: 10.1109/TPAMI.2022.3170155, https://ieeexplore.ieee.org/document/9763342 (40 pages, 33 figures)

Journal ref: IEEE Transactions on Pattern Analysis and Machine Intelligence (2022) 1-1

Scalable Deep Compressive Sensing

Authors: Zhonghao Zhang, Yipeng Liu, Xingyu Cao, Fei Wen, Ce Zhu

Abstract: Deep learning has been used to image compressive sensing (CS) for enhanced reconstruction performance. However, most existing deep learning methods train different models for different subsampling ratios, which brings additional hardware burden. In this paper, we develop a general framework named scalable deep compressive sensing (SDCS) for the scalable sampling and reconstruction (SSR) of all exi… ▽ More Deep learning has been used to image compressive sensing (CS) for enhanced reconstruction performance. However, most existing deep learning methods train different models for different subsampling ratios, which brings additional hardware burden. In this paper, we develop a general framework named scalable deep compressive sensing (SDCS) for the scalable sampling and reconstruction (SSR) of all existing end-to-end-trained models. In the proposed way, images are measured and initialized linearly. Two sampling masks are introduced to flexibly control the subsampling ratios used in sampling and reconstruction, respectively. To make the reconstruction model adapt to any subsampling ratio, a training strategy dubbed scalable training is developed. In scalable training, the model is trained with the sampling matrix and the initialization matrix at various subsampling ratios by integrating different sampling matrix masks. Experimental results show that models with SDCS can achieve SSR without changing their structure while maintaining good performance, and SDCS outperforms other SSR methods. △ Less

Submitted 21 January, 2021; v1 submitted 20 January, 2021; originally announced January 2021.

Hyperspectral Image Denoising with Partially Orthogonal Matrix Vector Tensor Factorization

Authors: Zhen Long, Yipeng Liu, Sixing Zeng, Jiani Liu, Fei Wen, Ce Zhu

Abstract: Hyperspectral image (HSI) has some advantages over natural image for various applications due to the extra spectral information. During the acquisition, it is often contaminated by severe noises including Gaussian noise, impulse noise, deadlines, and stripes. The image quality degeneration would badly effect some applications. In this paper, we present a HSI restoration method named smooth and rob… ▽ More Hyperspectral image (HSI) has some advantages over natural image for various applications due to the extra spectral information. During the acquisition, it is often contaminated by severe noises including Gaussian noise, impulse noise, deadlines, and stripes. The image quality degeneration would badly effect some applications. In this paper, we present a HSI restoration method named smooth and robust low rank tensor recovery. Specifically, we propose a structural tensor decomposition in accordance with the linear spectral mixture model of HSI. It decomposes a tensor into sums of outer matrix vector products, where the vectors are orthogonal due to the independence of endmember spectrums. Based on it, the global low rank tensor structure can be well exposited for HSI denoising. In addition, the 3D anisotropic total variation is used for spatial spectral piecewise smoothness of HSI. Meanwhile, the sparse noise including impulse noise, deadlines and stripes, is detected by the l1 norm regularization. The Frobenius norm is used for the heavy Gaussian noise in some real world scenarios. The alternating direction method of multipliers is adopted to solve the proposed optimization model, which simultaneously exploits the global low rank property and the spatial spectral smoothness of the HSI. Numerical experiments on both simulated and real data illustrate the superiority of the proposed method in comparison with the existing ones. △ Less

Submitted 28 June, 2020; originally announced July 2020.

PriorGAN: Real Data Prior for Generative Adversarial Nets

Authors: Shuyang Gu, Jianmin Bao, Dong Chen, Fang Wen

Abstract: Generative adversarial networks (GANs) have achieved rapid progress in learning rich data distributions. However, we argue about two main issues in existing techniques. First, the low quality problem where the learned distribution has massive low quality samples. Second, the missing modes problem where the learned distribution misses some certain regions of the real data distribution. To address t… ▽ More Generative adversarial networks (GANs) have achieved rapid progress in learning rich data distributions. However, we argue about two main issues in existing techniques. First, the low quality problem where the learned distribution has massive low quality samples. Second, the missing modes problem where the learned distribution misses some certain regions of the real data distribution. To address these two issues, we propose a novel prior that captures the whole real data distribution for GANs, which are called PriorGANs. To be specific, we adopt a simple yet elegant Gaussian Mixture Model (GMM) to build an explicit probability distribution on the feature level for the whole real data. By maximizing the probability of generated data, we can push the low quality samples to high quality. Meanwhile, equipped with the prior, we can estimate the missing modes in the learned distribution and design a sampling strategy on the real data to solve the problem. The proposed real data prior can generalize to various training settings of GANs, such as LSGAN, WGAN-GP, SNGAN, and even the StyleGAN. Our experiments demonstrate that PriorGANs outperform the state-of-the-art on the CIFAR-10, FFHQ, LSUN-cat, and LSUN-bird datasets by large margins. △ Less

Submitted 30 June, 2020; originally announced June 2020.

Exploiting Diffuse Multipath in 5G SLAM

Authors: Yu Ge, Hyowon Kim, Fuxi Wen, Lennart Svensson, Sunwoo Kim, Henk Wymeersch

Abstract: 5G millimeter wave (mmWave) signals can be used to jointly localize the receiver and map the propagation environment in vehicular networks, which is a typical simultaneous localization and mapping (SLAM) problem. Mapping the environment is challenging, due to measurements comprising both specular and diffuse multipath components, and diffuse multipath is usually considered as a perturbation. We he… ▽ More 5G millimeter wave (mmWave) signals can be used to jointly localize the receiver and map the propagation environment in vehicular networks, which is a typical simultaneous localization and mapping (SLAM) problem. Mapping the environment is challenging, due to measurements comprising both specular and diffuse multipath components, and diffuse multipath is usually considered as a perturbation. We here propose a novel method to utilize all available multipath signals from each landmark for mapping and incorporate this into a Poisson multi-Bernoulli mixture for the 5G SLAM problem. Simulation results demonstrate the efficacy of the proposed scheme. △ Less

Submitted 28 June, 2020; originally announced June 2020.

Comments: 6 pages, 9 figures

AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensing

Authors: Zhonghao Zhang, Yipeng Liu, Jiani Liu, Fei Wen, Ce Zhu

Abstract: Most compressive sensing (CS) reconstruction methods can be divided into two categories, i.e. model-based methods and classical deep network methods. By unfolding the iterative optimization algorithm for model-based methods onto networks, deep unfolding methods have the good interpretation of model-based methods and the high speed of classical deep network methods. In this paper, to solve the visu… ▽ More Most compressive sensing (CS) reconstruction methods can be divided into two categories, i.e. model-based methods and classical deep network methods. By unfolding the iterative optimization algorithm for model-based methods onto networks, deep unfolding methods have the good interpretation of model-based methods and the high speed of classical deep network methods. In this paper, to solve the visual image CS problem, we propose a deep unfolding model dubbed AMP-Net. Rather than learning regularization terms, it is established by unfolding the iterative denoising process of the well-known approximate message passing algorithm. Furthermore, AMP-Net integrates deblocking modules in order to eliminate the blocking artifacts that usually appear in CS of visual images. In addition, the sampling matrix is jointly trained with other network parameters to enhance the reconstruction performance. Experimental results show that the proposed AMP-Net has better reconstruction accuracy than other state-of-the-art methods with high reconstruction speed and a small number of network parameters. △ Less

Submitted 21 January, 2021; v1 submitted 21 April, 2020; originally announced April 2020.

Journal ref: IEEE Transactions on Image Processing 2021

Bringing Old Photos Back to Life

Authors: Ziyu Wan, Bo Zhang, Dongdong Chen, Pan Zhang, Dong Chen, Jing Liao, Fang Wen

Abstract: We propose to restore old photos that suffer from severe degradation through a deep learning approach. Unlike conventional restoration tasks that can be solved through supervised learning, the degradation in real photos is complex and the domain gap between synthetic images and real old photos makes the network fail to generalize. Therefore, we propose a novel triplet domain translation network by… ▽ More We propose to restore old photos that suffer from severe degradation through a deep learning approach. Unlike conventional restoration tasks that can be solved through supervised learning, the degradation in real photos is complex and the domain gap between synthetic images and real old photos makes the network fail to generalize. Therefore, we propose a novel triplet domain translation network by leveraging real photos along with massive synthetic image pairs. Specifically, we train two variational autoencoders (VAEs) to respectively transform old photos and clean photos into two latent spaces. And the translation between these two latent spaces is learned with synthetic paired data. This translation generalizes well to real photos because the domain gap is closed in the compact latent space. Besides, to address multiple degradations mixed in one old photo, we design a global branch with a partial nonlocal block targeting to the structured defects, such as scratches and dust spots, and a local branch targeting to the unstructured defects, such as noises and blurriness. Two branches are fused in the latent space, leading to improved capability to restore old photos from multiple defects. The proposed method outperforms state-of-the-art methods in terms of visual quality for old photos restoration. △ Less

Submitted 20 April, 2020; originally announced April 2020.

Comments: CVPR 2020 Oral, project website: http://raywzy.com/Old_Photo/

Cross-domain Correspondence Learning for Exemplar-based Image Translation

Authors: Pan Zhang, Bo Zhang, Dong Chen, Lu Yuan, Fang Wen

Abstract: We present a general framework for exemplar-based image translation, which synthesizes a photo-realistic image from the input in a distinct domain (e.g., semantic segmentation mask, or edge map, or pose keypoints), given an exemplar image. The output has the style (e.g., color, texture) in consistency with the semantically corresponding objects in the exemplar. We propose to jointly learn the cros… ▽ More We present a general framework for exemplar-based image translation, which synthesizes a photo-realistic image from the input in a distinct domain (e.g., semantic segmentation mask, or edge map, or pose keypoints), given an exemplar image. The output has the style (e.g., color, texture) in consistency with the semantically corresponding objects in the exemplar. We propose to jointly learn the crossdomain correspondence and the image translation, where both tasks facilitate each other and thus can be learned with weak supervision. The images from distinct domains are first aligned to an intermediate domain where dense correspondence is established. Then, the network synthesizes images based on the appearance of semantically corresponding patches in the exemplar. We demonstrate the effectiveness of our approach in several image translation tasks. Our method is superior to state-of-the-art methods in terms of image quality significantly, with the image style faithful to the exemplar with semantic consistency. Moreover, we show the utility of our method for several applications △ Less

Submitted 12 April, 2020; originally announced April 2020.

Comments: Accepted as a CVPR 2020 oral paper

Journal ref: CVPR 2020

GIQA: Generated Image Quality Assessment

Authors: Shuyang Gu, Jianmin Bao, Dong Chen, Fang Wen

Abstract: Generative adversarial networks (GANs) have achieved impressive results today, but not all generated images are perfect. A number of quantitative criteria have recently emerged for generative model, but none of them are designed for a single generated image. In this paper, we propose a new research topic, Generated Image Quality Assessment (GIQA), which quantitatively evaluates the quality of each… ▽ More Generative adversarial networks (GANs) have achieved impressive results today, but not all generated images are perfect. A number of quantitative criteria have recently emerged for generative model, but none of them are designed for a single generated image. In this paper, we propose a new research topic, Generated Image Quality Assessment (GIQA), which quantitatively evaluates the quality of each generated image. We introduce three GIQA algorithms from two perspectives: learning-based and data-based. We evaluate a number of images generated by various recent GAN models on different datasets and demonstrate that they are consistent with human assessments. Furthermore, GIQA is available to many applications, like separately evaluating the realism and diversity of generative models, and enabling online hard negative mining (OHEM) in the training of GANs to improve the results. △ Less

Submitted 14 July, 2020; v1 submitted 19 March, 2020; originally announced March 2020.

Comments: ECCV2020

5G Positioning and Mapping with Diffuse Multipath

Authors: Fuxi Wen, Josef Kulmer, Klaus Witrisal, Henk Wymeersch

Abstract: 5G mmWave communication is useful for positioning due to the geometric connection between the propagation channel and the propagation environment. Channel estimation methods can exploit the resulting sparsity to estimate parameters(delay and angles) of each propagation path, which in turn can be exploited for positioning and mapping. When paths exhibit significant spread in either angle or delay,… ▽ More 5G mmWave communication is useful for positioning due to the geometric connection between the propagation channel and the propagation environment. Channel estimation methods can exploit the resulting sparsity to estimate parameters(delay and angles) of each propagation path, which in turn can be exploited for positioning and mapping. When paths exhibit significant spread in either angle or delay, these methods breakdown or lead to significant biases. We present a novel tensor-based method for channel estimation that allows estimation of mmWave channel parameters in a non-parametric form. The method is able to accurately estimate the channel, even in the absence of a specular component. This in turn enables positioning and mapping using only diffuse multipath. Simulation results are provided to demonstrate the efficacy of the proposed approach. △ Less

Submitted 22 May, 2020; v1 submitted 18 December, 2019; originally announced December 2019.

Progressive-Growing of Generative Adversarial Networks for Metasurface Optimization

Authors: Fufang Wen, Jiaqi Jiang, Jonathan A. Fan

Abstract: Generative adversarial networks, which can generate metasurfaces based on a training set of high performance device layouts, have the potential to significantly reduce the computational cost of the metasurface design process. However, basic GAN architectures are unable to fully capture the detailed features of topologically complex metasurfaces, and generated devices therefore require additional c… ▽ More Generative adversarial networks, which can generate metasurfaces based on a training set of high performance device layouts, have the potential to significantly reduce the computational cost of the metasurface design process. However, basic GAN architectures are unable to fully capture the detailed features of topologically complex metasurfaces, and generated devices therefore require additional computationally-expensive design refinement. In this Letter, we show that GANs can better learn spatially fine features from high-resolution training data by progressively growing its network architecture and training set. Our results indicate that with this training methodology, the best generated devices have performances that compare well with the best devices produced by gradient-based topology optimization, thereby eliminating the need for additional design refinement. We envision that this network training method can generalize to other physical systems where device performance is strongly correlated with fine geometric structuring. △ Less

Submitted 2 December, 2019; v1 submitted 29 November, 2019; originally announced November 2019.

A Simple Local Minimal Intensity Prior and An Improved Algorithm for Blind Image Deblurring

Authors: Fei Wen, Rendong Ying, Yipeng Liu, Peilin Liu, Trieu-Kien Truong

Abstract: Blind image deblurring is a long standing challenging problem in image processing and low-level vision. Recently, sophisticated priors such as dark channel prior, extreme channel prior, and local maximum gradient prior, have shown promising effectiveness. However, these methods are computationally expensive. Meanwhile, since these priors involved subproblems cannot be solved explicitly, approximat… ▽ More Blind image deblurring is a long standing challenging problem in image processing and low-level vision. Recently, sophisticated priors such as dark channel prior, extreme channel prior, and local maximum gradient prior, have shown promising effectiveness. However, these methods are computationally expensive. Meanwhile, since these priors involved subproblems cannot be solved explicitly, approximate solution is commonly used, which limits the best exploitation of their capability. To address these problems, this work firstly proposes a simplified sparsity prior of local minimal pixels, namely patch-wise minimal pixels (PMP). The PMP of clear images is much more sparse than that of blurred ones, and hence is very effective in discriminating between clear and blurred images. Then, a novel algorithm is designed to efficiently exploit the sparsity of PMP in deblurring. The new algorithm flexibly imposes sparsity inducing on the PMP under the MAP framework rather than directly uses the half quadratic splitting algorithm. By this, it avoids non-rigorous approximation solution in existing algorithms, while being much more computationally efficient. Extensive experiments demonstrate that the proposed algorithm can achieve better practical stability compared with state-of-the-arts. In terms of deblurring quality, robustness and computational efficiency, the new algorithm is superior to state-of-the-arts. Code for reproducing the results of the new method is available at https://github.com/FWen/deblur-pmp.git. △ Less

Submitted 29 October, 2020; v1 submitted 15 June, 2019; originally announced June 2019.

Comments: 14 pages, 16 figures

Journal ref: IEEE Transactions on Circuits and Systems for Video Technology, 2020, https://ieeexplore.ieee.org/document/9241002

Robust Precoding Design for Coarsely Quantized MU-MIMO Under Channel Uncertainties

Authors: Lei Chu, Fei Wen, Robert Caiming Qiu

Abstract: Recently, multi-user multiple input multiple output (MU-MIMO) systems with low-resolution digital-to-analog converters (DACs) has received considerable attention, owing to the capability of dramatically reducing the hardware cost. Besides, it has been shown that the use of low-resolution DACs enable great reduction in power consumption while maintain the performance loss within acceptable margin,… ▽ More Recently, multi-user multiple input multiple output (MU-MIMO) systems with low-resolution digital-to-analog converters (DACs) has received considerable attention, owing to the capability of dramatically reducing the hardware cost. Besides, it has been shown that the use of low-resolution DACs enable great reduction in power consumption while maintain the performance loss within acceptable margin, under the assumption of perfect knowledge of channel state information (CSI). In this paper, we investigate the precoding problem for the coarsely quantized MU-MIMO system without such an assumption. The channel uncertainties are modeled to be a random matrix with finite second-order statistics. By leveraging a favorable relation between the multi-bit DACs outputs and the single-bit ones, we first reformulate the original complex precoding problem into a nonconvex binary optimization problem. Then, using the S-procedure lemma, the nonconvex problem is recast into a tractable formulation with convex constraints and finally solved by the semidefinite relaxation (SDR) method. Compared with existing representative methods, the proposed precoder is robust to various channel uncertainties and is able to support a MUMIMO system with higher-order modulations, e.g., 16QAM. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Comments: To appear in IEEE ICC 2019

5G mmWave Downlink Vehicular Positioning

Authors: Henk Wymeersch, Nil Garcia, Hyowon Kim, Gonzalo Seco-Granados, Sunwoo Kim, Fuxi Wen, Markus Fröhle

Abstract: 5G new radio (NR) provides new opportunities for accurate positioning from a single reference station: large bandwidth combined with multiple antennas, at both the base station and user sides, allows for unparalleled angle and delay resolution. Nevertheless, positioning quality is affected by multipath and clock biases. We study, in terms of performance bounds and algorithms, the ability to locali… ▽ More 5G new radio (NR) provides new opportunities for accurate positioning from a single reference station: large bandwidth combined with multiple antennas, at both the base station and user sides, allows for unparalleled angle and delay resolution. Nevertheless, positioning quality is affected by multipath and clock biases. We study, in terms of performance bounds and algorithms, the ability to localize a vehicle in the presence of multipath and unknown user clock bias. We find that when a sufficient number of paths is present, a vehicle can still be localized thanks to redundancy in the geometric constraints. Moreover, the 5G NR signals enable a vehicle to build up a map of the environment. △ Less

Submitted 7 January, 2019; originally announced January 2019.

Comments: Globecom 2018 paper with corrected figure # 7 (RMSE now significantly higher than CRB)

A Survey on Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learning

Authors: Fei Wen, Lei Chu, Peilin Liu, Robert C. Qiu

Abstract: In the past decade, sparse and low-rank recovery have drawn much attention in many areas such as signal/image processing, statistics, bioinformatics and machine learning. To achieve sparsity and/or low-rankness inducing, the $\ell_1$ norm and nuclear norm are of the most popular regularization penalties due to their convexity. While the $\ell_1$ and nuclear norm are convenient as the related conve… ▽ More In the past decade, sparse and low-rank recovery have drawn much attention in many areas such as signal/image processing, statistics, bioinformatics and machine learning. To achieve sparsity and/or low-rankness inducing, the $\ell_1$ norm and nuclear norm are of the most popular regularization penalties due to their convexity. While the $\ell_1$ and nuclear norm are convenient as the related convex optimization problems are usually tractable, it has been shown in many applications that a nonconvex penalty can yield significantly better performance. In recent, nonconvex regularization based sparse and low-rank recovery is of considerable interest and it in fact is a main driver of the recent progress in nonconvex and nonsmooth optimization. This paper gives an overview of this topic in various fields in signal processing, statistics and machine learning, including compressive sensing (CS), sparse regression and variable selection, sparse signals separation, sparse principal component analysis (PCA), large covariance and inverse covariance matrices estimation, matrix completion, and robust PCA. We present recent developments of nonconvex regularization based sparse and low-rank recovery in these fields, addressing the issues of penalty selection, applications and the convergence of nonconvex algorithms. Code is available at https://github.com/FWen/ncreg.git. △ Less

Submitted 6 June, 2019; v1 submitted 16 August, 2018; originally announced August 2018.

Comments: 22 pages

Journal ref: Published in IEEE Access 2018: https://ieeexplore.ieee.org/abstract/document/8531588

Efficient Nonlinear Precoding for Massive MU-MIMO Downlink Systems with 1-Bit DACs

Authors: Lei Chu, Fei Wen, Lily Li, Robert Qiu

Abstract: The power consumption of digital-to-analog converters (DACs) constitutes a significant proportion of the total power consumption in a massive multiuser multiple-input multiple-output (MU-MIMO) base station (BS). Using 1-bit DACs can significantly reduce the power consumption. This paper addresses the precoding problem for the massive narrow-band MU-MIMO downlink system equipped with 1-bit DACs at… ▽ More The power consumption of digital-to-analog converters (DACs) constitutes a significant proportion of the total power consumption in a massive multiuser multiple-input multiple-output (MU-MIMO) base station (BS). Using 1-bit DACs can significantly reduce the power consumption. This paper addresses the precoding problem for the massive narrow-band MU-MIMO downlink system equipped with 1-bit DACs at each BS. In such a system, the precoding problem plays a central role as the precoded symbols are affected by extra distortion introduced by 1-bit DACs. In this paper, we develop a highly-efficient nonlinear precoding algorithm based on the alternative direction method framework. Unlike the classic algorithms, such as the semidefinite relaxation (SDR) and squared-infinity norm Douglas-Rachford splitting (SQUID) algorithms, which solve convex relaxed versions of the original precoding problem, the new algorithm solves the original nonconvex problem directly. The new algorithm is guaranteed to globally converge under some mild conditions. A sufficient condition for its convergence has been derived. Experimental results in various conditions demonstrated that, the new algorithm can achieve state-of-the-art accuracy comparable to the SDR algorithm, while being much more efficient (more than 300 times faster than the SDR algorithm). △ Less

Submitted 8 June, 2019; v1 submitted 24 April, 2018; originally announced April 2018.

Comments: 12 pages, 7 figures

Journal ref: published in IEEE Transactions On Wireless Communications, 2019

Eigen-Inference Precoding for Coarsely Quantized Massive MU-MIMO System with Imperfect CSI

Authors: Lei Chu, Robert Qiu, Fei Wen

Abstract: This work considers the precoding problem in massive multiuser multiple-input multiple-output (MU-MIMO) systems equipped with low-resolution digital-to-analog converters (DACs). In previous literature on this topic, it is commonly assumed that the channel state information (CSI) is perfectly known. However, in practical applications the CSI is inevitably contaminated by noise. In this paper, we pr… ▽ More This work considers the precoding problem in massive multiuser multiple-input multiple-output (MU-MIMO) systems equipped with low-resolution digital-to-analog converters (DACs). In previous literature on this topic, it is commonly assumed that the channel state information (CSI) is perfectly known. However, in practical applications the CSI is inevitably contaminated by noise. In this paper, we propose, for the first time, an eigen-inference (EI) precoding scheme to improve the error performance of the coarsely quantized massive MU-MIMO systems under imperfect CSI, which is mathematically modeled by a sum of two rectangular random matrices (RRMs). Instead of performing analysis based on the RRM, using Girko's Hermitization trick, the proposed method leverages the block random matrix theory by augmenting the RRM into a block symmetric channel matrix (BSCA). Specially, we derive the empirical distribution of the eigenvalues of the BSCA and establish the limiting spectra distribution connection between the true BSCA and its noisy observation. Then, based on these theoretical results, we propose an EI-based moments matching method for CSI-related noise level estimation and a rotation invariant estimation method for CSI reconstruction. Based on the cleaned CSI, the quantized precoding problem is tackled via the Bussgang theorem and the Lagrangian multiplier method. The prosed methods are lastly verified by numerical simulations and the results demonstrate the effectiveness of the proposed precoder. △ Less

Submitted 20 April, 2019; v1 submitted 1 March, 2018; originally announced March 2018.

Phase Identification in Distribution Networks with Micro-Synchrophasors

Authors: Miles H. F. Wen, Reza Arghandeh, Alexandra von Meier, Kameshwar Poolla, Victor O. K. Li

Abstract: This paper proposes a novel phase identification method for distribution networks where phases can be severely unbalanced and insufficiently labeled. The analysis approach draws on data from high-precision phasor measurement units (micro-synchrophasors or uPMUs) for distribution systems. A key fact is that time-series voltage phasors taken from a distribution network show specific patterns regardi… ▽ More This paper proposes a novel phase identification method for distribution networks where phases can be severely unbalanced and insufficiently labeled. The analysis approach draws on data from high-precision phasor measurement units (micro-synchrophasors or uPMUs) for distribution systems. A key fact is that time-series voltage phasors taken from a distribution network show specific patterns regarding connected phases at measurement points. The algorithm is based on analyzing crosscorrelations over voltage magnitudes along with phase angle differences on two candidate phases to be matched. If two measurement points are on the same phase, large positive voltage magnitude correlations and small voltage angle differences should be observed. The algorithm is initially validated using the IEEE 13-bus model, and subsequently with actual uPMU measurements on a 12-kV feeder. △ Less

Submitted 7 January, 2015; originally announced January 2015.

Comments: 5 Pages, PESGM2015, Denver, CO

System Identification Using Reweighted Zero Attracting Least Absolute Deviation Algorithm

Authors: Fuxi Wen

Abstract: In this paper, the l1 norm penalty on the filter coefficients is incorporated in the least mean absolute deviation (LAD) algorithm to improve the performance of the LAD algorithm. The performance of LAD, zero-attracting LAD (ZA-LAD) and reweighted zero-attracting LAD (RZA-LAD) are evaluated for linear time varying system identification under the non-Gaussian (alpha-stable) noise environments. Effe… ▽ More In this paper, the l1 norm penalty on the filter coefficients is incorporated in the least mean absolute deviation (LAD) algorithm to improve the performance of the LAD algorithm. The performance of LAD, zero-attracting LAD (ZA-LAD) and reweighted zero-attracting LAD (RZA-LAD) are evaluated for linear time varying system identification under the non-Gaussian (alpha-stable) noise environments. Effectiveness of the ZA-LAD type algorithms is demonstrated through computer simulations. △ Less

Submitted 6 June, 2013; v1 submitted 13 October, 2011; originally announced October 2011.