-
Networked ISAC for Low-Altitude Economy: Coordinated Transmit Beamforming and UAV Trajectory Design
Authors:
Gaoyuan Cheng,
Xianxin Song,
Zhonghao Lyu,
Jie Xu
Abstract:
This paper exploits the networked integrated sensing and communications (ISAC) to support low-altitude economy (LAE), in which a set of networked ground base stations (GBSs) cooperatively transmit joint information and sensing signals to communicate with multiple authorized unmanned aerial vehicles (UAVs) and concurrently detect unauthorized objects over the interested region in the three-dimensio…
▽ More
This paper exploits the networked integrated sensing and communications (ISAC) to support low-altitude economy (LAE), in which a set of networked ground base stations (GBSs) cooperatively transmit joint information and sensing signals to communicate with multiple authorized unmanned aerial vehicles (UAVs) and concurrently detect unauthorized objects over the interested region in the three-dimensional (3D) space. We assume that each GBS is equipped with uniform linear array (ULA) antennas, which are deployed either horizontally or vertically to the ground. We also consider two types of UAV receivers, which have and do not have the capability of canceling the interference caused by dedicated sensing signals, respectively. Under each setup, we jointly design the coordinated transmit beamforming at multiple GBSs together with the authorized UAVs' trajectory control and their GBS associations, for enhancing the authorized UAVs' communication performance while ensuring the sensing requirements. In particular, we aim to maximize the average sum rate of authorized UAVs over a given flight period, subject to the minimum illumination power constraints toward the interested 3D sensing region, the maximum transmit power constraints at individual GBSs, and the flight constraints of UAVs. These problems are highly non-convex and challenging to solve, due to the involvement of binary UAV-GBS association variables as well as the coupling of beamforming and trajectory variables. To solve these non-convex problems, we propose efficient algorithms by using the techniques of alternating optimization, successive convex approximation, and semi-definite relaxation. Numerical results show that the proposed joint coordinated transmit beamforming and UAV trajectory designs efficiently balance the sensing-communication performance tradeoffs and significantly outperform various benchmarks.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Networked ISAC for Low-Altitude Economy: Transmit Beamforming and UAV Trajectory Design
Authors:
Gaoyuan Cheng,
Xianxin Song,
Zhonghao Lyu,
Jie Xu
Abstract:
This paper studies the exploitation of networked integrated sensing and communications (ISAC) to support low-altitude economy (LAE), in which a set of networked ground base stations (GBSs) transmit wireless signals to cooperatively communicate with multiple authorized unmanned aerial vehicles (UAVs) and concurrently use the echo signals to detect the invasion of unauthorized objects in interested…
▽ More
This paper studies the exploitation of networked integrated sensing and communications (ISAC) to support low-altitude economy (LAE), in which a set of networked ground base stations (GBSs) transmit wireless signals to cooperatively communicate with multiple authorized unmanned aerial vehicles (UAVs) and concurrently use the echo signals to detect the invasion of unauthorized objects in interested airspace. Under this setup, we jointly design the cooperative transmit beamforming at multiple GBSs together with the trajectory control of authorized UAVs and their GBS associations, for enhancing the authorized UAVs' communication performance while ensuring the sensing requirements for airspace monitoring. In particular, our objective is to maximize the average sum rate of authorized UAVs over a particular flight period, subject to the minimum illumination power constraints for sensing over the interested airspace, the maximum transmit power constraints at individual GBSs, and the flight constraints at UAVs. This problem is non-convex and challenging to solve, due to the involvement of integer variables and the coupling of optimization variables. To solve this non-convex problem, we propose an efficient algorithm by using the techniques of alternating optimization (AO), successive convex approximation (SCA), and semi-definite relaxation (SDR). Numerical results show that the obtained transmit beamforming and UAV trajectory designs in the proposed algorithm efficiently balance the tradeoff between the sensing and communication performances, thus significantly outperforming various benchmarks.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Intelligent Reflecting Surface Aided AirComp: Multi-Timescale Design and Performance Analysis
Authors:
Guangji Chen,
Jun Li,
Qingqing Wu,
Meng Hua,
Kaitao Meng,
Zhonghao Lyu
Abstract:
The integration of intelligent reflecting surface (IRS) into over-the-air computation (AirComp) is an effective solution for reducing the computational mean squared error (MSE) via its high passive beamforming gain. Prior works on IRS aided AirComp generally rely on the full instantaneous channel state information (I-CSI), which is not applicable to large-scale systems due to its heavy signalling…
▽ More
The integration of intelligent reflecting surface (IRS) into over-the-air computation (AirComp) is an effective solution for reducing the computational mean squared error (MSE) via its high passive beamforming gain. Prior works on IRS aided AirComp generally rely on the full instantaneous channel state information (I-CSI), which is not applicable to large-scale systems due to its heavy signalling overhead. To address this issue, we propose a novel multi-timescale transmission protocol. In particular, the receive beamforming at the access point (AP) is pre-determined based on the static angle information and the IRS phase-shifts are optimized relying on the long-term statistical CSI. With the obtained AP receive beamforming and IRS phase-shifts, the effective low-dimensional I-CSI is exploited to determine devices' transmit power in each coherence block, thus substantially reducing the signalling overhead. Theoretical analysis unveils that the achievable MSE scales on the order of ${\cal O}\left( {K/\left( {{N^2}M} \right)} \right)$, where $M$, $N$, and $K$ are the number of AP antennas, IRS elements, and devices, respectively. We also prove that the channel-inversion power control is asymptotically optimal for large $N$, which reveals that the full power transmission policy is not needed for lowering the power consumption of energy-limited devices.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
An Overview on IEEE 802.11bf: WLAN Sensing
Authors:
Rui Du,
Haocheng Hua,
Hailiang Xie,
Xianxin Song,
Zhonghao Lyu,
Mengshi Hu,
Narengerile,
Yan Xin,
Stephen McCann,
Michael Montemurro,
Tony Xiao Han,
Jie Xu
Abstract:
With recent advancements, the wireless local area network (WLAN) or wireless fidelity (Wi-Fi) technology has been successfully utilized to realize sensing functionalities such as detection, localization, and recognition. However, the WLANs standards are developed mainly for the purpose of communication, and thus may not be able to meet the stringent requirements for emerging sensing applications.…
▽ More
With recent advancements, the wireless local area network (WLAN) or wireless fidelity (Wi-Fi) technology has been successfully utilized to realize sensing functionalities such as detection, localization, and recognition. However, the WLANs standards are developed mainly for the purpose of communication, and thus may not be able to meet the stringent requirements for emerging sensing applications. To resolve this issue, a new Task Group (TG), namely IEEE 802.11bf, has been established by the IEEE 802.11 working group, with the objective of creating a new amendment to the WLAN standard to meet advanced sensing requirements while minimizing the effect on communications. This paper provides a comprehensive overview on the up-to-date efforts in the IEEE 802.11bf TG. First, we introduce the definition of the 802.11bf amendment and its formation and standardization timeline. Next, we discuss the WLAN sensing use cases with the corresponding key performance indicator (KPI) requirements. After reviewing previous WLAN sensing research based on communication-oriented WLAN standards, we identify their limitations and underscore the practical need for the new sensing-oriented amendment in 802.11bf. Furthermore, we discuss the WLAN sensing framework and procedure used for measurement acquisition, by considering both sensing at sub-7GHz and directional multi-gigabit (DMG) sensing at 60 GHz, respectively, and address their shared features, similarities, and differences. In addition, we present various candidate technical features for IEEE 802.11bf, including waveform/sequence design, feedback types, as well as quantization and compression techniques. We also describe the methodologies and the channel modeling used by the IEEE 802.11bf TG for evaluation. Finally, we discuss the challenges and future research directions to motivate more research endeavors towards this field in details.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
MediViSTA-SAM: Zero-shot Medical Video Analysis with Spatio-temporal SAM Adaptation for Echocardiography
Authors:
Sekeun Kim,
Kyungsang Kim,
Jiang Hu,
Cheng Chen,
Zhiliang Lyu,
Ren Hui,
Sunghwan Kim,
Zhengliang Liu,
Aoxiao Zhong,
Xiang Li,
Tianming Liu,
Quanzheng Li
Abstract:
The Segmentation Anything Model (SAM) has gained significant attention for its robust generalization capabilities across diverse downstream tasks. However, the performance of SAM is noticeably diminished in medical images due to the substantial disparity between natural and medical image domain. In this paper, we present a zero-shot generalization model specifically designed for echocardiography a…
▽ More
The Segmentation Anything Model (SAM) has gained significant attention for its robust generalization capabilities across diverse downstream tasks. However, the performance of SAM is noticeably diminished in medical images due to the substantial disparity between natural and medical image domain. In this paper, we present a zero-shot generalization model specifically designed for echocardiography analysis, called MediViSTA-SAM. Our key components include (i) the introduction of frame-level self-attention, which leverages cross-frame attention across each frame and its neighboring frames to guarantee consistent segmentation outcomes, and (ii) we utilize CNN backbone for feature embedding for the subsequent Transformer for efficient fine-tuning while keeping most of the SAM's parameter reusable. Experiments were conducted using zero-shot segmentation on multi-vendor in-house echocardiography datasets, indicating evaluation without prior exposure to the in-house dataset during training. MediViSTA-SAM effectively overcomes SAM's limitations and can be deployed across various hospital settings without the necessity of re-training models on their respective datasets. Our code is open sourced at: \url{https://github.com/kimsekeun/MediViSTA-SAM}
△ Less
Submitted 6 April, 2024; v1 submitted 23 September, 2023;
originally announced September 2023.
-
Small-Gain Theorem for Safety Verification under High-Relative-Degree Constraints
Authors:
Ziliang Lyu,
Xiangru Xu,
Yiguang Hong
Abstract:
This paper develops a small-gain technique for the safety analysis and verification of interconnected systems with high-relative-degree safety constraints. In this technique, input-to-state safety (ISSf) is used to characterize how the safety of a subsystem is influenced by the external input, and ISSf-barrier functions (ISSf-BFs) with high relative degree are employed to capture the safety of sub…
▽ More
This paper develops a small-gain technique for the safety analysis and verification of interconnected systems with high-relative-degree safety constraints. In this technique, input-to-state safety (ISSf) is used to characterize how the safety of a subsystem is influenced by the external input, and ISSf-barrier functions (ISSf-BFs) with high relative degree are employed to capture the safety of subsystems. With a coordination transform, the relationship between ISSf-BFs and the existing high-relative-degree (or high-order) barrier functions is established in order to simplify the ISSf analysis. With the help of high-relative-degree ISSf-BFs, a small-gain theorem is proposed for safety verification. It is shown that, under the small-gain condition, i) the interconnection of ISSf subsystems is still ISSf; and ii) the overall interconnected system is input-to-state stable (ISS) with respect to the compositional safe set. The effectiveness of the proposed small-gain theorem is illustrated on the output-constrained decentralized control of two inverted pendulums connected by a spring mounted on two carts.
△ Less
Submitted 8 April, 2022;
originally announced April 2022.
-
Ray-transfer functions for camera simulation of 3D scenes with hidden lens design
Authors:
Thomas Goossens,
Zheng Lyu,
Jamyuen Ko,
Gordon Wan,
Joyce Farrell,
Brian Wandell
Abstract:
Combining image sensor simulation tools (e.g., ISETCam) with physically based ray tracing (e.g., PBRT) offers possibilities for designing and evaluating novel imaging systems as well as for synthesizing physically accurate, labeled images for machine learning. One practical limitation has been simulating the optics precisely: Lens manufacturers generally prefer to keep lens design confidential. We…
▽ More
Combining image sensor simulation tools (e.g., ISETCam) with physically based ray tracing (e.g., PBRT) offers possibilities for designing and evaluating novel imaging systems as well as for synthesizing physically accurate, labeled images for machine learning. One practical limitation has been simulating the optics precisely: Lens manufacturers generally prefer to keep lens design confidential. We present a pragmatic solution to this problem using a black box lens model in Zemax; such models provide necessary optical information while preserving the lens designer's intellectual property. First, we describe and provide software to construct a polynomial ray transfer function that characterizes how rays entering the lens at any position and angle subsequently exit the lens. We implement the ray-transfer calculation as a camera model in PBRT and confirm that the PBRT ray-transfer calculations match the Zemax lens calculations for edge spread functions and relative illumination.
△ Less
Submitted 23 February, 2022; v1 submitted 17 February, 2022;
originally announced February 2022.
-
Accurate smartphone camera simulation using 3D scenes
Authors:
Zheng Lyu,
Thomas Goossens,
Brian Wandell,
Joyce Farrell
Abstract:
We assess the accuracy of a smartphone camera simulation. The simulation is an end-to-end analysis that begins with a physical description of a high dynamic range 3D scene and includes a specification of the optics and the image sensor. The simulation is compared to measurements of a physical version of the scene. The image system simulation accurately matched measurements of optical blur, depth o…
▽ More
We assess the accuracy of a smartphone camera simulation. The simulation is an end-to-end analysis that begins with a physical description of a high dynamic range 3D scene and includes a specification of the optics and the image sensor. The simulation is compared to measurements of a physical version of the scene. The image system simulation accurately matched measurements of optical blur, depth of field, spectral quantum efficiency, scene inter-reflections, and sensor noise. The results support the use of image systems simulation methods for soft prototyping cameras and for producing synthetic data in machine learning applications.
△ Less
Submitted 27 January, 2022; v1 submitted 18 January, 2022;
originally announced January 2022.
-
Joint Maneuver and Beamforming Design for UAV-Enabled Integrated Sensing and Communication
Authors:
Zhonghao Lyu,
Guangxu Zhu,
Jie Xu
Abstract:
This paper studies the UAV-enabled integrated sensing and communication (ISAC), in which UAVs are dispatched as aerial dual-functional access points (APs) for efficient ISAC. In particular, we consider a scenario with one UAV-AP equipped with a vertically placed uniform linear array (ULA), which sends combined information and sensing signals to communicate with multiple users and sense potential t…
▽ More
This paper studies the UAV-enabled integrated sensing and communication (ISAC), in which UAVs are dispatched as aerial dual-functional access points (APs) for efficient ISAC. In particular, we consider a scenario with one UAV-AP equipped with a vertically placed uniform linear array (ULA), which sends combined information and sensing signals to communicate with multiple users and sense potential targets at interested areas on the ground simultaneously. Our objective is to jointly design the UAV maneuver with the transmit beamforming for optimizing the communication performance while ensuring the sensing requirements. First, we consider the quasi-stationary UAV scenario, in which the UAV is deployed at an optimizable location over the whole ISAC mission period. In this case, we jointly optimize the UAV deployment location, as well as the transmit information and sensing beamforming to maximize the weighted sum-rate throughput, subject to the sensing beampattern gain requirements and transmit power constraint. Although the above problem is non-convex, we find a high-quality solution by using the techniques of SCA and SDR, together with a 2D location search. Next, we consider the fully mobile UAV scenario, in which the UAV can fly over different locations during the ISAC mission period. In this case, we optimize the UAV flight trajectory, jointly with the transmit beamforming over time, to maximize the average weighted sum-rate throughput, subject to the sensing beampattern gain requirements and transmit power constraints as well as practical flight constraints. While the joint UAV trajectory and beamforming problem is more challenging to solve, we propose an efficient algorithm by adopting the alternating optimization together with SCA. Finally, numerical results are provided to validate the superiority of our proposed designs as compared to various benchmark schemes.
△ Less
Submitted 6 October, 2021;
originally announced October 2021.
-
Validation of image systems simulation technology using a Cornell Box
Authors:
Zheng Lyu,
Krithin Kripakaran,
Max Furth,
Eric Tang,
Brian Wandell,
Joyce Farrell
Abstract:
We describe and experimentally validate an end-to-end simulation of a digital camera. The simulation models the spectral radiance of 3D-scenes, formation of the spectral irradiance by multi-element optics, and conversion of the irradiance to digital values by the image sensor. We quantify the accuracy of the simulation by comparing real and simulated images of a precisely constructed, three-dimens…
▽ More
We describe and experimentally validate an end-to-end simulation of a digital camera. The simulation models the spectral radiance of 3D-scenes, formation of the spectral irradiance by multi-element optics, and conversion of the irradiance to digital values by the image sensor. We quantify the accuracy of the simulation by comparing real and simulated images of a precisely constructed, three-dimensional high dynamic range test scene. Validated end-to-end software simulation of a digital camera can accelerate innovation by reducing many of the time-consuming and expensive steps in designing, building and evaluating image systems.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
Comparison of round- and square-core fibers for sensing, imaging and spectroscopy
Authors:
Matthias C. Velsink,
Zhouping Lyu,
Pepijn W. H. Pinkse,
Lyubov V. Amitonova
Abstract:
Multimode fibers (MMFs) show great promise as miniature probes for sensing, imaging and spectroscopy applications. Different parameters of the fibers, such as numerical aperture, refractive index profile and length, have been already optimized for better performance. Here we investigate the role of the core shape, in particular for wavefront shaping applications where a focus is formed at the outp…
▽ More
Multimode fibers (MMFs) show great promise as miniature probes for sensing, imaging and spectroscopy applications. Different parameters of the fibers, such as numerical aperture, refractive index profile and length, have been already optimized for better performance. Here we investigate the role of the core shape, in particular for wavefront shaping applications where a focus is formed at the output of the MMF. We demonstrate that in contrast to a conventional round-core MMF, a square-core design doesn't suffer from focus aberrations. Moreover, we find that how the interference pattern behind a square-core fiber decorrelates with the input frequency is largely independent of the input light coupling. Finally, we demonstrate that a square core shape provides an on-average uniform distribution of the output intensity, free from the input-output correlations seen in round fibers, showing great promise for imaging and spectroscopy applications.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
-
Small-Gain Theorem for Safety Verification of Interconnected Systems
Authors:
Ziliang Lyu,
Xiangru Xu,
Yiguang Hong
Abstract:
A small-gain theorem in the formulation of barrier function is developed in this work for safety verification of interconnected systems. This result is helpful to verify input-to-state safety (ISSf) of the overall system from the safety information encoded in the subsystem's ISSf-barrier function. Also, it can be used to obtain a safety set in a higher dimensional space from the safety sets in two…
▽ More
A small-gain theorem in the formulation of barrier function is developed in this work for safety verification of interconnected systems. This result is helpful to verify input-to-state safety (ISSf) of the overall system from the safety information encoded in the subsystem's ISSf-barrier function. Also, it can be used to obtain a safety set in a higher dimensional space from the safety sets in two lower dimensional spaces.
△ Less
Submitted 18 November, 2020;
originally announced November 2020.
-
Model-Aware Regularization For Learning Approaches To Inverse Problems
Authors:
Jaweria Amjad,
Zhaoyan Lyu,
Miguel R. D. Rodrigues
Abstract:
There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask whether such knowledge of the forward operator can be exploited in deep learning approaches increasingly used to solve inverse problems.
In this paper, we provide…
▽ More
There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask whether such knowledge of the forward operator can be exploited in deep learning approaches increasingly used to solve inverse problems.
In this paper, we provide one such way via an analysis of the generalisation error of deep learning methods applicable to inverse problems. In particular, by building on the algorithmic robustness framework, we offer a generalisation error bound that encapsulates key ingredients associated with the learning problem such as the complexity of the data space, the size of the training set, the Jacobian of the deep neural network and the Jacobian of the composition of the forward operator with the neural network. We then propose a 'plug-and-play' regulariser that leverages the knowledge of the forward map to improve the generalization of the network. We likewise also propose a new method allowing us to tightly upper bound the Lipschitz constants of the relevant functions that is much more computational efficient than existing ones. We demonstrate the efficacy of our model-aware regularised deep learning algorithms against other state-of-the-art approaches on inverse problems involving various sub-sampling operators such as those used in classical compressed sensing setup and accelerated Magnetic Resonance Imaging (MRI).
△ Less
Submitted 18 June, 2020;
originally announced June 2020.
-
An improved hybrid CTC-Attention model for speech recognition
Authors:
Zhe Yuan,
Zhuoran Lyu,
Jiwei Li,
Xi Zhou
Abstract:
Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder structure based on the experiments we conducted and explore the relation between decoding performance and the depth of encoder. We also apply attention smoothing me…
▽ More
Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder structure based on the experiments we conducted and explore the relation between decoding performance and the depth of encoder. We also apply attention smoothing mechanism to acquire more context information for subword-based decoding. Taken together, these strategies allow us to achieve a word error rate(WER) of 4.43% without LM and 3.34% with RNN-LM on the test-clean subset of the LibriSpeech corpora, which by far are the best reported WERs for end-to-end ASR systems on this dataset.
△ Less
Submitted 1 November, 2018; v1 submitted 29 October, 2018;
originally announced October 2018.
