Showing 1–46 of 46 results for author: Jin, L

DVOS: Self-Supervised Dense-Pattern Video Object Segmentation

Authors: Keyhan Najafian, Farhad Maleki, Ian Stavness, Lingling Jin

Abstract: Video object segmentation approaches primarily rely on large-scale pixel-accurate human-annotated datasets for model development. In Dense Video Object Segmentation (DVOS) scenarios, each video frame encompasses hundreds of small, dense, and partially occluded objects. Accordingly, the labor-intensive manual annotation of even a single frame often takes hours, which hinders the development of DVOS… ▽ More Video object segmentation approaches primarily rely on large-scale pixel-accurate human-annotated datasets for model development. In Dense Video Object Segmentation (DVOS) scenarios, each video frame encompasses hundreds of small, dense, and partially occluded objects. Accordingly, the labor-intensive manual annotation of even a single frame often takes hours, which hinders the development of DVOS for many applications. Furthermore, in videos with dense patterns, following a large number of objects that move in different directions poses additional challenges. To address these challenges, we proposed a semi-self-supervised spatiotemporal approach for DVOS utilizing a diffusion-based method through multi-task learning. Emulating real videos' optical flow and simulating their motion, we developed a methodology to synthesize computationally annotated videos that can be used for training DVOS models; The model performance was further improved by utilizing weakly labeled (computationally generated but imprecise) data. To demonstrate the utility and efficacy of the proposed approach, we developed DVOS models for wheat head segmentation of handheld and drone-captured videos, capturing wheat crops in fields of different locations across various growth stages, spanning from heading to maturity. Despite using only a few manually annotated video frames, the proposed approach yielded high-performing models, achieving a Dice score of 0.82 when tested on a drone-captured external test set. While we showed the efficacy of the proposed approach for wheat head segmentation, its application can be extended to other crops or DVOS in other domains, such as crowd analysis or microscopic image analysis. △ Less

Submitted 7 June, 2024; originally announced June 2024.

On Joint Convergence of Traffic State and Weight Vector in Learning-Based Dynamic Routing with Value Function Approximation

Authors: Yidan Wu, Jianan Zhang, Li Jin

Abstract: Learning-based approaches are increasingly popular for traffic control problems. However, these approaches are applied typically as black boxes with limited theoretical guarantees and interpretability. In this paper, we consider the theory of dynamic routing over parallel servers, a representative traffic control task, using semi-gradient on-policy control algorithm, a representative reinforcement… ▽ More Learning-based approaches are increasingly popular for traffic control problems. However, these approaches are applied typically as black boxes with limited theoretical guarantees and interpretability. In this paper, we consider the theory of dynamic routing over parallel servers, a representative traffic control task, using semi-gradient on-policy control algorithm, a representative reinforcement learning method. We consider a linear value function approximation on an infinite state space; a Lyapunov function is also derived from the approximator. In particular, the structure of the approximator naturally makes possible idling policies, which is an interesting and useful advantage over existing dynamic routing schemes. We show that the convergence of the approximation weights is coupled with the convergence of the traffic state. We show that if the system is stabilizable, then (i) the weight vector converges to a bounded region, and (ii) the traffic state is bounded in the mean. We also empirically show that the proposed algorithm is computationally efficient with an insignificant optimality gap. △ Less

Submitted 14 April, 2024; originally announced April 2024.

WaveMo: Learning Wavefront Modulations to See Through Scattering

Authors: Mingyang Xie, Haiyun Guo, Brandon Y. Feng, Lingbo Jin, Ashok Veeraraghavan, Christopher A. Metzler

Abstract: Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity during image acquisition. Despite its importance, designing optimal wavefront modulations to image through scattering remains under-explored. This paper introdu… ▽ More Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity during image acquisition. Despite its importance, designing optimal wavefront modulations to image through scattering remains under-explored. This paper introduces a novel learning-based framework to address the gap. Our approach jointly optimizes wavefront modulations and a computationally lightweight feedforward "proxy" reconstruction network. This network is trained to recover scenes obscured by scattering, using measurements that are modified by these modulations. The learned modulations produced by our framework generalize effectively to unseen scattering scenarios and exhibit remarkable versatility. During deployment, the learned modulations can be decoupled from the proxy network to augment other more computationally expensive restoration algorithms. Through extensive experiments, we demonstrate our approach significantly advances the state of the art in imaging through scattering media. Our project webpage is at https://wavemo-2024.github.io/. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Minimax Least-Square Policy Iteration for Cost-Aware Defense of Traffic Routing against Unknown Threats

Authors: Yuzhen Zhan, Li Jin

Abstract: Dynamic routing is one of the representative control scheme in transportation, production lines, and data transmission. In the modern context of connectivity and autonomy, routing decisions are potentially vulnerable to malicious attacks. In this paper, we consider the dynamic routing problem over parallel traffic links in the face of such threats. An attacker is capable of increasing or destabili… ▽ More Dynamic routing is one of the representative control scheme in transportation, production lines, and data transmission. In the modern context of connectivity and autonomy, routing decisions are potentially vulnerable to malicious attacks. In this paper, we consider the dynamic routing problem over parallel traffic links in the face of such threats. An attacker is capable of increasing or destabilizing traffic queues by strategic manipulating the nominally optimal routing decisions. A defender is capable of securing the correct routing decision. Attacking and defensive actions induce technological costs. The defender has no prior information about the attacker's strategy. We develop an least-square policy iteration algorithm for the defender to compute a cost-aware and threat-adaptive defensive strategy. The policy evaluation step computes a weight vector that minimizes the sampled temporal-difference error. We derive a concrete theoretical upper bound on the evaluation error based on the theory of value function approximation. The policy improvement step solves a minimax problem and thus iteratively computes the Markov perfect equilibrium of the security game. We also discuss the training error of the entire policy iteration process. △ Less

Submitted 7 April, 2024; originally announced April 2024.

Comments: 8 pages, 3 figures

A Crosstalk-Aware Timing Prediction Method in Routing

Authors: Leilei Jin, Jiajie Xu, Wenjie Fu, Hao Yan, Longxing Shi

Abstract: With shrinking interconnect spacing in advanced technology nodes, existing timing predictions become less precise due to the challenging quantification of crosstalk-induced delay. During the routing, the crosstalk effect is typically modeled by predicting coupling capacitance with congestion information. However, the timing estimation tends to be overly pessimistic, as the crosstalk-induced delay… ▽ More With shrinking interconnect spacing in advanced technology nodes, existing timing predictions become less precise due to the challenging quantification of crosstalk-induced delay. During the routing, the crosstalk effect is typically modeled by predicting coupling capacitance with congestion information. However, the timing estimation tends to be overly pessimistic, as the crosstalk-induced delay depends not only on the coupling capacitance but also on the signal arrival time. This work presents a crosstalk-aware timing estimation method using a two-step machine learning approach. Interconnects that are physically adjacent and overlap in signal timing windows are filtered first. Crosstalk delay is predicted by integrating physical topology and timing features without relying on post-routing results and the parasitic extraction. Experimental results show a match rate of over 99% for identifying crosstalk nets compared to the commercial tool on the OpenCores benchmarks, with prediction results being more accurate than those of other state-of-the-art methods. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 6 pages, 8 figures

ACM Class: I.6.4; B.7.3

Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challenge

Authors: Jiancheng Yang, Rui Shi, Liang Jin, Xiaoyang Huang, Kaiming Kuang, Donglai Wei, Shixuan Gu, Jianying Liu, Pengfei Liu, Zhizhong Chai, Yongjie Xiao, Hao Chen, Liming Xu, Bang Du, Xiangyi Yan, Hao Tang, Adam Alessio, Gregory Holste, Jiapeng Zhang, Xiaoming Wang, Jianye He, Lixuan Che, Hanspeter Pfister, Ming Li, Bingbing Ni

Abstract: Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmar… ▽ More Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmark dataset of over 5,000 rib fractures from 660 CT scans, with voxel-level instance mask annotations and diagnosis labels for four clinical categories (buckle, nondisplaced, displaced, or segmental). The challenge includes two tracks: a detection (instance segmentation) track evaluated by an FROC-style metric and a classification track evaluated by an F1-style metric. During the MICCAI 2020 challenge period, 243 results were evaluated, and seven teams were invited to participate in the challenge summary. The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts. Nevertheless, the current rib fracture classification solutions are hardly clinically applicable, which can be an interesting area in the future. As an active benchmark and research resource, the data and online evaluation of the RibFrac Challenge are available at the challenge website. As an independent contribution, we have also extended our previous internal baseline by incorporating recent advancements in large-scale pretrained networks and point-based rib segmentation techniques. The resulting FracNet+ demonstrates competitive performance in rib fracture detection, which lays a foundation for further research and development in AI-assisted rib fracture detection and diagnosis. △ Less

Submitted 14 February, 2024; originally announced February 2024.

Comments: Challenge paper for MICCAI RibFrac Challenge (https://ribfrac.grand-challenge.org/)

Fractional Deep Reinforcement Learning for Age-Minimal Mobile Edge Computing

Authors: Lyudong Jin, Ming Tang, Meng Zhang, Hao Wang

Abstract: Mobile edge computing (MEC) is a promising paradigm for real-time applications with intensive computational needs (e.g., autonomous driving), as it can reduce the processing delay. In this work, we focus on the timeliness of computational-intensive updates, measured by Age-ofInformation (AoI), and study how to jointly optimize the task updating and offloading policies for AoI with fractional form.… ▽ More Mobile edge computing (MEC) is a promising paradigm for real-time applications with intensive computational needs (e.g., autonomous driving), as it can reduce the processing delay. In this work, we focus on the timeliness of computational-intensive updates, measured by Age-ofInformation (AoI), and study how to jointly optimize the task updating and offloading policies for AoI with fractional form. Specifically, we consider edge load dynamics and formulate a task scheduling problem to minimize the expected time-average AoI. The uncertain edge load dynamics, the nature of the fractional objective, and hybrid continuous-discrete action space (due to the joint optimization) make this problem challenging and existing approaches not directly applicable. To this end, we propose a fractional reinforcement learning(RL) framework and prove its convergence. We further design a model-free fractional deep RL (DRL) algorithm, where each device makes scheduling decisions with the hybrid action space without knowing the system dynamics and decisions of other devices. Experimental results show that our proposed algorithms reduce the average AoI by up to 57.6% compared with several non-fractional benchmarks. △ Less

Submitted 19 December, 2023; v1 submitted 16 December, 2023; originally announced December 2023.

Robust Anti-jamming Communications with DMA-Based Reconfigurable Heterogeneous Array

Authors: Kaizhi Huang, Wenyu Jiang, Yajun Chen, Liang Jin, Qingqing Wu, Xiaoling Hu

Abstract: In the future commercial and military communication systems, anti-jamming remains a critical issue. Existing homogeneous or heterogeneous arrays with a limited degrees of freedom (DoF) and high consumption are unable to meet the requirements of communication in rapidly changing and intense jamming environments. To address these challenges, we propose a reconfigurable heterogeneous array (RHA) arch… ▽ More In the future commercial and military communication systems, anti-jamming remains a critical issue. Existing homogeneous or heterogeneous arrays with a limited degrees of freedom (DoF) and high consumption are unable to meet the requirements of communication in rapidly changing and intense jamming environments. To address these challenges, we propose a reconfigurable heterogeneous array (RHA) architecture based on dynamic metasurface antenna (DMA), which will increase the DoF and further improve anti-jamming capabilities. We propose a two-step anti-jamming scheme based on RHA, where the multipaths are estimated by an atomic norm minimization (ANM) based scheme, and then the received signal-to-interference-plus-noise ratio (SINR) is maximized by jointly designing the phase shift of each DMA element and the weights of the array elements. To solve the challenging non-convex discrete fractional problem along with the estimation error in the direction of arrival (DoA) and channel state information (CSI), we propose a robust alternative algorithm based on the S-procedure to solve the lower-bound SINR maximization problem. Simulation results demonstrate that the proposed RHA architecture and corresponding schemes have superior performance in terms of jamming immunity and robustness. △ Less

Submitted 13 October, 2023; originally announced October 2023.

DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Images

Authors: Xuechao Zou, Kai Li, Junliang Xing, Yu Zhang, Shiying Wang, Lei Jin, Pin Tao

Abstract: Optical satellite images are a critical data source; however, cloud cover often compromises their quality, hindering image applications and analysis. Consequently, effectively removing clouds from optical satellite images has emerged as a prominent research direction. While recent advancements in cloud removal primarily rely on generative adversarial networks, which may yield suboptimal image qual… ▽ More Optical satellite images are a critical data source; however, cloud cover often compromises their quality, hindering image applications and analysis. Consequently, effectively removing clouds from optical satellite images has emerged as a prominent research direction. While recent advancements in cloud removal primarily rely on generative adversarial networks, which may yield suboptimal image quality, diffusion models have demonstrated remarkable success in diverse image-generation tasks, showcasing their potential in addressing this challenge. This paper presents a novel framework called DiffCR, which leverages conditional guided diffusion with deep convolutional networks for high-performance cloud removal for optical satellite imagery. Specifically, we introduce a decoupled encoder for conditional image feature extraction, providing a robust color representation to ensure the close similarity of appearance information between the conditional input and the synthesized output. Moreover, we propose a novel and efficient time and condition fusion block within the cloud removal model to accurately simulate the correspondence between the appearance in the conditional image and the target image at a low computational cost. Extensive experimental evaluations on two commonly used benchmark datasets demonstrate that DiffCR consistently achieves state-of-the-art performance on all metrics, with parameter and computational complexities amounting to only 5.1% and 5.4%, respectively, of those previous best methods. The source code, pre-trained models, and all the experimental results will be publicly available at https://github.com/XavierJiezou/DiffCR upon the paper's acceptance of this work. △ Less

Submitted 8 August, 2023; originally announced August 2023.

Comments: 13 pages, 7 figures

An Approximate Dynamic Programming Approach to Vehicle Platooning Coordination in Networks

Authors: Xi Xiong, Maonan Wang, Dengfeng Sun, Li Jin

Abstract: Platooning connected and autonomous vehicles (CAVs) provide significant benefits in terms of traffic efficiency and fuel economy. However, most existing platooning systems assume the availability of pre-determined plans, which is not feasible in real-time scenarios. In this paper, we address this issue in time-dependent networks by formulating a Markov decision process at each junction, aiming to… ▽ More Platooning connected and autonomous vehicles (CAVs) provide significant benefits in terms of traffic efficiency and fuel economy. However, most existing platooning systems assume the availability of pre-determined plans, which is not feasible in real-time scenarios. In this paper, we address this issue in time-dependent networks by formulating a Markov decision process at each junction, aiming to minimize travel time and fuel consumption. Initially, we analyze coordinated platooning without routing to explore the cooperation among controllers on an identical path. We propose two novel approaches based on approximate dynamic programming, offering suboptimal control in the context of a stochastic finite horizon problem. The results demonstrate the superiority of the approximation in the policy space. Furthermore, we investigate platooning in a network setting, where speed profiles and routes are determined simultaneously. To simplify the problem, we decouple the action space by prioritizing routing decisions based on travel time estimation. We subsequently employ the aforementioned policy approximation to determine speed profiles, considering essential parameters such as travel times. Our simulation results in SUMO indicate that our method yields better performance than conventional approaches, leading to potential travel cost savings of up to 40%. Additionally, we evaluate the resilience of our approach in dynamically changing networks, affirming its ability to maintain efficient platooning operations. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Efficient Gaussian Process Classification-based Physical-Layer Authentication with Configurable Fingerprints for 6G-Enabled IoT

Authors: Rui Meng, Fangzhou Zhu, Xiaodong Xu, Liang Jin, Bizhu Wang, Bingxuan Xu, Han Meng, Ping Zhang

Abstract: Physical-Layer Authentication (PLA) has been recently believed as an endogenous-secure and energy-efficient technique to recognize IoT terminals. However, the major challenge of applying the state-of-the-art PLA schemes directly to 6G-enabled IoT is the inaccurate channel fingerprint estimation in low Signal-Noise Ratio (SNR) environments, which will greatly influence the reliability and robustnes… ▽ More Physical-Layer Authentication (PLA) has been recently believed as an endogenous-secure and energy-efficient technique to recognize IoT terminals. However, the major challenge of applying the state-of-the-art PLA schemes directly to 6G-enabled IoT is the inaccurate channel fingerprint estimation in low Signal-Noise Ratio (SNR) environments, which will greatly influence the reliability and robustness of PLA. To tackle this issue, we propose a configurable-fingerprint-based PLA architecture through Intelligent Reflecting Surface (IRS) that helps create an alternative wireless transmission path to provide more accurate fingerprints. According to Baye's theorem, we propose a Gaussian Process Classification (GPC)-based PLA scheme, which utilizes the Expectation Propagation (EP) method to obtain the identities of unknown fingerprints. Considering that obtaining sufficient labeled fingerprint samples to train the GPC-based authentication model is challenging for future 6G systems, we further extend the GPC-based PLA to the Efficient-GPC (EGPC)-based PLA through active learning, which requires fewer labeled fingerprints and is more feasible. We also propose three fingerprint selecting algorithms to choose fingerprints, whose identities are queried to the upper-layers authentication mechanisms. For this reason, the proposed EGPC-based scheme is also a lightweight cross-layer authentication method to offer a superior security level. The simulations conducted on synthetic datasets demonstrate that the IRS-assisted scheme reduces the authentication error rate by 98.69% compared to the non-IRS-based scheme. Additionally, the proposed fingerprint selection algorithms reduce the authentication error rate by 65.96% to 86.93% and 45.45% to 70.00% under perfect and imperfect channel estimation conditions, respectively, when compared with baseline algorithms. △ Less

Submitted 23 July, 2023; originally announced July 2023.

Comments: 12 pages, 9 figures

Robust Queue Length Estimation for Ramp Metering in a Connected Vehicle Environment

Authors: Yu Tang, Kaan Ozbay, Li Jin

Abstract: Connected vehicles (CVs) can provide numerous new data via vehicle-to-vehicle or vehicle-to-infrastructure communication. These data can in turn be used to facilitate real-time traffic state estimation. In this paper, we focus on ramp queue length estimation in a connected vehicle environment, which improves control design and implementation of ramp metering algorithms. One major challenge of the… ▽ More Connected vehicles (CVs) can provide numerous new data via vehicle-to-vehicle or vehicle-to-infrastructure communication. These data can in turn be used to facilitate real-time traffic state estimation. In this paper, we focus on ramp queue length estimation in a connected vehicle environment, which improves control design and implementation of ramp metering algorithms. One major challenge of the estimation problem is that the CV data only represent partial traffic observations and could introduce new uncertainties if real-time CV penetration rates are unknown. To address this, we build our estimation approach on both traditional freeway sensors and new CV data. We first formulate a ramp queue model that considers i) variations in the penetration rate and ii) noise in measurements. Then we develop a robust filter that minimizes the impacts of these two kinds of uncertainties on queue estimation. More importantly, we show that the designed filter has guaranteed long-term estimation accuracy. It allows us to quantify in a theoretical way the relationship between estimation error and fluctuation of CV penetration rates. We also provide a series of simulation results to verify our approach. △ Less

Submitted 29 May, 2023; originally announced May 2023.

How Does Driver Non-compliance Destroy Traffic Routing Control?

Authors: Yu Tang, Li Jin, Kaan Ozbay

Abstract: Routing control is one of important traffic management strategies against urban congestion. However, it could be compromised by heterogeneous driver non-compliance with routing instructions. In this article we model the compliance in a stochastic manner and investigate its impacts on routing control. We consider traffic routing for two parallel links. Particularly, we consider two scenarios: one i… ▽ More Routing control is one of important traffic management strategies against urban congestion. However, it could be compromised by heterogeneous driver non-compliance with routing instructions. In this article we model the compliance in a stochastic manner and investigate its impacts on routing control. We consider traffic routing for two parallel links. Particularly, we consider two scenarios: one ignores congestion spillback while the other one considers it. We formulate the problem as a non-linear Markov chain, given random compliance rates. Then we propose the stability and instability conditions to reveal when the routing is able or unable to stabilize the traffic. We show that for links without congestion spillback there exists a sufficient and necessary stability criterion. For links admiting congestion propagation, we present one stability condition and one instability condition. This stability conditions allow us to quantify the impacts of driver non-compliance on the two-link network in terms of throughput. Finally, we illustrate the results with a set of numerical examples. △ Less

Submitted 19 September, 2023; v1 submitted 1 April, 2023; originally announced April 2023.

Vehicle Sequencing at Signal-Free Intersections: Analytical Performance Guarantees Based on PDMP Formulation

Authors: Xiangchen Cheng, Wei Tang, Ming Yang, Li Jin

Abstract: Signal-free intersections are a representative application of smart and connected vehicle technologies. Although extensive results have been developed for trajectory planning and autonomous driving, the formulation and evaluation of vehicle sequencing have not been well understood.In this paper, we consider theoretical guarantees of macroscopic performance (i.e., capacity and delay) of typical seq… ▽ More Signal-free intersections are a representative application of smart and connected vehicle technologies. Although extensive results have been developed for trajectory planning and autonomous driving, the formulation and evaluation of vehicle sequencing have not been well understood.In this paper, we consider theoretical guarantees of macroscopic performance (i.e., capacity and delay) of typical sequencing policies at signal-free intersections. We model intersection traffic as a piecewise-deterministic Markov process (PDMP). We analytically characterize the intersection capacity regions and provide upper bounds on travel delay under three typical policies, viz. first-in-first-out, min-switchover, and longer-queue-first. We obtain these results by constructing policy-specific Lyapunov functions and computing mean drift of the PDMP. We also validate the results via a series of micro-simulation-based experiments. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Production

Authors: Anyi Rao, Xuekun Jiang, Yuwei Guo, Linning Xu, Lei Yang, Libiao Jin, Dahua Lin, Bo Dai

Abstract: Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual… ▽ More Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production. △ Less

Submitted 21 July, 2023; v1 submitted 30 January, 2023; originally announced January 2023.

Comments: Project page: https://virtualfilmstudio.github.io/

Cost-aware Defense for Parallel Server Systems against Reliability and Security Failures

Authors: Qian Xie, Jiayi Wang, Li Jin

Abstract: Parallel server systems in transportation, manufacturing, and computing heavily rely on dynamic routing using connected cyber components for computation and communication. Yet, these components remain vulnerable to random malfunctions and malicious attacks, motivating the need for fault-tolerant dynamic routing that are both traffic-stabilizing and cost-efficient. In this paper, we consider a para… ▽ More Parallel server systems in transportation, manufacturing, and computing heavily rely on dynamic routing using connected cyber components for computation and communication. Yet, these components remain vulnerable to random malfunctions and malicious attacks, motivating the need for fault-tolerant dynamic routing that are both traffic-stabilizing and cost-efficient. In this paper, we consider a parallel server system with dynamic routing subject to reliability and stability failures. For the reliability setting, we consider an infinite-horizon Markov decision process where the system operator strategically activates protection mechanism upon each job arrival based on traffic state observations. We prove an optimal deterministic threshold protecting policy exists based on dynamic programming recursion of the HJB equation. For the security setting, we extend the model to an infinite-horizon stochastic game where the attacker strategically manipulates routing assignment. We show that both players follow a threshold strategy at every Markov perfect equilibrium. For both failure settings, we also analyze the stability of the traffic queues under control. Finally, we develop approximate dynamic programming algorithms to compute the optimal/equilibrium policies, supplemented with numerical examples and experiments for validation and illustration. △ Less

Submitted 20 August, 2023; v1 submitted 26 January, 2023; originally announced January 2023.

Comments: Major Revision in Automatica

Evaluation of Public Transit Systems under Short Random Service Suspensions: A Bulk-Service Queuing Approach

Authors: Baichuan Mo, Li Jin, Haris N. Koutsopoulos, Zuo-Jun Max Shen, Jinhua Zhao

Abstract: This paper proposes a stochastic framework to evaluate the performance of public transit systems under short random service suspensions. We aim to derive closed-form formulations of the mean and variance of the queue length and waiting time. A bulk-service queue model is adopted to formulate the queuing behavior in the system. The random service suspension is modeled as a two-state (disruption and… ▽ More This paper proposes a stochastic framework to evaluate the performance of public transit systems under short random service suspensions. We aim to derive closed-form formulations of the mean and variance of the queue length and waiting time. A bulk-service queue model is adopted to formulate the queuing behavior in the system. The random service suspension is modeled as a two-state (disruption and normal) Markov process. We prove that headway is distributed as the difference between two compound Poisson exponential random variables. The distribution is used to specify the mean and variance of queue length and waiting time at each station with analytical formulations. The closed-form stability condition of the system is also derived, implying that the system is more likely to be unstable with high incident rates and long incident duration. The proposed model is implemented on a bus network. Results show that higher incident rates and higher average incident duration will increase both the mean and variance of queue length and waiting time, which are consistent with the theoretical analysis. Crowding stations are more vulnerable to random service suspensions. The theoretical results are validated with a simulation model, showing consistency between the two outcomes. △ Less

Submitted 2 January, 2023; originally announced January 2023.

Scalable Framework For Deep Learning based CSI Feedback

Authors: Liqiang Jin, Qiuping Huang, Qiubin Gao, Yongqiang Fei, Shaohui Sun

Abstract: Deep learning (DL) based channel state information (CSI) feedback in multiple-input multiple-output (MIMO) systems recently has attracted lots of attention from both academia and industrial. From a practical point of views, it is huge burden to train, transfer and deploy a DL model for each parameter configuration of the base station (BS). In this paper, we propose a scalable and flexible framewor… ▽ More Deep learning (DL) based channel state information (CSI) feedback in multiple-input multiple-output (MIMO) systems recently has attracted lots of attention from both academia and industrial. From a practical point of views, it is huge burden to train, transfer and deploy a DL model for each parameter configuration of the base station (BS). In this paper, we propose a scalable and flexible framework for DL based CSI feedback referred as scalable CsiNet (SCsiNet) to adapt a family of configured parameters such as feedback payloads, MIMO channel ranks, antenna numbers. To reduce model size and training complexity, the core block with pre-processing and post-processing in SCsiNet is reused among different parameter configurations as much as possible which is totally different from configuration-orienting design. The preprocessing and post-processing are trainable neural network layers introduced for matching input/output dimensions and probability distributions. The proposed SCsiNet is evaluated by metrics of squared generalized cosine similarity (SGCS) and user throughput (UPT) in system level simulations. Compared to existing schemes (configuration-orienting DL schemes and 3GPP Rel-16 Type-II codebook based schemes), the proposed scheme can significantly reduce mode size and achieve 2%-10% UPT improvement for all parameter configurations. △ Less

Submitted 18 October, 2022; originally announced October 2022.

Comments: 6 pages,3 figures

RibSeg v2: A Large-scale Benchmark for Rib Labeling and Anatomical Centerline Extraction

Authors: Liang Jin, Shixuan Gu, Donglai Wei, Jason Ken Adhinarta, Kaiming Kuang, Yongjie Jessica Zhang, Hanspeter Pfister, Bingbing Ni, Jiancheng Yang, Ming Li

Abstract: Automatic rib labeling and anatomical centerline extraction are common prerequisites for various clinical applications. Prior studies either use in-house datasets that are inaccessible to communities, or focus on rib segmentation that neglects the clinical significance of rib labeling. To address these issues, we extend our prior dataset (RibSeg) on the binary rib segmentation task to a comprehens… ▽ More Automatic rib labeling and anatomical centerline extraction are common prerequisites for various clinical applications. Prior studies either use in-house datasets that are inaccessible to communities, or focus on rib segmentation that neglects the clinical significance of rib labeling. To address these issues, we extend our prior dataset (RibSeg) on the binary rib segmentation task to a comprehensive benchmark, named RibSeg v2, with 660 CT scans (15,466 individual ribs in total) and annotations manually inspected by experts for rib labeling and anatomical centerline extraction. Based on the RibSeg v2, we develop a pipeline including deep learning-based methods for rib labeling, and a skeletonization-based method for centerline extraction. To improve computational efficiency, we propose a sparse point cloud representation of CT scans and compare it with standard dense voxel grids. Moreover, we design and analyze evaluation metrics to address the key challenges of each task. Our dataset, code, and model are available online to facilitate open research at https://github.com/M3DV/RibSeg △ Less

Submitted 1 August, 2023; v1 submitted 17 October, 2022; originally announced October 2022.

Comments: 10 pages, 6 figures, journal

EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control System

Authors: Haoran Su, Yaofeng D. Zhong, Joseph Y. J. Chow, Biswadip Dey, Li Jin

Abstract: Emergency vehicles (EMVs) play a crucial role in responding to time-critical calls such as medical emergencies and fire outbreaks in urban areas. Existing methods for EMV dispatch typically optimize routes based on historical traffic-flow data and design traffic signal pre-emption accordingly; however, we still lack a systematic methodology to address the coupling between EMV routing and traffic s… ▽ More Emergency vehicles (EMVs) play a crucial role in responding to time-critical calls such as medical emergencies and fire outbreaks in urban areas. Existing methods for EMV dispatch typically optimize routes based on historical traffic-flow data and design traffic signal pre-emption accordingly; however, we still lack a systematic methodology to address the coupling between EMV routing and traffic signal control. In this paper, we propose EMVLight, a decentralized reinforcement learning (RL) framework for joint dynamic EMV routing and traffic signal pre-emption. We adopt the multi-agent advantage actor-critic method with policy sharing and spatial discounted factor. This framework addresses the coupling between EMV navigation and traffic signal control via an innovative design of multi-class RL agents and a novel pressure-based reward function. The proposed methodology enables EMVLight to learn network-level cooperative traffic signal phasing strategies that not only reduce EMV travel time but also shortens the travel time of non-EMVs. Simulation-based experiments indicate that EMVLight enables up to a $42.6\%$ reduction in EMV travel time as well as an $23.5\%$ shorter average travel time compared with existing approaches. △ Less

Submitted 29 June, 2022; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: 19 figures, 10 tables. Manuscript extended on previous work arXiv:2109.05429, arXiv:2111.00278

Journal ref: Transportation Research Part C: Emerging Technologies Volume 146, January 2023, 103955

Securing Signal-free Intersections against Strategic Jamming Attacks: A Macroscopic Approach

Authors: Yumeng Bai, Saurabh Amin, Xudong Wang, Li Jin

Abstract: We consider the security-by-design of a signal-free intersection for connected and autonomous vehicles in the face of strategic jamming attacks. We use a fluid model to characterize macroscopic traffic flow through the intersection, where the saturation rate is derived from a vehicle coordination algorithm. We model jamming attacks as sudden increase in communication latency induced on vehicle-to-… ▽ More We consider the security-by-design of a signal-free intersection for connected and autonomous vehicles in the face of strategic jamming attacks. We use a fluid model to characterize macroscopic traffic flow through the intersection, where the saturation rate is derived from a vehicle coordination algorithm. We model jamming attacks as sudden increase in communication latency induced on vehicle-to-infrastructure connectivity; such latency triggers the safety mode for vehicle coordination and thus reduces the intersection saturation rate. A strategic attacker selects the attacking rate, while a system operator selects key design parameters, either the saturation rate or the recovery rate. Both players' actions induce technological costs and jointly determine the mean travel delay. By analyzing the equilibrium of the security game, we study the preferable level of investment in the intersection's nominal discharging capability or recovery capability. △ Less

Submitted 18 September, 2022; v1 submitted 18 April, 2022; originally announced April 2022.

Comments: Accepted by 2022 IEEE Conference on Decision and Control(CDC)

Resilient Ramp Control for Highways Facing Stochastic Perturbations

Authors: Yu Tang, Li Jin, Alexander A. Kurzhanskiy, Saurabh Amin

Abstract: Highway capacity is often subject to stochastic perturbations due to the combined effects of weather, traffic mixture, driver behavior, etc. This paper is motivated by the need of a systematic approach to traffic control with performance guarantees in the face of such perturbations. We develop a novel control-theoretic method for designing perturbation-resilient ramp metering. We consider a cell-t… ▽ More Highway capacity is often subject to stochastic perturbations due to the combined effects of weather, traffic mixture, driver behavior, etc. This paper is motivated by the need of a systematic approach to traffic control with performance guarantees in the face of such perturbations. We develop a novel control-theoretic method for designing perturbation-resilient ramp metering. We consider a cell-transmission model with 1) Markovian cell capacities and 2) buffers representing on-ramps and upstream mainline. Using this model, we analyze the stability of on-ramp queues by constructing piecewise Lyapunov functions that consider the nature of nonlinear traffic dynamics. Then, we design ramp controllers that guarantee bounds for throughput and queue sizes. We also formulate the problem of coordinated ramp metering as a bi-level optimization with non-convex inner sub-problems. To address the computational issue in solving this problem, we also consider localized and partially coordinated reformulations. A case study of a 18.1-km highway in Los Angeles, USA indicates a 8.3\% (resp. 9.9\%) reduction of vehicle-hours-traveled obtained by the localized (resp. partially coordinated) control, both outperforming the classical ALINEA and METALINE controllers. △ Less

Submitted 9 March, 2022; v1 submitted 21 April, 2021; originally announced April 2021.

A Hybrid Queuing Model for Coordinated Vehicle Platooning on Mixed-Autonomy Highways: Training and Validation

Authors: Haoran Su, Zhengjie Ji, Karl. H. Johansson, Li Jin

Abstract: Platooning of connected and autonomous vehicles (CAVs) is an emerging technology with a strong potential for throughput improvement and fuel reduction. Adequate macroscopic models are critical for system-level efficiency and reliability of platooning. In this paper, we consider a hybrid queuing model for a mixed-autonomy highway section and develop an easy-to-use training algorithm. The model pred… ▽ More Platooning of connected and autonomous vehicles (CAVs) is an emerging technology with a strong potential for throughput improvement and fuel reduction. Adequate macroscopic models are critical for system-level efficiency and reliability of platooning. In this paper, we consider a hybrid queuing model for a mixed-autonomy highway section and develop an easy-to-use training algorithm. The model predicts CAV and non-CAV counts according to the traffic demand as well as key parameters of the highway section. The training algorithm learns the highway parameters from observed data in real time. We test the model and the algorithm in Simulation of Urban Mobility (SUMO) and show that the prediction error is around 15% in a stationary setting and around 25% in a non-stationary setting. We also show that the trained model leads to a platoon headway regulation policy very close to the simulated optimum. The proposed model and algorithm can directly support model-predictive decision-making for platooning in mixed autonomy. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Comments: 12 pages, 9 figures

Stabilizing Queuing Networks with Model Data-Independent Control

Authors: Qian Xie, Li Jin

Abstract: Classical queuing network control strategies typically rely on accurate knowledge of model data, i.e., arrival and service rates. However, such data are not always available and may be time-variant. To address this challenge, we consider a class of model data-independent (MDI) control policies that only rely on traffic state observation and network topology. Specifically, we focus on the MDI contr… ▽ More Classical queuing network control strategies typically rely on accurate knowledge of model data, i.e., arrival and service rates. However, such data are not always available and may be time-variant. To address this challenge, we consider a class of model data-independent (MDI) control policies that only rely on traffic state observation and network topology. Specifically, we focus on the MDI control policies that can stabilize multi-class Markovian queuing networks under centralized and decentralized policies. Control actions include routing, sequencing, and holding. By expanding the routes and constructing piecewise-linear test functions, we derive an easy-to-use criterion to check the stability of a multi-class network under a given MDI policy. For stabilizable multi-class networks, we show that a centralized, stabilizing MDI policy exists. For stabilizable single-class networks, we further show that a decentralized, stabilizing MDI policy exists. In addition, for both settings, we construct explicit policies that attain maximal throughput and present numerical examples to illustrate the results. △ Less

Submitted 7 June, 2023; v1 submitted 23 November, 2020; originally announced November 2020.

Comments: Accepted by IEEE Transactions on Control of Network Systems

Latency-Robust Control of High-Speed Signal-Free Intersections

Authors: Yang Liu, Zev Nicolai-Scanio, Zhong-Ping Jiang, Li Jin

Abstract: High-speed signal-free intersections are a novel urban traffic operations enabled by connected and autonomous vehicles. However, the impact of communication latency on intersection performance has not been well understood. In this paper, we consider vehicle coordination at signal-free intersections with latency. We focus on two questions: (i) how to ensure latency-resiliency of the coordination al… ▽ More High-speed signal-free intersections are a novel urban traffic operations enabled by connected and autonomous vehicles. However, the impact of communication latency on intersection performance has not been well understood. In this paper, we consider vehicle coordination at signal-free intersections with latency. We focus on two questions: (i) how to ensure latency-resiliency of the coordination algorithm, and (ii) how latency affects the intersection's capacity. We consider a trajectory-based model with bounded speed uncertainties. Latency leads to uncertain state observation. We propose a piecewise-linear control law that ensures safety (avoidance of interference) as long as the initial condition is safe. We also analytically quantify the throughput that the proposed control can attain in the face of latency. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Analysis of a Markovian Queuing Model for Autonomous Signal-Free Intersection

Authors: Hanwen Dai, Li Jin

Abstract: We consider a novel, analytical queuing model for vehicle coordination at signal-free intersections. Vehicles arrive at an intersection according to Poisson processes, and the crossing times are constants dependent of vehicle types. We use this model to quantitatively relate key operational parameters (vehicle speed/acceleration, inter-vehicle headway) to key performance metrics (throughput and de… ▽ More We consider a novel, analytical queuing model for vehicle coordination at signal-free intersections. Vehicles arrive at an intersection according to Poisson processes, and the crossing times are constants dependent of vehicle types. We use this model to quantitatively relate key operational parameters (vehicle speed/acceleration, inter-vehicle headway) to key performance metrics (throughput and delay) under the first-come-first-serve rule. We use the Foster-Lyapunov drift condition to obtain stability criteria and an upper bound for average time delay. Based on these results, we compare the efficiency of signal free intersections with conventional vehicles and with connected and autonomous vehicles. We also validate our results in Simulation of Urban Mobility (SUMO). △ Less

Submitted 27 September, 2020; originally announced September 2020.

V2I Connectivity-Based Dynamic Queue-Jump Lane for Emergency Vehicles: A Deep Reinforcement Learning Approach

Authors: Haoran Su, Kejian Shi, Li Jin, Joseph Y. J. Chow

Abstract: Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. A main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. In this paper, we study the improvement of EMV service under V2I connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-t… ▽ More Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. A main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. In this paper, we study the improvement of EMV service under V2I connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-time coordination of connected vehicles. We develop a novel Markov decision process formulation for the DQJL problem, which explicitly accounts for the uncertainty of drivers' reaction to approaching EMVs. We propose a deep neural network-based reinforcement learning algorithm that efficiently computes the optimal coordination instructions. We also validate our approach on a micro-simulation testbed using Simulation of Urban Mobility (SUMO). Validation results show that with our proposed methodology, the centralized control system saves approximately 15\% EMV passing time than the benchmark system. △ Less

Submitted 29 May, 2021; v1 submitted 1 August, 2020; originally announced August 2020.

Comments: 20 pages, 6 figures

FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval

Authors: Dehong Gao, Linbo Jin, Ben Chen, Minghui Qiu, Peng Li, Yi Wei, Yi Hu, Hao Wang

Abstract: In this paper, we address the text and image matching in cross-modal retrieval of the fashion industry. Different from the matching in the general domain, the fashion matching is required to pay much more attention to the fine-grained information in the fashion images and texts. Pioneer approaches detect the region of interests (i.e., RoIs) from images and use the RoI embeddings as image represent… ▽ More In this paper, we address the text and image matching in cross-modal retrieval of the fashion industry. Different from the matching in the general domain, the fashion matching is required to pay much more attention to the fine-grained information in the fashion images and texts. Pioneer approaches detect the region of interests (i.e., RoIs) from images and use the RoI embeddings as image representations. In general, RoIs tend to represent the "object-level" information in the fashion images, while fashion texts are prone to describe more detailed information, e.g. styles, attributes. RoIs are thus not fine-grained enough for fashion text and image matching. To this end, we propose FashionBERT, which leverages patches as image features. With the pre-trained BERT model as the backbone network, FashionBERT learns high level representations of texts and images. Meanwhile, we propose an adaptive loss to trade off multitask learning in the FashionBERT modeling. Two tasks (i.e., text and image matching and cross-modal retrieval) are incorporated to evaluate FashionBERT. On the public dataset, experiments demonstrate FashionBERT achieves significant improvements in performances than the baseline and state-of-the-art approaches. In practice, FashionBERT is applied in a concrete cross-modal retrieval application. We provide the detailed matching performance and inference efficiency analysis. △ Less

Submitted 29 May, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

Comments: 10 pages, to be published in SIGIR20 Industry Track

NTIRE 2020 Challenge on Video Quality Mapping: Methods and Results

Authors: Dario Fuoli, Zhiwu Huang, Martin Danelljan, Radu Timofte, Hua Wang, Longcun Jin, Dewei Su, Jing Liu, Jaehoon Lee, Michal Kudelski, Lukasz Bala, Dmitry Hrybov, Marcin Mozejko, Muchen Li, Siyao Li, Bo Pang, Cewu Lu, Chao Li, Dongliang He, Fu Li, Shilei Wen

Abstract: This paper reviews the NTIRE 2020 challenge on video quality mapping (VQM), which addresses the issues of quality mapping from source video domain to target video domain. The challenge includes both a supervised track (track 1) and a weakly-supervised track (track 2) for two benchmark datasets. In particular, track 1 offers a new Internet video benchmark, requiring algorithms to learn the map from… ▽ More This paper reviews the NTIRE 2020 challenge on video quality mapping (VQM), which addresses the issues of quality mapping from source video domain to target video domain. The challenge includes both a supervised track (track 1) and a weakly-supervised track (track 2) for two benchmark datasets. In particular, track 1 offers a new Internet video benchmark, requiring algorithms to learn the map from more compressed videos to less compressed videos in a supervised training manner. In track 2, algorithms are required to learn the quality mapping from one device to another when their quality varies substantially and weakly-aligned video pairs are available. For track 1, in total 7 teams competed in the final test phase, demonstrating novel and effective solutions to the problem. For track 2, some existing methods are evaluated, showing promising solutions to the weakly-supervised video quality mapping problem. △ Less

Submitted 15 June, 2020; v1 submitted 5 May, 2020; originally announced May 2020.

Comments: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops

Analysis and Control of Dynamic Flow Networks Subject to Stochastic Cyber-Physical Disruptions

Authors: Yu Tang, Li Jin

Abstract: Modern network systems such as transportation, manufacturing, and communication systems are subject to cyber-physical disruptions. Cyber disruptions compromise sensing and/or actuating which closed-loop control relies on, and physical disruptions undermine network capability. This paper develops a novel approach to analysis and design of traffic control for dynamic flow networks subject to a rathe… ▽ More Modern network systems such as transportation, manufacturing, and communication systems are subject to cyber-physical disruptions. Cyber disruptions compromise sensing and/or actuating which closed-loop control relies on, and physical disruptions undermine network capability. This paper develops a novel approach to analysis and design of traffic control for dynamic flow networks subject to a rather broad class of disruptions. We consider a single-origin-single-destination acyclic network with possibly finite link storage spaces. Both cyber and physical disruptions are modeled as a set of discrete modes that modify the control and/or the network flow dynamics. The network switches between various modes according to a Markov process. By considering switched, piecewise polynomial Lyapunov functions and exploiting monotonicity of the network flow dynamics, we analyze network throughput under various disruption scenarios and show that cyber-physical disruptions can significantly reduce network throughput. For control design, we derive two results analogous to the classical max-flow min-cut theorem: (i) for a network with observable disruption modes, there exist mode-dependent controls that attain the expected-min-cut capacity; (ii) for a network with infinite link storage spaces, there exists an open-loop control that attains the min-expected-cut capacity. We also design a closed-loop control for general cases and derive an explicit relation from the control to a lower-bound for throughput. Our approach is illustrated by a series of numerical examples. △ Less

Submitted 21 April, 2020; v1 submitted 31 March, 2020; originally announced April 2020.

Optimizing Coordinated Vehicle Platooning: An Analytical Approach Based on Stochastic Dynamic Programming

Authors: Xi Xiong, Junyi Sha, Li Jin

Abstract: Platooning connected and autonomous vehicles (CAVs) can improve traffic and fuel efficiency. However, scalable platooning operations require junction-level coordination, which has not been well studied. In this paper, we study the coordination of vehicle platooning at highway junctions. We consider a setting where CAVs randomly arrive at a highway junction according to a general renewal process. W… ▽ More Platooning connected and autonomous vehicles (CAVs) can improve traffic and fuel efficiency. However, scalable platooning operations require junction-level coordination, which has not been well studied. In this paper, we study the coordination of vehicle platooning at highway junctions. We consider a setting where CAVs randomly arrive at a highway junction according to a general renewal process. When a CAV approaches the junction, a system operator determines whether the CAV will merge into the platoon ahead according to the positions and speeds of the CAV and the platoon. We formulate a Markov decision process to minimize the discounted cumulative travel cost, i.e. fuel consumption plus travel delay, over an infinite time horizon. We show that the optimal policy is threshold-based: the CAV will merge with the platoon if and only if the difference between the CAV's and the platoon's predicted times of arrival at the junction is less than a constant threshold. We also propose two ready-to-implement algorithms to derive the optimal policy. Comparison with the classical value iteration algorithm implies that our approach explicitly incorporating the characteristics of the optimal policy is significantly more efficient in terms of computation. Importantly, we show that the optimal policy under Poisson arrivals can be obtained by solving a system of integral equations. We also validate our results in simulation with Real-time Strategy (RTS) using real traffic data. The simulation results indicate that the proposed method yields better performance compared with the conventional method. △ Less

Submitted 8 May, 2020; v1 submitted 29 March, 2020; originally announced March 2020.

Report number: Volume 150, August 2021, Pages 482-502

Journal ref: 2021

Dynamic Queue-Jump Lane for Emergency Vehicles under Partially Connected Settings: A Multi-Agent Deep Reinforcement Learning Approach

Authors: Haoran Su, Kejian Shi, Joseph. Y. J. Chow, Li Jin

Abstract: Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. The main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. In this paper, we study the improvement of EMV service under V2X connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real… ▽ More Emergency vehicle (EMV) service is a key function of cities and is exceedingly challenging due to urban traffic congestion. The main reason behind EMV service delay is the lack of communication and cooperation between vehicles blocking EMVs. In this paper, we study the improvement of EMV service under V2X connectivity. We consider the establishment of dynamic queue jump lanes (DQJLs) based on real-time coordination of connected vehicles in the presence of non-connected human-driven vehicles. We develop a novel Markov decision process formulation for the DQJL coordination strategies, which explicitly accounts for the uncertainty of drivers' yielding pattern to approaching EMVs. Based on pairs of neural networks representing actors and critics for agent vehicles, we develop a multi-agent actor-critic deep reinforcement learning algorithm that handles a varying number of vehicles and a random proportion of connected vehicles in the traffic. Approaching the optimal coordination strategies via indirect and direct reinforcement learning, we present two schemata to address multi-agent reinforcement learning on this connected vehicle application. Both approaches are validated, on a micro-simulation testbed SUMO, to establish a DQJL fast and safely. Validation results reveal that, with DQJL coordination strategies, it saves up to 30% time for EMVs to pass a link-level intelligent urban roadway than the baseline scenario. △ Less

Submitted 15 January, 2021; v1 submitted 2 March, 2020; originally announced March 2020.

Comments: 42 pages, 13 figures, 7 tables

Fine-grained Attention and Feature-sharing Generative Adversarial Networks for Single Image Super-Resolution

Authors: Yitong Yan, Chuangchuang Liu, Changyou Chen, Xianfang Sun, Longcun Jin, Xiang Zhou

Abstract: The traditional super-resolution methods that aim to minimize the mean square error usually produce the images with over-smoothed and blurry edges, due to the lose of high-frequency details. In this paper, we propose two novel techniques in the generative adversarial networks to produce photo-realistic images for image super-resolution. Firstly, instead of producing a single score to discriminate… ▽ More The traditional super-resolution methods that aim to minimize the mean square error usually produce the images with over-smoothed and blurry edges, due to the lose of high-frequency details. In this paper, we propose two novel techniques in the generative adversarial networks to produce photo-realistic images for image super-resolution. Firstly, instead of producing a single score to discriminate images between real and fake, we propose a variant, called Fine-grained Attention Generative Adversarial Network for image super-resolution (FASRGAN), to discriminate each pixel between real and fake. FASRGAN adopts a Unet-like network as the discriminator with two outputs: an image score and an image score map. The score map has the same spatial size as the HR/SR images, serving as the fine-grained attention to represent the degree of reconstruction difficulty for each pixel. Secondly, instead of using different networks for the generator and the discriminator in the SR problem, we use a feature-sharing network (Fs-SRGAN) for both the generator and the discriminator. By network sharing, certain information is shared between the generator and the discriminator, which in turn can improve the ability of producing high-quality images. Quantitative and visual comparisons with the state-of-the-art methods on the benchmark datasets demonstrate the superiority of our methods. The application of super-resolution images to object recognition further proves that the proposed methods endow the power to reconstruction capabilities and the excellent super-resolution effects. △ Less

Submitted 24 December, 2020; v1 submitted 25 November, 2019; originally announced November 2019.

Comments: 15 pages, 14 figures, 7 tables

Air-Writing Translater: A Novel Unsupervised Domain Adaptation Method for Inertia-Trajectory Translation of In-air Handwriting

Authors: Songbin Xu, Yang Xue, Xin Zhang, Lianwen Jin

Abstract: As a new way of human-computer interaction, inertial sensor based in-air handwriting can provide a natural and unconstrained interaction to express more complex and richer information in 3D space. However, most of the existing in-air handwriting work is mainly focused on handwritten character recognition, which makes these work suffer from poor readability of inertial signal and lack of labeled sa… ▽ More As a new way of human-computer interaction, inertial sensor based in-air handwriting can provide a natural and unconstrained interaction to express more complex and richer information in 3D space. However, most of the existing in-air handwriting work is mainly focused on handwritten character recognition, which makes these work suffer from poor readability of inertial signal and lack of labeled samples. To address these two problems, we use unsupervised domain adaptation method to reconstruct the trajectory of inertial signal and generate inertial samples using online handwritten trajectories. In this paper, we propose an AirWriting Translater model to learn the bi-directional translation between trajectory domain and inertial domain in the absence of paired inertial and trajectory samples. Through semantic-level adversarial training and latent classification loss, the proposed model learns to extract domain-invariant content between inertial signal and trajectory, while preserving semantic consistency during the translation across the two domains. We carefully design the architecture, so that the proposed framework can accept inputs of arbitrary length and translate between different sampling rates. We also conduct experiments on two public datasets: 6DMG (in-air handwriting dataset) and CT (handwritten trajectory dataset), the results on the two datasets demonstrate that the proposed network successes in both Inertia-to Trajectory and Trajectory-to-Inertia translation tasks. △ Less

Submitted 1 November, 2019; originally announced November 2019.

Security Risk Analysis of the Shorter-Queue Routing Policy for Two Symmetric Servers

Authors: Yu Tang, Yining Wen, Li Jin

Abstract: In this article, we study the classical shortest queue problem under the influence of malicious attacks, which is relevant to a variety of engineering system including transportation, manufacturing, and communications. We consider a homogeneous Poisson arrival process of jobs and two parallel exponential servers with symmetric service rates. A system operator route incoming jobs to the shorter que… ▽ More In this article, we study the classical shortest queue problem under the influence of malicious attacks, which is relevant to a variety of engineering system including transportation, manufacturing, and communications. We consider a homogeneous Poisson arrival process of jobs and two parallel exponential servers with symmetric service rates. A system operator route incoming jobs to the shorter queue; if the queues are equal, the job is routed randomly. A malicious attacker is able to intercept the operator's routing instruction and overwrite it with a randomly generated one. The operator is able to defend individual jobs to ensure correct routing. Both attacking and defending induce technological costs. The attacker's (resp. operator's) decision is the probability of attacking (resp. defending) the routing of each job. We first quantify the queuing cost for given strategy profiles by deriving a theoretical upper bound for the cost. Then, we formulate a non-zero-sum attacker-defender game, characterize the equilibria in multiple regimes, and quantify the security risk. We find that the attacker's best strategy is either to attack all jobs or not to attack, and the defender's strategy is strongly influenced by the arrival rate of jobs. Finally, as a benchmark, we compare the security risks of the feedback-controlled system to a corresponding open-loop system with Bernoulli routing. We show that the shorter-queue policy has a higher (resp. lower) security risk than the Bernoulli policy if the demand is lower (resp. higher) than the service rate of one server. △ Less

Submitted 1 October, 2019; v1 submitted 24 September, 2019; originally announced September 2019.

Resilience of Dynamic Routing in the Face of Recurrent and Random Sensing Faults

Authors: Qian Xie, Li Jin

Abstract: Feedback dynamic routing is a commonly used control strategy in transportation systems. This class of control strategies relies on real-time information about the traffic state in each link. However, such information may not always be observable due to temporary sensing faults. In this article, we consider dynamic routing over two parallel routes, where the sensing on each link is subject to recur… ▽ More Feedback dynamic routing is a commonly used control strategy in transportation systems. This class of control strategies relies on real-time information about the traffic state in each link. However, such information may not always be observable due to temporary sensing faults. In this article, we consider dynamic routing over two parallel routes, where the sensing on each link is subject to recurrent and random faults. The faults occur and clear according to a finite-state Markov chain. When the sensing is faulty on a link, the traffic state on that link appears to be zero to the controller. Building on the theories of Markov processes and monotone dynamical systems, we derive lower and upper bounds for the resilience score, i.e. the guaranteed throughput of the network, in the face of sensing faults by establishing stability conditions for the network. We use these results to study how a variety of key parameters affect the resilience score of the network. The main conclusions are: (i) Sensing faults can reduce throughput and destabilize a nominally stable network; (ii) A higher failure rate does not necessarily reduce throughput, and there may exist a worst rate that minimizes throughput; (iii) Higher correlation between the failure probabilities of two links leads to greater throughput; (iv) A large difference in capacity between two links can result in a drop in throughput. △ Less

Submitted 12 March, 2020; v1 submitted 24 September, 2019; originally announced September 2019.

Comments: 17 pages, 4 figures, accepted by ACC 2020

Deformable Non-local Network for Video Super-Resolution

Authors: Hua Wang, Dewei Su, Chuangchuang Liu, Longcun Jin, Xianfang Sun, Xinyi Peng

Abstract: The video super-resolution (VSR) task aims to restore a high-resolution (HR) video frame by using its corresponding low-resolution (LR) frame and multiple neighboring frames. At present, many deep learning-based VSR methods rely on optical flow to perform frame alignment. The final recovery results will be greatly affected by the accuracy of optical flow. However, optical flow estimation cannot be… ▽ More The video super-resolution (VSR) task aims to restore a high-resolution (HR) video frame by using its corresponding low-resolution (LR) frame and multiple neighboring frames. At present, many deep learning-based VSR methods rely on optical flow to perform frame alignment. The final recovery results will be greatly affected by the accuracy of optical flow. However, optical flow estimation cannot be completely accurate, and there are always some errors. In this paper, we propose a novel deformable non-local network (DNLN) which is a non-optical-flow-based method. Specifically, we apply the deformable convolution and improve its ability of adaptive alignment at the feature level. Furthermore, we utilize a non-local structure to capture the global correlation between the reference frame and the aligned neighboring frames, and simultaneously enhance desired fine details in the aligned frames. To reconstruct the final high-quality HR video frames, we use residual in residual dense blocks to take full advantage of the hierarchical features. Experimental results on benchmark datasets demonstrate that the proposed DNLN can achieve state-of-the-art performance on VSR task. △ Less

Submitted 21 December, 2019; v1 submitted 23 September, 2019; originally announced September 2019.

Journal ref: IEEE Access, vol. 7, pp. 177734-177744, 2019

Multi-Task Deep Learning with Dynamic Programming for Embryo Early Development Stage Classification from Time-Lapse Videos

Authors: Zihan Liu, Bo Huang, Yuqi Cui, Yifan Xu, Bo Zhang, Lixia Zhu, Yang Wang, Lei Jin, Dongrui Wu

Abstract: Time-lapse is a technology used to record the development of embryos during in-vitro fertilization (IVF). Accurate classification of embryo early development stages can provide embryologists valuable information for assessing the embryo quality, and hence is critical to the success of IVF. This paper proposes a multi-task deep learning with dynamic programming (MTDL-DP) approach for this purpose.… ▽ More Time-lapse is a technology used to record the development of embryos during in-vitro fertilization (IVF). Accurate classification of embryo early development stages can provide embryologists valuable information for assessing the embryo quality, and hence is critical to the success of IVF. This paper proposes a multi-task deep learning with dynamic programming (MTDL-DP) approach for this purpose. It first uses MTDL to pre-classify each frame in the time-lapse video to an embryo development stage, and then DP to optimize the stage sequence so that the stage number is monotonically non-decreasing, which usually holds in practice. Different MTDL frameworks, e.g., one-to-many, many-to-one, and many-to-many, are investigated. It is shown that the one-to-many MTDL framework achieved the best compromise between performance and computational cost. To our knowledge, this is the first study that applies MTDL to embryo early development stage classification from time-lapse videos. △ Less

Submitted 22 August, 2019; originally announced August 2019.

Evaluation of Headway Threshold-based Coordinated Platooning over a Cascade of Highway Junctions

Authors: Xi Xiong, Teze Wang, Li Jin

Abstract: Platooning of vehicles with coordinated adaptive cruise control (CACC) capabilities is a promising technology with a strong potential for fuel savings and congestion mitigation. Although some researchers have studied the vehicle-level fuel savings of platooning, few have considered the system-level benefits. This paper evaluates vehicle platooning as a fuel-reduction method and propose a hierarchi… ▽ More Platooning of vehicles with coordinated adaptive cruise control (CACC) capabilities is a promising technology with a strong potential for fuel savings and congestion mitigation. Although some researchers have studied the vehicle-level fuel savings of platooning, few have considered the system-level benefits. This paper evaluates vehicle platooning as a fuel-reduction method and propose a hierarchical control system. We particularly focus on the impact of platooning coordination algorithm on system-wide benefits. The main task of platooning coordination is to regulate the times at which multiple vehicles arrive at a particular junction: these vehicles can platoon only if they meet (i.e. arrive within a common time interval) at the junction. We use a micro-simulation model to evaluate a class of threshold-based coordination strategies and derive insights about the trade-off between the fuel savings due to air drag reduction in platoons and the extra fuel consumption due to the coordination (i.e. acceleration of some vehicles to catch up with the leading ones). The model is calibrated using real traffic data of a section of Interstate 210 in the Los Angeles metropolitan area. We study the relation between key decision variables, including the platooning threshold and the coordination radius, and key performance metric, fuel consumption. △ Less

Submitted 6 August, 2019; originally announced August 2019.

Coordinating Vehicle Platoons for Highway Bottleneck Decongestion and Throughput Improvement

Authors: Mladen Čičić, Li Jin, Karl Henrik Johansson

Abstract: Truck platooning is a technology that is expected to become widespread in the coming years. Apart from the numerous benefits that it brings, its potential effects on the overall traffic situation need to be studied further, especially at bottlenecks and ramps. Assuming we can control the platoons from the infrastructure, they can be used as controlled moving bottlenecks, actuating control actions… ▽ More Truck platooning is a technology that is expected to become widespread in the coming years. Apart from the numerous benefits that it brings, its potential effects on the overall traffic situation need to be studied further, especially at bottlenecks and ramps. Assuming we can control the platoons from the infrastructure, they can be used as controlled moving bottlenecks, actuating control actions on the rest of the traffic, and potentially improving the throughput of the whole system. In this paper, we use a multi-class cell transmission model to capture the interaction between truck platoons and background traffic, and propose a corresponding queuing model, which we use for control design. We use platoon speeds, and the number of lanes platoons occupy as control inputs, and design a control strategy for throughput improvement of a highway section with a bottleneck. By postponing and shaping the inflow to the bottleneck, we are able to avoid traffic breakdown and capacity drop, which significantly reduces the total time spent of all vehicles. We derived the estimated improvement in throughput that is achieved by applying the proposed control law, and then tested it in a simulation study and found that the median delay of all vehicles by 75.6% compared to the uncontrolled case. Notably, although they are slowed down while actuating control actions, platooned vehicles experience less delay compared to the case without control, since they avoid going through congestion at the bottleneck. △ Less

Submitted 23 March, 2020; v1 submitted 30 July, 2019; originally announced July 2019.

MuFA (Multi-type Fourier Analyzer): A tool for batch generation of MuMax3 input scripts and multi-type Fourier analysis from micromagnetic simulation output data

Authors: Zhiwei Ren, Lichuan Jin, Tianlong Wen, Yulong Liao, Xiaoli Tang, Huaiwu Zhang, Zhiyong Zhong

Abstract: We present a tool for batch generation of input scripts and multi-type Fourier analysis from simulation results for the micromagnetic software MuMax3. The introduction of graphical user interface and parameter-sweeping functionality strongly speed up the input scripts creation and accelerate model optimization processes consequently. Three types of important Fourier analysis methods are provided f… ▽ More We present a tool for batch generation of input scripts and multi-type Fourier analysis from simulation results for the micromagnetic software MuMax3. The introduction of graphical user interface and parameter-sweeping functionality strongly speed up the input scripts creation and accelerate model optimization processes consequently. Three types of important Fourier analysis methods are provided for the acquisition of the quantitative frequency compositions, the spin-wave dispersion curve and the spatial distribution of spin-wave powers at different frequencies, respectively. Since the Fourier analysis is accelerated by parallel computations, the time cost is reduced to an acceptable level even in the presentation of tens of gigabytes data. With the MuMax3 and our proposal, a complete micromagnetic simulating tool chain from scripts generation to post analysis has been developed. △ Less

Submitted 17 June, 2019; originally announced July 2019.

Dynamic Origin-Destination Matrix Prediction with Line Graph Neural Networks and Kalman Filter

Authors: Xi Xiong, Kaan Ozbay, Li Jin, Chen Feng

Abstract: Modern intelligent transportation systems provide data that allow real-time dynamic demand prediction, which is essential for planning and operations. The main challenge of prediction of dynamic Origin-Destination (O-D) demand matrices is that demands cannot be directly measured by traffic sensors; instead, they have to be inferred from aggregate traffic flow data on traffic links. Specifically, s… ▽ More Modern intelligent transportation systems provide data that allow real-time dynamic demand prediction, which is essential for planning and operations. The main challenge of prediction of dynamic Origin-Destination (O-D) demand matrices is that demands cannot be directly measured by traffic sensors; instead, they have to be inferred from aggregate traffic flow data on traffic links. Specifically, spatial correlation, congestion and time dependent factors need to be considered in general transportation networks. In this paper we propose a novel O-D prediction framework combining heterogeneous prediction in graph neural networks and Kalman filter to recognize spatial and temporal patterns simultaneously. The underlying road network topology is converted into a corresponding line graph in the newly designed Fusion Line Graph Convolutional Networks (FL-GCNs), which provide a general framework of predicting spatial-temporal O-D flows from link information. Data from New Jersey Turnpike network are used to evaluate the proposed model. The results show that our proposed approach yields the best performance under various prediction scenarios. In addition, the advantage of combining deep neural networks and Kalman filter is demonstrated. △ Less

Submitted 24 March, 2020; v1 submitted 1 May, 2019; originally announced May 2019.

Resilient UAV Traffic Congestion Control using Fluid Queuing Models

Authors: Jiazhen Zhou, Li Jin, Dengfeng Sun

Abstract: In this paper, we address the issue of congestion in future Unmanned Aerial Vehicle (UAVs) traffic system in uncertain weather. We treat the traffic of UAVs as fluid queues, and introduce models for traffic dynamics at three basic traffic components: single link, tandem link, and merge link. The impact of weather uncertainty is captured as fluctuation of the saturation rate of fluid queue discharg… ▽ More In this paper, we address the issue of congestion in future Unmanned Aerial Vehicle (UAVs) traffic system in uncertain weather. We treat the traffic of UAVs as fluid queues, and introduce models for traffic dynamics at three basic traffic components: single link, tandem link, and merge link. The impact of weather uncertainty is captured as fluctuation of the saturation rate of fluid queue discharge (capacity). The uncertainty is assumed to follow a continuous-time Markov process. We define the resilience of the UAV traffic system as the long-run stability of the traffic queues and the optimal throughput strategy under uncertainties. We derive the necessary and sufficient conditions for the stabilities of the traffic queues in the three basic traffic components. Both conditions can be easily verified in practiceB. The optimal throughput can be calculated via the stability conditions. Our results offer strong insight and tool for designing flows in the UAV traffic system that is resilient against weather uncertainty. △ Less

Submitted 29 April, 2019; originally announced April 2019.

Comments: 7 figures

Analysis of a Stochastic Model for Coordinated Platooning of Heavy-duty Vehicles

Authors: Xi Xiong, Erdong Xiao, Li Jin

Abstract: Platooning of heavy-duty vehicles (HDVs) is a key component of smart and connected highways and is expected to bring remarkable fuel savings and emission reduction. In this paper, we study the coordination of HDV platooning on a highway section. We model the arrival of HDVs as a Poisson process. Multiple HDVs are merged into one platoon if their headways are below a given threshold. The merging is… ▽ More Platooning of heavy-duty vehicles (HDVs) is a key component of smart and connected highways and is expected to bring remarkable fuel savings and emission reduction. In this paper, we study the coordination of HDV platooning on a highway section. We model the arrival of HDVs as a Poisson process. Multiple HDVs are merged into one platoon if their headways are below a given threshold. The merging is done by accelerating the following vehicles to catch up with the leading ones. We characterize the following random variables: (i) platoon size, (ii) headway between platoons, and (iii) travel time increment due to platoon formation. We formulate and solve an optimization problem to determine the headway threshold for platooning that leads to minimal cost (time plus fuel). We also compare our results with that from Simulation of Urban MObility (SUMO). △ Less

Submitted 27 September, 2019; v1 submitted 15 March, 2019; originally announced March 2019.

Throughput-Improving Control of Highways Facing Stochastic Perturbations

Authors: Li Jin, Alexander A. Kurzhanskiy, Saurabh Amin

Abstract: In this paper, we study the problem of traffic management in highways facing stochastic perturbations. To model the macroscopic traffic flow under perturbations, we use cell-transmission model with Markovian capacities. The decision variables are: (i) the admissible flow through each on-ramp, and (ii) whether individual on-ramps are metered to prioritize the mainline traffic or not. The objective… ▽ More In this paper, we study the problem of traffic management in highways facing stochastic perturbations. To model the macroscopic traffic flow under perturbations, we use cell-transmission model with Markovian capacities. The decision variables are: (i) the admissible flow through each on-ramp, and (ii) whether individual on-ramps are metered to prioritize the mainline traffic or not. The objective is to maximize the throughput while ensuring that on-ramp queues remain bounded on average. We develop a computational approach to solving this stability-constrained, throughput-maximization problem. We establish a mixed-integer linear program for throughput maximization and construct an algorithm that gives the optimal solution in particular settings. We illustrate the performance benefits of the proposed approach through a computational study on a segment of Interstate 210 in California, USA. △ Less

Submitted 2 July, 2019; v1 submitted 20 September, 2018; originally announced September 2018.

Comments: 27 pages

Stability of Fluid Queuing Systems with Parallel Servers and Stochastic Capacities

Authors: Li Jin, Saurabh Amin

Abstract: This note introduces a piecewise-deterministic queueing (PDQ) model to study the stability of traffic queues in parallel-link transportation systems facing stochastic capacity fluctuations. The saturation rate (capacity) of the PDQ model switches between a finite set of modes according to a Markov chain, and link inflows are controlled by a state-feedback policy. A PDQ system is stable only if a l… ▽ More This note introduces a piecewise-deterministic queueing (PDQ) model to study the stability of traffic queues in parallel-link transportation systems facing stochastic capacity fluctuations. The saturation rate (capacity) of the PDQ model switches between a finite set of modes according to a Markov chain, and link inflows are controlled by a state-feedback policy. A PDQ system is stable only if a lower bound on the time-average link inflows does not exceed the corresponding time-average saturation rate. Furthermore, a PDQ system is stable if the following two conditions hold: the nominal mode's saturation rate is high enough that all queues vanish in this mode, and a bilinear matrix inequality (BMI) involving an underestimate of the discharge rates of the PDQ in individual modes is feasible. The stability conditions can be strengthened for two-mode PDQs. These results can be used for design of routing policies that guarantee stability of traffic queues under stochastic capacity fluctuations. △ Less

Submitted 16 February, 2018; v1 submitted 7 April, 2016; originally announced April 2016.

Comments: 20 pages, 3 figures