Showing 1–50 of 51 results for author: Annaswamy, A

Federated Learning Forecasting for Strengthening Grid Reliability and Enabling Markets for Resilience

Authors: Lucas Pereira, Vineet Jagadeesan Nair, Bruno Dias, Hugo Morais, Anuradha Annaswamy

Abstract: We propose a comprehensive approach to increase the reliability and resilience of future power grids rich in distributed energy resources. Our distributed scheme combines federated learning-based attack detection with a local electricity market-based attack mitigation method. We validate the scheme by applying it to a real-world distribution grid rich in solar PV. Simulation results demonstrate th… ▽ More We propose a comprehensive approach to increase the reliability and resilience of future power grids rich in distributed energy resources. Our distributed scheme combines federated learning-based attack detection with a local electricity market-based attack mitigation method. We validate the scheme by applying it to a real-world distribution grid rich in solar PV. Simulation results demonstrate that the approach is feasible and can successfully mitigate the grid impacts of cyber-physical attacks. △ Less

Submitted 16 July, 2024; originally announced July 2024.

Comments: Submitted to CIRED 2024 USA: Workshop on Resilience of Electric Distribution Systems

Resilience of the Electric Grid through Trustable IoT-Coordinated Assets

Authors: Vineet J. Nair, Venkatesh Venkataramanan, Priyank Srivastava, Partha S. Sarker, Anurag Srivastava, Laurentiu D. Marinovici, Jun Zha, Christopher Irwin, Prateek Mittal, John Williams, H. Vincent Poor, Anuradha M. Annaswamy

Abstract: The electricity grid has evolved from a physical system to a cyber-physical system with digital devices that perform measurement, control, communication, computation, and actuation. The increased penetration of distributed energy resources (DERs) that include renewable generation, flexible loads, and storage provides extraordinary opportunities for improvements in efficiency and sustainability. Ho… ▽ More The electricity grid has evolved from a physical system to a cyber-physical system with digital devices that perform measurement, control, communication, computation, and actuation. The increased penetration of distributed energy resources (DERs) that include renewable generation, flexible loads, and storage provides extraordinary opportunities for improvements in efficiency and sustainability. However, they can introduce new vulnerabilities in the form of cyberattacks, which can cause significant challenges in ensuring grid resilience. %, i.e. the ability to rapidly restore grid services in the face of severe disruptions. We propose a framework in this paper for achieving grid resilience through suitably coordinated assets including a network of Internet of Things (IoT) devices. A local electricity market is proposed to identify trustable assets and carry out this coordination. Situational Awareness (SA) of locally available DERs with the ability to inject power or reduce consumption is enabled by the market, together with a monitoring procedure for their trustability and commitment. With this SA, we show that a variety of cyberattacks can be mitigated using local trustable resources without stressing the bulk grid. The demonstrations are carried out using a variety of platforms with a high-fidelity co-simulation platform, real-time hardware-in-the-loop validation, and a utility-friendly simulator. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: Submitted to the Proceedings of the National Academy of Sciences (PNAS), under review

A game-theoretic, market-based approach to extract flexibility from distributed energy resources

Authors: Vineet Jagadeesan Nair, Anuradha Annaswamy

Abstract: In this paper, we propose a market design based on game theory to optimally utilize the flexibility of distributed energy resources (DERs) such as solar PV, batteries, electric vehicles, and flexible loads. Market agents perform multiperiod optimization to determine their feasible flexibility limits for power injections while satisfying all constraints of their DERs. This is followed by a Stackelb… ▽ More In this paper, we propose a market design based on game theory to optimally utilize the flexibility of distributed energy resources (DERs) such as solar PV, batteries, electric vehicles, and flexible loads. Market agents perform multiperiod optimization to determine their feasible flexibility limits for power injections while satisfying all constraints of their DERs. This is followed by a Stackelberg game between the market operator and the agents. The market operator as the leader aims to regulate the aggregate power injection around a desired value by leveraging the flexibility of their agents, and computes optimal prices for both electricity and flexibility services. The agents follow by optimally bidding their desired flexible power injections in response to these prices. We show the existence of an equilibrium among the market agents between all agents and the operator, along with simulation results for a small example system. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: This work has been submitted to IFAC for possible publication

On the stability of second order gradient descent for time varying convex functions

Authors: Travis E. Gibson, Sawal Acharya, Anjali Parashar, Joseph E. Gaudio, Anurdha M. Annaswamy

Abstract: Gradient based optimization algorithms deployed in Machine Learning (ML) applications are often analyzed and compared by their convergence rates or regret bounds. While these rates and bounds convey valuable information they don't always directly translate to stability guarantees. Stability and similar concepts, like robustness, will become ever more important as we move towards deploying models i… ▽ More Gradient based optimization algorithms deployed in Machine Learning (ML) applications are often analyzed and compared by their convergence rates or regret bounds. While these rates and bounds convey valuable information they don't always directly translate to stability guarantees. Stability and similar concepts, like robustness, will become ever more important as we move towards deploying models in real-time and safety critical systems. In this work we build upon the results in Gaudio et al. 2021 and Moreu and Annaswamy 2022 for second order gradient descent when applied to explicitly time varying cost functions and provide more general stability guarantees. These more general results can aid in the design and certification of these optimization schemes so as to help ensure safe and reliable deployment for real-time learning applications. We also hope that the techniques provided here will stimulate and cross-fertilize the analysis that occurs on the same algorithms from the online learning and stochastic optimization communities. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 13 pages, 0 figures

Safe and Stable Formation Control with Distributed Multi-Agents Using Adaptive Control and Control Barrier Functions

Authors: Jose A. Solano-Castellanos, Anuradha Annaswamy

Abstract: This manuscript considers the problem of ensuring stability and safety during formation control with distributed multi-agent systems in the presence of parametric uncertainty in the dynamics and limited communication. We propose an integrative approach that combines Control Barrier Functions, Adaptive Control, and connected graphs. A reference model is designed so as to ensure a safe and stable fo… ▽ More This manuscript considers the problem of ensuring stability and safety during formation control with distributed multi-agent systems in the presence of parametric uncertainty in the dynamics and limited communication. We propose an integrative approach that combines Control Barrier Functions, Adaptive Control, and connected graphs. A reference model is designed so as to ensure a safe and stable formation control strategy. This is combined with a provably correct adaptive control design that includes a use of a CBF-based safety filter that suitably generates safe reference commands, and employs error-based relaxation (EBR) of Nagumo's Invariance Theorem. Together, it is shown to lead to a guarantee of boundedness, formation control, and forward invariance. Numerical examples are provided to support the theoretical derivations. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Enhancing power grid resilience to cyber-physical attacks using distributed retail electricity markets

Authors: Vineet Jagadeesan Nair, Priyank Srivastava, Anuradha Annaswamy

Abstract: We propose using a hierarchical retail market structure to alert and dispatch resources to mitigate cyber-physical attacks on a distribution grid. We simulate attacks where a number of generation nodes in a distribution grid are attacked. We show that the market is able to successfully meet the shortfall between demand and supply by utilizing the flexibility of remaining resources while minimizing… ▽ More We propose using a hierarchical retail market structure to alert and dispatch resources to mitigate cyber-physical attacks on a distribution grid. We simulate attacks where a number of generation nodes in a distribution grid are attacked. We show that the market is able to successfully meet the shortfall between demand and supply by utilizing the flexibility of remaining resources while minimizing any extra power that needs to be imported from the main transmission grid. This includes utilizing upward flexibility or reserves of remaining online generators and some curtailment or shifting of flexible loads, which results in higher costs. Using price signals and market-based coordination, the grid operator can achieve its objectives without direct control over distributed energy resources and is able to accurately compensate prosumers for the grid support they provide. △ Less

Submitted 2 July, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

Comments: Accepted to the 15th ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) and as part of the CPS-IoT Week 2024

Physics-Informed Graph Neural Network for Dynamic Reconfiguration of Power Systems

Authors: Jules Authier, Rabab Haider, Anuradha Annaswamy, Florian Dorfler

Abstract: To maintain a reliable grid we need fast decision-making algorithms for complex problems like Dynamic Reconfiguration (DyR). DyR optimizes distribution grid switch settings in real-time to minimize grid losses and dispatches resources to supply loads with available generation. DyR is a mixed-integer problem and can be computationally intractable to solve for large grids and at fast timescales. We… ▽ More To maintain a reliable grid we need fast decision-making algorithms for complex problems like Dynamic Reconfiguration (DyR). DyR optimizes distribution grid switch settings in real-time to minimize grid losses and dispatches resources to supply loads with available generation. DyR is a mixed-integer problem and can be computationally intractable to solve for large grids and at fast timescales. We propose GraPhyR, a Physics-Informed Graph Neural Network (GNNs) framework tailored for DyR. We incorporate essential operational and connectivity constraints directly within the GNN framework and train it end-to-end. Our results show that GraPhyR is able to learn to optimize the DyR task. △ Less

Submitted 2 April, 2024; v1 submitted 1 October, 2023; originally announced October 2023.

Comments: 8 pages, 5 figures, 2 tables. To appear at PSCC 2024

Safe and Stable Adaptive Control for a Class of Dynamic Systems

Authors: Johannes Autenrieb, Anuradha M. Annaswamy

Abstract: Adaptive control has focused on online control of dynamic systems in the presence of parametric uncertainties, with solutions guaranteeing stability and control performance. Safety, a related property to stability, is becoming increasingly important as the footprint of autonomous systems grows in society. One of the popular ways for ensuring safety is through the notion of a control barrier functi… ▽ More Adaptive control has focused on online control of dynamic systems in the presence of parametric uncertainties, with solutions guaranteeing stability and control performance. Safety, a related property to stability, is becoming increasingly important as the footprint of autonomous systems grows in society. One of the popular ways for ensuring safety is through the notion of a control barrier function (CBF). In this paper, we combine adaptation and CBFs to develop a real-time controller that guarantees stability and remains safe in the presence of parametric uncertainties. The class of dynamic systems that we focus on is linear time-invariant systems whose states are accessible and where the inputs are subject to a magnitude limit. Conditions of stability, state convergence to a desired value, and parameter learning are all elucidated. One of the elements of the proposed adaptive controller that ensures stability and safety is the use of a CBF-based safety filter that suitably generates safe reference commands, employs error-based relaxation (EBR) of Nagumo's theorem, and leads to guarantees of set invariance. To demonstrate the effectiveness of our approach, we present two numerical examples, an obstacle avoidance case and a missile flight control case. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Comments: 10 pages, 5 figures, IEEE CDC 2023

Accelerated Algorithms for a Class of Optimization Problems with Equality and Box Constraints

Authors: Anjali Parashar, Priyank Srivastava, Anuradha M. Annaswamy

Abstract: Convex optimization with equality and inequality constraints is a ubiquitous problem in several optimization and control problems in large-scale systems. Recently there has been a lot of interest in establishing accelerated convergence of the loss function. A class of high-order tuners was recently proposed in an effort to lead to accelerated convergence for the case when no constraints are pres… ▽ More Convex optimization with equality and inequality constraints is a ubiquitous problem in several optimization and control problems in large-scale systems. Recently there has been a lot of interest in establishing accelerated convergence of the loss function. A class of high-order tuners was recently proposed in an effort to lead to accelerated convergence for the case when no constraints are present. In this paper, we propose a new high-order tuner that can accommodate the presence of equality constraints. In order to accommodate the underlying box constraints, time-varying gains are introduced in the high-order tuner which leverage convexity and ensure anytime feasibility of the constraints. Numerical examples are provided to support the theoretical derivations. △ Less

Submitted 7 May, 2023; originally announced May 2023.

Comments: 6 pages, accepted in ACC 2023 (American Control Conference, 2023)

Discrete-Time High Order Tuner With A Time-Varying Learning Rate

Authors: Yingnan Cui, Anuradha M. Annaswamy

Abstract: We propose a new discrete-time online parameter estimation algorithm that combines two different aspects, one that adds momentum, and another that includes a time-varying learning rate. It is well known that recursive least squares based approaches that include a time-varying gain can lead to exponential convergence of parameter errors under persistent excitation, while momentum-based approaches h… ▽ More We propose a new discrete-time online parameter estimation algorithm that combines two different aspects, one that adds momentum, and another that includes a time-varying learning rate. It is well known that recursive least squares based approaches that include a time-varying gain can lead to exponential convergence of parameter errors under persistent excitation, while momentum-based approaches have demonstrated a fast convergence of tracking error towards zero with constant regressors. The question is when combined, will the filter from the momentum method come in the way of exponential convergence. This paper proves that exponential convergence of parameter is still possible with persistent excitation. Simulation results demonstrated competitive properties of the proposed algorithm compared to the recursive least squares algorithm with forgetting. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Comments: 13 pages

Indirect Adaptive Optimal Control in the Presence of Input Saturation

Authors: Sunbochen Tang, Anuradha M. Annaswamy

Abstract: In this paper, we propose a combined Magnitude Saturated Adaptive Control (MSAC)-Model Predictive Control (MPC) approach to linear quadratic tracking optimal control problems with parametric uncertainties and input saturation. The proposed MSAC-MPC approach first focuses on a stable solution and parameter estimation, and switches to MPC when parameter learning is accomplished. We show that the MSA… ▽ More In this paper, we propose a combined Magnitude Saturated Adaptive Control (MSAC)-Model Predictive Control (MPC) approach to linear quadratic tracking optimal control problems with parametric uncertainties and input saturation. The proposed MSAC-MPC approach first focuses on a stable solution and parameter estimation, and switches to MPC when parameter learning is accomplished. We show that the MSAC, based on a high-order tuner, leads to parameter convergence to true values while providing stability guarantees. We also show that after switching to MPC, the optimality gap is well-defined and proportional to the parameter estimation error. We demonstrate the effectiveness of the proposed MSAC-MPC algorithm through a numerical example based on a linear second-order, two input, unstable system. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Local retail electricity markets for distribution grid services

Authors: Vineet Jagadeesan Nair, Anuradha Annaswamy

Abstract: We propose a hierarchical local electricity market (LEM) at the primary and secondary feeder levels in a distribution grid, to optimally coordinate and schedule distributed energy resources (DER) and provide valuable grid services like voltage control. At the primary level, we use a current injection-based model that is valid for both radial and meshed, balanced and unbalanced, multi-phase systems… ▽ More We propose a hierarchical local electricity market (LEM) at the primary and secondary feeder levels in a distribution grid, to optimally coordinate and schedule distributed energy resources (DER) and provide valuable grid services like voltage control. At the primary level, we use a current injection-based model that is valid for both radial and meshed, balanced and unbalanced, multi-phase systems. The primary and secondary markets leverage the flexibility offered by DERs to optimize grid operation and maximize social welfare. Numerical simulations on an IEEE-123 bus modified to include DERs, show that the LEM successfully achieves voltage control and reduces overall network costs, while also allowing us to decompose the price and value associated with different grid services so as to accurately compensate DERs. △ Less

Submitted 11 July, 2023; v1 submitted 13 February, 2023; originally announced February 2023.

Comments: 9 pages, 13 figures, Accepted to the 7th IEEE Conference on Control Technology and Applications (CCTA) 2023

Neural Network Adaptive Control with Long Short-Term Memory

Authors: Emirhan Inanc, Yigit Gurses, Abdullah Habboush, Yildiray Yildiz, Anuradha M. Annaswamy

Abstract: In this study, we propose a novel adaptive control architecture, which provides dramatically better transient response performance compared to conventional adaptive control methods. What makes this architecture unique is the synergistic employment of a traditional, Adaptive Neural Network (ANN) controller and a Long Short-Term Memory (LSTM) network. LSTM structures, unlike the standard feed-forwar… ▽ More In this study, we propose a novel adaptive control architecture, which provides dramatically better transient response performance compared to conventional adaptive control methods. What makes this architecture unique is the synergistic employment of a traditional, Adaptive Neural Network (ANN) controller and a Long Short-Term Memory (LSTM) network. LSTM structures, unlike the standard feed-forward neural networks, can take advantage of the dependencies in an input sequence, which can contain critical information that can help predict uncertainty. Through a novel training method we introduced, the LSTM network learns to compensate for the deficiencies of the ANN controller during sudden changes in plant dynamics. This substantially improves the transient response of the system and allows the controller to quickly react to unexpected events. Through careful simulation studies, we demonstrate that this architecture can improve the estimation accuracy on a diverse set of uncertainties for an indefinite time span. We also provide an analysis of the contributions of the ANN controller and LSTM network to the control input, identifying their individual roles in compensating low and high-frequency error dynamics. This analysis provides insight into why and how the LSTM augmentation improves the system's transient response. The stability of the overall system is also shown via a rigorous Lyapunov analysis. △ Less

Submitted 5 January, 2023; originally announced January 2023.

Comments: 11 pages, 12 figures

Human Behavioral Models Using Utility Theory and Prospect Theory

Authors: Anuradha M. Annaswamy, Vineet Jagadeesan Nair

Abstract: Several examples of Cyber-physical human systems (CPHS) include real-time decisions from humans as a necessary building block for the successful performance of the overall system. Many of these decision-making problems necessitate an appropriate model of human behavior. Tools from Utility Theory have been used successfully in several problems in transportation for resource allocation and balance o… ▽ More Several examples of Cyber-physical human systems (CPHS) include real-time decisions from humans as a necessary building block for the successful performance of the overall system. Many of these decision-making problems necessitate an appropriate model of human behavior. Tools from Utility Theory have been used successfully in several problems in transportation for resource allocation and balance of supply and demand \citep{ben1985discrete}. More recently, Prospect Theory has been demonstrated as a useful tool in behavioral economics and cognitive psychology for deriving human behavioral models that characterize their subjective decision-making in the presence of stochastic uncertainties and risks, as an alternative to conventional Utility Theory \citep{kahneman_prospect_2012}. These models will be described in this article. Theoretical implications of Prospect Theory are also discussed. Examples will be drawn from transportation use cases such as shared mobility to illustrate these models as well as the distinctions between Utility Theory and Prospect Theory. △ Less

Submitted 13 October, 2022; originally announced October 2022.

Comments: 26 pages, submitted chapter to upcoming Wiley book on Cyber-Physical Human Systems (CPHS). arXiv admin note: text overlap with arXiv:1904.04824

Grid-SiPhyR: An end-to-end learning to optimize framework for combinatorial problems in power systems

Authors: Rabab Haider, Anuradha M. Annaswamy

Abstract: Mixed integer problems are ubiquitous in decision making, from discrete device settings and design parameters, unit production, and on/off or yes/no decision in switches, routing, and social networks. Despite their prevalence, classical optimization approaches for combinatorial optimization remain prohibitively slow for fast and accurate decision making in dynamic and safety-critical environments… ▽ More Mixed integer problems are ubiquitous in decision making, from discrete device settings and design parameters, unit production, and on/off or yes/no decision in switches, routing, and social networks. Despite their prevalence, classical optimization approaches for combinatorial optimization remain prohibitively slow for fast and accurate decision making in dynamic and safety-critical environments with hard constraints. To address this gap, we propose SiPhyR (pronounced: cipher), a physics-informed machine learning framework for end-to-end learning to optimize for combinatorial problems. SiPhyR employs a novel physics-informed rounding approach to tackle the challenge of combinatorial optimization within a differentiable framework that has certified satisfiability of safety-critical constraints. We demonstrate the effectiveness of SiPhyR on an emerging paradigm for clean energy systems: dynamic reconfiguration, where the topology of the electric grid and power flow are optimized so as to maintain a safe and reliable power grid in the presence of intermittent renewable generation. Offline training of the unsupervised framework on representative load and generation data makes dynamic decision making via the online application of Grid-SiPhyR computationally feasible. △ Less

Submitted 24 May, 2023; v1 submitted 11 June, 2022; originally announced June 2022.

Comments: 36 pages, 5 appendices

Accelerated Algorithms for a Class of Optimization Problems with Constraints

Authors: Anjali Parashar, Priyank Srivastava, Anuradha M. Annaswamy

Abstract: This paper presents a framework to solve constrained optimization problems in an accelerated manner based on High-Order Tuners (HT). Our approach is based on reformulating the original constrained problem as the unconstrained optimization of a loss function. We start with convex optimization problems and identify the conditions under which the loss function is convex. Building on the insight that… ▽ More This paper presents a framework to solve constrained optimization problems in an accelerated manner based on High-Order Tuners (HT). Our approach is based on reformulating the original constrained problem as the unconstrained optimization of a loss function. We start with convex optimization problems and identify the conditions under which the loss function is convex. Building on the insight that the loss function could be convex even if the original optimization problem is not, we extend our approach to a class of nonconvex optimization problems. The use of a HT together with this approach enables us to achieve a convergence rate better than state-of-the-art gradient-based methods. Moreover, for equality-constrained optimization problems, the proposed method ensures that the state remains feasible throughout the evolution, regardless of the convexity of the original problem. △ Less

Submitted 25 May, 2022; v1 submitted 1 May, 2022; originally announced May 2022.

Comments: 6 pages

Discrete-Time Adaptive Control of a Class of Nonlinear Systems Using High-Order Tuners

Authors: Peter A. Fisher, Anuradha M. Annaswamy

Abstract: This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying regressors in the context of an identification problem. Based on Nesterov's algorithm, the high-order tuner was shown to guarantee bounded parameter estimation when reg… ▽ More This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying regressors in the context of an identification problem. Based on Nesterov's algorithm, the high-order tuner was shown to guarantee bounded parameter estimation when regressors vary with time, and to lead to accelerated convergence of the tracking error when regressors are constant. In this paper, we apply the high-order tuner to the adaptive control of a particular class of discrete-time nonlinear dynamical systems. First, we show that for plants of this class, the underlying dynamical error model can be causally converted to an algebraic error model. Second, we show that using this algebraic error model, the high-order tuner can be applied to provably stabilize the class of dynamical systems around a reference trajectory. △ Less

Submitted 17 March, 2023; v1 submitted 26 April, 2022; originally announced April 2022.

Comments: 11 pages, submitted without appendices to ACC 2023

Accelerated Performance and Accelerated Learning with Discrete-Time High-Order Tuners

Authors: Yingnan Cui, Anuradha M. Annaswamy

Abstract: We consider two high-order tuners that have been shown to have accelerated performance, one based on Polyak's heavy ball method and another based on Nesterov's acceleration method. We show that parameter estimates are bounded and converge to the true values exponentially fast when the regressors are persistently exciting. Simulation results corroborate the accelerated performance and accelerated l… ▽ More We consider two high-order tuners that have been shown to have accelerated performance, one based on Polyak's heavy ball method and another based on Nesterov's acceleration method. We show that parameter estimates are bounded and converge to the true values exponentially fast when the regressors are persistently exciting. Simulation results corroborate the accelerated performance and accelerated learning properties of these high-order tuners in comparison to algorithms based on normalized gradient descent. △ Less

Submitted 14 September, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

Comments: 18 pages

Flattening the Duck Curve: A Case for Distributed Decision Making

Authors: Rabab Haider, Giulio Ferro, Michela Robba, Anuradha M. Annaswamy

Abstract: The large penetration of renewable resources has resulted in rapidly changing net loads, resulting in the characteristic "duck curve". The resulting ramping requirements of bulk system resources is an operational challenge. To address this, we propose a distributed optimization framework within which distributed resources located in the distribution grid are coordinated to provide support to the b… ▽ More The large penetration of renewable resources has resulted in rapidly changing net loads, resulting in the characteristic "duck curve". The resulting ramping requirements of bulk system resources is an operational challenge. To address this, we propose a distributed optimization framework within which distributed resources located in the distribution grid are coordinated to provide support to the bulk system. We model the power flow of the multi-phase unbalanced distribution grid using a Current Injection (CI) approach, which leverages McCormick Envelope based convex relaxation to render a linear model. We then solve this CI-OPF with an accelerated Proximal Atomic Coordination (PAC) which employs Nesterov type acceleration, termed NST-PAC. We evaluate our distributed approach against a local approach, on a case study of San Francisco, California, using a modified IEEE-34 node network and under a high penetration of solar PV, flexible loads, and battery units. Our distributed approach reduced the ramping requirements of bulk system generators by up to 23%. △ Less

Submitted 1 February, 2022; v1 submitted 11 November, 2021; originally announced November 2021.

Comments: 5 pages, 4 figures, 1 table. This work has been accepted for presentation at the 2022 IEEE Power & Energy Society General Meeting, and will be a part of the conference proceedings.Copyright may be transferred without notice, after which this version may no longer be accessible

A Hierarchical Local Electricity Market for a DER-rich Grid Edge

Authors: Vineet Jagadeesan Nair, Venkatesh Venkataramanan, Rabab Haider, Anuradha Annaswamy

Abstract: With increasing penetration of DERs in the distribution system, it is critical to design market structures that enable smooth integration of DERs. A hierarchical local electricity market (LEM) structure is proposed in this paper with a secondary market (SM) at the lower level representing secondary feeders and a primary market (PM) at the upper level, representing primary feeders, in order to effe… ▽ More With increasing penetration of DERs in the distribution system, it is critical to design market structures that enable smooth integration of DERs. A hierarchical local electricity market (LEM) structure is proposed in this paper with a secondary market (SM) at the lower level representing secondary feeders and a primary market (PM) at the upper level, representing primary feeders, in order to effectively use DERs to increase grid efficiency and resilience. The lower level SM enforces budget, power balance and flexibility constraints and accounts for costs related to consumers, such as their disutility, flexibility limits, and commitment reliability, while the upper level PM enforces power physics constraints such as power balance and capacity limits, and also minimizes line losses. The hierarchical LEM is extensively evaluated using a modified IEEE-123 bus with high DER penetration, with each primary feeder consisting of at least three secondary feeders. Data from a GridLAB-D model is used to emulate realistic power injections and load profiles over the course of 24 hours. The performance of the LEM is illustrated by delineating the family of power-injection profiles across the primary and secondary feeders as well as corresponding local electricity tariffs that vary across the distribution grid. Together, it represents an overall framework for a Distribution System Operator (DSO) who can provide the oversight for the entire LEM. △ Less

Submitted 14 March, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

Comments: 14 pages, 13 figures, 1 table. This work has been submitted to the IEEE Transactions on Smart Grid for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

A Reactive Power Market for the Future Grid

Authors: Adam Potter, Rabab Haider, Giulio Ferro, Michela Robba, Anuradha M. Annaswamy

Abstract: As pressures to decarbonize the electricity grid increase, the grid edge is witnessing a rapid adoption of distributed and renewable generation. As a result, traditional methods for reactive power management and compensation may become ineffective. Current state of art for reactive power compensation, which rely primarily on capacity payments, exclude distributed generation (DG). We propose an alt… ▽ More As pressures to decarbonize the electricity grid increase, the grid edge is witnessing a rapid adoption of distributed and renewable generation. As a result, traditional methods for reactive power management and compensation may become ineffective. Current state of art for reactive power compensation, which rely primarily on capacity payments, exclude distributed generation (DG). We propose an alternative: a reactive power market at the distribution level designed to meet the needs of decentralized and decarbonized grids. The proposed market uses variable payments to compensate DGs equipped with smart inverters, at an increased spatial and temporal granularity, through a distribution-level Locational Marginal Price (d-LMP). We validate our proposed market with a case study of the US New England grid on a modified IEEE-123 bus, while varying DG penetration from 5% to 160%. Results show that our market can accommodate such a large penetration, with stable reactive power revenue streams. The market can leverage the considerable flexibility afforded by inverter-based resources to meet over 40% of reactive power load when operating in a power factor range of 0.6 to 1.0. DGs participating in the market can earn up to 11% of their total revenue from reactive power payments. Finally, the corresponding daily d-LMPs determined from the proposed market were observed to exhibit limited volatility. △ Less

Submitted 10 November, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

Comments: 26 pages, 9 figures, 3 tables

A Historical Perspective of Adaptive Control and Learning

Authors: Anuradha M. Annaswamy, Alexander L. Fradkov

Abstract: This article provides a historical perspective of the field of adaptive control over the past seven decades and its intersection with learning. A chronology of key events over this large time-span, problem statements that the field has focused on, and key solutions are presented. Fundamental results related to stability, robustness, and learning are sketched. A brief description of various applica… ▽ More This article provides a historical perspective of the field of adaptive control over the past seven decades and its intersection with learning. A chronology of key events over this large time-span, problem statements that the field has focused on, and key solutions are presented. Fundamental results related to stability, robustness, and learning are sketched. A brief description of various applications of adaptive control reported over this period is included. △ Less

Submitted 22 February, 2022; v1 submitted 24 August, 2021; originally announced August 2021.

DER Forecast using Privacy Preserving Federated Learning

Authors: Venkatesh Venkataramanan, Sridevi Kaza, Anuradha M. Annaswamy

Abstract: With increasing penetration of Distributed Energy Resources (DERs) in grid edge including renewable generation, flexible loads, and storage, accurate prediction of distributed generation and consumption at the consumer level becomes important. However, DER prediction based on the transmission of customer level data, either repeatedly or in large amounts, is not feasible due to privacy concerns. In… ▽ More With increasing penetration of Distributed Energy Resources (DERs) in grid edge including renewable generation, flexible loads, and storage, accurate prediction of distributed generation and consumption at the consumer level becomes important. However, DER prediction based on the transmission of customer level data, either repeatedly or in large amounts, is not feasible due to privacy concerns. In this paper, a distributed machine learning approach, Federated Learning, is proposed to carry out DER forecasting using a network of IoT nodes, each of which transmits a model of the consumption and generation patterns without revealing consumer data. We consider a simulation study which includes 1000 DERs, and show that our method leads to an accurate prediction of preserve consumer privacy, while still leading to an accurate forecast. We also evaluate grid-specific performance metrics such as load swings and load curtailment and show that our FL algorithm leads to satisfactory performance. Simulations are also performed on the Pecan street dataset to demonstrate the validity of the proposed approach on real data. △ Less

Submitted 7 July, 2021; originally announced July 2021.

Online Algorithms and Policies Using Adaptive and Machine Learning Approaches

Authors: Anuradha M. Annaswamy, Anubhav Guha, Yingnan Cui, Sunbochen Tang, Peter A. Fisher, Joseph E. Gaudio

Abstract: This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure stability and optimality for the nominal dynamics, together with Adaptive Control (AC) in the inner loop so that in real-time AC contracts the closed-loop dynam… ▽ More This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure stability and optimality for the nominal dynamics, together with Adaptive Control (AC) in the inner loop so that in real-time AC contracts the closed-loop dynamics towards a stable trajectory traced out by RL. Two classes of nonlinear dynamic systems are considered, both of which are control-affine. The first class of dynamic systems utilizes equilibrium points %with expansion forms around these points and a Lyapunov approach while second class of nonlinear systems uses contraction theory. AC-RL controllers are proposed for both classes of systems and shown to lead to online policies that guarantee stability using a high-order tuner and accommodate parametric uncertainties and magnitude limits on the input. In addition to establishing a stability guarantee with real-time control, the AC-RL controller is also shown to lead to parameter learning with persistent excitation for the first class of systems. Numerical validations of all algorithms are carried out using a quadrotor landing task on a moving platform. △ Less

Submitted 9 June, 2023; v1 submitted 13 May, 2021; originally announced May 2021.

Comments: 38 pages

Sensitivity Analysis of Passenger Behavioral Model for Dynamic Pricing of Shared Mobility on Demand

Authors: Vineet Jagadeesan Nair, Yue Guan, Anuradha M. Annaswamy, H. Eric Tseng, Baljeet Singh

Abstract: This paper provides a framework to quantify the sensitivity associated with behavioral models based on Cumulative Prospect Theory (CPT). These are used to design dynamic pricing strategies aimed at maximizing performance metrics of the Shared Mobility On-Demand Service (SMoDS), as solutions to a constrained nonlinear optimization problem. We analyze the sensitivity of both the optimal tariff as we… ▽ More This paper provides a framework to quantify the sensitivity associated with behavioral models based on Cumulative Prospect Theory (CPT). These are used to design dynamic pricing strategies aimed at maximizing performance metrics of the Shared Mobility On-Demand Service (SMoDS), as solutions to a constrained nonlinear optimization problem. We analyze the sensitivity of both the optimal tariff as well as the optimal objective function with respect to CPT model parameters. In addition to deriving analytical solutions under certain assumptions, more general numerical results are obtained via computational experiments and simulations to analyze the sensitivity. We find that the model is relatively robust for small to moderate parameter perturbations. Although some of the trends in sensitivity are fairly general, the exact nature of variations in many cases depends heavily on the specific travel scenarios and modes being considered. This is primarily due to the complex nonlinearities in the problem, as well as the significant heterogeneity in passenger preferences across different types of trips. △ Less

Submitted 18 April, 2021; originally announced April 2021.

Comments: 29 pages, 13 figures, submitted to Transportation Research Part B: Methodological

MSC Class: 90C31

New Algorithms for Discrete-Time Parameter Estimation

Authors: Yingnan Cui, Joseph E. Gaudio, Anuradha M. Annaswamy

Abstract: We propose two algorithms for discrete-time parameter estimation, one for time-varying parameters under persistent excitation (PE) condition, another for constant parameters under no PE condition. For the first algorithm, we show that in the presence of time-varying unknown parameters, the parameter estimation error converges uniformly to a compact set under conditions of persistent excitation, wi… ▽ More We propose two algorithms for discrete-time parameter estimation, one for time-varying parameters under persistent excitation (PE) condition, another for constant parameters under no PE condition. For the first algorithm, we show that in the presence of time-varying unknown parameters, the parameter estimation error converges uniformly to a compact set under conditions of persistent excitation, with the size of the compact set proportional to the time-variation of unknown parameters. Leveraging a projection operator, the second algorithm is shown to result in boundedness guarantees when the plant has constant unknown parameters. Simulations show better convergence results compared to recursive least squares (RLS) and comparable results to RLS with forgetting factor. △ Less

Submitted 14 March, 2022; v1 submitted 30 March, 2021; originally announced March 2021.

Comments: 20 pages

Online Policies for Real-Time Control Using MRAC-RL

Authors: Anubhav Guha, Anuradha Annaswamy

Abstract: In this paper, we propose the Model Reference Adaptive Control & Reinforcement Learning (MRAC-RL) approach to developing online policies for systems in which modeling errors occur in real-time. Although reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems, discrepancies between simulated dynamics and the true target dynamics can cause… ▽ More In this paper, we propose the Model Reference Adaptive Control & Reinforcement Learning (MRAC-RL) approach to developing online policies for systems in which modeling errors occur in real-time. Although reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems, discrepancies between simulated dynamics and the true target dynamics can cause trained policies to fail to generalize and adapt appropriately when deployed in the real-world. The MRAC-RL framework generates online policies by utilizing an inner-loop adaptive controller together with a simulation-trained outer-loop RL policy. This structure allows MRAC-RL to adapt and operate effectively in a target environment, even when parametric uncertainties exists. We propose a set of novel MRAC algorithms, apply them to a class of nonlinear systems, derive the associated control laws, provide stability guarantees for the resulting closed-loop system, and show that the adaptive tracking objective is achieved. Using a simulation study of an automated quadrotor landing task, we demonstrate that the MRAC-RL approach improves upon state-of-the-art RL algorithms and techniques through the generation of online policies. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Comments: Submitted to CDC 2021

A High-order Tuner for Accelerated Learning and Control

Authors: Spencer McDonald, Yingnan Cui, Joseph E. Gaudio, Anuradha M. Annaswamy

Abstract: Gradient-descent based iterative algorithms pervade a variety of problems in estimation, prediction, learning, control, and optimization. Recently iterative algorithms based on higher-order information have been explored in an attempt to lead to accelerated learning. In this paper, we explore a specific a high-order tuner that has been shown to result in stability with time-varying regressors in l… ▽ More Gradient-descent based iterative algorithms pervade a variety of problems in estimation, prediction, learning, control, and optimization. Recently iterative algorithms based on higher-order information have been explored in an attempt to lead to accelerated learning. In this paper, we explore a specific a high-order tuner that has been shown to result in stability with time-varying regressors in linearly parametrized systems, and accelerated convergence with constant regressors. We show that this tuner continues to provide bounded parameter estimates even if the gradients are corrupted by noise. Additionally, we also show that the parameter estimates converge exponentially to a compact set whose size is dependent on noise statistics. As the HT algorithms can be applied to a wide range of problems in estimation, filtering, control, and machine learning, the result obtained in this paper represents an important extension to the topic of real-time and fast decision making. △ Less

Submitted 23 March, 2021; originally announced March 2021.

Comments: 31 pages

Reinventing the Utility for DERs: A Proposal for a DSO-Centric Retail Electricity Market

Authors: Rabab Haider, David D'Achiardi, Venkatesh Venkataramanan, Anurag Srivastava, Anjan Bose, Anuradha M. Annaswamy

Abstract: The increasing penetration of intermittent renewables, storage devices, and flexible loads is introducing operational challenges in distribution grids. The proper coordination and scheduling of these resources using a distributed approach is warranted, and can only be achieved through local retail markets employing transactive energy schemes. To this end, we propose a distribution-level retail mar… ▽ More The increasing penetration of intermittent renewables, storage devices, and flexible loads is introducing operational challenges in distribution grids. The proper coordination and scheduling of these resources using a distributed approach is warranted, and can only be achieved through local retail markets employing transactive energy schemes. To this end, we propose a distribution-level retail market operated by a Distribution System Operator (DSO), which schedules DERs and determines the real-time distribution-level Locational Marginal Price (d-LPM). The retail market is built using a distributed Proximal Atomic Coordination (PAC) algorithm, which solves the optimal power flow model while accounting for network physics, rendering locationally and temporally varying d-LMPs. A numerical study of the market structure is carried out via simulations of the IEEE-123 node network using data from ISO-NE and Eversource in Massachusetts, US. The market performance is compared to existing retail practices, including demand response (DR) with no-export rules and net metering. The DSO-centric market increases DER utilization, permits continual market participation for DR, lowers electricity rates for customers, and eliminates the subsidies inherent to net metering programs. The resulting lower revenue stream for the DSO highlights the evolving business model of the modern utility, moving from commoditized markets towards performance-based ratemaking. △ Less

Submitted 1 February, 2021; originally announced February 2021.

MRAC-RL: A Framework for On-Line Policy Adaptation Under Parametric Model Uncertainty

Authors: Anubhav Guha, Anuradha Annaswamy

Abstract: Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated model and the true system dynamics, RL trained policies often fail to generalize and adapt appropriately when deployed in the real-world environment. Current res… ▽ More Reinforcement learning (RL) algorithms have been successfully used to develop control policies for dynamical systems. For many such systems, these policies are trained in a simulated environment. Due to discrepancies between the simulated model and the true system dynamics, RL trained policies often fail to generalize and adapt appropriately when deployed in the real-world environment. Current research in bridging this sim-to-real gap has largely focused on improvements in simulation design and on the development of improved and specialized RL algorithms for robust control policy generation. In this paper we apply principles from adaptive control and system identification to develop the model-reference adaptive control & reinforcement learning (MRAC-RL) framework. We propose a set of novel MRAC algorithms applicable to a broad range of linear and nonlinear systems, and derive the associated control laws. The MRAC-RL framework utilizes an inner-loop adaptive controller that allows a simulation-trained outer-loop policy to adapt and operate effectively in a test environment, even when parametric model uncertainty exists. We demonstrate that the MRAC-RL approach improves upon state-of-the-art RL algorithms in developing control policies that can be applied to systems with modeling errors. △ Less

Submitted 20 November, 2020; originally announced November 2020.

Comments: Short version submitted to Learning for Dynamics & Control (L4DC) 2021 Conference

A Stable High-order Tuner for General Convex Functions

Authors: José M. Moreu, Anuradha M. Annaswamy

Abstract: Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, momentum-based methods, with accelerated learning guarantees, have received a lot of attention due to their provable guarantees of fast learning in certain classes of problems and multiple algorithms have been derived. However… ▽ More Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, momentum-based methods, with accelerated learning guarantees, have received a lot of attention due to their provable guarantees of fast learning in certain classes of problems and multiple algorithms have been derived. However, properties for these methods hold only for constant regressors. When time-varying regressors occur, which is commonplace in dynamic systems, many of these momentum-based methods cannot guarantee stability. Recently, a new High-order Tuner (HT) was developed for linear regression problems and shown to have 1) stability and asymptotic convergence for time-varying regressors and 2) non-asymptotic accelerated learning guarantees for constant regressors. In this paper, we extend and discuss the results of this same HT for general convex loss functions. Through the exploitation of convexity and smoothness definitions, we establish similar stability and asymptotic convergence guarantees. Finally, we provide numerical simulations supporting the satisfactory behavior of the HT algorithm as well as an accelerated learning property. △ Less

Submitted 8 June, 2021; v1 submitted 19 November, 2020; originally announced November 2020.

Comments: 6 pages, 3 figures. This work has been accepted for publication at IEEE Control Systems Letters

Accurate Parameter Estimation for Risk-aware Autonomous Systems

Authors: Arnab Sarker, Peter Fisher, Joseph E. Gaudio, Anuradha M. Annaswamy

Abstract: Analysis and synthesis of safety-critical autonomous systems are carried out using models which are often dynamic. Two central features of these dynamic systems are parameters and unmodeled dynamics. This paper addresses the use of a spectral lines-based approach for estimating parameters of the dynamic model of an autonomous system. Existing literature has treated all unmodeled components of the… ▽ More Analysis and synthesis of safety-critical autonomous systems are carried out using models which are often dynamic. Two central features of these dynamic systems are parameters and unmodeled dynamics. This paper addresses the use of a spectral lines-based approach for estimating parameters of the dynamic model of an autonomous system. Existing literature has treated all unmodeled components of the dynamic system as sub-Gaussian noise and proposed parameter estimation using Gaussian noise-based exogenous signals. In contrast, we allow the unmodeled part to have deterministic unmodeled dynamics, which are almost always present in physical systems, in addition to sub-Gaussian noise. In addition, we propose a deterministic construction of the exogenous signal in order to carry out parameter estimation. We introduce a new tool kit which employs the theory of spectral lines, retains the stochastic setting, and leads to non-asymptotic bounds on the parameter estimation error. Unlike the existing stochastic approach, these bounds are tunable through an optimal choice of the spectrum of the exogenous signal leading to accurate parameter estimation. We also show that this estimation is robust to unmodeled dynamics, a property that is not assured by the existing approach. Finally, we show that under ideal conditions with no unmodeled dynamics, the proposed approach can ensure a $\tilde{O}(\sqrt{T})$ regret, matching existing literature. Experiments are provided to support all theoretical derivations, which show that the spectral lines-based approach outperforms the Gaussian noise-based method when unmodeled dynamics are present, in terms of both parameter estimation error and Regret obtained using the parameter estimates with a Linear Quadratic Regulator in feedback. △ Less

Submitted 16 March, 2022; v1 submitted 22 June, 2020; originally announced June 2020.

Transactive Control of Electric Railways Using Dynamic Market Mechanisms

Authors: David D'Achiardi, Anuradha M. Annaswamy, Sudip K. Mazumder, Eduardo Pilo

Abstract: Electricity demand of electric railways is a relatively unexplored source of flexibility in demand response applications in power systems. In this paper, we propose a transactive control based optimization framework for coordinating the power grid network and the train network. This is accomplished by coordinating dispatchable distributed energy resources and demand profiles of trains using a two-… ▽ More Electricity demand of electric railways is a relatively unexplored source of flexibility in demand response applications in power systems. In this paper, we propose a transactive control based optimization framework for coordinating the power grid network and the train network. This is accomplished by coordinating dispatchable distributed energy resources and demand profiles of trains using a two-step optimization. A railway based dynamic market mechanism (rDMM) is proposed for the dispatch of distributed energy resources (DER) in the power network along the electric railway using an iterative negotiation process, and generates profiles of electricity prices, and constitutes the first step. The train dispatch attempts minimize the operational costs of trains that ply along the railway, while subject to constraints on their acceleration profiles, route schedules, and the train dynamics, and generates demand profiles of trains and constitutes the second step. The rDMM seeks to optimize the operational costs of the underlying DERs while ensuring power balance. Together, they form an overall framework that yields the desired transactions between the railway and power grid infrastructures. This overall optimization approach is validated using simulation studies of the Southbound Amtrak service along the Northeast Corridor (NEC) in the United States, which shows a 25% reduction in energy costs when compared to standard trip optimization based on minimum work, and a 75% reduction in energy costs when compared to the train cost calculated using a field dataset. △ Less

Submitted 15 June, 2020; originally announced June 2020.

Accelerated Learning with Robustness to Adversarial Regressors

Authors: Joseph E. Gaudio, Anuradha M. Annaswamy, José M. Moreu, Michael A. Bolender, Travis E. Gibson

Abstract: High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with accelerated learning guarantees. Such methods however, have only considered the case of static regressors. There is a significant need for parameter update algorithms… ▽ More High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with accelerated learning guarantees. Such methods however, have only considered the case of static regressors. There is a significant need for parameter update algorithms which can be proven stable in the presence of adversarial time-varying regressors, as is commonplace in control theory. In this paper, we propose a new discrete time algorithm which 1) provides stability and asymptotic convergence guarantees in the presence of adversarial regressors by leveraging insights from adaptive control theory and 2) provides non-asymptotic accelerated learning guarantees leveraging insights from convex optimization. In particular, our algorithm reaches an $εいぷしろん$ sub-optimal point in at most $\tilde{\mathcal{O}}(1/\sqrtεいぷしろん)$ iterations when regressors are constant - matching lower bounds due to Nesterov of $Ωおめが(1/\sqrtεいぷしろん)$, up to a $\log(1/εいぷしろん)$ factor and provides guaranteed bounds for stability when regressors are time-varying. We provide numerical experiments for a variant of Nesterov's provably hard convex optimization problem with time-varying regressors, as well as the problem of recovering an image with a time-varying blur and noise using streaming data. △ Less

Submitted 4 June, 2021; v1 submitted 4 May, 2020; originally announced May 2020.

Comments: L4DC 2021 Full Version

Parameter Estimation in Adaptive Control of Time-Varying Systems Under a Range of Excitation Conditions

Authors: Joseph E. Gaudio, Anuradha M. Annaswamy, Eugene Lavretsky, Michael A. Bolender

Abstract: This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error trajectories to tend exponentially fast towards a compact set whenever excitation conditions are satisfied. This algorithm is employed in a large class of problems… ▽ More This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error trajectories to tend exponentially fast towards a compact set whenever excitation conditions are satisfied. This algorithm is employed in a large class of problems where unknown parameters are present and are time-varying. It is shown that this algorithm guarantees global boundedness of the state and parameter errors of the system, and avoids an often used filtering approach for constructing key regressor signals. In addition, intervals of time over which these errors tend exponentially fast toward a compact set are provided, both in the presence of finite and persistent excitation. A projection operator is used to ensure the boundedness of the learning rate matrix, as compared to a time-varying forgetting factor. Numerical simulations are provided to complement the theoretical analysis. △ Less

Submitted 16 November, 2021; v1 submitted 9 November, 2019; originally announced November 2019.

Comments: IEEE Transactions on Automatic Control

Towards Dynamic Pricing for Shared Mobility on Demand using Markov Decision Processes and Dynamic Programming

Authors: Yue Guan, Anuradha M. Annaswamy, H. Eric Tseng

Abstract: In a Shared Mobility on Demand Service (SMoDS), dynamic pricing plays an important role in the form of an incentive for the decision of the empowered passenger on the ride offer. Strategies for determining the dynamic tariff should be suitably designed so that the incurred demand and supply are balanced and therefore economic efficiency is achieved. In this manuscript, we formulate a discrete time… ▽ More In a Shared Mobility on Demand Service (SMoDS), dynamic pricing plays an important role in the form of an incentive for the decision of the empowered passenger on the ride offer. Strategies for determining the dynamic tariff should be suitably designed so that the incurred demand and supply are balanced and therefore economic efficiency is achieved. In this manuscript, we formulate a discrete time Markov Decision Process (MDP) to determine the probability desired by the SMoDS platform corresponding to the acceptance rate of each empowered passenger at each state of the system. We use Estimated Waiting Time (EWT) as the metric for the balance between demand and supply, with the goal that EWT be regulated around a target value. We then develop a Dynamic Programming (DP) algorithm to derive the optimal policy of the MDP that regulates EWT around the target value. Computational experiments are conducted that demonstrate the regulation of EWT is effective, through various scenarios. The overall demonstration is carried out offline. The MDP formulation together with the DP algorithm can be utilized to an online determination of the dynamic tariff by integrating with our earlier works on Cumulative Prospect Theory based passenger behavioral modeling and the AltMin dynamic routing algorithm, and form the subject of future works. △ Less

Submitted 2 July, 2020; v1 submitted 4 October, 2019; originally announced October 2019.

Comments: 17 pages, 6 figures, and has been accepted for publication at the 23rd IEEE International Conference on Intelligent Transportation Systems, 2020

Journal ref: 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC). IEEE, 2020

Shared Control Between Pilots and Autopilots: Illustration of a Cyber-Physical Human System

Authors: Emre Eraslan, Yildiray Yildiz, Anuradha M. Annaswamy

Abstract: Although increased automation has made it easier to control aircraft, ensuring a safe interaction between the pilots and the autopilots is still a challenging problem, especially in the presence of severe anomalies. Current approach consists of autopilot solutions that disengage themselves when they become ineffective. This may cause reengagement of the pilot at the worst possible time, which can… ▽ More Although increased automation has made it easier to control aircraft, ensuring a safe interaction between the pilots and the autopilots is still a challenging problem, especially in the presence of severe anomalies. Current approach consists of autopilot solutions that disengage themselves when they become ineffective. This may cause reengagement of the pilot at the worst possible time, which can result in undesired consequences. In this paper, a series of research studies that propose pilot-autopilot interaction schemes based on the Capacity for Maneuver (CfM) concept, are covered. CfM refers to the remaining capacity of the actuators that can be used for bringing the aircraft to safety. It is demonstrated that CfM-based pilot-autopilot interaction schemes, or Shared Control Architectures (SCA), can be promising alternatives to the existing schemes. Two SCAs are tested in the experiments. In SCA1, the pilot takes over the control from the autopilot using the monitored CfM information. In SCA2, the pilot takes on the role of a supervisor helping the autopilot whenever a need arises, based on the CfM information. Whenever the aircraft experiences a severe anomaly, the pilot assesses the situation based on his/her CfM monitoring and intervenes by providing two control system parameter estimates to the autopilot. This increases the effectiveness of the autopilot. Using human-in-the-loop simulations, it is shown that CfM based interactions provides smaller tracking errors and larger overall CfM. The subjects including a commercial airline pilot and several university students are trained using a systematic procedure. Creation of new cyber physical & human systems is inevitable along with deeper engagement with the social science community so as to get better insight into human decision making. The results reported here should be viewed as a first of several steps in this research direction. △ Less

Submitted 17 April, 2020; v1 submitted 17 September, 2019; originally announced September 2019.

Comments: 26 pages, 13 figures, 12 tables

Adaptive Flight Control in the Presence of Limits on Magnitude and Rate

Authors: Joseph E. Gaudio, Anuradha M. Annaswamy, Michael A. Bolender, Eugene Lavretsky

Abstract: Input constraints as well as parametric uncertainties must be accounted for in the design of safe control systems. This paper presents an adaptive controller for multiple-input-multiple-output (MIMO) plants with input magnitude and rate saturation in the presence of parametric uncertainties. A filter is introduced in the control path to accommodate the presence of rate limits. An output feedback a… ▽ More Input constraints as well as parametric uncertainties must be accounted for in the design of safe control systems. This paper presents an adaptive controller for multiple-input-multiple-output (MIMO) plants with input magnitude and rate saturation in the presence of parametric uncertainties. A filter is introduced in the control path to accommodate the presence of rate limits. An output feedback adaptive controller is designed to stabilize the closed loop system even in the presence of this filter. The overall control architecture includes adaptive laws that are modified to account for the magnitude and rate limits. Analytical guarantees of bounded solutions and satisfactory tracking are provided. Three flight control simulations with nonlinear models of the aircraft dynamics are provided to demonstrate the efficacy of the proposed adaptive controller for open loop stable and unstable systems in the presence of uncertainties in the dynamics as well as input magnitude and rate saturation. △ Less

Submitted 27 July, 2019; originally announced July 2019.

Comments: 16 pages

Connections Between Adaptive Control and Optimization in Machine Learning

Authors: Joseph E. Gaudio, Travis E. Gibson, Anuradha M. Annaswamy, Michael A. Bolender, Eugene Lavretsky

Abstract: This paper demonstrates many immediate connections between adaptive control and optimization methods commonly employed in machine learning. Starting from common output error formulations, similarities in update law modifications are examined. Concepts in stability, performance, and learning, common to both fields are then discussed. Building on the similarities in update laws and common concepts,… ▽ More This paper demonstrates many immediate connections between adaptive control and optimization methods commonly employed in machine learning. Starting from common output error formulations, similarities in update law modifications are examined. Concepts in stability, performance, and learning, common to both fields are then discussed. Building on the similarities in update laws and common concepts, new intersections and opportunities for improved algorithm analysis are provided. In particular, a specific problem related to higher order learning is solved through insights obtained from these intersections. △ Less

Submitted 11 April, 2019; originally announced April 2019.

Comments: 18 pages

Cumulative Prospect Theory Based Dynamic Pricing for Shared Mobility on Demand Services

Authors: Yue Guan, Anuradha M. Annaswamy, H. Eric Tseng

Abstract: Cumulative Prospect Theory (CPT) is a modeling tool widely used in behavioral economics and cognitive psychology that captures subjective decision making of individuals under risk or uncertainty. In this paper, we propose a dynamic pricing strategy for Shared Mobility on Demand Services (SMoDSs) using a passenger behavioral model based on CPT. This dynamic pricing strategy together with dynamic ro… ▽ More Cumulative Prospect Theory (CPT) is a modeling tool widely used in behavioral economics and cognitive psychology that captures subjective decision making of individuals under risk or uncertainty. In this paper, we propose a dynamic pricing strategy for Shared Mobility on Demand Services (SMoDSs) using a passenger behavioral model based on CPT. This dynamic pricing strategy together with dynamic routing via a constrained optimization algorithm that we have developed earlier, provide a complete solution customized for SMoDS of multi-passenger transportation. The basic principles of CPT and the derivation of the passenger behavioral model in the SMoDS context are described in detail. The implications of CPT on dynamic pricing of the SMoDS are delineated using computational experiments involving passenger preferences. These implications include interpretation of the classic fourfold pattern of risk attitudes, strong risk aversion over mixed prospects, and behavioral preferences of self reference. Overall, it is argued that the use of the CPT framework corresponds to a crucial building block in designing socio-technical systems by allowing quantification of subjective decision making under risk or uncertainty that is perceived to be otherwise qualitative. △ Less

Submitted 28 November, 2019; v1 submitted 3 April, 2019; originally announced April 2019.

Comments: 17 pages, 6 figures, and has been accepted for publication at the 58th Annual Conference on Decision and Control, 2019

Journal ref: 2019 IEEE 58th Annual Conference on Decision and Control (CDC). IEEE, 2019

A Dynamic Routing Framework for Shared Mobility Services

Authors: Yue Guan, Anuradha M. Annaswamy, H. Eric Tseng

Abstract: Travel time in urban centers is a significant contributor to the quality of living of its citizens. Mobility on Demand (MoD) services such as Uber and Lyft have revolutionized the transportation infrastructure, enabling new solutions for passengers. Shared MoD services have shown that a continuum of solutions can be provided between the traditional private transport for an individual and the publi… ▽ More Travel time in urban centers is a significant contributor to the quality of living of its citizens. Mobility on Demand (MoD) services such as Uber and Lyft have revolutionized the transportation infrastructure, enabling new solutions for passengers. Shared MoD services have shown that a continuum of solutions can be provided between the traditional private transport for an individual and the public mass transit based transport, by making use of the underlying cyber-physical substrate that provides advanced, distributed, and networked computational and communicational support. In this paper, we propose a novel shared mobility service using a dynamic framework. This framework generates a dynamic route for multi-passenger transport, optimized to reduce time costs for both the shuttle and the passengers and is designed using a new concept of a space window. This concept introduces a degree of freedom that helps reduce the cost of the system involved in designing the optimal route. A specific algorithm based on the Alternating Minimization approach is proposed. Its analytical properties are characterized. Detailed computational experiments are carried out to demonstrate the advantages of the proposed approach and are shown to result in an order of magnitude improvement in the computational efficiency with minimal optimality gap when compared to a standard Mixed Integer Quadratically Constrained Programming based algorithm. △ Less

Submitted 26 March, 2019; originally announced March 2019.

Comments: 27 pages, 7 figures, has been accepted by ACM Transactions on Cyber-Physical Systems (TCPS), Special Issue on Transportation Cyber-Physical Systems

ACM Class: G.1.6; I.1.2; F.2.1

Provably Correct Learning Algorithms in the Presence of Time-Varying Features Using a Variational Perspective

Authors: Joseph E. Gaudio, Travis E. Gibson, Anuradha M. Annaswamy, Michael A. Bolender

Abstract: Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent methods unstable or weakens their convergence guarantees. Inspired by methods employed in adaptive control, this paper proposes new algorithms for the case when… ▽ More Features in machine learning problems are often time-varying and may be related to outputs in an algebraic or dynamical manner. The dynamic nature of these machine learning problems renders current higher order accelerated gradient descent methods unstable or weakens their convergence guarantees. Inspired by methods employed in adaptive control, this paper proposes new algorithms for the case when time-varying features are present, and demonstrates provable performance guarantees. In particular, we develop a unified variational perspective within a continuous time algorithm. This variational perspective includes higher order learning concepts and normalization, both of which stem from adaptive control, and allows stability to be established for dynamical machine learning problems where time-varying features are present. These higher order algorithms are also examined for provably correct learning in adaptive control and identification. Simulations are provided to verify the theoretical results. △ Less

Submitted 27 May, 2019; v1 submitted 11 March, 2019; originally announced March 2019.

Comments: 25 pages, additional simulation detail, paper rewritten

Convergence Properties of Adaptive Systems and the Definition of Exponential Stability

Authors: Benjamin M. Jenkins, Anuradha M. Annaswamy, Eugene Lavretsky, Travis E. Gibson

Abstract: The convergence properties of adaptive systems in terms of excitation conditions on the regressor vector are well known. With persistent excitation of the regressor vector in model reference adaptive control the state error and the adaptation error are globally exponentially stable, or equivalently, exponentially stable in the large. When the excitation condition however is imposed on the referenc… ▽ More The convergence properties of adaptive systems in terms of excitation conditions on the regressor vector are well known. With persistent excitation of the regressor vector in model reference adaptive control the state error and the adaptation error are globally exponentially stable, or equivalently, exponentially stable in the large. When the excitation condition however is imposed on the reference input or the reference model state it is often incorrectly concluded that the persistent excitation in those signals also implies exponential stability in the large. The definition of persistent excitation is revisited so as to address some possible confusion in the adaptive control literature. It is then shown that persistent excitation of the reference model only implies local persistent excitation (weak persistent excitation). Weak persistent excitation of the regressor is still sufficient for uniform asymptotic stability in the large, but not exponential stability in the large. We show that there exists an infinite region in the state-space of adaptive systems where the state rate is bounded. This infinite region with finite rate of convergence is shown to exist not only in classic open-loop reference model adaptive systems, but also in a new class of closed-loop reference model adaptive systems. △ Less

Submitted 10 November, 2015; originally announced November 2015.

Comments: 22 pages, 5 figures

Adaptive Output Feedback based on Closed-loop Reference Models

Authors: Travis E. Gibson, Zheng Qu, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: This note presents the design and analysis of an adaptive controller for a class of linear plants in the presence of output feedback. This controller makes use of a closed-loop reference model as an observer, and guarantees global stability and asymptotic output tracking. This note presents the design and analysis of an adaptive controller for a class of linear plants in the presence of output feedback. This controller makes use of a closed-loop reference model as an observer, and guarantees global stability and asymptotic output tracking. △ Less

Submitted 7 October, 2014; originally announced October 2014.

Comments: 8 Pages, submitted to IEEE Transactions on Automatic Control

Journal ref: Automatic Control, IEEE Transactions on , vol.60, no.10, pp.2728-2733, Oct. 2015

Squaring-Up Method In the Presence of Transmission Zeros

Authors: Zheng Qu, Daniel Wiese, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: This paper presents a method to square up a generic MIMO system that already possesses transmission zeros. The proposed method is developed based on and therefore can be incorporated into the existing method that has been proven effective on a system without transmission zeros. It has been shown that for the generic system considering here, the squaring-up problem can be transformed into a state-f… ▽ More This paper presents a method to square up a generic MIMO system that already possesses transmission zeros. The proposed method is developed based on and therefore can be incorporated into the existing method that has been proven effective on a system without transmission zeros. It has been shown that for the generic system considering here, the squaring-up problem can be transformed into a state-feedback problem with uncontrollable modes. △ Less

Submitted 22 October, 2013; v1 submitted 4 October, 2013; originally announced October 2013.

Comments: Correction to the typos and content

On Adaptive Control with Closed-loop Reference Models: Transients, Oscillations, and Peaking

Authors: Travis E. Gibson, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: One of the main features of adaptive systems is an oscillatory convergence that exacerbates with the speed of adaptation. Recently it has been shown that Closed-loop Reference Models (CRMs) can result in improved transient performance over their open-loop counterparts in model reference adaptive control. In this paper, we quantify both the transient performance in the classical adaptive systems an… ▽ More One of the main features of adaptive systems is an oscillatory convergence that exacerbates with the speed of adaptation. Recently it has been shown that Closed-loop Reference Models (CRMs) can result in improved transient performance over their open-loop counterparts in model reference adaptive control. In this paper, we quantify both the transient performance in the classical adaptive systems and their improvement with CRMs. In addition to deriving bounds on L-2 norms of the derivatives of the adaptive parameters which are shown to be smaller, an optimal design of CRMs is proposed which minimizes an underlying peaking phenomenon. The analytical tools proposed are shown to be applicable for a range of adaptive control problems including direct control and composite control with observer feedback. The presence of CRMs in adaptive backstepping and adaptive robot control are also discussed. Simulation results are presented throughout the paper to support the theoretical derivations. △ Less

Submitted 8 August, 2013; v1 submitted 26 April, 2013; originally announced April 2013.

Adaptive Control of Scalar Plants in the Presence of Unmodeled Dynamics

Authors: Heather S. Hussain, Megumi M. Matsutani, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: Robust adaptive control of scalar plants in the presence of unmodeled dynamics is established in this paper. It is shown that implementation of a projection algorithm with standard adaptive control of a scalar plant ensures global boundedness of the overall adaptive system for a class of unmodeled dynamics. Robust adaptive control of scalar plants in the presence of unmodeled dynamics is established in this paper. It is shown that implementation of a projection algorithm with standard adaptive control of a scalar plant ensures global boundedness of the overall adaptive system for a class of unmodeled dynamics. △ Less

Submitted 31 January, 2013; originally announced February 2013.

Closed-loop Reference Models for Output-Feedback Adaptive Systems

Authors: Travis E. Gibson, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: Closed-loop reference models have recently been proposed for states accessible adaptive systems. They have been shown to have improved transient response over their open loop counter parts. The results in the states accessible case are extended to single input single output plants of arbitrary relative degree. Closed-loop reference models have recently been proposed for states accessible adaptive systems. They have been shown to have improved transient response over their open loop counter parts. The results in the states accessible case are extended to single input single output plants of arbitrary relative degree. △ Less

Submitted 27 November, 2012; v1 submitted 30 October, 2012; originally announced October 2012.

Comments: v1 Submitted to European Control Conference 2013, v2 Typos corrected

Adaptive Switching Controllers for Tracking using Persistent Excitation

Authors: Harald Voit, Anuradha Annaswamy

Abstract: The focus of this paper is on the co-design of control and communication protocol for the control of multiple applications with unknown parameters using a distributed embedded system. The co-design consists of an adaptive switching controller and a hybrid communication architecture that switches between a time-triggered and event-triggered protocol. It is shown that the overall co-design leads to… ▽ More The focus of this paper is on the co-design of control and communication protocol for the control of multiple applications with unknown parameters using a distributed embedded system. The co-design consists of an adaptive switching controller and a hybrid communication architecture that switches between a time-triggered and event-triggered protocol. It is shown that the overall co-design leads to an overall switching adaptive system that has bounded solutions and ensures tracking in the presence of a class of disturbances. In order to achieve the goal of tracking persistent excitation techniques are used. △ Less

Submitted 21 August, 2012; originally announced August 2012.

Adaptive Systems with Closed-loop Reference Models: Stability, Robustness and Transient Performance

Authors: Travis E. Gibson, Anuradha M. Annaswamy, Eugene Lavretsky

Abstract: This paper explores the properties of adaptive systems with closed-loop reference models. Using additional design freedom available in closed-loop reference models, we design new adaptive controllers that are (a) stable, and (b) have improved transient properties. Numerical studies that complement theoretical derivations are also reported. This paper explores the properties of adaptive systems with closed-loop reference models. Using additional design freedom available in closed-loop reference models, we design new adaptive controllers that are (a) stable, and (b) have improved transient properties. Numerical studies that complement theoretical derivations are also reported. △ Less

Submitted 30 October, 2012; v1 submitted 23 January, 2012; originally announced January 2012.

Comments: 16 pages. v2: submission to IEEE CDC 2012, v3: Typos corrected in section IV, v4: expanded paper to CMRAC, v5 Typos corrected, v6 Submitted to Transactions