-
Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI)
Authors:
Gabriel F. Machado,
Morgan Jones
Abstract:
Modern societies have an abundance of data yet good system models are rare. Unfortunately, many of the current system identification and machine learning techniques fail to generalize outside of the training set, producing models that violate basic physical laws. This work proposes a novel method for the Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI). SINDy-SI is an i…
▽ More
Modern societies have an abundance of data yet good system models are rare. Unfortunately, many of the current system identification and machine learning techniques fail to generalize outside of the training set, producing models that violate basic physical laws. This work proposes a novel method for the Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI). SINDy-SI is an iterative method that uses Sum-of-Squares (SOS) programming to learn optimally fitted models while guaranteeing that the learned model satisfies side information, such as symmetry's and physical laws. Guided by the principle of Occam's razor, that the simplest or most regularized best fitted model is typically the superior choice, during each iteration SINDy-SI prunes the basis functions associated with small coefficients, yielding a sparse dynamical model upon termination. Through several numerical experiments we will show how the combination of side information constraints and sparse polynomial representation cultivates dynamical models that obey known physical laws while displaying impressive generalized performance beyond the training set.
△ Less
Submitted 24 November, 2023; v1 submitted 6 October, 2023;
originally announced October 2023.
-
Multiscale Stochastic Simulation of the US Pacific Northwest Using Distributed Computing and Databases with Integrated Inflow and Variable Renewable Energy
Authors:
Joaquim Dias Garcia,
Guilherme Machado,
André Dias,
Gerson Couto,
John Ollis,
John Fazio,
Daniel Hua
Abstract:
Modelling challenges of the United States Pacific Northwest system have grown in the last decade. Besides classical modelling difficulties such as a complex hydro cascade with many operational constraints, we have seen higher penetration of variable renewable energy inside and outside the system leading to internal issues and completely different power exchanges with the West Coast System. The ana…
▽ More
Modelling challenges of the United States Pacific Northwest system have grown in the last decade. Besides classical modelling difficulties such as a complex hydro cascade with many operational constraints, we have seen higher penetration of variable renewable energy inside and outside the system leading to internal issues and completely different power exchanges with the West Coast System. The analysis of adequacy and reliability of this system motivated the design and implementation of a five-step simulator including four planning phases and an operation step. The five levels were modeled as mathematical programs that are linked from top to bottom by fixed decisions and improvements in forecasts, on the other hand they are also linked from bottom to top by system updated states. The solution of the millions of resulting mathematical programs was made possible by applying state of the art optimization techniques and high performance data bases in a massively parallel environment.
△ Less
Submitted 5 August, 2020;
originally announced August 2020.
-
Fully Convolutional Open Set Segmentation
Authors:
Hugo Oliveira,
Caio Silva,
Gabriel L. S. Machado,
Keiller Nogueira,
Jefersson A. dos Santos
Abstract:
In semantic segmentation knowing about all existing classes is essential to yield effective results with the majority of existing approaches. However, these methods trained in a Closed Set of classes fail when new classes are found in the test phase. It means that they are not suitable for Open Set scenarios, which are very common in real-world computer vision and remote sensing applications. In t…
▽ More
In semantic segmentation knowing about all existing classes is essential to yield effective results with the majority of existing approaches. However, these methods trained in a Closed Set of classes fail when new classes are found in the test phase. It means that they are not suitable for Open Set scenarios, which are very common in real-world computer vision and remote sensing applications. In this paper, we discuss the limitations of Closed Set segmentation and propose two fully convolutional approaches to effectively address Open Set semantic segmentation: OpenFCN and OpenPCS. OpenFCN is based on the well-known OpenMax algorithm, configuring a new application of this approach in segmentation settings. OpenPCS is a fully novel approach based on feature-space from DNN activations that serve as features for computing PCA and multi-variate gaussian likelihood in a lower dimensional space. Experiments were conducted on the well-known Vaihingen and Potsdam segmentation datasets. OpenFCN showed little-to-no improvement when compared to the simpler and much more time efficient SoftMax thresholding, while being between some orders of magnitude slower. OpenPCS achieved promising results in almost all experiments by overcoming both OpenFCN and SoftMax thresholding. OpenPCS is also a reasonable compromise between the runtime performances of the extremely fast SoftMax thresholding and the extremely slow OpenFCN, being close able to run close to real-time. Experiments also indicate that OpenPCS is effective, robust and suitable for Open Set segmentation, being able to improve the recognition of unknown class pixels without reducing the accuracy on the known class pixels.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
