Showing 1–50 of 70 results for author: Delvenne, J

Predicting State Transitions in Autonomous Nonlinear Bistable Systems with Hidden Stochasticity

Authors: Léopold Van Brandt, Jean-Charles Delvenne

Abstract: Bistable autonomous systems can be found inmany areas of science. When the intrinsic noise intensity is large, these systems exhibits stochastic transitions from onemetastable steady state to another. In electronic bistable memories, these transitions are failures, usually simulated in a Monte-Carlo fashion at a high CPU-time price. Existing closed-form formulas, relying on near-stable-steady-stat… ▽ More Bistable autonomous systems can be found inmany areas of science. When the intrinsic noise intensity is large, these systems exhibits stochastic transitions from onemetastable steady state to another. In electronic bistable memories, these transitions are failures, usually simulated in a Monte-Carlo fashion at a high CPU-time price. Existing closed-form formulas, relying on near-stable-steady-state approximations of the nonlinear system dynamics to estimate the mean transition time, have turned out inaccurate. Our contribution is twofold. From a unidimensional stochastic model of overdamped autonomous systems, we propose an extended Eyring-Kramers analytical formula accounting for both nonlinear drift and state-dependent white noise variance, rigorously derived from Itô stochastic calculus. We also adapt it to practical system engineering situations where the intrinsic noise sources are hidden and can only be inferred from the fluctuations of observables measured in steady states. First numerical trials on an industrial electronic case study suggest that our approximate prediction formula achieve remarkable accuracy, outperforming previous non-Monte-Carlo approaches. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: Accepted for IEEE L-CSS

Moments of Entropy Production in Dissipative Devices

Authors: Jean-Charles Delvenne, Léopold Van Brandt

Abstract: We characterize the possible moments of entropy production for general overdamped Markovian systems. We find a general formulation of the problem, and derive a new necessary condition between the second and third moment. We determine all possible first, second and third moments of entropy production for a white noise process. As a consequence, we obtain a lower bound for the skewness of the curren… ▽ More We characterize the possible moments of entropy production for general overdamped Markovian systems. We find a general formulation of the problem, and derive a new necessary condition between the second and third moment. We determine all possible first, second and third moments of entropy production for a white noise process. As a consequence, we obtain a lower bound for the skewness of the current fluctuations in dissipative devices such as transistors, thereby demonstrating that the Gaussianity assumption widely used in electronic engineering is thermodynamically inconsistent. △ Less

Submitted 30 March, 2024; originally announced April 2024.

Ellipsoidal embeddings of graphs

Authors: Michaël Fanuel, Antoine Aspeel, Michael T. Schaub, Jean-Charles Delvenne

Abstract: Due to their flexibility to represent almost any kind of relational data, graph-based models have enjoyed a tremendous success over the past decades. While graphs are inherently only combinatorial objects, however, many prominent analysis tools are based on the algebraic representation of graphs via matrices such as the graph Laplacian, or on associated graph embeddings. Such embeddings associate… ▽ More Due to their flexibility to represent almost any kind of relational data, graph-based models have enjoyed a tremendous success over the past decades. While graphs are inherently only combinatorial objects, however, many prominent analysis tools are based on the algebraic representation of graphs via matrices such as the graph Laplacian, or on associated graph embeddings. Such embeddings associate to each node a set of coordinates in a vector space, a representation which can then be employed for learning tasks such as the classification or alignment of the nodes of the graph. As the geometric picture provided by embedding methods enables the use of a multitude of methods developed for vector space data, embeddings have thus gained interest both from a theoretical as well as a practical perspective. Inspired by trace-optimization problems, often encountered in the analysis of graph-based data, here we present a method to derive ellipsoidal embeddings of the nodes of a graph, in which each node is assigned a set of coordinates on the surface of a hyperellipsoid. Our method may be seen as an alternative to popular spectral embedding techniques, to which it shares certain similarities we discuss. To illustrate the utility of the embedding we conduct a case study in which we analyse synthetic and real world networks with modular structure, and compare the results obtained with known methods in the literature. △ Less

Submitted 26 March, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Comments: 29 pages, 6 figures. A few typos corrected

Stochastic Nonlinear Dynamical Modelling of SRAM Bitcells in Retention Mode

Authors: Léopold Van Brandt, Denis Flandre, Jean-Charles Delvenne

Abstract: SRAM bitcells in retention mode behave as autonomous stochastic nonlinear dynamical systems. From observation of variability-aware transient noise simulations, we provide an unidimensional model, fully characterizable by conventional deterministic SPICE simulations, insightfully explaining the mechanism of intrinsic noise-induced bit flips. The proposed model is exploited to, first, explain the re… ▽ More SRAM bitcells in retention mode behave as autonomous stochastic nonlinear dynamical systems. From observation of variability-aware transient noise simulations, we provide an unidimensional model, fully characterizable by conventional deterministic SPICE simulations, insightfully explaining the mechanism of intrinsic noise-induced bit flips. The proposed model is exploited to, first, explain the reported inaccuracy of existing closed-form near-equilibrium formulas aimed at predicting the mean time to failure and, secondly, to propose a closer estimate attractive in terms of CPU time. △ Less

Submitted 18 February, 2024; originally announced February 2024.

Comments: Accepted proceeding for invited talk at IEEE EDTM 2024, Bangalore, India

Variability-Aware Noise-Induced Dynamic Instability of Ultra-Low-Voltage SRAM Bitcells

Authors: Léopold Van Brandt, Jean-Charles Delvenne, Denis Flandre

Abstract: Stability of ultra-low-voltage SRAM bitcells in retention mode is threatened by two types of uncertainty: process variability and intrinsic noise. While variability dominates the failure probability, noise-induced bit flips in weakened bitcells lead to dynamic instability. We study both effects jointly in a unified SPICE simulation framework. Starting from a synthetic representation of process var… ▽ More Stability of ultra-low-voltage SRAM bitcells in retention mode is threatened by two types of uncertainty: process variability and intrinsic noise. While variability dominates the failure probability, noise-induced bit flips in weakened bitcells lead to dynamic instability. We study both effects jointly in a unified SPICE simulation framework. Starting from a synthetic representation of process variations introduced in a previous work, we identify the cases of poor noise immunity that require thorough noise analyses. Relying on a rigorous and systematic methodology, we simulate them in the time domain so as to emulate a true data retention operation. Short times to failure, unacceptable for a practical ultra-low-power memory system application, are recorded. The transient bit-flip mechanism is analysed and a dynamic failure criterion involving the unstable point is established. We conclude that, beyond static variability, the dynamic noise inflates defectiveness among SRAM bitcells. We also discuss the limits of existing analytical formulas from the literature, which rely on a linear near-equilibrium approximation of the SRAM dynamics to, inaccurately, predict the mean time to failure. △ Less

Submitted 18 February, 2024; originally announced February 2024.

Comments: Accepted proceeding of IEEE LASCAS 2024, Punta del Este, Uruguay

Efficiency Separation between RL Methods: Model-Free, Model-Based and Goal-Conditioned

Authors: Brieuc Pinon, Raphaël Jungers, Jean-Charles Delvenne

Abstract: We prove a fundamental limitation on the efficiency of a wide class of Reinforcement Learning (RL) algorithms. This limitation applies to model-free RL methods as well as a broad range of model-based methods, such as planning with tree search. Under an abstract definition of this class, we provide a family of RL problems for which these methods suffer a lower bound exponential in the horizon for… ▽ More We prove a fundamental limitation on the efficiency of a wide class of Reinforcement Learning (RL) algorithms. This limitation applies to model-free RL methods as well as a broad range of model-based methods, such as planning with tree search. Under an abstract definition of this class, we provide a family of RL problems for which these methods suffer a lower bound exponential in the horizon for their interactions with the environment to find an optimal behavior. However, there exists a method, not tailored to this specific family of problems, which can efficiently solve the problems in the family. In contrast, our limitation does not apply to several types of methods proposed in the literature, for instance, goal-conditioned methods or other algorithms that construct an inverse dynamics model. △ Less

Submitted 28 September, 2023; originally announced September 2023.

The non-Landauer Bound for the Dissipation of Bit Writing Operation

Authors: Léopold Van Brandt, Jean-Charles Delvenne

Abstract: We propose a novel bound on the mimimum dissipation required in any circumstances to transfer a certain amount of charge through any resistive device. We illustrate it on the task of writing a logical 1 (encoded as a prescribed voltage) into a capacitance, through various linear or nonlinear devices. We show that, even though the celebrated Landauer bound (which only applies to bit erasure) does n… ▽ More We propose a novel bound on the mimimum dissipation required in any circumstances to transfer a certain amount of charge through any resistive device. We illustrate it on the task of writing a logical 1 (encoded as a prescribed voltage) into a capacitance, through various linear or nonlinear devices. We show that, even though the celebrated Landauer bound (which only applies to bit erasure) does not apply here, one can still formulate a "non- Landauer" lower bound on dissipation, that crucially depends on the time budget to perform the operation, as well as the average conductance of the driving device. We compare our bound with empirical results reported in the literature and realistic simulations of CMOS pass and transmission gates in decananometer technology. Our non-Landauer bound turns out to be a quantitative benchmark to assess the (non-)optimality of a writing operation. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Noise-dissipation relation for nonlinear electronic circuits

Authors: Léopold Van Brandt, Jean-Charles Delvenne

Abstract: An extension of fluctuation-dissipation theorem is used to derive a "speed limit" theorem for nonlinear electronic devices. This speed limit provides a lower bound on the dissipation that is incurred when transferring a given amount of electric charge in a certain amount of time with a certain noise level (average variance of the current). This bound, which implies a high energy dissipation for fa… ▽ More An extension of fluctuation-dissipation theorem is used to derive a "speed limit" theorem for nonlinear electronic devices. This speed limit provides a lower bound on the dissipation that is incurred when transferring a given amount of electric charge in a certain amount of time with a certain noise level (average variance of the current). This bound, which implies a high energy dissipation for fast, low-noise operations (such as switching a bit in a digital memory), brings together recent results of stochastic thermodynamics into a form that is usable for practical nonlinear electronic circuits, as we illustrate on a switching circuit made of an nMOS pass gate in a state-of-the-art industrial technology. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Journal ref: VAN BRANDT, Léopold et DELVENNE, Jean-Charles. Noise-dissipation relation for nonlinear electronic circuits. Applied Physics Letters, 2023, vol. 122, no 26

Bounding Variance and Skewness of Fluctuations in Nonlinear Mesoscopic Systems with Stochastic Thermodynamics

Authors: Jean-Charles Delvenne, Léopold Van Brandt

Abstract: Fluctuations arising in nonlinear dissipative systems (diode, transistors, chemical reaction, etc.) subject to an external drive (voltage, chemical potential, etc.) are well known to elude any simple characterization such as the fluctuation-dissipation theorem (also called Johnson-Nyquist law, or Einstein's law in specific contexts). Using results from stochastic thermodynamics, we show that the v… ▽ More Fluctuations arising in nonlinear dissipative systems (diode, transistors, chemical reaction, etc.) subject to an external drive (voltage, chemical potential, etc.) are well known to elude any simple characterization such as the fluctuation-dissipation theorem (also called Johnson-Nyquist law, or Einstein's law in specific contexts). Using results from stochastic thermodynamics, we show that the variance of these fluctuations exceeds the variance predicted by a suitably extended version of Johnson-Nyquist's formula, by an amount that is controlled by the skewness (third moment) of the fluctuations. As a consequence, symmetric fluctuations necessarily obey the extended Johnson-Nyquist formula. This shows the physical inconsistency of Gaussian approximation for the noise arising in some nonlinear models, such as MOS transistors or chemical reactions. More generally, this suggests the need for a stochastic nonlinear systems theory that is compatible with the teachings of thermodynamics. △ Less

Submitted 7 July, 2023; v1 submitted 30 August, 2022; originally announced August 2022.

Comments: 7 pages, 3 figures

A model-based approach to meta-Reinforcement Learning: Transformers and tree search

Authors: Brieuc Pinon, Jean-Charles Delvenne, Raphaël Jungers

Abstract: Meta-learning is a line of research that develops the ability to leverage past experiences to efficiently solve new learning problems. Meta-Reinforcement Learning (meta-RL) methods demonstrate a capability to learn behaviors that efficiently acquire and exploit information in several meta-RL problems. In this context, the Alchemy benchmark has been proposed by Wang et al. [2021]. Alchemy feature… ▽ More Meta-learning is a line of research that develops the ability to leverage past experiences to efficiently solve new learning problems. Meta-Reinforcement Learning (meta-RL) methods demonstrate a capability to learn behaviors that efficiently acquire and exploit information in several meta-RL problems. In this context, the Alchemy benchmark has been proposed by Wang et al. [2021]. Alchemy features a rich structured latent space that is challenging for state-of-the-art model-free RL methods. These methods fail to learn to properly explore then exploit. We develop a model-based algorithm. We train a model whose principal block is a Transformer Encoder to fit the symbolic Alchemy environment dynamics. Then we define an online planner with the learned model using a tree search method. This algorithm significantly outperforms previously applied model-free RL methods on the symbolic Alchemy problem. Our results reveal the relevance of model-based approaches with online planning to perform exploration and exploitation successfully in meta-RL. Moreover, we show the efficiency of the Transformer architecture to learn complex dynamics that arise from latent spaces present in meta-RL problems. △ Less

Submitted 24 August, 2022; originally announced August 2022.

The Thermo-Kinetic Relations

Authors: Jean-Charles Delvenne, Gianmaria Falasco

Abstract: Thermo-Kinetic relations bound thermodynamic quantities such as entropy production with statistics of dynamical observables. We introduce a Thermo-Kinetic Relation to bound the entropy production or the non-adiabatic (Hatano-Sasa, excess) entropy production for overdamped Markov jump processes, possibly with time-varying rates and non stationary distributions. For stationary cases, this bound is a… ▽ More Thermo-Kinetic relations bound thermodynamic quantities such as entropy production with statistics of dynamical observables. We introduce a Thermo-Kinetic Relation to bound the entropy production or the non-adiabatic (Hatano-Sasa, excess) entropy production for overdamped Markov jump processes, possibly with time-varying rates and non stationary distributions. For stationary cases, this bound is akin to a Thermodynamic Uncertainty Relation, only involving absolute fluctuations rather than the mean square, thereby offering a better lower bound far from equilibrium. For non-stationary cases, this bound generalises Classical Speed Limits, where the kinetic term is not necessarily the activity (number of jumps) but any trajectory observable of interest. As a consequence, in the task of driving a system from a given probability distribution to another, we find a trade-off between non-adiabatic entropy production and housekeeping entropy production: the latter can be increased in order to decrease the former, although to a limited extent. We also find constraints specific to constant-rate Markov processes. We illustrate our Thermo-Kinetic Relations on simple examples from biophysics and computing devices. △ Less

Submitted 3 June, 2022; v1 submitted 25 October, 2021; originally announced October 2021.

Comments: 12 pages. Results generalised, discussion extended, two examples included

Beyond Thermodynamic Uncertainty Relations: nonlinear response, error-dissipation trade-offs, and speed limits

Authors: Gianmaria Falasco, Massimiliano Esposito, Jean-Charles Delvenne

Abstract: From a recent geometric generalization of Thermodynamic Uncertainty Relations (TURs) we derive novel upper bounds on the nonlinear response of an observable of an arbitrary system undergoing a change of probabilistic state. Various relaxations of these bounds allow to recover well known bounds such as (strengthenings of) Cramer-Rao's and Pinsker's inequalities. In particular we obtain a master ine… ▽ More From a recent geometric generalization of Thermodynamic Uncertainty Relations (TURs) we derive novel upper bounds on the nonlinear response of an observable of an arbitrary system undergoing a change of probabilistic state. Various relaxations of these bounds allow to recover well known bounds such as (strengthenings of) Cramer-Rao's and Pinsker's inequalities. In particular we obtain a master inequality, named Symmetric Response Intensity Relation, which recovers several TURs as particular cases. We employ this set of bounds for three physical applications. First, we derive a trade-off between thermodynamic cost (dissipated free energy) and reliability of systems switching instantly between two states, such as one-bit memories. We derive in particular a lower bound of $2.8 k_BT$ per Shannon bit to write a bit in such a memory, a bound distinct from Landauer's one. Second, we obtain a new family of classic speed limits which provide lower bounds for non-autonomous Markov processes on the time needed to transition between two probabilistic states in terms of a thermodynamic quantity (e.g. non-equilibrium free energy) and a kinetic quantity (e.g. dynamical activity). Third, we provide an upper bound on the nonlinear response of a system based solely on the `complexity' of the system (which we relate to a high entropy and non-uniformity of the probabilities). We find that `complex' models (e.g. with many states) are necessarily fragile to some perturbations, while simple systems are robust, in that they display a low response to arbitrary perturbations. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: 23 pages + appendix

PAC-learning gains of Turing machines over circuits and neural networks

Authors: Brieuc Pinon, Raphaël Jungers, Jean-Charles Delvenne

Abstract: A caveat to many applications of the current Deep Learning approach is the need for large-scale data. One improvement suggested by Kolmogorov Complexity results is to apply the minimum description length principle with computationally universal models. We study the potential gains in sample efficiency that this approach can bring in principle. We use polynomial-time Turing machines to represent co… ▽ More A caveat to many applications of the current Deep Learning approach is the need for large-scale data. One improvement suggested by Kolmogorov Complexity results is to apply the minimum description length principle with computationally universal models. We study the potential gains in sample efficiency that this approach can bring in principle. We use polynomial-time Turing machines to represent computationally universal models and Boolean circuits to represent Artificial Neural Networks (ANNs) acting on finite-precision digits. Our analysis unravels direct links between our question and Computational Complexity results. We provide lower and upper bounds on the potential gains in sample efficiency between the MDL applied with Turing machines instead of ANNs. Our bounds depend on the bit-size of the input of the Boolean function to be learned. Furthermore, we highlight close relationships between classical open problems in Circuit Complexity and the tightness of these. △ Less

Submitted 24 August, 2022; v1 submitted 23 March, 2021; originally announced March 2021.

Flow stability for dynamic community detection

Authors: Alexandre Bovet, Jean-Charles Delvenne, Renaud Lambiotte

Abstract: Many systems exhibit complex temporal dynamics due to the presence of different processes taking place simultaneously. An important task in such systems is to extract a simplified view of their time-dependent network of interactions. Community detection in temporal networks usually relies on aggregation over time windows or consider sequences of different stationary epochs. For dynamics-based meth… ▽ More Many systems exhibit complex temporal dynamics due to the presence of different processes taking place simultaneously. An important task in such systems is to extract a simplified view of their time-dependent network of interactions. Community detection in temporal networks usually relies on aggregation over time windows or consider sequences of different stationary epochs. For dynamics-based methods, attempts to generalize static-network methodologies also face the fundamental difficulty that a stationary state of the dynamics does not always exist. Here, we derive a method based on a dynamical process evolving on the temporal network. Our method allows dynamics that do not reach a steady state and uncovers two sets of communities for a given time interval that accounts for the ordering of edges in forward and backward time. We show that our method provides a natural way to disentangle the different dynamical scales present in a system with synthetic and real-world examples. △ Less

Submitted 20 May, 2022; v1 submitted 15 January, 2021; originally announced January 2021.

Comments: 54 pages, 14 figures. Accepted version by Science Advances

Journal ref: Science Advances, 8(19), p. eabj3063

Stochastic Thermodynamics of Non-Linear Electronic Circuits: A Realistic Framework for Computing around kT

Authors: Nahuel Freitas, Jean-Charles Delvenne, Massimiliano Esposito

Abstract: We present a general formalism for the construction of thermodynamically consistent stochastic models of non-linear electronic circuits. The devices constituting the circuit can have arbitrary I-V curves and may include tunnel junctions, diodes, and MOS transistors in subthreshold operation, among others. We provide a full analysis of the stochastic non-equilibrium thermodynamics of these models,… ▽ More We present a general formalism for the construction of thermodynamically consistent stochastic models of non-linear electronic circuits. The devices constituting the circuit can have arbitrary I-V curves and may include tunnel junctions, diodes, and MOS transistors in subthreshold operation, among others. We provide a full analysis of the stochastic non-equilibrium thermodynamics of these models, identifying the relevant thermodynamic potentials, characterizing the different contributions to the irreversible entropy production, and obtaining different fluctuation theorems. Our work provides a realistic framework to study thermodynamics of computing with electronic circuits. We demonstrate this point by constructing a stochastic model of a CMOS inverter. We find that a deterministic analysis is only compatible with the assumption of equilibrium fluctuations, and analyze how the non-equilibrium fluctuations induce deviations from its deterministic transfer function. Finally, building on the CMOS inverter, we propose a full-CMOS design for a probabilistic bit (or binary stochastic neuron) exploiting intrinsic noise. △ Less

Submitted 18 May, 2021; v1 submitted 24 August, 2020; originally announced August 2020.

Comments: Updated version

Journal ref: Phys. Rev. X 11, 031064 (2021)

Severability of mesoscale components and local time scales in dynamical networks

Authors: Yun William Yu, Jean-Charles Delvenne, Sophia N. Yaliraki, Mauricio Barahona

Abstract: A major goal of dynamical systems theory is the search for simplified descriptions of the dynamics of a large number of interacting states. For overwhelmingly complex dynamical systems, the derivation of a reduced description on the entire dynamics at once is computationally infeasible. Other complex systems are so expansive that despite the continual onslaught of new data only partial information… ▽ More A major goal of dynamical systems theory is the search for simplified descriptions of the dynamics of a large number of interacting states. For overwhelmingly complex dynamical systems, the derivation of a reduced description on the entire dynamics at once is computationally infeasible. Other complex systems are so expansive that despite the continual onslaught of new data only partial information is available. To address this challenge, we define and optimise for a local quality function severability for measuring the dynamical coherency of a set of states over time. The theoretical underpinnings of severability lie in our local adaptation of the Simon-Ando-Fisher time-scale separation theorem, which formalises the intuition of local wells in the Markov landscape of a dynamical process, or the separation between a microscopic and a macroscopic dynamics. Finally, we demonstrate the practical relevance of severability by applying it to examples drawn from power networks, image segmentation, social networks, metabolic networks, and word association. △ Less

Submitted 4 June, 2020; originally announced June 2020.

Comments: 24 pages, 13 figures

State aggregations in Markov chains and block models of networks

Authors: Mauro Faccin, Michael T. Schaub, Jean-Charles Delvenne

Abstract: We consider state-aggregation schemes for Markov chains from an information-theoretic perspective. Specifically, we consider aggregating the states of a Markov chain such that the mutual information of the aggregated states separated by T time steps is maximized. We show that for T = 1 this approach recovers the maximum-likelihood estimator of the degree-corrected stochastic block model as a parti… ▽ More We consider state-aggregation schemes for Markov chains from an information-theoretic perspective. Specifically, we consider aggregating the states of a Markov chain such that the mutual information of the aggregated states separated by T time steps is maximized. We show that for T = 1 this approach recovers the maximum-likelihood estimator of the degree-corrected stochastic block model as a particular case, thereby enabling us to explain certain features of the likelihood landscape of this popular generative network model from a dynamical lens. We further highlight how we can uncover coherent, long-range dynamical modules for which considering a time-scale T >> 1 is essential, using synthetic flows and real-world ocean currents, where we are able to recover the fundamental features of the surface currents of the oceans. △ Less

Submitted 20 August, 2021; v1 submitted 1 May, 2020; originally announced May 2020.

Comments: 18 pages, 13 figures

MSC Class: 05C81; 60J10

Journal ref: Phys. Rev. Lett. 127, 078301 (2021)

Multi-scale Anomaly Detection on Attributed Networks

Authors: Leonardo Gutiérrez-Gómez, Alexandre Bovet, Jean-Charles Delvenne

Abstract: Many social and economic systems can be represented as attributed networks encoding the relations between entities who are themselves described by different node attributes. Finding anomalies in these systems is crucial for detecting abuses such as credit card frauds, web spams or network intrusions. Intuitively, anomalous nodes are defined as nodes whose attributes differ starkly from the attribu… ▽ More Many social and economic systems can be represented as attributed networks encoding the relations between entities who are themselves described by different node attributes. Finding anomalies in these systems is crucial for detecting abuses such as credit card frauds, web spams or network intrusions. Intuitively, anomalous nodes are defined as nodes whose attributes differ starkly from the attributes of a certain set of nodes of reference, called the context of the anomaly. While some methods have proposed to spot anomalies locally, globally or within a community context, the problem remain challenging due to the multi-scale composition of real networks and the heterogeneity of node metadata. Here, we propose a principled way to uncover outlier nodes simultaneously with the context with respect to which they are anomalous, at all relevant scales of the network. We characterize anomalous nodes in terms of the concentration retained for each node after smoothing specific signals localized on the vertices of the graph. Besides, we introduce a graph signal processing formulation of the Markov stability framework used in community detection, in order to find the context of anomalies. The performance of our method is assessed on synthetic and real-world attributed networks and shows superior results concerning state of the art algorithms. Finally, we show the scalability of our approach in large networks employing Chebychev polynomial approximations. △ Less

Submitted 25 November, 2019; originally announced December 2019.

Comments: Accepted paper at the 34th AAAI Conference on Artificial Intelligence (AAAI-20), New York, US. 8 pages, 5 figures

Network constraints on the mixing patterns of binary node metadata

Authors: Matteo Cinelli, Leto Peel, Antonio Iovanella, Jean-Charles Delvenne

Abstract: We consider the network constraints on the bounds of the assortativity coefficient, which measures the tendency of nodes with the same attribute values to be interconnected. The assortativity coefficient is the Pearson's correlation coefficient of node attribute values across network edges and ranges between -1 and 1. We focus here on the assortativity of binary node attributes and show that prope… ▽ More We consider the network constraints on the bounds of the assortativity coefficient, which measures the tendency of nodes with the same attribute values to be interconnected. The assortativity coefficient is the Pearson's correlation coefficient of node attribute values across network edges and ranges between -1 and 1. We focus here on the assortativity of binary node attributes and show that properties of the network, such as degree distribution and the number of nodes with each attribute value place constraints upon the attainable values of the assortativity coefficient. We explore the assortativity in three different spaces, that is, ensembles of graph configurations and node-attribute assignments that are valid for a given set of network constraints. We provide means for obtaining bounds on the extremal values of assortativity for each of these spaces. Finally, we demonstrate that under certain conditions the network constraints severely limit the maximum and minimum values of assortativity, which may present issues in how we interpret the assortativity coefficient. △ Less

Submitted 12 January, 2021; v1 submitted 13 August, 2019; originally announced August 2019.

Comments: 18 pages, 7 figures

Journal ref: Phys. Rev. E 102, 062310 (2020)

Unifying Thermodynamic Uncertainty Relations

Authors: Gianmaria Falasco, Massimiliano Esposito, Jean-Charles Delvenne

Abstract: We introduce a new technique to bound the fluctuations exhibited by a physical system, based on the Euclidean geometry of the space of observables. Through a simple unifying argument, we derive a sweeping generalization of so-called Thermodynamic Uncertainty Relations (TURs). We not only strengthen the bounds but extend their realm of applicability and in many cases prove their optimality, without… ▽ More We introduce a new technique to bound the fluctuations exhibited by a physical system, based on the Euclidean geometry of the space of observables. Through a simple unifying argument, we derive a sweeping generalization of so-called Thermodynamic Uncertainty Relations (TURs). We not only strengthen the bounds but extend their realm of applicability and in many cases prove their optimality, without resorting to large deviation theory or information-theoretic techniques. In particular, we find the best TUR based on entropy production alone and also derive a novel bound for stationary Markov processes, which surpasses previous known bounds. Our results derive from the non-invariance of the system under a symmetry which can be other than time reversal and thus open a wide new spectrum of applications. △ Less

Submitted 26 June, 2019; originally announced June 2019.

Comments: 5 pages and SI

Stochastic and Quantum Thermodynamics of Driven RLC Networks

Authors: Nahuel Freitas, Jean-Charles Delvenne, Massimiliano Esposito

Abstract: We develop a general stochastic thermodynamics of RLC electrical networks built on top of a graph-theoretical representation of the dynamics commonly used by engineers. The network is: open, as it contains resistors and current and voltage sources, nonisothermal as resistors may be at different temperatures, and driven, as circuit elements may be subjected to external parametric driving. The prope… ▽ More We develop a general stochastic thermodynamics of RLC electrical networks built on top of a graph-theoretical representation of the dynamics commonly used by engineers. The network is: open, as it contains resistors and current and voltage sources, nonisothermal as resistors may be at different temperatures, and driven, as circuit elements may be subjected to external parametric driving. The proper description of the heat dissipated in each resistor requires care within the white noise idealization as it depends on the network topology. Our theory provides the basis to design circuits-based thermal machines, as we illustrate by designing a refrigerator using a simple driven circuit. We also derive exact results for the low temperature regime in which the quantum nature of the electrical noise must be taken into account. We do so using a semiclassical approach which can be shown to coincide with a fully quantum treatment of linear circuits for which canonical quantization is possible. We use it to generalize the Landauer-Buttiker formula for energy currents to arbitrary time-dependent driving protocols. △ Less

Submitted 7 May, 2020; v1 submitted 26 June, 2019; originally announced June 2019.

Comments: Final version

Journal ref: Phys. Rev. X 10, 031005 (2020)

Unsupervised Network Embedding for Graph Visualization, Clustering and Classification

Authors: Leonardo Gutiérrez-Gómez, Jean-Charles Delvenne

Abstract: A main challenge in mining network-based data is finding effective ways to represent or encode graph structures so that it can be efficiently exploited by machine learning algorithms. Several methods have focused in network representation at node/edge or substructure level. However, many real life challenges such as time-varying, multilayer, chemical compounds and brain networks involve analysis o… ▽ More A main challenge in mining network-based data is finding effective ways to represent or encode graph structures so that it can be efficiently exploited by machine learning algorithms. Several methods have focused in network representation at node/edge or substructure level. However, many real life challenges such as time-varying, multilayer, chemical compounds and brain networks involve analysis of a family of graphs instead of single one opening additional challenges in graph comparison and representation. Traditional approaches for learning representations relies on hand-crafting specialized heuristics to extract meaningful information about the graphs, e.g statistical properties, structural features, etc. as well as engineered graph distances to quantify dissimilarity between networks. In this work we provide an unsupervised approach to learn embedding representation for a collection of graphs so that it can be used in numerous graph mining tasks. By using an unsupervised neural network approach on input graphs, we aim to capture the underlying distribution of the data in order to discriminate between different class of networks. Our method is assessed empirically on synthetic and real life datasets and evaluated in three different tasks: graph clustering, visualization and classification. Results reveal that our method outperforms well known graph distances and graph-kernels in clustering and classification tasks, being highly efficient in runtime. △ Less

Submitted 15 March, 2019; v1 submitted 25 February, 2019; originally announced March 2019.

Comments: 17 pages, 8 figures, 4 tables

Rock-Paper-Scissors Random Walks on Temporal Multilayer Networks

Authors: Martin Gueuning, Sibo Cheng, Renaud Lambiotte, Jean-Charles Delvenne

Abstract: We study diffusion on a multilayer network where the contact dynamics between the nodes is governed by a random process and where the waiting time distribution differs for edges from different layers. We study the impact on a random walk of the competition that naturally emerges between the edges of the different layers. In opposition to previous studies which have imposed a priori inter-layer com… ▽ More We study diffusion on a multilayer network where the contact dynamics between the nodes is governed by a random process and where the waiting time distribution differs for edges from different layers. We study the impact on a random walk of the competition that naturally emerges between the edges of the different layers. In opposition to previous studies which have imposed a priori inter-layer competition, the competition is here induced by the heterogeneity of the activity on the different layers. We first study the precedence relation between different edges and by extension between different layers, and show that it determines biased paths for the walker. We also discuss the emergence of cyclic, rock-paper-scissors random walks, when the precedence between layers is non-transitive. Finally, we numerically show the slowing-down effect due to the competition on a heterogeneous multilayer as the walker is likely to be trapped for a longer time either on a single layer, or on an oriented cycle . Keywords: random walks; multilayer networks; dynamical systems on networks; models of networks; simulations of networks; competition between layers. △ Less

Submitted 14 December, 2018; originally announced December 2018.

Comments: 8 pages, 5 figures

The anatomy of Reddit: An overview of academic research

Authors: Alexey N. Medvedev, Renaud Lambiotte, Jean-Charles Delvenne

Abstract: Online forums provide rich environments where users may post questions and comments about different topics. Understanding how people behave in online forums may shed light on the fundamental mechanisms by which collective thinking emerges in a group of individuals, but it has also important practical applications, for instance to improve user experience, increase engagement or automatically identi… ▽ More Online forums provide rich environments where users may post questions and comments about different topics. Understanding how people behave in online forums may shed light on the fundamental mechanisms by which collective thinking emerges in a group of individuals, but it has also important practical applications, for instance to improve user experience, increase engagement or automatically identify bullying. Importantly, the datasets generated by the activity of the users are often openly available for researchers, in contrast to other sources of data in computational social science. In this survey, we map the main research directions that arose in recent years and focus primarily on the most popular platform, Reddit. We distinguish and categorise research depending on their focus on the posts or on the users, and point to different types of methodologies to extract information from the structure and dynamics of the system. We emphasize the diversity and richness of the research in terms of questions and methods, and suggest future avenues of research. △ Less

Submitted 4 June, 2020; v1 submitted 25 October, 2018; originally announced October 2018.

Comments: 21 pages, 7 figures, 2 tables

Journal ref: In: Ghanbarnejad F., Saha Roy R., Karimi F., Delvenne JC., Mitra B. (eds) Dynamics On and Of Complex Networks III. DOOCN 2017. Springer Proceedings in Complexity. Springer, Cham

Measuring the effect of node aggregation on community detection

Authors: Yérali Gandica, Adeline Decuyper, Christophe Cloquet, Isabelle Thomas, Jean-Charles Delvenne

Abstract: Many times the nodes of a complex network, whether deliberately or not, are aggregated for technical, ethical, legal limitations or privacy reasons. A common example is the geographic position: one may uncover communities in a network of places, or of individuals identified with their typical geographical position, and then aggregate these places into larger entities, such as municipalities, thus… ▽ More Many times the nodes of a complex network, whether deliberately or not, are aggregated for technical, ethical, legal limitations or privacy reasons. A common example is the geographic position: one may uncover communities in a network of places, or of individuals identified with their typical geographical position, and then aggregate these places into larger entities, such as municipalities, thus obtaining another network. The communities found in the networks obtained at various levels of aggregation may exhibit various degrees of similarity, from full alignment to perfect independence. This is akin to the problem of ecological and atomic fallacies in statistics, or to the Modified Areal Unit Problem in geography. We identify the class of community detection algorithms most suitable to cope with node aggregation, and develop an index for aggregability, capturing to which extent the aggregation preserves the community structure. We illustrate its relevance on real-world examples (mobile phone and Twitter reply-to networks). Our main message is that any node-partitioning analysis performed on aggregated networks should be interpreted with caution, as the outcome may be strongly influenced by the level of the aggregation. △ Less

Submitted 28 March, 2020; v1 submitted 24 September, 2018; originally announced September 2018.

Comments: 12 pages, 5 figures

Journal ref: EPJ Data Sci. 9, 6 (2020)

Multi-hop assortativities for networks classification

Authors: Leonardo Gutierrez Gomez, Jean-Charles Delvenne

Abstract: Several social, medical, engineering and biological challenges rely on discovering the functionality of networks from their structure and node metadata, when it is available. For example, in chemoinformatics one might want to detect whether a molecule is toxic based on structure and atomic types, or discover the research field of a scientific collaboration network. Existing techniques rely on coun… ▽ More Several social, medical, engineering and biological challenges rely on discovering the functionality of networks from their structure and node metadata, when it is available. For example, in chemoinformatics one might want to detect whether a molecule is toxic based on structure and atomic types, or discover the research field of a scientific collaboration network. Existing techniques rely on counting or measuring structural patterns that are known to show large variations from network to network, such as the number of triangles, or the assortativity of node metadata. We introduce the concept of multi-hop assortativity, that captures the similarity of the nodes situated at the extremities of a randomly selected path of a given length. We show that multi-hop assortativity unifies various existing concepts and offers a versatile family of 'fingerprints' to characterize networks. These fingerprints allow in turn to recover the functionalities of a network, with the help of the machine learning toolbox. Our method is evaluated empirically on established social and chemoinformatic network benchmarks. Results reveal that our assortativity based features are competitive providing highly accurate results often outperforming state of the art methods for the network classification task. △ Less

Submitted 16 November, 2018; v1 submitted 14 September, 2018; originally announced September 2018.

Comments: 20 pages, 7 figures. arXiv admin note: text overlap with arXiv:1705.10817

Spectral clustering algorithms for the detection of clusters in block-cyclic and block-acyclic graphs

Authors: H. Van Lierde, T. W. S. Chow, J. -C. Delvenne

Abstract: We propose two spectral algorithms for partitioning nodes in directed graphs respectively with a cyclic and an acyclic pattern of connection between groups of nodes. Our methods are based on the computation of extremal eigenvalues of the transition matrix associated to the directed graph. The two algorithms outperform state-of-the art methods for directed graph clustering on synthetic datasets, in… ▽ More We propose two spectral algorithms for partitioning nodes in directed graphs respectively with a cyclic and an acyclic pattern of connection between groups of nodes. Our methods are based on the computation of extremal eigenvalues of the transition matrix associated to the directed graph. The two algorithms outperform state-of-the art methods for directed graph clustering on synthetic datasets, including methods based on blockmodels, bibliometric symmetrization and random walks. Our algorithms have the same space complexity as classical spectral clustering algorithms for undirected graphs and their time complexity is also linear in the number of edges in the graph. One of our methods is applied to a trophic network based on predator-prey relationships. It successfully extracts common categories of preys and predators encountered in food chains. The same method is also applied to highlight the hierarchical structure of a worldwide network of Autonomous Systems depicting business agreements between Internet Service Providers. △ Less

Submitted 2 May, 2018; originally announced May 2018.

Comments: This is the unrefereed Author's Original Version of the article. A peer-reviewed version has been accepted for publication in the Journal of Complex Networks published by Oxford University Press. The present version is not the Accepted Manuscript

Journal ref: Journal of Complex Networks, cny011 (2018)

Structured networks and coarse-grained descriptions: a dynamical perspective

Authors: Michael T. Schaub, Jean-Charles Delvenne, Renaud Lambiotte, Mauricio Barahona

Abstract: This chapter discusses the interplay between structure and dynamics in complex networks. Given a particular network with an endowed dynamics, our goal is to find partitions aligned with the dynamical process acting on top of the network. We thus aim to gain a reduced description of the system that takes into account both its structure and dynamics. In the first part, we introduce the general mathe… ▽ More This chapter discusses the interplay between structure and dynamics in complex networks. Given a particular network with an endowed dynamics, our goal is to find partitions aligned with the dynamical process acting on top of the network. We thus aim to gain a reduced description of the system that takes into account both its structure and dynamics. In the first part, we introduce the general mathematical setup for the types of dynamics we consider throughout the chapter. We provide two guiding examples, namely consensus dynamics and diffusion processes (random walks), motivating their connection to social network analysis, and provide a brief discussion on the general dynamical framework and its possible extensions. In the second part, we focus on the influence of graph structure on the dynamics taking place on the network, focusing on three concepts that allow us to gain insight into this notion. First, we describe how time scale separation can appear in the dynamics on a network as a consequence of graph structure. Second, we discuss how the presence of particular symmetries in the network give rise to invariant dynamical subspaces that can be precisely described by graph partitions. Third, we show how this dynamical viewpoint can be extended to study dynamics on networks with signed edges, which allow us to discuss connections to concepts in social network analysis, such as structural balance. In the third part, we discuss how to use dynamical processes unfolding on the network to detect meaningful network substructures. We then show how such dynamical measures can be related to seemingly different algorithm for community detection and coarse-graining proposed in the literature. We conclude with a brief summary and highlight interesting open future directions. △ Less

Submitted 17 April, 2018; originally announced April 2018.

Comments: 21 pages; 7 figures; To appear as a chapter in "Advances in Network Clustering and Blockmodeling" edited by P. Doreian, V. Batagelj & A. Ferligoj (Wiley, New York, 2018)

Journal ref: Advances in Network Clustering and Blockmodeling, Ed.P. Doreian, V. Batagelj, and A. Ferligoj John Wiley & Sons, Ltd, 2019, ch.12, pp. 333-361

Multiscale dynamical embeddings of complex networks

Authors: Michael T. Schaub, Jean-Charles Delvenne, Renaud Lambiotte, Mauricio Barahona

Abstract: Complex systems and relational data are often abstracted as dynamical processes on networks. To understand, predict and control their behavior, a crucial step is to extract reduced descriptions of such networks. Inspired by notions from Control Theory, we propose a time-dependent dynamical similarity measure between nodes, which quantifies the effect a node-input has on the network. This dynamical… ▽ More Complex systems and relational data are often abstracted as dynamical processes on networks. To understand, predict and control their behavior, a crucial step is to extract reduced descriptions of such networks. Inspired by notions from Control Theory, we propose a time-dependent dynamical similarity measure between nodes, which quantifies the effect a node-input has on the network. This dynamical similarity induces an embedding that can be employed for several analysis tasks. Here we focus on (i)~dimensionality reduction, i.e., projecting nodes onto a low dimensional space that captures dynamic similarity at different time scales, and (ii)~how to exploit our embeddings to uncover functional modules. We exemplify our ideas through case studies focusing on directed networks without strong connectivity, and signed networks. We further highlight how certain ideas from community detection can be generalized and linked to Control Theory, by using the here developed dynamical perspective. △ Less

Submitted 24 June, 2019; v1 submitted 10 April, 2018; originally announced April 2018.

Comments: 13 pages; 7 pages SI; 8 Figures

Journal ref: Phys. Rev. E 99, 062308 (2019)

Modelling structure and predicting dynamics of discussion threads in online boards

Authors: Alexey N. Medvedev, Jean-Charles Delvenne, Renaud Lambiotte

Abstract: Internet boards are platforms for online discussions about a variety of topics. On these boards, individuals may start a new thread on a specific matter, or leave comments in an existing discussion. The resulting collective process leads to the formation of `discussion trees', where nodes represent a post and comments, and an edge represents a `reply-to' relation. The structure of discussion trees… ▽ More Internet boards are platforms for online discussions about a variety of topics. On these boards, individuals may start a new thread on a specific matter, or leave comments in an existing discussion. The resulting collective process leads to the formation of `discussion trees', where nodes represent a post and comments, and an edge represents a `reply-to' relation. The structure of discussion trees has been analysed in previous works, but only from a static perspective. In this paper, we focus on their structural and dynamical properties by modelling their formation as a self-exciting Hawkes process. We first study a Reddit dataset to show that the structure of the trees resemble those produced by a Galton-Watson process with a special root offspring distribution. The dynamical aspect of the model is then used to predict future commenting activity and the final size of a discussion tree. We compare the efficiency of our approach with previous works and show its superiority for the prediction of the dynamics of discussions. △ Less

Submitted 4 June, 2020; v1 submitted 30 January, 2018; originally announced January 2018.

Comments: 16 pages (2 pages appendix incl.), 10 figures (8 in main text + 2 in appendix)

MSC Class: 90B18; 60K35; 60G55; 82C99

Journal ref: Journal of Complex Networks, Volume 7, Issue 1, February 2019, Pages 67-82

Different approaches to community detection

Authors: Martin Rosvall, Jean-Charles Delvenne, Michael T. Schaub, Renaud Lambiotte

Abstract: A precise definition of what constitutes a community in networks has remained elusive. Consequently, network scientists have compared community detection algorithms on benchmark networks with a particular form of community structure and classified them based on the mathematical techniques they employ. However, this comparison can be misleading because apparent similarities in their mathematical ma… ▽ More A precise definition of what constitutes a community in networks has remained elusive. Consequently, network scientists have compared community detection algorithms on benchmark networks with a particular form of community structure and classified them based on the mathematical techniques they employ. However, this comparison can be misleading because apparent similarities in their mathematical machinery can disguise different reasons for why we would want to employ community detection in the first place. Here we provide a focused review of these different motivations that underpin community detection. This problem-driven classification is useful in applied network science, where it is important to select an appropriate algorithm for the given purpose. Moreover, highlighting the different approaches to community detection also delineates the many lines of research and points out open directions and avenues for future research. △ Less

Submitted 18 December, 2017; originally announced December 2017.

Comments: 14 pages, 2 figures. Written as a chapter for forthcoming Advances in network clustering and blockmodeling, and based on an extended version of The many facets of community detection in complex networks, Appl. Netw. Sci. 2: 4 (2017) by the same authors

Journal ref: Advances in Network Clustering and Blockmodeling, Ed.P. Doreian, V. Batagelj, and A. Ferligoj John Wiley & Sons, Ltd, 2019, ch.4, pp. 105-119

Positive semi-definite embedding for dimensionality reduction and out-of-sample extensions

Authors: Michaël Fanuel, Antoine Aspeel, Jean-Charles Delvenne, Johan A. K. Suykens

Abstract: In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding coordinates are the eigenvectors of a positive semi-definite kernel obtained as the solution of an infinite dimensional analogue of a semi-definite program. This embed… ▽ More In machine learning or statistics, it is often desirable to reduce the dimensionality of a sample of data points in a high dimensional space $\mathbb{R}^d$. This paper introduces a dimensionality reduction method where the embedding coordinates are the eigenvectors of a positive semi-definite kernel obtained as the solution of an infinite dimensional analogue of a semi-definite program. This embedding is adaptive and non-linear. We discuss this problem both with weak and strong smoothness assumptions about the learned kernel. A main feature of our approach is the existence of an out-of-sample extension formula of the embedding coordinates in both cases. This extrapolation formula yields an extension of the kernel matrix to a data-dependent Mercer kernel function. Our empirical results indicate that this embedding method is more robust with respect to the influence of outliers, compared with a spectral embedding method. △ Less

Submitted 27 November, 2021; v1 submitted 20 November, 2017; originally announced November 2017.

Comments: 26 pages, 8 figures. Additional results for the kernelized problem and more numerical simulations

Entrograms and coarse graining of dynamics on complex networks

Authors: Mauro Faccin, Michael T. Schaub, Jean-Charles Delvenne

Abstract: Using an information theoretic point of view, we investigate how a dynamics acting on a network can be coarse grained through the use of graph partitions. Specifically, we are interested in how aggregating the state space of a Markov process according to a partition impacts on the thus obtained lower-dimensional dynamics. We highlight that for a dynamics on a particular graph there may be multiple… ▽ More Using an information theoretic point of view, we investigate how a dynamics acting on a network can be coarse grained through the use of graph partitions. Specifically, we are interested in how aggregating the state space of a Markov process according to a partition impacts on the thus obtained lower-dimensional dynamics. We highlight that for a dynamics on a particular graph there may be multiple coarse grained descriptions that capture different, incomparable features of the original process. For instance, a coarse graining induced by one partition may be commensurate with a time-scale separation in the dynamics, while another coarse graining may correspond to a different lower-dimensional dynamics that preserves the Markov property of the original process. Taking inspiration from the literature of Computational Mechanics, we find that a convenient tool to summarise and visualise such dynamical properties of a coarse grained model (partition) is the entrogram. The entrogram gathers certain information-theoretic measures, which quantify how information flows across time steps. These information theoretic quantities include the entropy rate, as well as a measure for the memory contained in the process, i.e., how well the dynamics can be approximated by a first order Markov process. We use the entrogram to investigate how specific macro-scale connection patterns in the state-space transition graph of the original dynamics result in desirable properties of coarse grained descriptions. We thereby provide a fresh perspective on the interplay between structure and dynamics in networks, and the process of partitioning from an information theoretic perspective. We focus on networks that may be approximated by both a core-periphery or a clustered organization, and highlight that each of these coarse grained descriptions can capture different aspects of a Markov process acting on the network. △ Less

Submitted 6 November, 2017; originally announced November 2017.

Comments: 17 pages, 6 figues

MSC Class: 05C82

Journal ref: Journal of Complex Networks, cnx055, 2017

Multiscale mixing patterns in networks

Authors: Leto Peel, Jean-Charles Delvenne, Renaud Lambiotte

Abstract: Assortative mixing in networks is the tendency for nodes with the same attributes, or metadata, to link to each other. It is a property often found in social networks manifesting as a higher tendency of links occurring between people with the same age, race, or political belief. Quantifying the level of assortativity or disassortativity (the preference of linking to nodes with different attributes… ▽ More Assortative mixing in networks is the tendency for nodes with the same attributes, or metadata, to link to each other. It is a property often found in social networks manifesting as a higher tendency of links occurring between people with the same age, race, or political belief. Quantifying the level of assortativity or disassortativity (the preference of linking to nodes with different attributes) can shed light on the factors involved in the formation of links and contagion processes in complex networks. It is common practice to measure the level of assortativity according to the assortativity coefficient, or modularity in the case of discrete-valued metadata. This global value is the average level of assortativity across the network and may not be a representative statistic when mixing patterns are heterogeneous. For example, a social network spanning the globe may exhibit local differences in mixing patterns as a consequence of differences in cultural norms. Here, we introduce an approach to localise this global measure so that we can describe the assortativity, across multiple scales, at the node level. Consequently we are able to capture and qualitatively evaluate the distribution of mixing patterns in the network. We find that for many real-world networks the distribution of assortativity is skewed, overdispersed and multimodal. Our method provides a clearer lens through which we can more closely examine mixing patterns in networks. △ Less

Submitted 18 April, 2018; v1 submitted 3 August, 2017; originally announced August 2017.

Comments: 11 pages, 7 figures

Journal ref: Proceedings of the National Academy of Sciences USA 115(16) 4057-4062, 2018

Dynamics Based Features For Graph Classification

Authors: Leonardo Gutierrez Gomez, Benjamin Chiem, Jean-Charles Delvenne

Abstract: Numerous social, medical, engineering and biological challenges can be framed as graph-based learning tasks. Here, we propose a new feature based approach to network classification. We show how dynamics on a network can be useful to reveal patterns about the organization of the components of the underlying graph where the process takes place. We define generalized assortativities on networks and u… ▽ More Numerous social, medical, engineering and biological challenges can be framed as graph-based learning tasks. Here, we propose a new feature based approach to network classification. We show how dynamics on a network can be useful to reveal patterns about the organization of the components of the underlying graph where the process takes place. We define generalized assortativities on networks and use them as generalized features across multiple time scales. These features turn out to be suitable signatures for discriminating between different classes of networks. Our method is evaluated empirically on established network benchmarks. We also introduce a new dataset of human brain networks (connectomes) and use it to evaluate our method. Results reveal that our dynamics based features are competitive and often outperform state of the art accuracies. △ Less

Submitted 30 May, 2017; originally announced May 2017.

Comments: This paper is under review as a conference paper at ECML-PKDD 2017

Random Multi-Hopper Model. Super-Fast Random Walks on Graphs

Authors: Ernesto Estrada, Jean-Charles Delvenne, Naomichi Hatano, José L. Mateos, Ralf Metzler, Alejandro P. Riascos, Michael T. Schaub

Abstract: We develop a model for a random walker with long-range hops on general graphs. This random multi-hopper jumps from a node to any other node in the graph with a probability that decays as a function of the shortest-path distance between the two nodes. We consider here two decaying functions in the form of the Laplace and Mellin transforms of the shortest-path distances. Remarkably, when the paramet… ▽ More We develop a model for a random walker with long-range hops on general graphs. This random multi-hopper jumps from a node to any other node in the graph with a probability that decays as a function of the shortest-path distance between the two nodes. We consider here two decaying functions in the form of the Laplace and Mellin transforms of the shortest-path distances. Remarkably, when the parameters of these transforms approach zero asymptotically, the multi-hopper's hitting times between any two nodes in the graph converge to their minimum possible value, given by the hitting times of a normal random walker on a complete graph. Stated differently, for small parameter values the multi-hopper explores a general graph as fast as possible when compared to a random walker on a full graph. Using computational experiments we show that compared to the normal random walker, the multi-hopper indeed explores graphs with clusters or skewed degree distributions more efficiently for a large parameter range. We provide further computational evidence of the speed-up attained by the random multi-hopper model with respect to the normal random walker by studying deterministic, random and real-world networks. △ Less

Submitted 17 October, 2020; v1 submitted 24 December, 2016; originally announced December 2016.

Comments: 22 pages, 9 figures

Journal ref: Journal of Complex Networks, Volume 6, Issue 3, July 2018, Pages 382-403

The many facets of community detection in complex networks

Authors: Michael T. Schaub, Jean-Charles Delvenne, Martin Rosvall, Renaud Lambiotte

Abstract: Community detection, the decomposition of a graph into essential building blocks, has been a core research topic in network science over the past years. Since a precise notion of what constitutes a community has remained evasive, community detection algorithms have often been compared on benchmark graphs with a particular form of assortative community structure and classified based on the mathemat… ▽ More Community detection, the decomposition of a graph into essential building blocks, has been a core research topic in network science over the past years. Since a precise notion of what constitutes a community has remained evasive, community detection algorithms have often been compared on benchmark graphs with a particular form of assortative community structure and classified based on the mathematical techniques they employ. However, this comparison can be misleading because apparent similarities in their mathematical machinery can disguise different goals and reasons for why we want to employ community detection in the first place. Here we provide a focused review of these different motivations that underpin community detection. This problem-driven classification is useful in applied network science, where it is important to select an appropriate algorithm for the given purpose. Moreover, highlighting the different facets of community detection also delineates the many lines of research and points out open directions and avenues for future research. △ Less

Submitted 15 February, 2017; v1 submitted 23 November, 2016; originally announced November 2016.

Comments: 8 Pages, 1 Figure

Journal ref: Schaub, M.T., Delvenne, JC., Rosvall, M. et al. Appl Netw Sci (2017) 2: 4

Clean up or mess up: the effect of sampling biases on measurements of degree distributions in mobile phone datasets

Authors: Adeline Decuyper, Arnaud Browet, Vincent Traag, Vincent D. Blondel, Jean-Charles Delvenne

Abstract: Mobile phone data have been extensively used in the recent years to study social behavior. However, most of these studies are based on only partial data whose coverage is limited both in space and time. In this paper, we point to an observation that the bias due to the limited coverage in time may have an important influence on the results of the analyses performed. In particular, we observe signi… ▽ More Mobile phone data have been extensively used in the recent years to study social behavior. However, most of these studies are based on only partial data whose coverage is limited both in space and time. In this paper, we point to an observation that the bias due to the limited coverage in time may have an important influence on the results of the analyses performed. In particular, we observe significant differences, both qualitatively and quantitatively, in the degree distribution of the network, depending on the way the dataset is pre-processed and we present a possible explanation for the emergence of Double Pareto LogNormal (DPLN) degree distributions in temporal data. △ Less

Submitted 29 September, 2016; originally announced September 2016.

Graph partitions and cluster synchronization in networks of oscillators

Authors: Michael T. Schaub, Neave O'Clery, Yazan N. Billeh, Jean-Charles Delvenne, Renaud Lambiotte, Mauricio Barahona

Abstract: Synchronization over networks depends strongly on the structure of the coupling between the oscillators. When the coupling presents certain regularities, the dynamics can be coarse-grained into clusters by means of External Equitable Partitions of the network graph and their associated quotient graphs. We exploit this graph-theoretical concept to study the phenomenon of cluster synchronization, in… ▽ More Synchronization over networks depends strongly on the structure of the coupling between the oscillators. When the coupling presents certain regularities, the dynamics can be coarse-grained into clusters by means of External Equitable Partitions of the network graph and their associated quotient graphs. We exploit this graph-theoretical concept to study the phenomenon of cluster synchronization, in which different groups of nodes converge to distinct behaviors. We derive conditions and properties of networks in which such clustered behavior emerges, and show that the ensuing dynamics is the result of the localization of the eigenvectors of the associated graph Laplacians linked to the existence of invariant subspaces. The framework is applied to both linear and non-linear models, first for the standard case of networks with positive edges, before being generalized to the case of signed networks with both positive and negative interactions. We illustrate our results with examples of both signed and unsigned graphs for consensus dynamics and for partial synchronization of oscillator networks under the master stability function as well as Kuramoto oscillators. △ Less

Submitted 16 August, 2016; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 16 pages, 8 Figures

Journal ref: Chaos, 26, 094821 (2016)

Sparse matrix factorizations for fast linear solvers with application to Laplacian systems

Authors: Michael T. Schaub, Maguy Trefois, Paul Van Dooren, Jean-Charles Delvenne

Abstract: In solving a linear system with iterative methods, one is usually confronted with the dilemma of having to choose between cheap, inefficient iterates over sparse search directions (e.g., coordinate descent), or expensive iterates in well-chosen search directions (e.g., conjugate gradients). In this paper, we propose to interpolate between these two extremes, and show how to perform cheap iteration… ▽ More In solving a linear system with iterative methods, one is usually confronted with the dilemma of having to choose between cheap, inefficient iterates over sparse search directions (e.g., coordinate descent), or expensive iterates in well-chosen search directions (e.g., conjugate gradients). In this paper, we propose to interpolate between these two extremes, and show how to perform cheap iterations along non-sparse search directions, provided that these directions can be extracted from a new kind of sparse factorization. For example, if the search directions are the columns of a hierarchical matrix, then the cost of each iteration is typically logarithmic in the number of variables. Using some graph-theoretical results on low-stretch spanning trees, we deduce as a special case a nearly-linear time algorithm to approximate the minimal norm solution of a linear system $Bx= b$ where $B$ is the incidence matrix of a graph. We thereby can connect our results to recently proposed nearly-linear time solvers for Laplacian systems, which emerge here as a particular application of our sparse matrix factorization. △ Less

Submitted 1 December, 2016; v1 submitted 30 May, 2016; originally announced May 2016.

Comments: 20 pages, 2 figures

Journal ref: SIAM J. Matrix Anal. Appl., 38(2), 505-529, 2017

Sensitivity analysis of a branching process evolving on a network with application in epidemiology

Authors: Sophie Hautphenne, Gautier Krings, Jean-Charles Delvenne, Vincent D. Blondel

Abstract: We perform an analytical sensitivity analysis for a model of a continuous-time branching process evolving on a fixed network. This allows us to determine the relative importance of the model parameters to the growth of the population on the network. We then apply our results to the early stages of an influenza-like epidemic spreading among a set of cities connected by air routes in the United Stat… ▽ More We perform an analytical sensitivity analysis for a model of a continuous-time branching process evolving on a fixed network. This allows us to determine the relative importance of the model parameters to the growth of the population on the network. We then apply our results to the early stages of an influenza-like epidemic spreading among a set of cities connected by air routes in the United States. We also consider vaccination and analyze the sensitivity of the total size of the epidemic with respect to the fraction of vaccinated people. Our analysis shows that the epidemic growth is more sensitive with respect to transmission rates within cities than travel rates between cities. More generally, we highlight the fact that branching processes offer a powerful stochastic modeling tool with analytical formulas for sensitivity which are easy to use in practice. △ Less

Submitted 6 September, 2015; originally announced September 2015.

Comments: 17 pages (30 with SI), Journal of Complex Networks, Feb 2015

Imperfect spreading on temporal networks

Authors: Martin Gueuning, Jean-Charles Delvenne, Renaud Lambiotte

Abstract: We study spreading on networks where the contact dynamics between the nodes is governed by a random process and where the inter-contact time distribution may differ from the exponential. We consider a process of imperfect spreading, where transmission is successful with a determined probability at each contact. We first derive an expression for the inter-success time distribution, determining the… ▽ More We study spreading on networks where the contact dynamics between the nodes is governed by a random process and where the inter-contact time distribution may differ from the exponential. We consider a process of imperfect spreading, where transmission is successful with a determined probability at each contact. We first derive an expression for the inter-success time distribution, determining the speed of the propagation, and then focus on a problem related to epidemic spreading, by estimating the epidemic threshold in a system where nodes remain infectious during a finite, random period of time. Finally, we discuss the implications of our work to design an efficient strategy to enhance spreading on temporal networks. △ Less

Submitted 6 July, 2016; v1 submitted 17 August, 2015; originally announced August 2015.

Comments: 5 pages

Journal ref: The European Physical Journal B, 88:282 (2015)

Gradient and Passive Circuit Structure in a Class of Non-linear Dynamics on a Graph

Authors: Herbert Mangesius, Jean-Charles Delvenne, Sanjoy K. Mitter

Abstract: We consider a class of non-linear dynamics on a graph that contains and generalizes various models from network systems and control and study convergence to uniform agreement states using gradient methods. In particular, under the assumption of detailed balance, we provide a method to formulate the governing ODE system in gradient descent form of sum-separable energy functions, which thus represen… ▽ More We consider a class of non-linear dynamics on a graph that contains and generalizes various models from network systems and control and study convergence to uniform agreement states using gradient methods. In particular, under the assumption of detailed balance, we provide a method to formulate the governing ODE system in gradient descent form of sum-separable energy functions, which thus represent a class of Lyapunov functions; this class coincides with Csiszár's information divergences. Our approach bases on a transformation of the original problem to a mass-preserving transport problem and it reflects a little-noticed general structure result for passive network synthesis obtained by B.D.O. Anderson and P.J. Moylan in 1975. The proposed gradient formulation extends known gradient results in dynamical systems obtained recently by M. Erbar and J. Maas in the context of porous medium equations. Furthermore, we exhibit a novel relationship between inhomogeneous Markov chains and passive non-linear circuits through gradient systems, and show that passivity of resistor elements is equivalent to strict convexity of sum-separable stored energy. Eventually, we discuss our results at the intersection of Markov chains and network systems under sinusoidal coupling. △ Less

Submitted 9 August, 2016; v1 submitted 2 August, 2015; originally announced August 2015.

Detecting communities using asymptotical Surprise

Authors: V. A. Traag, R. Aldecoa, J-C. Delvenne

Abstract: Nodes in real-world networks are repeatedly observed to form dense clusters, often referred to as communities. Methods to detect these groups of nodes usually maximize an objective function, which implicitly contains the definition of a community. We here analyze a recently proposed measure called surprise, which assesses the quality of the partition of a network into communities. In its current f… ▽ More Nodes in real-world networks are repeatedly observed to form dense clusters, often referred to as communities. Methods to detect these groups of nodes usually maximize an objective function, which implicitly contains the definition of a community. We here analyze a recently proposed measure called surprise, which assesses the quality of the partition of a network into communities. In its current form, the formulation of surprise is rather difficult to analyze. We here therefore develop an accurate asymptotic approximation. This allows for the development of an efficient algorithm for optimizing surprise. Incidentally, this leads to a straightforward extension of surprise to weighted graphs. Additionally, the approximation makes it possible to analyze surprise more closely and compare it to other methods, especially modularity. We show that surprise is (nearly) unaffected by the well known resolution limit, a particular problem for modularity. However, surprise may tend to overestimate the number of communities, whereas they may be underestimated by modularity. In short, surprise works well in the limit of many small communities, whereas modularity works better in the limit of few large communities. In this sense, surprise is more discriminative than modularity, and may find communities where modularity fails to discern any structure. △ Less

Submitted 9 September, 2015; v1 submitted 2 March, 2015; originally announced March 2015.

Journal ref: Phys. Rev. E 92, 022816 (2015)

Random Walks, Markov Processes and the Multiscale Modular Organization of Complex Networks

Authors: Renaud Lambiotte, Jean-Charles Delvenne, Mauricio Barahona

Abstract: Most methods proposed to uncover communities in complex networks rely on combinatorial graph properties. Usually an edge-counting quality function, such as modularity, is optimized over all partitions of the graph compared against a null random graph model. Here we introduce a systematic dynamical framework to design and analyze a wide variety of quality functions for community detection. The qual… ▽ More Most methods proposed to uncover communities in complex networks rely on combinatorial graph properties. Usually an edge-counting quality function, such as modularity, is optimized over all partitions of the graph compared against a null random graph model. Here we introduce a systematic dynamical framework to design and analyze a wide variety of quality functions for community detection. The quality of a partition is measured by its Markov Stability, a time-parametrized function defined in terms of the statistical properties of a Markov process taking place on the graph. The Markov process provides a dynamical sweeping across all scales in the graph, and the time scale is an intrinsic parameter that uncovers communities at different resolutions. This dynamic-based community detection leads to a compound optimization, which favours communities of comparable centrality (as defined by the stationary distribution), and provides a unifying framework for spectral algorithms, as well as different heuristics for community detection, including versions of modularity and Potts model. Our dynamic framework creates a systematic link between different stochastic dynamics and their corresponding notions of optimal communities under distinct (node and edge) centralities. We show that the Markov Stability can be computed efficiently to find multi-scale community structure in large networks. △ Less

Submitted 15 February, 2015; originally announced February 2015.

Comments: Extended version of arXiv:0812.1770, 'Laplacian Dynamics and Multiscale Modular Structure in Networks', by the same authors, with new content; published in Transactions on Network Science and Engineering; 16 pages; 11 figs

Journal ref: IEEE Transactions on Network Science and Engineering (Volume:1 , Issue: 2 ) pp 76-90, 2015

The robustness of democratic consensus

Authors: Fabio Fagnani, Jean-Charles Delvenne

Abstract: In linear models of consensus dynamics, the state of the various agents converges to a value which is a convex combination of the agents' initial states. We call it democratic if in the large scale limit (number of agents going to infinity) the vector of convex weights converges to 0 uniformly. Democracy is a relevant property which naturally shows up when we deal with opinion dynamic models and… ▽ More In linear models of consensus dynamics, the state of the various agents converges to a value which is a convex combination of the agents' initial states. We call it democratic if in the large scale limit (number of agents going to infinity) the vector of convex weights converges to 0 uniformly. Democracy is a relevant property which naturally shows up when we deal with opinion dynamic models and cooperative algorithms such as consensus over a network: it says that each agent's measure/opinion is going to play a negligeable role in the asymptotic behavior of the global system. It can be seen as a relaxation of average consensus, where all agents have exactly the same weight in the final value, which becomes negligible for a large number of agents. △ Less

Submitted 14 February, 2015; originally announced February 2015.

Comments: 13 pages, 2 figs

Journal ref: The robustness of democratic consensus, Automatica, Volume 52, February 2015, Pages 232-241

On Lyapunov functions and gradient flow structures in linear consensus systems

Authors: Herbert Mangesius, Jean-Charles Delvenne

Abstract: Quadratic Lyapunov functions are prevalent in stability analysis of linear consensus systems. In this paper we show that weighted sums of convex functions of the different coordinates are Lyapunov functions for irreducible consensus systems. We introduce a particular class of additive convex Lyapunov functions that includes as particular instances the stored electric energy in RC circuits, Kullbac… ▽ More Quadratic Lyapunov functions are prevalent in stability analysis of linear consensus systems. In this paper we show that weighted sums of convex functions of the different coordinates are Lyapunov functions for irreducible consensus systems. We introduce a particular class of additive convex Lyapunov functions that includes as particular instances the stored electric energy in RC circuits, Kullback-Leiber's information divergence between two probability measures, and Gibbs free energy in chemical reaction networks. On that basis we establish a general gradient formalism that allows to represent linear symmetric consensus dynamics as a gradient descent dynamics of any additive convex Lyapunov function, for a suitable choice of local scalar product. This result generalizes the well-known Euclidean gradient structures of consensus to general Riemannian ones. We also find natural non-linear consensus dynamics differing only from linearity by a different Riemannian structure, sharing a same Lyapunov function. We also see how information-theoretic Lyapunov functions, common in Markov chain theory, generate linear consensus through an appropriate gradient descent. From this unified perspective we hope to open avenues for the study of convergence for linear and non-linear consensus alike. △ Less

Submitted 7 January, 2015; v1 submitted 21 December, 2014; originally announced December 2014.

Improved bound on the worst case complexity of Policy Iteration

Authors: Romain Hollanders, Balázs Gerencsér, Jean-Charles Delvenne, Raphaël M. Jungers

Abstract: Solving Markov Decision Processes (MDPs) is a recurrent task in engineering. Even though it is known that solutions for minimizing the infinite horizon expected reward can be found in polynomial time using Linear Programming techniques, iterative methods like the Policy Iteration algorithm (PI) remain usually the most efficient in practice. This method is guaranteed to converge in a finite number… ▽ More Solving Markov Decision Processes (MDPs) is a recurrent task in engineering. Even though it is known that solutions for minimizing the infinite horizon expected reward can be found in polynomial time using Linear Programming techniques, iterative methods like the Policy Iteration algorithm (PI) remain usually the most efficient in practice. This method is guaranteed to converge in a finite number of steps. Unfortunately, it is known that it may require an exponential number of steps in the size of the problem to converge. On the other hand, many open questions remain considering the actual worst case complexity. In this work, we provide the first improvement over the fifteen years old upper bound from Mansour & Singh (1999) by showing that PI requires at most k/(k-1)*k^n/n + o(k^n/n) iterations to converge, where n is the number of states of the MDP and k is the maximum number of actions per state. Perhaps more importantly, we also show that this bound is optimal for an important relaxation of the problem. △ Less

Submitted 28 October, 2014; originally announced October 2014.

Comments: 11 pages, 1 figure, submitted to a journal

Network entropy and data rates required for networked control

Authors: Christoph Kawan, Jean-Charles Delvenne

Abstract: We consider the problem of making a set of states invariant for a network of controlled systems. We assume that the subsystems, initially uncoupled, must be interconnected through controllers to be designed with a constraint on the data rate obtained by every subsystem from all the other subsystems. We introduce the notion of subsystem invariance entropy, which is a measure for the smallest data r… ▽ More We consider the problem of making a set of states invariant for a network of controlled systems. We assume that the subsystems, initially uncoupled, must be interconnected through controllers to be designed with a constraint on the data rate obtained by every subsystem from all the other subsystems. We introduce the notion of subsystem invariance entropy, which is a measure for the smallest data rate arriving at a fixed subsystem, above which the overall system is able to achieve the control goal. Moreover, we associate to a network of n subsystems a closed convex set of R^n encompassing all possible combinations of data rates within the network that guarantee the existence of corresponding feedback strategies for making a given set invariant. The extremal points of this convex set can be regarded as Pareto-optimal data rates for the control problem, expressing a trade-off between the data rates required by different systems. We characterize these quantities for linear systems, and for synchronization of chaos. △ Less

Submitted 21 September, 2014; originally announced September 2014.

MSC Class: 93C10; 93C55; 94A17

A complexity analysis of Policy Iteration through combinatorial matrices arising from Unique Sink Orientations

Authors: Romain Hollanders, Balázs Gerencsér, Jean-Charles Delvenne, Raphaël M. Jungers

Abstract: Unique Sink Orientations (USOs) are an appealing abstraction of several major optimization problems of applied mathematics such as for instance Linear Programming (LP), Markov Decision Processes (MDPs) or 2-player Turn Based Stochastic Games (2TBSGs). A polynomial time algorithm to find the sink of a USO would translate into a strongly polynomial time algorithm to solve the aforementioned problems… ▽ More Unique Sink Orientations (USOs) are an appealing abstraction of several major optimization problems of applied mathematics such as for instance Linear Programming (LP), Markov Decision Processes (MDPs) or 2-player Turn Based Stochastic Games (2TBSGs). A polynomial time algorithm to find the sink of a USO would translate into a strongly polynomial time algorithm to solve the aforementioned problems---a major quest for all three cases. In addition, we may translate MDPs and 2TBSGs into the problem of finding the sink of an acyclic USO of a cube, which can be done using the well-known Policy Iteration algorithm (PI). The study of its complexity is the object of this work. Despite its exponential worst case complexity, the principle of PI is a powerful source of inspiration for other methods. As our first contribution, we disprove Hansen and Zwick's conjecture claiming that the number of steps of PI should follow the Fibonacci sequence in the worst case. Our analysis relies on a new combinatorial formulation of the problem---the so-called Order-Regularity formulation (OR). Then, for our second contribution, we (exponentially) improve the $Ωおめが(1.4142^n)$ lower bound on the number of steps of PI from Schurr and Szabó in the case of the OR formulation and obtain an $Ωおめが(1.4269^n)$ bound. △ Less

Submitted 9 January, 2015; v1 submitted 16 July, 2014; originally announced July 2014.

Comments: 21 pages, 6 colored figures, submitted to a journal