Extreme event quantification in dynamical systems with random components

G. Dematteis, T. Grafke, and E. Vanden-Eijnden, J. Uncertainty Quantification 7 (3), (2019), 1029

Abstract

A central problem in uncertainty quantification is how to characterize the impact that our incomplete knowledge about models has on the predictions we make from them. This question naturally lends itself to a probabilistic formulation, by making the unknown model parameters random with given statistics. Here this approach is used in concert with tools from large deviation theory (LDT) and optimal control to estimate the probability that some observables in a dynamical system go above a large threshold after some time, given the prior statistical information about the system's parameters and/or its initial conditions. Specifically, it is established under which conditions such extreme events occur in a predictable way, as the minimizer of the LDT action functional. It is also shown how this minimization can be numerically performed in an efficient way using tools from optimal control. These findings are illustrated on the examples of a rod with random elasticity pulled by a time-dependent force, and the nonlinear Schrödinger equation (NLSE) with random initial conditions.


doi:10.1137/18M1211003

arXiv

Numerical computation of rare events via large deviation theory

T. Grafke, and E. Vanden-Eijnden, Chaos 29 (2019), 063118

Abstract

An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and implementation trade-offs. Generalizations, extensions, and improvements of the minimum action methods are proposed. These algorithms are tested on example problems which illustrate several common difficulties which arise e.g. when the forcing is degenerate or multiplicative, or the systems are infinite-dimensional. Generalizations to processes driven by non-Gaussian noises or random initial data and parameters are also discussed, along with the connection between the LDT-based approach reviewed here and other methods, such as stochastic field theory and optimal control. Finally, the integration of this approach in importance sampling methods using e.g. genealogical algorithms is explored.


doi:10.1063/1.5084025

arXiv

String Method for Generalized Gradient Flows: Computation of Rare Events in Reversible Stochastic Processes

T. Grafke, J. Stat. Mech 2019/4 (2019) 043206

Abstract

Rare transitions in stochastic processes often can be rigorously described via an underlying large deviation principle. Recent breakthroughs in the classification of reversible stochastic processes as gradient flows have led to a connection of large deviation principles to a generalized gradient structure. Here, we show that, as a consequence, metastable transitions in these reversible processes can be interpreted as heteroclinic orbits of the generalized gradient flow. As a consequence, this suggests a numerical algorithm to compute the transition trajectories in configuration space efficiently, based on the string method traditionally restricted only to gradient diffusions.


doi:10.1088/1742-5468/ab11db

arXiv

Rogue Waves and Large Deviations in Deep Sea

G. Dematteis, T. Grafke, and E. Vanden-Eijnden, Proc. Natl. Acad. Sci., 115 (2018), 855-860

Abstract

The appearance of rogue waves in deep sea is investigated using the modified nonlinear Schrödinger (MNLS) equation with random initial conditions that are assumed to be Gaussian distributed, with a spectrum approximating the JONSWAP spectrum obtained from observations of the North Sea. It is shown that by supplementing the incomplete information contained in the JONSWAP spectrum with the MNLS dynamics one can reliably estimate the probability distribution of the sea surface elevation far in the tail at later times. Our results indicate that rogue waves occur when the system hit small pockets of wave configurations hidden in the core of their distribution that trigger large disturbances of the surface height via modulational instability. The rogue wave precursors in these pockets are wave patterns of regular height but with a very specific shape that is identified explicitly, thereby allowing for early detection. The method proposed here builds on tools from large deviation theory that reduce the calculation of the most likely rogue wave precursors to an optimization problem that can be solved efficiently.


doi:10.1073/pnas.1710670115

arXiv

Spatiotemporal Self-Organization of Fluctuating Bacterial Colonies

T. Grafke, M. Cates, and E. Vanden-Eijnden, Phys. Rev. Lett., 119 (2017), 188003

Abstract

We model an enclosed system of bacteria, whose motility-induced phase separation is coupled to slow population dynamics. Without noise, the system shows both static phase separation and a limit cycle, in which a rising global population causes a dense bacterial colony to form, which then declines by local cell death, before dispersing to re-initiate the cycle. Adding fluctuations, we find that static colonies are now metastable, moving between spatial locations via rare and strongly nonequilibrium pathways, whereas the limit cycle becomes quasi-periodic such that after each redispersion event the next colony forms in a random location. These results, which resemble some aspects of the biofilm-planktonic life cycle, can be explained by combining tools from large deviation theory with a bifurcation analysis in which the global population density plays the role of control parameter.


doi:10.1103/PhysRevLett.119.188003

arXiv

Non-equilibrium transitions in multiscale systems with a bifurcating slow manifold

T. Grafke, and E. Vanden-Eijnden, J. Stat. Mech 2017/9 (2017) 093208

Abstract

Noise-induced transitions between metastable fixed points in systems evolving on multiple time scales are analyzed in situations where the time scale separation gives rise to a slow manifold with bifurcation. This analysis is performed within the realm of large deviation theory. It is shown that these non-equilibrium transitions make use of a reaction channel created by the bifurcation structure of the slow manifold, leading to vastly increased transition rates. Several examples are used to illustrate these findings, including an insect outbreak model, a system modeling phase separation in the presence of evaporation, and a system modeling transitions in active matter self-assembly. The last example involves a spatially extended system modeled by a stochastic partial differential equation.


doi:10.1088/1742-5468/aa85cb

arXiv

Long Term Effects of Small Random Perturbations on Dynamical Systems: Theoretical and Computational Tools

T. Grafke, T. Schäfer, and E. Vanden-Eijnden, Fields Institute Communications, In: Recent Progress and Modern Challenges in Applied Mathematics, Modeling and Computational Science (Springer, New York, NY) (2017)

Abstract

Small random perturbations may have a dramatic impact on the long time evolution of dynamical systems, and large deviation theory is often the right theoretical framework to understand these effects. At the core of the theory lies the minimization of an action functional, which in many cases of interest has to be computed by numerical means. Here we review the theoretical and computational aspects behind these calculations, and propose an algorithm that simplifies the geometric minimum action method introduced in [M. Heymann and E. Vanden-Eijnden, CPAM Vol. LXI, 1052–1117 (2008)] to minimize the action in the space of arc-length parametrized curves. We then illustrate this algorithm's capabilities by applying it to various examples from material sciences, fluid dynamics, atmosphere/ocean sciences, and reaction kinetics. In terms of models, these examples involve stochastic (ordinary or partial) differential equations with multiplicative or degenerate noise, Markov jump processes, and systems with fast and slow degrees of freedom, which all violate detailed balance, so that simpler computational methods are not applicable.


doi:10.1007/978-1-4939-6969-2_2

arXiv

Metastability in Active Matter: Transitions between Colony Patterns in Reproducing Motile Microorganisms

Summary: Active materials can self-organize in many more ways than their equilibrium counterparts. For example, self-propelled particles whose velocity decreases with their density can display motility-induced phase separation (MIPS), a phenomenon building on a positive feedback loop in which patterns emerge in locations where the particles slow down. Here, we investigate the effects of intrinsic fluctuations in the system's dynamics on MIPS. We show that these fluctuations can lead to transitions between metastable patterns. The pathway and rate of these transitions is analyzed within the realm of large deviation theory, and they are shown to proceed in a very different way than one would predict from arguments based on detailed-balance and microscopic reversibility.

Introduction

Bacteria show complex collective behaviour. For example, bacteria such as E. Coli

  • are capable of active propulsion, i.e. have a free-swimming (planktonic) stage.
  • hey are capable of sensing their environment through quorum sensing, density-dependent gene regulation.
  • They stick to surface to form biofilms, high density colonies.
  • They exhibit cyclic/time-periodic behaviour: Biofilm formation, maturation, dispersion, planktonic stage.

The goal of this project is as follows:

Main Problem: Is it possible to describe similarly complex life-cycles as emergent behaviour of a large number of simple individual agents subject to a small number of collective rules?

Continuum description of motile bacteria

We model the motion of motile reproducing microorganisms with simple behavioural rules. The self-propulsion is modelled as active Brownian motion. For position $X\in\Omega\subset\mathbb{R}^d$, direction $\hat n \in S^{d-1}$, and location dependent swim speed $v(X)\in\mathbb{R}$

$$\dot X = v(X) \hat{n}\,,$$ $$d\hat n = \tau^{-1/2} P\circ dW\,,\qquad P=\textrm{Id} - \hat n \hat n^T$$

The direction vector diffuses on $S^{d-1}$ with tumbling rate $\tau^{-1}$. The fast tumlbing limit $\tau\to0$ yields Brownian motion

$$ dX = \sqrt{2 D(X)} \circ dW $$

with density dependend diffusivity $D(x) = v^2(x)$. Now consider $N$ such particles with position $X_i, i\in{1,\dots,N}$. To model quorum sensing, introduce scale $\delta$ over which particles feel each other's influence,

$$dX_i = \sqrt{2 D(\rho_{N,\delta}(t,X_i))}\circ dW_i$$

with

$$\rho_{N,\delta}(t,x) = \int_\Omega \phi_\delta(x-y)\rho_N(t,y)\,dy,\qquad \rho_N(t,x) = \frac1N \sum_{j=1}^N \delta(x-X_j(t))$$

In the limit $N\to\infty$, through a Deans-type argument, this yields a closed integro-differential equation for $\rho_N\to\rho$,

$$\partial_t \rho = \nabla\cdot(D(\rho_\delta) \nabla\rho +\tfrac12 D'(\rho_\delta)\nabla \rho_\delta),\qquad \rho_\delta(t,x) = \int_\Omega \phi_\delta(x-y)\rho(t,x) \,dy$$

in the sense that $$\forall\ \varepsilon,T>0:\quad \lim_{N\to\infty} \mathcal P\Big(\sup_{0\le t\le T}\Big| \frac1N \sum_{j=1}^N f(X_j(t))-\int_\Omega \rho(t,x) f(x)\,dx \Big| >\varepsilon \Big)=0$$

To make this model closed in $\rho(t,x)$, consider $D(\rho)=D_0 e^{-\rho}$, and expand in $\delta\ll1$,

$$\rho_\delta(x) \approx \rho(x) + \tfrac12 \delta^2 \partial_x^2 \rho(x)\,.$$

Then we obtain an effective diffusion equation

$$\partial_t \rho = \nabla \cdot (D_e(\rho)\nabla\rho - \delta^2 \rho D(\rho) \nabla\Delta \rho)$$ with diffusivity $$ D_e(\rho) = D(\rho) + \tfrac12 D'(\rho)\rho\,. $$

Despite the microscopic model being not reversible, the continuum model restores detailed balance

$$ \partial_t\rho = \nabla\cdot(\rho D(\rho) \nabla(\delta E/\delta \rho)) $$ with free energy $$ E(\rho) = \int_\Omega (\rho\log\rho - \rho + f(\rho) + \tfrac12 \delta^2 |\nabla \rho|^2)\,dx\,,\quad f'(\rho)=\tfrac12 \log D(\rho) $$

In other words, the model is a $(\rho D(\rho))$-Wasserstein gradient flow. This model demonstrates the effect of motility induced phase separation: While the microscopic diffusivity $D(\rho)$ is strictly positive, this is no longer true for the effective diffusivity $D_e(\rho)$! For example, for $D(\rho) = D_0 e^{-\rho}$, the effective diffusivty becomes $$D_e(\rho) = D_0 (1-\tfrac12\rho) e^{-\rho}$$

As a consequence, homogeneous configurations $\rho(x) = \bar\rho$ are only stable, if $\bar\rho<2$. If instead $\bar\rho>2$ phase separation occurs, as depicted in the animation. This is the mentioned feedback loop: Accumulation induced slowdown and slowdown-induced accumulation.

We now additionally introduce a second behavioral rule for the active agents: Reproduction and competition. This is models as a Poisson process

$$A\stackrel{\lambda_r}{\longrightarrow} A+A\qquad\lambda_r=\alpha\qquad\text{(reproduction)}$$ $$A+A\stackrel{\lambda_c}{\longrightarrow} A\qquad\lambda_c=\alpha/\rho_0\qquad\text{(competition)} $$

with carrying capacity $\rho_0$ and timescale $\alpha$. In the limit $N\to\infty$, this effectively leads to logistic growth

$$\partial_t \rho = \nabla \cdot (D_e(\rho)\nabla\rho - \delta^2 \rho D(\rho) \nabla\Delta \rho) {\color{red} + \alpha \rho (1-\rho/\rho_0)} $$

Interestingly, now, phase separation will eventually occur if $D_e(\rho_0)<0$, even if currently $D_e(\bar\rho)>0$. In other words, the system will drive itself into instability. In particular, we identify three regimes, with spinodal density $\rho_S$ and critical density $\rho_c$:

  • if $\rho_0 < \rho_S$, only the homogeneous solution will be stable, and no instability occurs (homogeneous phase)
  • if $\rho_S < \rho_0 < \rho_c$, instead limit cycles occur, where reproduction induces motility induced phase separation, but the resulting dense bacterial clusters are unsustainable under the current carrying capacity, and thus slowly die out.
  • if $\rho_c < \rho_0$, bacterial clusters become (meta-)stable.

This behavior is reminiscient of the biofilm-planktonic lifecycle: Bacteria occur in a diluted planctonic phase, until a critical density is reached. They then stick to walls to form a biofilm, which over time slowly dissolves back into the planktonic phase. The corresponding phase-diagram in carrying capacity $\rho_0$ and inverse quorum sensing range (equivalently, domain-size), $\delta^{-1}$, is shown in the figure.

Relevant publications

  1. T. Grafke, M. Cates, and E. Vanden-Eijnden, "Spatiotemporal Self-Organization of Fluctuating Bacterial Colonies", Phys. Rev. Lett. 119 (2017), 188003 (link)