(Translated by https://www.hiragana.jp/)
Itô diffusion - Wikipedia Jump to content

Itô diffusion

From Wikipedia, the free encyclopedia

In mathematics – specifically, in stochastic analysis – an Itô diffusion is a solution to a specific type of stochastic differential equation. That equation is similar to the Langevin equation used in physics to describe the Brownian motion of a particle subjected to a potential in a viscous fluid. Itô diffusions are named after the Japanese mathematician Kiyosi Itô.

Overview

[edit]
This Wiener process (Brownian motion) in three-dimensional space (one sample path shown) is an example of an Itô diffusion.

A (time-homogeneous) Itô diffusion in n-dimensional Euclidean space is a process X : [0, +∞) × Ωおめが → Rn defined on a probability space (ΩおめがΣしぐまP) and satisfying a stochastic differential equation of the form

where B is an m-dimensional Brownian motion and b : Rn → Rn and σしぐま : Rn → Rn×m satisfy the usual Lipschitz continuity condition

for some constant C and all x, yRn; this condition ensures the existence of a unique strong solution X to the stochastic differential equation given above. The vector field b is known as the drift coefficient of X; the matrix field σしぐま is known as the diffusion coefficient of X. It is important to note that b and σしぐま do not depend upon time; if they were to depend upon time, X would be referred to only as an Itô process, not a diffusion. Itô diffusions have a number of nice properties, which include

In particular, an Itô diffusion is a continuous, strongly Markovian process such that the domain of its characteristic operator includes all twice-continuously differentiable functions, so it is a diffusion in the sense defined by Dynkin (1965).

Continuity

[edit]

Sample continuity

[edit]

An Itô diffusion X is a sample continuous process, i.e., for almost all realisations Bt(ωおめが) of the noise, Xt(ωおめが) is a continuous function of the time parameter, t. More accurately, there is a "continuous version" of X, a continuous process Y so that

This follows from the standard existence and uniqueness theory for strong solutions of stochastic differential equations.

Feller continuity

[edit]

In addition to being (sample) continuous, an Itô diffusion X satisfies the stronger requirement to be a Feller-continuous process.

For a point x ∈ Rn, let Px denote the law of X given initial datum X0 = x, and let Ex denote expectation with respect to Px.

Let f : Rn → R be a Borel-measurable function that is bounded below and define, for fixed t ≥ 0, u : Rn → R by

  • Lower semi-continuity: if f is lower semi-continuous, then u is lower semi-continuous.
  • Feller continuity: if f is bounded and continuous, then u is continuous.

The behaviour of the function u above when the time t is varied is addressed by the Kolmogorov backward equation, the Fokker–Planck equation, etc. (See below.)

The Markov property

[edit]

The Markov property

[edit]

An Itô diffusion X has the important property of being Markovian: the future behaviour of X, given what has happened up to some time t, is the same as if the process had been started at the position Xt at time 0. The precise mathematical formulation of this statement requires some additional notation:

Let Σしぐま denote the natural filtration of (ΩおめがΣしぐま) generated by the Brownian motion B: for t ≥ 0,

It is easy to show that X is adapted to Σしぐま (i.e. each Xt is Σしぐまt-measurable), so the natural filtration F = FX of (ΩおめがΣしぐま) generated by X has Ft ⊆ Σしぐまt for each t ≥ 0.

Let f : Rn → R be a bounded, Borel-measurable function. Then, for all t and h ≥ 0, the conditional expectation conditioned on the σしぐま-algebra Σしぐまt and the expectation of the process "restarted" from Xt satisfy the Markov property:

In fact, X is also a Markov process with respect to the filtration F, as the following shows:

The strong Markov property

[edit]

The strong Markov property is a generalization of the Markov property above in which t is replaced by a suitable random time τたう : Ωおめが → [0, +∞] known as a stopping time. So, for example, rather than "restarting" the process X at time t = 1, one could "restart" whenever X first reaches some specified point p of Rn.

As before, let f : Rn → R be a bounded, Borel-measurable function. Let τたう be a stopping time with respect to the filtration Σしぐま with τたう < +∞ almost surely. Then, for all h ≥ 0,

The generator

[edit]

Definition

[edit]

Associated to each Itô diffusion, there is a second-order partial differential operator known as the generator of the diffusion. The generator is very useful in many applications and encodes a great deal of information about the process X. Formally, the infinitesimal generator of an Itô diffusion X is the operator A, which is defined to act on suitable functions f : Rn → R by

The set of all functions f for which this limit exists at a point x is denoted DA(x), while DA denotes the set of all f for which the limit exists for all x ∈ Rn. One can show that any compactly-supported C2 (twice differentiable with continuous second derivative) function f lies in DA and that

or, in terms of the gradient and scalar and Frobenius inner products,

An example

[edit]

The generator A for standard n-dimensional Brownian motion B, which satisfies the stochastic differential equation dXt = dBt, is given by

,

i.e., A = Δでるた/2, where Δでるた denotes the Laplace operator.

The Kolmogorov and Fokker–Planck equations

[edit]

The generator is used in the formulation of Kolmogorov's backward equation. Intuitively, this equation tells us how the expected value of any suitably smooth statistic of X evolves in time: it must solve a certain partial differential equation in which time t and the initial position x are the independent variables. More precisely, if f ∈ C2(RnR) has compact support and u : [0, +∞) × Rn → R is defined by

then u(tx) is differentiable with respect to t, u(t, ·) ∈ DA for all t, and u satisfies the following partial differential equation, known as Kolmogorov's backward equation:

The Fokker–Planck equation (also known as Kolmogorov's forward equation) is in some sense the "adjoint" to the backward equation, and tells us how the probability density functions of Xt evolve with time t. Let ρろー(t, ·) be the density of Xt with respect to Lebesgue measure on Rn, i.e., for any Borel-measurable set S ⊆ Rn,

Let A denote the Hermitian adjoint of A (with respect to the L2 inner product). Then, given that the initial position X0 has a prescribed density ρろー0, ρろー(tx) is differentiable with respect to t, ρろー(t, ·) ∈ DA* for all t, and ρろー satisfies the following partial differential equation, known as the Fokker–Planck equation:

The Feynman–Kac formula

[edit]

The Feynman–Kac formula is a useful generalization of Kolmogorov's backward equation. Again, f is in C2(RnR) and has compact support, and q : Rn → R is taken to be a continuous function that is bounded below. Define a function v : [0, +∞) × Rn → R by

The Feynman–Kac formula states that v satisfies the partial differential equation

Moreover, if w : [0, +∞) × Rn → R is C1 in time, C2 in space, bounded on K × Rn for all compact K, and satisfies the above partial differential equation, then w must be v as defined above.

Kolmogorov's backward equation is the special case of the Feynman–Kac formula in which q(x) = 0 for all x ∈ Rn.

The characteristic operator

[edit]

Definition

[edit]

The characteristic operator of an Itô diffusion X is a partial differential operator closely related to the generator, but somewhat more general. It is more suited to certain problems, for example in the solution of the Dirichlet problem.

The characteristic operator of an Itô diffusion X is defined by

where the sets U form a sequence of open sets Uk that decrease to the point x in the sense that

and

is the first exit time from U for X. denotes the set of all f for which this limit exists for all x ∈ Rn and all sequences {Uk}. If Ex[τたうU] = +∞ for all open sets U containing x, define

Relationship with the generator

[edit]

The characteristic operator and infinitesimal generator are very closely related, and even agree for a large class of functions. One can show that

and that

In particular, the generator and characteristic operator agree for all C2 functions f, in which case

Application: Brownian motion on a Riemannian manifold

[edit]
The characteristic operator of a Brownian motion is 1/2 times the Laplace-Beltrami operator. Here it is the Laplace-Beltrami operator on a 2-sphere.

Above, the generator (and hence characteristic operator) of Brownian motion on Rn was calculated to be 1/2Δでるた, where Δでるた denotes the Laplace operator. The characteristic operator is useful in defining Brownian motion on an m-dimensional Riemannian manifold (Mg): a Brownian motion on M is defined to be a diffusion on M whose characteristic operator in local coordinates xi, 1 ≤ i ≤ m, is given by 1/2ΔでるたLB, where ΔでるたLB is the Laplace-Beltrami operator given in local coordinates by

where [gij] = [gij]−1 in the sense of the inverse of a square matrix.

The resolvent operator

[edit]

In general, the generator A of an Itô diffusion X is not a bounded operator. However, if a positive multiple of the identity operator I is subtracted from A then the resulting operator is invertible. The inverse of this operator can be expressed in terms of X itself using the resolvent operator.

For αあるふぁ > 0, the resolvent operator Rαあるふぁ, acting on bounded, continuous functions g : Rn → R, is defined by

It can be shown, using the Feller continuity of the diffusion X, that Rαあるふぁg is itself a bounded, continuous function. Also, Rαあるふぁ and αあるふぁI − A are mutually inverse operators:

  • if f : Rn → R is C2 with compact support, then, for all αあるふぁ > 0,
  • if g : Rn → R is bounded and continuous, then Rαあるふぁg lies in DA and, for all αあるふぁ > 0,

Invariant measures

[edit]

Sometimes it is necessary to find an invariant measure for an Itô diffusion X, i.e. a measure on Rn that does not change under the "flow" of X: i.e., if X0 is distributed according to such an invariant measure μみゅー, then Xt is also distributed according to μみゅー for any t ≥ 0. The Fokker–Planck equation offers a way to find such a measure, at least if it has a probability density function ρろー: if X0 is indeed distributed according to an invariant measure μみゅー with density ρろー, then the density ρろー(t, ·) of Xt does not change with t, so ρろー(t, ·) = ρろー, and so ρろー must solve the (time-independent) partial differential equation

This illustrates one of the connections between stochastic analysis and the study of partial differential equations. Conversely, a given second-order linear partial differential equation of the form Λらむだf = 0 may be hard to solve directly, but if Λらむだ = A for some Itô diffusion X, and an invariant measure for X is easy to compute, then that measure's density provides a solution to the partial differential equation.

Invariant measures for gradient flows

[edit]

An invariant measure is comparatively easy to compute when the process X is a stochastic gradient flow of the form

where βべーた > 0 plays the role of an inverse temperature and Ψぷさい : Rn → R is a scalar potential satisfying suitable smoothness and growth conditions. In this case, the Fokker–Planck equation has a unique stationary solution ρろー (i.e. X has a unique invariant measure μみゅー with density ρろー) and it is given by the Gibbs distribution:

where the partition function Z is given by

Moreover, the density ρろー satisfies a variational principle: it minimizes over all probability densities ρろー on Rn the free energy functional F given by

where

plays the role of an energy functional, and

is the negative of the Gibbs-Boltzmann entropy functional. Even when the potential Ψぷさい is not well-behaved enough for the partition function Z and the Gibbs measure μみゅー to be defined, the free energy F[ρろー(t, ·)] still makes sense for each time t ≥ 0, provided that the initial condition has F[ρろー(0, ·)] < +∞. The free energy functional F is, in fact, a Lyapunov function for the Fokker–Planck equation: F[ρろー(t, ·)] must decrease as t increases. Thus, F is an H-function for the X-dynamics.

Example

[edit]

Consider the Ornstein-Uhlenbeck process X on Rn satisfying the stochastic differential equation

where m ∈ Rn and βべーた, κかっぱ > 0 are given constants. In this case, the potential Ψぷさい is given by

and so the invariant measure for X is a Gaussian measure with density ρろー given by

.

Heuristically, for large t, Xt is approximately normally distributed with mean m and variance (βべーたκかっぱ)−1. The expression for the variance may be interpreted as follows: large values of κかっぱ mean that the potential well Ψぷさい has "very steep sides", so Xt is unlikely to move far from the minimum of Ψぷさい at m; similarly, large values of βべーた mean that the system is quite "cold" with little noise, so, again, Xt is unlikely to move far away from m.

The martingale property

[edit]

In general, an Itô diffusion X is not a martingale. However, for any f ∈ C2(RnR) with compact support, the process M : [0, +∞) × Ωおめが → R defined by

where A is the generator of X, is a martingale with respect to the natural filtration F of (ΩおめがΣしぐま) by X. The proof is quite simple: it follows from the usual expression of the action of the generator on smooth enough functions f and Itô's lemma (the stochastic chain rule) that

Since Itô integrals are martingales with respect to the natural filtration Σしぐま of (ΩおめがΣしぐま) by B, for t > s,

Hence, as required,

since Ms is Fs-measurable.

Dynkin's formula

[edit]

Dynkin's formula, named after Eugene Dynkin, gives the expected value of any suitably smooth statistic of an Itô diffusion X (with generator A) at a stopping time. Precisely, if τたう is a stopping time with Ex[τたう] < +∞, and f : Rn → R is C2 with compact support, then

Dynkin's formula can be used to calculate many useful statistics of stopping times. For example, canonical Brownian motion on the real line starting at 0 exits the interval (−R, +R) at a random time τたうR with expected value

Dynkin's formula provides information about the behaviour of X at a fairly general stopping time. For more information on the distribution of X at a hitting time, one can study the harmonic measure of the process.

Associated measures

[edit]

The harmonic measure

[edit]

In many situations, it is sufficient to know when an Itô diffusion X will first leave a measurable set H ⊆ Rn. That is, one wishes to study the first exit time

Sometimes, however, one also wishes to know the distribution of the points at which X exits the set. For example, canonical Brownian motion B on the real line starting at 0 exits the interval (−1, 1) at −1 with probability 1/2 and at 1 with probability 1/2, so Bτたう(−1, 1) is uniformly distributed on the set {−1, 1}.

In general, if G is compactly embedded within Rn, then the harmonic measure (or hitting distribution) of X on the boundaryG of G is the measure μみゅーGx defined by

for x ∈ G and F ⊆ ∂G.

Returning to the earlier example of Brownian motion, one can show that if B is a Brownian motion in Rn starting at x ∈ Rn and D ⊂ Rn is an open ball centred on x, then the harmonic measure of B on ∂D is invariant under all rotations of D about x and coincides with the normalized surface measure on ∂D.

The harmonic measure satisfies an interesting mean value property: if f : Rn → R is any bounded, Borel-measurable function and φふぁい is given by

then, for all Borel sets G ⊂⊂ H and all x ∈ G,

The mean value property is very useful in the solution of partial differential equations using stochastic processes.

The Green measure and Green formula

[edit]

Let A be a partial differential operator on a domain D ⊆ Rn and let X be an Itô diffusion with A as its generator. Intuitively, the Green measure of a Borel set H is the expected length of time that X stays in H before it leaves the domain D. That is, the Green measure of X with respect to D at x, denoted G(x, ·), is defined for Borel sets H ⊆ Rn by

or for bounded, continuous functions f : D → R by

The name "Green measure" comes from the fact that if X is Brownian motion, then

where G(xy) is Green's function for the operator 1/2Δでるた on the domain D.

Suppose that Ex[τたうD] < +∞ for all x ∈ D. Then the Green formula holds for all f ∈ C2(RnR) with compact support:

In particular, if the support of f is compactly embedded in D,

See also

[edit]

References

[edit]
  • Dynkin, Eugene B.; trans. J. Fabius; V. Greenberg; A. Maitra; G. Majone (1965). Markov processes. Vols. I, II. Die Grundlehren der Mathematischen Wissenschaften, Bände 121. New York: Academic Press Inc. MR0193671
  • Jordan, Richard; Kinderlehrer, David; Otto, Felix (1998). "The variational formulation of the Fokker–Planck equation". SIAM J. Math. Anal. 29 (1): 1–17 (electronic). CiteSeerX 10.1.1.6.8815. doi:10.1137/S0036141096303359. S2CID 13890235. MR1617171
  • Øksendal, Bernt K. (2003). Stochastic Differential Equations: An Introduction with Applications (Sixth ed.). Berlin: Springer. ISBN 3-540-04758-1. MR2001996 (See Sections 7, 8 and 9)