Infinitesimal generator (stochastic processes)

In mathematics — specifically, in stochastic analysis — the infinitesimal generator of a Feller process (i.e. a continuous-time Markov process satisfying certain regularity conditions) is a partial differential operator that encodes a great deal of information about the process. The generator is used in evolution equations such as the Kolmogorov backward equation (which describes the evolution of statistics of the process); its L² Hermitian adjoint is used in evolution equations such as the Fokker–Planck equation (which describes the evolution of the probability density functions of the process).

Definition

General case

For a d-dimensional Feller process $(X_{t})_{t\geq 0}$ we define the generator $A$ by

Af(x):=\lim _{t\downarrow 0}{\frac {\mathbb {E} ^{x}(f(X_{t}))-f(x)}{t}}

whenever this limit exists in ${\overline {C_{c}^{0}(\mathbb {R} ^{d})}}\subset (C^{0}(\mathbb {R} ^{d}),\|\cdot \|_{\infty })$ , i.e. in the space of continuous functions $\mathbb {R} ^{d}\to \mathbb {R}$ vanishing at infinity.

This definition parallels the one of infinitesimal generator of $C^{0}$ -semigroup.

Stochastic differential equations driven by Brownian motion

Let ${\textstyle X:[0,\infty )\times \Omega \rightarrow \mathbb {R} ^{n}}$ defined on a probability space ${\textstyle (\Omega ,{\mathcal {F}},P)}$ be an Itô diffusion satisfying a stochastic differential equation of the form:

\mathrm {d} X_{t}=b(X_{t})\,\mathrm {d} t+\sigma (X_{t})\,\mathrm {d} B_{t}

where $B$ is an m-dimensional Brownian motion and $b:\mathbb {R} ^{n}\rightarrow \mathbb {R} ^{n}$ and ${\displaystyle \sigma$ are the drift and diffusion fields respectively. For a point $x\in \mathbb {R} ^{n}$ , let $\mathbb {P} ^{x}$ denote the law of $X$ given initial datum $X_{0}=x$ , and let $\mathbb {E} ^{x}$ denote expectation with respect to $\mathbb {P} ^{x}$ .

The infinitesimal generator of $X$ is the operator ${\mathcal {A}}$ , which is defined to act on suitable functions $f:\mathbb {R} ^{n}\rightarrow \mathbb {R}$ by:

{\mathcal {A}}f(x)=\lim _{t\downarrow 0}{\frac {\mathbb {E} ^{x}[f(X_{t})]-f(x)}{t}}

The set of all functions $f$ for which this limit exists at a point $x$ is denoted $D_{\mathcal {A}}(x)$ , while $D_{\mathcal {A}}$ denotes the set of all $f$ for which the limit exists for all $x\in \mathbb {R} ^{n}$ . One can show that any compactly-supported $C^{2}$ (twice differentiable with continuous second derivative) function $f$ lies in $D_{\mathcal {A}}$ and that:

{\mathcal {A}}f(x)=\sum _{i}b_{i}(x){\frac {\partial f}{\partial x_{i}}}(x)+{\frac {1}{2}}\sum _{i,j}{\big (}\sigma (x)\sigma (x)^{\top }{\big )}_{i,j}{\frac {\partial ^{2}f}{\partial x_{i}\,\partial x_{j}}}(x)

Or, in terms of the gradient and scalar and Frobenius inner products:

{\mathcal {A}}f(x)=b(x)\cdot \nabla _{x}f(x)+{\frac {1}{2}}{\big (}\sigma (x)\sigma (x)^{\top }{\big )}:\nabla _{x}\nabla _{x}f(x)

Generators of some common processes

For finite-state continuous time Markov chains the generator may be expressed as a transition rate matrix
Standard Brownian motion on $\mathbb {R} ^{n}$ , which satisfies the stochastic differential equation $dX_{t}=dB_{t}$ , has generator ${\textstyle {1 \over {2}}\Delta }$ , where $\Delta$ denotes the Laplace operator.
The two-dimensional process $Y$ satisfying:

\mathrm {d} Y_{t}={\mathrm {d} t \choose \mathrm {d} B_{t}}

where

B

is a one-dimensional Brownian motion, can be thought of as the graph of that Brownian motion, and has generator:

{\mathcal {A}}f(t,x)={\frac {\partial f}{\partial t}}(t,x)+{\frac {1}{2}}{\frac {\partial ^{2}f}{\partial x^{2}}}(t,x)

The Ornstein–Uhlenbeck process on $\mathbb {R}$ , which satisfies the stochastic differential equation ${\textstyle dX_{t}=\theta (\mu -X_{t})dt+\sigma dB_{t}}$ , has generator:

{\mathcal {A}}f(x)=\theta (\mu -x)f'(x)+{\frac {\sigma ^{2}}{2}}f''(x)

Similarly, the graph of the Ornstein–Uhlenbeck process has generator:

{\mathcal {A}}f(t,x)={\frac {\partial f}{\partial t}}(t,x)+\theta (\mu -x){\frac {\partial f}{\partial x}}(t,x)+{\frac {\sigma ^{2}}{2}}{\frac {\partial ^{2}f}{\partial x^{2}}}(t,x)

A geometric Brownian motion on $\mathbb {R}$ , which satisfies the stochastic differential equation ${\textstyle dX_{t}=rX_{t}dt+\alpha X_{t}dB_{t}}$ , has generator:

{\mathcal {A}}f(x)=rxf'(x)+{\frac {1}{2}}\alpha ^{2}x^{2}f''(x)

References

Calin, Ovidiu (2015). An Informal Introduction to Stochastic Calculus with Applications. Singapore: World Scientific Publishing. p. 315. ISBN 978-981-4678-93-3. (See Chapter 9)
Øksendal, Bernt K. (2003). Stochastic Differential Equations: An Introduction with Applications (Sixth ed.). Berlin: Springer. doi:10.1007/978-3-642-14394-6. ISBN 3-540-04758-1. (See Section 7.3)

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.