Integration by substitution

In calculus, integration by substitution, also known as u-substitution or change of variables,[1] is a method for evaluating integrals and antiderivatives. It is the counterpart to the chain rule for differentiation, in fact, it can loosely be thought of as using the chain rule "backwards".

Substitution for a single variable

Introduction

Before stating the result rigorously, consider a simple case using indefinite integrals.

Compute $\textstyle \int \left(2x^{3}+1\right)^{7}\left(x^{2}\right)dx$ .[2]

Set $u=2x^{3}+1$ . This means $\textstyle {\frac {du}{dx}}=6x^{2}$ , or, in differential form $du=6x^{2}\,dx$ . Now

\int \left(2x^{3}+1\right)^{7}\left(x^{2}\right)dx={\frac {1}{6}}\int \underbrace {\left(2x^{3}+1\right)^{7}} _{u^{7}}\underbrace {\left(6x^{2}\right)dx} _{du}={\frac {1}{6}}\int u^{7}\,du={\frac {1}{6}}\left({\frac {1}{8}}u^{8}\right)+C={\frac {1}{48}}\left(2x^{3}+1\right)^{8}+C

,

where $C$ is an arbitrary constant of integration.

This procedure is frequently used, but not all integrals are of a form that permits its use. In any event, the result should be verified by differentiating and comparing to the original integrand.

{\frac {d}{dx}}\left[{\frac {1}{48}}\left(2x^{3}+1\right)^{8}+C\right]={\frac {1}{6}}\left(2x^{3}+1\right)^{7}\left(6x^{2}\right)=\left(2x^{3}+1\right)^{7}\left(x^{2}\right).

For definite integrals, the limits of integration must also be adjusted, but the procedure is mostly the same.

Definite integrals

Let $φ : [a, b] \to I$ be a differentiable function with a continuous derivative, where $I \subseteq R$ is an interval. Suppose that $f : I \to R$ is a continuous function. Then[3]

\int _{a}^{b}f(\varphi (x))\varphi '(x)\,dx=\int _{\varphi (a)}^{\varphi (b)}f(u)\,du.

In Leibniz notation, the substitution $u = φ (x)$ yields

{\frac {du}{dx}}=\varphi '(x).

Working heuristically with infinitesimals yields the equation

du=\varphi '(x)\,dx,

which suggests the substitution formula above. (This equation may be put on a rigorous foundation by interpreting it as a statement about differential forms.) One may view the method of integration by substitution as a partial justification of Leibniz's notation for integrals and derivatives.

The formula is used to transform one integral into another integral that is easier to compute. Thus, the formula can be read from left to right or from right to left in order to simplify a given integral. When used in the former manner, it is sometimes known as u-substitution or w-substitution in which a new variable is defined to be a function of the original variable found inside the composite function multiplied by the derivative of the inner function. The latter manner is commonly used in trigonometric substitution, replacing the original variable with a trigonometric function of a new variable and the original differential with the differential of the trigonometric function.

Proof

Integration by substitution can be derived from the fundamental theorem of calculus as follows. Let $f$ and $φ$ be two functions satisfying the above hypothesis that $f$ is continuous on $I$ and $φ'$ is integrable on the closed interval $[a, b]$ . Then the function $f (φ (x)) φ'(x)$ is also integrable on $[a, b]$ . Hence the integrals

\int _{a}^{b}f(\varphi (x))\varphi '(x)\,dx

and

\int _{\varphi (a)}^{\varphi (b)}f(u)\,du

in fact exist, and it remains to show that they are equal.

Since $f$ is continuous, it has an antiderivative $F$ . The composite function $F \circ φ$ is then defined. Since $φ$ is differentiable, combining the chain rule and the definition of an antiderivative gives

(F\circ \varphi )'(x)=F'(\varphi (x))\varphi '(x)=f(\varphi (x))\varphi '(x).

Applying the fundamental theorem of calculus twice gives

{\begin{aligned}\int _{a}^{b}f(\varphi (x))\varphi '(x)\,dx&=\int _{a}^{b}(F\circ \varphi )'(x)\,dx\\&=(F\circ \varphi )(b)-(F\circ \varphi )(a)\\&=F(\varphi (b))-F(\varphi (a))\\&=\int _{\varphi (a)}^{\varphi (b)}f(u)\,du,\end{aligned}}

which is the substitution rule.

Example 1:

Consider the integral

\int _{0}^{2}x\cos \left(x^{2}+1\right)dx.

Make the substitution $u=x^{2}+1$ to obtain $du=2x\,dx$ , meaning $\textstyle x\,dx={\frac {1}{2}}du$ . Therefore,

{\begin{aligned}\int _{x=0}^{x=2}x\cos \left(x^{2}+1\right)dx&={\frac {1}{2}}\int _{u=1}^{u=5}\cos(u)\,du\\[6pt]&={\frac {1}{2}}(\sin(5)-\sin(1)).\end{aligned}}

Since the lower limit $x=0$ was replaced with $u=1$ , and the upper limit $x=2$ with $2^{2}+1=5$ , a transformation back into terms of $x$ was unnecessary.

Alternatively, one may fully evaluate the indefinite integral (see below) first then apply the boundary conditions. This becomes especially handy when multiple substitutions are used.

Example 2:

For the integral

\int _{0}^{1}{\sqrt {1-x^{2}}}\,dx,

a variation of the above procedure is needed. The substitution $x=\sin u$ implying $dx=\cos(u)\,du$ is useful because ${\sqrt {1-\sin ^{2}u}}=\cos(u)$ . We thus have

{\begin{aligned}\int _{0}^{1}{\sqrt {1-x^{2}}}\,dx&=\int _{0}^{\pi /2}{\sqrt {1-\sin ^{2}u}}\cos(u)\,du\\[6pt]&=\int _{0}^{\pi /2}\cos ^{2}(u)\,du\\[6pt]&=\left[{\frac {u}{2}}+{\frac {\sin(2u)}{4}}\right]_{0}^{\pi /2}\\[6pt]&={\frac {\pi }{4}}+0={\frac {\pi }{4}}.\end{aligned}}

The resulting integral can be computed using integration by parts or a double angle formula, $2\cos ^{2}(u)=1+\cos(2u)$ , followed by one more substitution. One can also note that the function being integrated is the upper right quarter of a circle with a radius of one, and hence integrating the upper right quarter from zero to one is the geometric equivalent to the area of one quarter of the unit circle, or $\pi /4$ .

Antiderivatives

Substitution can be used to determine antiderivatives. One chooses a relation between $x$ and $u$ , determines the corresponding relation between $dx$ and $du$ by differentiating, and performs the substitutions. An antiderivative for the substituted function can hopefully be determined; the original substitution between $x$ and $u$ is then undone.

Similar to example 1 above, the following antiderivative can be obtained with this method:

{\begin{aligned}\int x\cos \left(x^{2}+1\right)\,dx&={\frac {1}{2}}\int 2x\cos \left(x^{2}+1\right)\,dx\\[6pt]&={\frac {1}{2}}\int \cos u\,du\\[6pt]&={\frac {1}{2}}\sin u+C={\frac {1}{2}}\sin \left(x^{2}+1\right)+C,\end{aligned}}

where $C$ is an arbitrary constant of integration.

There were no integral boundaries to transform, but in the last step reverting the original substitution $u=x^{2}+1$ was necessary. When evaluating definite integrals by substitution, one may calculate the antiderivative fully first, then apply the boundary conditions. In that case, there is no need to transform the boundary terms.

The tangent function can be integrated using substitution by expressing it in terms of the sine and cosine:

\int \tan x\,dx=\int {\frac {\sin x}{\cos x}}\,dx

Using the substitution $u=\cos x$ gives $du=-\sin x\,dx$ and

{\begin{aligned}\int \tan x\,dx&=\int {\frac {\sin x}{\cos x}}\,dx\\&=\int -{\frac {du}{u}}\\&=-\ln |u|+C\\&=-\ln |\cos x|+C=\ln |\sec x|+C.\end{aligned}}

Substitution for multiple variables

One may also use substitution when integrating functions of several variables. Here the substitution function $(v 1, \dots, v n) = φ (u 1, \dots, u n)$ needs to be injective and continuously differentiable, and the differentials transform as

dv_{1}\cdots dv_{n}=|\det(D\varphi )(u_{1},\ldots ,u_{n})|\,du_{1}\cdots du_{n},

where $det(Dφ)(u 1, ..., u n)$ denotes the determinant of the Jacobian matrix of partial derivatives of $φ$ at the point $(u 1, ..., u n)$ . This formula expresses the fact that the absolute value of the determinant of a matrix equals the volume of the parallelotope spanned by its columns or rows.

More precisely, the change of variables formula is stated in the next theorem:

Theorem. Let $U$ be an open set in $R n$ and $φ : U \to R n$ an injective differentiable function with continuous partial derivatives, the Jacobian of which is nonzero for every $x$ in $U$ . Then for any real-valued, compactly supported, continuous function $f$ , with support contained in $φ (U)$ ,

\int _{\varphi (U)}f(\mathbf {v} )\,d\mathbf {v} =\int _{U}f(\varphi (\mathbf {u} ))\left|\det(D\varphi )(\mathbf {u} )\right|\,d\mathbf {u} .

The conditions on the theorem can be weakened in various ways. First, the requirement that $φ$ be continuously differentiable can be replaced by the weaker assumption that $φ$ be merely differentiable and have a continuous inverse.[4] This is guaranteed to hold if $φ$ is continuously differentiable by the inverse function theorem. Alternatively, the requirement that $det(Dφ) \neq 0$ can be eliminated by applying Sard's theorem.[5]

For Lebesgue measurable functions, the theorem can be stated in the following form:[6]

Theorem. Let $U$ be a measurable subset of $R n$ and $φ : U \to R n$ an injective function, and suppose for every $x$ in $U$ there exists $φ' (x)$ in $R n, n$ such that $φ (y) = φ (x) + φ' (x)(y - x) + o (|| y - x ||)$ as $y \to x$ (here $o$ is little-o notation). Then $φ (U)$ is measurable, and for any real-valued function $f$ defined on $φ (U)$ ,

\int _{\varphi (U)}f(v)\,dv=\int _{U}f(\varphi (u))\left|\det \varphi '(u)\right|\,du

in the sense that if either integral exists (including the possibility of being properly infinite), then so does the other one, and they have the same value.

Another very general version in measure theory is the following:[7]

Theorem. Let $X$ be a locally compact Hausdorff space equipped with a finite Radon measure $μ$ , and let $Y$ be a σ-compact Hausdorff space with a σ-finite Radon measure $ρ$ . Let $φ : X \to Y$ be a continuous and absolutely continuous function (where the latter means that $ρ (φ (E)) = 0$ whenever $μ (E) = 0$ ). Then there exists a real-valued Borel measurable function $w$ on $X$ such that for every Lebesgue integrable function $f : Y \to R$ , the function $(f \circ φ) \cdot w$ is Lebesgue integrable on $X$ , and

\int _{Y}f(y)\,d\rho (y)=\int _{X}(f\circ \varphi )(x)\,w(x)\,d\mu (x).

Furthermore, it is possible to write

w(x)=(g\circ \varphi )(x)

for some Borel measurable function $g$ on $Y$ .

In geometric measure theory, integration by substitution is used with Lipschitz functions. A bi-Lipschitz function is a Lipschitz function $φ : U \to R n$ which is injective and whose inverse function $φ - 1 : φ (U) \to U$ is also Lipschitz. By Rademacher's theorem a bi-Lipschitz mapping is differentiable almost everywhere. In particular, the Jacobian determinant of a bi-Lipschitz mapping $det Dφ$ is well-defined almost everywhere. The following result then holds:

Theorem. Let $U$ be an open subset of $R n$ and $φ : U \to R n$ be a bi-Lipschitz mapping. Let $f : φ (U) \to R$ be measurable. Then

\int _{U}(f\circ \varphi )(x)|\det D\varphi (x)|\,dx=\int _{\varphi (U)}f(x)\,dx

in the sense that if either integral exists (or is properly infinite), then so does the other one, and they have the same value.

The above theorem was first proposed by Euler when he developed the notion of double integrals in 1769. Although generalized to triple integrals by Lagrange in 1773, and used by Legendre, Laplace, Gauss, and first generalized to $n$ variables by Mikhail Ostrogradski in 1836, it resisted a fully rigorous formal proof for a surprisingly long time, and was first satisfactorily resolved 125 years later, by Élie Cartan in a series of papers beginning in the mid-1890s.[8][9]

Application in probability

Substitution can be used to answer the following important question in probability: given a random variable $X$ with probability density $p_{X}$ and another random variable $Y$ such that $Y=\phi (X)$ , what is the probability density for $Y$ ?

It is easiest to answer this question by first answering a slightly different question: what is the probability that $Y$ takes a value in some particular subset $S$ ? Denote this probability $P(Y\in S)$ . Of course, if $Y$ has probability density $p_{Y}$ then the answer is

P(Y\in S)=\int _{S}p_{Y}(y)\,dy,

but this isn't really useful because we don't know $p_{Y}$ ; it's what we're trying to find. We can make progress by considering the problem in the variable $X$ . $Y$ takes a value in $S$ whenever $X$ takes a value in $\phi ^{-1}(S)$ , so

P(Y\in S)=\int _{\phi ^{-1}(S)}p_{X}(x)\,dx.

Changing from variable $x$ to $y$ gives

P(Y\in S)=\int _{\phi ^{-1}(S)}p_{X}(x)\,dx=\int _{S}p_{X}(\phi ^{-1}(y))\left|{\frac {d\phi ^{-1}}{dy}}\right|\,dy.

Combining this with our first equation gives

\int _{S}p_{Y}(y)\,dy=\int _{S}p_{X}(\phi ^{-1}(y))\left|{\frac {d\phi ^{-1}}{dy}}\right|\,dy,

so

p_{Y}(y)=p_{X}(\phi ^{-1}(y))\left|{\frac {d\phi ^{-1}}{dy}}\right|.

In the case where $X$ and $Y$ depend on several uncorrelated variables, i.e. $p_{X}=p_{X}(x_{1},\ldots ,x_{n})$ and $y=\phi (x)$ , $p_{Y}$ can be found by substitution in several variables discussed above. The result is

p_{Y}(y)=p_{X}(\phi ^{-1}(y))\left|\det D\phi ^{-1}(y)\right|.

Notes

Swokowski 1983, p. 257
Swokowsi 1983, p. 258
Briggs & Cochran 2011, pg.361
Rudin 1987, Theorem 7.26
Spivak 1965, p. 72
Fremlin 2010, Theorem 263D
Hewitt & Stromberg 1965, Theorem 20.3
Katz 1982
Ferzola 1994

References

Briggs, William; Cochran, Lyle (2011), Calculus /Early Transcendentals (Single Variable ed.), Addison-Wesley, ISBN 978-0-321-66414-3
Ferzola, Anthony P. (1994), "Euler and differentials", The College Mathematics Journal, 25 (2): 102–111, doi:10.2307/2687130
Fremlin, D.H. (2010), Measure Theory, Volume 2, Torres Fremlin, ISBN 978-0-9538129-7-4.
Hewitt, Edwin; Stromberg, Karl (1965), Real and Abstract Analysis, Springer-Verlag, ISBN 978-0-387-04559-7.
Katz, V. (1982), "Change of variables in multiple integrals: Euler to Cartan", Mathematics Magazine, 55 (1): 3–11, doi:10.2307/2689856
Rudin, Walter (1987), Real and Complex Analysis, McGraw-Hill, ISBN 978-0-07-054234-1.
Swokowski, Earl W. (1983), Calculus with analytic geometry (alternate ed.), Prindle, Weber & Schmidt, ISBN 0-87150-341-7
Spivak, Michael (1965), Calculus on Manifolds, Westview Press, ISBN 978-0-8053-9021-6.

External links

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.

[1] Swokowski 1983, p. 257

[2] Swokowsi 1983, p. 258

[3] Briggs & Cochran 2011, pg.361

[4] Rudin 1987, Theorem 7.26

[5] Spivak 1965, p. 72

[6] Fremlin 2010, Theorem 263D

[7] Hewitt & Stromberg 1965, Theorem 20.3

[8] Katz 1982

[9] Ferzola 1994

Calculus
Precalculus	Binomial theorem Concave function Continuous function Factorial Finite difference Free variables and bound variables Graph of a function Linear function Radian Rolle's theorem Secant Slope Tangent
Limits	Indeterminate form Limit of a function One-sided limit Limit of a sequence Order of approximation (ε, δ)-definition of limit
Differential calculus	Derivative Differential Differential equation Differential operator Mean value theorem Notation Leibniz's notation Newton's notation Rules of differentiation linearity Power Sum Chain L'Hôpital's Product General Leibniz's rule Quotient Other techniques Implicit differentiation Inverse functions and differentiation Logarithmic derivative Related rates Stationary points First derivative test Second derivative test Extreme value theorem Maxima and minima Further applications Newton's method Taylor's theorem
Integral calculus	Antiderivative Arc length Basic properties Constant of integration Differentiation under the integral sign Fundamental theorem of calculus Differentiating under the integral sign Integration by parts Integration by substitution trigonometric Euler Weierstrass Partial fractions in integration Quadratic integral Trapezoidal rule Volumes Washer method Shell method
Vector calculus	Derivatives Curl Directional derivative Divergence Gradient Laplacian Basic theorems Line integrals Green's Stokes' Gauss'
Multivariable calculus	Divergence theorem Geometric Hessian matrix Jacobian matrix and determinant Lagrange multiplier Line integral Matrix Multiple integral Partial derivative Surface integral Volume integral Advanced topics Differential forms Exterior derivative Generalized Stokes' Theorem Tensor calculus
Sequences and series	Arithmetico–geometric sequence Types of series Alternating Binomial Fourier Geometric Harmonic Infinite Power Maclaurin Taylor Telescoping Tests of convergence Abel's Alternating series Cauchy condensation Direct comparison Dirichlet's Integral Limit comparison Ratio Root Term
Special functions and numbers	Bernoulli numbers e (mathematical constant) Exponential function Natural logarithm Stirling's approximation
History of calculus	Adequality Brook Taylor Colin Maclaurin Generality of algebra Gottfried Wilhelm Leibniz Infinitesimal Infinitesimal calculus Isaac Newton Fluxion Law of Continuity Leonhard Euler Method of Fluxions The Method of Mechanical Theorems
Lists	Differentiation rules List of integrals of exponential functions List of integrals of hyperbolic functions List of integrals of inverse hyperbolic functions List of integrals of inverse trigonometric functions List of integrals of irrational functions List of integrals of logarithmic functions List of integrals of rational functions List of integrals of trigonometric functions Secant Secant cubed List of limits Lists of integrals
Miscellaneous topics	Differential geometry curvature of curves of surfaces Euler–Maclaurin formula Gabriel's Horn Integration Bee Proof that 22/7 exceeds π Regiomontanus' angle maximization problem Steinmetz solid