Ordinary differential equation
- ODE redirects here. For the real-time physics engine, see open dynamics engine.
In mathematics, and particularly in analysis, an ordinary differential equation (or ODE) is an equation that involves the derivatives of an unknown function of one variable. A simple example of an ordinary differential equation is
- ,
where is an unknown function, and is its derivative.
See differential calculus and integral calculus for basic calculus background.
Definition
Let y represent an unknown function of x, and let
denote the derivatives
An ordinary differential equation (ODE) is an equation involving
- .
The order of a differential equation is the order of the highest derivative that appears.
A solution of an ODE is a function y(x) whose derivatives satisfy the equation. Such a function is not guaranteed to exist and, if it does exist, is usually not unique.
When a differential equation of order n has the form
it is called an implicit differential equation whereas the form
is called an explicit differential equation.
A differential equation not depending on x is called autonomous, and one with no terms depending only on x is called homogeneous.
General application
An important special case is when the equations do not involve . These differential equations may be represented as vector fields. This type of differential equations has the property that space can be divided into equivalence classes based on whether two points lie on the same solution curve. Since the laws of physics are believed not to change with time, the physical world is governed by such differential equations. (See also symplectic topology for abstract discussion.)
The problem of solving a differential equation is to find the function whose derivatives satisfy the equation. For example, the differential equation
has the general solution
- ,
where A, B are constants determined from boundary conditions. In the case where the equations are linear, this can be done by breaking the original equation down into smaller equations, solving those, and then adding the results back together. Unfortunately, many of the interesting differential equations are non-linear, which means that they cannot be broken down in this way. There are also a number of techniques for solving differential equations using a computer (see numerical ordinary differential equations).
Ordinary differential equations are to be distinguished from partial differential equations where is a function of several variables, and the differential equation involves partial derivatives.
Types of differential equations with some history
The influence of geometry, physics, and astronomy, starting with Newton and Leibniz, and further manifested through the Bernoullis, Riccati, and Clairaut, but chiefly through d'Alembert and Euler, has been very marked, and especially on the theory of linear partial differential equations with constant coefficients.
Homogeneous Linear ODEs with constant coefficients
The first method of integrating linear ordinary differential equations with constant coefficients is due to Euler, who made the solutions of
depend on those of the algebraic equation of the nth degree
in which zk takes the place of
This equation F(z) = 0, is the "characteristic" equation considered later by Monge and Cauchy.
If z is a (possibly not real) zero of F(z) of multiplicity m and then is a solution of the ODE. These functions make up a basis of the ODE's solutions.
If the Ai are real then real-valued solutions are preferable. Since the non-real z values will come in conjugate pairs, so will their corresponding ys; replace each pair with their linear combinations Re(y) and Im(y).
A case that involves complex roots can be solved with the aid of Euler's formula.
- Example: Given . The characteristic equation is which has zeroes 2+i and 2−i. Thus the solution basis is . Now y is a solution iff for .
Because the coefficients are real,
- we are likely not interested in the complex solutions
- our basis elements are mutual conjugates
The linear combinations
- and
will give us a real basis in .
Linear ODEs with constant coefficients
Suppose instead we face
For later convenience, define the characteristic polynomial
We find the solution basis as in the homogeneous (f=0) case. We now seek a particular solution yp by the variation of parameters method. Let the coefficients of the linear combination be functions of x:
Using the "operator" notation and a broad-minded use of notation, the ODE in question is ; so
With the constraints
- …
the parameters commute out, with a little "dirt":
But , therefore
This, with the constraints, gives a linear system in the . This much can always be solved; in fact, combining Cramer's rule with the Wronskian,
The rest is a matter of integrating .
The particular solution is not unique; also satisfies the ODE for any set of constants cj.
See also variation of parameters.
Example: Suppose . We take the solution basis found above .
Using the list of integrals of exponential functions
And so
(Notice that u1 and u2 had factors that canceled y1 and y2; that is typical.)
For interest's sake, this ODE has a physical interpretation as a driven damped harmonic oscillator; yp represents the steady state, and is the transient.
Linear ODEs with variable coefficient
Method of undetermined coefficients
The method of undetermined coefficients (MoUC), is useful in finding solution for . Given the ODE , find another differential operator such that ; this is called the annihilator. Applying to both sides of the ODE gives an homogeneous ODE for which we find a solution basis as before. Then the original nonhomogeneous ODE is used to construct a system of equations restricting the coefficients of the linear combinations to satisfy the ODE.
Undetermined coefficients is not as general as variation of parameters in the sense that an annihilator does not always exist.
Example: Given , . The simplest annihilator of is . The zeros of are , so the solution basis of is .
Setting we find
giving the system
which has solutions
- ,
giving the solution set
Method of variation of parameters
As explained above, the general solution to a non-homogeneous, linear differential equation can be expressed as the sum of the general solution to the corresponding homogenous, linear differential equation and any one solution to .
Like the method of undetermined coefficients, described above, the method of variation of parameters is a method for finding one solution to , having already found the general solution to . Unlike the method of undetermined coefficients, which fails except with certain specific forms of g(x), the method of variation of parameters will always work; however, it is significantly more difficult to use.
For a second-order equation, the method of variation of parameters makes use of the following fact:
Fact
Let p(x), q(x), and g(x) be functions, and let and be solutions to the homogeneous, linear differential equation . Further, let u(x) and v(x) be functions such that and for all x, and define . Then is a solution to the non-homogeneous, linear differential equation .
Proof
Usage
To solve the second-order, non-homogeneous, linear differential equation using the method of variation of parameters, use the following steps:
- Find the general solution to the corresponding homogeneous equation . Specifically, find two linearly independent solutions and .
- Since and are linearly independent solutions, their Wronskian is nonzero, so we can compute and . If the former is equal to u'(x) and the latter to v'(x), then u and v satisfy the two constraints given above: that and that . We can tell this after multiplying by the denominator and comparing coefficients.
- Integrate and to obtain u(x) and v(x), respectively. (Note that we only need one choice of u and v, so there is no need for constants of integration.)
- Compute . The function is one solution of .
- The general solution is , where and are arbitrary constants.
Higher-order equations
The method of variation of parameters can also be used with higher-order equations. For example, if , , and are linearly independent solutions to , then there exist functions u(x), v(x), and w(x) such that , , and . Having found such functions (by solving algebraically for u'(x), v'(x), and w'(x), then integrating each), we have , one solution to the equation .
Example
Solve the previous example, Recall . From technique learned from 3.1, LHS has root of that yield , (so , ) and its derivatives
where the Wronskian
were computed in order to seek solution to its derivatives.
Upon integration,
Computing and :
General solution method for first-order linear ODEs
For a first-order linear ODE, with coefficients that may or may not vary with t:
Then,
where is the constant of integration, and
Proof
This proof comes from Jean Bernoulli. Let
Suppose for some unknown functions u(t) and v(t) that x = uv.
Then
Substituting into the differential equation,
Now, the most important step: Since the differential equation is linear we can split this into two independent equations and write
Since v is not zero, the top equation becomes
The solution of this is
Substituting into the second equation
Since x = uv, for arbitrary constant C
First order differential equation with constant coefficients
As an illustrative example, consider a first order differential equation with constant coefficients:
This equation is particularly relevant to first order systems such as RC circuits, mass-damper systems.
After nondimensionalization, the equation becomes
In this case, p(t) = r(t) = 1.
Hence its solution by inspection is
Linear PDEs
The theory of linear partial differential equations may be said to begin with Lagrange (1779 to 1785). Monge (1809) treated ordinary and partial differential equations of the first and second order, uniting the theory to geometry, and introducing the notion of the "characteristic", the curve represented by , which was investigated by Darboux, Levy, and Lie.
First-order PDEs
Pfaff (1814, 1815) gave the first general method of integrating partial differential equations of the first order, of which Gauss (1815) gave an analysis. Cauchy (1819) gave a simpler method, attacking the subject from the analytical standpoint, but using the Monge characteristic. Cauchy also first stated the theorem (now called the Cauchy-Kovalevskaya theorem) that every analytic differential equation defines an analytic function, expressible by means of a convergent series.
Jacobi (1827) also gave an analysis of Pfaff's method, besides developing an original one (1836) which Clebsch published (1862). Clebsch's own method appeared in 1866, and others are due to Boole (1859), Korkine (1869), and A. Mayer (1872). Pfaff's problem (on total differential equations) was investigated by Natani (1859), Clebsch (1861, 1862), DuBois-Reymond (1869), Cayley, Baltzer, Frobenius, Morera, Darboux, and Lie.
The next great improvement in the theory of partial differential equations of the first order was made by Lie (1872), who placed the whole subject on a solid foundation. After about 1870, Darboux, Kovalevsky, Méray, Mansion, Graindorge, and Imschenetsky became prominent in this line. The theory of partial differential equations of the second and higher orders, beginning with Laplace and Monge, was notably advanced by Ampère (1840).
The integration of partial differential equations with three or more variables was the object of elaborate investigations by Lagrange, and his name became connected with certain subsidiary equations. It was he and Charpit who originated one of the methods for integrating the general equation with two variables; a method which now bears Charpit's name.
Singular solutions
The theory of singular solutions of ordinary and partial differential equations was a subject of research from the time of Leibniz, but only since the middle of the nineteenth century did it receive special attention. A valuable but little-known work on the subject is that of Houtain (1854). Darboux (starting in 1873) was a leader in the theory, and in the geometric interpretation of these solutions he opened a field which was worked by various writers, notably Casorati and Cayley. To the latter is due (1872) the theory of singular solutions of differential equations of the first order as accepted circa 1900.
Reduction to quadratures
The primitive attempt in dealing with differential equations had in view a reduction to quadratures. As it had been the hope of eighteenth-century algebraists to find a method for solving the general equation of the th degree, so it was the hope of analysts to find a general method for integrating any differential equation. Gauss (1799) showed, however, that the differential equation meets its limitations very soon unless complex numbers are introduced. Hence analysts began to substitute the study of functions, thus opening a new and fertile field. Cauchy was the first to appreciate the importance of this view. Thereafter the real question was to be, not whether a solution is possible by means of known functions or their integrals, but whether a given differential equation suffices for the definition of a function of the independent variable or variables, and if so, what are the characteristic properties of this function.
The Fuchsian theory
Two memoirs by Fuchs (Crelle, 1866, 1868), inspired a novel approach, subsequently elaborated by Thomé and Frobenius. Collet was a prominent contributor beginning in 1869, although his method for integrating a non-linear system was communicated to Bertrand in 1868. Clebsch (1873) attacked the theory along lines parallel to those followed in his theory of Abelian integrals. As the latter can be classified according to the properties of the fundamental curve which remains unchanged under a rational transformation, so Clebsch proposed to classify the transcendent functions defined by the differential equations according to the invariant properties of the corresponding surfaces f = 0 under rational one-to-one transformations.
Lie's theory
From 1870 Lie's work put the theory of differential equations on a more satisfactory foundation. He showed that the integration theories of the older mathematicians can, by the introduction of what are now called Lie groups, be referred to a common source; and that ordinary differential equations which admit the same infinitesimal transformations present comparable difficulties of integration. He also emphasized the subject of transformations of contact (Berührungstransformationen).
See also
- Examples of differential equations
- Differential equations of mathematical physics
- Differential equations from outside physics
- Difference equation
- Laplace transform applied to differential equations
- Boundary value problem
- List of dynamical systems and differential equations topics
External links
- EqWorld: The World of Mathematical Equations, containing a list of ordinary differential equations with their solutions.
- Example ODEs from exampleproblems.com.
Bibliography
- A. D. Polyanin and V. F. Zaitsev, Handbook of Exact Solutions for Ordinary Differential Equations (2nd edition)", Chapman & Hall/CRC Press, Boca Raton, 2003. ISBN 1-58488-297-2
- A. D. Polyanin, V. F. Zaitsev, and A. Moussiaux, Handbook of First Order Partial Differential Equations, Taylor & Francis, London, 2002. ISBN 0-415-27267-X
- D. Zwillinger, Handbook of Differential Equations (3rd edition), Academic Press, Boston, 1997.
- Refaat El Attar, Ordinary Differential Equations, Lulu Press, Morrisville NC, 2005. ISBN 1-41163-920-0.
- Hartman, Philip, Ordinary Differential Equations, 2nd Ed., Society for Industrial & Applied Math, 2002. ISBN 0898715105.