Ordinary differential equation
In mathematics, an ordinary differential equation (ODE) is a differential equation containing one or more functions of one independent variable and its derivatives. The term ordinary is used in contrast with the term partial differential equation which may be with respect to more than one independent variable.^{[1]}
A linear differential equation is a differential equation that is defined by a linear polynomial in the unknown function and its derivatives, that is an equation of the form
where , ..., and are arbitrary differentiable functions that do not need to be linear, and are the successive derivatives of the unknown function y of the variable x.
Among ordinary differential equations, linear differential equations play a prominent role for several reasons. Most elementary and special functions that are encountered in physics and applied mathematics are solutions of linear differential equations (see Holonomic function). When physical phenomena are modeled with nonlinear equations, they are generally approximated by linear differential equations for an easier solution. The few nonlinear ODEs that can be solved explicitly are generally solved by transforming the equation into an equivalent linear ODE (see, for example Riccati equation).
Some ODEs may be solved explicitly in terms of known functions and integrals. When it is not possible, one may often use the equation for computing the Taylor series of the solutions. For applied problems, one generally use numerical methods for ordinary differential equations for getting an approximation of the desired solution.
Background
Ordinary differential equations (ODEs) arise in many contexts of mathematics and science (social as well as natural). Mathematical descriptions of change use differentials and derivatives. Various differentials, derivatives, and functions become related to each other via equations, and thus a differential equation is a result that describes dynamically changing phenomena, evolution, and variation. Often, quantities are defined as the rate of change of other quantities (for example, derivatives of displacement with respect to time), or gradients of quantities, which is how they enter differential equations.
Specific mathematical fields include geometry and analytical mechanics. Scientific fields include much of physics and astronomy (celestial mechanics), meteorology (weather modelling), chemistry (reaction rates),^{[2]} biology (infectious diseases, genetic variation), ecology and population modelling (population competition), economics (stock trends, interest rates and the market equilibrium price changes).
Many mathematicians have studied differential equations and contributed to the field, including Newton, Leibniz, the Bernoulli family, Riccati, Clairaut, d'Alembert, and Euler.
A simple example is Newton's second law of motion — the relationship between the displacement x and the time t of an object under the force F, is given by the differential equation
which constrains the motion of a particle of constant mass m. In general, F is a function of the position x(t) of the particle at time t. The unknown function x(t) appears on both sides of the differential equation, and is indicated in the notation F(x(t)).^{[3]}^{[4]}^{[5]}^{[6]}
Definitions
In what follows, let y be a dependent variable and x an independent variable, and y = f(x) is an unknown function of x. The notation for differentiation varies depending upon the author and upon which notation is most useful for the task at hand. In this context, the Leibniz's notation (dy/dx,d^{2}y/dx^{2},...,d^{n}y/dx^{n}) is more useful for differentiation and integration, whereas Lagrange's notation (y′,y′′, ..., y^{(n)}) is more useful for representing derivatives of any order compactly, and Newton's notation is often used in physics for representing derivatives of low order with respect to time.
General definition
Given F, a function of x, y, and derivatives of y. Then an equation of the form
is called an explicit ordinary differential equation of order n.^{[7]}^{[8]}
More generally, an implicit ordinary differential equation of order n takes the form:^{[9]}
There are further classifications:
 Autonomous
 A differential equation not depending on x is called autonomous.
 Linear

A differential equation is said to be linear if F can be written as a linear combination of the derivatives of y:
where a_{i}(x) and r(x) are continuous functions in x.^{[7]}^{[10]}^{[11]}
The function r(x) is called the source term, leading to two further important classifications:^{[10]}^{[12]}  Homogeneous
 If r(x) = 0, and consequently one "automatic" solution is the trivial solution, y = 0. The solution of a linear homogeneous equation is a complementary function, denoted here by y_{c}.
 Nonhomogeneous (or inhomogeneous)
 If r(x) ≠ 0. The additional solution to the complementary function is the particular integral, denoted here by y_{p}.
 Nonlinear
 A differential equation that cannot be written in the form of a linear combination.
The general solution to a linear equation can be written as y = y_{c} + y_{p}.
System of ODEs
A number of coupled differential equations form a system of equations. If y is a vector whose elements are functions; y(x) = [y_{1}(x), y_{2}(x),..., y_{m}(x)], and F is a vectorvalued function of y and its derivatives, then
is an explicit system of ordinary differential equations of order n and dimension m. In column vector form:
These are not necessarily linear. The implicit analogue is:
where 0 = (0, 0,... 0) is the zero vector. In matrix form
For a system of the form , some sources also require that the Jacobian matrix be nonsingular in order to call this an implicit ODE [system]; an implicit ODE system satisfying this Jacobian nonsingularity condition can be transformed into an explicit ODE system. In the same sources, implicit ODE systems with a singular Jacobian are termed differential algebraic equations (DAEs). This distinction is not merely one of terminology; DAEs have fundamentally different characteristics and are generally more involved to solve than (nonsingular) ODE systems.^{[13]}^{[14]} Presumably for additional derivatives, the Hessian matrix and so forth are also assumed nonsingular according to this scheme, although note that any ODE of order greater than one can be [and usually is] rewritten as system of ODEs of first order,^{[15]} which makes the Jacobian singularity criterion sufficient for this taxonomy to be comprehensive at all orders.
Solutions
Given a differential equation
a function u: I ⊂ R → R is called a solution or integral curve for F, if u is ntimes differentiable on I, and
Given two solutions u: J ⊂ R → R and v: I ⊂ R → R, u is called an extension of v if I ⊂ J and
A solution that has no extension is called a maximal solution. A solution defined on all of R is called a global solution.
A general solution of an nthorder equation is a solution containing n arbitrary independent constants of integration. A particular solution is derived from the general solution by setting the constants to particular values, often chosen to fulfill set 'initial conditions or boundary conditions'.^{[16]} A singular solution is a solution that cannot be obtained by assigning definite values to the arbitrary constants in the general solution.^{[17]}
Theories
Singular solutions
The theory of singular solutions of ordinary and partial differential equations was a subject of research from the time of Leibniz, but only since the middle of the nineteenth century did it receive special attention. A valuable but littleknown work on the subject is that of Houtain (1854). Darboux (starting in 1873) was a leader in the theory, and in the geometric interpretation of these solutions he opened a field worked by various writers, notable ones being Casorati and Cayley. To the latter is due (1872) the theory of singular solutions of differential equations of the first order as accepted circa 1900.
Reduction to quadratures
The primitive attempt in dealing with differential equations had in view a reduction to quadratures. As it had been the hope of eighteenthcentury algebraists to find a method for solving the general equation of the nth degree, so it was the hope of analysts to find a general method for integrating any differential equation. Gauss (1799) showed, however, that the differential equation meets its limitations very soon unless complex numbers are introduced. Hence, analysts began to substitute the study of functions, thus opening a new and fertile field. Cauchy was the first to appreciate the importance of this view. Thereafter, the real question was to be not whether a solution is possible by means of known functions or their integrals but whether a given differential equation suffices for the definition of a function of the independent variable or variables, and, if so, what are the characteristic properties of this function.
Fuchsian theory
Two memoirs by Fuchs (Crelle, 1866, 1868), inspired a novel approach, subsequently elaborated by Thomé and Frobenius. Collet was a prominent contributor beginning in 1869, although his method for integrating a nonlinear system was communicated to Bertrand in 1868. Clebsch (1873) attacked the theory along lines parallel to those followed in his theory of Abelian integrals. As the latter can be classified according to the properties of the fundamental curve that remains unchanged under a rational transformation, so Clebsch proposed to classify the transcendent functions defined by the differential equations according to the invariant properties of the corresponding surfaces f = 0 under rational onetoone transformations.
Lie's theory
From 1870, Sophus Lie's work put the theory of differential equations on a more satisfactory foundation. He showed that the integration theories of the older mathematicians can, by the introduction of what are now called Lie groups, be referred to a common source, and that ordinary differential equations that admit the same infinitesimal transformations present comparable difficulties of integration. He also emphasized the subject of transformations of contact.
Lie's group theory of differential equations has been certified, namely: (1) that it unifies the many ad hoc methods known for solving differential equations, and (2) that it provides powerful new ways to find solutions. The theory has applications to both ordinary and partial differential equations.^{[18]}
A general approach to solve DEs uses the symmetry property of differential equations, the continuous infinitesimal transformations of solutions to solutions (Lie theory). Continuous group theory, Lie algebras, and differential geometry are used to understand the structure of linear and nonlinear (partial) differential equations for generating integrable equations, to find its Lax pairs, recursion operators, Bäcklund transform, and finally finding exact analytic solutions to the DE.
Symmetry methods have been recognized to study differential equations, arising in mathematics, physics, engineering, and many other disciplines.
Sturm–Liouville theory
Sturm–Liouville theory is a theory of a special type of second order linear ordinary differential equations. Their solutions are based on eigenvalues and corresponding eigenfunctions of linear operators defined in terms of secondorder homogeneous linear equations. The problems are identified as SturmLiouville Problems (SLP) and are named after J.C.F. Sturm and J. Liouville, who studied such problems in the mid1800s. The interesting fact about regular SLPs is that they have an infinite number of eigenvalues, and the corresponding eigenfunctions form a complete, orthogonal set, which makes orthogonal expansions possible. This is a key idea in applied mathematics, physics, and engineering.^{[19]} SLPs are also useful in the analysis of certain partial differential equations.
Existence and uniqueness of solutions
There are several theorems that establish existence and uniqueness of solutions to initial value problems involving ODEs both locally and globally. The two main theorems are
Theorem Assumption Conclusion Peano existence theorem F continuous local existence only Picard–Lindelöf theorem F Lipschitz continuous local existence and uniqueness
In their basic form both of these theorems only guarantee local results, though the latter can be extended to give a global result, for example, if the conditions of Grönwall's inequality are met.
Also, uniqueness theorems like the Lipschitz one above do not apply to DAE systems, which may have multiple solutions stemming from their (nonlinear) algebraic part alone.^{[20]}
Local existence and uniqueness theorem simplified
The theorem can be stated simply as follows.^{[21]} For the equation and initial value problem:
if F and ∂F/∂y are continuous in a closed rectangle
in the xy plane, where a and b are real (symbolically: a, b ∈ ℝ) and × denotes the cartesian product, square brackets denote closed intervals, then there is an interval
for some h ∈ ℝ where the solution to the above equation and initial value problem can be found. That is, there is a solution and it is unique. Since there is no restriction on F to be linear, this applies to nonlinear equations that take the form F(x, y), and it can also be applied to systems of equations.
Global uniqueness and maximum domain of solution
When the hypotheses of the Picard–Lindelöf theorem are satisfied, then local existence and uniqueness can be extended to a global result. More precisely:^{[22]}
For each initial condition (x_{0}, y_{0}) there exists a unique maximum (possibly infinite) open interval
such that any solution that satisfies this initial condition is a restriction of the solution that satisfies this initial condition with domain .
In the case that , there are exactly two possibilities
 explosion in finite time:
 leaves domain of definition:
where Ω is the open set in which F is defined, and is its boundary.
Note that the maximum domain of the solution
 is always an interval (to have uniqueness)
 may be smaller than
 may depend on the specific choice of (x_{0}, y_{0}).
 Example.
This means that F(x, y) = y^{2}, which is C^{1} and therefore locally Lipschitz continuous, satisfying the Picard–Lindelöf theorem.
Even in such a simple setting, the maximum domain of solution cannot be all since the solution is
which has maximum domain:
This shows clearly that the maximum interval may depend on the initial conditions. The domain of y could be taken as being but this would lead to a domain that is not an interval, so that the side opposite to the initial condition would be disconnected from the initial condition, and therefore not uniquely determined by it.
The maximum domain is not because
which is one of the two possible cases according to the above theorem.
Reduction of order
Differential equations can usually be solved more easily if the order of the equation can be reduced.
Reduction to a firstorder system
Any explicit differential equation of order n,
can be written as a system of n firstorder differential equations by defining a new family of unknown functions
for i = 1, 2,..., n. The ndimensional system of firstorder coupled differential equations is then
more compactly in vector notation:
where
Summary of exact solutions
Some differential equations have solutions that can be written in an exact and closed form. Several important classes are given here.
In the table below, P(x), Q(x), P(y), Q(y), and M(x,y), N(x,y) are any integrable functions of x, y, and b and c are real given constants, and C_{1}, C_{2},... are arbitrary constants (complex in general). The differential equations are in their equivalent and alternative forms that lead to the solution through integration.
In the integral solutions, λ and ε are dummy variables of integration (the continuum analogues of indices in summation), and the notation ∫^{x}F(λ) dλ just means to integrate F(λ) with respect to λ, then after the integration substitute λ = x, without adding constants (explicitly stated).
Type Differential equation Solution method General solution Separable Firstorder, separable in x and y (general case, see below for special cases)^{[23]} Separation of variables (divide by P_{2}Q_{1}). Firstorder, separable in x^{[21]} Direct integration. Firstorder, autonomous, separable in y^{[21]} Separation of variables (divide by F). Firstorder, separable in x and y^{[21]} Integrate throughout. General firstorder Firstorder, homogeneous^{[21]} Set y = ux, then solve by separation of variables in u and x. Firstorder, separable^{[23]} Separation of variables (divide by xy). If N = M, the solution is xy = C.
Exact differential, firstorder^{[21]} where
Integrate throughout. where Y(y) and X(x) are functions from the integrals rather than constant values, which are set to make the final function F(x, y) satisfy the initial equation.
Inexact differential, firstorder^{[21]} where
Integration factor μ(x, y) satisfying If μ(x, y) can be found: General secondorder Secondorder, autonomous^{[24]} Multiply both sides of equation by 2dy/dx, substitute , then integrate twice. Linear to nth order Firstorder, linear, inhomogeneous, function coefficients^{[21]} Integrating factor: Secondorder, linear, inhomogeneous, constant coefficients^{[25]} Complementary function y_{c}: assume y_{c} = e^{αx}, substitute and solve polynomial in α, to find the linearly independent functions . Particular integral y_{p}: in general the method of variation of parameters, though for very simple r(x) inspection may work.^{[21]}
If b^{2} > 4c, then
If b^{2} = 4c, then
If b^{2} < 4c, then
nthorder, linear, inhomogeneous, constant coefficients^{[25]} Complementary function y_{c}: assume y_{c} = e^{αx}, substitute and solve polynomial in α, to find the linearly independent functions . Particular integral y_{p}: in general the method of variation of parameters, though for very simple r(x) inspection may work.^{[21]}
Since α_{j} are the solutions of the polynomial of degree n: , then:
for α_{j} all different,
for each root α_{j} repeated k_{j} times,
for some α_{j} complex, then setting α = χ_{j} + iγ_{j}, and using Euler's formula, allows some terms in the previous results to be written in the form
where ϕ_{j} is an arbitrary constant (phase shift).
Software for ODE solving
 Maxima, an opensource computer algebra system.
 COPASI, a free (Artistic License 2.0) software package for the integration and analysis of ODEs.
 MATLAB, a technical computing application (MATrix LABoratory)
 GNU Octave, a highlevel language, primarily intended for numerical computations.
 Scilab, an open source application for numerical computation.
 Maple, a proprietary application for symbolic calculations.
 Mathematica, a proprietary application primarily intended for symbolic calculations.
 Julia (programming language), a highlevel, multiparadigm, opensource, dynamic programming language primarily intended for numerical computations, although it is flexible enough for generalpurpose programming.
 SageMath, an opensource application that uses a Pythonlike syntax with a wide range of capabilities spanning several branches of mathematics.
 SciPy, a Python package that includes an ODE integration module.
 Chebfun, an opensource package, written in MATLAB, for computing with functions to 15digit accuracy.
 GNU R, an open source computational environment primarily intended for statistics, which includes package for ODE solving.
 EROS.NET a free ODE solver for .NET.
See also
 Examples of differential equations
 Boundary value problem
 Laplace transform applied to differential equations
 List of dynamical systems and differential equations topics
 Matrix differential equation
 Method of undetermined coefficients
 Numerical methods for ordinary differential equations
 Recurrence relation
 Separation of variables
Notes
 ↑ "What is the origin of the term "ordinary differential equations"?". hsm.stackexchange.com. Stack Exchange. Retrieved 20160728.
 ↑ Mathematics for Chemists, D.M. Hirst, Macmillan Press, 1976, (No ISBN) SBN: 333181727
 ↑ Kreyszig (1972, p. 64)
 ↑ Simmons (1972, pp. 1,2)
 ↑ Halliday & Resnick (1977, p. 78)
 ↑ Tipler (1991, pp. 78–83)
 1 2 Harper (1976, p. 127)
 ↑ Kreyszig (1972, p. 2)
 ↑ Simmons (1972, p. 3)
 1 2 Kreyszig (1972, p. 24)
 ↑ Simmons (1972, p. 47)
 ↑ Harper (1976, p. 128)
 ↑ Uri M. Ascher; Linda R. Petzold (1998). Computer Methods for Ordinary Differential Equations and DifferentialAlgebraic Equations. SIAM. p. 12. ISBN 9781611971392.
 ↑ Achim Ilchmann; Timo Reis (2014). Surveys in DifferentialAlgebraic Equations II. Springer. pp. 104–105. ISBN 9783319110509.
 ↑ Uri M. Ascher; Linda R. Petzold (1998). Computer Methods for Ordinary Differential Equations and DifferentialAlgebraic Equations. SIAM. p. 5. ISBN 9781611971392.
 ↑ Kreyszig (1972, p. 78)
 ↑ Kreyszig (1972, p. 4)
 ↑ Lawrence (1999, p. 9)
 ↑ Logan, J. (2013). Applied mathematics (Fourth ed.).
 ↑ Uri M. Ascher; Linda R. Petzold (1998). Computer Methods for Ordinary Differential Equations and DifferentialAlgebraic Equations. SIAM. p. 13. ISBN 9781611971392.
 1 2 3 4 5 6 7 8 9 10 Elementary Differential Equations and Boundary Value Problems (4th Edition), W.E. Boyce, R.C. Diprima, Wiley International, John Wiley & Sons, 1986, ISBN 0471838241
 ↑ Boscain; Chitour 2011, p. 21
 1 2 Mathematical Handbook of Formulas and Tables (3rd edition), S. Lipschutz, M. R. Spiegel, J. Liu, Schuam's Outline Series, 2009, ISC_2N 9780071548557
 ↑ Further Elementary Analysis, R. Porter, G.Bell & Sons (London), 1978, ISBN 0713515945
 1 2 Mathematical methods for physics and engineering, K.F. Riley, M.P. Hobson, S.J. Bence, Cambridge University Press, 2010, ISC_2N 9780521861533
References
 Halliday, David; Resnick, Robert (1977), Physics (3rd ed.), New York: Wiley, ISBN 0471717169
 Harper, Charlie (1976), Introduction to Mathematical Physics, New Jersey: PrenticeHall, ISBN 0134875389
 Kreyszig, Erwin (1972), Advanced Engineering Mathematics (3rd ed.), New York: Wiley, ISBN 0471507288 .
 Polyanin, A. D. and V. F. Zaitsev, Handbook of Exact Solutions for Ordinary Differential Equations (2nd edition)", Chapman & Hall/CRC Press, Boca Raton, 2003. ISBN 1584882972
 Simmons, George F. (1972), Differential Equations with Applications and Historical Notes, New York: McGrawHill, LCCN 75173716
 Tipler, Paul A. (1991), Physics for Scientists and Engineers: Extended version (3rd ed.), New York: Worth Publishers, ISBN 0879014326
 Boscain, Ugo; Chitour, Yacine (2011), Introduction à l'automatique (PDF) (in French)
 Dresner, Lawrence (1999), Applications of Lie's Theory of Ordinary and Partial Differential Equations, Bristol and Philadelphia: Institute of Physics Publishing, ISBN 9780750305303
Bibliography
 Coddington, Earl A.; Levinson, Norman (1955). Theory of Ordinary Differential Equations. New York: McGrawHill.
 Hartman, Philip (2002) [1964], Ordinary differential equations, Classics in Applied Mathematics, 38, Philadelphia: Society for Industrial and Applied Mathematics, doi:10.1137/1.9780898719222, ISBN 9780898715101, MR 1929104
 W. Johnson, A Treatise on Ordinary and Partial Differential Equations, John Wiley and Sons, 1913, in University of Michigan Historical Math Collection
 Ince, Edward L. (1944) [1926], Ordinary Differential Equations, Dover Publications, New York, ISBN 9780486603490, MR 0010757
 Witold Hurewicz, Lectures on Ordinary Differential Equations, Dover Publications, ISBN 0486495108
 Ibragimov, Nail H (1993). CRC Handbook of Lie Group Analysis of Differential Equations Vol. 13. Providence: CRCPress. ISBN 0849344883 .
 Teschl, Gerald (2012). Ordinary Differential Equations and Dynamical Systems. Providence: American Mathematical Society. ISBN 9780821883280.
 A. D. Polyanin, V. F. Zaitsev, and A. Moussiaux, Handbook of First Order Partial Differential Equations, Taylor & Francis, London, 2002. ISBN 041527267X
 D. Zwillinger, Handbook of Differential Equations (3rd edition), Academic Press, Boston, 1997.
External links
Wikibooks has a book on the topic of: Calculus/Ordinary differential equations 
Wikimedia Commons has media related to Ordinary differential equations. 
 Hazewinkel, Michiel, ed. (2001) [1994], "Differential equation, ordinary", Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 9781556080104
 Differential Equations at Curlie (based on DMOZ) (includes a list of software for solving differential equations).
 EqWorld: The World of Mathematical Equations, containing a list of ordinary differential equations with their solutions.
 Online Notes / Differential Equations by Paul Dawkins, Lamar University.
 Differential Equations, S.O.S. Mathematics.
 A primer on analytical solution of differential equations from the Holistic Numerical Methods Institute, University of South Florida.
 Ordinary Differential Equations and Dynamical Systems lecture notes by Gerald Teschl.
 Notes on Diffy Qs: Differential Equations for Engineers An introductory textbook on differential equations by Jiri Lebl of UIUC.
 Modeling with ODEs using Scilab A tutorial on how to model a physical system described by ODE using Scilab standard programming language by Openeering team.
 Solving an ordinary differential equation in WolframAlpha