0 Finite Difference
0 Finite Difference
0 Finite Difference
Contents
[hide]
3 Higher-order differences
o
3.2 Properties
5 Newton's series
8 Generalizations
10 See also
11 References
12 External links
Depending on the application, the spacing h may be variable or constant. When omitted, h is taken to be 1:
A backward difference uses the function values at x and x h, instead of the values at x + h and x:
If h has a fixed (non-zero) value instead of approaching zero, then the right-hand side of the above equation would be written
Hence, the forward difference divided by h approximates the derivative when h is small. The error in this approximation can be
derived from Taylor's theorem. Assuming that f is differentiable, we have for the forward difference:
However, the central (also called centered) difference yields a more accurate approximation. If f is twice differentiable,
The main problem with the central difference method, however, is that oscillating functions can yield zero derivative. If f(nh)=1 for n
odd, and f(nh)=2 for n even, then f ' (nh)=0 if it is calculated with the central difference scheme. This is particularly troublesome if
the domain of f is discrete.
Authors for whom finite differences mean finite difference approximations define the forward/backward/central differences as the
quotients given in this section (instead of employing the definitions given in the previous section).[1][2][3]
See also: Symmetric derivative
Higher-order differences
In an analogous way one can obtain finite difference approximations to higher order derivatives and differential operators. For
example, by using the above central difference formula for f ' (x+h/2) and f ' (xh/2) and applying a central difference formula for
the derivative of f ' at x, we obtain the central difference approximation of the second derivative of f:
2nd order central
More generally, the n-th order forward, backward, and central differences are given by, respectively,
Forward
or for h=1,
Backward
Central
These equations are using binomial coefficients after the summation sign shown as
coefficient for each value of i.
Note that the central difference will, for odd n, have h multiplied by non-integers. This is often a problem because it amounts to
changing the interval of discretization. The problem may be remedied taking the average of
and
Forward differences applied to a sequence are sometimes called the binomial transform of the sequence, and have a number of
interesting combinatorial properties. Forward differences may be evaluated using the NrlundRice integral. The integral
representation for these types of series is interesting, because the integral can often be evaluated using asymptotic expansion or saddlepoint techniques; by contrast, the forward difference series can be extremely hard to evaluate numerically, because the binomial
coefficients grow rapidly for large n.
The relationship of these higher-order differences with the respective derivatives is straightforward,
Higher-order differences can also be used to construct better approximations. As mentioned above, the first-order difference
approximates the first-order derivative up to a term of order h. However, the combination
approximates f'(x) up to a term of order h2. This can be proven by expanding the above expression in Taylor series, or by using the
calculus of finite differences, explained below.
If necessary, the finite difference can be centered about any point by mixing forward, backward, and central differences.
Properties[edit]
Leibniz rule:
Common applications of the finite difference method are in computational science and engineering disciplines, such as thermal
engineering, fluid mechanics, etc.
Newton's series
The Newton series consists of the terms of the Newton forward difference equation, named after Isaac Newton; in essence, it is the
Newton interpolation formula, first published in his Principia Mathematica in 1687,[5] namely the discrete analog of the continuum
Taylor expansion,
which holds for any polynomial function f and for most (but not all) analytic functions. Here, the expression
is the "falling factorial" or "lower factorial", while the empty product (x)0 is defined to be 1. In this particular case, there is an
assumption of unit steps for the changes in the values of x, h = 1 of the generalization below.
Note the formal correspondence of this result to Taylor's theorem. Historically, this, as well as the ChuVandermonde identity,
(following from it, and corresponding to the binomial theorem), are included in the observations that matured to the system of the
umbral calculus.
To illustrate how one may use Newton's formula in actual practice, consider the first few terms of doubling the Fibonacci sequence
f = 2, 2, 4, ... One can find a polynomial that reproduces these values, by first computing a difference table, and then substituting the
differences that correspond to x0 (underlined) into the formula as follows,
For the case of nonuniform steps in the values of x, Newton computes the divided differences,
.[6]
In analysis with p-adic numbers, Mahler's theorem states that the assumption that f is a polynomial function can be weakened all the
way to the assumption that f is merely continuous.
Carlson's theorem provides necessary and sufficient conditions for a Newton series to be unique, if it exists. However, a Newton series
does not, in general, exist.
The Newton series, together with the Stirling series and the Selberg series, is a special case of the general difference series, all of
which are defined in terms of suitably scaled forward differences.
In a compressed and slightly more general form and equidistant nodes the formula reads
where Th is the shift operator with step h, defined by Th[f ](x) = f(x+h), and I is the identity operator.
The finite difference of higher orders can be defined in recursive manner as hn h (hn1). Another equivalent definition is hn =
[Th I]n.
The difference operator h is a linear operator and it satisfies a special Leibniz rule indicated above, h(f(x)g(x)) = (hf(x)) g(x+h)
+ f(x) (hg(x)). Similar statements hold for the backward and central differences.
Formally applying the Taylor series with respect to h, yields the formula
where D denotes the continuum derivative operator, mapping f to its derivative f'. The expansion is valid when both sides act on
analytic functions, for sufficiently small h. Thus, Th=ehD, and formally inverting the exponential yields
This formula holds in the sense that both operators give the same result when applied to a polynomial.
Even for analytic functions, the series on the right is not guaranteed to converge; it may be an asymptotic series. However, it can be
used to obtain more accurate approximations for the derivative. For instance, retaining the first two terms of the series yields the
second-order approximation to f(x) mentioned at the end of the section Higher-order differences.
The analogous formulas for the backward and central difference operators are
The calculus of finite differences is related to the umbral calculus of combinatorics. This remarkably systematic correspondence is due
to the identity of the commutators of the umbral quantities to their continuum analogs (h0 limits),
A large number of formal differential relations of standard calculus involving functions f(x) thus map systematically to umbral finitedifference analogs involving f(xTh1).
For instance, the umbral analog of a monomial xn is a generalization of the above falling factorial (Pochhammer k-symbol),
,
so that
hence the above Newton interpolation formula (by matching coefficients in the expansion of an arbitrary function f(x) in such
symbols), and so on.
For example, the umbral sine is
and hence Fourier sums of continuum functions are readily mapped to umbral Fourier sums faithfully, i.e., involving the same Fourier
coefficients multiplying these umbral basis exponentials.[9] This umbral exponential thus amounts to the exponential generating
function of the Pochhammer symbols.
Thus, for instance, the Dirac delta function maps to its umbral correspondent, the cardinal sine function,
and so forth.[10] Difference equations can often be solved with techniques very similar to those for solving differential equations.
The inverse operator of the forward difference operator, so then the umbral integral, is the indefinite sum or antidifference operator.
All of the above rules apply equally well to any difference operator, including
Product rule:
Quotient rule:
or
Summation rules:
Generalizations[edit]
as to
where
is its coefficients vector. An infinite difference is a further generalization, where the finite sum above is
depend on point
considering weighted finite difference. Also one may make step depend on point
constructing different modulus of continuity.
, thus
As a convolution operator: Via the formalism of incidence algebras, difference operators and other Mbius inversion can be
represented by convolution with a function on the poset, called the Mbius function ; for the difference operator, is the
sequence (1, 1, 0, 0, 0, ...).
Alternatively, for applications in which the computation of f is the most costly step, and both first and second derivatives must be
computed, a more efficient formula for the last case is
since the only values to compute that are not already needed for the previous four equations are f(x+h, y+k) and f(xh, yk).
See also[edit]
Arc elasticity
Carlson's theorem
Divided differences
Five-point stencil
Gilbreath's conjecture
Lagrange polynomial
Modulus of continuity
Newton polynomial
NrlundRice integral
Numerical differentiation
Sheffer sequence
Summation by parts
Taylor series
Umbral calculus
References[edit]
1. ^ Jump up to: a b c Paul Wilmott; Sam Howison; Jeff Dewynne (1995). The Mathematics of Financial Derivatives: A Student Introduction.
Cambridge University Press. p. 137. ISBN 978-0-521-49789-3.
2. ^ Jump up to: a b c Peter Olver (2013). Introduction to Partial Differential Equations. Springer Science & Business Media. p. 182.
ISBN 978-3-319-02099-0.
3. ^ Jump up to: a b c M Hanif Chaudhry (2007). Open-Channel Flow. Springer. p. 369. ISBN 978-0-387-68648-6.
4. Jump up ^ Jordn, op. cit., p. 1 and Milne-Thomson, p. xxi. Milne-Thomson, Louis Melville (2000): The Calculus of Finite Differences
(Chelsea Pub Co, 2000) ISBN 978-0821821077
5. Jump up ^ Newton, Isaac, (1687). Principia, Book III, Lemma V, Case 1
6. Jump up ^ Richtmeyer, D. and Morton, K.W., (1967). Difference Methods for Initial Value Problems, 2nd ed., Wiley, New York.
7. Jump up ^ Boole, George, (1872). A Treatise On The Calculus of Finite Differences, 2nd ed., Macmillan and Company. On line. Also,
[Dover edition 1960]
8. Jump up ^ Jordan, Charles, (1939/1965). "Calculus of Finite Differences", Chelsea Publishing. On-line: [1]
9. Jump up ^ Zachos, C. (2008). "Umbral Deformations on Discrete Space-Time". International Journal of Modern Physics A 23 (13):
20052014. doi:10.1142/S0217751X08040548.
10. Jump up ^ Curtright, T. L.; Zachos, C. K. (2013). "Umbral Vade Mecum". Frontiers in Physics 1. doi:10.3389/fphy.2013.00015.
11. Jump up ^ Levy, H.; Lessman, F. (1992). Finite Difference Equations. Dover. ISBN 0-486-67260-3.
12. Jump up ^ Ames, W. F., (1977). Numerical Methods for Partial Differential Equations, Section 1.6. Academic Press, New York. ISBN 012-056760-1.
13. Jump up ^ Hildebrand, F. B., (1968). Finite-Difference Equations and Simulations, Section 2.2, Prentice-Hall, Englewood Cliffs, New
Jersey.
14. Jump up ^ Flajolet, Philippe; Sedgewick, Robert (1995). "Mellin transforms and asymptotics: Finite differences and Rice's integrals"
(PDF). Theoretical Computer Science 144 (12): 101124. doi:10.1016/0304-3975(94)00281-M.
Richardson, C. H. (1954): An Introduction to the Calculus of Finite Differences (Van Nostrand (1954) online copy
Mickens, R. E. (1991): Difference Equations: Theory and Applications (Chapman and Hall/CRC) ISBN 978-0442001360
External links[edit]
Hazewinkel, Michiel, ed. (2001), "Finite-difference calculus", Encyclopedia of Mathematics, Springer, ISBN 978-1-55608010-4
Table of useful finite difference formula generated using Mathematica
Mathematical analysis