Numerical Analysis For Singularity Perturbed Differential Equations and Its Applications
Advancements in Numerical Analysis for Singularly Perturbed Differential Equations
by Aabid Mushtaq*,
- Published in Journal of Advances in Science and Technology, E-ISSN: 2230-9659
Volume 7, Issue No. 14, Aug 2014, Pages 0 - 0 (0)
Published by: Ignited Minds Journals
ABSTRACT
In this talk, I will discuss the role of numericalanalysis in the design of numerical algorithms to approximately solve certainclasses of singularly perturbed differential equations. The solutions ofsingularly perturbed differential equation have narrow layer regions in thedomain, where the solution exhibits steep gradients. Classical numericalmethods suffer major defects in these regions. Alternative computationalapproaches will be discussed and the central issues in the associated numericalanalysis of these layer-adapted algorithms will be outlined. We present new results in the numerical analysis ofsingularly perturbed convection-diffusion- reaction problems that have appearedin the last five years. Mainly discussing layer-adapted meshes, we present alsoa survey on stabilization methods, adaptive methods, and on systems ofsingularly perturbed equations. In this paper a singularly perturbed reaction-diffusionequation with a discontinuous source term is examined. A numerical method isconstructed for this problem which involves an appropriate piecewise-uniformmesh. The method is shown to be uniformly convergent with respect to thesingular perturbation parameter. An exponentially-fitted method for singularly perturbed,one-dimensional parabolic equations and ordinary differential equations both ofthe convection-diffusion-reaction type in equally-spaced grids is presented. Singular perturbation problems with turning points ariseas mathematical models for various physical phenomena. The problem withinterior turning point represent one-dimensional version of stationaryconvection- diffusion problems with a dominant convective term and a speedfield that changes its sign in the catch basin.
KEYWORD
numerical analysis, singularity perturbed differential equations, numerical algorithms, narrow layer regions, gradient, computational approaches, numerical analysis, convection-diffusion-reaction problems, layer-adapted meshes, stabilization methods, adaptive methods, systems of singularly perturbed equations, singularly perturbed reaction-diffusion equation, discontinuous source term, numerical method, exponentially-fitted method, one-dimensional parabolic equations, ordinary differential equations, turning points, mathematical models, physical phenomena, interior turning point, stationary convection-diffusion problems, catch basin
INTRODUCTION
A singular perturbation problem is a problem which depends on a parameter (or parameters) in such a uay that solutions of the problem behave nonuniformly as the parameter tends toward some limiting value of interest. Such singular perturbation problems involving differential equations arise in many areas of interest, e.g. modelling of semi-conductor devices, aero-dynamics, fluid mechanics, thin shells. We illustrate some of the nonuniformities that occur with some simple prototypes. There are two main approaches to solving differential equations numerically: (1) Finite Difference Methods In one dimension, divide the interval [a,b] into N sub- intervals Replace y and its derivatives in the differential equation by suitable (difference) approximations e.g. replace and then replace the coefficients of the derivatives by an appropriate approximation. e.g. onreplace generate a set of pointsas an approximation to the set (2) Finite Element Methods A function u(x) is generated by discretizing a weak form of the differential equation. This function approximates the solution y(x) globally. In this note we will confine the discussion to finite difference methods. Classical numerical methods perform badly (to say the least) when applied to singularly perturbed problems. In particular, their atrocious behaviour is most noticeable in non-self-adjoint problems. Singularly perturbed differential equations arise in many branches of science and engineering. The solutions of such equations have boundary and interior layers. That is, there are thin layer(s) where the solution changes rapidly, while away from the layer(s) the solution behaves regularly and changes slowly. So the numerical treatment of singularly perturbed differential equations gives major computational difficulties, and in recent years, a large number of special purpose methods have been developed to provide accurate numerical solutions which cover mostly second order equations. But only a very few authors have developed numerical methods for singularly perturbed higher order differential equations [IT]. Moreover, most of them have concentrated only on the problems with smooth data. Of course, some authors have recently considered Singular Perturbation Problems (SPPs) for second order ODEs with discontinuous source term and discontinuous convection coefficient. Due to the discontinuity at one or more points in the interior domain, this gives rise to an interior layer(s) in the exact solution of the problem, in addition to the boundary layer at the outflow boundary point. Therefore, these types of SPPs have to be dealt with separately and carefully. In this paper, an asymptotic numerical method for singularly perturbed react ion-diffusion type third order ODE with a discontinuous source term is developed. The classification of singularly perturbed higher order problems (reaction-diffusion/convection-diffusion) depend on how the order of the original equation is affected if one sets e = 0. If the order is reduced by one, we say that the problem is of convection-diffusion type, and of reaction-diffusion type if the order is reduced by two. Systems involving several time scales often assume the prototypical form whereandis a small parameter and we use the "overdot" to denote derivatives with respect to the free variable, i.e.,andare globally Lipschitz and uniformly bounded in, thenwill be of orderfaster than. Accordingly, we call x the slow variables and y the fast variables of the system. The analyses of singularly perturbed differential equations such as (1) often boil down to linear operator equations of the type (see, e.g., for a treatment of stochastic systems)
(2)
Hereis a differential operator that is defined on some Banach space subject to suitable boundary conditions andis a shorthand for (x, y). If we confine our attention to the aforementioned class of problems (averaging or geometric singular perturbation) the operator typically takes the form whereand"generate" the slow and fast dynamics, respectively. (The properties ofdepend on the actual problem and will be discussed later on in the text.) Notice thatandmay still depend on, but the dominant singularity is as sketched. We seek a perturbative expansion of the solution of (2) that has the form Hence (1.6) can be recast as and equating powers ofyields a hierarchy of equations the first two of which are
Aabid Mushtaq
The first equation implies that the lowest-order perturbation approximation of (1) lies in the nullspace of, which typically entails a condition of the form. Averaging or geometric singular perturbation theory now consists in finding an appropriate closure of the second equation subject to. This results in an effective equation for, namely, Once the effective linear operatorhas been computed fromand, the result can be reinterpreted in terms of the corresponding differential equation to give
GEOMETRIC SINGULAR PERTURBATION THEORY
Consider the following system of singularly perturbed ordinary differential equation
(3)
foraid. Here and in the following we omit the parameter, i.e., we write, and so on; the meaning should be always clear from the context and we indicate otherwise when not. We denote the solution of the associated system
(4)
and recall that the first (i.e., slow) equation in (3) can be approximately viewed as an equation of the form Let us suppose that valueand uniformly in, i.e., the rate of convergence is independent of the slow variable. In particular, for fixed and, by the above argument, we may replace (4.1) by the equation whenever e is sufficiently small. We shall give an example. Example 4.1 Consider the linear system We suppose that, i.e., all eigenvalues of A22 lie in the open left complex half-plane. As we shall see this is equivalent to the statement that the fast subsystem is asymptotically stable. The associated system is easily solvable using variation of constants, viz., Note thatis invertible by the stability assumption above. Furthermore The vector field for a planar linear system withandis shown in Figure 1 below. The leftmost plot shows various solutions for e whereas the right figure depicts solutions (blue curves) for . It turns out that the solutions quickly converge to the null cline (fast dynamics) before converging to the asymptotically stable fixed pointalong the nullcline (slow dynamics). Note that the nullcline corresponds to the invariant subspace that is defined by the equation. If, the subspace is attractive (i.e., asymptotically stable). Fig. 1 Planar linear system An = A22 = —1, A12 = A21 = -1/2 for e = 1 (left panel) and e = 0.05 (right panel). The orange line shows the nullcline y = 0.
ROBUST NUMERICAL METHODS FOR SINGULARLY PERTURBED DIFFERENTIAL EQUATIONS: A SURVEY 5. SINGULARLY PERTURBED SYSTEMS
In 2009, Linss and Stynes presented a survey on the numerical solution of singularly perturbed systems. In this Section we only comment on some recent results not contained in which sparkle that survey. First we study systems of reaction-diffusion equations of the form
(5)
wherewith. If the matrix A satisfies certain conditions, the asymptotic behavior of such a system is well understood. Assume that A has positive diagonal entries, moreover the matrixdefined by
(6)
satisfies. Then, in the existence of a solution decomposition is proved. Other authors assume that A is an M-matrix or that A is point-wise positive definite. See for establishing a connection between positive definiteness and the property . In a full asymptotic expansion is derived for positive definite A in the case of two equations, including information on analytic regularity. Systems of convection-diffusion problems are more delicate to handle. Consider first weakly coupled systems of the form
(7) (8)
Then it was shown in for
(9)
When only first order derivatives are considered, there is no strong interaction between the layers of different components unlike the reaction-diffusion case. But, consider for example a set of two equations withandfor Then the layer at x = 1 in the first component generates a weak layer at x = 1 in the second component; the situation at* = 0 is analogous. Under certain conditions , one can prove the existence of the following solution decomposition for:
(10)
11)
Hereis some positive parameter. This observation is important for control problems governed by convection-diffusion equations:
(12)
subject to
(13)
For strongly coupled systems of convection-diffusion equations full layer-interaction takes place. Consider the system of two equations
(14)
assuming
Aabid Mushtaq
(V2)is positive semidefinite. (V3) The eigenvalues of B satisfyfor all x. If both eigenvalues of B are positive, both solution components do have overlapping layers at x = 0, the reduced solution solves an initial value problem. But if the eigenvalues do have a different sign, both solution components do have layers at x = 0 and x = 1; we have full layer interaction. It is remarkable that the reduced solution, in general, does not satisfy any of the given boundary conditions. Even more complicated are strongly coupled systems with several small parameters of the form
(15)
Some a priori estimates are to find in, information on the layer structure in.
A REVIEW ON SINGULARLY PERTURBED DIFFERENTIAL EQUATIONS WITH TURNING POINTS AND INTERIOR LAYERS
Many phenomena in biology, chemistry, engineering, physics, etc., can be described by boundary value problems associated with various type of differential equations or systems. Whenever a mathematical model is associated with a phenomenon, the researchers generally try to capture what is essential, retaining the important quantities and omitting the negligible ones which involve small parameters. The model that would be obtained by maintaining the small parameters is called the perturbed model, whereas the simplified model (the one that does not include the small parameters) is called the unperturbed (or reduced) model. For study purpose the perturbed model can be replaced by its unperturbed counterpart but what matters is that its solution must be "close enough" to the solution of the corresponding perturbed model. This fact holds good in case of regular perturbation but, in the case of singular perturbation it is very unlikely to hold. These singular perturbation problems with or without turning point(s) commonly occur in many branches of applied mathematics, e.g., as boundary layers in fluid mechanics, edge layers in solid mechanics, skin layers in electrical applications, shock layers in fluid and solid mechanics, transition points in quantum mechanics and Stokes lines and surfaces in mathematics. In these kind of problems perturbations are operative over a very narrow region across which the dependent variable undergoes very rapid change. These narrow regions frequently adjoin the boundaries or some interior point of the domain of interest, owing to the boundary and/or interior layers, i.e., there are thin regions where the solution changes rapidly. Kadalbajoo and Reddy gave survey of various asymptotic and numerical methods developed from 1908 — 1986 for the determination of approximate solution of singular perturbation problems of various kinds. Kadalbajoo and Patidar extended the work done by Kadalbajoo and Reddy and surveyed the work done by various researchers in the area of singular perturbation from 1984 — 2000. In this work they considered one dimensional problem only and discussed the work done on linear, non-linear, semilinear and quasilinear problems. In Kadalbajoo and Patidar covered the survey of singularly perturbed partial differential equations and surveyed the work done in this area from 1980 — 2000. Kadalbajoo and Vikas in continuation with the work done by the first author gave brief survey on the computational techniques for different classes of singular perturbation problems considered by various researchers from 2000 — 2009. In this way one can see that this area has developed so much in the past century that it is not possible to give whole of the survey in a single paper. In particular, singularly perturbed differential equations with turning point form an important class of problems which are very challenging and even today there is a lot to be explored in this area. Also, problems where discontinuity in the data results into interior layers in the solution of the problem commonly occur during modeling of physical processes. So. we thought that it will be good to write a survey which exclusively gives details about the work done in these two areas till date. In this work we restrict ourselves to the study of singularly perturbed turning point problems whose solution possesses either boundary or interior layers in the turning point region. We also consider some works in which non-smooth solutions occur inside the domain. We tried to give as much information as we can but if we miss some important names and papers that is purely unintentional. Singular perturbation problems with turning points arise as mathematical models for various physical phenomena. Among these, the problem with interior turning points represent one-dimensional version of stationary convection-diffusion problems with a dominant convective term and a speed field that changes its sign in the catch basin. Boundary turning point problems, on the other hand, arise in geophysics and in the modeling of thermal boundary layers in laminar flow. The problem from models heat flow and mass transport near an oceanic rise. It is a single boundary turning point problem because of the assumption that the velocity distribution is linear. If A typical linear turning point problem in one dimension is given by where,are sufficiently smooth. This problem has acquired great amount of interest of mathematicians as well as physicist due to the fact that the solution exhibit some interesting behavior such as boundary layer, interior layer and resonance phenomena. Whendoes not change sign in the entire interval, the solution is characterized by a boundary layer near one endpoint as. Whenhas a simple zero, say atin, the pointis the so-called turning point and the problem is classified as turning point problem? In this situation the solution behavior depend upon the properties of the coefficient functionsandat the turning point xo = 0. Indeed, if it is assumed that, for, constants, andasthe following cases arise: (i) If, an internal layer occurs near the turning point (ii) If, then there are two boundary layers appearing at the two endpoints of the interval. (iii) Ifand,, or if ,, the solution exhibit a very interesting phenomenon named as Ackerberg-O'Malley's resonance phenomenon . Another situation where interior layer arise would be the case of singularly perturbed convection- diffusion-reaction problems based on non-smooth data. If one or more coefficients such as the convection term, reaction term, source term or the boundary conditions are discontinuous, the solution of such type of problems exhibit strong or weak interior layers depending on the magnitude of the singular perturbation parameter and the nature of the coefficients. There are two principle approaches for solving singular perturbation problems: Numerical approach and Asymptotic approach. Asymptotic approach helps us to gain insight into the qualitative behavior of the problem and give only semi quantitative information, of solutions. Numerical methods can be applied to a broader class of problems and are intended to minimize demands upon the problem solver. Asymptotic methods require the problem solver to have some knowledge of the behavior of the expected solution and treat comparatively restricted class of problems. There are few researchers who combined both the above approaches to yield better results. Systematic study of turning point problems started in late 60s. Since then this subject has matured quite a lot and many textbooks have appeared in the area of singular perturbations which discussed turning point problems and dealt with either asymptotic approach or numerical approach or considered both of them, see, e.g., - .
SINGULARLY PERTURBED DIFFERENTIAL EQUATIONS WITH DISCONTINUOUS
SOURCE TERMS
In this paper a singularly perturbed reaction - diffusion equation in one dimension with a discontinuous source term is considered on the unit interval. A single discontinuity in the source term is assumed to occur at a point. It is convenient to introduce the notationand and to denote the jump at d in any function with. The corresponding self-adjoint two point boundary value problem is whereandare sufficiently smooth on. Becauseis discontinuous at cl the solutionofdoes not necessarily have a continuous second order derivative at the point d. Thus, but the first derivative of the solution exists and is continuous.
Theorem 1 the problemhas a solution
Proof: The proof is by construction. Let 2/1,2/2 be particular solutions of the differential equations
Aabid Mushtaq
Consider the function whereare the solutions of the boundary value problems and A. D are constants to be chosen so that. Note that on the open interval,,. Thuscannot have an internal maximum or minimum and hence We wish to choose the constants A. D so that. That is we impose and For the constants A, D to exist we require This follows from observing that
CONCLUSION
With the advent of robust computational solvers, we can now solve very complex systems of differential equations which, perhaps, cannot even be analyzed using the asymptotic methods. Since singular perturbation problems are parameter dependent, the use of numerical methods developed for solving regular problems leads to errors in the solution that depend on the value of the parameter. Errors of the numerical solution depend on the distribution of mesh points and become small only when the effective mesh-size in the layer is much less than the value of the parameter. Such numerical methods turn out to be inapplicable for singular perturbation problems. Due
REFERENCES
- De. Jager, E. M. The Theory of Singular Perturbations, North Holland Series in Applied Mathematics and Mechanics, Elsevier, Amsterdam (1996).
- ECKHAUS, W.,'Mutched Asymptotic Expansions end Singular Perturbations . North Holland, Amsterdam (1973).
- H.-G. Roos, M. Stynes, and L. Tobiska, Robust Numerical Methods for Singularly Perturbed Differential Equations, vol. 24 of Springer Series in Computational Mathematics, Springer, Berlin, Germany, 2nd edition, 2008, Convection-diffusion-reaction and flow problems.
- J.J.H. Miller, E. O'Riordan and G.I. Shishkin, Fitted numerical methods for singular perturbation problems, World-Scienti_c, (Singapore), 1996.
- Kadalbajoo, M. K., Gupta, V. A brief survey on numerical methods for solving singularly perturbed problems, Appl. Math. Comput. 217, 3641-3716 (2010).
- Kadalbajoo, M. K., Patidar, K. C. Singularly perturbed problems in partial di_erential equations: A survey, Appl. Math. Comput. 134, 371-429 (2003).
- Liseikin, V. D. Layer Resolving Grids and Transformations for Singular Perturbation Problems, VSP Utrecht, Boston (2001).
- M. K. Kadalbajoo and V. Gupta, ―A brief survey on numerical methods for solving singularly perturbed problems,‖ Applied Mathematics and Computation, vol. 217, no. 8, pp. 3641–3716, 2010.
- Nayfeh, A. H., Introduction to Perturbation Methods. New York: John Wiley and Sons 1981.
- Roos, H. G., Stynes, M., Tobiska, L. Robust Numerical Methods for Singularly Perturbed Differential Equations, Convection-Di_usion Reaction and Flow Problems, Springer (1996).
Roos, H.-G., Zarin, H., A second-order scheme for Singularly Perturbed Differential
- Shishkin, G. I. Grid approximations to singularly perturbed parabolic equations with turning points, Di_. Eqn. 37(7), 137-150 (2001).
Verlhulst, F. Methods and Applications of Singular Perturbations, Boundary layers and Multiple Time Scale Dynamics, Springer-Verlag, New York (2000).