ENGR 3621 Advanced Engineering Mathematics: Instructor: Prof. Margareta Stefanovic
ENGR 3621 Advanced Engineering Mathematics: Instructor: Prof. Margareta Stefanovic
1
Contact Information and Class Schedule
Instructor: Prof. Margareta Stefanovic
Office: ECS 453 Phone: 303 871 6513
Email: Margareta.Stefanovic@du.edu
Office Hours: Tue, Thu 2-3 pm (Zoom), or by appointment.
Email questions are welcome.
Class Time: Tue, Thu 4:00 –5:50pm
Location:
Tuesdays in ECS 300 or via Zoom if you cannot attend
in person
Thursdays via Zoom only.
Grader: TBA
2
Reading material
3
Course description
• Pre-requisites:
– MATH 2070 (Intro to Differential Equations and MATH
2080 (Calculus of Several Variables)
4
5
Project
6
Honor Code
• All work turned in for grading must be your own work. Use of
any material not your own must be fully disclosed and a
permission from the instructor obtained in advance.
• Discussion among students concerning homework and course
topics is allowed, however the work you turn in must be your
own - no copying. See Assistance in the course information
sheet.
• Possession of, or referencing the textbook solution manual, is
strictly not allowed.
• Violation of any of these will be considered a violation of the
Honor Code and will be dealt with in accordance with the
University's policies.
7
Lecture 1:
Introduction to Differential Equations
8
Introduction to Differential Equations
➢ Where do we use Differential Equations?
➢ ODEs Examples
➢ Applications
9
Real Life Applications of Diferential Equations
Modeling physical behavior of dynamical systems using mathematical equations.
Solving these equations to help predict and study the behavior of the system.
10
Airflow Around Airfoils Population Growth
Real Life Applications of Diferential Equations
Traffic Flow 11
Weather and climate prediction
Real Life Applications of Diferential Equations
12
Water Pollution Brain Function
ODEs in Engineering fields
Electrical
Engineering
13
What do those applications have in common?
Rate of Change
14
Introduction to Differential Equations
➢ What is a Differential Equation ?
Rate of Change
d2y
Leibniz notation
dx 2
16
Classifying Differential Equations
Differential
Equations
Ordinary Partial
(ODEs) (PDEs)
17
Classifying Differential Equations
Differential
Equations
Ordinary Partial
(ODEs) (PDEs)
𝑑𝑣 𝑐
=𝑔− 𝑣
𝑑𝑡 𝑚
By: 1) Order
2) Linearity
3) Homogeneity
18
Classification by Order
➢ The order of a differential equation (ODE, PDE) is the highest
derivative in the equation
𝑑2 𝑥 𝑘 𝑏 𝑑𝑥 𝑘 𝑏
=− 𝑥− 𝑥ሷ = − 𝑥 − 𝑥ሶ
𝑑𝑡 2 𝑚 𝑚 𝑑𝑡 𝑚 𝑚
nth Order: example
𝑑𝑛 𝑦 𝑑 𝑛−1 𝑦 𝑑𝑦
𝑝𝑛 𝑥 𝑛
+ 𝑝𝑛−1 𝑥 𝑛−1
+ ⋯ + 𝑝1 𝑥 + 𝑝0 𝑥 𝑦 = 𝑔(𝑥)
𝑑𝑥 𝑑𝑥 𝑑𝑥
19
Classification by Linearity
Linear DE implies that the dependent variable (‘function’)
𝑑2 𝑥 𝑘 𝑏 𝑑𝑥
(say, 𝑥 in = − 𝑥 − ) and its derivatives appear in the equation
𝑑𝑡 2 𝑚 𝑚 𝑑𝑡
only with a power of one; that there are no nonlinear functions of 𝑥 in
the equation, and that 𝑥 and its derivatives are multiplied only by
constants or functions of 𝑡 (independent variable).
Linear DE is a linear polynomial in the unknown function and its
derivatives.
2
𝑑2𝑥 𝑑𝑥
𝑆𝑜, 2 𝑖𝑛 𝑎 𝐷𝐸 𝑖𝑠 𝑎 𝑙𝑖𝑛𝑒𝑎𝑟 𝑡𝑒𝑟𝑚, 𝑏𝑢𝑡 𝑖𝑠 𝑛𝑜𝑡.
𝑑𝑡 𝑑𝑡
𝐴𝑙𝑠𝑜, 𝑎𝑛𝑦 𝑓𝑢𝑛𝑐𝑡𝑖𝑜𝑛 𝑜𝑓 𝑡ℎ𝑒 𝑑𝑒𝑝𝑒𝑛𝑑𝑒𝑛𝑡 𝑣𝑎𝑟𝑖𝑎𝑏𝑙𝑒 𝑠𝑢𝑐ℎ 𝑎𝑠 cos 𝑥 𝑖𝑠 𝑛𝑜𝑛𝑙𝑖𝑛𝑒𝑎𝑟
21
Classification by Linearity
➢ Some examples
𝑥 ′′ + 𝑥 = 0 Linear
𝑥 ′′ + 2𝑥 ′ + 𝑥 = 0 Linear
𝑥 ′ + 1ൗ𝑥 = 0 Non-linear
𝑥′ + 𝑥2 = 0 Non-linear
𝑥 ′′ + sin(𝑥) = 0 Non-linear
𝑥𝑥 ′ = 1 Non-linear
22
Classification by Linearity
➢ Note that the independent variable t (the variable that we are
differentiating by) may appear in a nonlinear way:
𝑥 ′ + 𝑡2𝑥 = 0 Linear in 𝑥
23
Solution of an nth order ODE…
24
Solution of an ODE
25
The Calculus we need...
➢ differentiation of some basic functions, such as xn , sin(x)
cos(x), ex ln 𝑥
➢Derivative Rules:
o f(x) ± g(x) Sum/Difference
f′(x) ±g′(x)
Product rule
o f(x)g(x) f′(x)g(x)+ f(x)g′(x)
Chain rule
o f(g(x)) f ′(g(x))g ′(x)
𝑑𝑦 𝑑𝑦 𝑑𝑢
or =
𝑑𝑥 𝑑𝑢 𝑑𝑥 26
https://www.mathsisfun.com/calculus/derivatives-rules.html
Examples...
27
Solutions
28
Examples...
➢ 1.1 Exercises page 11. Problem 15:
𝑦 ′′ − 6𝑦 ′ + 13𝑦 = 0; 𝑦 = 𝑒 3𝑥 𝑐𝑜𝑠2𝑥
Solution:
29
Examples...
➢ 1.1 Exercises page 12. Problem 34.
3𝑦 ′ = 4𝑦;
Find values of m so that the function 𝑦 = 𝑒 𝑚𝑥 is a solution of the
given DE.
Solution : m = 4/3
30
A Differential Equation...
𝑑𝑣 𝑐
=𝑔− 𝑣
𝑑𝑡 𝑚
31
A Differential Equation...
𝑑𝑣 𝑐
=𝑔− 𝑣
𝑑𝑡 𝑚
Find the
Analytical Solution
𝑐
𝑣 = න 𝑔 − 𝑣 𝑑𝑡
𝑚
32
The Analytical Solution
𝑐
𝑣 = න 𝑔 − 𝑣 𝑑𝑡
𝑚
𝑐
𝑔− 𝑣 ≝𝑔 𝑡
𝑚
𝑣 = න 𝑔 𝑡 𝑑𝑡
33
The Analytical Solution
𝑣 = න 𝑔 𝑡 𝑑𝑡
𝑣 =𝐺 𝑥 +𝐶
Constant of Integration
34
Constant of Integration
𝑣 = න 𝑔 𝑡 𝑑𝑡 𝑣 =𝐺 𝑥 +𝐶
35
Example...
4th Order Polynomial
𝑑𝑦
= −2𝑥 3 + 12𝑥 2 − 20𝑥 + 8.5
𝑑𝑥
Differential Equation
36
Example...
𝑑𝑦
= −2𝑥 3 + 12𝑥 2 − 20𝑥 + 8.5
𝑑𝑥
➢ The equation above also describes the behavior of the polynomial
but in a different manner!
37
➢ Position
➢ Velocity
𝑑𝑥
=𝑣
𝑑𝑡
38
Example...
𝑑𝑦
= −2𝑥 3 + 12𝑥 2 − 20𝑥 + 8.5
𝑑𝑥
39
Example...
𝑑𝑦
= −2𝑥 3 + 12𝑥 2 − 20𝑥 + 8.5
𝑑𝑥
𝑑𝑦
Integrate න 𝑑𝑥
𝑑𝑥
40
Example...
Solution
Original Polynomial
Constant of Integration
41
Example...
42
Initial-Value Problem
In an initial-value problem (IVP), we seek a
solution y(x) of a differential equation so that
y(x) satisfies initial conditions at xo
The nth-order IVP is the ODE
dny
dx n (
= f x, y, y',..., y ( n-1)
) “Normal” form of
the ODE
44
(Theorem 1.2.1)
45
Initial-Value Problem
Note: this is a sufficient condition for existence and
uniqueness of solution, not a necessary one.
Example
Is there a unique solution for 𝑥𝑦 ′ = 𝑦, 𝑦 0 = 0?
Try Theorem 1.2.1:
𝑑𝑦 𝑦 𝑑𝑓 1 𝑦 𝑑𝑓 1
= ⇒ = . Both 𝑓 𝑥, 𝑦 = and = are continuous for all x,y
𝑑𝑥 𝑥 𝑑𝑦 𝑥 𝑥 𝑑𝑦 𝑥
except at x=0, so we define the region R as , for example, 0 < 𝑥 < ∞,
−∞ < 𝑦 < ∞. If the initial point 𝑥0 , 𝑦0 were anywhere in the interior of R,
then the equation would have a unique solution. But here, 𝑥0 = 0 lies
outside of R.
Note that 𝑦 = 𝐶𝑥, for any constant 𝐶, solved the IVP problem above. In
other words, we have infinitely many solutions.
46
47
y
48
Example
Solve the initial value problem:
𝑑𝑦
= 10 − 𝑥, 𝑦 0 = −1
𝑑𝑥
𝑑𝑦
= 10 − 𝑥 → 𝑑𝑦 = 10 − 𝑥 𝑑𝑥
𝑑𝑥
𝑥2
න 𝑑𝑦 = න 10 − 𝑥 𝑑𝑥 → 𝑦 = 10𝑥 − + 𝑐
2
For x=0, y=−1 → c=−1
𝑥2
Solution: 𝑦 = 10𝑥 − −1
2
49
Example
Solve the initial value problem:
𝑑𝑠
= 𝑐𝑜𝑠𝑡 + 𝑠𝑖𝑛𝑡, 𝑠 𝜋 =1
𝑑𝑡
𝑑𝑠
= 𝑐𝑜𝑠𝑡 + 𝑠𝑖𝑛𝑡 → 𝑑𝑠 = 𝑐𝑜𝑠𝑡 + 𝑠𝑖𝑛𝑡 𝑑𝑡
𝑑𝑡
The expression
𝑥 = 𝑐1 𝑐𝑜𝑠𝑡 + 𝑐2 𝑠𝑖𝑛𝑡
Is a family of solutions of the second order DE 𝑥 ′′ + 𝑥 = 0. Find
a solution of the IVP when x(0) = -1, x’(0) = 8.
Solution:
c1=-1 and c2 = 8
51
We start by looking into particular techniques used to solve some
special (relatively simple) types of first order ordinary differential
equations.
52
• Alternative approach: Instead of solving the equations, we may try to show
whether the equation has solutions or not, if the solution is unique or not, and
what properties such solutions may have. Graphical methods exist for some
ODEs and may give significant insight into the solution behavior.
• This is less information than obtaining the exact solution, but it is still valuable
information. The theorems describing the existence and uniqueness of
solutions to certain classes of differential equations are useful.
53
First Order Differential Equations
➢ There are 3 different ways that DE can be studied:
54
Qualitative analysis
DEs can be analyzed qualitatively, allowing us to
approximate a solution curve without solving
the problem.
Two approaches are:
Direction fields
Autonomous first-order DEs
55
Qualitative analysis
Direction fields
Slope of the lineal element
(tangent line) at (x,y(x)) on a
solution curve is the value of
dy/dx at this point
Direction/slope fields of
dy/dx = f(x, y) are collections
of lineal slope elements that
visually suggest the shape of a
family of solution curves
56
Qualitative analysis
Direction Field
– If we systematically evaluate f over a rectangular grid of points in the
xy-plane and draw a lineal element at each point (x, y) of the grid with
slope f(x, y), then the collection of all these lineal elements is called a
direction field or a slope field of the DE dy/dx=f(x, y).
57
First Order Differential Equations
➢ There are 3 different ways that DE can be studied:
58
First Order Differential Equations
➢ Different Solution Methods
➢Direct (by integration)
➢By separation of variables
➢Using Integrating Factor method
➢Using Exact Differential method
➢By substitution
➢Other methods
59
Direct integration
– Consider a 1st Order DE dy/dx=f(x, y). When f does not
depend on the variable y, that is f(x, y)=g(x) then the
differential equation dy/dx=g(x) can be solved by integration.
– i.e. dy/dx=1+e2x
– Then:
• y=∫(1+e2x)dx or y=x+0.5e2x+c
60
Separable Variables
Definition– Separable Equation:
dy
A first order DE of the form = g ( x) h ( y)
is said to be
dx
separable or to have separable variables.
61
Separable Variables
Example – Solving a Separable DE
62
Separable Variables
Example – Solution Curve
Solution:
– ∫ ydy = - ∫ xdx
– y2/2=-x2/2+c1
– By rewriting: c1=c2 then y2/2=-x2/2+c2
– Apply initial the conditions x=4, y=3
– Then; c2=25
– Equation becomes x2+y2=25
– Circle with radius 5
63
Separable Variables
Losing a Solution - Caution
– Be careful when separating variables, since the variable divisors could
be zero at a point. Specifically, if r is a zero of the function h(y), then
substituting y=r into dy/dx=g(x)h(y) makes both sides zero.
• In other words y=r is a constant solution of the DE.
64
Separable Variables
Example – Losing a Solution:
– Solve dy/dx=y2-4
65
Linear Equations
dy
A first-order DE of the form a1 ( x ) + a0 ( x ) y = g ( x ) is
dx
a linear equation in the dependent variable y
The DE is homogenous when g ( x ) = 0 ; otherwise,
it is nonhomogenous
The Standard Form of a linear DE is obtained by
dividing both sides by the lead coefficient
dy
+ P ( x) y = f ( x)
dx
66
Linear Equations
The standard form equation has the property
that its solution y is the sum of the solution of
the associated homogenous equation yc and the
particular solution of the nonhomogenous
equation yp
The homogenous equation is separable, allowing us
to solve for yc
The Variation of Parameters method can be used to
solve the nonhomogenous equation for yp
67
Linear Equations
Guidelines for solving a 1st ODE
Step 1: 𝑑𝑦
Put a linear equation into the standard form + 𝑃 𝑥 𝑦 = 𝑓(𝑥) and then
𝑑𝑥
Step 2:
Multiply the standard form by the integration factor (IF). The left side of the resulting
Equation is automatically the derivative of the integration factor and y. Write
𝑑 𝑃 𝑥 𝑑𝑥
𝑒 . 𝑦 = 𝑒𝑃 𝑥 𝑑𝑥
. 𝑓(𝑥)
𝑑𝑥
and then integrate both sides of this equation.
68
Linear Equations
➢ Occasionally a first-order DE is not linear in one variable but
it is linear in the other variable. For example, the DE
𝑑𝑦 1
=
𝑑𝑥 𝑥 + 𝑦 2
𝑑𝑥 𝑑𝑥
= 𝑥 + 𝑦2 − 𝑥 = 𝑦2
𝑑𝑦 𝑑𝑦
From table of integrals
y e dy =
n ay
is recognized as linear in the variable x
1 n ay n n −1 ay
= y e − y e dy
Integration Factor: 𝑒 −1𝑑𝑦 = 𝑒 −𝑦 a a
Verify solution: 𝑥 = −𝑦 2 − 2𝑦 − 2 + 𝑐𝑒 𝑦
69
Linear Equations
Example – Solving a Linear DE
– Solve: dy/dx-3y=6
𝑑𝑦 4𝑦
– Standard from: −= 𝑥5𝑒 𝑥 • P(x)=-4/x (Coefficient of y)
𝑑𝑥 𝑥
• Hence, the integrating factor is e ∫P(x)dx = e ∫(-4/x)dx = e-4ln(x) = x-4
𝑑𝑦
– Then write: 𝑥 −4 − 4𝑥 −5 𝑦 = 𝑥𝑒 𝑥
𝑑𝑥
𝑑
– Which is the same as: 𝑥 −4 𝑦 = 𝑥𝑒 𝑥
𝑑𝑥 xe dx = ( x − 1) e
x x
y= x5ex- x4ex+cx4
71
Linear Equations
Example – IVP
𝑑𝑦
– Solve the IVP: + 𝑦 = 𝑥, 𝑦 0 = 4
𝑑𝑥
𝑑𝑦
– Standard from: +𝑦 =𝑥
𝑑𝑥
• P(x)= 1 (Coefficient of y)
• Hence, the integrating factor is e ∫P(x)dx = e ∫1dx = ex
𝑑
– Then write: 𝑦𝑒 𝑥 = 𝑥𝑒 𝑥
𝑑𝑥
A differential expression M ( x, y ) dx + N ( x, y ) dy is
an exact differential in a region R of the xy-plane
if it corresponds to the differential of some
f ( x, y ) function
M ( x, y ) dx + N ( x, y ) dy = 0 is an exact equation if the
left side is an exact differential
A condition of exact differentials is:
M N
=
y x
73
Exact Equations
Example
–ODE: 2xydx+(x2-1)dy=0
75
Exact Equations
Example – Solving an Exact DE
– Solve: (e2y-ycos(xy))dx+(2xe2y-xcos(xy)+2y)dy=0
– Taking the partial derivative with respect to x and setting it equal to M(x, y):
• ∂f/∂x = e2y-ycos(xy)+h’(x) = e2y-ycosxy which means that h’(x)=0 and hence h(x)=c
– Therefore the family of solution is: xe2y-sinxy+y2+c
76
A Non-exact DE Made to be Exact
– Solve the non-linear non-exact DE: xydx+(2x2+3y2-20)dy=0
−𝑀𝑦 +𝑁𝑥
– Otherwise, if quotient depends only on y, then the IF to be used is
𝑀
−𝑀𝑦 +𝑁𝑥
𝑑𝑦
𝑒 𝑀
77
A Non-exact DE Made to be Exact
– Back to solving xydx+(2x2+3y2-20)dy=0
𝑀𝑦 −𝑁𝑥
In this example, the quotient depends on both x and y
𝑁
𝑀𝑦 − 𝑁𝑥 𝑥 − 4𝑥 −3𝑥
= 2 =
𝑁 2𝑥 + 3𝑦 2 − 20 2𝑥 2 + 3𝑦 2 − 20
78
79
Solutions by Substitutions
u = Ax + By + C , B 0
80
Solutions by Substitutions
81
Solutions by Substitutions
𝑑𝑦
+ 𝑃 𝑥 𝑦 = 𝑓(𝑥)𝑦 𝑛 Bernoulli’s Equation
𝑑𝑥
where n is any real number
If n = 0 and n =1 the equation is linear
𝑑𝑦 𝑑𝑦
+ 𝑃 𝑥 𝑦 = 𝑓(𝑥) and +𝑃 𝑥 𝑦 =𝑓 𝑥 𝑦
𝑑𝑥 𝑑𝑥
82
Solutions by Substitutions
Example – Solving a Bernoulli Equation
𝑑𝑦
– Solve: 𝑥 + 𝑦 = 𝑦2𝑥 2
𝑑𝑥
𝑑𝑦 1
– Rewrite equation as: + y = x𝑦 2 (x0)
𝑑𝑥 𝑥
– Hence, n=2
– Substitute y=u-1
– Chain Rule: dy/dx = -u-2du/dx
84
Solutions by Substitutions
Example – Solving a Homogeneous NL Equation
– Solve: (x2+y2)dx+(x2-xy)dy=0
• Solution
– By inspection: M(x, y)=x2+y2 and N(x, y)=x2-xy Homogeneous
function of degree 2