Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

MEHRAN UNIVERSITY OF ENGINEERING AND TECHNOLOGY, JAMSHORO. FIRST SEMESTER FIRST YEAR (M.Phil.) 15BATCH PROGRAM: APPLIED MATHEMATICS Subject: Scientific Computing LECTURE 08 Conducted on: 15/04/2015 Timings: 6pm to 7.30pm

“It does not matter how slowly you go as long as you do not stop.” Confucius SYSTEM OF NONLINEAR EQUATIONS Objectives: o Introduction and Importance of Nonlinear Systems o Newton’s Method using Jacobians for two equations o Newton-Raphson Method without Jacobians for two equations o Generalized Newton’s Method from Taylor’s Theorem o Discussion of Ongoing Research to solve Nonlinear Systems Introduction and Importance of Nonlinear Systems Generally, we can find solution to a system of nonlinear equations when the number of unknowns matches the number of equations. Thus, the solution of the system having the following form is sought: f1 x1 , x2 , x3 ,, xn   0

f 2 x1 , x2 , x3 ,, xn   0 f 3 x1 , x2 , x3 , , xn   0

 f n x1 , x2 , x3 , , xn   0 For the sake of convenience, x  x1 , x2 , x3 ,, xn  and f   f1 , f 2 , f3 ,, f n  is a vectorvalued function. Thus, the above system becomes:



f x 0 Our objective is to find a vector that makes the vector function equal to zero. Consider the system of two nonlinear equations in two variables:

f  x, y   0   g  x, y   0 

1

Knowing that x0 , y0  is an approximated solution of (1), we’ll try to improve it. Let x0  h, y0  k  be the exact solution of (1), then 1

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

f x0  h, y0  k   0 g x0  h, y0  k   0 Using Taylor’s series for a function of two variables, we have

 f f  f x0  h, y0  k   f x0 , y0    h  k     0 y   x

 2

 g g  g x0  h, y0  k   g x0 , y0    h  k     0 y   x

 3

 f f  f x0 , y0    h  k   0 y   x

 4

 g g  g x0 , y0    h  k   0 y   x g Multiply (4) with y

 5

 g f g g f  0 f x0 , y0    h k y y y   y x f Multiply (5) with y

 6

 f g f f g  0 g x0 , y0    h k y y y   y x Subtraction of (6) from (7) gives

 7 

g x0 , y0 

h

h

 f g f g  f g   0  f x0 , y0   h  y y  y x x y 

g f  g x0 , y0  y y  f g g f      y x y x 

f x0 , y0 

f g  f x0 , y0  y y  f g f g      x y y x 

g x0 , y0 

 gf y  fg y  h   f x g y  f y g x   x0 , y0  fx  gf y  fg y  h   ; where J Jacobian  f g  f g   x y y x gx J    x0 , y0  2

fy gy



 f , g  x, y 

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

 fg x  gf x   fg  gf x  and similarly k    x   J   x0 , y0   f x g y  f y g x   x0 , y0  

Finally

h

f g

fy gy

fx gx

fy gy

f fx g gx  8 and k  fx f y gx g y

 9

Better approximation is found as

x1  x0  h and y1  y0  k Next better approximation is found as x2  x1  h and y2  y1  k Newton-Raphson Method without Jacobians Consider the system of two nonlinear equations in two variables:

f  x, y   0   g  x, y   0 

Treating each equation in one variable, Newton’s method for one variable can be applied and the iterative formulae are: f xi , yi  g xi 1, yi  xi 1  xi  and yi 1  yi  ; i  0,1,2, f x xi , yi  g y xi 1, yi  This algorithm can be extended to n simultaneous equations in n variables. Here, only latest values available are employed. Moreover, the algorithm requires computation of only one derivative to get xi 1 or yi 1 . Example. Solve the following system of equations:

x 2  y 2  16   ; 2 2 x y 4  

x0 , y0   2

Solution. Let

f x, y   x 2  y 2  16  g x, y   x 2  y 2  4 

f x  2 x, g x  2 x,

f y  2 y   g y  2 y 

3

2 ,2 2



Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

 

          f x , y   f 2 2 ,2 2   4 2 , f x , y   f 2 2 ,2 2   4 2    g x , y   g 2 2 ,2 2   4 2 , g x , y   g 2 2 ,2 2   4 2  

2 2 f x0 , y0   f 2 2 ,2 2  2 2  2 2  16  0   2 2 g x0 , y0   g 2 2 ,2 2  2 2  2 2  4  4 

x

0

0

x

x

0

0

x

J

fx

fy

gx

gy

 gf  fg y  h y  J   2  fg  gf x  k x  J  2



y

0

y

4 2

4 2

4 2

4 2

0

0

y

0

y

 64  0

  



2 ,2

4 4 2 0 4 2  2     0.353553390593274   64 4    2

2 ,2

 0 4 2   4 4 2  2     0.353553390593274   64 4 2  

 

 

Thus,

x1  x0  h  x1  3.181980515339464 and y1  y0  k  y1  2.474873734152916 Repeating the above computations with modified values, we get f x1 , y1   f 3.181980515339464, 2.474873734152916  0.25

  g x1 , y1   g 3.181980515339464, 2.474873734152916  1.776356839400251e - 15

f x  6.363961030678928, g x  6.363961030678928, J

fx

fy

gx

gy

f y  4.949747468305832    g y  4.949747468305832 

 -62.999999999999986

h  0.019641855032960 and k  0.025253813613805 Thus, x2  x1  h  x1  3.162338660306504 and y2  y1  k  y2  2.449619920539111

f x2 , y2   f 3.162338660306504, 2.449619920539111  0.001023557571173

  g x2 , y2   g 3.162338660306504, 2.449619920539111  -2.519526329072264e - 04 Example. Use Newton’s Method to solve

f x, y   y 2  4 x 2  2 xy  y  2  0  ; 2 2  g x, y   y  2 x  3xy  3  0 

x0 , y0   0.4,0.9 4

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

Solution.

f x  8x  2 y   g y  2 y  3x

f x0 , y0   f 0.4,0.9  0.73 and f x x0 , y0   f x 0.4,0.9  5 For i  0 : 

x1  x0 

f x0 , y0   0.73  0.546  0.4  f x x0 , y0  5

g x1, y0   g 0.546,0.9  0.119568

g y x1, y0   g y 0.546,0.9  3.438 For i  0 : 

y1  y0 

 0.119568  0.934778359511344 g x1, y0   0.9  g y x1, y0  3.438

Thus,

x1, y1   0.546,0.934778359511344 f x1, y1   0.152274190485763 and g x1, y1   0.001209534290301 .

Iterations have been run until absolute relative error  0.0001 in both variables:

Thus, The approximate solution is: xn = 5.0005543232e-001 and yn = 9.9992078543e-001. Following iterations have been recorded using Newton’s Method with Jacobian:

5

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

The approximate root is: xn = 5.0000000000e-001 and yn = 9.9999994040e-001 f x, y   -1.1920928955e-007 and g x, y   -2.0861625671e-007

Note. Look at number of iterations required by both methods. Example. Solve following system:

x 2  2 x  y  0.5  0   2 2  x  4y  y  0  Solution.

f x, y   x 2  2 x  y  0.5   2 2  g  x, y   x  4 y  y  With the initial guess x0 , y0   0,1 and the algorithm:

xi 1  xi 

f xi , yi  g xi 1, yi  and yi 1  yi  ; i  0,1,2, f x xi , yi  g y xi 1, yi 

Iterations are recorded as:

The approximate root is: x, y   1.4809843898e - 001,2.2570607066e - 001 f x, y   3.0199009416e - 005 and g x, y   -1.6998695784e - 009 6

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

Newton’s Method with Jacobians

Specifically,

Or



x1  x0  J x, y x10 f x0

provided that the inverse exists. This formula is the vector equivalent of the Newton’s formula we learned before. However, in practice we never use the inverse of a matrix for computations, so we cannot use this formula directly. Rather, we do the following. First solve the equation

Example. Solve the following nonlinear system:

x 3  y  1   with x0 , y0   0.5,0.5 . y 3  x  1 Solution. 7

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

 x 3  y  1 f1 x, y   x 3  y  1    f x  3   y  x  1 f 2 x, y   y 3  x  1   



    f  f   x x  y x   x  y  1   x      f x  f x   y  x  1   x  y Df x0 x   f x0

1

1

0

2

3

0

3

2

0

x0 , y0 



0

3x 2   1

 x 3  y  1 1   x     3  3 y 2  0.5,0.5   y  x  1 0.5,0.5



1  0.75  0.375   1 0.75 x    0.625      1

1   0.375  0.58  0.75 x     x        0.06   1 0.75  0.625 

Thus,

0.5  0.58  1.08  x1  x0  x        0.5  0.06 0.44 Iterations are given below:

The approximate root is: x = 1.0000000000e+000 and y = 4.8254150897e-008 f x, y   4.8254150897e-008 and g x, y   0.0000000000e+000

8

Prepared by Asif Ali Shaikh/Sania Qureshi Assistant Professors Department of BSRS Mehran, UET, Jamshoro

Note: Detailed discussion of following topics is being carried out in the classes. It is highly recommended that you may follow textbooks suggested by your mentors. These handouts can never ever replace textbooks. Material included here has been taken from textbooks and internet.

Example. Solve the following nonlinear system:

x  y  xy  2  with x0 , y0   1,3 . xe y   1  Solution.

f1x, y   x  y  xy  2  x  y  xy  2 1 and x0    .  f x     y   y  1  f 2 x, y   xe 1  3  xe  Iterations using above method are given below:



The approximate root is: x = 9.7773097456e-002 and y = -2.3251059055e+000 f1x, y   -1.7813110986e-009 and f 2 x, y   8.5755353041e-008

Explore by yourself for how Gauss-Seidel’s Method is used to solve Non-linear systems of equations.

9

Lecture # 08 (Nonlinear Systems).pdf

o Newton's Method using Jacobians for two equations. o Newton-Raphson Method without Jacobians for two equations. o Generalized Newton's Method from ...

582KB Sizes 7 Downloads 233 Views

Recommend Documents

LECTURE 7: NONLINEAR EQUATIONS and 1-d ... - GitHub
solving nonlinear equations and 1-d optimization here. • f(x)=0 (either in 1-d or many ... dimensions. • Requires a gradient: f(x+δ)=f(x)+δf'(x)+… • We want f(x+δ)=0, hence δ=-f(x)/f'(x). • Rate of convergence is quadratic (NR 9.4) εi+

08-08-11schoolboardmtg.pdf
5) Contract Approvals; Sharon Uhl, Para educator Student Specific; Caleb Christensen,. Regular Route Driver; Toni Weber, Substitute Bus Driver; Dick Bloyer, ...

Lecture 7
Nov 22, 2016 - Faculty of Computer and Information Sciences. Ain Shams University ... A into two subsequences A0 and A1 such that all the elements in A0 are ... In this example, once the list has been partitioned around the pivot, each sublist .....

BI490 Spring 2008 Lecture 1 (1/15/08) Senior Seminar ...
BI490 Spring 2008. Lecture 1 (1/15/08). Senior Seminar. Class Activity Write-up. 1 of 1. Each group came up with 3 questions that they had regarding cancer. These questions are listed below, in no particular order, and may be revisited later in the c

LECTURE - CHECKLIST
Consider hardware available for visual aids - Computer/ Laptop, LCD ... Decide timing- 65 minutes for lecture and 10 minutes for questions and answers.

Lecture 3
Oct 11, 2016 - request to the time the data is available at the ... If you want to fight big fires, you want high ... On the above architecture, consider the problem.

Nonlinear electroseismic exploration
Aug 5, 2004 - H. - _- o 0o0. 2 1 ..|4. 03:5'. 6 0. o a. Mn. 0m 8. Me. 0m T. n n b. 50 1| - 4.I. FIG. 26. FIG. 1C .... The seismic waves are detected at or near the surface by seismic receivers. .... 13 illustrates a shift register of degree 4 With fe

acd-08-08-reglamento-biblioteca.pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item.

pdf-1490\record-of-agard-lecture-series-lecture ...
... the apps below to open or edit this item. pdf-1490\record-of-agard-lecture-series-lecture-series-i ... unne-j-c-north-atlantic-treaty-organization-vannucci.pdf.

0680-08
Oct 16, 2017 - colleges in this state, and through apprenticeship Programs. Authority: T.C.A. §§ 4-41-105, 4-41-107, and 4-41-108. Administrative History: ...

1140-08
Feb 1, 2017 - Repetitions of the violation. (c). Magnitude of the risk of harm caused by the violation. (2). Each violation of any statute, rule or order enforceable ...

0680-08
Oct 16, 2017 - (e) The Corporation may delegate the review and acceptance of bids to one (1) or more persons each having no direct or indirect interest in any of the bidders, as defined above, who shall review all submissions and choose a qualifying

Lectures / Lecture 4
Mar 1, 2010 - Exam 1 is next week during normal lecture hours. You'll find resources to help you prepare for the exam, which will be comprehensive, on the.

Prize Lecture slides
Dec 8, 2011 - Statistical Model for government surplus net-of interest st st = ∞. ∑ ... +R. −1 bt+1,t ≥ 0. Iterating backward bt = − t−1. ∑ j=0. Rj+1st+j−1 + Rtb0.

Lecture Note_Spectrophotometry.pdf
Aug 18, 2016 - ... rival UV‐Visible spectrometry. for its simplicity simplicity, versatility versatility, speed, accuracy accuracy and. cost‐effectiveness. Page 1 of 34 ...

Lecture 9
Feb 15, 2016 - ideological content have persisted among the American public from 1987 to 2012.2 ... That is, learning is social and takes place within the individuals' ... independent network structures, deriving always consensus results.

0680-08
Oct 16, 2017 - generally accepted accounting principles; and .... detailed description of the project and timeline pursuant to 0680-08-.06 (1)(b), the name of.

Lectures / Lecture 4
Mar 1, 2010 - course website. After lecture today, there will also be a review section. • Assignments are graded on a /–, /, /+ basis whereas exams are graded.

Lectures / Lecture 7
Apr 5, 2010 - Contents. 1 Introduction (0:00–5:00). 2. 2 Security (5:00–112:00). 2 .... use it to distribute pornography, you don't have to pay for disk space or bandwidth, but you might make money off ... requests—the more of a threat you pose

Inaugural lecture
Jan 31, 2001 - Contemporary global capitalism results from interactions between economics, finance, and technology. Any number of ... the form of software, but in the creation of images, and symbols. You could view it as a .... formal structures, rul

Frederick Sanger - Nobel Lecture
and hence the number of amino acid residues present. Values varying from ... In order to study in more detail the free amino groups of insulin and other proteins, a general ... disulphide bridges of cystine residues. Insulin is relatively rich in ...

Lecture Capture - USFSM
Step 2 on the Crestron: Touch the Lecture Capture Mode to turn on the projector and camera. Page 2. Step 3 on the Crestron Choose Podium PC. Now you will see your desktop on the projector. Panopto. Step 1 Log in to myUSF. Page 3. Step 2 Launch Canvas