OneStopGate.Com
OnestopGate   OnestopGate
   Thursday, May 9, 2024 Login  
OnestopGate
Home | Overview | Syllabus | Tutorials | FAQs | Downloads | Recommended Websites | Advertise | Payments | Contact Us | Forum
OneStopGate

GATE Resources
Gate Articles
Gate Books
Gate Colleges 
Gate Downloads 
Gate Faqs
Gate Jobs
Gate News 
Gate Sample Papers
Training Institutes

GATE Overview
Overview
GATE Eligibility
Structure Of GATE
GATE Coaching Centers
Colleges Providing M.Tech/M.E.
GATE Score
GATE Results
PG with Scholarships
Article On GATE
Admission Process For M.Tech/ MCP-PhD
GATE Topper 2012-13
GATE Forum




GATE 2025 Exclusive
Organizing Institute
Important Dates
How to Apply
Discipline Codes
GATE 2025 Exam Structure

GATE 2025 Syllabus
Aerospace Engg..
Agricultural Engg..
Architecture and Planning
Chemical Engg..
Chemistry
Civil Engg..
Computer Science / IT
Electronics & Communication Engg..
Electrical Engg..
Engineering Sciences
Geology and Geophysics
Instrumentation Engineering
Life Sciences
Mathematics
Mechanical Engg..
Metallurgical Engg..
Mining Engg..
Physics
Production & Industrial Engg..
Pharmaceutical Sciences
Textile Engineering and Fibre Science

GATE Study Material
Aerospace Engg..
Agricultural Engg..
Chemical Engg..
Chemistry
Civil Engg..
Computer Science / IT
Electronics & Communication Engg..
Electrical Engg..
Engineering Sciences
Instrumentation Engg..
Life Sciences
Mathematics
Mechanical Engg..
Physics
Pharmaceutical Sciences
Textile Engineering  and Fibre Science

GATE Preparation
GATE Pattern
GATE Tips N Tricks
Compare Evaluation
Sample Papers 
Gate Downloads 
Experts View

CEED 2013
CEED Exams
Eligibility
Application Forms
Important Dates
Contact Address
Examination Centres
CEED Sample Papers

Discuss GATE
GATE Forum
Exam Cities
Contact Details
Bank Details

Miscellaneous
Advertisment
Contact Us


Home » GATE Study Material » Mathematics » Numerical Analysis » Linear Equations » Iterative Refinement - Residual Correction

Iterative Refinement - Residual Correction

Looking for GATE Preparation Material? Join & Get here now!

** Gate 2013 Question Papers.. ** CEED 2013 Results.. ** Gate 2013 Question Papers With Solutions.. ** GATE 2013 CUT-OFFs.. ** GATE 2013 Results.. **

Iterative Refinement - Residual Correction

Iterative Refinement - Residual Correction

 

Background

    In the

LU-Factorization module we developed the "LU-solve" method which will now be used as the computational engine in the iterative refinement - residual correction method.  

Definition ( LU-Factorization ).  The matrix A has an LU-factorization if it can be expressed as the product of a lower-triangular matrix L and an upper triangular matrix U  

        [Graphics:Images/IterativeRefinementMod_gr_1.gif].

Theorem (A = LU;  Factorization with NO Pivoting).  Assume that A has a LU-factorization.  The solution X to the linear system  [Graphics:Images/IterativeRefinementMod_gr_2.gif], is found in three steps:  

    
1.  Construct the matrices  [Graphics:Images/IterativeRefinementMod_gr_3.gif], if possible.  
    
2.  Solve  [Graphics:Images/IterativeRefinementMod_gr_4.gif]  for  [Graphics:Images/IterativeRefinementMod_gr_5.gif]  using forward substitution.
    
3.  Solve  [Graphics:Images/IterativeRefinementMod_gr_6.gif]  for  [Graphics:Images/IterativeRefinementMod_gr_7.gif]  using back substitution.

  

    The above theorem assumes that there are no row interchanges.  If row interchanges are permitted then a factorization of a "permuted matrix" will be obtained.  A permutation of the first n positive integers  [Graphics:Images/IterativeRefinementMod_gr_8.gif].  is an arrangement  [Graphics:Images/IterativeRefinementMod_gr_9.gif]  of these integers in a definite order.  The standard base vectors  [Graphics:Images/IterativeRefinementMod_gr_10.gif]  for  [Graphics:Images/IterativeRefinementMod_gr_11.gif]  are used in the next definition.  

Definition ( Permutation Matrix ).  An n�n permutation matrix P is a matrix with precisely one entry whose value is "1" in each column and row, and all of whose other entries are "0."  The rows of  P  are a permutation of the rows of the identity matrix and  P  can be written as  [Graphics:Images/IterativeRefinementMod_gr_12.gif].  The elements of  [Graphics:Images/IterativeRefinementMod_gr_13.gif]  have the form  

        [Graphics:Images/IterativeRefinementMod_gr_14.gif]  

Theorem.  Suppose that  [Graphics:Images/IterativeRefinementMod_gr_15.gif]  is a permutation matrix.  The product  PA  is a new matrix whose rows consists of the rows of  A  rearranged in the new order  [Graphics:Images/IterativeRefinementMod_gr_16.gif].  

Exploration

Theorem.  If  A  is a nonsingular matrix, then there exists a permutation matrix  P  so that  PA  has an LU-factorization

        P A  =  L U.  

Theorem (PA = LU;  Factorization with Pivoting).  Given that A is nonsingular.  The solution X to the linear system  [Graphics:Images/IterativeRefinementMod_gr_20.gif], is found in four steps:  

    
1.  Construct the matrices  [Graphics:Images/IterativeRefinementMod_gr_21.gif].  
    
2.  Compute the column vector   [Graphics:Images/IterativeRefinementMod_gr_22.gif].
    
3.  Solve  [Graphics:Images/IterativeRefinementMod_gr_23.gif]  for  [Graphics:Images/IterativeRefinementMod_gr_24.gif]  using forward substitution.
    
4.  Solve  [Graphics:Images/IterativeRefinementMod_gr_25.gif]  for  [Graphics:Images/IterativeRefinementMod_gr_26.gif]  using back substitution.

 

The "LU-solve" Method

    The following pair of subroutines are the heart of the computational engine for the computational engine in the iterative refinement - residual correction method.  When we refer to a "LU-solve step" it means use LUfactor followed by SolveLU.  The next example will review these concepts, and more explanation is in the

 

 

Mathematica Subroutine (LUfactor).  Matrix  A  is a global variable and elements are changed when the LUfactor is executed.  We save a copy of A in A0.

[Graphics:Images/IterativeRefinementMod_gr_27.gif]

Mathematica Subroutine (SolveLU).  The subroutine SolveLU which is similar to the

back substitution subroutine.

[Graphics:Images/IterativeRefinementMod_gr_28.gif]

 

Iterative Refinement - Residual Correction Method

    This is a method for improving the accuracy of a solution produced using
LU-factorization.  To start the process, the factorization  [Graphics:Images/IterativeRefinementMod_gr_55.gif]  is computed only once, and we have
    
(1)            
[Graphics:Images/IterativeRefinementMod_gr_56.gif].  

Use the LU solver to construct  [Graphics:Images/IterativeRefinementMod_gr_57.gif]  which is an approximate solution to  [Graphics:Images/IterativeRefinementMod_gr_58.gif],  i.e.  [Graphics:Images/IterativeRefinementMod_gr_59.gif]   

Form the error in the computation  [Graphics:Images/IterativeRefinementMod_gr_60.gif],  this is called the residual

(2)            
[Graphics:Images/IterativeRefinementMod_gr_61.gif].  

Now subtract  
[Graphics:Images/IterativeRefinementMod_gr_62.gif]  from  [Graphics:Images/IterativeRefinementMod_gr_63.gif],  obtaining  [Graphics:Images/IterativeRefinementMod_gr_64.gif]  or  [Graphics:Images/IterativeRefinementMod_gr_65.gif].  Use the substitution  [Graphics:Images/IterativeRefinementMod_gr_66.gif]  and this equation becomes  

               
[Graphics:Images/IterativeRefinementMod_gr_67.gif].   

Use the LU solver to compute  [Graphics:Images/IterativeRefinementMod_gr_68.gif]  as follows  

(3)            
[Graphics:Images/IterativeRefinementMod_gr_69.gif].  

Then the improvement  [Graphics:Images/IterativeRefinementMod_gr_70.gif]  is made  

(4)            [Graphics:Images/IterativeRefinementMod_gr_71.gif]

The process can be iterated to obtain a sequence [Graphics:Images/IterativeRefinementMod_gr_72.gif]  converging to  [Graphics:Images/IterativeRefinementMod_gr_73.gif]  
    
        
    For  [Graphics:Images/IterativeRefinementMod_gr_74.gif]  
    
            [Graphics:Images/IterativeRefinementMod_gr_75.gif]

 

Algorithm (Iterative Refinement).  Compute the factorization  [Graphics:Images/IterativeRefinementMod_gr_76.gif]  is computed once.  The notation  [Graphics:Images/IterativeRefinementMod_gr_77.gif]  means that [Graphics:Images/IterativeRefinementMod_gr_78.gif] is the computed solution for the equation  [Graphics:Images/IterativeRefinementMod_gr_79.gif].  

        Set  [Graphics:Images/IterativeRefinementMod_gr_80.gif]
    
        [Graphics:Images/IterativeRefinementMod_gr_81.gif]
    
    
    For  [Graphics:Images/IterativeRefinementMod_gr_82.gif]  
    
        [Graphics:Images/IterativeRefinementMod_gr_83.gif]

Mathematica Subroutine (Iterative Refinement).  The following subroutine will perform the [Graphics:Images/IterativeRefinementMod_gr_84.gif] step of iterative refinement.  Input [Graphics:Images/IterativeRefinementMod_gr_85.gif] and output [Graphics:Images/IterativeRefinementMod_gr_86.gif].  The local variables in the subroutine are labeled as the first step.  The subroutine call should be  [Graphics:Images/IterativeRefinementMod_gr_87.gif],  it is assumed that [Graphics:Images/IterativeRefinementMod_gr_88.gif] is already a global variable and will create and return  [Graphics:Images/IterativeRefinementMod_gr_89.gif].  Notice that the computational part of the subroutine consists of only three lines:

        [Graphics:Images/IterativeRefinementMod_gr_90.gif]

The remainder of the subroutine consists of print statements.

[Graphics:Images/IterativeRefinementMod_gr_91.gif]

Remark 1.  Historically, iterative improvement was devised to use a limited amount of "

double precision" arithmetic to try to refine the computed solution  [Graphics:Images/IterativeRefinementMod_gr_92.gif]  of a linear system  [Graphics:Images/IterativeRefinementMod_gr_93.gif].  We see an inherent difficulty in this process:  if we cannot solve  [Graphics:Images/IterativeRefinementMod_gr_94.gif]  exactly, we cannot expect to solve  [Graphics:Images/IterativeRefinementMod_gr_95.gif]  exactly!  The signal feature of iterative improvement is to calculate the residuals  [Graphics:Images/IterativeRefinementMod_gr_96.gif] in double precision and everything else in single precision.

FORTRAN is well suited for defining the type of a variable to be either single precision or

double precision.  A resource for this technique is found in, Section 2.5 Iterative Improvement of a Solution to Linear Equations pp. 47-50, in the book by William H. Press, Saul A. Teukolsky, William T. Vetterling, Brian P. Flannery: Numerical Recipes in Fortran 77, Cambridge University Press, 1992, Cambridge, UK.

Remark 2.  The examples we present are for pedagogical purposes and because this module does not use FORTRAN, we cannot illustrate the full purpose of iterative improvement.  Also, because the convergence will be rapid, we only perform two iterations and to not need a subroutine for the computations.

 



Discussion Center

Discuss/
Query

Papers/
Syllabus

Feedback/
Suggestion

Yahoo
Groups

Sirfdosti
Groups

Contact
Us

MEMBERS LOGIN
  
Email ID:
Password:

  Forgot Password?
 New User? Register!

INTERVIEW EBOOK
Get 9,000+ Interview Questions & Answers in an eBook. Interview Question & Answer Guide
  • 9,000+ Interview Questions
  • All Questions Answered
  • 5 FREE Bonuses
  • Free Upgrades
GATE RESOURCES
 
  • Gate Books
  • Training Institutes
  • Gate FAQs
  • GATE BOOKS
     
  • Mechanical Engineeering Books
  • Robotics Automations Engineering Books
  • Civil Engineering Books
  • Chemical Engineering Books
  • Environmental Engineering Books
  • Electrical Engineering Books
  • Electronics Engineering Books
  • Information Technology Books
  • Software Engineering Books
  • GATE Preparation Books
  • Exciting Offers



    GATE Exam, Gate 2009, Gate Papers, Gate Preparation & Related Pages


    GATE Overview | GATE Eligibility | Structure Of GATE | GATE Training Institutes | Colleges Providing M.Tech/M.E. | GATE Score | GATE Results | PG with Scholarships | Article On GATE | GATE Forum | GATE 2009 Exclusive | GATE 2009 Syllabus | GATE Organizing Institute | Important Dates for GATE Exam | How to Apply for GATE | Discipline / Branch Codes | GATE Syllabus for Aerospace Engineering | GATE Syllabus for Agricultural Engineering | GATE Syllabus for Architecture and Planning | GATE Syllabus for Chemical Engineering | GATE Syllabus for Chemistry | GATE Syllabus for Civil Engineering | GATE Syllabus for Computer Science / IT | GATE Syllabus for Electronics and Communication Engineering | GATE Syllabus for Engineering Sciences | GATE Syllabus for Geology and Geophysics | GATE Syllabus for Instrumentation Engineering | GATE Syllabus for Life Sciences | GATE Syllabus for Mathematics | GATE Syllabus for Mechanical Engineering | GATE Syllabus for Metallurgical Engineering | GATE Syllabus for Mining Engineering | GATE Syllabus for Physics | GATE Syllabus for Production and Industrial Engineering | GATE Syllabus for Pharmaceutical Sciences | GATE Syllabus for Textile Engineering and Fibre Science | GATE Preparation | GATE Pattern | GATE Tips & Tricks | GATE Compare Evaluation | GATE Sample Papers | GATE Downloads | Experts View on GATE | CEED 2009 | CEED 2009 Exam | Eligibility for CEED Exam | Application forms of CEED Exam | Important Dates of CEED Exam | Contact Address for CEED Exam | CEED Examination Centres | CEED Sample Papers | Discuss GATE | GATE Forum of OneStopGATE.com | GATE Exam Cities | Contact Details for GATE | Bank Details for GATE | GATE Miscellaneous Info | GATE FAQs | Advertisement on GATE | Contact Us on OneStopGATE |
    Copyright © 2024. One Stop Gate.com. All rights reserved Testimonials |Link To Us |Sitemap |Privacy Policy | Terms and Conditions|About Us
    Our Portals : Academic Tutorials | Best eBooksworld | Beyond Stats | City Details | Interview Questions | India Job Forum | Excellent Mobiles | Free Bangalore | Give Me The Code | Gog Logo | Free Classifieds | Jobs Assist | Interview Questions | One Stop FAQs | One Stop GATE | One Stop GRE | One Stop IAS | One Stop MBA | One Stop SAP | One Stop Testing | Web Hosting | Quick Site Kit | Sirf Dosti | Source Codes World | Tasty Food | Tech Archive | Software Testing Interview Questions | Free Online Exams | The Galz | Top Masala | Vyom | Vyom eBooks | Vyom International | Vyom Links | Vyoms | Vyom World
    C Interview Questions | C++ Interview Questions | Send Free SMS | Placement Papers | SMS Jokes | Cool Forwards | Romantic Shayari