SLN 10224, MWF 2:30-3:20, LOW 216
Click here for online lectures: amath584
|Professor Anne Greenbaum
office hours: T, Th 10-11.
office hours: W 3:30-4:30 (for online students, Skype firstname.lastname@example.org)
Th 2:50-3:50 (for on campus students), Lewis 320.
Numerical linear algebra. Review of basic linear algebra and Matlab programming. The singular value decomposition, QR factorization and least squares problems. Conditioning of problems, stability of algorithms. Solving systems of linear equations using Gaussian elimination: timing and accuracy considerations. Solving eigenvalue problems.
The required textbook for this course is "Numerical Linear Algebra" by L.N. Trefethen and D. Bau, SIAM, 1997. We will cover chapters I through V of this book. You also will need access to MATLAB.
Other recommended books (that will not be used in class but are valuable resources) include:
1. "Matrix Computations," by Golub and Van Loan. This is an excellent reference book for practically everything there is to know about numerical linear algebra.
2. "Applied Linear Algebra," by J. Demmel, SIAM, 1997. Goes more deeply into the same topics covered in Trefethen and Bau, especially concerning different variants of computational algorithms.
3. "Numerical Methods: Design, Analysis, and Computer Implementation of Algorithms," by Greenbaum and Chartier, Princeton, 2012. Covers numerical analysis in general but contains chapters on solving linear systems and least squares problems, floating point arithmetic, conditioning and stability, and eigenvalue problems that are along the lines of Trefethen and Bau. Also contains an appendix with a review of basic linear algebra and a chapter on Matlab.
- (1) Review of basic linear algebra and Matlab:
Ways of looking at matrix-vector multiplication. Linear independence and dependence, span of a set of vectors, dimension of a vector space. Orthogonal vectors and matrices. Basic operations with Matlab.
- (2) The singular value decomposition.
What is it and how can it be useful?
- (3) QR factorization and least squares.
- Gram-Schmidt and Householder orthogonalization. Least squares solutions to overdetermined linear systems. Fitting polynomials to data.
- (4) Conditioning of problems, stability of algorithms.
- Floating point arithmetic. What does it mean for a problem to be "ill-conditioned"? Forward and backward error analysis.
- (5) Direct methods for solving systems of linear equations.
- Gaussian elimination. Pivoting. Operation counts and implementation issues for high performance computing. Stability of Gaussian elimination with partial pivoting.
- (6) Eigenvalue problems.
- The power method, inverse iteration, Rayleigh quotient iteration. Reduction to Hessenberg or tridiagonal form. The QR algorithm. Computing the SVD.
Learning objectives and instructor expectations
Schedule and Homework
Follow links in the table below to obtain a copy of the homework in latex (.tex) or Adobe Acrobat (.pdf) format. You may also obtain here solutions to some of the homework and exam problems. An item shown below in plain text is not yet available.
|Homework and Exams||Homework Due Date||Homework Problem Sets||Homework Solutions|
|First day of classes||Wednesday, Sept. 30|
|Homework#1||due Friday, Oct. 9||Homework #1 (.pdf, .tex)||HW #1 Solutions (.pdf)|
|Homework#2||due Friday, Oct. 16||Homework #2 (.pdf,.tex)||HW #2 Solutions (.pdf)|
|Homework#3||due Friday, Oct. 23||Homework #3 (.pdf,.tex)||HW #3 Solutions (.pdf)|
|Homework#4||due Friday, Oct. 30||Homework #4 (.pdf,.tex)||HW #4 Solutions (.pdf)|
|Practice problems for midterm||Practice (.pdf)||Practice Problems Solutions (.pdf)|
|Midterm||Monday, Nov. 2||Midterm Solutions(.pdf)|
|Homework#4.5||due Monday, Nov. 9||Homework #4.5 (.pdf,.tex)|
|University holiday--Veterans Day||Wednesday, Nov. 11|
|Homework#5||due Monday, Nov. 16||Homework #5 (.pdf,.tex)||HW #5 Solutions (.pdf)|
|Homework#6||due Monday, Nov. 23||Homework #6 (.pdf,.tex)||HW #6 Solutions (.pdf)|
|University holiday--Thanksgiving||Thursday-Friday, Nov. 26-27|
|Homework#7||due Wednesday, Dec. 2||Homework #7 (.pdf,.tex)||HW #7 Solutions (.pdf)|
|Homework#8||due Wednesday, Dec. 9||Homework #8 (.pdf,.tex)||HW #8 Solutions (.pdf)|
|Practice problems for final||Practice (.pdf)||Practice Problems Solutions (.pdf)|
|Last day of classes||Friday, Dec. 11|
|Final||Tuesday, Dec. 15, 2:30-4:20pm||Final Solutions(.pdf)|
There will be weekly homework assignments (usually due on Fridays), a midterm (tentatively scheduled for Mon., Nov. 2), and a final. Exams count for 60% of the final grade. The final counts more than the midterm. ONLINE STUDENTS: YOU MUST HAVE A PROCTOR (APPROVED BY EDGE) FOR THE MIDTERM AND FINAL. Homework counts for 40% of your grade. You may work together on homework assignments, but each person must write up his/her own answers to the exercises.