You are here

MATH 584 A: Applied Linear Algebra And Introductory Numerical Analysis

Meeting Time: 
MWF 2:30pm - 3:20pm
LOW 216
Joint Sections: 
AMATH 584 A, AMATH 584 B, MATH 584 B
Anne Greenbaum

Syllabus Description:


SLN 10224, MWF 2:30-3:20, LOW 216

Click here for online lectures: amath584



Professor Anne Greenbaum
Lewis 312
tel: 206-543-1175
office hours: T, Th 10-11.


Yue Wang
office hours: W 3:30-4:30 (for online students, Skype
Th 2:50-3:50 (for on campus students), Lewis 320.


Homework Grades

Course description Textbook References Syllabus Objectives Schedule

Course Description

Numerical linear algebra. Review of basic linear algebra and Matlab programming. The singular value decomposition, QR factorization and least squares problems. Conditioning of problems, stability of algorithms. Solving systems of linear equations using Gaussian elimination: timing and accuracy considerations. Solving eigenvalue problems.


The required textbook for this course is "Numerical Linear Algebra" by L.N. Trefethen and D. Bau, SIAM, 1997. We will cover chapters I through V of this book. You also will need access to MATLAB.



Other recommended books (that will not be used in class but are valuable resources) include:

1. "Matrix Computations," by Golub and Van Loan. This is an excellent reference book for practically everything there is to know about numerical linear algebra.
2. "Applied Linear Algebra," by J. Demmel, SIAM, 1997. Goes more deeply into the same topics covered in Trefethen and Bau, especially concerning different variants of computational algorithms.
3. "Numerical Methods: Design, Analysis, and Computer Implementation of Algorithms," by Greenbaum and Chartier, Princeton, 2012. Covers numerical analysis in general but contains chapters on solving linear systems and least squares problems, floating point arithmetic, conditioning and stability, and eigenvalue problems that are along the lines of Trefethen and Bau. Also contains an appendix with a review of basic linear algebra and a chapter on Matlab.


(1) Review of basic linear algebra and Matlab:

Ways of looking at matrix-vector multiplication. Linear independence and dependence, span of a set of vectors, dimension of a vector space. Orthogonal vectors and matrices. Basic operations with Matlab.

(2) The singular value decomposition.

What is it and how can it be useful?

(3) QR factorization and least squares.
Gram-Schmidt and Householder orthogonalization. Least squares solutions to overdetermined linear systems. Fitting polynomials to data. 
(4) Conditioning of problems, stability of algorithms.
Floating point arithmetic. What does it mean for a problem to be "ill-conditioned"? Forward and backward error analysis.
(5) Direct methods for solving systems of linear equations.
Gaussian elimination. Pivoting. Operation counts and implementation issues for high performance computing. Stability of Gaussian elimination with partial pivoting.
(6) Eigenvalue problems. 
The power method, inverse iteration, Rayleigh quotient iteration. Reduction to Hessenberg or tridiagonal form. The QR algorithm. Computing the SVD.

Learning objectives and instructor expectations

Students are expected to gain an understanding of algorithms for solving problems in linear algebra: how they work, why they work, and what difficulties they might encounter.

Schedule and Homework

Follow links in the table below to obtain a copy of the homework in latex (.tex) or Adobe Acrobat (.pdf) format. You may also obtain here solutions to some of the homework and exam problems. An item shown below in plain text is not yet available.


Homework and Exams Homework Due Date Homework Problem Sets Homework Solutions
First day of classes Wednesday, Sept. 30
Homework#1 due Friday, Oct. 9 Homework #1 (.pdf, .tex) HW #1 Solutions (.pdf)
Homework#2 due Friday, Oct. 16 Homework #2 (.pdf,.tex) HW #2 Solutions (.pdf)
Homework#3 due Friday, Oct. 23 Homework #3 (.pdf,.tex) HW #3 Solutions (.pdf)
Homework#4 due Friday, Oct. 30 Homework #4 (.pdf,.tex) HW #4 Solutions (.pdf)
Practice problems for midterm Practice (.pdf) Practice Problems Solutions (.pdf)
Midterm Monday, Nov. 2 Midterm Solutions(.pdf)
Homework#4.5 due Monday, Nov. 9 Homework #4.5 (.pdf,.tex)
University holiday--Veterans Day Wednesday, Nov. 11
Homework#5 due Monday, Nov. 16 Homework #5 (.pdf,.tex) HW #5 Solutions (.pdf)
Homework#6 due Monday, Nov. 23 Homework #6 (.pdf,.tex) HW #6 Solutions (.pdf)
University holiday--Thanksgiving Thursday-Friday, Nov. 26-27
Homework#7 due Wednesday, Dec. 2 Homework #7 (.pdf,.tex) HW #7 Solutions (.pdf)
Homework#8 due Wednesday, Dec. 9 Homework #8 (.pdf,.tex) HW #8 Solutions (.pdf)
Practice problems for final Practice (.pdf) Practice Problems Solutions (.pdf)
Last day of classes Friday, Dec. 11
Final Tuesday, Dec. 15, 2:30-4:20pm Final Solutions(.pdf)

Class Summaries

class summaries


There will be weekly homework assignments (usually due on Fridays), a midterm (tentatively scheduled for Mon., Nov. 2), and a final. Exams count for 60% of the final grade. The final counts more than the midterm. ONLINE STUDENTS:  YOU MUST HAVE A PROCTOR (APPROVED BY EDGE) FOR THE MIDTERM AND FINAL.  Homework counts for 40% of your grade. You may work together on homework assignments, but each person must write up his/her own answers to the exercises.


Catalog Description: 
Numerical methods for solving linear systems of equations, linear least squares problems, matrix eigen value problems, nonlinear systems of equations, interpolation, quadrature, and initial value ordinary differential equations. Prerequisite: either a course in linear algebra or permission of instructor. Offered: jointly with AMATH 584; A.
Last updated: 
January 10, 2018 - 10:11pm