Applied Numerical Linear Algebra

Table 6.1 lists the costs of various direct and iterative methods for solving the model problem on an N-by- N grid. The variable n = N 2, the number of unknowns. Since direct methods provide the exact answer (in the absence of roundoff), whereas iterative methods provide only approximate answers, we must be careful when comparing their costs, since a low-accuracy answer can be computed more cheaply by an iterative method than a high-accuracy answer. Therefore, we compare costs, assuming that the iterative methods iterate often enough to make the error at most some fixed small value [27] (say, 10 ?6).
The second and third columns of Table 6.1 give the number of arithmetic operations (or time) and space required on a serial machine. Column 4 indicates whether the method is direct (D) or iterative (I). All entries are meant in the O( ) sense; the constants depend on implementation details and the stopping criterion for the iterative methods (say, 10 ?6). For example, the entry for Cholesky also applies to Gaussian elimination, since this changes the constant only by a factor of two. The last column indicates where the algorithm is discussed in the text.
The methods are listed in increasing order of speed, from slowest (dense Cholesky) to fastest (multigrid), ending with a lower bound applying to any method. The lower bound is n because at least one operation is required per...