History of Numerical Linear Algebra, a Personal View Gene H.Golub Stanford University Gene Golub History of Numerical Linear Algebra
History of Numerical Linear Algebra, a Personal View Gene H. Golub Stanford University Gene Golub / History of Numerical Linear Algebra
What is Numerical Analysis? .Webster's New Collegiate Dictionary (1973): "The study of quantitative approximations to the solutions of mathematical problems including consideration of the errors and bounds to the errors involved." .The American Heritage Dictionary(1992): "The study of approximate solutions to mathematical problems,taking into account the extent of possible errors." Gene Golub/History of Numerical Linear Algebra
What is Numerical Analysis? • Webster’s New Collegiate Dictionary (1973): ”The study of quantitative approximations to the solutions of mathematical problems including consideration of the errors and bounds to the errors involved.” • The American Heritage Dictionary (1992): ”The study of approximate solutions to mathematical problems, taking into account the extent of possible errors.” Gene Golub / History of Numerical Linear Algebra 1
Numerical Linear Algebra Numerical Linear Algebra (NLA)is a small but active area of research:a couple of hundred active,committed persons.But the community involves many scientists. Gene Golub/History of Numerical Linear Algebra 2
Numerical Linear Algebra Numerical Linear Algebra (NLA) is a small but active area of research: a couple of hundred active, committed persons. But the community involves many scientists. Gene Golub / History of Numerical Linear Algebra 2
How It All Started Numerical analysis motivated the development of the earliest computers. ●Ballistics ●Solution of PDE's ●Data Analysis Early pioneers included: J.von Neumann A.M.Turing In the beginning.·. von Neumann Goldstine (1947): "Numerical Inversion of Matrices of High Order" Gene Golub/History of Numerical Linear Algebra
How It All Started Numerical analysis motivated the development of the earliest computers. • Ballistics • Solution of PDE’s • Data Analysis Early pioneers included: J. von Neumann A. M. Turing In the beginning... von Neumann & Goldstine (1947): “Numerical Inversion of Matrices of High Order” Gene Golub / History of Numerical Linear Algebra 3
Top Ten Algorithms in Science (Dongarra and Sullivan,2000) 1.Metropolis Algorithm (Monte Carlo method) 2.Simplex Method for Linear Programming 3.Krylov Subspace Iteration Methods 4.The Decompositional Approach to Matrix Computations 5.The Fortran Optimizing Compiler 6.QR Algorithm for Computing Eigenvalues 7.Quicksort Algorithm for Sorting 8.Fast Fourier Transform 9.Integer Relation Detection Algorithm 10.Fast Multipole Method Red:Algorithms within the exclusive domain of NLA research. Blue:Algorithms strongly (though not exclusively) connected to NLA research. Gene Golub/History of Numerical Linear Algebra 4
Top Ten Algorithms in Science (Dongarra and Sullivan, 2000) 1. Metropolis Algorithm (Monte Carlo method) 2. Simplex Method for Linear Programming 3. Krylov Subspace Iteration Methods 4. The Decompositional Approach to Matrix Computations 5. The Fortran Optimizing Compiler 6. QR Algorithm for Computing Eigenvalues 7. Quicksort Algorithm for Sorting 8. Fast Fourier Transform 9. Integer Relation Detection Algorithm 10. Fast Multipole Method • Red: Algorithms within the exclusive domain of NLA research. • Blue: Algorithms strongly (though not exclusively) connected to NLA research. Gene Golub / History of Numerical Linear Algebra 4