Origins: Practical Computation Before Formal Theory (Antiquity–1600s)
Early arithmetic methods for approximation in astronomy, engineering, and measurement
Iterative procedures appear implicitly (e.g., root-finding ideas akin to later methods)
Foundational Era: Calculus and Early Error Awareness (1600s–1700s)
Development of calculus enables systematic approximation of derivatives and integrals
Early numerical quadrature and series-based approximations used in mechanics and astronomy
Increasing attention to approximation error and convergence in computations
Classical Numerical Methods Take Shape (1800s–Early 1900s)
Interpolation and approximation theory mature (polynomial interpolation, least squares)
Numerical solutions for differential equations emerge for physics and engineering problems
Linear algebra computations develop (elimination methods, conditioning concepts begin)
Numerical analysis becomes identifiable as a toolkit: algorithms + error/efficiency concerns
Modern Discipline Formation with Digital Computers (1940s–1960s)
Electronic computing makes algorithmic efficiency and stability central concerns
Formal concepts expand: stability, consistency, convergence, floating-point rounding error
Standard families of methods become widely used
Root finding (Newton-type methods)
Numerical integration (quadrature rules)
ODE/PDE discretization (finite difference, early finite element ideas)
Matrix computations (factorizations for linear systems)
Expansion into Scientific Computing (1970s–1990s)
Large-scale linear algebra and eigenvalue problems (iterative methods, Krylov subspace methods)
Finite element and finite volume methods mature for PDEs in engineering and physics
Error estimation and adaptivity become practical (adaptive mesh refinement, adaptive step sizes)
High-performance computing shapes algorithm design (vectorization, parallelism)
Contemporary Numerical Analysis (2000s–Present)
Emphasis on scalability for massive data and simulations (parallel and distributed algorithms)
Structure-exploiting methods (sparse, low-rank, randomized numerical linear algebra)
Uncertainty quantification and probabilistic numerics influence modeling and decision-making
Interaction with machine learning
Optimization algorithms as numerical methods at scale
Differentiable programming and automatic differentiation for scientific models
What Numerical Analysis Is (Core Definition Across All Periods)
The study and design of algorithms to obtain approximate solutions to mathematical problems
Central pillars
Accuracy (how close the approximation is)
Stability (how errors propagate, especially rounding and perturbations)
Convergence (whether the method approaches the true solution)
Efficiency (time/memory cost)
Typical problem classes
Solving nonlinear equations, numerical integration/differentiation
Solving linear systems and eigenvalue problems
Numerical solutions of ODEs and PDEs
Approximation, interpolation, and optimization