List of numerical libraries

This is a list of numerical libraries, which are libraries used in software development for performing numerical calculations. It is not a complete listing but is instead a list of numerical libraries with articles on Wikipedia, with few exceptions.

The choice of a typical library depends on a range of requirements such as: desired features (e.g. large dimensional linear algebra, parallel computation, partial differential equations), licensing, readability of API, portability or platform/compiler dependence (e.g. Linux, Windows, Visual C++, GCC), performance, ease-of-use, continued support from developers, standard compliance, specialized optimization in code for specific application scenarios or even the size of the code-base to be installed.

Multi-language

ALGLIB is an open source numerical analysis library which may be used from C++, C#, FreePascal, Delphi, VBA.
ArrayFire is a high performance open source software library for parallel computing with an easy-to-use API.
IMSL Numerical Libraries are libraries of numerical analysis functionality implemented in standard programming languages like C, Java, C# .NET, Fortran, and Python.
The NAG Library is a collection of mathematical and statistical routines for multiple programming languages (C, C++, Fortran, Visual Basic, Java, Python and C#) and packages (MATLAB, Excel, R, LabVIEW).
GNU Octave is an open source high level programming language and library, including a command line interface and GUI, analogous to commercial alternatives such as Maple, MATLAB, Mathematica, etc. APIs, functions and libraries can be called from many platforms, including high level engineering programs, where functions are, in many cases, seamlessly interpreted and integrated in similar fashion to MATLAB. It also can be used with batch orientation.
librsb is an open source library for high performance sparse matrix computations providing multi-threaded primitives to build iterative solvers (implements also the Sparse BLAS standard). It can be used from C, C++, Fortran, and a dedicated GNU Octave package.

C

BLOPEX (Block Locally Optimal Preconditioned Eigenvalue Xolvers) is an open-source library for the scalable (parallel) solution of eigenvalue problems.
FFTW (Fastest Fourier Transform in the West) is a software library for computing Fourier and related transforms.
GNU Scientific Library, a popular, free numerical analysis library implemented in C.
GNU Multi-Precision Library is a library for doing arbitrary-precision arithmetic.
hypre (High Performance Preconditioners) is an open-source library of routines for scalable (parallel) solution of linear systems and preconditioning.
LabWindows/CVI is an ANSI C IDE that includes built-in libraries for analysis of raw measurement data, signal generation, windowing, filter functions, signal processing, linear algebra, array and complex operations, curve fitting and statistics.
Lis is a scalable parallel library for solving systems of linear equations and eigenvalue problems using iterative methods.
Intel MKL (Math Kernel Library) contains optimized math routines for science, engineering, and financial applications, and is written in C/C++ and Fortran. Core math functions include BLAS, LAPACK, ScaLAPACK, sparse solvers, fast Fourier transforms, and vector math.
Intel IPP is a multi-threaded software library of functions for multimedia and data processing applications.
OpenBLAS is an open source implementation of the BLAS API with many hand-crafted optimizations for specific processor types. It performs similar to Intel MKL on Intel processors and higher on various others.
Portable, Extensible Toolkit for Scientific Computation (PETSc), is a suite of data structures and routines for the scalable (parallel) solution of scientific applications modeled by partial differential equations.
SLEPc Scalable Library for Eigenvalue Problem Computations is a PETSc-based open-source library for the scalable (parallel) solution of eigenvalue problems.
UMFPACK is a library for solving sparse linear systems, written in Ansi C. It is the backend for sparse matrices in MATLAB and SciPy.

C++

Adept is a combined automatic differentiation and array library.
Advanced Simulation Library is free and open source hardware accelerated multiphysics simulation software with an OpenCL-based internal computational engine.
ALGLIB is an open source / commercial numerical analysis library with C++ version
Armadillo is a C++ linear algebra library (matrix and vector maths), aiming towards a good balance between speed and ease of use.^[1] It employs template classes, and has optional links to BLAS and LAPACK. The syntax (API) is similar to MATLAB.
Blitz++ is a high-performance vector mathematics library written in C++.
Boost.uBLAS C++ libraries for numerical computation
deal.II is a library supporting all the finite element solution of partial differential equations.
Dlib is a modern C++ library with easy to use linear algebra and optimization tools which benefit from optimized BLAS and LAPACK libraries.
Eigen is a vector mathematics library with performance comparable with Intel's Math Kernel Library
Hermes Project: C++/Python library for rapid prototyping of space- and space-time adaptive hp-FEM solvers.
IML++ is a C++ library for solving linear systems of equations, capable of dealing with dense, sparse, and distributed matrices.
IT++ is a C++ library for linear algebra (matrices and vectors), signal processing and communications. Functionality similar to MATLAB and Octave.
LAPACK++, a C++ wrapper library for LAPACK and BLAS
MFEM is a free, lightweight, scalable C++ library for finite element methods.
Intel MKL, Intel Math Kernel Library (in C and C++), a library of optimized math routines for science, engineering, and financial applications, written in C/C++ and Fortran. Core math functions include BLAS, LAPACK, ScaLAPACK, sparse solvers, fast Fourier transforms, and vector math.
mlpack is an open-source library for machine learning, exploiting C++ language features to provide maximum performance and flexibility while providing a simple and consistent API
MTL4 is a generic C++ template library providing sparse and dense BLAS functionality. MTL4 establishes an intuitive interface (similar to MATLAB) and broad applicability thanks to Generic programming.
The NAG Library has C++ API
NTL is a C++ library for number theory.
OpenFOAM is an open-source C++ library for solving partial differential equations in computational fluid dynamics (CFD).
SU2 code is an open-source library for solving partial differential equations with the finite volume or finite element method.
Trilinos is an effort to develop algorithms and enabling technologies for the solution of large-scale, complex multi-physics engineering and scientific problems. It is a collection of packages.
Template Numerical Toolkit (TNT) linear algebra software in the public domain and entirely in the form of headers, from NIST. TNT was originally presented as a successor to Lapack++, Sparselib++, and IML++.^[2]

Delphi

ALGLIB - an open source numerical analysis library.

.NET Framework languages C#, F#, VB.NET and PowerShell

Accord.NET is a collection of libraries for scientific computing, including numerical linear algebra, optimization, statistics, artificial neural networks, machine learning, signal processing and computer vision. LGPLv3, partly GPLv3.
AForge.NET is a computer vision and artificial intelligence library. It implements a number of genetic, fuzzy logic and machine learning algorithms with several architectures of artificial neural networks with corresponding training algorithms. LGPLv3 and partly GPLv3.
ALGLIB is an open source numerical analysis library with C# version. Dual licensed: GPLv2+, commercial license.
ILNumerics.Net Commercial high performance, typesafe numerical array classes and functions for general math, FFT and linear algebra, aims .NET/mono, 32&64 bit, script-like syntax in C#, 2D & 3D plot controls, efficient memory management.
IMSL Numerical Libraries have C# version (commercially licensed). IMSL .Net have announced end of life at the end of 2020.
Math.NET Numerics aims to provide methods and algorithms for numerical computations in science, engineering and everyday use. Covered topics include special functions, linear algebra, probability models, random numbers, interpolation, integral transforms and more. Free software under MIT/X11 license.
Measurement Studio is a commercial integrated suite UI controls and class libraries for use in developing test and measurement applications. The analysis class libraries provide various digital signal processing, signal filtering, signal generation, peak detection, and other general mathematical functionality.
ML.NET is a free software machine learning library for the C# programming language.^[3]^[4]
The NAG Library has C# API. Commercially licensed.
NMath by CenterSpace Software: Commercial numerical component libraries for the .NET platform, including signal processing (FFT) classes, a linear algebra (LAPACK & BLAS) framework, and a statistics package.

Fortran

BLAS (Basic Linear Algebra Subprograms) is a de facto application programming interface standard for publishing libraries to perform basic linear algebra operations such as vector and matrix multiplication.
CERNLIB is a collection of FORTRAN 77 libraries and modules.
EISPACK is a software library for numerical computation of eigenvalues and eigenvectors of matrices,^[5] written in FORTRAN. It contains subroutines for calculating the eigenvalues of nine classes of matrices: complex general, complex Hermitian, real general, real symmetric, real symmetric banded, real symmetric tridiagonal, special real tridiagonal, generalized real, and generalized real symmetric matices.
IMSL Numerical Libraries are cross-platform libraries containing a comprehensive set of mathematical and statistical functions that can be embedded in a users application.
Harwell Subroutine Library is a collection of Fortran 77 and 95 codes that address core problems in numerical analysis.
LAPACK,^[6]^[7] the Linear Algebra PACKage, is a software library for numerical computing originally written in FORTRAN 77 and now written in Fortran 90.
LINPACK is a software library for performing numerical linear algebra on digital computers.^[8]^[9]^[10] It was written in Fortran by Jack Dongarra, Jim Bunch, Cleve Moler, and Pete Stewart, and was intended for use on supercomputers in the 1970s and early 1980s. It has been largely superseded by LAPACK, which will run more efficiently on modern architectures.
Lis is a scalable parallel library for solving systems of linear equations and eigenvalue problems using iterative methods.
MINPACK is a library of FORTRAN subroutines for the solving of systems of nonlinear equations, or the least squares minimization of the residual of a set of linear or nonlinear equations.
The NAG Fortran Library is a collection of mathematical and statistical routines for Fortran.
NOVAS is a software library for astrometry-related numerical computations. Both Fortran and C versions are available.
Netlib is a repository of scientific computing software which contains a large number of separate programs and libraries including BLAS, EISPACK, LAPACK and others.
PAW is a free data analysis package developed at CERN.
Portable, Extensible Toolkit for Scientific Computation (PETSc), is a suite of data structures and routines for the scalable (parallel) solution of scientific applications modeled by partial differential equations.
QUADPACK is a FORTRAN 77 library for numerical integration of one-dimensional functions
SLATEC is a FORTRAN 77 library of over 1400 general purpose mathematical and statistical routines.
SOFA is a collection of subroutines that implement official IAU algorithms for astronomical computations. Both Fortran and C versions are available.
ARPACK is a collection of Fortran77 subroutines designed to solve large scale eigenvalue problems.
BLIS is an open-source framework for implementing a superset of BLAS functionality for specific processor types that was awarded the J. H. Wilkinson Prize for Numerical Software.

Java

Apache Commons, is an open-source for creating reusable Java components. It has numerical packages for linear algebra and non-linear optimization.
Colt provides a set of Open Source Libraries for High Performance Scientific and Technical Computing.
Efficient Java Matrix Library (EJML) is an open-source linear algebra library for manipulating dense matrices.
JAMA, a numerical linear algebra toolkit for the Java programming language. No active development has taken place since 2005, but it still one of the more popular linear algebra packages in Java.
Jblas: Linear Algebra for Java, a linear algebra library which is an easy to use wrapper around BLAS and LAPACK.
Parallel Colt is an open source library for scientific computing. A parallel extension of Colt.
Matrix Toolkit Java is a linear algebra library based on BLAS and LAPACK.
ojAlgo is an open source Java library for mathematics, linear algebra and optimisation.
exp4j is a small Java library for evaluation of mathematical expressions.
SuanShu is an open-source Java math library. It supports numerical analysis, statistics and optimization.
Maja is an open-source Java library focusing primarily on correct implementations of various special functions.

Perl

Perl Data Language gives standard Perl the ability to compactly store and speedily manipulate the large N-dimensional data arrays.^[11] It can perform complex and matrix maths, and has interfaces for the GNU Scientific Library, LINPACK, PROJ, and plotting with PGPLOT. There are libraries on CPAN adding support for the linear algebra library LAPACK,^[12] the Fourier transform library FFTW,^[13] and plotting with gnuplot,^[14] and PLplot.^[15]

Python

NumPy, a BSD-licensed library that adds support for the manipulation of large, multi-dimensional arrays and matrices; it also includes a large collection of high-level mathematical functions. NumPy serves as the backbone for a number of other numerical libraries, notably SciPy. De facto standard for matrix/tensor operations in Python.
Pandas, a library for data manipulation and analysis.
SageMath is a large mathematical software application which integrates the work of nearly 100 free software projects and supports linear algebra, combinatorics, numerical mathematics, calculus, and more.^[16]
SciPy,^[17]^[18]^[19] a large BSD-licensed library of scientific tools. De facto standard for scientific computations in Python.
ScientificPython, a library with a different set of scientific tools
SymPy, a library based on New BSD license for symbolic computation. Features of Sympy range from basic symbolic arithmetic to calculus, algebra, discrete mathematics and quantum physics.

Others

XNUMBERS – multi-precision floating-Point computing and numerical methods for Microsoft Excel.
INTLAB – interval arithmetic library for MATLAB.^[20]^[21]^[22]^[23]

References

^ Sanderson, C., & Curtin, R. (2016). Armadillo: a template-based C++ library for linear algebra. Journal of Open Source Software, 1(2), 26.
^ Pozo, Roldan (1997). "Template Numerical Toolkit for Linear Algebra: High Performance Programming With C++ and the Standard Template Library". The International Journal of Supercomputer Applications and High Performance Computing. 11 (3). Association for Computing Machinery: 251–263. doi:10.1177/109434209701100307. Retrieved 15 October 2024.
^ David Ramel (2018-05-08). "Open Source, Cross-Platform ML.NET Simplifies Machine Learning -- Visual Studio Magazine". Visual Studio Magazine. Retrieved 2018-05-10.
^ Kareem Anderson (2017-05-09). "Microsoft debuts ML.NET cross-platform machine learning framework". On MSFT. Retrieved 2018-05-10.
^ Smith, B. T., Boyle, J. M., Garbow, B. S., Ikebe, Y., Klema, V. C., & Moler, C. B. (2013). Matrix eigensystem routines-EISPACK guide (Vol. 6). Springer.
^ Anderson, E., Bai, Z., Bischof, C., Blackford, S., Dongarra, J., Du Croz, J., ... & Sorensen, D. (1999). LAPACK Users' guide (Vol. 9). SIAM.
^ Demmel, J. (1989, December). LAPACK: A portable linear algebra library for supercomputers. In IEEE Control Systems Society Workshop on Computer-Aided Control System Design (pp. 1-7). IEEE.
^ Dongarra, J. J., Moler, C. B., Bunch, J. R., & Stewart, G. W. (1979). LINPACK users' guide. Society for Industrial and Applied Mathematics.
^ Dongarra, J. J., Luszczek, P., & Petitet, A. (2003). The LINPACK benchmark: past, present and future. Concurrency and Computation: practice and experience, 15(9), 803-820.
^ Dongarra, J. J. (1987, June). The LINPACK benchmark: An explanation. In International Conference on Supercomputing (pp. 456-474). Springer, Berlin, Heidelberg.
^ "Perl Data Language - metacpan.org". July 26, 2021.
^ "PDL::LinearAlgebra - Linear Algebra utils for PDL - metacpan.org". July 26, 2021.
^ "PDL::FFTW3 - PDL interface to the Fastest Fourier Transform in the West - metacpan.org". July 26, 2021.
^ "PDL::Graphics::Gnuplot - Gnuplot-based plotting for PDL - metacpan.org". July 26, 2021.
^ "PDL::Graphics::PLplot - Object-oriented interface from perl/PDL to the PLPLOT plotting library - metacpan.org". July 26, 2021.
^ Zimmermann, P., Casamayou, A., Cohen, N., Connan, G., Dumont, T., Fousse, L., ... & Bray, E. (2018). Computational Mathematics with SageMath. SIAM.
^ Jones, E., Oliphant, T., & Peterson, P. (2001). SciPy: Open source scientific tools for Python.
^ Bressert, E. (2012). SciPy and NumPy: an overview for developers. " O'Reilly Media, Inc.".
^ Blanco-Silva, F. J. (2013). Learning SciPy for numerical and scientific computing. Packt Publishing Ltd.
^ S.M. Rump: INTLAB – INTerval LABoratory. In Tibor Csendes, editor, Developments in Reliable Computing, pages 77–104. Kluwer Academic Publishers, Dordrecht, 1999.
^ Moore, R. E., Kearfott, R. B., & Cloud, M. J. (2009). Introduction to Interval Analysis. Society for Industrial and Applied Mathematics.
^ Rump, S. M. (2010). Verification methods: Rigorous results using floating-point arithmetic. Acta Numerica, 19, 287–449.
^ Hargreaves, G. I. (2002). Interval analysis in MATLAB. Numerical Algorithms, (2009.1).

External links

The Math Forum - Math Libraries, an extensive list of mathematical libraries with short descriptions

[1] Sanderson, C., & Curtin, R. (2016). Armadillo: a template-based C++ library for linear algebra. Journal of Open Source Software, 1(2), 26.

[2] Pozo, Roldan (1997). "Template Numerical Toolkit for Linear Algebra: High Performance Programming With C++ and the Standard Template Library". The International Journal of Supercomputer Applications and High Performance Computing. 11 (3). Association for Computing Machinery: 251–263. doi:10.1177/109434209701100307. Retrieved 15 October 2024.

[visu_Open-3] David Ramel (2018-05-08). "Open Source, Cross-Platform ML.NET Simplifies Machine Learning -- Visual Studio Magazine". Visual Studio Magazine. Retrieved 2018-05-10.

[onms_Micr-4] Kareem Anderson (2017-05-09). "Microsoft debuts ML.NET cross-platform machine learning framework". On MSFT. Retrieved 2018-05-10.

[5] Smith, B. T., Boyle, J. M., Garbow, B. S., Ikebe, Y., Klema, V. C., & Moler, C. B. (2013). Matrix eigensystem routines-EISPACK guide (Vol. 6). Springer.

[6] Anderson, E., Bai, Z., Bischof, C., Blackford, S., Dongarra, J., Du Croz, J., ... & Sorensen, D. (1999). LAPACK Users' guide (Vol. 9). SIAM.

[7] Demmel, J. (1989, December). LAPACK: A portable linear algebra library for supercomputers. In IEEE Control Systems Society Workshop on Computer-Aided Control System Design (pp. 1-7). IEEE.

[8] Dongarra, J. J., Moler, C. B., Bunch, J. R., & Stewart, G. W. (1979). LINPACK users' guide. Society for Industrial and Applied Mathematics.

[9] Dongarra, J. J., Luszczek, P., & Petitet, A. (2003). The LINPACK benchmark: past, present and future. Concurrency and Computation: practice and experience, 15(9), 803-820.

[10] Dongarra, J. J. (1987, June). The LINPACK benchmark: An explanation. In International Conference on Supercomputing (pp. 456-474). Springer, Berlin, Heidelberg.

[11] "Perl Data Language - metacpan.org". July 26, 2021.

[12] "PDL::LinearAlgebra - Linear Algebra utils for PDL - metacpan.org". July 26, 2021.

[13] "PDL::FFTW3 - PDL interface to the Fastest Fourier Transform in the West - metacpan.org". July 26, 2021.

[14] "PDL::Graphics::Gnuplot - Gnuplot-based plotting for PDL - metacpan.org". July 26, 2021.

[15] "PDL::Graphics::PLplot - Object-oriented interface from perl/PDL to the PLPLOT plotting library - metacpan.org". July 26, 2021.

[16] Zimmermann, P., Casamayou, A., Cohen, N., Connan, G., Dumont, T., Fousse, L., ... & Bray, E. (2018). Computational Mathematics with SageMath. SIAM.

[17] Jones, E., Oliphant, T., & Peterson, P. (2001). SciPy: Open source scientific tools for Python.

[18] Bressert, E. (2012). SciPy and NumPy: an overview for developers. " O'Reilly Media, Inc.".

[19] Blanco-Silva, F. J. (2013). Learning SciPy for numerical and scientific computing. Packt Publishing Ltd.

[rump-20] S.M. Rump: INTLAB – INTerval LABoratory. In Tibor Csendes, editor, Developments in Reliable Computing, pages 77–104. Kluwer Academic Publishers, Dordrecht, 1999.

[moore-21] Moore, R. E., Kearfott, R. B., & Cloud, M. J. (2009). Introduction to Interval Analysis. Society for Industrial and Applied Mathematics.

[acta-22] Rump, S. M. (2010). Verification methods: Rigorous results using floating-point arithmetic. Acta Numerica, 19, 287–449.

[har-23] Hargreaves, G. I. (2002). Interval analysis in MATLAB. Numerical Algorithms, (2009.1).

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]