Professional Documents
Culture Documents
Numerical Computing
Numerical Computing
Numerical Computing
Title
Furniture business in Gakhar
By Group
To
Mrs. Sadia Tasaddaque
With respect to Computer Science, here are some examples where numerical methods are
used:
● Systems that predict things
● Simulations
● Systems that analyze user behaviors
● Systems that calculate the safest decision to take based on numerical data
● Some algorithms related to computer graphics
● Some algorithms used in videogames to make the AI take smart decisions
● one such Practical application is in machine learning where you have to build a model
from huge amount of data and this model is actually a precise model which can classify
your test cases into some category or can output you some value.
Here are some more uses of numerical Computing in Artificial Intelligence:
1. Learning/Parameter Estimation
The goal of a learning machine is often formalized in terms of an optimization problem, i.e.,
minimization or maximization of a mathematical function. Numerical methods are crucial when
an analytical solution to the optimization does not exist. The most popular numerical
optimization algorithms in ML use derivative information (for example, gradient descent,
accelerated gradient descent methods including Momentum, Nestorov method etc., Newton's
method, L-BFGS). Stochastic approximation algorithms (for example, stochastic gradient
descent) are also popular and have become especially relevant with the proliferation of large
datasets.
The Expectation Maximization (EM) algorithm and variants are popular numerical methods for
estimation in models with hidden/latent variables (for example, Gaussian mixture model,
Hidden Markov Random Field, Structural Equation Model with latent variables).
These algorithms are widely used in regression models (for example, neural
network model with real valued output, large scale linear regression model),
classification models (for example, logistic regression and multinomial
regression), clustering models (for example, k-means clustering, Gaussian mixture
model), structure learning models (for example, Hidden Markov Model, Conditional Random
Field) and reinforcement learning models.
2. Inference
Inference in large probability distributions such as Markov Random Fields (example: Boltzmann
Machine is a special case of a MRF) is often intractable because the normalization constant is
computationally intractable. Hence, to be able to answer questions such as "what is the most
probable value under this distribution?" requires relying upon numerical methods such as
Monte Carlo Markov Chain methods (for example, Metropolis Hastings algorithm, Metropolis
algorithm, Gibbs sampler) which can provide approximations.
3. Numerical Integration
Computing large integrals (or sums) is a common operation in ML. For example, Bayesian
Statistics often requires computing very large multidimensional integrals.
Computing expectations is another common operation in ML and often requires computing
large integrals (examples include EM type algorithms, MRF learning algorithms).
Numerical methods such as Monte Carlo methods are commonly called upon in these cases.