CRAWLIN

G AND
INDEXING
 In the simplest terms, you could think of searching the
web as looking in a very large book with an impressive
index telling you exactly where everything is located.

When we perform a Google search, Google

programs check their index to determine the most
relevant search results.
There are three process in delivering search results.
1. Crawling – Does Google know about your site
and find it.
2. Indexing – Can Google index your site.
3. Serving – Does the site have good and useful content
that is relevant to search users.
CRAWLING
Crawling is the process of fetching all the web
pages linked with a website.

This task is performed by a software called crawler.

The crawlers are also known as spiders or bots , they
visit website and send information to their
respective parent websites.
INDEXING
Indexing is the process of creating index for all
the fetched web pages and keeping them into a
huge database from where it can later be
retrieved.
An index is another name for the database used
by a search engines. It contains information on all
the websites the search engine was able to find. If a
website is not in a search engine’s index, users will
not be able to find it using that search engine. Search
engines regularly update their indexes.
Difference between Indexing and
Crawling
Crawling is the process through which indexing is
done. Google crawlers crawls through the WebPages
and index the pages.

When search engine crawlers visit any link is called

crawling and when crawlers save or index that links
in search engine database is called indexing.
Crawling means to visit the link by Search engines
and indexing means to put the page contents in
Database (after analysis) and make them available in
search results when a request is made.

Crawling means the search engine robot crawl or

fetch the web pages while Indexing means search
engine robot crawl the web pages, saved the
information and it appear in the search engine.
THANK
YOU