Difference between Indexing and Crawling

Started by krishnanayak, 12-21-2015, 23:47:32

Previous topic - Next topic

kumar29

Web crawling is at the core of many web businesses. Whether you call it web crawling, web or screen scraping, or mining the web, it involves going to sites on the web, grabbing pages, and parsing them to pull out links, images, text, prices, titles, email addresses, and numerous other page attributes.


Sallynguyen

Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages. Crawls show all the errors that need fixing in a website. It is like the search engine robots that follow the links.

Indexing takes place right after a crawled URIs are processed.  The Google index is similar to an index in a library, which lists information about all the books the library has available. However, instead of books, the Google index lists all of the webpages that Google knows about. When Google visits your site, it detects new and updated pages and updates the Google index.
Simicart - Best mobile app builder for Magento Android App. Try it for free now to bloom your business
  •  


Ghazala

Hello Friends,

Crawling is the process of an engine requesting — and successfully downloading — a unique URL.

Indexing is the result of successful crawling. I consider a URL to be indexed (by Google) when an info: or cache: query produces a result, signifying the URL's presence in the Google index.

qx_1789

Crawling is the process of an engine requesting — and successfully downloading — a unique URL. Obstacles to crawling include no links to a URL, server downtime, robots exclusion, or using links (such as some JavaScript links) from which bots cannot find a valid URL.Google crawlers crawls through the webpages and index the pages.

Indexing is the result of successful crawling. I consider a URL to be indexed (by Google) when an info: or cache: query produces a result, signifying the URL's presence in the Google index.  indexing refers to various methods for indexing the contents of a website or of the Internet as a whole.

brknny

Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.Indexing takes place after a crawled URIs are processed. Note that there may be several URIs that are crawled but there could be fewer of them whose content will be processed through indexing


Shikha Singh

Crawling is the process of an engine requesting — and successfully downloading — a unique URL. Obstacles to crawling include no links to a URL, server downtime, robots exclusion, or using links (such as some JavaScript links) from which bots cannot find a valid URL.
Indexing is the result of successful crawling.

hoamai

Quote from: krishnanayak on 12-21-2015, 23:47:32
Crawling is the procedure of a motor asking for — and effectively downloading — an extraordinary URL. Obstructions to creeping incorporate no connections to a URL, server downtime, robots prohibition, or utilizing connections, (for example, some JavaScript joins) from which bots can't locate a substantial URL.

Indexing is the consequence of effective slithering. I consider a URL to be listed (by Google) when an information: or reserve: question creates an outcome, meaning the URL's vicinity in the Google record. Deterrents to indexing can incorporate duplication (the motor may choose to list stand out rendition of substance for which it finds numerous almost indistinguishable URLs), sensitive server conveyance (the motor may choose to not record a page that it can access amid one and only third of its endeavors),
thank you for your share

96Livepro

Difference between Indexing and Crawling are

Crawling: Crawling is the process by which search engines discover updated content on the web,such as new sites or pages, changes to existing sites, and Dead Links.

Indexing: Indexing is a search engine processes each of the pages it crawls, it Compiles a massive index of all the words it sees and their location on each page. It is essentially a database of billions of web pages.