Crawl

This is the process of visiting all site of the world wide web and is performed by crawlers or robots used by search engine specifically for gathering information from sites located on the internet. As a crawler crawls through sites, it indexes it and this indexed information is used in displaying results to searcher queries in search listings.

Related posts:

1. AllTheWeb
2. Agent Name
3. Cross Linking
4. Findability
5. Crawler
6. FFA
7. Bait and Switch
8. Directory
9. Banned
10. Algorithm