Spiders in SEO

The first part of what Google does is crawl the web.A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. Google’s spider can only crawl linked pages by the way - it can only access pages that you could access with a mouse.