The Interactive Glossary: Defining the Net
Spider
Besides being an insect, a spider refers to a software program that crawls the Web, indexing web pages for a search engine. The spider travels from link to link, indexing all the content on a site. Once the pages are crawled, you can then enter a keyword in the search engine to locate specific content. With billions of pages online, imagine how fast spiders have to work!