Please enable JavaScript to use CodeHS

CodeHS Glossary


Web crawler General

A program, also called a crawler or spider, that visits web pages, reads them and follows their links to find more pages. A search engine uses crawlers to collect pages for its index.