Search engines use automated programs called crawlers (also known as spiders or bots) to discover and index web pages. These crawlers follow links from page to page, collecting information about each page's content. Affiliate marketing, cost per impression, and cost per action are advertising models, not indexing mechanisms.