Spiders, Robots and Crawlers are primarily associated with:
Authentication testing
Session Management
Information Gathering
Authorization Testing