# Asks bots to index the site less frequently, preventing # accidental bot based DDoS. # KB Article - https://kb.wisc.edu/webhosting/page.php?id=62214 User-agent: * Crawl-delay: 10