User-agent: * Disallow: /whois/ Disallow: /ping/ Disallow: /tracert/ Disallow: /traceroute/ Disallow: /dnstraversal/ Disallow: /spamcheck/ Disallow: /mtr/ Disallow: /dns/