Last.fm Has the Best robots.txt Ever

User-Agent: *
Disallow: /music?
Disallow: /widgets/radio?
Disallow: /show_ads.php
Disallow: /affiliate/
Disallow: /affiliate_redirect.php
Disallow: /affiliate_sendto.php
Disallow: /affiliatelink.php
Disallow: /campaignlink.php
Disallow: /delivery.php
Disallow: /music/+noredirect/
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self
Allow: /

Yup, that’s the content of Last.fm robots.txt file from July 28, 2010, 3:21am EST. Nice.

Comments
One Response to “Last.fm Has the Best robots.txt Ever”
  1. fineartrec fineartrec says:

    RT @sotek: Blog: Last.fm Has the Best robots.txt Ever http://www.vault45.com/267
    via Twitoaster

Leave A Comment