uggabugga





Monday, November 09, 2009

Hey Rupert Murdoch!

Put this little file (robots.txt) on all your websites:
User-agent: *
Disallow: /
The world will be a much better place.



2 comments

Here's the current one from Faux:

User-agent: *
Disallow: /printer_friendly_story
Disallow: /projects/livestream
#
User-agent: gsa-crawler
Allow: /printer_friendly_story
Allow: /google_search_index.xml
Allow: /google_news_index.xml
Allow: /*.xml.gz
#
Sitemap: http://www.foxnews.com/google_search_index.xml
Sitemap: http://www.foxnews.com/google_news_index.xml

By Anonymous Anonymous, at 11/10/2009 4:27 AM  

Hey, thanks for that!

By Blogger Quiddity, at 11/10/2009 11:16 AM  

Post a Comment