uggabugga

HOME RSS | .

Monday, November 09, 2009

Hey Rupert Murdoch!

Put this little file (robots.txt) on all your websites:

User-agent: *
Disallow: /

The world will be a much better place.

posted by Quiddity at 11/09/2009 09:47:00 PM

2 comments

Here's the current one from Faux:

User-agent: *
Disallow: /printer_friendly_story
Disallow: /projects/livestream
#
User-agent: gsa-crawler
Allow: /printer_friendly_story
Allow: /google_search_index.xml
Allow: /google_news_index.xml
Allow: /*.xml.gz
#
Sitemap: http://www.foxnews.com/google_search_index.xml
Sitemap: http://www.foxnews.com/google_news_index.xml

By Anonymous, at 11/10/2009 4:27 AM

Hey, thanks for that!

By Quiddity, at 11/10/2009 11:16 AM