User-agent: *Disallow: /
Here's the current one from Faux:User-agent: *Disallow: /printer_friendly_storyDisallow: /projects/livestream#User-agent: gsa-crawlerAllow: /printer_friendly_storyAllow: /google_search_index.xmlAllow: /google_news_index.xmlAllow: /*.xml.gz#Sitemap: http://www.foxnews.com/google_search_index.xmlSitemap: http://www.foxnews.com/google_news_index.xml
By Anonymous, at 11/10/2009 4:27 AM
Hey, thanks for that!
By Quiddity, at 11/10/2009 11:16 AM
Post a Comment