a permalink

news and thoughts on and around the development of the iCite net
by Jay Fienberg

When White House robots.txt disallow

posted: Nov 11, 2003 1:05:27 AM

My friend Ted always sends me good stuff. Seems he was peeking at the White House robots.txt file, and noticed it filled with strange wonders like:

Disallow: /help
Disallow: /kids/pets/iraq
Disallow: /kids/games/iraq
Disallow: /president/tee-ball-01/iraq
Disallow: /firstlady/recipes/iraq

Check it out for yourself while these wonders persist.

permalink | comments {1} · trackbacks {0}

also available as: rss · rss2 · rdf · atom

Comments and Tracbacks

Comment awaiting approval
posted: Mar 19, 2006 7:54:43 PM

Note: All comments and trackbacks are moderated. Spam is deleted. Other comments are approved as promptly as possible.

Note: Older posts no longer accept new comments or trackbacks.

« prev post
Hack your worldview

» next post
Sam's semantic web hootenanny

the iCite net

     news / blog
     software
     related
     about

blog newsfeeds

brief content:

XML · RSS · RDF · Atom

full content:

XML · RSS · RDF · Atom

blog archive

2006:
jan · feb · mar · apr
may · jun · jul · aug 
sep · oct · nov · dec
		
2005:
jan · feb · mar · apr
may · jun · jul · aug
sep · oct · nov · dec

2004:
jan · feb · mar · apr
may · jun · jul · aug
sep · oct · nov · dec

2003:
may · jun · jul · aug
sep · oct · nov · dec

first post: 
April 30, 2003

highlight views:
Spammers' Choice

Jay elsewhere online
Jay Fienberg - the official home page

Wrong Notes - the music blog of the Ear Reverends

Fine & Full, aka, a fine and full burger

Sociomobilepoetextologia (moblog, currently inactive due to lack of proper mobile)

to enjoy roll
sites I like to read when I start from here

· Anastasia Fuller
· Andy Baio
· Biz Stone
· Boris Mann
· Bre Pettis
· Chris Dent
· Danny Ayers
· Dare Obasanjo
· David Czarnecki
· David Weinberger
· Don Park
· Evan Williams
· Greg Narain
· Jason Kottke
· Jim Benson
· Lucas Gonze
· Marc Canter
· Matt May
· Matt Mullenweg
· Michal Migurski
· Nancy White
· Rebecca Blood
· Reg Cheramy
· Richard MacManus
· Sam Ruby
· Shelley Powers
· Tim Bray
· danah boyd