Archive: 2003-05-29

Um. Someone has proposed a Perl Module for ESF. Golly

robots.txt is a file that ninty-nine percent of all search engines download from the root domain of a webserver and use it as instructions for what – and what not – to index. This is my robots.txt file:

See

Now Read On…