Halloween - uhhhhh - do not forget to customize the robots.txt!

Dear admins, it's that time again - thrilled this evening / night there - walking zombies. So let it be said: tektiert still fast your robots.txt server, so nothing can happen, yes.

The correct entry is:

  User-agent: zombies
 Disallow: / directory 

Also, the admin of G aunt . has responded appropriately and quickly changed his transfer robots to draw so that the evil, naughty zombies, not too much mind can:

  User-agent: zombies
 Disallow: / brains

 User-agent: *
 Allow: / search history /
 Disallow: / news & output = xhtml?
 Allow: / news output = xhtml? 

I call that just PERFECT! And who know a little more to robots.txt needed, I refer to the SELFHTML construct - Let'z halloweeeeeennnn ;-)

Leave a Reply