# All robots will spider the domain

User-agent: *
Disallow:/cgi-bin/
Disallow:/_clients/
Disallow:/_suppliers/
Disallow:/_private/
Disallow:/errors/
Disallow:/favicons/
Disallow:/home/
Disallow:/spoofed/
Disallow:/start/
Disallow:/temp/
Disallow:/nest/