robots .txt file

G

Guest

Looks so simple yet when I check to see if it validates I get some messages
wrong syntax etc.
User-Agent: *
Disallow: /cgi-bin/
What could possibly be wrong with the above? Am using Linux server and fp
2003.
Thanks
 
G

Guest

Any robots .txt syntax checker. They all seem to give me something wrong and
not a way that I can understand how to fix it.
 
G

Guest

ok will ignore it but can I use any upper case using Linux server? example
User-agent: *
Disallow: /cgi-bin/
Disallow: /maui-jap-g/
Disallow: /image_event/
I don't need to enter the full url for the disallow do I?
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top