Robots question

[paul]

If I use eg Disallow: /Potatoes/Chips/

Will this Disallow access to just the Chips directory.

I would want the Potatoes directory to be spidered but not the Chips
directory.

 

[Steve Easton]

To just disallow Chips

User-agent: *
Disallow: /Chips/

Make sure the CaSe is exactly like the folder name.

The only drawback to this is, if you're trying to hide Chips from surfers,
your robots text file shows them that the folder exists.

--

Steve Easton
Microsoft MVP FrontPage
FP Cleaner
http://www.95isalive.com/fixes/fpclean.htm
Hit Me FP
http://www.95isalive.com/fixes/HitMeFP.htm

 

[SingaporeWebDesign]

Hello,

Yes, it will disallow access to just the Chips directory and allow Potatoes
to be spidered.

More info
http://www.robotstxt.org/wc/norobots.html

--
Singapore Website Design
http://www.bootstrike.com/Webdesign/
Singapore Web Hosting
http://www.bootstrike.com/WinXP/faq.html
Windows XP FAQ