Robots.txt file question

S

Steve G

I'm curious if there is a way to have the robots.txt file
include info for the search engines not to archive any
old data, just get the new stuff each time they search.

Does anyone have any experience with adding this into the
robots.txt file?

Thanks,
Steve
 
T

Tom Pepper Willett

No, not using the robots.txt file.

You might try googling for information.
--
=====================================================
Tom Pepper Willett [Microsoft MVP - FrontPage]
----------------------------------------------------------------------------
-------------------
Microsoft FrontPage:
http://www.microsoft.com/office/frontpage/prodinfo/default.mspx
http://msdn.microsoft.com/office/understanding/frontpage/

=====================================================


| I'm curious if there is a way to have the robots.txt file
| include info for the search engines not to archive any
| old data, just get the new stuff each time they search.
|
| Does anyone have any experience with adding this into the
| robots.txt file?
|
| Thanks,
| Steve
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top