Robots.txt file question

  • Thread starter Thread starter Steve G
  • Start date Start date
S

Steve G

I'm curious if there is a way to have the robots.txt file
include info for the search engines not to archive any
old data, just get the new stuff each time they search.

Does anyone have any experience with adding this into the
robots.txt file?

Thanks,
Steve
 
No, not using the robots.txt file.

You might try googling for information.
--
=====================================================
Tom Pepper Willett [Microsoft MVP - FrontPage]
----------------------------------------------------------------------------
-------------------
Microsoft FrontPage:
http://www.microsoft.com/office/frontpage/prodinfo/default.mspx
http://msdn.microsoft.com/office/understanding/frontpage/

=====================================================


| I'm curious if there is a way to have the robots.txt file
| include info for the search engines not to archive any
| old data, just get the new stuff each time they search.
|
| Does anyone have any experience with adding this into the
| robots.txt file?
|
| Thanks,
| Steve
 
Back
Top