WEB Crawling

[Steve Drake]

Hello,

I have a HUGE website that is generated from a database.

It could be millions of pages and has an hierarchical structure.

How does incremental search make it easy for me to tell MOSS what changed?

Does the crawler do a full craw but use HTTP HEAD and look at the header
that says when the webpage was changed?

So... If I have the following

Top Folder - Sub Folder - Doc , If a user changes a DOC then I need to mark
each page that is used to to get to the document as changed so the links
down to the doc will be followed.

Also... how does metadata map? should I was HTML META TAGS to MAP to MOSS
metadata.

Thanks

Steve

 

[Steve Drake]

Sorry, wrong group

I was sure I was on the MOSS group.

sorry....