FP Search Bot Index (including and excluding directories)

[PhilP]

I am using FP 2000 targeting to an Apache Server (with FP
2000 ext.) in combination with catalog pages generated by
the bCommerce / Commerce Manager. The bCommerce wizard
generates a set of .htm files under
both "/catalog_templates" and "/catalog" directories. How
can I exclude pages under "/catalog_templates" and include
pages under "/catalog" as well as other selections on a
directory-by-directory basis? I don't believe that the
wizard will allow me to include a "_" on the front of
these directories or to change file permissions. So what
is the recommended way to include or exclude these
directories?

 

[Thomas A. Rowe]

Convert the folders to subwebs, if your host allows is the only other option
to exclude them from the Search bot.

--

==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
WEBMASTER Resources(tm)

FrontPage Resources, Forums, WebCircle,
MS KB Quick Links, etc.
==============================================

 

[PhilP]

When folders such as 'catalog_templates' are converted to
subwebs then the eCommerce Wizard that generates them
fails. Fortunately, the subweb can be converted back to
a normal directory to perform updates. Apparently, I
will be forced to change the directory name to include a
leading "_" doing a recalc hyperlinks (or convert to
subwebs and back and forth) every time I make a change.
This is extremely error prone and time consuming. Do you
have information that would allow me to write a program to
generate my own _vti_txt/.../All.* index files? I don't
want to use 3rd party tools that pull in advertising, use
external web sites, or that add expense.

 

[Thomas A. Rowe]

1. The _vti folders are a function of FrontPage and the FP extensions, there
are not other application that would create or maintain them.

2. What is the reason that you want to exclude the catalog_templates folder?

--

==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
WEBMASTER Resources(tm)

FrontPage Resources, Forums, WebCircle,
MS KB Quick Links, etc.
==============================================

 

[Thomas A. Rowe]

Disregard my question (#2). Unless the eCommerce Wizard can be set to use
specific folders, you are limited to what you are currently doing as a
workaround.

--

==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
WEBMASTER Resources(tm)

FrontPage Resources, Forums, WebCircle,
MS KB Quick Links, etc.
==============================================

 

[PhilP]

I have already invested a lot of time into various search
component work arounds - for example, using the search
component in the shared border area then redirecting
search results to a common results page via modifications
to the 'shmtl.exe' path. Since I have used my quota of
database connections for my own DB search, I thought that
I would use the intrinsic features of search feature as
much as possible. Apparently, the search feature is a
WAIS implementation when targeted to an Apache server.
Unfortunately I have little information on the specific
details of it's design and implementation (file format
specs, overall design specs) so that I might construct my
own indexing functions - thus bypassing the idiosyncracies
of the Microsoft/VTI toolset. Any ideas where to find the
information that I need?