Hiding pages from Google

G

Gene

How do you hide pages from Google?

When I search our site using Google (site: www.mydomain.com) Google lists
pages in our site that are inside folders that start with an underscore
(like _private). Pages in those folders are hidden from the FP Search
component, but Google sees them.

I have a robots.txt file at the root level of my site. I just added all the
folders that start with _underscore to the list of folders that robots are
not to index. Google still searches inside them.

Any ideas? I could not find any help on the Google web site.

Thanks,
Gene
 
S

Steve Easton

Add the following meta tag between the head tags in the pages you don't want
spidered:
<meta name="ROBOTS" content="NOINDEX, NOFOLLOW">

Also, have your host check the permissions for the _private folder.

--
Steve Easton
Microsoft MVP FrontPage
95isalive
This site is best viewed............
........................with a computer
 
T

Thomas A. Rowe

The _folder name is only protected by the FP search.

Make sure you do not have link to any file within the _private folder.

Add the following to the head section of all page you do not want indexed by good robots:

<meta name="robots" content="NOINDEX,NOFOLLOW">

Bad robots don't honor robots.txt or the above line.

--
==============================================
Thomas A. Rowe (Microsoft MVP - FrontPage)
==============================================
If you feel your current issue is a results of installing
a Service Pack or security update, please contact
Microsoft Product Support Services:
http://support.microsoft.com
If the problem can be shown to have been caused by a
security update, then there is usually no charge for the call.
==============================================
 
P

p c

The reason that google has indexed those pages it's because you have
"public" (visible) pages piting to pages or docuements to that folder.
Once searhe engines have you indexted the pages our ther for evevrpoen
to find out. If they are not password protectd, they can see them and
ther contents. Even after you rmove HTML pages form your site, these
pages may remained cached at searche engines.

Do not delete _folders. They are used by FP. You may want to rename
sensitive files in the _private folder to different name to prevent
acces through inrent search (before you delete, you may want to evaluate
if it will affect results pages placed there by FPSE enabled gadgets or
forms). If you want cached of pages stored by search engines, you would
need to contact them

Another point to note: hackers are aware of standardzed private folders.
They often try to access files in these folders by gueesing filenames.
If these pages are not secured, do not sore any sensitive infrmation there.
...PC
 
S

Steve Easton

Huh??

--
Steve Easton
Microsoft MVP FrontPage
95isalive
This site is best viewed............
........................with a computer
 
G

Gene

Thank you all for your quick answers. I posted my question before leaving
work last night, and when I came in this morning the answers were waiting
for me. These newsgroups, and the people who inhabit them, are great.

Kind regards to you all,
Gene
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top