PC Review


Reply
 
 
Senior Member
Join Date: Feb 2003
Posts: 127
 
      13th Aug 2005
I have created a robots.txt file but when I run a sitemap maker for google two files that I have listed a .jpg and .gif file continue to be listed in the sitemap maker even though they are on the disallow area of the robots.txt.

Other diallowed criteria is successfully bypassed.

Any ideas why these two are not and is there a disallow syntax that can miss all jpeg and gif files?
 
Reply With Quote
 
 
 
 
Ian Ian is offline
Rocket Scientist
Ian's Avatar
Join Date: Feb 2002
Location: Manchester, UK
Posts: 16,407
 
      13th Aug 2005
I don't think sitemap makers will take robots.txt into account, but google should set robots.txt criteria over the sitemap file (I think!).
 
Reply With Quote
 
 
 
Reply

Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



Features
 

Advertising
 

Newsgroups
 


All times are GMT +1. The time now is 08:29 AM.