I don't see the file sitemap.axd anyplace but it's referenced in robots.txt

[Cal Who]

I'm looking at someone elses code and they have the following in robots.txt.

But I don't see the file sitemap.axd anyplace.

What is going on here?


User-agent: *
Disallow: /login.aspx
Disallow: /search.aspx
Disallow: /error404.aspx
Disallow: /archive.aspx

#Remove the '#' character below and replace example.com with your own
website address.
#sitemap: http://example.com/sitemap.axd


Thanks

 

[Andrew Morton]

I'm looking at someone elses code and they have the following in
robots.txt.
But I don't see the file sitemap.axd anyplace.

What is going on here?

User-agent: *
Disallow: /login.aspx
Disallow: /search.aspx
Disallow: /error404.aspx
Disallow: /archive.aspx

#Remove the '#' character below and replace example.com with your own
website address.
#sitemap: http://example.com/sitemap.axd

The # character indicates that that line is only a comment. Everything after
it is ignored. I bet that the web site isn't at example.com, too ;-)

 

[Cal Who]

The # character indicates that that line is only a comment. Everything
after it is ignored. I bet that the web site isn't at example.com, too ;-)

I'm sorry, I should have said that I'm suppose to remove the # and insert my
address.
But what good will it do if the file is not present.

Thanks

 

[Andrew Morton]

I'm sorry, I should have said that I'm suppose to remove the # and
insert my address.
But what good will it do if the file is not present.

It will do no good. That line is entirely optional. It is only an example;
probably the someone else grabbed an example robots.txt and left those lines
in.

Google's info on sitemaps is at
http://www.google.com/support/webmasters/bin/topic.py?topic=8476

and Yahoo!'s is out there somewhere too.

 

[Cal Who]

It will do no good. That line is entirely optional. It is only an example;
probably the someone else grabbed an example robots.txt and left those
lines in.

Google's info on sitemaps is at
http://www.google.com/support/webmasters/bin/topic.py?topic=8476

and Yahoo!'s is out there somewhere too.

I believe that it will do no good with out the file, but it is not that
simple. There was a video that showed how to install the software and he
made a point of changing that line to insert the correct domain and remove
the #.

Is an .axd file something I could generate or better, have vs generate?


Thanks

 

[Andrew Morton]

I believe that it will do no good with out the file, but it is not
that simple. There was a video that showed how to install the
software and he made a point of changing that line to insert the
correct domain and remove the #.

Is an .axd file something I could generate or better, have vs
generate?

There is no need for it to be a file ending in .axd; there are many examples
of generating sitemaps at
http://www.google.com/#hl=en&q=asp.net+generate+sitemap

 

[Harlan Messinger]

I believe that it will do no good with out the file, but it is not that
simple. There was a video that showed how to install the software and he
made a point of changing that line to insert the correct domain and remove
the #.

"There" where? Whose video? Made for what audience? The video was not a
commandment from The Lord Himself to every creature that creepeth and
maketh a robots.txt. The line with a file of that name only serves a
purpose if you have a file by that name. Since sitemap.axd pertains to
Google Sitemaps, it stands to reason that if you aren't using Google
Sitemaps, *you won't have one* and you don't need to follow Google's
instructions for implementing Google Sitemaps.

 

[Cal Who]

There is no need for it to be a file ending in .axd; there are many
examples of generating sitemaps at
http://www.google.com/#hl=en&q=asp.net+generate+sitemap

Thanks for the links. I think I understand now. The author expect that the
user (me) would understand about generating a site map and simply made a
point of showing that the robots file needed to be updated.

Thanks

 

[Cal Who]

"There" where? Whose video? Made for what audience? The video was not a
commandment from The Lord Himself to every creature that creepeth and
maketh a robots.txt. The line with a file of that name only serves a
purpose if you have a file by that name. Since sitemap.axd pertains to
Google Sitemaps, it stands to reason that if you aren't using Google
Sitemaps, *you won't have one* and you don't need to follow Google's
instructions for implementing Google Sitemaps.

I think I understand now. The author expect that the user (me) would
understand about generating a site map and simply made a point of showing
that the robots file needed to be updated.

Thanks