My Meta tags and Robots

[David Baxter]

You're already listed in Google, although it looks like a new site which
hasn't yet been fully spidered:
http://www.google.com/search?sourceid=navclient&ie=UTF-8&q=http://streetwhispers.com


Web Showing web page information for http://streetwhispers.com

www.streetwhispers.com/


Google can show you the following information for this URL:

a.. Find web pages that are similar to streetwhispers.com
b.. Find web pages that link to streetwhispers.com
c.. Find web pages that contain the term "streetwhispers.com"
d..

 

[David Baxter]

Have you submitted the site to the search engines?

BTW, it can take weeks or months to get listed.

Not usually -- but it may well take months to get into the top 20-30
listings. Unless you're talking about the DMOZ/ODP directory: that can
and often does take more than a lifetime...

 

[David Baxter]

Is it a good idea to submit a website to more then one

search engine.

Sure - most search engines these days are net crawlers and they'll find
you without manually submitting the site, as long as you have one link
to the site from somewhere.

It's not a bad idea to submit the site to appropriate directories --
gives you additional backlinks and ensures you'll get picked up bu the
spiders.

 

[David Baxter]

Better yet -- see http://www.bandofgonzos.com

 

[David Baxter]

Inline...

Add a robots meta tag to the head section of every page you want indexed:
<meta NAME="ROBOTS" CONTENT="index,follow">

This tag is not necessary. In the form above, it tells spiders to do
what they do by default. The tag is only necessary if you do NOT want
the default behavior, as in "noindex, nofollow" or "noindex,follow" or
"index,nofollow".

Then using notepad create a file named robots.txt that contains this:

User-agent: *

Place the robots.txt file in the root of your web ( where your home

page lives ) and then "Publish"

Actually, you need one more line there:

User-agent: *
Disallow:

(i.e., nothing after "Disallow", which means "index everything"...)

 

[David Baxter]

index the page and follow the links.
<meta NAME="ROBOTS" CONTENT="index,follow">

The robots.txt file gives the robots permission to index your web

site.

No... it tells the spider to do what it was going to do anyway.

Open notepad, paste this: User-agent: * into the new notepad file.

save it with the name robots.txt

 

[David Baxter]

I think you mean "link farms" but generally speaking links TO your site
can help, even low ranking sites, but cannot harm you. If you think
about it, if it were otherwise, it would be a simple way to penalize
competitor's sites...