Robots.txt

F

Fred

I've actually got a website that I don't want Mr. Google or his mates to
crawl. Can anyone point me to the correct text I type to block all. I know I
can add <meta name="robots" content="noindex,nofollow"> to every page but
I'm not sure of the wording for the actual robots text. Fred
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Similar Threads

How to keep Google from listing site 3
FP and preventing robots 3
Create a folder with "noindex, no follow?" 9
Robots 2
can username and password prevent search engines to index and cache my page? 1
Problem with empty page 3
Robots.txt 2
Robots.txt file. 2

Top