don't want google crawl my site...

[BounceR]

H! to all of you.
i put a folder in my website and don't want google scrool it.
if i put
user-agent:*
disallow

please tell me what is the best method to solve my problem.

BounceR Reviewed by BounceR on 17th May 2010. don't want google crawl my site... H! to all of you. i put a folder in my website and don't want google scrool it. if i put user-agent:* disallow please tell me what is the best method to solve my problem. Rating: 5

[mRAza]

save as robots.txt

for all bots

User-agent: *
Disallow: /

for folder

User-Agent: Googlebot
Disallow: /folder1/

for file

User-Agent: Googlebot
Allow: /folder1/myfile.html

save file in your root folder (public_html/robots.txt)

[BounceR]

thankyou dude,

[lion_boy877]

what is rebot and what is the purpose ? can u please explain me i also want it for my site

[mRAza]

to allow or disallow robots to crawl through your site

Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site (i.e. it is not a firewall, or a kind of password protection) and the fact that you put a robots.txt file is something like putting a note “Please, do not enter” on an unlocked door – e.g. you cannot prevent thieves from coming in but the good guys will not open to door and enter. That is why we say that if you have really sen sitive data, it is too na?ve to rely on robots.txt to protect it from being indexed and displayed in search results.

read this for more info
http://www.webconfs.com/what-is-robo...article-12.php

[Whoo]

^It makes you tell google what to index and what not

[EsotorisK]

Lol lion you don't know what a robot is?
I guess it might help you in your newly added vbseo

You need to give some command line for google to not to index those pages.
Like you won't like the announcement, members id and some dead link's folder to be indexed right.

[The Coon]

Why would you not want google to index you unless you're starting a terrorist site or something

[mRAza]

no The Coon there are many usage, example like i have make many websites for clients and i dont wants bots to index them in search, understand?

[The Coon]

Ah right yeah okay I get that tired