problem with robot.txt file !

[shufol]

my site's robots.txt.
is that good for google search. posts are not indexing by google properly ..

what to edit on robots.txt ? pls suggest me ..

shufol Reviewed by shufol on 18th Jun 2011. problem with robot.txt file ! http://lulzimg.com/i23/f3dd51.png my site's robots.txt. is that good for google search. posts are not indexing by google properly .. :facepalm: what to edit on robots.txt ? pls suggest me .. Rating: 5

[Rox]

mate you need to add you sitemap link in you robots.txt file

add this -
Sitemap: http://www.wrz4all.com/sitemap.xml

[shufol]

User-agent: *
Disallow: /engine/go.php
Disallow: /user/
Disallow: /newposts/
Disallow: /statistics.html
Disallow: /*subaction=userinfo
Disallow: /*subaction=newposts
Disallow: /*do=lastcomments
Disallow: /*do=feedback
Disallow: /*do=register
Disallow: /*do=lostpassword
Disallow: /*do=addnews
Disallow: /*do=stats
Disallow: /*do=pm

pls edit this and tell me where to write it ...

[Rox]

User-agent: *
Sitemap: http://www.wrz4all.com/sitemap.xml
Disallow: /engine/go.php
Disallow: /user/
Disallow: /newposts/
Disallow: /statistics.html
Disallow: /*subaction=userinfo
Disallow: /*subaction=newposts
Disallow: /*do=lastcomments
Disallow: /*do=feedback
Disallow: /*do=register
Disallow: /*do=lostpassword
Disallow: /*do=addnews
Disallow: /*do=stats
Disallow: /*do=pm

There you go!

[shufol]

disallow all those are showing or allowing some?

[lukip006]

Your robots seems fine to me as the disallow lines are only preventing bot access to pages which you dont need to index such as login,register etc. You should be fine.

[shufol]

thanks lukip006 and SagarRox for helping..

[lukip006]

Welcome bro