Wed 31 May, 2006 01:55 pm - lets say the robot.txt is in forum.mysite.com/
The command inside robots.txt should look like this?:
Disallow: forum.mysite.com/admin/
Disallow: forum.mysite.com/images/
Disallow:... (view)
Thu 25 May, 2006 11:51 am - after installing able2know, my forum is crawled incorrectly?
After installing the able2know mod, google crawled by forums root url like this:
Index of /[DIR] Parent Directory 17-May-2006 20:23... (view)