I have read more posts than I can count and figure I just have to ask for some help here!
I have applied the mod and the static url mod to my site. My robots.txt looks like this:
Code:User-agent: *
Disallow: /forum/index.php?
Disallow: /forum/posting.php
Disallow: /forum/groupcp.php
Disallow: /forum/search.php
Disallow: /forum/login.php
Disallow: /forum/privmsg.php
Disallow: /forum/post
Disallow: /forum/member
Disallow: /forum/profile.php
Disallow: /forum/memberlist.php
Disallow: /forum/faq.php
Disallow: /forums/post-*.html$
Disallow: /forums/updates-topic.html*$
Disallow: /forums/stop-updates-topic.html*$
Disallow: /forums/ptopic*.html$
Disallow: /forums/ntopic*.html$
and my .htacces looks like this
Code:RewriteEngine on
RewriteBase /
RewriteRule ^forum/forums.* /forum/index.php [L,NC]
RewriteRule ^forum/post-([0-9]*).html&highlight=([a-zA-Z0-9]*) /forum/viewtopic.php?p=$1&highlight=$2 [L,NC]
RewriteRule ^forum/post-([0-9]*).* /forum/viewtopic.php?p=$1 [L,NC]
RewriteRule ^forum/view-poll([0-9]*)-([0-9]*)-([a-zA-Z]*).* /forum/viewtopic.php?t=$1&postdays=$2&postorder=$3&vote=viewresult [L,NC]
RewriteRule ^forum/about([0-9]*).html&highlight=([a-zA-Z0-9]*) /forum/viewtopic.php?t=$1&highlight=$2 [L,NC]
RewriteRule ^forum/about([0-9]*).html&view=newest /forum/viewtopic.php?t=$1&view=newest [L,NC]
RewriteRule ^forum/about([0-9]*)-([0-9]*)-([a-zA-Z]*)-([0-9]*).* /forum/viewtopic.php?t=$1&postdays=$2&postorder=$3&start=$4 [L,NC]
RewriteRule ^forum/about([0-9]*)-([0-9]*).* /forum/viewtopic.php?t=$1&start=$2 [L,NC]
RewriteRule ^forum/about([0-9]*).* /forum/viewtopic.php?t=$1 [L,NC]
RewriteRule ^forum/about([0-9]*).html /forum/viewtopic.php?t=$1&start=$2&postdays=$3&postorder=$4&highlight=$5 [L,NC]
RewriteRule ^forum/mark-forum([0-9]*).html* /forum/viewforum.php?f=$1&mark=topics [L,NC]
RewriteRule ^forum/updates-topic([0-9]*).html* /forum/viewtopic.php?t=$1&watch=topic [L,NC]
RewriteRule ^forum/stop-updates-topic([0-9]*).html* /forum/viewtopic.php?t=$1&unwatch=topic [L,NC]
RewriteRule ^forum/forum-([0-9]*).html /forum/viewforum.php?f=$1 [L,NC]
RewriteRule ^forum/forum-([0-9]*).* /forum/viewforum.php?f=$1 [L,NC]
RewriteRule ^forum/topic-([0-9]*)-([0-9]*)-([0-9]*).* /forum/viewforum.php?f=$1&topicdays=$2&start=$3 [L,NC]
RewriteRule ^forum/ptopic([0-9]*).* /forum/viewtopic.php?t=$1&view=previous [L,NC]
RewriteRule ^forum/ntopic([0-9]*).* /forum/viewtopic.php?t=$1&view=next [L,NC]
the .htaccess and robots.txt sit in my root directory and my forum is in a sub directory (root/forum) which is why I added to the code above.
So: Everything works fine when browsing the forums as a guest and as a registered user. My sitemap files even output the static links for the forum.
My issue is that when google crawls my site, it gives me 100's of web crawl errors. Looking at the log, it is trying to crawl the correct static links for my forums (as it should) but it gives the "file not found 404 error"
If I enter the links, I get the site to pull up just fine. I assume I have something wrong with my robots.txt or my .htacces file.
Can someone point me in teh right direction here?
