site now staticly indexable by search engines

[sothis]

(i need to add this to the front pages as well as an update, ill do that later)

as some of you may or may not know, most search engine robots ignore and don't index anything with ? in the title. this means that basically any dynamic page (php, asp, jsp) can't be indexed, because the format is index.php?var1=this&var2=this.

but notice that with sites like animenfo, the urls are a bit strange:

http://www.animenfo.com/animetitle,1...px,naruto.html

with the huge help from devilbunny, i have alleviated this situation. what animenfo and other sites do is using the mod_rewrite function in apache to trick search engines into indexing the pages. notice animenfo has a bunch of variables, seperated by commas? this is the work of mod_rewrite. how it works is you type in a "fake" url, the server sees it, says "oh, i recognize that format", then gets you the page that you tell it it SHOULD get. so in the anime recommendation database now (and soon to be rest of the site, but its a lower priority), you'll see links like this:

http://www.anime-planet.com/animerec/100_ken.html

instead of:

http://www.anime-planet.com/animerec...&theme=KEN

the old links will still work, so don't worry about that. remember that what i "installed" is the ABILITY to type in the fake links, it doesn't actually replace them.

what does this mean? that now, google will be able to index every single series page in the database. not only does this mean that anime planet will move higher up in the ranks because the site will appear to have more pages (one of the factors in list placement), but now, when people search for a regular series, the anime planet page will show up high in the list, kind of like how animenfo is almost always #1 now. this will bring a huge amount more attention to the site from google searchers, so i am happy ^_^.

anyways, just thought i'd let you guys know. all the links on the site have been updated to show these new urls, so please start pasting those instead of the old style so people get used to them. notice that i am trying to move away from capitolized themes, etc.

post here with any questions or comments!

[Incantrix]

Hey Soth--

I see you're getting every page indexed. Wow...

You'll need a sitemap html file on one of the pages, that will help...
And if you take the summaries and dupe it out into the description META tag, that will do wonders!

[DS AP]

how bout you tel us how to google bomb so we can get the anirecdatabase up on the list

[Rar]

Originally Posted by sothis

so in the anime recommendation database now (and soon to be rest of the site, but its a lower priority), you'll see links like this:

http://www.anime-planet.com/animerec/100_ken.html

instead of:

http://www.anime-planet.com/animerec...&theme=KEN

So the current theme is given to the page as a variable? This means you have 6 or seven versions of the 100_***.html page for google to look at? Surely that's a bad thing. Also, wouldn't it be better to store current theme data in a user's session, and just default to one for guests. Extra themes would be more incentive to sign up. :D

By the way, searching for 'anime recommendations' on Google at the moment gives http://www.anime-planet.com/animerec/hel.html at number six. Not bad. :)

Rar

[sothis]

i'd prefer to have random themes for guests so they still enjoy them and know they exist.. besides, i'd never be able to choose a favorite thing for my own ;)

#6 isn't good enough! it's been there for too long :/ ... i still need to add the meta tags so hopefully then teh series start showing up high on the list as well ^_^

google indexes pages with querystring vars just fine. Who cares about all the other search engines, most of them use google now anyway :-)

Although it appears that google stops after 1,000 pages with the same filename, different querystrings.

[Jederek]

just to add that a lot of link dosnt work anymore in the Alphabetical List of Series/fansubs discussed in Fansub Quality Comparison .
maybere there more link that dont work but i found only those so far

[sothis]

hm, yeah i thought lucky or masakari had taken care of it. ill remind them