google spider

[tripp]

Reload this Page 13 members and 2 guests
Most users ever online was 59, 02-03-2005 at 11:52 AM.
Last Activity User Name Location Instant Messaging
09:10 AM Deriffe Searching Forums
09:11 AM Ironman+ Viewing Thread
Monte#5
09:05 AM jcleer1 Searching Forums
09:11 AM john tripp Viewing Index
BOTL Community Forums
09:07 AM Jwrussell Viewing Forum
Cigars
09:02 AM MadAl Viewing Forum
Herfs
09:10 AM N2Advnture+ Viewing Index
BOTL Community Forums
09:04 AM Pulse Viewing Thread
January MoM Voting
09:05 AM RonC Viewing Thread
65% Humidification Beads
08:57 AM smokem94 Viewing Thread
Mark!
08:57 AM sunivy Viewing Thread
Monte#5
09:10 AM wasch_24+ Viewing Thread
Habanos and BOTL - PAY IT FORWARD
09:11 AM Google Spider Viewing Index <<<<<<<<<<<what the hell is this??
BOTL Community Forums
09:03 AM Guest

This is from the who's online page. What does it mean Google spider?

[1f1fan]

The search engines, in this case google, send out "spiders" to log information on sites. This is how the search engine gives back information when you performa a search....and provides the proper link to the page.

[tedski]

I don't like arachnids :smt120

[hex1848]

Google Spider = Good. It's what google uses to "index" the web. How do you think the 8 billion pages in the index get there? MSN, Yahoo, all search engines pretty much use them.

[Kingston]

Google Spider = Good.
Depends on who you ask.
Some sites don't want to be searchable.

[Poni]

I believe you can make your site or page unsearchable with a robot.txt file. Don't quote me on the name but there is some sort of file, or its a setting in the page. Something like that

[Kingston]

Close, it's robots.txt.
Here's a little tutorial:
http://www.searchengineworld.com/robots/robots_tutorial.htm

[David]

Damn tarantulas!

[Kingston]

I've always had a thing against arachnids

[Black Dog]

I don't know how true it is but I've heard that google spiders crawl the entire net something like every four days.

[David]

They're everywhere!.......RUN!!.....AHHHHHHHH!

[Kingston]

In college, my roommate once called me when I was still on campus because she wanted me to come kill a spider for her.

[David]

Oh, this is gettin good now....hehehehe.....

[Kingston]

The worst are the ones that think they are superheroes
;)

[David]

Don't bother me now...I'm watching Spiderman 2.

[tripp]

So we have Peter Parker and Tony Stark on here.....

[Poni]

I don't know how true it is but I've heard that google spiders crawl the entire net something like every four days.

it's either 4 days or a few weeks. so if you update your site it may not get searched on until google re-indexes it.

[Ironman]

John you have to much time on your hands!!!! LOL

Hehehehe

Ironman