Skip to main content ↑ ↓
Topic: Whats a yahoo slurp spider? (Read 1095 times) previous topic - next topic

Whats a yahoo slurp spider?

Whats a yahoo slurp spider?
And how do you stop them?
[SIGPIC][/SIGPIC]
***** Project "EVOLUTION" 1987 Cougar LS  & 1985 Cougar Convertible *****
[/COLOR]
5.0 HO 306 roller block, machined GT-40P heads, Wiseco dished forged pistons, Eagle forged floating I-beam connecting rods, Lunati pushrods, ARP bolts, Scorpion aluminum 1.6 rockers, Comp Cams Magnum 266HR, Explorer intake, 65mm TB, MAF Conversion, 19# injectors, Ford Racing stainless P-headers, 2-1/2" cat-less exhaust w/ Flowtech Afterburner lers , SC AOD with 2800 BDR torque converter, 3.73 T-Lok rear, CHE rear control arms, full 2-1/2" frame w/1" jacking rails & seat supports, Rear disk brakes, Turbine wheels, All original interior w/ floor shift upgrade .......
Pretty much every panel on my 87 is new, rebuilt, or re constructed. :D
Join us on Facebook
http://www.facebook.com/home.php?sk=group_137541156293768&ap=1

Whats a yahoo slurp spider?

Reply #1 –
check for yahoo.com's webmaster related info on robots.txt file to tell spiders to go away
[SIGPIC][/SIGPIC]
1974 maverick lsx powered turbo car SOLD
1973 maverick Tijuana Taxi Tribute
1957 chevy LSX Turbo project (race car)
Owner of Joe Dirt Fabrication

Whats a yahoo slurp spider?

Reply #2 –
while checkin board activities, i noticed this spider is on the board.

what does it do?


*edit, google is my friend.
slurp spider indexes pages to be used in searches.
gumby - beauty may fade, but stupid is forever!

Whats a yahoo slurp spider?

Reply #3 –
so, does it send out a spider when someone does a search.
or, does it search gathering info, to speed up a future search from someone?
[SIGPIC][/SIGPIC]
***** Project "EVOLUTION" 1987 Cougar LS  & 1985 Cougar Convertible *****
[/COLOR]
5.0 HO 306 roller block, machined GT-40P heads, Wiseco dished forged pistons, Eagle forged floating I-beam connecting rods, Lunati pushrods, ARP bolts, Scorpion aluminum 1.6 rockers, Comp Cams Magnum 266HR, Explorer intake, 65mm TB, MAF Conversion, 19# injectors, Ford Racing stainless P-headers, 2-1/2" cat-less exhaust w/ Flowtech Afterburner lers , SC AOD with 2800 BDR torque converter, 3.73 T-Lok rear, CHE rear control arms, full 2-1/2" frame w/1" jacking rails & seat supports, Rear disk brakes, Turbine wheels, All original interior w/ floor shift upgrade .......
Pretty much every panel on my 87 is new, rebuilt, or re constructed. :D
Join us on Facebook
http://www.facebook.com/home.php?sk=group_137541156293768&ap=1

Whats a yahoo slurp spider?

Reply #4 –
Quote from: daminc;221527
so, does it send out a spider when someone does a search.
or, does it search gathering info, to speed up a future search from someone?

from what i read last night it is the latter.

i also read about some boards that were having issues with too much access allowed for the spiders actually slowin the board down.
gumby - beauty may fade, but stupid is forever!
 

Whats a yahoo slurp spider?

Reply #5 –
Quote from: daminc;220308
Whats a yahoo slurp spider?


It's what happens when you hook up a 7-11 Slurpee machine to the internet.
-John Fordham
 
1993 Cougar XR7 302 HO AOD
245,000 miles and still running strong

2005 F-150 FX4 SuperCab 5.4L