[squid-users] Reverse Proxy and Googlebot

Seeing issues with Googlebots retrying on large PDF files.

Apache logs a 200 for the HTTP 1.0 requests.

Squid logs an HTTP 1.1 request that looks to have stopped early (3MB out of
13MB).

This pattern is repeated with slight variation in the amount of data served to
the Googlebots, and after about 14 attempts it gives up and goes away.

Anyone else seeing same?
Received on Mon Oct 06 2008 - 10:06:42 MDT