Re: [squid-users] Reverse Proxy and Googlebot

Simon Waters wrote:
> Seeing issues with Googlebots retrying on large PDF files.
>
> Apache logs a 200 for the HTTP 1.0 requests.
>
> Squid logs an HTTP 1.1 request that looks to have stopped early (3MB out of
> 13MB).
>
> This pattern is repeated with slight variation in the amount of data served to
> the Googlebots, and after about 14 attempts it gives up and goes away.
>
> Anyone else seeing same?
>

Not seeing this, but.... do you have correct Expires: and Cache-Control
headers on those .pdf? and is GoogleBot not obeying them?

Amos

-- 
Please use Squid 2.7.STABLE4 or 3.0.STABLE9