Re: [squid-users] Cache problem- should i remove the cache In doingso will it be recrated once gain ?

From: Amos Jeffries <squid3_at_treenet.co.nz>
Date: Sun, 14 Sep 2008 03:57:50 +1200

jmaan_at_nits.ac.in wrote:
> *************************************************
> This message has been scanned by IMSS NIT-Silchar
>
>
>> Jyotishmaan Ray wrote:
>>> Please find your reply below embedded:
>>>
>>>
>>>
> /0K /var/nis
>>> 8.0K /var/opt
>>> 8.0K /var/preserve
>>> 8.0K /var/racoon
>>> 384K /var/run
>>> 1.8G /var/spool
>>> 2.5M /var/tmp
>>> 12M /var/www
>>> 24K /var/yp
>>> [root_at_stud-pxy ~]#
>>>
>>>
>>> Now tell me should I delete /var/cache as it occupies around 127M of the
>>> disk space. In doing so it will create a lot of free space in the /var
>>> partition, but then how good it would be for the cache ??
>>>
>>> Will it become too slow as then cache has been removed ?
>> Ah, /var/cache usually contains the combined caches of many system
>> services. You can see which ones by "ls -la /var/cache"
>
>
> The output of ls -la /var/cache is shown below as:
>
> Now tell me which directories should I look on to delete the unwanted files.
> [root_at_stud-pxy squid]# ls -la /var/cache
> total 172
> drwxr-xr-x 22 root root 4096 2007-12-27 15:39 .
> drwxr-xr-x 27 root root 4096 2007-12-27 20:43 ..
> drwxr-xr-x 3 root root 4096 2007-12-27 21:02 alchemist
> drwxrws--- 18 root ccache 4096 2008-04-10 14:15 ccache
> drwxrwxrwt 2 root root 4096 2007-12-27 15:39 coolkey
> drwxrwxr-x 2 root lp 4096 2007-12-27 15:38 cups
> drwxr-xr-x 2 apache apache 4096 2007-06-02 12:32 dap-server
> drwxr-xr-x 3 root root 4096 2007-12-27 20:33 dirmngr
> drwxr-xr-x 2 root root 4096 2008-03-31 14:56 fontconfig
> drwxr-xr-x 2 root root 4096 2008-04-01 18:56 foomatic
> drwx------ 2 haldaemon haldaemon 4096 2008-05-11 19:52 hald
> drwxr-xr-x 3 root root 4096 2007-12-27 20:48 jetty
> drwx------ 2 root root 4096 2008-05-11 19:01 ldconfig
> drwxr-xr-x 2 root root 4096 2008-09-12 04:16 logwatch
> drwxr-xr-x 14 root root 4096 2007-12-27 17:02 man
> drwxrwxr-x 2 root apache 4096 2007-09-18 04:51 mason
> drwx------ 2 apache apache 4096 2008-01-28 16:57 mod_proxy
> drwx------ 2 apache root 4096 2008-01-28 16:57 mod_ssl
> drwxr-xr-x 4 root root 4096 2008-02-13 01:29 tomcat5
> drwxr-xr-x 2 vdr root 4096 2007-10-17 12:30 vdr
> drwxr-xr-x 2 vdradmin vdradmin 4096 2007-12-20 06:30 vdradmin
> drwxr-xr-x 5 root root 4096 2008-01-23 10:55 yum
> [root_at_stud-pxy squid]#
>
>
>
>
>> The worst problem you have is as I suspected the logs at ~10,000 MB,
>> next biggest is the /var/spool at ~2,000 MB (which is probably where
>> squid cache data actually is).
>>
>

Lets see which of those apps is guzzling space:
   du -sh /var/cache/*

my moneys on yum or tomcat.

>
> The following has been observed in the /var/spool. this is as shown below.
> It has been observed that most of the files of /var/spool/squid are all
> empty except some which are big and they are in machine format (ascii).
>
> If these files are used by the cache to speed up the function of the proxy
> whenever it comes across a request from a student.

They look to me like your squid is crashing and burning. Those are core
files, generated by the system on fatal software errors.

Remove the ones of size zero, they are useless. Also any from before
your last squid install upgrade.

For the rest there is a simple procedure to find out why it died so
horribly:
http://wiki.squid-cache.org/SquidFaq/TroubleShooting#head-ec6b316c2f73a72782198dab56d9e9a3a7127eeb

If it shows an "assert" happening, we would be interested in knowing the
squid version where its happening and getting a copy of the trace.
Bug reporting details are on that page I linked.

>
> [root_at_stud-pxy squid]# ls -la /var/spool/squid
> total 1878740
> drwxr-x--- 2 squid squid 4096 2008-09-12 00:45 .
> drwxr-xr-x 17 root root 4096 2008-05-11 18:59 ..
> -rw------- 1 squid squid 0 2008-02-29 12:12 core.10033
> -rw------- 1 squid squid 0 2008-08-15 03:14 core.10987
> -rw------- 1 squid squid 0 2008-08-15 03:15 core.13847
> -rw------- 1 squid squid 0 2008-08-15 03:15 core.13867
> -rw------- 1 squid squid 0 2008-08-15 03:15 core.13875
> -rw------- 1 squid squid 0 2008-08-15 03:16 core.13886
> -rw------- 1 squid squid 0 2008-08-15 03:16 core.13897
> -rw------- 1 squid squid 0 2008-08-15 03:16 core.13905
> -rw------- 1 squid squid 0 2008-08-15 03:22 core.14123
> -rw------- 1 squid squid 0 2008-08-15 03:22 core.14131
> -rw------- 1 squid squid 0 2008-08-15 03:22 core.14141
> -rw------- 1 squid squid 0 2008-08-15 03:22 core.14150
> -rw------- 1 squid squid 274755584 2008-05-11 00:33 core.14159
> -rw------- 1 squid squid 0 2008-08-15 03:22 core.14160
> -rw------- 1 squid squid 0 2008-08-15 03:23 core.14168
> -rw------- 1 squid squid 0 2008-08-15 03:24 core.14242
> -rw------- 1 squid squid 0 2008-08-15 03:24 core.14250
> -rw------- 1 squid squid 0 2008-08-15 03:24 core.14258
> -rw------- 1 squid squid 0 2008-08-15 03:24 core.14266
> -rw------- 1 squid squid 0 2008-08-15 03:24 core.14274
> -rw------- 1 squid squid 273784832 2008-09-05 00:50 core.15288
> -rw------- 1 squid squid 298901504 2008-02-09 02:24 core.19953
> -rw------- 1 squid squid 0 2008-08-14 11:24 core.2041
> -rw------- 1 squid squid 0 2008-08-17 15:52 core.2043
> -rw------- 1 squid squid 0 2008-02-28 00:47 core.2050
> -rw------- 1 squid squid 192131072 2008-09-09 00:40 core.2053
> -rw------- 1 squid squid 280207360 2008-08-30 00:51 core.2054
> -rw------- 1 squid squid 10489856 2008-08-14 12:06 core.2055
> -rw------- 1 squid squid 0 2008-08-10 12:07 core.2056
> -rw------- 1 squid squid 0 2008-08-17 15:50 core.2066
> -rw------- 1 squid squid 0 2008-08-17 15:53 core.2420
> -rw------- 1 squid squid 0 2008-08-17 15:50 core.2425
> -rw------- 1 squid squid 0 2008-08-17 15:50 core.2433
> -rw------- 1 squid squid 0 2008-08-17 15:51 core.2471
> -rw------- 1 squid squid 0 2008-08-17 15:51 core.2480
> -rw------- 1 squid squid 0 2008-08-17 15:51 core.2488
> -rw------- 1 squid squid 276963328 2008-08-31 00:50 core.24985
> -rw------- 1 squid squid 0 2008-08-14 11:39 core.2510
> -rw------- 1 squid squid 0 2008-08-14 11:39 core.2519
> -rw------- 1 squid squid 0 2008-08-14 11:40 core.2527
> -rw------- 1 squid squid 0 2008-08-14 11:46 core.3016
> -rw------- 1 squid squid 0 2008-08-14 11:46 core.3024
> -rw------- 1 squid squid 0 2008-08-14 11:49 core.3129
> -rw------- 1 squid squid 58486784 2008-04-11 00:17 core.31365
> -rw------- 1 squid squid 0 2008-08-14 11:49 core.3157
<snip>
> [root_at_stud-pxy squid]# pwd
> /var/spool/squid
> [root_at_stud-pxy squid]# du -sh /var/spool/squid
> 1.8G /var/spool/squid
> [root_at_stud-pxy squid]#
>
>
>
>
>
>> Find out whats leaving so many of such big logs and see if you can cut
>> the size down a bit.
>>
>> Amos
>>
>>> Give the pointers and the step-wise solution of the problem.
>>>
>>>
>>> > Which will show you what parts of /var/ are the biggest space users
>>> and
>>> > then recurse down to see what inside them is wasting space.
>>> >
>>> >>
>>> >> Give some poniters, as i am a new bie.
>>> >>
>>> >> As of now, I keep deleting the files which are created on daily
>>> basis.
>>> >>
>>> >
>>> > huh? what filenames?
>>>
>>> yup these files are generated to keep track of the sites visited by the
>>> student users more than 1000, to keep a check on :
>>>
>>> they are crated on the directory:
>>>
>>> /var/www/sarg/daily
>>>
>>> The filenames are of the type:
>>>
>>> 2008Sep10-2008Sep10
>>>
>
>
>

-- 
Please use Squid 2.7.STABLE4 or 3.0.STABLE9
Received on Sat Sep 13 2008 - 15:58:01 MDT

This archive was generated by hypermail 2.2.0 : Sun Sep 14 2008 - 12:00:02 MDT