Re: l10n.gnome.org almost out of disk space

[Claude Paroz <claude 2xlibre net>]

Le jeudi 20 janvier 2011 à 22:36 +0100, Claude Paroz a écrit :
> Le jeudi 20 janvier 2011 à 17:20 +0100, Olav Vitters a écrit :
> > Main disk space usage seems to be the 'POT' directory. The server has
> > 129GB in total. Out of 117GB used, 90GB is used by
> > /var/www/gnomeweb/scratchdir/POT
> > 
> > 
> > # df -h
> > Filesystem            Size  Used Avail Use% Mounted on
> > /dev/cciss/c0d0p1     129G  117G  5.0G  96% /
> > none                  1.9G  200K  1.9G   1% /dev
> > none                  1.9G     0  1.9G   0% /dev/shm
> > none                  1.9G   84K  1.9G   1% /var/run
> > none                  1.9G     0  1.9G   0% /var/lock
> > none                  1.9G     0  1.9G   0% /lib/init/rw
> > 
> > 
> > root@progress:/var/www/gnomeweb/scratchdir# du -sh *
> > 12K	cvs
> > 17G	git
> > 90G	POT
> > 3.2G	svn
> > 9.1M	xml
> > 
> > 
> > So 17GB for git clones. Almost nothing for cvs. Minor for svn (gnucash,
> > webkit). Majority is in POT.
> > 
> > Noticed that the POT directory has things like:
> >   gnome-screensaver.gnome-2-14
> 
> > 
> > Could we limit the number of previous versions? E.g. head, GNOME 2.32,
> > 2.30 and perhaps 2.28?
> > 
> > Furthermore, could damned-lies automatically clean the scratchdir for
> > items it really does not need anymore?
> > 
> > Lastly, above is mostly text. If these are needed, I think we could
> > setup something where the files are stored with compressed (.gz!) and
> > serves them that way (automatically decompressing for the few clients
> > which do not handle gzip).
> 
> I think I will go the 'delete older releases' route. I just need to
> properly implement deletion of unused files when deleting branches.
> 
> I also implemented an 'archiver' (tabular data) so as stats-addicted can
> always go back in the past if they want. We just should find a location
> for these files.

I've managed to save approximatively 3-4Gb with various housekeeping,
but deleting older GNOME releases doesn't save much (less than
1Gb/release). I deleted GNOME 2.14 and GNOME 2.16.

The next step would be to try compressing merged po files, if we really
need to save more space. But this adds some complexity to the
application.

Claude
-- 
www.2xlibre.net