Re: How have folks been dealing with the Channel Archiver's 2GB index file limit?

[Thomas Birke <Thomas.Birke@bessy.de>]

Tom Cumming schrieb:
> I've hit the 2GB Channel Achiver index file limit. How have people been
> dealing with this limit? Is it time to move it up to 4GB? Modern
> machines should be able to handle it.
>   
As far as I remember (Kay?) the limit is not imposed by the filesystem used.
The data-structures used within the index and data files hold 32-bit 
offsets into these files.
And if these offsets go in both directions, we're stuck with the 2GB 
limit...

If our index-files at BESSY approach the 2GB limit, I usually re-create 
the index completely from scratch which typically produces a much 
smaller index-file.

Otherwise, the only way out is to introduce a new file-format and partly 
re-write the code of the ChannelArchiver-DataStore.

Hope it helps,
Thomas

--
BESSY GmbH
Albert-Einstein-Str. 15, D-12489 BERLIN
BESSY GmbH - Mitglied der Leibniz Gemeinschaft
Vorsitzender des Aufsichtsrates: Prof. Dr. Dr. h.c. mult Joachim Treusch
Geschäftsführer: Prof. Dr. Dr. h.c. Wolfgang Eberhardt, Prof. Dr. Eberhard Jaeschke
Sitz Berlin, AG Charlottenburg, HRB 14635

begin:vcard
fn:Thomas Birke
n:Birke;Thomas
org:BESSY GmbH;MBP
adr;quoted-printable:;;Albert-Einstein-Stra=C3=9Fe 15;Berlin;;12489;Germany
email;internet:Thomas.Birke@bessy.de
tel;work:+49 30 6392-4934
tel;fax:+49 30 6392-4859
tel;cell:+49 179 2445891
url:http://www.bessy.de/
version:2.1
end:vcard