Talk:WikiBrowse: Difference between revisions
(Compression) |
(reply) |
||
| Line 6: | Line 6: | ||
Note that higher compression levels mean faster decompression. |
Note that higher compression levels mean faster decompression. |
||
[[User:AlbertCahalan|AlbertCahalan]] 00:07, 26 May 2008 (EDT) |
[[User:AlbertCahalan|AlbertCahalan]] 00:07, 26 May 2008 (EDT) |
||
---- |
|||
We tried 7zip. It didn't do any better than bzip2 for our archive, which is the latest revision of every article, but I was shocked to see that it produces archives 20x smaller for the archive that is every revision of every article. |
|||
We aren't able to interchange compression formats easily, since the code is dependent on an indexer that can create an index of articles into compression blocks, and then decode an individual compression block quickly. This would need to be ported per-format. |
|||
[[User:Cjb|Cjb]] 01:59, 26 May 2008 (EDT) |
|||
Revision as of 05:59, 26 May 2008
Compression
There are better choices than bzip2. The obvious one is 7zip, which is excellent for both decompression speed and compression ability according to this comparison chart. Note that higher compression levels mean faster decompression. AlbertCahalan 00:07, 26 May 2008 (EDT)
We tried 7zip. It didn't do any better than bzip2 for our archive, which is the latest revision of every article, but I was shocked to see that it produces archives 20x smaller for the archive that is every revision of every article.
We aren't able to interchange compression formats easily, since the code is dependent on an indexer that can create an index of articles into compression blocks, and then decode an individual compression block quickly. This would need to be ported per-format. Cjb 01:59, 26 May 2008 (EDT)