33c9443delta encodingJeremy Magland 3A benchmarking framework for evaluating compression algorithms on integer array datasets, with a focus on scientific data.
7ccd097update web-uiJeremy Magland 4
7Zia provides systematic benchmarking of compression methods for integer arrays, measuring:
8- Compression ratio
9- Encoding throughput (MB/s)
10- Decoding throughput (MB/s)
12## Repository Structure
14Key components are located in the `zia_benchmark/src/zia_benchmark/` directory:
16- Algorithms: `/algorithms/`
17 - LZMA: `/algorithms/lzma/`
18 - Zstandard: `/algorithms/zstd/`
19 - ZLIB: `/algorithms/zlib/`
20 - Simple ANS: `/algorithms/simple_ans/`
21 - etc.
23- Datasets: `/datasets/`
24 - Synthetic data generators:
25 - `/datasets/bernoulli/`: Binary random data
26 - `/datasets/gaussian/`: Normal distribution samples
27 - Real data: `/datasets/real/`
28 - etc.
30- Core functionality:
31 - `run_benchmarks.py`: Main benchmarking engine
33## Results
35Latest benchmark results: https://magland.github.io/zia/