c4b8c52Check the model against real ephys, and measure FLACJeremy Magland 1
2==============================================================================
3ecephys-000409-ch101.filtered n = 200000
4==============================================================================
5 real: std 4.104 kurtosis 17.70
6 surrogate: std 4.064 kurtosis 3.03
7 fit: taps 4096 spectrum RMS error 0.00 dB
8 s_* = 0.9076 quantization steps -> predicted entropy rate G(s_*) = 1.9767 bits/sample (8.1x)
9 [9.3s]
11 method real model diff real x model x
12 ------------------------------------------------------------------
13 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
14 order-0 H(z) 3.8712 4.0698 +0.1986 4.13 3.93
15 zlib 3.5021 3.6375 +0.1354 4.57 4.40
16 zlib+delta 3.0835 3.1808 +0.0973 5.19 5.03
17 zlib+shuffle 3.8026 3.8942 +0.0916 4.21 4.11
18 zstd 2.9785 3.1001 +0.1216 5.37 5.16
19 zstd+delta 2.7010 2.8254 +0.1244 5.92 5.66
20 zstd+shuffle 3.4699 3.5757 +0.1058 4.61 4.47
21 lzma 2.7819 2.9048 +0.1229 5.75 5.51
22 lzma+delta 2.5067 2.6013 +0.0946 6.38 6.15
23 lzma+shuffle 3.3894 3.5037 +0.1142 4.72 4.57
24 bz2 2.5189 2.5797 +0.0608 6.35 6.20
25 bz2+delta 2.6231 2.7260 +0.1029 6.10 5.87
26 bz2+shuffle 3.1706 3.1916 +0.0210 5.05 5.01
27 brotli 2.8846 3.0133 +0.1286 5.55 5.31
28 brotli+delta 2.6920 2.8064 +0.1144 5.94 5.70
29 brotli+shuffle 3.4607 3.5651 +0.1044 4.62 4.49
30 lz4 3.8891 4.0757 +0.1866 4.11 3.93
31 lz4+delta 3.5282 3.6736 +0.1454 4.53 4.36
32 lz4+shuffle 4.5850 4.7857 +0.2007 3.49 3.34
33 FLAC 2.6798 2.7252 +0.0454 5.97 5.87
34 LPC(32)+ANS 2.0827 2.1277 +0.0450 7.68 7.52
35 LPC(32) resid H0 2.0528 2.0938 +0.0410 7.79 7.64
36 cond-Gauss(32) 2.0288 2.0390 +0.0102 7.89 7.85
38==============================================================================
39ecephys-000409-ch101.raw n = 200000
40==============================================================================
41 real: std 14.440 kurtosis 19.18
42 surrogate: std 14.347 kurtosis 2.98
43 fit: taps 4096 spectrum RMS error 0.00 dB
44 s_* = 6.7593 quantization steps -> predicted entropy rate G(s_*) = 4.8053 bits/sample (3.3x)
45 [6.9s]
47 method real model diff real x model x
48 ------------------------------------------------------------------
49 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
50 order-0 H(z) 5.5107 5.8893 +0.3786 2.90 2.72
51 zlib 6.6606 7.0779 +0.4173 2.40 2.26
52 zlib+delta 6.5159 6.6210 +0.1050 2.46 2.42
53 zlib+shuffle 6.5794 6.8628 +0.2833 2.43 2.33
54 zstd 6.1070 6.4985 +0.3915 2.62 2.46
55 zstd+delta 6.0940 6.1588 +0.0649 2.63 2.60
56 zstd+shuffle 6.3090 6.6619 +0.3529 2.54 2.40
57 lzma 5.5096 5.8578 +0.3482 2.90 2.73
58 lzma+delta 5.6008 5.6872 +0.0864 2.86 2.81
59 lzma+shuffle 5.8715 6.1821 +0.3106 2.73 2.59
60 bz2 5.1064 5.3492 +0.2428 3.13 2.99
61 bz2+delta 5.3751 5.4582 +0.0831 2.98 2.93
62 bz2+shuffle 5.8671 6.0611 +0.1940 2.73 2.64
63 brotli 5.5399 5.5734 +0.0334 2.89 2.87
64 brotli+delta 5.2531 5.2589 +0.0058 3.05 3.04
65 brotli+shuffle 5.7376 5.8984 +0.1608 2.79 2.71
66 lz4 7.9504 8.4726 +0.5222 2.01 1.89
67 lz4+delta 7.9536 8.1194 +0.1658 2.01 1.97
68 lz4+shuffle 8.3784 8.8310 +0.4526 1.91 1.81
69 FLAC 4.9060 4.9645 +0.0585 3.26 3.22
70 LPC(32)+ANS 4.8550 4.9015 +0.0465 3.30 3.26
71 LPC(32) resid H0 4.7790 4.8271 +0.0481 3.35 3.31
72 cond-Gauss(32) 4.8181 4.8317 +0.0136 3.32 3.31
74==============================================================================
75ecephys-000876-ch45.filtered n = 200000
76==============================================================================
77 real: std 4.756 kurtosis 5.98
78 surrogate: std 4.759 kurtosis 3.03
79 fit: taps 4096 spectrum RMS error 0.00 dB
80 s_* = 1.0220 quantization steps -> predicted entropy rate G(s_*) = 2.1338 bits/sample (7.5x)
81 [8.9s]
83 method real model diff real x model x
84 ------------------------------------------------------------------
85 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
86 order-0 H(z) 4.2362 4.2975 +0.0612 3.78 3.72
87 zlib 4.0053 4.0200 +0.0147 3.99 3.98
88 zlib+delta 3.4830 3.5000 +0.0170 4.59 4.57
89 zlib+shuffle 4.1611 4.1991 +0.0380 3.85 3.81
90 zstd 3.4278 3.4267 -0.0012 4.67 4.67
91 zstd+delta 3.0654 3.1046 +0.0392 5.22 5.15
92 zstd+shuffle 3.8712 3.8989 +0.0277 4.13 4.10
93 lzma 3.1691 3.1901 +0.0210 5.05 5.02
94 lzma+delta 2.8229 2.8539 +0.0310 5.67 5.61
95 lzma+shuffle 3.7782 3.8112 +0.0330 4.23 4.20
96 bz2 2.7516 2.7393 -0.0123 5.81 5.84
97 bz2+delta 2.8424 2.8723 +0.0299 5.63 5.57
98 bz2+shuffle 3.4249 3.4278 +0.0029 4.67 4.67
99 brotli 3.2793 3.3048 +0.0254 4.88 4.84
100 brotli+delta 3.0191 3.0434 +0.0243 5.30 5.26
101 brotli+shuffle 3.8470 3.8901 +0.0431 4.16 4.11
102 lz4 4.4432 4.5126 +0.0694 3.60 3.55
103 lz4+delta 3.9691 4.0342 +0.0651 4.03 3.97
104 lz4+shuffle 5.1227 5.2399 +0.1172 3.12 3.05
105 FLAC 2.8648 2.9087 +0.0439 5.58 5.50
106 LPC(32)+ANS 2.2614 2.2702 +0.0088 7.08 7.05
107 LPC(32) resid H0 2.2151 2.2324 +0.0173 7.22 7.17
108 cond-Gauss(32) 2.1731 2.1898 +0.0167 7.36 7.31
110==============================================================================
111ecephys-000876-ch45.raw n = 200000
112==============================================================================
113 real: std 47.855 kurtosis 4.49
114 surrogate: std 26.107 kurtosis 2.90
115 fit: taps 4096 spectrum RMS error 0.00 dB
116 s_* = 5.2245 quantization steps -> predicted entropy rate G(s_*) = 4.4346 bits/sample (3.6x)
117 [5.4s]
119 method real model diff real x model x
120 ------------------------------------------------------------------
121 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
122 order-0 H(z) 7.5227 6.7494 -0.7734 2.13 2.37
123 zlib 7.4830 7.2800 -0.2029 2.14 2.20
124 zlib+delta 6.1132 6.1128 -0.0003 2.62 2.62
125 zlib+shuffle 7.0132 7.0086 -0.0046 2.28 2.28
126 zstd 6.5590 6.5471 -0.0119 2.44 2.44
127 zstd+delta 5.6966 5.7258 +0.0292 2.81 2.79
128 zstd+shuffle 6.3085 6.3790 +0.0705 2.54 2.51
129 lzma 5.6602 5.7149 +0.0547 2.83 2.80
130 lzma+delta 5.1886 5.2382 +0.0496 3.08 3.05
131 lzma+shuffle 5.3280 5.6688 +0.3408 3.00 2.82
132 bz2 4.9190 4.9421 +0.0231 3.25 3.24
133 bz2+delta 5.0644 5.0874 +0.0230 3.16 3.15
134 bz2+shuffle 5.1363 5.3262 +0.1899 3.12 3.00
135 brotli 5.8924 5.8680 -0.0244 2.72 2.73
136 brotli+delta 4.9019 4.8860 -0.0160 3.26 3.27
137 brotli+shuffle 5.5244 5.5517 +0.0272 2.90 2.88
138 lz4 8.8184 8.5224 -0.2960 1.81 1.88
139 lz4+delta 7.4188 7.5147 +0.0959 2.16 2.13
140 lz4+shuffle 8.0256 8.2186 +0.1930 1.99 1.95
141 FLAC 4.6271 4.6990 +0.0719 3.46 3.41
142 LPC(32)+ANS 4.5216 4.5119 -0.0097 3.54 3.55
143 LPC(32) resid H0 4.4219 4.4508 +0.0290 3.62 3.59
144 cond-Gauss(32) 4.4463 4.4525 +0.0062 3.60 3.59
146==============================================================================
147ecephys-001290-ch0.filtered n = 200000
148==============================================================================
149 real: std 4.322 kurtosis 5.87
150 surrogate: std 4.296 kurtosis 3.03
151 fit: taps 4096 spectrum RMS error 0.00 dB
152 s_* = 1.1039 quantization steps -> predicted entropy rate G(s_*) = 2.2374 bits/sample (7.2x)
153 [8.7s]
155 method real model diff real x model x
156 ------------------------------------------------------------------
157 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
158 order-0 H(z) 4.1290 4.1499 +0.0209 3.87 3.86
159 zlib 4.1723 4.1764 +0.0041 3.83 3.83
160 zlib+delta 3.7257 3.7364 +0.0107 4.29 4.28
161 zlib+shuffle 4.4166 4.4142 -0.0025 3.62 3.62
162 zstd 3.6014 3.5934 -0.0079 4.44 4.45
163 zstd+delta 3.3478 3.3034 -0.0444 4.78 4.84
164 zstd+shuffle 4.1235 4.1213 -0.0022 3.88 3.88
165 lzma 3.3408 3.3544 +0.0136 4.79 4.77
166 lzma+delta 3.0323 3.0560 +0.0237 5.28 5.24
167 lzma+shuffle 4.0374 4.0413 +0.0038 3.96 3.96
168 bz2 2.9192 2.9349 +0.0157 5.48 5.45
169 bz2+delta 2.9805 2.9936 +0.0130 5.37 5.34
170 bz2+shuffle 3.7126 3.7067 -0.0059 4.31 4.32
171 brotli 3.4559 3.4662 +0.0103 4.63 4.62
172 brotli+delta 3.2234 3.2378 +0.0144 4.96 4.94
173 brotli+shuffle 4.1373 4.1834 +0.0462 3.87 3.82
174 lz4 4.7044 4.7448 +0.0404 3.40 3.37
175 lz4+delta 4.2923 4.3249 +0.0326 3.73 3.70
176 lz4+shuffle 5.5315 5.5628 +0.0313 2.89 2.88
177 FLAC 3.0432 3.0751 +0.0319 5.26 5.20
178 LPC(32)+ANS 2.3687 2.3914 +0.0227 6.75 6.69
179 LPC(32) resid H0 2.3335 2.3469 +0.0134 6.86 6.82
180 cond-Gauss(32) 2.3008 2.3109 +0.0100 6.95 6.92
182==============================================================================
183ecephys-001290-ch0.raw n = 200000
184==============================================================================
185 real: std 5.327 kurtosis 6.33
186 surrogate: std 5.284 kurtosis 3.00
187 fit: taps 4096 spectrum RMS error 0.00 dB
188 s_* = 3.8062 quantization steps -> predicted entropy rate G(s_*) = 3.9796 bits/sample (4.0x)
189 [7.4s]
191 method real model diff real x model x
192 ------------------------------------------------------------------
193 raw int16 16.0000 16.0000 +0.0000 1.00 1.00
194 order-0 H(z) 4.4112 4.4485 +0.0373 3.63 3.60
195 zlib 5.6398 5.6495 +0.0097 2.84 2.83
196 zlib+delta 5.6191 5.6258 +0.0067 2.85 2.84
197 zlib+shuffle 5.8701 5.8890 +0.0189 2.73 2.72
198 zstd 5.2041 5.2108 +0.0067 3.07 3.07
199 zstd+delta 5.2158 5.2163 +0.0004 3.07 3.07
200 zstd+shuffle 5.5396 5.5896 +0.0500 2.89 2.86
201 lzma 4.6978 4.7408 +0.0430 3.41 3.37
202 lzma+delta 4.7106 4.7165 +0.0059 3.40 3.39
203 lzma+shuffle 5.2611 5.3035 +0.0424 3.04 3.02
204 bz2 4.6195 4.6238 +0.0043 3.46 3.46
205 bz2+delta 4.6766 4.6846 +0.0080 3.42 3.42
206 bz2+shuffle 5.5546 5.5349 -0.0196 2.88 2.89
207 brotli 4.4975 4.8334 +0.3359 3.56 3.31
208 brotli+delta 4.5357 4.5447 +0.0090 3.53 3.52
209 brotli+shuffle 5.2336 5.3565 +0.1228 3.06 2.99
210 lz4 6.7834 6.8391 +0.0557 2.36 2.34
211 lz4+delta 6.8257 6.8540 +0.0282 2.34 2.33
212 lz4+shuffle 7.6468 7.6958 +0.0491 2.09 2.08
213 FLAC 4.1928 4.2078 +0.0150 3.82 3.80
214 LPC(32)+ANS 4.0743 4.1166 +0.0422 3.93 3.89
215 LPC(32) resid H0 4.0199 4.0253 +0.0054 3.98 3.97
216 cond-Gauss(32) 4.0247 4.0272 +0.0025 3.98 3.97