Update Results.md with new results and clarifications about BBD's version and amount of iterations

This commit is contained in:
Timofey Solomko
2018-01-07 15:17:04 +03:00
parent b9440aac9f
commit 1929250dc1
+32 -18
View File
@@ -3,6 +3,12 @@
In this document you can find the results of performance tests which were run on Macbook Pro, Late 2011.
The main purpose of them is to track the progress from version to version.
__Note:__ Since version 4.1.0 of SWCompression internal functionality related to reading/writing bits and bytes
was published as a separate framework, [BitByteData](https://github.com/tsolomko/BitByteData).
It is worth mentioning that overall performance depends on the speed of reading and writing,
and thus BitByteData's version (which is specified in a separate column in the tables below)
becomes relevant to performance testing, since newer version can contain speed improvements.
## Tests description
There are three different dataset for testing. When choosing them, I was trying to have something,
@@ -16,44 +22,52 @@ in the repository.
All tests were run using swcomp's "perf-test" command. SWCompression (and swcomp) were compiled
using "Release" configuration.
__Note:__ All results are averages over 6 iterations.
## BZip2 Decompress
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|6.821 ± 0.042|54.214 ± 1.398|7.255 ± 0.117|
|4.0.1|6.797 ± 0.080|54.046 ± 1.070|7.177 ± 0.029|
|4.0.0|&mdash;|6.821 ± 0.042|54.214 ± 1.398|7.255 ± 0.117|
|4.0.1|&mdash;|6.797 ± 0.080|54.046 ± 1.070|7.177 ± 0.029|
|4.1.0-test.2-dev|1.0.1|4.619 ± 0.111|37.149 ± 0.354|4.961 ± 0.085|
## XZ Unarchive (LZMA/LZMA2 Decompress)
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|error|24.663 ± 2.349|2.904 ± 0.076|
|4.0.1|2.475 ± 0.067|23.507 ± 0.423|2.901 ± 0.049|
|4.0.0|&mdash;|error|24.663 ± 2.349|2.904 ± 0.076|
|4.0.1|&mdash;|2.475 ± 0.067|23.507 ± 0.423|2.901 ± 0.049|
|4.1.0-test.2-dev|1.0.1|2.487 ± 0.100|23.497 ± 0.121|2.927 ± 0.062|
## GZip Unarchive (Deflate Decompress)
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|4.007 ± 0.196|32.043 ± 0.581|4.303 ± 0.045|
|4.0.1|3.886 ± 0.100|32.390 ± 0.896|4.295 ± 0.040|
|4.0.0|&mdash;|4.007 ± 0.196|32.043 ± 0.581|4.303 ± 0.045|
|4.0.1|&mdash;|3.886 ± 0.100|32.390 ± 0.896|4.295 ± 0.040|
|4.1.0-test.2-dev|1.0.1|2.400 ± 0.108|21.439 ± 0.192|2.614 ± 0.077|
## 7-Zip Info Function
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|0.270 ± 0.010|crash|0.601 ± 0.057|
|4.0.1|0.258 ± 0.003|0.601 ± 0.010|0.473 ± 0.008|
|4.0.0|&mdash;|0.270 ± 0.010|crash|0.601 ± 0.057|
|4.0.1|&mdash;|0.258 ± 0.003|0.601 ± 0.010|0.473 ± 0.008|
|4.1.0-test.2-dev|1.0.1|0.265 ± 0.012|0.603 ± 0.015|0.479 ± 0.011|
## TAR Info Function
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|0.248 ± 0.172|1.563 ± 0.442|1.254 ± 0.277|
|4.0.1|0.187 ± 0.177|1.257 ± 0.404|1.016 ± 0.325|
|4.0.0|&mdash;|0.248 ± 0.172|1.563 ± 0.442|1.254 ± 0.277|
|4.0.1|&mdash;|0.187 ± 0.177|1.257 ± 0.404|1.016 ± 0.325|
|4.1.0-test.2-dev|1.0.1|0.184 ± 0.182|1.265 ± 0.435|1.024 ± 0.357|
## ZIP Info Function
|Version|Test 1|Test 2|Test 3|
|SWCompression<br>version|BitByteData<br>version|Test 1|Test 2|Test 3|
|---|---|---|---|
|4.0.0|0.072 ± 0.065|0.669 ± 0.147|0.120 ± 0.081|
|4.0.1|0.076 ± 0.064|0.670 ± 0.142|0.123 ± 0.080|
|4.0.0|&mdash;|0.072 ± 0.065|0.669 ± 0.147|0.120 ± 0.081|
|4.0.1|&mdash;|0.076 ± 0.064|0.670 ± 0.142|0.123 ± 0.080|
|4.1.0-test.2-dev|1.0.1|0.062 ± 0.073|0.638 ± 0.148|0.105 ± 0.090|