Skip to content

Update streamly to the latest master #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 14 commits into
base: master
Choose a base branch
from
Open

Update streamly to the latest master #52

wants to merge 14 commits into from

Conversation

@adithyaov
Copy link
Member

@adithyaov adithyaov commented Sep 25, 2022

No description provided.

@adithyaov
Copy link
Member Author

adithyaov commented Sep 25, 2022

Benchmarks:

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 30.10 ms   (30.03 ms .. 30.19 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 30.48 ms   (30.30 ms .. 30.87 ms)
std dev              541.0 μs   (269.6 μs .. 921.8 μs)

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized
time                 25.07 ms   (25.00 ms .. 25.18 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 25.32 ms   (25.25 ms .. 25.42 ms)
std dev              198.0 μs   (151.8 μs .. 286.0 μs)

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized
time                 28.50 ms   (28.27 ms .. 28.75 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 29.29 ms   (29.09 ms .. 29.61 ms)
std dev              590.9 μs   (341.6 μs .. 851.5 μs)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.650 ms   (2.618 ms .. 2.685 ms)
                     0.998 R²   (0.997 R² .. 0.999 R²)
mean                 2.730 ms   (2.704 ms .. 2.761 ms)
std dev              94.86 μs   (74.76 μs .. 136.0 μs)
variance introduced by outliers: 18% (moderately inflated)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.big
time                 2.483 ms   (2.465 ms .. 2.508 ms)
                     0.999 R²   (0.997 R² .. 0.999 R²)
mean                 2.544 ms   (2.526 ms .. 2.563 ms)
std dev              64.97 μs   (53.04 μs .. 79.01 μs)
variance introduced by outliers: 11% (moderately inflated)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.big
time                 2.710 ms   (2.608 ms .. 2.830 ms)
                     0.987 R²   (0.972 R² .. 0.997 R²)
mean                 2.597 ms   (2.564 ms .. 2.649 ms)
std dev              138.5 μs   (83.24 μs .. 241.0 μs)
variance introduced by outliers: 32% (moderately inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.frame
time                 2.728 ms   (2.682 ms .. 2.793 ms)
                     0.987 R²   (0.964 R² .. 0.998 R²)
mean                 2.823 ms   (2.769 ms .. 2.904 ms)
std dev              212.3 μs   (147.8 μs .. 348.0 μs)
variance introduced by outliers: 47% (moderately inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.frame
time                 2.936 ms   (2.713 ms .. 3.296 ms)
                     0.954 R²   (0.914 R² .. 0.996 R²)
mean                 2.919 ms   (2.841 ms .. 3.057 ms)
std dev              323.2 μs   (213.3 μs .. 454.0 μs)
variance introduced by outliers: 68% (severely inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.frame
time                 2.859 ms   (2.781 ms .. 2.969 ms)
                     0.985 R²   (0.973 R² .. 0.994 R²)
mean                 3.006 ms   (2.916 ms .. 3.224 ms)
std dev              462.3 μs   (230.3 μs .. 867.5 μs)
variance introduced by outliers: 81% (severely inflated)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.small
time                 5.824 ms   (5.757 ms .. 5.897 ms)
                     0.999 R²   (0.998 R² .. 0.999 R²)
mean                 5.891 ms   (5.851 ms .. 5.943 ms)
std dev              136.2 μs   (105.6 μs .. 163.4 μs)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.small
time                 5.444 ms   (5.243 ms .. 5.752 ms)
                     0.985 R²   (0.975 R² .. 0.995 R²)
mean                 5.230 ms   (5.153 ms .. 5.342 ms)
std dev              287.8 μs   (205.7 μs .. 396.8 μs)
variance introduced by outliers: 29% (moderately inflated)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.small
time                 5.880 ms   (5.725 ms .. 6.012 ms)
                     0.996 R²   (0.991 R² .. 0.999 R²)
mean                 5.737 ms   (5.652 ms .. 5.929 ms)
std dev              353.7 μs   (189.9 μs .. 647.2 μs)
variance introduced by outliers: 33% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress -1//home/adithya/Desktop/Prog/strbenchmarked compression/acceleration/bufsize(65536)/compress -1//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 35.29 ms   (35.06 ms .. 35.51 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 35.10 ms   (35.02 ms .. 35.19 ms)
std dev              171.9 μs   (124.9 μs .. 226.3 μs)

benchmarking compression/acceleration/bufsize(65536)/compress 10//home/adithya/Desktop/Prog/strbenchmarked compression/acceleration/bufsize(65536)/compress 10//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 30.88 ms   (28.89 ms .. 32.61 ms)
                     0.989 R²   (0.981 R² .. 0.996 R²)
mean                 27.69 ms   (27.07 ms .. 28.63 ms)
std dev              1.629 ms   (1.053 ms .. 1.959 ms)
variance introduced by outliers: 21% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress 1000//home/adithya/Desktop/Prog/sbenchmarked compression/acceleration/bufsize(65536)/compress 1000//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 2.633 ms   (2.545 ms .. 2.724 ms)
                     0.990 R²   (0.983 R² .. 0.995 R²)
mean                 2.738 ms   (2.688 ms .. 2.808 ms)
std dev              196.7 μs   (145.5 μs .. 275.3 μs)
variance introduced by outliers: 45% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress 65537//home/adithya/Desktop/Prog/benchmarked compression/acceleration/bufsize(65536)/compress 65537//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 2.277 ms   (2.145 ms .. 2.472 ms)
                     0.974 R²   (0.963 R² .. 0.986 R²)
mean                 2.457 ms   (2.410 ms .. 2.524 ms)
std dev              188.7 μs   (152.0 μs .. 270.5 μs)
variance introduced by outliers: 48% (moderately inflated)

benchmarking compression/buffer/bufsize(6553)/compress 5//home/adithya/Desktop/Prog/streamly-lzbenchmarked compression/buffer/bufsize(6553)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 32.24 ms   (31.97 ms .. 32.45 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 32.65 ms   (32.40 ms .. 32.97 ms)
std dev              633.6 μs   (403.3 μs .. 883.5 μs)

benchmarking compression/buffer/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lbenchmarked compression/buffer/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 30.94 ms   (30.71 ms .. 31.17 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 31.15 ms   (30.99 ms .. 31.40 ms)
std dev              442.4 μs   (327.2 μs .. 580.3 μs)

benchmarking compression/buffer/bufsize(655360)/compress 5//home/adithya/Desktop/Prog/streamly-benchmarked compression/buffer/bufsize(655360)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 32.75 ms   (30.36 ms .. 34.53 ms)
                     0.987 R²   (0.975 R² .. 0.996 R²)
mean                 29.40 ms   (28.63 ms .. 30.35 ms)
std dev              1.864 ms   (1.338 ms .. 2.186 ms)
variance introduced by outliers: 22% (moderately inflated)

benchmarking decompression/buffer/bufsize(6553)/decompress//home/adithya/Desktop/Prog/streamly-benchmarked decompression/buffer/bufsize(6553)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 8.036 ms   (7.325 ms .. 9.013 ms)
                     0.914 R²   (0.852 R² .. 0.955 R²)
mean                 9.049 ms   (8.614 ms .. 9.597 ms)
std dev              1.362 ms   (1.033 ms .. 1.794 ms)
variance introduced by outliers: 72% (severely inflated)

benchmarking decompression/buffer/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompression/buffer/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 3.332 ms   (3.129 ms .. 3.662 ms)
                     0.946 R²   (0.913 R² .. 0.979 R²)
mean                 3.183 ms   (3.092 ms .. 3.323 ms)
std dev              361.3 μs   (239.2 μs .. 484.8 μs)
variance introduced by outliers: 65% (severely inflated)

benchmarking decompression/buffer/bufsize(655360)/decompress//home/adithya/Desktop/Prog/streamlbenchmarked decompression/buffer/bufsize(655360)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 3.809 ms   (3.636 ms .. 3.995 ms)
                     0.990 R²   (0.985 R² .. 0.995 R²)
mean                 3.519 ms   (3.457 ms .. 3.581 ms)
std dev              212.2 μs   (178.6 μs .. 263.2 μs)
variance introduced by outliers: 34% (moderately inflated)

benchmarking resizing/buffer/bufsize(6553)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpobenchmarked resizing/buffer/bufsize(6553)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 7.720 ms   (7.493 ms .. 7.909 ms)
                     0.997 R²   (0.995 R² .. 0.999 R²)
mean                 7.804 ms   (7.717 ms .. 7.925 ms)
std dev              308.9 μs   (212.9 μs .. 436.7 μs)
variance introduced by outliers: 18% (moderately inflated)

benchmarking resizing/buffer/bufsize(65536)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpbenchmarked resizing/buffer/bufsize(65536)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.825 ms   (2.706 ms .. 2.925 ms)
                     0.992 R²   (0.988 R² .. 0.995 R²)
mean                 2.786 ms   (2.738 ms .. 2.831 ms)
std dev              153.9 μs   (137.8 μs .. 172.2 μs)
variance introduced by outliers: 32% (moderately inflated)

benchmarking resizing/buffer/bufsize(655360)/resize//home/adithya/Desktop/Prog/streamly-lz4/corbenchmarked resizing/buffer/bufsize(655360)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.799 ms   (2.711 ms .. 2.893 ms)
                     0.996 R²   (0.994 R² .. 0.998 R²)
mean                 2.848 ms   (2.819 ms .. 2.893 ms)
std dev              110.3 μs   (78.78 μs .. 183.4 μs)
variance introduced by outliers: 20% (moderately inflated)

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 31.07 ms   (30.44 ms .. 31.84 ms)
                     0.998 R²   (0.996 R² .. 1.000 R²)
mean                 30.75 ms   (30.55 ms .. 31.05 ms)
std dev              554.3 μs   (350.3 μs .. 816.4 μs)

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized
time                 25.64 ms   (25.26 ms .. 26.07 ms)
                     0.999 R²   (0.998 R² .. 1.000 R²)
mean                 25.50 ms   (25.40 ms .. 25.67 ms)
std dev              299.3 μs   (175.5 μs .. 447.3 μs)

benchmarking compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/cbenchmarked compress/files/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized
time                 29.08 ms   (28.86 ms .. 29.21 ms)
                     1.000 R²   (0.999 R² .. 1.000 R²)
mean                 29.52 ms   (29.38 ms .. 29.77 ms)
std dev              424.9 μs   (277.4 μs .. 667.3 μs)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.477 ms   (2.407 ms .. 2.538 ms)
                     0.988 R²   (0.971 R² .. 0.997 R²)
mean                 2.570 ms   (2.526 ms .. 2.666 ms)
std dev              199.5 μs   (97.31 μs .. 370.1 μs)
variance introduced by outliers: 48% (moderately inflated)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.big
time                 2.341 ms   (2.263 ms .. 2.399 ms)
                     0.988 R²   (0.970 R² .. 0.998 R²)
mean                 2.499 ms   (2.445 ms .. 2.647 ms)
std dev              268.0 μs   (120.9 μs .. 543.9 μs)
variance introduced by outliers: 65% (severely inflated)

benchmarking decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompress/files/big/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.big
time                 2.436 ms   (2.277 ms .. 2.629 ms)
                     0.968 R²   (0.952 R² .. 0.987 R²)
mean                 2.581 ms   (2.511 ms .. 2.710 ms)
std dev              300.9 μs   (215.1 μs .. 448.6 μs)
variance introduced by outliers: 70% (severely inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.frame
time                 2.653 ms   (2.612 ms .. 2.684 ms)
                     0.997 R²   (0.993 R² .. 0.999 R²)
mean                 2.623 ms   (2.600 ms .. 2.661 ms)
std dev              96.32 μs   (65.52 μs .. 144.0 μs)
variance introduced by outliers: 18% (moderately inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.frame
time                 2.555 ms   (2.490 ms .. 2.622 ms)
                     0.987 R²   (0.968 R² .. 0.999 R²)
mean                 2.679 ms   (2.633 ms .. 2.784 ms)
std dev              223.9 μs   (83.23 μs .. 430.7 μs)
variance introduced by outliers: 53% (severely inflated)

benchmarking decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lbenchmarked decompressWith/bufsize(65536)/decompressWith//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.frame
time                 2.681 ms   (2.590 ms .. 2.816 ms)
                     0.984 R²   (0.964 R² .. 0.998 R²)
mean                 2.768 ms   (2.716 ms .. 2.900 ms)
std dev              253.4 μs   (118.3 μs .. 480.6 μs)
variance introduced by outliers: 57% (severely inflated)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.small
time                 6.050 ms   (5.727 ms .. 6.430 ms)
                     0.988 R²   (0.983 R² .. 0.996 R²)
mean                 6.428 ms   (6.330 ms .. 6.525 ms)
std dev              287.6 μs   (210.8 μs .. 370.1 μs)
variance introduced by outliers: 22% (moderately inflated)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/world192.txt.normalized.compressed.small
time                 5.362 ms   (5.310 ms .. 5.415 ms)
                     0.999 R²   (0.998 R² .. 0.999 R²)
mean                 5.278 ms   (5.240 ms .. 5.319 ms)
std dev              121.9 μs   (102.5 μs .. 156.0 μs)

benchmarking decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/strbenchmarked decompression/files/small/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/cantrbry/alice29.txt.normalized.compressed.small
time                 5.683 ms   (5.609 ms .. 5.749 ms)
                     0.998 R²   (0.997 R² .. 0.999 R²)
mean                 5.709 ms   (5.660 ms .. 5.776 ms)
std dev              169.2 μs   (128.2 μs .. 229.1 μs)
variance introduced by outliers: 11% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress -1//home/adithya/Desktop/Prog/strbenchmarked compression/acceleration/bufsize(65536)/compress -1//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 35.31 ms   (34.72 ms .. 35.82 ms)
                     0.999 R²   (0.998 R² .. 1.000 R²)
mean                 35.51 ms   (35.27 ms .. 36.00 ms)
std dev              714.9 μs   (394.4 μs .. 1.207 ms)

benchmarking compression/acceleration/bufsize(65536)/compress 10//home/adithya/Desktop/Prog/strbenchmarked compression/acceleration/bufsize(65536)/compress 10//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 26.77 ms   (26.57 ms .. 26.99 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 27.15 ms   (26.80 ms .. 28.46 ms)
std dev              1.392 ms   (208.9 μs .. 2.724 ms)
variance introduced by outliers: 20% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress 1000//home/adithya/Desktop/Prog/sbenchmarked compression/acceleration/bufsize(65536)/compress 1000//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 2.123 ms   (2.070 ms .. 2.169 ms)
                     0.996 R²   (0.994 R² .. 0.998 R²)
mean                 2.091 ms   (2.068 ms .. 2.114 ms)
std dev              76.91 μs   (65.71 μs .. 90.30 μs)
variance introduced by outliers: 19% (moderately inflated)

benchmarking compression/acceleration/bufsize(65536)/compress 65537//home/adithya/Desktop/Prog/benchmarked compression/acceleration/bufsize(65536)/compress 65537//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 1.857 ms   (1.800 ms .. 1.920 ms)
                     0.987 R²   (0.974 R² .. 0.994 R²)
mean                 1.853 ms   (1.811 ms .. 1.902 ms)
std dev              147.3 μs   (122.2 μs .. 204.7 μs)
variance introduced by outliers: 51% (severely inflated)

benchmarking compression/buffer/bufsize(6553)/compress 5//home/adithya/Desktop/Prog/streamly-lzbenchmarked compression/buffer/bufsize(6553)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 32.36 ms   (31.92 ms .. 33.00 ms)
                     0.999 R²   (0.998 R² .. 1.000 R²)
mean                 32.29 ms   (32.16 ms .. 32.53 ms)
std dev              368.4 μs   (222.3 μs .. 617.2 μs)

benchmarking compression/buffer/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lbenchmarked compression/buffer/bufsize(65536)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 30.90 ms   (30.79 ms .. 31.00 ms)
                     1.000 R²   (1.000 R² .. 1.000 R²)
mean                 30.85 ms   (30.78 ms .. 30.92 ms)
std dev              148.0 μs   (115.5 μs .. 205.0 μs)

benchmarking compression/buffer/bufsize(655360)/compress 5//home/adithya/Desktop/Prog/streamly-benchmarked compression/buffer/bufsize(655360)/compress 5//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized
time                 29.18 ms   (28.63 ms .. 29.45 ms)
                     0.999 R²   (0.997 R² .. 1.000 R²)
mean                 29.53 ms   (29.32 ms .. 30.03 ms)
std dev              657.1 μs   (283.5 μs .. 1.066 ms)

benchmarking decompression/buffer/bufsize(6553)/decompress//home/adithya/Desktop/Prog/streamly-benchmarked decompression/buffer/bufsize(6553)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 7.228 ms   (7.066 ms .. 7.432 ms)
                     0.997 R²   (0.995 R² .. 0.999 R²)
mean                 7.179 ms   (7.130 ms .. 7.238 ms)
std dev              166.8 μs   (136.6 μs .. 228.4 μs)

benchmarking decompression/buffer/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamlybenchmarked decompression/buffer/bufsize(65536)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.526 ms   (2.447 ms .. 2.649 ms)
                     0.985 R²   (0.969 R² .. 0.996 R²)
mean                 2.603 ms   (2.546 ms .. 2.703 ms)
std dev              248.0 μs   (141.7 μs .. 394.4 μs)
variance introduced by outliers: 60% (severely inflated)

benchmarking decompression/buffer/bufsize(655360)/decompress//home/adithya/Desktop/Prog/streamlbenchmarked decompression/buffer/bufsize(655360)/decompress//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 6.776 ms   (6.186 ms .. 7.239 ms)
                     0.979 R²   (0.969 R² .. 0.990 R²)
mean                 6.259 ms   (6.154 ms .. 6.406 ms)
std dev              366.0 μs   (266.4 μs .. 472.6 μs)
variance introduced by outliers: 31% (moderately inflated)

benchmarking resizing/buffer/bufsize(6553)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpobenchmarked resizing/buffer/bufsize(6553)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 7.065 ms   (6.729 ms .. 7.350 ms)
                     0.980 R²   (0.965 R² .. 0.990 R²)
mean                 7.209 ms   (6.972 ms .. 7.520 ms)
std dev              790.8 μs   (605.4 μs .. 1.109 ms)
variance introduced by outliers: 61% (severely inflated)

benchmarking resizing/buffer/bufsize(65536)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpbenchmarked resizing/buffer/bufsize(65536)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.209 ms   (2.096 ms .. 2.295 ms)
                     0.969 R²   (0.935 R² .. 0.988 R²)
mean                 2.364 ms   (2.242 ms .. 2.526 ms)
std dev              486.1 μs   (340.4 μs .. 615.6 μs)
variance introduced by outliers: 88% (severely inflated)

benchmarking resizing/buffer/bufsize(655360)/resize//home/adithya/Desktop/Prog/streamly-lz4/corbenchmarked resizing/buffer/bufsize(655360)/resize//home/adithya/Desktop/Prog/streamly-lz4/corpora/large/bible.txt.normalized.compressed.big
time                 2.045 ms   (2.001 ms .. 2.089 ms)
                     0.997 R²   (0.995 R² .. 0.998 R²)
mean                 2.040 ms   (2.024 ms .. 2.062 ms)
std dev              65.26 μs   (55.10 μs .. 83.42 μs)
variance introduced by outliers: 15% (moderately inflated)

adithyaov
adithyaov commented Sep 30, 2022
View reviewed changes
src/Streamly/Internal/LZ4.hs Outdated
++ " maxCompLenC: " ++ show maxCompLenC
++ " uncompLenC: " ++ show uncompLenC
(MArray.Array cont dstBegin_ dstBegin dstMax) <-
newarr@(MArray.Array cont arrStart arrEnd arrBound) <-
Copy link
Member Author

@adithyaov adithyaov Sep 30, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make a new pinned array!

@harendra-kumar
Copy link
Member

harendra-kumar commented Dec 5, 2022

Need to update stack.yaml for appveyor build.

@TheKK TheKK mentioned this pull request Jul 18, 2023
Closed
@TheKK
Copy link

TheKK commented Jul 18, 2023

Hi, is this PR still running? I'd like to use lz4 in latest streamly and happy to help :)

@harendra-kumar
Copy link
Member

harendra-kumar commented Jul 18, 2023

@TheKK the last update on this was long ago, so it is stalled. @adithyaov can you update this, I will review. See if @TheKK can help in some way if you are busy.

@adithyaov
Copy link
Member Author

adithyaov commented Sep 7, 2023 •
edited
Loading

Hey @TheKK this PR is stalled. If possible please send a new PR or update this PR accordingly. I can review it.
Tasks:

  • Update streamly to 0.9.0.
  • Update the CI file.

@TheKK
Copy link

TheKK commented Sep 7, 2023

Got it. I'd like to work on this one but still have other task to work on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@adithyaov @harendra-kumar @TheKK @rnjtranjan