mtbl 1.7.1 release

The immutable sorted string table library project, mtbl 1.7.0, is released. This release is a version bump to create a new tarball since the 1.7.1 tarball was generated incorrectly. Only metadata has changed.

Download https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.7.1.tar.gz
SHA256: da2693ea8f9d915a09cdb55815ebd92e84211443b0d5525789d92d57a5381d7b

mtbl 1.7.0 release

The immutable sorted string table library project, mtbl 1.7.0, is released. This release includes:

Add public mtbl_threadpool API for creating, sharing, and destroying threadpools.
When passed an mtbl_threadpool, mtbl_writer will send data block compression jobs to worker threads.
When passed an mtbl_threadpool, mtbl_sorter will dispatch sorting and temporary-file-writing to worker threads.
Add -t option to mtbl_merge.

Download https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.7.0.tar.gz
SHA256: 088ff314106b4c425179b7edfd749c6f810142a7c3812f29a9d25e95050a9365

mtbl 1.6.1 release

The immutable sorted string table library project, mtbl 1.6.1, is released. This release includes:

Debian packaging updates.
Code coverage make targets.

Download https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.6.1.tar.gz
SHA256: bf2711aa81a996cddf99f270cc7cb1c32dbed7f1bfc95e23ec6227e4bd08365d

Part of this was erroneously released as v1.6.0 after the original v1.6.0 release. The original v1.6.0 release (sha256sum 6563ddf1c7d9973efa7c58033fd339e68e19be69a234fa5a25448871704942df) has been restored.

mtbl 1.6.0 release

The immutable sorted string table library project, mtbl 1.6.0, is released. This release includes:

• Return mtbl_iter_init() to public API.
• Further optimizations to mtbl_iter_seek() for mtbl_reader and mtbl_merger.
• Streamline mtbl varint decoding.

Download https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.6.0.tar.gz
SHA256: 6563ddf1c7d9973efa7c58033fd339e68e19be69a234fa5a25448871704942df

mtbl 1.5.1 release

The immutable sorted string table library project, mtbl 1.5.1, is released. The new changes improve lookup speeds and fix regressions for time-fencing performance:

• Skip unnecessary seeks when seeking forward on a merger iterator.
• Fix inefficiency in heap implementation impacting merger iterator performance.

Download https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.5.1.tar.gz
SHA256: 2e2055d2a2a776cc723ad9e9ba4b781b783a29616c37968b724e657987b8763b

mtbl 1.5.0 release

The immutable sorted string table library project, mtbl 1.5.0, is released. The new changes include:

• Add reader filter function option to mtbl_fileset.
• Use "galloping search" instead of full binary search for mtbl_iter_seek().
• Make index block verification optional for more efficient reader initialization.
• Fix underflow errors triggered by short keys and empty mtbl files.
• mtbl_fileset_partition() use is deprecated in favor of mtbl_fileset_dup() with the fname_filter_func option set.

Download: https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.5.0.tar.gz
SHA256: a19484a9ce208251327ba5a429d9fab717709ea8ab8f79236b02d67e0ba92477

mtbl 1.4.0

The immutable sorted string table library project, mtbl 1.4.0, is released. This release adds command-line options to support compression levels in mtbl_merge, and a hex formatting option and a variety of filtering options for mtbl_dump. Note that this release leaves the MTBL file format unchanged. In detail:

• Add -l option to specify compression level for mtbl_merge.
• Add -x option to mtbl_dump to print data for the key and value each formatted
  with the length (8 digit hexadecimal), a colon, and then hex digit pairs
  separated by a dash.
• Minimum and maximum Zstd compression levels changed from hardcoded 1 and 22,
  respectively, to values defined by Zstd.
• Add -k and -v options to mtbl_dump to print only entries for which the key or
  value, respectively, matches the given prefix.
• Add -K and -V options to mbtl_dump to print only entries for which the length
  of the key or value, respectively, is greater than or equal to the given
  integer.

Download: https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.4.0.tar.gz
SHA256: 22a41252798d3d6f5d4d82154681996fe25e5554969d26272bf6e33be846fe73

mtbl 1.3.0

The immutable sorted string table library project, mtbl 1.3.0, was released. This release includes improvements enabling aggregation. In detail:

• Fix mtbl_reload_now() on filesets with open iterators.
• Add support for absolute pathnames in filesets
• Make merge function an optional parameter for mergers and filesets to enable unmerged results.
• Add dupsort function to sort unmerged results based on data.
• Add filename filter option to filesets. This provides functionality similar to mtbl_fileset_partition() but resilient against fileset reloads.
• Add mtbl_fileset_dup() to open an existing fileset with different options.

Download: https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.3.0.tar.gz

SHA256: 3738944a7018e2a74646ec3f87432788d084b2fe975e01d84163e1cf4eb5a4d5

mtbl 1.2.1

The immutable sorted string table library project, mtbl 1.2.1, was released. This release features fileset reloading improvements, fixes for 32-bit systems, and the addition of several unit tests. Note that 1.2.1 fixes a library versioning error in 1.2.0. In detail (from 1.2.0 notes):

• Prevent fileset reloading when the fileset has iterators open.
• Add and document facility to disable reloading of filesets.
• Defer initial load of fileset until the first operation on a fileset
  source.
• Handle 32bit size_t overflows, failing with an assertion upon opening
  an mtbl_reader with an oversized data block.
• Fix for systems with 32-bit size_t.
• Add several unit tests for various libmtbl functions.

Download: https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.2.1.tar.gz

SHA256: a82f425a2c8e21e326cbe0255627b1c8f50cd13472f1bc8b8cb13a202ea0024b

mtbl 1.1.0 released

mtbl, the immutable sorted string table library, was released at version 1.1.0 with the following bug fixes and improvements:

• Fix default zlib compression level.
• Add callback data (clos) parameter to mtbl_fileset_partition function and its callback. Early users of mtbl_fileset_partition will need to rewrite accordingly.
• Use 64-bit offsets in blocks with more than 4G of data.
• Fix undefined behavior when seeking past end of mtbl file.

A source tarball is available at https://dl.farsightsecurity.com/dist/mtbl/mtbl-1.1.0.tar.gz

SHA256 892d41100349602f180f34ab9007fb511715d344b7393b313e8740f3acf47107