CesiumDB Benchmark Update Details

This snippet provides an update for the CesiumDB benchmark, including system information, CPU and memory details, and a log of changes made in the recent version. Highlights include the addition of a `merge` module and optimization of the `MergeIterator`.
 avatar
siennathesane
markdown
6 months ago
26 kB
10
Indexable

CesiumDB Benchmark Update

System Info

======================================== System Information ========================================
System: Darwin
Node Name: Siennas-MacBook-Pro.local
Release: 24.1.0
Version: Darwin Kernel Version 24.1.0: Thu Oct 10 21:03:15 PDT 2024; root:xnu-11215.41.3~2/RELEASE_ARM64_T6000
Machine: arm64
Processor: arm
======================================== CPU Info ========================================
Physical cores: 10
Total cores: 10
======================================== Memory Information ========================================
Total: 32.00GB
Available: 14.06GB
Used: 15.73GB
Percentage: 56.1%

Benchmark Changes (mainline v0.0.2 -> v0.0.3)

  • added new merge module with MergeIterator for efficient merging of multiple iterators
  • implemented Peekable adapter in peek.rs to allow peeking at next item without consuming
  • updated Memtable to use Peekable iterator
  • optimized MergeIterator to handle pointer entries and exhausted iterators
  • added comprehensive tests for MergeIterator and Peekable
  • improved performance of key lookups in memtables
  • refactored KeyBytes and ValueBytes serialization/deserialization
  • added benchmarks for database operations in benches/db.rs
  • implemented new merge benchmarks in benches/merge.rs
  • updated README.md with info on MVCC semantics and hybrid logical clock
  • added sysinfo.py script to gather system information for benchmarks
  • various minor code cleanups and optimizations throughout

Results

to read the benchmark groups, the structure is like this:

  • operation/size of value for non-batched operations
  • operation/batch/size of batch/size of value for batched operations

running 22 tests
test hlc::tests::test_time ... ignored
test keypair::tests::test_key_serialization ... ignored
test keypair::tests::test_value_serialization ... ignored
test memtable::tests::test_exceeds_max_size ... ignored
test memtable::tests::test_frozen ... ignored
test memtable::tests::test_memtable_basic ... ignored
test memtable::tests::test_memtable_versioning ... ignored
test merge::tests::test_complex_merge ... ignored
test merge::tests::test_empty_iterator ... ignored
test merge::tests::test_iterator_exhaustion ... ignored
test merge::tests::test_namespace_ordering ... ignored
test merge::tests::test_single_iterator ... ignored
test merge::tests::test_size_hint ... ignored
test merge::tests::test_version_ordering ... ignored
test merge::tests::test_with_memtable_iterators ... ignored
test peek::tests::test_next ... ignored
test peek::tests::test_peek ... ignored
test peek::tests::test_peek_mut ... ignored
test peek::tests::test_size_hint ... ignored
test state::tests::test_new_memtable ... ignored
test tests::db_put_batch ... ignored
test tests::test_db_put ... ignored

test result: ok. 0 passed; 0 failed; 22 ignored; 0 measured; 0 filtered out; finished in 0.00s

get_value               time:   [2.5876 µs 2.5951 µs 2.6031 µs]
                        change: [-3.3781% -2.3673% -1.3848%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe

put_value/1024          time:   [184.65 ns 185.05 ns 185.44 ns]
                        thrpt:  [5.1427 GiB/s 5.1537 GiB/s 5.1649 GiB/s]
                 change:
                        time:   [-1.8557% -1.4336% -1.0288%] (p = 0.00 < 0.05)
                        thrpt:  [+1.0395% +1.4545% +1.8907%]
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_value/2048          time:   [207.77 ns 207.88 ns 208.00 ns]
                        thrpt:  [9.1699 GiB/s 9.1752 GiB/s 9.1802 GiB/s]
                 change:
                        time:   [-1.5176% -1.1612% -0.7802%] (p = 0.00 < 0.05)
                        thrpt:  [+0.7864% +1.1748% +1.5410%]
                        Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
  1 (1.00%) high mild
  7 (7.00%) high severe
put_value/4096          time:   [282.33 ns 285.31 ns 288.39 ns]
                        thrpt:  [13.227 GiB/s 13.371 GiB/s 13.512 GiB/s]
                 change:
                        time:   [-0.2206% +1.0295% +2.2504%] (p = 0.10 > 0.05)
                        thrpt:  [-2.2008% -1.0190% +0.2211%]
                        No change in performance detected.
put_value/8192          time:   [407.48 ns 410.57 ns 413.56 ns]
                        thrpt:  [18.448 GiB/s 18.582 GiB/s 18.723 GiB/s]
                 change:
                        time:   [+2.1828% +3.4642% +4.7825%] (p = 0.00 < 0.05)
                        thrpt:  [-4.5642% -3.3482% -2.1362%]
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_value/16384         time:   [672.84 ns 675.97 ns 680.11 ns]
                        thrpt:  [22.436 GiB/s 22.573 GiB/s 22.678 GiB/s]
                 change:
                        time:   [-9.7659% -8.7493% -7.6952%] (p = 0.00 < 0.05)
                        thrpt:  [+8.3367% +9.5882% +10.823%]
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe
put_value/32768         time:   [1.3247 µs 1.3363 µs 1.3492 µs]
                        thrpt:  [22.618 GiB/s 22.837 GiB/s 23.037 GiB/s]
                 change:
                        time:   [-5.9792% -4.1183% -2.4848%] (p = 0.00 < 0.05)
                        thrpt:  [+2.5481% +4.2952% +6.3594%]
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

put_batch_value/batch/1/size/1024
                        time:   [183.22 ns 183.77 ns 184.39 ns]
                        thrpt:  [5.1721 GiB/s 5.1896 GiB/s 5.2050 GiB/s]
                 change:
                        time:   [-0.5370% -0.0651% +0.3923%] (p = 0.79 > 0.05)
                        thrpt:  [-0.3907% +0.0652% +0.5399%]
                        No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/4/size/1024
                        time:   [182.46 ns 182.63 ns 182.85 ns]
                        thrpt:  [5.2155 GiB/s 5.2219 GiB/s 5.2268 GiB/s]
                 change:
                        time:   [+0.6356% +1.0171% +1.3729%] (p = 0.00 < 0.05)
                        thrpt:  [-1.3543% -1.0069% -0.6315%]
                        Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
  8 (8.00%) high mild
put_batch_value/batch/8/size/1024
                        time:   [182.22 ns 182.30 ns 182.38 ns]
                        thrpt:  [5.2292 GiB/s 5.2315 GiB/s 5.2337 GiB/s]
                 change:
                        time:   [-1.6829% -1.2294% -0.7738%] (p = 0.00 < 0.05)
                        thrpt:  [+0.7798% +1.2447% +1.7117%]
                        Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
  2 (2.00%) high mild
  5 (5.00%) high severe
put_batch_value/batch/32/size/1024
                        time:   [182.27 ns 182.46 ns 182.74 ns]
                        thrpt:  [5.2188 GiB/s 5.2267 GiB/s 5.2321 GiB/s]
                 change:
                        time:   [-0.3595% -0.0432% +0.2645%] (p = 0.79 > 0.05)
                        thrpt:  [-0.2638% +0.0432% +0.3608%]
                        No change in performance detected.
Found 10 outliers among 100 measurements (10.00%)
  4 (4.00%) high mild
  6 (6.00%) high severe
put_batch_value/batch/512/size/1024
                        time:   [184.39 ns 184.94 ns 185.50 ns]
                        thrpt:  [5.1412 GiB/s 5.1565 GiB/s 5.1721 GiB/s]
                 change:
                        time:   [-0.4895% -0.0867% +0.2905%] (p = 0.66 > 0.05)
                        thrpt:  [-0.2897% +0.0868% +0.4919%]
                        No change in performance detected.
put_batch_value/batch/131072/size/1024
                        time:   [182.89 ns 183.40 ns 184.01 ns]
                        thrpt:  [5.1829 GiB/s 5.1998 GiB/s 5.2145 GiB/s]
                 change:
                        time:   [-1.0297% -0.5495% -0.0572%] (p = 0.03 < 0.05)
                        thrpt:  [+0.0572% +0.5525% +1.0404%]
                        Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/1/size/2048
                        time:   [214.19 ns 214.81 ns 215.46 ns]
                        thrpt:  [8.8524 GiB/s 8.8792 GiB/s 8.9048 GiB/s]
                 change:
                        time:   [+0.3265% +0.6185% +0.9106%] (p = 0.00 < 0.05)
                        thrpt:  [-0.9024% -0.6147% -0.3255%]
                        Change within noise threshold.
put_batch_value/batch/4/size/2048
                        time:   [217.80 ns 218.16 ns 218.54 ns]
                        thrpt:  [8.7278 GiB/s 8.7427 GiB/s 8.7574 GiB/s]
                 change:
                        time:   [+0.7710% +1.1129% +1.4242%] (p = 0.00 < 0.05)
                        thrpt:  [-1.4042% -1.1006% -0.7651%]
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_batch_value/batch/8/size/2048
                        time:   [220.73 ns 221.44 ns 222.26 ns]
                        thrpt:  [8.5818 GiB/s 8.6134 GiB/s 8.6412 GiB/s]
                 change:
                        time:   [+2.0524% +2.5113% +2.9316%] (p = 0.00 < 0.05)
                        thrpt:  [-2.8481% -2.4498% -2.0111%]
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  3 (3.00%) high mild
  2 (2.00%) high severe
put_batch_value/batch/32/size/2048
                        time:   [217.59 ns 218.41 ns 219.21 ns]
                        thrpt:  [8.7011 GiB/s 8.7329 GiB/s 8.7657 GiB/s]
                 change:
                        time:   [+1.1639% +1.5290% +1.8906%] (p = 0.00 < 0.05)
                        thrpt:  [-1.8555% -1.5060% -1.1505%]
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_batch_value/batch/512/size/2048
                        time:   [217.83 ns 218.60 ns 219.40 ns]
                        thrpt:  [8.6936 GiB/s 8.7253 GiB/s 8.7561 GiB/s]
                 change:
                        time:   [+0.7642% +1.1049% +1.4654%] (p = 0.00 < 0.05)
                        thrpt:  [-1.4442% -1.0929% -0.7584%]
                        Change within noise threshold.
put_batch_value/batch/131072/size/2048
                        time:   [217.50 ns 218.19 ns 218.95 ns]
                        thrpt:  [8.7115 GiB/s 8.7419 GiB/s 8.7693 GiB/s]
                 change:
                        time:   [+1.1746% +1.4753% +1.7846%] (p = 0.00 < 0.05)
                        thrpt:  [-1.7533% -1.4539% -1.1609%]
                        Performance has regressed.
put_batch_value/batch/1/size/4096
                        time:   [280.90 ns 282.93 ns 285.16 ns]
                        thrpt:  [13.378 GiB/s 13.483 GiB/s 13.580 GiB/s]
                 change:
                        time:   [-2.2776% -1.1776% -0.1323%] (p = 0.03 < 0.05)
                        thrpt:  [+0.1325% +1.1916% +2.3307%]
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe
put_batch_value/batch/4/size/4096
                        time:   [288.51 ns 290.66 ns 292.79 ns]
                        thrpt:  [13.029 GiB/s 13.124 GiB/s 13.222 GiB/s]
                 change:
                        time:   [-1.8932% -0.8650% +0.1582%] (p = 0.10 > 0.05)
                        thrpt:  [-0.1580% +0.8725% +1.9297%]
                        No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/8/size/4096
                        time:   [285.95 ns 288.67 ns 291.40 ns]
                        thrpt:  [13.091 GiB/s 13.215 GiB/s 13.340 GiB/s]
                 change:
                        time:   [-2.2641% -1.2684% -0.2256%] (p = 0.01 < 0.05)
                        thrpt:  [+0.2261% +1.2847% +2.3166%]
                        Change within noise threshold.
put_batch_value/batch/32/size/4096
                        time:   [283.22 ns 285.54 ns 288.15 ns]
                        thrpt:  [13.239 GiB/s 13.360 GiB/s 13.469 GiB/s]
                 change:
                        time:   [-2.6008% -1.5173% -0.4350%] (p = 0.01 < 0.05)
                        thrpt:  [+0.4369% +1.5407% +2.6703%]
                        Change within noise threshold.
put_batch_value/batch/512/size/4096
                        time:   [279.97 ns 281.43 ns 282.89 ns]
                        thrpt:  [13.485 GiB/s 13.554 GiB/s 13.625 GiB/s]
                 change:
                        time:   [-3.9361% -2.9601% -1.9596%] (p = 0.00 < 0.05)
                        thrpt:  [+1.9987% +3.0504% +4.0974%]
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
put_batch_value/batch/131072/size/4096
                        time:   [272.19 ns 273.42 ns 274.91 ns]
                        thrpt:  [13.876 GiB/s 13.952 GiB/s 14.015 GiB/s]
                 change:
                        time:   [-4.7131% -3.7380% -2.7800%] (p = 0.00 < 0.05)
                        thrpt:  [+2.8595% +3.8832% +4.9462%]
                        Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
  6 (6.00%) high mild
  4 (4.00%) high severe
put_batch_value/batch/1/size/8192
                        time:   [401.20 ns 404.95 ns 408.69 ns]
                        thrpt:  [18.668 GiB/s 18.840 GiB/s 19.017 GiB/s]
                 change:
                        time:   [-2.4127% -1.3721% -0.3541%] (p = 0.01 < 0.05)
                        thrpt:  [+0.3554% +1.3912% +2.4724%]
                        Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/4/size/8192
                        time:   [396.39 ns 400.08 ns 403.69 ns]
                        thrpt:  [18.899 GiB/s 19.070 GiB/s 19.247 GiB/s]
                 change:
                        time:   [-3.3936% -2.2342% -1.0838%] (p = 0.00 < 0.05)
                        thrpt:  [+1.0957% +2.2853% +3.5129%]
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/8/size/8192
                        time:   [406.77 ns 409.80 ns 412.81 ns]
                        thrpt:  [18.481 GiB/s 18.617 GiB/s 18.756 GiB/s]
                 change:
                        time:   [-0.3296% +0.7898% +1.8380%] (p = 0.16 > 0.05)
                        thrpt:  [-1.8048% -0.7836% +0.3307%]
                        No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild
put_batch_value/batch/32/size/8192
                        time:   [395.60 ns 398.79 ns 401.87 ns]
                        thrpt:  [18.985 GiB/s 19.131 GiB/s 19.286 GiB/s]
                 change:
                        time:   [-3.9319% -2.7056% -1.4995%] (p = 0.00 < 0.05)
                        thrpt:  [+1.5224% +2.7809% +4.0928%]
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/512/size/8192
                        time:   [395.99 ns 399.58 ns 403.14 ns]
                        thrpt:  [18.925 GiB/s 19.093 GiB/s 19.267 GiB/s]
                 change:
                        time:   [-1.5394% -0.4685% +0.6893%] (p = 0.41 > 0.05)
                        thrpt:  [-0.6846% +0.4707% +1.5635%]
                        No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_batch_value/batch/131072/size/8192
                        time:   [399.24 ns 402.83 ns 406.53 ns]
                        thrpt:  [18.767 GiB/s 18.940 GiB/s 19.110 GiB/s]
                 change:
                        time:   [-0.7800% +0.3269% +1.4937%] (p = 0.58 > 0.05)
                        thrpt:  [-1.4717% -0.3258% +0.7861%]
                        No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
put_batch_value/batch/1/size/16384
                        time:   [802.21 ns 802.85 ns 803.51 ns]
                        thrpt:  [18.990 GiB/s 19.006 GiB/s 19.021 GiB/s]
                 change:
                        time:   [+8.1714% +9.1120% +10.059%] (p = 0.00 < 0.05)
                        thrpt:  [-9.1397% -8.3510% -7.5541%]
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) high mild
  4 (4.00%) high severe
put_batch_value/batch/4/size/16384
                        time:   [801.58 ns 802.18 ns 802.81 ns]
                        thrpt:  [19.007 GiB/s 19.022 GiB/s 19.036 GiB/s]
                 change:
                        time:   [+6.7236% +7.6010% +8.5011%] (p = 0.00 < 0.05)
                        thrpt:  [-7.8350% -7.0640% -6.3000%]
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) high mild
  4 (4.00%) high severe
put_batch_value/batch/8/size/16384
                        time:   [773.58 ns 774.51 ns 775.23 ns]
                        thrpt:  [19.683 GiB/s 19.701 GiB/s 19.725 GiB/s]
                 change:
                        time:   [+0.6839% +1.8443% +2.9541%] (p = 0.00 < 0.05)
                        thrpt:  [-2.8694% -1.8109% -0.6792%]
                        Change within noise threshold.
Found 20 outliers among 100 measurements (20.00%)
  16 (16.00%) low severe
  2 (2.00%) high mild
  2 (2.00%) high severe
put_batch_value/batch/32/size/16384
                        time:   [796.58 ns 802.39 ns 808.10 ns]
                        thrpt:  [18.882 GiB/s 19.017 GiB/s 19.155 GiB/s]
                 change:
                        time:   [+8.2194% +9.1900% +10.152%] (p = 0.00 < 0.05)
                        thrpt:  [-9.2162% -8.4165% -7.5952%]
                        Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
  2 (2.00%) low severe
  2 (2.00%) high mild
  6 (6.00%) high severe
put_batch_value/batch/512/size/16384
                        time:   [802.59 ns 803.29 ns 804.02 ns]
                        thrpt:  [18.978 GiB/s 18.995 GiB/s 19.012 GiB/s]
                 change:
                        time:   [+7.5865% +8.5908% +9.5893%] (p = 0.00 < 0.05)
                        thrpt:  [-8.7502% -7.9111% -7.0515%]
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe
put_batch_value/batch/131072/size/16384
                        time:   [772.27 ns 776.69 ns 780.56 ns]
                        thrpt:  [19.549 GiB/s 19.646 GiB/s 19.758 GiB/s]
                 change:
                        time:   [+6.3552% +7.2372% +8.1061%] (p = 0.00 < 0.05)
                        thrpt:  [-7.4983% -6.7488% -5.9754%]
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) low mild
  1 (1.00%) high mild
put_batch_value/batch/1/size/32768
                        time:   [1.4420 µs 1.4543 µs 1.4653 µs]
                        thrpt:  [20.826 GiB/s 20.984 GiB/s 21.164 GiB/s]
                 change:
                        time:   [+8.9075% +9.9784% +11.032%] (p = 0.00 < 0.05)
                        thrpt:  [-9.9361% -9.0731% -8.1789%]
                        Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
  6 (6.00%) low severe
  1 (1.00%) high mild
  4 (4.00%) high severe
put_batch_value/batch/4/size/32768
                        time:   [1.4714 µs 1.4727 µs 1.4742 µs]
                        thrpt:  [20.702 GiB/s 20.722 GiB/s 20.741 GiB/s]
                 change:
                        time:   [+0.0951% +0.3950% +0.7351%] (p = 0.01 < 0.05)
                        thrpt:  [-0.7297% -0.3934% -0.0950%]
                        Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
  5 (5.00%) high mild
  4 (4.00%) high severe
put_batch_value/batch/8/size/32768
                        time:   [1.4680 µs 1.4692 µs 1.4705 µs]
                        thrpt:  [20.753 GiB/s 20.771 GiB/s 20.789 GiB/s]
                 change:
                        time:   [+6.0912% +7.0801% +8.0704%] (p = 0.00 < 0.05)
                        thrpt:  [-7.4677% -6.6120% -5.7415%]
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe
put_batch_value/batch/32/size/32768
                        time:   [1.4172 µs 1.4252 µs 1.4344 µs]
                        thrpt:  [21.276 GiB/s 21.413 GiB/s 21.534 GiB/s]
                 change:
                        time:   [-0.6456% +0.3043% +1.2794%] (p = 0.54 > 0.05)
                        thrpt:  [-1.2633% -0.3034% +0.6498%]
                        No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
put_batch_value/batch/512/size/32768
                        time:   [1.4584 µs 1.4598 µs 1.4614 µs]
                        thrpt:  [20.883 GiB/s 20.905 GiB/s 20.926 GiB/s]
                 change:
                        time:   [+4.3244% +5.0066% +5.7801%] (p = 0.00 < 0.05)
                        thrpt:  [-5.4643% -4.7679% -4.1451%]
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe
put_batch_value/batch/131072/size/32768
                        time:   [1.4705 µs 1.4718 µs 1.4731 µs]
                        thrpt:  [20.717 GiB/s 20.735 GiB/s 20.753 GiB/s]
                 change:
                        time:   [-0.4791% -0.1069% +0.2939%] (p = 0.60 > 0.05)
                        thrpt:  [-0.2931% +0.1070% +0.4815%]
                        No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high severe

HybridLogicalClock::time()
                        time:   [2.5455 ns 2.5474 ns 2.5493 ns]
                        change: [-0.0380% +0.1461% +0.3584%] (p = 0.13 > 0.05)
                        No change in performance detected.
Found 19 outliers among 100 measurements (19.00%)
  3 (3.00%) low severe
  7 (7.00%) low mild
  3 (3.00%) high mild
  6 (6.00%) high severe

merge_iterator_full_scan/tables/2/size/10000
                        time:   [1.9859 ms 1.9944 ms 2.0011 ms]
Found 4 outliers among 30 measurements (13.33%)
  3 (10.00%) low severe
  1 (3.33%) low mild
merge_iterator_full_scan/tables/4/size/10000
                        time:   [5.0773 ms 5.1020 ms 5.1393 ms]
merge_iterator_full_scan/tables/8/size/10000
                        time:   [11.835 ms 11.863 ms 11.890 ms]
merge_iterator_full_scan/tables/2/size/100000
                        time:   [18.990 ms 19.036 ms 19.082 ms]
merge_iterator_full_scan/tables/4/size/100000
                        time:   [51.240 ms 51.404 ms 51.555 ms]
Found 1 outliers among 30 measurements (3.33%)
  1 (3.33%) low mild
merge_iterator_full_scan/tables/8/size/100000
                        time:   [130.09 ms 130.38 ms 130.70 ms]

merge_iterator_range_scan/tables/2/size/10000
                        time:   [571.23 µs 577.10 µs 587.75 µs]
Found 6 outliers among 30 measurements (20.00%)
  4 (13.33%) low severe
  2 (6.67%) high severe
merge_iterator_range_scan/tables/4/size/10000
                        time:   [1.4791 ms 1.4955 ms 1.5193 ms]
merge_iterator_range_scan/tables/8/size/10000
                        time:   [3.8172 ms 4.0175 ms 4.3725 ms]
Found 1 outliers among 30 measurements (3.33%)
  1 (3.33%) high severe
merge_iterator_range_scan/tables/2/size/100000
                        time:   [5.4523 ms 5.4853 ms 5.5217 ms]
Found 4 outliers among 30 measurements (13.33%)
  1 (3.33%) low mild
  2 (6.67%) high mild
  1 (3.33%) high severe
merge_iterator_range_scan/tables/4/size/100000
                        time:   [16.580 ms 16.683 ms 16.794 ms]
Found 1 outliers among 30 measurements (3.33%)
  1 (3.33%) high mild
merge_iterator_range_scan/tables/8/size/100000
                        time:   [53.562 ms 54.062 ms 54.594 ms]

merge_iterator_latest_versions/tables/2/size/10000
                        time:   [1.5296 ms 1.5461 ms 1.5589 ms]
merge_iterator_latest_versions/tables/4/size/10000
                        time:   [3.4277 ms 3.4496 ms 3.4708 ms]
Found 5 outliers among 30 measurements (16.67%)
  1 (3.33%) low severe
  2 (6.67%) low mild
  1 (3.33%) high mild
  1 (3.33%) high severe
merge_iterator_latest_versions/tables/8/size/10000
                        time:   [6.9662 ms 7.0497 ms 7.1321 ms]
merge_iterator_latest_versions/tables/2/size/100000
                        time:   [4.0408 ms 4.0986 ms 4.1756 ms]
Found 1 outliers among 30 measurements (3.33%)
  1 (3.33%) high severe
merge_iterator_latest_versions/tables/4/size/100000
                        time:   [12.082 ms 12.198 ms 12.302 ms]
Found 5 outliers among 30 measurements (16.67%)
  5 (16.67%) low mild
merge_iterator_latest_versions/tables/8/size/100000
                        time:   [41.804 ms 42.181 ms 42.575 ms]
Leave a Comment