Fri Dec  8 17:37:18 UTC 2023
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     95.3301 (1.03)     95.3301 (1.03)     95.3301 (1.03)     0.0000 (1.0)      95.3301 (1.03)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_add-add[3.30.1]     93.8922 (1.01)     93.8922 (1.01)     93.8922 (1.01)     0.0000 (1.0)      93.8922 (1.01)     0.0000 (1.0)           0;0  0.0107 (0.99)          1           1
test_add-add[main]       92.8793 (1.0)      92.8793 (1.0)      92.8793 (1.0)      0.0000 (1.0)      92.8793 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.4635 (1.34)     43.4635 (1.34)     43.4635 (1.34)     0.0000 (1.0)      43.4635 (1.34)     0.0000 (1.0)           0;0  0.0230 (0.75)          1           1
test_checkout_copy-checkout[3.30.1]     32.4558 (1.0)      32.4558 (1.0)      32.4558 (1.0)      0.0000 (1.0)      32.4558 (1.0)      0.0000 (1.0)           0;0  0.0308 (1.0)           1           1
test_checkout_copy-checkout[main]       32.4673 (1.00)     32.4673 (1.00)     32.4673 (1.00)     0.0000 (1.0)      32.4673 (1.00)     0.0000 (1.0)           0;0  0.0308 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.9003 (1.02)     6.9003 (1.02)     6.9003 (1.02)     0.0000 (1.0)      6.9003 (1.02)     0.0000 (1.0)           0;0  0.1449 (0.98)          1           1
test_checkout_copy-checkout-noop[3.30.1]     6.7491 (1.0)      6.7491 (1.0)      6.7491 (1.0)      0.0000 (1.0)      6.7491 (1.0)      0.0000 (1.0)           0;0  0.1482 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       6.8037 (1.01)     6.8037 (1.01)     6.8037 (1.01)     0.0000 (1.0)      6.8037 (1.01)     0.0000 (1.0)           0;0  0.1470 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.5405 (1.40)     10.5405 (1.40)     10.5405 (1.40)     0.0000 (1.0)      10.5405 (1.40)     0.0000 (1.0)           0;0  0.0949 (0.71)          1           1
test_checkout_copy-checkout-update[3.30.1]      7.5035 (1.0)       7.5035 (1.0)       7.5035 (1.0)      0.0000 (1.0)       7.5035 (1.0)      0.0000 (1.0)           0;0  0.1333 (1.0)           1           1
test_checkout_copy-checkout-update[main]        7.5216 (1.00)      7.5216 (1.00)      7.5216 (1.00)     0.0000 (1.0)       7.5216 (1.00)     0.0000 (1.0)           0;0  0.1329 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     24.6497 (1.36)     24.6497 (1.36)     24.6497 (1.36)     0.0000 (1.0)      24.6497 (1.36)     0.0000 (1.0)           0;0  0.0406 (0.73)          1           1
test_checkout_hardlink-checkout[3.30.1]     18.2978 (1.01)     18.2978 (1.01)     18.2978 (1.01)     0.0000 (1.0)      18.2978 (1.01)     0.0000 (1.0)           0;0  0.0547 (0.99)          1           1
test_checkout_hardlink-checkout[main]       18.0732 (1.0)      18.0732 (1.0)      18.0732 (1.0)      0.0000 (1.0)      18.0732 (1.0)      0.0000 (1.0)           0;0  0.0553 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.3350 (1.00)     6.3350 (1.00)     6.3350 (1.00)     0.0000 (1.0)      6.3350 (1.00)     0.0000 (1.0)           0;0  0.1579 (1.00)          1           1
test_checkout_hardlink-checkout-noop[3.30.1]     6.5691 (1.04)     6.5691 (1.04)     6.5691 (1.04)     0.0000 (1.0)      6.5691 (1.04)     0.0000 (1.0)           0;0  0.1522 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       6.3200 (1.0)      6.3200 (1.0)      6.3200 (1.0)      0.0000 (1.0)      6.3200 (1.0)      0.0000 (1.0)           0;0  0.1582 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.0224 (1.39)     10.0224 (1.39)     10.0224 (1.39)     0.0000 (1.0)      10.0224 (1.39)     0.0000 (1.0)           0;0  0.0998 (0.72)          1           1
test_checkout_hardlink-checkout-update[3.30.1]      7.2602 (1.00)      7.2602 (1.00)      7.2602 (1.00)     0.0000 (1.0)       7.2602 (1.00)     0.0000 (1.0)           0;0  0.1377 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]        7.2260 (1.0)       7.2260 (1.0)       7.2260 (1.0)      0.0000 (1.0)       7.2260 (1.0)      0.0000 (1.0)           0;0  0.1384 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.8949 (1.31)     30.8949 (1.31)     30.8949 (1.31)     0.0000 (1.0)      30.8949 (1.31)     0.0000 (1.0)           0;0  0.0324 (0.76)          1           1
test_checkout_symlink-checkout[3.30.1]     24.1611 (1.02)     24.1611 (1.02)     24.1611 (1.02)     0.0000 (1.0)      24.1611 (1.02)     0.0000 (1.0)           0;0  0.0414 (0.98)          1           1
test_checkout_symlink-checkout[main]       23.6091 (1.0)      23.6091 (1.0)      23.6091 (1.0)      0.0000 (1.0)      23.6091 (1.0)      0.0000 (1.0)           0;0  0.0424 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.4476 (1.0)      8.4476 (1.0)      8.4476 (1.0)      0.0000 (1.0)      8.4476 (1.0)      0.0000 (1.0)           0;0  0.1184 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.30.1]     8.7367 (1.03)     8.7367 (1.03)     8.7367 (1.03)     0.0000 (1.0)      8.7367 (1.03)     0.0000 (1.0)           0;0  0.1145 (0.97)          1           1
test_checkout_symlink-checkout-noop[main]       8.6466 (1.02)     8.6466 (1.02)     8.6466 (1.02)     0.0000 (1.0)      8.6466 (1.02)     0.0000 (1.0)           0;0  0.1157 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     13.5775 (1.28)     13.5775 (1.28)     13.5775 (1.28)     0.0000 (1.0)      13.5775 (1.28)     0.0000 (1.0)           0;0  0.0737 (0.78)          1           1
test_checkout_symlink-checkout-update[3.30.1]     10.6393 (1.0)      10.6393 (1.0)      10.6393 (1.0)      0.0000 (1.0)      10.6393 (1.0)      0.0000 (1.0)           0;0  0.0940 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       10.7148 (1.01)     10.7148 (1.01)     10.7148 (1.01)     0.0000 (1.0)      10.7148 (1.01)     0.0000 (1.0)           0;0  0.0933 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.5671 (1.0)      4.5671 (1.0)      4.5671 (1.0)      0.0000 (1.0)      4.5671 (1.0)      0.0000 (1.0)           0;0  0.2190 (1.0)           1           1
test_data_status-data-changed[3.30.1]     5.4655 (1.20)     5.4655 (1.20)     5.4655 (1.20)     0.0000 (1.0)      5.4655 (1.20)     0.0000 (1.0)           0;0  0.1830 (0.84)          1           1
test_data_status-data-changed[main]       5.3510 (1.17)     5.3510 (1.17)     5.3510 (1.17)     0.0000 (1.0)      5.3510 (1.17)     0.0000 (1.0)           0;0  0.1869 (0.85)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8778 (1.0)      4.8778 (1.0)      4.8778 (1.0)      0.0000 (1.0)      4.8778 (1.0)      0.0000 (1.0)           0;0  0.2050 (1.0)           1           1
test_data_status-data-changed-noop[3.30.1]     5.4405 (1.12)     5.4405 (1.12)     5.4405 (1.12)     0.0000 (1.0)      5.4405 (1.12)     0.0000 (1.0)           0;0  0.1838 (0.90)          1           1
test_data_status-data-changed-noop[main]       5.4097 (1.11)     5.4097 (1.11)     5.4097 (1.11)     0.0000 (1.0)      5.4097 (1.11)     0.0000 (1.0)           0;0  0.1849 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.2419 (1.0)      20.2419 (1.0)      20.2419 (1.0)      0.0000 (1.0)      20.2419 (1.0)      0.0000 (1.0)           0;0  0.0494 (1.0)           1           1
test_data_status-data-new[3.30.1]     21.2496 (1.05)     21.2496 (1.05)     21.2496 (1.05)     0.0000 (1.0)      21.2496 (1.05)     0.0000 (1.0)           0;0  0.0471 (0.95)          1           1
test_data_status-data-new[main]       21.3495 (1.05)     21.3495 (1.05)     21.3495 (1.05)     0.0000 (1.0)      21.3495 (1.05)     0.0000 (1.0)           0;0  0.0468 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.8852 (1.0)      4.8852 (1.0)      4.8852 (1.0)      0.0000 (1.0)      4.8852 (1.0)      0.0000 (1.0)           0;0  0.2047 (1.0)           1           1
test_data_status-data-noop[3.30.1]     5.6724 (1.16)     5.6724 (1.16)     5.6724 (1.16)     0.0000 (1.0)      5.6724 (1.16)     0.0000 (1.0)           0;0  0.1763 (0.86)          1           1
test_data_status-data-noop[main]       5.5269 (1.13)     5.5269 (1.13)     5.5269 (1.13)     0.0000 (1.0)      5.5269 (1.13)     0.0000 (1.0)           0;0  0.1809 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     18.8983 (1.0)      18.8983 (1.0)      18.8983 (1.0)      0.0000 (1.0)      18.8983 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
test_data_status_all_flags-data-changed[3.30.1]     19.6703 (1.04)     19.6703 (1.04)     19.6703 (1.04)     0.0000 (1.0)      19.6703 (1.04)     0.0000 (1.0)           0;0  0.0508 (0.96)          1           1
test_data_status_all_flags-data-changed[main]       19.7818 (1.05)     19.7818 (1.05)     19.7818 (1.05)     0.0000 (1.0)      19.7818 (1.05)     0.0000 (1.0)           0;0  0.0506 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.1419 (1.0)      19.1419 (1.0)      19.1419 (1.0)      0.0000 (1.0)      19.1419 (1.0)      0.0000 (1.0)           0;0  0.0522 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.30.1]     19.9530 (1.04)     19.9530 (1.04)     19.9530 (1.04)     0.0000 (1.0)      19.9530 (1.04)     0.0000 (1.0)           0;0  0.0501 (0.96)          1           1
test_data_status_all_flags-data-changed-noop[main]       20.0484 (1.05)     20.0484 (1.05)     20.0484 (1.05)     0.0000 (1.0)      20.0484 (1.05)     0.0000 (1.0)           0;0  0.0499 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.6320 (1.0)      34.6320 (1.0)      34.6320 (1.0)      0.0000 (1.0)      34.6320 (1.0)      0.0000 (1.0)           0;0  0.0289 (1.0)           1           1
test_data_status_all_flags-data-new[3.30.1]     35.8024 (1.03)     35.8024 (1.03)     35.8024 (1.03)     0.0000 (1.0)      35.8024 (1.03)     0.0000 (1.0)           0;0  0.0279 (0.97)          1           1
test_data_status_all_flags-data-new[main]       35.9079 (1.04)     35.9079 (1.04)     35.9079 (1.04)     0.0000 (1.0)      35.9079 (1.04)     0.0000 (1.0)           0;0  0.0278 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.2856 (1.0)      18.2856 (1.0)      18.2856 (1.0)      0.0000 (1.0)      18.2856 (1.0)      0.0000 (1.0)           0;0  0.0547 (1.0)           1           1
test_data_status_all_flags-data-noop[3.30.1]     19.1056 (1.04)     19.1056 (1.04)     19.1056 (1.04)     0.0000 (1.0)      19.1056 (1.04)     0.0000 (1.0)           0;0  0.0523 (0.96)          1           1
test_data_status_all_flags-data-noop[main]       19.1475 (1.05)     19.1475 (1.05)     19.1475 (1.05)     0.0000 (1.0)      19.1475 (1.05)     0.0000 (1.0)           0;0  0.0522 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.3924 (1.0)      20.3924 (1.0)      20.3924 (1.0)      0.0000 (1.0)      20.3924 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
test_diff-diff[3.30.1]     24.0580 (1.18)     24.0580 (1.18)     24.0580 (1.18)     0.0000 (1.0)      24.0580 (1.18)     0.0000 (1.0)           0;0  0.0416 (0.85)          1           1
test_diff-diff[main]       24.0594 (1.18)     24.0594 (1.18)     24.0594 (1.18)     0.0000 (1.0)      24.0594 (1.18)     0.0000 (1.0)           0;0  0.0416 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.0864 (1.10)     7.0864 (1.10)     7.0864 (1.10)     0.0000 (1.0)      7.0864 (1.10)     0.0000 (1.0)           0;0  0.1411 (0.91)          1           1
test_diff-diff-changed[3.30.1]     6.4585 (1.0)      6.4585 (1.0)      6.4585 (1.0)      0.0000 (1.0)      6.4585 (1.0)      0.0000 (1.0)           0;0  0.1548 (1.0)           1           1
test_diff-diff-changed[main]       6.8286 (1.06)     6.8286 (1.06)     6.8286 (1.06)     0.0000 (1.0)      6.8286 (1.06)     0.0000 (1.0)           0;0  0.1464 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.0578 (1.0)      6.0578 (1.0)      6.0578 (1.0)      0.0000 (1.0)      6.0578 (1.0)      0.0000 (1.0)           0;0  0.1651 (1.0)           1           1
test_diff-diff-changed-noop[3.30.1]     6.3985 (1.06)     6.3985 (1.06)     6.3985 (1.06)     0.0000 (1.0)      6.3985 (1.06)     0.0000 (1.0)           0;0  0.1563 (0.95)          1           1
test_diff-diff-changed-noop[main]       6.7727 (1.12)     6.7727 (1.12)     6.7727 (1.12)     0.0000 (1.0)      6.7727 (1.12)     0.0000 (1.0)           0;0  0.1477 (0.89)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9803 (1.0)      4.9803 (1.0)      4.9803 (1.0)      0.0000 (1.0)      4.9803 (1.0)      0.0000 (1.0)           0;0  0.2008 (1.0)           1           1
test_diff-diff-noop[3.30.1]     6.5824 (1.32)     6.5824 (1.32)     6.5824 (1.32)     0.0000 (1.0)      6.5824 (1.32)     0.0000 (1.0)           0;0  0.1519 (0.76)          1           1
test_diff-diff-noop[main]       6.8392 (1.37)     6.8392 (1.37)     6.8392 (1.37)     0.0000 (1.0)      6.8392 (1.37)     0.0000 (1.0)           0;0  0.1462 (0.73)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       841.6473 (1.0)        841.6473 (1.0)        841.6473 (1.0)      0.0000 (1.0)        841.6473 (1.0)      0.0000 (1.0)           0;0  1.1881 (1.0)           1           1
test_exp_show-exp[3.30.1]     4,126.8459 (4.90)     4,126.8459 (4.90)     4,126.8459 (4.90)     0.0000 (1.0)      4,126.8459 (4.90)     0.0000 (1.0)           0;0  0.2423 (0.20)          1           1
test_exp_show-exp[main]       4,666.0498 (5.54)     4,666.0498 (5.54)     4,666.0498 (5.54)     0.0000 (1.0)      4,666.0498 (5.54)     0.0000 (1.0)           0;0  0.2143 (0.18)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     111.9525 (2.73)     111.9525 (2.73)     111.9525 (2.73)     0.0000 (1.0)      111.9525 (2.73)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_fetch-fetch[3.30.1]      40.9743 (1.0)       40.9743 (1.0)       40.9743 (1.0)      0.0000 (1.0)       40.9743 (1.0)      0.0000 (1.0)           0;0  0.0244 (1.0)           1           1
test_fetch-fetch[main]        41.4421 (1.01)      41.4421 (1.01)      41.4421 (1.01)     0.0000 (1.0)       41.4421 (1.01)     0.0000 (1.0)           0;0  0.0241 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2996 (1.0)      3.2996 (1.0)      3.2996 (1.0)      0.0000 (1.0)      3.2996 (1.0)      0.0000 (1.0)           0;0  0.3031 (1.0)           1           1
test_gc-gc[3.30.1]     3.3100 (1.00)     3.3100 (1.00)     3.3100 (1.00)     0.0000 (1.0)      3.3100 (1.00)     0.0000 (1.0)           0;0  0.3021 (1.00)          1           1
test_gc-gc[main]       3.3122 (1.00)     3.3122 (1.00)     3.3122 (1.00)     0.0000 (1.0)      3.3122 (1.00)     0.0000 (1.0)           0;0  0.3019 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     186.7888 (1.10)     186.7888 (1.10)     186.7888 (1.10)     0.0000 (1.0)      186.7888 (1.10)     0.0000 (1.0)           0;0  0.0054 (0.91)          1           1
test_get-get[3.30.1]     169.2473 (1.0)      169.2473 (1.0)      169.2473 (1.0)      0.0000 (1.0)      169.2473 (1.0)      0.0000 (1.0)           0;0  0.0059 (1.0)           1           1
test_get-get[main]       170.1729 (1.01)     170.1729 (1.01)     170.1729 (1.01)     0.0000 (1.0)      170.1729 (1.01)     0.0000 (1.0)           0;0  0.0059 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     84.9058 (4.66)     84.9058 (4.66)     84.9058 (4.66)     0.0000 (1.0)      84.9058 (4.66)     0.0000 (1.0)           0;0  0.0118 (0.21)          1           1
test_get_url-get-url[3.30.1]     18.2037 (1.0)      18.2037 (1.0)      18.2037 (1.0)      0.0000 (1.0)      18.2037 (1.0)      0.0000 (1.0)           0;0  0.0549 (1.0)           1           1
test_get_url-get-url[main]       18.3895 (1.01)     18.3895 (1.01)     18.3895 (1.01)     0.0000 (1.0)      18.3895 (1.01)     0.0000 (1.0)           0;0  0.0544 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.6919 (1.03)     138.2741 (1.04)     131.7384 (1.04)     1.6468 (1.01)     131.5746 (1.04)     2.0256 (1.16)         25;3  7.5908 (0.96)        100           1
test_help---help[3.30.1]     124.4628 (1.0)      132.4888 (1.0)      126.9167 (1.0)      1.6257 (1.0)      126.6060 (1.0)      2.0804 (1.19)         24;5  7.8792 (1.0)         100           1
test_help---help[main]       125.7687 (1.01)     147.3680 (1.11)     128.0825 (1.01)     2.2865 (1.41)     127.5884 (1.01)     1.7419 (1.0)           6;2  7.8075 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     289.7349 (1.06)     289.7349 (1.06)     289.7349 (1.06)     0.0000 (1.0)      289.7349 (1.06)     0.0000 (1.0)           0;0  0.0035 (0.94)          1           1
test_import-import[3.30.1]     275.4760 (1.01)     275.4760 (1.01)     275.4760 (1.01)     0.0000 (1.0)      275.4760 (1.01)     0.0000 (1.0)           0;0  0.0036 (0.99)          1           1
test_import-import[main]       272.7196 (1.0)      272.7196 (1.0)      272.7196 (1.0)      0.0000 (1.0)      272.7196 (1.0)      0.0000 (1.0)           0;0  0.0037 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     211.9416 (1.51)     211.9416 (1.51)     211.9416 (1.51)     0.0000 (1.0)      211.9416 (1.51)     0.0000 (1.0)           0;0  0.0047 (0.66)          1           1
test_import_url-import-url[3.30.1]     140.5782 (1.0)      140.5782 (1.0)      140.5782 (1.0)      0.0000 (1.0)      140.5782 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
test_import_url-import-url[main]       141.9120 (1.01)     141.9120 (1.01)     141.9120 (1.01)     0.0000 (1.0)      141.9120 (1.01)     0.0000 (1.0)           0;0  0.0070 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     359.9744 (1.0)      402.9495 (1.0)      367.5265 (1.0)       6.8842 (1.0)      365.8889 (1.0)       5.9827 (1.0)          10;6  2.7209 (1.0)         100           1
test_init-init[3.30.1]     381.6842 (1.06)     433.9950 (1.08)     406.5411 (1.11)     10.9537 (1.59)     409.4683 (1.12)     16.0862 (2.69)         35;0  2.4598 (0.90)        100           1
test_init-init[main]       380.2546 (1.06)     454.4012 (1.13)     388.8336 (1.06)      8.3779 (1.22)     387.1121 (1.06)      7.0589 (1.18)          9;3  2.5718 (0.95)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     466.1085 (1.18)     466.1085 (1.18)     466.1085 (1.18)     0.0000 (1.0)      466.1085 (1.18)     0.0000 (1.0)           0;0  2.1454 (0.85)          1           1
test_list-list[3.30.1]     404.7968 (1.03)     404.7968 (1.03)     404.7968 (1.03)     0.0000 (1.0)      404.7968 (1.03)     0.0000 (1.0)           0;0  2.4704 (0.97)          1           1
test_list-list[main]       394.5457 (1.0)      394.5457 (1.0)      394.5457 (1.0)      0.0000 (1.0)      394.5457 (1.0)      0.0000 (1.0)           0;0  2.5346 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     394.9113 (1.01)     394.9113 (1.01)     394.9113 (1.01)     0.0000 (1.0)      394.9113 (1.01)     0.0000 (1.0)           0;0  2.5322 (0.99)          1           1
test_list-list-dvc-only[3.30.1]     427.3591 (1.09)     427.3591 (1.09)     427.3591 (1.09)     0.0000 (1.0)      427.3591 (1.09)     0.0000 (1.0)           0;0  2.3400 (0.92)          1           1
test_list-list-dvc-only[main]       392.5395 (1.0)      392.5395 (1.0)      392.5395 (1.0)      0.0000 (1.0)      392.5395 (1.0)      0.0000 (1.0)           0;0  2.5475 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1968 (1.0)      3.1968 (1.0)      3.1968 (1.0)      0.0000 (1.0)      3.1968 (1.0)      0.0000 (1.0)           0;0  0.3128 (1.0)           1           1
test_list-list-recursive[3.30.1]     3.2254 (1.01)     3.2254 (1.01)     3.2254 (1.01)     0.0000 (1.0)      3.2254 (1.01)     0.0000 (1.0)           0;0  0.3100 (0.99)          1           1
test_list-list-recursive[main]       3.2378 (1.01)     3.2378 (1.01)     3.2378 (1.01)     0.0000 (1.0)      3.2378 (1.01)     0.0000 (1.0)           0;0  0.3088 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     387.4785 (1.0)      387.4785 (1.0)      387.4785 (1.0)      0.0000 (1.0)      387.4785 (1.0)      0.0000 (1.0)           0;0  2.5808 (1.0)           1           1
test_list-list-shallow[3.30.1]     391.0283 (1.01)     391.0283 (1.01)     391.0283 (1.01)     0.0000 (1.0)      391.0283 (1.01)     0.0000 (1.0)           0;0  2.5574 (0.99)          1           1
test_list-list-shallow[main]       390.3430 (1.01)     390.3430 (1.01)     390.3430 (1.01)     0.0000 (1.0)      390.3430 (1.01)     0.0000 (1.0)           0;0  2.5618 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.3148 (1.01)     13.3148 (1.01)     13.3148 (1.01)     0.0000 (1.0)      13.3148 (1.01)     0.0000 (1.0)           0;0  0.0751 (0.99)          1           1
test_partial_add-add[3.30.1]     13.2079 (1.00)     13.2079 (1.00)     13.2079 (1.00)     0.0000 (1.0)      13.2079 (1.00)     0.0000 (1.0)           0;0  0.0757 (1.00)          1           1
test_partial_add-add[main]       13.1794 (1.0)      13.1794 (1.0)      13.1794 (1.0)      0.0000 (1.0)      13.1794 (1.0)      0.0000 (1.0)           0;0  0.0759 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     90.5713 (1.02)     90.5713 (1.02)     90.5713 (1.02)     0.0000 (1.0)      90.5713 (1.02)     0.0000 (1.0)           0;0  0.0110 (0.98)          1           1
test_partial_add-add-partial[3.30.1]     90.2247 (1.02)     90.2247 (1.02)     90.2247 (1.02)     0.0000 (1.0)      90.2247 (1.02)     0.0000 (1.0)           0;0  0.0111 (0.98)          1           1
test_partial_add-add-partial[main]       88.8025 (1.0)      88.8025 (1.0)      88.8025 (1.0)      0.0000 (1.0)      88.8025 (1.0)      0.0000 (1.0)           0;0  0.0113 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]      6.6393 (1.0)       6.6393 (1.0)       6.6393 (1.0)      0.0000 (1.0)       6.6393 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.30.1]     10.0621 (1.52)     10.0621 (1.52)     10.0621 (1.52)     0.0000 (1.0)      10.0621 (1.52)     0.0000 (1.0)           0;0  0.0994 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       10.0923 (1.52)     10.0923 (1.52)     10.0923 (1.52)     0.0000 (1.0)      10.0923 (1.52)     0.0000 (1.0)           0;0  0.0991 (0.66)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.8867 (1.0)      3.8867 (1.0)      3.8867 (1.0)      0.0000 (1.0)      3.8867 (1.0)      0.0000 (1.0)           0;0  0.2573 (1.0)           1           1
test_partial_add-gc-noop[3.30.1]     5.7383 (1.48)     5.7383 (1.48)     5.7383 (1.48)     0.0000 (1.0)      5.7383 (1.48)     0.0000 (1.0)           0;0  0.1743 (0.68)          1           1
test_partial_add-gc-noop[main]       5.9558 (1.53)     5.9558 (1.53)     5.9558 (1.53)     0.0000 (1.0)      5.9558 (1.53)     0.0000 (1.0)           0;0  0.1679 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     13.8328 (3.33)     13.8328 (3.33)     13.8328 (3.33)     0.0000 (1.0)      13.8328 (3.33)     0.0000 (1.0)           0;0  0.0723 (0.30)          1           1
test_partial_add-push[3.30.1]      4.1540 (1.0)       4.1540 (1.0)       4.1540 (1.0)      0.0000 (1.0)       4.1540 (1.0)      0.0000 (1.0)           0;0  0.2407 (1.0)           1           1
test_partial_add-push[main]        4.1725 (1.00)      4.1725 (1.00)      4.1725 (1.00)     0.0000 (1.0)       4.1725 (1.00)     0.0000 (1.0)           0;0  0.2397 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     81.7734 (3.32)     81.7734 (3.32)     81.7734 (3.32)     0.0000 (1.0)      81.7734 (3.32)     0.0000 (1.0)           0;0  0.0122 (0.30)          1           1
test_partial_add-push-partial[3.30.1]     24.6131 (1.0)      24.6131 (1.0)      24.6131 (1.0)      0.0000 (1.0)      24.6131 (1.0)      0.0000 (1.0)           0;0  0.0406 (1.0)           1           1
test_partial_add-push-partial[main]       24.8304 (1.01)     24.8304 (1.01)     24.8304 (1.01)     0.0000 (1.0)      24.8304 (1.01)     0.0000 (1.0)           0;0  0.0403 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.0872 (1.02)     95.0872 (1.02)     95.0872 (1.02)     0.0000 (1.0)      95.0872 (1.02)     0.0000 (1.0)           0;0  0.0105 (0.98)          1           1
test_partial_remove-add[3.30.1]     93.6988 (1.00)     93.6988 (1.00)     93.6988 (1.00)     0.0000 (1.0)      93.6988 (1.00)     0.0000 (1.0)           0;0  0.0107 (1.00)          1           1
test_partial_remove-add[main]       93.3896 (1.0)      93.3896 (1.0)      93.3896 (1.0)      0.0000 (1.0)      93.3896 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     53.5603 (1.03)     53.5603 (1.03)     53.5603 (1.03)     0.0000 (1.0)      53.5603 (1.03)     0.0000 (1.0)           0;0  0.0187 (0.97)          1           1
test_partial_remove-add-update[3.30.1]     51.8383 (1.0)      51.8383 (1.0)      51.8383 (1.0)      0.0000 (1.0)      51.8383 (1.0)      0.0000 (1.0)           0;0  0.0193 (1.0)           1           1
test_partial_remove-add-update[main]       52.0908 (1.00)     52.0908 (1.00)     52.0908 (1.00)     0.0000 (1.0)      52.0908 (1.00)     0.0000 (1.0)           0;0  0.0192 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6849 (1.0)      3.6849 (1.0)      3.6849 (1.0)      0.0000 (1.0)      3.6849 (1.0)      0.0000 (1.0)           0;0  0.2714 (1.0)           1           1
test_partial_remove-gc[3.30.1]     5.3886 (1.46)     5.3886 (1.46)     5.3886 (1.46)     0.0000 (1.0)      5.3886 (1.46)     0.0000 (1.0)           0;0  0.1856 (0.68)          1           1
test_partial_remove-gc[main]       5.4198 (1.47)     5.4198 (1.47)     5.4198 (1.47)     0.0000 (1.0)      5.4198 (1.47)     0.0000 (1.0)           0;0  0.1845 (0.68)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.3328 (1.0)      6.3328 (1.0)      6.3328 (1.0)      0.0000 (1.0)      6.3328 (1.0)      0.0000 (1.0)           0;0  0.1579 (1.0)           1           1
test_partial_remove-gc-cloud[3.30.1]     9.5848 (1.51)     9.5848 (1.51)     9.5848 (1.51)     0.0000 (1.0)      9.5848 (1.51)     0.0000 (1.0)           0;0  0.1043 (0.66)          1           1
test_partial_remove-gc-cloud[main]       9.2372 (1.46)     9.2372 (1.46)     9.2372 (1.46)     0.0000 (1.0)      9.2372 (1.46)     0.0000 (1.0)           0;0  0.1083 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     92.7534 (3.52)     92.7534 (3.52)     92.7534 (3.52)     0.0000 (1.0)      92.7534 (3.52)     0.0000 (1.0)           0;0  0.0108 (0.28)          1           1
test_partial_remove-push[3.30.1]     26.6433 (1.01)     26.6433 (1.01)     26.6433 (1.01)     0.0000 (1.0)      26.6433 (1.01)     0.0000 (1.0)           0;0  0.0375 (0.99)          1           1
test_partial_remove-push[main]       26.3856 (1.0)      26.3856 (1.0)      26.3856 (1.0)      0.0000 (1.0)      26.3856 (1.0)      0.0000 (1.0)           0;0  0.0379 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.2905 (1.0)      4.2905 (1.0)      4.2905 (1.0)      0.0000 (1.0)      4.2905 (1.0)      0.0000 (1.0)           0;0  0.2331 (1.0)           1           1
test_partial_remove-push-update[3.30.1]     8.7927 (2.05)     8.7927 (2.05)     8.7927 (2.05)     0.0000 (1.0)      8.7927 (2.05)     0.0000 (1.0)           0;0  0.1137 (0.49)          1           1
test_partial_remove-push-update[main]       8.8441 (2.06)     8.8441 (2.06)     8.8441 (2.06)     0.0000 (1.0)      8.8441 (2.06)     0.0000 (1.0)           0;0  0.1131 (0.49)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     424.8421 (1.0)      429.3638 (1.0)      426.4954 (1.0)      2.0141 (1.0)      425.5967 (1.0)       3.3572 (1.0)           1;0  2.3447 (1.0)           5           3
test_plots-plots-diff[3.30.1]     777.2046 (1.83)     795.5971 (1.85)     786.1918 (1.84)     7.3359 (3.64)     783.4994 (1.84)     10.9796 (3.27)          2;0  1.2720 (0.54)          5           3
test_plots-plots-diff[main]       739.0372 (1.74)     751.0664 (1.75)     745.0069 (1.75)     4.6184 (2.29)     744.1617 (1.75)      6.6763 (1.99)          2;0  1.3423 (0.57)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       428.4882 (1.0)        443.5242 (1.0)        434.8552 (1.0)      5.6222 (1.41)       433.2795 (1.0)       6.7593 (1.03)          2;0  2.2996 (1.0)           5           3
test_plots-plots-diff-json[3.30.1]     1,035.2766 (2.42)     1,049.0979 (2.37)     1,042.7011 (2.40)     6.4665 (1.63)     1,045.3078 (2.41)     11.8860 (1.81)          1;0  0.9590 (0.42)          5           3
test_plots-plots-diff-json[main]         823.1094 (1.92)       832.5408 (1.88)       826.9255 (1.90)     3.9791 (1.0)        826.9120 (1.91)      6.5528 (1.0)           1;0  1.2093 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     391.8676 (1.0)      404.2662 (1.0)      397.2790 (1.0)       5.0735 (1.25)     398.6843 (1.0)       7.6541 (1.12)          2;0  2.5171 (1.0)           5           3
test_plots-plots-show[3.30.1]     648.1200 (1.65)     675.8892 (1.67)     659.6586 (1.66)     11.5834 (2.85)     653.9816 (1.64)     17.9351 (2.63)          1;0  1.5159 (0.60)          5           3
test_plots-plots-show[main]       635.2142 (1.62)     644.8788 (1.60)     640.0923 (1.61)      4.0656 (1.0)      638.9074 (1.60)      6.8137 (1.0)           2;0  1.5623 (0.62)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     407.2192 (1.0)      414.8228 (1.0)      411.3689 (1.0)      3.0179 (1.0)      411.2847 (1.0)       4.7013 (1.01)          2;0  2.4309 (1.0)           5           3
test_plots-plots-show-json[3.30.1]     804.4394 (1.98)     823.7074 (1.99)     813.7923 (1.98)     8.8378 (2.93)     810.4528 (1.97)     16.0233 (3.45)          3;0  1.2288 (0.51)          5           3
test_plots-plots-show-json[main]       686.6366 (1.69)     697.9235 (1.68)     689.7707 (1.68)     4.6811 (1.55)     687.9604 (1.67)      4.6391 (1.0)           1;0  1.4498 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     92.6095 (3.51)     92.6095 (3.51)     92.6095 (3.51)     0.0000 (1.0)      92.6095 (3.51)     0.0000 (1.0)           0;0  0.0108 (0.28)          1           1
test_push-push[3.30.1]     26.3931 (1.0)      26.3931 (1.0)      26.3931 (1.0)      0.0000 (1.0)      26.3931 (1.0)      0.0000 (1.0)           0;0  0.0379 (1.0)           1           1
test_push-push[main]       26.4860 (1.00)     26.4860 (1.00)     26.4860 (1.00)     0.0000 (1.0)      26.4860 (1.00)     0.0000 (1.0)           0;0  0.0378 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     97.5049 (1.03)     97.5049 (1.03)     97.5049 (1.03)     0.0000 (1.0)      97.5049 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing-add[3.30.1]     96.0712 (1.02)     96.0712 (1.02)     96.0712 (1.02)     0.0000 (1.0)      96.0712 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing-add[main]       94.5308 (1.0)      94.5308 (1.0)      94.5308 (1.0)      0.0000 (1.0)      94.5308 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     63.5411 (1.03)     63.5411 (1.03)     63.5411 (1.03)     0.0000 (1.0)      63.5411 (1.03)     0.0000 (1.0)           0;0  0.0157 (0.97)          1           1
test_sharing-add-noop[3.30.1]     61.7252 (1.0)      61.7252 (1.0)      61.7252 (1.0)      0.0000 (1.0)      61.7252 (1.0)      0.0000 (1.0)           0;0  0.0162 (1.0)           1           1
test_sharing-add-noop[main]       61.7569 (1.00)     61.7569 (1.00)     61.7569 (1.00)     0.0000 (1.0)      61.7569 (1.00)     0.0000 (1.0)           0;0  0.0162 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     44.2605 (1.42)     44.2605 (1.42)     44.2605 (1.42)     0.0000 (1.0)      44.2605 (1.42)     0.0000 (1.0)           0;0  0.0226 (0.70)          1           1
test_sharing-checkout[3.30.1]     31.9980 (1.03)     31.9980 (1.03)     31.9980 (1.03)     0.0000 (1.0)      31.9980 (1.03)     0.0000 (1.0)           0;0  0.0313 (0.97)          1           1
test_sharing-checkout[main]       31.1475 (1.0)      31.1475 (1.0)      31.1475 (1.0)      0.0000 (1.0)      31.1475 (1.0)      0.0000 (1.0)           0;0  0.0321 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.7410 (1.02)     6.7410 (1.02)     6.7410 (1.02)     0.0000 (1.0)      6.7410 (1.02)     0.0000 (1.0)           0;0  0.1483 (0.98)          1           1
test_sharing-checkout-noop[3.30.1]     6.7057 (1.01)     6.7057 (1.01)     6.7057 (1.01)     0.0000 (1.0)      6.7057 (1.01)     0.0000 (1.0)           0;0  0.1491 (0.99)          1           1
test_sharing-checkout-noop[main]       6.6069 (1.0)      6.6069 (1.0)      6.6069 (1.0)      0.0000 (1.0)      6.6069 (1.0)      0.0000 (1.0)           0;0  0.1514 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     111.4452 (2.64)     111.4452 (2.64)     111.4452 (2.64)     0.0000 (1.0)      111.4452 (2.64)     0.0000 (1.0)           0;0  0.0090 (0.38)          1           1
test_sharing-fetch[3.30.1]      42.8418 (1.02)      42.8418 (1.02)      42.8418 (1.02)     0.0000 (1.0)       42.8418 (1.02)     0.0000 (1.0)           0;0  0.0233 (0.98)          1           1
test_sharing-fetch[main]        42.1913 (1.0)       42.1913 (1.0)       42.1913 (1.0)      0.0000 (1.0)       42.1913 (1.0)      0.0000 (1.0)           0;0  0.0237 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4047 (1.0)      1.4047 (1.0)      1.4047 (1.0)      0.0000 (1.0)      1.4047 (1.0)      0.0000 (1.0)           0;0  0.7119 (1.0)           1           1
test_sharing-fetch-noop[3.30.1]     6.9856 (4.97)     6.9856 (4.97)     6.9856 (4.97)     0.0000 (1.0)      6.9856 (4.97)     0.0000 (1.0)           0;0  0.1432 (0.20)          1           1
test_sharing-fetch-noop[main]       6.9413 (4.94)     6.9413 (4.94)     6.9413 (4.94)     0.0000 (1.0)      6.9413 (4.94)     0.0000 (1.0)           0;0  0.1441 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.0254 (3.41)     95.0254 (3.41)     95.0254 (3.41)     0.0000 (1.0)      95.0254 (3.41)     0.0000 (1.0)           0;0  0.0105 (0.29)          1           1
test_sharing-push[3.30.1]     27.9453 (1.00)     27.9453 (1.00)     27.9453 (1.00)     0.0000 (1.0)      27.9453 (1.00)     0.0000 (1.0)           0;0  0.0358 (1.00)          1           1
test_sharing-push[main]       27.8304 (1.0)      27.8304 (1.0)      27.8304 (1.0)      0.0000 (1.0)      27.8304 (1.0)      0.0000 (1.0)           0;0  0.0359 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.4809 (1.0)      2.4809 (1.0)      2.4809 (1.0)      0.0000 (1.0)      2.4809 (1.0)      0.0000 (1.0)           0;0  0.4031 (1.0)           1           1
test_sharing-push-noop[3.30.1]     7.9239 (3.19)     7.9239 (3.19)     7.9239 (3.19)     0.0000 (1.0)      7.9239 (3.19)     0.0000 (1.0)           0;0  0.1262 (0.31)          1           1
test_sharing-push-noop[main]       8.1219 (3.27)     8.1219 (3.27)     8.1219 (3.27)     0.0000 (1.0)      8.1219 (3.27)     0.0000 (1.0)           0;0  0.1231 (0.31)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.5383 (1.01)     22.5383 (1.01)     22.5383 (1.01)     0.0000 (1.0)      22.5383 (1.01)     0.0000 (1.0)           0;0  0.0444 (0.99)          1           1
test_status-status[3.30.1]     22.6815 (1.02)     22.6815 (1.02)     22.6815 (1.02)     0.0000 (1.0)      22.6815 (1.02)     0.0000 (1.0)           0;0  0.0441 (0.98)          1           1
test_status-status[main]       22.2433 (1.0)      22.2433 (1.0)      22.2433 (1.0)      0.0000 (1.0)      22.2433 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.7227 (1.0)      5.7227 (1.0)      5.7227 (1.0)      0.0000 (1.0)      5.7227 (1.0)      0.0000 (1.0)           0;0  0.1747 (1.0)           1           1
test_status-status-changed[3.30.1]     6.0423 (1.06)     6.0423 (1.06)     6.0423 (1.06)     0.0000 (1.0)      6.0423 (1.06)     0.0000 (1.0)           0;0  0.1655 (0.95)          1           1
test_status-status-changed[main]       5.8436 (1.02)     5.8436 (1.02)     5.8436 (1.02)     0.0000 (1.0)      5.8436 (1.02)     0.0000 (1.0)           0;0  0.1711 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.8754 (1.04)     5.8754 (1.04)     5.8754 (1.04)     0.0000 (1.0)      5.8754 (1.04)     0.0000 (1.0)           0;0  0.1702 (0.96)          1           1
test_status-status-changed-noop[3.30.1]     5.9069 (1.05)     5.9069 (1.05)     5.9069 (1.05)     0.0000 (1.0)      5.9069 (1.05)     0.0000 (1.0)           0;0  0.1693 (0.95)          1           1
test_status-status-changed-noop[main]       5.6275 (1.0)      5.6275 (1.0)      5.6275 (1.0)      0.0000 (1.0)      5.6275 (1.0)      0.0000 (1.0)           0;0  0.1777 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.9680 (1.02)     5.9680 (1.02)     5.9680 (1.02)     0.0000 (1.0)      5.9680 (1.02)     0.0000 (1.0)           0;0  0.1676 (0.98)          1           1
test_status-status-noop[3.30.1]     5.9670 (1.02)     5.9670 (1.02)     5.9670 (1.02)     0.0000 (1.0)      5.9670 (1.02)     0.0000 (1.0)           0;0  0.1676 (0.98)          1           1
test_status-status-noop[main]       5.8424 (1.0)      5.8424 (1.0)      5.8424 (1.0)      0.0000 (1.0)      5.8424 (1.0)      0.0000 (1.0)           0;0  0.1712 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     211.1041 (1.48)     211.1041 (1.48)     211.1041 (1.48)     0.0000 (1.0)      211.1041 (1.48)     0.0000 (1.0)           0;0  0.0047 (0.68)          1           1
test_update-import-url[3.30.1]     142.5849 (1.0)      142.5849 (1.0)      142.5849 (1.0)      0.0000 (1.0)      142.5849 (1.0)      0.0000 (1.0)           0;0  0.0070 (1.0)           1           1
test_update-import-url[main]       142.8077 (1.00)     142.8077 (1.00)     142.8077 (1.00)     0.0000 (1.0)      142.8077 (1.00)     0.0000 (1.0)           0;0  0.0070 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     191.8424 (1.54)     191.8424 (1.54)     191.8424 (1.54)     0.0000 (1.0)      191.8424 (1.54)     0.0000 (1.0)           0;0  0.0052 (0.65)          1           1
test_update-update[3.30.1]     124.8291 (1.0)      124.8291 (1.0)      124.8291 (1.0)      0.0000 (1.0)      124.8291 (1.0)      0.0000 (1.0)           0;0  0.0080 (1.0)           1           1
test_update-update[main]       124.9143 (1.00)     124.9143 (1.00)     124.9143 (1.00)     0.0000 (1.0)      124.9143 (1.00)     0.0000 (1.0)           0;0  0.0080 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.5834 (1.0)      19.5834 (1.0)      19.5834 (1.0)      0.0000 (1.0)      19.5834 (1.0)      0.0000 (1.0)           0;0  0.0511 (1.0)           1           1
test_update-update-noop[3.30.1]     20.0496 (1.02)     20.0496 (1.02)     20.0496 (1.02)     0.0000 (1.0)      20.0496 (1.02)     0.0000 (1.0)           0;0  0.0499 (0.98)          1           1
test_update-update-noop[main]       20.1503 (1.03)     20.1503 (1.03)     20.1503 (1.03)     0.0000 (1.0)      20.1503 (1.03)     0.0000 (1.0)           0;0  0.0496 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean