Fri Dec  8 21:10:38 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     598.1347 (1.03)     598.1347 (1.03)     598.1347 (1.03)     0.0000 (1.0)      598.1347 (1.03)     0.0000 (1.0)           0;0  1.6719 (0.97)          1           1
test_add-add[3.10.0]     608.0465 (1.05)     608.0465 (1.05)     608.0465 (1.05)     0.0000 (1.0)      608.0465 (1.05)     0.0000 (1.0)           0;0  1.6446 (0.95)          1           1
test_add-add[main]       577.9957 (1.0)      577.9957 (1.0)      577.9957 (1.0)      0.0000 (1.0)      577.9957 (1.0)      0.0000 (1.0)           0;0  1.7301 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     554.8159 (1.0)      554.8159 (1.0)      554.8159 (1.0)      0.0000 (1.0)      554.8159 (1.0)      0.0000 (1.0)           0;0  1.8024 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     588.6029 (1.06)     588.6029 (1.06)     588.6029 (1.06)     0.0000 (1.0)      588.6029 (1.06)     0.0000 (1.0)           0;0  1.6989 (0.94)          1           1
test_checkout_copy-checkout[main]       568.1311 (1.02)     568.1311 (1.02)     568.1311 (1.02)     0.0000 (1.0)      568.1311 (1.02)     0.0000 (1.0)           0;0  1.7602 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     383.7382 (1.0)      383.7382 (1.0)      383.7382 (1.0)      0.0000 (1.0)      383.7382 (1.0)      0.0000 (1.0)           0;0  2.6059 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     391.7774 (1.02)     391.7774 (1.02)     391.7774 (1.02)     0.0000 (1.0)      391.7774 (1.02)     0.0000 (1.0)           0;0  2.5525 (0.98)          1           1
test_checkout_copy-checkout-noop[main]       397.1531 (1.03)     397.1531 (1.03)     397.1531 (1.03)     0.0000 (1.0)      397.1531 (1.03)     0.0000 (1.0)           0;0  2.5179 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     436.0911 (1.02)     436.0911 (1.02)     436.0911 (1.02)     0.0000 (1.0)      436.0911 (1.02)     0.0000 (1.0)           0;0  2.2931 (0.98)          1           1
test_checkout_copy-checkout-update[3.10.0]     429.2144 (1.0)      429.2144 (1.0)      429.2144 (1.0)      0.0000 (1.0)      429.2144 (1.0)      0.0000 (1.0)           0;0  2.3298 (1.0)           1           1
test_checkout_copy-checkout-update[main]       442.5020 (1.03)     442.5020 (1.03)     442.5020 (1.03)     0.0000 (1.0)      442.5020 (1.03)     0.0000 (1.0)           0;0  2.2599 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     545.3436 (1.0)      545.3436 (1.0)      545.3436 (1.0)      0.0000 (1.0)      545.3436 (1.0)      0.0000 (1.0)           0;0  1.8337 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     560.8513 (1.03)     560.8513 (1.03)     560.8513 (1.03)     0.0000 (1.0)      560.8513 (1.03)     0.0000 (1.0)           0;0  1.7830 (0.97)          1           1
test_checkout_hardlink-checkout[main]       582.6702 (1.07)     582.6702 (1.07)     582.6702 (1.07)     0.0000 (1.0)      582.6702 (1.07)     0.0000 (1.0)           0;0  1.7162 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     405.9900 (1.0)      405.9900 (1.0)      405.9900 (1.0)      0.0000 (1.0)      405.9900 (1.0)      0.0000 (1.0)           0;0  2.4631 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     409.8498 (1.01)     409.8498 (1.01)     409.8498 (1.01)     0.0000 (1.0)      409.8498 (1.01)     0.0000 (1.0)           0;0  2.4399 (0.99)          1           1
test_checkout_hardlink-checkout-noop[main]       431.2205 (1.06)     431.2205 (1.06)     431.2205 (1.06)     0.0000 (1.0)      431.2205 (1.06)     0.0000 (1.0)           0;0  2.3190 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     442.5173 (1.0)      442.5173 (1.0)      442.5173 (1.0)      0.0000 (1.0)      442.5173 (1.0)      0.0000 (1.0)           0;0  2.2598 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     455.3978 (1.03)     455.3978 (1.03)     455.3978 (1.03)     0.0000 (1.0)      455.3978 (1.03)     0.0000 (1.0)           0;0  2.1959 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       456.5612 (1.03)     456.5612 (1.03)     456.5612 (1.03)     0.0000 (1.0)      456.5612 (1.03)     0.0000 (1.0)           0;0  2.1903 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     519.1435 (1.0)      519.1435 (1.0)      519.1435 (1.0)      0.0000 (1.0)      519.1435 (1.0)      0.0000 (1.0)           0;0  1.9262 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     531.2921 (1.02)     531.2921 (1.02)     531.2921 (1.02)     0.0000 (1.0)      531.2921 (1.02)     0.0000 (1.0)           0;0  1.8822 (0.98)          1           1
test_checkout_symlink-checkout[main]       562.6834 (1.08)     562.6834 (1.08)     562.6834 (1.08)     0.0000 (1.0)      562.6834 (1.08)     0.0000 (1.0)           0;0  1.7772 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     384.8042 (1.0)      384.8042 (1.0)      384.8042 (1.0)      0.0000 (1.0)      384.8042 (1.0)      0.0000 (1.0)           0;0  2.5987 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     397.3411 (1.03)     397.3411 (1.03)     397.3411 (1.03)     0.0000 (1.0)      397.3411 (1.03)     0.0000 (1.0)           0;0  2.5167 (0.97)          1           1
test_checkout_symlink-checkout-noop[main]       397.5977 (1.03)     397.5977 (1.03)     397.5977 (1.03)     0.0000 (1.0)      397.5977 (1.03)     0.0000 (1.0)           0;0  2.5151 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     426.0323 (1.01)     426.0323 (1.01)     426.0323 (1.01)     0.0000 (1.0)      426.0323 (1.01)     0.0000 (1.0)           0;0  2.3472 (0.99)          1           1
test_checkout_symlink-checkout-update[3.10.0]     423.8724 (1.0)      423.8724 (1.0)      423.8724 (1.0)      0.0000 (1.0)      423.8724 (1.0)      0.0000 (1.0)           0;0  2.3592 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       431.2786 (1.02)     431.2786 (1.02)     431.2786 (1.02)     0.0000 (1.0)      431.2786 (1.02)     0.0000 (1.0)           0;0  2.3187 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     455.5149 (1.07)     455.5149 (1.07)     455.5149 (1.07)     0.0000 (1.0)      455.5149 (1.07)     0.0000 (1.0)           0;0  2.1953 (0.93)          1           1
test_data_status-data-changed[3.10.0]     433.1510 (1.02)     433.1510 (1.02)     433.1510 (1.02)     0.0000 (1.0)      433.1510 (1.02)     0.0000 (1.0)           0;0  2.3087 (0.98)          1           1
test_data_status-data-changed[main]       425.1663 (1.0)      425.1663 (1.0)      425.1663 (1.0)      0.0000 (1.0)      425.1663 (1.0)      0.0000 (1.0)           0;0  2.3520 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     457.3481 (1.08)     457.3481 (1.08)     457.3481 (1.08)     0.0000 (1.0)      457.3481 (1.08)     0.0000 (1.0)           0;0  2.1865 (0.92)          1           1
test_data_status-data-changed-noop[3.10.0]     448.2319 (1.06)     448.2319 (1.06)     448.2319 (1.06)     0.0000 (1.0)      448.2319 (1.06)     0.0000 (1.0)           0;0  2.2310 (0.94)          1           1
test_data_status-data-changed-noop[main]       422.6364 (1.0)      422.6364 (1.0)      422.6364 (1.0)      0.0000 (1.0)      422.6364 (1.0)      0.0000 (1.0)           0;0  2.3661 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     513.7296 (1.08)     513.7296 (1.08)     513.7296 (1.08)     0.0000 (1.0)      513.7296 (1.08)     0.0000 (1.0)           0;0  1.9465 (0.92)          1           1
test_data_status-data-new[3.10.0]     481.4938 (1.02)     481.4938 (1.02)     481.4938 (1.02)     0.0000 (1.0)      481.4938 (1.02)     0.0000 (1.0)           0;0  2.0769 (0.98)          1           1
test_data_status-data-new[main]       473.9213 (1.0)      473.9213 (1.0)      473.9213 (1.0)      0.0000 (1.0)      473.9213 (1.0)      0.0000 (1.0)           0;0  2.1101 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     461.1876 (1.08)     461.1876 (1.08)     461.1876 (1.08)     0.0000 (1.0)      461.1876 (1.08)     0.0000 (1.0)           0;0  2.1683 (0.93)          1           1
test_data_status-data-noop[3.10.0]     429.8218 (1.01)     429.8218 (1.01)     429.8218 (1.01)     0.0000 (1.0)      429.8218 (1.01)     0.0000 (1.0)           0;0  2.3265 (0.99)          1           1
test_data_status-data-noop[main]       427.5031 (1.0)      427.5031 (1.0)      427.5031 (1.0)      0.0000 (1.0)      427.5031 (1.0)      0.0000 (1.0)           0;0  2.3392 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     460.9240 (1.05)     460.9240 (1.05)     460.9240 (1.05)     0.0000 (1.0)      460.9240 (1.05)     0.0000 (1.0)           0;0  2.1696 (0.96)          1           1
test_data_status_all_flags-data-changed[3.10.0]     441.0382 (1.0)      441.0382 (1.0)      441.0382 (1.0)      0.0000 (1.0)      441.0382 (1.0)      0.0000 (1.0)           0;0  2.2674 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       449.3522 (1.02)     449.3522 (1.02)     449.3522 (1.02)     0.0000 (1.0)      449.3522 (1.02)     0.0000 (1.0)           0;0  2.2254 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     465.1995 (1.06)     465.1995 (1.06)     465.1995 (1.06)     0.0000 (1.0)      465.1995 (1.06)     0.0000 (1.0)           0;0  2.1496 (0.95)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     440.4995 (1.0)      440.4995 (1.0)      440.4995 (1.0)      0.0000 (1.0)      440.4995 (1.0)      0.0000 (1.0)           0;0  2.2702 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       446.8373 (1.01)     446.8373 (1.01)     446.8373 (1.01)     0.0000 (1.0)      446.8373 (1.01)     0.0000 (1.0)           0;0  2.2380 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     524.0735 (1.05)     524.0735 (1.05)     524.0735 (1.05)     0.0000 (1.0)      524.0735 (1.05)     0.0000 (1.0)           0;0  1.9081 (0.96)          1           1
test_data_status_all_flags-data-new[3.10.0]     500.5922 (1.0)      500.5922 (1.0)      500.5922 (1.0)      0.0000 (1.0)      500.5922 (1.0)      0.0000 (1.0)           0;0  1.9976 (1.0)           1           1
test_data_status_all_flags-data-new[main]       508.5725 (1.02)     508.5725 (1.02)     508.5725 (1.02)     0.0000 (1.0)      508.5725 (1.02)     0.0000 (1.0)           0;0  1.9663 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     465.7823 (1.06)     465.7823 (1.06)     465.7823 (1.06)     0.0000 (1.0)      465.7823 (1.06)     0.0000 (1.0)           0;0  2.1469 (0.94)          1           1
test_data_status_all_flags-data-noop[3.10.0]     439.5701 (1.0)      439.5701 (1.0)      439.5701 (1.0)      0.0000 (1.0)      439.5701 (1.0)      0.0000 (1.0)           0;0  2.2749 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       445.3690 (1.01)     445.3690 (1.01)     445.3690 (1.01)     0.0000 (1.0)      445.3690 (1.01)     0.0000 (1.0)           0;0  2.2453 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     508.5953 (1.0)      508.5953 (1.0)      508.5953 (1.0)      0.0000 (1.0)      508.5953 (1.0)      0.0000 (1.0)           0;0  1.9662 (1.0)           1           1
test_diff-diff[3.10.0]     534.0836 (1.05)     534.0836 (1.05)     534.0836 (1.05)     0.0000 (1.0)      534.0836 (1.05)     0.0000 (1.0)           0;0  1.8724 (0.95)          1           1
test_diff-diff[main]       517.1801 (1.02)     517.1801 (1.02)     517.1801 (1.02)     0.0000 (1.0)      517.1801 (1.02)     0.0000 (1.0)           0;0  1.9336 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     475.3783 (1.0)      475.3783 (1.0)      475.3783 (1.0)      0.0000 (1.0)      475.3783 (1.0)      0.0000 (1.0)           0;0  2.1036 (1.0)           1           1
test_diff-diff-changed[3.10.0]     478.2431 (1.01)     478.2431 (1.01)     478.2431 (1.01)     0.0000 (1.0)      478.2431 (1.01)     0.0000 (1.0)           0;0  2.0910 (0.99)          1           1
test_diff-diff-changed[main]       487.5212 (1.03)     487.5212 (1.03)     487.5212 (1.03)     0.0000 (1.0)      487.5212 (1.03)     0.0000 (1.0)           0;0  2.0512 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     459.3835 (1.0)      459.3835 (1.0)      459.3835 (1.0)      0.0000 (1.0)      459.3835 (1.0)      0.0000 (1.0)           0;0  2.1768 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     477.0841 (1.04)     477.0841 (1.04)     477.0841 (1.04)     0.0000 (1.0)      477.0841 (1.04)     0.0000 (1.0)           0;0  2.0961 (0.96)          1           1
test_diff-diff-changed-noop[main]       472.9174 (1.03)     472.9174 (1.03)     472.9174 (1.03)     0.0000 (1.0)      472.9174 (1.03)     0.0000 (1.0)           0;0  2.1145 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     459.5475 (1.0)      459.5475 (1.0)      459.5475 (1.0)      0.0000 (1.0)      459.5475 (1.0)      0.0000 (1.0)           0;0  2.1761 (1.0)           1           1
test_diff-diff-noop[3.10.0]     485.5505 (1.06)     485.5505 (1.06)     485.5505 (1.06)     0.0000 (1.0)      485.5505 (1.06)     0.0000 (1.0)           0;0  2.0595 (0.95)          1           1
test_diff-diff-noop[main]       468.9921 (1.02)     468.9921 (1.02)     468.9921 (1.02)     0.0000 (1.0)      468.9921 (1.02)     0.0000 (1.0)           0;0  2.1322 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       843.3955 (1.0)        843.3955 (1.0)        843.3955 (1.0)      0.0000 (1.0)        843.3955 (1.0)      0.0000 (1.0)           0;0  1.1857 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,917.3167 (5.83)     4,917.3167 (5.83)     4,917.3167 (5.83)     0.0000 (1.0)      4,917.3167 (5.83)     0.0000 (1.0)           0;0  0.2034 (0.17)          1           1
test_exp_show-exp[main]       4,013.2341 (4.76)     4,013.2341 (4.76)     4,013.2341 (4.76)     0.0000 (1.0)      4,013.2341 (4.76)     0.0000 (1.0)           0;0  0.2492 (0.21)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     486.2652 (1.0)      486.2652 (1.0)      486.2652 (1.0)      0.0000 (1.0)      486.2652 (1.0)      0.0000 (1.0)           0;0  2.0565 (1.0)           1           1
test_fetch-fetch[3.10.0]     506.9916 (1.04)     506.9916 (1.04)     506.9916 (1.04)     0.0000 (1.0)      506.9916 (1.04)     0.0000 (1.0)           0;0  1.9724 (0.96)          1           1
test_fetch-fetch[main]       494.7616 (1.02)     494.7616 (1.02)     494.7616 (1.02)     0.0000 (1.0)      494.7616 (1.02)     0.0000 (1.0)           0;0  2.0212 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     368.6621 (1.00)     368.6621 (1.00)     368.6621 (1.00)     0.0000 (1.0)      368.6621 (1.00)     0.0000 (1.0)           0;0  2.7125 (1.00)          1           1
test_gc-gc[3.10.0]     388.4130 (1.06)     388.4130 (1.06)     388.4130 (1.06)     0.0000 (1.0)      388.4130 (1.06)     0.0000 (1.0)           0;0  2.5746 (0.95)          1           1
test_gc-gc[main]       367.2365 (1.0)      367.2365 (1.0)      367.2365 (1.0)      0.0000 (1.0)      367.2365 (1.0)      0.0000 (1.0)           0;0  2.7230 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     478.9076 (1.0)      478.9076 (1.0)      478.9076 (1.0)      0.0000 (1.0)      478.9076 (1.0)      0.0000 (1.0)           0;0  2.0881 (1.0)           1           1
test_get-get[3.10.0]     479.0867 (1.00)     479.0867 (1.00)     479.0867 (1.00)     0.0000 (1.0)      479.0867 (1.00)     0.0000 (1.0)           0;0  2.0873 (1.00)          1           1
test_get-get[main]       512.4462 (1.07)     512.4462 (1.07)     512.4462 (1.07)     0.0000 (1.0)      512.4462 (1.07)     0.0000 (1.0)           0;0  1.9514 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     330.4480 (1.0)      330.4480 (1.0)      330.4480 (1.0)      0.0000 (1.0)      330.4480 (1.0)      0.0000 (1.0)           0;0  3.0262 (1.0)           1           1
test_get_url-get-url[3.10.0]     349.9379 (1.06)     349.9379 (1.06)     349.9379 (1.06)     0.0000 (1.0)      349.9379 (1.06)     0.0000 (1.0)           0;0  2.8576 (0.94)          1           1
test_get_url-get-url[main]       350.2793 (1.06)     350.2793 (1.06)     350.2793 (1.06)     0.0000 (1.0)      350.2793 (1.06)     0.0000 (1.0)           0;0  2.8549 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     130.0713 (1.02)     139.0723 (1.01)     133.0423 (1.02)     1.6786 (1.0)      132.9368 (1.02)     2.1651 (1.05)         31;3  7.5164 (0.98)        100           1
test_help---help[3.10.0]     128.1613 (1.00)     148.0540 (1.07)     130.9706 (1.0)      2.6354 (1.57)     130.5680 (1.00)     2.0637 (1.0)           8;4  7.6353 (1.0)         100           1
test_help---help[main]       127.8706 (1.0)      137.8995 (1.0)      130.9952 (1.00)     1.9587 (1.17)     130.5408 (1.0)      2.1080 (1.02)         26;4  7.6339 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     679.1848 (1.01)     679.1848 (1.01)     679.1848 (1.01)     0.0000 (1.0)      679.1848 (1.01)     0.0000 (1.0)           0;0  1.4724 (0.99)          1           1
test_import-import[3.10.0]     670.9862 (1.0)      670.9862 (1.0)      670.9862 (1.0)      0.0000 (1.0)      670.9862 (1.0)      0.0000 (1.0)           0;0  1.4903 (1.0)           1           1
test_import-import[main]       717.3731 (1.07)     717.3731 (1.07)     717.3731 (1.07)     0.0000 (1.0)      717.3731 (1.07)     0.0000 (1.0)           0;0  1.3940 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     628.7905 (1.02)     628.7905 (1.02)     628.7905 (1.02)     0.0000 (1.0)      628.7905 (1.02)     0.0000 (1.0)           0;0  1.5904 (0.98)          1           1
test_import_url-import-url[3.10.0]     636.6687 (1.04)     636.6687 (1.04)     636.6687 (1.04)     0.0000 (1.0)      636.6687 (1.04)     0.0000 (1.0)           0;0  1.5707 (0.97)          1           1
test_import_url-import-url[main]       614.8073 (1.0)      614.8073 (1.0)      614.8073 (1.0)      0.0000 (1.0)      614.8073 (1.0)      0.0000 (1.0)           0;0  1.6265 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     360.0363 (1.0)      375.6663 (1.0)      365.3850 (1.0)      2.5572 (1.0)      365.0418 (1.0)      3.4624 (1.0)          30;1  2.7368 (1.0)         100           1
test_init-init[3.10.0]     365.4510 (1.02)     411.0534 (1.09)     372.9877 (1.02)     5.2042 (2.04)     371.9869 (1.02)     3.8400 (1.11)          7;3  2.6811 (0.98)        100           1
test_init-init[main]       376.0672 (1.04)     426.0622 (1.13)     383.1083 (1.05)     5.8670 (2.29)     382.1923 (1.05)     3.6158 (1.04)          7;5  2.6102 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     422.3212 (1.0)      422.3212 (1.0)      422.3212 (1.0)      0.0000 (1.0)      422.3212 (1.0)      0.0000 (1.0)           0;0  2.3679 (1.0)           1           1
test_list-list[3.10.0]     453.1747 (1.07)     453.1747 (1.07)     453.1747 (1.07)     0.0000 (1.0)      453.1747 (1.07)     0.0000 (1.0)           0;0  2.2067 (0.93)          1           1
test_list-list[main]       427.0814 (1.01)     427.0814 (1.01)     427.0814 (1.01)     0.0000 (1.0)      427.0814 (1.01)     0.0000 (1.0)           0;0  2.3415 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     408.9032 (1.0)      408.9032 (1.0)      408.9032 (1.0)      0.0000 (1.0)      408.9032 (1.0)      0.0000 (1.0)           0;0  2.4456 (1.0)           1           1
test_list-list-dvc-only[3.10.0]     442.7056 (1.08)     442.7056 (1.08)     442.7056 (1.08)     0.0000 (1.0)      442.7056 (1.08)     0.0000 (1.0)           0;0  2.2588 (0.92)          1           1
test_list-list-dvc-only[main]       452.4692 (1.11)     452.4692 (1.11)     452.4692 (1.11)     0.0000 (1.0)      452.4692 (1.11)     0.0000 (1.0)           0;0  2.2101 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     420.2693 (1.0)      420.2693 (1.0)      420.2693 (1.0)      0.0000 (1.0)      420.2693 (1.0)      0.0000 (1.0)           0;0  2.3794 (1.0)           1           1
test_list-list-recursive[3.10.0]     459.5151 (1.09)     459.5151 (1.09)     459.5151 (1.09)     0.0000 (1.0)      459.5151 (1.09)     0.0000 (1.0)           0;0  2.1762 (0.91)          1           1
test_list-list-recursive[main]       434.7682 (1.03)     434.7682 (1.03)     434.7682 (1.03)     0.0000 (1.0)      434.7682 (1.03)     0.0000 (1.0)           0;0  2.3001 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     402.0808 (1.0)      402.0808 (1.0)      402.0808 (1.0)      0.0000 (1.0)      402.0808 (1.0)      0.0000 (1.0)           0;0  2.4871 (1.0)           1           1
test_list-list-shallow[3.10.0]     431.6798 (1.07)     431.6798 (1.07)     431.6798 (1.07)     0.0000 (1.0)      431.6798 (1.07)     0.0000 (1.0)           0;0  2.3165 (0.93)          1           1
test_list-list-shallow[main]       419.6688 (1.04)     419.6688 (1.04)     419.6688 (1.04)     0.0000 (1.0)      419.6688 (1.04)     0.0000 (1.0)           0;0  2.3828 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     529.8443 (1.01)     529.8443 (1.01)     529.8443 (1.01)     0.0000 (1.0)      529.8443 (1.01)     0.0000 (1.0)           0;0  1.8873 (0.99)          1           1
test_partial_add-add[3.10.0]     534.0434 (1.02)     534.0434 (1.02)     534.0434 (1.02)     0.0000 (1.0)      534.0434 (1.02)     0.0000 (1.0)           0;0  1.8725 (0.98)          1           1
test_partial_add-add[main]       522.7717 (1.0)      522.7717 (1.0)      522.7717 (1.0)      0.0000 (1.0)      522.7717 (1.0)      0.0000 (1.0)           0;0  1.9129 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     562.0366 (1.00)     562.0366 (1.00)     562.0366 (1.00)     0.0000 (1.0)      562.0366 (1.00)     0.0000 (1.0)           0;0  1.7792 (1.00)          1           1
test_partial_add-add-partial[3.10.0]     570.3865 (1.02)     570.3865 (1.02)     570.3865 (1.02)     0.0000 (1.0)      570.3865 (1.02)     0.0000 (1.0)           0;0  1.7532 (0.98)          1           1
test_partial_add-add-partial[main]       561.1060 (1.0)      561.1060 (1.0)      561.1060 (1.0)      0.0000 (1.0)      561.1060 (1.0)      0.0000 (1.0)           0;0  1.7822 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     379.0692 (1.00)     379.0692 (1.00)     379.0692 (1.00)     0.0000 (1.0)      379.0692 (1.00)     0.0000 (1.0)           0;0  2.6380 (1.00)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     377.5926 (1.0)      377.5926 (1.0)      377.5926 (1.0)      0.0000 (1.0)      377.5926 (1.0)      0.0000 (1.0)           0;0  2.6484 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       390.5374 (1.03)     390.5374 (1.03)     390.5374 (1.03)     0.0000 (1.0)      390.5374 (1.03)     0.0000 (1.0)           0;0  2.5606 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     365.8275 (1.0)      365.8275 (1.0)      365.8275 (1.0)      0.0000 (1.0)      365.8275 (1.0)      0.0000 (1.0)           0;0  2.7335 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     372.7105 (1.02)     372.7105 (1.02)     372.7105 (1.02)     0.0000 (1.0)      372.7105 (1.02)     0.0000 (1.0)           0;0  2.6830 (0.98)          1           1
test_partial_add-gc-noop[main]       369.9838 (1.01)     369.9838 (1.01)     369.9838 (1.01)     0.0000 (1.0)      369.9838 (1.01)     0.0000 (1.0)           0;0  2.7028 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     404.7770 (1.01)     404.7770 (1.01)     404.7770 (1.01)     0.0000 (1.0)      404.7770 (1.01)     0.0000 (1.0)           0;0  2.4705 (0.99)          1           1
test_partial_add-push[3.10.0]     400.6386 (1.0)      400.6386 (1.0)      400.6386 (1.0)      0.0000 (1.0)      400.6386 (1.0)      0.0000 (1.0)           0;0  2.4960 (1.0)           1           1
test_partial_add-push[main]       424.4120 (1.06)     424.4120 (1.06)     424.4120 (1.06)     0.0000 (1.0)      424.4120 (1.06)     0.0000 (1.0)           0;0  2.3562 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     410.2872 (1.02)     410.2872 (1.02)     410.2872 (1.02)     0.0000 (1.0)      410.2872 (1.02)     0.0000 (1.0)           0;0  2.4373 (0.98)          1           1
test_partial_add-push-partial[3.10.0]     401.2549 (1.0)      401.2549 (1.0)      401.2549 (1.0)      0.0000 (1.0)      401.2549 (1.0)      0.0000 (1.0)           0;0  2.4922 (1.0)           1           1
test_partial_add-push-partial[main]       439.1880 (1.09)     439.1880 (1.09)     439.1880 (1.09)     0.0000 (1.0)      439.1880 (1.09)     0.0000 (1.0)           0;0  2.2769 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     607.5198 (1.02)     607.5198 (1.02)     607.5198 (1.02)     0.0000 (1.0)      607.5198 (1.02)     0.0000 (1.0)           0;0  1.6460 (0.98)          1           1
test_partial_remove-add[3.10.0]     663.3696 (1.11)     663.3696 (1.11)     663.3696 (1.11)     0.0000 (1.0)      663.3696 (1.11)     0.0000 (1.0)           0;0  1.5075 (0.90)          1           1
test_partial_remove-add[main]       595.8692 (1.0)      595.8692 (1.0)      595.8692 (1.0)      0.0000 (1.0)      595.8692 (1.0)      0.0000 (1.0)           0;0  1.6782 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     532.9084 (1.0)      532.9084 (1.0)      532.9084 (1.0)      0.0000 (1.0)      532.9084 (1.0)      0.0000 (1.0)           0;0  1.8765 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     559.6102 (1.05)     559.6102 (1.05)     559.6102 (1.05)     0.0000 (1.0)      559.6102 (1.05)     0.0000 (1.0)           0;0  1.7870 (0.95)          1           1
test_partial_remove-add-update[main]       543.2778 (1.02)     543.2778 (1.02)     543.2778 (1.02)     0.0000 (1.0)      543.2778 (1.02)     0.0000 (1.0)           0;0  1.8407 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     398.9873 (1.04)     398.9873 (1.04)     398.9873 (1.04)     0.0000 (1.0)      398.9873 (1.04)     0.0000 (1.0)           0;0  2.5063 (0.96)          1           1
test_partial_remove-gc[3.10.0]     403.2337 (1.05)     403.2337 (1.05)     403.2337 (1.05)     0.0000 (1.0)      403.2337 (1.05)     0.0000 (1.0)           0;0  2.4800 (0.95)          1           1
test_partial_remove-gc[main]       383.2716 (1.0)      383.2716 (1.0)      383.2716 (1.0)      0.0000 (1.0)      383.2716 (1.0)      0.0000 (1.0)           0;0  2.6091 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     399.5282 (1.03)     399.5282 (1.03)     399.5282 (1.03)     0.0000 (1.0)      399.5282 (1.03)     0.0000 (1.0)           0;0  2.5030 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     389.7393 (1.0)      389.7393 (1.0)      389.7393 (1.0)      0.0000 (1.0)      389.7393 (1.0)      0.0000 (1.0)           0;0  2.5658 (1.0)           1           1
test_partial_remove-gc-cloud[main]       399.3692 (1.02)     399.3692 (1.02)     399.3692 (1.02)     0.0000 (1.0)      399.3692 (1.02)     0.0000 (1.0)           0;0  2.5039 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     442.0170 (1.04)     442.0170 (1.04)     442.0170 (1.04)     0.0000 (1.0)      442.0170 (1.04)     0.0000 (1.0)           0;0  2.2624 (0.96)          1           1
test_partial_remove-push[3.10.0]     425.5554 (1.0)      425.5554 (1.0)      425.5554 (1.0)      0.0000 (1.0)      425.5554 (1.0)      0.0000 (1.0)           0;0  2.3499 (1.0)           1           1
test_partial_remove-push[main]       477.3694 (1.12)     477.3694 (1.12)     477.3694 (1.12)     0.0000 (1.0)      477.3694 (1.12)     0.0000 (1.0)           0;0  2.0948 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     407.6438 (1.03)     407.6438 (1.03)     407.6438 (1.03)     0.0000 (1.0)      407.6438 (1.03)     0.0000 (1.0)           0;0  2.4531 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     395.7755 (1.0)      395.7755 (1.0)      395.7755 (1.0)      0.0000 (1.0)      395.7755 (1.0)      0.0000 (1.0)           0;0  2.5267 (1.0)           1           1
test_partial_remove-push-update[main]       436.2875 (1.10)     436.2875 (1.10)     436.2875 (1.10)     0.0000 (1.0)      436.2875 (1.10)     0.0000 (1.0)           0;0  2.2921 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     411.0451 (1.0)      417.1957 (1.0)      413.7736 (1.0)      2.4420 (4.21)     413.1222 (1.0)      3.7301 (4.71)          2;0  2.4168 (1.0)           5           3
test_plots-plots-diff[3.10.0]     763.0617 (1.86)     764.5908 (1.83)     763.7474 (1.85)     0.5807 (1.0)      763.6145 (1.85)     0.7925 (1.0)           2;0  1.3093 (0.54)          5           3
test_plots-plots-diff[main]       730.6903 (1.78)     736.7512 (1.77)     733.8698 (1.77)     2.3777 (4.09)     734.4610 (1.78)     3.5855 (4.52)          2;0  1.3626 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       425.2514 (1.0)        428.6478 (1.0)        426.4641 (1.0)      1.3510 (1.0)        426.0266 (1.0)      1.7540 (1.07)          1;0  2.3449 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,017.0097 (2.39)     1,021.0651 (2.38)     1,019.4897 (2.39)     1.5243 (1.13)     1,019.9542 (2.39)     1.6402 (1.0)           2;0  0.9809 (0.42)          5           3
test_plots-plots-diff-json[main]         809.7628 (1.90)       815.2473 (1.90)       811.8225 (1.90)     2.1675 (1.60)       811.4444 (1.90)     2.9408 (1.79)          1;0  1.2318 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     380.5037 (1.0)      384.1845 (1.0)      382.0544 (1.0)      1.5513 (1.22)     382.3905 (1.0)      2.4761 (1.24)          1;0  2.6174 (1.0)           5           3
test_plots-plots-show[3.10.0]     629.1260 (1.65)     632.2120 (1.65)     630.7697 (1.65)     1.2749 (1.0)      631.3422 (1.65)     1.9913 (1.0)           2;0  1.5854 (0.61)          5           3
test_plots-plots-show[main]       622.9818 (1.64)     626.1982 (1.63)     624.7133 (1.64)     1.4930 (1.17)     624.7877 (1.63)     2.8425 (1.43)          1;0  1.6007 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     396.4162 (1.0)      406.5537 (1.0)      399.3456 (1.0)      4.1924 (1.45)     397.6526 (1.0)      4.5347 (1.33)          1;0  2.5041 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     775.9334 (1.96)     783.2261 (1.93)     779.9520 (1.95)     2.8961 (1.0)      779.5093 (1.96)     4.3734 (1.29)          2;0  1.2821 (0.51)          5           3
test_plots-plots-show-json[main]       670.8979 (1.69)     678.7761 (1.67)     673.9262 (1.69)     2.9973 (1.03)     672.8623 (1.69)     3.4022 (1.0)           2;0  1.4838 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     484.1504 (1.03)     484.1504 (1.03)     484.1504 (1.03)     0.0000 (1.0)      484.1504 (1.03)     0.0000 (1.0)           0;0  2.0655 (0.97)          1           1
test_push-push[3.10.0]     468.2211 (1.0)      468.2211 (1.0)      468.2211 (1.0)      0.0000 (1.0)      468.2211 (1.0)      0.0000 (1.0)           0;0  2.1357 (1.0)           1           1
test_push-push[main]       483.2424 (1.03)     483.2424 (1.03)     483.2424 (1.03)     0.0000 (1.0)      483.2424 (1.03)     0.0000 (1.0)           0;0  2.0694 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     608.1319 (1.0)      608.1319 (1.0)      608.1319 (1.0)      0.0000 (1.0)      608.1319 (1.0)      0.0000 (1.0)           0;0  1.6444 (1.0)           1           1
test_sharing-add[3.10.0]     614.0853 (1.01)     614.0853 (1.01)     614.0853 (1.01)     0.0000 (1.0)      614.0853 (1.01)     0.0000 (1.0)           0;0  1.6284 (0.99)          1           1
test_sharing-add[main]       615.8435 (1.01)     615.8435 (1.01)     615.8435 (1.01)     0.0000 (1.0)      615.8435 (1.01)     0.0000 (1.0)           0;0  1.6238 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     550.5761 (1.0)      550.5761 (1.0)      550.5761 (1.0)      0.0000 (1.0)      550.5761 (1.0)      0.0000 (1.0)           0;0  1.8163 (1.0)           1           1
test_sharing-add-noop[3.10.0]     602.5059 (1.09)     602.5059 (1.09)     602.5059 (1.09)     0.0000 (1.0)      602.5059 (1.09)     0.0000 (1.0)           0;0  1.6597 (0.91)          1           1
test_sharing-add-noop[main]       556.8412 (1.01)     556.8412 (1.01)     556.8412 (1.01)     0.0000 (1.0)      556.8412 (1.01)     0.0000 (1.0)           0;0  1.7958 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     493.7961 (1.09)     493.7961 (1.09)     493.7961 (1.09)     0.0000 (1.0)      493.7961 (1.09)     0.0000 (1.0)           0;0  2.0251 (0.92)          1           1
test_sharing-checkout[3.10.0]     505.5624 (1.12)     505.5624 (1.12)     505.5624 (1.12)     0.0000 (1.0)      505.5624 (1.12)     0.0000 (1.0)           0;0  1.9780 (0.90)          1           1
test_sharing-checkout[main]       453.0809 (1.0)      453.0809 (1.0)      453.0809 (1.0)      0.0000 (1.0)      453.0809 (1.0)      0.0000 (1.0)           0;0  2.2071 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     379.6954 (1.0)      379.6954 (1.0)      379.6954 (1.0)      0.0000 (1.0)      379.6954 (1.0)      0.0000 (1.0)           0;0  2.6337 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     414.1809 (1.09)     414.1809 (1.09)     414.1809 (1.09)     0.0000 (1.0)      414.1809 (1.09)     0.0000 (1.0)           0;0  2.4144 (0.92)          1           1
test_sharing-checkout-noop[main]       395.6154 (1.04)     395.6154 (1.04)     395.6154 (1.04)     0.0000 (1.0)      395.6154 (1.04)     0.0000 (1.0)           0;0  2.5277 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     504.2214 (1.09)     504.2214 (1.09)     504.2214 (1.09)     0.0000 (1.0)      504.2214 (1.09)     0.0000 (1.0)           0;0  1.9833 (0.92)          1           1
test_sharing-fetch[3.10.0]     489.4345 (1.06)     489.4345 (1.06)     489.4345 (1.06)     0.0000 (1.0)      489.4345 (1.06)     0.0000 (1.0)           0;0  2.0432 (0.94)          1           1
test_sharing-fetch[main]       461.9219 (1.0)      461.9219 (1.0)      461.9219 (1.0)      0.0000 (1.0)      461.9219 (1.0)      0.0000 (1.0)           0;0  2.1649 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     437.5237 (1.04)     437.5237 (1.04)     437.5237 (1.04)     0.0000 (1.0)      437.5237 (1.04)     0.0000 (1.0)           0;0  2.2856 (0.96)          1           1
test_sharing-fetch-noop[3.10.0]     420.8444 (1.0)      420.8444 (1.0)      420.8444 (1.0)      0.0000 (1.0)      420.8444 (1.0)      0.0000 (1.0)           0;0  2.3762 (1.0)           1           1
test_sharing-fetch-noop[main]       431.8130 (1.03)     431.8130 (1.03)     431.8130 (1.03)     0.0000 (1.0)      431.8130 (1.03)     0.0000 (1.0)           0;0  2.3158 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     470.3997 (1.06)     470.3997 (1.06)     470.3997 (1.06)     0.0000 (1.0)      470.3997 (1.06)     0.0000 (1.0)           0;0  2.1259 (0.95)          1           1
test_sharing-push[3.10.0]     445.2074 (1.0)      445.2074 (1.0)      445.2074 (1.0)      0.0000 (1.0)      445.2074 (1.0)      0.0000 (1.0)           0;0  2.2461 (1.0)           1           1
test_sharing-push[main]       483.8447 (1.09)     483.8447 (1.09)     483.8447 (1.09)     0.0000 (1.0)      483.8447 (1.09)     0.0000 (1.0)           0;0  2.0668 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     443.9424 (1.11)     443.9424 (1.11)     443.9424 (1.11)     0.0000 (1.0)      443.9424 (1.11)     0.0000 (1.0)           0;0  2.2525 (0.90)          1           1
test_sharing-push-noop[3.10.0]     399.7139 (1.0)      399.7139 (1.0)      399.7139 (1.0)      0.0000 (1.0)      399.7139 (1.0)      0.0000 (1.0)           0;0  2.5018 (1.0)           1           1
test_sharing-push-noop[main]       440.1155 (1.10)     440.1155 (1.10)     440.1155 (1.10)     0.0000 (1.0)      440.1155 (1.10)     0.0000 (1.0)           0;0  2.2721 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     421.7595 (1.01)     421.7595 (1.01)     421.7595 (1.01)     0.0000 (1.0)      421.7595 (1.01)     0.0000 (1.0)           0;0  2.3710 (0.99)          1           1
test_status-status[3.10.0]     423.5412 (1.01)     423.5412 (1.01)     423.5412 (1.01)     0.0000 (1.0)      423.5412 (1.01)     0.0000 (1.0)           0;0  2.3610 (0.99)          1           1
test_status-status[main]       418.3712 (1.0)      418.3712 (1.0)      418.3712 (1.0)      0.0000 (1.0)      418.3712 (1.0)      0.0000 (1.0)           0;0  2.3902 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     379.7822 (1.00)     379.7822 (1.00)     379.7822 (1.00)     0.0000 (1.0)      379.7822 (1.00)     0.0000 (1.0)           0;0  2.6331 (1.00)          1           1
test_status-status-changed[3.10.0]     379.6968 (1.0)      379.6968 (1.0)      379.6968 (1.0)      0.0000 (1.0)      379.6968 (1.0)      0.0000 (1.0)           0;0  2.6337 (1.0)           1           1
test_status-status-changed[main]       385.2279 (1.01)     385.2279 (1.01)     385.2279 (1.01)     0.0000 (1.0)      385.2279 (1.01)     0.0000 (1.0)           0;0  2.5959 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     376.9112 (1.0)      376.9112 (1.0)      376.9112 (1.0)      0.0000 (1.0)      376.9112 (1.0)      0.0000 (1.0)           0;0  2.6531 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     380.9164 (1.01)     380.9164 (1.01)     380.9164 (1.01)     0.0000 (1.0)      380.9164 (1.01)     0.0000 (1.0)           0;0  2.6252 (0.99)          1           1
test_status-status-changed-noop[main]       381.7414 (1.01)     381.7414 (1.01)     381.7414 (1.01)     0.0000 (1.0)      381.7414 (1.01)     0.0000 (1.0)           0;0  2.6196 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     377.8909 (1.0)      377.8909 (1.0)      377.8909 (1.0)      0.0000 (1.0)      377.8909 (1.0)      0.0000 (1.0)           0;0  2.6463 (1.0)           1           1
test_status-status-noop[3.10.0]     378.9384 (1.00)     378.9384 (1.00)     378.9384 (1.00)     0.0000 (1.0)      378.9384 (1.00)     0.0000 (1.0)           0;0  2.6390 (1.00)          1           1
test_status-status-noop[main]       383.1741 (1.01)     383.1741 (1.01)     383.1741 (1.01)     0.0000 (1.0)      383.1741 (1.01)     0.0000 (1.0)           0;0  2.6098 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     622.3200 (1.02)     622.3200 (1.02)     622.3200 (1.02)     0.0000 (1.0)      622.3200 (1.02)     0.0000 (1.0)           0;0  1.6069 (0.98)          1           1
test_update-import-url[3.10.0]     656.4390 (1.07)     656.4390 (1.07)     656.4390 (1.07)     0.0000 (1.0)      656.4390 (1.07)     0.0000 (1.0)           0;0  1.5234 (0.93)          1           1
test_update-import-url[main]       610.7978 (1.0)      610.7978 (1.0)      610.7978 (1.0)      0.0000 (1.0)      610.7978 (1.0)      0.0000 (1.0)           0;0  1.6372 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     515.8506 (1.03)     515.8506 (1.03)     515.8506 (1.03)     0.0000 (1.0)      515.8506 (1.03)     0.0000 (1.0)           0;0  1.9385 (0.97)          1           1
test_update-update[3.10.0]     556.5827 (1.11)     556.5827 (1.11)     556.5827 (1.11)     0.0000 (1.0)      556.5827 (1.11)     0.0000 (1.0)           0;0  1.7967 (0.90)          1           1
test_update-update[main]       499.8296 (1.0)      499.8296 (1.0)      499.8296 (1.0)      0.0000 (1.0)      499.8296 (1.0)      0.0000 (1.0)           0;0  2.0007 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     384.4050 (1.0)      384.4050 (1.0)      384.4050 (1.0)      0.0000 (1.0)      384.4050 (1.0)      0.0000 (1.0)           0;0  2.6014 (1.0)           1           1
test_update-update-noop[3.10.0]     401.9086 (1.05)     401.9086 (1.05)     401.9086 (1.05)     0.0000 (1.0)      401.9086 (1.05)     0.0000 (1.0)           0;0  2.4881 (0.96)          1           1
test_update-update-noop[main]       394.2807 (1.03)     394.2807 (1.03)     394.2807 (1.03)     0.0000 (1.0)      394.2807 (1.03)     0.0000 (1.0)           0;0  2.5363 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean