Sat Dec  9 14:29:48 UTC 2023
dataset: chest-xray-pneumonia
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     12.5383 (1.0)      12.5383 (1.0)      12.5383 (1.0)      0.0000 (1.0)      12.5383 (1.0)      0.0000 (1.0)           0;0  0.0798 (1.0)           1           1
test_add-add[3.10.0]     13.7602 (1.10)     13.7602 (1.10)     13.7602 (1.10)     0.0000 (1.0)      13.7602 (1.10)     0.0000 (1.0)           0;0  0.0727 (0.91)          1           1
test_add-add[main]       13.0558 (1.04)     13.0558 (1.04)     13.0558 (1.04)     0.0000 (1.0)      13.0558 (1.04)     0.0000 (1.0)           0;0  0.0766 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     7.0602 (1.37)     7.0602 (1.37)     7.0602 (1.37)     0.0000 (1.0)      7.0602 (1.37)     0.0000 (1.0)           0;0  0.1416 (0.73)          1           1
test_checkout_copy-checkout[3.10.0]     9.6797 (1.88)     9.6797 (1.88)     9.6797 (1.88)     0.0000 (1.0)      9.6797 (1.88)     0.0000 (1.0)           0;0  0.1033 (0.53)          1           1
test_checkout_copy-checkout[main]       5.1448 (1.0)      5.1448 (1.0)      5.1448 (1.0)      0.0000 (1.0)      5.1448 (1.0)      0.0000 (1.0)           0;0  0.1944 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     867.7368 (1.0)      867.7368 (1.0)      867.7368 (1.0)      0.0000 (1.0)      867.7368 (1.0)      0.0000 (1.0)           0;0  1.1524 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     915.4616 (1.05)     915.4616 (1.05)     915.4616 (1.05)     0.0000 (1.0)      915.4616 (1.05)     0.0000 (1.0)           0;0  1.0923 (0.95)          1           1
test_checkout_copy-checkout-noop[main]       904.0350 (1.04)     904.0350 (1.04)     904.0350 (1.04)     0.0000 (1.0)      904.0350 (1.04)     0.0000 (1.0)           0;0  1.1062 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     1.2110 (1.20)     1.2110 (1.20)     1.2110 (1.20)     0.0000 (1.0)      1.2110 (1.20)     0.0000 (1.0)           0;0  0.8258 (0.84)          1           1
test_checkout_copy-checkout-update[3.10.0]     1.0188 (1.01)     1.0188 (1.01)     1.0188 (1.01)     0.0000 (1.0)      1.0188 (1.01)     0.0000 (1.0)           0;0  0.9815 (0.99)          1           1
test_checkout_copy-checkout-update[main]       1.0128 (1.0)      1.0128 (1.0)      1.0128 (1.0)      0.0000 (1.0)      1.0128 (1.0)      0.0000 (1.0)           0;0  0.9873 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     4.2286 (1.73)     4.2286 (1.73)     4.2286 (1.73)     0.0000 (1.0)      4.2286 (1.73)     0.0000 (1.0)           0;0  0.2365 (0.58)          1           1
test_checkout_hardlink-checkout[3.10.0]     3.7517 (1.54)     3.7517 (1.54)     3.7517 (1.54)     0.0000 (1.0)      3.7517 (1.54)     0.0000 (1.0)           0;0  0.2665 (0.65)          1           1
test_checkout_hardlink-checkout[main]       2.4409 (1.0)      2.4409 (1.0)      2.4409 (1.0)      0.0000 (1.0)      2.4409 (1.0)      0.0000 (1.0)           0;0  0.4097 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     879.7290 (1.0)      879.7290 (1.0)      879.7290 (1.0)      0.0000 (1.0)      879.7290 (1.0)      0.0000 (1.0)           0;0  1.1367 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     954.4462 (1.08)     954.4462 (1.08)     954.4462 (1.08)     0.0000 (1.0)      954.4462 (1.08)     0.0000 (1.0)           0;0  1.0477 (0.92)          1           1
test_checkout_hardlink-checkout-noop[main]       906.8438 (1.03)     906.8438 (1.03)     906.8438 (1.03)     0.0000 (1.0)      906.8438 (1.03)     0.0000 (1.0)           0;0  1.1027 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     1.1936 (1.18)     1.1936 (1.18)     1.1936 (1.18)     0.0000 (1.0)      1.1936 (1.18)     0.0000 (1.0)           0;0  0.8378 (0.84)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     1.0261 (1.02)     1.0261 (1.02)     1.0261 (1.02)     0.0000 (1.0)      1.0261 (1.02)     0.0000 (1.0)           0;0  0.9746 (0.98)          1           1
test_checkout_hardlink-checkout-update[main]       1.0077 (1.0)      1.0077 (1.0)      1.0077 (1.0)      0.0000 (1.0)      1.0077 (1.0)      0.0000 (1.0)           0;0  0.9923 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     4.5375 (1.99)     4.5375 (1.99)     4.5375 (1.99)     0.0000 (1.0)      4.5375 (1.99)     0.0000 (1.0)           0;0  0.2204 (0.50)          1           1
test_checkout_symlink-checkout[3.10.0]     2.2856 (1.0)      2.2856 (1.0)      2.2856 (1.0)      0.0000 (1.0)      2.2856 (1.0)      0.0000 (1.0)           0;0  0.4375 (1.0)           1           1
test_checkout_symlink-checkout[main]       4.1498 (1.82)     4.1498 (1.82)     4.1498 (1.82)     0.0000 (1.0)      4.1498 (1.82)     0.0000 (1.0)           0;0  0.2410 (0.55)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                      Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]       970.7391 (1.0)        970.7391 (1.0)        970.7391 (1.0)      0.0000 (1.0)        970.7391 (1.0)      0.0000 (1.0)           0;0  1.0301 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     1,017.6976 (1.05)     1,017.6976 (1.05)     1,017.6976 (1.05)     0.0000 (1.0)      1,017.6976 (1.05)     0.0000 (1.0)           0;0  0.9826 (0.95)          1           1
test_checkout_symlink-checkout-noop[main]         984.9707 (1.01)       984.9707 (1.01)       984.9707 (1.01)     0.0000 (1.0)        984.9707 (1.01)     0.0000 (1.0)           0;0  1.0153 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     1.3918 (1.18)     1.3918 (1.18)     1.3918 (1.18)     0.0000 (1.0)      1.3918 (1.18)     0.0000 (1.0)           0;0  0.7185 (0.85)          1           1
test_checkout_symlink-checkout-update[3.10.0]     1.1850 (1.00)     1.1850 (1.00)     1.1850 (1.00)     0.0000 (1.0)      1.1850 (1.00)     0.0000 (1.0)           0;0  0.8439 (1.00)          1           1
test_checkout_symlink-checkout-update[main]       1.1815 (1.0)      1.1815 (1.0)      1.1815 (1.0)      0.0000 (1.0)      1.1815 (1.0)      0.0000 (1.0)           0;0  0.8464 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]       996.1537 (1.0)        996.1537 (1.0)        996.1537 (1.0)      0.0000 (1.0)        996.1537 (1.0)      0.0000 (1.0)           0;0  1.0039 (1.0)           1           1
test_data_status-data-changed[3.10.0]     1,099.1346 (1.10)     1,099.1346 (1.10)     1,099.1346 (1.10)     0.0000 (1.0)      1,099.1346 (1.10)     0.0000 (1.0)           0;0  0.9098 (0.91)          1           1
test_data_status-data-changed[main]       1,223.0597 (1.23)     1,223.0597 (1.23)     1,223.0597 (1.23)     0.0000 (1.0)      1,223.0597 (1.23)     0.0000 (1.0)           0;0  0.8176 (0.81)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                     Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]       836.4420 (1.01)       836.4420 (1.01)       836.4420 (1.01)     0.0000 (1.0)        836.4420 (1.01)     0.0000 (1.0)           0;0  1.1955 (0.99)          1           1
test_data_status-data-changed-noop[3.10.0]     1,065.4885 (1.28)     1,065.4885 (1.28)     1,065.4885 (1.28)     0.0000 (1.0)      1,065.4885 (1.28)     0.0000 (1.0)           0;0  0.9385 (0.78)          1           1
test_data_status-data-changed-noop[main]         831.3828 (1.0)        831.3828 (1.0)        831.3828 (1.0)      0.0000 (1.0)        831.3828 (1.0)      0.0000 (1.0)           0;0  1.2028 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     4.7596 (1.0)      4.7596 (1.0)      4.7596 (1.0)      0.0000 (1.0)      4.7596 (1.0)      0.0000 (1.0)           0;0  0.2101 (1.0)           1           1
test_data_status-data-new[3.10.0]     5.2339 (1.10)     5.2339 (1.10)     5.2339 (1.10)     0.0000 (1.0)      5.2339 (1.10)     0.0000 (1.0)           0;0  0.1911 (0.91)          1           1
test_data_status-data-new[main]       5.7634 (1.21)     5.7634 (1.21)     5.7634 (1.21)     0.0000 (1.0)      5.7634 (1.21)     0.0000 (1.0)           0;0  0.1735 (0.83)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     826.9602 (1.00)     826.9602 (1.00)     826.9602 (1.00)     0.0000 (1.0)      826.9602 (1.00)     0.0000 (1.0)           0;0  1.2092 (1.00)          1           1
test_data_status-data-noop[3.10.0]     824.2706 (1.0)      824.2706 (1.0)      824.2706 (1.0)      0.0000 (1.0)      824.2706 (1.0)      0.0000 (1.0)           0;0  1.2132 (1.0)           1           1
test_data_status-data-noop[main]       844.7694 (1.02)     844.7694 (1.02)     844.7694 (1.02)     0.0000 (1.0)      844.7694 (1.02)     0.0000 (1.0)           0;0  1.1838 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     1.9611 (1.0)      1.9611 (1.0)      1.9611 (1.0)      0.0000 (1.0)      1.9611 (1.0)      0.0000 (1.0)           0;0  0.5099 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     2.0287 (1.03)     2.0287 (1.03)     2.0287 (1.03)     0.0000 (1.0)      2.0287 (1.03)     0.0000 (1.0)           0;0  0.4929 (0.97)          1           1
test_data_status_all_flags-data-changed[main]       2.0625 (1.05)     2.0625 (1.05)     2.0625 (1.05)     0.0000 (1.0)      2.0625 (1.05)     0.0000 (1.0)           0;0  0.4849 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     1.9771 (1.0)      1.9771 (1.0)      1.9771 (1.0)      0.0000 (1.0)      1.9771 (1.0)      0.0000 (1.0)           0;0  0.5058 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     2.0352 (1.03)     2.0352 (1.03)     2.0352 (1.03)     0.0000 (1.0)      2.0352 (1.03)     0.0000 (1.0)           0;0  0.4914 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[main]       2.0799 (1.05)     2.0799 (1.05)     2.0799 (1.05)     0.0000 (1.0)      2.0799 (1.05)     0.0000 (1.0)           0;0  0.4808 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     5.9075 (1.0)      5.9075 (1.0)      5.9075 (1.0)      0.0000 (1.0)      5.9075 (1.0)      0.0000 (1.0)           0;0  0.1693 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     5.9928 (1.01)     5.9928 (1.01)     5.9928 (1.01)     0.0000 (1.0)      5.9928 (1.01)     0.0000 (1.0)           0;0  0.1669 (0.99)          1           1
test_data_status_all_flags-data-new[main]       7.0548 (1.19)     7.0548 (1.19)     7.0548 (1.19)     0.0000 (1.0)      7.0548 (1.19)     0.0000 (1.0)           0;0  0.1417 (0.84)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     2.1271 (1.0)      2.1271 (1.0)      2.1271 (1.0)      0.0000 (1.0)      2.1271 (1.0)      0.0000 (1.0)           0;0  0.4701 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     2.2694 (1.07)     2.2694 (1.07)     2.2694 (1.07)     0.0000 (1.0)      2.2694 (1.07)     0.0000 (1.0)           0;0  0.4406 (0.94)          1           1
test_data_status_all_flags-data-noop[main]       2.6959 (1.27)     2.6959 (1.27)     2.6959 (1.27)     0.0000 (1.0)      2.6959 (1.27)     0.0000 (1.0)           0;0  0.3709 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     4.1421 (1.0)      4.1421 (1.0)      4.1421 (1.0)      0.0000 (1.0)      4.1421 (1.0)      0.0000 (1.0)           0;0  0.2414 (1.0)           1           1
test_diff-diff[3.10.0]     4.7878 (1.16)     4.7878 (1.16)     4.7878 (1.16)     0.0000 (1.0)      4.7878 (1.16)     0.0000 (1.0)           0;0  0.2089 (0.87)          1           1
test_diff-diff[main]       4.6712 (1.13)     4.6712 (1.13)     4.6712 (1.13)     0.0000 (1.0)      4.6712 (1.13)     0.0000 (1.0)           0;0  0.2141 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     2.5327 (2.57)     2.5327 (2.57)     2.5327 (2.57)     0.0000 (1.0)      2.5327 (2.57)     0.0000 (1.0)           0;0  0.3948 (0.39)          1           1
test_diff-diff-changed[3.10.0]     1.0388 (1.05)     1.0388 (1.05)     1.0388 (1.05)     0.0000 (1.0)      1.0388 (1.05)     0.0000 (1.0)           0;0  0.9627 (0.95)          1           1
test_diff-diff-changed[main]       0.9857 (1.0)      0.9857 (1.0)      0.9857 (1.0)      0.0000 (1.0)      0.9857 (1.0)      0.0000 (1.0)           0;0  1.0145 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     917.2865 (1.0)      917.2865 (1.0)      917.2865 (1.0)      0.0000 (1.0)      917.2865 (1.0)      0.0000 (1.0)           0;0  1.0902 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     952.0874 (1.04)     952.0874 (1.04)     952.0874 (1.04)     0.0000 (1.0)      952.0874 (1.04)     0.0000 (1.0)           0;0  1.0503 (0.96)          1           1
test_diff-diff-changed-noop[main]       963.3705 (1.05)     963.3705 (1.05)     963.3705 (1.05)     0.0000 (1.0)      963.3705 (1.05)     0.0000 (1.0)           0;0  1.0380 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     779.7702 (1.0)      779.7702 (1.0)      779.7702 (1.0)      0.0000 (1.0)      779.7702 (1.0)      0.0000 (1.0)           0;0  1.2824 (1.0)           1           1
test_diff-diff-noop[3.10.0]     841.3796 (1.08)     841.3796 (1.08)     841.3796 (1.08)     0.0000 (1.0)      841.3796 (1.08)     0.0000 (1.0)           0;0  1.1885 (0.93)          1           1
test_diff-diff-noop[main]       934.7490 (1.20)     934.7490 (1.20)     934.7490 (1.20)     0.0000 (1.0)      934.7490 (1.20)     0.0000 (1.0)           0;0  1.0698 (0.83)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       854.4152 (1.0)        854.4152 (1.0)        854.4152 (1.0)      0.0000 (1.0)        854.4152 (1.0)      0.0000 (1.0)           0;0  1.1704 (1.0)           1           1
test_exp_show-exp[3.10.0]     6,118.7367 (7.16)     6,118.7367 (7.16)     6,118.7367 (7.16)     0.0000 (1.0)      6,118.7367 (7.16)     0.0000 (1.0)           0;0  0.1634 (0.14)          1           1
test_exp_show-exp[main]       5,596.6946 (6.55)     5,596.6946 (6.55)     5,596.6946 (6.55)     0.0000 (1.0)      5,596.6946 (6.55)     0.0000 (1.0)           0;0  0.1787 (0.15)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]      9.7593 (1.89)      9.7593 (1.89)      9.7593 (1.89)     0.0000 (1.0)       9.7593 (1.89)     0.0000 (1.0)           0;0  0.1025 (0.53)          1           1
test_fetch-fetch[3.10.0]     12.5071 (2.42)     12.5071 (2.42)     12.5071 (2.42)     0.0000 (1.0)      12.5071 (2.42)     0.0000 (1.0)           0;0  0.0800 (0.41)          1           1
test_fetch-fetch[main]        5.1587 (1.0)       5.1587 (1.0)       5.1587 (1.0)      0.0000 (1.0)       5.1587 (1.0)      0.0000 (1.0)           0;0  0.1938 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     860.9507 (1.0)      860.9507 (1.0)      860.9507 (1.0)      0.0000 (1.0)      860.9507 (1.0)      0.0000 (1.0)           0;0  1.1615 (1.0)           1           1
test_gc-gc[3.10.0]     864.7340 (1.00)     864.7340 (1.00)     864.7340 (1.00)     0.0000 (1.0)      864.7340 (1.00)     0.0000 (1.0)           0;0  1.1564 (1.00)          1           1
test_gc-gc[main]       961.1783 (1.12)     961.1783 (1.12)     961.1783 (1.12)     0.0000 (1.0)      961.1783 (1.12)     0.0000 (1.0)           0;0  1.0404 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     15.6115 (1.11)     15.6115 (1.11)     15.6115 (1.11)     0.0000 (1.0)      15.6115 (1.11)     0.0000 (1.0)           0;0  0.0641 (0.90)          1           1
test_get-get[3.10.0]     18.2874 (1.30)     18.2874 (1.30)     18.2874 (1.30)     0.0000 (1.0)      18.2874 (1.30)     0.0000 (1.0)           0;0  0.0547 (0.77)          1           1
test_get-get[main]       14.0585 (1.0)      14.0585 (1.0)      14.0585 (1.0)      0.0000 (1.0)      14.0585 (1.0)      0.0000 (1.0)           0;0  0.0711 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     7.9045 (2.64)     7.9045 (2.64)     7.9045 (2.64)     0.0000 (1.0)      7.9045 (2.64)     0.0000 (1.0)           0;0  0.1265 (0.38)          1           1
test_get_url-get-url[3.10.0]     8.1979 (2.74)     8.1979 (2.74)     8.1979 (2.74)     0.0000 (1.0)      8.1979 (2.74)     0.0000 (1.0)           0;0  0.1220 (0.37)          1           1
test_get_url-get-url[main]       2.9972 (1.0)      2.9972 (1.0)      2.9972 (1.0)      0.0000 (1.0)      2.9972 (1.0)      0.0000 (1.0)           0;0  0.3336 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     120.4473 (1.03)     128.9967 (1.01)     125.7358 (1.02)     1.1363 (1.0)      125.8173 (1.02)     0.7078 (1.0)         16;14  7.9532 (0.98)        100           1
test_help---help[3.10.0]     116.9887 (1.0)      127.2140 (1.0)      123.3763 (1.0)      1.4889 (1.31)     123.6956 (1.0)      1.0423 (1.47)        21;13  8.1053 (1.0)         100           1
test_help---help[main]       118.0985 (1.01)     130.0846 (1.02)     124.1616 (1.01)     1.6519 (1.45)     124.2486 (1.00)     0.9622 (1.36)        13;12  8.0540 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     27.7646 (1.0)      27.7646 (1.0)      27.7646 (1.0)      0.0000 (1.0)      27.7646 (1.0)      0.0000 (1.0)           0;0  0.0360 (1.0)           1           1
test_import-import[3.10.0]     30.8196 (1.11)     30.8196 (1.11)     30.8196 (1.11)     0.0000 (1.0)      30.8196 (1.11)     0.0000 (1.0)           0;0  0.0324 (0.90)          1           1
test_import-import[main]       28.3599 (1.02)     28.3599 (1.02)     28.3599 (1.02)     0.0000 (1.0)      28.3599 (1.02)     0.0000 (1.0)           0;0  0.0353 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     25.3458 (1.16)     25.3458 (1.16)     25.3458 (1.16)     0.0000 (1.0)      25.3458 (1.16)     0.0000 (1.0)           0;0  0.0395 (0.86)          1           1
test_import_url-import-url[3.10.0]     25.9670 (1.19)     25.9670 (1.19)     25.9670 (1.19)     0.0000 (1.0)      25.9670 (1.19)     0.0000 (1.0)           0;0  0.0385 (0.84)          1           1
test_import_url-import-url[main]       21.8810 (1.0)      21.8810 (1.0)      21.8810 (1.0)      0.0000 (1.0)      21.8810 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     360.4108 (1.0)      446.1810 (1.06)     378.3937 (1.0)      11.2354 (2.01)     375.1941 (1.0)      15.1866 (2.50)         18;1  2.6427 (1.0)         100           1
test_init-init[3.10.0]     382.7645 (1.06)     422.6086 (1.0)      392.2258 (1.04)      5.5959 (1.0)      392.1665 (1.05)      7.2717 (1.20)         28;1  2.5496 (0.96)        100           1
test_init-init[main]       397.6888 (1.10)     439.7528 (1.04)     408.7245 (1.08)      6.7309 (1.20)     407.8701 (1.09)      6.0828 (1.0)          23;4  2.4466 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     452.9256 (1.0)      452.9256 (1.0)      452.9256 (1.0)      0.0000 (1.0)      452.9256 (1.0)      0.0000 (1.0)           0;0  2.2079 (1.0)           1           1
test_list-list[3.10.0]     460.3104 (1.02)     460.3104 (1.02)     460.3104 (1.02)     0.0000 (1.0)      460.3104 (1.02)     0.0000 (1.0)           0;0  2.1724 (0.98)          1           1
test_list-list[main]       480.5124 (1.06)     480.5124 (1.06)     480.5124 (1.06)     0.0000 (1.0)      480.5124 (1.06)     0.0000 (1.0)           0;0  2.0811 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     446.5017 (1.01)     446.5017 (1.01)     446.5017 (1.01)     0.0000 (1.0)      446.5017 (1.01)     0.0000 (1.0)           0;0  2.2396 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     441.8208 (1.0)      441.8208 (1.0)      441.8208 (1.0)      0.0000 (1.0)      441.8208 (1.0)      0.0000 (1.0)           0;0  2.2634 (1.0)           1           1
test_list-list-dvc-only[main]       458.9392 (1.04)     458.9392 (1.04)     458.9392 (1.04)     0.0000 (1.0)      458.9392 (1.04)     0.0000 (1.0)           0;0  2.1789 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     721.7136 (1.0)      721.7136 (1.0)      721.7136 (1.0)      0.0000 (1.0)      721.7136 (1.0)      0.0000 (1.0)           0;0  1.3856 (1.0)           1           1
test_list-list-recursive[3.10.0]     732.5956 (1.02)     732.5956 (1.02)     732.5956 (1.02)     0.0000 (1.0)      732.5956 (1.02)     0.0000 (1.0)           0;0  1.3650 (0.99)          1           1
test_list-list-recursive[main]       734.7979 (1.02)     734.7979 (1.02)     734.7979 (1.02)     0.0000 (1.0)      734.7979 (1.02)     0.0000 (1.0)           0;0  1.3609 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     591.8166 (1.36)     591.8166 (1.36)     591.8166 (1.36)     0.0000 (1.0)      591.8166 (1.36)     0.0000 (1.0)           0;0  1.6897 (0.74)          1           1
test_list-list-shallow[3.10.0]     435.3970 (1.0)      435.3970 (1.0)      435.3970 (1.0)      0.0000 (1.0)      435.3970 (1.0)      0.0000 (1.0)           0;0  2.2968 (1.0)           1           1
test_list-list-shallow[main]       445.7643 (1.02)     445.7643 (1.02)     445.7643 (1.02)     0.0000 (1.0)      445.7643 (1.02)     0.0000 (1.0)           0;0  2.2433 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     12.1656 (1.08)     12.1656 (1.08)     12.1656 (1.08)     0.0000 (1.0)      12.1656 (1.08)     0.0000 (1.0)           0;0  0.0822 (0.93)          1           1
test_partial_add-add[3.10.0]     11.2533 (1.0)      11.2533 (1.0)      11.2533 (1.0)      0.0000 (1.0)      11.2533 (1.0)      0.0000 (1.0)           0;0  0.0889 (1.0)           1           1
test_partial_add-add[main]       11.4718 (1.02)     11.4718 (1.02)     11.4718 (1.02)     0.0000 (1.0)      11.4718 (1.02)     0.0000 (1.0)           0;0  0.0872 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     9.0518 (1.21)     9.0518 (1.21)     9.0518 (1.21)     0.0000 (1.0)      9.0518 (1.21)     0.0000 (1.0)           0;0  0.1105 (0.83)          1           1
test_partial_add-add-partial[3.10.0]     7.5095 (1.0)      7.5095 (1.0)      7.5095 (1.0)      0.0000 (1.0)      7.5095 (1.0)      0.0000 (1.0)           0;0  0.1332 (1.0)           1           1
test_partial_add-add-partial[main]       8.4283 (1.12)     8.4283 (1.12)     8.4283 (1.12)     0.0000 (1.0)      8.4283 (1.12)     0.0000 (1.0)           0;0  0.1186 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                 Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]       838.3614 (1.0)        838.3614 (1.0)        838.3614 (1.0)      0.0000 (1.0)        838.3614 (1.0)      0.0000 (1.0)           0;0  1.1928 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     1,015.3699 (1.21)     1,015.3699 (1.21)     1,015.3699 (1.21)     0.0000 (1.0)      1,015.3699 (1.21)     0.0000 (1.0)           0;0  0.9849 (0.83)          1           1
test_partial_add-gc-cloud-noop[main]       1,110.0731 (1.32)     1,110.0731 (1.32)     1,110.0731 (1.32)     0.0000 (1.0)      1,110.0731 (1.32)     0.0000 (1.0)           0;0  0.9008 (0.76)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     650.4936 (1.0)      650.4936 (1.0)      650.4936 (1.0)      0.0000 (1.0)      650.4936 (1.0)      0.0000 (1.0)           0;0  1.5373 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     834.4942 (1.28)     834.4942 (1.28)     834.4942 (1.28)     0.0000 (1.0)      834.4942 (1.28)     0.0000 (1.0)           0;0  1.1983 (0.78)          1           1
test_partial_add-gc-noop[main]       815.6863 (1.25)     815.6863 (1.25)     815.6863 (1.25)     0.0000 (1.0)      815.6863 (1.25)     0.0000 (1.0)           0;0  1.2260 (0.80)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     7.7829 (1.97)     7.7829 (1.97)     7.7829 (1.97)     0.0000 (1.0)      7.7829 (1.97)     0.0000 (1.0)           0;0  0.1285 (0.51)          1           1
test_partial_add-push[3.10.0]     4.9186 (1.24)     4.9186 (1.24)     4.9186 (1.24)     0.0000 (1.0)      4.9186 (1.24)     0.0000 (1.0)           0;0  0.2033 (0.80)          1           1
test_partial_add-push[main]       3.9568 (1.0)      3.9568 (1.0)      3.9568 (1.0)      0.0000 (1.0)      3.9568 (1.0)      0.0000 (1.0)           0;0  0.2527 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     1.5970 (1.40)     1.5970 (1.40)     1.5970 (1.40)     0.0000 (1.0)      1.5970 (1.40)     0.0000 (1.0)           0;0  0.6262 (0.72)          1           1
test_partial_add-push-partial[3.10.0]     1.1425 (1.0)      1.1425 (1.0)      1.1425 (1.0)      0.0000 (1.0)      1.1425 (1.0)      0.0000 (1.0)           0;0  0.8753 (1.0)           1           1
test_partial_add-push-partial[main]       1.6173 (1.42)     1.6173 (1.42)     1.6173 (1.42)     0.0000 (1.0)      1.6173 (1.42)     0.0000 (1.0)           0;0  0.6183 (0.71)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     12.3982 (1.0)      12.3982 (1.0)      12.3982 (1.0)      0.0000 (1.0)      12.3982 (1.0)      0.0000 (1.0)           0;0  0.0807 (1.0)           1           1
test_partial_remove-add[3.10.0]     13.5155 (1.09)     13.5155 (1.09)     13.5155 (1.09)     0.0000 (1.0)      13.5155 (1.09)     0.0000 (1.0)           0;0  0.0740 (0.92)          1           1
test_partial_remove-add[main]       13.6387 (1.10)     13.6387 (1.10)     13.6387 (1.10)     0.0000 (1.0)      13.6387 (1.10)     0.0000 (1.0)           0;0  0.0733 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     7.2669 (1.04)     7.2669 (1.04)     7.2669 (1.04)     0.0000 (1.0)      7.2669 (1.04)     0.0000 (1.0)           0;0  0.1376 (0.96)          1           1
test_partial_remove-add-update[3.10.0]     6.9890 (1.0)      6.9890 (1.0)      6.9890 (1.0)      0.0000 (1.0)      6.9890 (1.0)      0.0000 (1.0)           0;0  0.1431 (1.0)           1           1
test_partial_remove-add-update[main]       8.3399 (1.19)     8.3399 (1.19)     8.3399 (1.19)     0.0000 (1.0)      8.3399 (1.19)     0.0000 (1.0)           0;0  0.1199 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     655.7943 (1.0)      655.7943 (1.0)      655.7943 (1.0)      0.0000 (1.0)      655.7943 (1.0)      0.0000 (1.0)           0;0  1.5249 (1.0)           1           1
test_partial_remove-gc[3.10.0]     826.5212 (1.26)     826.5212 (1.26)     826.5212 (1.26)     0.0000 (1.0)      826.5212 (1.26)     0.0000 (1.0)           0;0  1.2099 (0.79)          1           1
test_partial_remove-gc[main]       826.9884 (1.26)     826.9884 (1.26)     826.9884 (1.26)     0.0000 (1.0)      826.9884 (1.26)     0.0000 (1.0)           0;0  1.2092 (0.79)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                               Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]       871.2168 (1.0)        871.2168 (1.0)        871.2168 (1.0)      0.0000 (1.0)        871.2168 (1.0)      0.0000 (1.0)           0;0  1.1478 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     1,011.0692 (1.16)     1,011.0692 (1.16)     1,011.0692 (1.16)     0.0000 (1.0)      1,011.0692 (1.16)     0.0000 (1.0)           0;0  0.9891 (0.86)          1           1
test_partial_remove-gc-cloud[main]       1,132.3619 (1.30)     1,132.3619 (1.30)     1,132.3619 (1.30)     0.0000 (1.0)      1,132.3619 (1.30)     0.0000 (1.0)           0;0  0.8831 (0.77)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     8.7208 (2.03)     8.7208 (2.03)     8.7208 (2.03)     0.0000 (1.0)      8.7208 (2.03)     0.0000 (1.0)           0;0  0.1147 (0.49)          1           1
test_partial_remove-push[3.10.0]     5.3620 (1.25)     5.3620 (1.25)     5.3620 (1.25)     0.0000 (1.0)      5.3620 (1.25)     0.0000 (1.0)           0;0  0.1865 (0.80)          1           1
test_partial_remove-push[main]       4.2971 (1.0)      4.2971 (1.0)      4.2971 (1.0)      0.0000 (1.0)      4.2971 (1.0)      0.0000 (1.0)           0;0  0.2327 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                  Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]       758.2888 (1.03)       758.2888 (1.03)       758.2888 (1.03)     0.0000 (1.0)        758.2888 (1.03)     0.0000 (1.0)           0;0  1.3188 (0.97)          1           1
test_partial_remove-push-update[3.10.0]       736.9150 (1.0)        736.9150 (1.0)        736.9150 (1.0)      0.0000 (1.0)        736.9150 (1.0)      0.0000 (1.0)           0;0  1.3570 (1.0)           1           1
test_partial_remove-push-update[main]       1,333.4480 (1.81)     1,333.4480 (1.81)     1,333.4480 (1.81)     0.0000 (1.0)      1,333.4480 (1.81)     0.0000 (1.0)           0;0  0.7499 (0.55)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     432.9965 (1.0)      446.2243 (1.0)      440.6543 (1.0)      5.4631 (1.0)      443.3385 (1.0)      8.3191 (1.05)          2;0  2.2694 (1.0)           5           3
test_plots-plots-diff[3.10.0]     802.4139 (1.85)     817.4033 (1.83)     809.4069 (1.84)     5.8126 (1.06)     810.2425 (1.83)     8.4801 (1.07)          2;0  1.2355 (0.54)          5           3
test_plots-plots-diff[main]       769.5790 (1.78)     785.4927 (1.76)     779.5893 (1.77)     6.2321 (1.14)     780.1779 (1.76)     7.9130 (1.0)           1;0  1.2827 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       451.4282 (1.0)        463.1913 (1.0)        459.2106 (1.0)      4.9883 (1.20)       461.7644 (1.0)      7.1595 (1.92)          1;0  2.1777 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,062.6510 (2.35)     1,075.7162 (2.32)     1,070.0258 (2.33)     5.3037 (1.27)     1,069.4425 (2.32)     8.3349 (2.24)          2;0  0.9346 (0.43)          5           3
test_plots-plots-diff-json[main]         853.3950 (1.89)       864.5409 (1.87)       860.3874 (1.87)     4.1736 (1.0)        861.5415 (1.87)     3.7223 (1.0)           1;0  1.1623 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     414.5973 (1.0)      422.9057 (1.0)      419.4052 (1.0)       3.8150 (1.0)      421.0367 (1.0)       6.8361 (1.0)           1;0  2.3843 (1.0)           5           3
test_plots-plots-show[3.10.0]     668.7419 (1.61)     687.1100 (1.62)     676.8859 (1.61)      6.7627 (1.77)     675.2891 (1.60)      7.8463 (1.15)          2;0  1.4774 (0.62)          5           3
test_plots-plots-show[main]       678.2811 (1.64)     704.8044 (1.67)     691.0255 (1.65)     10.5053 (2.75)     691.9944 (1.64)     16.4796 (2.41)          2;0  1.4471 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     422.5075 (1.0)      435.9608 (1.0)      429.6474 (1.0)      5.0678 (1.81)     428.8231 (1.0)       6.6923 (1.69)          2;0  2.3275 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     818.9545 (1.94)     841.0249 (1.93)     831.0819 (1.93)     9.4338 (3.37)     834.1392 (1.95)     16.1412 (4.07)          2;0  1.2033 (0.52)          5           3
test_plots-plots-show-json[main]       726.4999 (1.72)     733.7077 (1.68)     729.5710 (1.70)     2.7983 (1.0)      729.6235 (1.70)      3.9626 (1.0)           2;0  1.3707 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     9.3722 (1.88)     9.3722 (1.88)     9.3722 (1.88)     0.0000 (1.0)      9.3722 (1.88)     0.0000 (1.0)           0;0  0.1067 (0.53)          1           1
test_push-push[3.10.0]     5.2457 (1.05)     5.2457 (1.05)     5.2457 (1.05)     0.0000 (1.0)      5.2457 (1.05)     0.0000 (1.0)           0;0  0.1906 (0.95)          1           1
test_push-push[main]       4.9982 (1.0)      4.9982 (1.0)      4.9982 (1.0)      0.0000 (1.0)      4.9982 (1.0)      0.0000 (1.0)           0;0  0.2001 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     12.5308 (1.0)      12.5308 (1.0)      12.5308 (1.0)      0.0000 (1.0)      12.5308 (1.0)      0.0000 (1.0)           0;0  0.0798 (1.0)           1           1
test_sharing-add[3.10.0]     13.8419 (1.10)     13.8419 (1.10)     13.8419 (1.10)     0.0000 (1.0)      13.8419 (1.10)     0.0000 (1.0)           0;0  0.0722 (0.91)          1           1
test_sharing-add[main]       12.7069 (1.01)     12.7069 (1.01)     12.7069 (1.01)     0.0000 (1.0)      12.7069 (1.01)     0.0000 (1.0)           0;0  0.0787 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     7.1287 (1.09)     7.1287 (1.09)     7.1287 (1.09)     0.0000 (1.0)      7.1287 (1.09)     0.0000 (1.0)           0;0  0.1403 (0.92)          1           1
test_sharing-add-noop[3.10.0]     6.6523 (1.01)     6.6523 (1.01)     6.6523 (1.01)     0.0000 (1.0)      6.6523 (1.01)     0.0000 (1.0)           0;0  0.1503 (0.99)          1           1
test_sharing-add-noop[main]       6.5645 (1.0)      6.5645 (1.0)      6.5645 (1.0)      0.0000 (1.0)      6.5645 (1.0)      0.0000 (1.0)           0;0  0.1523 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     5.0157 (1.20)     5.0157 (1.20)     5.0157 (1.20)     0.0000 (1.0)      5.0157 (1.20)     0.0000 (1.0)           0;0  0.1994 (0.83)          1           1
test_sharing-checkout[3.10.0]     9.4296 (2.25)     9.4296 (2.25)     9.4296 (2.25)     0.0000 (1.0)      9.4296 (2.25)     0.0000 (1.0)           0;0  0.1060 (0.44)          1           1
test_sharing-checkout[main]       4.1844 (1.0)      4.1844 (1.0)      4.1844 (1.0)      0.0000 (1.0)      4.1844 (1.0)      0.0000 (1.0)           0;0  0.2390 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     856.1582 (1.0)      856.1582 (1.0)      856.1582 (1.0)      0.0000 (1.0)      856.1582 (1.0)      0.0000 (1.0)           0;0  1.1680 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     903.2595 (1.06)     903.2595 (1.06)     903.2595 (1.06)     0.0000 (1.0)      903.2595 (1.06)     0.0000 (1.0)           0;0  1.1071 (0.95)          1           1
test_sharing-checkout-noop[main]       882.9444 (1.03)     882.9444 (1.03)     882.9444 (1.03)     0.0000 (1.0)      882.9444 (1.03)     0.0000 (1.0)           0;0  1.1326 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]      9.7494 (1.93)      9.7494 (1.93)      9.7494 (1.93)     0.0000 (1.0)       9.7494 (1.93)     0.0000 (1.0)           0;0  0.1026 (0.52)          1           1
test_sharing-fetch[3.10.0]     10.8517 (2.14)     10.8517 (2.14)     10.8517 (2.14)     0.0000 (1.0)      10.8517 (2.14)     0.0000 (1.0)           0;0  0.0922 (0.47)          1           1
test_sharing-fetch[main]        5.0619 (1.0)       5.0619 (1.0)       5.0619 (1.0)      0.0000 (1.0)       5.0619 (1.0)      0.0000 (1.0)           0;0  0.1976 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]       463.7849 (1.0)        463.7849 (1.0)        463.7849 (1.0)      0.0000 (1.0)        463.7849 (1.0)      0.0000 (1.0)           0;0  2.1562 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]       664.9353 (1.43)       664.9353 (1.43)       664.9353 (1.43)     0.0000 (1.0)        664.9353 (1.43)     0.0000 (1.0)           0;0  1.5039 (0.70)          1           1
test_sharing-fetch-noop[main]       1,064.7360 (2.30)     1,064.7360 (2.30)     1,064.7360 (2.30)     0.0000 (1.0)      1,064.7360 (2.30)     0.0000 (1.0)           0;0  0.9392 (0.44)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     8.5419 (2.08)     8.5419 (2.08)     8.5419 (2.08)     0.0000 (1.0)      8.5419 (2.08)     0.0000 (1.0)           0;0  0.1171 (0.48)          1           1
test_sharing-push[3.10.0]     4.6511 (1.13)     4.6511 (1.13)     4.6511 (1.13)     0.0000 (1.0)      4.6511 (1.13)     0.0000 (1.0)           0;0  0.2150 (0.88)          1           1
test_sharing-push[main]       4.1100 (1.0)      4.1100 (1.0)      4.1100 (1.0)      0.0000 (1.0)      4.1100 (1.0)      0.0000 (1.0)           0;0  0.2433 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]       530.1372 (1.0)        530.1372 (1.0)        530.1372 (1.0)      0.0000 (1.0)        530.1372 (1.0)      0.0000 (1.0)           0;0  1.8863 (1.0)           1           1
test_sharing-push-noop[3.10.0]       537.0191 (1.01)       537.0191 (1.01)       537.0191 (1.01)     0.0000 (1.0)        537.0191 (1.01)     0.0000 (1.0)           0;0  1.8621 (0.99)          1           1
test_sharing-push-noop[main]       1,124.6910 (2.12)     1,124.6910 (2.12)     1,124.6910 (2.12)     0.0000 (1.0)      1,124.6910 (2.12)     0.0000 (1.0)           0;0  0.8891 (0.47)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     12.3284 (1.0)      12.3284 (1.0)      12.3284 (1.0)      0.0000 (1.0)      12.3284 (1.0)      0.0000 (1.0)           0;0  0.0811 (1.0)           1           1
test_sharing_azure-add[3.10.0]     13.3438 (1.08)     13.3438 (1.08)     13.3438 (1.08)     0.0000 (1.0)      13.3438 (1.08)     0.0000 (1.0)           0;0  0.0749 (0.92)          1           1
test_sharing_azure-add[main]       13.0375 (1.06)     13.0375 (1.06)     13.0375 (1.06)     0.0000 (1.0)      13.0375 (1.06)     0.0000 (1.0)           0;0  0.0767 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     7.0154 (1.08)     7.0154 (1.08)     7.0154 (1.08)     0.0000 (1.0)      7.0154 (1.08)     0.0000 (1.0)           0;0  0.1425 (0.93)          1           1
test_sharing_azure-add-noop[3.10.0]     7.7449 (1.19)     7.7449 (1.19)     7.7449 (1.19)     0.0000 (1.0)      7.7449 (1.19)     0.0000 (1.0)           0;0  0.1291 (0.84)          1           1
test_sharing_azure-add-noop[main]       6.5129 (1.0)      6.5129 (1.0)      6.5129 (1.0)      0.0000 (1.0)      6.5129 (1.0)      0.0000 (1.0)           0;0  0.1535 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]     5.1606 (1.10)     5.1606 (1.10)     5.1606 (1.10)     0.0000 (1.0)      5.1606 (1.10)     0.0000 (1.0)           0;0  0.1938 (0.91)          1           1
test_sharing_azure-checkout[3.10.0]     9.0659 (1.94)     9.0659 (1.94)     9.0659 (1.94)     0.0000 (1.0)      9.0659 (1.94)     0.0000 (1.0)           0;0  0.1103 (0.52)          1           1
test_sharing_azure-checkout[main]       4.6837 (1.0)      4.6837 (1.0)      4.6837 (1.0)      0.0000 (1.0)      4.6837 (1.0)      0.0000 (1.0)           0;0  0.2135 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     859.5567 (1.0)      859.5567 (1.0)      859.5567 (1.0)      0.0000 (1.0)      859.5567 (1.0)      0.0000 (1.0)           0;0  1.1634 (1.0)           1           1
test_sharing_azure-checkout-noop[3.10.0]     904.0993 (1.05)     904.0993 (1.05)     904.0993 (1.05)     0.0000 (1.0)      904.0993 (1.05)     0.0000 (1.0)           0;0  1.1061 (0.95)          1           1
test_sharing_azure-checkout-noop[main]       906.7200 (1.05)     906.7200 (1.05)     906.7200 (1.05)     0.0000 (1.0)      906.7200 (1.05)     0.0000 (1.0)           0;0  1.1029 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]      9.7399 (1.91)      9.7399 (1.91)      9.7399 (1.91)     0.0000 (1.0)       9.7399 (1.91)     0.0000 (1.0)           0;0  0.1027 (0.52)          1           1
test_sharing_azure-fetch[3.10.0]     11.4017 (2.24)     11.4017 (2.24)     11.4017 (2.24)     0.0000 (1.0)      11.4017 (2.24)     0.0000 (1.0)           0;0  0.0877 (0.45)          1           1
test_sharing_azure-fetch[main]        5.0950 (1.0)       5.0950 (1.0)       5.0950 (1.0)      0.0000 (1.0)       5.0950 (1.0)      0.0000 (1.0)           0;0  0.1963 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]       462.0525 (1.0)        462.0525 (1.0)        462.0525 (1.0)      0.0000 (1.0)        462.0525 (1.0)      0.0000 (1.0)           0;0  2.1643 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]       660.3269 (1.43)       660.3269 (1.43)       660.3269 (1.43)     0.0000 (1.0)        660.3269 (1.43)     0.0000 (1.0)           0;0  1.5144 (0.70)          1           1
test_sharing_azure-fetch-noop[main]       1,090.6860 (2.36)     1,090.6860 (2.36)     1,090.6860 (2.36)     0.0000 (1.0)      1,090.6860 (2.36)     0.0000 (1.0)           0;0  0.9169 (0.42)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     8.5718 (1.75)     8.5718 (1.75)     8.5718 (1.75)     0.0000 (1.0)      8.5718 (1.75)     0.0000 (1.0)           0;0  0.1167 (0.57)          1           1
test_sharing_azure-push[3.10.0]     4.9102 (1.00)     4.9102 (1.00)     4.9102 (1.00)     0.0000 (1.0)      4.9102 (1.00)     0.0000 (1.0)           0;0  0.2037 (1.00)          1           1
test_sharing_azure-push[main]       4.8910 (1.0)      4.8910 (1.0)      4.8910 (1.0)      0.0000 (1.0)      4.8910 (1.0)      0.0000 (1.0)           0;0  0.2045 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                               Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]       529.6718 (1.0)        529.6718 (1.0)        529.6718 (1.0)      0.0000 (1.0)        529.6718 (1.0)      0.0000 (1.0)           0;0  1.8880 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]       547.7983 (1.03)       547.7983 (1.03)       547.7983 (1.03)     0.0000 (1.0)        547.7983 (1.03)     0.0000 (1.0)           0;0  1.8255 (0.97)          1           1
test_sharing_azure-push-noop[main]       1,158.9899 (2.19)     1,158.9899 (2.19)     1,158.9899 (2.19)     0.0000 (1.0)      1,158.9899 (2.19)     0.0000 (1.0)           0;0  0.8628 (0.46)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     13.7045 (1.07)     13.7045 (1.07)     13.7045 (1.07)     0.0000 (1.0)      13.7045 (1.07)     0.0000 (1.0)           0;0  0.0730 (0.94)          1           1
test_sharing_gs-add[3.10.0]     13.3125 (1.04)     13.3125 (1.04)     13.3125 (1.04)     0.0000 (1.0)      13.3125 (1.04)     0.0000 (1.0)           0;0  0.0751 (0.97)          1           1
test_sharing_gs-add[main]       12.8501 (1.0)      12.8501 (1.0)      12.8501 (1.0)      0.0000 (1.0)      12.8501 (1.0)      0.0000 (1.0)           0;0  0.0778 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     6.6653 (1.04)     6.6653 (1.04)     6.6653 (1.04)     0.0000 (1.0)      6.6653 (1.04)     0.0000 (1.0)           0;0  0.1500 (0.96)          1           1
test_sharing_gs-add-noop[3.10.0]     7.2661 (1.13)     7.2661 (1.13)     7.2661 (1.13)     0.0000 (1.0)      7.2661 (1.13)     0.0000 (1.0)           0;0  0.1376 (0.88)          1           1
test_sharing_gs-add-noop[main]       6.4245 (1.0)      6.4245 (1.0)      6.4245 (1.0)      0.0000 (1.0)      6.4245 (1.0)      0.0000 (1.0)           0;0  0.1557 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      5.1763 (1.15)      5.1763 (1.15)      5.1763 (1.15)     0.0000 (1.0)       5.1763 (1.15)     0.0000 (1.0)           0;0  0.1932 (0.87)          1           1
test_sharing_gs-checkout[3.10.0]     10.1571 (2.26)     10.1571 (2.26)     10.1571 (2.26)     0.0000 (1.0)      10.1571 (2.26)     0.0000 (1.0)           0;0  0.0985 (0.44)          1           1
test_sharing_gs-checkout[main]        4.4915 (1.0)       4.4915 (1.0)       4.4915 (1.0)      0.0000 (1.0)       4.4915 (1.0)      0.0000 (1.0)           0;0  0.2226 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     1.1080 (1.26)     1.1080 (1.26)     1.1080 (1.26)     0.0000 (1.0)      1.1080 (1.26)     0.0000 (1.0)           0;0  0.9025 (0.79)          1           1
test_sharing_gs-checkout-noop[3.10.0]     0.8971 (1.02)     0.8971 (1.02)     0.8971 (1.02)     0.0000 (1.0)      0.8971 (1.02)     0.0000 (1.0)           0;0  1.1147 (0.98)          1           1
test_sharing_gs-checkout-noop[main]       0.8767 (1.0)      0.8767 (1.0)      0.8767 (1.0)      0.0000 (1.0)      0.8767 (1.0)      0.0000 (1.0)           0;0  1.1406 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]      9.6672 (1.90)      9.6672 (1.90)      9.6672 (1.90)     0.0000 (1.0)       9.6672 (1.90)     0.0000 (1.0)           0;0  0.1034 (0.53)          1           1
test_sharing_gs-fetch[3.10.0]     10.2230 (2.00)     10.2230 (2.00)     10.2230 (2.00)     0.0000 (1.0)      10.2230 (2.00)     0.0000 (1.0)           0;0  0.0978 (0.50)          1           1
test_sharing_gs-fetch[main]        5.1006 (1.0)       5.1006 (1.0)       5.1006 (1.0)      0.0000 (1.0)       5.1006 (1.0)      0.0000 (1.0)           0;0  0.1961 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]       459.2140 (1.0)        459.2140 (1.0)        459.2140 (1.0)      0.0000 (1.0)        459.2140 (1.0)      0.0000 (1.0)           0;0  2.1776 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]       652.9129 (1.42)       652.9129 (1.42)       652.9129 (1.42)     0.0000 (1.0)        652.9129 (1.42)     0.0000 (1.0)           0;0  1.5316 (0.70)          1           1
test_sharing_gs-fetch-noop[main]       1,076.6091 (2.34)     1,076.6091 (2.34)     1,076.6091 (2.34)     0.0000 (1.0)      1,076.6091 (2.34)     0.0000 (1.0)           0;0  0.9288 (0.43)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     8.6752 (2.11)     8.6752 (2.11)     8.6752 (2.11)     0.0000 (1.0)      8.6752 (2.11)     0.0000 (1.0)           0;0  0.1153 (0.47)          1           1
test_sharing_gs-push[3.10.0]     5.0127 (1.22)     5.0127 (1.22)     5.0127 (1.22)     0.0000 (1.0)      5.0127 (1.22)     0.0000 (1.0)           0;0  0.1995 (0.82)          1           1
test_sharing_gs-push[main]       4.1081 (1.0)      4.1081 (1.0)      4.1081 (1.0)      0.0000 (1.0)      4.1081 (1.0)      0.0000 (1.0)           0;0  0.2434 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                            Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]       520.8235 (1.00)       520.8235 (1.00)       520.8235 (1.00)     0.0000 (1.0)        520.8235 (1.00)     0.0000 (1.0)           0;0  1.9200 (1.00)          1           1
test_sharing_gs-push-noop[3.10.0]       520.3573 (1.0)        520.3573 (1.0)        520.3573 (1.0)      0.0000 (1.0)        520.3573 (1.0)      0.0000 (1.0)           0;0  1.9218 (1.0)           1           1
test_sharing_gs-push-noop[main]       1,140.5469 (2.19)     1,140.5469 (2.19)     1,140.5469 (2.19)     0.0000 (1.0)      1,140.5469 (2.19)     0.0000 (1.0)           0;0  0.8768 (0.46)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     13.2682 (1.05)     13.2682 (1.05)     13.2682 (1.05)     0.0000 (1.0)      13.2682 (1.05)     0.0000 (1.0)           0;0  0.0754 (0.95)          1           1
test_sharing_s3-add[3.10.0]     12.6241 (1.0)      12.6241 (1.0)      12.6241 (1.0)      0.0000 (1.0)      12.6241 (1.0)      0.0000 (1.0)           0;0  0.0792 (1.0)           1           1
test_sharing_s3-add[main]       12.6771 (1.00)     12.6771 (1.00)     12.6771 (1.00)     0.0000 (1.0)      12.6771 (1.00)     0.0000 (1.0)           0;0  0.0789 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     7.5516 (1.13)     7.5516 (1.13)     7.5516 (1.13)     0.0000 (1.0)      7.5516 (1.13)     0.0000 (1.0)           0;0  0.1324 (0.89)          1           1
test_sharing_s3-add-noop[3.10.0]     6.7052 (1.0)      6.7052 (1.0)      6.7052 (1.0)      0.0000 (1.0)      6.7052 (1.0)      0.0000 (1.0)           0;0  0.1491 (1.0)           1           1
test_sharing_s3-add-noop[main]       6.9218 (1.03)     6.9218 (1.03)     6.9218 (1.03)     0.0000 (1.0)      6.9218 (1.03)     0.0000 (1.0)           0;0  0.1445 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]     5.0830 (1.03)     5.0830 (1.03)     5.0830 (1.03)     0.0000 (1.0)      5.0830 (1.03)     0.0000 (1.0)           0;0  0.1967 (0.97)          1           1
test_sharing_s3-checkout[3.10.0]     9.3262 (1.89)     9.3262 (1.89)     9.3262 (1.89)     0.0000 (1.0)      9.3262 (1.89)     0.0000 (1.0)           0;0  0.1072 (0.53)          1           1
test_sharing_s3-checkout[main]       4.9429 (1.0)      4.9429 (1.0)      4.9429 (1.0)      0.0000 (1.0)      4.9429 (1.0)      0.0000 (1.0)           0;0  0.2023 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]       854.5403 (1.0)        854.5403 (1.0)        854.5403 (1.0)      0.0000 (1.0)        854.5403 (1.0)      0.0000 (1.0)           0;0  1.1702 (1.0)           1           1
test_sharing_s3-checkout-noop[3.10.0]     1,050.6803 (1.23)     1,050.6803 (1.23)     1,050.6803 (1.23)     0.0000 (1.0)      1,050.6803 (1.23)     0.0000 (1.0)           0;0  0.9518 (0.81)          1           1
test_sharing_s3-checkout-noop[main]         890.2997 (1.04)       890.2997 (1.04)       890.2997 (1.04)     0.0000 (1.0)        890.2997 (1.04)     0.0000 (1.0)           0;0  1.1232 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     23.8577 (1.04)     23.8577 (1.04)     23.8577 (1.04)     0.0000 (1.0)      23.8577 (1.04)     0.0000 (1.0)           0;0  0.0419 (0.96)          1           1
test_sharing_s3-fetch[3.10.0]     22.9377 (1.00)     22.9377 (1.00)     22.9377 (1.00)     0.0000 (1.0)      22.9377 (1.00)     0.0000 (1.0)           0;0  0.0436 (1.00)          1           1
test_sharing_s3-fetch[main]       22.9187 (1.0)      22.9187 (1.0)      22.9187 (1.0)      0.0000 (1.0)      22.9187 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]       607.1223 (1.0)        607.1223 (1.0)        607.1223 (1.0)      0.0000 (1.0)        607.1223 (1.0)      0.0000 (1.0)           0;0  1.6471 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]       794.3290 (1.31)       794.3290 (1.31)       794.3290 (1.31)     0.0000 (1.0)        794.3290 (1.31)     0.0000 (1.0)           0;0  1.2589 (0.76)          1           1
test_sharing_s3-fetch-noop[main]       1,449.4206 (2.39)     1,449.4206 (2.39)     1,449.4206 (2.39)     0.0000 (1.0)      1,449.4206 (2.39)     0.0000 (1.0)           0;0  0.6899 (0.42)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     26.7150 (1.15)     26.7150 (1.15)     26.7150 (1.15)     0.0000 (1.0)      26.7150 (1.15)     0.0000 (1.0)           0;0  0.0374 (0.87)          1           1
test_sharing_s3-push[3.10.0]     23.2945 (1.0)      23.2945 (1.0)      23.2945 (1.0)      0.0000 (1.0)      23.2945 (1.0)      0.0000 (1.0)           0;0  0.0429 (1.0)           1           1
test_sharing_s3-push[main]       26.7649 (1.15)     26.7649 (1.15)     26.7649 (1.15)     0.0000 (1.0)      26.7649 (1.15)     0.0000 (1.0)           0;0  0.0374 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                            Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]       893.8707 (1.0)        893.8707 (1.0)        893.8707 (1.0)      0.0000 (1.0)        893.8707 (1.0)      0.0000 (1.0)           0;0  1.1187 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     1,208.2448 (1.35)     1,208.2448 (1.35)     1,208.2448 (1.35)     0.0000 (1.0)      1,208.2448 (1.35)     0.0000 (1.0)           0;0  0.8276 (0.74)          1           1
test_sharing_s3-push-noop[main]       1,728.2380 (1.93)     1,728.2380 (1.93)     1,728.2380 (1.93)     0.0000 (1.0)      1,728.2380 (1.93)     0.0000 (1.0)           0;0  0.5786 (0.52)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     5.7388 (1.18)     5.7388 (1.18)     5.7388 (1.18)     0.0000 (1.0)      5.7388 (1.18)     0.0000 (1.0)           0;0  0.1743 (0.85)          1           1
test_status-status[3.10.0]     4.8691 (1.0)      4.8691 (1.0)      4.8691 (1.0)      0.0000 (1.0)      4.8691 (1.0)      0.0000 (1.0)           0;0  0.2054 (1.0)           1           1
test_status-status[main]       5.6023 (1.15)     5.6023 (1.15)     5.6023 (1.15)     0.0000 (1.0)      5.6023 (1.15)     0.0000 (1.0)           0;0  0.1785 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     1.0815 (1.28)     1.0815 (1.28)     1.0815 (1.28)     0.0000 (1.0)      1.0815 (1.28)     0.0000 (1.0)           0;0  0.9247 (0.78)          1           1
test_status-status-changed[3.10.0]     0.9218 (1.09)     0.9218 (1.09)     0.9218 (1.09)     0.0000 (1.0)      0.9218 (1.09)     0.0000 (1.0)           0;0  1.0849 (0.92)          1           1
test_status-status-changed[main]       0.8438 (1.0)      0.8438 (1.0)      0.8438 (1.0)      0.0000 (1.0)      0.8438 (1.0)      0.0000 (1.0)           0;0  1.1851 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     1.3956 (1.71)     1.3956 (1.71)     1.3956 (1.71)     0.0000 (1.0)      1.3956 (1.71)     0.0000 (1.0)           0;0  0.7165 (0.58)          1           1
test_status-status-changed-noop[3.10.0]     0.8159 (1.0)      0.8159 (1.0)      0.8159 (1.0)      0.0000 (1.0)      0.8159 (1.0)      0.0000 (1.0)           0;0  1.2256 (1.0)           1           1
test_status-status-changed-noop[main]       0.8379 (1.03)     0.8379 (1.03)     0.8379 (1.03)     0.0000 (1.0)      0.8379 (1.03)     0.0000 (1.0)           0;0  1.1934 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     810.7209 (1.00)     810.7209 (1.00)     810.7209 (1.00)     0.0000 (1.0)      810.7209 (1.00)     0.0000 (1.0)           0;0  1.2335 (1.00)          1           1
test_status-status-noop[3.10.0]     824.1096 (1.02)     824.1096 (1.02)     824.1096 (1.02)     0.0000 (1.0)      824.1096 (1.02)     0.0000 (1.0)           0;0  1.2134 (0.98)          1           1
test_status-status-noop[main]       809.6264 (1.0)      809.6264 (1.0)      809.6264 (1.0)      0.0000 (1.0)      809.6264 (1.0)      0.0000 (1.0)           0;0  1.2351 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     25.9960 (1.28)     25.9960 (1.28)     25.9960 (1.28)     0.0000 (1.0)      25.9960 (1.28)     0.0000 (1.0)           0;0  0.0385 (0.78)          1           1
test_update-import-url[3.10.0]     26.0494 (1.28)     26.0494 (1.28)     26.0494 (1.28)     0.0000 (1.0)      26.0494 (1.28)     0.0000 (1.0)           0;0  0.0384 (0.78)          1           1
test_update-import-url[main]       20.3889 (1.0)      20.3889 (1.0)      20.3889 (1.0)      0.0000 (1.0)      20.3889 (1.0)      0.0000 (1.0)           0;0  0.0490 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     20.0341 (1.33)     20.0341 (1.33)     20.0341 (1.33)     0.0000 (1.0)      20.0341 (1.33)     0.0000 (1.0)           0;0  0.0499 (0.75)          1           1
test_update-update[3.10.0]     20.2951 (1.35)     20.2951 (1.35)     20.2951 (1.35)     0.0000 (1.0)      20.2951 (1.35)     0.0000 (1.0)           0;0  0.0493 (0.74)          1           1
test_update-update[main]       15.0452 (1.0)      15.0452 (1.0)      15.0452 (1.0)      0.0000 (1.0)      15.0452 (1.0)      0.0000 (1.0)           0;0  0.0665 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     1.9731 (1.0)      1.9731 (1.0)      1.9731 (1.0)      0.0000 (1.0)      1.9731 (1.0)      0.0000 (1.0)           0;0  0.5068 (1.0)           1           1
test_update-update-noop[3.10.0]     2.0361 (1.03)     2.0361 (1.03)     2.0361 (1.03)     0.0000 (1.0)      2.0361 (1.03)     0.0000 (1.0)           0;0  0.4911 (0.97)          1           1
test_update-update-noop[main]       1.9998 (1.01)     1.9998 (1.01)     1.9998 (1.01)     0.0000 (1.0)      1.9998 (1.01)     0.0000 (1.0)           0;0  0.5001 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean