Thu May  2 02:41:44 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     96.2465 (1.03)     96.2465 (1.03)     96.2465 (1.03)     0.0000 (1.0)      96.2465 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_add-add[3.10.0]     96.7684 (1.04)     96.7684 (1.04)     96.7684 (1.04)     0.0000 (1.0)      96.7684 (1.04)     0.0000 (1.0)           0;0  0.0103 (0.96)          1           1
test_add-add[main]       93.0167 (1.0)      93.0167 (1.0)      93.0167 (1.0)      0.0000 (1.0)      93.0167 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      43.7420 (1.36)      43.7420 (1.36)      43.7420 (1.36)     0.0000 (1.0)       43.7420 (1.36)     0.0000 (1.0)           0;0  0.0229 (0.74)          1           1
test_checkout_copy-checkout[3.10.0]     104.4694 (3.24)     104.4694 (3.24)     104.4694 (3.24)     0.0000 (1.0)      104.4694 (3.24)     0.0000 (1.0)           0;0  0.0096 (0.31)          1           1
test_checkout_copy-checkout[main]        32.2684 (1.0)       32.2684 (1.0)       32.2684 (1.0)      0.0000 (1.0)       32.2684 (1.0)      0.0000 (1.0)           0;0  0.0310 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.7187 (1.01)     6.7187 (1.01)     6.7187 (1.01)     0.0000 (1.0)      6.7187 (1.01)     0.0000 (1.0)           0;0  0.1488 (0.99)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.8585 (1.03)     6.8585 (1.03)     6.8585 (1.03)     0.0000 (1.0)      6.8585 (1.03)     0.0000 (1.0)           0;0  0.1458 (0.97)          1           1
test_checkout_copy-checkout-noop[main]       6.6486 (1.0)      6.6486 (1.0)      6.6486 (1.0)      0.0000 (1.0)      6.6486 (1.0)      0.0000 (1.0)           0;0  0.1504 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.6886 (1.42)     10.6886 (1.42)     10.6886 (1.42)     0.0000 (1.0)      10.6886 (1.42)     0.0000 (1.0)           0;0  0.0936 (0.70)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.5067 (1.0)       7.5067 (1.0)       7.5067 (1.0)      0.0000 (1.0)       7.5067 (1.0)      0.0000 (1.0)           0;0  0.1332 (1.0)           1           1
test_checkout_copy-checkout-update[main]        7.6482 (1.02)      7.6482 (1.02)      7.6482 (1.02)     0.0000 (1.0)       7.6482 (1.02)     0.0000 (1.0)           0;0  0.1307 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     26.3946 (1.40)     26.3946 (1.40)     26.3946 (1.40)     0.0000 (1.0)      26.3946 (1.40)     0.0000 (1.0)           0;0  0.0379 (0.71)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.8043 (1.0)      18.8043 (1.0)      18.8043 (1.0)      0.0000 (1.0)      18.8043 (1.0)      0.0000 (1.0)           0;0  0.0532 (1.0)           1           1
test_checkout_hardlink-checkout[main]       19.0013 (1.01)     19.0013 (1.01)     19.0013 (1.01)     0.0000 (1.0)      19.0013 (1.01)     0.0000 (1.0)           0;0  0.0526 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.9038 (1.07)     6.9038 (1.07)     6.9038 (1.07)     0.0000 (1.0)      6.9038 (1.07)     0.0000 (1.0)           0;0  0.1448 (0.94)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.8678 (1.06)     6.8678 (1.06)     6.8678 (1.06)     0.0000 (1.0)      6.8678 (1.06)     0.0000 (1.0)           0;0  0.1456 (0.94)          1           1
test_checkout_hardlink-checkout-noop[main]       6.4746 (1.0)      6.4746 (1.0)      6.4746 (1.0)      0.0000 (1.0)      6.4746 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.6709 (1.43)     10.6709 (1.43)     10.6709 (1.43)     0.0000 (1.0)      10.6709 (1.43)     0.0000 (1.0)           0;0  0.0937 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.7078 (1.03)      7.7078 (1.03)      7.7078 (1.03)     0.0000 (1.0)       7.7078 (1.03)     0.0000 (1.0)           0;0  0.1297 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]        7.4582 (1.0)       7.4582 (1.0)       7.4582 (1.0)      0.0000 (1.0)       7.4582 (1.0)      0.0000 (1.0)           0;0  0.1341 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.0571 (1.27)     30.0571 (1.27)     30.0571 (1.27)     0.0000 (1.0)      30.0571 (1.27)     0.0000 (1.0)           0;0  0.0333 (0.79)          1           1
test_checkout_symlink-checkout[3.10.0]     23.7924 (1.00)     23.7924 (1.00)     23.7924 (1.00)     0.0000 (1.0)      23.7924 (1.00)     0.0000 (1.0)           0;0  0.0420 (1.00)          1           1
test_checkout_symlink-checkout[main]       23.7547 (1.0)      23.7547 (1.0)      23.7547 (1.0)      0.0000 (1.0)      23.7547 (1.0)      0.0000 (1.0)           0;0  0.0421 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.2488 (1.02)     8.2488 (1.02)     8.2488 (1.02)     0.0000 (1.0)      8.2488 (1.02)     0.0000 (1.0)           0;0  0.1212 (0.98)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.4207 (1.04)     8.4207 (1.04)     8.4207 (1.04)     0.0000 (1.0)      8.4207 (1.04)     0.0000 (1.0)           0;0  0.1188 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       8.1064 (1.0)      8.1064 (1.0)      8.1064 (1.0)      0.0000 (1.0)      8.1064 (1.0)      0.0000 (1.0)           0;0  0.1234 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     13.3333 (1.32)     13.3333 (1.32)     13.3333 (1.32)     0.0000 (1.0)      13.3333 (1.32)     0.0000 (1.0)           0;0  0.0750 (0.76)          1           1
test_checkout_symlink-checkout-update[3.10.0]     10.0941 (1.0)      10.0941 (1.0)      10.0941 (1.0)      0.0000 (1.0)      10.0941 (1.0)      0.0000 (1.0)           0;0  0.0991 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       10.2735 (1.02)     10.2735 (1.02)     10.2735 (1.02)     0.0000 (1.0)      10.2735 (1.02)     0.0000 (1.0)           0;0  0.0973 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.7282 (1.0)      4.7282 (1.0)      4.7282 (1.0)      0.0000 (1.0)      4.7282 (1.0)      0.0000 (1.0)           0;0  0.2115 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.4455 (1.15)     5.4455 (1.15)     5.4455 (1.15)     0.0000 (1.0)      5.4455 (1.15)     0.0000 (1.0)           0;0  0.1836 (0.87)          1           1
test_data_status-data-changed[main]       5.4675 (1.16)     5.4675 (1.16)     5.4675 (1.16)     0.0000 (1.0)      5.4675 (1.16)     0.0000 (1.0)           0;0  0.1829 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8980 (1.0)      4.8980 (1.0)      4.8980 (1.0)      0.0000 (1.0)      4.8980 (1.0)      0.0000 (1.0)           0;0  0.2042 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.4670 (1.12)     5.4670 (1.12)     5.4670 (1.12)     0.0000 (1.0)      5.4670 (1.12)     0.0000 (1.0)           0;0  0.1829 (0.90)          1           1
test_data_status-data-changed-noop[main]       5.3424 (1.09)     5.3424 (1.09)     5.3424 (1.09)     0.0000 (1.0)      5.3424 (1.09)     0.0000 (1.0)           0;0  0.1872 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.6612 (1.0)      20.6612 (1.0)      20.6612 (1.0)      0.0000 (1.0)      20.6612 (1.0)      0.0000 (1.0)           0;0  0.0484 (1.0)           1           1
test_data_status-data-new[3.10.0]     21.3410 (1.03)     21.3410 (1.03)     21.3410 (1.03)     0.0000 (1.0)      21.3410 (1.03)     0.0000 (1.0)           0;0  0.0469 (0.97)          1           1
test_data_status-data-new[main]       20.9129 (1.01)     20.9129 (1.01)     20.9129 (1.01)     0.0000 (1.0)      20.9129 (1.01)     0.0000 (1.0)           0;0  0.0478 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.7965 (1.0)      4.7965 (1.0)      4.7965 (1.0)      0.0000 (1.0)      4.7965 (1.0)      0.0000 (1.0)           0;0  0.2085 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.6185 (1.17)     5.6185 (1.17)     5.6185 (1.17)     0.0000 (1.0)      5.6185 (1.17)     0.0000 (1.0)           0;0  0.1780 (0.85)          1           1
test_data_status-data-noop[main]       5.5297 (1.15)     5.5297 (1.15)     5.5297 (1.15)     0.0000 (1.0)      5.5297 (1.15)     0.0000 (1.0)           0;0  0.1808 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     19.0271 (1.0)      19.0271 (1.0)      19.0271 (1.0)      0.0000 (1.0)      19.0271 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.9618 (1.05)     19.9618 (1.05)     19.9618 (1.05)     0.0000 (1.0)      19.9618 (1.05)     0.0000 (1.0)           0;0  0.0501 (0.95)          1           1
test_data_status_all_flags-data-changed[main]       19.8178 (1.04)     19.8178 (1.04)     19.8178 (1.04)     0.0000 (1.0)      19.8178 (1.04)     0.0000 (1.0)           0;0  0.0505 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.8174 (1.0)      19.8174 (1.0)      19.8174 (1.0)      0.0000 (1.0)      19.8174 (1.0)      0.0000 (1.0)           0;0  0.0505 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.8276 (1.00)     19.8276 (1.00)     19.8276 (1.00)     0.0000 (1.0)      19.8276 (1.00)     0.0000 (1.0)           0;0  0.0504 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       20.3216 (1.03)     20.3216 (1.03)     20.3216 (1.03)     0.0000 (1.0)      20.3216 (1.03)     0.0000 (1.0)           0;0  0.0492 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     35.3416 (1.0)      35.3416 (1.0)      35.3416 (1.0)      0.0000 (1.0)      35.3416 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     36.7278 (1.04)     36.7278 (1.04)     36.7278 (1.04)     0.0000 (1.0)      36.7278 (1.04)     0.0000 (1.0)           0;0  0.0272 (0.96)          1           1
test_data_status_all_flags-data-new[main]       37.4229 (1.06)     37.4229 (1.06)     37.4229 (1.06)     0.0000 (1.0)      37.4229 (1.06)     0.0000 (1.0)           0;0  0.0267 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.3509 (1.0)      18.3509 (1.0)      18.3509 (1.0)      0.0000 (1.0)      18.3509 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     18.9905 (1.03)     18.9905 (1.03)     18.9905 (1.03)     0.0000 (1.0)      18.9905 (1.03)     0.0000 (1.0)           0;0  0.0527 (0.97)          1           1
test_data_status_all_flags-data-noop[main]       18.8125 (1.03)     18.8125 (1.03)     18.8125 (1.03)     0.0000 (1.0)      18.8125 (1.03)     0.0000 (1.0)           0;0  0.0532 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.6858 (1.0)      20.6858 (1.0)      20.6858 (1.0)      0.0000 (1.0)      20.6858 (1.0)      0.0000 (1.0)           0;0  0.0483 (1.0)           1           1
test_diff-diff[3.10.0]     21.3362 (1.03)     21.3362 (1.03)     21.3362 (1.03)     0.0000 (1.0)      21.3362 (1.03)     0.0000 (1.0)           0;0  0.0469 (0.97)          1           1
test_diff-diff[main]       23.7610 (1.15)     23.7610 (1.15)     23.7610 (1.15)     0.0000 (1.0)      23.7610 (1.15)     0.0000 (1.0)           0;0  0.0421 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.3620 (1.11)     7.3620 (1.11)     7.3620 (1.11)     0.0000 (1.0)      7.3620 (1.11)     0.0000 (1.0)           0;0  0.1358 (0.90)          1           1
test_diff-diff-changed[3.10.0]     8.0265 (1.21)     8.0265 (1.21)     8.0265 (1.21)     0.0000 (1.0)      8.0265 (1.21)     0.0000 (1.0)           0;0  0.1246 (0.82)          1           1
test_diff-diff-changed[main]       6.6098 (1.0)      6.6098 (1.0)      6.6098 (1.0)      0.0000 (1.0)      6.6098 (1.0)      0.0000 (1.0)           0;0  0.1513 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.2226 (1.0)      6.2226 (1.0)      6.2226 (1.0)      0.0000 (1.0)      6.2226 (1.0)      0.0000 (1.0)           0;0  0.1607 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.8068 (1.09)     6.8068 (1.09)     6.8068 (1.09)     0.0000 (1.0)      6.8068 (1.09)     0.0000 (1.0)           0;0  0.1469 (0.91)          1           1
test_diff-diff-changed-noop[main]       6.5782 (1.06)     6.5782 (1.06)     6.5782 (1.06)     0.0000 (1.0)      6.5782 (1.06)     0.0000 (1.0)           0;0  0.1520 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9684 (1.0)      4.9684 (1.0)      4.9684 (1.0)      0.0000 (1.0)      4.9684 (1.0)      0.0000 (1.0)           0;0  0.2013 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.6052 (1.13)     5.6052 (1.13)     5.6052 (1.13)     0.0000 (1.0)      5.6052 (1.13)     0.0000 (1.0)           0;0  0.1784 (0.89)          1           1
test_diff-diff-noop[main]       6.6502 (1.34)     6.6502 (1.34)     6.6502 (1.34)     0.0000 (1.0)      6.6502 (1.34)     0.0000 (1.0)           0;0  0.1504 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       890.9634 (1.0)        890.9634 (1.0)        890.9634 (1.0)      0.0000 (1.0)        890.9634 (1.0)      0.0000 (1.0)           0;0  1.1224 (1.0)           1           1
test_exp_show-exp[3.10.0]     7,114.7586 (7.99)     7,114.7586 (7.99)     7,114.7586 (7.99)     0.0000 (1.0)      7,114.7586 (7.99)     0.0000 (1.0)           0;0  0.1406 (0.13)          1           1
test_exp_show-exp[main]       7,228.1173 (8.11)     7,228.1173 (8.11)     7,228.1173 (8.11)     0.0000 (1.0)      7,228.1173 (8.11)     0.0000 (1.0)           0;0  0.1383 (0.12)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     111.6638 (2.84)     111.6638 (2.84)     111.6638 (2.84)     0.0000 (1.0)      111.6638 (2.84)     0.0000 (1.0)           0;0  0.0090 (0.35)          1           1
test_fetch-fetch[3.10.0]     117.8445 (3.00)     117.8445 (3.00)     117.8445 (3.00)     0.0000 (1.0)      117.8445 (3.00)     0.0000 (1.0)           0;0  0.0085 (0.33)          1           1
test_fetch-fetch[main]        39.3061 (1.0)       39.3061 (1.0)       39.3061 (1.0)      0.0000 (1.0)       39.3061 (1.0)      0.0000 (1.0)           0;0  0.0254 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.3412 (1.02)     3.3412 (1.02)     3.3412 (1.02)     0.0000 (1.0)      3.3412 (1.02)     0.0000 (1.0)           0;0  0.2993 (0.98)          1           1
test_gc-gc[3.10.0]     3.2838 (1.0)      3.2838 (1.0)      3.2838 (1.0)      0.0000 (1.0)      3.2838 (1.0)      0.0000 (1.0)           0;0  0.3045 (1.0)           1           1
test_gc-gc[main]       3.3309 (1.01)     3.3309 (1.01)     3.3309 (1.01)     0.0000 (1.0)      3.3309 (1.01)     0.0000 (1.0)           0;0  0.3002 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     182.9773 (1.12)     182.9773 (1.12)     182.9773 (1.12)     0.0000 (1.0)      182.9773 (1.12)     0.0000 (1.0)           0;0  0.0055 (0.89)          1           1
test_get-get[3.10.0]     218.9170 (1.34)     218.9170 (1.34)     218.9170 (1.34)     0.0000 (1.0)      218.9170 (1.34)     0.0000 (1.0)           0;0  0.0046 (0.74)          1           1
test_get-get[main]       163.0844 (1.0)      163.0844 (1.0)      163.0844 (1.0)      0.0000 (1.0)      163.0844 (1.0)      0.0000 (1.0)           0;0  0.0061 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.8449 (5.05)     85.8449 (5.05)     85.8449 (5.05)     0.0000 (1.0)      85.8449 (5.05)     0.0000 (1.0)           0;0  0.0116 (0.20)          1           1
test_get_url-get-url[3.10.0]     89.5843 (5.27)     89.5843 (5.27)     89.5843 (5.27)     0.0000 (1.0)      89.5843 (5.27)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[main]       16.9899 (1.0)      16.9899 (1.0)      16.9899 (1.0)      0.0000 (1.0)      16.9899 (1.0)      0.0000 (1.0)           0;0  0.0589 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     129.8124 (1.02)     139.6737 (1.02)     133.8164 (1.02)     1.7580 (1.0)      133.6891 (1.03)     1.6644 (1.0)          26;7  7.4729 (0.98)        100           1
test_help---help[3.10.0]     127.7029 (1.0)      136.7331 (1.0)      130.7060 (1.0)      1.8280 (1.04)     130.4078 (1.0)      2.1806 (1.31)         31;2  7.6508 (1.0)         100           1
test_help---help[main]       129.8096 (1.02)     142.3862 (1.04)     132.6574 (1.01)     2.0586 (1.17)     132.2520 (1.01)     2.3782 (1.43)         23;3  7.5382 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     285.3165 (1.08)     285.3165 (1.08)     285.3165 (1.08)     0.0000 (1.0)      285.3165 (1.08)     0.0000 (1.0)           0;0  0.0035 (0.92)          1           1
test_import-import[3.10.0]     320.5948 (1.22)     320.5948 (1.22)     320.5948 (1.22)     0.0000 (1.0)      320.5948 (1.22)     0.0000 (1.0)           0;0  0.0031 (0.82)          1           1
test_import-import[main]       263.6874 (1.0)      263.6874 (1.0)      263.6874 (1.0)      0.0000 (1.0)      263.6874 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     212.9982 (1.55)     212.9982 (1.55)     212.9982 (1.55)     0.0000 (1.0)      212.9982 (1.55)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_import_url-import-url[3.10.0]     214.9444 (1.56)     214.9444 (1.56)     214.9444 (1.56)     0.0000 (1.0)      214.9444 (1.56)     0.0000 (1.0)           0;0  0.0047 (0.64)          1           1
test_import_url-import-url[main]       137.6217 (1.0)      137.6217 (1.0)      137.6217 (1.0)      0.0000 (1.0)      137.6217 (1.0)      0.0000 (1.0)           0;0  0.0073 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     359.2258 (1.0)      449.8363 (1.05)     370.9951 (1.0)      10.7523 (1.40)     369.8976 (1.0)       9.1711 (1.31)         12;4  2.6955 (1.0)         100           1
test_init-init[3.10.0]     365.3527 (1.02)     429.5116 (1.0)      373.4198 (1.01)      7.6885 (1.0)      371.1585 (1.00)      7.0203 (1.0)           7;2  2.6780 (0.99)        100           1
test_init-init[main]       364.1138 (1.01)     504.8388 (1.18)     381.5168 (1.03)     15.5919 (2.03)     379.5430 (1.03)     13.3080 (1.90)          5;2  2.6211 (0.97)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     439.7879 (1.14)     439.7879 (1.14)     439.7879 (1.14)     0.0000 (1.0)      439.7879 (1.14)     0.0000 (1.0)           0;0  2.2738 (0.87)          1           1
test_list-list[3.10.0]     399.7991 (1.04)     399.7991 (1.04)     399.7991 (1.04)     0.0000 (1.0)      399.7991 (1.04)     0.0000 (1.0)           0;0  2.5013 (0.96)          1           1
test_list-list[main]       384.6925 (1.0)      384.6925 (1.0)      384.6925 (1.0)      0.0000 (1.0)      384.6925 (1.0)      0.0000 (1.0)           0;0  2.5995 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     388.8679 (1.02)     388.8679 (1.02)     388.8679 (1.02)     0.0000 (1.0)      388.8679 (1.02)     0.0000 (1.0)           0;0  2.5716 (0.98)          1           1
test_list-list-dvc-only[3.10.0]     386.4800 (1.01)     386.4800 (1.01)     386.4800 (1.01)     0.0000 (1.0)      386.4800 (1.01)     0.0000 (1.0)           0;0  2.5875 (0.99)          1           1
test_list-list-dvc-only[main]       382.4840 (1.0)      382.4840 (1.0)      382.4840 (1.0)      0.0000 (1.0)      382.4840 (1.0)      0.0000 (1.0)           0;0  2.6145 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1268 (1.0)      3.1268 (1.0)      3.1268 (1.0)      0.0000 (1.0)      3.1268 (1.0)      0.0000 (1.0)           0;0  0.3198 (1.0)           1           1
test_list-list-recursive[3.10.0]     3.1389 (1.00)     3.1389 (1.00)     3.1389 (1.00)     0.0000 (1.0)      3.1389 (1.00)     0.0000 (1.0)           0;0  0.3186 (1.00)          1           1
test_list-list-recursive[main]       3.1677 (1.01)     3.1677 (1.01)     3.1677 (1.01)     0.0000 (1.0)      3.1677 (1.01)     0.0000 (1.0)           0;0  0.3157 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     391.2528 (1.02)     391.2528 (1.02)     391.2528 (1.02)     0.0000 (1.0)      391.2528 (1.02)     0.0000 (1.0)           0;0  2.5559 (0.98)          1           1
test_list-list-shallow[3.10.0]     386.0644 (1.01)     386.0644 (1.01)     386.0644 (1.01)     0.0000 (1.0)      386.0644 (1.01)     0.0000 (1.0)           0;0  2.5902 (0.99)          1           1
test_list-list-shallow[main]       381.8186 (1.0)      381.8186 (1.0)      381.8186 (1.0)      0.0000 (1.0)      381.8186 (1.0)      0.0000 (1.0)           0;0  2.6190 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     84.2236 (1.04)     84.2236 (1.04)     84.2236 (1.04)     0.0000 (1.0)      84.2236 (1.04)     0.0000 (1.0)           0;0  0.0119 (0.96)          1           1
test_partial_add-add[3.10.0]     83.7562 (1.03)     83.7562 (1.03)     83.7562 (1.03)     0.0000 (1.0)      83.7562 (1.03)     0.0000 (1.0)           0;0  0.0119 (0.97)          1           1
test_partial_add-add[main]       80.9533 (1.0)      80.9533 (1.0)      80.9533 (1.0)      0.0000 (1.0)      80.9533 (1.0)      0.0000 (1.0)           0;0  0.0124 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     69.8310 (1.05)     69.8310 (1.05)     69.8310 (1.05)     0.0000 (1.0)      69.8310 (1.05)     0.0000 (1.0)           0;0  0.0143 (0.95)          1           1
test_partial_add-add-partial[3.10.0]     71.5706 (1.08)     71.5706 (1.08)     71.5706 (1.08)     0.0000 (1.0)      71.5706 (1.08)     0.0000 (1.0)           0;0  0.0140 (0.93)          1           1
test_partial_add-add-partial[main]       66.2499 (1.0)      66.2499 (1.0)      66.2499 (1.0)      0.0000 (1.0)      66.2499 (1.0)      0.0000 (1.0)           0;0  0.0151 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]      6.6347 (1.0)       6.6347 (1.0)       6.6347 (1.0)      0.0000 (1.0)       6.6347 (1.0)      0.0000 (1.0)           0;0  0.1507 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]      8.7497 (1.32)      8.7497 (1.32)      8.7497 (1.32)     0.0000 (1.0)       8.7497 (1.32)     0.0000 (1.0)           0;0  0.1143 (0.76)          1           1
test_partial_add-gc-cloud-noop[main]       10.0033 (1.51)     10.0033 (1.51)     10.0033 (1.51)     0.0000 (1.0)      10.0033 (1.51)     0.0000 (1.0)           0;0  0.1000 (0.66)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.7682 (1.0)      3.7682 (1.0)      3.7682 (1.0)      0.0000 (1.0)      3.7682 (1.0)      0.0000 (1.0)           0;0  0.2654 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.7336 (1.52)     5.7336 (1.52)     5.7336 (1.52)     0.0000 (1.0)      5.7336 (1.52)     0.0000 (1.0)           0;0  0.1744 (0.66)          1           1
test_partial_add-gc-noop[main]       5.7374 (1.52)     5.7374 (1.52)     5.7374 (1.52)     0.0000 (1.0)      5.7374 (1.52)     0.0000 (1.0)           0;0  0.1743 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     83.1133 (3.80)     83.1133 (3.80)     83.1133 (3.80)     0.0000 (1.0)      83.1133 (3.80)     0.0000 (1.0)           0;0  0.0120 (0.26)          1           1
test_partial_add-push[3.10.0]     41.3103 (1.89)     41.3103 (1.89)     41.3103 (1.89)     0.0000 (1.0)      41.3103 (1.89)     0.0000 (1.0)           0;0  0.0242 (0.53)          1           1
test_partial_add-push[main]       21.8850 (1.0)      21.8850 (1.0)      21.8850 (1.0)      0.0000 (1.0)      21.8850 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     18.6750 (1.58)     18.6750 (1.58)     18.6750 (1.58)     0.0000 (1.0)      18.6750 (1.58)     0.0000 (1.0)           0;0  0.0535 (0.63)          1           1
test_partial_add-push-partial[3.10.0]     11.8252 (1.0)      11.8252 (1.0)      11.8252 (1.0)      0.0000 (1.0)      11.8252 (1.0)      0.0000 (1.0)           0;0  0.0846 (1.0)           1           1
test_partial_add-push-partial[main]       12.3293 (1.04)     12.3293 (1.04)     12.3293 (1.04)     0.0000 (1.0)      12.3293 (1.04)     0.0000 (1.0)           0;0  0.0811 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.8930 (1.02)     95.8930 (1.02)     95.8930 (1.02)     0.0000 (1.0)      95.8930 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_partial_remove-add[3.10.0]     96.6433 (1.03)     96.6433 (1.03)     96.6433 (1.03)     0.0000 (1.0)      96.6433 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_partial_remove-add[main]       93.8790 (1.0)      93.8790 (1.0)      93.8790 (1.0)      0.0000 (1.0)      93.8790 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.3954 (1.03)     9.3954 (1.03)     9.3954 (1.03)     0.0000 (1.0)      9.3954 (1.03)     0.0000 (1.0)           0;0  0.1064 (0.97)          1           1
test_partial_remove-add-update[3.10.0]     9.4533 (1.03)     9.4533 (1.03)     9.4533 (1.03)     0.0000 (1.0)      9.4533 (1.03)     0.0000 (1.0)           0;0  0.1058 (0.97)          1           1
test_partial_remove-add-update[main]       9.1529 (1.0)      9.1529 (1.0)      9.1529 (1.0)      0.0000 (1.0)      9.1529 (1.0)      0.0000 (1.0)           0;0  0.1093 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.2149 (1.0)      4.2149 (1.0)      4.2149 (1.0)      0.0000 (1.0)      4.2149 (1.0)      0.0000 (1.0)           0;0  0.2373 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.7657 (1.13)     4.7657 (1.13)     4.7657 (1.13)     0.0000 (1.0)      4.7657 (1.13)     0.0000 (1.0)           0;0  0.2098 (0.88)          1           1
test_partial_remove-gc[main]       4.8781 (1.16)     4.8781 (1.16)     4.8781 (1.16)     0.0000 (1.0)      4.8781 (1.16)     0.0000 (1.0)           0;0  0.2050 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.0201 (1.0)      6.0201 (1.0)      6.0201 (1.0)      0.0000 (1.0)      6.0201 (1.0)      0.0000 (1.0)           0;0  0.1661 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.7629 (1.12)     6.7629 (1.12)     6.7629 (1.12)     0.0000 (1.0)      6.7629 (1.12)     0.0000 (1.0)           0;0  0.1479 (0.89)          1           1
test_partial_remove-gc-cloud[main]       6.7414 (1.12)     6.7414 (1.12)     6.7414 (1.12)     0.0000 (1.0)      6.7414 (1.12)     0.0000 (1.0)           0;0  0.1483 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     94.8519 (3.76)     94.8519 (3.76)     94.8519 (3.76)     0.0000 (1.0)      94.8519 (3.76)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_partial_remove-push[3.10.0]     47.8913 (1.90)     47.8913 (1.90)     47.8913 (1.90)     0.0000 (1.0)      47.8913 (1.90)     0.0000 (1.0)           0;0  0.0209 (0.53)          1           1
test_partial_remove-push[main]       25.2136 (1.0)      25.2136 (1.0)      25.2136 (1.0)      0.0000 (1.0)      25.2136 (1.0)      0.0000 (1.0)           0;0  0.0397 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0148 (1.0)      2.0148 (1.0)      2.0148 (1.0)      0.0000 (1.0)      2.0148 (1.0)      0.0000 (1.0)           0;0  0.4963 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     2.0481 (1.02)     2.0481 (1.02)     2.0481 (1.02)     0.0000 (1.0)      2.0481 (1.02)     0.0000 (1.0)           0;0  0.4883 (0.98)          1           1
test_partial_remove-push-update[main]       2.8052 (1.39)     2.8052 (1.39)     2.8052 (1.39)     0.0000 (1.0)      2.8052 (1.39)     0.0000 (1.0)           0;0  0.3565 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     420.4065 (1.0)      422.2054 (1.0)      421.0935 (1.0)      0.7798 (1.0)      420.7146 (1.0)      1.2572 (1.0)           1;0  2.3748 (1.0)           5           3
test_plots-plots-diff[3.10.0]     781.7895 (1.86)     798.3369 (1.89)     785.8376 (1.87)     7.0139 (8.99)     783.0665 (1.86)     4.7618 (3.79)          1;1  1.2725 (0.54)          5           3
test_plots-plots-diff[main]       738.1576 (1.76)     746.3932 (1.77)     742.4202 (1.76)     3.6644 (4.70)     744.2457 (1.77)     6.2003 (4.93)          2;0  1.3469 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       434.6147 (1.0)        438.6703 (1.0)        436.9115 (1.0)      1.5378 (1.0)        437.1072 (1.0)      2.0710 (1.0)           2;0  2.2888 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,025.5163 (2.36)     1,044.0255 (2.38)     1,031.8368 (2.36)     7.1449 (4.65)     1,030.5659 (2.36)     6.6133 (3.19)          1;0  0.9691 (0.42)          5           3
test_plots-plots-diff-json[main]         817.2480 (1.88)       823.8785 (1.88)       820.2184 (1.88)     2.4773 (1.61)       820.5753 (1.88)     3.0217 (1.46)          2;0  1.2192 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     384.3665 (1.0)      386.8983 (1.0)      385.6429 (1.0)      0.9906 (1.0)      385.8575 (1.0)      1.4915 (1.04)          2;0  2.5931 (1.0)           5           3
test_plots-plots-show[3.10.0]     640.9854 (1.67)     645.8083 (1.67)     644.3407 (1.67)     1.9135 (1.93)     644.9855 (1.67)     1.4321 (1.0)           1;1  1.5520 (0.60)          5           3
test_plots-plots-show[main]       621.3408 (1.62)     631.6666 (1.63)     626.4602 (1.62)     4.2335 (4.27)     627.4831 (1.63)     6.9175 (4.83)          2;0  1.5963 (0.62)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     399.3254 (1.0)      402.5070 (1.0)      400.6814 (1.0)      1.3730 (1.05)     400.7200 (1.0)      2.3824 (1.36)          1;0  2.4957 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     789.6473 (1.98)     797.9170 (1.98)     793.2061 (1.98)     3.6180 (2.76)     792.4244 (1.98)     6.4178 (3.67)          1;0  1.2607 (0.51)          5           3
test_plots-plots-show-json[main]       669.3312 (1.68)     672.7871 (1.67)     671.2757 (1.68)     1.3109 (1.0)      671.6011 (1.68)     1.7489 (1.0)           2;0  1.4897 (0.60)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     94.9679 (3.89)     94.9679 (3.89)     94.9679 (3.89)     0.0000 (1.0)      94.9679 (3.89)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_push-push[3.10.0]     47.4561 (1.94)     47.4561 (1.94)     47.4561 (1.94)     0.0000 (1.0)      47.4561 (1.94)     0.0000 (1.0)           0;0  0.0211 (0.51)          1           1
test_push-push[main]       24.4124 (1.0)      24.4124 (1.0)      24.4124 (1.0)      0.0000 (1.0)      24.4124 (1.0)      0.0000 (1.0)           0;0  0.0410 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     94.9830 (1.04)     94.9830 (1.04)     94.9830 (1.04)     0.0000 (1.0)      94.9830 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.96)          1           1
test_sharing-add[3.10.0]     96.1619 (1.05)     96.1619 (1.05)     96.1619 (1.05)     0.0000 (1.0)      96.1619 (1.05)     0.0000 (1.0)           0;0  0.0104 (0.95)          1           1
test_sharing-add[main]       91.3752 (1.0)      91.3752 (1.0)      91.3752 (1.0)      0.0000 (1.0)      91.3752 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     62.2964 (1.05)     62.2964 (1.05)     62.2964 (1.05)     0.0000 (1.0)      62.2964 (1.05)     0.0000 (1.0)           0;0  0.0161 (0.95)          1           1
test_sharing-add-noop[3.10.0]     62.6622 (1.06)     62.6622 (1.06)     62.6622 (1.06)     0.0000 (1.0)      62.6622 (1.06)     0.0000 (1.0)           0;0  0.0160 (0.94)          1           1
test_sharing-add-noop[main]       59.0738 (1.0)      59.0738 (1.0)      59.0738 (1.0)      0.0000 (1.0)      59.0738 (1.0)      0.0000 (1.0)           0;0  0.0169 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      42.4330 (1.43)      42.4330 (1.43)      42.4330 (1.43)     0.0000 (1.0)       42.4330 (1.43)     0.0000 (1.0)           0;0  0.0236 (0.70)          1           1
test_sharing-checkout[3.10.0]     102.9964 (3.47)     102.9964 (3.47)     102.9964 (3.47)     0.0000 (1.0)      102.9964 (3.47)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing-checkout[main]        29.6420 (1.0)       29.6420 (1.0)       29.6420 (1.0)      0.0000 (1.0)       29.6420 (1.0)      0.0000 (1.0)           0;0  0.0337 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6486 (1.02)     6.6486 (1.02)     6.6486 (1.02)     0.0000 (1.0)      6.6486 (1.02)     0.0000 (1.0)           0;0  0.1504 (0.98)          1           1
test_sharing-checkout-noop[3.10.0]     6.8111 (1.04)     6.8111 (1.04)     6.8111 (1.04)     0.0000 (1.0)      6.8111 (1.04)     0.0000 (1.0)           0;0  0.1468 (0.96)          1           1
test_sharing-checkout-noop[main]       6.5205 (1.0)      6.5205 (1.0)      6.5205 (1.0)      0.0000 (1.0)      6.5205 (1.0)      0.0000 (1.0)           0;0  0.1534 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.8961 (2.76)     110.8961 (2.76)     110.8961 (2.76)     0.0000 (1.0)      110.8961 (2.76)     0.0000 (1.0)           0;0  0.0090 (0.36)          1           1
test_sharing-fetch[3.10.0]     117.1068 (2.92)     117.1068 (2.92)     117.1068 (2.92)     0.0000 (1.0)      117.1068 (2.92)     0.0000 (1.0)           0;0  0.0085 (0.34)          1           1
test_sharing-fetch[main]        40.1628 (1.0)       40.1628 (1.0)       40.1628 (1.0)      0.0000 (1.0)       40.1628 (1.0)      0.0000 (1.0)           0;0  0.0249 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4056 (1.0)      1.4056 (1.0)      1.4056 (1.0)      0.0000 (1.0)      1.4056 (1.0)      0.0000 (1.0)           0;0  0.7115 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8109 (2.71)     3.8109 (2.71)     3.8109 (2.71)     0.0000 (1.0)      3.8109 (2.71)     0.0000 (1.0)           0;0  0.2624 (0.37)          1           1
test_sharing-fetch-noop[main]       6.8732 (4.89)     6.8732 (4.89)     6.8732 (4.89)     0.0000 (1.0)      6.8732 (4.89)     0.0000 (1.0)           0;0  0.1455 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     94.8351 (3.65)     94.8351 (3.65)     94.8351 (3.65)     0.0000 (1.0)      94.8351 (3.65)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing-push[3.10.0]     48.1358 (1.85)     48.1358 (1.85)     48.1358 (1.85)     0.0000 (1.0)      48.1358 (1.85)     0.0000 (1.0)           0;0  0.0208 (0.54)          1           1
test_sharing-push[main]       26.0154 (1.0)      26.0154 (1.0)      26.0154 (1.0)      0.0000 (1.0)      26.0154 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.4613 (1.0)      2.4613 (1.0)      2.4613 (1.0)      0.0000 (1.0)      2.4613 (1.0)      0.0000 (1.0)           0;0  0.4063 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.4797 (1.01)     2.4797 (1.01)     2.4797 (1.01)     0.0000 (1.0)      2.4797 (1.01)     0.0000 (1.0)           0;0  0.4033 (0.99)          1           1
test_sharing-push-noop[main]       7.1366 (2.90)     7.1366 (2.90)     7.1366 (2.90)     0.0000 (1.0)      7.1366 (2.90)     0.0000 (1.0)           0;0  0.1401 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     95.9635 (1.02)     95.9635 (1.02)     95.9635 (1.02)     0.0000 (1.0)      95.9635 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_azure-add[3.10.0]     97.7953 (1.04)     97.7953 (1.04)     97.7953 (1.04)     0.0000 (1.0)      97.7953 (1.04)     0.0000 (1.0)           0;0  0.0102 (0.96)          1           1
test_sharing_azure-add[main]       93.6365 (1.0)      93.6365 (1.0)      93.6365 (1.0)      0.0000 (1.0)      93.6365 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.2544 (1.06)     63.2544 (1.06)     63.2544 (1.06)     0.0000 (1.0)      63.2544 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.95)          1           1
test_sharing_azure-add-noop[3.10.0]     64.2483 (1.07)     64.2483 (1.07)     64.2483 (1.07)     0.0000 (1.0)      64.2483 (1.07)     0.0000 (1.0)           0;0  0.0156 (0.93)          1           1
test_sharing_azure-add-noop[main]       59.8351 (1.0)      59.8351 (1.0)      59.8351 (1.0)      0.0000 (1.0)      59.8351 (1.0)      0.0000 (1.0)           0;0  0.0167 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      43.4925 (1.44)      43.4925 (1.44)      43.4925 (1.44)     0.0000 (1.0)       43.4925 (1.44)     0.0000 (1.0)           0;0  0.0230 (0.70)          1           1
test_sharing_azure-checkout[3.10.0]     103.4532 (3.42)     103.4532 (3.42)     103.4532 (3.42)     0.0000 (1.0)      103.4532 (3.42)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_azure-checkout[main]        30.2594 (1.0)       30.2594 (1.0)       30.2594 (1.0)      0.0000 (1.0)       30.2594 (1.0)      0.0000 (1.0)           0;0  0.0330 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.6419 (1.01)     6.6419 (1.01)     6.6419 (1.01)     0.0000 (1.0)      6.6419 (1.01)     0.0000 (1.0)           0;0  0.1506 (0.99)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.8594 (1.05)     6.8594 (1.05)     6.8594 (1.05)     0.0000 (1.0)      6.8594 (1.05)     0.0000 (1.0)           0;0  0.1458 (0.95)          1           1
test_sharing_azure-checkout-noop[main]       6.5444 (1.0)      6.5444 (1.0)      6.5444 (1.0)      0.0000 (1.0)      6.5444 (1.0)      0.0000 (1.0)           0;0  0.1528 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     112.2373 (2.69)     112.2373 (2.69)     112.2373 (2.69)     0.0000 (1.0)      112.2373 (2.69)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_azure-fetch[3.10.0]     117.6409 (2.82)     117.6409 (2.82)     117.6409 (2.82)     0.0000 (1.0)      117.6409 (2.82)     0.0000 (1.0)           0;0  0.0085 (0.35)          1           1
test_sharing_azure-fetch[main]        41.7411 (1.0)       41.7411 (1.0)       41.7411 (1.0)      0.0000 (1.0)       41.7411 (1.0)      0.0000 (1.0)           0;0  0.0240 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4356 (1.0)      1.4356 (1.0)      1.4356 (1.0)      0.0000 (1.0)      1.4356 (1.0)      0.0000 (1.0)           0;0  0.6966 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.9146 (2.73)     3.9146 (2.73)     3.9146 (2.73)     0.0000 (1.0)      3.9146 (2.73)     0.0000 (1.0)           0;0  0.2555 (0.37)          1           1
test_sharing_azure-fetch-noop[main]       7.1019 (4.95)     7.1019 (4.95)     7.1019 (4.95)     0.0000 (1.0)      7.1019 (4.95)     0.0000 (1.0)           0;0  0.1408 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     95.5429 (3.73)     95.5429 (3.73)     95.5429 (3.73)     0.0000 (1.0)      95.5429 (3.73)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing_azure-push[3.10.0]     47.9567 (1.87)     47.9567 (1.87)     47.9567 (1.87)     0.0000 (1.0)      47.9567 (1.87)     0.0000 (1.0)           0;0  0.0209 (0.53)          1           1
test_sharing_azure-push[main]       25.6150 (1.0)      25.6150 (1.0)      25.6150 (1.0)      0.0000 (1.0)      25.6150 (1.0)      0.0000 (1.0)           0;0  0.0390 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.4575 (1.0)      2.4575 (1.0)      2.4575 (1.0)      0.0000 (1.0)      2.4575 (1.0)      0.0000 (1.0)           0;0  0.4069 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]     2.5895 (1.05)     2.5895 (1.05)     2.5895 (1.05)     0.0000 (1.0)      2.5895 (1.05)     0.0000 (1.0)           0;0  0.3862 (0.95)          1           1
test_sharing_azure-push-noop[main]       7.4226 (3.02)     7.4226 (3.02)     7.4226 (3.02)     0.0000 (1.0)      7.4226 (3.02)     0.0000 (1.0)           0;0  0.1347 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     97.1582 (1.03)     97.1582 (1.03)     97.1582 (1.03)     0.0000 (1.0)      97.1582 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing_gs-add[3.10.0]     96.9431 (1.03)     96.9431 (1.03)     96.9431 (1.03)     0.0000 (1.0)      96.9431 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing_gs-add[main]       94.0282 (1.0)      94.0282 (1.0)      94.0282 (1.0)      0.0000 (1.0)      94.0282 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     63.9249 (1.05)     63.9249 (1.05)     63.9249 (1.05)     0.0000 (1.0)      63.9249 (1.05)     0.0000 (1.0)           0;0  0.0156 (0.95)          1           1
test_sharing_gs-add-noop[3.10.0]     65.0333 (1.07)     65.0333 (1.07)     65.0333 (1.07)     0.0000 (1.0)      65.0333 (1.07)     0.0000 (1.0)           0;0  0.0154 (0.94)          1           1
test_sharing_gs-add-noop[main]       60.8261 (1.0)      60.8261 (1.0)      60.8261 (1.0)      0.0000 (1.0)      60.8261 (1.0)      0.0000 (1.0)           0;0  0.0164 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      43.1700 (1.43)      43.1700 (1.43)      43.1700 (1.43)     0.0000 (1.0)       43.1700 (1.43)     0.0000 (1.0)           0;0  0.0232 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     104.5013 (3.47)     104.5013 (3.47)     104.5013 (3.47)     0.0000 (1.0)      104.5013 (3.47)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing_gs-checkout[main]        30.1377 (1.0)       30.1377 (1.0)       30.1377 (1.0)      0.0000 (1.0)       30.1377 (1.0)      0.0000 (1.0)           0;0  0.0332 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.8279 (1.02)     6.8279 (1.02)     6.8279 (1.02)     0.0000 (1.0)      6.8279 (1.02)     0.0000 (1.0)           0;0  0.1465 (0.98)          1           1
test_sharing_gs-checkout-noop[3.10.0]     7.0607 (1.05)     7.0607 (1.05)     7.0607 (1.05)     0.0000 (1.0)      7.0607 (1.05)     0.0000 (1.0)           0;0  0.1416 (0.95)          1           1
test_sharing_gs-checkout-noop[main]       6.7248 (1.0)      6.7248 (1.0)      6.7248 (1.0)      0.0000 (1.0)      6.7248 (1.0)      0.0000 (1.0)           0;0  0.1487 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     112.6236 (2.69)     112.6236 (2.69)     112.6236 (2.69)     0.0000 (1.0)      112.6236 (2.69)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_gs-fetch[3.10.0]     118.6570 (2.84)     118.6570 (2.84)     118.6570 (2.84)     0.0000 (1.0)      118.6570 (2.84)     0.0000 (1.0)           0;0  0.0084 (0.35)          1           1
test_sharing_gs-fetch[main]        41.7946 (1.0)       41.7946 (1.0)       41.7946 (1.0)      0.0000 (1.0)       41.7946 (1.0)      0.0000 (1.0)           0;0  0.0239 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4932 (1.0)      1.4932 (1.0)      1.4932 (1.0)      0.0000 (1.0)      1.4932 (1.0)      0.0000 (1.0)           0;0  0.6697 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.8641 (2.59)     3.8641 (2.59)     3.8641 (2.59)     0.0000 (1.0)      3.8641 (2.59)     0.0000 (1.0)           0;0  0.2588 (0.39)          1           1
test_sharing_gs-fetch-noop[main]       7.0651 (4.73)     7.0651 (4.73)     7.0651 (4.73)     0.0000 (1.0)      7.0651 (4.73)     0.0000 (1.0)           0;0  0.1415 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     96.2628 (3.67)     96.2628 (3.67)     96.2628 (3.67)     0.0000 (1.0)      96.2628 (3.67)     0.0000 (1.0)           0;0  0.0104 (0.27)          1           1
test_sharing_gs-push[3.10.0]     48.5656 (1.85)     48.5656 (1.85)     48.5656 (1.85)     0.0000 (1.0)      48.5656 (1.85)     0.0000 (1.0)           0;0  0.0206 (0.54)          1           1
test_sharing_gs-push[main]       26.2089 (1.0)      26.2089 (1.0)      26.2089 (1.0)      0.0000 (1.0)      26.2089 (1.0)      0.0000 (1.0)           0;0  0.0382 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.5959 (1.0)      2.5959 (1.0)      2.5959 (1.0)      0.0000 (1.0)      2.5959 (1.0)      0.0000 (1.0)           0;0  0.3852 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.6962 (1.04)     2.6962 (1.04)     2.6962 (1.04)     0.0000 (1.0)      2.6962 (1.04)     0.0000 (1.0)           0;0  0.3709 (0.96)          1           1
test_sharing_gs-push-noop[main]       7.5422 (2.91)     7.5422 (2.91)     7.5422 (2.91)     0.0000 (1.0)      7.5422 (2.91)     0.0000 (1.0)           0;0  0.1326 (0.34)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     94.3118 (1.03)     94.3118 (1.03)     94.3118 (1.03)     0.0000 (1.0)      94.3118 (1.03)     0.0000 (1.0)           0;0  0.0106 (0.97)          1           1
test_sharing_s3-add[3.10.0]     93.8591 (1.02)     93.8591 (1.02)     93.8591 (1.02)     0.0000 (1.0)      93.8591 (1.02)     0.0000 (1.0)           0;0  0.0107 (0.98)          1           1
test_sharing_s3-add[main]       91.8800 (1.0)      91.8800 (1.0)      91.8800 (1.0)      0.0000 (1.0)      91.8800 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     62.7783 (1.08)     62.7783 (1.08)     62.7783 (1.08)     0.0000 (1.0)      62.7783 (1.08)     0.0000 (1.0)           0;0  0.0159 (0.93)          1           1
test_sharing_s3-add-noop[3.10.0]     62.1812 (1.07)     62.1812 (1.07)     62.1812 (1.07)     0.0000 (1.0)      62.1812 (1.07)     0.0000 (1.0)           0;0  0.0161 (0.94)          1           1
test_sharing_s3-add-noop[main]       58.3443 (1.0)      58.3443 (1.0)      58.3443 (1.0)      0.0000 (1.0)      58.3443 (1.0)      0.0000 (1.0)           0;0  0.0171 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.3893 (1.45)      42.3893 (1.45)      42.3893 (1.45)     0.0000 (1.0)       42.3893 (1.45)     0.0000 (1.0)           0;0  0.0236 (0.69)          1           1
test_sharing_s3-checkout[3.10.0]     104.6151 (3.58)     104.6151 (3.58)     104.6151 (3.58)     0.0000 (1.0)      104.6151 (3.58)     0.0000 (1.0)           0;0  0.0096 (0.28)          1           1
test_sharing_s3-checkout[main]        29.2058 (1.0)       29.2058 (1.0)       29.2058 (1.0)      0.0000 (1.0)       29.2058 (1.0)      0.0000 (1.0)           0;0  0.0342 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.7177 (1.05)     6.7177 (1.05)     6.7177 (1.05)     0.0000 (1.0)      6.7177 (1.05)     0.0000 (1.0)           0;0  0.1489 (0.95)          1           1
test_sharing_s3-checkout-noop[3.10.0]     6.9854 (1.10)     6.9854 (1.10)     6.9854 (1.10)     0.0000 (1.0)      6.9854 (1.10)     0.0000 (1.0)           0;0  0.1432 (0.91)          1           1
test_sharing_s3-checkout-noop[main]       6.3695 (1.0)      6.3695 (1.0)      6.3695 (1.0)      0.0000 (1.0)      6.3695 (1.0)      0.0000 (1.0)           0;0  0.1570 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests --------------------------------------------------------------------------------
Name (time in s)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     1,023.4553 (1.30)     1,023.4553 (1.30)     1,023.4553 (1.30)     0.0000 (1.0)      1,023.4553 (1.30)     0.0000 (1.0)           0;0  0.0010 (0.77)          1           1
test_sharing_s3-fetch[3.10.0]     1,237.1069 (1.57)     1,237.1069 (1.57)     1,237.1069 (1.57)     0.0000 (1.0)      1,237.1069 (1.57)     0.0000 (1.0)           0;0  0.0008 (0.64)          1           1
test_sharing_s3-fetch[main]         787.6365 (1.0)        787.6365 (1.0)        787.6365 (1.0)      0.0000 (1.0)        787.6365 (1.0)      0.0000 (1.0)           0;0  0.0013 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.6356 (1.0)      1.6356 (1.0)      1.6356 (1.0)      0.0000 (1.0)      1.6356 (1.0)      0.0000 (1.0)           0;0  0.6114 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     4.0663 (2.49)     4.0663 (2.49)     4.0663 (2.49)     0.0000 (1.0)      4.0663 (2.49)     0.0000 (1.0)           0;0  0.2459 (0.40)          1           1
test_sharing_s3-fetch-noop[main]       7.5822 (4.64)     7.5822 (4.64)     7.5822 (4.64)     0.0000 (1.0)      7.5822 (4.64)     0.0000 (1.0)           0;0  0.1319 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     1,198.1130 (1.00)     1,198.1130 (1.00)     1,198.1130 (1.00)     0.0000 (1.0)      1,198.1130 (1.00)     0.0000 (1.0)           0;0  0.0008 (1.00)          1           1
test_sharing_s3-push[3.10.0]     1,192.2420 (1.0)      1,192.2420 (1.0)      1,192.2420 (1.0)      0.0000 (1.0)      1,192.2420 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
test_sharing_s3-push[main]       1,227.8659 (1.03)     1,227.8659 (1.03)     1,227.8659 (1.03)     0.0000 (1.0)      1,227.8659 (1.03)     0.0000 (1.0)           0;0  0.0008 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.9537 (1.0)      2.9537 (1.0)      2.9537 (1.0)      0.0000 (1.0)      2.9537 (1.0)      0.0000 (1.0)           0;0  0.3386 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     3.1936 (1.08)     3.1936 (1.08)     3.1936 (1.08)     0.0000 (1.0)      3.1936 (1.08)     0.0000 (1.0)           0;0  0.3131 (0.92)          1           1
test_sharing_s3-push-noop[main]       8.4511 (2.86)     8.4511 (2.86)     8.4511 (2.86)     0.0000 (1.0)      8.4511 (2.86)     0.0000 (1.0)           0;0  0.1183 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.4965 (1.0)      21.4965 (1.0)      21.4965 (1.0)      0.0000 (1.0)      21.4965 (1.0)      0.0000 (1.0)           0;0  0.0465 (1.0)           1           1
test_status-status[3.10.0]     22.0747 (1.03)     22.0747 (1.03)     22.0747 (1.03)     0.0000 (1.0)      22.0747 (1.03)     0.0000 (1.0)           0;0  0.0453 (0.97)          1           1
test_status-status[main]       21.6511 (1.01)     21.6511 (1.01)     21.6511 (1.01)     0.0000 (1.0)      21.6511 (1.01)     0.0000 (1.0)           0;0  0.0462 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.6042 (1.0)      5.6042 (1.0)      5.6042 (1.0)      0.0000 (1.0)      5.6042 (1.0)      0.0000 (1.0)           0;0  0.1784 (1.0)           1           1
test_status-status-changed[3.10.0]     5.7889 (1.03)     5.7889 (1.03)     5.7889 (1.03)     0.0000 (1.0)      5.7889 (1.03)     0.0000 (1.0)           0;0  0.1727 (0.97)          1           1
test_status-status-changed[main]       5.8780 (1.05)     5.8780 (1.05)     5.8780 (1.05)     0.0000 (1.0)      5.8780 (1.05)     0.0000 (1.0)           0;0  0.1701 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.5691 (1.0)      5.5691 (1.0)      5.5691 (1.0)      0.0000 (1.0)      5.5691 (1.0)      0.0000 (1.0)           0;0  0.1796 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.7574 (1.03)     5.7574 (1.03)     5.7574 (1.03)     0.0000 (1.0)      5.7574 (1.03)     0.0000 (1.0)           0;0  0.1737 (0.97)          1           1
test_status-status-changed-noop[main]       5.5698 (1.00)     5.5698 (1.00)     5.5698 (1.00)     0.0000 (1.0)      5.5698 (1.00)     0.0000 (1.0)           0;0  0.1795 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7034 (1.02)     5.7034 (1.02)     5.7034 (1.02)     0.0000 (1.0)      5.7034 (1.02)     0.0000 (1.0)           0;0  0.1753 (0.98)          1           1
test_status-status-noop[3.10.0]     5.8688 (1.05)     5.8688 (1.05)     5.8688 (1.05)     0.0000 (1.0)      5.8688 (1.05)     0.0000 (1.0)           0;0  0.1704 (0.95)          1           1
test_status-status-noop[main]       5.5922 (1.0)      5.5922 (1.0)      5.5922 (1.0)      0.0000 (1.0)      5.5922 (1.0)      0.0000 (1.0)           0;0  0.1788 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     213.7710 (1.54)     213.7710 (1.54)     213.7710 (1.54)     0.0000 (1.0)      213.7710 (1.54)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_update-import-url[3.10.0]     216.7607 (1.56)     216.7607 (1.56)     216.7607 (1.56)     0.0000 (1.0)      216.7607 (1.56)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_update-import-url[main]       138.5181 (1.0)      138.5181 (1.0)      138.5181 (1.0)      0.0000 (1.0)      138.5181 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     196.8157 (1.62)     196.8157 (1.62)     196.8157 (1.62)     0.0000 (1.0)      196.8157 (1.62)     0.0000 (1.0)           0;0  0.0051 (0.62)          1           1
test_update-update[3.10.0]     202.1489 (1.66)     202.1489 (1.66)     202.1489 (1.66)     0.0000 (1.0)      202.1489 (1.66)     0.0000 (1.0)           0;0  0.0049 (0.60)          1           1
test_update-update[main]       121.7410 (1.0)      121.7410 (1.0)      121.7410 (1.0)      0.0000 (1.0)      121.7410 (1.0)      0.0000 (1.0)           0;0  0.0082 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     20.1968 (1.03)     20.1968 (1.03)     20.1968 (1.03)     0.0000 (1.0)      20.1968 (1.03)     0.0000 (1.0)           0;0  0.0495 (0.97)          1           1
test_update-update-noop[3.10.0]     21.2197 (1.08)     21.2197 (1.08)     21.2197 (1.08)     0.0000 (1.0)      21.2197 (1.08)     0.0000 (1.0)           0;0  0.0471 (0.92)          1           1
test_update-update-noop[main]       19.5882 (1.0)      19.5882 (1.0)      19.5882 (1.0)      0.0000 (1.0)      19.5882 (1.0)      0.0000 (1.0)           0;0  0.0511 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean