Mon Apr 29 02:29:34 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     94.3521 (1.01)     94.3521 (1.01)     94.3521 (1.01)     0.0000 (1.0)      94.3521 (1.01)     0.0000 (1.0)           0;0  0.0106 (0.99)          1           1
test_add-add[3.10.0]     97.1707 (1.04)     97.1707 (1.04)     97.1707 (1.04)     0.0000 (1.0)      97.1707 (1.04)     0.0000 (1.0)           0;0  0.0103 (0.96)          1           1
test_add-add[main]       93.5092 (1.0)      93.5092 (1.0)      93.5092 (1.0)      0.0000 (1.0)      93.5092 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      44.5178 (1.36)      44.5178 (1.36)      44.5178 (1.36)     0.0000 (1.0)       44.5178 (1.36)     0.0000 (1.0)           0;0  0.0225 (0.73)          1           1
test_checkout_copy-checkout[3.10.0]     106.6617 (3.27)     106.6617 (3.27)     106.6617 (3.27)     0.0000 (1.0)      106.6617 (3.27)     0.0000 (1.0)           0;0  0.0094 (0.31)          1           1
test_checkout_copy-checkout[main]        32.6650 (1.0)       32.6650 (1.0)       32.6650 (1.0)      0.0000 (1.0)       32.6650 (1.0)      0.0000 (1.0)           0;0  0.0306 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.9020 (1.02)     6.9020 (1.02)     6.9020 (1.02)     0.0000 (1.0)      6.9020 (1.02)     0.0000 (1.0)           0;0  0.1449 (0.98)          1           1
test_checkout_copy-checkout-noop[3.10.0]     7.0360 (1.04)     7.0360 (1.04)     7.0360 (1.04)     0.0000 (1.0)      7.0360 (1.04)     0.0000 (1.0)           0;0  0.1421 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       6.7560 (1.0)      6.7560 (1.0)      6.7560 (1.0)      0.0000 (1.0)      6.7560 (1.0)      0.0000 (1.0)           0;0  0.1480 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.9503 (1.45)     10.9503 (1.45)     10.9503 (1.45)     0.0000 (1.0)      10.9503 (1.45)     0.0000 (1.0)           0;0  0.0913 (0.69)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.7365 (1.02)      7.7365 (1.02)      7.7365 (1.02)     0.0000 (1.0)       7.7365 (1.02)     0.0000 (1.0)           0;0  0.1293 (0.98)          1           1
test_checkout_copy-checkout-update[main]        7.5490 (1.0)       7.5490 (1.0)       7.5490 (1.0)      0.0000 (1.0)       7.5490 (1.0)      0.0000 (1.0)           0;0  0.1325 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     26.0106 (1.43)     26.0106 (1.43)     26.0106 (1.43)     0.0000 (1.0)      26.0106 (1.43)     0.0000 (1.0)           0;0  0.0384 (0.70)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.3506 (1.01)     18.3506 (1.01)     18.3506 (1.01)     0.0000 (1.0)      18.3506 (1.01)     0.0000 (1.0)           0;0  0.0545 (0.99)          1           1
test_checkout_hardlink-checkout[main]       18.2225 (1.0)      18.2225 (1.0)      18.2225 (1.0)      0.0000 (1.0)      18.2225 (1.0)      0.0000 (1.0)           0;0  0.0549 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.6234 (1.04)     6.6234 (1.04)     6.6234 (1.04)     0.0000 (1.0)      6.6234 (1.04)     0.0000 (1.0)           0;0  0.1510 (0.96)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.7937 (1.07)     6.7937 (1.07)     6.7937 (1.07)     0.0000 (1.0)      6.7937 (1.07)     0.0000 (1.0)           0;0  0.1472 (0.94)          1           1
test_checkout_hardlink-checkout-noop[main]       6.3780 (1.0)      6.3780 (1.0)      6.3780 (1.0)      0.0000 (1.0)      6.3780 (1.0)      0.0000 (1.0)           0;0  0.1568 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.4515 (1.42)     10.4515 (1.42)     10.4515 (1.42)     0.0000 (1.0)      10.4515 (1.42)     0.0000 (1.0)           0;0  0.0957 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.5375 (1.02)      7.5375 (1.02)      7.5375 (1.02)     0.0000 (1.0)       7.5375 (1.02)     0.0000 (1.0)           0;0  0.1327 (0.98)          1           1
test_checkout_hardlink-checkout-update[main]        7.3601 (1.0)       7.3601 (1.0)       7.3601 (1.0)      0.0000 (1.0)       7.3601 (1.0)      0.0000 (1.0)           0;0  0.1359 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.1201 (1.30)     30.1201 (1.30)     30.1201 (1.30)     0.0000 (1.0)      30.1201 (1.30)     0.0000 (1.0)           0;0  0.0332 (0.77)          1           1
test_checkout_symlink-checkout[3.10.0]     23.2913 (1.00)     23.2913 (1.00)     23.2913 (1.00)     0.0000 (1.0)      23.2913 (1.00)     0.0000 (1.0)           0;0  0.0429 (1.00)          1           1
test_checkout_symlink-checkout[main]       23.2156 (1.0)      23.2156 (1.0)      23.2156 (1.0)      0.0000 (1.0)      23.2156 (1.0)      0.0000 (1.0)           0;0  0.0431 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.3390 (1.01)     8.3390 (1.01)     8.3390 (1.01)     0.0000 (1.0)      8.3390 (1.01)     0.0000 (1.0)           0;0  0.1199 (0.99)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.7278 (1.06)     8.7278 (1.06)     8.7278 (1.06)     0.0000 (1.0)      8.7278 (1.06)     0.0000 (1.0)           0;0  0.1146 (0.95)          1           1
test_checkout_symlink-checkout-noop[main]       8.2589 (1.0)      8.2589 (1.0)      8.2589 (1.0)      0.0000 (1.0)      8.2589 (1.0)      0.0000 (1.0)           0;0  0.1211 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     13.3734 (1.31)     13.3734 (1.31)     13.3734 (1.31)     0.0000 (1.0)      13.3734 (1.31)     0.0000 (1.0)           0;0  0.0748 (0.76)          1           1
test_checkout_symlink-checkout-update[3.10.0]     10.3830 (1.01)     10.3830 (1.01)     10.3830 (1.01)     0.0000 (1.0)      10.3830 (1.01)     0.0000 (1.0)           0;0  0.0963 (0.99)          1           1
test_checkout_symlink-checkout-update[main]       10.2305 (1.0)      10.2305 (1.0)      10.2305 (1.0)      0.0000 (1.0)      10.2305 (1.0)      0.0000 (1.0)           0;0  0.0977 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.6208 (1.0)      4.6208 (1.0)      4.6208 (1.0)      0.0000 (1.0)      4.6208 (1.0)      0.0000 (1.0)           0;0  0.2164 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.4162 (1.17)     5.4162 (1.17)     5.4162 (1.17)     0.0000 (1.0)      5.4162 (1.17)     0.0000 (1.0)           0;0  0.1846 (0.85)          1           1
test_data_status-data-changed[main]       5.2092 (1.13)     5.2092 (1.13)     5.2092 (1.13)     0.0000 (1.0)      5.2092 (1.13)     0.0000 (1.0)           0;0  0.1920 (0.89)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8172 (1.0)      4.8172 (1.0)      4.8172 (1.0)      0.0000 (1.0)      4.8172 (1.0)      0.0000 (1.0)           0;0  0.2076 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.3361 (1.11)     5.3361 (1.11)     5.3361 (1.11)     0.0000 (1.0)      5.3361 (1.11)     0.0000 (1.0)           0;0  0.1874 (0.90)          1           1
test_data_status-data-changed-noop[main]       5.2728 (1.09)     5.2728 (1.09)     5.2728 (1.09)     0.0000 (1.0)      5.2728 (1.09)     0.0000 (1.0)           0;0  0.1897 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.7898 (1.0)      19.7898 (1.0)      19.7898 (1.0)      0.0000 (1.0)      19.7898 (1.0)      0.0000 (1.0)           0;0  0.0505 (1.0)           1           1
test_data_status-data-new[3.10.0]     20.5811 (1.04)     20.5811 (1.04)     20.5811 (1.04)     0.0000 (1.0)      20.5811 (1.04)     0.0000 (1.0)           0;0  0.0486 (0.96)          1           1
test_data_status-data-new[main]       20.8149 (1.05)     20.8149 (1.05)     20.8149 (1.05)     0.0000 (1.0)      20.8149 (1.05)     0.0000 (1.0)           0;0  0.0480 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.7912 (1.0)      4.7912 (1.0)      4.7912 (1.0)      0.0000 (1.0)      4.7912 (1.0)      0.0000 (1.0)           0;0  0.2087 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.5103 (1.15)     5.5103 (1.15)     5.5103 (1.15)     0.0000 (1.0)      5.5103 (1.15)     0.0000 (1.0)           0;0  0.1815 (0.87)          1           1
test_data_status-data-noop[main]       5.3778 (1.12)     5.3778 (1.12)     5.3778 (1.12)     0.0000 (1.0)      5.3778 (1.12)     0.0000 (1.0)           0;0  0.1859 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     18.8472 (1.0)      18.8472 (1.0)      18.8472 (1.0)      0.0000 (1.0)      18.8472 (1.0)      0.0000 (1.0)           0;0  0.0531 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     20.0749 (1.07)     20.0749 (1.07)     20.0749 (1.07)     0.0000 (1.0)      20.0749 (1.07)     0.0000 (1.0)           0;0  0.0498 (0.94)          1           1
test_data_status_all_flags-data-changed[main]       19.6983 (1.05)     19.6983 (1.05)     19.6983 (1.05)     0.0000 (1.0)      19.6983 (1.05)     0.0000 (1.0)           0;0  0.0508 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.2018 (1.0)      19.2018 (1.0)      19.2018 (1.0)      0.0000 (1.0)      19.2018 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.6505 (1.02)     19.6505 (1.02)     19.6505 (1.02)     0.0000 (1.0)      19.6505 (1.02)     0.0000 (1.0)           0;0  0.0509 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       20.1173 (1.05)     20.1173 (1.05)     20.1173 (1.05)     0.0000 (1.0)      20.1173 (1.05)     0.0000 (1.0)           0;0  0.0497 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.9432 (1.0)      34.9432 (1.0)      34.9432 (1.0)      0.0000 (1.0)      34.9432 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     36.2404 (1.04)     36.2404 (1.04)     36.2404 (1.04)     0.0000 (1.0)      36.2404 (1.04)     0.0000 (1.0)           0;0  0.0276 (0.96)          1           1
test_data_status_all_flags-data-new[main]       35.6998 (1.02)     35.6998 (1.02)     35.6998 (1.02)     0.0000 (1.0)      35.6998 (1.02)     0.0000 (1.0)           0;0  0.0280 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.1653 (1.0)      18.1653 (1.0)      18.1653 (1.0)      0.0000 (1.0)      18.1653 (1.0)      0.0000 (1.0)           0;0  0.0551 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     19.3952 (1.07)     19.3952 (1.07)     19.3952 (1.07)     0.0000 (1.0)      19.3952 (1.07)     0.0000 (1.0)           0;0  0.0516 (0.94)          1           1
test_data_status_all_flags-data-noop[main]       18.7832 (1.03)     18.7832 (1.03)     18.7832 (1.03)     0.0000 (1.0)      18.7832 (1.03)     0.0000 (1.0)           0;0  0.0532 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     21.2010 (1.0)      21.2010 (1.0)      21.2010 (1.0)      0.0000 (1.0)      21.2010 (1.0)      0.0000 (1.0)           0;0  0.0472 (1.0)           1           1
test_diff-diff[3.10.0]     21.5237 (1.02)     21.5237 (1.02)     21.5237 (1.02)     0.0000 (1.0)      21.5237 (1.02)     0.0000 (1.0)           0;0  0.0465 (0.99)          1           1
test_diff-diff[main]       24.2947 (1.15)     24.2947 (1.15)     24.2947 (1.15)     0.0000 (1.0)      24.2947 (1.15)     0.0000 (1.0)           0;0  0.0412 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.4347 (1.12)     7.4347 (1.12)     7.4347 (1.12)     0.0000 (1.0)      7.4347 (1.12)     0.0000 (1.0)           0;0  0.1345 (0.89)          1           1
test_diff-diff-changed[3.10.0]     8.1501 (1.23)     8.1501 (1.23)     8.1501 (1.23)     0.0000 (1.0)      8.1501 (1.23)     0.0000 (1.0)           0;0  0.1227 (0.81)          1           1
test_diff-diff-changed[main]       6.6164 (1.0)      6.6164 (1.0)      6.6164 (1.0)      0.0000 (1.0)      6.6164 (1.0)      0.0000 (1.0)           0;0  0.1511 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.3600 (1.0)      6.3600 (1.0)      6.3600 (1.0)      0.0000 (1.0)      6.3600 (1.0)      0.0000 (1.0)           0;0  0.1572 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     7.0768 (1.11)     7.0768 (1.11)     7.0768 (1.11)     0.0000 (1.0)      7.0768 (1.11)     0.0000 (1.0)           0;0  0.1413 (0.90)          1           1
test_diff-diff-changed-noop[main]       6.6758 (1.05)     6.6758 (1.05)     6.6758 (1.05)     0.0000 (1.0)      6.6758 (1.05)     0.0000 (1.0)           0;0  0.1498 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     5.0528 (1.0)      5.0528 (1.0)      5.0528 (1.0)      0.0000 (1.0)      5.0528 (1.0)      0.0000 (1.0)           0;0  0.1979 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.6157 (1.11)     5.6157 (1.11)     5.6157 (1.11)     0.0000 (1.0)      5.6157 (1.11)     0.0000 (1.0)           0;0  0.1781 (0.90)          1           1
test_diff-diff-noop[main]       6.7563 (1.34)     6.7563 (1.34)     6.7563 (1.34)     0.0000 (1.0)      6.7563 (1.34)     0.0000 (1.0)           0;0  0.1480 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       859.0748 (1.0)        859.0748 (1.0)        859.0748 (1.0)      0.0000 (1.0)        859.0748 (1.0)      0.0000 (1.0)           0;0  1.1640 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,921.0336 (5.73)     4,921.0336 (5.73)     4,921.0336 (5.73)     0.0000 (1.0)      4,921.0336 (5.73)     0.0000 (1.0)           0;0  0.2032 (0.17)          1           1
test_exp_show-exp[main]       4,583.8543 (5.34)     4,583.8543 (5.34)     4,583.8543 (5.34)     0.0000 (1.0)      4,583.8543 (5.34)     0.0000 (1.0)           0;0  0.2182 (0.19)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     112.9233 (2.89)     112.9233 (2.89)     112.9233 (2.89)     0.0000 (1.0)      112.9233 (2.89)     0.0000 (1.0)           0;0  0.0089 (0.35)          1           1
test_fetch-fetch[3.10.0]     117.3315 (3.00)     117.3315 (3.00)     117.3315 (3.00)     0.0000 (1.0)      117.3315 (3.00)     0.0000 (1.0)           0;0  0.0085 (0.33)          1           1
test_fetch-fetch[main]        39.1227 (1.0)       39.1227 (1.0)       39.1227 (1.0)      0.0000 (1.0)       39.1227 (1.0)      0.0000 (1.0)           0;0  0.0256 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.3064 (1.00)     3.3064 (1.00)     3.3064 (1.00)     0.0000 (1.0)      3.3064 (1.00)     0.0000 (1.0)           0;0  0.3024 (1.00)          1           1
test_gc-gc[3.10.0]     3.3019 (1.0)      3.3019 (1.0)      3.3019 (1.0)      0.0000 (1.0)      3.3019 (1.0)      0.0000 (1.0)           0;0  0.3029 (1.0)           1           1
test_gc-gc[main]       3.4737 (1.05)     3.4737 (1.05)     3.4737 (1.05)     0.0000 (1.0)      3.4737 (1.05)     0.0000 (1.0)           0;0  0.2879 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     183.2084 (1.12)     183.2084 (1.12)     183.2084 (1.12)     0.0000 (1.0)      183.2084 (1.12)     0.0000 (1.0)           0;0  0.0055 (0.89)          1           1
test_get-get[3.10.0]     221.1909 (1.35)     221.1909 (1.35)     221.1909 (1.35)     0.0000 (1.0)      221.1909 (1.35)     0.0000 (1.0)           0;0  0.0045 (0.74)          1           1
test_get-get[main]       163.2980 (1.0)      163.2980 (1.0)      163.2980 (1.0)      0.0000 (1.0)      163.2980 (1.0)      0.0000 (1.0)           0;0  0.0061 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.4160 (5.07)     85.4160 (5.07)     85.4160 (5.07)     0.0000 (1.0)      85.4160 (5.07)     0.0000 (1.0)           0;0  0.0117 (0.20)          1           1
test_get_url-get-url[3.10.0]     89.5929 (5.32)     89.5929 (5.32)     89.5929 (5.32)     0.0000 (1.0)      89.5929 (5.32)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[main]       16.8563 (1.0)      16.8563 (1.0)      16.8563 (1.0)      0.0000 (1.0)      16.8563 (1.0)      0.0000 (1.0)           0;0  0.0593 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.8163 (1.00)     136.4198 (1.02)     128.7297 (1.01)     1.9244 (1.32)     128.0846 (1.01)     2.5374 (2.03)         23;4  7.7682 (0.99)        100           1
test_help---help[3.10.0]     125.3354 (1.0)      133.1645 (1.0)      127.2514 (1.0)      1.4629 (1.0)      126.9137 (1.0)      1.2508 (1.0)          20;6  7.8585 (1.0)         100           1
test_help---help[main]       126.0421 (1.01)     142.8751 (1.07)     128.7737 (1.01)     2.4990 (1.71)     128.0057 (1.01)     1.8323 (1.46)          9;8  7.7656 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     284.9498 (1.08)     284.9498 (1.08)     284.9498 (1.08)     0.0000 (1.0)      284.9498 (1.08)     0.0000 (1.0)           0;0  0.0035 (0.92)          1           1
test_import-import[3.10.0]     320.8623 (1.22)     320.8623 (1.22)     320.8623 (1.22)     0.0000 (1.0)      320.8623 (1.22)     0.0000 (1.0)           0;0  0.0031 (0.82)          1           1
test_import-import[main]       263.1023 (1.0)      263.1023 (1.0)      263.1023 (1.0)      0.0000 (1.0)      263.1023 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     211.9816 (1.54)     211.9816 (1.54)     211.9816 (1.54)     0.0000 (1.0)      211.9816 (1.54)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_import_url-import-url[3.10.0]     215.1433 (1.56)     215.1433 (1.56)     215.1433 (1.56)     0.0000 (1.0)      215.1433 (1.56)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_import_url-import-url[main]       137.6907 (1.0)      137.6907 (1.0)      137.6907 (1.0)      0.0000 (1.0)      137.6907 (1.0)      0.0000 (1.0)           0;0  0.0073 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     368.8344 (1.0)      421.0053 (1.0)      376.7025 (1.0)       7.1985 (1.0)      375.5792 (1.0)      5.1697 (1.01)          7;3  2.6546 (1.0)         100           1
test_init-init[3.10.0]     374.4697 (1.02)     440.5989 (1.05)     384.0936 (1.02)      7.9285 (1.10)     382.1941 (1.02)     5.1394 (1.0)          12;6  2.6035 (0.98)        100           1
test_init-init[main]       373.8250 (1.01)     460.6773 (1.09)     386.2018 (1.03)     10.2722 (1.43)     384.3189 (1.02)     7.9221 (1.54)         12;7  2.5893 (0.98)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     428.4098 (1.10)     428.4098 (1.10)     428.4098 (1.10)     0.0000 (1.0)      428.4098 (1.10)     0.0000 (1.0)           0;0  2.3342 (0.91)          1           1
test_list-list[3.10.0]     420.5842 (1.08)     420.5842 (1.08)     420.5842 (1.08)     0.0000 (1.0)      420.5842 (1.08)     0.0000 (1.0)           0;0  2.3776 (0.92)          1           1
test_list-list[main]       388.2374 (1.0)      388.2374 (1.0)      388.2374 (1.0)      0.0000 (1.0)      388.2374 (1.0)      0.0000 (1.0)           0;0  2.5757 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     413.7430 (1.08)     413.7430 (1.08)     413.7430 (1.08)     0.0000 (1.0)      413.7430 (1.08)     0.0000 (1.0)           0;0  2.4170 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     400.1723 (1.05)     400.1723 (1.05)     400.1723 (1.05)     0.0000 (1.0)      400.1723 (1.05)     0.0000 (1.0)           0;0  2.4989 (0.96)          1           1
test_list-list-dvc-only[main]       382.6975 (1.0)      382.6975 (1.0)      382.6975 (1.0)      0.0000 (1.0)      382.6975 (1.0)      0.0000 (1.0)           0;0  2.6130 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.2453 (1.01)     3.2453 (1.01)     3.2453 (1.01)     0.0000 (1.0)      3.2453 (1.01)     0.0000 (1.0)           0;0  0.3081 (0.99)          1           1
test_list-list-recursive[3.10.0]     3.2542 (1.02)     3.2542 (1.02)     3.2542 (1.02)     0.0000 (1.0)      3.2542 (1.02)     0.0000 (1.0)           0;0  0.3073 (0.98)          1           1
test_list-list-recursive[main]       3.1984 (1.0)      3.1984 (1.0)      3.1984 (1.0)      0.0000 (1.0)      3.1984 (1.0)      0.0000 (1.0)           0;0  0.3127 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     413.9220 (1.09)     413.9220 (1.09)     413.9220 (1.09)     0.0000 (1.0)      413.9220 (1.09)     0.0000 (1.0)           0;0  2.4159 (0.92)          1           1
test_list-list-shallow[3.10.0]     401.9100 (1.06)     401.9100 (1.06)     401.9100 (1.06)     0.0000 (1.0)      401.9100 (1.06)     0.0000 (1.0)           0;0  2.4881 (0.94)          1           1
test_list-list-shallow[main]       378.8856 (1.0)      378.8856 (1.0)      378.8856 (1.0)      0.0000 (1.0)      378.8856 (1.0)      0.0000 (1.0)           0;0  2.6393 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     79.7086 (1.03)     79.7086 (1.03)     79.7086 (1.03)     0.0000 (1.0)      79.7086 (1.03)     0.0000 (1.0)           0;0  0.0125 (0.97)          1           1
test_partial_add-add[3.10.0]     81.5092 (1.05)     81.5092 (1.05)     81.5092 (1.05)     0.0000 (1.0)      81.5092 (1.05)     0.0000 (1.0)           0;0  0.0123 (0.95)          1           1
test_partial_add-add[main]       77.7043 (1.0)      77.7043 (1.0)      77.7043 (1.0)      0.0000 (1.0)      77.7043 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     66.9304 (1.04)     66.9304 (1.04)     66.9304 (1.04)     0.0000 (1.0)      66.9304 (1.04)     0.0000 (1.0)           0;0  0.0149 (0.96)          1           1
test_partial_add-add-partial[3.10.0]     69.3050 (1.08)     69.3050 (1.08)     69.3050 (1.08)     0.0000 (1.0)      69.3050 (1.08)     0.0000 (1.0)           0;0  0.0144 (0.93)          1           1
test_partial_add-add-partial[main]       64.4601 (1.0)      64.4601 (1.0)      64.4601 (1.0)      0.0000 (1.0)      64.4601 (1.0)      0.0000 (1.0)           0;0  0.0155 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.3857 (1.0)      6.3857 (1.0)      6.3857 (1.0)      0.0000 (1.0)      6.3857 (1.0)      0.0000 (1.0)           0;0  0.1566 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     8.6889 (1.36)     8.6889 (1.36)     8.6889 (1.36)     0.0000 (1.0)      8.6889 (1.36)     0.0000 (1.0)           0;0  0.1151 (0.73)          1           1
test_partial_add-gc-cloud-noop[main]       9.8325 (1.54)     9.8325 (1.54)     9.8325 (1.54)     0.0000 (1.0)      9.8325 (1.54)     0.0000 (1.0)           0;0  0.1017 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.6600 (1.0)      3.6600 (1.0)      3.6600 (1.0)      0.0000 (1.0)      3.6600 (1.0)      0.0000 (1.0)           0;0  0.2732 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.6898 (1.55)     5.6898 (1.55)     5.6898 (1.55)     0.0000 (1.0)      5.6898 (1.55)     0.0000 (1.0)           0;0  0.1758 (0.64)          1           1
test_partial_add-gc-noop[main]       5.6699 (1.55)     5.6699 (1.55)     5.6699 (1.55)     0.0000 (1.0)      5.6699 (1.55)     0.0000 (1.0)           0;0  0.1764 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     80.6573 (3.74)     80.6573 (3.74)     80.6573 (3.74)     0.0000 (1.0)      80.6573 (3.74)     0.0000 (1.0)           0;0  0.0124 (0.27)          1           1
test_partial_add-push[3.10.0]     40.6752 (1.88)     40.6752 (1.88)     40.6752 (1.88)     0.0000 (1.0)      40.6752 (1.88)     0.0000 (1.0)           0;0  0.0246 (0.53)          1           1
test_partial_add-push[main]       21.5871 (1.0)      21.5871 (1.0)      21.5871 (1.0)      0.0000 (1.0)      21.5871 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.9867 (1.58)     17.9867 (1.58)     17.9867 (1.58)     0.0000 (1.0)      17.9867 (1.58)     0.0000 (1.0)           0;0  0.0556 (0.63)          1           1
test_partial_add-push-partial[3.10.0]     11.3652 (1.0)      11.3652 (1.0)      11.3652 (1.0)      0.0000 (1.0)      11.3652 (1.0)      0.0000 (1.0)           0;0  0.0880 (1.0)           1           1
test_partial_add-push-partial[main]       11.8966 (1.05)     11.8966 (1.05)     11.8966 (1.05)     0.0000 (1.0)      11.8966 (1.05)     0.0000 (1.0)           0;0  0.0841 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     96.0319 (1.04)     96.0319 (1.04)     96.0319 (1.04)     0.0000 (1.0)      96.0319 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_partial_remove-add[3.10.0]     95.8559 (1.04)     95.8559 (1.04)     95.8559 (1.04)     0.0000 (1.0)      95.8559 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_partial_remove-add[main]       92.5365 (1.0)      92.5365 (1.0)      92.5365 (1.0)      0.0000 (1.0)      92.5365 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.2285 (1.07)     9.2285 (1.07)     9.2285 (1.07)     0.0000 (1.0)      9.2285 (1.07)     0.0000 (1.0)           0;0  0.1084 (0.93)          1           1
test_partial_remove-add-update[3.10.0]     9.4371 (1.10)     9.4371 (1.10)     9.4371 (1.10)     0.0000 (1.0)      9.4371 (1.10)     0.0000 (1.0)           0;0  0.1060 (0.91)          1           1
test_partial_remove-add-update[main]       8.5960 (1.0)      8.5960 (1.0)      8.5960 (1.0)      0.0000 (1.0)      8.5960 (1.0)      0.0000 (1.0)           0;0  0.1163 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.2653 (1.0)      4.2653 (1.0)      4.2653 (1.0)      0.0000 (1.0)      4.2653 (1.0)      0.0000 (1.0)           0;0  0.2344 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.8241 (1.13)     4.8241 (1.13)     4.8241 (1.13)     0.0000 (1.0)      4.8241 (1.13)     0.0000 (1.0)           0;0  0.2073 (0.88)          1           1
test_partial_remove-gc[main]       4.9965 (1.17)     4.9965 (1.17)     4.9965 (1.17)     0.0000 (1.0)      4.9965 (1.17)     0.0000 (1.0)           0;0  0.2001 (0.85)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.8501 (1.0)      5.8501 (1.0)      5.8501 (1.0)      0.0000 (1.0)      5.8501 (1.0)      0.0000 (1.0)           0;0  0.1709 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.6017 (1.13)     6.6017 (1.13)     6.6017 (1.13)     0.0000 (1.0)      6.6017 (1.13)     0.0000 (1.0)           0;0  0.1515 (0.89)          1           1
test_partial_remove-gc-cloud[main]       6.2688 (1.07)     6.2688 (1.07)     6.2688 (1.07)     0.0000 (1.0)      6.2688 (1.07)     0.0000 (1.0)           0;0  0.1595 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     95.1640 (3.87)     95.1640 (3.87)     95.1640 (3.87)     0.0000 (1.0)      95.1640 (3.87)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_partial_remove-push[3.10.0]     47.7398 (1.94)     47.7398 (1.94)     47.7398 (1.94)     0.0000 (1.0)      47.7398 (1.94)     0.0000 (1.0)           0;0  0.0209 (0.51)          1           1
test_partial_remove-push[main]       24.5852 (1.0)      24.5852 (1.0)      24.5852 (1.0)      0.0000 (1.0)      24.5852 (1.0)      0.0000 (1.0)           0;0  0.0407 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0580 (1.03)     2.0580 (1.03)     2.0580 (1.03)     0.0000 (1.0)      2.0580 (1.03)     0.0000 (1.0)           0;0  0.4859 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     1.9898 (1.0)      1.9898 (1.0)      1.9898 (1.0)      0.0000 (1.0)      1.9898 (1.0)      0.0000 (1.0)           0;0  0.5026 (1.0)           1           1
test_partial_remove-push-update[main]       2.7941 (1.40)     2.7941 (1.40)     2.7941 (1.40)     0.0000 (1.0)      2.7941 (1.40)     0.0000 (1.0)           0;0  0.3579 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     424.3257 (1.0)      428.7524 (1.0)      425.6938 (1.0)      1.8808 (1.0)      424.8015 (1.0)      2.5326 (1.0)           1;0  2.3491 (1.0)           5           3
test_plots-plots-diff[3.10.0]     785.3623 (1.85)     790.7110 (1.84)     788.7028 (1.85)     2.0998 (1.12)     788.9913 (1.86)     2.7667 (1.09)          1;0  1.2679 (0.54)          5           3
test_plots-plots-diff[main]       744.0066 (1.75)     750.9589 (1.75)     748.2280 (1.76)     3.6436 (1.94)     750.8145 (1.77)     6.5444 (2.58)          2;0  1.3365 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       437.1264 (1.0)        454.1012 (1.0)        441.7988 (1.0)      7.0282 (2.53)       439.5797 (1.0)      6.5767 (1.57)          1;1  2.2635 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,030.8091 (2.36)     1,037.9289 (2.29)     1,034.3398 (2.34)     2.7777 (1.0)      1,034.7875 (2.35)     4.1957 (1.0)           2;0  0.9668 (0.43)          5           3
test_plots-plots-diff-json[main]         817.7597 (1.87)       829.4094 (1.83)       824.6802 (1.87)     4.5764 (1.65)       825.5286 (1.88)     6.5702 (1.57)          2;0  1.2126 (0.54)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     389.0667 (1.0)      393.0182 (1.0)      391.1963 (1.0)      1.5536 (1.0)      391.5889 (1.0)      2.3470 (1.0)           2;0  2.5563 (1.0)           5           3
test_plots-plots-show[3.10.0]     650.7241 (1.67)     655.0426 (1.67)     652.9042 (1.67)     1.7503 (1.13)     652.9017 (1.67)     2.8945 (1.23)          2;0  1.5316 (0.60)          5           3
test_plots-plots-show[main]       628.9403 (1.62)     634.0483 (1.61)     631.8182 (1.62)     2.4191 (1.56)     632.5327 (1.62)     4.5702 (1.95)          1;0  1.5827 (0.62)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     402.7655 (1.0)      412.7244 (1.0)      405.6758 (1.0)      4.0684 (1.31)     404.9157 (1.0)      3.9010 (1.0)           1;0  2.4650 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     791.1716 (1.96)     798.9719 (1.94)     795.8693 (1.96)     3.1170 (1.0)      797.1571 (1.97)     4.4291 (1.14)          1;0  1.2565 (0.51)          5           3
test_plots-plots-show-json[main]       673.6605 (1.67)     683.3484 (1.66)     678.5790 (1.67)     3.9289 (1.26)     678.5430 (1.68)     6.5009 (1.67)          2;0  1.4737 (0.60)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     93.8597 (3.87)     93.8597 (3.87)     93.8597 (3.87)     0.0000 (1.0)      93.8597 (3.87)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_push-push[3.10.0]     48.1124 (1.98)     48.1124 (1.98)     48.1124 (1.98)     0.0000 (1.0)      48.1124 (1.98)     0.0000 (1.0)           0;0  0.0208 (0.50)          1           1
test_push-push[main]       24.2618 (1.0)      24.2618 (1.0)      24.2618 (1.0)      0.0000 (1.0)      24.2618 (1.0)      0.0000 (1.0)           0;0  0.0412 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     95.6906 (1.05)     95.6906 (1.05)     95.6906 (1.05)     0.0000 (1.0)      95.6906 (1.05)     0.0000 (1.0)           0;0  0.0105 (0.95)          1           1
test_sharing-add[3.10.0]     96.2288 (1.06)     96.2288 (1.06)     96.2288 (1.06)     0.0000 (1.0)      96.2288 (1.06)     0.0000 (1.0)           0;0  0.0104 (0.95)          1           1
test_sharing-add[main]       91.1347 (1.0)      91.1347 (1.0)      91.1347 (1.0)      0.0000 (1.0)      91.1347 (1.0)      0.0000 (1.0)           0;0  0.0110 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     62.2131 (1.05)     62.2131 (1.05)     62.2131 (1.05)     0.0000 (1.0)      62.2131 (1.05)     0.0000 (1.0)           0;0  0.0161 (0.95)          1           1
test_sharing-add-noop[3.10.0]     64.1322 (1.09)     64.1322 (1.09)     64.1322 (1.09)     0.0000 (1.0)      64.1322 (1.09)     0.0000 (1.0)           0;0  0.0156 (0.92)          1           1
test_sharing-add-noop[main]       58.9994 (1.0)      58.9994 (1.0)      58.9994 (1.0)      0.0000 (1.0)      58.9994 (1.0)      0.0000 (1.0)           0;0  0.0169 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      42.3849 (1.40)      42.3849 (1.40)      42.3849 (1.40)     0.0000 (1.0)       42.3849 (1.40)     0.0000 (1.0)           0;0  0.0236 (0.71)          1           1
test_sharing-checkout[3.10.0]     103.2430 (3.42)     103.2430 (3.42)     103.2430 (3.42)     0.0000 (1.0)      103.2430 (3.42)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing-checkout[main]        30.1713 (1.0)       30.1713 (1.0)       30.1713 (1.0)      0.0000 (1.0)       30.1713 (1.0)      0.0000 (1.0)           0;0  0.0331 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6220 (1.01)     6.6220 (1.01)     6.6220 (1.01)     0.0000 (1.0)      6.6220 (1.01)     0.0000 (1.0)           0;0  0.1510 (1.00)          1           1
test_sharing-checkout-noop[3.10.0]     6.9538 (1.06)     6.9538 (1.06)     6.9538 (1.06)     0.0000 (1.0)      6.9538 (1.06)     0.0000 (1.0)           0;0  0.1438 (0.95)          1           1
test_sharing-checkout-noop[main]       6.5890 (1.0)      6.5890 (1.0)      6.5890 (1.0)      0.0000 (1.0)      6.5890 (1.0)      0.0000 (1.0)           0;0  0.1518 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     110.8751 (2.77)     110.8751 (2.77)     110.8751 (2.77)     0.0000 (1.0)      110.8751 (2.77)     0.0000 (1.0)           0;0  0.0090 (0.36)          1           1
test_sharing-fetch[3.10.0]     117.6359 (2.94)     117.6359 (2.94)     117.6359 (2.94)     0.0000 (1.0)      117.6359 (2.94)     0.0000 (1.0)           0;0  0.0085 (0.34)          1           1
test_sharing-fetch[main]        40.0229 (1.0)       40.0229 (1.0)       40.0229 (1.0)      0.0000 (1.0)       40.0229 (1.0)      0.0000 (1.0)           0;0  0.0250 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.3955 (1.0)      1.3955 (1.0)      1.3955 (1.0)      0.0000 (1.0)      1.3955 (1.0)      0.0000 (1.0)           0;0  0.7166 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8743 (2.78)     3.8743 (2.78)     3.8743 (2.78)     0.0000 (1.0)      3.8743 (2.78)     0.0000 (1.0)           0;0  0.2581 (0.36)          1           1
test_sharing-fetch-noop[main]       6.8810 (4.93)     6.8810 (4.93)     6.8810 (4.93)     0.0000 (1.0)      6.8810 (4.93)     0.0000 (1.0)           0;0  0.1453 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.5966 (3.74)     95.5966 (3.74)     95.5966 (3.74)     0.0000 (1.0)      95.5966 (3.74)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing-push[3.10.0]     47.7590 (1.87)     47.7590 (1.87)     47.7590 (1.87)     0.0000 (1.0)      47.7590 (1.87)     0.0000 (1.0)           0;0  0.0209 (0.53)          1           1
test_sharing-push[main]       25.5484 (1.0)      25.5484 (1.0)      25.5484 (1.0)      0.0000 (1.0)      25.5484 (1.0)      0.0000 (1.0)           0;0  0.0391 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.4327 (1.0)      2.4327 (1.0)      2.4327 (1.0)      0.0000 (1.0)      2.4327 (1.0)      0.0000 (1.0)           0;0  0.4111 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.5079 (1.03)     2.5079 (1.03)     2.5079 (1.03)     0.0000 (1.0)      2.5079 (1.03)     0.0000 (1.0)           0;0  0.3987 (0.97)          1           1
test_sharing-push-noop[main]       7.2286 (2.97)     7.2286 (2.97)     7.2286 (2.97)     0.0000 (1.0)      7.2286 (2.97)     0.0000 (1.0)           0;0  0.1383 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     97.8501 (1.01)     97.8501 (1.01)     97.8501 (1.01)     0.0000 (1.0)      97.8501 (1.01)     0.0000 (1.0)           0;0  0.0102 (0.99)          1           1
test_sharing_azure-add[3.10.0]     98.4958 (1.02)     98.4958 (1.02)     98.4958 (1.02)     0.0000 (1.0)      98.4958 (1.02)     0.0000 (1.0)           0;0  0.0102 (0.98)          1           1
test_sharing_azure-add[main]       96.6995 (1.0)      96.6995 (1.0)      96.6995 (1.0)      0.0000 (1.0)      96.6995 (1.0)      0.0000 (1.0)           0;0  0.0103 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     64.4076 (1.05)     64.4076 (1.05)     64.4076 (1.05)     0.0000 (1.0)      64.4076 (1.05)     0.0000 (1.0)           0;0  0.0155 (0.95)          1           1
test_sharing_azure-add-noop[3.10.0]     65.2169 (1.06)     65.2169 (1.06)     65.2169 (1.06)     0.0000 (1.0)      65.2169 (1.06)     0.0000 (1.0)           0;0  0.0153 (0.94)          1           1
test_sharing_azure-add-noop[main]       61.4076 (1.0)      61.4076 (1.0)      61.4076 (1.0)      0.0000 (1.0)      61.4076 (1.0)      0.0000 (1.0)           0;0  0.0163 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      43.9722 (1.44)      43.9722 (1.44)      43.9722 (1.44)     0.0000 (1.0)       43.9722 (1.44)     0.0000 (1.0)           0;0  0.0227 (0.70)          1           1
test_sharing_azure-checkout[3.10.0]     106.3526 (3.48)     106.3526 (3.48)     106.3526 (3.48)     0.0000 (1.0)      106.3526 (3.48)     0.0000 (1.0)           0;0  0.0094 (0.29)          1           1
test_sharing_azure-checkout[main]        30.5873 (1.0)       30.5873 (1.0)       30.5873 (1.0)      0.0000 (1.0)       30.5873 (1.0)      0.0000 (1.0)           0;0  0.0327 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.7112 (1.01)     6.7112 (1.01)     6.7112 (1.01)     0.0000 (1.0)      6.7112 (1.01)     0.0000 (1.0)           0;0  0.1490 (0.99)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.9473 (1.04)     6.9473 (1.04)     6.9473 (1.04)     0.0000 (1.0)      6.9473 (1.04)     0.0000 (1.0)           0;0  0.1439 (0.96)          1           1
test_sharing_azure-checkout-noop[main]       6.6681 (1.0)      6.6681 (1.0)      6.6681 (1.0)      0.0000 (1.0)      6.6681 (1.0)      0.0000 (1.0)           0;0  0.1500 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     114.5425 (2.74)     114.5425 (2.74)     114.5425 (2.74)     0.0000 (1.0)      114.5425 (2.74)     0.0000 (1.0)           0;0  0.0087 (0.37)          1           1
test_sharing_azure-fetch[3.10.0]     121.1481 (2.90)     121.1481 (2.90)     121.1481 (2.90)     0.0000 (1.0)      121.1481 (2.90)     0.0000 (1.0)           0;0  0.0083 (0.35)          1           1
test_sharing_azure-fetch[main]        41.8158 (1.0)       41.8158 (1.0)       41.8158 (1.0)      0.0000 (1.0)       41.8158 (1.0)      0.0000 (1.0)           0;0  0.0239 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4522 (1.0)      1.4522 (1.0)      1.4522 (1.0)      0.0000 (1.0)      1.4522 (1.0)      0.0000 (1.0)           0;0  0.6886 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.8882 (2.68)     3.8882 (2.68)     3.8882 (2.68)     0.0000 (1.0)      3.8882 (2.68)     0.0000 (1.0)           0;0  0.2572 (0.37)          1           1
test_sharing_azure-fetch-noop[main]       7.0455 (4.85)     7.0455 (4.85)     7.0455 (4.85)     0.0000 (1.0)      7.0455 (4.85)     0.0000 (1.0)           0;0  0.1419 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     98.3352 (3.77)     98.3352 (3.77)     98.3352 (3.77)     0.0000 (1.0)      98.3352 (3.77)     0.0000 (1.0)           0;0  0.0102 (0.27)          1           1
test_sharing_azure-push[3.10.0]     49.3312 (1.89)     49.3312 (1.89)     49.3312 (1.89)     0.0000 (1.0)      49.3312 (1.89)     0.0000 (1.0)           0;0  0.0203 (0.53)          1           1
test_sharing_azure-push[main]       26.0897 (1.0)      26.0897 (1.0)      26.0897 (1.0)      0.0000 (1.0)      26.0897 (1.0)      0.0000 (1.0)           0;0  0.0383 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5519 (1.0)      2.5519 (1.0)      2.5519 (1.0)      0.0000 (1.0)      2.5519 (1.0)      0.0000 (1.0)           0;0  0.3919 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]     2.5691 (1.01)     2.5691 (1.01)     2.5691 (1.01)     0.0000 (1.0)      2.5691 (1.01)     0.0000 (1.0)           0;0  0.3892 (0.99)          1           1
test_sharing_azure-push-noop[main]       7.4452 (2.92)     7.4452 (2.92)     7.4452 (2.92)     0.0000 (1.0)      7.4452 (2.92)     0.0000 (1.0)           0;0  0.1343 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     96.5770 (1.04)     96.5770 (1.04)     96.5770 (1.04)     0.0000 (1.0)      96.5770 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_sharing_gs-add[3.10.0]     95.8817 (1.03)     95.8817 (1.03)     95.8817 (1.03)     0.0000 (1.0)      95.8817 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_sharing_gs-add[main]       93.1009 (1.0)      93.1009 (1.0)      93.1009 (1.0)      0.0000 (1.0)      93.1009 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     63.2328 (1.06)     63.2328 (1.06)     63.2328 (1.06)     0.0000 (1.0)      63.2328 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.94)          1           1
test_sharing_gs-add-noop[3.10.0]     63.6898 (1.07)     63.6898 (1.07)     63.6898 (1.07)     0.0000 (1.0)      63.6898 (1.07)     0.0000 (1.0)           0;0  0.0157 (0.93)          1           1
test_sharing_gs-add-noop[main]       59.5268 (1.0)      59.5268 (1.0)      59.5268 (1.0)      0.0000 (1.0)      59.5268 (1.0)      0.0000 (1.0)           0;0  0.0168 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      43.0499 (1.43)      43.0499 (1.43)      43.0499 (1.43)     0.0000 (1.0)       43.0499 (1.43)     0.0000 (1.0)           0;0  0.0232 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     103.1565 (3.44)     103.1565 (3.44)     103.1565 (3.44)     0.0000 (1.0)      103.1565 (3.44)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_gs-checkout[main]        30.0153 (1.0)       30.0153 (1.0)       30.0153 (1.0)      0.0000 (1.0)       30.0153 (1.0)      0.0000 (1.0)           0;0  0.0333 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.5752 (1.01)     6.5752 (1.01)     6.5752 (1.01)     0.0000 (1.0)      6.5752 (1.01)     0.0000 (1.0)           0;0  0.1521 (0.99)          1           1
test_sharing_gs-checkout-noop[3.10.0]     6.8682 (1.05)     6.8682 (1.05)     6.8682 (1.05)     0.0000 (1.0)      6.8682 (1.05)     0.0000 (1.0)           0;0  0.1456 (0.95)          1           1
test_sharing_gs-checkout-noop[main]       6.5218 (1.0)      6.5218 (1.0)      6.5218 (1.0)      0.0000 (1.0)      6.5218 (1.0)      0.0000 (1.0)           0;0  0.1533 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     111.7860 (2.72)     111.7860 (2.72)     111.7860 (2.72)     0.0000 (1.0)      111.7860 (2.72)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_gs-fetch[3.10.0]     117.5641 (2.86)     117.5641 (2.86)     117.5641 (2.86)     0.0000 (1.0)      117.5641 (2.86)     0.0000 (1.0)           0;0  0.0085 (0.35)          1           1
test_sharing_gs-fetch[main]        41.1485 (1.0)       41.1485 (1.0)       41.1485 (1.0)      0.0000 (1.0)       41.1485 (1.0)      0.0000 (1.0)           0;0  0.0243 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4497 (1.0)      1.4497 (1.0)      1.4497 (1.0)      0.0000 (1.0)      1.4497 (1.0)      0.0000 (1.0)           0;0  0.6898 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.8682 (2.67)     3.8682 (2.67)     3.8682 (2.67)     0.0000 (1.0)      3.8682 (2.67)     0.0000 (1.0)           0;0  0.2585 (0.37)          1           1
test_sharing_gs-fetch-noop[main]       6.8971 (4.76)     6.8971 (4.76)     6.8971 (4.76)     0.0000 (1.0)      6.8971 (4.76)     0.0000 (1.0)           0;0  0.1450 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     95.1063 (3.75)     95.1063 (3.75)     95.1063 (3.75)     0.0000 (1.0)      95.1063 (3.75)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing_gs-push[3.10.0]     48.2445 (1.90)     48.2445 (1.90)     48.2445 (1.90)     0.0000 (1.0)      48.2445 (1.90)     0.0000 (1.0)           0;0  0.0207 (0.53)          1           1
test_sharing_gs-push[main]       25.3537 (1.0)      25.3537 (1.0)      25.3537 (1.0)      0.0000 (1.0)      25.3537 (1.0)      0.0000 (1.0)           0;0  0.0394 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.5358 (1.0)      2.5358 (1.0)      2.5358 (1.0)      0.0000 (1.0)      2.5358 (1.0)      0.0000 (1.0)           0;0  0.3944 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.5887 (1.02)     2.5887 (1.02)     2.5887 (1.02)     0.0000 (1.0)      2.5887 (1.02)     0.0000 (1.0)           0;0  0.3863 (0.98)          1           1
test_sharing_gs-push-noop[main]       7.2044 (2.84)     7.2044 (2.84)     7.2044 (2.84)     0.0000 (1.0)      7.2044 (2.84)     0.0000 (1.0)           0;0  0.1388 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     97.5860 (1.05)     97.5860 (1.05)     97.5860 (1.05)     0.0000 (1.0)      97.5860 (1.05)     0.0000 (1.0)           0;0  0.0102 (0.95)          1           1
test_sharing_s3-add[3.10.0]     97.7502 (1.05)     97.7502 (1.05)     97.7502 (1.05)     0.0000 (1.0)      97.7502 (1.05)     0.0000 (1.0)           0;0  0.0102 (0.95)          1           1
test_sharing_s3-add[main]       92.7779 (1.0)      92.7779 (1.0)      92.7779 (1.0)      0.0000 (1.0)      92.7779 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     63.4742 (1.06)     63.4742 (1.06)     63.4742 (1.06)     0.0000 (1.0)      63.4742 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.94)          1           1
test_sharing_s3-add-noop[3.10.0]     63.2060 (1.06)     63.2060 (1.06)     63.2060 (1.06)     0.0000 (1.0)      63.2060 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.95)          1           1
test_sharing_s3-add-noop[main]       59.8527 (1.0)      59.8527 (1.0)      59.8527 (1.0)      0.0000 (1.0)      59.8527 (1.0)      0.0000 (1.0)           0;0  0.0167 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.7190 (1.43)      42.7190 (1.43)      42.7190 (1.43)     0.0000 (1.0)       42.7190 (1.43)     0.0000 (1.0)           0;0  0.0234 (0.70)          1           1
test_sharing_s3-checkout[3.10.0]     104.9653 (3.50)     104.9653 (3.50)     104.9653 (3.50)     0.0000 (1.0)      104.9653 (3.50)     0.0000 (1.0)           0;0  0.0095 (0.29)          1           1
test_sharing_s3-checkout[main]        29.9511 (1.0)       29.9511 (1.0)       29.9511 (1.0)      0.0000 (1.0)       29.9511 (1.0)      0.0000 (1.0)           0;0  0.0334 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.7738 (1.03)     6.7738 (1.03)     6.7738 (1.03)     0.0000 (1.0)      6.7738 (1.03)     0.0000 (1.0)           0;0  0.1476 (0.97)          1           1
test_sharing_s3-checkout-noop[3.10.0]     6.9914 (1.06)     6.9914 (1.06)     6.9914 (1.06)     0.0000 (1.0)      6.9914 (1.06)     0.0000 (1.0)           0;0  0.1430 (0.94)          1           1
test_sharing_s3-checkout-noop[main]       6.5673 (1.0)      6.5673 (1.0)      6.5673 (1.0)      0.0000 (1.0)      6.5673 (1.0)      0.0000 (1.0)           0;0  0.1523 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests --------------------------------------------------------------------------------
Name (time in s)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     1,128.8920 (1.52)     1,128.8920 (1.52)     1,128.8920 (1.52)     0.0000 (1.0)      1,128.8920 (1.52)     0.0000 (1.0)           0;0  0.0009 (0.66)          1           1
test_sharing_s3-fetch[3.10.0]       753.5994 (1.02)       753.5994 (1.02)       753.5994 (1.02)     0.0000 (1.0)        753.5994 (1.02)     0.0000 (1.0)           0;0  0.0013 (0.98)          1           1
test_sharing_s3-fetch[main]         740.9992 (1.0)        740.9992 (1.0)        740.9992 (1.0)      0.0000 (1.0)        740.9992 (1.0)      0.0000 (1.0)           0;0  0.0013 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.6456 (1.0)      1.6456 (1.0)      1.6456 (1.0)      0.0000 (1.0)      1.6456 (1.0)      0.0000 (1.0)           0;0  0.6077 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     4.0133 (2.44)     4.0133 (2.44)     4.0133 (2.44)     0.0000 (1.0)      4.0133 (2.44)     0.0000 (1.0)           0;0  0.2492 (0.41)          1           1
test_sharing_s3-fetch-noop[main]       7.8256 (4.76)     7.8256 (4.76)     7.8256 (4.76)     0.0000 (1.0)      7.8256 (4.76)     0.0000 (1.0)           0;0  0.1278 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     1,195.6649 (1.01)     1,195.6649 (1.01)     1,195.6649 (1.01)     0.0000 (1.0)      1,195.6649 (1.01)     0.0000 (1.0)           0;0  0.0008 (0.99)          1           1
test_sharing_s3-push[3.10.0]     1,186.7843 (1.00)     1,186.7843 (1.00)     1,186.7843 (1.00)     0.0000 (1.0)      1,186.7843 (1.00)     0.0000 (1.0)           0;0  0.0008 (1.00)          1           1
test_sharing_s3-push[main]       1,186.7564 (1.0)      1,186.7564 (1.0)      1,186.7564 (1.0)      0.0000 (1.0)      1,186.7564 (1.0)      0.0000 (1.0)           0;0  0.0008 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     3.0570 (1.0)      3.0570 (1.0)      3.0570 (1.0)      0.0000 (1.0)      3.0570 (1.0)      0.0000 (1.0)           0;0  0.3271 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     3.1802 (1.04)     3.1802 (1.04)     3.1802 (1.04)     0.0000 (1.0)      3.1802 (1.04)     0.0000 (1.0)           0;0  0.3144 (0.96)          1           1
test_sharing_s3-push-noop[main]       8.3569 (2.73)     8.3569 (2.73)     8.3569 (2.73)     0.0000 (1.0)      8.3569 (2.73)     0.0000 (1.0)           0;0  0.1197 (0.37)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.9387 (1.0)      21.9387 (1.0)      21.9387 (1.0)      0.0000 (1.0)      21.9387 (1.0)      0.0000 (1.0)           0;0  0.0456 (1.0)           1           1
test_status-status[3.10.0]     22.0411 (1.00)     22.0411 (1.00)     22.0411 (1.00)     0.0000 (1.0)      22.0411 (1.00)     0.0000 (1.0)           0;0  0.0454 (1.00)          1           1
test_status-status[main]       22.0442 (1.00)     22.0442 (1.00)     22.0442 (1.00)     0.0000 (1.0)      22.0442 (1.00)     0.0000 (1.0)           0;0  0.0454 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.6555 (1.0)      5.6555 (1.0)      5.6555 (1.0)      0.0000 (1.0)      5.6555 (1.0)      0.0000 (1.0)           0;0  0.1768 (1.0)           1           1
test_status-status-changed[3.10.0]     5.9081 (1.04)     5.9081 (1.04)     5.9081 (1.04)     0.0000 (1.0)      5.9081 (1.04)     0.0000 (1.0)           0;0  0.1693 (0.96)          1           1
test_status-status-changed[main]       5.9094 (1.04)     5.9094 (1.04)     5.9094 (1.04)     0.0000 (1.0)      5.9094 (1.04)     0.0000 (1.0)           0;0  0.1692 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6325 (1.0)      5.6325 (1.0)      5.6325 (1.0)      0.0000 (1.0)      5.6325 (1.0)      0.0000 (1.0)           0;0  0.1775 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.7717 (1.02)     5.7717 (1.02)     5.7717 (1.02)     0.0000 (1.0)      5.7717 (1.02)     0.0000 (1.0)           0;0  0.1733 (0.98)          1           1
test_status-status-changed-noop[main]       5.6735 (1.01)     5.6735 (1.01)     5.6735 (1.01)     0.0000 (1.0)      5.6735 (1.01)     0.0000 (1.0)           0;0  0.1763 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7437 (1.0)      5.7437 (1.0)      5.7437 (1.0)      0.0000 (1.0)      5.7437 (1.0)      0.0000 (1.0)           0;0  0.1741 (1.0)           1           1
test_status-status-noop[3.10.0]     6.0777 (1.06)     6.0777 (1.06)     6.0777 (1.06)     0.0000 (1.0)      6.0777 (1.06)     0.0000 (1.0)           0;0  0.1645 (0.95)          1           1
test_status-status-noop[main]       5.8355 (1.02)     5.8355 (1.02)     5.8355 (1.02)     0.0000 (1.0)      5.8355 (1.02)     0.0000 (1.0)           0;0  0.1714 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     212.4882 (1.51)     212.4882 (1.51)     212.4882 (1.51)     0.0000 (1.0)      212.4882 (1.51)     0.0000 (1.0)           0;0  0.0047 (0.66)          1           1
test_update-import-url[3.10.0]     215.4488 (1.53)     215.4488 (1.53)     215.4488 (1.53)     0.0000 (1.0)      215.4488 (1.53)     0.0000 (1.0)           0;0  0.0046 (0.65)          1           1
test_update-import-url[main]       140.4073 (1.0)      140.4073 (1.0)      140.4073 (1.0)      0.0000 (1.0)      140.4073 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     195.4183 (1.59)     195.4183 (1.59)     195.4183 (1.59)     0.0000 (1.0)      195.4183 (1.59)     0.0000 (1.0)           0;0  0.0051 (0.63)          1           1
test_update-update[3.10.0]     199.9108 (1.62)     199.9108 (1.62)     199.9108 (1.62)     0.0000 (1.0)      199.9108 (1.62)     0.0000 (1.0)           0;0  0.0050 (0.62)          1           1
test_update-update[main]       123.2216 (1.0)      123.2216 (1.0)      123.2216 (1.0)      0.0000 (1.0)      123.2216 (1.0)      0.0000 (1.0)           0;0  0.0081 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.6485 (1.0)      19.6485 (1.0)      19.6485 (1.0)      0.0000 (1.0)      19.6485 (1.0)      0.0000 (1.0)           0;0  0.0509 (1.0)           1           1
test_update-update-noop[3.10.0]     20.7477 (1.06)     20.7477 (1.06)     20.7477 (1.06)     0.0000 (1.0)      20.7477 (1.06)     0.0000 (1.0)           0;0  0.0482 (0.95)          1           1
test_update-update-noop[main]       19.7195 (1.00)     19.7195 (1.00)     19.7195 (1.00)     0.0000 (1.0)      19.7195 (1.00)     0.0000 (1.0)           0;0  0.0507 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean