Mon Apr 22 01:25:05 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     90.7793 (1.04)     90.7793 (1.04)     90.7793 (1.04)     0.0000 (1.0)      90.7793 (1.04)     0.0000 (1.0)           0;0  0.0110 (0.97)          1           1
test_add-add[3.10.0]     90.3651 (1.03)     90.3651 (1.03)     90.3651 (1.03)     0.0000 (1.0)      90.3651 (1.03)     0.0000 (1.0)           0;0  0.0111 (0.97)          1           1
test_add-add[main]       87.6630 (1.0)      87.6630 (1.0)      87.6630 (1.0)      0.0000 (1.0)      87.6630 (1.0)      0.0000 (1.0)           0;0  0.0114 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      43.5048 (1.37)      43.5048 (1.37)      43.5048 (1.37)     0.0000 (1.0)       43.5048 (1.37)     0.0000 (1.0)           0;0  0.0230 (0.73)          1           1
test_checkout_copy-checkout[3.10.0]     104.0140 (3.26)     104.0140 (3.26)     104.0140 (3.26)     0.0000 (1.0)      104.0140 (3.26)     0.0000 (1.0)           0;0  0.0096 (0.31)          1           1
test_checkout_copy-checkout[main]        31.8646 (1.0)       31.8646 (1.0)       31.8646 (1.0)      0.0000 (1.0)       31.8646 (1.0)      0.0000 (1.0)           0;0  0.0314 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.6173 (1.02)     6.6173 (1.02)     6.6173 (1.02)     0.0000 (1.0)      6.6173 (1.02)     0.0000 (1.0)           0;0  0.1511 (0.98)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.6621 (1.02)     6.6621 (1.02)     6.6621 (1.02)     0.0000 (1.0)      6.6621 (1.02)     0.0000 (1.0)           0;0  0.1501 (0.98)          1           1
test_checkout_copy-checkout-noop[main]       6.5072 (1.0)      6.5072 (1.0)      6.5072 (1.0)      0.0000 (1.0)      6.5072 (1.0)      0.0000 (1.0)           0;0  0.1537 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.5410 (1.45)     10.5410 (1.45)     10.5410 (1.45)     0.0000 (1.0)      10.5410 (1.45)     0.0000 (1.0)           0;0  0.0949 (0.69)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.4767 (1.03)      7.4767 (1.03)      7.4767 (1.03)     0.0000 (1.0)       7.4767 (1.03)     0.0000 (1.0)           0;0  0.1337 (0.98)          1           1
test_checkout_copy-checkout-update[main]        7.2917 (1.0)       7.2917 (1.0)       7.2917 (1.0)      0.0000 (1.0)       7.2917 (1.0)      0.0000 (1.0)           0;0  0.1371 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.9109 (1.39)     25.9109 (1.39)     25.9109 (1.39)     0.0000 (1.0)      25.9109 (1.39)     0.0000 (1.0)           0;0  0.0386 (0.72)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.6306 (1.0)      18.6306 (1.0)      18.6306 (1.0)      0.0000 (1.0)      18.6306 (1.0)      0.0000 (1.0)           0;0  0.0537 (1.0)           1           1
test_checkout_hardlink-checkout[main]       18.8366 (1.01)     18.8366 (1.01)     18.8366 (1.01)     0.0000 (1.0)      18.8366 (1.01)     0.0000 (1.0)           0;0  0.0531 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.6760 (1.03)     6.6760 (1.03)     6.6760 (1.03)     0.0000 (1.0)      6.6760 (1.03)     0.0000 (1.0)           0;0  0.1498 (0.97)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.7479 (1.04)     6.7479 (1.04)     6.7479 (1.04)     0.0000 (1.0)      6.7479 (1.04)     0.0000 (1.0)           0;0  0.1482 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       6.4933 (1.0)      6.4933 (1.0)      6.4933 (1.0)      0.0000 (1.0)      6.4933 (1.0)      0.0000 (1.0)           0;0  0.1540 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.5477 (1.42)     10.5477 (1.42)     10.5477 (1.42)     0.0000 (1.0)      10.5477 (1.42)     0.0000 (1.0)           0;0  0.0948 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.5751 (1.02)      7.5751 (1.02)      7.5751 (1.02)     0.0000 (1.0)       7.5751 (1.02)     0.0000 (1.0)           0;0  0.1320 (0.98)          1           1
test_checkout_hardlink-checkout-update[main]        7.4203 (1.0)       7.4203 (1.0)       7.4203 (1.0)      0.0000 (1.0)       7.4203 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     34.1224 (1.39)     34.1224 (1.39)     34.1224 (1.39)     0.0000 (1.0)      34.1224 (1.39)     0.0000 (1.0)           0;0  0.0293 (0.72)          1           1
test_checkout_symlink-checkout[3.10.0]     25.8657 (1.05)     25.8657 (1.05)     25.8657 (1.05)     0.0000 (1.0)      25.8657 (1.05)     0.0000 (1.0)           0;0  0.0387 (0.95)          1           1
test_checkout_symlink-checkout[main]       24.5664 (1.0)      24.5664 (1.0)      24.5664 (1.0)      0.0000 (1.0)      24.5664 (1.0)      0.0000 (1.0)           0;0  0.0407 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     9.1284 (1.0)      9.1284 (1.0)      9.1284 (1.0)      0.0000 (1.0)      9.1284 (1.0)      0.0000 (1.0)           0;0  0.1095 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     9.3188 (1.02)     9.3188 (1.02)     9.3188 (1.02)     0.0000 (1.0)      9.3188 (1.02)     0.0000 (1.0)           0;0  0.1073 (0.98)          1           1
test_checkout_symlink-checkout-noop[main]       9.4919 (1.04)     9.4919 (1.04)     9.4919 (1.04)     0.0000 (1.0)      9.4919 (1.04)     0.0000 (1.0)           0;0  0.1054 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     14.7005 (1.31)     14.7005 (1.31)     14.7005 (1.31)     0.0000 (1.0)      14.7005 (1.31)     0.0000 (1.0)           0;0  0.0680 (0.76)          1           1
test_checkout_symlink-checkout-update[3.10.0]     11.3602 (1.02)     11.3602 (1.02)     11.3602 (1.02)     0.0000 (1.0)      11.3602 (1.02)     0.0000 (1.0)           0;0  0.0880 (0.99)          1           1
test_checkout_symlink-checkout-update[main]       11.1919 (1.0)      11.1919 (1.0)      11.1919 (1.0)      0.0000 (1.0)      11.1919 (1.0)      0.0000 (1.0)           0;0  0.0894 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.5428 (1.0)      4.5428 (1.0)      4.5428 (1.0)      0.0000 (1.0)      4.5428 (1.0)      0.0000 (1.0)           0;0  0.2201 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.4417 (1.20)     5.4417 (1.20)     5.4417 (1.20)     0.0000 (1.0)      5.4417 (1.20)     0.0000 (1.0)           0;0  0.1838 (0.83)          1           1
test_data_status-data-changed[main]       5.4557 (1.20)     5.4557 (1.20)     5.4557 (1.20)     0.0000 (1.0)      5.4557 (1.20)     0.0000 (1.0)           0;0  0.1833 (0.83)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.8942 (1.0)      4.8942 (1.0)      4.8942 (1.0)      0.0000 (1.0)      4.8942 (1.0)      0.0000 (1.0)           0;0  0.2043 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.5406 (1.13)     5.5406 (1.13)     5.5406 (1.13)     0.0000 (1.0)      5.5406 (1.13)     0.0000 (1.0)           0;0  0.1805 (0.88)          1           1
test_data_status-data-changed-noop[main]       5.3325 (1.09)     5.3325 (1.09)     5.3325 (1.09)     0.0000 (1.0)      5.3325 (1.09)     0.0000 (1.0)           0;0  0.1875 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.4613 (1.0)      20.4613 (1.0)      20.4613 (1.0)      0.0000 (1.0)      20.4613 (1.0)      0.0000 (1.0)           0;0  0.0489 (1.0)           1           1
test_data_status-data-new[3.10.0]     21.2346 (1.04)     21.2346 (1.04)     21.2346 (1.04)     0.0000 (1.0)      21.2346 (1.04)     0.0000 (1.0)           0;0  0.0471 (0.96)          1           1
test_data_status-data-new[main]       21.2397 (1.04)     21.2397 (1.04)     21.2397 (1.04)     0.0000 (1.0)      21.2397 (1.04)     0.0000 (1.0)           0;0  0.0471 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.9199 (1.0)      4.9199 (1.0)      4.9199 (1.0)      0.0000 (1.0)      4.9199 (1.0)      0.0000 (1.0)           0;0  0.2033 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.5940 (1.14)     5.5940 (1.14)     5.5940 (1.14)     0.0000 (1.0)      5.5940 (1.14)     0.0000 (1.0)           0;0  0.1788 (0.88)          1           1
test_data_status-data-noop[main]       5.4702 (1.11)     5.4702 (1.11)     5.4702 (1.11)     0.0000 (1.0)      5.4702 (1.11)     0.0000 (1.0)           0;0  0.1828 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     19.0691 (1.0)      19.0691 (1.0)      19.0691 (1.0)      0.0000 (1.0)      19.0691 (1.0)      0.0000 (1.0)           0;0  0.0524 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.5669 (1.03)     19.5669 (1.03)     19.5669 (1.03)     0.0000 (1.0)      19.5669 (1.03)     0.0000 (1.0)           0;0  0.0511 (0.97)          1           1
test_data_status_all_flags-data-changed[main]       19.7785 (1.04)     19.7785 (1.04)     19.7785 (1.04)     0.0000 (1.0)      19.7785 (1.04)     0.0000 (1.0)           0;0  0.0506 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.3785 (1.0)      19.3785 (1.0)      19.3785 (1.0)      0.0000 (1.0)      19.3785 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.6761 (1.02)     19.6761 (1.02)     19.6761 (1.02)     0.0000 (1.0)      19.6761 (1.02)     0.0000 (1.0)           0;0  0.0508 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.7869 (1.02)     19.7869 (1.02)     19.7869 (1.02)     0.0000 (1.0)      19.7869 (1.02)     0.0000 (1.0)           0;0  0.0505 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.6738 (1.0)      34.6738 (1.0)      34.6738 (1.0)      0.0000 (1.0)      34.6738 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     35.8662 (1.03)     35.8662 (1.03)     35.8662 (1.03)     0.0000 (1.0)      35.8662 (1.03)     0.0000 (1.0)           0;0  0.0279 (0.97)          1           1
test_data_status_all_flags-data-new[main]       36.1234 (1.04)     36.1234 (1.04)     36.1234 (1.04)     0.0000 (1.0)      36.1234 (1.04)     0.0000 (1.0)           0;0  0.0277 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.3535 (1.0)      18.3535 (1.0)      18.3535 (1.0)      0.0000 (1.0)      18.3535 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     18.9996 (1.04)     18.9996 (1.04)     18.9996 (1.04)     0.0000 (1.0)      18.9996 (1.04)     0.0000 (1.0)           0;0  0.0526 (0.97)          1           1
test_data_status_all_flags-data-noop[main]       19.0249 (1.04)     19.0249 (1.04)     19.0249 (1.04)     0.0000 (1.0)      19.0249 (1.04)     0.0000 (1.0)           0;0  0.0526 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.9743 (1.0)      19.9743 (1.0)      19.9743 (1.0)      0.0000 (1.0)      19.9743 (1.0)      0.0000 (1.0)           0;0  0.0501 (1.0)           1           1
test_diff-diff[3.10.0]     20.8212 (1.04)     20.8212 (1.04)     20.8212 (1.04)     0.0000 (1.0)      20.8212 (1.04)     0.0000 (1.0)           0;0  0.0480 (0.96)          1           1
test_diff-diff[main]       23.2787 (1.17)     23.2787 (1.17)     23.2787 (1.17)     0.0000 (1.0)      23.2787 (1.17)     0.0000 (1.0)           0;0  0.0430 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.1572 (1.11)     7.1572 (1.11)     7.1572 (1.11)     0.0000 (1.0)      7.1572 (1.11)     0.0000 (1.0)           0;0  0.1397 (0.90)          1           1
test_diff-diff-changed[3.10.0]     7.8572 (1.22)     7.8572 (1.22)     7.8572 (1.22)     0.0000 (1.0)      7.8572 (1.22)     0.0000 (1.0)           0;0  0.1273 (0.82)          1           1
test_diff-diff-changed[main]       6.4237 (1.0)      6.4237 (1.0)      6.4237 (1.0)      0.0000 (1.0)      6.4237 (1.0)      0.0000 (1.0)           0;0  0.1557 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1024 (1.0)      6.1024 (1.0)      6.1024 (1.0)      0.0000 (1.0)      6.1024 (1.0)      0.0000 (1.0)           0;0  0.1639 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.7075 (1.10)     6.7075 (1.10)     6.7075 (1.10)     0.0000 (1.0)      6.7075 (1.10)     0.0000 (1.0)           0;0  0.1491 (0.91)          1           1
test_diff-diff-changed-noop[main]       6.3432 (1.04)     6.3432 (1.04)     6.3432 (1.04)     0.0000 (1.0)      6.3432 (1.04)     0.0000 (1.0)           0;0  0.1576 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9353 (1.0)      4.9353 (1.0)      4.9353 (1.0)      0.0000 (1.0)      4.9353 (1.0)      0.0000 (1.0)           0;0  0.2026 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.5114 (1.12)     5.5114 (1.12)     5.5114 (1.12)     0.0000 (1.0)      5.5114 (1.12)     0.0000 (1.0)           0;0  0.1814 (0.90)          1           1
test_diff-diff-noop[main]       6.5337 (1.32)     6.5337 (1.32)     6.5337 (1.32)     0.0000 (1.0)      6.5337 (1.32)     0.0000 (1.0)           0;0  0.1531 (0.76)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        831.7356 (1.0)         831.7356 (1.0)         831.7356 (1.0)      0.0000 (1.0)         831.7356 (1.0)      0.0000 (1.0)           0;0  1.2023 (1.0)           1           1
test_exp_show-exp[3.10.0]     12,235.9796 (14.71)    12,235.9796 (14.71)    12,235.9796 (14.71)    0.0000 (1.0)      12,235.9796 (14.71)    0.0000 (1.0)           0;0  0.0817 (0.07)          1           1
test_exp_show-exp[main]       11,991.7403 (14.42)    11,991.7403 (14.42)    11,991.7403 (14.42)    0.0000 (1.0)      11,991.7403 (14.42)    0.0000 (1.0)           0;0  0.0834 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     110.3827 (2.84)     110.3827 (2.84)     110.3827 (2.84)     0.0000 (1.0)      110.3827 (2.84)     0.0000 (1.0)           0;0  0.0091 (0.35)          1           1
test_fetch-fetch[3.10.0]     116.4570 (2.99)     116.4570 (2.99)     116.4570 (2.99)     0.0000 (1.0)      116.4570 (2.99)     0.0000 (1.0)           0;0  0.0086 (0.33)          1           1
test_fetch-fetch[main]        38.8947 (1.0)       38.8947 (1.0)       38.8947 (1.0)      0.0000 (1.0)       38.8947 (1.0)      0.0000 (1.0)           0;0  0.0257 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2926 (1.01)     3.2926 (1.01)     3.2926 (1.01)     0.0000 (1.0)      3.2926 (1.01)     0.0000 (1.0)           0;0  0.3037 (0.99)          1           1
test_gc-gc[3.10.0]     3.2736 (1.0)      3.2736 (1.0)      3.2736 (1.0)      0.0000 (1.0)      3.2736 (1.0)      0.0000 (1.0)           0;0  0.3055 (1.0)           1           1
test_gc-gc[main]       3.3070 (1.01)     3.3070 (1.01)     3.3070 (1.01)     0.0000 (1.0)      3.3070 (1.01)     0.0000 (1.0)           0;0  0.3024 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     183.7910 (1.12)     183.7910 (1.12)     183.7910 (1.12)     0.0000 (1.0)      183.7910 (1.12)     0.0000 (1.0)           0;0  0.0054 (0.89)          1           1
test_get-get[3.10.0]     225.5616 (1.38)     225.5616 (1.38)     225.5616 (1.38)     0.0000 (1.0)      225.5616 (1.38)     0.0000 (1.0)           0;0  0.0044 (0.72)          1           1
test_get-get[main]       163.4268 (1.0)      163.4268 (1.0)      163.4268 (1.0)      0.0000 (1.0)      163.4268 (1.0)      0.0000 (1.0)           0;0  0.0061 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.0353 (4.98)     85.0353 (4.98)     85.0353 (4.98)     0.0000 (1.0)      85.0353 (4.98)     0.0000 (1.0)           0;0  0.0118 (0.20)          1           1
test_get_url-get-url[3.10.0]     88.1947 (5.17)     88.1947 (5.17)     88.1947 (5.17)     0.0000 (1.0)      88.1947 (5.17)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[main]       17.0677 (1.0)      17.0677 (1.0)      17.0677 (1.0)      0.0000 (1.0)      17.0677 (1.0)      0.0000 (1.0)           0;0  0.0586 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.3794 (1.02)     135.6996 (1.03)     127.1549 (1.02)     1.2672 (1.0)      126.9596 (1.02)     1.1505 (1.00)         13;4  7.8644 (0.98)        100           1
test_help---help[3.10.0]     122.9242 (1.0)      132.2440 (1.0)      124.8132 (1.0)      1.3071 (1.03)     124.5034 (1.0)      1.1475 (1.0)          12;5  8.0120 (1.0)         100           1
test_help---help[main]       125.2251 (1.02)     151.7280 (1.15)     127.0764 (1.02)     2.6292 (2.07)     126.8665 (1.02)     1.3484 (1.18)          1;1  7.8693 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     287.5453 (1.08)     287.5453 (1.08)     287.5453 (1.08)     0.0000 (1.0)      287.5453 (1.08)     0.0000 (1.0)           0;0  0.0035 (0.92)          1           1
test_import-import[3.10.0]     320.9753 (1.21)     320.9753 (1.21)     320.9753 (1.21)     0.0000 (1.0)      320.9753 (1.21)     0.0000 (1.0)           0;0  0.0031 (0.83)          1           1
test_import-import[main]       265.3081 (1.0)      265.3081 (1.0)      265.3081 (1.0)      0.0000 (1.0)      265.3081 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     212.1296 (1.52)     212.1296 (1.52)     212.1296 (1.52)     0.0000 (1.0)      212.1296 (1.52)     0.0000 (1.0)           0;0  0.0047 (0.66)          1           1
test_import_url-import-url[3.10.0]     215.4388 (1.54)     215.4388 (1.54)     215.4388 (1.54)     0.0000 (1.0)      215.4388 (1.54)     0.0000 (1.0)           0;0  0.0046 (0.65)          1           1
test_import_url-import-url[main]       139.6856 (1.0)      139.6856 (1.0)      139.6856 (1.0)      0.0000 (1.0)      139.6856 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     360.5905 (1.0)      418.4524 (1.04)     365.9276 (1.0)      7.2973 (1.47)     364.5003 (1.0)      3.3992 (1.0)           6;9  2.7328 (1.0)         100           1
test_init-init[3.10.0]     365.9731 (1.01)     401.8882 (1.0)      372.5129 (1.02)     4.9726 (1.0)      371.1674 (1.02)     4.2924 (1.26)         13;5  2.6845 (0.98)        100           1
test_init-init[main]       365.3776 (1.01)     456.8330 (1.14)     372.0099 (1.02)     9.9498 (2.00)     370.0724 (1.02)     3.6326 (1.07)          3;5  2.6881 (0.98)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     418.3014 (1.06)     418.3014 (1.06)     418.3014 (1.06)     0.0000 (1.0)      418.3014 (1.06)     0.0000 (1.0)           0;0  2.3906 (0.94)          1           1
test_list-list[3.10.0]     413.8583 (1.05)     413.8583 (1.05)     413.8583 (1.05)     0.0000 (1.0)      413.8583 (1.05)     0.0000 (1.0)           0;0  2.4163 (0.95)          1           1
test_list-list[main]       393.3978 (1.0)      393.3978 (1.0)      393.3978 (1.0)      0.0000 (1.0)      393.3978 (1.0)      0.0000 (1.0)           0;0  2.5420 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     392.0591 (1.02)     392.0591 (1.02)     392.0591 (1.02)     0.0000 (1.0)      392.0591 (1.02)     0.0000 (1.0)           0;0  2.5506 (0.98)          1           1
test_list-list-dvc-only[3.10.0]     389.0004 (1.01)     389.0004 (1.01)     389.0004 (1.01)     0.0000 (1.0)      389.0004 (1.01)     0.0000 (1.0)           0;0  2.5707 (0.99)          1           1
test_list-list-dvc-only[main]       383.4201 (1.0)      383.4201 (1.0)      383.4201 (1.0)      0.0000 (1.0)      383.4201 (1.0)      0.0000 (1.0)           0;0  2.6081 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.2017 (1.0)      3.2017 (1.0)      3.2017 (1.0)      0.0000 (1.0)      3.2017 (1.0)      0.0000 (1.0)           0;0  0.3123 (1.0)           1           1
test_list-list-recursive[3.10.0]     3.2608 (1.02)     3.2608 (1.02)     3.2608 (1.02)     0.0000 (1.0)      3.2608 (1.02)     0.0000 (1.0)           0;0  0.3067 (0.98)          1           1
test_list-list-recursive[main]       3.2085 (1.00)     3.2085 (1.00)     3.2085 (1.00)     0.0000 (1.0)      3.2085 (1.00)     0.0000 (1.0)           0;0  0.3117 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     393.1076 (1.03)     393.1076 (1.03)     393.1076 (1.03)     0.0000 (1.0)      393.1076 (1.03)     0.0000 (1.0)           0;0  2.5438 (0.97)          1           1
test_list-list-shallow[3.10.0]     399.3537 (1.04)     399.3537 (1.04)     399.3537 (1.04)     0.0000 (1.0)      399.3537 (1.04)     0.0000 (1.0)           0;0  2.5040 (0.96)          1           1
test_list-list-shallow[main]       382.6576 (1.0)      382.6576 (1.0)      382.6576 (1.0)      0.0000 (1.0)      382.6576 (1.0)      0.0000 (1.0)           0;0  2.6133 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     83.4010 (1.04)     83.4010 (1.04)     83.4010 (1.04)     0.0000 (1.0)      83.4010 (1.04)     0.0000 (1.0)           0;0  0.0120 (0.96)          1           1
test_partial_add-add[3.10.0]     84.6936 (1.06)     84.6936 (1.06)     84.6936 (1.06)     0.0000 (1.0)      84.6936 (1.06)     0.0000 (1.0)           0;0  0.0118 (0.95)          1           1
test_partial_add-add[main]       80.1486 (1.0)      80.1486 (1.0)      80.1486 (1.0)      0.0000 (1.0)      80.1486 (1.0)      0.0000 (1.0)           0;0  0.0125 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     69.5678 (1.06)     69.5678 (1.06)     69.5678 (1.06)     0.0000 (1.0)      69.5678 (1.06)     0.0000 (1.0)           0;0  0.0144 (0.95)          1           1
test_partial_add-add-partial[3.10.0]     69.7318 (1.06)     69.7318 (1.06)     69.7318 (1.06)     0.0000 (1.0)      69.7318 (1.06)     0.0000 (1.0)           0;0  0.0143 (0.94)          1           1
test_partial_add-add-partial[main]       65.7448 (1.0)      65.7448 (1.0)      65.7448 (1.0)      0.0000 (1.0)      65.7448 (1.0)      0.0000 (1.0)           0;0  0.0152 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.5719 (1.0)      6.5719 (1.0)      6.5719 (1.0)      0.0000 (1.0)      6.5719 (1.0)      0.0000 (1.0)           0;0  0.1522 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     8.6534 (1.32)     8.6534 (1.32)     8.6534 (1.32)     0.0000 (1.0)      8.6534 (1.32)     0.0000 (1.0)           0;0  0.1156 (0.76)          1           1
test_partial_add-gc-cloud-noop[main]       9.9678 (1.52)     9.9678 (1.52)     9.9678 (1.52)     0.0000 (1.0)      9.9678 (1.52)     0.0000 (1.0)           0;0  0.1003 (0.66)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.6872 (1.0)      3.6872 (1.0)      3.6872 (1.0)      0.0000 (1.0)      3.6872 (1.0)      0.0000 (1.0)           0;0  0.2712 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.7029 (1.55)     5.7029 (1.55)     5.7029 (1.55)     0.0000 (1.0)      5.7029 (1.55)     0.0000 (1.0)           0;0  0.1754 (0.65)          1           1
test_partial_add-gc-noop[main]       5.7930 (1.57)     5.7930 (1.57)     5.7930 (1.57)     0.0000 (1.0)      5.7930 (1.57)     0.0000 (1.0)           0;0  0.1726 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     82.1992 (3.91)     82.1992 (3.91)     82.1992 (3.91)     0.0000 (1.0)      82.1992 (3.91)     0.0000 (1.0)           0;0  0.0122 (0.26)          1           1
test_partial_add-push[3.10.0]     41.8458 (1.99)     41.8458 (1.99)     41.8458 (1.99)     0.0000 (1.0)      41.8458 (1.99)     0.0000 (1.0)           0;0  0.0239 (0.50)          1           1
test_partial_add-push[main]       21.0316 (1.0)      21.0316 (1.0)      21.0316 (1.0)      0.0000 (1.0)      21.0316 (1.0)      0.0000 (1.0)           0;0  0.0475 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     18.5103 (1.64)     18.5103 (1.64)     18.5103 (1.64)     0.0000 (1.0)      18.5103 (1.64)     0.0000 (1.0)           0;0  0.0540 (0.61)          1           1
test_partial_add-push-partial[3.10.0]     11.3174 (1.0)      11.3174 (1.0)      11.3174 (1.0)      0.0000 (1.0)      11.3174 (1.0)      0.0000 (1.0)           0;0  0.0884 (1.0)           1           1
test_partial_add-push-partial[main]       11.9835 (1.06)     11.9835 (1.06)     11.9835 (1.06)     0.0000 (1.0)      11.9835 (1.06)     0.0000 (1.0)           0;0  0.0834 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.4050 (1.02)     95.4050 (1.02)     95.4050 (1.02)     0.0000 (1.0)      95.4050 (1.02)     0.0000 (1.0)           0;0  0.0105 (0.98)          1           1
test_partial_remove-add[3.10.0]     96.5529 (1.03)     96.5529 (1.03)     96.5529 (1.03)     0.0000 (1.0)      96.5529 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_partial_remove-add[main]       93.4329 (1.0)      93.4329 (1.0)      93.4329 (1.0)      0.0000 (1.0)      93.4329 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.4849 (1.08)     9.4849 (1.08)     9.4849 (1.08)     0.0000 (1.0)      9.4849 (1.08)     0.0000 (1.0)           0;0  0.1054 (0.92)          1           1
test_partial_remove-add-update[3.10.0]     9.5156 (1.09)     9.5156 (1.09)     9.5156 (1.09)     0.0000 (1.0)      9.5156 (1.09)     0.0000 (1.0)           0;0  0.1051 (0.92)          1           1
test_partial_remove-add-update[main]       8.7694 (1.0)      8.7694 (1.0)      8.7694 (1.0)      0.0000 (1.0)      8.7694 (1.0)      0.0000 (1.0)           0;0  0.1140 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.2727 (1.0)      4.2727 (1.0)      4.2727 (1.0)      0.0000 (1.0)      4.2727 (1.0)      0.0000 (1.0)           0;0  0.2340 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.8490 (1.13)     4.8490 (1.13)     4.8490 (1.13)     0.0000 (1.0)      4.8490 (1.13)     0.0000 (1.0)           0;0  0.2062 (0.88)          1           1
test_partial_remove-gc[main]       4.8682 (1.14)     4.8682 (1.14)     4.8682 (1.14)     0.0000 (1.0)      4.8682 (1.14)     0.0000 (1.0)           0;0  0.2054 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.0353 (1.0)      6.0353 (1.0)      6.0353 (1.0)      0.0000 (1.0)      6.0353 (1.0)      0.0000 (1.0)           0;0  0.1657 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.6490 (1.10)     6.6490 (1.10)     6.6490 (1.10)     0.0000 (1.0)      6.6490 (1.10)     0.0000 (1.0)           0;0  0.1504 (0.91)          1           1
test_partial_remove-gc-cloud[main]       6.5643 (1.09)     6.5643 (1.09)     6.5643 (1.09)     0.0000 (1.0)      6.5643 (1.09)     0.0000 (1.0)           0;0  0.1523 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     95.2658 (3.87)     95.2658 (3.87)     95.2658 (3.87)     0.0000 (1.0)      95.2658 (3.87)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_partial_remove-push[3.10.0]     47.6918 (1.94)     47.6918 (1.94)     47.6918 (1.94)     0.0000 (1.0)      47.6918 (1.94)     0.0000 (1.0)           0;0  0.0210 (0.52)          1           1
test_partial_remove-push[main]       24.6258 (1.0)      24.6258 (1.0)      24.6258 (1.0)      0.0000 (1.0)      24.6258 (1.0)      0.0000 (1.0)           0;0  0.0406 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0173 (1.00)     2.0173 (1.00)     2.0173 (1.00)     0.0000 (1.0)      2.0173 (1.00)     0.0000 (1.0)           0;0  0.4957 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     2.0165 (1.0)      2.0165 (1.0)      2.0165 (1.0)      0.0000 (1.0)      2.0165 (1.0)      0.0000 (1.0)           0;0  0.4959 (1.0)           1           1
test_partial_remove-push-update[main]       2.8610 (1.42)     2.8610 (1.42)     2.8610 (1.42)     0.0000 (1.0)      2.8610 (1.42)     0.0000 (1.0)           0;0  0.3495 (0.70)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     437.4559 (1.0)      452.4846 (1.0)      443.3043 (1.0)      5.7820 (7.68)     441.3969 (1.0)      7.2092 (7.79)          2;0  2.2558 (1.0)           5           3
test_plots-plots-diff[3.10.0]     778.7447 (1.78)     780.7657 (1.73)     779.8317 (1.76)     0.7533 (1.0)      780.0670 (1.77)     0.9256 (1.0)           2;0  1.2823 (0.57)          5           3
test_plots-plots-diff[main]       731.2176 (1.67)     755.0152 (1.67)     738.1009 (1.66)     9.7092 (12.89)    735.8552 (1.67)     8.9973 (9.72)          1;1  1.3548 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       438.6313 (1.0)        446.7434 (1.0)        442.3779 (1.0)      2.9436 (1.05)       442.1916 (1.0)      3.2999 (1.0)           2;0  2.2605 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,023.6859 (2.33)     1,030.5905 (2.31)     1,026.7406 (2.32)     2.7923 (1.0)      1,025.5546 (2.32)     4.2252 (1.28)          2;0  0.9740 (0.43)          5           3
test_plots-plots-diff-json[main]         804.9389 (1.84)       812.7914 (1.82)       809.5239 (1.83)     3.0649 (1.10)       810.3923 (1.83)     4.3397 (1.32)          2;0  1.2353 (0.55)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     384.8872 (1.0)      393.8682 (1.0)      388.6471 (1.0)       3.6548 (1.09)     387.8909 (1.0)       5.7970 (2.01)          2;0  2.5730 (1.0)           5           3
test_plots-plots-show[3.10.0]     640.1130 (1.66)     648.5756 (1.65)     642.7155 (1.65)      3.3638 (1.0)      641.8558 (1.65)      2.8901 (1.0)           1;1  1.5559 (0.60)          5           3
test_plots-plots-show[main]       619.2159 (1.61)     768.7609 (1.95)     665.0197 (1.71)     62.4230 (18.56)    638.7340 (1.65)     78.9343 (27.31)         1;0  1.5037 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     401.9019 (1.0)      416.3862 (1.0)      407.3417 (1.0)      6.3457 (2.26)     404.3494 (1.0)      10.3741 (4.19)          1;0  2.4549 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     784.8068 (1.95)     791.7114 (1.90)     786.7978 (1.93)     2.8048 (1.0)      785.7444 (1.94)      2.4788 (1.0)           1;1  1.2710 (0.52)          5           3
test_plots-plots-show-json[main]       660.7036 (1.64)     670.5352 (1.61)     666.1122 (1.64)     4.2691 (1.52)     667.7521 (1.65)      7.3392 (2.96)          2;0  1.5012 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     95.2368 (3.86)     95.2368 (3.86)     95.2368 (3.86)     0.0000 (1.0)      95.2368 (3.86)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_push-push[3.10.0]     48.0108 (1.94)     48.0108 (1.94)     48.0108 (1.94)     0.0000 (1.0)      48.0108 (1.94)     0.0000 (1.0)           0;0  0.0208 (0.51)          1           1
test_push-push[main]       24.6875 (1.0)      24.6875 (1.0)      24.6875 (1.0)      0.0000 (1.0)      24.6875 (1.0)      0.0000 (1.0)           0;0  0.0405 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     97.9635 (1.03)     97.9635 (1.03)     97.9635 (1.03)     0.0000 (1.0)      97.9635 (1.03)     0.0000 (1.0)           0;0  0.0102 (0.97)          1           1
test_sharing-add[3.10.0]     99.1202 (1.04)     99.1202 (1.04)     99.1202 (1.04)     0.0000 (1.0)      99.1202 (1.04)     0.0000 (1.0)           0;0  0.0101 (0.96)          1           1
test_sharing-add[main]       95.1676 (1.0)      95.1676 (1.0)      95.1676 (1.0)      0.0000 (1.0)      95.1676 (1.0)      0.0000 (1.0)           0;0  0.0105 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     63.8777 (1.05)     63.8777 (1.05)     63.8777 (1.05)     0.0000 (1.0)      63.8777 (1.05)     0.0000 (1.0)           0;0  0.0157 (0.96)          1           1
test_sharing-add-noop[3.10.0]     65.1536 (1.07)     65.1536 (1.07)     65.1536 (1.07)     0.0000 (1.0)      65.1536 (1.07)     0.0000 (1.0)           0;0  0.0153 (0.94)          1           1
test_sharing-add-noop[main]       61.0394 (1.0)      61.0394 (1.0)      61.0394 (1.0)      0.0000 (1.0)      61.0394 (1.0)      0.0000 (1.0)           0;0  0.0164 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      44.0304 (1.45)      44.0304 (1.45)      44.0304 (1.45)     0.0000 (1.0)       44.0304 (1.45)     0.0000 (1.0)           0;0  0.0227 (0.69)          1           1
test_sharing-checkout[3.10.0]     106.4167 (3.51)     106.4167 (3.51)     106.4167 (3.51)     0.0000 (1.0)      106.4167 (3.51)     0.0000 (1.0)           0;0  0.0094 (0.28)          1           1
test_sharing-checkout[main]        30.2755 (1.0)       30.2755 (1.0)       30.2755 (1.0)      0.0000 (1.0)       30.2755 (1.0)      0.0000 (1.0)           0;0  0.0330 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.8254 (1.02)     6.8254 (1.02)     6.8254 (1.02)     0.0000 (1.0)      6.8254 (1.02)     0.0000 (1.0)           0;0  0.1465 (0.98)          1           1
test_sharing-checkout-noop[3.10.0]     6.9777 (1.05)     6.9777 (1.05)     6.9777 (1.05)     0.0000 (1.0)      6.9777 (1.05)     0.0000 (1.0)           0;0  0.1433 (0.96)          1           1
test_sharing-checkout-noop[main]       6.6699 (1.0)      6.6699 (1.0)      6.6699 (1.0)      0.0000 (1.0)      6.6699 (1.0)      0.0000 (1.0)           0;0  0.1499 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     113.8010 (2.73)     113.8010 (2.73)     113.8010 (2.73)     0.0000 (1.0)      113.8010 (2.73)     0.0000 (1.0)           0;0  0.0088 (0.37)          1           1
test_sharing-fetch[3.10.0]     119.8927 (2.87)     119.8927 (2.87)     119.8927 (2.87)     0.0000 (1.0)      119.8927 (2.87)     0.0000 (1.0)           0;0  0.0083 (0.35)          1           1
test_sharing-fetch[main]        41.7508 (1.0)       41.7508 (1.0)       41.7508 (1.0)      0.0000 (1.0)       41.7508 (1.0)      0.0000 (1.0)           0;0  0.0240 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.5270 (1.0)      1.5270 (1.0)      1.5270 (1.0)      0.0000 (1.0)      1.5270 (1.0)      0.0000 (1.0)           0;0  0.6549 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.9236 (2.57)     3.9236 (2.57)     3.9236 (2.57)     0.0000 (1.0)      3.9236 (2.57)     0.0000 (1.0)           0;0  0.2549 (0.39)          1           1
test_sharing-fetch-noop[main]       7.1309 (4.67)     7.1309 (4.67)     7.1309 (4.67)     0.0000 (1.0)      7.1309 (4.67)     0.0000 (1.0)           0;0  0.1402 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     96.4206 (3.70)     96.4206 (3.70)     96.4206 (3.70)     0.0000 (1.0)      96.4206 (3.70)     0.0000 (1.0)           0;0  0.0104 (0.27)          1           1
test_sharing-push[3.10.0]     48.9354 (1.88)     48.9354 (1.88)     48.9354 (1.88)     0.0000 (1.0)      48.9354 (1.88)     0.0000 (1.0)           0;0  0.0204 (0.53)          1           1
test_sharing-push[main]       26.0329 (1.0)      26.0329 (1.0)      26.0329 (1.0)      0.0000 (1.0)      26.0329 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.6026 (1.0)      2.6026 (1.0)      2.6026 (1.0)      0.0000 (1.0)      2.6026 (1.0)      0.0000 (1.0)           0;0  0.3842 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.7486 (1.06)     2.7486 (1.06)     2.7486 (1.06)     0.0000 (1.0)      2.7486 (1.06)     0.0000 (1.0)           0;0  0.3638 (0.95)          1           1
test_sharing-push-noop[main]       7.4513 (2.86)     7.4513 (2.86)     7.4513 (2.86)     0.0000 (1.0)      7.4513 (2.86)     0.0000 (1.0)           0;0  0.1342 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     97.0629 (1.04)     97.0629 (1.04)     97.0629 (1.04)     0.0000 (1.0)      97.0629 (1.04)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing_azure-add[3.10.0]     95.8719 (1.02)     95.8719 (1.02)     95.8719 (1.02)     0.0000 (1.0)      95.8719 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_azure-add[main]       93.6893 (1.0)      93.6893 (1.0)      93.6893 (1.0)      0.0000 (1.0)      93.6893 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.7301 (1.06)     63.7301 (1.06)     63.7301 (1.06)     0.0000 (1.0)      63.7301 (1.06)     0.0000 (1.0)           0;0  0.0157 (0.94)          1           1
test_sharing_azure-add-noop[3.10.0]     63.5822 (1.06)     63.5822 (1.06)     63.5822 (1.06)     0.0000 (1.0)      63.5822 (1.06)     0.0000 (1.0)           0;0  0.0157 (0.94)          1           1
test_sharing_azure-add-noop[main]       60.0467 (1.0)      60.0467 (1.0)      60.0467 (1.0)      0.0000 (1.0)      60.0467 (1.0)      0.0000 (1.0)           0;0  0.0167 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      43.1421 (1.43)      43.1421 (1.43)      43.1421 (1.43)     0.0000 (1.0)       43.1421 (1.43)     0.0000 (1.0)           0;0  0.0232 (0.70)          1           1
test_sharing_azure-checkout[3.10.0]     103.4080 (3.43)     103.4080 (3.43)     103.4080 (3.43)     0.0000 (1.0)      103.4080 (3.43)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_azure-checkout[main]        30.1078 (1.0)       30.1078 (1.0)       30.1078 (1.0)      0.0000 (1.0)       30.1078 (1.0)      0.0000 (1.0)           0;0  0.0332 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.6013 (1.02)     6.6013 (1.02)     6.6013 (1.02)     0.0000 (1.0)      6.6013 (1.02)     0.0000 (1.0)           0;0  0.1515 (0.98)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.8362 (1.05)     6.8362 (1.05)     6.8362 (1.05)     0.0000 (1.0)      6.8362 (1.05)     0.0000 (1.0)           0;0  0.1463 (0.95)          1           1
test_sharing_azure-checkout-noop[main]       6.4949 (1.0)      6.4949 (1.0)      6.4949 (1.0)      0.0000 (1.0)      6.4949 (1.0)      0.0000 (1.0)           0;0  0.1540 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     112.4338 (2.74)     112.4338 (2.74)     112.4338 (2.74)     0.0000 (1.0)      112.4338 (2.74)     0.0000 (1.0)           0;0  0.0089 (0.36)          1           1
test_sharing_azure-fetch[3.10.0]     117.4496 (2.87)     117.4496 (2.87)     117.4496 (2.87)     0.0000 (1.0)      117.4496 (2.87)     0.0000 (1.0)           0;0  0.0085 (0.35)          1           1
test_sharing_azure-fetch[main]        40.9831 (1.0)       40.9831 (1.0)       40.9831 (1.0)      0.0000 (1.0)       40.9831 (1.0)      0.0000 (1.0)           0;0  0.0244 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4495 (1.0)      1.4495 (1.0)      1.4495 (1.0)      0.0000 (1.0)      1.4495 (1.0)      0.0000 (1.0)           0;0  0.6899 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.8584 (2.66)     3.8584 (2.66)     3.8584 (2.66)     0.0000 (1.0)      3.8584 (2.66)     0.0000 (1.0)           0;0  0.2592 (0.38)          1           1
test_sharing_azure-fetch-noop[main]       6.9800 (4.82)     6.9800 (4.82)     6.9800 (4.82)     0.0000 (1.0)      6.9800 (4.82)     0.0000 (1.0)           0;0  0.1433 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     95.7648 (3.78)     95.7648 (3.78)     95.7648 (3.78)     0.0000 (1.0)      95.7648 (3.78)     0.0000 (1.0)           0;0  0.0104 (0.26)          1           1
test_sharing_azure-push[3.10.0]     48.7486 (1.92)     48.7486 (1.92)     48.7486 (1.92)     0.0000 (1.0)      48.7486 (1.92)     0.0000 (1.0)           0;0  0.0205 (0.52)          1           1
test_sharing_azure-push[main]       25.3562 (1.0)      25.3562 (1.0)      25.3562 (1.0)      0.0000 (1.0)      25.3562 (1.0)      0.0000 (1.0)           0;0  0.0394 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.6016 (1.0)      2.6016 (1.0)      2.6016 (1.0)      0.0000 (1.0)      2.6016 (1.0)      0.0000 (1.0)           0;0  0.3844 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]     2.6034 (1.00)     2.6034 (1.00)     2.6034 (1.00)     0.0000 (1.0)      2.6034 (1.00)     0.0000 (1.0)           0;0  0.3841 (1.00)          1           1
test_sharing_azure-push-noop[main]       7.3323 (2.82)     7.3323 (2.82)     7.3323 (2.82)     0.0000 (1.0)      7.3323 (2.82)     0.0000 (1.0)           0;0  0.1364 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     94.3961 (1.03)     94.3961 (1.03)     94.3961 (1.03)     0.0000 (1.0)      94.3961 (1.03)     0.0000 (1.0)           0;0  0.0106 (0.97)          1           1
test_sharing_gs-add[3.10.0]     95.6143 (1.04)     95.6143 (1.04)     95.6143 (1.04)     0.0000 (1.0)      95.6143 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.96)          1           1
test_sharing_gs-add[main]       91.9743 (1.0)      91.9743 (1.0)      91.9743 (1.0)      0.0000 (1.0)      91.9743 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     62.3612 (1.06)     62.3612 (1.06)     62.3612 (1.06)     0.0000 (1.0)      62.3612 (1.06)     0.0000 (1.0)           0;0  0.0160 (0.95)          1           1
test_sharing_gs-add-noop[3.10.0]     62.5146 (1.06)     62.5146 (1.06)     62.5146 (1.06)     0.0000 (1.0)      62.5146 (1.06)     0.0000 (1.0)           0;0  0.0160 (0.94)          1           1
test_sharing_gs-add-noop[main]       58.9354 (1.0)      58.9354 (1.0)      58.9354 (1.0)      0.0000 (1.0)      58.9354 (1.0)      0.0000 (1.0)           0;0  0.0170 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      42.1718 (1.43)      42.1718 (1.43)      42.1718 (1.43)     0.0000 (1.0)       42.1718 (1.43)     0.0000 (1.0)           0;0  0.0237 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     103.9541 (3.52)     103.9541 (3.52)     103.9541 (3.52)     0.0000 (1.0)      103.9541 (3.52)     0.0000 (1.0)           0;0  0.0096 (0.28)          1           1
test_sharing_gs-checkout[main]        29.5347 (1.0)       29.5347 (1.0)       29.5347 (1.0)      0.0000 (1.0)       29.5347 (1.0)      0.0000 (1.0)           0;0  0.0339 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.6171 (1.02)     6.6171 (1.02)     6.6171 (1.02)     0.0000 (1.0)      6.6171 (1.02)     0.0000 (1.0)           0;0  0.1511 (0.98)          1           1
test_sharing_gs-checkout-noop[3.10.0]     6.7552 (1.05)     6.7552 (1.05)     6.7552 (1.05)     0.0000 (1.0)      6.7552 (1.05)     0.0000 (1.0)           0;0  0.1480 (0.96)          1           1
test_sharing_gs-checkout-noop[main]       6.4635 (1.0)      6.4635 (1.0)      6.4635 (1.0)      0.0000 (1.0)      6.4635 (1.0)      0.0000 (1.0)           0;0  0.1547 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     110.4296 (2.75)     110.4296 (2.75)     110.4296 (2.75)     0.0000 (1.0)      110.4296 (2.75)     0.0000 (1.0)           0;0  0.0091 (0.36)          1           1
test_sharing_gs-fetch[3.10.0]     117.0273 (2.92)     117.0273 (2.92)     117.0273 (2.92)     0.0000 (1.0)      117.0273 (2.92)     0.0000 (1.0)           0;0  0.0085 (0.34)          1           1
test_sharing_gs-fetch[main]        40.1288 (1.0)       40.1288 (1.0)       40.1288 (1.0)      0.0000 (1.0)       40.1288 (1.0)      0.0000 (1.0)           0;0  0.0249 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4241 (1.0)      1.4241 (1.0)      1.4241 (1.0)      0.0000 (1.0)      1.4241 (1.0)      0.0000 (1.0)           0;0  0.7022 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.8898 (2.73)     3.8898 (2.73)     3.8898 (2.73)     0.0000 (1.0)      3.8898 (2.73)     0.0000 (1.0)           0;0  0.2571 (0.37)          1           1
test_sharing_gs-fetch-noop[main]       6.8930 (4.84)     6.8930 (4.84)     6.8930 (4.84)     0.0000 (1.0)      6.8930 (4.84)     0.0000 (1.0)           0;0  0.1451 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     95.3804 (3.68)     95.3804 (3.68)     95.3804 (3.68)     0.0000 (1.0)      95.3804 (3.68)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing_gs-push[3.10.0]     48.4906 (1.87)     48.4906 (1.87)     48.4906 (1.87)     0.0000 (1.0)      48.4906 (1.87)     0.0000 (1.0)           0;0  0.0206 (0.54)          1           1
test_sharing_gs-push[main]       25.9479 (1.0)      25.9479 (1.0)      25.9479 (1.0)      0.0000 (1.0)      25.9479 (1.0)      0.0000 (1.0)           0;0  0.0385 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.5011 (1.0)      2.5011 (1.0)      2.5011 (1.0)      0.0000 (1.0)      2.5011 (1.0)      0.0000 (1.0)           0;0  0.3998 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.5102 (1.00)     2.5102 (1.00)     2.5102 (1.00)     0.0000 (1.0)      2.5102 (1.00)     0.0000 (1.0)           0;0  0.3984 (1.00)          1           1
test_sharing_gs-push-noop[main]       7.1597 (2.86)     7.1597 (2.86)     7.1597 (2.86)     0.0000 (1.0)      7.1597 (2.86)     0.0000 (1.0)           0;0  0.1397 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     94.7945 (1.04)     94.7945 (1.04)     94.7945 (1.04)     0.0000 (1.0)      94.7945 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.96)          1           1
test_sharing_s3-add[3.10.0]     96.0806 (1.05)     96.0806 (1.05)     96.0806 (1.05)     0.0000 (1.0)      96.0806 (1.05)     0.0000 (1.0)           0;0  0.0104 (0.95)          1           1
test_sharing_s3-add[main]       91.3070 (1.0)      91.3070 (1.0)      91.3070 (1.0)      0.0000 (1.0)      91.3070 (1.0)      0.0000 (1.0)           0;0  0.0110 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     62.5572 (1.06)     62.5572 (1.06)     62.5572 (1.06)     0.0000 (1.0)      62.5572 (1.06)     0.0000 (1.0)           0;0  0.0160 (0.95)          1           1
test_sharing_s3-add-noop[3.10.0]     63.1805 (1.07)     63.1805 (1.07)     63.1805 (1.07)     0.0000 (1.0)      63.1805 (1.07)     0.0000 (1.0)           0;0  0.0158 (0.94)          1           1
test_sharing_s3-add-noop[main]       59.1956 (1.0)      59.1956 (1.0)      59.1956 (1.0)      0.0000 (1.0)      59.1956 (1.0)      0.0000 (1.0)           0;0  0.0169 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.5286 (1.43)      42.5286 (1.43)      42.5286 (1.43)     0.0000 (1.0)       42.5286 (1.43)     0.0000 (1.0)           0;0  0.0235 (0.70)          1           1
test_sharing_s3-checkout[3.10.0]     101.8644 (3.42)     101.8644 (3.42)     101.8644 (3.42)     0.0000 (1.0)      101.8644 (3.42)     0.0000 (1.0)           0;0  0.0098 (0.29)          1           1
test_sharing_s3-checkout[main]        29.8283 (1.0)       29.8283 (1.0)       29.8283 (1.0)      0.0000 (1.0)       29.8283 (1.0)      0.0000 (1.0)           0;0  0.0335 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.7824 (1.04)     6.7824 (1.04)     6.7824 (1.04)     0.0000 (1.0)      6.7824 (1.04)     0.0000 (1.0)           0;0  0.1474 (0.96)          1           1
test_sharing_s3-checkout-noop[3.10.0]     7.0160 (1.07)     7.0160 (1.07)     7.0160 (1.07)     0.0000 (1.0)      7.0160 (1.07)     0.0000 (1.0)           0;0  0.1425 (0.93)          1           1
test_sharing_s3-checkout-noop[main]       6.5267 (1.0)      6.5267 (1.0)      6.5267 (1.0)      0.0000 (1.0)      6.5267 (1.0)      0.0000 (1.0)           0;0  0.1532 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     310.3638 (1.11)     310.3638 (1.11)     310.3638 (1.11)     0.0000 (1.0)      310.3638 (1.11)     0.0000 (1.0)           0;0  0.0032 (0.90)          1           1
test_sharing_s3-fetch[3.10.0]     380.6719 (1.37)     380.6719 (1.37)     380.6719 (1.37)     0.0000 (1.0)      380.6719 (1.37)     0.0000 (1.0)           0;0  0.0026 (0.73)          1           1
test_sharing_s3-fetch[main]       278.7033 (1.0)      278.7033 (1.0)      278.7033 (1.0)      0.0000 (1.0)      278.7033 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.5947 (1.0)      1.5947 (1.0)      1.5947 (1.0)      0.0000 (1.0)      1.5947 (1.0)      0.0000 (1.0)           0;0  0.6271 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     3.9262 (2.46)     3.9262 (2.46)     3.9262 (2.46)     0.0000 (1.0)      3.9262 (2.46)     0.0000 (1.0)           0;0  0.2547 (0.41)          1           1
test_sharing_s3-fetch-noop[main]       7.3974 (4.64)     7.3974 (4.64)     7.3974 (4.64)     0.0000 (1.0)      7.3974 (4.64)     0.0000 (1.0)           0;0  0.1352 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     444.4926 (1.16)     444.4926 (1.16)     444.4926 (1.16)     0.0000 (1.0)      444.4926 (1.16)     0.0000 (1.0)           0;0  0.0022 (0.86)          1           1
test_sharing_s3-push[3.10.0]     382.8680 (1.0)      382.8680 (1.0)      382.8680 (1.0)      0.0000 (1.0)      382.8680 (1.0)      0.0000 (1.0)           0;0  0.0026 (1.0)           1           1
test_sharing_s3-push[main]       452.7633 (1.18)     452.7633 (1.18)     452.7633 (1.18)     0.0000 (1.0)      452.7633 (1.18)     0.0000 (1.0)           0;0  0.0022 (0.85)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.9097 (1.0)      2.9097 (1.0)      2.9097 (1.0)      0.0000 (1.0)      2.9097 (1.0)      0.0000 (1.0)           0;0  0.3437 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     7.9079 (2.72)     7.9079 (2.72)     7.9079 (2.72)     0.0000 (1.0)      7.9079 (2.72)     0.0000 (1.0)           0;0  0.1265 (0.37)          1           1
test_sharing_s3-push-noop[main]       7.4735 (2.57)     7.4735 (2.57)     7.4735 (2.57)     0.0000 (1.0)      7.4735 (2.57)     0.0000 (1.0)           0;0  0.1338 (0.39)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.2508 (1.00)     22.2508 (1.00)     22.2508 (1.00)     0.0000 (1.0)      22.2508 (1.00)     0.0000 (1.0)           0;0  0.0449 (1.00)          1           1
test_status-status[3.10.0]     22.4909 (1.02)     22.4909 (1.02)     22.4909 (1.02)     0.0000 (1.0)      22.4909 (1.02)     0.0000 (1.0)           0;0  0.0445 (0.98)          1           1
test_status-status[main]       22.1443 (1.0)      22.1443 (1.0)      22.1443 (1.0)      0.0000 (1.0)      22.1443 (1.0)      0.0000 (1.0)           0;0  0.0452 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.8060 (1.0)      5.8060 (1.0)      5.8060 (1.0)      0.0000 (1.0)      5.8060 (1.0)      0.0000 (1.0)           0;0  0.1722 (1.0)           1           1
test_status-status-changed[3.10.0]     6.1290 (1.06)     6.1290 (1.06)     6.1290 (1.06)     0.0000 (1.0)      6.1290 (1.06)     0.0000 (1.0)           0;0  0.1632 (0.95)          1           1
test_status-status-changed[main]       5.8738 (1.01)     5.8738 (1.01)     5.8738 (1.01)     0.0000 (1.0)      5.8738 (1.01)     0.0000 (1.0)           0;0  0.1702 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6529 (1.00)     5.6529 (1.00)     5.6529 (1.00)     0.0000 (1.0)      5.6529 (1.00)     0.0000 (1.0)           0;0  0.1769 (1.00)          1           1
test_status-status-changed-noop[3.10.0]     5.9446 (1.06)     5.9446 (1.06)     5.9446 (1.06)     0.0000 (1.0)      5.9446 (1.06)     0.0000 (1.0)           0;0  0.1682 (0.95)          1           1
test_status-status-changed-noop[main]       5.6263 (1.0)      5.6263 (1.0)      5.6263 (1.0)      0.0000 (1.0)      5.6263 (1.0)      0.0000 (1.0)           0;0  0.1777 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7482 (1.0)      5.7482 (1.0)      5.7482 (1.0)      0.0000 (1.0)      5.7482 (1.0)      0.0000 (1.0)           0;0  0.1740 (1.0)           1           1
test_status-status-noop[3.10.0]     6.0503 (1.05)     6.0503 (1.05)     6.0503 (1.05)     0.0000 (1.0)      6.0503 (1.05)     0.0000 (1.0)           0;0  0.1653 (0.95)          1           1
test_status-status-noop[main]       5.9270 (1.03)     5.9270 (1.03)     5.9270 (1.03)     0.0000 (1.0)      5.9270 (1.03)     0.0000 (1.0)           0;0  0.1687 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     201.4537 (1.53)     201.4537 (1.53)     201.4537 (1.53)     0.0000 (1.0)      201.4537 (1.53)     0.0000 (1.0)           0;0  0.0050 (0.65)          1           1
test_update-import-url[3.10.0]     204.7353 (1.56)     204.7353 (1.56)     204.7353 (1.56)     0.0000 (1.0)      204.7353 (1.56)     0.0000 (1.0)           0;0  0.0049 (0.64)          1           1
test_update-import-url[main]       131.6572 (1.0)      131.6572 (1.0)      131.6572 (1.0)      0.0000 (1.0)      131.6572 (1.0)      0.0000 (1.0)           0;0  0.0076 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     184.6499 (1.60)     184.6499 (1.60)     184.6499 (1.60)     0.0000 (1.0)      184.6499 (1.60)     0.0000 (1.0)           0;0  0.0054 (0.63)          1           1
test_update-update[3.10.0]     190.1828 (1.64)     190.1828 (1.64)     190.1828 (1.64)     0.0000 (1.0)      190.1828 (1.64)     0.0000 (1.0)           0;0  0.0053 (0.61)          1           1
test_update-update[main]       115.6673 (1.0)      115.6673 (1.0)      115.6673 (1.0)      0.0000 (1.0)      115.6673 (1.0)      0.0000 (1.0)           0;0  0.0086 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     18.0204 (1.0)      18.0204 (1.0)      18.0204 (1.0)      0.0000 (1.0)      18.0204 (1.0)      0.0000 (1.0)           0;0  0.0555 (1.0)           1           1
test_update-update-noop[3.10.0]     19.0923 (1.06)     19.0923 (1.06)     19.0923 (1.06)     0.0000 (1.0)      19.0923 (1.06)     0.0000 (1.0)           0;0  0.0524 (0.94)          1           1
test_update-update-noop[main]       18.1723 (1.01)     18.1723 (1.01)     18.1723 (1.01)     0.0000 (1.0)      18.1723 (1.01)     0.0000 (1.0)           0;0  0.0550 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean