Sat Apr 27 01:12:26 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     95.9709 (1.03)     95.9709 (1.03)     95.9709 (1.03)     0.0000 (1.0)      95.9709 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_add-add[3.10.0]     96.2869 (1.04)     96.2869 (1.04)     96.2869 (1.04)     0.0000 (1.0)      96.2869 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_add-add[main]       92.7494 (1.0)      92.7494 (1.0)      92.7494 (1.0)      0.0000 (1.0)      92.7494 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      44.0091 (1.37)      44.0091 (1.37)      44.0091 (1.37)     0.0000 (1.0)       44.0091 (1.37)     0.0000 (1.0)           0;0  0.0227 (0.73)          1           1
test_checkout_copy-checkout[3.10.0]     105.4164 (3.28)     105.4164 (3.28)     105.4164 (3.28)     0.0000 (1.0)      105.4164 (3.28)     0.0000 (1.0)           0;0  0.0095 (0.30)          1           1
test_checkout_copy-checkout[main]        32.1044 (1.0)       32.1044 (1.0)       32.1044 (1.0)      0.0000 (1.0)       32.1044 (1.0)      0.0000 (1.0)           0;0  0.0311 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.8369 (1.04)     6.8369 (1.04)     6.8369 (1.04)     0.0000 (1.0)      6.8369 (1.04)     0.0000 (1.0)           0;0  0.1463 (0.96)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.8911 (1.05)     6.8911 (1.05)     6.8911 (1.05)     0.0000 (1.0)      6.8911 (1.05)     0.0000 (1.0)           0;0  0.1451 (0.95)          1           1
test_checkout_copy-checkout-noop[main]       6.5627 (1.0)      6.5627 (1.0)      6.5627 (1.0)      0.0000 (1.0)      6.5627 (1.0)      0.0000 (1.0)           0;0  0.1524 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.9145 (1.47)     10.9145 (1.47)     10.9145 (1.47)     0.0000 (1.0)      10.9145 (1.47)     0.0000 (1.0)           0;0  0.0916 (0.68)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.4940 (1.01)      7.4940 (1.01)      7.4940 (1.01)     0.0000 (1.0)       7.4940 (1.01)     0.0000 (1.0)           0;0  0.1334 (0.99)          1           1
test_checkout_copy-checkout-update[main]        7.4315 (1.0)       7.4315 (1.0)       7.4315 (1.0)      0.0000 (1.0)       7.4315 (1.0)      0.0000 (1.0)           0;0  0.1346 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.7269 (1.34)     25.7269 (1.34)     25.7269 (1.34)     0.0000 (1.0)      25.7269 (1.34)     0.0000 (1.0)           0;0  0.0389 (0.75)          1           1
test_checkout_hardlink-checkout[3.10.0]     19.7384 (1.03)     19.7384 (1.03)     19.7384 (1.03)     0.0000 (1.0)      19.7384 (1.03)     0.0000 (1.0)           0;0  0.0507 (0.97)          1           1
test_checkout_hardlink-checkout[main]       19.2097 (1.0)      19.2097 (1.0)      19.2097 (1.0)      0.0000 (1.0)      19.2097 (1.0)      0.0000 (1.0)           0;0  0.0521 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.9109 (1.05)     6.9109 (1.05)     6.9109 (1.05)     0.0000 (1.0)      6.9109 (1.05)     0.0000 (1.0)           0;0  0.1447 (0.96)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.8609 (1.04)     6.8609 (1.04)     6.8609 (1.04)     0.0000 (1.0)      6.8609 (1.04)     0.0000 (1.0)           0;0  0.1458 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       6.6120 (1.0)      6.6120 (1.0)      6.6120 (1.0)      0.0000 (1.0)      6.6120 (1.0)      0.0000 (1.0)           0;0  0.1512 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.7105 (1.44)     10.7105 (1.44)     10.7105 (1.44)     0.0000 (1.0)      10.7105 (1.44)     0.0000 (1.0)           0;0  0.0934 (0.69)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.5235 (1.01)      7.5235 (1.01)      7.5235 (1.01)     0.0000 (1.0)       7.5235 (1.01)     0.0000 (1.0)           0;0  0.1329 (0.99)          1           1
test_checkout_hardlink-checkout-update[main]        7.4211 (1.0)       7.4211 (1.0)       7.4211 (1.0)      0.0000 (1.0)       7.4211 (1.0)      0.0000 (1.0)           0;0  0.1348 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.2288 (1.31)     30.2288 (1.31)     30.2288 (1.31)     0.0000 (1.0)      30.2288 (1.31)     0.0000 (1.0)           0;0  0.0331 (0.77)          1           1
test_checkout_symlink-checkout[3.10.0]     23.1638 (1.0)      23.1638 (1.0)      23.1638 (1.0)      0.0000 (1.0)      23.1638 (1.0)      0.0000 (1.0)           0;0  0.0432 (1.0)           1           1
test_checkout_symlink-checkout[main]       23.4380 (1.01)     23.4380 (1.01)     23.4380 (1.01)     0.0000 (1.0)      23.4380 (1.01)     0.0000 (1.0)           0;0  0.0427 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.3913 (1.01)     8.3913 (1.01)     8.3913 (1.01)     0.0000 (1.0)      8.3913 (1.01)     0.0000 (1.0)           0;0  0.1192 (0.99)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.4794 (1.02)     8.4794 (1.02)     8.4794 (1.02)     0.0000 (1.0)      8.4794 (1.02)     0.0000 (1.0)           0;0  0.1179 (0.98)          1           1
test_checkout_symlink-checkout-noop[main]       8.3450 (1.0)      8.3450 (1.0)      8.3450 (1.0)      0.0000 (1.0)      8.3450 (1.0)      0.0000 (1.0)           0;0  0.1198 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     13.4946 (1.35)     13.4946 (1.35)     13.4946 (1.35)     0.0000 (1.0)      13.4946 (1.35)     0.0000 (1.0)           0;0  0.0741 (0.74)          1           1
test_checkout_symlink-checkout-update[3.10.0]     10.0190 (1.0)      10.0190 (1.0)      10.0190 (1.0)      0.0000 (1.0)      10.0190 (1.0)      0.0000 (1.0)           0;0  0.0998 (1.0)           1           1
test_checkout_symlink-checkout-update[main]       10.2300 (1.02)     10.2300 (1.02)     10.2300 (1.02)     0.0000 (1.0)      10.2300 (1.02)     0.0000 (1.0)           0;0  0.0978 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.7984 (1.0)      4.7984 (1.0)      4.7984 (1.0)      0.0000 (1.0)      4.7984 (1.0)      0.0000 (1.0)           0;0  0.2084 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.2963 (1.10)     5.2963 (1.10)     5.2963 (1.10)     0.0000 (1.0)      5.2963 (1.10)     0.0000 (1.0)           0;0  0.1888 (0.91)          1           1
test_data_status-data-changed[main]       5.3049 (1.11)     5.3049 (1.11)     5.3049 (1.11)     0.0000 (1.0)      5.3049 (1.11)     0.0000 (1.0)           0;0  0.1885 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.9008 (1.0)      4.9008 (1.0)      4.9008 (1.0)      0.0000 (1.0)      4.9008 (1.0)      0.0000 (1.0)           0;0  0.2040 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.5097 (1.12)     5.5097 (1.12)     5.5097 (1.12)     0.0000 (1.0)      5.5097 (1.12)     0.0000 (1.0)           0;0  0.1815 (0.89)          1           1
test_data_status-data-changed-noop[main]       5.4029 (1.10)     5.4029 (1.10)     5.4029 (1.10)     0.0000 (1.0)      5.4029 (1.10)     0.0000 (1.0)           0;0  0.1851 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.9314 (1.00)     20.9314 (1.00)     20.9314 (1.00)     0.0000 (1.0)      20.9314 (1.00)     0.0000 (1.0)           0;0  0.0478 (1.00)          1           1
test_data_status-data-new[3.10.0]     21.5073 (1.03)     21.5073 (1.03)     21.5073 (1.03)     0.0000 (1.0)      21.5073 (1.03)     0.0000 (1.0)           0;0  0.0465 (0.97)          1           1
test_data_status-data-new[main]       20.8815 (1.0)      20.8815 (1.0)      20.8815 (1.0)      0.0000 (1.0)      20.8815 (1.0)      0.0000 (1.0)           0;0  0.0479 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     5.0343 (1.0)      5.0343 (1.0)      5.0343 (1.0)      0.0000 (1.0)      5.0343 (1.0)      0.0000 (1.0)           0;0  0.1986 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.4699 (1.09)     5.4699 (1.09)     5.4699 (1.09)     0.0000 (1.0)      5.4699 (1.09)     0.0000 (1.0)           0;0  0.1828 (0.92)          1           1
test_data_status-data-noop[main]       5.6099 (1.11)     5.6099 (1.11)     5.6099 (1.11)     0.0000 (1.0)      5.6099 (1.11)     0.0000 (1.0)           0;0  0.1783 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     18.9203 (1.0)      18.9203 (1.0)      18.9203 (1.0)      0.0000 (1.0)      18.9203 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.9553 (1.05)     19.9553 (1.05)     19.9553 (1.05)     0.0000 (1.0)      19.9553 (1.05)     0.0000 (1.0)           0;0  0.0501 (0.95)          1           1
test_data_status_all_flags-data-changed[main]       19.6651 (1.04)     19.6651 (1.04)     19.6651 (1.04)     0.0000 (1.0)      19.6651 (1.04)     0.0000 (1.0)           0;0  0.0509 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.1141 (1.0)      19.1141 (1.0)      19.1141 (1.0)      0.0000 (1.0)      19.1141 (1.0)      0.0000 (1.0)           0;0  0.0523 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.8443 (1.04)     19.8443 (1.04)     19.8443 (1.04)     0.0000 (1.0)      19.8443 (1.04)     0.0000 (1.0)           0;0  0.0504 (0.96)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.8479 (1.04)     19.8479 (1.04)     19.8479 (1.04)     0.0000 (1.0)      19.8479 (1.04)     0.0000 (1.0)           0;0  0.0504 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.6901 (1.0)      34.6901 (1.0)      34.6901 (1.0)      0.0000 (1.0)      34.6901 (1.0)      0.0000 (1.0)           0;0  0.0288 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     36.0682 (1.04)     36.0682 (1.04)     36.0682 (1.04)     0.0000 (1.0)      36.0682 (1.04)     0.0000 (1.0)           0;0  0.0277 (0.96)          1           1
test_data_status_all_flags-data-new[main]       35.9635 (1.04)     35.9635 (1.04)     35.9635 (1.04)     0.0000 (1.0)      35.9635 (1.04)     0.0000 (1.0)           0;0  0.0278 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.4463 (1.0)      18.4463 (1.0)      18.4463 (1.0)      0.0000 (1.0)      18.4463 (1.0)      0.0000 (1.0)           0;0  0.0542 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     18.9987 (1.03)     18.9987 (1.03)     18.9987 (1.03)     0.0000 (1.0)      18.9987 (1.03)     0.0000 (1.0)           0;0  0.0526 (0.97)          1           1
test_data_status_all_flags-data-noop[main]       18.8357 (1.02)     18.8357 (1.02)     18.8357 (1.02)     0.0000 (1.0)      18.8357 (1.02)     0.0000 (1.0)           0;0  0.0531 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     19.6195 (1.0)      19.6195 (1.0)      19.6195 (1.0)      0.0000 (1.0)      19.6195 (1.0)      0.0000 (1.0)           0;0  0.0510 (1.0)           1           1
test_diff-diff[3.10.0]     21.0782 (1.07)     21.0782 (1.07)     21.0782 (1.07)     0.0000 (1.0)      21.0782 (1.07)     0.0000 (1.0)           0;0  0.0474 (0.93)          1           1
test_diff-diff[main]       23.1748 (1.18)     23.1748 (1.18)     23.1748 (1.18)     0.0000 (1.0)      23.1748 (1.18)     0.0000 (1.0)           0;0  0.0432 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.1887 (1.12)     7.1887 (1.12)     7.1887 (1.12)     0.0000 (1.0)      7.1887 (1.12)     0.0000 (1.0)           0;0  0.1391 (0.89)          1           1
test_diff-diff-changed[3.10.0]     7.9697 (1.24)     7.9697 (1.24)     7.9697 (1.24)     0.0000 (1.0)      7.9697 (1.24)     0.0000 (1.0)           0;0  0.1255 (0.81)          1           1
test_diff-diff-changed[main]       6.4324 (1.0)      6.4324 (1.0)      6.4324 (1.0)      0.0000 (1.0)      6.4324 (1.0)      0.0000 (1.0)           0;0  0.1555 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1759 (1.0)      6.1759 (1.0)      6.1759 (1.0)      0.0000 (1.0)      6.1759 (1.0)      0.0000 (1.0)           0;0  0.1619 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.7713 (1.10)     6.7713 (1.10)     6.7713 (1.10)     0.0000 (1.0)      6.7713 (1.10)     0.0000 (1.0)           0;0  0.1477 (0.91)          1           1
test_diff-diff-changed-noop[main]       6.4135 (1.04)     6.4135 (1.04)     6.4135 (1.04)     0.0000 (1.0)      6.4135 (1.04)     0.0000 (1.0)           0;0  0.1559 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.8051 (1.0)      4.8051 (1.0)      4.8051 (1.0)      0.0000 (1.0)      4.8051 (1.0)      0.0000 (1.0)           0;0  0.2081 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.4667 (1.14)     5.4667 (1.14)     5.4667 (1.14)     0.0000 (1.0)      5.4667 (1.14)     0.0000 (1.0)           0;0  0.1829 (0.88)          1           1
test_diff-diff-noop[main]       6.6992 (1.39)     6.6992 (1.39)     6.6992 (1.39)     0.0000 (1.0)      6.6992 (1.39)     0.0000 (1.0)           0;0  0.1493 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       873.3368 (1.0)        873.3368 (1.0)        873.3368 (1.0)      0.0000 (1.0)        873.3368 (1.0)      0.0000 (1.0)           0;0  1.1450 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,386.9242 (5.02)     4,386.9242 (5.02)     4,386.9242 (5.02)     0.0000 (1.0)      4,386.9242 (5.02)     0.0000 (1.0)           0;0  0.2280 (0.20)          1           1
test_exp_show-exp[main]       4,197.5787 (4.81)     4,197.5787 (4.81)     4,197.5787 (4.81)     0.0000 (1.0)      4,197.5787 (4.81)     0.0000 (1.0)           0;0  0.2382 (0.21)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     113.1343 (2.79)     113.1343 (2.79)     113.1343 (2.79)     0.0000 (1.0)      113.1343 (2.79)     0.0000 (1.0)           0;0  0.0088 (0.36)          1           1
test_fetch-fetch[3.10.0]     120.0159 (2.96)     120.0159 (2.96)     120.0159 (2.96)     0.0000 (1.0)      120.0159 (2.96)     0.0000 (1.0)           0;0  0.0083 (0.34)          1           1
test_fetch-fetch[main]        40.5303 (1.0)       40.5303 (1.0)       40.5303 (1.0)      0.0000 (1.0)       40.5303 (1.0)      0.0000 (1.0)           0;0  0.0247 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2937 (1.0)      3.2937 (1.0)      3.2937 (1.0)      0.0000 (1.0)      3.2937 (1.0)      0.0000 (1.0)           0;0  0.3036 (1.0)           1           1
test_gc-gc[3.10.0]     3.3234 (1.01)     3.3234 (1.01)     3.3234 (1.01)     0.0000 (1.0)      3.3234 (1.01)     0.0000 (1.0)           0;0  0.3009 (0.99)          1           1
test_gc-gc[main]       3.3449 (1.02)     3.3449 (1.02)     3.3449 (1.02)     0.0000 (1.0)      3.3449 (1.02)     0.0000 (1.0)           0;0  0.2990 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     183.3106 (1.12)     183.3106 (1.12)     183.3106 (1.12)     0.0000 (1.0)      183.3106 (1.12)     0.0000 (1.0)           0;0  0.0055 (0.89)          1           1
test_get-get[3.10.0]     219.0015 (1.34)     219.0015 (1.34)     219.0015 (1.34)     0.0000 (1.0)      219.0015 (1.34)     0.0000 (1.0)           0;0  0.0046 (0.75)          1           1
test_get-get[main]       163.4359 (1.0)      163.4359 (1.0)      163.4359 (1.0)      0.0000 (1.0)      163.4359 (1.0)      0.0000 (1.0)           0;0  0.0061 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     86.7847 (5.13)     86.7847 (5.13)     86.7847 (5.13)     0.0000 (1.0)      86.7847 (5.13)     0.0000 (1.0)           0;0  0.0115 (0.19)          1           1
test_get_url-get-url[3.10.0]     88.9507 (5.26)     88.9507 (5.26)     88.9507 (5.26)     0.0000 (1.0)      88.9507 (5.26)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[main]       16.9045 (1.0)      16.9045 (1.0)      16.9045 (1.0)      0.0000 (1.0)      16.9045 (1.0)      0.0000 (1.0)           0;0  0.0592 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.0329 (1.03)     141.4395 (1.02)     129.8758 (1.02)     2.1581 (1.05)     129.2191 (1.02)     2.5096 (1.05)         22;2  7.6997 (0.98)        100           1
test_help---help[3.10.0]     123.8806 (1.0)      148.9201 (1.07)     127.7192 (1.0)      3.0599 (1.48)     126.9075 (1.0)      3.1037 (1.30)         14;1  7.8297 (1.0)         100           1
test_help---help[main]       126.9588 (1.02)     138.7394 (1.0)      130.0371 (1.02)     2.0612 (1.0)      129.8788 (1.02)     2.3837 (1.0)          22;3  7.6901 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     296.4882 (1.08)     296.4882 (1.08)     296.4882 (1.08)     0.0000 (1.0)      296.4882 (1.08)     0.0000 (1.0)           0;0  0.0034 (0.93)          1           1
test_import-import[3.10.0]     336.7698 (1.23)     336.7698 (1.23)     336.7698 (1.23)     0.0000 (1.0)      336.7698 (1.23)     0.0000 (1.0)           0;0  0.0030 (0.82)          1           1
test_import-import[main]       274.6495 (1.0)      274.6495 (1.0)      274.6495 (1.0)      0.0000 (1.0)      274.6495 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     213.2781 (1.53)     213.2781 (1.53)     213.2781 (1.53)     0.0000 (1.0)      213.2781 (1.53)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_import_url-import-url[3.10.0]     217.3886 (1.56)     217.3886 (1.56)     217.3886 (1.56)     0.0000 (1.0)      217.3886 (1.56)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_import_url-import-url[main]       139.1626 (1.0)      139.1626 (1.0)      139.1626 (1.0)      0.0000 (1.0)      139.1626 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     365.7556 (1.0)      411.0838 (1.0)      377.9408 (1.0)      8.8653 (1.25)     375.9213 (1.0)      12.3661 (1.69)         28;2  2.6459 (1.0)         100           1
test_init-init[3.10.0]     369.0605 (1.01)     434.1760 (1.06)     381.0099 (1.01)     8.7022 (1.23)     379.8518 (1.01)      7.3300 (1.0)          10;4  2.6246 (0.99)        100           1
test_init-init[main]       372.0519 (1.02)     411.9998 (1.00)     383.1441 (1.01)     7.1016 (1.0)      382.9598 (1.02)      7.3605 (1.00)         17;4  2.6100 (0.99)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     435.5946 (1.07)     435.5946 (1.07)     435.5946 (1.07)     0.0000 (1.0)      435.5946 (1.07)     0.0000 (1.0)           0;0  2.2957 (0.93)          1           1
test_list-list[3.10.0]     407.2708 (1.0)      407.2708 (1.0)      407.2708 (1.0)      0.0000 (1.0)      407.2708 (1.0)      0.0000 (1.0)           0;0  2.4554 (1.0)           1           1
test_list-list[main]       407.7852 (1.00)     407.7852 (1.00)     407.7852 (1.00)     0.0000 (1.0)      407.7852 (1.00)     0.0000 (1.0)           0;0  2.4523 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     406.4903 (1.04)     406.4903 (1.04)     406.4903 (1.04)     0.0000 (1.0)      406.4903 (1.04)     0.0000 (1.0)           0;0  2.4601 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     390.5188 (1.0)      390.5188 (1.0)      390.5188 (1.0)      0.0000 (1.0)      390.5188 (1.0)      0.0000 (1.0)           0;0  2.5607 (1.0)           1           1
test_list-list-dvc-only[main]       394.0722 (1.01)     394.0722 (1.01)     394.0722 (1.01)     0.0000 (1.0)      394.0722 (1.01)     0.0000 (1.0)           0;0  2.5376 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.3111 (1.01)     3.3111 (1.01)     3.3111 (1.01)     0.0000 (1.0)      3.3111 (1.01)     0.0000 (1.0)           0;0  0.3020 (0.99)          1           1
test_list-list-recursive[3.10.0]     3.2757 (1.0)      3.2757 (1.0)      3.2757 (1.0)      0.0000 (1.0)      3.2757 (1.0)      0.0000 (1.0)           0;0  0.3053 (1.0)           1           1
test_list-list-recursive[main]       3.2824 (1.00)     3.2824 (1.00)     3.2824 (1.00)     0.0000 (1.0)      3.2824 (1.00)     0.0000 (1.0)           0;0  0.3047 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     412.2516 (1.06)     412.2516 (1.06)     412.2516 (1.06)     0.0000 (1.0)      412.2516 (1.06)     0.0000 (1.0)           0;0  2.4257 (0.94)          1           1
test_list-list-shallow[3.10.0]     388.1047 (1.0)      388.1047 (1.0)      388.1047 (1.0)      0.0000 (1.0)      388.1047 (1.0)      0.0000 (1.0)           0;0  2.5766 (1.0)           1           1
test_list-list-shallow[main]       403.2278 (1.04)     403.2278 (1.04)     403.2278 (1.04)     0.0000 (1.0)      403.2278 (1.04)     0.0000 (1.0)           0;0  2.4800 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     81.5949 (1.02)     81.5949 (1.02)     81.5949 (1.02)     0.0000 (1.0)      81.5949 (1.02)     0.0000 (1.0)           0;0  0.0123 (0.98)          1           1
test_partial_add-add[3.10.0]     81.9633 (1.03)     81.9633 (1.03)     81.9633 (1.03)     0.0000 (1.0)      81.9633 (1.03)     0.0000 (1.0)           0;0  0.0122 (0.97)          1           1
test_partial_add-add[main]       79.6196 (1.0)      79.6196 (1.0)      79.6196 (1.0)      0.0000 (1.0)      79.6196 (1.0)      0.0000 (1.0)           0;0  0.0126 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     68.1547 (1.02)     68.1547 (1.02)     68.1547 (1.02)     0.0000 (1.0)      68.1547 (1.02)     0.0000 (1.0)           0;0  0.0147 (0.98)          1           1
test_partial_add-add-partial[3.10.0]     69.3914 (1.04)     69.3914 (1.04)     69.3914 (1.04)     0.0000 (1.0)      69.3914 (1.04)     0.0000 (1.0)           0;0  0.0144 (0.96)          1           1
test_partial_add-add-partial[main]       66.8551 (1.0)      66.8551 (1.0)      66.8551 (1.0)      0.0000 (1.0)      66.8551 (1.0)      0.0000 (1.0)           0;0  0.0150 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]      6.4011 (1.0)       6.4011 (1.0)       6.4011 (1.0)      0.0000 (1.0)       6.4011 (1.0)      0.0000 (1.0)           0;0  0.1562 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]      8.8480 (1.38)      8.8480 (1.38)      8.8480 (1.38)     0.0000 (1.0)       8.8480 (1.38)     0.0000 (1.0)           0;0  0.1130 (0.72)          1           1
test_partial_add-gc-cloud-noop[main]       10.0256 (1.57)     10.0256 (1.57)     10.0256 (1.57)     0.0000 (1.0)      10.0256 (1.57)     0.0000 (1.0)           0;0  0.0997 (0.64)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.6456 (1.0)      3.6456 (1.0)      3.6456 (1.0)      0.0000 (1.0)      3.6456 (1.0)      0.0000 (1.0)           0;0  0.2743 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.7654 (1.58)     5.7654 (1.58)     5.7654 (1.58)     0.0000 (1.0)      5.7654 (1.58)     0.0000 (1.0)           0;0  0.1734 (0.63)          1           1
test_partial_add-gc-noop[main]       5.8008 (1.59)     5.8008 (1.59)     5.8008 (1.59)     0.0000 (1.0)      5.8008 (1.59)     0.0000 (1.0)           0;0  0.1724 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     81.2756 (3.73)     81.2756 (3.73)     81.2756 (3.73)     0.0000 (1.0)      81.2756 (3.73)     0.0000 (1.0)           0;0  0.0123 (0.27)          1           1
test_partial_add-push[3.10.0]     40.9652 (1.88)     40.9652 (1.88)     40.9652 (1.88)     0.0000 (1.0)      40.9652 (1.88)     0.0000 (1.0)           0;0  0.0244 (0.53)          1           1
test_partial_add-push[main]       21.8123 (1.0)      21.8123 (1.0)      21.8123 (1.0)      0.0000 (1.0)      21.8123 (1.0)      0.0000 (1.0)           0;0  0.0458 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.9566 (1.57)     17.9566 (1.57)     17.9566 (1.57)     0.0000 (1.0)      17.9566 (1.57)     0.0000 (1.0)           0;0  0.0557 (0.64)          1           1
test_partial_add-push-partial[3.10.0]     11.4089 (1.0)      11.4089 (1.0)      11.4089 (1.0)      0.0000 (1.0)      11.4089 (1.0)      0.0000 (1.0)           0;0  0.0877 (1.0)           1           1
test_partial_add-push-partial[main]       12.4488 (1.09)     12.4488 (1.09)     12.4488 (1.09)     0.0000 (1.0)      12.4488 (1.09)     0.0000 (1.0)           0;0  0.0803 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.8717 (1.04)     95.8717 (1.04)     95.8717 (1.04)     0.0000 (1.0)      95.8717 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_partial_remove-add[3.10.0]     97.2528 (1.05)     97.2528 (1.05)     97.2528 (1.05)     0.0000 (1.0)      97.2528 (1.05)     0.0000 (1.0)           0;0  0.0103 (0.95)          1           1
test_partial_remove-add[main]       92.4275 (1.0)      92.4275 (1.0)      92.4275 (1.0)      0.0000 (1.0)      92.4275 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.6090 (1.07)     9.6090 (1.07)     9.6090 (1.07)     0.0000 (1.0)      9.6090 (1.07)     0.0000 (1.0)           0;0  0.1041 (0.94)          1           1
test_partial_remove-add-update[3.10.0]     9.7336 (1.08)     9.7336 (1.08)     9.7336 (1.08)     0.0000 (1.0)      9.7336 (1.08)     0.0000 (1.0)           0;0  0.1027 (0.92)          1           1
test_partial_remove-add-update[main]       9.0027 (1.0)      9.0027 (1.0)      9.0027 (1.0)      0.0000 (1.0)      9.0027 (1.0)      0.0000 (1.0)           0;0  0.1111 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.2828 (1.0)      4.2828 (1.0)      4.2828 (1.0)      0.0000 (1.0)      4.2828 (1.0)      0.0000 (1.0)           0;0  0.2335 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.7479 (1.11)     4.7479 (1.11)     4.7479 (1.11)     0.0000 (1.0)      4.7479 (1.11)     0.0000 (1.0)           0;0  0.2106 (0.90)          1           1
test_partial_remove-gc[main]       4.9858 (1.16)     4.9858 (1.16)     4.9858 (1.16)     0.0000 (1.0)      4.9858 (1.16)     0.0000 (1.0)           0;0  0.2006 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.8547 (1.0)      5.8547 (1.0)      5.8547 (1.0)      0.0000 (1.0)      5.8547 (1.0)      0.0000 (1.0)           0;0  0.1708 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.3786 (1.09)     6.3786 (1.09)     6.3786 (1.09)     0.0000 (1.0)      6.3786 (1.09)     0.0000 (1.0)           0;0  0.1568 (0.92)          1           1
test_partial_remove-gc-cloud[main]       6.6560 (1.14)     6.6560 (1.14)     6.6560 (1.14)     0.0000 (1.0)      6.6560 (1.14)     0.0000 (1.0)           0;0  0.1502 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     94.7797 (3.82)     94.7797 (3.82)     94.7797 (3.82)     0.0000 (1.0)      94.7797 (3.82)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_partial_remove-push[3.10.0]     47.6769 (1.92)     47.6769 (1.92)     47.6769 (1.92)     0.0000 (1.0)      47.6769 (1.92)     0.0000 (1.0)           0;0  0.0210 (0.52)          1           1
test_partial_remove-push[main]       24.8124 (1.0)      24.8124 (1.0)      24.8124 (1.0)      0.0000 (1.0)      24.8124 (1.0)      0.0000 (1.0)           0;0  0.0403 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0486 (1.0)      2.0486 (1.0)      2.0486 (1.0)      0.0000 (1.0)      2.0486 (1.0)      0.0000 (1.0)           0;0  0.4881 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     2.1058 (1.03)     2.1058 (1.03)     2.1058 (1.03)     0.0000 (1.0)      2.1058 (1.03)     0.0000 (1.0)           0;0  0.4749 (0.97)          1           1
test_partial_remove-push-update[main]       2.8633 (1.40)     2.8633 (1.40)     2.8633 (1.40)     0.0000 (1.0)      2.8633 (1.40)     0.0000 (1.0)           0;0  0.3492 (0.72)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     440.0682 (1.0)      451.0609 (1.0)      446.6786 (1.0)      5.0282 (2.23)     448.6927 (1.0)      8.9466 (3.40)          1;0  2.2387 (1.0)           5           3
test_plots-plots-diff[3.10.0]     794.9050 (1.81)     807.3542 (1.79)     800.6547 (1.79)     4.8780 (2.16)     801.2313 (1.79)     7.3201 (2.78)          2;0  1.2490 (0.56)          5           3
test_plots-plots-diff[main]       737.7416 (1.68)     743.9644 (1.65)     740.8730 (1.66)     2.2577 (1.0)      740.9132 (1.65)     2.6300 (1.0)           2;0  1.3498 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       452.6636 (1.0)        471.5029 (1.0)        460.6676 (1.0)      6.9370 (3.07)       460.4618 (1.0)       7.6209 (2.24)          2;0  2.1708 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,059.5247 (2.34)     1,065.3280 (2.26)     1,062.6374 (2.31)     2.2595 (1.0)      1,062.8999 (2.31)      3.4097 (1.0)           2;0  0.9411 (0.43)          5           3
test_plots-plots-diff-json[main]         815.2361 (1.80)       836.8849 (1.77)       826.1403 (1.79)     8.1132 (3.59)       825.8562 (1.79)     11.1016 (3.26)          2;0  1.2104 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     399.4618 (1.0)      411.4701 (1.0)      404.6731 (1.0)      4.5647 (1.59)     403.5130 (1.0)       6.1038 (2.49)          2;0  2.4711 (1.0)           5           3
test_plots-plots-show[3.10.0]     640.2061 (1.60)     647.3006 (1.57)     645.2403 (1.59)     2.8748 (1.0)      645.9526 (1.60)      2.4496 (1.0)           1;1  1.5498 (0.63)          5           3
test_plots-plots-show[main]       627.7062 (1.57)     645.3465 (1.57)     638.4002 (1.58)     7.9355 (2.76)     643.2296 (1.59)     12.9858 (5.30)          1;0  1.5664 (0.63)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     418.7544 (1.0)      430.5839 (1.0)      424.5266 (1.0)      4.7297 (4.96)     425.0223 (1.0)      7.5710 (4.74)          2;0  2.3556 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     787.1950 (1.88)     800.2419 (1.86)     792.7964 (1.87)     5.4740 (5.74)     793.7934 (1.87)     8.8760 (5.55)          2;0  1.2614 (0.54)          5           3
test_plots-plots-show-json[main]       671.1997 (1.60)     673.4101 (1.56)     672.3240 (1.58)     0.9533 (1.0)      672.7184 (1.58)     1.5987 (1.0)           2;0  1.4874 (0.63)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     95.9777 (3.90)     95.9777 (3.90)     95.9777 (3.90)     0.0000 (1.0)      95.9777 (3.90)     0.0000 (1.0)           0;0  0.0104 (0.26)          1           1
test_push-push[3.10.0]     48.1176 (1.96)     48.1176 (1.96)     48.1176 (1.96)     0.0000 (1.0)      48.1176 (1.96)     0.0000 (1.0)           0;0  0.0208 (0.51)          1           1
test_push-push[main]       24.5947 (1.0)      24.5947 (1.0)      24.5947 (1.0)      0.0000 (1.0)      24.5947 (1.0)      0.0000 (1.0)           0;0  0.0407 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     95.1414 (1.03)     95.1414 (1.03)     95.1414 (1.03)     0.0000 (1.0)      95.1414 (1.03)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_sharing-add[3.10.0]     96.2461 (1.04)     96.2461 (1.04)     96.2461 (1.04)     0.0000 (1.0)      96.2461 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_sharing-add[main]       92.4887 (1.0)      92.4887 (1.0)      92.4887 (1.0)      0.0000 (1.0)      92.4887 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     62.7564 (1.05)     62.7564 (1.05)     62.7564 (1.05)     0.0000 (1.0)      62.7564 (1.05)     0.0000 (1.0)           0;0  0.0159 (0.95)          1           1
test_sharing-add-noop[3.10.0]     63.5547 (1.07)     63.5547 (1.07)     63.5547 (1.07)     0.0000 (1.0)      63.5547 (1.07)     0.0000 (1.0)           0;0  0.0157 (0.94)          1           1
test_sharing-add-noop[main]       59.4881 (1.0)      59.4881 (1.0)      59.4881 (1.0)      0.0000 (1.0)      59.4881 (1.0)      0.0000 (1.0)           0;0  0.0168 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      42.4426 (1.42)      42.4426 (1.42)      42.4426 (1.42)     0.0000 (1.0)       42.4426 (1.42)     0.0000 (1.0)           0;0  0.0236 (0.70)          1           1
test_sharing-checkout[3.10.0]     104.4965 (3.50)     104.4965 (3.50)     104.4965 (3.50)     0.0000 (1.0)      104.4965 (3.50)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing-checkout[main]        29.8787 (1.0)       29.8787 (1.0)       29.8787 (1.0)      0.0000 (1.0)       29.8787 (1.0)      0.0000 (1.0)           0;0  0.0335 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6573 (1.01)     6.6573 (1.01)     6.6573 (1.01)     0.0000 (1.0)      6.6573 (1.01)     0.0000 (1.0)           0;0  0.1502 (0.99)          1           1
test_sharing-checkout-noop[3.10.0]     6.8126 (1.03)     6.8126 (1.03)     6.8126 (1.03)     0.0000 (1.0)      6.8126 (1.03)     0.0000 (1.0)           0;0  0.1468 (0.97)          1           1
test_sharing-checkout-noop[main]       6.6048 (1.0)      6.6048 (1.0)      6.6048 (1.0)      0.0000 (1.0)      6.6048 (1.0)      0.0000 (1.0)           0;0  0.1514 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     112.6065 (2.75)     112.6065 (2.75)     112.6065 (2.75)     0.0000 (1.0)      112.6065 (2.75)     0.0000 (1.0)           0;0  0.0089 (0.36)          1           1
test_sharing-fetch[3.10.0]     116.3011 (2.84)     116.3011 (2.84)     116.3011 (2.84)     0.0000 (1.0)      116.3011 (2.84)     0.0000 (1.0)           0;0  0.0086 (0.35)          1           1
test_sharing-fetch[main]        40.9830 (1.0)       40.9830 (1.0)       40.9830 (1.0)      0.0000 (1.0)       40.9830 (1.0)      0.0000 (1.0)           0;0  0.0244 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4345 (1.0)      1.4345 (1.0)      1.4345 (1.0)      0.0000 (1.0)      1.4345 (1.0)      0.0000 (1.0)           0;0  0.6971 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8538 (2.69)     3.8538 (2.69)     3.8538 (2.69)     0.0000 (1.0)      3.8538 (2.69)     0.0000 (1.0)           0;0  0.2595 (0.37)          1           1
test_sharing-fetch-noop[main]       7.0032 (4.88)     7.0032 (4.88)     7.0032 (4.88)     0.0000 (1.0)      7.0032 (4.88)     0.0000 (1.0)           0;0  0.1428 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.4372 (3.67)     95.4372 (3.67)     95.4372 (3.67)     0.0000 (1.0)      95.4372 (3.67)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing-push[3.10.0]     48.3832 (1.86)     48.3832 (1.86)     48.3832 (1.86)     0.0000 (1.0)      48.3832 (1.86)     0.0000 (1.0)           0;0  0.0207 (0.54)          1           1
test_sharing-push[main]       26.0117 (1.0)      26.0117 (1.0)      26.0117 (1.0)      0.0000 (1.0)      26.0117 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.6105 (1.00)     2.6105 (1.00)     2.6105 (1.00)     0.0000 (1.0)      2.6105 (1.00)     0.0000 (1.0)           0;0  0.3831 (1.00)          1           1
test_sharing-push-noop[3.10.0]     2.6080 (1.0)      2.6080 (1.0)      2.6080 (1.0)      0.0000 (1.0)      2.6080 (1.0)      0.0000 (1.0)           0;0  0.3834 (1.0)           1           1
test_sharing-push-noop[main]       7.2005 (2.76)     7.2005 (2.76)     7.2005 (2.76)     0.0000 (1.0)      7.2005 (2.76)     0.0000 (1.0)           0;0  0.1389 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     97.6552 (1.02)     97.6552 (1.02)     97.6552 (1.02)     0.0000 (1.0)      97.6552 (1.02)     0.0000 (1.0)           0;0  0.0102 (0.98)          1           1
test_sharing_azure-add[3.10.0]     97.7038 (1.02)     97.7038 (1.02)     97.7038 (1.02)     0.0000 (1.0)      97.7038 (1.02)     0.0000 (1.0)           0;0  0.0102 (0.98)          1           1
test_sharing_azure-add[main]       95.9888 (1.0)      95.9888 (1.0)      95.9888 (1.0)      0.0000 (1.0)      95.9888 (1.0)      0.0000 (1.0)           0;0  0.0104 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.4782 (1.04)     63.4782 (1.04)     63.4782 (1.04)     0.0000 (1.0)      63.4782 (1.04)     0.0000 (1.0)           0;0  0.0158 (0.96)          1           1
test_sharing_azure-add-noop[3.10.0]     64.1182 (1.05)     64.1182 (1.05)     64.1182 (1.05)     0.0000 (1.0)      64.1182 (1.05)     0.0000 (1.0)           0;0  0.0156 (0.95)          1           1
test_sharing_azure-add-noop[main]       60.9692 (1.0)      60.9692 (1.0)      60.9692 (1.0)      0.0000 (1.0)      60.9692 (1.0)      0.0000 (1.0)           0;0  0.0164 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      42.9198 (1.41)      42.9198 (1.41)      42.9198 (1.41)     0.0000 (1.0)       42.9198 (1.41)     0.0000 (1.0)           0;0  0.0233 (0.71)          1           1
test_sharing_azure-checkout[3.10.0]     105.8409 (3.48)     105.8409 (3.48)     105.8409 (3.48)     0.0000 (1.0)      105.8409 (3.48)     0.0000 (1.0)           0;0  0.0094 (0.29)          1           1
test_sharing_azure-checkout[main]        30.3989 (1.0)       30.3989 (1.0)       30.3989 (1.0)      0.0000 (1.0)       30.3989 (1.0)      0.0000 (1.0)           0;0  0.0329 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.7132 (1.01)     6.7132 (1.01)     6.7132 (1.01)     0.0000 (1.0)      6.7132 (1.01)     0.0000 (1.0)           0;0  0.1490 (0.99)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.8202 (1.03)     6.8202 (1.03)     6.8202 (1.03)     0.0000 (1.0)      6.8202 (1.03)     0.0000 (1.0)           0;0  0.1466 (0.97)          1           1
test_sharing_azure-checkout-noop[main]       6.6423 (1.0)      6.6423 (1.0)      6.6423 (1.0)      0.0000 (1.0)      6.6423 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     112.4984 (2.74)     112.4984 (2.74)     112.4984 (2.74)     0.0000 (1.0)      112.4984 (2.74)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_azure-fetch[3.10.0]     119.9571 (2.92)     119.9571 (2.92)     119.9571 (2.92)     0.0000 (1.0)      119.9571 (2.92)     0.0000 (1.0)           0;0  0.0083 (0.34)          1           1
test_sharing_azure-fetch[main]        41.1096 (1.0)       41.1096 (1.0)       41.1096 (1.0)      0.0000 (1.0)       41.1096 (1.0)      0.0000 (1.0)           0;0  0.0243 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4142 (1.0)      1.4142 (1.0)      1.4142 (1.0)      0.0000 (1.0)      1.4142 (1.0)      0.0000 (1.0)           0;0  0.7071 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.9012 (2.76)     3.9012 (2.76)     3.9012 (2.76)     0.0000 (1.0)      3.9012 (2.76)     0.0000 (1.0)           0;0  0.2563 (0.36)          1           1
test_sharing_azure-fetch-noop[main]       7.0554 (4.99)     7.0554 (4.99)     7.0554 (4.99)     0.0000 (1.0)      7.0554 (4.99)     0.0000 (1.0)           0;0  0.1417 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     96.0153 (3.68)     96.0153 (3.68)     96.0153 (3.68)     0.0000 (1.0)      96.0153 (3.68)     0.0000 (1.0)           0;0  0.0104 (0.27)          1           1
test_sharing_azure-push[3.10.0]     48.6865 (1.87)     48.6865 (1.87)     48.6865 (1.87)     0.0000 (1.0)      48.6865 (1.87)     0.0000 (1.0)           0;0  0.0205 (0.54)          1           1
test_sharing_azure-push[main]       26.0582 (1.0)      26.0582 (1.0)      26.0582 (1.0)      0.0000 (1.0)      26.0582 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5091 (1.0)      2.5091 (1.0)      2.5091 (1.0)      0.0000 (1.0)      2.5091 (1.0)      0.0000 (1.0)           0;0  0.3985 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]     2.5854 (1.03)     2.5854 (1.03)     2.5854 (1.03)     0.0000 (1.0)      2.5854 (1.03)     0.0000 (1.0)           0;0  0.3868 (0.97)          1           1
test_sharing_azure-push-noop[main]       7.5339 (3.00)     7.5339 (3.00)     7.5339 (3.00)     0.0000 (1.0)      7.5339 (3.00)     0.0000 (1.0)           0;0  0.1327 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     96.9805 (1.04)     96.9805 (1.04)     96.9805 (1.04)     0.0000 (1.0)      96.9805 (1.04)     0.0000 (1.0)           0;0  0.0103 (0.96)          1           1
test_sharing_gs-add[3.10.0]     98.8264 (1.06)     98.8264 (1.06)     98.8264 (1.06)     0.0000 (1.0)      98.8264 (1.06)     0.0000 (1.0)           0;0  0.0101 (0.94)          1           1
test_sharing_gs-add[main]       93.1202 (1.0)      93.1202 (1.0)      93.1202 (1.0)      0.0000 (1.0)      93.1202 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     62.4018 (1.04)     62.4018 (1.04)     62.4018 (1.04)     0.0000 (1.0)      62.4018 (1.04)     0.0000 (1.0)           0;0  0.0160 (0.96)          1           1
test_sharing_gs-add-noop[3.10.0]     63.8616 (1.06)     63.8616 (1.06)     63.8616 (1.06)     0.0000 (1.0)      63.8616 (1.06)     0.0000 (1.0)           0;0  0.0157 (0.94)          1           1
test_sharing_gs-add-noop[main]       60.0343 (1.0)      60.0343 (1.0)      60.0343 (1.0)      0.0000 (1.0)      60.0343 (1.0)      0.0000 (1.0)           0;0  0.0167 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      42.7462 (1.41)      42.7462 (1.41)      42.7462 (1.41)     0.0000 (1.0)       42.7462 (1.41)     0.0000 (1.0)           0;0  0.0234 (0.71)          1           1
test_sharing_gs-checkout[3.10.0]     105.0791 (3.47)     105.0791 (3.47)     105.0791 (3.47)     0.0000 (1.0)      105.0791 (3.47)     0.0000 (1.0)           0;0  0.0095 (0.29)          1           1
test_sharing_gs-checkout[main]        30.2406 (1.0)       30.2406 (1.0)       30.2406 (1.0)      0.0000 (1.0)       30.2406 (1.0)      0.0000 (1.0)           0;0  0.0331 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.7767 (1.00)     6.7767 (1.00)     6.7767 (1.00)     0.0000 (1.0)      6.7767 (1.00)     0.0000 (1.0)           0;0  0.1476 (1.00)          1           1
test_sharing_gs-checkout-noop[3.10.0]     6.8841 (1.02)     6.8841 (1.02)     6.8841 (1.02)     0.0000 (1.0)      6.8841 (1.02)     0.0000 (1.0)           0;0  0.1453 (0.98)          1           1
test_sharing_gs-checkout-noop[main]       6.7757 (1.0)      6.7757 (1.0)      6.7757 (1.0)      0.0000 (1.0)      6.7757 (1.0)      0.0000 (1.0)           0;0  0.1476 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     112.5158 (2.74)     112.5158 (2.74)     112.5158 (2.74)     0.0000 (1.0)      112.5158 (2.74)     0.0000 (1.0)           0;0  0.0089 (0.36)          1           1
test_sharing_gs-fetch[3.10.0]     118.6942 (2.89)     118.6942 (2.89)     118.6942 (2.89)     0.0000 (1.0)      118.6942 (2.89)     0.0000 (1.0)           0;0  0.0084 (0.35)          1           1
test_sharing_gs-fetch[main]        41.0358 (1.0)       41.0358 (1.0)       41.0358 (1.0)      0.0000 (1.0)       41.0358 (1.0)      0.0000 (1.0)           0;0  0.0244 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4634 (1.0)      1.4634 (1.0)      1.4634 (1.0)      0.0000 (1.0)      1.4634 (1.0)      0.0000 (1.0)           0;0  0.6833 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.9274 (2.68)     3.9274 (2.68)     3.9274 (2.68)     0.0000 (1.0)      3.9274 (2.68)     0.0000 (1.0)           0;0  0.2546 (0.37)          1           1
test_sharing_gs-fetch-noop[main]       7.2042 (4.92)     7.2042 (4.92)     7.2042 (4.92)     0.0000 (1.0)      7.2042 (4.92)     0.0000 (1.0)           0;0  0.1388 (0.20)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     96.0010 (3.69)     96.0010 (3.69)     96.0010 (3.69)     0.0000 (1.0)      96.0010 (3.69)     0.0000 (1.0)           0;0  0.0104 (0.27)          1           1
test_sharing_gs-push[3.10.0]     49.2407 (1.89)     49.2407 (1.89)     49.2407 (1.89)     0.0000 (1.0)      49.2407 (1.89)     0.0000 (1.0)           0;0  0.0203 (0.53)          1           1
test_sharing_gs-push[main]       26.0479 (1.0)      26.0479 (1.0)      26.0479 (1.0)      0.0000 (1.0)      26.0479 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.6775 (1.0)      2.6775 (1.0)      2.6775 (1.0)      0.0000 (1.0)      2.6775 (1.0)      0.0000 (1.0)           0;0  0.3735 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.6890 (1.00)     2.6890 (1.00)     2.6890 (1.00)     0.0000 (1.0)      2.6890 (1.00)     0.0000 (1.0)           0;0  0.3719 (1.00)          1           1
test_sharing_gs-push-noop[main]       7.4177 (2.77)     7.4177 (2.77)     7.4177 (2.77)     0.0000 (1.0)      7.4177 (2.77)     0.0000 (1.0)           0;0  0.1348 (0.36)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     94.8637 (1.03)     94.8637 (1.03)     94.8637 (1.03)     0.0000 (1.0)      94.8637 (1.03)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_sharing_s3-add[3.10.0]     95.3916 (1.04)     95.3916 (1.04)     95.3916 (1.04)     0.0000 (1.0)      95.3916 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_sharing_s3-add[main]       92.0950 (1.0)      92.0950 (1.0)      92.0950 (1.0)      0.0000 (1.0)      92.0950 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     62.9577 (1.06)     62.9577 (1.06)     62.9577 (1.06)     0.0000 (1.0)      62.9577 (1.06)     0.0000 (1.0)           0;0  0.0159 (0.94)          1           1
test_sharing_s3-add-noop[3.10.0]     63.2283 (1.06)     63.2283 (1.06)     63.2283 (1.06)     0.0000 (1.0)      63.2283 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.94)          1           1
test_sharing_s3-add-noop[main]       59.4238 (1.0)      59.4238 (1.0)      59.4238 (1.0)      0.0000 (1.0)      59.4238 (1.0)      0.0000 (1.0)           0;0  0.0168 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.7894 (1.45)      42.7894 (1.45)      42.7894 (1.45)     0.0000 (1.0)       42.7894 (1.45)     0.0000 (1.0)           0;0  0.0234 (0.69)          1           1
test_sharing_s3-checkout[3.10.0]     106.4112 (3.60)     106.4112 (3.60)     106.4112 (3.60)     0.0000 (1.0)      106.4112 (3.60)     0.0000 (1.0)           0;0  0.0094 (0.28)          1           1
test_sharing_s3-checkout[main]        29.5900 (1.0)       29.5900 (1.0)       29.5900 (1.0)      0.0000 (1.0)       29.5900 (1.0)      0.0000 (1.0)           0;0  0.0338 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.6221 (1.01)     6.6221 (1.01)     6.6221 (1.01)     0.0000 (1.0)      6.6221 (1.01)     0.0000 (1.0)           0;0  0.1510 (0.99)          1           1
test_sharing_s3-checkout-noop[3.10.0]     6.9951 (1.07)     6.9951 (1.07)     6.9951 (1.07)     0.0000 (1.0)      6.9951 (1.07)     0.0000 (1.0)           0;0  0.1430 (0.93)          1           1
test_sharing_s3-checkout-noop[main]       6.5394 (1.0)      6.5394 (1.0)      6.5394 (1.0)      0.0000 (1.0)      6.5394 (1.0)      0.0000 (1.0)           0;0  0.1529 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     306.4023 (1.10)     306.4023 (1.10)     306.4023 (1.10)     0.0000 (1.0)      306.4023 (1.10)     0.0000 (1.0)           0;0  0.0033 (0.91)          1           1
test_sharing_s3-fetch[3.10.0]     327.3179 (1.17)     327.3179 (1.17)     327.3179 (1.17)     0.0000 (1.0)      327.3179 (1.17)     0.0000 (1.0)           0;0  0.0031 (0.85)          1           1
test_sharing_s3-fetch[main]       279.6870 (1.0)      279.6870 (1.0)      279.6870 (1.0)      0.0000 (1.0)      279.6870 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.5950 (1.0)      1.5950 (1.0)      1.5950 (1.0)      0.0000 (1.0)      1.5950 (1.0)      0.0000 (1.0)           0;0  0.6270 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     4.0933 (2.57)     4.0933 (2.57)     4.0933 (2.57)     0.0000 (1.0)      4.0933 (2.57)     0.0000 (1.0)           0;0  0.2443 (0.39)          1           1
test_sharing_s3-fetch-noop[main]       7.3124 (4.58)     7.3124 (4.58)     7.3124 (4.58)     0.0000 (1.0)      7.3124 (4.58)     0.0000 (1.0)           0;0  0.1368 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     410.2691 (1.11)     410.2691 (1.11)     410.2691 (1.11)     0.0000 (1.0)      410.2691 (1.11)     0.0000 (1.0)           0;0  0.0024 (0.90)          1           1
test_sharing_s3-push[3.10.0]     369.2758 (1.0)      369.2758 (1.0)      369.2758 (1.0)      0.0000 (1.0)      369.2758 (1.0)      0.0000 (1.0)           0;0  0.0027 (1.0)           1           1
test_sharing_s3-push[main]       470.5492 (1.27)     470.5492 (1.27)     470.5492 (1.27)     0.0000 (1.0)      470.5492 (1.27)     0.0000 (1.0)           0;0  0.0021 (0.78)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.8418 (1.0)      2.8418 (1.0)      2.8418 (1.0)      0.0000 (1.0)      2.8418 (1.0)      0.0000 (1.0)           0;0  0.3519 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     2.9562 (1.04)     2.9562 (1.04)     2.9562 (1.04)     0.0000 (1.0)      2.9562 (1.04)     0.0000 (1.0)           0;0  0.3383 (0.96)          1           1
test_sharing_s3-push-noop[main]       7.5550 (2.66)     7.5550 (2.66)     7.5550 (2.66)     0.0000 (1.0)      7.5550 (2.66)     0.0000 (1.0)           0;0  0.1324 (0.38)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.0944 (1.02)     22.0944 (1.02)     22.0944 (1.02)     0.0000 (1.0)      22.0944 (1.02)     0.0000 (1.0)           0;0  0.0453 (0.98)          1           1
test_status-status[3.10.0]     21.7310 (1.0)      21.7310 (1.0)      21.7310 (1.0)      0.0000 (1.0)      21.7310 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_status-status[main]       22.1227 (1.02)     22.1227 (1.02)     22.1227 (1.02)     0.0000 (1.0)      22.1227 (1.02)     0.0000 (1.0)           0;0  0.0452 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.5187 (1.0)      5.5187 (1.0)      5.5187 (1.0)      0.0000 (1.0)      5.5187 (1.0)      0.0000 (1.0)           0;0  0.1812 (1.0)           1           1
test_status-status-changed[3.10.0]     5.8550 (1.06)     5.8550 (1.06)     5.8550 (1.06)     0.0000 (1.0)      5.8550 (1.06)     0.0000 (1.0)           0;0  0.1708 (0.94)          1           1
test_status-status-changed[main]       5.6934 (1.03)     5.6934 (1.03)     5.6934 (1.03)     0.0000 (1.0)      5.6934 (1.03)     0.0000 (1.0)           0;0  0.1756 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.4941 (1.0)      5.4941 (1.0)      5.4941 (1.0)      0.0000 (1.0)      5.4941 (1.0)      0.0000 (1.0)           0;0  0.1820 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.7438 (1.05)     5.7438 (1.05)     5.7438 (1.05)     0.0000 (1.0)      5.7438 (1.05)     0.0000 (1.0)           0;0  0.1741 (0.96)          1           1
test_status-status-changed-noop[main]       5.5670 (1.01)     5.5670 (1.01)     5.5670 (1.01)     0.0000 (1.0)      5.5670 (1.01)     0.0000 (1.0)           0;0  0.1796 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.6928 (1.0)      5.6928 (1.0)      5.6928 (1.0)      0.0000 (1.0)      5.6928 (1.0)      0.0000 (1.0)           0;0  0.1757 (1.0)           1           1
test_status-status-noop[3.10.0]     5.8545 (1.03)     5.8545 (1.03)     5.8545 (1.03)     0.0000 (1.0)      5.8545 (1.03)     0.0000 (1.0)           0;0  0.1708 (0.97)          1           1
test_status-status-noop[main]       5.7692 (1.01)     5.7692 (1.01)     5.7692 (1.01)     0.0000 (1.0)      5.7692 (1.01)     0.0000 (1.0)           0;0  0.1733 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     214.0199 (1.53)     214.0199 (1.53)     214.0199 (1.53)     0.0000 (1.0)      214.0199 (1.53)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_update-import-url[3.10.0]     217.1573 (1.55)     217.1573 (1.55)     217.1573 (1.55)     0.0000 (1.0)      217.1573 (1.55)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_update-import-url[main]       139.6965 (1.0)      139.6965 (1.0)      139.6965 (1.0)      0.0000 (1.0)      139.6965 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     196.5195 (1.60)     196.5195 (1.60)     196.5195 (1.60)     0.0000 (1.0)      196.5195 (1.60)     0.0000 (1.0)           0;0  0.0051 (0.63)          1           1
test_update-update[3.10.0]     202.0025 (1.64)     202.0025 (1.64)     202.0025 (1.64)     0.0000 (1.0)      202.0025 (1.64)     0.0000 (1.0)           0;0  0.0050 (0.61)          1           1
test_update-update[main]       123.1931 (1.0)      123.1931 (1.0)      123.1931 (1.0)      0.0000 (1.0)      123.1931 (1.0)      0.0000 (1.0)           0;0  0.0081 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.6598 (1.0)      19.6598 (1.0)      19.6598 (1.0)      0.0000 (1.0)      19.6598 (1.0)      0.0000 (1.0)           0;0  0.0509 (1.0)           1           1
test_update-update-noop[3.10.0]     20.4861 (1.04)     20.4861 (1.04)     20.4861 (1.04)     0.0000 (1.0)      20.4861 (1.04)     0.0000 (1.0)           0;0  0.0488 (0.96)          1           1
test_update-update-noop[main]       19.7658 (1.01)     19.7658 (1.01)     19.7658 (1.01)     0.0000 (1.0)      19.7658 (1.01)     0.0000 (1.0)           0;0  0.0506 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean