Fri Apr 26 02:22:05 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     95.0870 (1.04)     95.0870 (1.04)     95.0870 (1.04)     0.0000 (1.0)      95.0870 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.96)          1           1
test_add-add[3.10.0]     95.1634 (1.04)     95.1634 (1.04)     95.1634 (1.04)     0.0000 (1.0)      95.1634 (1.04)     0.0000 (1.0)           0;0  0.0105 (0.96)          1           1
test_add-add[main]       91.2819 (1.0)      91.2819 (1.0)      91.2819 (1.0)      0.0000 (1.0)      91.2819 (1.0)      0.0000 (1.0)           0;0  0.0110 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      44.0227 (1.35)      44.0227 (1.35)      44.0227 (1.35)     0.0000 (1.0)       44.0227 (1.35)     0.0000 (1.0)           0;0  0.0227 (0.74)          1           1
test_checkout_copy-checkout[3.10.0]     103.9121 (3.19)     103.9121 (3.19)     103.9121 (3.19)     0.0000 (1.0)      103.9121 (3.19)     0.0000 (1.0)           0;0  0.0096 (0.31)          1           1
test_checkout_copy-checkout[main]        32.5584 (1.0)       32.5584 (1.0)       32.5584 (1.0)      0.0000 (1.0)       32.5584 (1.0)      0.0000 (1.0)           0;0  0.0307 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.7840 (1.03)     6.7840 (1.03)     6.7840 (1.03)     0.0000 (1.0)      6.7840 (1.03)     0.0000 (1.0)           0;0  0.1474 (0.97)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.8292 (1.04)     6.8292 (1.04)     6.8292 (1.04)     0.0000 (1.0)      6.8292 (1.04)     0.0000 (1.0)           0;0  0.1464 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       6.5560 (1.0)      6.5560 (1.0)      6.5560 (1.0)      0.0000 (1.0)      6.5560 (1.0)      0.0000 (1.0)           0;0  0.1525 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.6762 (1.45)     10.6762 (1.45)     10.6762 (1.45)     0.0000 (1.0)      10.6762 (1.45)     0.0000 (1.0)           0;0  0.0937 (0.69)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.3731 (1.0)       7.3731 (1.0)       7.3731 (1.0)      0.0000 (1.0)       7.3731 (1.0)      0.0000 (1.0)           0;0  0.1356 (1.0)           1           1
test_checkout_copy-checkout-update[main]        7.4053 (1.00)      7.4053 (1.00)      7.4053 (1.00)     0.0000 (1.0)       7.4053 (1.00)     0.0000 (1.0)           0;0  0.1350 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.2069 (1.39)     25.2069 (1.39)     25.2069 (1.39)     0.0000 (1.0)      25.2069 (1.39)     0.0000 (1.0)           0;0  0.0397 (0.72)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.1957 (1.0)      18.1957 (1.0)      18.1957 (1.0)      0.0000 (1.0)      18.1957 (1.0)      0.0000 (1.0)           0;0  0.0550 (1.0)           1           1
test_checkout_hardlink-checkout[main]       18.6786 (1.03)     18.6786 (1.03)     18.6786 (1.03)     0.0000 (1.0)      18.6786 (1.03)     0.0000 (1.0)           0;0  0.0535 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.8065 (1.05)     6.8065 (1.05)     6.8065 (1.05)     0.0000 (1.0)      6.8065 (1.05)     0.0000 (1.0)           0;0  0.1469 (0.96)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.8870 (1.06)     6.8870 (1.06)     6.8870 (1.06)     0.0000 (1.0)      6.8870 (1.06)     0.0000 (1.0)           0;0  0.1452 (0.94)          1           1
test_checkout_hardlink-checkout-noop[main]       6.5048 (1.0)      6.5048 (1.0)      6.5048 (1.0)      0.0000 (1.0)      6.5048 (1.0)      0.0000 (1.0)           0;0  0.1537 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.4550 (1.41)     10.4550 (1.41)     10.4550 (1.41)     0.0000 (1.0)      10.4550 (1.41)     0.0000 (1.0)           0;0  0.0956 (0.71)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.4483 (1.00)      7.4483 (1.00)      7.4483 (1.00)     0.0000 (1.0)       7.4483 (1.00)     0.0000 (1.0)           0;0  0.1343 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]        7.4294 (1.0)       7.4294 (1.0)       7.4294 (1.0)      0.0000 (1.0)       7.4294 (1.0)      0.0000 (1.0)           0;0  0.1346 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     29.1586 (1.31)     29.1586 (1.31)     29.1586 (1.31)     0.0000 (1.0)      29.1586 (1.31)     0.0000 (1.0)           0;0  0.0343 (0.76)          1           1
test_checkout_symlink-checkout[3.10.0]     22.1984 (1.0)      22.1984 (1.0)      22.1984 (1.0)      0.0000 (1.0)      22.1984 (1.0)      0.0000 (1.0)           0;0  0.0450 (1.0)           1           1
test_checkout_symlink-checkout[main]       22.5075 (1.01)     22.5075 (1.01)     22.5075 (1.01)     0.0000 (1.0)      22.5075 (1.01)     0.0000 (1.0)           0;0  0.0444 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.0029 (1.01)     8.0029 (1.01)     8.0029 (1.01)     0.0000 (1.0)      8.0029 (1.01)     0.0000 (1.0)           0;0  0.1250 (0.99)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.0214 (1.01)     8.0214 (1.01)     8.0214 (1.01)     0.0000 (1.0)      8.0214 (1.01)     0.0000 (1.0)           0;0  0.1247 (0.99)          1           1
test_checkout_symlink-checkout-noop[main]       7.9182 (1.0)      7.9182 (1.0)      7.9182 (1.0)      0.0000 (1.0)      7.9182 (1.0)      0.0000 (1.0)           0;0  0.1263 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     12.9910 (1.34)     12.9910 (1.34)     12.9910 (1.34)     0.0000 (1.0)      12.9910 (1.34)     0.0000 (1.0)           0;0  0.0770 (0.75)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.8866 (1.02)      9.8866 (1.02)      9.8866 (1.02)     0.0000 (1.0)       9.8866 (1.02)     0.0000 (1.0)           0;0  0.1011 (0.98)          1           1
test_checkout_symlink-checkout-update[main]        9.6896 (1.0)       9.6896 (1.0)       9.6896 (1.0)      0.0000 (1.0)       9.6896 (1.0)      0.0000 (1.0)           0;0  0.1032 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.6891 (1.0)      4.6891 (1.0)      4.6891 (1.0)      0.0000 (1.0)      4.6891 (1.0)      0.0000 (1.0)           0;0  0.2133 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.4637 (1.17)     5.4637 (1.17)     5.4637 (1.17)     0.0000 (1.0)      5.4637 (1.17)     0.0000 (1.0)           0;0  0.1830 (0.86)          1           1
test_data_status-data-changed[main]       5.1828 (1.11)     5.1828 (1.11)     5.1828 (1.11)     0.0000 (1.0)      5.1828 (1.11)     0.0000 (1.0)           0;0  0.1929 (0.90)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.7245 (1.0)      4.7245 (1.0)      4.7245 (1.0)      0.0000 (1.0)      4.7245 (1.0)      0.0000 (1.0)           0;0  0.2117 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.4057 (1.14)     5.4057 (1.14)     5.4057 (1.14)     0.0000 (1.0)      5.4057 (1.14)     0.0000 (1.0)           0;0  0.1850 (0.87)          1           1
test_data_status-data-changed-noop[main]       5.3446 (1.13)     5.3446 (1.13)     5.3446 (1.13)     0.0000 (1.0)      5.3446 (1.13)     0.0000 (1.0)           0;0  0.1871 (0.88)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.0366 (1.0)      20.0366 (1.0)      20.0366 (1.0)      0.0000 (1.0)      20.0366 (1.0)      0.0000 (1.0)           0;0  0.0499 (1.0)           1           1
test_data_status-data-new[3.10.0]     20.8740 (1.04)     20.8740 (1.04)     20.8740 (1.04)     0.0000 (1.0)      20.8740 (1.04)     0.0000 (1.0)           0;0  0.0479 (0.96)          1           1
test_data_status-data-new[main]       20.6839 (1.03)     20.6839 (1.03)     20.6839 (1.03)     0.0000 (1.0)      20.6839 (1.03)     0.0000 (1.0)           0;0  0.0483 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.7586 (1.0)      4.7586 (1.0)      4.7586 (1.0)      0.0000 (1.0)      4.7586 (1.0)      0.0000 (1.0)           0;0  0.2101 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.6080 (1.18)     5.6080 (1.18)     5.6080 (1.18)     0.0000 (1.0)      5.6080 (1.18)     0.0000 (1.0)           0;0  0.1783 (0.85)          1           1
test_data_status-data-noop[main]       5.3500 (1.12)     5.3500 (1.12)     5.3500 (1.12)     0.0000 (1.0)      5.3500 (1.12)     0.0000 (1.0)           0;0  0.1869 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     19.0889 (1.0)      19.0889 (1.0)      19.0889 (1.0)      0.0000 (1.0)      19.0889 (1.0)      0.0000 (1.0)           0;0  0.0524 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.7442 (1.03)     19.7442 (1.03)     19.7442 (1.03)     0.0000 (1.0)      19.7442 (1.03)     0.0000 (1.0)           0;0  0.0506 (0.97)          1           1
test_data_status_all_flags-data-changed[main]       19.7537 (1.03)     19.7537 (1.03)     19.7537 (1.03)     0.0000 (1.0)      19.7537 (1.03)     0.0000 (1.0)           0;0  0.0506 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.3838 (1.0)      19.3838 (1.0)      19.3838 (1.0)      0.0000 (1.0)      19.3838 (1.0)      0.0000 (1.0)           0;0  0.0516 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.8477 (1.02)     19.8477 (1.02)     19.8477 (1.02)     0.0000 (1.0)      19.8477 (1.02)     0.0000 (1.0)           0;0  0.0504 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.7824 (1.02)     19.7824 (1.02)     19.7824 (1.02)     0.0000 (1.0)      19.7824 (1.02)     0.0000 (1.0)           0;0  0.0505 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.3249 (1.0)      34.3249 (1.0)      34.3249 (1.0)      0.0000 (1.0)      34.3249 (1.0)      0.0000 (1.0)           0;0  0.0291 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     35.8095 (1.04)     35.8095 (1.04)     35.8095 (1.04)     0.0000 (1.0)      35.8095 (1.04)     0.0000 (1.0)           0;0  0.0279 (0.96)          1           1
test_data_status_all_flags-data-new[main]       35.5987 (1.04)     35.5987 (1.04)     35.5987 (1.04)     0.0000 (1.0)      35.5987 (1.04)     0.0000 (1.0)           0;0  0.0281 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.3432 (1.0)      18.3432 (1.0)      18.3432 (1.0)      0.0000 (1.0)      18.3432 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     18.8504 (1.03)     18.8504 (1.03)     18.8504 (1.03)     0.0000 (1.0)      18.8504 (1.03)     0.0000 (1.0)           0;0  0.0530 (0.97)          1           1
test_data_status_all_flags-data-noop[main]       18.7364 (1.02)     18.7364 (1.02)     18.7364 (1.02)     0.0000 (1.0)      18.7364 (1.02)     0.0000 (1.0)           0;0  0.0534 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.0192 (1.0)      20.0192 (1.0)      20.0192 (1.0)      0.0000 (1.0)      20.0192 (1.0)      0.0000 (1.0)           0;0  0.0500 (1.0)           1           1
test_diff-diff[3.10.0]     21.1629 (1.06)     21.1629 (1.06)     21.1629 (1.06)     0.0000 (1.0)      21.1629 (1.06)     0.0000 (1.0)           0;0  0.0473 (0.95)          1           1
test_diff-diff[main]       23.6568 (1.18)     23.6568 (1.18)     23.6568 (1.18)     0.0000 (1.0)      23.6568 (1.18)     0.0000 (1.0)           0;0  0.0423 (0.85)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.5168 (1.16)     7.5168 (1.16)     7.5168 (1.16)     0.0000 (1.0)      7.5168 (1.16)     0.0000 (1.0)           0;0  0.1330 (0.86)          1           1
test_diff-diff-changed[3.10.0]     7.8640 (1.22)     7.8640 (1.22)     7.8640 (1.22)     0.0000 (1.0)      7.8640 (1.22)     0.0000 (1.0)           0;0  0.1272 (0.82)          1           1
test_diff-diff-changed[main]       6.4705 (1.0)      6.4705 (1.0)      6.4705 (1.0)      0.0000 (1.0)      6.4705 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1098 (1.0)      6.1098 (1.0)      6.1098 (1.0)      0.0000 (1.0)      6.1098 (1.0)      0.0000 (1.0)           0;0  0.1637 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.7787 (1.11)     6.7787 (1.11)     6.7787 (1.11)     0.0000 (1.0)      6.7787 (1.11)     0.0000 (1.0)           0;0  0.1475 (0.90)          1           1
test_diff-diff-changed-noop[main]       6.4198 (1.05)     6.4198 (1.05)     6.4198 (1.05)     0.0000 (1.0)      6.4198 (1.05)     0.0000 (1.0)           0;0  0.1558 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.8601 (1.0)      4.8601 (1.0)      4.8601 (1.0)      0.0000 (1.0)      4.8601 (1.0)      0.0000 (1.0)           0;0  0.2058 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.4112 (1.11)     5.4112 (1.11)     5.4112 (1.11)     0.0000 (1.0)      5.4112 (1.11)     0.0000 (1.0)           0;0  0.1848 (0.90)          1           1
test_diff-diff-noop[main]       6.6097 (1.36)     6.6097 (1.36)     6.6097 (1.36)     0.0000 (1.0)      6.6097 (1.36)     0.0000 (1.0)           0;0  0.1513 (0.74)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        927.1961 (1.0)         927.1961 (1.0)         927.1961 (1.0)      0.0000 (1.0)         927.1961 (1.0)      0.0000 (1.0)           0;0  1.0785 (1.0)           1           1
test_exp_show-exp[3.10.0]     12,715.8365 (13.71)    12,715.8365 (13.71)    12,715.8365 (13.71)    0.0000 (1.0)      12,715.8365 (13.71)    0.0000 (1.0)           0;0  0.0786 (0.07)          1           1
test_exp_show-exp[main]       12,147.7358 (13.10)    12,147.7358 (13.10)    12,147.7358 (13.10)    0.0000 (1.0)      12,147.7358 (13.10)    0.0000 (1.0)           0;0  0.0823 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     109.4802 (2.79)     109.4802 (2.79)     109.4802 (2.79)     0.0000 (1.0)      109.4802 (2.79)     0.0000 (1.0)           0;0  0.0091 (0.36)          1           1
test_fetch-fetch[3.10.0]     116.8330 (2.98)     116.8330 (2.98)     116.8330 (2.98)     0.0000 (1.0)      116.8330 (2.98)     0.0000 (1.0)           0;0  0.0086 (0.34)          1           1
test_fetch-fetch[main]        39.2688 (1.0)       39.2688 (1.0)       39.2688 (1.0)      0.0000 (1.0)       39.2688 (1.0)      0.0000 (1.0)           0;0  0.0255 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2901 (1.0)      3.2901 (1.0)      3.2901 (1.0)      0.0000 (1.0)      3.2901 (1.0)      0.0000 (1.0)           0;0  0.3039 (1.0)           1           1
test_gc-gc[3.10.0]     3.4122 (1.04)     3.4122 (1.04)     3.4122 (1.04)     0.0000 (1.0)      3.4122 (1.04)     0.0000 (1.0)           0;0  0.2931 (0.96)          1           1
test_gc-gc[main]       3.4605 (1.05)     3.4605 (1.05)     3.4605 (1.05)     0.0000 (1.0)      3.4605 (1.05)     0.0000 (1.0)           0;0  0.2890 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     185.4826 (1.11)     185.4826 (1.11)     185.4826 (1.11)     0.0000 (1.0)      185.4826 (1.11)     0.0000 (1.0)           0;0  0.0054 (0.90)          1           1
test_get-get[3.10.0]     224.4700 (1.35)     224.4700 (1.35)     224.4700 (1.35)     0.0000 (1.0)      224.4700 (1.35)     0.0000 (1.0)           0;0  0.0045 (0.74)          1           1
test_get-get[main]       166.6732 (1.0)      166.6732 (1.0)      166.6732 (1.0)      0.0000 (1.0)      166.6732 (1.0)      0.0000 (1.0)           0;0  0.0060 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.6668 (5.05)     85.6668 (5.05)     85.6668 (5.05)     0.0000 (1.0)      85.6668 (5.05)     0.0000 (1.0)           0;0  0.0117 (0.20)          1           1
test_get_url-get-url[3.10.0]     88.5743 (5.22)     88.5743 (5.22)     88.5743 (5.22)     0.0000 (1.0)      88.5743 (5.22)     0.0000 (1.0)           0;0  0.0113 (0.19)          1           1
test_get_url-get-url[main]       16.9522 (1.0)      16.9522 (1.0)      16.9522 (1.0)      0.0000 (1.0)      16.9522 (1.0)      0.0000 (1.0)           0;0  0.0590 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.3114 (1.02)     136.7379 (1.0)      130.5942 (1.02)     1.8610 (1.0)      130.4264 (1.02)     2.3218 (1.0)          29;2  7.6573 (0.98)        100           1
test_help---help[3.10.0]     124.7139 (1.0)      137.1162 (1.00)     128.0890 (1.0)      2.1245 (1.14)     127.4779 (1.0)      2.7882 (1.20)         26;1  7.8071 (1.0)         100           1
test_help---help[main]       126.8446 (1.02)     145.9853 (1.07)     130.6666 (1.02)     2.3987 (1.29)     130.2795 (1.02)     2.4456 (1.05)         21;1  7.6531 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     284.9159 (1.08)     284.9159 (1.08)     284.9159 (1.08)     0.0000 (1.0)      284.9159 (1.08)     0.0000 (1.0)           0;0  0.0035 (0.93)          1           1
test_import-import[3.10.0]     321.5473 (1.22)     321.5473 (1.22)     321.5473 (1.22)     0.0000 (1.0)      321.5473 (1.22)     0.0000 (1.0)           0;0  0.0031 (0.82)          1           1
test_import-import[main]       263.8573 (1.0)      263.8573 (1.0)      263.8573 (1.0)      0.0000 (1.0)      263.8573 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     212.2685 (1.53)     212.2685 (1.53)     212.2685 (1.53)     0.0000 (1.0)      212.2685 (1.53)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_import_url-import-url[3.10.0]     215.2335 (1.55)     215.2335 (1.55)     215.2335 (1.55)     0.0000 (1.0)      215.2335 (1.55)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_import_url-import-url[main]       138.6613 (1.0)      138.6613 (1.0)      138.6613 (1.0)      0.0000 (1.0)      138.6613 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     368.2099 (1.0)      403.6084 (1.0)      378.7549 (1.0)       6.1382 (1.0)      377.9937 (1.0)       7.0262 (1.0)          25;3  2.6402 (1.0)         100           1
test_init-init[3.10.0]     375.9653 (1.02)     435.8931 (1.08)     388.8257 (1.03)      8.6841 (1.41)     387.8057 (1.03)      7.6782 (1.09)         14;5  2.5718 (0.97)        100           1
test_init-init[main]       379.4754 (1.03)     427.9428 (1.06)     395.5224 (1.04)     11.2979 (1.84)     392.7363 (1.04)     19.0671 (2.71)         38;0  2.5283 (0.96)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     415.4480 (1.06)     415.4480 (1.06)     415.4480 (1.06)     0.0000 (1.0)      415.4480 (1.06)     0.0000 (1.0)           0;0  2.4070 (0.94)          1           1
test_list-list[3.10.0]     477.4742 (1.22)     477.4742 (1.22)     477.4742 (1.22)     0.0000 (1.0)      477.4742 (1.22)     0.0000 (1.0)           0;0  2.0944 (0.82)          1           1
test_list-list[main]       390.8474 (1.0)      390.8474 (1.0)      390.8474 (1.0)      0.0000 (1.0)      390.8474 (1.0)      0.0000 (1.0)           0;0  2.5585 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     394.8176 (1.04)     394.8176 (1.04)     394.8176 (1.04)     0.0000 (1.0)      394.8176 (1.04)     0.0000 (1.0)           0;0  2.5328 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     386.8024 (1.01)     386.8024 (1.01)     386.8024 (1.01)     0.0000 (1.0)      386.8024 (1.01)     0.0000 (1.0)           0;0  2.5853 (0.99)          1           1
test_list-list-dvc-only[main]       381.1206 (1.0)      381.1206 (1.0)      381.1206 (1.0)      0.0000 (1.0)      381.1206 (1.0)      0.0000 (1.0)           0;0  2.6238 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1695 (1.0)      3.1695 (1.0)      3.1695 (1.0)      0.0000 (1.0)      3.1695 (1.0)      0.0000 (1.0)           0;0  0.3155 (1.0)           1           1
test_list-list-recursive[3.10.0]     3.1868 (1.01)     3.1868 (1.01)     3.1868 (1.01)     0.0000 (1.0)      3.1868 (1.01)     0.0000 (1.0)           0;0  0.3138 (0.99)          1           1
test_list-list-recursive[main]       3.3149 (1.05)     3.3149 (1.05)     3.3149 (1.05)     0.0000 (1.0)      3.3149 (1.05)     0.0000 (1.0)           0;0  0.3017 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     399.4586 (1.04)     399.4586 (1.04)     399.4586 (1.04)     0.0000 (1.0)      399.4586 (1.04)     0.0000 (1.0)           0;0  2.5034 (0.96)          1           1
test_list-list-shallow[3.10.0]     386.0715 (1.01)     386.0715 (1.01)     386.0715 (1.01)     0.0000 (1.0)      386.0715 (1.01)     0.0000 (1.0)           0;0  2.5902 (0.99)          1           1
test_list-list-shallow[main]       383.5230 (1.0)      383.5230 (1.0)      383.5230 (1.0)      0.0000 (1.0)      383.5230 (1.0)      0.0000 (1.0)           0;0  2.6074 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     80.1904 (1.03)     80.1904 (1.03)     80.1904 (1.03)     0.0000 (1.0)      80.1904 (1.03)     0.0000 (1.0)           0;0  0.0125 (0.97)          1           1
test_partial_add-add[3.10.0]     81.4638 (1.05)     81.4638 (1.05)     81.4638 (1.05)     0.0000 (1.0)      81.4638 (1.05)     0.0000 (1.0)           0;0  0.0123 (0.96)          1           1
test_partial_add-add[main]       77.9245 (1.0)      77.9245 (1.0)      77.9245 (1.0)      0.0000 (1.0)      77.9245 (1.0)      0.0000 (1.0)           0;0  0.0128 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     67.2618 (1.05)     67.2618 (1.05)     67.2618 (1.05)     0.0000 (1.0)      67.2618 (1.05)     0.0000 (1.0)           0;0  0.0149 (0.95)          1           1
test_partial_add-add-partial[3.10.0]     68.1297 (1.06)     68.1297 (1.06)     68.1297 (1.06)     0.0000 (1.0)      68.1297 (1.06)     0.0000 (1.0)           0;0  0.0147 (0.94)          1           1
test_partial_add-add-partial[main]       64.1536 (1.0)      64.1536 (1.0)      64.1536 (1.0)      0.0000 (1.0)      64.1536 (1.0)      0.0000 (1.0)           0;0  0.0156 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.3733 (1.0)      6.3733 (1.0)      6.3733 (1.0)      0.0000 (1.0)      6.3733 (1.0)      0.0000 (1.0)           0;0  0.1569 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     8.5140 (1.34)     8.5140 (1.34)     8.5140 (1.34)     0.0000 (1.0)      8.5140 (1.34)     0.0000 (1.0)           0;0  0.1175 (0.75)          1           1
test_partial_add-gc-cloud-noop[main]       9.7712 (1.53)     9.7712 (1.53)     9.7712 (1.53)     0.0000 (1.0)      9.7712 (1.53)     0.0000 (1.0)           0;0  0.1023 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.5432 (1.0)      3.5432 (1.0)      3.5432 (1.0)      0.0000 (1.0)      3.5432 (1.0)      0.0000 (1.0)           0;0  0.2822 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.5815 (1.58)     5.5815 (1.58)     5.5815 (1.58)     0.0000 (1.0)      5.5815 (1.58)     0.0000 (1.0)           0;0  0.1792 (0.63)          1           1
test_partial_add-gc-noop[main]       5.6009 (1.58)     5.6009 (1.58)     5.6009 (1.58)     0.0000 (1.0)      5.6009 (1.58)     0.0000 (1.0)           0;0  0.1785 (0.63)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     80.1034 (3.84)     80.1034 (3.84)     80.1034 (3.84)     0.0000 (1.0)      80.1034 (3.84)     0.0000 (1.0)           0;0  0.0125 (0.26)          1           1
test_partial_add-push[3.10.0]     40.4510 (1.94)     40.4510 (1.94)     40.4510 (1.94)     0.0000 (1.0)      40.4510 (1.94)     0.0000 (1.0)           0;0  0.0247 (0.52)          1           1
test_partial_add-push[main]       20.8373 (1.0)      20.8373 (1.0)      20.8373 (1.0)      0.0000 (1.0)      20.8373 (1.0)      0.0000 (1.0)           0;0  0.0480 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     17.7522 (1.59)     17.7522 (1.59)     17.7522 (1.59)     0.0000 (1.0)      17.7522 (1.59)     0.0000 (1.0)           0;0  0.0563 (0.63)          1           1
test_partial_add-push-partial[3.10.0]     11.1945 (1.0)      11.1945 (1.0)      11.1945 (1.0)      0.0000 (1.0)      11.1945 (1.0)      0.0000 (1.0)           0;0  0.0893 (1.0)           1           1
test_partial_add-push-partial[main]       11.6584 (1.04)     11.6584 (1.04)     11.6584 (1.04)     0.0000 (1.0)      11.6584 (1.04)     0.0000 (1.0)           0;0  0.0858 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     96.3546 (1.03)     96.3546 (1.03)     96.3546 (1.03)     0.0000 (1.0)      96.3546 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_partial_remove-add[3.10.0]     96.2080 (1.03)     96.2080 (1.03)     96.2080 (1.03)     0.0000 (1.0)      96.2080 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_partial_remove-add[main]       93.5887 (1.0)      93.5887 (1.0)      93.5887 (1.0)      0.0000 (1.0)      93.5887 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     9.0872 (1.05)     9.0872 (1.05)     9.0872 (1.05)     0.0000 (1.0)      9.0872 (1.05)     0.0000 (1.0)           0;0  0.1100 (0.96)          1           1
test_partial_remove-add-update[3.10.0]     9.2787 (1.07)     9.2787 (1.07)     9.2787 (1.07)     0.0000 (1.0)      9.2787 (1.07)     0.0000 (1.0)           0;0  0.1078 (0.94)          1           1
test_partial_remove-add-update[main]       8.6884 (1.0)      8.6884 (1.0)      8.6884 (1.0)      0.0000 (1.0)      8.6884 (1.0)      0.0000 (1.0)           0;0  0.1151 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.4354 (1.0)      4.4354 (1.0)      4.4354 (1.0)      0.0000 (1.0)      4.4354 (1.0)      0.0000 (1.0)           0;0  0.2255 (1.0)           1           1
test_partial_remove-gc[3.10.0]     5.0337 (1.13)     5.0337 (1.13)     5.0337 (1.13)     0.0000 (1.0)      5.0337 (1.13)     0.0000 (1.0)           0;0  0.1987 (0.88)          1           1
test_partial_remove-gc[main]       4.9603 (1.12)     4.9603 (1.12)     4.9603 (1.12)     0.0000 (1.0)      4.9603 (1.12)     0.0000 (1.0)           0;0  0.2016 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     5.8690 (1.0)      5.8690 (1.0)      5.8690 (1.0)      0.0000 (1.0)      5.8690 (1.0)      0.0000 (1.0)           0;0  0.1704 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.5058 (1.11)     6.5058 (1.11)     6.5058 (1.11)     0.0000 (1.0)      6.5058 (1.11)     0.0000 (1.0)           0;0  0.1537 (0.90)          1           1
test_partial_remove-gc-cloud[main]       6.4446 (1.10)     6.4446 (1.10)     6.4446 (1.10)     0.0000 (1.0)      6.4446 (1.10)     0.0000 (1.0)           0;0  0.1552 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     94.0448 (3.83)     94.0448 (3.83)     94.0448 (3.83)     0.0000 (1.0)      94.0448 (3.83)     0.0000 (1.0)           0;0  0.0106 (0.26)          1           1
test_partial_remove-push[3.10.0]     48.5920 (1.98)     48.5920 (1.98)     48.5920 (1.98)     0.0000 (1.0)      48.5920 (1.98)     0.0000 (1.0)           0;0  0.0206 (0.51)          1           1
test_partial_remove-push[main]       24.5592 (1.0)      24.5592 (1.0)      24.5592 (1.0)      0.0000 (1.0)      24.5592 (1.0)      0.0000 (1.0)           0;0  0.0407 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0206 (1.00)     2.0206 (1.00)     2.0206 (1.00)     0.0000 (1.0)      2.0206 (1.00)     0.0000 (1.0)           0;0  0.4949 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     2.0177 (1.0)      2.0177 (1.0)      2.0177 (1.0)      0.0000 (1.0)      2.0177 (1.0)      0.0000 (1.0)           0;0  0.4956 (1.0)           1           1
test_partial_remove-push-update[main]       2.8278 (1.40)     2.8278 (1.40)     2.8278 (1.40)     0.0000 (1.0)      2.8278 (1.40)     0.0000 (1.0)           0;0  0.3536 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     425.6898 (1.0)      428.8091 (1.0)      427.7886 (1.0)      1.3229 (1.28)     428.4571 (1.0)      1.8529 (1.19)          1;0  2.3376 (1.0)           5           3
test_plots-plots-diff[3.10.0]     783.7276 (1.84)     786.3375 (1.83)     784.9375 (1.83)     1.0320 (1.0)      784.6321 (1.83)     1.5626 (1.0)           2;0  1.2740 (0.54)          5           3
test_plots-plots-diff[main]       757.7956 (1.78)     764.7104 (1.78)     761.0608 (1.78)     3.2185 (3.12)     760.7684 (1.78)     6.1485 (3.93)          2;0  1.3140 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       438.7366 (1.0)        446.2773 (1.0)        441.5286 (1.0)      2.8612 (3.01)       440.7248 (1.0)      2.9925 (3.11)          1;0  2.2649 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,030.4271 (2.35)     1,033.0646 (2.31)     1,031.6326 (2.34)     0.9496 (1.0)      1,031.6121 (2.34)     0.9622 (1.0)           2;0  0.9693 (0.43)          5           3
test_plots-plots-diff-json[main]         823.6118 (1.88)       842.9927 (1.89)       836.7656 (1.90)     7.7721 (8.18)       840.2118 (1.91)     8.5027 (8.84)          1;0  1.1951 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     390.5419 (1.0)      396.4321 (1.0)      392.2443 (1.0)      2.4592 (1.0)      391.1685 (1.0)      2.8161 (1.0)           1;0  2.5494 (1.0)           5           3
test_plots-plots-show[3.10.0]     645.3984 (1.65)     655.7541 (1.65)     648.7741 (1.65)     4.0617 (1.65)     647.4175 (1.66)     3.8917 (1.38)          1;0  1.5414 (0.60)          5           3
test_plots-plots-show[main]       635.0540 (1.63)     649.3735 (1.64)     642.1682 (1.64)     5.5500 (2.26)     643.3844 (1.64)     8.1231 (2.88)          2;0  1.5572 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     404.6135 (1.0)      411.0541 (1.0)      406.7894 (1.0)      2.6143 (1.0)      405.5253 (1.0)      3.2795 (1.01)          1;0  2.4583 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     792.0492 (1.96)     799.6408 (1.95)     796.9413 (1.96)     2.9416 (1.13)     798.0204 (1.97)     3.2424 (1.0)           1;0  1.2548 (0.51)          5           3
test_plots-plots-show-json[main]       683.9916 (1.69)     696.0542 (1.69)     690.6709 (1.70)     4.6061 (1.76)     691.7367 (1.71)     6.3878 (1.97)          2;0  1.4479 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     96.4823 (3.88)     96.4823 (3.88)     96.4823 (3.88)     0.0000 (1.0)      96.4823 (3.88)     0.0000 (1.0)           0;0  0.0104 (0.26)          1           1
test_push-push[3.10.0]     48.3425 (1.94)     48.3425 (1.94)     48.3425 (1.94)     0.0000 (1.0)      48.3425 (1.94)     0.0000 (1.0)           0;0  0.0207 (0.51)          1           1
test_push-push[main]       24.8882 (1.0)      24.8882 (1.0)      24.8882 (1.0)      0.0000 (1.0)      24.8882 (1.0)      0.0000 (1.0)           0;0  0.0402 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     94.9026 (1.02)     94.9026 (1.02)     94.9026 (1.02)     0.0000 (1.0)      94.9026 (1.02)     0.0000 (1.0)           0;0  0.0105 (0.98)          1           1
test_sharing-add[3.10.0]     96.1279 (1.04)     96.1279 (1.04)     96.1279 (1.04)     0.0000 (1.0)      96.1279 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_sharing-add[main]       92.8594 (1.0)      92.8594 (1.0)      92.8594 (1.0)      0.0000 (1.0)      92.8594 (1.0)      0.0000 (1.0)           0;0  0.0108 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     63.4837 (1.06)     63.4837 (1.06)     63.4837 (1.06)     0.0000 (1.0)      63.4837 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.95)          1           1
test_sharing-add-noop[3.10.0]     63.2957 (1.05)     63.2957 (1.05)     63.2957 (1.05)     0.0000 (1.0)      63.2957 (1.05)     0.0000 (1.0)           0;0  0.0158 (0.95)          1           1
test_sharing-add-noop[main]       60.0732 (1.0)      60.0732 (1.0)      60.0732 (1.0)      0.0000 (1.0)      60.0732 (1.0)      0.0000 (1.0)           0;0  0.0166 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      42.5430 (1.43)      42.5430 (1.43)      42.5430 (1.43)     0.0000 (1.0)       42.5430 (1.43)     0.0000 (1.0)           0;0  0.0235 (0.70)          1           1
test_sharing-checkout[3.10.0]     102.5221 (3.44)     102.5221 (3.44)     102.5221 (3.44)     0.0000 (1.0)      102.5221 (3.44)     0.0000 (1.0)           0;0  0.0098 (0.29)          1           1
test_sharing-checkout[main]        29.8197 (1.0)       29.8197 (1.0)       29.8197 (1.0)      0.0000 (1.0)       29.8197 (1.0)      0.0000 (1.0)           0;0  0.0335 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6616 (1.03)     6.6616 (1.03)     6.6616 (1.03)     0.0000 (1.0)      6.6616 (1.03)     0.0000 (1.0)           0;0  0.1501 (0.98)          1           1
test_sharing-checkout-noop[3.10.0]     6.8075 (1.05)     6.8075 (1.05)     6.8075 (1.05)     0.0000 (1.0)      6.8075 (1.05)     0.0000 (1.0)           0;0  0.1469 (0.95)          1           1
test_sharing-checkout-noop[main]       6.4976 (1.0)      6.4976 (1.0)      6.4976 (1.0)      0.0000 (1.0)      6.4976 (1.0)      0.0000 (1.0)           0;0  0.1539 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     112.0892 (2.75)     112.0892 (2.75)     112.0892 (2.75)     0.0000 (1.0)      112.0892 (2.75)     0.0000 (1.0)           0;0  0.0089 (0.36)          1           1
test_sharing-fetch[3.10.0]     117.6791 (2.89)     117.6791 (2.89)     117.6791 (2.89)     0.0000 (1.0)      117.6791 (2.89)     0.0000 (1.0)           0;0  0.0085 (0.35)          1           1
test_sharing-fetch[main]        40.7315 (1.0)       40.7315 (1.0)       40.7315 (1.0)      0.0000 (1.0)       40.7315 (1.0)      0.0000 (1.0)           0;0  0.0246 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4189 (1.0)      1.4189 (1.0)      1.4189 (1.0)      0.0000 (1.0)      1.4189 (1.0)      0.0000 (1.0)           0;0  0.7048 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.8860 (2.74)     3.8860 (2.74)     3.8860 (2.74)     0.0000 (1.0)      3.8860 (2.74)     0.0000 (1.0)           0;0  0.2573 (0.37)          1           1
test_sharing-fetch-noop[main]       7.0234 (4.95)     7.0234 (4.95)     7.0234 (4.95)     0.0000 (1.0)      7.0234 (4.95)     0.0000 (1.0)           0;0  0.1424 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     96.8685 (3.66)     96.8685 (3.66)     96.8685 (3.66)     0.0000 (1.0)      96.8685 (3.66)     0.0000 (1.0)           0;0  0.0103 (0.27)          1           1
test_sharing-push[3.10.0]     48.4607 (1.83)     48.4607 (1.83)     48.4607 (1.83)     0.0000 (1.0)      48.4607 (1.83)     0.0000 (1.0)           0;0  0.0206 (0.55)          1           1
test_sharing-push[main]       26.4852 (1.0)      26.4852 (1.0)      26.4852 (1.0)      0.0000 (1.0)      26.4852 (1.0)      0.0000 (1.0)           0;0  0.0378 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.5527 (1.01)     2.5527 (1.01)     2.5527 (1.01)     0.0000 (1.0)      2.5527 (1.01)     0.0000 (1.0)           0;0  0.3917 (0.99)          1           1
test_sharing-push-noop[3.10.0]     2.5271 (1.0)      2.5271 (1.0)      2.5271 (1.0)      0.0000 (1.0)      2.5271 (1.0)      0.0000 (1.0)           0;0  0.3957 (1.0)           1           1
test_sharing-push-noop[main]       7.5921 (3.00)     7.5921 (3.00)     7.5921 (3.00)     0.0000 (1.0)      7.5921 (3.00)     0.0000 (1.0)           0;0  0.1317 (0.33)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     95.9930 (1.02)     95.9930 (1.02)     95.9930 (1.02)     0.0000 (1.0)      95.9930 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_azure-add[3.10.0]     97.5147 (1.03)     97.5147 (1.03)     97.5147 (1.03)     0.0000 (1.0)      97.5147 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing_azure-add[main]       94.2774 (1.0)      94.2774 (1.0)      94.2774 (1.0)      0.0000 (1.0)      94.2774 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.2848 (1.06)     63.2848 (1.06)     63.2848 (1.06)     0.0000 (1.0)      63.2848 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.95)          1           1
test_sharing_azure-add-noop[3.10.0]     64.7531 (1.08)     64.7531 (1.08)     64.7531 (1.08)     0.0000 (1.0)      64.7531 (1.08)     0.0000 (1.0)           0;0  0.0154 (0.93)          1           1
test_sharing_azure-add-noop[main]       59.9692 (1.0)      59.9692 (1.0)      59.9692 (1.0)      0.0000 (1.0)      59.9692 (1.0)      0.0000 (1.0)           0;0  0.0167 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      42.9595 (1.41)      42.9595 (1.41)      42.9595 (1.41)     0.0000 (1.0)       42.9595 (1.41)     0.0000 (1.0)           0;0  0.0233 (0.71)          1           1
test_sharing_azure-checkout[3.10.0]     104.6433 (3.44)     104.6433 (3.44)     104.6433 (3.44)     0.0000 (1.0)      104.6433 (3.44)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing_azure-checkout[main]        30.4069 (1.0)       30.4069 (1.0)       30.4069 (1.0)      0.0000 (1.0)       30.4069 (1.0)      0.0000 (1.0)           0;0  0.0329 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.6975 (1.0)      6.6975 (1.0)      6.6975 (1.0)      0.0000 (1.0)      6.6975 (1.0)      0.0000 (1.0)           0;0  0.1493 (1.0)           1           1
test_sharing_azure-checkout-noop[3.10.0]     6.8117 (1.02)     6.8117 (1.02)     6.8117 (1.02)     0.0000 (1.0)      6.8117 (1.02)     0.0000 (1.0)           0;0  0.1468 (0.98)          1           1
test_sharing_azure-checkout-noop[main]       6.7127 (1.00)     6.7127 (1.00)     6.7127 (1.00)     0.0000 (1.0)      6.7127 (1.00)     0.0000 (1.0)           0;0  0.1490 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     112.4505 (2.73)     112.4505 (2.73)     112.4505 (2.73)     0.0000 (1.0)      112.4505 (2.73)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_azure-fetch[3.10.0]     118.2986 (2.87)     118.2986 (2.87)     118.2986 (2.87)     0.0000 (1.0)      118.2986 (2.87)     0.0000 (1.0)           0;0  0.0085 (0.35)          1           1
test_sharing_azure-fetch[main]        41.1798 (1.0)       41.1798 (1.0)       41.1798 (1.0)      0.0000 (1.0)       41.1798 (1.0)      0.0000 (1.0)           0;0  0.0243 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4506 (1.0)      1.4506 (1.0)      1.4506 (1.0)      0.0000 (1.0)      1.4506 (1.0)      0.0000 (1.0)           0;0  0.6894 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.9375 (2.71)     3.9375 (2.71)     3.9375 (2.71)     0.0000 (1.0)      3.9375 (2.71)     0.0000 (1.0)           0;0  0.2540 (0.37)          1           1
test_sharing_azure-fetch-noop[main]       7.0732 (4.88)     7.0732 (4.88)     7.0732 (4.88)     0.0000 (1.0)      7.0732 (4.88)     0.0000 (1.0)           0;0  0.1414 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     95.7065 (3.72)     95.7065 (3.72)     95.7065 (3.72)     0.0000 (1.0)      95.7065 (3.72)     0.0000 (1.0)           0;0  0.0104 (0.27)          1           1
test_sharing_azure-push[3.10.0]     48.1823 (1.87)     48.1823 (1.87)     48.1823 (1.87)     0.0000 (1.0)      48.1823 (1.87)     0.0000 (1.0)           0;0  0.0208 (0.53)          1           1
test_sharing_azure-push[main]       25.7139 (1.0)      25.7139 (1.0)      25.7139 (1.0)      0.0000 (1.0)      25.7139 (1.0)      0.0000 (1.0)           0;0  0.0389 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5269 (1.0)      2.5269 (1.0)      2.5269 (1.0)      0.0000 (1.0)      2.5269 (1.0)      0.0000 (1.0)           0;0  0.3957 (1.0)           1           1
test_sharing_azure-push-noop[3.10.0]     2.6893 (1.06)     2.6893 (1.06)     2.6893 (1.06)     0.0000 (1.0)      2.6893 (1.06)     0.0000 (1.0)           0;0  0.3719 (0.94)          1           1
test_sharing_azure-push-noop[main]       7.1846 (2.84)     7.1846 (2.84)     7.1846 (2.84)     0.0000 (1.0)      7.1846 (2.84)     0.0000 (1.0)           0;0  0.1392 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     96.6022 (1.03)     96.6022 (1.03)     96.6022 (1.03)     0.0000 (1.0)      96.6022 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_sharing_gs-add[3.10.0]     97.3618 (1.04)     97.3618 (1.04)     97.3618 (1.04)     0.0000 (1.0)      97.3618 (1.04)     0.0000 (1.0)           0;0  0.0103 (0.96)          1           1
test_sharing_gs-add[main]       93.7466 (1.0)      93.7466 (1.0)      93.7466 (1.0)      0.0000 (1.0)      93.7466 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     63.5856 (1.07)     63.5856 (1.07)     63.5856 (1.07)     0.0000 (1.0)      63.5856 (1.07)     0.0000 (1.0)           0;0  0.0157 (0.93)          1           1
test_sharing_gs-add-noop[3.10.0]     63.7264 (1.07)     63.7264 (1.07)     63.7264 (1.07)     0.0000 (1.0)      63.7264 (1.07)     0.0000 (1.0)           0;0  0.0157 (0.93)          1           1
test_sharing_gs-add-noop[main]       59.4118 (1.0)      59.4118 (1.0)      59.4118 (1.0)      0.0000 (1.0)      59.4118 (1.0)      0.0000 (1.0)           0;0  0.0168 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      43.0267 (1.43)      43.0267 (1.43)      43.0267 (1.43)     0.0000 (1.0)       43.0267 (1.43)     0.0000 (1.0)           0;0  0.0232 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     103.2635 (3.44)     103.2635 (3.44)     103.2635 (3.44)     0.0000 (1.0)      103.2635 (3.44)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_gs-checkout[main]        30.0225 (1.0)       30.0225 (1.0)       30.0225 (1.0)      0.0000 (1.0)       30.0225 (1.0)      0.0000 (1.0)           0;0  0.0333 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.6061 (1.02)     6.6061 (1.02)     6.6061 (1.02)     0.0000 (1.0)      6.6061 (1.02)     0.0000 (1.0)           0;0  0.1514 (0.98)          1           1
test_sharing_gs-checkout-noop[3.10.0]     6.7560 (1.04)     6.7560 (1.04)     6.7560 (1.04)     0.0000 (1.0)      6.7560 (1.04)     0.0000 (1.0)           0;0  0.1480 (0.96)          1           1
test_sharing_gs-checkout-noop[main]       6.4717 (1.0)      6.4717 (1.0)      6.4717 (1.0)      0.0000 (1.0)      6.4717 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     110.5900 (2.65)     110.5900 (2.65)     110.5900 (2.65)     0.0000 (1.0)      110.5900 (2.65)     0.0000 (1.0)           0;0  0.0090 (0.38)          1           1
test_sharing_gs-fetch[3.10.0]     116.5290 (2.79)     116.5290 (2.79)     116.5290 (2.79)     0.0000 (1.0)      116.5290 (2.79)     0.0000 (1.0)           0;0  0.0086 (0.36)          1           1
test_sharing_gs-fetch[main]        41.7242 (1.0)       41.7242 (1.0)       41.7242 (1.0)      0.0000 (1.0)       41.7242 (1.0)      0.0000 (1.0)           0;0  0.0240 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4579 (1.0)      1.4579 (1.0)      1.4579 (1.0)      0.0000 (1.0)      1.4579 (1.0)      0.0000 (1.0)           0;0  0.6859 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.8899 (2.67)     3.8899 (2.67)     3.8899 (2.67)     0.0000 (1.0)      3.8899 (2.67)     0.0000 (1.0)           0;0  0.2571 (0.37)          1           1
test_sharing_gs-fetch-noop[main]       7.0703 (4.85)     7.0703 (4.85)     7.0703 (4.85)     0.0000 (1.0)      7.0703 (4.85)     0.0000 (1.0)           0;0  0.1414 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     94.3818 (3.70)     94.3818 (3.70)     94.3818 (3.70)     0.0000 (1.0)      94.3818 (3.70)     0.0000 (1.0)           0;0  0.0106 (0.27)          1           1
test_sharing_gs-push[3.10.0]     48.4747 (1.90)     48.4747 (1.90)     48.4747 (1.90)     0.0000 (1.0)      48.4747 (1.90)     0.0000 (1.0)           0;0  0.0206 (0.53)          1           1
test_sharing_gs-push[main]       25.4761 (1.0)      25.4761 (1.0)      25.4761 (1.0)      0.0000 (1.0)      25.4761 (1.0)      0.0000 (1.0)           0;0  0.0393 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.5233 (1.0)      2.5233 (1.0)      2.5233 (1.0)      0.0000 (1.0)      2.5233 (1.0)      0.0000 (1.0)           0;0  0.3963 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.5683 (1.02)     2.5683 (1.02)     2.5683 (1.02)     0.0000 (1.0)      2.5683 (1.02)     0.0000 (1.0)           0;0  0.3894 (0.98)          1           1
test_sharing_gs-push-noop[main]       7.2480 (2.87)     7.2480 (2.87)     7.2480 (2.87)     0.0000 (1.0)      7.2480 (2.87)     0.0000 (1.0)           0;0  0.1380 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     95.6991 (1.02)     95.6991 (1.02)     95.6991 (1.02)     0.0000 (1.0)      95.6991 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_s3-add[3.10.0]     95.9386 (1.02)     95.9386 (1.02)     95.9386 (1.02)     0.0000 (1.0)      95.9386 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_s3-add[main]       93.8997 (1.0)      93.8997 (1.0)      93.8997 (1.0)      0.0000 (1.0)      93.8997 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     62.7904 (1.05)     62.7904 (1.05)     62.7904 (1.05)     0.0000 (1.0)      62.7904 (1.05)     0.0000 (1.0)           0;0  0.0159 (0.95)          1           1
test_sharing_s3-add-noop[3.10.0]     63.4232 (1.06)     63.4232 (1.06)     63.4232 (1.06)     0.0000 (1.0)      63.4232 (1.06)     0.0000 (1.0)           0;0  0.0158 (0.94)          1           1
test_sharing_s3-add-noop[main]       59.5606 (1.0)      59.5606 (1.0)      59.5606 (1.0)      0.0000 (1.0)      59.5606 (1.0)      0.0000 (1.0)           0;0  0.0168 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.1683 (1.41)      42.1683 (1.41)      42.1683 (1.41)     0.0000 (1.0)       42.1683 (1.41)     0.0000 (1.0)           0;0  0.0237 (0.71)          1           1
test_sharing_s3-checkout[3.10.0]     104.5688 (3.48)     104.5688 (3.48)     104.5688 (3.48)     0.0000 (1.0)      104.5688 (3.48)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing_s3-checkout[main]        30.0096 (1.0)       30.0096 (1.0)       30.0096 (1.0)      0.0000 (1.0)       30.0096 (1.0)      0.0000 (1.0)           0;0  0.0333 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.5699 (1.01)     6.5699 (1.01)     6.5699 (1.01)     0.0000 (1.0)      6.5699 (1.01)     0.0000 (1.0)           0;0  0.1522 (0.99)          1           1
test_sharing_s3-checkout-noop[3.10.0]     6.9781 (1.07)     6.9781 (1.07)     6.9781 (1.07)     0.0000 (1.0)      6.9781 (1.07)     0.0000 (1.0)           0;0  0.1433 (0.94)          1           1
test_sharing_s3-checkout-noop[main]       6.5370 (1.0)      6.5370 (1.0)      6.5370 (1.0)      0.0000 (1.0)      6.5370 (1.0)      0.0000 (1.0)           0;0  0.1530 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests --------------------------------------------------------------------------------
Name (time in s)                         Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]       897.4011 (1.31)       897.4011 (1.31)       897.4011 (1.31)     0.0000 (1.0)        897.4011 (1.31)     0.0000 (1.0)           0;0  0.0011 (0.76)          1           1
test_sharing_s3-fetch[3.10.0]     1,083.3448 (1.58)     1,083.3448 (1.58)     1,083.3448 (1.58)     0.0000 (1.0)      1,083.3448 (1.58)     0.0000 (1.0)           0;0  0.0009 (0.63)          1           1
test_sharing_s3-fetch[main]         685.1990 (1.0)        685.1990 (1.0)        685.1990 (1.0)      0.0000 (1.0)        685.1990 (1.0)      0.0000 (1.0)           0;0  0.0015 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.5891 (1.0)      1.5891 (1.0)      1.5891 (1.0)      0.0000 (1.0)      1.5891 (1.0)      0.0000 (1.0)           0;0  0.6293 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     3.9570 (2.49)     3.9570 (2.49)     3.9570 (2.49)     0.0000 (1.0)      3.9570 (2.49)     0.0000 (1.0)           0;0  0.2527 (0.40)          1           1
test_sharing_s3-fetch-noop[main]       7.5680 (4.76)     7.5680 (4.76)     7.5680 (4.76)     0.0000 (1.0)      7.5680 (4.76)     0.0000 (1.0)           0;0  0.1321 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests --------------------------------------------------------------------------------
Name (time in s)                        Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     1,018.4101 (1.00)     1,018.4101 (1.00)     1,018.4101 (1.00)     0.0000 (1.0)      1,018.4101 (1.00)     0.0000 (1.0)           0;0  0.0010 (1.00)          1           1
test_sharing_s3-push[3.10.0]     1,022.0095 (1.01)     1,022.0095 (1.01)     1,022.0095 (1.01)     0.0000 (1.0)      1,022.0095 (1.01)     0.0000 (1.0)           0;0  0.0010 (0.99)          1           1
test_sharing_s3-push[main]       1,015.9474 (1.0)      1,015.9474 (1.0)      1,015.9474 (1.0)      0.0000 (1.0)      1,015.9474 (1.0)      0.0000 (1.0)           0;0  0.0010 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.9189 (1.0)      2.9189 (1.0)      2.9189 (1.0)      0.0000 (1.0)      2.9189 (1.0)      0.0000 (1.0)           0;0  0.3426 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     2.9938 (1.03)     2.9938 (1.03)     2.9938 (1.03)     0.0000 (1.0)      2.9938 (1.03)     0.0000 (1.0)           0;0  0.3340 (0.97)          1           1
test_sharing_s3-push-noop[main]       9.0042 (3.08)     9.0042 (3.08)     9.0042 (3.08)     0.0000 (1.0)      9.0042 (3.08)     0.0000 (1.0)           0;0  0.1111 (0.32)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     22.0267 (1.01)     22.0267 (1.01)     22.0267 (1.01)     0.0000 (1.0)      22.0267 (1.01)     0.0000 (1.0)           0;0  0.0454 (0.99)          1           1
test_status-status[3.10.0]     22.1870 (1.01)     22.1870 (1.01)     22.1870 (1.01)     0.0000 (1.0)      22.1870 (1.01)     0.0000 (1.0)           0;0  0.0451 (0.99)          1           1
test_status-status[main]       21.8617 (1.0)      21.8617 (1.0)      21.8617 (1.0)      0.0000 (1.0)      21.8617 (1.0)      0.0000 (1.0)           0;0  0.0457 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.5765 (1.0)      5.5765 (1.0)      5.5765 (1.0)      0.0000 (1.0)      5.5765 (1.0)      0.0000 (1.0)           0;0  0.1793 (1.0)           1           1
test_status-status-changed[3.10.0]     5.9891 (1.07)     5.9891 (1.07)     5.9891 (1.07)     0.0000 (1.0)      5.9891 (1.07)     0.0000 (1.0)           0;0  0.1670 (0.93)          1           1
test_status-status-changed[main]       5.8441 (1.05)     5.8441 (1.05)     5.8441 (1.05)     0.0000 (1.0)      5.8441 (1.05)     0.0000 (1.0)           0;0  0.1711 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6545 (1.0)      5.6545 (1.0)      5.6545 (1.0)      0.0000 (1.0)      5.6545 (1.0)      0.0000 (1.0)           0;0  0.1769 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.9393 (1.05)     5.9393 (1.05)     5.9393 (1.05)     0.0000 (1.0)      5.9393 (1.05)     0.0000 (1.0)           0;0  0.1684 (0.95)          1           1
test_status-status-changed-noop[main]       5.6552 (1.00)     5.6552 (1.00)     5.6552 (1.00)     0.0000 (1.0)      5.6552 (1.00)     0.0000 (1.0)           0;0  0.1768 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7139 (1.0)      5.7139 (1.0)      5.7139 (1.0)      0.0000 (1.0)      5.7139 (1.0)      0.0000 (1.0)           0;0  0.1750 (1.0)           1           1
test_status-status-noop[3.10.0]     5.9971 (1.05)     5.9971 (1.05)     5.9971 (1.05)     0.0000 (1.0)      5.9971 (1.05)     0.0000 (1.0)           0;0  0.1667 (0.95)          1           1
test_status-status-noop[main]       5.7562 (1.01)     5.7562 (1.01)     5.7562 (1.01)     0.0000 (1.0)      5.7562 (1.01)     0.0000 (1.0)           0;0  0.1737 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     216.2080 (1.55)     216.2080 (1.55)     216.2080 (1.55)     0.0000 (1.0)      216.2080 (1.55)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_update-import-url[3.10.0]     219.3371 (1.58)     219.3371 (1.58)     219.3371 (1.58)     0.0000 (1.0)      219.3371 (1.58)     0.0000 (1.0)           0;0  0.0046 (0.63)          1           1
test_update-import-url[main]       139.0501 (1.0)      139.0501 (1.0)      139.0501 (1.0)      0.0000 (1.0)      139.0501 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     194.9570 (1.60)     194.9570 (1.60)     194.9570 (1.60)     0.0000 (1.0)      194.9570 (1.60)     0.0000 (1.0)           0;0  0.0051 (0.63)          1           1
test_update-update[3.10.0]     199.3207 (1.64)     199.3207 (1.64)     199.3207 (1.64)     0.0000 (1.0)      199.3207 (1.64)     0.0000 (1.0)           0;0  0.0050 (0.61)          1           1
test_update-update[main]       121.8825 (1.0)      121.8825 (1.0)      121.8825 (1.0)      0.0000 (1.0)      121.8825 (1.0)      0.0000 (1.0)           0;0  0.0082 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.6017 (1.00)     19.6017 (1.00)     19.6017 (1.00)     0.0000 (1.0)      19.6017 (1.00)     0.0000 (1.0)           0;0  0.0510 (1.00)          1           1
test_update-update-noop[3.10.0]     20.5620 (1.05)     20.5620 (1.05)     20.5620 (1.05)     0.0000 (1.0)      20.5620 (1.05)     0.0000 (1.0)           0;0  0.0486 (0.95)          1           1
test_update-update-noop[main]       19.5597 (1.0)      19.5597 (1.0)      19.5597 (1.0)      0.0000 (1.0)      19.5597 (1.0)      0.0000 (1.0)           0;0  0.0511 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean