Sun Apr 28 02:19:05 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     94.3656 (1.03)     94.3656 (1.03)     94.3656 (1.03)     0.0000 (1.0)      94.3656 (1.03)     0.0000 (1.0)           0;0  0.0106 (0.97)          1           1
test_add-add[3.10.0]     96.3336 (1.05)     96.3336 (1.05)     96.3336 (1.05)     0.0000 (1.0)      96.3336 (1.05)     0.0000 (1.0)           0;0  0.0104 (0.95)          1           1
test_add-add[main]       91.5163 (1.0)      91.5163 (1.0)      91.5163 (1.0)      0.0000 (1.0)      91.5163 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      43.5590 (1.34)      43.5590 (1.34)      43.5590 (1.34)     0.0000 (1.0)       43.5590 (1.34)     0.0000 (1.0)           0;0  0.0230 (0.75)          1           1
test_checkout_copy-checkout[3.10.0]     105.6742 (3.24)     105.6742 (3.24)     105.6742 (3.24)     0.0000 (1.0)      105.6742 (3.24)     0.0000 (1.0)           0;0  0.0095 (0.31)          1           1
test_checkout_copy-checkout[main]        32.5828 (1.0)       32.5828 (1.0)       32.5828 (1.0)      0.0000 (1.0)       32.5828 (1.0)      0.0000 (1.0)           0;0  0.0307 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.6152 (1.02)     6.6152 (1.02)     6.6152 (1.02)     0.0000 (1.0)      6.6152 (1.02)     0.0000 (1.0)           0;0  0.1512 (0.98)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.8550 (1.06)     6.8550 (1.06)     6.8550 (1.06)     0.0000 (1.0)      6.8550 (1.06)     0.0000 (1.0)           0;0  0.1459 (0.94)          1           1
test_checkout_copy-checkout-noop[main]       6.4707 (1.0)      6.4707 (1.0)      6.4707 (1.0)      0.0000 (1.0)      6.4707 (1.0)      0.0000 (1.0)           0;0  0.1545 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.5188 (1.41)     10.5188 (1.41)     10.5188 (1.41)     0.0000 (1.0)      10.5188 (1.41)     0.0000 (1.0)           0;0  0.0951 (0.71)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.5371 (1.01)      7.5371 (1.01)      7.5371 (1.01)     0.0000 (1.0)       7.5371 (1.01)     0.0000 (1.0)           0;0  0.1327 (0.99)          1           1
test_checkout_copy-checkout-update[main]        7.4471 (1.0)       7.4471 (1.0)       7.4471 (1.0)      0.0000 (1.0)       7.4471 (1.0)      0.0000 (1.0)           0;0  0.1343 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.5158 (1.37)     25.5158 (1.37)     25.5158 (1.37)     0.0000 (1.0)      25.5158 (1.37)     0.0000 (1.0)           0;0  0.0392 (0.73)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.6274 (1.0)      18.6274 (1.0)      18.6274 (1.0)      0.0000 (1.0)      18.6274 (1.0)      0.0000 (1.0)           0;0  0.0537 (1.0)           1           1
test_checkout_hardlink-checkout[main]       18.7007 (1.00)     18.7007 (1.00)     18.7007 (1.00)     0.0000 (1.0)      18.7007 (1.00)     0.0000 (1.0)           0;0  0.0535 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.8252 (1.03)     6.8252 (1.03)     6.8252 (1.03)     0.0000 (1.0)      6.8252 (1.03)     0.0000 (1.0)           0;0  0.1465 (0.97)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.9079 (1.05)     6.9079 (1.05)     6.9079 (1.05)     0.0000 (1.0)      6.9079 (1.05)     0.0000 (1.0)           0;0  0.1448 (0.96)          1           1
test_checkout_hardlink-checkout-noop[main]       6.6059 (1.0)      6.6059 (1.0)      6.6059 (1.0)      0.0000 (1.0)      6.6059 (1.0)      0.0000 (1.0)           0;0  0.1514 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.6388 (1.42)     10.6388 (1.42)     10.6388 (1.42)     0.0000 (1.0)      10.6388 (1.42)     0.0000 (1.0)           0;0  0.0940 (0.70)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.8038 (1.04)      7.8038 (1.04)      7.8038 (1.04)     0.0000 (1.0)       7.8038 (1.04)     0.0000 (1.0)           0;0  0.1281 (0.96)          1           1
test_checkout_hardlink-checkout-update[main]        7.4960 (1.0)       7.4960 (1.0)       7.4960 (1.0)      0.0000 (1.0)       7.4960 (1.0)      0.0000 (1.0)           0;0  0.1334 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.0363 (1.31)     30.0363 (1.31)     30.0363 (1.31)     0.0000 (1.0)      30.0363 (1.31)     0.0000 (1.0)           0;0  0.0333 (0.76)          1           1
test_checkout_symlink-checkout[3.10.0]     22.8976 (1.0)      22.8976 (1.0)      22.8976 (1.0)      0.0000 (1.0)      22.8976 (1.0)      0.0000 (1.0)           0;0  0.0437 (1.0)           1           1
test_checkout_symlink-checkout[main]       23.2765 (1.02)     23.2765 (1.02)     23.2765 (1.02)     0.0000 (1.0)      23.2765 (1.02)     0.0000 (1.0)           0;0  0.0430 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.0694 (1.01)     8.0694 (1.01)     8.0694 (1.01)     0.0000 (1.0)      8.0694 (1.01)     0.0000 (1.0)           0;0  0.1239 (0.99)          1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.3360 (1.04)     8.3360 (1.04)     8.3360 (1.04)     0.0000 (1.0)      8.3360 (1.04)     0.0000 (1.0)           0;0  0.1200 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       8.0252 (1.0)      8.0252 (1.0)      8.0252 (1.0)      0.0000 (1.0)      8.0252 (1.0)      0.0000 (1.0)           0;0  0.1246 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     13.0195 (1.32)     13.0195 (1.32)     13.0195 (1.32)     0.0000 (1.0)      13.0195 (1.32)     0.0000 (1.0)           0;0  0.0768 (0.76)          1           1
test_checkout_symlink-checkout-update[3.10.0]     10.0275 (1.02)     10.0275 (1.02)     10.0275 (1.02)     0.0000 (1.0)      10.0275 (1.02)     0.0000 (1.0)           0;0  0.0997 (0.98)          1           1
test_checkout_symlink-checkout-update[main]        9.8744 (1.0)       9.8744 (1.0)       9.8744 (1.0)      0.0000 (1.0)       9.8744 (1.0)      0.0000 (1.0)           0;0  0.1013 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.5886 (1.0)      4.5886 (1.0)      4.5886 (1.0)      0.0000 (1.0)      4.5886 (1.0)      0.0000 (1.0)           0;0  0.2179 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.4144 (1.18)     5.4144 (1.18)     5.4144 (1.18)     0.0000 (1.0)      5.4144 (1.18)     0.0000 (1.0)           0;0  0.1847 (0.85)          1           1
test_data_status-data-changed[main]       5.3240 (1.16)     5.3240 (1.16)     5.3240 (1.16)     0.0000 (1.0)      5.3240 (1.16)     0.0000 (1.0)           0;0  0.1878 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.9365 (1.0)      4.9365 (1.0)      4.9365 (1.0)      0.0000 (1.0)      4.9365 (1.0)      0.0000 (1.0)           0;0  0.2026 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.4604 (1.11)     5.4604 (1.11)     5.4604 (1.11)     0.0000 (1.0)      5.4604 (1.11)     0.0000 (1.0)           0;0  0.1831 (0.90)          1           1
test_data_status-data-changed-noop[main]       5.5042 (1.12)     5.5042 (1.12)     5.5042 (1.12)     0.0000 (1.0)      5.5042 (1.12)     0.0000 (1.0)           0;0  0.1817 (0.90)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.6204 (1.0)      20.6204 (1.0)      20.6204 (1.0)      0.0000 (1.0)      20.6204 (1.0)      0.0000 (1.0)           0;0  0.0485 (1.0)           1           1
test_data_status-data-new[3.10.0]     21.6380 (1.05)     21.6380 (1.05)     21.6380 (1.05)     0.0000 (1.0)      21.6380 (1.05)     0.0000 (1.0)           0;0  0.0462 (0.95)          1           1
test_data_status-data-new[main]       21.9554 (1.06)     21.9554 (1.06)     21.9554 (1.06)     0.0000 (1.0)      21.9554 (1.06)     0.0000 (1.0)           0;0  0.0455 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.8840 (1.0)      4.8840 (1.0)      4.8840 (1.0)      0.0000 (1.0)      4.8840 (1.0)      0.0000 (1.0)           0;0  0.2048 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.6175 (1.15)     5.6175 (1.15)     5.6175 (1.15)     0.0000 (1.0)      5.6175 (1.15)     0.0000 (1.0)           0;0  0.1780 (0.87)          1           1
test_data_status-data-noop[main]       5.5847 (1.14)     5.5847 (1.14)     5.5847 (1.14)     0.0000 (1.0)      5.5847 (1.14)     0.0000 (1.0)           0;0  0.1791 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     19.0054 (1.0)      19.0054 (1.0)      19.0054 (1.0)      0.0000 (1.0)      19.0054 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.9030 (1.05)     19.9030 (1.05)     19.9030 (1.05)     0.0000 (1.0)      19.9030 (1.05)     0.0000 (1.0)           0;0  0.0502 (0.95)          1           1
test_data_status_all_flags-data-changed[main]       19.6669 (1.03)     19.6669 (1.03)     19.6669 (1.03)     0.0000 (1.0)      19.6669 (1.03)     0.0000 (1.0)           0;0  0.0508 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.6169 (1.0)      19.6169 (1.0)      19.6169 (1.0)      0.0000 (1.0)      19.6169 (1.0)      0.0000 (1.0)           0;0  0.0510 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.8817 (1.01)     19.8817 (1.01)     19.8817 (1.01)     0.0000 (1.0)      19.8817 (1.01)     0.0000 (1.0)           0;0  0.0503 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.7725 (1.01)     19.7725 (1.01)     19.7725 (1.01)     0.0000 (1.0)      19.7725 (1.01)     0.0000 (1.0)           0;0  0.0506 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     34.9537 (1.0)      34.9537 (1.0)      34.9537 (1.0)      0.0000 (1.0)      34.9537 (1.0)      0.0000 (1.0)           0;0  0.0286 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     35.9570 (1.03)     35.9570 (1.03)     35.9570 (1.03)     0.0000 (1.0)      35.9570 (1.03)     0.0000 (1.0)           0;0  0.0278 (0.97)          1           1
test_data_status_all_flags-data-new[main]       36.1525 (1.03)     36.1525 (1.03)     36.1525 (1.03)     0.0000 (1.0)      36.1525 (1.03)     0.0000 (1.0)           0;0  0.0277 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.3644 (1.0)      18.3644 (1.0)      18.3644 (1.0)      0.0000 (1.0)      18.3644 (1.0)      0.0000 (1.0)           0;0  0.0545 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     19.1031 (1.04)     19.1031 (1.04)     19.1031 (1.04)     0.0000 (1.0)      19.1031 (1.04)     0.0000 (1.0)           0;0  0.0523 (0.96)          1           1
test_data_status_all_flags-data-noop[main]       18.7977 (1.02)     18.7977 (1.02)     18.7977 (1.02)     0.0000 (1.0)      18.7977 (1.02)     0.0000 (1.0)           0;0  0.0532 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.0320 (1.0)      20.0320 (1.0)      20.0320 (1.0)      0.0000 (1.0)      20.0320 (1.0)      0.0000 (1.0)           0;0  0.0499 (1.0)           1           1
test_diff-diff[3.10.0]     20.9642 (1.05)     20.9642 (1.05)     20.9642 (1.05)     0.0000 (1.0)      20.9642 (1.05)     0.0000 (1.0)           0;0  0.0477 (0.96)          1           1
test_diff-diff[main]       23.1024 (1.15)     23.1024 (1.15)     23.1024 (1.15)     0.0000 (1.0)      23.1024 (1.15)     0.0000 (1.0)           0;0  0.0433 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.2142 (1.13)     7.2142 (1.13)     7.2142 (1.13)     0.0000 (1.0)      7.2142 (1.13)     0.0000 (1.0)           0;0  0.1386 (0.88)          1           1
test_diff-diff-changed[3.10.0]     7.8952 (1.24)     7.8952 (1.24)     7.8952 (1.24)     0.0000 (1.0)      7.8952 (1.24)     0.0000 (1.0)           0;0  0.1267 (0.81)          1           1
test_diff-diff-changed[main]       6.3789 (1.0)      6.3789 (1.0)      6.3789 (1.0)      0.0000 (1.0)      6.3789 (1.0)      0.0000 (1.0)           0;0  0.1568 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1307 (1.0)      6.1307 (1.0)      6.1307 (1.0)      0.0000 (1.0)      6.1307 (1.0)      0.0000 (1.0)           0;0  0.1631 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.6963 (1.09)     6.6963 (1.09)     6.6963 (1.09)     0.0000 (1.0)      6.6963 (1.09)     0.0000 (1.0)           0;0  0.1493 (0.92)          1           1
test_diff-diff-changed-noop[main]       6.3717 (1.04)     6.3717 (1.04)     6.3717 (1.04)     0.0000 (1.0)      6.3717 (1.04)     0.0000 (1.0)           0;0  0.1569 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9725 (1.0)      4.9725 (1.0)      4.9725 (1.0)      0.0000 (1.0)      4.9725 (1.0)      0.0000 (1.0)           0;0  0.2011 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.4269 (1.09)     5.4269 (1.09)     5.4269 (1.09)     0.0000 (1.0)      5.4269 (1.09)     0.0000 (1.0)           0;0  0.1843 (0.92)          1           1
test_diff-diff-noop[main]       6.4765 (1.30)     6.4765 (1.30)     6.4765 (1.30)     0.0000 (1.0)      6.4765 (1.30)     0.0000 (1.0)           0;0  0.1544 (0.77)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       871.7144 (1.0)        871.7144 (1.0)        871.7144 (1.0)      0.0000 (1.0)        871.7144 (1.0)      0.0000 (1.0)           0;0  1.1472 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,810.6583 (5.52)     4,810.6583 (5.52)     4,810.6583 (5.52)     0.0000 (1.0)      4,810.6583 (5.52)     0.0000 (1.0)           0;0  0.2079 (0.18)          1           1
test_exp_show-exp[main]       5,729.5553 (6.57)     5,729.5553 (6.57)     5,729.5553 (6.57)     0.0000 (1.0)      5,729.5553 (6.57)     0.0000 (1.0)           0;0  0.1745 (0.15)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     113.2069 (2.81)     113.2069 (2.81)     113.2069 (2.81)     0.0000 (1.0)      113.2069 (2.81)     0.0000 (1.0)           0;0  0.0088 (0.36)          1           1
test_fetch-fetch[3.10.0]     117.5934 (2.91)     117.5934 (2.91)     117.5934 (2.91)     0.0000 (1.0)      117.5934 (2.91)     0.0000 (1.0)           0;0  0.0085 (0.34)          1           1
test_fetch-fetch[main]        40.3561 (1.0)       40.3561 (1.0)       40.3561 (1.0)      0.0000 (1.0)       40.3561 (1.0)      0.0000 (1.0)           0;0  0.0248 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.3133 (1.01)     3.3133 (1.01)     3.3133 (1.01)     0.0000 (1.0)      3.3133 (1.01)     0.0000 (1.0)           0;0  0.3018 (0.99)          1           1
test_gc-gc[3.10.0]     3.2951 (1.0)      3.2951 (1.0)      3.2951 (1.0)      0.0000 (1.0)      3.2951 (1.0)      0.0000 (1.0)           0;0  0.3035 (1.0)           1           1
test_gc-gc[main]       3.3188 (1.01)     3.3188 (1.01)     3.3188 (1.01)     0.0000 (1.0)      3.3188 (1.01)     0.0000 (1.0)           0;0  0.3013 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     186.4214 (1.12)     186.4214 (1.12)     186.4214 (1.12)     0.0000 (1.0)      186.4214 (1.12)     0.0000 (1.0)           0;0  0.0054 (0.89)          1           1
test_get-get[3.10.0]     222.7283 (1.34)     222.7283 (1.34)     222.7283 (1.34)     0.0000 (1.0)      222.7283 (1.34)     0.0000 (1.0)           0;0  0.0045 (0.75)          1           1
test_get-get[main]       166.1558 (1.0)      166.1558 (1.0)      166.1558 (1.0)      0.0000 (1.0)      166.1558 (1.0)      0.0000 (1.0)           0;0  0.0060 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     85.9408 (5.01)     85.9408 (5.01)     85.9408 (5.01)     0.0000 (1.0)      85.9408 (5.01)     0.0000 (1.0)           0;0  0.0116 (0.20)          1           1
test_get_url-get-url[3.10.0]     89.4331 (5.21)     89.4331 (5.21)     89.4331 (5.21)     0.0000 (1.0)      89.4331 (5.21)     0.0000 (1.0)           0;0  0.0112 (0.19)          1           1
test_get_url-get-url[main]       17.1545 (1.0)      17.1545 (1.0)      17.1545 (1.0)      0.0000 (1.0)      17.1545 (1.0)      0.0000 (1.0)           0;0  0.0583 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.2241 (1.04)     133.4267 (1.0)      130.0765 (1.03)     0.9381 (1.0)      129.9371 (1.03)     1.0397 (1.0)          30;3  7.6878 (0.97)        100           1
test_help---help[3.10.0]     123.6561 (1.0)      134.9310 (1.01)     126.6390 (1.0)      1.3925 (1.48)     126.3693 (1.0)      1.5126 (1.45)         17;2  7.8965 (1.0)         100           1
test_help---help[main]       125.5943 (1.02)     135.8338 (1.02)     127.8550 (1.01)     1.2717 (1.36)     127.7548 (1.01)     1.1377 (1.09)         19;5  7.8214 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     286.2526 (1.08)     286.2526 (1.08)     286.2526 (1.08)     0.0000 (1.0)      286.2526 (1.08)     0.0000 (1.0)           0;0  0.0035 (0.93)          1           1
test_import-import[3.10.0]     325.1249 (1.23)     325.1249 (1.23)     325.1249 (1.23)     0.0000 (1.0)      325.1249 (1.23)     0.0000 (1.0)           0;0  0.0031 (0.82)          1           1
test_import-import[main]       265.1976 (1.0)      265.1976 (1.0)      265.1976 (1.0)      0.0000 (1.0)      265.1976 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     214.4161 (1.54)     214.4161 (1.54)     214.4161 (1.54)     0.0000 (1.0)      214.4161 (1.54)     0.0000 (1.0)           0;0  0.0047 (0.65)          1           1
test_import_url-import-url[3.10.0]     217.4486 (1.57)     217.4486 (1.57)     217.4486 (1.57)     0.0000 (1.0)      217.4486 (1.57)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_import_url-import-url[main]       138.8669 (1.0)      138.8669 (1.0)      138.8669 (1.0)      0.0000 (1.0)      138.8669 (1.0)      0.0000 (1.0)           0;0  0.0072 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     366.3610 (1.0)      405.8313 (1.01)     373.4632 (1.0)      6.4729 (1.38)     372.3638 (1.0)      4.5939 (1.0)           9;4  2.6776 (1.0)         100           1
test_init-init[3.10.0]     373.0127 (1.02)     401.0814 (1.0)      381.7024 (1.02)     4.7031 (1.0)      381.2837 (1.02)     6.0927 (1.33)         31;1  2.6198 (0.98)        100           1
test_init-init[main]       369.3122 (1.01)     421.4091 (1.05)     383.2835 (1.03)     6.9343 (1.47)     381.8509 (1.03)     6.6864 (1.46)         16;5  2.6090 (0.97)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     386.7483 (1.09)     386.7483 (1.09)     386.7483 (1.09)     0.0000 (1.0)      386.7483 (1.09)     0.0000 (1.0)           0;0  2.5857 (0.91)          1           1
test_list-list[3.10.0]     366.9613 (1.04)     366.9613 (1.04)     366.9613 (1.04)     0.0000 (1.0)      366.9613 (1.04)     0.0000 (1.0)           0;0  2.7251 (0.96)          1           1
test_list-list[main]       353.4348 (1.0)      353.4348 (1.0)      353.4348 (1.0)      0.0000 (1.0)      353.4348 (1.0)      0.0000 (1.0)           0;0  2.8294 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     354.9646 (1.03)     354.9646 (1.03)     354.9646 (1.03)     0.0000 (1.0)      354.9646 (1.03)     0.0000 (1.0)           0;0  2.8172 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     408.5898 (1.18)     408.5898 (1.18)     408.5898 (1.18)     0.0000 (1.0)      408.5898 (1.18)     0.0000 (1.0)           0;0  2.4474 (0.84)          1           1
test_list-list-dvc-only[main]       345.2220 (1.0)      345.2220 (1.0)      345.2220 (1.0)      0.0000 (1.0)      345.2220 (1.0)      0.0000 (1.0)           0;0  2.8967 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     2.8764 (1.00)     2.8764 (1.00)     2.8764 (1.00)     0.0000 (1.0)      2.8764 (1.00)     0.0000 (1.0)           0;0  0.3477 (1.00)          1           1
test_list-list-recursive[3.10.0]     2.8633 (1.0)      2.8633 (1.0)      2.8633 (1.0)      0.0000 (1.0)      2.8633 (1.0)      0.0000 (1.0)           0;0  0.3492 (1.0)           1           1
test_list-list-recursive[main]       2.9072 (1.02)     2.9072 (1.02)     2.9072 (1.02)     0.0000 (1.0)      2.9072 (1.02)     0.0000 (1.0)           0;0  0.3440 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     349.9424 (1.00)     349.9424 (1.00)     349.9424 (1.00)     0.0000 (1.0)      349.9424 (1.00)     0.0000 (1.0)           0;0  2.8576 (1.00)          1           1
test_list-list-shallow[3.10.0]     363.3822 (1.04)     363.3822 (1.04)     363.3822 (1.04)     0.0000 (1.0)      363.3822 (1.04)     0.0000 (1.0)           0;0  2.7519 (0.96)          1           1
test_list-list-shallow[main]       349.7025 (1.0)      349.7025 (1.0)      349.7025 (1.0)      0.0000 (1.0)      349.7025 (1.0)      0.0000 (1.0)           0;0  2.8596 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     81.7231 (1.04)     81.7231 (1.04)     81.7231 (1.04)     0.0000 (1.0)      81.7231 (1.04)     0.0000 (1.0)           0;0  0.0122 (0.96)          1           1
test_partial_add-add[3.10.0]     81.9482 (1.04)     81.9482 (1.04)     81.9482 (1.04)     0.0000 (1.0)      81.9482 (1.04)     0.0000 (1.0)           0;0  0.0122 (0.96)          1           1
test_partial_add-add[main]       78.7943 (1.0)      78.7943 (1.0)      78.7943 (1.0)      0.0000 (1.0)      78.7943 (1.0)      0.0000 (1.0)           0;0  0.0127 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     68.7595 (1.05)     68.7595 (1.05)     68.7595 (1.05)     0.0000 (1.0)      68.7595 (1.05)     0.0000 (1.0)           0;0  0.0145 (0.95)          1           1
test_partial_add-add-partial[3.10.0]     68.9899 (1.06)     68.9899 (1.06)     68.9899 (1.06)     0.0000 (1.0)      68.9899 (1.06)     0.0000 (1.0)           0;0  0.0145 (0.95)          1           1
test_partial_add-add-partial[main]       65.3259 (1.0)      65.3259 (1.0)      65.3259 (1.0)      0.0000 (1.0)      65.3259 (1.0)      0.0000 (1.0)           0;0  0.0153 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.4812 (1.0)      6.4812 (1.0)      6.4812 (1.0)      0.0000 (1.0)      6.4812 (1.0)      0.0000 (1.0)           0;0  0.1543 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     8.5544 (1.32)     8.5544 (1.32)     8.5544 (1.32)     0.0000 (1.0)      8.5544 (1.32)     0.0000 (1.0)           0;0  0.1169 (0.76)          1           1
test_partial_add-gc-cloud-noop[main]       9.9163 (1.53)     9.9163 (1.53)     9.9163 (1.53)     0.0000 (1.0)      9.9163 (1.53)     0.0000 (1.0)           0;0  0.1008 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.6597 (1.0)      3.6597 (1.0)      3.6597 (1.0)      0.0000 (1.0)      3.6597 (1.0)      0.0000 (1.0)           0;0  0.2732 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.6214 (1.54)     5.6214 (1.54)     5.6214 (1.54)     0.0000 (1.0)      5.6214 (1.54)     0.0000 (1.0)           0;0  0.1779 (0.65)          1           1
test_partial_add-gc-noop[main]       5.6638 (1.55)     5.6638 (1.55)     5.6638 (1.55)     0.0000 (1.0)      5.6638 (1.55)     0.0000 (1.0)           0;0  0.1766 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     80.8172 (3.86)     80.8172 (3.86)     80.8172 (3.86)     0.0000 (1.0)      80.8172 (3.86)     0.0000 (1.0)           0;0  0.0124 (0.26)          1           1
test_partial_add-push[3.10.0]     40.4425 (1.93)     40.4425 (1.93)     40.4425 (1.93)     0.0000 (1.0)      40.4425 (1.93)     0.0000 (1.0)           0;0  0.0247 (0.52)          1           1
test_partial_add-push[main]       20.9613 (1.0)      20.9613 (1.0)      20.9613 (1.0)      0.0000 (1.0)      20.9613 (1.0)      0.0000 (1.0)           0;0  0.0477 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     18.0800 (1.60)     18.0800 (1.60)     18.0800 (1.60)     0.0000 (1.0)      18.0800 (1.60)     0.0000 (1.0)           0;0  0.0553 (0.63)          1           1
test_partial_add-push-partial[3.10.0]     11.3000 (1.0)      11.3000 (1.0)      11.3000 (1.0)      0.0000 (1.0)      11.3000 (1.0)      0.0000 (1.0)           0;0  0.0885 (1.0)           1           1
test_partial_add-push-partial[main]       11.9033 (1.05)     11.9033 (1.05)     11.9033 (1.05)     0.0000 (1.0)      11.9033 (1.05)     0.0000 (1.0)           0;0  0.0840 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     98.1988 (1.03)     98.1988 (1.03)     98.1988 (1.03)     0.0000 (1.0)      98.1988 (1.03)     0.0000 (1.0)           0;0  0.0102 (0.97)          1           1
test_partial_remove-add[3.10.0]     98.7574 (1.04)     98.7574 (1.04)     98.7574 (1.04)     0.0000 (1.0)      98.7574 (1.04)     0.0000 (1.0)           0;0  0.0101 (0.96)          1           1
test_partial_remove-add[main]       95.0633 (1.0)      95.0633 (1.0)      95.0633 (1.0)      0.0000 (1.0)      95.0633 (1.0)      0.0000 (1.0)           0;0  0.0105 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]      9.4460 (1.05)      9.4460 (1.05)      9.4460 (1.05)     0.0000 (1.0)       9.4460 (1.05)     0.0000 (1.0)           0;0  0.1059 (0.95)          1           1
test_partial_remove-add-update[3.10.0]     10.0039 (1.12)     10.0039 (1.12)     10.0039 (1.12)     0.0000 (1.0)      10.0039 (1.12)     0.0000 (1.0)           0;0  0.1000 (0.90)          1           1
test_partial_remove-add-update[main]        8.9649 (1.0)       8.9649 (1.0)       8.9649 (1.0)      0.0000 (1.0)       8.9649 (1.0)      0.0000 (1.0)           0;0  0.1115 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.1671 (1.0)      4.1671 (1.0)      4.1671 (1.0)      0.0000 (1.0)      4.1671 (1.0)      0.0000 (1.0)           0;0  0.2400 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.7204 (1.13)     4.7204 (1.13)     4.7204 (1.13)     0.0000 (1.0)      4.7204 (1.13)     0.0000 (1.0)           0;0  0.2118 (0.88)          1           1
test_partial_remove-gc[main]       4.8275 (1.16)     4.8275 (1.16)     4.8275 (1.16)     0.0000 (1.0)      4.8275 (1.16)     0.0000 (1.0)           0;0  0.2071 (0.86)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.1770 (1.0)      6.1770 (1.0)      6.1770 (1.0)      0.0000 (1.0)      6.1770 (1.0)      0.0000 (1.0)           0;0  0.1619 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.7305 (1.09)     6.7305 (1.09)     6.7305 (1.09)     0.0000 (1.0)      6.7305 (1.09)     0.0000 (1.0)           0;0  0.1486 (0.92)          1           1
test_partial_remove-gc-cloud[main]       6.5965 (1.07)     6.5965 (1.07)     6.5965 (1.07)     0.0000 (1.0)      6.5965 (1.07)     0.0000 (1.0)           0;0  0.1516 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     94.6668 (3.67)     94.6668 (3.67)     94.6668 (3.67)     0.0000 (1.0)      94.6668 (3.67)     0.0000 (1.0)           0;0  0.0106 (0.27)          1           1
test_partial_remove-push[3.10.0]     48.1257 (1.87)     48.1257 (1.87)     48.1257 (1.87)     0.0000 (1.0)      48.1257 (1.87)     0.0000 (1.0)           0;0  0.0208 (0.54)          1           1
test_partial_remove-push[main]       25.7726 (1.0)      25.7726 (1.0)      25.7726 (1.0)      0.0000 (1.0)      25.7726 (1.0)      0.0000 (1.0)           0;0  0.0388 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.1457 (1.01)     2.1457 (1.01)     2.1457 (1.01)     0.0000 (1.0)      2.1457 (1.01)     0.0000 (1.0)           0;0  0.4660 (0.99)          1           1
test_partial_remove-push-update[3.10.0]     2.1155 (1.0)      2.1155 (1.0)      2.1155 (1.0)      0.0000 (1.0)      2.1155 (1.0)      0.0000 (1.0)           0;0  0.4727 (1.0)           1           1
test_partial_remove-push-update[main]       2.9992 (1.42)     2.9992 (1.42)     2.9992 (1.42)     0.0000 (1.0)      2.9992 (1.42)     0.0000 (1.0)           0;0  0.3334 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     427.6295 (1.0)      442.4731 (1.0)      433.5234 (1.0)      5.4875 (1.14)     432.0753 (1.0)       5.2935 (1.17)          2;0  2.3067 (1.0)           5           3
test_plots-plots-diff[3.10.0]     784.7994 (1.84)     807.9396 (1.83)     795.5989 (1.84)     8.5116 (1.77)     795.8054 (1.84)     10.4442 (2.31)          2;0  1.2569 (0.54)          5           3
test_plots-plots-diff[main]       738.6031 (1.73)     751.1996 (1.70)     746.7509 (1.72)     4.8116 (1.0)      747.6119 (1.73)      4.5147 (1.0)           1;0  1.3391 (0.58)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       444.8571 (1.0)        449.0005 (1.0)        446.5724 (1.0)      1.5769 (1.0)        446.6968 (1.0)       1.9499 (1.0)           2;0  2.2393 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,034.2182 (2.32)     1,052.3988 (2.34)     1,041.8538 (2.33)     7.2696 (4.61)     1,039.1507 (2.33)     10.7806 (5.53)          2;0  0.9598 (0.43)          5           3
test_plots-plots-diff-json[main]         822.5168 (1.85)       826.8900 (1.84)       824.2291 (1.85)     1.8144 (1.15)       823.7456 (1.84)      2.8725 (1.47)          1;0  1.2133 (0.54)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     394.5619 (1.0)      419.6596 (1.0)      405.1260 (1.0)      10.4116 (3.78)     405.7431 (1.0)      16.8746 (4.79)          2;0  2.4684 (1.0)           5           3
test_plots-plots-show[3.10.0]     651.9757 (1.65)     658.9018 (1.57)     655.0056 (1.62)      2.7562 (1.0)      655.1318 (1.61)      4.2232 (1.20)          2;0  1.5267 (0.62)          5           3
test_plots-plots-show[main]       635.1527 (1.61)     645.5406 (1.54)     637.7552 (1.57)      4.3920 (1.59)     635.8345 (1.57)      3.5244 (1.0)           1;1  1.5680 (0.64)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     408.1385 (1.0)      410.5891 (1.0)      409.0479 (1.0)      1.0892 (1.0)      408.5274 (1.0)      1.8058 (1.07)          1;0  2.4447 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     794.5769 (1.95)     806.3719 (1.96)     797.8835 (1.95)     4.9105 (4.51)     795.7169 (1.95)     5.1293 (3.03)          1;0  1.2533 (0.51)          5           3
test_plots-plots-show-json[main]       679.5520 (1.67)     683.1062 (1.66)     680.6292 (1.66)     1.4597 (1.34)     680.1404 (1.66)     1.6917 (1.0)           1;0  1.4692 (0.60)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     95.6867 (3.88)     95.6867 (3.88)     95.6867 (3.88)     0.0000 (1.0)      95.6867 (3.88)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_push-push[3.10.0]     47.4202 (1.92)     47.4202 (1.92)     47.4202 (1.92)     0.0000 (1.0)      47.4202 (1.92)     0.0000 (1.0)           0;0  0.0211 (0.52)          1           1
test_push-push[main]       24.6596 (1.0)      24.6596 (1.0)      24.6596 (1.0)      0.0000 (1.0)      24.6596 (1.0)      0.0000 (1.0)           0;0  0.0406 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     98.8677 (1.05)     98.8677 (1.05)     98.8677 (1.05)     0.0000 (1.0)      98.8677 (1.05)     0.0000 (1.0)           0;0  0.0101 (0.95)          1           1
test_sharing-add[3.10.0]     99.1802 (1.05)     99.1802 (1.05)     99.1802 (1.05)     0.0000 (1.0)      99.1802 (1.05)     0.0000 (1.0)           0;0  0.0101 (0.95)          1           1
test_sharing-add[main]       94.3201 (1.0)      94.3201 (1.0)      94.3201 (1.0)      0.0000 (1.0)      94.3201 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     64.2243 (1.06)     64.2243 (1.06)     64.2243 (1.06)     0.0000 (1.0)      64.2243 (1.06)     0.0000 (1.0)           0;0  0.0156 (0.95)          1           1
test_sharing-add-noop[3.10.0]     64.8043 (1.07)     64.8043 (1.07)     64.8043 (1.07)     0.0000 (1.0)      64.8043 (1.07)     0.0000 (1.0)           0;0  0.0154 (0.94)          1           1
test_sharing-add-noop[main]       60.8003 (1.0)      60.8003 (1.0)      60.8003 (1.0)      0.0000 (1.0)      60.8003 (1.0)      0.0000 (1.0)           0;0  0.0164 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      42.9045 (1.41)      42.9045 (1.41)      42.9045 (1.41)     0.0000 (1.0)       42.9045 (1.41)     0.0000 (1.0)           0;0  0.0233 (0.71)          1           1
test_sharing-checkout[3.10.0]     105.3019 (3.47)     105.3019 (3.47)     105.3019 (3.47)     0.0000 (1.0)      105.3019 (3.47)     0.0000 (1.0)           0;0  0.0095 (0.29)          1           1
test_sharing-checkout[main]        30.3420 (1.0)       30.3420 (1.0)       30.3420 (1.0)      0.0000 (1.0)       30.3420 (1.0)      0.0000 (1.0)           0;0  0.0330 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.5997 (1.0)      6.5997 (1.0)      6.5997 (1.0)      0.0000 (1.0)      6.5997 (1.0)      0.0000 (1.0)           0;0  0.1515 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     7.0453 (1.07)     7.0453 (1.07)     7.0453 (1.07)     0.0000 (1.0)      7.0453 (1.07)     0.0000 (1.0)           0;0  0.1419 (0.94)          1           1
test_sharing-checkout-noop[main]       6.7719 (1.03)     6.7719 (1.03)     6.7719 (1.03)     0.0000 (1.0)      6.7719 (1.03)     0.0000 (1.0)           0;0  0.1477 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     111.8125 (2.66)     111.8125 (2.66)     111.8125 (2.66)     0.0000 (1.0)      111.8125 (2.66)     0.0000 (1.0)           0;0  0.0089 (0.38)          1           1
test_sharing-fetch[3.10.0]     119.2008 (2.84)     119.2008 (2.84)     119.2008 (2.84)     0.0000 (1.0)      119.2008 (2.84)     0.0000 (1.0)           0;0  0.0084 (0.35)          1           1
test_sharing-fetch[main]        41.9971 (1.0)       41.9971 (1.0)       41.9971 (1.0)      0.0000 (1.0)       41.9971 (1.0)      0.0000 (1.0)           0;0  0.0238 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4351 (1.0)      1.4351 (1.0)      1.4351 (1.0)      0.0000 (1.0)      1.4351 (1.0)      0.0000 (1.0)           0;0  0.6968 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.9350 (2.74)     3.9350 (2.74)     3.9350 (2.74)     0.0000 (1.0)      3.9350 (2.74)     0.0000 (1.0)           0;0  0.2541 (0.36)          1           1
test_sharing-fetch-noop[main]       7.2957 (5.08)     7.2957 (5.08)     7.2957 (5.08)     0.0000 (1.0)      7.2957 (5.08)     0.0000 (1.0)           0;0  0.1371 (0.20)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     95.0702 (3.66)     95.0702 (3.66)     95.0702 (3.66)     0.0000 (1.0)      95.0702 (3.66)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing-push[3.10.0]     48.9177 (1.88)     48.9177 (1.88)     48.9177 (1.88)     0.0000 (1.0)      48.9177 (1.88)     0.0000 (1.0)           0;0  0.0204 (0.53)          1           1
test_sharing-push[main]       25.9766 (1.0)      25.9766 (1.0)      25.9766 (1.0)      0.0000 (1.0)      25.9766 (1.0)      0.0000 (1.0)           0;0  0.0385 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.4821 (1.0)      2.4821 (1.0)      2.4821 (1.0)      0.0000 (1.0)      2.4821 (1.0)      0.0000 (1.0)           0;0  0.4029 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.7436 (1.11)     2.7436 (1.11)     2.7436 (1.11)     0.0000 (1.0)      2.7436 (1.11)     0.0000 (1.0)           0;0  0.3645 (0.90)          1           1
test_sharing-push-noop[main]       7.6930 (3.10)     7.6930 (3.10)     7.6930 (3.10)     0.0000 (1.0)      7.6930 (3.10)     0.0000 (1.0)           0;0  0.1300 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     96.9242 (1.05)     96.9242 (1.05)     96.9242 (1.05)     0.0000 (1.0)      96.9242 (1.05)     0.0000 (1.0)           0;0  0.0103 (0.95)          1           1
test_sharing_azure-add[3.10.0]     95.1961 (1.03)     95.1961 (1.03)     95.1961 (1.03)     0.0000 (1.0)      95.1961 (1.03)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_sharing_azure-add[main]       92.0235 (1.0)      92.0235 (1.0)      92.0235 (1.0)      0.0000 (1.0)      92.0235 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.5732 (1.08)     63.5732 (1.08)     63.5732 (1.08)     0.0000 (1.0)      63.5732 (1.08)     0.0000 (1.0)           0;0  0.0157 (0.93)          1           1
test_sharing_azure-add-noop[3.10.0]     62.7021 (1.06)     62.7021 (1.06)     62.7021 (1.06)     0.0000 (1.0)      62.7021 (1.06)     0.0000 (1.0)           0;0  0.0159 (0.94)          1           1
test_sharing_azure-add-noop[main]       59.0354 (1.0)      59.0354 (1.0)      59.0354 (1.0)      0.0000 (1.0)      59.0354 (1.0)      0.0000 (1.0)           0;0  0.0169 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      42.7096 (1.43)      42.7096 (1.43)      42.7096 (1.43)     0.0000 (1.0)       42.7096 (1.43)     0.0000 (1.0)           0;0  0.0234 (0.70)          1           1
test_sharing_azure-checkout[3.10.0]     103.0336 (3.46)     103.0336 (3.46)     103.0336 (3.46)     0.0000 (1.0)      103.0336 (3.46)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_azure-checkout[main]        29.8131 (1.0)       29.8131 (1.0)       29.8131 (1.0)      0.0000 (1.0)       29.8131 (1.0)      0.0000 (1.0)           0;0  0.0335 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.7294 (1.01)     6.7294 (1.01)     6.7294 (1.01)     0.0000 (1.0)      6.7294 (1.01)     0.0000 (1.0)           0;0  0.1486 (0.99)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.9744 (1.05)     6.9744 (1.05)     6.9744 (1.05)     0.0000 (1.0)      6.9744 (1.05)     0.0000 (1.0)           0;0  0.1434 (0.95)          1           1
test_sharing_azure-checkout-noop[main]       6.6406 (1.0)      6.6406 (1.0)      6.6406 (1.0)      0.0000 (1.0)      6.6406 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     111.0657 (2.73)     111.0657 (2.73)     111.0657 (2.73)     0.0000 (1.0)      111.0657 (2.73)     0.0000 (1.0)           0;0  0.0090 (0.37)          1           1
test_sharing_azure-fetch[3.10.0]     116.5394 (2.86)     116.5394 (2.86)     116.5394 (2.86)     0.0000 (1.0)      116.5394 (2.86)     0.0000 (1.0)           0;0  0.0086 (0.35)          1           1
test_sharing_azure-fetch[main]        40.7134 (1.0)       40.7134 (1.0)       40.7134 (1.0)      0.0000 (1.0)       40.7134 (1.0)      0.0000 (1.0)           0;0  0.0246 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4912 (1.0)      1.4912 (1.0)      1.4912 (1.0)      0.0000 (1.0)      1.4912 (1.0)      0.0000 (1.0)           0;0  0.6706 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.8621 (2.59)     3.8621 (2.59)     3.8621 (2.59)     0.0000 (1.0)      3.8621 (2.59)     0.0000 (1.0)           0;0  0.2589 (0.39)          1           1
test_sharing_azure-fetch-noop[main]       7.0383 (4.72)     7.0383 (4.72)     7.0383 (4.72)     0.0000 (1.0)      7.0383 (4.72)     0.0000 (1.0)           0;0  0.1421 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     94.6652 (3.60)     94.6652 (3.60)     94.6652 (3.60)     0.0000 (1.0)      94.6652 (3.60)     0.0000 (1.0)           0;0  0.0106 (0.28)          1           1
test_sharing_azure-push[3.10.0]     48.0281 (1.83)     48.0281 (1.83)     48.0281 (1.83)     0.0000 (1.0)      48.0281 (1.83)     0.0000 (1.0)           0;0  0.0208 (0.55)          1           1
test_sharing_azure-push[main]       26.2762 (1.0)      26.2762 (1.0)      26.2762 (1.0)      0.0000 (1.0)      26.2762 (1.0)      0.0000 (1.0)           0;0  0.0381 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5834 (1.02)     2.5834 (1.02)     2.5834 (1.02)     0.0000 (1.0)      2.5834 (1.02)     0.0000 (1.0)           0;0  0.3871 (0.98)          1           1
test_sharing_azure-push-noop[3.10.0]     2.5403 (1.0)      2.5403 (1.0)      2.5403 (1.0)      0.0000 (1.0)      2.5403 (1.0)      0.0000 (1.0)           0;0  0.3937 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.5382 (2.97)     7.5382 (2.97)     7.5382 (2.97)     0.0000 (1.0)      7.5382 (2.97)     0.0000 (1.0)           0;0  0.1327 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     96.5310 (1.03)     96.5310 (1.03)     96.5310 (1.03)     0.0000 (1.0)      96.5310 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_sharing_gs-add[3.10.0]     98.8118 (1.05)     98.8118 (1.05)     98.8118 (1.05)     0.0000 (1.0)      98.8118 (1.05)     0.0000 (1.0)           0;0  0.0101 (0.95)          1           1
test_sharing_gs-add[main]       94.0459 (1.0)      94.0459 (1.0)      94.0459 (1.0)      0.0000 (1.0)      94.0459 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     64.1644 (1.06)     64.1644 (1.06)     64.1644 (1.06)     0.0000 (1.0)      64.1644 (1.06)     0.0000 (1.0)           0;0  0.0156 (0.94)          1           1
test_sharing_gs-add-noop[3.10.0]     65.2670 (1.08)     65.2670 (1.08)     65.2670 (1.08)     0.0000 (1.0)      65.2670 (1.08)     0.0000 (1.0)           0;0  0.0153 (0.93)          1           1
test_sharing_gs-add-noop[main]       60.6111 (1.0)      60.6111 (1.0)      60.6111 (1.0)      0.0000 (1.0)      60.6111 (1.0)      0.0000 (1.0)           0;0  0.0165 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      43.7182 (1.44)      43.7182 (1.44)      43.7182 (1.44)     0.0000 (1.0)       43.7182 (1.44)     0.0000 (1.0)           0;0  0.0229 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     105.4276 (3.46)     105.4276 (3.46)     105.4276 (3.46)     0.0000 (1.0)      105.4276 (3.46)     0.0000 (1.0)           0;0  0.0095 (0.29)          1           1
test_sharing_gs-checkout[main]        30.4481 (1.0)       30.4481 (1.0)       30.4481 (1.0)      0.0000 (1.0)       30.4481 (1.0)      0.0000 (1.0)           0;0  0.0328 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.7515 (1.02)     6.7515 (1.02)     6.7515 (1.02)     0.0000 (1.0)      6.7515 (1.02)     0.0000 (1.0)           0;0  0.1481 (0.98)          1           1
test_sharing_gs-checkout-noop[3.10.0]     7.0591 (1.06)     7.0591 (1.06)     7.0591 (1.06)     0.0000 (1.0)      7.0591 (1.06)     0.0000 (1.0)           0;0  0.1417 (0.94)          1           1
test_sharing_gs-checkout-noop[main]       6.6410 (1.0)      6.6410 (1.0)      6.6410 (1.0)      0.0000 (1.0)      6.6410 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     113.5319 (2.75)     113.5319 (2.75)     113.5319 (2.75)     0.0000 (1.0)      113.5319 (2.75)     0.0000 (1.0)           0;0  0.0088 (0.36)          1           1
test_sharing_gs-fetch[3.10.0]     120.6981 (2.93)     120.6981 (2.93)     120.6981 (2.93)     0.0000 (1.0)      120.6981 (2.93)     0.0000 (1.0)           0;0  0.0083 (0.34)          1           1
test_sharing_gs-fetch[main]        41.2466 (1.0)       41.2466 (1.0)       41.2466 (1.0)      0.0000 (1.0)       41.2466 (1.0)      0.0000 (1.0)           0;0  0.0242 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.5234 (1.0)      1.5234 (1.0)      1.5234 (1.0)      0.0000 (1.0)      1.5234 (1.0)      0.0000 (1.0)           0;0  0.6564 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     3.9256 (2.58)     3.9256 (2.58)     3.9256 (2.58)     0.0000 (1.0)      3.9256 (2.58)     0.0000 (1.0)           0;0  0.2547 (0.39)          1           1
test_sharing_gs-fetch-noop[main]       7.1806 (4.71)     7.1806 (4.71)     7.1806 (4.71)     0.0000 (1.0)      7.1806 (4.71)     0.0000 (1.0)           0;0  0.1393 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     97.7101 (3.80)     97.7101 (3.80)     97.7101 (3.80)     0.0000 (1.0)      97.7101 (3.80)     0.0000 (1.0)           0;0  0.0102 (0.26)          1           1
test_sharing_gs-push[3.10.0]     49.6994 (1.93)     49.6994 (1.93)     49.6994 (1.93)     0.0000 (1.0)      49.6994 (1.93)     0.0000 (1.0)           0;0  0.0201 (0.52)          1           1
test_sharing_gs-push[main]       25.7325 (1.0)      25.7325 (1.0)      25.7325 (1.0)      0.0000 (1.0)      25.7325 (1.0)      0.0000 (1.0)           0;0  0.0389 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.8358 (1.00)     2.8358 (1.00)     2.8358 (1.00)     0.0000 (1.0)      2.8358 (1.00)     0.0000 (1.0)           0;0  0.3526 (1.00)          1           1
test_sharing_gs-push-noop[3.10.0]     2.8231 (1.0)      2.8231 (1.0)      2.8231 (1.0)      0.0000 (1.0)      2.8231 (1.0)      0.0000 (1.0)           0;0  0.3542 (1.0)           1           1
test_sharing_gs-push-noop[main]       7.3693 (2.61)     7.3693 (2.61)     7.3693 (2.61)     0.0000 (1.0)      7.3693 (2.61)     0.0000 (1.0)           0;0  0.1357 (0.38)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     96.9394 (1.01)     96.9394 (1.01)     96.9394 (1.01)     0.0000 (1.0)      96.9394 (1.01)     0.0000 (1.0)           0;0  0.0103 (0.99)          1           1
test_sharing_s3-add[3.10.0]     97.5288 (1.02)     97.5288 (1.02)     97.5288 (1.02)     0.0000 (1.0)      97.5288 (1.02)     0.0000 (1.0)           0;0  0.0103 (0.98)          1           1
test_sharing_s3-add[main]       95.8876 (1.0)      95.8876 (1.0)      95.8876 (1.0)      0.0000 (1.0)      95.8876 (1.0)      0.0000 (1.0)           0;0  0.0104 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     64.0918 (1.06)     64.0918 (1.06)     64.0918 (1.06)     0.0000 (1.0)      64.0918 (1.06)     0.0000 (1.0)           0;0  0.0156 (0.94)          1           1
test_sharing_s3-add-noop[3.10.0]     64.3260 (1.06)     64.3260 (1.06)     64.3260 (1.06)     0.0000 (1.0)      64.3260 (1.06)     0.0000 (1.0)           0;0  0.0155 (0.94)          1           1
test_sharing_s3-add-noop[main]       60.4164 (1.0)      60.4164 (1.0)      60.4164 (1.0)      0.0000 (1.0)      60.4164 (1.0)      0.0000 (1.0)           0;0  0.0166 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      43.5917 (1.42)      43.5917 (1.42)      43.5917 (1.42)     0.0000 (1.0)       43.5917 (1.42)     0.0000 (1.0)           0;0  0.0229 (0.70)          1           1
test_sharing_s3-checkout[3.10.0]     105.6237 (3.44)     105.6237 (3.44)     105.6237 (3.44)     0.0000 (1.0)      105.6237 (3.44)     0.0000 (1.0)           0;0  0.0095 (0.29)          1           1
test_sharing_s3-checkout[main]        30.7019 (1.0)       30.7019 (1.0)       30.7019 (1.0)      0.0000 (1.0)       30.7019 (1.0)      0.0000 (1.0)           0;0  0.0326 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.8241 (1.02)     6.8241 (1.02)     6.8241 (1.02)     0.0000 (1.0)      6.8241 (1.02)     0.0000 (1.0)           0;0  0.1465 (0.98)          1           1
test_sharing_s3-checkout-noop[3.10.0]     7.0863 (1.06)     7.0863 (1.06)     7.0863 (1.06)     0.0000 (1.0)      7.0863 (1.06)     0.0000 (1.0)           0;0  0.1411 (0.95)          1           1
test_sharing_s3-checkout-noop[main]       6.7045 (1.0)      6.7045 (1.0)      6.7045 (1.0)      0.0000 (1.0)      6.7045 (1.0)      0.0000 (1.0)           0;0  0.1492 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     531.1474 (1.28)     531.1474 (1.28)     531.1474 (1.28)     0.0000 (1.0)      531.1474 (1.28)     0.0000 (1.0)           0;0  0.0019 (0.78)          1           1
test_sharing_s3-fetch[3.10.0]     413.5490 (1.0)      413.5490 (1.0)      413.5490 (1.0)      0.0000 (1.0)      413.5490 (1.0)      0.0000 (1.0)           0;0  0.0024 (1.0)           1           1
test_sharing_s3-fetch[main]       415.4596 (1.00)     415.4596 (1.00)     415.4596 (1.00)     0.0000 (1.0)      415.4596 (1.00)     0.0000 (1.0)           0;0  0.0024 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.6360 (1.0)      1.6360 (1.0)      1.6360 (1.0)      0.0000 (1.0)      1.6360 (1.0)      0.0000 (1.0)           0;0  0.6113 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     3.9991 (2.44)     3.9991 (2.44)     3.9991 (2.44)     0.0000 (1.0)      3.9991 (2.44)     0.0000 (1.0)           0;0  0.2501 (0.41)          1           1
test_sharing_s3-fetch-noop[main]       7.5396 (4.61)     7.5396 (4.61)     7.5396 (4.61)     0.0000 (1.0)      7.5396 (4.61)     0.0000 (1.0)           0;0  0.1326 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     587.5287 (1.01)     587.5287 (1.01)     587.5287 (1.01)     0.0000 (1.0)      587.5287 (1.01)     0.0000 (1.0)           0;0  0.0017 (0.99)          1           1
test_sharing_s3-push[3.10.0]     584.4192 (1.0)      584.4192 (1.0)      584.4192 (1.0)      0.0000 (1.0)      584.4192 (1.0)      0.0000 (1.0)           0;0  0.0017 (1.0)           1           1
test_sharing_s3-push[main]       605.8021 (1.04)     605.8021 (1.04)     605.8021 (1.04)     0.0000 (1.0)      605.8021 (1.04)     0.0000 (1.0)           0;0  0.0017 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.9801 (1.00)     2.9801 (1.00)     2.9801 (1.00)     0.0000 (1.0)      2.9801 (1.00)     0.0000 (1.0)           0;0  0.3356 (1.00)          1           1
test_sharing_s3-push-noop[3.10.0]     2.9656 (1.0)      2.9656 (1.0)      2.9656 (1.0)      0.0000 (1.0)      2.9656 (1.0)      0.0000 (1.0)           0;0  0.3372 (1.0)           1           1
test_sharing_s3-push-noop[main]       8.0144 (2.70)     8.0144 (2.70)     8.0144 (2.70)     0.0000 (1.0)      8.0144 (2.70)     0.0000 (1.0)           0;0  0.1248 (0.37)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.5698 (1.00)     21.5698 (1.00)     21.5698 (1.00)     0.0000 (1.0)      21.5698 (1.00)     0.0000 (1.0)           0;0  0.0464 (1.00)          1           1
test_status-status[3.10.0]     21.6856 (1.01)     21.6856 (1.01)     21.6856 (1.01)     0.0000 (1.0)      21.6856 (1.01)     0.0000 (1.0)           0;0  0.0461 (0.99)          1           1
test_status-status[main]       21.4808 (1.0)      21.4808 (1.0)      21.4808 (1.0)      0.0000 (1.0)      21.4808 (1.0)      0.0000 (1.0)           0;0  0.0466 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.6411 (1.0)      5.6411 (1.0)      5.6411 (1.0)      0.0000 (1.0)      5.6411 (1.0)      0.0000 (1.0)           0;0  0.1773 (1.0)           1           1
test_status-status-changed[3.10.0]     5.7607 (1.02)     5.7607 (1.02)     5.7607 (1.02)     0.0000 (1.0)      5.7607 (1.02)     0.0000 (1.0)           0;0  0.1736 (0.98)          1           1
test_status-status-changed[main]       5.6746 (1.01)     5.6746 (1.01)     5.6746 (1.01)     0.0000 (1.0)      5.6746 (1.01)     0.0000 (1.0)           0;0  0.1762 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.5222 (1.0)      5.5222 (1.0)      5.5222 (1.0)      0.0000 (1.0)      5.5222 (1.0)      0.0000 (1.0)           0;0  0.1811 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.7094 (1.03)     5.7094 (1.03)     5.7094 (1.03)     0.0000 (1.0)      5.7094 (1.03)     0.0000 (1.0)           0;0  0.1751 (0.97)          1           1
test_status-status-changed-noop[main]       5.6771 (1.03)     5.6771 (1.03)     5.6771 (1.03)     0.0000 (1.0)      5.6771 (1.03)     0.0000 (1.0)           0;0  0.1761 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.6433 (1.00)     5.6433 (1.00)     5.6433 (1.00)     0.0000 (1.0)      5.6433 (1.00)     0.0000 (1.0)           0;0  0.1772 (1.00)          1           1
test_status-status-noop[3.10.0]     5.8948 (1.05)     5.8948 (1.05)     5.8948 (1.05)     0.0000 (1.0)      5.8948 (1.05)     0.0000 (1.0)           0;0  0.1696 (0.95)          1           1
test_status-status-noop[main]       5.6291 (1.0)      5.6291 (1.0)      5.6291 (1.0)      0.0000 (1.0)      5.6291 (1.0)      0.0000 (1.0)           0;0  0.1776 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     214.4960 (1.52)     214.4960 (1.52)     214.4960 (1.52)     0.0000 (1.0)      214.4960 (1.52)     0.0000 (1.0)           0;0  0.0047 (0.66)          1           1
test_update-import-url[3.10.0]     219.0976 (1.56)     219.0976 (1.56)     219.0976 (1.56)     0.0000 (1.0)      219.0976 (1.56)     0.0000 (1.0)           0;0  0.0046 (0.64)          1           1
test_update-import-url[main]       140.7250 (1.0)      140.7250 (1.0)      140.7250 (1.0)      0.0000 (1.0)      140.7250 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     198.6019 (1.60)     198.6019 (1.60)     198.6019 (1.60)     0.0000 (1.0)      198.6019 (1.60)     0.0000 (1.0)           0;0  0.0050 (0.63)          1           1
test_update-update[3.10.0]     203.0827 (1.64)     203.0827 (1.64)     203.0827 (1.64)     0.0000 (1.0)      203.0827 (1.64)     0.0000 (1.0)           0;0  0.0049 (0.61)          1           1
test_update-update[main]       124.2046 (1.0)      124.2046 (1.0)      124.2046 (1.0)      0.0000 (1.0)      124.2046 (1.0)      0.0000 (1.0)           0;0  0.0081 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     20.2153 (1.01)     20.2153 (1.01)     20.2153 (1.01)     0.0000 (1.0)      20.2153 (1.01)     0.0000 (1.0)           0;0  0.0495 (0.99)          1           1
test_update-update-noop[3.10.0]     21.1575 (1.06)     21.1575 (1.06)     21.1575 (1.06)     0.0000 (1.0)      21.1575 (1.06)     0.0000 (1.0)           0;0  0.0473 (0.94)          1           1
test_update-update-noop[main]       19.9929 (1.0)      19.9929 (1.0)      19.9929 (1.0)      0.0000 (1.0)      19.9929 (1.0)      0.0000 (1.0)           0;0  0.0500 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean