Mon Mar  4 06:38:07 UTC 2024
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     96.5387 (1.02)     96.5387 (1.02)     96.5387 (1.02)     0.0000 (1.0)      96.5387 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.99)          1           1
test_add-add[3.10.0]     98.4325 (1.04)     98.4325 (1.04)     98.4325 (1.04)     0.0000 (1.0)      98.4325 (1.04)     0.0000 (1.0)           0;0  0.0102 (0.97)          1           1
test_add-add[main]       95.1022 (1.0)      95.1022 (1.0)      95.1022 (1.0)      0.0000 (1.0)      95.1022 (1.0)      0.0000 (1.0)           0;0  0.0105 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]      43.7435 (1.39)      43.7435 (1.39)      43.7435 (1.39)     0.0000 (1.0)       43.7435 (1.39)     0.0000 (1.0)           0;0  0.0229 (0.72)          1           1
test_checkout_copy-checkout[3.10.0]     105.4826 (3.34)     105.4826 (3.34)     105.4826 (3.34)     0.0000 (1.0)      105.4826 (3.34)     0.0000 (1.0)           0;0  0.0095 (0.30)          1           1
test_checkout_copy-checkout[main]        31.5689 (1.0)       31.5689 (1.0)       31.5689 (1.0)      0.0000 (1.0)       31.5689 (1.0)      0.0000 (1.0)           0;0  0.0317 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.8289 (1.03)     6.8289 (1.03)     6.8289 (1.03)     0.0000 (1.0)      6.8289 (1.03)     0.0000 (1.0)           0;0  0.1464 (0.97)          1           1
test_checkout_copy-checkout-noop[3.10.0]     6.9558 (1.05)     6.9558 (1.05)     6.9558 (1.05)     0.0000 (1.0)      6.9558 (1.05)     0.0000 (1.0)           0;0  0.1438 (0.95)          1           1
test_checkout_copy-checkout-noop[main]       6.6333 (1.0)      6.6333 (1.0)      6.6333 (1.0)      0.0000 (1.0)      6.6333 (1.0)      0.0000 (1.0)           0;0  0.1508 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.7398 (1.43)     10.7398 (1.43)     10.7398 (1.43)     0.0000 (1.0)      10.7398 (1.43)     0.0000 (1.0)           0;0  0.0931 (0.70)          1           1
test_checkout_copy-checkout-update[3.10.0]      7.7158 (1.03)      7.7158 (1.03)      7.7158 (1.03)     0.0000 (1.0)       7.7158 (1.03)     0.0000 (1.0)           0;0  0.1296 (0.98)          1           1
test_checkout_copy-checkout-update[main]        7.5249 (1.0)       7.5249 (1.0)       7.5249 (1.0)      0.0000 (1.0)       7.5249 (1.0)      0.0000 (1.0)           0;0  0.1329 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     25.8287 (1.40)     25.8287 (1.40)     25.8287 (1.40)     0.0000 (1.0)      25.8287 (1.40)     0.0000 (1.0)           0;0  0.0387 (0.71)          1           1
test_checkout_hardlink-checkout[3.10.0]     18.5331 (1.01)     18.5331 (1.01)     18.5331 (1.01)     0.0000 (1.0)      18.5331 (1.01)     0.0000 (1.0)           0;0  0.0540 (0.99)          1           1
test_checkout_hardlink-checkout[main]       18.3841 (1.0)      18.3841 (1.0)      18.3841 (1.0)      0.0000 (1.0)      18.3841 (1.0)      0.0000 (1.0)           0;0  0.0544 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.6935 (1.04)     6.6935 (1.04)     6.6935 (1.04)     0.0000 (1.0)      6.6935 (1.04)     0.0000 (1.0)           0;0  0.1494 (0.96)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     6.8138 (1.06)     6.8138 (1.06)     6.8138 (1.06)     0.0000 (1.0)      6.8138 (1.06)     0.0000 (1.0)           0;0  0.1468 (0.95)          1           1
test_checkout_hardlink-checkout-noop[main]       6.4455 (1.0)      6.4455 (1.0)      6.4455 (1.0)      0.0000 (1.0)      6.4455 (1.0)      0.0000 (1.0)           0;0  0.1551 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.5847 (1.42)     10.5847 (1.42)     10.5847 (1.42)     0.0000 (1.0)      10.5847 (1.42)     0.0000 (1.0)           0;0  0.0945 (0.71)          1           1
test_checkout_hardlink-checkout-update[3.10.0]      7.4906 (1.00)      7.4906 (1.00)      7.4906 (1.00)     0.0000 (1.0)       7.4906 (1.00)     0.0000 (1.0)           0;0  0.1335 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]        7.4663 (1.0)       7.4663 (1.0)       7.4663 (1.0)      0.0000 (1.0)       7.4663 (1.0)      0.0000 (1.0)           0;0  0.1339 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     30.1046 (1.31)     30.1046 (1.31)     30.1046 (1.31)     0.0000 (1.0)      30.1046 (1.31)     0.0000 (1.0)           0;0  0.0332 (0.76)          1           1
test_checkout_symlink-checkout[3.10.0]     23.0424 (1.00)     23.0424 (1.00)     23.0424 (1.00)     0.0000 (1.0)      23.0424 (1.00)     0.0000 (1.0)           0;0  0.0434 (1.00)          1           1
test_checkout_symlink-checkout[main]       22.9997 (1.0)      22.9997 (1.0)      22.9997 (1.0)      0.0000 (1.0)      22.9997 (1.0)      0.0000 (1.0)           0;0  0.0435 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.0501 (1.0)      8.0501 (1.0)      8.0501 (1.0)      0.0000 (1.0)      8.0501 (1.0)      0.0000 (1.0)           0;0  0.1242 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     8.3569 (1.04)     8.3569 (1.04)     8.3569 (1.04)     0.0000 (1.0)      8.3569 (1.04)     0.0000 (1.0)           0;0  0.1197 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       8.0886 (1.00)     8.0886 (1.00)     8.0886 (1.00)     0.0000 (1.0)      8.0886 (1.00)     0.0000 (1.0)           0;0  0.1236 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     12.9621 (1.30)     12.9621 (1.30)     12.9621 (1.30)     0.0000 (1.0)      12.9621 (1.30)     0.0000 (1.0)           0;0  0.0771 (0.77)          1           1
test_checkout_symlink-checkout-update[3.10.0]      9.9898 (1.00)      9.9898 (1.00)      9.9898 (1.00)     0.0000 (1.0)       9.9898 (1.00)     0.0000 (1.0)           0;0  0.1001 (1.00)          1           1
test_checkout_symlink-checkout-update[main]        9.9788 (1.0)       9.9788 (1.0)       9.9788 (1.0)      0.0000 (1.0)       9.9788 (1.0)      0.0000 (1.0)           0;0  0.1002 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.2828 (1.0)      4.2828 (1.0)      4.2828 (1.0)      0.0000 (1.0)      4.2828 (1.0)      0.0000 (1.0)           0;0  0.2335 (1.0)           1           1
test_data_status-data-changed[3.10.0]     5.0553 (1.18)     5.0553 (1.18)     5.0553 (1.18)     0.0000 (1.0)      5.0553 (1.18)     0.0000 (1.0)           0;0  0.1978 (0.85)          1           1
test_data_status-data-changed[main]       5.0518 (1.18)     5.0518 (1.18)     5.0518 (1.18)     0.0000 (1.0)      5.0518 (1.18)     0.0000 (1.0)           0;0  0.1979 (0.85)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.6577 (1.0)      4.6577 (1.0)      4.6577 (1.0)      0.0000 (1.0)      4.6577 (1.0)      0.0000 (1.0)           0;0  0.2147 (1.0)           1           1
test_data_status-data-changed-noop[3.10.0]     5.2388 (1.12)     5.2388 (1.12)     5.2388 (1.12)     0.0000 (1.0)      5.2388 (1.12)     0.0000 (1.0)           0;0  0.1909 (0.89)          1           1
test_data_status-data-changed-noop[main]       5.0190 (1.08)     5.0190 (1.08)     5.0190 (1.08)     0.0000 (1.0)      5.0190 (1.08)     0.0000 (1.0)           0;0  0.1992 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     19.3110 (1.0)      19.3110 (1.0)      19.3110 (1.0)      0.0000 (1.0)      19.3110 (1.0)      0.0000 (1.0)           0;0  0.0518 (1.0)           1           1
test_data_status-data-new[3.10.0]     20.1147 (1.04)     20.1147 (1.04)     20.1147 (1.04)     0.0000 (1.0)      20.1147 (1.04)     0.0000 (1.0)           0;0  0.0497 (0.96)          1           1
test_data_status-data-new[main]       20.1527 (1.04)     20.1527 (1.04)     20.1527 (1.04)     0.0000 (1.0)      20.1527 (1.04)     0.0000 (1.0)           0;0  0.0496 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.5845 (1.0)      4.5845 (1.0)      4.5845 (1.0)      0.0000 (1.0)      4.5845 (1.0)      0.0000 (1.0)           0;0  0.2181 (1.0)           1           1
test_data_status-data-noop[3.10.0]     5.3242 (1.16)     5.3242 (1.16)     5.3242 (1.16)     0.0000 (1.0)      5.3242 (1.16)     0.0000 (1.0)           0;0  0.1878 (0.86)          1           1
test_data_status-data-noop[main]       5.2368 (1.14)     5.2368 (1.14)     5.2368 (1.14)     0.0000 (1.0)      5.2368 (1.14)     0.0000 (1.0)           0;0  0.1910 (0.88)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     18.9009 (1.0)      18.9009 (1.0)      18.9009 (1.0)      0.0000 (1.0)      18.9009 (1.0)      0.0000 (1.0)           0;0  0.0529 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]     19.6950 (1.04)     19.6950 (1.04)     19.6950 (1.04)     0.0000 (1.0)      19.6950 (1.04)     0.0000 (1.0)           0;0  0.0508 (0.96)          1           1
test_data_status_all_flags-data-changed[main]       19.5950 (1.04)     19.5950 (1.04)     19.5950 (1.04)     0.0000 (1.0)      19.5950 (1.04)     0.0000 (1.0)           0;0  0.0510 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.4233 (1.0)      19.4233 (1.0)      19.4233 (1.0)      0.0000 (1.0)      19.4233 (1.0)      0.0000 (1.0)           0;0  0.0515 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     19.6221 (1.01)     19.6221 (1.01)     19.6221 (1.01)     0.0000 (1.0)      19.6221 (1.01)     0.0000 (1.0)           0;0  0.0510 (0.99)          1           1
test_data_status_all_flags-data-changed-noop[main]       19.8569 (1.02)     19.8569 (1.02)     19.8569 (1.02)     0.0000 (1.0)      19.8569 (1.02)     0.0000 (1.0)           0;0  0.0504 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     35.0780 (1.0)      35.0780 (1.0)      35.0780 (1.0)      0.0000 (1.0)      35.0780 (1.0)      0.0000 (1.0)           0;0  0.0285 (1.0)           1           1
test_data_status_all_flags-data-new[3.10.0]     36.4378 (1.04)     36.4378 (1.04)     36.4378 (1.04)     0.0000 (1.0)      36.4378 (1.04)     0.0000 (1.0)           0;0  0.0274 (0.96)          1           1
test_data_status_all_flags-data-new[main]       36.4939 (1.04)     36.4939 (1.04)     36.4939 (1.04)     0.0000 (1.0)      36.4939 (1.04)     0.0000 (1.0)           0;0  0.0274 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.3168 (1.0)      18.3168 (1.0)      18.3168 (1.0)      0.0000 (1.0)      18.3168 (1.0)      0.0000 (1.0)           0;0  0.0546 (1.0)           1           1
test_data_status_all_flags-data-noop[3.10.0]     18.8641 (1.03)     18.8641 (1.03)     18.8641 (1.03)     0.0000 (1.0)      18.8641 (1.03)     0.0000 (1.0)           0;0  0.0530 (0.97)          1           1
test_data_status_all_flags-data-noop[main]       18.8726 (1.03)     18.8726 (1.03)     18.8726 (1.03)     0.0000 (1.0)      18.8726 (1.03)     0.0000 (1.0)           0;0  0.0530 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.3067 (1.0)      20.3067 (1.0)      20.3067 (1.0)      0.0000 (1.0)      20.3067 (1.0)      0.0000 (1.0)           0;0  0.0492 (1.0)           1           1
test_diff-diff[3.10.0]     20.8902 (1.03)     20.8902 (1.03)     20.8902 (1.03)     0.0000 (1.0)      20.8902 (1.03)     0.0000 (1.0)           0;0  0.0479 (0.97)          1           1
test_diff-diff[main]       23.5267 (1.16)     23.5267 (1.16)     23.5267 (1.16)     0.0000 (1.0)      23.5267 (1.16)     0.0000 (1.0)           0;0  0.0425 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.5484 (1.16)     7.5484 (1.16)     7.5484 (1.16)     0.0000 (1.0)      7.5484 (1.16)     0.0000 (1.0)           0;0  0.1325 (0.86)          1           1
test_diff-diff-changed[3.10.0]     7.9495 (1.22)     7.9495 (1.22)     7.9495 (1.22)     0.0000 (1.0)      7.9495 (1.22)     0.0000 (1.0)           0;0  0.1258 (0.82)          1           1
test_diff-diff-changed[main]       6.5109 (1.0)      6.5109 (1.0)      6.5109 (1.0)      0.0000 (1.0)      6.5109 (1.0)      0.0000 (1.0)           0;0  0.1536 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.3344 (1.0)      6.3344 (1.0)      6.3344 (1.0)      0.0000 (1.0)      6.3344 (1.0)      0.0000 (1.0)           0;0  0.1579 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     6.9034 (1.09)     6.9034 (1.09)     6.9034 (1.09)     0.0000 (1.0)      6.9034 (1.09)     0.0000 (1.0)           0;0  0.1449 (0.92)          1           1
test_diff-diff-changed-noop[main]       6.3974 (1.01)     6.3974 (1.01)     6.3974 (1.01)     0.0000 (1.0)      6.3974 (1.01)     0.0000 (1.0)           0;0  0.1563 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     5.0559 (1.0)      5.0559 (1.0)      5.0559 (1.0)      0.0000 (1.0)      5.0559 (1.0)      0.0000 (1.0)           0;0  0.1978 (1.0)           1           1
test_diff-diff-noop[3.10.0]     5.5662 (1.10)     5.5662 (1.10)     5.5662 (1.10)     0.0000 (1.0)      5.5662 (1.10)     0.0000 (1.0)           0;0  0.1797 (0.91)          1           1
test_diff-diff-noop[main]       6.4605 (1.28)     6.4605 (1.28)     6.4605 (1.28)     0.0000 (1.0)      6.4605 (1.28)     0.0000 (1.0)           0;0  0.1548 (0.78)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       916.2958 (1.0)        916.2958 (1.0)        916.2958 (1.0)      0.0000 (1.0)        916.2958 (1.0)      0.0000 (1.0)           0;0  1.0914 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,411.9893 (4.82)     4,411.9893 (4.82)     4,411.9893 (4.82)     0.0000 (1.0)      4,411.9893 (4.82)     0.0000 (1.0)           0;0  0.2267 (0.21)          1           1
test_exp_show-exp[main]       3,655.5433 (3.99)     3,655.5433 (3.99)     3,655.5433 (3.99)     0.0000 (1.0)      3,655.5433 (3.99)     0.0000 (1.0)           0;0  0.2736 (0.25)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     111.8831 (2.75)     111.8831 (2.75)     111.8831 (2.75)     0.0000 (1.0)      111.8831 (2.75)     0.0000 (1.0)           0;0  0.0089 (0.36)          1           1
test_fetch-fetch[3.10.0]     118.3552 (2.91)     118.3552 (2.91)     118.3552 (2.91)     0.0000 (1.0)      118.3552 (2.91)     0.0000 (1.0)           0;0  0.0084 (0.34)          1           1
test_fetch-fetch[main]        40.7093 (1.0)       40.7093 (1.0)       40.7093 (1.0)      0.0000 (1.0)       40.7093 (1.0)      0.0000 (1.0)           0;0  0.0246 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.3070 (1.02)     3.3070 (1.02)     3.3070 (1.02)     0.0000 (1.0)      3.3070 (1.02)     0.0000 (1.0)           0;0  0.3024 (0.98)          1           1
test_gc-gc[3.10.0]     3.2384 (1.0)      3.2384 (1.0)      3.2384 (1.0)      0.0000 (1.0)      3.2384 (1.0)      0.0000 (1.0)           0;0  0.3088 (1.0)           1           1
test_gc-gc[main]       3.2807 (1.01)     3.2807 (1.01)     3.2807 (1.01)     0.0000 (1.0)      3.2807 (1.01)     0.0000 (1.0)           0;0  0.3048 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     186.8484 (1.12)     186.8484 (1.12)     186.8484 (1.12)     0.0000 (1.0)      186.8484 (1.12)     0.0000 (1.0)           0;0  0.0054 (0.90)          1           1
test_get-get[3.10.0]     225.1459 (1.34)     225.1459 (1.34)     225.1459 (1.34)     0.0000 (1.0)      225.1459 (1.34)     0.0000 (1.0)           0;0  0.0044 (0.74)          1           1
test_get-get[main]       167.5570 (1.0)      167.5570 (1.0)      167.5570 (1.0)      0.0000 (1.0)      167.5570 (1.0)      0.0000 (1.0)           0;0  0.0060 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     87.4717 (5.19)     87.4717 (5.19)     87.4717 (5.19)     0.0000 (1.0)      87.4717 (5.19)     0.0000 (1.0)           0;0  0.0114 (0.19)          1           1
test_get_url-get-url[3.10.0]     89.9584 (5.33)     89.9584 (5.33)     89.9584 (5.33)     0.0000 (1.0)      89.9584 (5.33)     0.0000 (1.0)           0;0  0.0111 (0.19)          1           1
test_get_url-get-url[main]       16.8626 (1.0)      16.8626 (1.0)      16.8626 (1.0)      0.0000 (1.0)      16.8626 (1.0)      0.0000 (1.0)           0;0  0.0593 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     124.8616 (1.02)     152.7520 (1.10)     127.2758 (1.01)     3.1640 (1.91)     126.4165 (1.01)     1.7935 (1.71)          9;9  7.8570 (0.99)        100           1
test_help---help[3.10.0]     122.5596 (1.0)      139.5820 (1.01)     126.5177 (1.01)     3.4803 (2.11)     124.7934 (1.0)      5.8863 (5.62)         23;1  7.9040 (0.99)        100           1
test_help---help[main]       123.7274 (1.01)     138.7730 (1.0)      125.7599 (1.0)      1.6530 (1.0)      125.4472 (1.01)     1.0479 (1.0)           5;4  7.9517 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     289.1425 (1.11)     289.1425 (1.11)     289.1425 (1.11)     0.0000 (1.0)      289.1425 (1.11)     0.0000 (1.0)           0;0  0.0035 (0.90)          1           1
test_import-import[3.10.0]     323.3804 (1.24)     323.3804 (1.24)     323.3804 (1.24)     0.0000 (1.0)      323.3804 (1.24)     0.0000 (1.0)           0;0  0.0031 (0.81)          1           1
test_import-import[main]       261.6300 (1.0)      261.6300 (1.0)      261.6300 (1.0)      0.0000 (1.0)      261.6300 (1.0)      0.0000 (1.0)           0;0  0.0038 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     207.8855 (1.51)     207.8855 (1.51)     207.8855 (1.51)     0.0000 (1.0)      207.8855 (1.51)     0.0000 (1.0)           0;0  0.0048 (0.66)          1           1
test_import_url-import-url[3.10.0]     213.4937 (1.55)     213.4937 (1.55)     213.4937 (1.55)     0.0000 (1.0)      213.4937 (1.55)     0.0000 (1.0)           0;0  0.0047 (0.64)          1           1
test_import_url-import-url[main]       137.3049 (1.0)      137.3049 (1.0)      137.3049 (1.0)      0.0000 (1.0)      137.3049 (1.0)      0.0000 (1.0)           0;0  0.0073 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     381.7244 (1.02)     405.3294 (1.0)      392.7675 (1.03)     4.7798 (1.0)      392.8657 (1.03)      7.4104 (1.21)         32;0  2.5460 (0.97)        100           1
test_init-init[3.10.0]     373.2184 (1.0)      409.7216 (1.01)     389.9857 (1.02)     9.5142 (1.99)     390.0686 (1.03)     15.6157 (2.55)         42;0  2.5642 (0.98)        100           1
test_init-init[main]       373.8404 (1.00)     420.7583 (1.04)     381.6270 (1.0)      6.9770 (1.46)     379.8998 (1.0)       6.1312 (1.0)          16;6  2.6204 (1.0)         100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     426.7919 (1.13)     426.7919 (1.13)     426.7919 (1.13)     0.0000 (1.0)      426.7919 (1.13)     0.0000 (1.0)           0;0  2.3431 (0.88)          1           1
test_list-list[3.10.0]     397.9116 (1.06)     397.9116 (1.06)     397.9116 (1.06)     0.0000 (1.0)      397.9116 (1.06)     0.0000 (1.0)           0;0  2.5131 (0.95)          1           1
test_list-list[main]       376.3339 (1.0)      376.3339 (1.0)      376.3339 (1.0)      0.0000 (1.0)      376.3339 (1.0)      0.0000 (1.0)           0;0  2.6572 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     404.8564 (1.09)     404.8564 (1.09)     404.8564 (1.09)     0.0000 (1.0)      404.8564 (1.09)     0.0000 (1.0)           0;0  2.4700 (0.92)          1           1
test_list-list-dvc-only[3.10.0]     393.7781 (1.06)     393.7781 (1.06)     393.7781 (1.06)     0.0000 (1.0)      393.7781 (1.06)     0.0000 (1.0)           0;0  2.5395 (0.94)          1           1
test_list-list-dvc-only[main]       371.6909 (1.0)      371.6909 (1.0)      371.6909 (1.0)      0.0000 (1.0)      371.6909 (1.0)      0.0000 (1.0)           0;0  2.6904 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.2924 (1.03)     3.2924 (1.03)     3.2924 (1.03)     0.0000 (1.0)      3.2924 (1.03)     0.0000 (1.0)           0;0  0.3037 (0.97)          1           1
test_list-list-recursive[3.10.0]     3.2056 (1.0)      3.2056 (1.0)      3.2056 (1.0)      0.0000 (1.0)      3.2056 (1.0)      0.0000 (1.0)           0;0  0.3120 (1.0)           1           1
test_list-list-recursive[main]       3.2257 (1.01)     3.2257 (1.01)     3.2257 (1.01)     0.0000 (1.0)      3.2257 (1.01)     0.0000 (1.0)           0;0  0.3100 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     406.2966 (1.08)     406.2966 (1.08)     406.2966 (1.08)     0.0000 (1.0)      406.2966 (1.08)     0.0000 (1.0)           0;0  2.4613 (0.92)          1           1
test_list-list-shallow[3.10.0]     381.6191 (1.02)     381.6191 (1.02)     381.6191 (1.02)     0.0000 (1.0)      381.6191 (1.02)     0.0000 (1.0)           0;0  2.6204 (0.98)          1           1
test_list-list-shallow[main]       374.8083 (1.0)      374.8083 (1.0)      374.8083 (1.0)      0.0000 (1.0)      374.8083 (1.0)      0.0000 (1.0)           0;0  2.6680 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     81.1946 (1.04)     81.1946 (1.04)     81.1946 (1.04)     0.0000 (1.0)      81.1946 (1.04)     0.0000 (1.0)           0;0  0.0123 (0.96)          1           1
test_partial_add-add[3.10.0]     83.2331 (1.07)     83.2331 (1.07)     83.2331 (1.07)     0.0000 (1.0)      83.2331 (1.07)     0.0000 (1.0)           0;0  0.0120 (0.93)          1           1
test_partial_add-add[main]       77.7977 (1.0)      77.7977 (1.0)      77.7977 (1.0)      0.0000 (1.0)      77.7977 (1.0)      0.0000 (1.0)           0;0  0.0129 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     69.2479 (1.08)     69.2479 (1.08)     69.2479 (1.08)     0.0000 (1.0)      69.2479 (1.08)     0.0000 (1.0)           0;0  0.0144 (0.93)          1           1
test_partial_add-add-partial[3.10.0]     68.0880 (1.06)     68.0880 (1.06)     68.0880 (1.06)     0.0000 (1.0)      68.0880 (1.06)     0.0000 (1.0)           0;0  0.0147 (0.94)          1           1
test_partial_add-add-partial[main]       64.1937 (1.0)      64.1937 (1.0)      64.1937 (1.0)      0.0000 (1.0)      64.1937 (1.0)      0.0000 (1.0)           0;0  0.0156 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.5346 (1.0)      6.5346 (1.0)      6.5346 (1.0)      0.0000 (1.0)      6.5346 (1.0)      0.0000 (1.0)           0;0  0.1530 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     8.5473 (1.31)     8.5473 (1.31)     8.5473 (1.31)     0.0000 (1.0)      8.5473 (1.31)     0.0000 (1.0)           0;0  0.1170 (0.76)          1           1
test_partial_add-gc-cloud-noop[main]       9.7601 (1.49)     9.7601 (1.49)     9.7601 (1.49)     0.0000 (1.0)      9.7601 (1.49)     0.0000 (1.0)           0;0  0.1025 (0.67)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.6775 (1.0)      3.6775 (1.0)      3.6775 (1.0)      0.0000 (1.0)      3.6775 (1.0)      0.0000 (1.0)           0;0  0.2719 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     5.6242 (1.53)     5.6242 (1.53)     5.6242 (1.53)     0.0000 (1.0)      5.6242 (1.53)     0.0000 (1.0)           0;0  0.1778 (0.65)          1           1
test_partial_add-gc-noop[main]       5.6328 (1.53)     5.6328 (1.53)     5.6328 (1.53)     0.0000 (1.0)      5.6328 (1.53)     0.0000 (1.0)           0;0  0.1775 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     81.2149 (3.84)     81.2149 (3.84)     81.2149 (3.84)     0.0000 (1.0)      81.2149 (3.84)     0.0000 (1.0)           0;0  0.0123 (0.26)          1           1
test_partial_add-push[3.10.0]     40.9015 (1.94)     40.9015 (1.94)     40.9015 (1.94)     0.0000 (1.0)      40.9015 (1.94)     0.0000 (1.0)           0;0  0.0244 (0.52)          1           1
test_partial_add-push[main]       21.1339 (1.0)      21.1339 (1.0)      21.1339 (1.0)      0.0000 (1.0)      21.1339 (1.0)      0.0000 (1.0)           0;0  0.0473 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     18.2754 (1.63)     18.2754 (1.63)     18.2754 (1.63)     0.0000 (1.0)      18.2754 (1.63)     0.0000 (1.0)           0;0  0.0547 (0.62)          1           1
test_partial_add-push-partial[3.10.0]     11.2402 (1.0)      11.2402 (1.0)      11.2402 (1.0)      0.0000 (1.0)      11.2402 (1.0)      0.0000 (1.0)           0;0  0.0890 (1.0)           1           1
test_partial_add-push-partial[main]       11.8055 (1.05)     11.8055 (1.05)     11.8055 (1.05)     0.0000 (1.0)      11.8055 (1.05)     0.0000 (1.0)           0;0  0.0847 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     98.9401 (1.03)     98.9401 (1.03)     98.9401 (1.03)     0.0000 (1.0)      98.9401 (1.03)     0.0000 (1.0)           0;0  0.0101 (0.97)          1           1
test_partial_remove-add[3.10.0]     98.7888 (1.03)     98.7888 (1.03)     98.7888 (1.03)     0.0000 (1.0)      98.7888 (1.03)     0.0000 (1.0)           0;0  0.0101 (0.97)          1           1
test_partial_remove-add[main]       96.0045 (1.0)      96.0045 (1.0)      96.0045 (1.0)      0.0000 (1.0)      96.0045 (1.0)      0.0000 (1.0)           0;0  0.0104 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]      9.4353 (1.02)      9.4353 (1.02)      9.4353 (1.02)     0.0000 (1.0)       9.4353 (1.02)     0.0000 (1.0)           0;0  0.1060 (0.98)          1           1
test_partial_remove-add-update[3.10.0]     10.1140 (1.09)     10.1140 (1.09)     10.1140 (1.09)     0.0000 (1.0)      10.1140 (1.09)     0.0000 (1.0)           0;0  0.0989 (0.92)          1           1
test_partial_remove-add-update[main]        9.2597 (1.0)       9.2597 (1.0)       9.2597 (1.0)      0.0000 (1.0)       9.2597 (1.0)      0.0000 (1.0)           0;0  0.1080 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     4.1192 (1.0)      4.1192 (1.0)      4.1192 (1.0)      0.0000 (1.0)      4.1192 (1.0)      0.0000 (1.0)           0;0  0.2428 (1.0)           1           1
test_partial_remove-gc[3.10.0]     4.9613 (1.20)     4.9613 (1.20)     4.9613 (1.20)     0.0000 (1.0)      4.9613 (1.20)     0.0000 (1.0)           0;0  0.2016 (0.83)          1           1
test_partial_remove-gc[main]       4.9487 (1.20)     4.9487 (1.20)     4.9487 (1.20)     0.0000 (1.0)      4.9487 (1.20)     0.0000 (1.0)           0;0  0.2021 (0.83)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.1158 (1.0)      6.1158 (1.0)      6.1158 (1.0)      0.0000 (1.0)      6.1158 (1.0)      0.0000 (1.0)           0;0  0.1635 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     6.6234 (1.08)     6.6234 (1.08)     6.6234 (1.08)     0.0000 (1.0)      6.6234 (1.08)     0.0000 (1.0)           0;0  0.1510 (0.92)          1           1
test_partial_remove-gc-cloud[main]       6.3823 (1.04)     6.3823 (1.04)     6.3823 (1.04)     0.0000 (1.0)      6.3823 (1.04)     0.0000 (1.0)           0;0  0.1567 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     97.9299 (3.82)     97.9299 (3.82)     97.9299 (3.82)     0.0000 (1.0)      97.9299 (3.82)     0.0000 (1.0)           0;0  0.0102 (0.26)          1           1
test_partial_remove-push[3.10.0]     48.2501 (1.88)     48.2501 (1.88)     48.2501 (1.88)     0.0000 (1.0)      48.2501 (1.88)     0.0000 (1.0)           0;0  0.0207 (0.53)          1           1
test_partial_remove-push[main]       25.6427 (1.0)      25.6427 (1.0)      25.6427 (1.0)      0.0000 (1.0)      25.6427 (1.0)      0.0000 (1.0)           0;0  0.0390 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     2.0359 (1.0)      2.0359 (1.0)      2.0359 (1.0)      0.0000 (1.0)      2.0359 (1.0)      0.0000 (1.0)           0;0  0.4912 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     2.0465 (1.01)     2.0465 (1.01)     2.0465 (1.01)     0.0000 (1.0)      2.0465 (1.01)     0.0000 (1.0)           0;0  0.4886 (0.99)          1           1
test_partial_remove-push-update[main]       2.8751 (1.41)     2.8751 (1.41)     2.8751 (1.41)     0.0000 (1.0)      2.8751 (1.41)     0.0000 (1.0)           0;0  0.3478 (0.71)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     420.0149 (1.0)      426.8630 (1.0)      422.8128 (1.0)      2.5069 (1.0)      422.4524 (1.0)      2.3640 (1.0)           2;0  2.3651 (1.0)           5           3
test_plots-plots-diff[3.10.0]     817.3757 (1.95)     833.6362 (1.95)     828.1401 (1.96)     6.3170 (2.52)     830.6939 (1.97)     6.0012 (2.54)          1;0  1.2075 (0.51)          5           3
test_plots-plots-diff[main]       784.5993 (1.87)     799.1503 (1.87)     791.8527 (1.87)     5.2112 (2.08)     792.1355 (1.88)     5.3569 (2.27)          2;0  1.2629 (0.53)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       435.9083 (1.0)        476.6561 (1.0)        456.5604 (1.0)      14.6665 (3.21)       456.0799 (1.0)      15.9292 (2.01)          2;0  2.1903 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,091.3903 (2.50)     1,102.8161 (2.31)     1,096.1080 (2.40)      4.9545 (1.08)     1,093.2954 (2.40)      7.9082 (1.0)           1;0  0.9123 (0.42)          5           3
test_plots-plots-diff-json[main]         870.7487 (2.00)       880.1617 (1.85)       875.6411 (1.92)      4.5729 (1.0)        877.2375 (1.92)      8.7152 (1.10)          2;0  1.1420 (0.52)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     392.9355 (1.0)      402.9854 (1.0)      399.9463 (1.0)      4.1399 (1.62)     401.3739 (1.0)      4.8590 (1.24)          1;0  2.5003 (1.0)           5           3
test_plots-plots-show[3.10.0]     688.6733 (1.75)     695.0791 (1.72)     692.3138 (1.73)     2.5568 (1.0)      692.9341 (1.73)     3.9329 (1.0)           2;0  1.4444 (0.58)          5           3
test_plots-plots-show[main]       662.1712 (1.69)     669.3813 (1.66)     665.2666 (1.66)     2.9858 (1.17)     665.1623 (1.66)     4.9342 (1.25)          2;0  1.5032 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     428.4528 (1.0)      441.4371 (1.0)      435.8101 (1.0)      5.2877 (1.97)     434.6088 (1.0)      8.0253 (2.67)          2;0  2.2946 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     837.9836 (1.96)     844.7168 (1.91)     842.5009 (1.93)     2.6853 (1.0)      843.6492 (1.94)     3.0013 (1.0)           1;0  1.1869 (0.52)          5           3
test_plots-plots-show-json[main]       712.7284 (1.66)     728.0241 (1.65)     719.7259 (1.65)     5.8545 (2.18)     719.1593 (1.65)     8.4088 (2.80)          2;0  1.3894 (0.61)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     93.7377 (3.79)     93.7377 (3.79)     93.7377 (3.79)     0.0000 (1.0)      93.7377 (3.79)     0.0000 (1.0)           0;0  0.0107 (0.26)          1           1
test_push-push[3.10.0]     51.3119 (2.07)     51.3119 (2.07)     51.3119 (2.07)     0.0000 (1.0)      51.3119 (2.07)     0.0000 (1.0)           0;0  0.0195 (0.48)          1           1
test_push-push[main]       24.7552 (1.0)      24.7552 (1.0)      24.7552 (1.0)      0.0000 (1.0)      24.7552 (1.0)      0.0000 (1.0)           0;0  0.0404 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     97.2260 (1.03)     97.2260 (1.03)     97.2260 (1.03)     0.0000 (1.0)      97.2260 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing-add[3.10.0]     98.0011 (1.04)     98.0011 (1.04)     98.0011 (1.04)     0.0000 (1.0)      98.0011 (1.04)     0.0000 (1.0)           0;0  0.0102 (0.96)          1           1
test_sharing-add[main]       94.3791 (1.0)      94.3791 (1.0)      94.3791 (1.0)      0.0000 (1.0)      94.3791 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     64.1063 (1.06)     64.1063 (1.06)     64.1063 (1.06)     0.0000 (1.0)      64.1063 (1.06)     0.0000 (1.0)           0;0  0.0156 (0.94)          1           1
test_sharing-add-noop[3.10.0]     64.5744 (1.07)     64.5744 (1.07)     64.5744 (1.07)     0.0000 (1.0)      64.5744 (1.07)     0.0000 (1.0)           0;0  0.0155 (0.93)          1           1
test_sharing-add-noop[main]       60.3696 (1.0)      60.3696 (1.0)      60.3696 (1.0)      0.0000 (1.0)      60.3696 (1.0)      0.0000 (1.0)           0;0  0.0166 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]      43.5747 (1.45)      43.5747 (1.45)      43.5747 (1.45)     0.0000 (1.0)       43.5747 (1.45)     0.0000 (1.0)           0;0  0.0229 (0.69)          1           1
test_sharing-checkout[3.10.0]     106.2355 (3.53)     106.2355 (3.53)     106.2355 (3.53)     0.0000 (1.0)      106.2355 (3.53)     0.0000 (1.0)           0;0  0.0094 (0.28)          1           1
test_sharing-checkout[main]        30.1313 (1.0)       30.1313 (1.0)       30.1313 (1.0)      0.0000 (1.0)       30.1313 (1.0)      0.0000 (1.0)           0;0  0.0332 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6954 (1.0)      6.6954 (1.0)      6.6954 (1.0)      0.0000 (1.0)      6.6954 (1.0)      0.0000 (1.0)           0;0  0.1494 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     6.9574 (1.04)     6.9574 (1.04)     6.9574 (1.04)     0.0000 (1.0)      6.9574 (1.04)     0.0000 (1.0)           0;0  0.1437 (0.96)          1           1
test_sharing-checkout-noop[main]       6.6988 (1.00)     6.6988 (1.00)     6.6988 (1.00)     0.0000 (1.0)      6.6988 (1.00)     0.0000 (1.0)           0;0  0.1493 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     112.7812 (2.69)     112.7812 (2.69)     112.7812 (2.69)     0.0000 (1.0)      112.7812 (2.69)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing-fetch[3.10.0]     120.2954 (2.87)     120.2954 (2.87)     120.2954 (2.87)     0.0000 (1.0)      120.2954 (2.87)     0.0000 (1.0)           0;0  0.0083 (0.35)          1           1
test_sharing-fetch[main]        41.8572 (1.0)       41.8572 (1.0)       41.8572 (1.0)      0.0000 (1.0)       41.8572 (1.0)      0.0000 (1.0)           0;0  0.0239 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4412 (1.0)      1.4412 (1.0)      1.4412 (1.0)      0.0000 (1.0)      1.4412 (1.0)      0.0000 (1.0)           0;0  0.6939 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     3.9280 (2.73)     3.9280 (2.73)     3.9280 (2.73)     0.0000 (1.0)      3.9280 (2.73)     0.0000 (1.0)           0;0  0.2546 (0.37)          1           1
test_sharing-fetch-noop[main]       7.0103 (4.86)     7.0103 (4.86)     7.0103 (4.86)     0.0000 (1.0)      7.0103 (4.86)     0.0000 (1.0)           0;0  0.1426 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     96.7557 (3.74)     96.7557 (3.74)     96.7557 (3.74)     0.0000 (1.0)      96.7557 (3.74)     0.0000 (1.0)           0;0  0.0103 (0.27)          1           1
test_sharing-push[3.10.0]     49.0273 (1.90)     49.0273 (1.90)     49.0273 (1.90)     0.0000 (1.0)      49.0273 (1.90)     0.0000 (1.0)           0;0  0.0204 (0.53)          1           1
test_sharing-push[main]       25.8651 (1.0)      25.8651 (1.0)      25.8651 (1.0)      0.0000 (1.0)      25.8651 (1.0)      0.0000 (1.0)           0;0  0.0387 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.5690 (1.0)      2.5690 (1.0)      2.5690 (1.0)      0.0000 (1.0)      2.5690 (1.0)      0.0000 (1.0)           0;0  0.3893 (1.0)           1           1
test_sharing-push-noop[3.10.0]     2.6159 (1.02)     2.6159 (1.02)     2.6159 (1.02)     0.0000 (1.0)      2.6159 (1.02)     0.0000 (1.0)           0;0  0.3823 (0.98)          1           1
test_sharing-push-noop[main]       7.5624 (2.94)     7.5624 (2.94)     7.5624 (2.94)     0.0000 (1.0)      7.5624 (2.94)     0.0000 (1.0)           0;0  0.1322 (0.34)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     94.1146 (1.02)     94.1146 (1.02)     94.1146 (1.02)     0.0000 (1.0)      94.1146 (1.02)     0.0000 (1.0)           0;0  0.0106 (0.98)          1           1
test_sharing_azure-add[3.10.0]     95.7943 (1.04)     95.7943 (1.04)     95.7943 (1.04)     0.0000 (1.0)      95.7943 (1.04)     0.0000 (1.0)           0;0  0.0104 (0.96)          1           1
test_sharing_azure-add[main]       91.9431 (1.0)      91.9431 (1.0)      91.9431 (1.0)      0.0000 (1.0)      91.9431 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     62.3976 (1.05)     62.3976 (1.05)     62.3976 (1.05)     0.0000 (1.0)      62.3976 (1.05)     0.0000 (1.0)           0;0  0.0160 (0.95)          1           1
test_sharing_azure-add-noop[3.10.0]     62.8375 (1.06)     62.8375 (1.06)     62.8375 (1.06)     0.0000 (1.0)      62.8375 (1.06)     0.0000 (1.0)           0;0  0.0159 (0.94)          1           1
test_sharing_azure-add-noop[main]       59.2280 (1.0)      59.2280 (1.0)      59.2280 (1.0)      0.0000 (1.0)      59.2280 (1.0)      0.0000 (1.0)           0;0  0.0169 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]      42.7875 (1.44)      42.7875 (1.44)      42.7875 (1.44)     0.0000 (1.0)       42.7875 (1.44)     0.0000 (1.0)           0;0  0.0234 (0.69)          1           1
test_sharing_azure-checkout[3.10.0]     103.8433 (3.50)     103.8433 (3.50)     103.8433 (3.50)     0.0000 (1.0)      103.8433 (3.50)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing_azure-checkout[main]        29.7032 (1.0)       29.7032 (1.0)       29.7032 (1.0)      0.0000 (1.0)       29.7032 (1.0)      0.0000 (1.0)           0;0  0.0337 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.6397 (1.02)     6.6397 (1.02)     6.6397 (1.02)     0.0000 (1.0)      6.6397 (1.02)     0.0000 (1.0)           0;0  0.1506 (0.98)          1           1
test_sharing_azure-checkout-noop[3.10.0]     6.8485 (1.05)     6.8485 (1.05)     6.8485 (1.05)     0.0000 (1.0)      6.8485 (1.05)     0.0000 (1.0)           0;0  0.1460 (0.95)          1           1
test_sharing_azure-checkout-noop[main]       6.5047 (1.0)      6.5047 (1.0)      6.5047 (1.0)      0.0000 (1.0)      6.5047 (1.0)      0.0000 (1.0)           0;0  0.1537 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     110.6385 (2.75)     110.6385 (2.75)     110.6385 (2.75)     0.0000 (1.0)      110.6385 (2.75)     0.0000 (1.0)           0;0  0.0090 (0.36)          1           1
test_sharing_azure-fetch[3.10.0]     117.0122 (2.91)     117.0122 (2.91)     117.0122 (2.91)     0.0000 (1.0)      117.0122 (2.91)     0.0000 (1.0)           0;0  0.0085 (0.34)          1           1
test_sharing_azure-fetch[main]        40.2619 (1.0)       40.2619 (1.0)       40.2619 (1.0)      0.0000 (1.0)       40.2619 (1.0)      0.0000 (1.0)           0;0  0.0248 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4077 (1.0)      1.4077 (1.0)      1.4077 (1.0)      0.0000 (1.0)      1.4077 (1.0)      0.0000 (1.0)           0;0  0.7104 (1.0)           1           1
test_sharing_azure-fetch-noop[3.10.0]     3.8227 (2.72)     3.8227 (2.72)     3.8227 (2.72)     0.0000 (1.0)      3.8227 (2.72)     0.0000 (1.0)           0;0  0.2616 (0.37)          1           1
test_sharing_azure-fetch-noop[main]       6.8438 (4.86)     6.8438 (4.86)     6.8438 (4.86)     0.0000 (1.0)      6.8438 (4.86)     0.0000 (1.0)           0;0  0.1461 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     94.9882 (3.78)     94.9882 (3.78)     94.9882 (3.78)     0.0000 (1.0)      94.9882 (3.78)     0.0000 (1.0)           0;0  0.0105 (0.26)          1           1
test_sharing_azure-push[3.10.0]     48.7675 (1.94)     48.7675 (1.94)     48.7675 (1.94)     0.0000 (1.0)      48.7675 (1.94)     0.0000 (1.0)           0;0  0.0205 (0.52)          1           1
test_sharing_azure-push[main]       25.1552 (1.0)      25.1552 (1.0)      25.1552 (1.0)      0.0000 (1.0)      25.1552 (1.0)      0.0000 (1.0)           0;0  0.0398 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5484 (1.00)     2.5484 (1.00)     2.5484 (1.00)     0.0000 (1.0)      2.5484 (1.00)     0.0000 (1.0)           0;0  0.3924 (1.00)          1           1
test_sharing_azure-push-noop[3.10.0]     2.5466 (1.0)      2.5466 (1.0)      2.5466 (1.0)      0.0000 (1.0)      2.5466 (1.0)      0.0000 (1.0)           0;0  0.3927 (1.0)           1           1
test_sharing_azure-push-noop[main]       7.3364 (2.88)     7.3364 (2.88)     7.3364 (2.88)     0.0000 (1.0)      7.3364 (2.88)     0.0000 (1.0)           0;0  0.1363 (0.35)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     94.7802 (1.03)     94.7802 (1.03)     94.7802 (1.03)     0.0000 (1.0)      94.7802 (1.03)     0.0000 (1.0)           0;0  0.0106 (0.97)          1           1
test_sharing_gs-add[3.10.0]     94.6563 (1.03)     94.6563 (1.03)     94.6563 (1.03)     0.0000 (1.0)      94.6563 (1.03)     0.0000 (1.0)           0;0  0.0106 (0.97)          1           1
test_sharing_gs-add[main]       91.8697 (1.0)      91.8697 (1.0)      91.8697 (1.0)      0.0000 (1.0)      91.8697 (1.0)      0.0000 (1.0)           0;0  0.0109 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     62.1092 (1.0)      62.1092 (1.0)      62.1092 (1.0)      0.0000 (1.0)      62.1092 (1.0)      0.0000 (1.0)           0;0  0.0161 (1.0)           1           1
test_sharing_gs-add-noop[3.10.0]     62.9556 (1.01)     62.9556 (1.01)     62.9556 (1.01)     0.0000 (1.0)      62.9556 (1.01)     0.0000 (1.0)           0;0  0.0159 (0.99)          1           1
test_sharing_gs-add-noop[main]       63.3148 (1.02)     63.3148 (1.02)     63.3148 (1.02)     0.0000 (1.0)      63.3148 (1.02)     0.0000 (1.0)           0;0  0.0158 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]      42.1367 (1.43)      42.1367 (1.43)      42.1367 (1.43)     0.0000 (1.0)       42.1367 (1.43)     0.0000 (1.0)           0;0  0.0237 (0.70)          1           1
test_sharing_gs-checkout[3.10.0]     103.2336 (3.50)     103.2336 (3.50)     103.2336 (3.50)     0.0000 (1.0)      103.2336 (3.50)     0.0000 (1.0)           0;0  0.0097 (0.29)          1           1
test_sharing_gs-checkout[main]        29.4853 (1.0)       29.4853 (1.0)       29.4853 (1.0)      0.0000 (1.0)       29.4853 (1.0)      0.0000 (1.0)           0;0  0.0339 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.5406 (1.0)      6.5406 (1.0)      6.5406 (1.0)      0.0000 (1.0)      6.5406 (1.0)      0.0000 (1.0)           0;0  0.1529 (1.0)           1           1
test_sharing_gs-checkout-noop[3.10.0]     6.6815 (1.02)     6.6815 (1.02)     6.6815 (1.02)     0.0000 (1.0)      6.6815 (1.02)     0.0000 (1.0)           0;0  0.1497 (0.98)          1           1
test_sharing_gs-checkout-noop[main]       6.6091 (1.01)     6.6091 (1.01)     6.6091 (1.01)     0.0000 (1.0)      6.6091 (1.01)     0.0000 (1.0)           0;0  0.1513 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     110.0767 (2.71)     110.0767 (2.71)     110.0767 (2.71)     0.0000 (1.0)      110.0767 (2.71)     0.0000 (1.0)           0;0  0.0091 (0.37)          1           1
test_sharing_gs-fetch[3.10.0]     122.3459 (3.01)     122.3459 (3.01)     122.3459 (3.01)     0.0000 (1.0)      122.3459 (3.01)     0.0000 (1.0)           0;0  0.0082 (0.33)          1           1
test_sharing_gs-fetch[main]        40.6871 (1.0)       40.6871 (1.0)       40.6871 (1.0)      0.0000 (1.0)       40.6871 (1.0)      0.0000 (1.0)           0;0  0.0246 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.3676 (1.0)      1.3676 (1.0)      1.3676 (1.0)      0.0000 (1.0)      1.3676 (1.0)      0.0000 (1.0)           0;0  0.7312 (1.0)           1           1
test_sharing_gs-fetch-noop[3.10.0]     4.2943 (3.14)     4.2943 (3.14)     4.2943 (3.14)     0.0000 (1.0)      4.2943 (3.14)     0.0000 (1.0)           0;0  0.2329 (0.32)          1           1
test_sharing_gs-fetch-noop[main]       6.9753 (5.10)     6.9753 (5.10)     6.9753 (5.10)     0.0000 (1.0)      6.9753 (5.10)     0.0000 (1.0)           0;0  0.1434 (0.20)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     94.8079 (3.73)     94.8079 (3.73)     94.8079 (3.73)     0.0000 (1.0)      94.8079 (3.73)     0.0000 (1.0)           0;0  0.0105 (0.27)          1           1
test_sharing_gs-push[3.10.0]     47.5051 (1.87)     47.5051 (1.87)     47.5051 (1.87)     0.0000 (1.0)      47.5051 (1.87)     0.0000 (1.0)           0;0  0.0211 (0.53)          1           1
test_sharing_gs-push[main]       25.4144 (1.0)      25.4144 (1.0)      25.4144 (1.0)      0.0000 (1.0)      25.4144 (1.0)      0.0000 (1.0)           0;0  0.0393 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.5004 (1.0)      2.5004 (1.0)      2.5004 (1.0)      0.0000 (1.0)      2.5004 (1.0)      0.0000 (1.0)           0;0  0.3999 (1.0)           1           1
test_sharing_gs-push-noop[3.10.0]     2.5057 (1.00)     2.5057 (1.00)     2.5057 (1.00)     0.0000 (1.0)      2.5057 (1.00)     0.0000 (1.0)           0;0  0.3991 (1.00)          1           1
test_sharing_gs-push-noop[main]       7.2325 (2.89)     7.2325 (2.89)     7.2325 (2.89)     0.0000 (1.0)      7.2325 (2.89)     0.0000 (1.0)           0;0  0.1383 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     95.7422 (1.02)     95.7422 (1.02)     95.7422 (1.02)     0.0000 (1.0)      95.7422 (1.02)     0.0000 (1.0)           0;0  0.0104 (0.98)          1           1
test_sharing_s3-add[3.10.0]     97.2951 (1.03)     97.2951 (1.03)     97.2951 (1.03)     0.0000 (1.0)      97.2951 (1.03)     0.0000 (1.0)           0;0  0.0103 (0.97)          1           1
test_sharing_s3-add[main]       94.2386 (1.0)      94.2386 (1.0)      94.2386 (1.0)      0.0000 (1.0)      94.2386 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     62.7809 (1.04)     62.7809 (1.04)     62.7809 (1.04)     0.0000 (1.0)      62.7809 (1.04)     0.0000 (1.0)           0;0  0.0159 (0.96)          1           1
test_sharing_s3-add-noop[3.10.0]     62.9459 (1.05)     62.9459 (1.05)     62.9459 (1.05)     0.0000 (1.0)      62.9459 (1.05)     0.0000 (1.0)           0;0  0.0159 (0.96)          1           1
test_sharing_s3-add-noop[main]       60.1520 (1.0)      60.1520 (1.0)      60.1520 (1.0)      0.0000 (1.0)      60.1520 (1.0)      0.0000 (1.0)           0;0  0.0166 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]      42.1084 (1.41)      42.1084 (1.41)      42.1084 (1.41)     0.0000 (1.0)       42.1084 (1.41)     0.0000 (1.0)           0;0  0.0237 (0.71)          1           1
test_sharing_s3-checkout[3.10.0]     103.9387 (3.49)     103.9387 (3.49)     103.9387 (3.49)     0.0000 (1.0)      103.9387 (3.49)     0.0000 (1.0)           0;0  0.0096 (0.29)          1           1
test_sharing_s3-checkout[main]        29.7846 (1.0)       29.7846 (1.0)       29.7846 (1.0)      0.0000 (1.0)       29.7846 (1.0)      0.0000 (1.0)           0;0  0.0336 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.4423 (1.0)      6.4423 (1.0)      6.4423 (1.0)      0.0000 (1.0)      6.4423 (1.0)      0.0000 (1.0)           0;0  0.1552 (1.0)           1           1
test_sharing_s3-checkout-noop[3.10.0]     6.9562 (1.08)     6.9562 (1.08)     6.9562 (1.08)     0.0000 (1.0)      6.9562 (1.08)     0.0000 (1.0)           0;0  0.1438 (0.93)          1           1
test_sharing_s3-checkout-noop[main]       6.4731 (1.00)     6.4731 (1.00)     6.4731 (1.00)     0.0000 (1.0)      6.4731 (1.00)     0.0000 (1.0)           0;0  0.1545 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     242.3496 (1.01)     242.3496 (1.01)     242.3496 (1.01)     0.0000 (1.0)      242.3496 (1.01)     0.0000 (1.0)           0;0  0.0041 (0.99)          1           1
test_sharing_s3-fetch[3.10.0]     254.0564 (1.06)     254.0564 (1.06)     254.0564 (1.06)     0.0000 (1.0)      254.0564 (1.06)     0.0000 (1.0)           0;0  0.0039 (0.95)          1           1
test_sharing_s3-fetch[main]       240.3200 (1.0)      240.3200 (1.0)      240.3200 (1.0)      0.0000 (1.0)      240.3200 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.5806 (1.0)      1.5806 (1.0)      1.5806 (1.0)      0.0000 (1.0)      1.5806 (1.0)      0.0000 (1.0)           0;0  0.6327 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     3.9765 (2.52)     3.9765 (2.52)     3.9765 (2.52)     0.0000 (1.0)      3.9765 (2.52)     0.0000 (1.0)           0;0  0.2515 (0.40)          1           1
test_sharing_s3-fetch-noop[main]       7.2815 (4.61)     7.2815 (4.61)     7.2815 (4.61)     0.0000 (1.0)      7.2815 (4.61)     0.0000 (1.0)           0;0  0.1373 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     250.3328 (1.16)     250.3328 (1.16)     250.3328 (1.16)     0.0000 (1.0)      250.3328 (1.16)     0.0000 (1.0)           0;0  0.0040 (0.86)          1           1
test_sharing_s3-push[3.10.0]     215.5729 (1.0)      215.5729 (1.0)      215.5729 (1.0)      0.0000 (1.0)      215.5729 (1.0)      0.0000 (1.0)           0;0  0.0046 (1.0)           1           1
test_sharing_s3-push[main]       248.9596 (1.15)     248.9596 (1.15)     248.9596 (1.15)     0.0000 (1.0)      248.9596 (1.15)     0.0000 (1.0)           0;0  0.0040 (0.87)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.7305 (1.0)      2.7305 (1.0)      2.7305 (1.0)      0.0000 (1.0)      2.7305 (1.0)      0.0000 (1.0)           0;0  0.3662 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]     2.7322 (1.00)     2.7322 (1.00)     2.7322 (1.00)     0.0000 (1.0)      2.7322 (1.00)     0.0000 (1.0)           0;0  0.3660 (1.00)          1           1
test_sharing_s3-push-noop[main]       7.3935 (2.71)     7.3935 (2.71)     7.3935 (2.71)     0.0000 (1.0)      7.3935 (2.71)     0.0000 (1.0)           0;0  0.1353 (0.37)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.7241 (1.0)      21.7241 (1.0)      21.7241 (1.0)      0.0000 (1.0)      21.7241 (1.0)      0.0000 (1.0)           0;0  0.0460 (1.0)           1           1
test_status-status[3.10.0]     21.7549 (1.00)     21.7549 (1.00)     21.7549 (1.00)     0.0000 (1.0)      21.7549 (1.00)     0.0000 (1.0)           0;0  0.0460 (1.00)          1           1
test_status-status[main]       21.9287 (1.01)     21.9287 (1.01)     21.9287 (1.01)     0.0000 (1.0)      21.9287 (1.01)     0.0000 (1.0)           0;0  0.0456 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.5547 (1.0)      5.5547 (1.0)      5.5547 (1.0)      0.0000 (1.0)      5.5547 (1.0)      0.0000 (1.0)           0;0  0.1800 (1.0)           1           1
test_status-status-changed[3.10.0]     5.8228 (1.05)     5.8228 (1.05)     5.8228 (1.05)     0.0000 (1.0)      5.8228 (1.05)     0.0000 (1.0)           0;0  0.1717 (0.95)          1           1
test_status-status-changed[main]       5.7209 (1.03)     5.7209 (1.03)     5.7209 (1.03)     0.0000 (1.0)      5.7209 (1.03)     0.0000 (1.0)           0;0  0.1748 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6048 (1.0)      5.6048 (1.0)      5.6048 (1.0)      0.0000 (1.0)      5.6048 (1.0)      0.0000 (1.0)           0;0  0.1784 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     5.8953 (1.05)     5.8953 (1.05)     5.8953 (1.05)     0.0000 (1.0)      5.8953 (1.05)     0.0000 (1.0)           0;0  0.1696 (0.95)          1           1
test_status-status-changed-noop[main]       5.6618 (1.01)     5.6618 (1.01)     5.6618 (1.01)     0.0000 (1.0)      5.6618 (1.01)     0.0000 (1.0)           0;0  0.1766 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.6101 (1.0)      5.6101 (1.0)      5.6101 (1.0)      0.0000 (1.0)      5.6101 (1.0)      0.0000 (1.0)           0;0  0.1783 (1.0)           1           1
test_status-status-noop[3.10.0]     5.8828 (1.05)     5.8828 (1.05)     5.8828 (1.05)     0.0000 (1.0)      5.8828 (1.05)     0.0000 (1.0)           0;0  0.1700 (0.95)          1           1
test_status-status-noop[main]       5.7704 (1.03)     5.7704 (1.03)     5.7704 (1.03)     0.0000 (1.0)      5.7704 (1.03)     0.0000 (1.0)           0;0  0.1733 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     210.4119 (1.54)     210.4119 (1.54)     210.4119 (1.54)     0.0000 (1.0)      210.4119 (1.54)     0.0000 (1.0)           0;0  0.0048 (0.65)          1           1
test_update-import-url[3.10.0]     214.0847 (1.57)     214.0847 (1.57)     214.0847 (1.57)     0.0000 (1.0)      214.0847 (1.57)     0.0000 (1.0)           0;0  0.0047 (0.64)          1           1
test_update-import-url[main]       136.5524 (1.0)      136.5524 (1.0)      136.5524 (1.0)      0.0000 (1.0)      136.5524 (1.0)      0.0000 (1.0)           0;0  0.0073 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     191.9447 (1.60)     191.9447 (1.60)     191.9447 (1.60)     0.0000 (1.0)      191.9447 (1.60)     0.0000 (1.0)           0;0  0.0052 (0.62)          1           1
test_update-update[3.10.0]     195.7384 (1.64)     195.7384 (1.64)     195.7384 (1.64)     0.0000 (1.0)      195.7384 (1.64)     0.0000 (1.0)           0;0  0.0051 (0.61)          1           1
test_update-update[main]       119.6433 (1.0)      119.6433 (1.0)      119.6433 (1.0)      0.0000 (1.0)      119.6433 (1.0)      0.0000 (1.0)           0;0  0.0084 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.3492 (1.0)      19.3492 (1.0)      19.3492 (1.0)      0.0000 (1.0)      19.3492 (1.0)      0.0000 (1.0)           0;0  0.0517 (1.0)           1           1
test_update-update-noop[3.10.0]     20.0652 (1.04)     20.0652 (1.04)     20.0652 (1.04)     0.0000 (1.0)      20.0652 (1.04)     0.0000 (1.0)           0;0  0.0498 (0.96)          1           1
test_update-update-noop[main]       19.6663 (1.02)     19.6663 (1.02)     19.6663 (1.02)     0.0000 (1.0)      19.6663 (1.02)     0.0000 (1.0)           0;0  0.0508 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean