Fri Dec  8 16:03:58 UTC 2023
dataset: mnist
project: example-get-started

-------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     96.5088 (1.03)     96.5088 (1.03)     96.5088 (1.03)     0.0000 (1.0)      96.5088 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_add-add[3.30.1]     93.9832 (1.01)     93.9832 (1.01)     93.9832 (1.01)     0.0000 (1.0)      93.9832 (1.01)     0.0000 (1.0)           0;0  0.0106 (0.99)          1           1
test_add-add[main]       93.4208 (1.0)      93.4208 (1.0)      93.4208 (1.0)      0.0000 (1.0)      93.4208 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     43.6164 (1.33)     43.6164 (1.33)     43.6164 (1.33)     0.0000 (1.0)      43.6164 (1.33)     0.0000 (1.0)           0;0  0.0229 (0.75)          1           1
test_checkout_copy-checkout[3.30.1]     32.8817 (1.0)      32.8817 (1.0)      32.8817 (1.0)      0.0000 (1.0)      32.8817 (1.0)      0.0000 (1.0)           0;0  0.0304 (1.0)           1           1
test_checkout_copy-checkout[main]       33.2648 (1.01)     33.2648 (1.01)     33.2648 (1.01)     0.0000 (1.0)      33.2648 (1.01)     0.0000 (1.0)           0;0  0.0301 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     6.6838 (1.01)     6.6838 (1.01)     6.6838 (1.01)     0.0000 (1.0)      6.6838 (1.01)     0.0000 (1.0)           0;0  0.1496 (0.99)          1           1
test_checkout_copy-checkout-noop[3.30.1]     6.6619 (1.00)     6.6619 (1.00)     6.6619 (1.00)     0.0000 (1.0)      6.6619 (1.00)     0.0000 (1.0)           0;0  0.1501 (1.00)          1           1
test_checkout_copy-checkout-noop[main]       6.6470 (1.0)      6.6470 (1.0)      6.6470 (1.0)      0.0000 (1.0)      6.6470 (1.0)      0.0000 (1.0)           0;0  0.1504 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     10.4035 (1.41)     10.4035 (1.41)     10.4035 (1.41)     0.0000 (1.0)      10.4035 (1.41)     0.0000 (1.0)           0;0  0.0961 (0.71)          1           1
test_checkout_copy-checkout-update[3.30.1]      7.3647 (1.0)       7.3647 (1.0)       7.3647 (1.0)      0.0000 (1.0)       7.3647 (1.0)      0.0000 (1.0)           0;0  0.1358 (1.0)           1           1
test_checkout_copy-checkout-update[main]        7.6063 (1.03)      7.6063 (1.03)      7.6063 (1.03)     0.0000 (1.0)       7.6063 (1.03)     0.0000 (1.0)           0;0  0.1315 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                                Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     26.0231 (1.39)     26.0231 (1.39)     26.0231 (1.39)     0.0000 (1.0)      26.0231 (1.39)     0.0000 (1.0)           0;0  0.0384 (0.72)          1           1
test_checkout_hardlink-checkout[3.30.1]     18.7508 (1.0)      18.7508 (1.0)      18.7508 (1.0)      0.0000 (1.0)      18.7508 (1.0)      0.0000 (1.0)           0;0  0.0533 (1.0)           1           1
test_checkout_hardlink-checkout[main]       19.0101 (1.01)     19.0101 (1.01)     19.0101 (1.01)     0.0000 (1.0)      19.0101 (1.01)     0.0000 (1.0)           0;0  0.0526 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     6.7579 (1.02)     6.7579 (1.02)     6.7579 (1.02)     0.0000 (1.0)      6.7579 (1.02)     0.0000 (1.0)           0;0  0.1480 (0.98)          1           1
test_checkout_hardlink-checkout-noop[3.30.1]     6.6494 (1.0)      6.6494 (1.0)      6.6494 (1.0)      0.0000 (1.0)      6.6494 (1.0)      0.0000 (1.0)           0;0  0.1504 (1.0)           1           1
test_checkout_hardlink-checkout-noop[main]       6.6923 (1.01)     6.6923 (1.01)     6.6923 (1.01)     0.0000 (1.0)      6.6923 (1.01)     0.0000 (1.0)           0;0  0.1494 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     10.4657 (1.40)     10.4657 (1.40)     10.4657 (1.40)     0.0000 (1.0)      10.4657 (1.40)     0.0000 (1.0)           0;0  0.0956 (0.72)          1           1
test_checkout_hardlink-checkout-update[3.30.1]      7.4913 (1.0)       7.4913 (1.0)       7.4913 (1.0)      0.0000 (1.0)       7.4913 (1.0)      0.0000 (1.0)           0;0  0.1335 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]        7.6825 (1.03)      7.6825 (1.03)      7.6825 (1.03)     0.0000 (1.0)       7.6825 (1.03)     0.0000 (1.0)           0;0  0.1302 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     29.7569 (1.30)     29.7569 (1.30)     29.7569 (1.30)     0.0000 (1.0)      29.7569 (1.30)     0.0000 (1.0)           0;0  0.0336 (0.77)          1           1
test_checkout_symlink-checkout[3.30.1]     22.9250 (1.0)      22.9250 (1.0)      22.9250 (1.0)      0.0000 (1.0)      22.9250 (1.0)      0.0000 (1.0)           0;0  0.0436 (1.0)           1           1
test_checkout_symlink-checkout[main]       23.1914 (1.01)     23.1914 (1.01)     23.1914 (1.01)     0.0000 (1.0)      23.1914 (1.01)     0.0000 (1.0)           0;0  0.0431 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     8.0473 (1.0)      8.0473 (1.0)      8.0473 (1.0)      0.0000 (1.0)      8.0473 (1.0)      0.0000 (1.0)           0;0  0.1243 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.30.1]     8.3004 (1.03)     8.3004 (1.03)     8.3004 (1.03)     0.0000 (1.0)      8.3004 (1.03)     0.0000 (1.0)           0;0  0.1205 (0.97)          1           1
test_checkout_symlink-checkout-noop[main]       8.2377 (1.02)     8.2377 (1.02)     8.2377 (1.02)     0.0000 (1.0)      8.2377 (1.02)     0.0000 (1.0)           0;0  0.1214 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     12.8908 (1.29)     12.8908 (1.29)     12.8908 (1.29)     0.0000 (1.0)      12.8908 (1.29)     0.0000 (1.0)           0;0  0.0776 (0.77)          1           1
test_checkout_symlink-checkout-update[3.30.1]     10.0279 (1.00)     10.0279 (1.00)     10.0279 (1.00)     0.0000 (1.0)      10.0279 (1.00)     0.0000 (1.0)           0;0  0.0997 (1.00)          1           1
test_checkout_symlink-checkout-update[main]        9.9897 (1.0)       9.9897 (1.0)       9.9897 (1.0)      0.0000 (1.0)       9.9897 (1.0)      0.0000 (1.0)           0;0  0.1001 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     4.5983 (1.0)      4.5983 (1.0)      4.5983 (1.0)      0.0000 (1.0)      4.5983 (1.0)      0.0000 (1.0)           0;0  0.2175 (1.0)           1           1
test_data_status-data-changed[3.30.1]     5.2951 (1.15)     5.2951 (1.15)     5.2951 (1.15)     0.0000 (1.0)      5.2951 (1.15)     0.0000 (1.0)           0;0  0.1889 (0.87)          1           1
test_data_status-data-changed[main]       5.2368 (1.14)     5.2368 (1.14)     5.2368 (1.14)     0.0000 (1.0)      5.2368 (1.14)     0.0000 (1.0)           0;0  0.1910 (0.88)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     4.9041 (1.0)      4.9041 (1.0)      4.9041 (1.0)      0.0000 (1.0)      4.9041 (1.0)      0.0000 (1.0)           0;0  0.2039 (1.0)           1           1
test_data_status-data-changed-noop[3.30.1]     5.4142 (1.10)     5.4142 (1.10)     5.4142 (1.10)     0.0000 (1.0)      5.4142 (1.10)     0.0000 (1.0)           0;0  0.1847 (0.91)          1           1
test_data_status-data-changed-noop[main]       5.3886 (1.10)     5.3886 (1.10)     5.3886 (1.10)     0.0000 (1.0)      5.3886 (1.10)     0.0000 (1.0)           0;0  0.1856 (0.91)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                          Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     20.3656 (1.0)      20.3656 (1.0)      20.3656 (1.0)      0.0000 (1.0)      20.3656 (1.0)      0.0000 (1.0)           0;0  0.0491 (1.0)           1           1
test_data_status-data-new[3.30.1]     21.3075 (1.05)     21.3075 (1.05)     21.3075 (1.05)     0.0000 (1.0)      21.3075 (1.05)     0.0000 (1.0)           0;0  0.0469 (0.96)          1           1
test_data_status-data-new[main]       20.9939 (1.03)     20.9939 (1.03)     20.9939 (1.03)     0.0000 (1.0)      20.9939 (1.03)     0.0000 (1.0)           0;0  0.0476 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     4.8146 (1.0)      4.8146 (1.0)      4.8146 (1.0)      0.0000 (1.0)      4.8146 (1.0)      0.0000 (1.0)           0;0  0.2077 (1.0)           1           1
test_data_status-data-noop[3.30.1]     5.4950 (1.14)     5.4950 (1.14)     5.4950 (1.14)     0.0000 (1.0)      5.4950 (1.14)     0.0000 (1.0)           0;0  0.1820 (0.88)          1           1
test_data_status-data-noop[main]       5.5246 (1.15)     5.5246 (1.15)     5.5246 (1.15)     0.0000 (1.0)      5.5246 (1.15)     0.0000 (1.0)           0;0  0.1810 (0.87)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------
Name (time in s)                                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     19.0225 (1.0)      19.0225 (1.0)      19.0225 (1.0)      0.0000 (1.0)      19.0225 (1.0)      0.0000 (1.0)           0;0  0.0526 (1.0)           1           1
test_data_status_all_flags-data-changed[3.30.1]     19.8878 (1.05)     19.8878 (1.05)     19.8878 (1.05)     0.0000 (1.0)      19.8878 (1.05)     0.0000 (1.0)           0;0  0.0503 (0.96)          1           1
test_data_status_all_flags-data-changed[main]       20.0553 (1.05)     20.0553 (1.05)     20.0553 (1.05)     0.0000 (1.0)      20.0553 (1.05)     0.0000 (1.0)           0;0  0.0499 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     19.5024 (1.0)      19.5024 (1.0)      19.5024 (1.0)      0.0000 (1.0)      19.5024 (1.0)      0.0000 (1.0)           0;0  0.0513 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.30.1]     19.9205 (1.02)     19.9205 (1.02)     19.9205 (1.02)     0.0000 (1.0)      19.9205 (1.02)     0.0000 (1.0)           0;0  0.0502 (0.98)          1           1
test_data_status_all_flags-data-changed-noop[main]       20.0179 (1.03)     20.0179 (1.03)     20.0179 (1.03)     0.0000 (1.0)      20.0179 (1.03)     0.0000 (1.0)           0;0  0.0500 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests --------------------------------------------------------------------------
Name (time in s)                                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     35.3519 (1.0)      35.3519 (1.0)      35.3519 (1.0)      0.0000 (1.0)      35.3519 (1.0)      0.0000 (1.0)           0;0  0.0283 (1.0)           1           1
test_data_status_all_flags-data-new[3.30.1]     36.1422 (1.02)     36.1422 (1.02)     36.1422 (1.02)     0.0000 (1.0)      36.1422 (1.02)     0.0000 (1.0)           0;0  0.0277 (0.98)          1           1
test_data_status_all_flags-data-new[main]       36.1884 (1.02)     36.1884 (1.02)     36.1884 (1.02)     0.0000 (1.0)      36.1884 (1.02)     0.0000 (1.0)           0;0  0.0276 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     18.5084 (1.0)      18.5084 (1.0)      18.5084 (1.0)      0.0000 (1.0)      18.5084 (1.0)      0.0000 (1.0)           0;0  0.0540 (1.0)           1           1
test_data_status_all_flags-data-noop[3.30.1]     19.2314 (1.04)     19.2314 (1.04)     19.2314 (1.04)     0.0000 (1.0)      19.2314 (1.04)     0.0000 (1.0)           0;0  0.0520 (0.96)          1           1
test_data_status_all_flags-data-noop[main]       19.4392 (1.05)     19.4392 (1.05)     19.4392 (1.05)     0.0000 (1.0)      19.4392 (1.05)     0.0000 (1.0)           0;0  0.0514 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     20.5318 (1.0)      20.5318 (1.0)      20.5318 (1.0)      0.0000 (1.0)      20.5318 (1.0)      0.0000 (1.0)           0;0  0.0487 (1.0)           1           1
test_diff-diff[3.30.1]     23.7098 (1.15)     23.7098 (1.15)     23.7098 (1.15)     0.0000 (1.0)      23.7098 (1.15)     0.0000 (1.0)           0;0  0.0422 (0.87)          1           1
test_diff-diff[main]       23.7089 (1.15)     23.7089 (1.15)     23.7089 (1.15)     0.0000 (1.0)      23.7089 (1.15)     0.0000 (1.0)           0;0  0.0422 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     7.0817 (1.09)     7.0817 (1.09)     7.0817 (1.09)     0.0000 (1.0)      7.0817 (1.09)     0.0000 (1.0)           0;0  0.1412 (0.92)          1           1
test_diff-diff-changed[3.30.1]     6.5120 (1.0)      6.5120 (1.0)      6.5120 (1.0)      0.0000 (1.0)      6.5120 (1.0)      0.0000 (1.0)           0;0  0.1536 (1.0)           1           1
test_diff-diff-changed[main]       6.6513 (1.02)     6.6513 (1.02)     6.6513 (1.02)     0.0000 (1.0)      6.6513 (1.02)     0.0000 (1.0)           0;0  0.1503 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     6.1548 (1.0)      6.1548 (1.0)      6.1548 (1.0)      0.0000 (1.0)      6.1548 (1.0)      0.0000 (1.0)           0;0  0.1625 (1.0)           1           1
test_diff-diff-changed-noop[3.30.1]     6.4923 (1.05)     6.4923 (1.05)     6.4923 (1.05)     0.0000 (1.0)      6.4923 (1.05)     0.0000 (1.0)           0;0  0.1540 (0.95)          1           1
test_diff-diff-changed-noop[main]       6.5702 (1.07)     6.5702 (1.07)     6.5702 (1.07)     0.0000 (1.0)      6.5702 (1.07)     0.0000 (1.0)           0;0  0.1522 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     4.9648 (1.0)      4.9648 (1.0)      4.9648 (1.0)      0.0000 (1.0)      4.9648 (1.0)      0.0000 (1.0)           0;0  0.2014 (1.0)           1           1
test_diff-diff-noop[3.30.1]     6.5841 (1.33)     6.5841 (1.33)     6.5841 (1.33)     0.0000 (1.0)      6.5841 (1.33)     0.0000 (1.0)           0;0  0.1519 (0.75)          1           1
test_diff-diff-noop[main]       6.6418 (1.34)     6.6418 (1.34)     6.6418 (1.34)     0.0000 (1.0)      6.6418 (1.34)     0.0000 (1.0)           0;0  0.1506 (0.75)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       829.1157 (1.0)        829.1157 (1.0)        829.1157 (1.0)      0.0000 (1.0)        829.1157 (1.0)      0.0000 (1.0)           0;0  1.2061 (1.0)           1           1
test_exp_show-exp[3.30.1]     3,549.9678 (4.28)     3,549.9678 (4.28)     3,549.9678 (4.28)     0.0000 (1.0)      3,549.9678 (4.28)     0.0000 (1.0)           0;0  0.2817 (0.23)          1           1
test_exp_show-exp[main]       3,730.6254 (4.50)     3,730.6254 (4.50)     3,730.6254 (4.50)     0.0000 (1.0)      3,730.6254 (4.50)     0.0000 (1.0)           0;0  0.2681 (0.22)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     110.0426 (2.70)     110.0426 (2.70)     110.0426 (2.70)     0.0000 (1.0)      110.0426 (2.70)     0.0000 (1.0)           0;0  0.0091 (0.37)          1           1
test_fetch-fetch[3.30.1]      40.8123 (1.0)       40.8123 (1.0)       40.8123 (1.0)      0.0000 (1.0)       40.8123 (1.0)      0.0000 (1.0)           0;0  0.0245 (1.0)           1           1
test_fetch-fetch[main]        40.8423 (1.00)      40.8423 (1.00)      40.8423 (1.00)     0.0000 (1.0)       40.8423 (1.00)     0.0000 (1.0)           0;0  0.0245 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_gc-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     3.2720 (1.01)     3.2720 (1.01)     3.2720 (1.01)     0.0000 (1.0)      3.2720 (1.01)     0.0000 (1.0)           0;0  0.3056 (0.99)          1           1
test_gc-gc[3.30.1]     3.2606 (1.01)     3.2606 (1.01)     3.2606 (1.01)     0.0000 (1.0)      3.2606 (1.01)     0.0000 (1.0)           0;0  0.3067 (0.99)          1           1
test_gc-gc[main]       3.2430 (1.0)      3.2430 (1.0)      3.2430 (1.0)      0.0000 (1.0)      3.2430 (1.0)      0.0000 (1.0)           0;0  0.3084 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in s)              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     182.1318 (1.08)     182.1318 (1.08)     182.1318 (1.08)     0.0000 (1.0)      182.1318 (1.08)     0.0000 (1.0)           0;0  0.0055 (0.93)          1           1
test_get-get[3.30.1]     169.8736 (1.00)     169.8736 (1.00)     169.8736 (1.00)     0.0000 (1.0)      169.8736 (1.00)     0.0000 (1.0)           0;0  0.0059 (1.00)          1           1
test_get-get[main]       169.2053 (1.0)      169.2053 (1.0)      169.2053 (1.0)      0.0000 (1.0)      169.2053 (1.0)      0.0000 (1.0)           0;0  0.0059 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     86.1136 (4.78)     86.1136 (4.78)     86.1136 (4.78)     0.0000 (1.0)      86.1136 (4.78)     0.0000 (1.0)           0;0  0.0116 (0.21)          1           1
test_get_url-get-url[3.30.1]     18.0299 (1.0)      18.0299 (1.0)      18.0299 (1.0)      0.0000 (1.0)      18.0299 (1.0)      0.0000 (1.0)           0;0  0.0555 (1.0)           1           1
test_get_url-get-url[main]       18.0775 (1.00)     18.0775 (1.00)     18.0775 (1.00)     0.0000 (1.0)      18.0775 (1.00)     0.0000 (1.0)           0;0  0.0553 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.5436 (1.03)     137.5349 (1.04)     129.6056 (1.03)     1.6070 (1.0)      129.0848 (1.03)     1.6948 (1.09)         20;4  7.7157 (0.97)        100           1
test_help---help[3.30.1]     123.5561 (1.0)      132.5109 (1.0)      125.8751 (1.0)      1.9311 (1.20)     125.2588 (1.0)      2.2421 (1.44)         20;6  7.9444 (1.0)         100           1
test_help---help[main]       125.6651 (1.02)     137.3936 (1.04)     127.7173 (1.01)     1.6845 (1.05)     127.3080 (1.02)     1.5568 (1.0)          15;6  7.8298 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     286.1671 (1.04)     286.1671 (1.04)     286.1671 (1.04)     0.0000 (1.0)      286.1671 (1.04)     0.0000 (1.0)           0;0  0.0035 (0.96)          1           1
test_import-import[3.30.1]     274.0812 (1.0)      274.0812 (1.0)      274.0812 (1.0)      0.0000 (1.0)      274.0812 (1.0)      0.0000 (1.0)           0;0  0.0036 (1.0)           1           1
test_import-import[main]       274.6075 (1.00)     274.6075 (1.00)     274.6075 (1.00)     0.0000 (1.0)      274.6075 (1.00)     0.0000 (1.0)           0;0  0.0036 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     213.5355 (1.50)     213.5355 (1.50)     213.5355 (1.50)     0.0000 (1.0)      213.5355 (1.50)     0.0000 (1.0)           0;0  0.0047 (0.67)          1           1
test_import_url-import-url[3.30.1]     143.3152 (1.01)     143.3152 (1.01)     143.3152 (1.01)     0.0000 (1.0)      143.3152 (1.01)     0.0000 (1.0)           0;0  0.0070 (0.99)          1           1
test_import_url-import-url[main]       142.0072 (1.0)      142.0072 (1.0)      142.0072 (1.0)      0.0000 (1.0)      142.0072 (1.0)      0.0000 (1.0)           0;0  0.0070 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     362.7450 (1.0)      389.6770 (1.0)      372.7480 (1.0)      5.6776 (1.0)      372.6150 (1.0)      8.3131 (1.33)         34;1  2.6828 (1.0)         100           1
test_init-init[3.30.1]     375.7943 (1.04)     453.7503 (1.16)     388.8142 (1.04)     8.4600 (1.49)     387.8403 (1.04)     6.2432 (1.00)         13;4  2.5719 (0.96)        100           1
test_init-init[main]       381.6114 (1.05)     424.6286 (1.09)     393.2401 (1.05)     6.0299 (1.06)     392.7002 (1.05)     6.2327 (1.0)          27;2  2.5430 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     411.8362 (1.04)     411.8362 (1.04)     411.8362 (1.04)     0.0000 (1.0)      411.8362 (1.04)     0.0000 (1.0)           0;0  2.4281 (0.96)          1           1
test_list-list[3.30.1]     395.5049 (1.0)      395.5049 (1.0)      395.5049 (1.0)      0.0000 (1.0)      395.5049 (1.0)      0.0000 (1.0)           0;0  2.5284 (1.0)           1           1
test_list-list[main]       404.4423 (1.02)     404.4423 (1.02)     404.4423 (1.02)     0.0000 (1.0)      404.4423 (1.02)     0.0000 (1.0)           0;0  2.4725 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     389.3683 (1.0)      389.3683 (1.0)      389.3683 (1.0)      0.0000 (1.0)      389.3683 (1.0)      0.0000 (1.0)           0;0  2.5683 (1.0)           1           1
test_list-list-dvc-only[3.30.1]     396.2351 (1.02)     396.2351 (1.02)     396.2351 (1.02)     0.0000 (1.0)      396.2351 (1.02)     0.0000 (1.0)           0;0  2.5238 (0.98)          1           1
test_list-list-dvc-only[main]       395.0536 (1.01)     395.0536 (1.01)     395.0536 (1.01)     0.0000 (1.0)      395.0536 (1.01)     0.0000 (1.0)           0;0  2.5313 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     3.1917 (1.0)      3.1917 (1.0)      3.1917 (1.0)      0.0000 (1.0)      3.1917 (1.0)      0.0000 (1.0)           0;0  0.3133 (1.0)           1           1
test_list-list-recursive[3.30.1]     3.1981 (1.00)     3.1981 (1.00)     3.1981 (1.00)     0.0000 (1.0)      3.1981 (1.00)     0.0000 (1.0)           0;0  0.3127 (1.00)          1           1
test_list-list-recursive[main]       3.2095 (1.01)     3.2095 (1.01)     3.2095 (1.01)     0.0000 (1.0)      3.2095 (1.01)     0.0000 (1.0)           0;0  0.3116 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     389.5719 (1.0)      389.5719 (1.0)      389.5719 (1.0)      0.0000 (1.0)      389.5719 (1.0)      0.0000 (1.0)           0;0  2.5669 (1.0)           1           1
test_list-list-shallow[3.30.1]     392.1856 (1.01)     392.1856 (1.01)     392.1856 (1.01)     0.0000 (1.0)      392.1856 (1.01)     0.0000 (1.0)           0;0  2.5498 (0.99)          1           1
test_list-list-shallow[main]       392.4813 (1.01)     392.4813 (1.01)     392.4813 (1.01)     0.0000 (1.0)      392.4813 (1.01)     0.0000 (1.0)           0;0  2.5479 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     13.3929 (1.00)     13.3929 (1.00)     13.3929 (1.00)     0.0000 (1.0)      13.3929 (1.00)     0.0000 (1.0)           0;0  0.0747 (1.00)          1           1
test_partial_add-add[3.30.1]     13.3559 (1.00)     13.3559 (1.00)     13.3559 (1.00)     0.0000 (1.0)      13.3559 (1.00)     0.0000 (1.0)           0;0  0.0749 (1.00)          1           1
test_partial_add-add[main]       13.3490 (1.0)      13.3490 (1.0)      13.3490 (1.0)      0.0000 (1.0)      13.3490 (1.0)      0.0000 (1.0)           0;0  0.0749 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                             Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     91.7574 (1.03)     91.7574 (1.03)     91.7574 (1.03)     0.0000 (1.0)      91.7574 (1.03)     0.0000 (1.0)           0;0  0.0109 (0.97)          1           1
test_partial_add-add-partial[3.30.1]     90.0880 (1.01)     90.0880 (1.01)     90.0880 (1.01)     0.0000 (1.0)      90.0880 (1.01)     0.0000 (1.0)           0;0  0.0111 (0.99)          1           1
test_partial_add-add-partial[main]       89.4360 (1.0)      89.4360 (1.0)      89.4360 (1.0)      0.0000 (1.0)      89.4360 (1.0)      0.0000 (1.0)           0;0  0.0112 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-cloud-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     6.4653 (1.0)      6.4653 (1.0)      6.4653 (1.0)      0.0000 (1.0)      6.4653 (1.0)      0.0000 (1.0)           0;0  0.1547 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.30.1]     9.7835 (1.51)     9.7835 (1.51)     9.7835 (1.51)     0.0000 (1.0)      9.7835 (1.51)     0.0000 (1.0)           0;0  0.1022 (0.66)          1           1
test_partial_add-gc-cloud-noop[main]       9.9782 (1.54)     9.9782 (1.54)     9.9782 (1.54)     0.0000 (1.0)      9.9782 (1.54)     0.0000 (1.0)           0;0  0.1002 (0.65)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-gc-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     3.7610 (1.0)      3.7610 (1.0)      3.7610 (1.0)      0.0000 (1.0)      3.7610 (1.0)      0.0000 (1.0)           0;0  0.2659 (1.0)           1           1
test_partial_add-gc-noop[3.30.1]     5.7523 (1.53)     5.7523 (1.53)     5.7523 (1.53)     0.0000 (1.0)      5.7523 (1.53)     0.0000 (1.0)           0;0  0.1738 (0.65)          1           1
test_partial_add-gc-noop[main]       5.8540 (1.56)     5.8540 (1.56)     5.8540 (1.56)     0.0000 (1.0)      5.8540 (1.56)     0.0000 (1.0)           0;0  0.1708 (0.64)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     13.8011 (3.28)     13.8011 (3.28)     13.8011 (3.28)     0.0000 (1.0)      13.8011 (3.28)     0.0000 (1.0)           0;0  0.0725 (0.30)          1           1
test_partial_add-push[3.30.1]      4.2029 (1.0)       4.2029 (1.0)       4.2029 (1.0)      0.0000 (1.0)       4.2029 (1.0)      0.0000 (1.0)           0;0  0.2379 (1.0)           1           1
test_partial_add-push[main]        4.2127 (1.00)      4.2127 (1.00)      4.2127 (1.00)     0.0000 (1.0)       4.2127 (1.00)     0.0000 (1.0)           0;0  0.2374 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests --------------------------------------------------------------------------
Name (time in s)                              Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     81.4321 (3.33)     81.4321 (3.33)     81.4321 (3.33)     0.0000 (1.0)      81.4321 (3.33)     0.0000 (1.0)           0;0  0.0123 (0.30)          1           1
test_partial_add-push-partial[3.30.1]     24.4589 (1.0)      24.4589 (1.0)      24.4589 (1.0)      0.0000 (1.0)      24.4589 (1.0)      0.0000 (1.0)           0;0  0.0409 (1.0)           1           1
test_partial_add-push-partial[main]       24.4631 (1.00)     24.4631 (1.00)     24.4631 (1.00)     0.0000 (1.0)      24.4631 (1.00)     0.0000 (1.0)           0;0  0.0409 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     95.5572 (1.03)     95.5572 (1.03)     95.5572 (1.03)     0.0000 (1.0)      95.5572 (1.03)     0.0000 (1.0)           0;0  0.0105 (0.97)          1           1
test_partial_remove-add[3.30.1]     93.1506 (1.0)      93.1506 (1.0)      93.1506 (1.0)      0.0000 (1.0)      93.1506 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
test_partial_remove-add[main]       94.2450 (1.01)     94.2450 (1.01)     94.2450 (1.01)     0.0000 (1.0)      94.2450 (1.01)     0.0000 (1.0)           0;0  0.0106 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests --------------------------------------------------------------------------
Name (time in s)                               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     53.8842 (1.03)     53.8842 (1.03)     53.8842 (1.03)     0.0000 (1.0)      53.8842 (1.03)     0.0000 (1.0)           0;0  0.0186 (0.97)          1           1
test_partial_remove-add-update[3.30.1]     52.1380 (1.0)      52.1380 (1.0)      52.1380 (1.0)      0.0000 (1.0)      52.1380 (1.0)      0.0000 (1.0)           0;0  0.0192 (1.0)           1           1
test_partial_remove-add-update[main]       52.4869 (1.01)     52.4869 (1.01)     52.4869 (1.01)     0.0000 (1.0)      52.4869 (1.01)     0.0000 (1.0)           0;0  0.0191 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     3.6976 (1.0)      3.6976 (1.0)      3.6976 (1.0)      0.0000 (1.0)      3.6976 (1.0)      0.0000 (1.0)           0;0  0.2704 (1.0)           1           1
test_partial_remove-gc[3.30.1]     5.3500 (1.45)     5.3500 (1.45)     5.3500 (1.45)     0.0000 (1.0)      5.3500 (1.45)     0.0000 (1.0)           0;0  0.1869 (0.69)          1           1
test_partial_remove-gc[main]       5.5010 (1.49)     5.5010 (1.49)     5.5010 (1.49)     0.0000 (1.0)      5.5010 (1.49)     0.0000 (1.0)           0;0  0.1818 (0.67)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-gc-cloud': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     6.2441 (1.0)      6.2441 (1.0)      6.2441 (1.0)      0.0000 (1.0)      6.2441 (1.0)      0.0000 (1.0)           0;0  0.1602 (1.0)           1           1
test_partial_remove-gc-cloud[3.30.1]     9.2288 (1.48)     9.2288 (1.48)     9.2288 (1.48)     0.0000 (1.0)      9.2288 (1.48)     0.0000 (1.0)           0;0  0.1084 (0.68)          1           1
test_partial_remove-gc-cloud[main]       9.5008 (1.52)     9.5008 (1.52)     9.5008 (1.52)     0.0000 (1.0)      9.5008 (1.52)     0.0000 (1.0)           0;0  0.1053 (0.66)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     93.8528 (3.57)     93.8528 (3.57)     93.8528 (3.57)     0.0000 (1.0)      93.8528 (3.57)     0.0000 (1.0)           0;0  0.0107 (0.28)          1           1
test_partial_remove-push[3.30.1]     26.6308 (1.01)     26.6308 (1.01)     26.6308 (1.01)     0.0000 (1.0)      26.6308 (1.01)     0.0000 (1.0)           0;0  0.0376 (0.99)          1           1
test_partial_remove-push[main]       26.3098 (1.0)      26.3098 (1.0)      26.3098 (1.0)      0.0000 (1.0)      26.3098 (1.0)      0.0000 (1.0)           0;0  0.0380 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     4.4185 (1.0)      4.4185 (1.0)      4.4185 (1.0)      0.0000 (1.0)      4.4185 (1.0)      0.0000 (1.0)           0;0  0.2263 (1.0)           1           1
test_partial_remove-push-update[3.30.1]     8.8340 (2.00)     8.8340 (2.00)     8.8340 (2.00)     0.0000 (1.0)      8.8340 (2.00)     0.0000 (1.0)           0;0  0.1132 (0.50)          1           1
test_partial_remove-push-update[main]       8.8526 (2.00)     8.8526 (2.00)     8.8526 (2.00)     0.0000 (1.0)      8.8526 (2.00)     0.0000 (1.0)           0;0  0.1130 (0.50)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     411.4670 (1.0)      428.0965 (1.0)      416.7338 (1.0)      6.6089 (2.83)     413.9598 (1.0)      6.4437 (1.73)          1;0  2.3996 (1.0)           5           3
test_plots-plots-diff[3.30.1]     768.4742 (1.87)     784.5333 (1.83)     772.5212 (1.85)     6.9316 (2.96)     768.5729 (1.86)     6.9888 (1.87)          1;0  1.2945 (0.54)          5           3
test_plots-plots-diff[main]       733.2176 (1.78)     738.6831 (1.73)     735.6353 (1.77)     2.3380 (1.0)      736.4671 (1.78)     3.7309 (1.0)           2;0  1.3594 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       424.4843 (1.0)        428.8567 (1.0)        427.1000 (1.0)       1.7130 (1.0)        426.9117 (1.0)       2.2675 (1.0)           2;0  2.3414 (1.0)           5           3
test_plots-plots-diff-json[3.30.1]     1,032.6612 (2.43)     1,064.8638 (2.48)     1,045.2580 (2.45)     13.0378 (7.61)     1,042.5792 (2.44)     19.6848 (8.68)          1;0  0.9567 (0.41)          5           3
test_plots-plots-diff-json[main]         820.2797 (1.93)       843.9866 (1.97)       830.7182 (1.95)      9.5016 (5.55)       828.0401 (1.94)     14.7326 (6.50)          2;0  1.2038 (0.51)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     385.3931 (1.0)      394.1453 (1.0)      390.0073 (1.0)       3.4544 (1.0)      390.4714 (1.0)       5.3882 (1.0)           2;0  2.5641 (1.0)           5           3
test_plots-plots-show[3.30.1]     660.1983 (1.71)     670.9185 (1.70)     665.6293 (1.71)      4.4291 (1.28)     664.6914 (1.70)      7.3681 (1.37)          2;0  1.5023 (0.59)          5           3
test_plots-plots-show[main]       634.7159 (1.65)     665.8576 (1.69)     642.6658 (1.65)     13.1791 (3.82)     636.6944 (1.63)     11.9016 (2.21)          1;1  1.5560 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     406.8481 (1.0)      414.0215 (1.0)      409.8707 (1.0)       3.4481 (1.83)     408.0007 (1.0)       6.2202 (1.83)          1;0  2.4398 (1.0)           5           3
test_plots-plots-show-json[3.30.1]     786.5109 (1.93)     812.5594 (1.96)     793.8470 (1.94)     10.9166 (5.79)     789.5086 (1.94)     12.2367 (3.60)          1;0  1.2597 (0.52)          5           3
test_plots-plots-show-json[main]       676.6479 (1.66)     680.8186 (1.64)     678.6712 (1.66)      1.8842 (1.0)      679.2302 (1.66)      3.4023 (1.0)           3;0  1.4735 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests --------------------------------------------------------------------------
Name (time in s)               Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     93.2321 (3.58)     93.2321 (3.58)     93.2321 (3.58)     0.0000 (1.0)      93.2321 (3.58)     0.0000 (1.0)           0;0  0.0107 (0.28)          1           1
test_push-push[3.30.1]     26.2787 (1.01)     26.2787 (1.01)     26.2787 (1.01)     0.0000 (1.0)      26.2787 (1.01)     0.0000 (1.0)           0;0  0.0381 (0.99)          1           1
test_push-push[main]       26.0373 (1.0)      26.0373 (1.0)      26.0373 (1.0)      0.0000 (1.0)      26.0373 (1.0)      0.0000 (1.0)           0;0  0.0384 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                 Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     96.1004 (1.03)     96.1004 (1.03)     96.1004 (1.03)     0.0000 (1.0)      96.1004 (1.03)     0.0000 (1.0)           0;0  0.0104 (0.97)          1           1
test_sharing-add[3.30.1]     93.2103 (1.0)      93.2103 (1.0)      93.2103 (1.0)      0.0000 (1.0)      93.2103 (1.0)      0.0000 (1.0)           0;0  0.0107 (1.0)           1           1
test_sharing-add[main]       93.8187 (1.01)     93.8187 (1.01)     93.8187 (1.01)     0.0000 (1.0)      93.8187 (1.01)     0.0000 (1.0)           0;0  0.0107 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     63.3033 (1.05)     63.3033 (1.05)     63.3033 (1.05)     0.0000 (1.0)      63.3033 (1.05)     0.0000 (1.0)           0;0  0.0158 (0.96)          1           1
test_sharing-add-noop[3.30.1]     60.5309 (1.0)      60.5309 (1.0)      60.5309 (1.0)      0.0000 (1.0)      60.5309 (1.0)      0.0000 (1.0)           0;0  0.0165 (1.0)           1           1
test_sharing-add-noop[main]       61.0317 (1.01)     61.0317 (1.01)     61.0317 (1.01)     0.0000 (1.0)      61.0317 (1.01)     0.0000 (1.0)           0;0  0.0164 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                      Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     43.2723 (1.40)     43.2723 (1.40)     43.2723 (1.40)     0.0000 (1.0)      43.2723 (1.40)     0.0000 (1.0)           0;0  0.0231 (0.71)          1           1
test_sharing-checkout[3.30.1]     30.9812 (1.00)     30.9812 (1.00)     30.9812 (1.00)     0.0000 (1.0)      30.9812 (1.00)     0.0000 (1.0)           0;0  0.0323 (1.00)          1           1
test_sharing-checkout[main]       30.8361 (1.0)      30.8361 (1.0)      30.8361 (1.0)      0.0000 (1.0)      30.8361 (1.0)      0.0000 (1.0)           0;0  0.0324 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     6.6263 (1.0)      6.6263 (1.0)      6.6263 (1.0)      0.0000 (1.0)      6.6263 (1.0)      0.0000 (1.0)           0;0  0.1509 (1.0)           1           1
test_sharing-checkout-noop[3.30.1]     6.6348 (1.00)     6.6348 (1.00)     6.6348 (1.00)     0.0000 (1.0)      6.6348 (1.00)     0.0000 (1.0)           0;0  0.1507 (1.00)          1           1
test_sharing-checkout-noop[main]       6.6861 (1.01)     6.6861 (1.01)     6.6861 (1.01)     0.0000 (1.0)      6.6861 (1.01)     0.0000 (1.0)           0;0  0.1496 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     111.4363 (2.69)     111.4363 (2.69)     111.4363 (2.69)     0.0000 (1.0)      111.4363 (2.69)     0.0000 (1.0)           0;0  0.0090 (0.37)          1           1
test_sharing-fetch[3.30.1]      41.3996 (1.0)       41.3996 (1.0)       41.3996 (1.0)      0.0000 (1.0)       41.3996 (1.0)      0.0000 (1.0)           0;0  0.0242 (1.0)           1           1
test_sharing-fetch[main]        41.4364 (1.00)      41.4364 (1.00)      41.4364 (1.00)     0.0000 (1.0)       41.4364 (1.00)     0.0000 (1.0)           0;0  0.0241 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     1.4470 (1.0)      1.4470 (1.0)      1.4470 (1.0)      0.0000 (1.0)      1.4470 (1.0)      0.0000 (1.0)           0;0  0.6911 (1.0)           1           1
test_sharing-fetch-noop[3.30.1]     6.7256 (4.65)     6.7256 (4.65)     6.7256 (4.65)     0.0000 (1.0)      6.7256 (4.65)     0.0000 (1.0)           0;0  0.1487 (0.22)          1           1
test_sharing-fetch-noop[main]       6.7925 (4.69)     6.7925 (4.69)     6.7925 (4.69)     0.0000 (1.0)      6.7925 (4.69)     0.0000 (1.0)           0;0  0.1472 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                  Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     94.7220 (3.50)     94.7220 (3.50)     94.7220 (3.50)     0.0000 (1.0)      94.7220 (3.50)     0.0000 (1.0)           0;0  0.0106 (0.29)          1           1
test_sharing-push[3.30.1]     27.0290 (1.0)      27.0290 (1.0)      27.0290 (1.0)      0.0000 (1.0)      27.0290 (1.0)      0.0000 (1.0)           0;0  0.0370 (1.0)           1           1
test_sharing-push[main]       27.3836 (1.01)     27.3836 (1.01)     27.3836 (1.01)     0.0000 (1.0)      27.3836 (1.01)     0.0000 (1.0)           0;0  0.0365 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     2.7475 (1.0)      2.7475 (1.0)      2.7475 (1.0)      0.0000 (1.0)      2.7475 (1.0)      0.0000 (1.0)           0;0  0.3640 (1.0)           1           1
test_sharing-push-noop[3.30.1]     7.8018 (2.84)     7.8018 (2.84)     7.8018 (2.84)     0.0000 (1.0)      7.8018 (2.84)     0.0000 (1.0)           0;0  0.1282 (0.35)          1           1
test_sharing-push-noop[main]       7.7257 (2.81)     7.7257 (2.81)     7.7257 (2.81)     0.0000 (1.0)      7.7257 (2.81)     0.0000 (1.0)           0;0  0.1294 (0.36)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     98.3259 (1.03)     98.3259 (1.03)     98.3259 (1.03)     0.0000 (1.0)      98.3259 (1.03)     0.0000 (1.0)           0;0  0.0102 (0.97)          1           1
test_sharing_azure-add[3.30.1]     96.2550 (1.01)     96.2550 (1.01)     96.2550 (1.01)     0.0000 (1.0)      96.2550 (1.01)     0.0000 (1.0)           0;0  0.0104 (0.99)          1           1
test_sharing_azure-add[main]       95.5589 (1.0)      95.5589 (1.0)      95.5589 (1.0)      0.0000 (1.0)      95.5589 (1.0)      0.0000 (1.0)           0;0  0.0105 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     63.6993 (1.03)     63.6993 (1.03)     63.6993 (1.03)     0.0000 (1.0)      63.6993 (1.03)     0.0000 (1.0)           0;0  0.0157 (0.97)          1           1
test_sharing_azure-add-noop[3.30.1]     62.2891 (1.00)     62.2891 (1.00)     62.2891 (1.00)     0.0000 (1.0)      62.2891 (1.00)     0.0000 (1.0)           0;0  0.0161 (1.00)          1           1
test_sharing_azure-add-noop[main]       62.0489 (1.0)      62.0489 (1.0)      62.0489 (1.0)      0.0000 (1.0)      62.0489 (1.0)      0.0000 (1.0)           0;0  0.0161 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                            Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]     43.9358 (1.40)     43.9358 (1.40)     43.9358 (1.40)     0.0000 (1.0)      43.9358 (1.40)     0.0000 (1.0)           0;0  0.0228 (0.72)          1           1
test_sharing_azure-checkout[3.30.1]     31.4796 (1.0)      31.4796 (1.0)      31.4796 (1.0)      0.0000 (1.0)      31.4796 (1.0)      0.0000 (1.0)           0;0  0.0318 (1.0)           1           1
test_sharing_azure-checkout[main]       31.4900 (1.00)     31.4900 (1.00)     31.4900 (1.00)     0.0000 (1.0)      31.4900 (1.00)     0.0000 (1.0)           0;0  0.0318 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     6.6400 (1.0)      6.6400 (1.0)      6.6400 (1.0)      0.0000 (1.0)      6.6400 (1.0)      0.0000 (1.0)           0;0  0.1506 (1.0)           1           1
test_sharing_azure-checkout-noop[3.30.1]     6.6758 (1.01)     6.6758 (1.01)     6.6758 (1.01)     0.0000 (1.0)      6.6758 (1.01)     0.0000 (1.0)           0;0  0.1498 (0.99)          1           1
test_sharing_azure-checkout-noop[main]       6.7572 (1.02)     6.7572 (1.02)     6.7572 (1.02)     0.0000 (1.0)      6.7572 (1.02)     0.0000 (1.0)           0;0  0.1480 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     111.7701 (2.68)     111.7701 (2.68)     111.7701 (2.68)     0.0000 (1.0)      111.7701 (2.68)     0.0000 (1.0)           0;0  0.0089 (0.37)          1           1
test_sharing_azure-fetch[3.30.1]      42.8846 (1.03)      42.8846 (1.03)      42.8846 (1.03)     0.0000 (1.0)       42.8846 (1.03)     0.0000 (1.0)           0;0  0.0233 (0.97)          1           1
test_sharing_azure-fetch[main]        41.7000 (1.0)       41.7000 (1.0)       41.7000 (1.0)      0.0000 (1.0)       41.7000 (1.0)      0.0000 (1.0)           0;0  0.0240 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     1.4468 (1.0)      1.4468 (1.0)      1.4468 (1.0)      0.0000 (1.0)      1.4468 (1.0)      0.0000 (1.0)           0;0  0.6912 (1.0)           1           1
test_sharing_azure-fetch-noop[3.30.1]     7.0053 (4.84)     7.0053 (4.84)     7.0053 (4.84)     0.0000 (1.0)      7.0053 (4.84)     0.0000 (1.0)           0;0  0.1427 (0.21)          1           1
test_sharing_azure-fetch-noop[main]       6.9748 (4.82)     6.9748 (4.82)     6.9748 (4.82)     0.0000 (1.0)      6.9748 (4.82)     0.0000 (1.0)           0;0  0.1434 (0.21)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     95.0810 (3.47)     95.0810 (3.47)     95.0810 (3.47)     0.0000 (1.0)      95.0810 (3.47)     0.0000 (1.0)           0;0  0.0105 (0.29)          1           1
test_sharing_azure-push[3.30.1]     27.4291 (1.00)     27.4291 (1.00)     27.4291 (1.00)     0.0000 (1.0)      27.4291 (1.00)     0.0000 (1.0)           0;0  0.0365 (1.00)          1           1
test_sharing_azure-push[main]       27.3756 (1.0)      27.3756 (1.0)      27.3756 (1.0)      0.0000 (1.0)      27.3756 (1.0)      0.0000 (1.0)           0;0  0.0365 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]     2.5109 (1.0)      2.5109 (1.0)      2.5109 (1.0)      0.0000 (1.0)      2.5109 (1.0)      0.0000 (1.0)           0;0  0.3983 (1.0)           1           1
test_sharing_azure-push-noop[3.30.1]     7.9727 (3.18)     7.9727 (3.18)     7.9727 (3.18)     0.0000 (1.0)      7.9727 (3.18)     0.0000 (1.0)           0;0  0.1254 (0.31)          1           1
test_sharing_azure-push-noop[main]       7.9454 (3.16)     7.9454 (3.16)     7.9454 (3.16)     0.0000 (1.0)      7.9454 (3.16)     0.0000 (1.0)           0;0  0.1259 (0.32)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     96.6432 (1.02)     96.6432 (1.02)     96.6432 (1.02)     0.0000 (1.0)      96.6432 (1.02)     0.0000 (1.0)           0;0  0.0103 (0.98)          1           1
test_sharing_gs-add[3.30.1]     94.4600 (1.0)      94.4600 (1.0)      94.4600 (1.0)      0.0000 (1.0)      94.4600 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
test_sharing_gs-add[main]       95.4347 (1.01)     95.4347 (1.01)     95.4347 (1.01)     0.0000 (1.0)      95.4347 (1.01)     0.0000 (1.0)           0;0  0.0105 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     63.4788 (1.04)     63.4788 (1.04)     63.4788 (1.04)     0.0000 (1.0)      63.4788 (1.04)     0.0000 (1.0)           0;0  0.0158 (0.97)          1           1
test_sharing_gs-add-noop[3.30.1]     61.5095 (1.00)     61.5095 (1.00)     61.5095 (1.00)     0.0000 (1.0)      61.5095 (1.00)     0.0000 (1.0)           0;0  0.0163 (1.00)          1           1
test_sharing_gs-add-noop[main]       61.3203 (1.0)      61.3203 (1.0)      61.3203 (1.0)      0.0000 (1.0)      61.3203 (1.0)      0.0000 (1.0)           0;0  0.0163 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]     43.2235 (1.39)     43.2235 (1.39)     43.2235 (1.39)     0.0000 (1.0)      43.2235 (1.39)     0.0000 (1.0)           0;0  0.0231 (0.72)          1           1
test_sharing_gs-checkout[3.30.1]     31.2338 (1.00)     31.2338 (1.00)     31.2338 (1.00)     0.0000 (1.0)      31.2338 (1.00)     0.0000 (1.0)           0;0  0.0320 (1.00)          1           1
test_sharing_gs-checkout[main]       31.1401 (1.0)      31.1401 (1.0)      31.1401 (1.0)      0.0000 (1.0)      31.1401 (1.0)      0.0000 (1.0)           0;0  0.0321 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     6.6918 (1.00)     6.6918 (1.00)     6.6918 (1.00)     0.0000 (1.0)      6.6918 (1.00)     0.0000 (1.0)           0;0  0.1494 (1.00)          1           1
test_sharing_gs-checkout-noop[3.30.1]     6.6666 (1.0)      6.6666 (1.0)      6.6666 (1.0)      0.0000 (1.0)      6.6666 (1.0)      0.0000 (1.0)           0;0  0.1500 (1.0)           1           1
test_sharing_gs-checkout-noop[main]       6.6752 (1.00)     6.6752 (1.00)     6.6752 (1.00)     0.0000 (1.0)      6.6752 (1.00)     0.0000 (1.0)           0;0  0.1498 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     112.3377 (2.62)     112.3377 (2.62)     112.3377 (2.62)     0.0000 (1.0)      112.3377 (2.62)     0.0000 (1.0)           0;0  0.0089 (0.38)          1           1
test_sharing_gs-fetch[3.30.1]      43.0128 (1.00)      43.0128 (1.00)      43.0128 (1.00)     0.0000 (1.0)       43.0128 (1.00)     0.0000 (1.0)           0;0  0.0232 (1.00)          1           1
test_sharing_gs-fetch[main]        42.8958 (1.0)       42.8958 (1.0)       42.8958 (1.0)      0.0000 (1.0)       42.8958 (1.0)      0.0000 (1.0)           0;0  0.0233 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     1.4582 (1.0)      1.4582 (1.0)      1.4582 (1.0)      0.0000 (1.0)      1.4582 (1.0)      0.0000 (1.0)           0;0  0.6858 (1.0)           1           1
test_sharing_gs-fetch-noop[3.30.1]     7.0031 (4.80)     7.0031 (4.80)     7.0031 (4.80)     0.0000 (1.0)      7.0031 (4.80)     0.0000 (1.0)           0;0  0.1428 (0.21)          1           1
test_sharing_gs-fetch-noop[main]       6.9364 (4.76)     6.9364 (4.76)     6.9364 (4.76)     0.0000 (1.0)      6.9364 (4.76)     0.0000 (1.0)           0;0  0.1442 (0.21)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_gs-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     95.6477 (3.43)     95.6477 (3.43)     95.6477 (3.43)     0.0000 (1.0)      95.6477 (3.43)     0.0000 (1.0)           0;0  0.0105 (0.29)          1           1
test_sharing_gs-push[3.30.1]     28.3310 (1.02)     28.3310 (1.02)     28.3310 (1.02)     0.0000 (1.0)      28.3310 (1.02)     0.0000 (1.0)           0;0  0.0353 (0.98)          1           1
test_sharing_gs-push[main]       27.9010 (1.0)      27.9010 (1.0)      27.9010 (1.0)      0.0000 (1.0)      27.9010 (1.0)      0.0000 (1.0)           0;0  0.0358 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     2.7016 (1.0)      2.7016 (1.0)      2.7016 (1.0)      0.0000 (1.0)      2.7016 (1.0)      0.0000 (1.0)           0;0  0.3702 (1.0)           1           1
test_sharing_gs-push-noop[3.30.1]     8.0620 (2.98)     8.0620 (2.98)     8.0620 (2.98)     0.0000 (1.0)      8.0620 (2.98)     0.0000 (1.0)           0;0  0.1240 (0.34)          1           1
test_sharing_gs-push-noop[main]       8.0846 (2.99)     8.0846 (2.99)     8.0846 (2.99)     0.0000 (1.0)      8.0846 (2.99)     0.0000 (1.0)           0;0  0.1237 (0.33)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 3 tests --------------------------------------------------------------------------
Name (time in s)                    Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     95.8281 (1.01)     95.8281 (1.01)     95.8281 (1.01)     0.0000 (1.0)      95.8281 (1.01)     0.0000 (1.0)           0;0  0.0104 (0.99)          1           1
test_sharing_s3-add[3.30.1]     95.7776 (1.01)     95.7776 (1.01)     95.7776 (1.01)     0.0000 (1.0)      95.7776 (1.01)     0.0000 (1.0)           0;0  0.0104 (0.99)          1           1
test_sharing_s3-add[main]       94.6298 (1.0)      94.6298 (1.0)      94.6298 (1.0)      0.0000 (1.0)      94.6298 (1.0)      0.0000 (1.0)           0;0  0.0106 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-add-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     63.0484 (1.02)     63.0484 (1.02)     63.0484 (1.02)     0.0000 (1.0)      63.0484 (1.02)     0.0000 (1.0)           0;0  0.0159 (0.98)          1           1
test_sharing_s3-add-noop[3.30.1]     62.1462 (1.01)     62.1462 (1.01)     62.1462 (1.01)     0.0000 (1.0)      62.1462 (1.01)     0.0000 (1.0)           0;0  0.0161 (0.99)          1           1
test_sharing_s3-add-noop[main]       61.6488 (1.0)      61.6488 (1.0)      61.6488 (1.0)      0.0000 (1.0)      61.6488 (1.0)      0.0000 (1.0)           0;0  0.0162 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout': 3 tests --------------------------------------------------------------------------
Name (time in s)                         Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]     43.4083 (1.40)     43.4083 (1.40)     43.4083 (1.40)     0.0000 (1.0)      43.4083 (1.40)     0.0000 (1.0)           0;0  0.0230 (0.71)          1           1
test_sharing_s3-checkout[3.30.1]     31.1724 (1.00)     31.1724 (1.00)     31.1724 (1.00)     0.0000 (1.0)      31.1724 (1.00)     0.0000 (1.0)           0;0  0.0321 (1.00)          1           1
test_sharing_s3-checkout[main]       31.0206 (1.0)      31.0206 (1.0)      31.0206 (1.0)      0.0000 (1.0)      31.0206 (1.0)      0.0000 (1.0)           0;0  0.0322 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                             Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     6.7144 (1.01)     6.7144 (1.01)     6.7144 (1.01)     0.0000 (1.0)      6.7144 (1.01)     0.0000 (1.0)           0;0  0.1489 (0.99)          1           1
test_sharing_s3-checkout-noop[3.30.1]     6.6863 (1.01)     6.6863 (1.01)     6.6863 (1.01)     0.0000 (1.0)      6.6863 (1.01)     0.0000 (1.0)           0;0  0.1496 (0.99)          1           1
test_sharing_s3-checkout-noop[main]       6.6477 (1.0)      6.6477 (1.0)      6.6477 (1.0)      0.0000 (1.0)      6.6477 (1.0)      0.0000 (1.0)           0;0  0.1504 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in s)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     242.1243 (1.01)     242.1243 (1.01)     242.1243 (1.01)     0.0000 (1.0)      242.1243 (1.01)     0.0000 (1.0)           0;0  0.0041 (0.99)          1           1
test_sharing_s3-fetch[3.30.1]     239.4234 (1.0)      239.4234 (1.0)      239.4234 (1.0)      0.0000 (1.0)      239.4234 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
test_sharing_s3-fetch[main]       243.2884 (1.02)     243.2884 (1.02)     243.2884 (1.02)     0.0000 (1.0)      243.2884 (1.02)     0.0000 (1.0)           0;0  0.0041 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     1.6288 (1.0)      1.6288 (1.0)      1.6288 (1.0)      0.0000 (1.0)      1.6288 (1.0)      0.0000 (1.0)           0;0  0.6140 (1.0)           1           1
test_sharing_s3-fetch-noop[3.30.1]     7.3669 (4.52)     7.3669 (4.52)     7.3669 (4.52)     0.0000 (1.0)      7.3669 (4.52)     0.0000 (1.0)           0;0  0.1357 (0.22)          1           1
test_sharing_s3-fetch-noop[main]       7.3214 (4.50)     7.3214 (4.50)     7.3214 (4.50)     0.0000 (1.0)      7.3214 (4.50)     0.0000 (1.0)           0;0  0.1366 (0.22)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests ----------------------------------------------------------------------------
Name (time in s)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     239.8391 (1.0)      239.8391 (1.0)      239.8391 (1.0)      0.0000 (1.0)      239.8391 (1.0)      0.0000 (1.0)           0;0  0.0042 (1.0)           1           1
test_sharing_s3-push[3.30.1]     243.0640 (1.01)     243.0640 (1.01)     243.0640 (1.01)     0.0000 (1.0)      243.0640 (1.01)     0.0000 (1.0)           0;0  0.0041 (0.99)          1           1
test_sharing_s3-push[main]       241.6406 (1.01)     241.6406 (1.01)     241.6406 (1.01)     0.0000 (1.0)      241.6406 (1.01)     0.0000 (1.0)           0;0  0.0041 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]     2.9262 (1.0)      2.9262 (1.0)      2.9262 (1.0)      0.0000 (1.0)      2.9262 (1.0)      0.0000 (1.0)           0;0  0.3417 (1.0)           1           1
test_sharing_s3-push-noop[3.30.1]     8.4146 (2.88)     8.4146 (2.88)     8.4146 (2.88)     0.0000 (1.0)      8.4146 (2.88)     0.0000 (1.0)           0;0  0.1188 (0.35)          1           1
test_sharing_s3-push-noop[main]       8.3896 (2.87)     8.3896 (2.87)     8.3896 (2.87)     0.0000 (1.0)      8.3896 (2.87)     0.0000 (1.0)           0;0  0.1192 (0.35)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     21.6173 (1.0)      21.6173 (1.0)      21.6173 (1.0)      0.0000 (1.0)      21.6173 (1.0)      0.0000 (1.0)           0;0  0.0463 (1.0)           1           1
test_status-status[3.30.1]     22.2696 (1.03)     22.2696 (1.03)     22.2696 (1.03)     0.0000 (1.0)      22.2696 (1.03)     0.0000 (1.0)           0;0  0.0449 (0.97)          1           1
test_status-status[main]       21.9812 (1.02)     21.9812 (1.02)     21.9812 (1.02)     0.0000 (1.0)      21.9812 (1.02)     0.0000 (1.0)           0;0  0.0455 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     5.4984 (1.0)      5.4984 (1.0)      5.4984 (1.0)      0.0000 (1.0)      5.4984 (1.0)      0.0000 (1.0)           0;0  0.1819 (1.0)           1           1
test_status-status-changed[3.30.1]     6.0039 (1.09)     6.0039 (1.09)     6.0039 (1.09)     0.0000 (1.0)      6.0039 (1.09)     0.0000 (1.0)           0;0  0.1666 (0.92)          1           1
test_status-status-changed[main]       6.0456 (1.10)     6.0456 (1.10)     6.0456 (1.10)     0.0000 (1.0)      6.0456 (1.10)     0.0000 (1.0)           0;0  0.1654 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                               Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     5.6294 (1.0)      5.6294 (1.0)      5.6294 (1.0)      0.0000 (1.0)      5.6294 (1.0)      0.0000 (1.0)           0;0  0.1776 (1.0)           1           1
test_status-status-changed-noop[3.30.1]     5.7214 (1.02)     5.7214 (1.02)     5.7214 (1.02)     0.0000 (1.0)      5.7214 (1.02)     0.0000 (1.0)           0;0  0.1748 (0.98)          1           1
test_status-status-changed-noop[main]       5.6600 (1.01)     5.6600 (1.01)     5.6600 (1.01)     0.0000 (1.0)      5.6600 (1.01)     0.0000 (1.0)           0;0  0.1767 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     5.7824 (1.0)      5.7824 (1.0)      5.7824 (1.0)      0.0000 (1.0)      5.7824 (1.0)      0.0000 (1.0)           0;0  0.1729 (1.0)           1           1
test_status-status-noop[3.30.1]     5.8986 (1.02)     5.8986 (1.02)     5.8986 (1.02)     0.0000 (1.0)      5.8986 (1.02)     0.0000 (1.0)           0;0  0.1695 (0.98)          1           1
test_status-status-noop[main]       5.8951 (1.02)     5.8951 (1.02)     5.8951 (1.02)     0.0000 (1.0)      5.8951 (1.02)     0.0000 (1.0)           0;0  0.1696 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in s)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     210.4157 (1.49)     210.4157 (1.49)     210.4157 (1.49)     0.0000 (1.0)      210.4157 (1.49)     0.0000 (1.0)           0;0  0.0048 (0.67)          1           1
test_update-import-url[3.30.1]     141.9079 (1.01)     141.9079 (1.01)     141.9079 (1.01)     0.0000 (1.0)      141.9079 (1.01)     0.0000 (1.0)           0;0  0.0070 (0.99)          1           1
test_update-import-url[main]       140.9640 (1.0)      140.9640 (1.0)      140.9640 (1.0)      0.0000 (1.0)      140.9640 (1.0)      0.0000 (1.0)           0;0  0.0071 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in s)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     191.9921 (1.53)     191.9921 (1.53)     191.9921 (1.53)     0.0000 (1.0)      191.9921 (1.53)     0.0000 (1.0)           0;0  0.0052 (0.66)          1           1
test_update-update[3.30.1]     125.8080 (1.0)      125.8080 (1.0)      125.8080 (1.0)      0.0000 (1.0)      125.8080 (1.0)      0.0000 (1.0)           0;0  0.0079 (1.0)           1           1
test_update-update[main]       126.2192 (1.00)     126.2192 (1.00)     126.2192 (1.00)     0.0000 (1.0)      126.2192 (1.00)     0.0000 (1.0)           0;0  0.0079 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------
Name (time in s)                        Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     19.0997 (1.0)      19.0997 (1.0)      19.0997 (1.0)      0.0000 (1.0)      19.0997 (1.0)      0.0000 (1.0)           0;0  0.0524 (1.0)           1           1
test_update-update-noop[3.30.1]     20.2283 (1.06)     20.2283 (1.06)     20.2283 (1.06)     0.0000 (1.0)      20.2283 (1.06)     0.0000 (1.0)           0;0  0.0494 (0.94)          1           1
test_update-update-noop[main]       20.0370 (1.05)     20.0370 (1.05)     20.0370 (1.05)     0.0000 (1.0)      20.0370 (1.05)     0.0000 (1.0)           0;0  0.0499 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean