Fri Dec  8 21:32:20 UTC 2023
dataset: used-cars
project: example-get-started
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     6.8075 (1.29)     6.8075 (1.29)     6.8075 (1.29)     0.0000 (1.0)      6.8075 (1.29)     0.0000 (1.0)           0;0  0.1469 (0.77)          1           1
test_add-add[3.10.0]     6.0012 (1.14)     6.0012 (1.14)     6.0012 (1.14)     0.0000 (1.0)      6.0012 (1.14)     0.0000 (1.0)           0;0  0.1666 (0.88)          1           1
test_add-add[main]       5.2692 (1.0)      5.2692 (1.0)      5.2692 (1.0)      0.0000 (1.0)      5.2692 (1.0)      0.0000 (1.0)           0;0  0.1898 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     3.0553 (1.0)      3.0553 (1.0)      3.0553 (1.0)      0.0000 (1.0)      3.0553 (1.0)      0.0000 (1.0)           0;0  0.3273 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     3.8577 (1.26)     3.8577 (1.26)     3.8577 (1.26)     0.0000 (1.0)      3.8577 (1.26)     0.0000 (1.0)           0;0  0.2592 (0.79)          1           1
test_checkout_copy-checkout[main]       4.0504 (1.33)     4.0504 (1.33)     4.0504 (1.33)     0.0000 (1.0)      4.0504 (1.33)     0.0000 (1.0)           0;0  0.2469 (0.75)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     796.3527 (2.05)     796.3527 (2.05)     796.3527 (2.05)     0.0000 (1.0)      796.3527 (2.05)     0.0000 (1.0)           0;0  1.2557 (0.49)          1           1
test_checkout_copy-checkout-noop[3.10.0]     388.5158 (1.0)      388.5158 (1.0)      388.5158 (1.0)      0.0000 (1.0)      388.5158 (1.0)      0.0000 (1.0)           0;0  2.5739 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       394.6694 (1.02)     394.6694 (1.02)     394.6694 (1.02)     0.0000 (1.0)      394.6694 (1.02)     0.0000 (1.0)           0;0  2.5338 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     413.2093 (1.0)      413.2093 (1.0)      413.2093 (1.0)      0.0000 (1.0)      413.2093 (1.0)      0.0000 (1.0)           0;0  2.4201 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     430.4349 (1.04)     430.4349 (1.04)     430.4349 (1.04)     0.0000 (1.0)      430.4349 (1.04)     0.0000 (1.0)           0;0  2.3232 (0.96)          1           1
test_checkout_copy-checkout-update[main]       432.4154 (1.05)     432.4154 (1.05)     432.4154 (1.05)     0.0000 (1.0)      432.4154 (1.05)     0.0000 (1.0)           0;0  2.3126 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                  Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]       537.5121 (1.0)        537.5121 (1.0)        537.5121 (1.0)      0.0000 (1.0)        537.5121 (1.0)      0.0000 (1.0)           0;0  1.8604 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]       573.0860 (1.07)       573.0860 (1.07)       573.0860 (1.07)     0.0000 (1.0)        573.0860 (1.07)     0.0000 (1.0)           0;0  1.7449 (0.94)          1           1
test_checkout_hardlink-checkout[main]       2,439.4692 (4.54)     2,439.4692 (4.54)     2,439.4692 (4.54)     0.0000 (1.0)      2,439.4692 (4.54)     0.0000 (1.0)           0;0  0.4099 (0.22)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     393.6587 (1.01)     393.6587 (1.01)     393.6587 (1.01)     0.0000 (1.0)      393.6587 (1.01)     0.0000 (1.0)           0;0  2.5403 (0.99)          1           1
test_checkout_hardlink-checkout-noop[3.10.0]     388.5736 (1.00)     388.5736 (1.00)     388.5736 (1.00)     0.0000 (1.0)      388.5736 (1.00)     0.0000 (1.0)           0;0  2.5735 (1.00)          1           1
test_checkout_hardlink-checkout-noop[main]       388.3457 (1.0)      388.3457 (1.0)      388.3457 (1.0)      0.0000 (1.0)      388.3457 (1.0)      0.0000 (1.0)           0;0  2.5750 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     445.9101 (1.06)     445.9101 (1.06)     445.9101 (1.06)     0.0000 (1.0)      445.9101 (1.06)     0.0000 (1.0)           0;0  2.2426 (0.95)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     424.9189 (1.01)     424.9189 (1.01)     424.9189 (1.01)     0.0000 (1.0)      424.9189 (1.01)     0.0000 (1.0)           0;0  2.3534 (0.99)          1           1
test_checkout_hardlink-checkout-update[main]       421.9233 (1.0)      421.9233 (1.0)      421.9233 (1.0)      0.0000 (1.0)      421.9233 (1.0)      0.0000 (1.0)           0;0  2.3701 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                 Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]       517.4224 (1.0)        517.4224 (1.0)        517.4224 (1.0)      0.0000 (1.0)        517.4224 (1.0)      0.0000 (1.0)           0;0  1.9327 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]       532.3698 (1.03)       532.3698 (1.03)       532.3698 (1.03)     0.0000 (1.0)        532.3698 (1.03)     0.0000 (1.0)           0;0  1.8784 (0.97)          1           1
test_checkout_symlink-checkout[main]       1,909.1228 (3.69)     1,909.1228 (3.69)     1,909.1228 (3.69)     0.0000 (1.0)      1,909.1228 (3.69)     0.0000 (1.0)           0;0  0.5238 (0.27)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     373.3612 (1.0)      373.3612 (1.0)      373.3612 (1.0)      0.0000 (1.0)      373.3612 (1.0)      0.0000 (1.0)           0;0  2.6784 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     384.7861 (1.03)     384.7861 (1.03)     384.7861 (1.03)     0.0000 (1.0)      384.7861 (1.03)     0.0000 (1.0)           0;0  2.5988 (0.97)          1           1
test_checkout_symlink-checkout-noop[main]       379.3472 (1.02)     379.3472 (1.02)     379.3472 (1.02)     0.0000 (1.0)      379.3472 (1.02)     0.0000 (1.0)           0;0  2.6361 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     413.7424 (1.0)      413.7424 (1.0)      413.7424 (1.0)      0.0000 (1.0)      413.7424 (1.0)      0.0000 (1.0)           0;0  2.4170 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     429.9155 (1.04)     429.9155 (1.04)     429.9155 (1.04)     0.0000 (1.0)      429.9155 (1.04)     0.0000 (1.0)           0;0  2.3260 (0.96)          1           1
test_checkout_symlink-checkout-update[main]       419.0395 (1.01)     419.0395 (1.01)     419.0395 (1.01)     0.0000 (1.0)      419.0395 (1.01)     0.0000 (1.0)           0;0  2.3864 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     455.8560 (1.08)     455.8560 (1.08)     455.8560 (1.08)     0.0000 (1.0)      455.8560 (1.08)     0.0000 (1.0)           0;0  2.1937 (0.93)          1           1
test_data_status-data-changed[3.10.0]     422.5361 (1.0)      422.5361 (1.0)      422.5361 (1.0)      0.0000 (1.0)      422.5361 (1.0)      0.0000 (1.0)           0;0  2.3667 (1.0)           1           1
test_data_status-data-changed[main]       551.7192 (1.31)     551.7192 (1.31)     551.7192 (1.31)     0.0000 (1.0)      551.7192 (1.31)     0.0000 (1.0)           0;0  1.8125 (0.77)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                     Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]       456.9146 (1.09)       456.9146 (1.09)       456.9146 (1.09)     0.0000 (1.0)        456.9146 (1.09)     0.0000 (1.0)           0;0  2.1886 (0.92)          1           1
test_data_status-data-changed-noop[3.10.0]       418.6202 (1.0)        418.6202 (1.0)        418.6202 (1.0)      0.0000 (1.0)        418.6202 (1.0)      0.0000 (1.0)           0;0  2.3888 (1.0)           1           1
test_data_status-data-changed-noop[main]       3,076.4495 (7.35)     3,076.4495 (7.35)     3,076.4495 (7.35)     0.0000 (1.0)      3,076.4495 (7.35)     0.0000 (1.0)           0;0  0.3251 (0.14)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     7.0775 (1.25)     7.0775 (1.25)     7.0775 (1.25)     0.0000 (1.0)      7.0775 (1.25)     0.0000 (1.0)           0;0  0.1413 (0.80)          1           1
test_data_status-data-new[3.10.0]     5.6544 (1.0)      5.6544 (1.0)      5.6544 (1.0)      0.0000 (1.0)      5.6544 (1.0)      0.0000 (1.0)           0;0  0.1769 (1.0)           1           1
test_data_status-data-new[main]       6.3156 (1.12)     6.3156 (1.12)     6.3156 (1.12)     0.0000 (1.0)      6.3156 (1.12)     0.0000 (1.0)           0;0  0.1583 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     450.5988 (1.07)     450.5988 (1.07)     450.5988 (1.07)     0.0000 (1.0)      450.5988 (1.07)     0.0000 (1.0)           0;0  2.2193 (0.94)          1           1
test_data_status-data-noop[3.10.0]     423.9241 (1.00)     423.9241 (1.00)     423.9241 (1.00)     0.0000 (1.0)      423.9241 (1.00)     0.0000 (1.0)           0;0  2.3589 (1.00)          1           1
test_data_status-data-noop[main]       422.8598 (1.0)      422.8598 (1.0)      422.8598 (1.0)      0.0000 (1.0)      422.8598 (1.0)      0.0000 (1.0)           0;0  2.3648 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                          Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]       477.2084 (1.0)        477.2084 (1.0)        477.2084 (1.0)      0.0000 (1.0)        477.2084 (1.0)      0.0000 (1.0)           0;0  2.0955 (1.0)           1           1
test_data_status_all_flags-data-changed[3.10.0]       481.8045 (1.01)       481.8045 (1.01)       481.8045 (1.01)     0.0000 (1.0)        481.8045 (1.01)     0.0000 (1.0)           0;0  2.0755 (0.99)          1           1
test_data_status_all_flags-data-changed[main]       3,399.7378 (7.12)     3,399.7378 (7.12)     3,399.7378 (7.12)     0.0000 (1.0)      3,399.7378 (7.12)     0.0000 (1.0)           0;0  0.2941 (0.14)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     2.3078 (4.99)     2.3078 (4.99)     2.3078 (4.99)     0.0000 (1.0)      2.3078 (4.99)     0.0000 (1.0)           0;0  0.4333 (0.20)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     0.4625 (1.0)      0.4625 (1.0)      0.4625 (1.0)      0.0000 (1.0)      0.4625 (1.0)      0.0000 (1.0)           0;0  2.1621 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       0.4960 (1.07)     0.4960 (1.07)     0.4960 (1.07)     0.0000 (1.0)      0.4960 (1.07)     0.0000 (1.0)           0;0  2.0161 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     5.8824 (1.04)     5.8824 (1.04)     5.8824 (1.04)     0.0000 (1.0)      5.8824 (1.04)     0.0000 (1.0)           0;0  0.1700 (0.96)          1           1
test_data_status_all_flags-data-new[3.10.0]     5.6399 (1.0)      5.6399 (1.0)      5.6399 (1.0)      0.0000 (1.0)      5.6399 (1.0)      0.0000 (1.0)           0;0  0.1773 (1.0)           1           1
test_data_status_all_flags-data-new[main]       6.5767 (1.17)     6.5767 (1.17)     6.5767 (1.17)     0.0000 (1.0)      6.5767 (1.17)     0.0000 (1.0)           0;0  0.1521 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     491.9292 (1.13)     491.9292 (1.13)     491.9292 (1.13)     0.0000 (1.0)      491.9292 (1.13)     0.0000 (1.0)           0;0  2.0328 (0.89)          1           1
test_data_status_all_flags-data-noop[3.10.0]     436.8667 (1.0)      436.8667 (1.0)      436.8667 (1.0)      0.0000 (1.0)      436.8667 (1.0)      0.0000 (1.0)           0;0  2.2890 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       479.9290 (1.10)     479.9290 (1.10)     479.9290 (1.10)     0.0000 (1.0)      479.9290 (1.10)     0.0000 (1.0)           0;0  2.0836 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     4.4914 (1.10)     4.4914 (1.10)     4.4914 (1.10)     0.0000 (1.0)      4.4914 (1.10)     0.0000 (1.0)           0;0  0.2226 (0.91)          1           1
test_diff-diff[3.10.0]     5.1881 (1.27)     5.1881 (1.27)     5.1881 (1.27)     0.0000 (1.0)      5.1881 (1.27)     0.0000 (1.0)           0;0  0.1928 (0.78)          1           1
test_diff-diff[main]       4.0718 (1.0)      4.0718 (1.0)      4.0718 (1.0)      0.0000 (1.0)      4.0718 (1.0)      0.0000 (1.0)           0;0  0.2456 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     462.8229 (1.01)     462.8229 (1.01)     462.8229 (1.01)     0.0000 (1.0)      462.8229 (1.01)     0.0000 (1.0)           0;0  2.1607 (0.99)          1           1
test_diff-diff-changed[3.10.0]     460.7955 (1.01)     460.7955 (1.01)     460.7955 (1.01)     0.0000 (1.0)      460.7955 (1.01)     0.0000 (1.0)           0;0  2.1702 (0.99)          1           1
test_diff-diff-changed[main]       458.3191 (1.0)      458.3191 (1.0)      458.3191 (1.0)      0.0000 (1.0)      458.3191 (1.0)      0.0000 (1.0)           0;0  2.1819 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     3.0356 (6.22)     3.0356 (6.22)     3.0356 (6.22)     0.0000 (1.0)      3.0356 (6.22)     0.0000 (1.0)           0;0  0.3294 (0.16)          1           1
test_diff-diff-changed-noop[3.10.0]     1.6218 (3.32)     1.6218 (3.32)     1.6218 (3.32)     0.0000 (1.0)      1.6218 (3.32)     0.0000 (1.0)           0;0  0.6166 (0.30)          1           1
test_diff-diff-changed-noop[main]       0.4883 (1.0)      0.4883 (1.0)      0.4883 (1.0)      0.0000 (1.0)      0.4883 (1.0)      0.0000 (1.0)           0;0  2.0478 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     462.0721 (1.0)      462.0721 (1.0)      462.0721 (1.0)      0.0000 (1.0)      462.0721 (1.0)      0.0000 (1.0)           0;0  2.1642 (1.0)           1           1
test_diff-diff-noop[3.10.0]     476.6963 (1.03)     476.6963 (1.03)     476.6963 (1.03)     0.0000 (1.0)      476.6963 (1.03)     0.0000 (1.0)           0;0  2.0978 (0.97)          1           1
test_diff-diff-noop[main]       470.6948 (1.02)     470.6948 (1.02)     470.6948 (1.02)     0.0000 (1.0)      470.6948 (1.02)     0.0000 (1.0)           0;0  2.1245 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       853.3253 (1.0)        853.3253 (1.0)        853.3253 (1.0)      0.0000 (1.0)        853.3253 (1.0)      0.0000 (1.0)           0;0  1.1719 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,674.3081 (5.48)     4,674.3081 (5.48)     4,674.3081 (5.48)     0.0000 (1.0)      4,674.3081 (5.48)     0.0000 (1.0)           0;0  0.2139 (0.18)          1           1
test_exp_show-exp[main]       4,032.2414 (4.73)     4,032.2414 (4.73)     4,032.2414 (4.73)     0.0000 (1.0)      4,032.2414 (4.73)     0.0000 (1.0)           0;0  0.2480 (0.21)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     2.6320 (1.0)      2.6320 (1.0)      2.6320 (1.0)      0.0000 (1.0)      2.6320 (1.0)      0.0000 (1.0)           0;0  0.3799 (1.0)           1           1
test_fetch-fetch[3.10.0]     2.7756 (1.05)     2.7756 (1.05)     2.7756 (1.05)     0.0000 (1.0)      2.7756 (1.05)     0.0000 (1.0)           0;0  0.3603 (0.95)          1           1
test_fetch-fetch[main]       2.8286 (1.07)     2.8286 (1.07)     2.8286 (1.07)     0.0000 (1.0)      2.8286 (1.07)     0.0000 (1.0)           0;0  0.3535 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests --------------------------------------------------------------------------------
Name (time in ms)             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]       643.3541 (1.0)        643.3541 (1.0)        643.3541 (1.0)      0.0000 (1.0)        643.3541 (1.0)      0.0000 (1.0)           0;0  1.5544 (1.0)           1           1
test_gc-gc[3.10.0]       664.5138 (1.03)       664.5138 (1.03)       664.5138 (1.03)     0.0000 (1.0)        664.5138 (1.03)     0.0000 (1.0)           0;0  1.5049 (0.97)          1           1
test_gc-gc[main]       1,321.8624 (2.05)     1,321.8624 (2.05)     1,321.8624 (2.05)     0.0000 (1.0)      1,321.8624 (2.05)     0.0000 (1.0)           0;0  0.7565 (0.49)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     2.4290 (1.25)     2.4290 (1.25)     2.4290 (1.25)     0.0000 (1.0)      2.4290 (1.25)     0.0000 (1.0)           0;0  0.4117 (0.80)          1           1
test_get-get[3.10.0]     2.3392 (1.20)     2.3392 (1.20)     2.3392 (1.20)     0.0000 (1.0)      2.3392 (1.20)     0.0000 (1.0)           0;0  0.4275 (0.83)          1           1
test_get-get[main]       1.9458 (1.0)      1.9458 (1.0)      1.9458 (1.0)      0.0000 (1.0)      1.9458 (1.0)      0.0000 (1.0)           0;0  0.5139 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     1.7790 (1.0)      1.7790 (1.0)      1.7790 (1.0)      0.0000 (1.0)      1.7790 (1.0)      0.0000 (1.0)           0;0  0.5621 (1.0)           1           1
test_get_url-get-url[3.10.0]     1.8115 (1.02)     1.8115 (1.02)     1.8115 (1.02)     0.0000 (1.0)      1.8115 (1.02)     0.0000 (1.0)           0;0  0.5520 (0.98)          1           1
test_get_url-get-url[main]       3.5390 (1.99)     3.5390 (1.99)     3.5390 (1.99)     0.0000 (1.0)      3.5390 (1.99)     0.0000 (1.0)           0;0  0.2826 (0.50)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.3210 (1.02)     129.5690 (1.00)     127.0861 (1.02)     0.8218 (1.0)      126.9655 (1.02)     1.2028 (1.25)         27;1  7.8687 (0.98)        100           1
test_help---help[3.10.0]     123.1062 (1.0)      129.0776 (1.0)      124.5561 (1.0)      0.9187 (1.12)     124.4394 (1.0)      0.9619 (1.0)          18;5  8.0285 (1.0)         100           1
test_help---help[main]       123.5289 (1.00)     136.5173 (1.06)     125.5934 (1.01)     1.4794 (1.80)     125.3293 (1.01)     1.0800 (1.12)          8;7  7.9622 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     10.0790 (1.40)     10.0790 (1.40)     10.0790 (1.40)     0.0000 (1.0)      10.0790 (1.40)     0.0000 (1.0)           0;0  0.0992 (0.71)          1           1
test_import-import[3.10.0]      7.7352 (1.07)      7.7352 (1.07)      7.7352 (1.07)     0.0000 (1.0)       7.7352 (1.07)     0.0000 (1.0)           0;0  0.1293 (0.93)          1           1
test_import-import[main]        7.2040 (1.0)       7.2040 (1.0)       7.2040 (1.0)      0.0000 (1.0)       7.2040 (1.0)      0.0000 (1.0)           0;0  0.1388 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     12.3161 (1.27)     12.3161 (1.27)     12.3161 (1.27)     0.0000 (1.0)      12.3161 (1.27)     0.0000 (1.0)           0;0  0.0812 (0.79)          1           1
test_import_url-import-url[3.10.0]      9.7123 (1.0)       9.7123 (1.0)       9.7123 (1.0)      0.0000 (1.0)       9.7123 (1.0)      0.0000 (1.0)           0;0  0.1030 (1.0)           1           1
test_import_url-import-url[main]       10.1702 (1.05)     10.1702 (1.05)     10.1702 (1.05)     0.0000 (1.0)      10.1702 (1.05)     0.0000 (1.0)           0;0  0.0983 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     364.4258 (1.0)      398.9452 (1.0)      374.8090 (1.0)       6.3904 (1.0)      374.0806 (1.0)       8.4097 (1.0)          30;3  2.6680 (1.0)         100           1
test_init-init[3.10.0]     368.9172 (1.01)     439.7090 (1.10)     385.0901 (1.03)     11.2968 (1.77)     382.3146 (1.02)     13.0593 (1.55)         23;3  2.5968 (0.97)        100           1
test_init-init[main]       384.9517 (1.06)     447.7158 (1.12)     405.1875 (1.08)     13.2801 (2.08)     403.6982 (1.08)     19.8178 (2.36)         28;2  2.4680 (0.93)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     404.8438 (1.02)     404.8438 (1.02)     404.8438 (1.02)     0.0000 (1.0)      404.8438 (1.02)     0.0000 (1.0)           0;0  2.4701 (0.98)          1           1
test_list-list[3.10.0]     409.2455 (1.04)     409.2455 (1.04)     409.2455 (1.04)     0.0000 (1.0)      409.2455 (1.04)     0.0000 (1.0)           0;0  2.4435 (0.97)          1           1
test_list-list[main]       395.1146 (1.0)      395.1146 (1.0)      395.1146 (1.0)      0.0000 (1.0)      395.1146 (1.0)      0.0000 (1.0)           0;0  2.5309 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     392.4762 (1.01)     392.4762 (1.01)     392.4762 (1.01)     0.0000 (1.0)      392.4762 (1.01)     0.0000 (1.0)           0;0  2.5479 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     395.5928 (1.02)     395.5928 (1.02)     395.5928 (1.02)     0.0000 (1.0)      395.5928 (1.02)     0.0000 (1.0)           0;0  2.5279 (0.98)          1           1
test_list-list-dvc-only[main]       388.2522 (1.0)      388.2522 (1.0)      388.2522 (1.0)      0.0000 (1.0)      388.2522 (1.0)      0.0000 (1.0)           0;0  2.5756 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     398.3660 (1.02)     398.3660 (1.02)     398.3660 (1.02)     0.0000 (1.0)      398.3660 (1.02)     0.0000 (1.0)           0;0  2.5103 (0.98)          1           1
test_list-list-recursive[3.10.0]     404.6886 (1.04)     404.6886 (1.04)     404.6886 (1.04)     0.0000 (1.0)      404.6886 (1.04)     0.0000 (1.0)           0;0  2.4710 (0.96)          1           1
test_list-list-recursive[main]       390.2292 (1.0)      390.2292 (1.0)      390.2292 (1.0)      0.0000 (1.0)      390.2292 (1.0)      0.0000 (1.0)           0;0  2.5626 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     392.9932 (1.02)     392.9932 (1.02)     392.9932 (1.02)     0.0000 (1.0)      392.9932 (1.02)     0.0000 (1.0)           0;0  2.5446 (0.98)          1           1
test_list-list-shallow[3.10.0]     391.7067 (1.01)     391.7067 (1.01)     391.7067 (1.01)     0.0000 (1.0)      391.7067 (1.01)     0.0000 (1.0)           0;0  2.5529 (0.99)          1           1
test_list-list-shallow[main]       386.5935 (1.0)      386.5935 (1.0)      386.5935 (1.0)      0.0000 (1.0)      386.5935 (1.0)      0.0000 (1.0)           0;0  2.5867 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     7.3794 (1.25)     7.3794 (1.25)     7.3794 (1.25)     0.0000 (1.0)      7.3794 (1.25)     0.0000 (1.0)           0;0  0.1355 (0.80)          1           1
test_partial_add-add[3.10.0]     5.9244 (1.00)     5.9244 (1.00)     5.9244 (1.00)     0.0000 (1.0)      5.9244 (1.00)     0.0000 (1.0)           0;0  0.1688 (1.00)          1           1
test_partial_add-add[main]       5.9190 (1.0)      5.9190 (1.0)      5.9190 (1.0)      0.0000 (1.0)      5.9190 (1.0)      0.0000 (1.0)           0;0  0.1689 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.2745 (1.44)     3.2745 (1.44)     3.2745 (1.44)     0.0000 (1.0)      3.2745 (1.44)     0.0000 (1.0)           0;0  0.3054 (0.69)          1           1
test_partial_add-add-partial[3.10.0]     3.6487 (1.60)     3.6487 (1.60)     3.6487 (1.60)     0.0000 (1.0)      3.6487 (1.60)     0.0000 (1.0)           0;0  0.2741 (0.62)          1           1
test_partial_add-add-partial[main]       2.2736 (1.0)      2.2736 (1.0)      2.2736 (1.0)      0.0000 (1.0)      2.2736 (1.0)      0.0000 (1.0)           0;0  0.4398 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     393.9484 (1.02)     393.9484 (1.02)     393.9484 (1.02)     0.0000 (1.0)      393.9484 (1.02)     0.0000 (1.0)           0;0  2.5384 (0.98)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     385.9654 (1.0)      385.9654 (1.0)      385.9654 (1.0)      0.0000 (1.0)      385.9654 (1.0)      0.0000 (1.0)           0;0  2.5909 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       389.9566 (1.01)     389.9566 (1.01)     389.9566 (1.01)     0.0000 (1.0)      389.9566 (1.01)     0.0000 (1.0)           0;0  2.5644 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     377.1170 (1.0)      377.1170 (1.0)      377.1170 (1.0)      0.0000 (1.0)      377.1170 (1.0)      0.0000 (1.0)           0;0  2.6517 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     384.7055 (1.02)     384.7055 (1.02)     384.7055 (1.02)     0.0000 (1.0)      384.7055 (1.02)     0.0000 (1.0)           0;0  2.5994 (0.98)          1           1
test_partial_add-gc-noop[main]       385.4367 (1.02)     385.4367 (1.02)     385.4367 (1.02)     0.0000 (1.0)      385.4367 (1.02)     0.0000 (1.0)           0;0  2.5945 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     3.5806 (1.20)     3.5806 (1.20)     3.5806 (1.20)     0.0000 (1.0)      3.5806 (1.20)     0.0000 (1.0)           0;0  0.2793 (0.83)          1           1
test_partial_add-push[3.10.0]     2.9773 (1.0)      2.9773 (1.0)      2.9773 (1.0)      0.0000 (1.0)      2.9773 (1.0)      0.0000 (1.0)           0;0  0.3359 (1.0)           1           1
test_partial_add-push[main]       5.2158 (1.75)     5.2158 (1.75)     5.2158 (1.75)     0.0000 (1.0)      5.2158 (1.75)     0.0000 (1.0)           0;0  0.1917 (0.57)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     957.4147 (1.28)     957.4147 (1.28)     957.4147 (1.28)     0.0000 (1.0)      957.4147 (1.28)     0.0000 (1.0)           0;0  1.0445 (0.78)          1           1
test_partial_add-push-partial[3.10.0]     745.5739 (1.0)      745.5739 (1.0)      745.5739 (1.0)      0.0000 (1.0)      745.5739 (1.0)      0.0000 (1.0)           0;0  1.3412 (1.0)           1           1
test_partial_add-push-partial[main]       769.8420 (1.03)     769.8420 (1.03)     769.8420 (1.03)     0.0000 (1.0)      769.8420 (1.03)     0.0000 (1.0)           0;0  1.2990 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     7.2150 (1.21)     7.2150 (1.21)     7.2150 (1.21)     0.0000 (1.0)      7.2150 (1.21)     0.0000 (1.0)           0;0  0.1386 (0.83)          1           1
test_partial_remove-add[3.10.0]     6.0681 (1.02)     6.0681 (1.02)     6.0681 (1.02)     0.0000 (1.0)      6.0681 (1.02)     0.0000 (1.0)           0;0  0.1648 (0.98)          1           1
test_partial_remove-add[main]       5.9578 (1.0)      5.9578 (1.0)      5.9578 (1.0)      0.0000 (1.0)      5.9578 (1.0)      0.0000 (1.0)           0;0  0.1678 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     497.0837 (1.0)      497.0837 (1.0)      497.0837 (1.0)      0.0000 (1.0)      497.0837 (1.0)      0.0000 (1.0)           0;0  2.0117 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     505.7818 (1.02)     505.7818 (1.02)     505.7818 (1.02)     0.0000 (1.0)      505.7818 (1.02)     0.0000 (1.0)           0;0  1.9771 (0.98)          1           1
test_partial_remove-add-update[main]       509.9578 (1.03)     509.9578 (1.03)     509.9578 (1.03)     0.0000 (1.0)      509.9578 (1.03)     0.0000 (1.0)           0;0  1.9609 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     590.1984 (1.0)      590.1984 (1.0)      590.1984 (1.0)      0.0000 (1.0)      590.1984 (1.0)      0.0000 (1.0)           0;0  1.6943 (1.0)           1           1
test_partial_remove-gc[3.10.0]     598.9813 (1.01)     598.9813 (1.01)     598.9813 (1.01)     0.0000 (1.0)      598.9813 (1.01)     0.0000 (1.0)           0;0  1.6695 (0.99)          1           1
test_partial_remove-gc[main]       595.5234 (1.01)     595.5234 (1.01)     595.5234 (1.01)     0.0000 (1.0)      595.5234 (1.01)     0.0000 (1.0)           0;0  1.6792 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     635.3960 (1.0)      635.3960 (1.0)      635.3960 (1.0)      0.0000 (1.0)      635.3960 (1.0)      0.0000 (1.0)           0;0  1.5738 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     643.2163 (1.01)     643.2163 (1.01)     643.2163 (1.01)     0.0000 (1.0)      643.2163 (1.01)     0.0000 (1.0)           0;0  1.5547 (0.99)          1           1
test_partial_remove-gc-cloud[main]       637.2512 (1.00)     637.2512 (1.00)     637.2512 (1.00)     0.0000 (1.0)      637.2512 (1.00)     0.0000 (1.0)           0;0  1.5692 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     2.8128 (1.0)      2.8128 (1.0)      2.8128 (1.0)      0.0000 (1.0)      2.8128 (1.0)      0.0000 (1.0)           0;0  0.3555 (1.0)           1           1
test_partial_remove-push[3.10.0]     3.1773 (1.13)     3.1773 (1.13)     3.1773 (1.13)     0.0000 (1.0)      3.1773 (1.13)     0.0000 (1.0)           0;0  0.3147 (0.89)          1           1
test_partial_remove-push[main]       4.6689 (1.66)     4.6689 (1.66)     4.6689 (1.66)     0.0000 (1.0)      4.6689 (1.66)     0.0000 (1.0)           0;0  0.2142 (0.60)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     391.0413 (1.03)     391.0413 (1.03)     391.0413 (1.03)     0.0000 (1.0)      391.0413 (1.03)     0.0000 (1.0)           0;0  2.5573 (0.97)          1           1
test_partial_remove-push-update[3.10.0]     380.1501 (1.0)      380.1501 (1.0)      380.1501 (1.0)      0.0000 (1.0)      380.1501 (1.0)      0.0000 (1.0)           0;0  2.6305 (1.0)           1           1
test_partial_remove-push-update[main]       405.5627 (1.07)     405.5627 (1.07)     405.5627 (1.07)     0.0000 (1.0)      405.5627 (1.07)     0.0000 (1.0)           0;0  2.4657 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     428.1248 (1.0)      443.8832 (1.0)      436.3348 (1.0)      6.8092 (1.44)     436.3468 (1.0)      12.2147 (1.63)          2;0  2.2918 (1.0)           5           3
test_plots-plots-diff[3.10.0]     786.0824 (1.84)     797.8980 (1.80)     791.7345 (1.81)     4.7222 (1.0)      790.7913 (1.81)      7.4887 (1.0)           2;0  1.2630 (0.55)          5           3
test_plots-plots-diff[main]       772.6921 (1.80)     791.0278 (1.78)     781.6372 (1.79)     7.4171 (1.57)     783.0349 (1.79)     11.9479 (1.60)          2;0  1.2794 (0.56)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       443.6222 (1.0)        472.7246 (1.0)        459.3927 (1.0)      11.7556 (2.93)       455.9514 (1.0)      17.7328 (3.05)          2;0  2.1768 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,044.4389 (2.35)     1,054.9145 (2.23)     1,049.4144 (2.28)      4.0063 (1.0)      1,049.0487 (2.30)      5.8097 (1.0)           2;0  0.9529 (0.44)          5           3
test_plots-plots-diff-json[main]         844.2209 (1.90)       863.9101 (1.83)       853.5127 (1.86)      7.1940 (1.80)       853.6808 (1.87)      8.5554 (1.47)          2;0  1.1716 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     395.8962 (1.0)      413.8864 (1.0)      401.4303 (1.0)      7.3169 (2.04)     399.2410 (1.0)      8.2285 (1.80)          1;0  2.4911 (1.0)           5           3
test_plots-plots-show[3.10.0]     661.8701 (1.67)     669.5953 (1.62)     665.0453 (1.66)     3.5867 (1.0)      662.8103 (1.66)     6.0812 (1.33)          1;0  1.5037 (0.60)          5           3
test_plots-plots-show[main]       654.5799 (1.65)     668.4366 (1.62)     662.3870 (1.65)     4.9950 (1.39)     663.2729 (1.66)     4.5701 (1.0)           2;0  1.5097 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     417.7170 (1.0)      423.7096 (1.0)      420.0063 (1.0)      2.4526 (1.0)      419.6896 (1.0)      3.7239 (1.0)           1;0  2.3809 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     803.8834 (1.92)     822.3246 (1.94)     817.0932 (1.95)     7.5348 (3.07)     818.9539 (1.95)     6.4620 (1.74)          1;1  1.2239 (0.51)          5           3
test_plots-plots-show-json[main]       725.6083 (1.74)     732.6100 (1.73)     729.1490 (1.74)     2.8227 (1.15)     729.8142 (1.74)     4.5045 (1.21)          2;0  1.3715 (0.58)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.3853 (1.02)     3.3853 (1.02)     3.3853 (1.02)     0.0000 (1.0)      3.3853 (1.02)     0.0000 (1.0)           0;0  0.2954 (0.98)          1           1
test_push-push[3.10.0]     3.3133 (1.0)      3.3133 (1.0)      3.3133 (1.0)      0.0000 (1.0)      3.3133 (1.0)      0.0000 (1.0)           0;0  0.3018 (1.0)           1           1
test_push-push[main]       5.4819 (1.65)     5.4819 (1.65)     5.4819 (1.65)     0.0000 (1.0)      5.4819 (1.65)     0.0000 (1.0)           0;0  0.1824 (0.60)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     7.6237 (1.42)     7.6237 (1.42)     7.6237 (1.42)     0.0000 (1.0)      7.6237 (1.42)     0.0000 (1.0)           0;0  0.1312 (0.71)          1           1
test_sharing-add[3.10.0]     5.3792 (1.0)      5.3792 (1.0)      5.3792 (1.0)      0.0000 (1.0)      5.3792 (1.0)      0.0000 (1.0)           0;0  0.1859 (1.0)           1           1
test_sharing-add[main]       5.6980 (1.06)     5.6980 (1.06)     5.6980 (1.06)     0.0000 (1.0)      5.6980 (1.06)     0.0000 (1.0)           0;0  0.1755 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     3.8972 (1.61)     3.8972 (1.61)     3.8972 (1.61)     0.0000 (1.0)      3.8972 (1.61)     0.0000 (1.0)           0;0  0.2566 (0.62)          1           1
test_sharing-add-noop[3.10.0]     3.4477 (1.43)     3.4477 (1.43)     3.4477 (1.43)     0.0000 (1.0)      3.4477 (1.43)     0.0000 (1.0)           0;0  0.2901 (0.70)          1           1
test_sharing-add-noop[main]       2.4166 (1.0)      2.4166 (1.0)      2.4166 (1.0)      0.0000 (1.0)      2.4166 (1.0)      0.0000 (1.0)           0;0  0.4138 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     3.2600 (1.70)     3.2600 (1.70)     3.2600 (1.70)     0.0000 (1.0)      3.2600 (1.70)     0.0000 (1.0)           0;0  0.3067 (0.59)          1           1
test_sharing-checkout[3.10.0]     3.6389 (1.90)     3.6389 (1.90)     3.6389 (1.90)     0.0000 (1.0)      3.6389 (1.90)     0.0000 (1.0)           0;0  0.2748 (0.53)          1           1
test_sharing-checkout[main]       1.9154 (1.0)      1.9154 (1.0)      1.9154 (1.0)      0.0000 (1.0)      1.9154 (1.0)      0.0000 (1.0)           0;0  0.5221 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     560.5221 (1.43)     560.5221 (1.43)     560.5221 (1.43)     0.0000 (1.0)      560.5221 (1.43)     0.0000 (1.0)           0;0  1.7841 (0.70)          1           1
test_sharing-checkout-noop[3.10.0]     390.6535 (1.0)      390.6535 (1.0)      390.6535 (1.0)      0.0000 (1.0)      390.6535 (1.0)      0.0000 (1.0)           0;0  2.5598 (1.0)           1           1
test_sharing-checkout-noop[main]       397.2816 (1.02)     397.2816 (1.02)     397.2816 (1.02)     0.0000 (1.0)      397.2816 (1.02)     0.0000 (1.0)           0;0  2.5171 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     2.7047 (1.02)     2.7047 (1.02)     2.7047 (1.02)     0.0000 (1.0)      2.7047 (1.02)     0.0000 (1.0)           0;0  0.3697 (0.98)          1           1
test_sharing-fetch[3.10.0]     2.6478 (1.0)      2.6478 (1.0)      2.6478 (1.0)      0.0000 (1.0)      2.6478 (1.0)      0.0000 (1.0)           0;0  0.3777 (1.0)           1           1
test_sharing-fetch[main]       2.7537 (1.04)     2.7537 (1.04)     2.7537 (1.04)     0.0000 (1.0)      2.7537 (1.04)     0.0000 (1.0)           0;0  0.3631 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     393.1138 (1.0)      393.1138 (1.0)      393.1138 (1.0)      0.0000 (1.0)      393.1138 (1.0)      0.0000 (1.0)           0;0  2.5438 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     401.7159 (1.02)     401.7159 (1.02)     401.7159 (1.02)     0.0000 (1.0)      401.7159 (1.02)     0.0000 (1.0)           0;0  2.4893 (0.98)          1           1
test_sharing-fetch-noop[main]       418.6390 (1.06)     418.6390 (1.06)     418.6390 (1.06)     0.0000 (1.0)      418.6390 (1.06)     0.0000 (1.0)           0;0  2.3887 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.3758 (1.0)      3.3758 (1.0)      3.3758 (1.0)      0.0000 (1.0)      3.3758 (1.0)      0.0000 (1.0)           0;0  0.2962 (1.0)           1           1
test_sharing-push[3.10.0]     3.5850 (1.06)     3.5850 (1.06)     3.5850 (1.06)     0.0000 (1.0)      3.5850 (1.06)     0.0000 (1.0)           0;0  0.2789 (0.94)          1           1
test_sharing-push[main]       3.5166 (1.04)     3.5166 (1.04)     3.5166 (1.04)     0.0000 (1.0)      3.5166 (1.04)     0.0000 (1.0)           0;0  0.2844 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     541.9336 (1.40)     541.9336 (1.40)     541.9336 (1.40)     0.0000 (1.0)      541.9336 (1.40)     0.0000 (1.0)           0;0  1.8452 (0.71)          1           1
test_sharing-push-noop[3.10.0]     387.2126 (1.0)      387.2126 (1.0)      387.2126 (1.0)      0.0000 (1.0)      387.2126 (1.0)      0.0000 (1.0)           0;0  2.5826 (1.0)           1           1
test_sharing-push-noop[main]       431.5497 (1.11)     431.5497 (1.11)     431.5497 (1.11)     0.0000 (1.0)      431.5497 (1.11)     0.0000 (1.0)           0;0  2.3172 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                      Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.58.2]     7.1273 (1.56)     7.1273 (1.56)     7.1273 (1.56)     0.0000 (1.0)      7.1273 (1.56)     0.0000 (1.0)           0;0  0.1403 (0.64)          1           1
test_sharing_azure-add[3.10.0]     4.5804 (1.0)      4.5804 (1.0)      4.5804 (1.0)      0.0000 (1.0)      4.5804 (1.0)      0.0000 (1.0)           0;0  0.2183 (1.0)           1           1
test_sharing_azure-add[main]       5.7624 (1.26)     5.7624 (1.26)     5.7624 (1.26)     0.0000 (1.0)      5.7624 (1.26)     0.0000 (1.0)           0;0  0.1735 (0.79)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.58.2]     2.3190 (1.0)      2.3190 (1.0)      2.3190 (1.0)      0.0000 (1.0)      2.3190 (1.0)      0.0000 (1.0)           0;0  0.4312 (1.0)           1           1
test_sharing_azure-add-noop[3.10.0]     3.2558 (1.40)     3.2558 (1.40)     3.2558 (1.40)     0.0000 (1.0)      3.2558 (1.40)     0.0000 (1.0)           0;0  0.3071 (0.71)          1           1
test_sharing_azure-add-noop[main]       2.6600 (1.15)     2.6600 (1.15)     2.6600 (1.15)     0.0000 (1.0)      2.6600 (1.15)     0.0000 (1.0)           0;0  0.3759 (0.87)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout[2.58.2]     2.7320 (1.45)     2.7320 (1.45)     2.7320 (1.45)     0.0000 (1.0)      2.7320 (1.45)     0.0000 (1.0)           0;0  0.3660 (0.69)          1           1
test_sharing_azure-checkout[3.10.0]     3.5824 (1.90)     3.5824 (1.90)     3.5824 (1.90)     0.0000 (1.0)      3.5824 (1.90)     0.0000 (1.0)           0;0  0.2791 (0.53)          1           1
test_sharing_azure-checkout[main]       1.8868 (1.0)      1.8868 (1.0)      1.8868 (1.0)      0.0000 (1.0)      1.8868 (1.0)      0.0000 (1.0)           0;0  0.5300 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-checkout-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.58.2]     1.1501 (2.97)     1.1501 (2.97)     1.1501 (2.97)     0.0000 (1.0)      1.1501 (2.97)     0.0000 (1.0)           0;0  0.8695 (0.34)          1           1
test_sharing_azure-checkout-noop[3.10.0]     0.3868 (1.0)      0.3868 (1.0)      0.3868 (1.0)      0.0000 (1.0)      0.3868 (1.0)      0.0000 (1.0)           0;0  2.5850 (1.0)           1           1
test_sharing_azure-checkout-noop[main]       0.4307 (1.11)     0.4307 (1.11)     0.4307 (1.11)     0.0000 (1.0)      0.4307 (1.11)     0.0000 (1.0)           0;0  2.3216 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch[2.58.2]     2.7170 (1.45)     2.7170 (1.45)     2.7170 (1.45)     0.0000 (1.0)      2.7170 (1.45)     0.0000 (1.0)           0;0  0.3681 (0.69)          1           1
test_sharing_azure-fetch[3.10.0]     2.7484 (1.46)     2.7484 (1.46)     2.7484 (1.46)     0.0000 (1.0)      2.7484 (1.46)     0.0000 (1.0)           0;0  0.3638 (0.68)          1           1
test_sharing_azure-fetch[main]       1.8780 (1.0)      1.8780 (1.0)      1.8780 (1.0)      0.0000 (1.0)      1.8780 (1.0)      0.0000 (1.0)           0;0  0.5325 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_azure-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-fetch-noop[2.58.2]     410.2588 (1.01)     410.2588 (1.01)     410.2588 (1.01)     0.0000 (1.0)      410.2588 (1.01)     0.0000 (1.0)           0;0  2.4375 (0.99)          1           1
test_sharing_azure-fetch-noop[3.10.0]     406.2954 (1.0)      406.2954 (1.0)      406.2954 (1.0)      0.0000 (1.0)      406.2954 (1.0)      0.0000 (1.0)           0;0  2.4613 (1.0)           1           1
test_sharing_azure-fetch-noop[main]       410.7706 (1.01)     410.7706 (1.01)     410.7706 (1.01)     0.0000 (1.0)      410.7706 (1.01)     0.0000 (1.0)           0;0  2.4344 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_azure-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.58.2]     3.2057 (1.0)      3.2057 (1.0)      3.2057 (1.0)      0.0000 (1.0)      3.2057 (1.0)      0.0000 (1.0)           0;0  0.3119 (1.0)           1           1
test_sharing_azure-push[3.10.0]     3.2592 (1.02)     3.2592 (1.02)     3.2592 (1.02)     0.0000 (1.0)      3.2592 (1.02)     0.0000 (1.0)           0;0  0.3068 (0.98)          1           1
test_sharing_azure-push[main]       3.2383 (1.01)     3.2383 (1.01)     3.2383 (1.01)     0.0000 (1.0)      3.2383 (1.01)     0.0000 (1.0)           0;0  0.3088 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                               Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.58.2]       742.8716 (1.36)       742.8716 (1.36)       742.8716 (1.36)     0.0000 (1.0)        742.8716 (1.36)     0.0000 (1.0)           0;0  1.3461 (0.73)          1           1
test_sharing_azure-push-noop[3.10.0]       545.7668 (1.0)        545.7668 (1.0)        545.7668 (1.0)      0.0000 (1.0)        545.7668 (1.0)      0.0000 (1.0)           0;0  1.8323 (1.0)           1           1
test_sharing_azure-push-noop[main]       4,028.8169 (7.38)     4,028.8169 (7.38)     4,028.8169 (7.38)     0.0000 (1.0)      4,028.8169 (7.38)     0.0000 (1.0)           0;0  0.2482 (0.14)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_sharing_gs-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.58.2]     7.4876 (1.65)     7.4876 (1.65)     7.4876 (1.65)     0.0000 (1.0)      7.4876 (1.65)     0.0000 (1.0)           0;0  0.1336 (0.61)          1           1
test_sharing_gs-add[3.10.0]     4.5339 (1.0)      4.5339 (1.0)      4.5339 (1.0)      0.0000 (1.0)      4.5339 (1.0)      0.0000 (1.0)           0;0  0.2206 (1.0)           1           1
test_sharing_gs-add[main]       5.4851 (1.21)     5.4851 (1.21)     5.4851 (1.21)     0.0000 (1.0)      5.4851 (1.21)     0.0000 (1.0)           0;0  0.1823 (0.83)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.58.2]     2.6488 (1.0)      2.6488 (1.0)      2.6488 (1.0)      0.0000 (1.0)      2.6488 (1.0)      0.0000 (1.0)           0;0  0.3775 (1.0)           1           1
test_sharing_gs-add-noop[3.10.0]     3.9540 (1.49)     3.9540 (1.49)     3.9540 (1.49)     0.0000 (1.0)      3.9540 (1.49)     0.0000 (1.0)           0;0  0.2529 (0.67)          1           1
test_sharing_gs-add-noop[main]       2.8083 (1.06)     2.8083 (1.06)     2.8083 (1.06)     0.0000 (1.0)      2.8083 (1.06)     0.0000 (1.0)           0;0  0.3561 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout[2.58.2]     3.5434 (1.86)     3.5434 (1.86)     3.5434 (1.86)     0.0000 (1.0)      3.5434 (1.86)     0.0000 (1.0)           0;0  0.2822 (0.54)          1           1
test_sharing_gs-checkout[3.10.0]     3.8216 (2.01)     3.8216 (2.01)     3.8216 (2.01)     0.0000 (1.0)      3.8216 (2.01)     0.0000 (1.0)           0;0  0.2617 (0.50)          1           1
test_sharing_gs-checkout[main]       1.9038 (1.0)      1.9038 (1.0)      1.9038 (1.0)      0.0000 (1.0)      1.9038 (1.0)      0.0000 (1.0)           0;0  0.5253 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.58.2]     446.3419 (1.19)     446.3419 (1.19)     446.3419 (1.19)     0.0000 (1.0)      446.3419 (1.19)     0.0000 (1.0)           0;0  2.2404 (0.84)          1           1
test_sharing_gs-checkout-noop[3.10.0]     374.2392 (1.0)      374.2392 (1.0)      374.2392 (1.0)      0.0000 (1.0)      374.2392 (1.0)      0.0000 (1.0)           0;0  2.6721 (1.0)           1           1
test_sharing_gs-checkout-noop[main]       382.3166 (1.02)     382.3166 (1.02)     382.3166 (1.02)     0.0000 (1.0)      382.3166 (1.02)     0.0000 (1.0)           0;0  2.6156 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch[2.58.2]     2.6611 (1.0)      2.6611 (1.0)      2.6611 (1.0)      0.0000 (1.0)      2.6611 (1.0)      0.0000 (1.0)           0;0  0.3758 (1.0)           1           1
test_sharing_gs-fetch[3.10.0]     2.7218 (1.02)     2.7218 (1.02)     2.7218 (1.02)     0.0000 (1.0)      2.7218 (1.02)     0.0000 (1.0)           0;0  0.3674 (0.98)          1           1
test_sharing_gs-fetch[main]       2.9123 (1.09)     2.9123 (1.09)     2.9123 (1.09)     0.0000 (1.0)      2.9123 (1.09)     0.0000 (1.0)           0;0  0.3434 (0.91)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_gs-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-fetch-noop[2.58.2]     376.6258 (1.01)     376.6258 (1.01)     376.6258 (1.01)     0.0000 (1.0)      376.6258 (1.01)     0.0000 (1.0)           0;0  2.6552 (0.99)          1           1
test_sharing_gs-fetch-noop[3.10.0]     374.5466 (1.0)      374.5466 (1.0)      374.5466 (1.0)      0.0000 (1.0)      374.5466 (1.0)      0.0000 (1.0)           0;0  2.6699 (1.0)           1           1
test_sharing_gs-fetch-noop[main]       919.4821 (2.45)     919.4821 (2.45)     919.4821 (2.45)     0.0000 (1.0)      919.4821 (2.45)     0.0000 (1.0)           0;0  1.0876 (0.41)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.58.2]     2.3811 (1.0)      2.3811 (1.0)      2.3811 (1.0)      0.0000 (1.0)      2.3811 (1.0)      0.0000 (1.0)           0;0  0.4200 (1.0)           1           1
test_sharing_gs-push[3.10.0]     3.6078 (1.52)     3.6078 (1.52)     3.6078 (1.52)     0.0000 (1.0)      3.6078 (1.52)     0.0000 (1.0)           0;0  0.2772 (0.66)          1           1
test_sharing_gs-push[main]       4.1618 (1.75)     4.1618 (1.75)     4.1618 (1.75)     0.0000 (1.0)      4.1618 (1.75)     0.0000 (1.0)           0;0  0.2403 (0.57)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_gs-push-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.58.2]     1.4712 (4.01)     1.4712 (4.01)     1.4712 (4.01)     0.0000 (1.0)      1.4712 (4.01)     0.0000 (1.0)           0;0  0.6797 (0.25)          1           1
test_sharing_gs-push-noop[3.10.0]     0.3670 (1.0)      0.3670 (1.0)      0.3670 (1.0)      0.0000 (1.0)      0.3670 (1.0)      0.0000 (1.0)           0;0  2.7249 (1.0)           1           1
test_sharing_gs-push-noop[main]       0.3885 (1.06)     0.3885 (1.06)     0.3885 (1.06)     0.0000 (1.0)      0.3885 (1.06)     0.0000 (1.0)           0;0  2.5739 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.58.2]     7.3974 (1.60)     7.3974 (1.60)     7.3974 (1.60)     0.0000 (1.0)      7.3974 (1.60)     0.0000 (1.0)           0;0  0.1352 (0.62)          1           1
test_sharing_s3-add[3.10.0]     5.9168 (1.28)     5.9168 (1.28)     5.9168 (1.28)     0.0000 (1.0)      5.9168 (1.28)     0.0000 (1.0)           0;0  0.1690 (0.78)          1           1
test_sharing_s3-add[main]       4.6172 (1.0)      4.6172 (1.0)      4.6172 (1.0)      0.0000 (1.0)      4.6172 (1.0)      0.0000 (1.0)           0;0  0.2166 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.58.2]     2.3020 (1.00)     2.3020 (1.00)     2.3020 (1.00)     0.0000 (1.0)      2.3020 (1.00)     0.0000 (1.0)           0;0  0.4344 (1.00)          1           1
test_sharing_s3-add-noop[3.10.0]     2.2954 (1.0)      2.2954 (1.0)      2.2954 (1.0)      0.0000 (1.0)      2.2954 (1.0)      0.0000 (1.0)           0;0  0.4357 (1.0)           1           1
test_sharing_s3-add-noop[main]       2.3812 (1.04)     2.3812 (1.04)     2.3812 (1.04)     0.0000 (1.0)      2.3812 (1.04)     0.0000 (1.0)           0;0  0.4200 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout[2.58.2]     3.5187 (1.82)     3.5187 (1.82)     3.5187 (1.82)     0.0000 (1.0)      3.5187 (1.82)     0.0000 (1.0)           0;0  0.2842 (0.55)          1           1
test_sharing_s3-checkout[3.10.0]     2.0715 (1.07)     2.0715 (1.07)     2.0715 (1.07)     0.0000 (1.0)      2.0715 (1.07)     0.0000 (1.0)           0;0  0.4828 (0.93)          1           1
test_sharing_s3-checkout[main]       1.9332 (1.0)      1.9332 (1.0)      1.9332 (1.0)      0.0000 (1.0)      1.9332 (1.0)      0.0000 (1.0)           0;0  0.5173 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.58.2]     399.3899 (1.0)      399.3899 (1.0)      399.3899 (1.0)      0.0000 (1.0)      399.3899 (1.0)      0.0000 (1.0)           0;0  2.5038 (1.0)           1           1
test_sharing_s3-checkout-noop[3.10.0]     560.3337 (1.40)     560.3337 (1.40)     560.3337 (1.40)     0.0000 (1.0)      560.3337 (1.40)     0.0000 (1.0)           0;0  1.7847 (0.71)          1           1
test_sharing_s3-checkout-noop[main]       419.4334 (1.05)     419.4334 (1.05)     419.4334 (1.05)     0.0000 (1.0)      419.4334 (1.05)     0.0000 (1.0)           0;0  2.3842 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing_s3-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch[2.58.2]     4.1712 (1.02)     4.1712 (1.02)     4.1712 (1.02)     0.0000 (1.0)      4.1712 (1.02)     0.0000 (1.0)           0;0  0.2397 (0.98)          1           1
test_sharing_s3-fetch[3.10.0]     6.6626 (1.63)     6.6626 (1.63)     6.6626 (1.63)     0.0000 (1.0)      6.6626 (1.63)     0.0000 (1.0)           0;0  0.1501 (0.61)          1           1
test_sharing_s3-fetch[main]       4.0776 (1.0)      4.0776 (1.0)      4.0776 (1.0)      0.0000 (1.0)      4.0776 (1.0)      0.0000 (1.0)           0;0  0.2452 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing_s3-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-fetch-noop[2.58.2]     561.6137 (1.0)      561.6137 (1.0)      561.6137 (1.0)      0.0000 (1.0)      561.6137 (1.0)      0.0000 (1.0)           0;0  1.7806 (1.0)           1           1
test_sharing_s3-fetch-noop[3.10.0]     807.7824 (1.44)     807.7824 (1.44)     807.7824 (1.44)     0.0000 (1.0)      807.7824 (1.44)     0.0000 (1.0)           0;0  1.2380 (0.70)          1           1
test_sharing_s3-fetch-noop[main]       819.0835 (1.46)     819.0835 (1.46)     819.0835 (1.46)     0.0000 (1.0)      819.0835 (1.46)     0.0000 (1.0)           0;0  1.2209 (0.69)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 3 tests --------------------------------------------------------------------------
Name (time in s)                     Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.58.2]     17.1560 (1.10)     17.1560 (1.10)     17.1560 (1.10)     0.0000 (1.0)      17.1560 (1.10)     0.0000 (1.0)           0;0  0.0583 (0.91)          1           1
test_sharing_s3-push[3.10.0]     15.6955 (1.00)     15.6955 (1.00)     15.6955 (1.00)     0.0000 (1.0)      15.6955 (1.00)     0.0000 (1.0)           0;0  0.0637 (1.00)          1           1
test_sharing_s3-push[main]       15.6359 (1.0)      15.6359 (1.0)      15.6359 (1.0)      0.0000 (1.0)      15.6359 (1.0)      0.0000 (1.0)           0;0  0.0640 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                            Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.58.2]       801.5688 (1.0)        801.5688 (1.0)        801.5688 (1.0)      0.0000 (1.0)        801.5688 (1.0)      0.0000 (1.0)           0;0  1.2476 (1.0)           1           1
test_sharing_s3-push-noop[3.10.0]       803.6203 (1.00)       803.6203 (1.00)       803.6203 (1.00)     0.0000 (1.0)        803.6203 (1.00)     0.0000 (1.0)           0;0  1.2444 (1.00)          1           1
test_sharing_s3-push-noop[main]       1,096.2043 (1.37)     1,096.2043 (1.37)     1,096.2043 (1.37)     0.0000 (1.0)      1,096.2043 (1.37)     0.0000 (1.0)           0;0  0.9122 (0.73)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     6.5110 (1.34)     6.5110 (1.34)     6.5110 (1.34)     0.0000 (1.0)      6.5110 (1.34)     0.0000 (1.0)           0;0  0.1536 (0.75)          1           1
test_status-status[3.10.0]     5.6280 (1.16)     5.6280 (1.16)     5.6280 (1.16)     0.0000 (1.0)      5.6280 (1.16)     0.0000 (1.0)           0;0  0.1777 (0.86)          1           1
test_status-status[main]       4.8526 (1.0)      4.8526 (1.0)      4.8526 (1.0)      0.0000 (1.0)      4.8526 (1.0)      0.0000 (1.0)           0;0  0.2061 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_status-status-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                          Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     3.1855 (8.49)     3.1855 (8.49)     3.1855 (8.49)     0.0000 (1.0)      3.1855 (8.49)     0.0000 (1.0)           0;0  0.3139 (0.12)          1           1
test_status-status-changed[3.10.0]     0.3752 (1.0)      0.3752 (1.0)      0.3752 (1.0)      0.0000 (1.0)      0.3752 (1.0)      0.0000 (1.0)           0;0  2.6655 (1.0)           1           1
test_status-status-changed[main]       0.3761 (1.00)     0.3761 (1.00)     0.3761 (1.00)     0.0000 (1.0)      0.3761 (1.00)     0.0000 (1.0)           0;0  2.6589 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     362.3127 (1.0)      362.3127 (1.0)      362.3127 (1.0)      0.0000 (1.0)      362.3127 (1.0)      0.0000 (1.0)           0;0  2.7600 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     372.4901 (1.03)     372.4901 (1.03)     372.4901 (1.03)     0.0000 (1.0)      372.4901 (1.03)     0.0000 (1.0)           0;0  2.6846 (0.97)          1           1
test_status-status-changed-noop[main]       373.9347 (1.03)     373.9347 (1.03)     373.9347 (1.03)     0.0000 (1.0)      373.9347 (1.03)     0.0000 (1.0)           0;0  2.6743 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     364.8339 (1.0)      364.8339 (1.0)      364.8339 (1.0)      0.0000 (1.0)      364.8339 (1.0)      0.0000 (1.0)           0;0  2.7410 (1.0)           1           1
test_status-status-noop[3.10.0]     373.8520 (1.02)     373.8520 (1.02)     373.8520 (1.02)     0.0000 (1.0)      373.8520 (1.02)     0.0000 (1.0)           0;0  2.6749 (0.98)          1           1
test_status-status-noop[main]       376.5368 (1.03)     376.5368 (1.03)     376.5368 (1.03)     0.0000 (1.0)      376.5368 (1.03)     0.0000 (1.0)           0;0  2.6558 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
DVC Plot 

-------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     11.7446 (1.24)     11.7446 (1.24)     11.7446 (1.24)     0.0000 (1.0)      11.7446 (1.24)     0.0000 (1.0)           0;0  0.0851 (0.81)          1           1
test_update-import-url[3.10.0]      9.4872 (1.0)       9.4872 (1.0)       9.4872 (1.0)      0.0000 (1.0)       9.4872 (1.0)      0.0000 (1.0)           0;0  0.1054 (1.0)           1           1
test_update-import-url[main]       10.3994 (1.10)     10.3994 (1.10)     10.3994 (1.10)     0.0000 (1.0)      10.3994 (1.10)     0.0000 (1.0)           0;0  0.0962 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     8.0533 (1.31)     8.0533 (1.31)     8.0533 (1.31)     0.0000 (1.0)      8.0533 (1.31)     0.0000 (1.0)           0;0  0.1242 (0.77)          1           1
test_update-update[3.10.0]     6.1703 (1.0)      6.1703 (1.0)      6.1703 (1.0)      0.0000 (1.0)      6.1703 (1.0)      0.0000 (1.0)           0;0  0.1621 (1.0)           1           1
test_update-update[main]       7.1195 (1.15)     7.1195 (1.15)     7.1195 (1.15)     0.0000 (1.0)      7.1195 (1.15)     0.0000 (1.0)           0;0  0.1405 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     384.3414 (1.0)      384.3414 (1.0)      384.3414 (1.0)      0.0000 (1.0)      384.3414 (1.0)      0.0000 (1.0)           0;0  2.6019 (1.0)           1           1
test_update-update-noop[3.10.0]     391.6869 (1.02)     391.6869 (1.02)     391.6869 (1.02)     0.0000 (1.0)      391.6869 (1.02)     0.0000 (1.0)           0;0  2.5531 (0.98)          1           1
test_update-update-noop[main]       392.1524 (1.02)     392.1524 (1.02)     392.1524 (1.02)     0.0000 (1.0)      392.1524 (1.02)     0.0000 (1.0)           0;0  2.5500 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean