Fri Dec  8 19:38:51 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     580.7924 (1.02)     580.7924 (1.02)     580.7924 (1.02)     0.0000 (1.0)      580.7924 (1.02)     0.0000 (1.0)           0;0  1.7218 (0.98)          1           1
test_add-add[3.10.0]     593.1876 (1.04)     593.1876 (1.04)     593.1876 (1.04)     0.0000 (1.0)      593.1876 (1.04)     0.0000 (1.0)           0;0  1.6858 (0.96)          1           1
test_add-add[main]       571.9604 (1.0)      571.9604 (1.0)      571.9604 (1.0)      0.0000 (1.0)      571.9604 (1.0)      0.0000 (1.0)           0;0  1.7484 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     561.8855 (1.01)     561.8855 (1.01)     561.8855 (1.01)     0.0000 (1.0)      561.8855 (1.01)     0.0000 (1.0)           0;0  1.7797 (0.99)          1           1
test_checkout_copy-checkout[3.10.0]     582.9062 (1.05)     582.9062 (1.05)     582.9062 (1.05)     0.0000 (1.0)      582.9062 (1.05)     0.0000 (1.0)           0;0  1.7155 (0.96)          1           1
test_checkout_copy-checkout[main]       557.0030 (1.0)      557.0030 (1.0)      557.0030 (1.0)      0.0000 (1.0)      557.0030 (1.0)      0.0000 (1.0)           0;0  1.7953 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     381.7359 (1.0)      381.7359 (1.0)      381.7359 (1.0)      0.0000 (1.0)      381.7359 (1.0)      0.0000 (1.0)           0;0  2.6196 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     402.7285 (1.05)     402.7285 (1.05)     402.7285 (1.05)     0.0000 (1.0)      402.7285 (1.05)     0.0000 (1.0)           0;0  2.4831 (0.95)          1           1
test_checkout_copy-checkout-noop[main]       401.8819 (1.05)     401.8819 (1.05)     401.8819 (1.05)     0.0000 (1.0)      401.8819 (1.05)     0.0000 (1.0)           0;0  2.4883 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     421.2128 (1.0)      421.2128 (1.0)      421.2128 (1.0)      0.0000 (1.0)      421.2128 (1.0)      0.0000 (1.0)           0;0  2.3741 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     435.4066 (1.03)     435.4066 (1.03)     435.4066 (1.03)     0.0000 (1.0)      435.4066 (1.03)     0.0000 (1.0)           0;0  2.2967 (0.97)          1           1
test_checkout_copy-checkout-update[main]       452.4358 (1.07)     452.4358 (1.07)     452.4358 (1.07)     0.0000 (1.0)      452.4358 (1.07)     0.0000 (1.0)           0;0  2.2103 (0.93)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     534.9322 (1.0)      534.9322 (1.0)      534.9322 (1.0)      0.0000 (1.0)      534.9322 (1.0)      0.0000 (1.0)           0;0  1.8694 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     544.7618 (1.02)     544.7618 (1.02)     544.7618 (1.02)     0.0000 (1.0)      544.7618 (1.02)     0.0000 (1.0)           0;0  1.8357 (0.98)          1           1
test_checkout_hardlink-checkout[main]       554.5916 (1.04)     554.5916 (1.04)     554.5916 (1.04)     0.0000 (1.0)      554.5916 (1.04)     0.0000 (1.0)           0;0  1.8031 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     387.8646 (1.0)      387.8646 (1.0)      387.8646 (1.0)      0.0000 (1.0)      387.8646 (1.0)      0.0000 (1.0)           0;0  2.5782 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     401.5531 (1.04)     401.5531 (1.04)     401.5531 (1.04)     0.0000 (1.0)      401.5531 (1.04)     0.0000 (1.0)           0;0  2.4903 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       396.1688 (1.02)     396.1688 (1.02)     396.1688 (1.02)     0.0000 (1.0)      396.1688 (1.02)     0.0000 (1.0)           0;0  2.5242 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     457.9681 (1.08)     457.9681 (1.08)     457.9681 (1.08)     0.0000 (1.0)      457.9681 (1.08)     0.0000 (1.0)           0;0  2.1836 (0.93)          1           1
test_checkout_hardlink-checkout-update[3.10.0]     424.1706 (1.0)      424.1706 (1.0)      424.1706 (1.0)      0.0000 (1.0)      424.1706 (1.0)      0.0000 (1.0)           0;0  2.3575 (1.0)           1           1
test_checkout_hardlink-checkout-update[main]       427.7453 (1.01)     427.7453 (1.01)     427.7453 (1.01)     0.0000 (1.0)      427.7453 (1.01)     0.0000 (1.0)           0;0  2.3378 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     536.8740 (1.0)      536.8740 (1.0)      536.8740 (1.0)      0.0000 (1.0)      536.8740 (1.0)      0.0000 (1.0)           0;0  1.8626 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     567.3341 (1.06)     567.3341 (1.06)     567.3341 (1.06)     0.0000 (1.0)      567.3341 (1.06)     0.0000 (1.0)           0;0  1.7626 (0.95)          1           1
test_checkout_symlink-checkout[main]       573.5559 (1.07)     573.5559 (1.07)     573.5559 (1.07)     0.0000 (1.0)      573.5559 (1.07)     0.0000 (1.0)           0;0  1.7435 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     386.4047 (1.0)      386.4047 (1.0)      386.4047 (1.0)      0.0000 (1.0)      386.4047 (1.0)      0.0000 (1.0)           0;0  2.5880 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     428.4030 (1.11)     428.4030 (1.11)     428.4030 (1.11)     0.0000 (1.0)      428.4030 (1.11)     0.0000 (1.0)           0;0  2.3343 (0.90)          1           1
test_checkout_symlink-checkout-noop[main]       408.0236 (1.06)     408.0236 (1.06)     408.0236 (1.06)     0.0000 (1.0)      408.0236 (1.06)     0.0000 (1.0)           0;0  2.4508 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     438.3833 (1.00)     438.3833 (1.00)     438.3833 (1.00)     0.0000 (1.0)      438.3833 (1.00)     0.0000 (1.0)           0;0  2.2811 (1.00)          1           1
test_checkout_symlink-checkout-update[3.10.0]     441.2073 (1.01)     441.2073 (1.01)     441.2073 (1.01)     0.0000 (1.0)      441.2073 (1.01)     0.0000 (1.0)           0;0  2.2665 (0.99)          1           1
test_checkout_symlink-checkout-update[main]       437.5620 (1.0)      437.5620 (1.0)      437.5620 (1.0)      0.0000 (1.0)      437.5620 (1.0)      0.0000 (1.0)           0;0  2.2854 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     479.8313 (1.01)     479.8313 (1.01)     479.8313 (1.01)     0.0000 (1.0)      479.8313 (1.01)     0.0000 (1.0)           0;0  2.0841 (0.99)          1           1
test_data_status-data-changed[3.10.0]     475.9671 (1.0)      475.9671 (1.0)      475.9671 (1.0)      0.0000 (1.0)      475.9671 (1.0)      0.0000 (1.0)           0;0  2.1010 (1.0)           1           1
test_data_status-data-changed[main]       487.4637 (1.02)     487.4637 (1.02)     487.4637 (1.02)     0.0000 (1.0)      487.4637 (1.02)     0.0000 (1.0)           0;0  2.0514 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     469.0139 (1.03)     469.0139 (1.03)     469.0139 (1.03)     0.0000 (1.0)      469.0139 (1.03)     0.0000 (1.0)           0;0  2.1321 (0.97)          1           1
test_data_status-data-changed-noop[3.10.0]     456.5649 (1.0)      456.5649 (1.0)      456.5649 (1.0)      0.0000 (1.0)      456.5649 (1.0)      0.0000 (1.0)           0;0  2.1903 (1.0)           1           1
test_data_status-data-changed-noop[main]       460.9427 (1.01)     460.9427 (1.01)     460.9427 (1.01)     0.0000 (1.0)      460.9427 (1.01)     0.0000 (1.0)           0;0  2.1695 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     522.2599 (1.05)     522.2599 (1.05)     522.2599 (1.05)     0.0000 (1.0)      522.2599 (1.05)     0.0000 (1.0)           0;0  1.9148 (0.96)          1           1
test_data_status-data-new[3.10.0]     499.3775 (1.0)      499.3775 (1.0)      499.3775 (1.0)      0.0000 (1.0)      499.3775 (1.0)      0.0000 (1.0)           0;0  2.0025 (1.0)           1           1
test_data_status-data-new[main]       530.5844 (1.06)     530.5844 (1.06)     530.5844 (1.06)     0.0000 (1.0)      530.5844 (1.06)     0.0000 (1.0)           0;0  1.8847 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     481.1843 (1.05)     481.1843 (1.05)     481.1843 (1.05)     0.0000 (1.0)      481.1843 (1.05)     0.0000 (1.0)           0;0  2.0782 (0.95)          1           1
test_data_status-data-noop[3.10.0]     456.6089 (1.0)      456.6089 (1.0)      456.6089 (1.0)      0.0000 (1.0)      456.6089 (1.0)      0.0000 (1.0)           0;0  2.1901 (1.0)           1           1
test_data_status-data-noop[main]       473.6345 (1.04)     473.6345 (1.04)     473.6345 (1.04)     0.0000 (1.0)      473.6345 (1.04)     0.0000 (1.0)           0;0  2.1113 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     464.2575 (1.02)     464.2575 (1.02)     464.2575 (1.02)     0.0000 (1.0)      464.2575 (1.02)     0.0000 (1.0)           0;0  2.1540 (0.98)          1           1
test_data_status_all_flags-data-changed[3.10.0]     453.7866 (1.0)      453.7866 (1.0)      453.7866 (1.0)      0.0000 (1.0)      453.7866 (1.0)      0.0000 (1.0)           0;0  2.2037 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       462.4815 (1.02)     462.4815 (1.02)     462.4815 (1.02)     0.0000 (1.0)      462.4815 (1.02)     0.0000 (1.0)           0;0  2.1622 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     462.3660 (1.03)     462.3660 (1.03)     462.3660 (1.03)     0.0000 (1.0)      462.3660 (1.03)     0.0000 (1.0)           0;0  2.1628 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     448.2060 (1.0)      448.2060 (1.0)      448.2060 (1.0)      0.0000 (1.0)      448.2060 (1.0)      0.0000 (1.0)           0;0  2.2311 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       470.5747 (1.05)     470.5747 (1.05)     470.5747 (1.05)     0.0000 (1.0)      470.5747 (1.05)     0.0000 (1.0)           0;0  2.1251 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     532.7063 (1.05)     532.7063 (1.05)     532.7063 (1.05)     0.0000 (1.0)      532.7063 (1.05)     0.0000 (1.0)           0;0  1.8772 (0.95)          1           1
test_data_status_all_flags-data-new[3.10.0]     508.2291 (1.0)      508.2291 (1.0)      508.2291 (1.0)      0.0000 (1.0)      508.2291 (1.0)      0.0000 (1.0)           0;0  1.9676 (1.0)           1           1
test_data_status_all_flags-data-new[main]       530.1318 (1.04)     530.1318 (1.04)     530.1318 (1.04)     0.0000 (1.0)      530.1318 (1.04)     0.0000 (1.0)           0;0  1.8863 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     464.5226 (1.03)     464.5226 (1.03)     464.5226 (1.03)     0.0000 (1.0)      464.5226 (1.03)     0.0000 (1.0)           0;0  2.1527 (0.97)          1           1
test_data_status_all_flags-data-noop[3.10.0]     450.2721 (1.0)      450.2721 (1.0)      450.2721 (1.0)      0.0000 (1.0)      450.2721 (1.0)      0.0000 (1.0)           0;0  2.2209 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       460.2680 (1.02)     460.2680 (1.02)     460.2680 (1.02)     0.0000 (1.0)      460.2680 (1.02)     0.0000 (1.0)           0;0  2.1726 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     514.8728 (1.02)     514.8728 (1.02)     514.8728 (1.02)     0.0000 (1.0)      514.8728 (1.02)     0.0000 (1.0)           0;0  1.9422 (0.98)          1           1
test_diff-diff[3.10.0]     518.3958 (1.03)     518.3958 (1.03)     518.3958 (1.03)     0.0000 (1.0)      518.3958 (1.03)     0.0000 (1.0)           0;0  1.9290 (0.97)          1           1
test_diff-diff[main]       504.9302 (1.0)      504.9302 (1.0)      504.9302 (1.0)      0.0000 (1.0)      504.9302 (1.0)      0.0000 (1.0)           0;0  1.9805 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     465.6204 (1.00)     465.6204 (1.00)     465.6204 (1.00)     0.0000 (1.0)      465.6204 (1.00)     0.0000 (1.0)           0;0  2.1477 (1.00)          1           1
test_diff-diff-changed[3.10.0]     464.8372 (1.0)      464.8372 (1.0)      464.8372 (1.0)      0.0000 (1.0)      464.8372 (1.0)      0.0000 (1.0)           0;0  2.1513 (1.0)           1           1
test_diff-diff-changed[main]       465.5794 (1.00)     465.5794 (1.00)     465.5794 (1.00)     0.0000 (1.0)      465.5794 (1.00)     0.0000 (1.0)           0;0  2.1479 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     457.2538 (1.00)     457.2538 (1.00)     457.2538 (1.00)     0.0000 (1.0)      457.2538 (1.00)     0.0000 (1.0)           0;0  2.1870 (1.00)          1           1
test_diff-diff-changed-noop[3.10.0]     457.0614 (1.0)      457.0614 (1.0)      457.0614 (1.0)      0.0000 (1.0)      457.0614 (1.0)      0.0000 (1.0)           0;0  2.1879 (1.0)           1           1
test_diff-diff-changed-noop[main]       465.2258 (1.02)     465.2258 (1.02)     465.2258 (1.02)     0.0000 (1.0)      465.2258 (1.02)     0.0000 (1.0)           0;0  2.1495 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     447.3363 (1.0)      447.3363 (1.0)      447.3363 (1.0)      0.0000 (1.0)      447.3363 (1.0)      0.0000 (1.0)           0;0  2.2355 (1.0)           1           1
test_diff-diff-noop[3.10.0]     460.0842 (1.03)     460.0842 (1.03)     460.0842 (1.03)     0.0000 (1.0)      460.0842 (1.03)     0.0000 (1.0)           0;0  2.1735 (0.97)          1           1
test_diff-diff-noop[main]       453.0525 (1.01)     453.0525 (1.01)     453.0525 (1.01)     0.0000 (1.0)      453.0525 (1.01)     0.0000 (1.0)           0;0  2.2072 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        834.8168 (1.0)         834.8168 (1.0)         834.8168 (1.0)      0.0000 (1.0)         834.8168 (1.0)      0.0000 (1.0)           0;0  1.1979 (1.0)           1           1
test_exp_show-exp[3.10.0]     13,158.2268 (15.76)    13,158.2268 (15.76)    13,158.2268 (15.76)    0.0000 (1.0)      13,158.2268 (15.76)    0.0000 (1.0)           0;0  0.0760 (0.06)          1           1
test_exp_show-exp[main]       10,293.1589 (12.33)    10,293.1589 (12.33)    10,293.1589 (12.33)    0.0000 (1.0)      10,293.1589 (12.33)    0.0000 (1.0)           0;0  0.0972 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     454.4597 (1.0)      454.4597 (1.0)      454.4597 (1.0)      0.0000 (1.0)      454.4597 (1.0)      0.0000 (1.0)           0;0  2.2004 (1.0)           1           1
test_fetch-fetch[3.10.0]     481.3708 (1.06)     481.3708 (1.06)     481.3708 (1.06)     0.0000 (1.0)      481.3708 (1.06)     0.0000 (1.0)           0;0  2.0774 (0.94)          1           1
test_fetch-fetch[main]       464.9009 (1.02)     464.9009 (1.02)     464.9009 (1.02)     0.0000 (1.0)      464.9009 (1.02)     0.0000 (1.0)           0;0  2.1510 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     366.2795 (1.0)      366.2795 (1.0)      366.2795 (1.0)      0.0000 (1.0)      366.2795 (1.0)      0.0000 (1.0)           0;0  2.7302 (1.0)           1           1
test_gc-gc[3.10.0]     367.0211 (1.00)     367.0211 (1.00)     367.0211 (1.00)     0.0000 (1.0)      367.0211 (1.00)     0.0000 (1.0)           0;0  2.7246 (1.00)          1           1
test_gc-gc[main]       366.3283 (1.00)     366.3283 (1.00)     366.3283 (1.00)     0.0000 (1.0)      366.3283 (1.00)     0.0000 (1.0)           0;0  2.7298 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     512.3016 (1.05)     512.3016 (1.05)     512.3016 (1.05)     0.0000 (1.0)      512.3016 (1.05)     0.0000 (1.0)           0;0  1.9520 (0.95)          1           1
test_get-get[3.10.0]     487.0687 (1.0)      487.0687 (1.0)      487.0687 (1.0)      0.0000 (1.0)      487.0687 (1.0)      0.0000 (1.0)           0;0  2.0531 (1.0)           1           1
test_get-get[main]       518.3933 (1.06)     518.3933 (1.06)     518.3933 (1.06)     0.0000 (1.0)      518.3933 (1.06)     0.0000 (1.0)           0;0  1.9290 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     364.2667 (1.0)      364.2667 (1.0)      364.2667 (1.0)      0.0000 (1.0)      364.2667 (1.0)      0.0000 (1.0)           0;0  2.7452 (1.0)           1           1
test_get_url-get-url[3.10.0]     392.9031 (1.08)     392.9031 (1.08)     392.9031 (1.08)     0.0000 (1.0)      392.9031 (1.08)     0.0000 (1.0)           0;0  2.5452 (0.93)          1           1
test_get_url-get-url[main]       391.2858 (1.07)     391.2858 (1.07)     391.2858 (1.07)     0.0000 (1.0)      391.2858 (1.07)     0.0000 (1.0)           0;0  2.5557 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.4729 (1.02)     150.8287 (1.12)     133.4847 (1.03)     2.8422 (1.73)     133.0105 (1.03)     2.6753 (1.19)         16;4  7.4915 (0.97)        100           1
test_help---help[3.10.0]     126.0878 (1.0)      135.1372 (1.0)      129.7365 (1.0)      1.6426 (1.0)      129.5313 (1.0)      2.2391 (1.0)          30;1  7.7079 (1.0)         100           1
test_help---help[main]       127.6923 (1.01)     144.0911 (1.07)     130.5516 (1.01)     2.7226 (1.66)     129.8722 (1.00)     2.5274 (1.13)          8;5  7.6598 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     681.9986 (1.02)     681.9986 (1.02)     681.9986 (1.02)     0.0000 (1.0)      681.9986 (1.02)     0.0000 (1.0)           0;0  1.4663 (0.98)          1           1
test_import-import[3.10.0]     669.2070 (1.0)      669.2070 (1.0)      669.2070 (1.0)      0.0000 (1.0)      669.2070 (1.0)      0.0000 (1.0)           0;0  1.4943 (1.0)           1           1
test_import-import[main]       714.8385 (1.07)     714.8385 (1.07)     714.8385 (1.07)     0.0000 (1.0)      714.8385 (1.07)     0.0000 (1.0)           0;0  1.3989 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     630.5701 (1.03)     630.5701 (1.03)     630.5701 (1.03)     0.0000 (1.0)      630.5701 (1.03)     0.0000 (1.0)           0;0  1.5859 (0.97)          1           1
test_import_url-import-url[3.10.0]     641.8097 (1.04)     641.8097 (1.04)     641.8097 (1.04)     0.0000 (1.0)      641.8097 (1.04)     0.0000 (1.0)           0;0  1.5581 (0.96)          1           1
test_import_url-import-url[main]       614.3588 (1.0)      614.3588 (1.0)      614.3588 (1.0)      0.0000 (1.0)      614.3588 (1.0)      0.0000 (1.0)           0;0  1.6277 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     361.9483 (1.0)      404.1496 (1.0)      374.8934 (1.0)      7.0321 (1.0)      374.5076 (1.0)       8.9406 (1.10)         27;2  2.6674 (1.0)         100           1
test_init-init[3.10.0]     371.1180 (1.03)     414.2951 (1.03)     382.9087 (1.02)     7.1650 (1.02)     382.2565 (1.02)      8.0940 (1.0)          23;4  2.6116 (0.98)        100           1
test_init-init[main]       380.0858 (1.05)     419.6890 (1.04)     396.4981 (1.06)     7.8644 (1.12)     395.8743 (1.06)     10.6350 (1.31)         33;1  2.5221 (0.95)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     412.4135 (1.04)     412.4135 (1.04)     412.4135 (1.04)     0.0000 (1.0)      412.4135 (1.04)     0.0000 (1.0)           0;0  2.4248 (0.97)          1           1
test_list-list[3.10.0]     404.8101 (1.02)     404.8101 (1.02)     404.8101 (1.02)     0.0000 (1.0)      404.8101 (1.02)     0.0000 (1.0)           0;0  2.4703 (0.98)          1           1
test_list-list[main]       398.3496 (1.0)      398.3496 (1.0)      398.3496 (1.0)      0.0000 (1.0)      398.3496 (1.0)      0.0000 (1.0)           0;0  2.5104 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     392.0143 (1.01)     392.0143 (1.01)     392.0143 (1.01)     0.0000 (1.0)      392.0143 (1.01)     0.0000 (1.0)           0;0  2.5509 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     386.4534 (1.0)      386.4534 (1.0)      386.4534 (1.0)      0.0000 (1.0)      386.4534 (1.0)      0.0000 (1.0)           0;0  2.5876 (1.0)           1           1
test_list-list-dvc-only[main]       400.0413 (1.04)     400.0413 (1.04)     400.0413 (1.04)     0.0000 (1.0)      400.0413 (1.04)     0.0000 (1.0)           0;0  2.4997 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     409.3810 (1.01)     409.3810 (1.01)     409.3810 (1.01)     0.0000 (1.0)      409.3810 (1.01)     0.0000 (1.0)           0;0  2.4427 (0.99)          1           1
test_list-list-recursive[3.10.0]     455.2604 (1.13)     455.2604 (1.13)     455.2604 (1.13)     0.0000 (1.0)      455.2604 (1.13)     0.0000 (1.0)           0;0  2.1965 (0.89)          1           1
test_list-list-recursive[main]       404.1767 (1.0)      404.1767 (1.0)      404.1767 (1.0)      0.0000 (1.0)      404.1767 (1.0)      0.0000 (1.0)           0;0  2.4742 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     394.8698 (1.00)     394.8698 (1.00)     394.8698 (1.00)     0.0000 (1.0)      394.8698 (1.00)     0.0000 (1.0)           0;0  2.5325 (1.00)          1           1
test_list-list-shallow[3.10.0]     402.7531 (1.02)     402.7531 (1.02)     402.7531 (1.02)     0.0000 (1.0)      402.7531 (1.02)     0.0000 (1.0)           0;0  2.4829 (0.98)          1           1
test_list-list-shallow[main]       394.3132 (1.0)      394.3132 (1.0)      394.3132 (1.0)      0.0000 (1.0)      394.3132 (1.0)      0.0000 (1.0)           0;0  2.5361 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     576.6946 (1.04)     576.6946 (1.04)     576.6946 (1.04)     0.0000 (1.0)      576.6946 (1.04)     0.0000 (1.0)           0;0  1.7340 (0.97)          1           1
test_partial_add-add[3.10.0]     560.0199 (1.01)     560.0199 (1.01)     560.0199 (1.01)     0.0000 (1.0)      560.0199 (1.01)     0.0000 (1.0)           0;0  1.7857 (0.99)          1           1
test_partial_add-add[main]       557.1778 (1.0)      557.1778 (1.0)      557.1778 (1.0)      0.0000 (1.0)      557.1778 (1.0)      0.0000 (1.0)           0;0  1.7948 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     597.3834 (1.01)     597.3834 (1.01)     597.3834 (1.01)     0.0000 (1.0)      597.3834 (1.01)     0.0000 (1.0)           0;0  1.6740 (0.99)          1           1
test_partial_add-add-partial[3.10.0]     592.1588 (1.00)     592.1588 (1.00)     592.1588 (1.00)     0.0000 (1.0)      592.1588 (1.00)     0.0000 (1.0)           0;0  1.6887 (1.00)          1           1
test_partial_add-add-partial[main]       589.6516 (1.0)      589.6516 (1.0)      589.6516 (1.0)      0.0000 (1.0)      589.6516 (1.0)      0.0000 (1.0)           0;0  1.6959 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     403.7847 (1.00)     403.7847 (1.00)     403.7847 (1.00)     0.0000 (1.0)      403.7847 (1.00)     0.0000 (1.0)           0;0  2.4766 (1.00)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     403.1837 (1.0)      403.1837 (1.0)      403.1837 (1.0)      0.0000 (1.0)      403.1837 (1.0)      0.0000 (1.0)           0;0  2.4803 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       412.3897 (1.02)     412.3897 (1.02)     412.3897 (1.02)     0.0000 (1.0)      412.3897 (1.02)     0.0000 (1.0)           0;0  2.4249 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     380.0494 (1.0)      380.0494 (1.0)      380.0494 (1.0)      0.0000 (1.0)      380.0494 (1.0)      0.0000 (1.0)           0;0  2.6312 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     392.0028 (1.03)     392.0028 (1.03)     392.0028 (1.03)     0.0000 (1.0)      392.0028 (1.03)     0.0000 (1.0)           0;0  2.5510 (0.97)          1           1
test_partial_add-gc-noop[main]       395.2170 (1.04)     395.2170 (1.04)     395.2170 (1.04)     0.0000 (1.0)      395.2170 (1.04)     0.0000 (1.0)           0;0  2.5303 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     434.6408 (1.01)     434.6408 (1.01)     434.6408 (1.01)     0.0000 (1.0)      434.6408 (1.01)     0.0000 (1.0)           0;0  2.3008 (0.99)          1           1
test_partial_add-push[3.10.0]     431.9325 (1.0)      431.9325 (1.0)      431.9325 (1.0)      0.0000 (1.0)      431.9325 (1.0)      0.0000 (1.0)           0;0  2.3152 (1.0)           1           1
test_partial_add-push[main]       453.8566 (1.05)     453.8566 (1.05)     453.8566 (1.05)     0.0000 (1.0)      453.8566 (1.05)     0.0000 (1.0)           0;0  2.2033 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     432.0806 (1.01)     432.0806 (1.01)     432.0806 (1.01)     0.0000 (1.0)      432.0806 (1.01)     0.0000 (1.0)           0;0  2.3144 (0.99)          1           1
test_partial_add-push-partial[3.10.0]     427.2945 (1.0)      427.2945 (1.0)      427.2945 (1.0)      0.0000 (1.0)      427.2945 (1.0)      0.0000 (1.0)           0;0  2.3403 (1.0)           1           1
test_partial_add-push-partial[main]       464.9846 (1.09)     464.9846 (1.09)     464.9846 (1.09)     0.0000 (1.0)      464.9846 (1.09)     0.0000 (1.0)           0;0  2.1506 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     574.9143 (1.00)     574.9143 (1.00)     574.9143 (1.00)     0.0000 (1.0)      574.9143 (1.00)     0.0000 (1.0)           0;0  1.7394 (1.00)          1           1
test_partial_remove-add[3.10.0]     581.9985 (1.01)     581.9985 (1.01)     581.9985 (1.01)     0.0000 (1.0)      581.9985 (1.01)     0.0000 (1.0)           0;0  1.7182 (0.99)          1           1
test_partial_remove-add[main]       573.6285 (1.0)      573.6285 (1.0)      573.6285 (1.0)      0.0000 (1.0)      573.6285 (1.0)      0.0000 (1.0)           0;0  1.7433 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     518.4853 (1.0)      518.4853 (1.0)      518.4853 (1.0)      0.0000 (1.0)      518.4853 (1.0)      0.0000 (1.0)           0;0  1.9287 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     525.9348 (1.01)     525.9348 (1.01)     525.9348 (1.01)     0.0000 (1.0)      525.9348 (1.01)     0.0000 (1.0)           0;0  1.9014 (0.99)          1           1
test_partial_remove-add-update[main]       523.7473 (1.01)     523.7473 (1.01)     523.7473 (1.01)     0.0000 (1.0)      523.7473 (1.01)     0.0000 (1.0)           0;0  1.9093 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     363.6892 (1.0)      363.6892 (1.0)      363.6892 (1.0)      0.0000 (1.0)      363.6892 (1.0)      0.0000 (1.0)           0;0  2.7496 (1.0)           1           1
test_partial_remove-gc[3.10.0]     368.7762 (1.01)     368.7762 (1.01)     368.7762 (1.01)     0.0000 (1.0)      368.7762 (1.01)     0.0000 (1.0)           0;0  2.7117 (0.99)          1           1
test_partial_remove-gc[main]       372.4368 (1.02)     372.4368 (1.02)     372.4368 (1.02)     0.0000 (1.0)      372.4368 (1.02)     0.0000 (1.0)           0;0  2.6850 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     382.4375 (1.01)     382.4375 (1.01)     382.4375 (1.01)     0.0000 (1.0)      382.4375 (1.01)     0.0000 (1.0)           0;0  2.6148 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     376.9888 (1.0)      376.9888 (1.0)      376.9888 (1.0)      0.0000 (1.0)      376.9888 (1.0)      0.0000 (1.0)           0;0  2.6526 (1.0)           1           1
test_partial_remove-gc-cloud[main]       382.6152 (1.01)     382.6152 (1.01)     382.6152 (1.01)     0.0000 (1.0)      382.6152 (1.01)     0.0000 (1.0)           0;0  2.6136 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     425.6770 (1.04)     425.6770 (1.04)     425.6770 (1.04)     0.0000 (1.0)      425.6770 (1.04)     0.0000 (1.0)           0;0  2.3492 (0.96)          1           1
test_partial_remove-push[3.10.0]     410.7266 (1.0)      410.7266 (1.0)      410.7266 (1.0)      0.0000 (1.0)      410.7266 (1.0)      0.0000 (1.0)           0;0  2.4347 (1.0)           1           1
test_partial_remove-push[main]       462.9509 (1.13)     462.9509 (1.13)     462.9509 (1.13)     0.0000 (1.0)      462.9509 (1.13)     0.0000 (1.0)           0;0  2.1601 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     385.0310 (1.02)     385.0310 (1.02)     385.0310 (1.02)     0.0000 (1.0)      385.0310 (1.02)     0.0000 (1.0)           0;0  2.5972 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     377.5059 (1.0)      377.5059 (1.0)      377.5059 (1.0)      0.0000 (1.0)      377.5059 (1.0)      0.0000 (1.0)           0;0  2.6490 (1.0)           1           1
test_partial_remove-push-update[main]       410.6869 (1.09)     410.6869 (1.09)     410.6869 (1.09)     0.0000 (1.0)      410.6869 (1.09)     0.0000 (1.0)           0;0  2.4349 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     436.3961 (1.0)      453.2797 (1.0)      445.1127 (1.0)       6.7531 (1.0)      444.1491 (1.0)      10.7302 (1.0)           2;0  2.2466 (1.0)           5           3
test_plots-plots-diff[3.10.0]     769.3268 (1.76)     813.7401 (1.80)     781.3434 (1.76)     18.5006 (2.74)     772.5916 (1.74)     17.0034 (1.58)          1;1  1.2798 (0.57)          5           3
test_plots-plots-diff[main]       744.7006 (1.71)     763.6661 (1.68)     756.7533 (1.70)      8.5019 (1.26)     761.2249 (1.71)     13.9791 (1.30)          1;0  1.3214 (0.59)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       441.7866 (1.0)        453.3256 (1.0)        446.5212 (1.0)       5.0137 (1.0)        444.3975 (1.0)       8.4288 (1.05)          1;0  2.2395 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,026.3805 (2.32)     1,052.5622 (2.32)     1,033.8795 (2.32)     10.7993 (2.15)     1,029.4819 (2.32)     11.1512 (1.39)          1;0  0.9672 (0.43)          5           3
test_plots-plots-diff-json[main]         821.2613 (1.86)       838.4764 (1.85)       830.1159 (1.86)      6.3438 (1.27)       829.9138 (1.87)      8.0368 (1.0)           2;0  1.2047 (0.54)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     406.8632 (1.0)      420.2528 (1.0)      413.3704 (1.0)      6.4157 (1.43)     413.1198 (1.0)      12.5245 (2.97)          2;0  2.4191 (1.0)           5           3
test_plots-plots-show[3.10.0]     637.7564 (1.57)     648.8669 (1.54)     641.0688 (1.55)     4.4943 (1.0)      640.1218 (1.55)      4.2221 (1.0)           1;1  1.5599 (0.64)          5           3
test_plots-plots-show[main]       645.7604 (1.59)     660.3672 (1.57)     651.9114 (1.58)     5.7677 (1.28)     651.2611 (1.58)      8.6196 (2.04)          2;0  1.5340 (0.63)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     412.2012 (1.0)      446.4853 (1.0)      428.7283 (1.0)      12.4162 (1.96)     429.7958 (1.0)      13.8123 (1.62)          2;0  2.3325 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     789.2582 (1.91)     871.9636 (1.95)     807.8871 (1.88)     35.8579 (5.66)     792.7426 (1.84)     22.1101 (2.59)          1;1  1.2378 (0.53)          5           3
test_plots-plots-show-json[main]       693.5602 (1.68)     709.8842 (1.59)     700.1177 (1.63)      6.3318 (1.0)      698.2525 (1.62)      8.5303 (1.0)           2;0  1.4283 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     456.9379 (1.02)     456.9379 (1.02)     456.9379 (1.02)     0.0000 (1.0)      456.9379 (1.02)     0.0000 (1.0)           0;0  2.1885 (0.98)          1           1
test_push-push[3.10.0]     447.8732 (1.0)      447.8732 (1.0)      447.8732 (1.0)      0.0000 (1.0)      447.8732 (1.0)      0.0000 (1.0)           0;0  2.2328 (1.0)           1           1
test_push-push[main]       462.4333 (1.03)     462.4333 (1.03)     462.4333 (1.03)     0.0000 (1.0)      462.4333 (1.03)     0.0000 (1.0)           0;0  2.1625 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     589.3262 (1.00)     589.3262 (1.00)     589.3262 (1.00)     0.0000 (1.0)      589.3262 (1.00)     0.0000 (1.0)           0;0  1.6969 (1.00)          1           1
test_sharing-add[3.10.0]     596.4298 (1.01)     596.4298 (1.01)     596.4298 (1.01)     0.0000 (1.0)      596.4298 (1.01)     0.0000 (1.0)           0;0  1.6766 (0.99)          1           1
test_sharing-add[main]       587.7475 (1.0)      587.7475 (1.0)      587.7475 (1.0)      0.0000 (1.0)      587.7475 (1.0)      0.0000 (1.0)           0;0  1.7014 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     552.4011 (1.01)     552.4011 (1.01)     552.4011 (1.01)     0.0000 (1.0)      552.4011 (1.01)     0.0000 (1.0)           0;0  1.8103 (0.99)          1           1
test_sharing-add-noop[3.10.0]     577.8522 (1.05)     577.8522 (1.05)     577.8522 (1.05)     0.0000 (1.0)      577.8522 (1.05)     0.0000 (1.0)           0;0  1.7305 (0.95)          1           1
test_sharing-add-noop[main]       549.3849 (1.0)      549.3849 (1.0)      549.3849 (1.0)      0.0000 (1.0)      549.3849 (1.0)      0.0000 (1.0)           0;0  1.8202 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     439.7817 (1.0)      439.7817 (1.0)      439.7817 (1.0)      0.0000 (1.0)      439.7817 (1.0)      0.0000 (1.0)           0;0  2.2739 (1.0)           1           1
test_sharing-checkout[3.10.0]     470.9208 (1.07)     470.9208 (1.07)     470.9208 (1.07)     0.0000 (1.0)      470.9208 (1.07)     0.0000 (1.0)           0;0  2.1235 (0.93)          1           1
test_sharing-checkout[main]       451.3316 (1.03)     451.3316 (1.03)     451.3316 (1.03)     0.0000 (1.0)      451.3316 (1.03)     0.0000 (1.0)           0;0  2.2157 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     374.7156 (1.0)      374.7156 (1.0)      374.7156 (1.0)      0.0000 (1.0)      374.7156 (1.0)      0.0000 (1.0)           0;0  2.6687 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     392.0827 (1.05)     392.0827 (1.05)     392.0827 (1.05)     0.0000 (1.0)      392.0827 (1.05)     0.0000 (1.0)           0;0  2.5505 (0.96)          1           1
test_sharing-checkout-noop[main]       391.4109 (1.04)     391.4109 (1.04)     391.4109 (1.04)     0.0000 (1.0)      391.4109 (1.04)     0.0000 (1.0)           0;0  2.5549 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     455.6669 (1.02)     455.6669 (1.02)     455.6669 (1.02)     0.0000 (1.0)      455.6669 (1.02)     0.0000 (1.0)           0;0  2.1946 (0.98)          1           1
test_sharing-fetch[3.10.0]     462.1716 (1.04)     462.1716 (1.04)     462.1716 (1.04)     0.0000 (1.0)      462.1716 (1.04)     0.0000 (1.0)           0;0  2.1637 (0.97)          1           1
test_sharing-fetch[main]       445.9964 (1.0)      445.9964 (1.0)      445.9964 (1.0)      0.0000 (1.0)      445.9964 (1.0)      0.0000 (1.0)           0;0  2.2422 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     391.2625 (1.0)      391.2625 (1.0)      391.2625 (1.0)      0.0000 (1.0)      391.2625 (1.0)      0.0000 (1.0)           0;0  2.5558 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     391.3703 (1.00)     391.3703 (1.00)     391.3703 (1.00)     0.0000 (1.0)      391.3703 (1.00)     0.0000 (1.0)           0;0  2.5551 (1.00)          1           1
test_sharing-fetch-noop[main]       414.1296 (1.06)     414.1296 (1.06)     414.1296 (1.06)     0.0000 (1.0)      414.1296 (1.06)     0.0000 (1.0)           0;0  2.4147 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     439.4482 (1.03)     439.4482 (1.03)     439.4482 (1.03)     0.0000 (1.0)      439.4482 (1.03)     0.0000 (1.0)           0;0  2.2756 (0.97)          1           1
test_sharing-push[3.10.0]     428.2526 (1.0)      428.2526 (1.0)      428.2526 (1.0)      0.0000 (1.0)      428.2526 (1.0)      0.0000 (1.0)           0;0  2.3351 (1.0)           1           1
test_sharing-push[main]       458.7092 (1.07)     458.7092 (1.07)     458.7092 (1.07)     0.0000 (1.0)      458.7092 (1.07)     0.0000 (1.0)           0;0  2.1800 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     390.1748 (1.01)     390.1748 (1.01)     390.1748 (1.01)     0.0000 (1.0)      390.1748 (1.01)     0.0000 (1.0)           0;0  2.5630 (0.99)          1           1
test_sharing-push-noop[3.10.0]     384.5178 (1.0)      384.5178 (1.0)      384.5178 (1.0)      0.0000 (1.0)      384.5178 (1.0)      0.0000 (1.0)           0;0  2.6007 (1.0)           1           1
test_sharing-push-noop[main]       420.3546 (1.09)     420.3546 (1.09)     420.3546 (1.09)     0.0000 (1.0)      420.3546 (1.09)     0.0000 (1.0)           0;0  2.3789 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     417.6385 (1.00)     417.6385 (1.00)     417.6385 (1.00)     0.0000 (1.0)      417.6385 (1.00)     0.0000 (1.0)           0;0  2.3944 (1.00)          1           1
test_status-status[3.10.0]     424.9340 (1.02)     424.9340 (1.02)     424.9340 (1.02)     0.0000 (1.0)      424.9340 (1.02)     0.0000 (1.0)           0;0  2.3533 (0.98)          1           1
test_status-status[main]       416.3417 (1.0)      416.3417 (1.0)      416.3417 (1.0)      0.0000 (1.0)      416.3417 (1.0)      0.0000 (1.0)           0;0  2.4019 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     367.3001 (1.0)      367.3001 (1.0)      367.3001 (1.0)      0.0000 (1.0)      367.3001 (1.0)      0.0000 (1.0)           0;0  2.7226 (1.0)           1           1
test_status-status-changed[3.10.0]     384.3804 (1.05)     384.3804 (1.05)     384.3804 (1.05)     0.0000 (1.0)      384.3804 (1.05)     0.0000 (1.0)           0;0  2.6016 (0.96)          1           1
test_status-status-changed[main]       380.7732 (1.04)     380.7732 (1.04)     380.7732 (1.04)     0.0000 (1.0)      380.7732 (1.04)     0.0000 (1.0)           0;0  2.6262 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     362.7809 (1.0)      362.7809 (1.0)      362.7809 (1.0)      0.0000 (1.0)      362.7809 (1.0)      0.0000 (1.0)           0;0  2.7565 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     381.3747 (1.05)     381.3747 (1.05)     381.3747 (1.05)     0.0000 (1.0)      381.3747 (1.05)     0.0000 (1.0)           0;0  2.6221 (0.95)          1           1
test_status-status-changed-noop[main]       381.1635 (1.05)     381.1635 (1.05)     381.1635 (1.05)     0.0000 (1.0)      381.1635 (1.05)     0.0000 (1.0)           0;0  2.6235 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     366.8536 (1.0)      366.8536 (1.0)      366.8536 (1.0)      0.0000 (1.0)      366.8536 (1.0)      0.0000 (1.0)           0;0  2.7259 (1.0)           1           1
test_status-status-noop[3.10.0]     376.7140 (1.03)     376.7140 (1.03)     376.7140 (1.03)     0.0000 (1.0)      376.7140 (1.03)     0.0000 (1.0)           0;0  2.6545 (0.97)          1           1
test_status-status-noop[main]       376.9108 (1.03)     376.9108 (1.03)     376.9108 (1.03)     0.0000 (1.0)      376.9108 (1.03)     0.0000 (1.0)           0;0  2.6531 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     637.0362 (1.03)     637.0362 (1.03)     637.0362 (1.03)     0.0000 (1.0)      637.0362 (1.03)     0.0000 (1.0)           0;0  1.5698 (0.97)          1           1
test_update-import-url[3.10.0]     655.8465 (1.06)     655.8465 (1.06)     655.8465 (1.06)     0.0000 (1.0)      655.8465 (1.06)     0.0000 (1.0)           0;0  1.5247 (0.95)          1           1
test_update-import-url[main]       620.0081 (1.0)      620.0081 (1.0)      620.0081 (1.0)      0.0000 (1.0)      620.0081 (1.0)      0.0000 (1.0)           0;0  1.6129 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     524.7961 (1.02)     524.7961 (1.02)     524.7961 (1.02)     0.0000 (1.0)      524.7961 (1.02)     0.0000 (1.0)           0;0  1.9055 (0.98)          1           1
test_update-update[3.10.0]     543.8607 (1.06)     543.8607 (1.06)     543.8607 (1.06)     0.0000 (1.0)      543.8607 (1.06)     0.0000 (1.0)           0;0  1.8387 (0.94)          1           1
test_update-update[main]       513.1752 (1.0)      513.1752 (1.0)      513.1752 (1.0)      0.0000 (1.0)      513.1752 (1.0)      0.0000 (1.0)           0;0  1.9487 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     388.9303 (1.0)      388.9303 (1.0)      388.9303 (1.0)      0.0000 (1.0)      388.9303 (1.0)      0.0000 (1.0)           0;0  2.5712 (1.0)           1           1
test_update-update-noop[3.10.0]     408.4047 (1.05)     408.4047 (1.05)     408.4047 (1.05)     0.0000 (1.0)      408.4047 (1.05)     0.0000 (1.0)           0;0  2.4486 (0.95)          1           1
test_update-update-noop[main]       401.7358 (1.03)     401.7358 (1.03)     401.7358 (1.03)     0.0000 (1.0)      401.7358 (1.03)     0.0000 (1.0)           0;0  2.4892 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean