Fri Dec  8 22:43:24 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     582.0870 (1.01)     582.0870 (1.01)     582.0870 (1.01)     0.0000 (1.0)      582.0870 (1.01)     0.0000 (1.0)           0;0  1.7180 (0.99)          1           1
test_add-add[3.10.0]     601.0232 (1.04)     601.0232 (1.04)     601.0232 (1.04)     0.0000 (1.0)      601.0232 (1.04)     0.0000 (1.0)           0;0  1.6638 (0.96)          1           1
test_add-add[main]       576.5987 (1.0)      576.5987 (1.0)      576.5987 (1.0)      0.0000 (1.0)      576.5987 (1.0)      0.0000 (1.0)           0;0  1.7343 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     620.1629 (1.0)      620.1629 (1.0)      620.1629 (1.0)      0.0000 (1.0)      620.1629 (1.0)      0.0000 (1.0)           0;0  1.6125 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     648.0875 (1.05)     648.0875 (1.05)     648.0875 (1.05)     0.0000 (1.0)      648.0875 (1.05)     0.0000 (1.0)           0;0  1.5430 (0.96)          1           1
test_checkout_copy-checkout[main]       632.9414 (1.02)     632.9414 (1.02)     632.9414 (1.02)     0.0000 (1.0)      632.9414 (1.02)     0.0000 (1.0)           0;0  1.5799 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     436.3215 (1.01)     436.3215 (1.01)     436.3215 (1.01)     0.0000 (1.0)      436.3215 (1.01)     0.0000 (1.0)           0;0  2.2919 (0.99)          1           1
test_checkout_copy-checkout-noop[3.10.0]     450.1063 (1.04)     450.1063 (1.04)     450.1063 (1.04)     0.0000 (1.0)      450.1063 (1.04)     0.0000 (1.0)           0;0  2.2217 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       433.9948 (1.0)      433.9948 (1.0)      433.9948 (1.0)      0.0000 (1.0)      433.9948 (1.0)      0.0000 (1.0)           0;0  2.3042 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     475.0598 (1.02)     475.0598 (1.02)     475.0598 (1.02)     0.0000 (1.0)      475.0598 (1.02)     0.0000 (1.0)           0;0  2.1050 (0.99)          1           1
test_checkout_copy-checkout-update[3.10.0]     473.8168 (1.01)     473.8168 (1.01)     473.8168 (1.01)     0.0000 (1.0)      473.8168 (1.01)     0.0000 (1.0)           0;0  2.1105 (0.99)          1           1
test_checkout_copy-checkout-update[main]       468.0086 (1.0)      468.0086 (1.0)      468.0086 (1.0)      0.0000 (1.0)      468.0086 (1.0)      0.0000 (1.0)           0;0  2.1367 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     530.7868 (1.00)     530.7868 (1.00)     530.7868 (1.00)     0.0000 (1.0)      530.7868 (1.00)     0.0000 (1.0)           0;0  1.8840 (1.00)          1           1
test_checkout_hardlink-checkout[3.10.0]     581.4252 (1.10)     581.4252 (1.10)     581.4252 (1.10)     0.0000 (1.0)      581.4252 (1.10)     0.0000 (1.0)           0;0  1.7199 (0.91)          1           1
test_checkout_hardlink-checkout[main]       528.8816 (1.0)      528.8816 (1.0)      528.8816 (1.0)      0.0000 (1.0)      528.8816 (1.0)      0.0000 (1.0)           0;0  1.8908 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     381.1345 (1.0)      381.1345 (1.0)      381.1345 (1.0)      0.0000 (1.0)      381.1345 (1.0)      0.0000 (1.0)           0;0  2.6237 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     390.6720 (1.03)     390.6720 (1.03)     390.6720 (1.03)     0.0000 (1.0)      390.6720 (1.03)     0.0000 (1.0)           0;0  2.5597 (0.98)          1           1
test_checkout_hardlink-checkout-noop[main]       385.4637 (1.01)     385.4637 (1.01)     385.4637 (1.01)     0.0000 (1.0)      385.4637 (1.01)     0.0000 (1.0)           0;0  2.5943 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     416.8804 (1.0)      416.8804 (1.0)      416.8804 (1.0)      0.0000 (1.0)      416.8804 (1.0)      0.0000 (1.0)           0;0  2.3988 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     420.6706 (1.01)     420.6706 (1.01)     420.6706 (1.01)     0.0000 (1.0)      420.6706 (1.01)     0.0000 (1.0)           0;0  2.3772 (0.99)          1           1
test_checkout_hardlink-checkout-update[main]       421.3225 (1.01)     421.3225 (1.01)     421.3225 (1.01)     0.0000 (1.0)      421.3225 (1.01)     0.0000 (1.0)           0;0  2.3735 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     520.1317 (1.0)      520.1317 (1.0)      520.1317 (1.0)      0.0000 (1.0)      520.1317 (1.0)      0.0000 (1.0)           0;0  1.9226 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     550.4041 (1.06)     550.4041 (1.06)     550.4041 (1.06)     0.0000 (1.0)      550.4041 (1.06)     0.0000 (1.0)           0;0  1.8168 (0.94)          1           1
test_checkout_symlink-checkout[main]       543.3359 (1.04)     543.3359 (1.04)     543.3359 (1.04)     0.0000 (1.0)      543.3359 (1.04)     0.0000 (1.0)           0;0  1.8405 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     373.1516 (1.0)      373.1516 (1.0)      373.1516 (1.0)      0.0000 (1.0)      373.1516 (1.0)      0.0000 (1.0)           0;0  2.6799 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     391.7416 (1.05)     391.7416 (1.05)     391.7416 (1.05)     0.0000 (1.0)      391.7416 (1.05)     0.0000 (1.0)           0;0  2.5527 (0.95)          1           1
test_checkout_symlink-checkout-noop[main]       392.7743 (1.05)     392.7743 (1.05)     392.7743 (1.05)     0.0000 (1.0)      392.7743 (1.05)     0.0000 (1.0)           0;0  2.5460 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     417.9780 (1.0)      417.9780 (1.0)      417.9780 (1.0)      0.0000 (1.0)      417.9780 (1.0)      0.0000 (1.0)           0;0  2.3925 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     434.6473 (1.04)     434.6473 (1.04)     434.6473 (1.04)     0.0000 (1.0)      434.6473 (1.04)     0.0000 (1.0)           0;0  2.3007 (0.96)          1           1
test_checkout_symlink-checkout-update[main]       423.2156 (1.01)     423.2156 (1.01)     423.2156 (1.01)     0.0000 (1.0)      423.2156 (1.01)     0.0000 (1.0)           0;0  2.3629 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     468.5999 (1.07)     468.5999 (1.07)     468.5999 (1.07)     0.0000 (1.0)      468.5999 (1.07)     0.0000 (1.0)           0;0  2.1340 (0.93)          1           1
test_data_status-data-changed[3.10.0]     442.1871 (1.01)     442.1871 (1.01)     442.1871 (1.01)     0.0000 (1.0)      442.1871 (1.01)     0.0000 (1.0)           0;0  2.2615 (0.99)          1           1
test_data_status-data-changed[main]       437.0076 (1.0)      437.0076 (1.0)      437.0076 (1.0)      0.0000 (1.0)      437.0076 (1.0)      0.0000 (1.0)           0;0  2.2883 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     462.7482 (1.05)     462.7482 (1.05)     462.7482 (1.05)     0.0000 (1.0)      462.7482 (1.05)     0.0000 (1.0)           0;0  2.1610 (0.95)          1           1
test_data_status-data-changed-noop[3.10.0]     438.6349 (1.0)      438.6349 (1.0)      438.6349 (1.0)      0.0000 (1.0)      438.6349 (1.0)      0.0000 (1.0)           0;0  2.2798 (1.0)           1           1
test_data_status-data-changed-noop[main]       440.7920 (1.00)     440.7920 (1.00)     440.7920 (1.00)     0.0000 (1.0)      440.7920 (1.00)     0.0000 (1.0)           0;0  2.2686 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     521.5792 (1.07)     521.5792 (1.07)     521.5792 (1.07)     0.0000 (1.0)      521.5792 (1.07)     0.0000 (1.0)           0;0  1.9173 (0.94)          1           1
test_data_status-data-new[3.10.0]     488.9984 (1.0)      488.9984 (1.0)      488.9984 (1.0)      0.0000 (1.0)      488.9984 (1.0)      0.0000 (1.0)           0;0  2.0450 (1.0)           1           1
test_data_status-data-new[main]       496.9033 (1.02)     496.9033 (1.02)     496.9033 (1.02)     0.0000 (1.0)      496.9033 (1.02)     0.0000 (1.0)           0;0  2.0125 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     468.9572 (1.08)     468.9572 (1.08)     468.9572 (1.08)     0.0000 (1.0)      468.9572 (1.08)     0.0000 (1.0)           0;0  2.1324 (0.93)          1           1
test_data_status-data-noop[3.10.0]     436.1523 (1.0)      436.1523 (1.0)      436.1523 (1.0)      0.0000 (1.0)      436.1523 (1.0)      0.0000 (1.0)           0;0  2.2928 (1.0)           1           1
test_data_status-data-noop[main]       439.0838 (1.01)     439.0838 (1.01)     439.0838 (1.01)     0.0000 (1.0)      439.0838 (1.01)     0.0000 (1.0)           0;0  2.2775 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     487.3116 (1.04)     487.3116 (1.04)     487.3116 (1.04)     0.0000 (1.0)      487.3116 (1.04)     0.0000 (1.0)           0;0  2.0521 (0.96)          1           1
test_data_status_all_flags-data-changed[3.10.0]     467.2529 (1.0)      467.2529 (1.0)      467.2529 (1.0)      0.0000 (1.0)      467.2529 (1.0)      0.0000 (1.0)           0;0  2.1402 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       478.9946 (1.03)     478.9946 (1.03)     478.9946 (1.03)     0.0000 (1.0)      478.9946 (1.03)     0.0000 (1.0)           0;0  2.0877 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     476.5300 (1.05)     476.5300 (1.05)     476.5300 (1.05)     0.0000 (1.0)      476.5300 (1.05)     0.0000 (1.0)           0;0  2.0985 (0.95)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     452.5083 (1.0)      452.5083 (1.0)      452.5083 (1.0)      0.0000 (1.0)      452.5083 (1.0)      0.0000 (1.0)           0;0  2.2099 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       465.1363 (1.03)     465.1363 (1.03)     465.1363 (1.03)     0.0000 (1.0)      465.1363 (1.03)     0.0000 (1.0)           0;0  2.1499 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     547.1961 (1.03)     547.1961 (1.03)     547.1961 (1.03)     0.0000 (1.0)      547.1961 (1.03)     0.0000 (1.0)           0;0  1.8275 (0.97)          1           1
test_data_status_all_flags-data-new[3.10.0]     534.8325 (1.01)     534.8325 (1.01)     534.8325 (1.01)     0.0000 (1.0)      534.8325 (1.01)     0.0000 (1.0)           0;0  1.8697 (0.99)          1           1
test_data_status_all_flags-data-new[main]       532.1554 (1.0)      532.1554 (1.0)      532.1554 (1.0)      0.0000 (1.0)      532.1554 (1.0)      0.0000 (1.0)           0;0  1.8792 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     477.5168 (1.02)     477.5168 (1.02)     477.5168 (1.02)     0.0000 (1.0)      477.5168 (1.02)     0.0000 (1.0)           0;0  2.0942 (0.98)          1           1
test_data_status_all_flags-data-noop[3.10.0]     467.4923 (1.0)      467.4923 (1.0)      467.4923 (1.0)      0.0000 (1.0)      467.4923 (1.0)      0.0000 (1.0)           0;0  2.1391 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       468.7833 (1.00)     468.7833 (1.00)     468.7833 (1.00)     0.0000 (1.0)      468.7833 (1.00)     0.0000 (1.0)           0;0  2.1332 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     501.8821 (1.00)     501.8821 (1.00)     501.8821 (1.00)     0.0000 (1.0)      501.8821 (1.00)     0.0000 (1.0)           0;0  1.9925 (1.00)          1           1
test_diff-diff[3.10.0]     510.8519 (1.02)     510.8519 (1.02)     510.8519 (1.02)     0.0000 (1.0)      510.8519 (1.02)     0.0000 (1.0)           0;0  1.9575 (0.98)          1           1
test_diff-diff[main]       501.2845 (1.0)      501.2845 (1.0)      501.2845 (1.0)      0.0000 (1.0)      501.2845 (1.0)      0.0000 (1.0)           0;0  1.9949 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     469.5605 (1.03)     469.5605 (1.03)     469.5605 (1.03)     0.0000 (1.0)      469.5605 (1.03)     0.0000 (1.0)           0;0  2.1297 (0.97)          1           1
test_diff-diff-changed[3.10.0]     460.4680 (1.01)     460.4680 (1.01)     460.4680 (1.01)     0.0000 (1.0)      460.4680 (1.01)     0.0000 (1.0)           0;0  2.1717 (0.99)          1           1
test_diff-diff-changed[main]       456.1899 (1.0)      456.1899 (1.0)      456.1899 (1.0)      0.0000 (1.0)      456.1899 (1.0)      0.0000 (1.0)           0;0  2.1921 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     454.6355 (1.0)      454.6355 (1.0)      454.6355 (1.0)      0.0000 (1.0)      454.6355 (1.0)      0.0000 (1.0)           0;0  2.1996 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     476.7337 (1.05)     476.7337 (1.05)     476.7337 (1.05)     0.0000 (1.0)      476.7337 (1.05)     0.0000 (1.0)           0;0  2.0976 (0.95)          1           1
test_diff-diff-changed-noop[main]       483.8501 (1.06)     483.8501 (1.06)     483.8501 (1.06)     0.0000 (1.0)      483.8501 (1.06)     0.0000 (1.0)           0;0  2.0668 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     459.0595 (1.01)     459.0595 (1.01)     459.0595 (1.01)     0.0000 (1.0)      459.0595 (1.01)     0.0000 (1.0)           0;0  2.1784 (0.99)          1           1
test_diff-diff-noop[3.10.0]     455.2208 (1.0)      455.2208 (1.0)      455.2208 (1.0)      0.0000 (1.0)      455.2208 (1.0)      0.0000 (1.0)           0;0  2.1967 (1.0)           1           1
test_diff-diff-noop[main]       456.9499 (1.00)     456.9499 (1.00)     456.9499 (1.00)     0.0000 (1.0)      456.9499 (1.00)     0.0000 (1.0)           0;0  2.1884 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        846.8935 (1.0)         846.8935 (1.0)         846.8935 (1.0)      0.0000 (1.0)         846.8935 (1.0)      0.0000 (1.0)           0;0  1.1808 (1.0)           1           1
test_exp_show-exp[3.10.0]     13,291.9025 (15.69)    13,291.9025 (15.69)    13,291.9025 (15.69)    0.0000 (1.0)      13,291.9025 (15.69)    0.0000 (1.0)           0;0  0.0752 (0.06)          1           1
test_exp_show-exp[main]       10,098.5986 (11.92)    10,098.5986 (11.92)    10,098.5986 (11.92)    0.0000 (1.0)      10,098.5986 (11.92)    0.0000 (1.0)           0;0  0.0990 (0.08)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     485.4757 (1.04)     485.4757 (1.04)     485.4757 (1.04)     0.0000 (1.0)      485.4757 (1.04)     0.0000 (1.0)           0;0  2.0598 (0.96)          1           1
test_fetch-fetch[3.10.0]     481.6672 (1.03)     481.6672 (1.03)     481.6672 (1.03)     0.0000 (1.0)      481.6672 (1.03)     0.0000 (1.0)           0;0  2.0761 (0.97)          1           1
test_fetch-fetch[main]       466.3275 (1.0)      466.3275 (1.0)      466.3275 (1.0)      0.0000 (1.0)      466.3275 (1.0)      0.0000 (1.0)           0;0  2.1444 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     364.1284 (1.0)      364.1284 (1.0)      364.1284 (1.0)      0.0000 (1.0)      364.1284 (1.0)      0.0000 (1.0)           0;0  2.7463 (1.0)           1           1
test_gc-gc[3.10.0]     364.1624 (1.00)     364.1624 (1.00)     364.1624 (1.00)     0.0000 (1.0)      364.1624 (1.00)     0.0000 (1.0)           0;0  2.7460 (1.00)          1           1
test_gc-gc[main]       365.2344 (1.00)     365.2344 (1.00)     365.2344 (1.00)     0.0000 (1.0)      365.2344 (1.00)     0.0000 (1.0)           0;0  2.7380 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     472.0263 (1.0)      472.0263 (1.0)      472.0263 (1.0)      0.0000 (1.0)      472.0263 (1.0)      0.0000 (1.0)           0;0  2.1185 (1.0)           1           1
test_get-get[3.10.0]     472.7478 (1.00)     472.7478 (1.00)     472.7478 (1.00)     0.0000 (1.0)      472.7478 (1.00)     0.0000 (1.0)           0;0  2.1153 (1.00)          1           1
test_get-get[main]       514.8148 (1.09)     514.8148 (1.09)     514.8148 (1.09)     0.0000 (1.0)      514.8148 (1.09)     0.0000 (1.0)           0;0  1.9424 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     346.3408 (1.0)      346.3408 (1.0)      346.3408 (1.0)      0.0000 (1.0)      346.3408 (1.0)      0.0000 (1.0)           0;0  2.8873 (1.0)           1           1
test_get_url-get-url[3.10.0]     366.0680 (1.06)     366.0680 (1.06)     366.0680 (1.06)     0.0000 (1.0)      366.0680 (1.06)     0.0000 (1.0)           0;0  2.7317 (0.95)          1           1
test_get_url-get-url[main]       371.1821 (1.07)     371.1821 (1.07)     371.1821 (1.07)     0.0000 (1.0)      371.1821 (1.07)     0.0000 (1.0)           0;0  2.6941 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     129.3033 (1.02)     139.3680 (1.02)     132.6593 (1.02)     1.6271 (1.06)     132.6120 (1.03)     2.5393 (1.44)         32;1  7.5381 (0.98)        100           1
test_help---help[3.10.0]     126.4141 (1.0)      137.2562 (1.0)      129.5689 (1.0)      1.5404 (1.0)      129.3446 (1.0)      1.8920 (1.08)         26;1  7.7179 (1.0)         100           1
test_help---help[main]       128.6276 (1.02)     137.7360 (1.00)     131.0421 (1.01)     1.6583 (1.08)     130.6093 (1.01)     1.7582 (1.0)          19;5  7.6311 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     684.9382 (1.01)     684.9382 (1.01)     684.9382 (1.01)     0.0000 (1.0)      684.9382 (1.01)     0.0000 (1.0)           0;0  1.4600 (0.99)          1           1
test_import-import[3.10.0]     679.0005 (1.0)      679.0005 (1.0)      679.0005 (1.0)      0.0000 (1.0)      679.0005 (1.0)      0.0000 (1.0)           0;0  1.4728 (1.0)           1           1
test_import-import[main]       746.7262 (1.10)     746.7262 (1.10)     746.7262 (1.10)     0.0000 (1.0)      746.7262 (1.10)     0.0000 (1.0)           0;0  1.3392 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     645.7219 (1.04)     645.7219 (1.04)     645.7219 (1.04)     0.0000 (1.0)      645.7219 (1.04)     0.0000 (1.0)           0;0  1.5487 (0.96)          1           1
test_import_url-import-url[3.10.0]     651.1685 (1.05)     651.1685 (1.05)     651.1685 (1.05)     0.0000 (1.0)      651.1685 (1.05)     0.0000 (1.0)           0;0  1.5357 (0.95)          1           1
test_import_url-import-url[main]       621.7542 (1.0)      621.7542 (1.0)      621.7542 (1.0)      0.0000 (1.0)      621.7542 (1.0)      0.0000 (1.0)           0;0  1.6084 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     390.0521 (1.0)      445.3788 (1.0)      406.6890 (1.0)       9.2642 (1.02)     405.8205 (1.0)       8.8333 (1.0)          23;7  2.4589 (1.0)         100           1
test_init-init[3.10.0]     400.8829 (1.03)     461.8481 (1.04)     417.8422 (1.03)      9.1189 (1.0)      417.6715 (1.03)     10.6971 (1.21)         30;1  2.3932 (0.97)        100           1
test_init-init[main]       418.8289 (1.07)     485.7059 (1.09)     434.2160 (1.07)     11.2658 (1.24)     431.8437 (1.06)     13.5597 (1.54)         26;2  2.3030 (0.94)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     415.4891 (1.04)     415.4891 (1.04)     415.4891 (1.04)     0.0000 (1.0)      415.4891 (1.04)     0.0000 (1.0)           0;0  2.4068 (0.96)          1           1
test_list-list[3.10.0]     425.2463 (1.06)     425.2463 (1.06)     425.2463 (1.06)     0.0000 (1.0)      425.2463 (1.06)     0.0000 (1.0)           0;0  2.3516 (0.94)          1           1
test_list-list[main]       400.2882 (1.0)      400.2882 (1.0)      400.2882 (1.0)      0.0000 (1.0)      400.2882 (1.0)      0.0000 (1.0)           0;0  2.4982 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     390.2192 (1.0)      390.2192 (1.0)      390.2192 (1.0)      0.0000 (1.0)      390.2192 (1.0)      0.0000 (1.0)           0;0  2.5627 (1.0)           1           1
test_list-list-dvc-only[3.10.0]     391.0094 (1.00)     391.0094 (1.00)     391.0094 (1.00)     0.0000 (1.0)      391.0094 (1.00)     0.0000 (1.0)           0;0  2.5575 (1.00)          1           1
test_list-list-dvc-only[main]       404.4559 (1.04)     404.4559 (1.04)     404.4559 (1.04)     0.0000 (1.0)      404.4559 (1.04)     0.0000 (1.0)           0;0  2.4725 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     400.5687 (1.00)     400.5687 (1.00)     400.5687 (1.00)     0.0000 (1.0)      400.5687 (1.00)     0.0000 (1.0)           0;0  2.4965 (1.00)          1           1
test_list-list-recursive[3.10.0]     400.5086 (1.0)      400.5086 (1.0)      400.5086 (1.0)      0.0000 (1.0)      400.5086 (1.0)      0.0000 (1.0)           0;0  2.4968 (1.0)           1           1
test_list-list-recursive[main]       445.5147 (1.11)     445.5147 (1.11)     445.5147 (1.11)     0.0000 (1.0)      445.5147 (1.11)     0.0000 (1.0)           0;0  2.2446 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     393.0147 (1.01)     393.0147 (1.01)     393.0147 (1.01)     0.0000 (1.0)      393.0147 (1.01)     0.0000 (1.0)           0;0  2.5444 (0.99)          1           1
test_list-list-shallow[3.10.0]     390.6612 (1.0)      390.6612 (1.0)      390.6612 (1.0)      0.0000 (1.0)      390.6612 (1.0)      0.0000 (1.0)           0;0  2.5598 (1.0)           1           1
test_list-list-shallow[main]       409.7577 (1.05)     409.7577 (1.05)     409.7577 (1.05)     0.0000 (1.0)      409.7577 (1.05)     0.0000 (1.0)           0;0  2.4405 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     529.8282 (1.01)     529.8282 (1.01)     529.8282 (1.01)     0.0000 (1.0)      529.8282 (1.01)     0.0000 (1.0)           0;0  1.8874 (0.99)          1           1
test_partial_add-add[3.10.0]     557.8109 (1.06)     557.8109 (1.06)     557.8109 (1.06)     0.0000 (1.0)      557.8109 (1.06)     0.0000 (1.0)           0;0  1.7927 (0.94)          1           1
test_partial_add-add[main]       525.5594 (1.0)      525.5594 (1.0)      525.5594 (1.0)      0.0000 (1.0)      525.5594 (1.0)      0.0000 (1.0)           0;0  1.9027 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     558.4730 (1.0)      558.4730 (1.0)      558.4730 (1.0)      0.0000 (1.0)      558.4730 (1.0)      0.0000 (1.0)           0;0  1.7906 (1.0)           1           1
test_partial_add-add-partial[3.10.0]     566.0011 (1.01)     566.0011 (1.01)     566.0011 (1.01)     0.0000 (1.0)      566.0011 (1.01)     0.0000 (1.0)           0;0  1.7668 (0.99)          1           1
test_partial_add-add-partial[main]       561.1804 (1.00)     561.1804 (1.00)     561.1804 (1.00)     0.0000 (1.0)      561.1804 (1.00)     0.0000 (1.0)           0;0  1.7820 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     381.5384 (1.01)     381.5384 (1.01)     381.5384 (1.01)     0.0000 (1.0)      381.5384 (1.01)     0.0000 (1.0)           0;0  2.6210 (0.99)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     378.3359 (1.0)      378.3359 (1.0)      378.3359 (1.0)      0.0000 (1.0)      378.3359 (1.0)      0.0000 (1.0)           0;0  2.6432 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       382.6120 (1.01)     382.6120 (1.01)     382.6120 (1.01)     0.0000 (1.0)      382.6120 (1.01)     0.0000 (1.0)           0;0  2.6136 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     358.0836 (1.0)      358.0836 (1.0)      358.0836 (1.0)      0.0000 (1.0)      358.0836 (1.0)      0.0000 (1.0)           0;0  2.7926 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     370.4010 (1.03)     370.4010 (1.03)     370.4010 (1.03)     0.0000 (1.0)      370.4010 (1.03)     0.0000 (1.0)           0;0  2.6998 (0.97)          1           1
test_partial_add-gc-noop[main]       370.9227 (1.04)     370.9227 (1.04)     370.9227 (1.04)     0.0000 (1.0)      370.9227 (1.04)     0.0000 (1.0)           0;0  2.6960 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     406.1908 (1.01)     406.1908 (1.01)     406.1908 (1.01)     0.0000 (1.0)      406.1908 (1.01)     0.0000 (1.0)           0;0  2.4619 (0.99)          1           1
test_partial_add-push[3.10.0]     401.5336 (1.0)      401.5336 (1.0)      401.5336 (1.0)      0.0000 (1.0)      401.5336 (1.0)      0.0000 (1.0)           0;0  2.4905 (1.0)           1           1
test_partial_add-push[main]       424.3120 (1.06)     424.3120 (1.06)     424.3120 (1.06)     0.0000 (1.0)      424.3120 (1.06)     0.0000 (1.0)           0;0  2.3568 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     409.6827 (1.02)     409.6827 (1.02)     409.6827 (1.02)     0.0000 (1.0)      409.6827 (1.02)     0.0000 (1.0)           0;0  2.4409 (0.98)          1           1
test_partial_add-push-partial[3.10.0]     402.4624 (1.0)      402.4624 (1.0)      402.4624 (1.0)      0.0000 (1.0)      402.4624 (1.0)      0.0000 (1.0)           0;0  2.4847 (1.0)           1           1
test_partial_add-push-partial[main]       431.4016 (1.07)     431.4016 (1.07)     431.4016 (1.07)     0.0000 (1.0)      431.4016 (1.07)     0.0000 (1.0)           0;0  2.3180 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     584.1581 (1.0)      584.1581 (1.0)      584.1581 (1.0)      0.0000 (1.0)      584.1581 (1.0)      0.0000 (1.0)           0;0  1.7119 (1.0)           1           1
test_partial_remove-add[3.10.0]     587.7626 (1.01)     587.7626 (1.01)     587.7626 (1.01)     0.0000 (1.0)      587.7626 (1.01)     0.0000 (1.0)           0;0  1.7014 (0.99)          1           1
test_partial_remove-add[main]       587.9427 (1.01)     587.9427 (1.01)     587.9427 (1.01)     0.0000 (1.0)      587.9427 (1.01)     0.0000 (1.0)           0;0  1.7008 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     521.9041 (1.0)      521.9041 (1.0)      521.9041 (1.0)      0.0000 (1.0)      521.9041 (1.0)      0.0000 (1.0)           0;0  1.9161 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     548.5503 (1.05)     548.5503 (1.05)     548.5503 (1.05)     0.0000 (1.0)      548.5503 (1.05)     0.0000 (1.0)           0;0  1.8230 (0.95)          1           1
test_partial_remove-add-update[main]       532.6134 (1.02)     532.6134 (1.02)     532.6134 (1.02)     0.0000 (1.0)      532.6134 (1.02)     0.0000 (1.0)           0;0  1.8775 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     367.7753 (1.0)      367.7753 (1.0)      367.7753 (1.0)      0.0000 (1.0)      367.7753 (1.0)      0.0000 (1.0)           0;0  2.7191 (1.0)           1           1
test_partial_remove-gc[3.10.0]     374.6060 (1.02)     374.6060 (1.02)     374.6060 (1.02)     0.0000 (1.0)      374.6060 (1.02)     0.0000 (1.0)           0;0  2.6695 (0.98)          1           1
test_partial_remove-gc[main]       378.1440 (1.03)     378.1440 (1.03)     378.1440 (1.03)     0.0000 (1.0)      378.1440 (1.03)     0.0000 (1.0)           0;0  2.6445 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     384.1446 (1.0)      384.1446 (1.0)      384.1446 (1.0)      0.0000 (1.0)      384.1446 (1.0)      0.0000 (1.0)           0;0  2.6032 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     391.2356 (1.02)     391.2356 (1.02)     391.2356 (1.02)     0.0000 (1.0)      391.2356 (1.02)     0.0000 (1.0)           0;0  2.5560 (0.98)          1           1
test_partial_remove-gc-cloud[main]       390.2202 (1.02)     390.2202 (1.02)     390.2202 (1.02)     0.0000 (1.0)      390.2202 (1.02)     0.0000 (1.0)           0;0  2.5627 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     430.2015 (1.02)     430.2015 (1.02)     430.2015 (1.02)     0.0000 (1.0)      430.2015 (1.02)     0.0000 (1.0)           0;0  2.3245 (0.98)          1           1
test_partial_remove-push[3.10.0]     421.7166 (1.0)      421.7166 (1.0)      421.7166 (1.0)      0.0000 (1.0)      421.7166 (1.0)      0.0000 (1.0)           0;0  2.3713 (1.0)           1           1
test_partial_remove-push[main]       470.6096 (1.12)     470.6096 (1.12)     470.6096 (1.12)     0.0000 (1.0)      470.6096 (1.12)     0.0000 (1.0)           0;0  2.1249 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     384.9596 (1.0)      384.9596 (1.0)      384.9596 (1.0)      0.0000 (1.0)      384.9596 (1.0)      0.0000 (1.0)           0;0  2.5977 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     385.1249 (1.00)     385.1249 (1.00)     385.1249 (1.00)     0.0000 (1.0)      385.1249 (1.00)     0.0000 (1.0)           0;0  2.5966 (1.00)          1           1
test_partial_remove-push-update[main]       419.3610 (1.09)     419.3610 (1.09)     419.3610 (1.09)     0.0000 (1.0)      419.3610 (1.09)     0.0000 (1.0)           0;0  2.3846 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     423.6429 (1.0)      431.9602 (1.0)      429.4975 (1.0)      3.3547 (1.59)     430.7423 (1.0)      3.0397 (1.0)           1;1  2.3283 (1.0)           5           3
test_plots-plots-diff[3.10.0]     782.0598 (1.85)     791.5217 (1.83)     785.8497 (1.83)     3.5558 (1.68)     785.5498 (1.82)     4.1077 (1.35)          2;0  1.2725 (0.55)          5           3
test_plots-plots-diff[main]       747.6896 (1.76)     752.5925 (1.74)     750.2734 (1.75)     2.1138 (1.0)      749.8810 (1.74)     3.7014 (1.22)          2;0  1.3328 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       436.2049 (1.0)        447.3119 (1.0)        440.5546 (1.0)      4.2657 (1.54)       439.8033 (1.0)       5.4320 (1.44)          2;0  2.2699 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,032.8139 (2.37)     1,039.8618 (2.32)     1,037.0234 (2.35)     2.7680 (1.0)      1,036.8102 (2.36)      3.7663 (1.0)           2;0  0.9643 (0.42)          5           3
test_plots-plots-diff-json[main]         826.1467 (1.89)       849.8785 (1.90)       834.6453 (1.89)     9.1788 (3.32)       831.3248 (1.89)     10.1583 (2.70)          1;0  1.1981 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     395.4805 (1.0)      403.3855 (1.0)      399.0362 (1.0)      2.8707 (1.0)      398.6477 (1.0)      3.1243 (1.0)           2;0  2.5060 (1.0)           5           3
test_plots-plots-show[3.10.0]     648.8020 (1.64)     660.2954 (1.64)     651.9876 (1.63)     4.7403 (1.65)     649.7109 (1.63)     4.1643 (1.33)          1;1  1.5338 (0.61)          5           3
test_plots-plots-show[main]       646.8443 (1.64)     656.1527 (1.63)     650.8510 (1.63)     3.7554 (1.31)     651.4445 (1.63)     5.7004 (1.82)          2;0  1.5364 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     409.2854 (1.0)      414.5475 (1.0)      412.4205 (1.0)      2.1240 (1.0)      413.2488 (1.0)      3.1500 (1.0)           2;0  2.4247 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     796.5539 (1.95)     803.9725 (1.94)     801.0905 (1.94)     3.2833 (1.55)     802.8692 (1.94)     5.3826 (1.71)          1;0  1.2483 (0.51)          5           3
test_plots-plots-show-json[main]       693.1082 (1.69)     702.3617 (1.69)     697.5840 (1.69)     3.6644 (1.73)     696.4627 (1.69)     5.5409 (1.76)          2;0  1.4335 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     454.9655 (1.0)      454.9655 (1.0)      454.9655 (1.0)      0.0000 (1.0)      454.9655 (1.0)      0.0000 (1.0)           0;0  2.1980 (1.0)           1           1
test_push-push[3.10.0]     466.1891 (1.02)     466.1891 (1.02)     466.1891 (1.02)     0.0000 (1.0)      466.1891 (1.02)     0.0000 (1.0)           0;0  2.1451 (0.98)          1           1
test_push-push[main]       488.1309 (1.07)     488.1309 (1.07)     488.1309 (1.07)     0.0000 (1.0)      488.1309 (1.07)     0.0000 (1.0)           0;0  2.0486 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     580.0480 (1.0)      580.0480 (1.0)      580.0480 (1.0)      0.0000 (1.0)      580.0480 (1.0)      0.0000 (1.0)           0;0  1.7240 (1.0)           1           1
test_sharing-add[3.10.0]     606.5217 (1.05)     606.5217 (1.05)     606.5217 (1.05)     0.0000 (1.0)      606.5217 (1.05)     0.0000 (1.0)           0;0  1.6487 (0.96)          1           1
test_sharing-add[main]       600.8061 (1.04)     600.8061 (1.04)     600.8061 (1.04)     0.0000 (1.0)      600.8061 (1.04)     0.0000 (1.0)           0;0  1.6644 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     534.1137 (1.0)      534.1137 (1.0)      534.1137 (1.0)      0.0000 (1.0)      534.1137 (1.0)      0.0000 (1.0)           0;0  1.8723 (1.0)           1           1
test_sharing-add-noop[3.10.0]     545.8212 (1.02)     545.8212 (1.02)     545.8212 (1.02)     0.0000 (1.0)      545.8212 (1.02)     0.0000 (1.0)           0;0  1.8321 (0.98)          1           1
test_sharing-add-noop[main]       565.7985 (1.06)     565.7985 (1.06)     565.7985 (1.06)     0.0000 (1.0)      565.7985 (1.06)     0.0000 (1.0)           0;0  1.7674 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     434.3838 (1.0)      434.3838 (1.0)      434.3838 (1.0)      0.0000 (1.0)      434.3838 (1.0)      0.0000 (1.0)           0;0  2.3021 (1.0)           1           1
test_sharing-checkout[3.10.0]     465.0172 (1.07)     465.0172 (1.07)     465.0172 (1.07)     0.0000 (1.0)      465.0172 (1.07)     0.0000 (1.0)           0;0  2.1505 (0.93)          1           1
test_sharing-checkout[main]       461.8219 (1.06)     461.8219 (1.06)     461.8219 (1.06)     0.0000 (1.0)      461.8219 (1.06)     0.0000 (1.0)           0;0  2.1653 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     367.4296 (1.0)      367.4296 (1.0)      367.4296 (1.0)      0.0000 (1.0)      367.4296 (1.0)      0.0000 (1.0)           0;0  2.7216 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     387.3947 (1.05)     387.3947 (1.05)     387.3947 (1.05)     0.0000 (1.0)      387.3947 (1.05)     0.0000 (1.0)           0;0  2.5813 (0.95)          1           1
test_sharing-checkout-noop[main]       397.9318 (1.08)     397.9318 (1.08)     397.9318 (1.08)     0.0000 (1.0)      397.9318 (1.08)     0.0000 (1.0)           0;0  2.5130 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     441.9967 (1.0)      441.9967 (1.0)      441.9967 (1.0)      0.0000 (1.0)      441.9967 (1.0)      0.0000 (1.0)           0;0  2.2625 (1.0)           1           1
test_sharing-fetch[3.10.0]     507.2469 (1.15)     507.2469 (1.15)     507.2469 (1.15)     0.0000 (1.0)      507.2469 (1.15)     0.0000 (1.0)           0;0  1.9714 (0.87)          1           1
test_sharing-fetch[main]       469.5983 (1.06)     469.5983 (1.06)     469.5983 (1.06)     0.0000 (1.0)      469.5983 (1.06)     0.0000 (1.0)           0;0  2.1295 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     379.0644 (1.0)      379.0644 (1.0)      379.0644 (1.0)      0.0000 (1.0)      379.0644 (1.0)      0.0000 (1.0)           0;0  2.6381 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     381.7989 (1.01)     381.7989 (1.01)     381.7989 (1.01)     0.0000 (1.0)      381.7989 (1.01)     0.0000 (1.0)           0;0  2.6192 (0.99)          1           1
test_sharing-fetch-noop[main]       444.9350 (1.17)     444.9350 (1.17)     444.9350 (1.17)     0.0000 (1.0)      444.9350 (1.17)     0.0000 (1.0)           0;0  2.2475 (0.85)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     438.0731 (1.01)     438.0731 (1.01)     438.0731 (1.01)     0.0000 (1.0)      438.0731 (1.01)     0.0000 (1.0)           0;0  2.2827 (0.99)          1           1
test_sharing-push[3.10.0]     432.2519 (1.0)      432.2519 (1.0)      432.2519 (1.0)      0.0000 (1.0)      432.2519 (1.0)      0.0000 (1.0)           0;0  2.3135 (1.0)           1           1
test_sharing-push[main]       492.0749 (1.14)     492.0749 (1.14)     492.0749 (1.14)     0.0000 (1.0)      492.0749 (1.14)     0.0000 (1.0)           0;0  2.0322 (0.88)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     378.3881 (1.0)      378.3881 (1.0)      378.3881 (1.0)      0.0000 (1.0)      378.3881 (1.0)      0.0000 (1.0)           0;0  2.6428 (1.0)           1           1
test_sharing-push-noop[3.10.0]     383.3166 (1.01)     383.3166 (1.01)     383.3166 (1.01)     0.0000 (1.0)      383.3166 (1.01)     0.0000 (1.0)           0;0  2.6088 (0.99)          1           1
test_sharing-push-noop[main]       434.4838 (1.15)     434.4838 (1.15)     434.4838 (1.15)     0.0000 (1.0)      434.4838 (1.15)     0.0000 (1.0)           0;0  2.3016 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     414.0886 (1.0)      414.0886 (1.0)      414.0886 (1.0)      0.0000 (1.0)      414.0886 (1.0)      0.0000 (1.0)           0;0  2.4149 (1.0)           1           1
test_status-status[3.10.0]     425.0059 (1.03)     425.0059 (1.03)     425.0059 (1.03)     0.0000 (1.0)      425.0059 (1.03)     0.0000 (1.0)           0;0  2.3529 (0.97)          1           1
test_status-status[main]       416.3687 (1.01)     416.3687 (1.01)     416.3687 (1.01)     0.0000 (1.0)      416.3687 (1.01)     0.0000 (1.0)           0;0  2.4017 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     368.8942 (1.0)      368.8942 (1.0)      368.8942 (1.0)      0.0000 (1.0)      368.8942 (1.0)      0.0000 (1.0)           0;0  2.7108 (1.0)           1           1
test_status-status-changed[3.10.0]     381.1969 (1.03)     381.1969 (1.03)     381.1969 (1.03)     0.0000 (1.0)      381.1969 (1.03)     0.0000 (1.0)           0;0  2.6233 (0.97)          1           1
test_status-status-changed[main]       377.0866 (1.02)     377.0866 (1.02)     377.0866 (1.02)     0.0000 (1.0)      377.0866 (1.02)     0.0000 (1.0)           0;0  2.6519 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     366.9856 (1.0)      366.9856 (1.0)      366.9856 (1.0)      0.0000 (1.0)      366.9856 (1.0)      0.0000 (1.0)           0;0  2.7249 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     375.5361 (1.02)     375.5361 (1.02)     375.5361 (1.02)     0.0000 (1.0)      375.5361 (1.02)     0.0000 (1.0)           0;0  2.6629 (0.98)          1           1
test_status-status-changed-noop[main]       381.3917 (1.04)     381.3917 (1.04)     381.3917 (1.04)     0.0000 (1.0)      381.3917 (1.04)     0.0000 (1.0)           0;0  2.6220 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     369.8057 (1.0)      369.8057 (1.0)      369.8057 (1.0)      0.0000 (1.0)      369.8057 (1.0)      0.0000 (1.0)           0;0  2.7041 (1.0)           1           1
test_status-status-noop[3.10.0]     375.6024 (1.02)     375.6024 (1.02)     375.6024 (1.02)     0.0000 (1.0)      375.6024 (1.02)     0.0000 (1.0)           0;0  2.6624 (0.98)          1           1
test_status-status-noop[main]       375.6882 (1.02)     375.6882 (1.02)     375.6882 (1.02)     0.0000 (1.0)      375.6882 (1.02)     0.0000 (1.0)           0;0  2.6618 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     651.7451 (1.02)     651.7451 (1.02)     651.7451 (1.02)     0.0000 (1.0)      651.7451 (1.02)     0.0000 (1.0)           0;0  1.5343 (0.98)          1           1
test_update-import-url[3.10.0]     645.9988 (1.01)     645.9988 (1.01)     645.9988 (1.01)     0.0000 (1.0)      645.9988 (1.01)     0.0000 (1.0)           0;0  1.5480 (0.99)          1           1
test_update-import-url[main]       637.3770 (1.0)      637.3770 (1.0)      637.3770 (1.0)      0.0000 (1.0)      637.3770 (1.0)      0.0000 (1.0)           0;0  1.5689 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     524.0182 (1.0)      524.0182 (1.0)      524.0182 (1.0)      0.0000 (1.0)      524.0182 (1.0)      0.0000 (1.0)           0;0  1.9083 (1.0)           1           1
test_update-update[3.10.0]     529.7594 (1.01)     529.7594 (1.01)     529.7594 (1.01)     0.0000 (1.0)      529.7594 (1.01)     0.0000 (1.0)           0;0  1.8876 (0.99)          1           1
test_update-update[main]       527.0136 (1.01)     527.0136 (1.01)     527.0136 (1.01)     0.0000 (1.0)      527.0136 (1.01)     0.0000 (1.0)           0;0  1.8975 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     400.5602 (1.0)      400.5602 (1.0)      400.5602 (1.0)      0.0000 (1.0)      400.5602 (1.0)      0.0000 (1.0)           0;0  2.4965 (1.0)           1           1
test_update-update-noop[3.10.0]     439.3519 (1.10)     439.3519 (1.10)     439.3519 (1.10)     0.0000 (1.0)      439.3519 (1.10)     0.0000 (1.0)           0;0  2.2761 (0.91)          1           1
test_update-update-noop[main]       416.3903 (1.04)     416.3903 (1.04)     416.3903 (1.04)     0.0000 (1.0)      416.3903 (1.04)     0.0000 (1.0)           0;0  2.4016 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean