Fri Dec  8 23:31:15 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     583.8031 (1.0)      583.8031 (1.0)      583.8031 (1.0)      0.0000 (1.0)      583.8031 (1.0)      0.0000 (1.0)           0;0  1.7129 (1.0)           1           1
test_add-add[3.10.0]     604.4703 (1.04)     604.4703 (1.04)     604.4703 (1.04)     0.0000 (1.0)      604.4703 (1.04)     0.0000 (1.0)           0;0  1.6543 (0.97)          1           1
test_add-add[main]       589.4217 (1.01)     589.4217 (1.01)     589.4217 (1.01)     0.0000 (1.0)      589.4217 (1.01)     0.0000 (1.0)           0;0  1.6966 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     531.1047 (1.0)      531.1047 (1.0)      531.1047 (1.0)      0.0000 (1.0)      531.1047 (1.0)      0.0000 (1.0)           0;0  1.8829 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     573.7740 (1.08)     573.7740 (1.08)     573.7740 (1.08)     0.0000 (1.0)      573.7740 (1.08)     0.0000 (1.0)           0;0  1.7428 (0.93)          1           1
test_checkout_copy-checkout[main]       551.0648 (1.04)     551.0648 (1.04)     551.0648 (1.04)     0.0000 (1.0)      551.0648 (1.04)     0.0000 (1.0)           0;0  1.8147 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     377.1266 (1.0)      377.1266 (1.0)      377.1266 (1.0)      0.0000 (1.0)      377.1266 (1.0)      0.0000 (1.0)           0;0  2.6516 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     392.2347 (1.04)     392.2347 (1.04)     392.2347 (1.04)     0.0000 (1.0)      392.2347 (1.04)     0.0000 (1.0)           0;0  2.5495 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       390.5258 (1.04)     390.5258 (1.04)     390.5258 (1.04)     0.0000 (1.0)      390.5258 (1.04)     0.0000 (1.0)           0;0  2.5606 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     412.1717 (1.0)      412.1717 (1.0)      412.1717 (1.0)      0.0000 (1.0)      412.1717 (1.0)      0.0000 (1.0)           0;0  2.4262 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     419.6534 (1.02)     419.6534 (1.02)     419.6534 (1.02)     0.0000 (1.0)      419.6534 (1.02)     0.0000 (1.0)           0;0  2.3829 (0.98)          1           1
test_checkout_copy-checkout-update[main]       419.6333 (1.02)     419.6333 (1.02)     419.6333 (1.02)     0.0000 (1.0)      419.6333 (1.02)     0.0000 (1.0)           0;0  2.3830 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     511.1429 (1.0)      511.1429 (1.0)      511.1429 (1.0)      0.0000 (1.0)      511.1429 (1.0)      0.0000 (1.0)           0;0  1.9564 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     528.4972 (1.03)     528.4972 (1.03)     528.4972 (1.03)     0.0000 (1.0)      528.4972 (1.03)     0.0000 (1.0)           0;0  1.8922 (0.97)          1           1
test_checkout_hardlink-checkout[main]       519.3134 (1.02)     519.3134 (1.02)     519.3134 (1.02)     0.0000 (1.0)      519.3134 (1.02)     0.0000 (1.0)           0;0  1.9256 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     366.8532 (1.0)      366.8532 (1.0)      366.8532 (1.0)      0.0000 (1.0)      366.8532 (1.0)      0.0000 (1.0)           0;0  2.7259 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     388.4931 (1.06)     388.4931 (1.06)     388.4931 (1.06)     0.0000 (1.0)      388.4931 (1.06)     0.0000 (1.0)           0;0  2.5740 (0.94)          1           1
test_checkout_hardlink-checkout-noop[main]       378.7971 (1.03)     378.7971 (1.03)     378.7971 (1.03)     0.0000 (1.0)      378.7971 (1.03)     0.0000 (1.0)           0;0  2.6399 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     406.2902 (1.0)      406.2902 (1.0)      406.2902 (1.0)      0.0000 (1.0)      406.2902 (1.0)      0.0000 (1.0)           0;0  2.4613 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     420.0900 (1.03)     420.0900 (1.03)     420.0900 (1.03)     0.0000 (1.0)      420.0900 (1.03)     0.0000 (1.0)           0;0  2.3804 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       415.6597 (1.02)     415.6597 (1.02)     415.6597 (1.02)     0.0000 (1.0)      415.6597 (1.02)     0.0000 (1.0)           0;0  2.4058 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     529.2364 (1.0)      529.2364 (1.0)      529.2364 (1.0)      0.0000 (1.0)      529.2364 (1.0)      0.0000 (1.0)           0;0  1.8895 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     540.0126 (1.02)     540.0126 (1.02)     540.0126 (1.02)     0.0000 (1.0)      540.0126 (1.02)     0.0000 (1.0)           0;0  1.8518 (0.98)          1           1
test_checkout_symlink-checkout[main]       584.2343 (1.10)     584.2343 (1.10)     584.2343 (1.10)     0.0000 (1.0)      584.2343 (1.10)     0.0000 (1.0)           0;0  1.7116 (0.91)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     377.8673 (1.0)      377.8673 (1.0)      377.8673 (1.0)      0.0000 (1.0)      377.8673 (1.0)      0.0000 (1.0)           0;0  2.6464 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     407.9296 (1.08)     407.9296 (1.08)     407.9296 (1.08)     0.0000 (1.0)      407.9296 (1.08)     0.0000 (1.0)           0;0  2.4514 (0.93)          1           1
test_checkout_symlink-checkout-noop[main]       396.0719 (1.05)     396.0719 (1.05)     396.0719 (1.05)     0.0000 (1.0)      396.0719 (1.05)     0.0000 (1.0)           0;0  2.5248 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     412.1172 (1.0)      412.1172 (1.0)      412.1172 (1.0)      0.0000 (1.0)      412.1172 (1.0)      0.0000 (1.0)           0;0  2.4265 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     497.3798 (1.21)     497.3798 (1.21)     497.3798 (1.21)     0.0000 (1.0)      497.3798 (1.21)     0.0000 (1.0)           0;0  2.0105 (0.83)          1           1
test_checkout_symlink-checkout-update[main]       431.6676 (1.05)     431.6676 (1.05)     431.6676 (1.05)     0.0000 (1.0)      431.6676 (1.05)     0.0000 (1.0)           0;0  2.3166 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     464.0944 (1.07)     464.0944 (1.07)     464.0944 (1.07)     0.0000 (1.0)      464.0944 (1.07)     0.0000 (1.0)           0;0  2.1547 (0.94)          1           1
test_data_status-data-changed[3.10.0]     434.7476 (1.0)      434.7476 (1.0)      434.7476 (1.0)      0.0000 (1.0)      434.7476 (1.0)      0.0000 (1.0)           0;0  2.3002 (1.0)           1           1
test_data_status-data-changed[main]       438.5638 (1.01)     438.5638 (1.01)     438.5638 (1.01)     0.0000 (1.0)      438.5638 (1.01)     0.0000 (1.0)           0;0  2.2802 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     466.0973 (1.09)     466.0973 (1.09)     466.0973 (1.09)     0.0000 (1.0)      466.0973 (1.09)     0.0000 (1.0)           0;0  2.1455 (0.92)          1           1
test_data_status-data-changed-noop[3.10.0]     427.8217 (1.0)      427.8217 (1.0)      427.8217 (1.0)      0.0000 (1.0)      427.8217 (1.0)      0.0000 (1.0)           0;0  2.3374 (1.0)           1           1
test_data_status-data-changed-noop[main]       448.1750 (1.05)     448.1750 (1.05)     448.1750 (1.05)     0.0000 (1.0)      448.1750 (1.05)     0.0000 (1.0)           0;0  2.2313 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     519.4733 (1.07)     519.4733 (1.07)     519.4733 (1.07)     0.0000 (1.0)      519.4733 (1.07)     0.0000 (1.0)           0;0  1.9250 (0.94)          1           1
test_data_status-data-new[3.10.0]     486.2513 (1.0)      486.2513 (1.0)      486.2513 (1.0)      0.0000 (1.0)      486.2513 (1.0)      0.0000 (1.0)           0;0  2.0565 (1.0)           1           1
test_data_status-data-new[main]       491.8367 (1.01)     491.8367 (1.01)     491.8367 (1.01)     0.0000 (1.0)      491.8367 (1.01)     0.0000 (1.0)           0;0  2.0332 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     466.7121 (1.09)     466.7121 (1.09)     466.7121 (1.09)     0.0000 (1.0)      466.7121 (1.09)     0.0000 (1.0)           0;0  2.1426 (0.92)          1           1
test_data_status-data-noop[3.10.0]     429.0952 (1.0)      429.0952 (1.0)      429.0952 (1.0)      0.0000 (1.0)      429.0952 (1.0)      0.0000 (1.0)           0;0  2.3305 (1.0)           1           1
test_data_status-data-noop[main]       435.1568 (1.01)     435.1568 (1.01)     435.1568 (1.01)     0.0000 (1.0)      435.1568 (1.01)     0.0000 (1.0)           0;0  2.2980 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     502.8081 (1.08)     502.8081 (1.08)     502.8081 (1.08)     0.0000 (1.0)      502.8081 (1.08)     0.0000 (1.0)           0;0  1.9888 (0.92)          1           1
test_data_status_all_flags-data-changed[3.10.0]     465.0965 (1.0)      465.0965 (1.0)      465.0965 (1.0)      0.0000 (1.0)      465.0965 (1.0)      0.0000 (1.0)           0;0  2.1501 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       500.9948 (1.08)     500.9948 (1.08)     500.9948 (1.08)     0.0000 (1.0)      500.9948 (1.08)     0.0000 (1.0)           0;0  1.9960 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     495.1137 (1.06)     495.1137 (1.06)     495.1137 (1.06)     0.0000 (1.0)      495.1137 (1.06)     0.0000 (1.0)           0;0  2.0197 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     467.2688 (1.00)     467.2688 (1.00)     467.2688 (1.00)     0.0000 (1.0)      467.2688 (1.00)     0.0000 (1.0)           0;0  2.1401 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       465.7792 (1.0)      465.7792 (1.0)      465.7792 (1.0)      0.0000 (1.0)      465.7792 (1.0)      0.0000 (1.0)           0;0  2.1469 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     587.1041 (1.13)     587.1041 (1.13)     587.1041 (1.13)     0.0000 (1.0)      587.1041 (1.13)     0.0000 (1.0)           0;0  1.7033 (0.88)          1           1
test_data_status_all_flags-data-new[3.10.0]     518.6563 (1.0)      518.6563 (1.0)      518.6563 (1.0)      0.0000 (1.0)      518.6563 (1.0)      0.0000 (1.0)           0;0  1.9281 (1.0)           1           1
test_data_status_all_flags-data-new[main]       550.6423 (1.06)     550.6423 (1.06)     550.6423 (1.06)     0.0000 (1.0)      550.6423 (1.06)     0.0000 (1.0)           0;0  1.8161 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     493.5697 (1.04)     493.5697 (1.04)     493.5697 (1.04)     0.0000 (1.0)      493.5697 (1.04)     0.0000 (1.0)           0;0  2.0261 (0.96)          1           1
test_data_status_all_flags-data-noop[3.10.0]     475.6521 (1.0)      475.6521 (1.0)      475.6521 (1.0)      0.0000 (1.0)      475.6521 (1.0)      0.0000 (1.0)           0;0  2.1024 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       519.6781 (1.09)     519.6781 (1.09)     519.6781 (1.09)     0.0000 (1.0)      519.6781 (1.09)     0.0000 (1.0)           0;0  1.9243 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     494.0597 (1.0)      494.0597 (1.0)      494.0597 (1.0)      0.0000 (1.0)      494.0597 (1.0)      0.0000 (1.0)           0;0  2.0240 (1.0)           1           1
test_diff-diff[3.10.0]     495.2744 (1.00)     495.2744 (1.00)     495.2744 (1.00)     0.0000 (1.0)      495.2744 (1.00)     0.0000 (1.0)           0;0  2.0191 (1.00)          1           1
test_diff-diff[main]       497.8553 (1.01)     497.8553 (1.01)     497.8553 (1.01)     0.0000 (1.0)      497.8553 (1.01)     0.0000 (1.0)           0;0  2.0086 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     457.3510 (1.01)     457.3510 (1.01)     457.3510 (1.01)     0.0000 (1.0)      457.3510 (1.01)     0.0000 (1.0)           0;0  2.1865 (0.99)          1           1
test_diff-diff-changed[3.10.0]     457.2504 (1.01)     457.2504 (1.01)     457.2504 (1.01)     0.0000 (1.0)      457.2504 (1.01)     0.0000 (1.0)           0;0  2.1870 (0.99)          1           1
test_diff-diff-changed[main]       450.6017 (1.0)      450.6017 (1.0)      450.6017 (1.0)      0.0000 (1.0)      450.6017 (1.0)      0.0000 (1.0)           0;0  2.2193 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     449.1903 (1.00)     449.1903 (1.00)     449.1903 (1.00)     0.0000 (1.0)      449.1903 (1.00)     0.0000 (1.0)           0;0  2.2262 (1.00)          1           1
test_diff-diff-changed-noop[3.10.0]     447.5626 (1.0)      447.5626 (1.0)      447.5626 (1.0)      0.0000 (1.0)      447.5626 (1.0)      0.0000 (1.0)           0;0  2.2343 (1.0)           1           1
test_diff-diff-changed-noop[main]       452.0716 (1.01)     452.0716 (1.01)     452.0716 (1.01)     0.0000 (1.0)      452.0716 (1.01)     0.0000 (1.0)           0;0  2.2120 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     446.5761 (1.01)     446.5761 (1.01)     446.5761 (1.01)     0.0000 (1.0)      446.5761 (1.01)     0.0000 (1.0)           0;0  2.2393 (0.99)          1           1
test_diff-diff-noop[3.10.0]     443.0686 (1.0)      443.0686 (1.0)      443.0686 (1.0)      0.0000 (1.0)      443.0686 (1.0)      0.0000 (1.0)           0;0  2.2570 (1.0)           1           1
test_diff-diff-noop[main]       458.6777 (1.04)     458.6777 (1.04)     458.6777 (1.04)     0.0000 (1.0)      458.6777 (1.04)     0.0000 (1.0)           0;0  2.1802 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        832.0060 (1.0)         832.0060 (1.0)         832.0060 (1.0)      0.0000 (1.0)         832.0060 (1.0)      0.0000 (1.0)           0;0  1.2019 (1.0)           1           1
test_exp_show-exp[3.10.0]     11,844.9511 (14.24)    11,844.9511 (14.24)    11,844.9511 (14.24)    0.0000 (1.0)      11,844.9511 (14.24)    0.0000 (1.0)           0;0  0.0844 (0.07)          1           1
test_exp_show-exp[main]       11,745.1577 (14.12)    11,745.1577 (14.12)    11,745.1577 (14.12)    0.0000 (1.0)      11,745.1577 (14.12)    0.0000 (1.0)           0;0  0.0851 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     457.9128 (1.0)      457.9128 (1.0)      457.9128 (1.0)      0.0000 (1.0)      457.9128 (1.0)      0.0000 (1.0)           0;0  2.1838 (1.0)           1           1
test_fetch-fetch[3.10.0]     491.4988 (1.07)     491.4988 (1.07)     491.4988 (1.07)     0.0000 (1.0)      491.4988 (1.07)     0.0000 (1.0)           0;0  2.0346 (0.93)          1           1
test_fetch-fetch[main]       458.6563 (1.00)     458.6563 (1.00)     458.6563 (1.00)     0.0000 (1.0)      458.6563 (1.00)     0.0000 (1.0)           0;0  2.1803 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     376.4634 (1.01)     376.4634 (1.01)     376.4634 (1.01)     0.0000 (1.0)      376.4634 (1.01)     0.0000 (1.0)           0;0  2.6563 (0.99)          1           1
test_gc-gc[3.10.0]     379.9966 (1.02)     379.9966 (1.02)     379.9966 (1.02)     0.0000 (1.0)      379.9966 (1.02)     0.0000 (1.0)           0;0  2.6316 (0.98)          1           1
test_gc-gc[main]       374.0204 (1.0)      374.0204 (1.0)      374.0204 (1.0)      0.0000 (1.0)      374.0204 (1.0)      0.0000 (1.0)           0;0  2.6737 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     475.5610 (1.01)     475.5610 (1.01)     475.5610 (1.01)     0.0000 (1.0)      475.5610 (1.01)     0.0000 (1.0)           0;0  2.1028 (0.99)          1           1
test_get-get[3.10.0]     470.6716 (1.0)      470.6716 (1.0)      470.6716 (1.0)      0.0000 (1.0)      470.6716 (1.0)      0.0000 (1.0)           0;0  2.1246 (1.0)           1           1
test_get-get[main]       510.6756 (1.08)     510.6756 (1.08)     510.6756 (1.08)     0.0000 (1.0)      510.6756 (1.08)     0.0000 (1.0)           0;0  1.9582 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     329.0538 (1.0)      329.0538 (1.0)      329.0538 (1.0)      0.0000 (1.0)      329.0538 (1.0)      0.0000 (1.0)           0;0  3.0390 (1.0)           1           1
test_get_url-get-url[3.10.0]     352.5772 (1.07)     352.5772 (1.07)     352.5772 (1.07)     0.0000 (1.0)      352.5772 (1.07)     0.0000 (1.0)           0;0  2.8363 (0.93)          1           1
test_get_url-get-url[main]       351.2354 (1.07)     351.2354 (1.07)     351.2354 (1.07)     0.0000 (1.0)      351.2354 (1.07)     0.0000 (1.0)           0;0  2.8471 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.1474 (1.02)     148.5106 (1.04)     126.7074 (1.01)     2.6332 (1.28)     126.2223 (1.01)     0.7701 (1.0)           3;6  7.8922 (0.99)        100           1
test_help---help[3.10.0]     123.2004 (1.0)      145.1795 (1.02)     126.1293 (1.01)     2.6009 (1.26)     125.7519 (1.01)     3.1273 (4.06)         10;1  7.9284 (0.99)        100           1
test_help---help[main]       123.7953 (1.00)     142.8366 (1.0)      125.2798 (1.0)      2.0580 (1.0)      124.9136 (1.0)      1.0567 (1.37)          6;7  7.9821 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     672.4174 (1.0)      672.4174 (1.0)      672.4174 (1.0)      0.0000 (1.0)      672.4174 (1.0)      0.0000 (1.0)           0;0  1.4872 (1.0)           1           1
test_import-import[3.10.0]     681.0620 (1.01)     681.0620 (1.01)     681.0620 (1.01)     0.0000 (1.0)      681.0620 (1.01)     0.0000 (1.0)           0;0  1.4683 (0.99)          1           1
test_import-import[main]       717.6409 (1.07)     717.6409 (1.07)     717.6409 (1.07)     0.0000 (1.0)      717.6409 (1.07)     0.0000 (1.0)           0;0  1.3935 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     635.7193 (1.04)     635.7193 (1.04)     635.7193 (1.04)     0.0000 (1.0)      635.7193 (1.04)     0.0000 (1.0)           0;0  1.5730 (0.97)          1           1
test_import_url-import-url[3.10.0]     632.1378 (1.03)     632.1378 (1.03)     632.1378 (1.03)     0.0000 (1.0)      632.1378 (1.03)     0.0000 (1.0)           0;0  1.5819 (0.97)          1           1
test_import_url-import-url[main]       613.8068 (1.0)      613.8068 (1.0)      613.8068 (1.0)      0.0000 (1.0)      613.8068 (1.0)      0.0000 (1.0)           0;0  1.6292 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     364.7219 (1.0)      392.6749 (1.0)      372.6475 (1.0)      5.6572 (1.0)      371.5558 (1.0)      5.6105 (1.0)          23;7  2.6835 (1.0)         100           1
test_init-init[3.10.0]     372.5415 (1.02)     402.2639 (1.02)     381.2698 (1.02)     6.0691 (1.07)     380.1950 (1.02)     6.4132 (1.14)         28;4  2.6228 (0.98)        100           1
test_init-init[main]       382.7305 (1.05)     414.1700 (1.05)     392.9409 (1.05)     6.3367 (1.12)     391.8381 (1.05)     6.6102 (1.18)         22;9  2.5449 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     412.4851 (1.02)     412.4851 (1.02)     412.4851 (1.02)     0.0000 (1.0)      412.4851 (1.02)     0.0000 (1.0)           0;0  2.4243 (0.98)          1           1
test_list-list[3.10.0]     405.5305 (1.0)      405.5305 (1.0)      405.5305 (1.0)      0.0000 (1.0)      405.5305 (1.0)      0.0000 (1.0)           0;0  2.4659 (1.0)           1           1
test_list-list[main]       420.7232 (1.04)     420.7232 (1.04)     420.7232 (1.04)     0.0000 (1.0)      420.7232 (1.04)     0.0000 (1.0)           0;0  2.3769 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     390.4633 (1.0)      390.4633 (1.0)      390.4633 (1.0)      0.0000 (1.0)      390.4633 (1.0)      0.0000 (1.0)           0;0  2.5611 (1.0)           1           1
test_list-list-dvc-only[3.10.0]     413.4479 (1.06)     413.4479 (1.06)     413.4479 (1.06)     0.0000 (1.0)      413.4479 (1.06)     0.0000 (1.0)           0;0  2.4187 (0.94)          1           1
test_list-list-dvc-only[main]       397.0584 (1.02)     397.0584 (1.02)     397.0584 (1.02)     0.0000 (1.0)      397.0584 (1.02)     0.0000 (1.0)           0;0  2.5185 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     399.7321 (1.01)     399.7321 (1.01)     399.7321 (1.01)     0.0000 (1.0)      399.7321 (1.01)     0.0000 (1.0)           0;0  2.5017 (0.99)          1           1
test_list-list-recursive[3.10.0]     397.6560 (1.0)      397.6560 (1.0)      397.6560 (1.0)      0.0000 (1.0)      397.6560 (1.0)      0.0000 (1.0)           0;0  2.5147 (1.0)           1           1
test_list-list-recursive[main]       400.2388 (1.01)     400.2388 (1.01)     400.2388 (1.01)     0.0000 (1.0)      400.2388 (1.01)     0.0000 (1.0)           0;0  2.4985 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     390.1501 (1.0)      390.1501 (1.0)      390.1501 (1.0)      0.0000 (1.0)      390.1501 (1.0)      0.0000 (1.0)           0;0  2.5631 (1.0)           1           1
test_list-list-shallow[3.10.0]     394.3132 (1.01)     394.3132 (1.01)     394.3132 (1.01)     0.0000 (1.0)      394.3132 (1.01)     0.0000 (1.0)           0;0  2.5361 (0.99)          1           1
test_list-list-shallow[main]       394.1707 (1.01)     394.1707 (1.01)     394.1707 (1.01)     0.0000 (1.0)      394.1707 (1.01)     0.0000 (1.0)           0;0  2.5370 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     577.7217 (1.02)     577.7217 (1.02)     577.7217 (1.02)     0.0000 (1.0)      577.7217 (1.02)     0.0000 (1.0)           0;0  1.7309 (0.98)          1           1
test_partial_add-add[3.10.0]     591.3219 (1.04)     591.3219 (1.04)     591.3219 (1.04)     0.0000 (1.0)      591.3219 (1.04)     0.0000 (1.0)           0;0  1.6911 (0.96)          1           1
test_partial_add-add[main]       566.1064 (1.0)      566.1064 (1.0)      566.1064 (1.0)      0.0000 (1.0)      566.1064 (1.0)      0.0000 (1.0)           0;0  1.7665 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     591.1349 (1.0)      591.1349 (1.0)      591.1349 (1.0)      0.0000 (1.0)      591.1349 (1.0)      0.0000 (1.0)           0;0  1.6917 (1.0)           1           1
test_partial_add-add-partial[3.10.0]     614.0835 (1.04)     614.0835 (1.04)     614.0835 (1.04)     0.0000 (1.0)      614.0835 (1.04)     0.0000 (1.0)           0;0  1.6284 (0.96)          1           1
test_partial_add-add-partial[main]       604.4323 (1.02)     604.4323 (1.02)     604.4323 (1.02)     0.0000 (1.0)      604.4323 (1.02)     0.0000 (1.0)           0;0  1.6544 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     403.8572 (1.0)      403.8572 (1.0)      403.8572 (1.0)      0.0000 (1.0)      403.8572 (1.0)      0.0000 (1.0)           0;0  2.4761 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     413.1832 (1.02)     413.1832 (1.02)     413.1832 (1.02)     0.0000 (1.0)      413.1832 (1.02)     0.0000 (1.0)           0;0  2.4202 (0.98)          1           1
test_partial_add-gc-cloud-noop[main]       417.7533 (1.03)     417.7533 (1.03)     417.7533 (1.03)     0.0000 (1.0)      417.7533 (1.03)     0.0000 (1.0)           0;0  2.3938 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     379.2704 (1.0)      379.2704 (1.0)      379.2704 (1.0)      0.0000 (1.0)      379.2704 (1.0)      0.0000 (1.0)           0;0  2.6366 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     401.6874 (1.06)     401.6874 (1.06)     401.6874 (1.06)     0.0000 (1.0)      401.6874 (1.06)     0.0000 (1.0)           0;0  2.4895 (0.94)          1           1
test_partial_add-gc-noop[main]       393.6675 (1.04)     393.6675 (1.04)     393.6675 (1.04)     0.0000 (1.0)      393.6675 (1.04)     0.0000 (1.0)           0;0  2.5402 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     463.9101 (1.06)     463.9101 (1.06)     463.9101 (1.06)     0.0000 (1.0)      463.9101 (1.06)     0.0000 (1.0)           0;0  2.1556 (0.94)          1           1
test_partial_add-push[3.10.0]     436.4144 (1.0)      436.4144 (1.0)      436.4144 (1.0)      0.0000 (1.0)      436.4144 (1.0)      0.0000 (1.0)           0;0  2.2914 (1.0)           1           1
test_partial_add-push[main]       463.9469 (1.06)     463.9469 (1.06)     463.9469 (1.06)     0.0000 (1.0)      463.9469 (1.06)     0.0000 (1.0)           0;0  2.1554 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     427.9510 (1.0)      427.9510 (1.0)      427.9510 (1.0)      0.0000 (1.0)      427.9510 (1.0)      0.0000 (1.0)           0;0  2.3367 (1.0)           1           1
test_partial_add-push-partial[3.10.0]     435.2760 (1.02)     435.2760 (1.02)     435.2760 (1.02)     0.0000 (1.0)      435.2760 (1.02)     0.0000 (1.0)           0;0  2.2974 (0.98)          1           1
test_partial_add-push-partial[main]       455.6415 (1.06)     455.6415 (1.06)     455.6415 (1.06)     0.0000 (1.0)      455.6415 (1.06)     0.0000 (1.0)           0;0  2.1947 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     602.3462 (1.02)     602.3462 (1.02)     602.3462 (1.02)     0.0000 (1.0)      602.3462 (1.02)     0.0000 (1.0)           0;0  1.6602 (0.98)          1           1
test_partial_remove-add[3.10.0]     624.2747 (1.06)     624.2747 (1.06)     624.2747 (1.06)     0.0000 (1.0)      624.2747 (1.06)     0.0000 (1.0)           0;0  1.6019 (0.94)          1           1
test_partial_remove-add[main]       588.0481 (1.0)      588.0481 (1.0)      588.0481 (1.0)      0.0000 (1.0)      588.0481 (1.0)      0.0000 (1.0)           0;0  1.7005 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     543.9027 (1.01)     543.9027 (1.01)     543.9027 (1.01)     0.0000 (1.0)      543.9027 (1.01)     0.0000 (1.0)           0;0  1.8386 (0.99)          1           1
test_partial_remove-add-update[3.10.0]     539.0974 (1.0)      539.0974 (1.0)      539.0974 (1.0)      0.0000 (1.0)      539.0974 (1.0)      0.0000 (1.0)           0;0  1.8550 (1.0)           1           1
test_partial_remove-add-update[main]       548.2877 (1.02)     548.2877 (1.02)     548.2877 (1.02)     0.0000 (1.0)      548.2877 (1.02)     0.0000 (1.0)           0;0  1.8239 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     371.2592 (1.0)      371.2592 (1.0)      371.2592 (1.0)      0.0000 (1.0)      371.2592 (1.0)      0.0000 (1.0)           0;0  2.6935 (1.0)           1           1
test_partial_remove-gc[3.10.0]     425.9489 (1.15)     425.9489 (1.15)     425.9489 (1.15)     0.0000 (1.0)      425.9489 (1.15)     0.0000 (1.0)           0;0  2.3477 (0.87)          1           1
test_partial_remove-gc[main]       383.8204 (1.03)     383.8204 (1.03)     383.8204 (1.03)     0.0000 (1.0)      383.8204 (1.03)     0.0000 (1.0)           0;0  2.6054 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     393.9420 (1.0)      393.9420 (1.0)      393.9420 (1.0)      0.0000 (1.0)      393.9420 (1.0)      0.0000 (1.0)           0;0  2.5384 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     398.1169 (1.01)     398.1169 (1.01)     398.1169 (1.01)     0.0000 (1.0)      398.1169 (1.01)     0.0000 (1.0)           0;0  2.5118 (0.99)          1           1
test_partial_remove-gc-cloud[main]       394.5813 (1.00)     394.5813 (1.00)     394.5813 (1.00)     0.0000 (1.0)      394.5813 (1.00)     0.0000 (1.0)           0;0  2.5343 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     437.5468 (1.01)     437.5468 (1.01)     437.5468 (1.01)     0.0000 (1.0)      437.5468 (1.01)     0.0000 (1.0)           0;0  2.2855 (0.99)          1           1
test_partial_remove-push[3.10.0]     433.7152 (1.0)      433.7152 (1.0)      433.7152 (1.0)      0.0000 (1.0)      433.7152 (1.0)      0.0000 (1.0)           0;0  2.3057 (1.0)           1           1
test_partial_remove-push[main]       467.7996 (1.08)     467.7996 (1.08)     467.7996 (1.08)     0.0000 (1.0)      467.7996 (1.08)     0.0000 (1.0)           0;0  2.1377 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     397.5392 (1.02)     397.5392 (1.02)     397.5392 (1.02)     0.0000 (1.0)      397.5392 (1.02)     0.0000 (1.0)           0;0  2.5155 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     390.9092 (1.0)      390.9092 (1.0)      390.9092 (1.0)      0.0000 (1.0)      390.9092 (1.0)      0.0000 (1.0)           0;0  2.5581 (1.0)           1           1
test_partial_remove-push-update[main]       426.8655 (1.09)     426.8655 (1.09)     426.8655 (1.09)     0.0000 (1.0)      426.8655 (1.09)     0.0000 (1.0)           0;0  2.3427 (0.92)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     420.0018 (1.0)      424.4966 (1.0)      421.9866 (1.0)      2.0871 (1.92)     420.9032 (1.0)      3.6901 (2.45)          1;0  2.3697 (1.0)           5           3
test_plots-plots-diff[3.10.0]     768.8191 (1.83)     772.6835 (1.82)     770.2452 (1.83)     1.5840 (1.46)     770.3345 (1.83)     2.2401 (1.49)          1;0  1.2983 (0.55)          5           3
test_plots-plots-diff[main]       740.3361 (1.76)     743.1238 (1.75)     741.9977 (1.76)     1.0848 (1.0)      742.1499 (1.76)     1.5060 (1.0)           2;0  1.3477 (0.57)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       432.5369 (1.0)        435.5590 (1.0)        433.4059 (1.0)       1.2418 (1.0)        432.8758 (1.0)      1.2438 (1.0)           1;0  2.3073 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,024.8872 (2.37)     1,032.1197 (2.37)     1,026.8265 (2.37)      2.9998 (2.42)     1,025.4420 (2.37)     2.4432 (1.96)          1;1  0.9739 (0.42)          5           3
test_plots-plots-diff-json[main]         818.1768 (1.89)       846.0816 (1.94)       824.9892 (1.90)     11.8322 (9.53)       820.2466 (1.89)     7.8838 (6.34)          1;1  1.2121 (0.53)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     388.1872 (1.0)      392.5150 (1.0)      390.0344 (1.0)      1.5647 (1.04)     389.7081 (1.0)      1.3716 (1.0)           2;0  2.5639 (1.0)           5           3
test_plots-plots-show[3.10.0]     640.3843 (1.65)     649.7069 (1.66)     644.1421 (1.65)     4.2386 (2.82)     641.8016 (1.65)     7.2090 (5.26)          1;0  1.5525 (0.61)          5           3
test_plots-plots-show[main]       637.4937 (1.64)     641.0083 (1.63)     639.0911 (1.64)     1.5014 (1.0)      638.3107 (1.64)     2.4061 (1.75)          2;0  1.5647 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     403.9025 (1.0)      410.5986 (1.0)      406.7169 (1.0)      2.6130 (1.0)      406.7371 (1.0)      3.7228 (1.22)          2;0  2.4587 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     787.8854 (1.95)     799.4510 (1.95)     790.9923 (1.94)     4.7879 (1.83)     789.1042 (1.94)     3.9138 (1.28)          1;1  1.2642 (0.51)          5           3
test_plots-plots-show-json[main]       683.5723 (1.69)     693.1209 (1.69)     685.8484 (1.69)     4.0885 (1.56)     684.4054 (1.68)     3.0561 (1.0)           1;1  1.4580 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     450.2135 (1.02)     450.2135 (1.02)     450.2135 (1.02)     0.0000 (1.0)      450.2135 (1.02)     0.0000 (1.0)           0;0  2.2212 (0.98)          1           1
test_push-push[3.10.0]     442.3673 (1.0)      442.3673 (1.0)      442.3673 (1.0)      0.0000 (1.0)      442.3673 (1.0)      0.0000 (1.0)           0;0  2.2606 (1.0)           1           1
test_push-push[main]       477.9854 (1.08)     477.9854 (1.08)     477.9854 (1.08)     0.0000 (1.0)      477.9854 (1.08)     0.0000 (1.0)           0;0  2.0921 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     581.5480 (1.01)     581.5480 (1.01)     581.5480 (1.01)     0.0000 (1.0)      581.5480 (1.01)     0.0000 (1.0)           0;0  1.7195 (0.99)          1           1
test_sharing-add[3.10.0]     591.0998 (1.02)     591.0998 (1.02)     591.0998 (1.02)     0.0000 (1.0)      591.0998 (1.02)     0.0000 (1.0)           0;0  1.6918 (0.98)          1           1
test_sharing-add[main]       576.9390 (1.0)      576.9390 (1.0)      576.9390 (1.0)      0.0000 (1.0)      576.9390 (1.0)      0.0000 (1.0)           0;0  1.7333 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     537.9036 (1.0)      537.9036 (1.0)      537.9036 (1.0)      0.0000 (1.0)      537.9036 (1.0)      0.0000 (1.0)           0;0  1.8591 (1.0)           1           1
test_sharing-add-noop[3.10.0]     571.6132 (1.06)     571.6132 (1.06)     571.6132 (1.06)     0.0000 (1.0)      571.6132 (1.06)     0.0000 (1.0)           0;0  1.7494 (0.94)          1           1
test_sharing-add-noop[main]       539.8488 (1.00)     539.8488 (1.00)     539.8488 (1.00)     0.0000 (1.0)      539.8488 (1.00)     0.0000 (1.0)           0;0  1.8524 (1.00)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     430.2004 (1.0)      430.2004 (1.0)      430.2004 (1.0)      0.0000 (1.0)      430.2004 (1.0)      0.0000 (1.0)           0;0  2.3245 (1.0)           1           1
test_sharing-checkout[3.10.0]     462.9620 (1.08)     462.9620 (1.08)     462.9620 (1.08)     0.0000 (1.0)      462.9620 (1.08)     0.0000 (1.0)           0;0  2.1600 (0.93)          1           1
test_sharing-checkout[main]       436.9416 (1.02)     436.9416 (1.02)     436.9416 (1.02)     0.0000 (1.0)      436.9416 (1.02)     0.0000 (1.0)           0;0  2.2886 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     370.7850 (1.0)      370.7850 (1.0)      370.7850 (1.0)      0.0000 (1.0)      370.7850 (1.0)      0.0000 (1.0)           0;0  2.6970 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     380.4147 (1.03)     380.4147 (1.03)     380.4147 (1.03)     0.0000 (1.0)      380.4147 (1.03)     0.0000 (1.0)           0;0  2.6287 (0.97)          1           1
test_sharing-checkout-noop[main]       387.5462 (1.05)     387.5462 (1.05)     387.5462 (1.05)     0.0000 (1.0)      387.5462 (1.05)     0.0000 (1.0)           0;0  2.5803 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     435.0828 (1.00)     435.0828 (1.00)     435.0828 (1.00)     0.0000 (1.0)      435.0828 (1.00)     0.0000 (1.0)           0;0  2.2984 (1.00)          1           1
test_sharing-fetch[3.10.0]     450.7594 (1.04)     450.7594 (1.04)     450.7594 (1.04)     0.0000 (1.0)      450.7594 (1.04)     0.0000 (1.0)           0;0  2.2185 (0.97)          1           1
test_sharing-fetch[main]       435.0659 (1.0)      435.0659 (1.0)      435.0659 (1.0)      0.0000 (1.0)      435.0659 (1.0)      0.0000 (1.0)           0;0  2.2985 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     400.4876 (1.04)     400.4876 (1.04)     400.4876 (1.04)     0.0000 (1.0)      400.4876 (1.04)     0.0000 (1.0)           0;0  2.4970 (0.96)          1           1
test_sharing-fetch-noop[3.10.0]     385.0435 (1.0)      385.0435 (1.0)      385.0435 (1.0)      0.0000 (1.0)      385.0435 (1.0)      0.0000 (1.0)           0;0  2.5971 (1.0)           1           1
test_sharing-fetch-noop[main]       411.0912 (1.07)     411.0912 (1.07)     411.0912 (1.07)     0.0000 (1.0)      411.0912 (1.07)     0.0000 (1.0)           0;0  2.4326 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     426.1325 (1.01)     426.1325 (1.01)     426.1325 (1.01)     0.0000 (1.0)      426.1325 (1.01)     0.0000 (1.0)           0;0  2.3467 (0.99)          1           1
test_sharing-push[3.10.0]     420.1817 (1.0)      420.1817 (1.0)      420.1817 (1.0)      0.0000 (1.0)      420.1817 (1.0)      0.0000 (1.0)           0;0  2.3799 (1.0)           1           1
test_sharing-push[main]       455.5183 (1.08)     455.5183 (1.08)     455.5183 (1.08)     0.0000 (1.0)      455.5183 (1.08)     0.0000 (1.0)           0;0  2.1953 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     378.6578 (1.01)     378.6578 (1.01)     378.6578 (1.01)     0.0000 (1.0)      378.6578 (1.01)     0.0000 (1.0)           0;0  2.6409 (0.99)          1           1
test_sharing-push-noop[3.10.0]     376.0350 (1.0)      376.0350 (1.0)      376.0350 (1.0)      0.0000 (1.0)      376.0350 (1.0)      0.0000 (1.0)           0;0  2.6593 (1.0)           1           1
test_sharing-push-noop[main]       418.6790 (1.11)     418.6790 (1.11)     418.6790 (1.11)     0.0000 (1.0)      418.6790 (1.11)     0.0000 (1.0)           0;0  2.3885 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     463.3496 (1.03)     463.3496 (1.03)     463.3496 (1.03)     0.0000 (1.0)      463.3496 (1.03)     0.0000 (1.0)           0;0  2.1582 (0.97)          1           1
test_status-status[3.10.0]     489.7096 (1.09)     489.7096 (1.09)     489.7096 (1.09)     0.0000 (1.0)      489.7096 (1.09)     0.0000 (1.0)           0;0  2.0420 (0.92)          1           1
test_status-status[main]       451.1086 (1.0)      451.1086 (1.0)      451.1086 (1.0)      0.0000 (1.0)      451.1086 (1.0)      0.0000 (1.0)           0;0  2.2168 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     399.2190 (1.0)      399.2190 (1.0)      399.2190 (1.0)      0.0000 (1.0)      399.2190 (1.0)      0.0000 (1.0)           0;0  2.5049 (1.0)           1           1
test_status-status-changed[3.10.0]     441.9044 (1.11)     441.9044 (1.11)     441.9044 (1.11)     0.0000 (1.0)      441.9044 (1.11)     0.0000 (1.0)           0;0  2.2629 (0.90)          1           1
test_status-status-changed[main]       407.3986 (1.02)     407.3986 (1.02)     407.3986 (1.02)     0.0000 (1.0)      407.3986 (1.02)     0.0000 (1.0)           0;0  2.4546 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     401.5581 (1.0)      401.5581 (1.0)      401.5581 (1.0)      0.0000 (1.0)      401.5581 (1.0)      0.0000 (1.0)           0;0  2.4903 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     451.7759 (1.13)     451.7759 (1.13)     451.7759 (1.13)     0.0000 (1.0)      451.7759 (1.13)     0.0000 (1.0)           0;0  2.2135 (0.89)          1           1
test_status-status-changed-noop[main]       418.0383 (1.04)     418.0383 (1.04)     418.0383 (1.04)     0.0000 (1.0)      418.0383 (1.04)     0.0000 (1.0)           0;0  2.3921 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     404.0175 (1.02)     404.0175 (1.02)     404.0175 (1.02)     0.0000 (1.0)      404.0175 (1.02)     0.0000 (1.0)           0;0  2.4751 (0.98)          1           1
test_status-status-noop[3.10.0]     435.3644 (1.10)     435.3644 (1.10)     435.3644 (1.10)     0.0000 (1.0)      435.3644 (1.10)     0.0000 (1.0)           0;0  2.2969 (0.91)          1           1
test_status-status-noop[main]       395.2097 (1.0)      395.2097 (1.0)      395.2097 (1.0)      0.0000 (1.0)      395.2097 (1.0)      0.0000 (1.0)           0;0  2.5303 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     637.8363 (1.01)     637.8363 (1.01)     637.8363 (1.01)     0.0000 (1.0)      637.8363 (1.01)     0.0000 (1.0)           0;0  1.5678 (0.99)          1           1
test_update-import-url[3.10.0]     646.7648 (1.03)     646.7648 (1.03)     646.7648 (1.03)     0.0000 (1.0)      646.7648 (1.03)     0.0000 (1.0)           0;0  1.5462 (0.97)          1           1
test_update-import-url[main]       628.5794 (1.0)      628.5794 (1.0)      628.5794 (1.0)      0.0000 (1.0)      628.5794 (1.0)      0.0000 (1.0)           0;0  1.5909 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     520.8451 (1.01)     520.8451 (1.01)     520.8451 (1.01)     0.0000 (1.0)      520.8451 (1.01)     0.0000 (1.0)           0;0  1.9200 (0.99)          1           1
test_update-update[3.10.0]     535.6872 (1.04)     535.6872 (1.04)     535.6872 (1.04)     0.0000 (1.0)      535.6872 (1.04)     0.0000 (1.0)           0;0  1.8668 (0.96)          1           1
test_update-update[main]       515.7195 (1.0)      515.7195 (1.0)      515.7195 (1.0)      0.0000 (1.0)      515.7195 (1.0)      0.0000 (1.0)           0;0  1.9390 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     385.6676 (1.0)      385.6676 (1.0)      385.6676 (1.0)      0.0000 (1.0)      385.6676 (1.0)      0.0000 (1.0)           0;0  2.5929 (1.0)           1           1
test_update-update-noop[3.10.0]     402.8376 (1.04)     402.8376 (1.04)     402.8376 (1.04)     0.0000 (1.0)      402.8376 (1.04)     0.0000 (1.0)           0;0  2.4824 (0.96)          1           1
test_update-update-noop[main]       404.4096 (1.05)     404.4096 (1.05)     404.4096 (1.05)     0.0000 (1.0)      404.4096 (1.05)     0.0000 (1.0)           0;0  2.4727 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean