Sat Dec  9 00:28:39 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     596.0534 (1.03)     596.0534 (1.03)     596.0534 (1.03)     0.0000 (1.0)      596.0534 (1.03)     0.0000 (1.0)           0;0  1.6777 (0.97)          1           1
test_add-add[3.10.0]     590.9346 (1.02)     590.9346 (1.02)     590.9346 (1.02)     0.0000 (1.0)      590.9346 (1.02)     0.0000 (1.0)           0;0  1.6922 (0.98)          1           1
test_add-add[main]       580.8897 (1.0)      580.8897 (1.0)      580.8897 (1.0)      0.0000 (1.0)      580.8897 (1.0)      0.0000 (1.0)           0;0  1.7215 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     567.2285 (1.0)      567.2285 (1.0)      567.2285 (1.0)      0.0000 (1.0)      567.2285 (1.0)      0.0000 (1.0)           0;0  1.7630 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     630.8112 (1.11)     630.8112 (1.11)     630.8112 (1.11)     0.0000 (1.0)      630.8112 (1.11)     0.0000 (1.0)           0;0  1.5853 (0.90)          1           1
test_checkout_copy-checkout[main]       602.0366 (1.06)     602.0366 (1.06)     602.0366 (1.06)     0.0000 (1.0)      602.0366 (1.06)     0.0000 (1.0)           0;0  1.6610 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     397.9627 (1.0)      397.9627 (1.0)      397.9627 (1.0)      0.0000 (1.0)      397.9627 (1.0)      0.0000 (1.0)           0;0  2.5128 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     428.7200 (1.08)     428.7200 (1.08)     428.7200 (1.08)     0.0000 (1.0)      428.7200 (1.08)     0.0000 (1.0)           0;0  2.3325 (0.93)          1           1
test_checkout_copy-checkout-noop[main]       425.0099 (1.07)     425.0099 (1.07)     425.0099 (1.07)     0.0000 (1.0)      425.0099 (1.07)     0.0000 (1.0)           0;0  2.3529 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     466.6422 (1.02)     466.6422 (1.02)     466.6422 (1.02)     0.0000 (1.0)      466.6422 (1.02)     0.0000 (1.0)           0;0  2.1430 (0.98)          1           1
test_checkout_copy-checkout-update[3.10.0]     459.5975 (1.0)      459.5975 (1.0)      459.5975 (1.0)      0.0000 (1.0)      459.5975 (1.0)      0.0000 (1.0)           0;0  2.1758 (1.0)           1           1
test_checkout_copy-checkout-update[main]       464.7142 (1.01)     464.7142 (1.01)     464.7142 (1.01)     0.0000 (1.0)      464.7142 (1.01)     0.0000 (1.0)           0;0  2.1519 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     515.6482 (1.0)      515.6482 (1.0)      515.6482 (1.0)      0.0000 (1.0)      515.6482 (1.0)      0.0000 (1.0)           0;0  1.9393 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     543.2869 (1.05)     543.2869 (1.05)     543.2869 (1.05)     0.0000 (1.0)      543.2869 (1.05)     0.0000 (1.0)           0;0  1.8406 (0.95)          1           1
test_checkout_hardlink-checkout[main]       537.3200 (1.04)     537.3200 (1.04)     537.3200 (1.04)     0.0000 (1.0)      537.3200 (1.04)     0.0000 (1.0)           0;0  1.8611 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     376.0532 (1.0)      376.0532 (1.0)      376.0532 (1.0)      0.0000 (1.0)      376.0532 (1.0)      0.0000 (1.0)           0;0  2.6592 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     398.7243 (1.06)     398.7243 (1.06)     398.7243 (1.06)     0.0000 (1.0)      398.7243 (1.06)     0.0000 (1.0)           0;0  2.5080 (0.94)          1           1
test_checkout_hardlink-checkout-noop[main]       398.0055 (1.06)     398.0055 (1.06)     398.0055 (1.06)     0.0000 (1.0)      398.0055 (1.06)     0.0000 (1.0)           0;0  2.5125 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     413.0906 (1.0)      413.0906 (1.0)      413.0906 (1.0)      0.0000 (1.0)      413.0906 (1.0)      0.0000 (1.0)           0;0  2.4208 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     431.4890 (1.04)     431.4890 (1.04)     431.4890 (1.04)     0.0000 (1.0)      431.4890 (1.04)     0.0000 (1.0)           0;0  2.3176 (0.96)          1           1
test_checkout_hardlink-checkout-update[main]       417.3642 (1.01)     417.3642 (1.01)     417.3642 (1.01)     0.0000 (1.0)      417.3642 (1.01)     0.0000 (1.0)           0;0  2.3960 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     535.7181 (1.0)      535.7181 (1.0)      535.7181 (1.0)      0.0000 (1.0)      535.7181 (1.0)      0.0000 (1.0)           0;0  1.8667 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     561.9722 (1.05)     561.9722 (1.05)     561.9722 (1.05)     0.0000 (1.0)      561.9722 (1.05)     0.0000 (1.0)           0;0  1.7794 (0.95)          1           1
test_checkout_symlink-checkout[main]       551.5251 (1.03)     551.5251 (1.03)     551.5251 (1.03)     0.0000 (1.0)      551.5251 (1.03)     0.0000 (1.0)           0;0  1.8132 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     386.4777 (1.0)      386.4777 (1.0)      386.4777 (1.0)      0.0000 (1.0)      386.4777 (1.0)      0.0000 (1.0)           0;0  2.5875 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     400.4750 (1.04)     400.4750 (1.04)     400.4750 (1.04)     0.0000 (1.0)      400.4750 (1.04)     0.0000 (1.0)           0;0  2.4970 (0.97)          1           1
test_checkout_symlink-checkout-noop[main]       397.6861 (1.03)     397.6861 (1.03)     397.6861 (1.03)     0.0000 (1.0)      397.6861 (1.03)     0.0000 (1.0)           0;0  2.5145 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     417.2282 (1.0)      417.2282 (1.0)      417.2282 (1.0)      0.0000 (1.0)      417.2282 (1.0)      0.0000 (1.0)           0;0  2.3968 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     437.5985 (1.05)     437.5985 (1.05)     437.5985 (1.05)     0.0000 (1.0)      437.5985 (1.05)     0.0000 (1.0)           0;0  2.2852 (0.95)          1           1
test_checkout_symlink-checkout-update[main]       427.3151 (1.02)     427.3151 (1.02)     427.3151 (1.02)     0.0000 (1.0)      427.3151 (1.02)     0.0000 (1.0)           0;0  2.3402 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     456.4369 (1.08)     456.4369 (1.08)     456.4369 (1.08)     0.0000 (1.0)      456.4369 (1.08)     0.0000 (1.0)           0;0  2.1909 (0.92)          1           1
test_data_status-data-changed[3.10.0]     422.3936 (1.00)     422.3936 (1.00)     422.3936 (1.00)     0.0000 (1.0)      422.3936 (1.00)     0.0000 (1.0)           0;0  2.3675 (1.00)          1           1
test_data_status-data-changed[main]       421.8850 (1.0)      421.8850 (1.0)      421.8850 (1.0)      0.0000 (1.0)      421.8850 (1.0)      0.0000 (1.0)           0;0  2.3703 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     451.1356 (1.10)     451.1356 (1.10)     451.1356 (1.10)     0.0000 (1.0)      451.1356 (1.10)     0.0000 (1.0)           0;0  2.2166 (0.91)          1           1
test_data_status-data-changed-noop[3.10.0]     411.1320 (1.0)      411.1320 (1.0)      411.1320 (1.0)      0.0000 (1.0)      411.1320 (1.0)      0.0000 (1.0)           0;0  2.4323 (1.0)           1           1
test_data_status-data-changed-noop[main]       426.0490 (1.04)     426.0490 (1.04)     426.0490 (1.04)     0.0000 (1.0)      426.0490 (1.04)     0.0000 (1.0)           0;0  2.3471 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     517.8340 (1.10)     517.8340 (1.10)     517.8340 (1.10)     0.0000 (1.0)      517.8340 (1.10)     0.0000 (1.0)           0;0  1.9311 (0.91)          1           1
test_data_status-data-new[3.10.0]     472.5902 (1.0)      472.5902 (1.0)      472.5902 (1.0)      0.0000 (1.0)      472.5902 (1.0)      0.0000 (1.0)           0;0  2.1160 (1.0)           1           1
test_data_status-data-new[main]       478.1473 (1.01)     478.1473 (1.01)     478.1473 (1.01)     0.0000 (1.0)      478.1473 (1.01)     0.0000 (1.0)           0;0  2.0914 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     455.5190 (1.10)     455.5190 (1.10)     455.5190 (1.10)     0.0000 (1.0)      455.5190 (1.10)     0.0000 (1.0)           0;0  2.1953 (0.91)          1           1
test_data_status-data-noop[3.10.0]     414.9828 (1.0)      414.9828 (1.0)      414.9828 (1.0)      0.0000 (1.0)      414.9828 (1.0)      0.0000 (1.0)           0;0  2.4097 (1.0)           1           1
test_data_status-data-noop[main]       422.5878 (1.02)     422.5878 (1.02)     422.5878 (1.02)     0.0000 (1.0)      422.5878 (1.02)     0.0000 (1.0)           0;0  2.3664 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     474.4478 (1.05)     474.4478 (1.05)     474.4478 (1.05)     0.0000 (1.0)      474.4478 (1.05)     0.0000 (1.0)           0;0  2.1077 (0.95)          1           1
test_data_status_all_flags-data-changed[3.10.0]     450.5450 (1.0)      450.5450 (1.0)      450.5450 (1.0)      0.0000 (1.0)      450.5450 (1.0)      0.0000 (1.0)           0;0  2.2195 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       482.4864 (1.07)     482.4864 (1.07)     482.4864 (1.07)     0.0000 (1.0)      482.4864 (1.07)     0.0000 (1.0)           0;0  2.0726 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     470.3975 (1.03)     470.3975 (1.03)     470.3975 (1.03)     0.0000 (1.0)      470.3975 (1.03)     0.0000 (1.0)           0;0  2.1259 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     455.4325 (1.0)      455.4325 (1.0)      455.4325 (1.0)      0.0000 (1.0)      455.4325 (1.0)      0.0000 (1.0)           0;0  2.1957 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       473.7914 (1.04)     473.7914 (1.04)     473.7914 (1.04)     0.0000 (1.0)      473.7914 (1.04)     0.0000 (1.0)           0;0  2.1106 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     530.5537 (1.03)     530.5537 (1.03)     530.5537 (1.03)     0.0000 (1.0)      530.5537 (1.03)     0.0000 (1.0)           0;0  1.8848 (0.97)          1           1
test_data_status_all_flags-data-new[3.10.0]     513.0143 (1.0)      513.0143 (1.0)      513.0143 (1.0)      0.0000 (1.0)      513.0143 (1.0)      0.0000 (1.0)           0;0  1.9493 (1.0)           1           1
test_data_status_all_flags-data-new[main]       518.0257 (1.01)     518.0257 (1.01)     518.0257 (1.01)     0.0000 (1.0)      518.0257 (1.01)     0.0000 (1.0)           0;0  1.9304 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     476.1911 (1.06)     476.1911 (1.06)     476.1911 (1.06)     0.0000 (1.0)      476.1911 (1.06)     0.0000 (1.0)           0;0  2.1000 (0.94)          1           1
test_data_status_all_flags-data-noop[3.10.0]     449.3005 (1.0)      449.3005 (1.0)      449.3005 (1.0)      0.0000 (1.0)      449.3005 (1.0)      0.0000 (1.0)           0;0  2.2257 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       460.7983 (1.03)     460.7983 (1.03)     460.7983 (1.03)     0.0000 (1.0)      460.7983 (1.03)     0.0000 (1.0)           0;0  2.1701 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     538.3925 (1.02)     538.3925 (1.02)     538.3925 (1.02)     0.0000 (1.0)      538.3925 (1.02)     0.0000 (1.0)           0;0  1.8574 (0.98)          1           1
test_diff-diff[3.10.0]     528.2938 (1.0)      528.2938 (1.0)      528.2938 (1.0)      0.0000 (1.0)      528.2938 (1.0)      0.0000 (1.0)           0;0  1.8929 (1.0)           1           1
test_diff-diff[main]       546.3117 (1.03)     546.3117 (1.03)     546.3117 (1.03)     0.0000 (1.0)      546.3117 (1.03)     0.0000 (1.0)           0;0  1.8305 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     495.2220 (1.02)     495.2220 (1.02)     495.2220 (1.02)     0.0000 (1.0)      495.2220 (1.02)     0.0000 (1.0)           0;0  2.0193 (0.98)          1           1
test_diff-diff-changed[3.10.0]     490.4023 (1.01)     490.4023 (1.01)     490.4023 (1.01)     0.0000 (1.0)      490.4023 (1.01)     0.0000 (1.0)           0;0  2.0391 (0.99)          1           1
test_diff-diff-changed[main]       484.2735 (1.0)      484.2735 (1.0)      484.2735 (1.0)      0.0000 (1.0)      484.2735 (1.0)      0.0000 (1.0)           0;0  2.0649 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     478.0687 (1.0)      478.0687 (1.0)      478.0687 (1.0)      0.0000 (1.0)      478.0687 (1.0)      0.0000 (1.0)           0;0  2.0917 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     484.7063 (1.01)     484.7063 (1.01)     484.7063 (1.01)     0.0000 (1.0)      484.7063 (1.01)     0.0000 (1.0)           0;0  2.0631 (0.99)          1           1
test_diff-diff-changed-noop[main]       489.8603 (1.02)     489.8603 (1.02)     489.8603 (1.02)     0.0000 (1.0)      489.8603 (1.02)     0.0000 (1.0)           0;0  2.0414 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     477.2198 (1.02)     477.2198 (1.02)     477.2198 (1.02)     0.0000 (1.0)      477.2198 (1.02)     0.0000 (1.0)           0;0  2.0955 (0.98)          1           1
test_diff-diff-noop[3.10.0]     468.8756 (1.0)      468.8756 (1.0)      468.8756 (1.0)      0.0000 (1.0)      468.8756 (1.0)      0.0000 (1.0)           0;0  2.1328 (1.0)           1           1
test_diff-diff-noop[main]       482.9431 (1.03)     482.9431 (1.03)     482.9431 (1.03)     0.0000 (1.0)      482.9431 (1.03)     0.0000 (1.0)           0;0  2.0706 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        896.1178 (1.0)         896.1178 (1.0)         896.1178 (1.0)      0.0000 (1.0)         896.1178 (1.0)      0.0000 (1.0)           0;0  1.1159 (1.0)           1           1
test_exp_show-exp[3.10.0]     13,195.8862 (14.73)    13,195.8862 (14.73)    13,195.8862 (14.73)    0.0000 (1.0)      13,195.8862 (14.73)    0.0000 (1.0)           0;0  0.0758 (0.07)          1           1
test_exp_show-exp[main]       12,640.7637 (14.11)    12,640.7637 (14.11)    12,640.7637 (14.11)    0.0000 (1.0)      12,640.7637 (14.11)    0.0000 (1.0)           0;0  0.0791 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     454.3838 (1.02)     454.3838 (1.02)     454.3838 (1.02)     0.0000 (1.0)      454.3838 (1.02)     0.0000 (1.0)           0;0  2.2008 (0.98)          1           1
test_fetch-fetch[3.10.0]     467.0111 (1.05)     467.0111 (1.05)     467.0111 (1.05)     0.0000 (1.0)      467.0111 (1.05)     0.0000 (1.0)           0;0  2.1413 (0.96)          1           1
test_fetch-fetch[main]       446.7638 (1.0)      446.7638 (1.0)      446.7638 (1.0)      0.0000 (1.0)      446.7638 (1.0)      0.0000 (1.0)           0;0  2.2383 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     365.6899 (1.0)      365.6899 (1.0)      365.6899 (1.0)      0.0000 (1.0)      365.6899 (1.0)      0.0000 (1.0)           0;0  2.7346 (1.0)           1           1
test_gc-gc[3.10.0]     371.9875 (1.02)     371.9875 (1.02)     371.9875 (1.02)     0.0000 (1.0)      371.9875 (1.02)     0.0000 (1.0)           0;0  2.6883 (0.98)          1           1
test_gc-gc[main]       370.9206 (1.01)     370.9206 (1.01)     370.9206 (1.01)     0.0000 (1.0)      370.9206 (1.01)     0.0000 (1.0)           0;0  2.6960 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     504.5400 (1.01)     504.5400 (1.01)     504.5400 (1.01)     0.0000 (1.0)      504.5400 (1.01)     0.0000 (1.0)           0;0  1.9820 (0.99)          1           1
test_get-get[3.10.0]     500.6300 (1.0)      500.6300 (1.0)      500.6300 (1.0)      0.0000 (1.0)      500.6300 (1.0)      0.0000 (1.0)           0;0  1.9975 (1.0)           1           1
test_get-get[main]       526.6461 (1.05)     526.6461 (1.05)     526.6461 (1.05)     0.0000 (1.0)      526.6461 (1.05)     0.0000 (1.0)           0;0  1.8988 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     337.0317 (1.0)      337.0317 (1.0)      337.0317 (1.0)      0.0000 (1.0)      337.0317 (1.0)      0.0000 (1.0)           0;0  2.9671 (1.0)           1           1
test_get_url-get-url[3.10.0]     351.2586 (1.04)     351.2586 (1.04)     351.2586 (1.04)     0.0000 (1.0)      351.2586 (1.04)     0.0000 (1.0)           0;0  2.8469 (0.96)          1           1
test_get_url-get-url[main]       379.8771 (1.13)     379.8771 (1.13)     379.8771 (1.13)     0.0000 (1.0)      379.8771 (1.13)     0.0000 (1.0)           0;0  2.6324 (0.89)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.0924 (1.02)     136.0047 (1.0)      130.7762 (1.03)     1.8564 (1.0)      130.5466 (1.03)     2.5742 (1.12)         36;1  7.6466 (0.97)        100           1
test_help---help[3.10.0]     124.4391 (1.0)      137.9849 (1.01)     127.2934 (1.0)      2.1607 (1.16)     126.6624 (1.0)      2.4565 (1.07)         17;4  7.8559 (1.0)         100           1
test_help---help[main]       125.4917 (1.01)     136.0221 (1.00)     129.6686 (1.02)     1.9162 (1.03)     129.6745 (1.02)     2.2889 (1.0)          27;2  7.7120 (0.98)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     680.3878 (1.0)      680.3878 (1.0)      680.3878 (1.0)      0.0000 (1.0)      680.3878 (1.0)      0.0000 (1.0)           0;0  1.4697 (1.0)           1           1
test_import-import[3.10.0]     682.9866 (1.00)     682.9866 (1.00)     682.9866 (1.00)     0.0000 (1.0)      682.9866 (1.00)     0.0000 (1.0)           0;0  1.4642 (1.00)          1           1
test_import-import[main]       723.3222 (1.06)     723.3222 (1.06)     723.3222 (1.06)     0.0000 (1.0)      723.3222 (1.06)     0.0000 (1.0)           0;0  1.3825 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     626.4912 (1.02)     626.4912 (1.02)     626.4912 (1.02)     0.0000 (1.0)      626.4912 (1.02)     0.0000 (1.0)           0;0  1.5962 (0.98)          1           1
test_import_url-import-url[3.10.0]     650.5024 (1.06)     650.5024 (1.06)     650.5024 (1.06)     0.0000 (1.0)      650.5024 (1.06)     0.0000 (1.0)           0;0  1.5373 (0.95)          1           1
test_import_url-import-url[main]       616.1992 (1.0)      616.1992 (1.0)      616.1992 (1.0)      0.0000 (1.0)      616.1992 (1.0)      0.0000 (1.0)           0;0  1.6229 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     372.8227 (1.0)      406.4782 (1.0)      379.8132 (1.0)      4.7761 (1.0)      378.9329 (1.0)      3.9383 (1.0)          19;3  2.6329 (1.0)         100           1
test_init-init[3.10.0]     379.0480 (1.02)     429.2692 (1.06)     391.0031 (1.03)     9.6226 (2.01)     388.6831 (1.03)     8.7253 (2.22)         14;8  2.5575 (0.97)        100           1
test_init-init[main]       387.3073 (1.04)     442.6885 (1.09)     400.3411 (1.05)     7.9578 (1.67)     398.8416 (1.05)     8.0699 (2.05)         19;2  2.4979 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     412.6574 (1.03)     412.6574 (1.03)     412.6574 (1.03)     0.0000 (1.0)      412.6574 (1.03)     0.0000 (1.0)           0;0  2.4233 (0.97)          1           1
test_list-list[3.10.0]     414.7871 (1.04)     414.7871 (1.04)     414.7871 (1.04)     0.0000 (1.0)      414.7871 (1.04)     0.0000 (1.0)           0;0  2.4109 (0.96)          1           1
test_list-list[main]       399.9207 (1.0)      399.9207 (1.0)      399.9207 (1.0)      0.0000 (1.0)      399.9207 (1.0)      0.0000 (1.0)           0;0  2.5005 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     403.3077 (1.03)     403.3077 (1.03)     403.3077 (1.03)     0.0000 (1.0)      403.3077 (1.03)     0.0000 (1.0)           0;0  2.4795 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     390.8662 (1.0)      390.8662 (1.0)      390.8662 (1.0)      0.0000 (1.0)      390.8662 (1.0)      0.0000 (1.0)           0;0  2.5584 (1.0)           1           1
test_list-list-dvc-only[main]       401.3833 (1.03)     401.3833 (1.03)     401.3833 (1.03)     0.0000 (1.0)      401.3833 (1.03)     0.0000 (1.0)           0;0  2.4914 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     408.6720 (1.03)     408.6720 (1.03)     408.6720 (1.03)     0.0000 (1.0)      408.6720 (1.03)     0.0000 (1.0)           0;0  2.4470 (0.97)          1           1
test_list-list-recursive[3.10.0]     397.3013 (1.0)      397.3013 (1.0)      397.3013 (1.0)      0.0000 (1.0)      397.3013 (1.0)      0.0000 (1.0)           0;0  2.5170 (1.0)           1           1
test_list-list-recursive[main]       405.3127 (1.02)     405.3127 (1.02)     405.3127 (1.02)     0.0000 (1.0)      405.3127 (1.02)     0.0000 (1.0)           0;0  2.4672 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     396.4917 (1.01)     396.4917 (1.01)     396.4917 (1.01)     0.0000 (1.0)      396.4917 (1.01)     0.0000 (1.0)           0;0  2.5221 (0.99)          1           1
test_list-list-shallow[3.10.0]     390.7949 (1.0)      390.7949 (1.0)      390.7949 (1.0)      0.0000 (1.0)      390.7949 (1.0)      0.0000 (1.0)           0;0  2.5589 (1.0)           1           1
test_list-list-shallow[main]       394.2758 (1.01)     394.2758 (1.01)     394.2758 (1.01)     0.0000 (1.0)      394.2758 (1.01)     0.0000 (1.0)           0;0  2.5363 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     527.9570 (1.00)     527.9570 (1.00)     527.9570 (1.00)     0.0000 (1.0)      527.9570 (1.00)     0.0000 (1.0)           0;0  1.8941 (1.00)          1           1
test_partial_add-add[3.10.0]     539.8662 (1.03)     539.8662 (1.03)     539.8662 (1.03)     0.0000 (1.0)      539.8662 (1.03)     0.0000 (1.0)           0;0  1.8523 (0.97)          1           1
test_partial_add-add[main]       526.1167 (1.0)      526.1167 (1.0)      526.1167 (1.0)      0.0000 (1.0)      526.1167 (1.0)      0.0000 (1.0)           0;0  1.9007 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     561.1367 (1.0)      561.1367 (1.0)      561.1367 (1.0)      0.0000 (1.0)      561.1367 (1.0)      0.0000 (1.0)           0;0  1.7821 (1.0)           1           1
test_partial_add-add-partial[3.10.0]     569.6352 (1.02)     569.6352 (1.02)     569.6352 (1.02)     0.0000 (1.0)      569.6352 (1.02)     0.0000 (1.0)           0;0  1.7555 (0.99)          1           1
test_partial_add-add-partial[main]       563.6905 (1.00)     563.6905 (1.00)     563.6905 (1.00)     0.0000 (1.0)      563.6905 (1.00)     0.0000 (1.0)           0;0  1.7740 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     378.5596 (1.0)      378.5596 (1.0)      378.5596 (1.0)      0.0000 (1.0)      378.5596 (1.0)      0.0000 (1.0)           0;0  2.6416 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     381.2728 (1.01)     381.2728 (1.01)     381.2728 (1.01)     0.0000 (1.0)      381.2728 (1.01)     0.0000 (1.0)           0;0  2.6228 (0.99)          1           1
test_partial_add-gc-cloud-noop[main]       385.3295 (1.02)     385.3295 (1.02)     385.3295 (1.02)     0.0000 (1.0)      385.3295 (1.02)     0.0000 (1.0)           0;0  2.5952 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     363.5067 (1.0)      363.5067 (1.0)      363.5067 (1.0)      0.0000 (1.0)      363.5067 (1.0)      0.0000 (1.0)           0;0  2.7510 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     377.5318 (1.04)     377.5318 (1.04)     377.5318 (1.04)     0.0000 (1.0)      377.5318 (1.04)     0.0000 (1.0)           0;0  2.6488 (0.96)          1           1
test_partial_add-gc-noop[main]       371.8189 (1.02)     371.8189 (1.02)     371.8189 (1.02)     0.0000 (1.0)      371.8189 (1.02)     0.0000 (1.0)           0;0  2.6895 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     407.1128 (1.0)      407.1128 (1.0)      407.1128 (1.0)      0.0000 (1.0)      407.1128 (1.0)      0.0000 (1.0)           0;0  2.4563 (1.0)           1           1
test_partial_add-push[3.10.0]     411.6916 (1.01)     411.6916 (1.01)     411.6916 (1.01)     0.0000 (1.0)      411.6916 (1.01)     0.0000 (1.0)           0;0  2.4290 (0.99)          1           1
test_partial_add-push[main]       426.5281 (1.05)     426.5281 (1.05)     426.5281 (1.05)     0.0000 (1.0)      426.5281 (1.05)     0.0000 (1.0)           0;0  2.3445 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     404.9428 (1.0)      404.9428 (1.0)      404.9428 (1.0)      0.0000 (1.0)      404.9428 (1.0)      0.0000 (1.0)           0;0  2.4695 (1.0)           1           1
test_partial_add-push-partial[3.10.0]     408.3822 (1.01)     408.3822 (1.01)     408.3822 (1.01)     0.0000 (1.0)      408.3822 (1.01)     0.0000 (1.0)           0;0  2.4487 (0.99)          1           1
test_partial_add-push-partial[main]       441.0990 (1.09)     441.0990 (1.09)     441.0990 (1.09)     0.0000 (1.0)      441.0990 (1.09)     0.0000 (1.0)           0;0  2.2671 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     593.7544 (1.01)     593.7544 (1.01)     593.7544 (1.01)     0.0000 (1.0)      593.7544 (1.01)     0.0000 (1.0)           0;0  1.6842 (0.99)          1           1
test_partial_remove-add[3.10.0]     599.2729 (1.02)     599.2729 (1.02)     599.2729 (1.02)     0.0000 (1.0)      599.2729 (1.02)     0.0000 (1.0)           0;0  1.6687 (0.98)          1           1
test_partial_remove-add[main]       586.2428 (1.0)      586.2428 (1.0)      586.2428 (1.0)      0.0000 (1.0)      586.2428 (1.0)      0.0000 (1.0)           0;0  1.7058 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     547.0439 (1.02)     547.0439 (1.02)     547.0439 (1.02)     0.0000 (1.0)      547.0439 (1.02)     0.0000 (1.0)           0;0  1.8280 (0.98)          1           1
test_partial_remove-add-update[3.10.0]     544.9061 (1.01)     544.9061 (1.01)     544.9061 (1.01)     0.0000 (1.0)      544.9061 (1.01)     0.0000 (1.0)           0;0  1.8352 (0.99)          1           1
test_partial_remove-add-update[main]       537.3138 (1.0)      537.3138 (1.0)      537.3138 (1.0)      0.0000 (1.0)      537.3138 (1.0)      0.0000 (1.0)           0;0  1.8611 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     372.2388 (1.0)      372.2388 (1.0)      372.2388 (1.0)      0.0000 (1.0)      372.2388 (1.0)      0.0000 (1.0)           0;0  2.6864 (1.0)           1           1
test_partial_remove-gc[3.10.0]     376.0724 (1.01)     376.0724 (1.01)     376.0724 (1.01)     0.0000 (1.0)      376.0724 (1.01)     0.0000 (1.0)           0;0  2.6591 (0.99)          1           1
test_partial_remove-gc[main]       379.1218 (1.02)     379.1218 (1.02)     379.1218 (1.02)     0.0000 (1.0)      379.1218 (1.02)     0.0000 (1.0)           0;0  2.6377 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     389.5567 (1.0)      389.5567 (1.0)      389.5567 (1.0)      0.0000 (1.0)      389.5567 (1.0)      0.0000 (1.0)           0;0  2.5670 (1.0)           1           1
test_partial_remove-gc-cloud[3.10.0]     400.0476 (1.03)     400.0476 (1.03)     400.0476 (1.03)     0.0000 (1.0)      400.0476 (1.03)     0.0000 (1.0)           0;0  2.4997 (0.97)          1           1
test_partial_remove-gc-cloud[main]       392.1793 (1.01)     392.1793 (1.01)     392.1793 (1.01)     0.0000 (1.0)      392.1793 (1.01)     0.0000 (1.0)           0;0  2.5499 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     435.3984 (1.01)     435.3984 (1.01)     435.3984 (1.01)     0.0000 (1.0)      435.3984 (1.01)     0.0000 (1.0)           0;0  2.2967 (0.99)          1           1
test_partial_remove-push[3.10.0]     430.3040 (1.0)      430.3040 (1.0)      430.3040 (1.0)      0.0000 (1.0)      430.3040 (1.0)      0.0000 (1.0)           0;0  2.3239 (1.0)           1           1
test_partial_remove-push[main]       461.5877 (1.07)     461.5877 (1.07)     461.5877 (1.07)     0.0000 (1.0)      461.5877 (1.07)     0.0000 (1.0)           0;0  2.1664 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     419.2711 (1.06)     419.2711 (1.06)     419.2711 (1.06)     0.0000 (1.0)      419.2711 (1.06)     0.0000 (1.0)           0;0  2.3851 (0.94)          1           1
test_partial_remove-push-update[3.10.0]     395.5431 (1.0)      395.5431 (1.0)      395.5431 (1.0)      0.0000 (1.0)      395.5431 (1.0)      0.0000 (1.0)           0;0  2.5282 (1.0)           1           1
test_partial_remove-push-update[main]       423.9311 (1.07)     423.9311 (1.07)     423.9311 (1.07)     0.0000 (1.0)      423.9311 (1.07)     0.0000 (1.0)           0;0  2.3589 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     439.0046 (1.0)      455.6342 (1.0)      445.8906 (1.0)       6.7779 (2.03)     443.8950 (1.0)      10.6137 (2.28)          2;0  2.2427 (1.0)           5           3
test_plots-plots-diff[3.10.0]     790.6229 (1.80)     820.4122 (1.80)     804.0853 (1.80)     10.9286 (3.27)     803.1131 (1.81)     12.9784 (2.79)          2;0  1.2436 (0.55)          5           3
test_plots-plots-diff[main]       762.4864 (1.74)     770.9091 (1.69)     765.7575 (1.72)      3.3377 (1.0)      765.6526 (1.72)      4.6456 (1.0)           1;0  1.3059 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       451.5195 (1.0)        467.8473 (1.0)        456.7722 (1.0)      6.7522 (1.94)       454.8168 (1.0)       8.9215 (1.94)          1;0  2.1893 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,065.5291 (2.36)     1,085.7353 (2.32)     1,076.7839 (2.36)     9.8944 (2.85)     1,080.8222 (2.38)     18.7577 (4.07)          2;0  0.9287 (0.42)          5           3
test_plots-plots-diff-json[main]         848.8307 (1.88)       858.0997 (1.83)       853.3552 (1.87)     3.4737 (1.0)        853.9138 (1.88)      4.6094 (1.0)           2;0  1.1718 (0.54)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     402.8102 (1.0)      427.2781 (1.0)      410.5219 (1.0)      9.7798 (2.41)     408.7076 (1.0)       9.9273 (2.11)          1;0  2.4359 (1.0)           5           3
test_plots-plots-show[3.10.0]     678.1717 (1.68)     689.2613 (1.61)     683.5002 (1.66)     4.0526 (1.0)      684.0404 (1.67)      4.7127 (1.0)           2;0  1.4631 (0.60)          5           3
test_plots-plots-show[main]       672.7513 (1.67)     694.0610 (1.62)     686.1607 (1.67)     8.9183 (2.20)     690.6509 (1.69)     13.2101 (2.80)          1;0  1.4574 (0.60)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     420.5108 (1.0)      447.6438 (1.0)      434.1534 (1.0)      10.1994 (1.20)     432.3440 (1.0)      13.7225 (1.11)          2;0  2.3033 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     822.6606 (1.96)     847.2313 (1.89)     830.2973 (1.91)     10.1105 (1.18)     826.9757 (1.91)     12.4110 (1.0)           1;0  1.2044 (0.52)          5           3
test_plots-plots-show-json[main]       704.7869 (1.68)     723.6518 (1.62)     714.6417 (1.65)      8.5331 (1.0)      718.9172 (1.66)     14.7108 (1.19)          2;0  1.3993 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     494.0017 (1.01)     494.0017 (1.01)     494.0017 (1.01)     0.0000 (1.0)      494.0017 (1.01)     0.0000 (1.0)           0;0  2.0243 (0.99)          1           1
test_push-push[3.10.0]     488.3492 (1.0)      488.3492 (1.0)      488.3492 (1.0)      0.0000 (1.0)      488.3492 (1.0)      0.0000 (1.0)           0;0  2.0477 (1.0)           1           1
test_push-push[main]       503.3088 (1.03)     503.3088 (1.03)     503.3088 (1.03)     0.0000 (1.0)      503.3088 (1.03)     0.0000 (1.0)           0;0  1.9869 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     577.3487 (1.0)      577.3487 (1.0)      577.3487 (1.0)      0.0000 (1.0)      577.3487 (1.0)      0.0000 (1.0)           0;0  1.7321 (1.0)           1           1
test_sharing-add[3.10.0]     593.7494 (1.03)     593.7494 (1.03)     593.7494 (1.03)     0.0000 (1.0)      593.7494 (1.03)     0.0000 (1.0)           0;0  1.6842 (0.97)          1           1
test_sharing-add[main]       577.9510 (1.00)     577.9510 (1.00)     577.9510 (1.00)     0.0000 (1.0)      577.9510 (1.00)     0.0000 (1.0)           0;0  1.7303 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     572.9324 (1.06)     572.9324 (1.06)     572.9324 (1.06)     0.0000 (1.0)      572.9324 (1.06)     0.0000 (1.0)           0;0  1.7454 (0.95)          1           1
test_sharing-add-noop[3.10.0]     541.8157 (1.00)     541.8157 (1.00)     541.8157 (1.00)     0.0000 (1.0)      541.8157 (1.00)     0.0000 (1.0)           0;0  1.8456 (1.00)          1           1
test_sharing-add-noop[main]       541.4796 (1.0)      541.4796 (1.0)      541.4796 (1.0)      0.0000 (1.0)      541.4796 (1.0)      0.0000 (1.0)           0;0  1.8468 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     431.0635 (1.0)      431.0635 (1.0)      431.0635 (1.0)      0.0000 (1.0)      431.0635 (1.0)      0.0000 (1.0)           0;0  2.3198 (1.0)           1           1
test_sharing-checkout[3.10.0]     498.3220 (1.16)     498.3220 (1.16)     498.3220 (1.16)     0.0000 (1.0)      498.3220 (1.16)     0.0000 (1.0)           0;0  2.0067 (0.87)          1           1
test_sharing-checkout[main]       437.0488 (1.01)     437.0488 (1.01)     437.0488 (1.01)     0.0000 (1.0)      437.0488 (1.01)     0.0000 (1.0)           0;0  2.2881 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     365.9950 (1.0)      365.9950 (1.0)      365.9950 (1.0)      0.0000 (1.0)      365.9950 (1.0)      0.0000 (1.0)           0;0  2.7323 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     378.9906 (1.04)     378.9906 (1.04)     378.9906 (1.04)     0.0000 (1.0)      378.9906 (1.04)     0.0000 (1.0)           0;0  2.6386 (0.97)          1           1
test_sharing-checkout-noop[main]       378.2052 (1.03)     378.2052 (1.03)     378.2052 (1.03)     0.0000 (1.0)      378.2052 (1.03)     0.0000 (1.0)           0;0  2.6441 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     430.8729 (1.0)      430.8729 (1.0)      430.8729 (1.0)      0.0000 (1.0)      430.8729 (1.0)      0.0000 (1.0)           0;0  2.3209 (1.0)           1           1
test_sharing-fetch[3.10.0]     448.8521 (1.04)     448.8521 (1.04)     448.8521 (1.04)     0.0000 (1.0)      448.8521 (1.04)     0.0000 (1.0)           0;0  2.2279 (0.96)          1           1
test_sharing-fetch[main]       440.3745 (1.02)     440.3745 (1.02)     440.3745 (1.02)     0.0000 (1.0)      440.3745 (1.02)     0.0000 (1.0)           0;0  2.2708 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     381.0851 (1.0)      381.0851 (1.0)      381.0851 (1.0)      0.0000 (1.0)      381.0851 (1.0)      0.0000 (1.0)           0;0  2.6241 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     385.1753 (1.01)     385.1753 (1.01)     385.1753 (1.01)     0.0000 (1.0)      385.1753 (1.01)     0.0000 (1.0)           0;0  2.5962 (0.99)          1           1
test_sharing-fetch-noop[main]       406.1845 (1.07)     406.1845 (1.07)     406.1845 (1.07)     0.0000 (1.0)      406.1845 (1.07)     0.0000 (1.0)           0;0  2.4619 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     431.4233 (1.04)     431.4233 (1.04)     431.4233 (1.04)     0.0000 (1.0)      431.4233 (1.04)     0.0000 (1.0)           0;0  2.3179 (0.96)          1           1
test_sharing-push[3.10.0]     413.9134 (1.0)      413.9134 (1.0)      413.9134 (1.0)      0.0000 (1.0)      413.9134 (1.0)      0.0000 (1.0)           0;0  2.4160 (1.0)           1           1
test_sharing-push[main]       457.1901 (1.10)     457.1901 (1.10)     457.1901 (1.10)     0.0000 (1.0)      457.1901 (1.10)     0.0000 (1.0)           0;0  2.1873 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     378.1888 (1.01)     378.1888 (1.01)     378.1888 (1.01)     0.0000 (1.0)      378.1888 (1.01)     0.0000 (1.0)           0;0  2.6442 (0.99)          1           1
test_sharing-push-noop[3.10.0]     373.4887 (1.0)      373.4887 (1.0)      373.4887 (1.0)      0.0000 (1.0)      373.4887 (1.0)      0.0000 (1.0)           0;0  2.6775 (1.0)           1           1
test_sharing-push-noop[main]       408.5391 (1.09)     408.5391 (1.09)     408.5391 (1.09)     0.0000 (1.0)      408.5391 (1.09)     0.0000 (1.0)           0;0  2.4477 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     429.4458 (1.02)     429.4458 (1.02)     429.4458 (1.02)     0.0000 (1.0)      429.4458 (1.02)     0.0000 (1.0)           0;0  2.3286 (0.98)          1           1
test_status-status[3.10.0]     427.3513 (1.01)     427.3513 (1.01)     427.3513 (1.01)     0.0000 (1.0)      427.3513 (1.01)     0.0000 (1.0)           0;0  2.3400 (0.99)          1           1
test_status-status[main]       422.0612 (1.0)      422.0612 (1.0)      422.0612 (1.0)      0.0000 (1.0)      422.0612 (1.0)      0.0000 (1.0)           0;0  2.3693 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     374.7808 (1.0)      374.7808 (1.0)      374.7808 (1.0)      0.0000 (1.0)      374.7808 (1.0)      0.0000 (1.0)           0;0  2.6682 (1.0)           1           1
test_status-status-changed[3.10.0]     388.3543 (1.04)     388.3543 (1.04)     388.3543 (1.04)     0.0000 (1.0)      388.3543 (1.04)     0.0000 (1.0)           0;0  2.5750 (0.97)          1           1
test_status-status-changed[main]       383.7985 (1.02)     383.7985 (1.02)     383.7985 (1.02)     0.0000 (1.0)      383.7985 (1.02)     0.0000 (1.0)           0;0  2.6055 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     369.4906 (1.0)      369.4906 (1.0)      369.4906 (1.0)      0.0000 (1.0)      369.4906 (1.0)      0.0000 (1.0)           0;0  2.7064 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     413.1891 (1.12)     413.1891 (1.12)     413.1891 (1.12)     0.0000 (1.0)      413.1891 (1.12)     0.0000 (1.0)           0;0  2.4202 (0.89)          1           1
test_status-status-changed-noop[main]       378.0131 (1.02)     378.0131 (1.02)     378.0131 (1.02)     0.0000 (1.0)      378.0131 (1.02)     0.0000 (1.0)           0;0  2.6454 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     369.3348 (1.0)      369.3348 (1.0)      369.3348 (1.0)      0.0000 (1.0)      369.3348 (1.0)      0.0000 (1.0)           0;0  2.7076 (1.0)           1           1
test_status-status-noop[3.10.0]     377.5540 (1.02)     377.5540 (1.02)     377.5540 (1.02)     0.0000 (1.0)      377.5540 (1.02)     0.0000 (1.0)           0;0  2.6486 (0.98)          1           1
test_status-status-noop[main]       379.5053 (1.03)     379.5053 (1.03)     379.5053 (1.03)     0.0000 (1.0)      379.5053 (1.03)     0.0000 (1.0)           0;0  2.6350 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     662.1973 (1.03)     662.1973 (1.03)     662.1973 (1.03)     0.0000 (1.0)      662.1973 (1.03)     0.0000 (1.0)           0;0  1.5101 (0.97)          1           1
test_update-import-url[3.10.0]     687.0346 (1.07)     687.0346 (1.07)     687.0346 (1.07)     0.0000 (1.0)      687.0346 (1.07)     0.0000 (1.0)           0;0  1.4555 (0.94)          1           1
test_update-import-url[main]       642.4711 (1.0)      642.4711 (1.0)      642.4711 (1.0)      0.0000 (1.0)      642.4711 (1.0)      0.0000 (1.0)           0;0  1.5565 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     535.6211 (1.02)     535.6211 (1.02)     535.6211 (1.02)     0.0000 (1.0)      535.6211 (1.02)     0.0000 (1.0)           0;0  1.8670 (0.98)          1           1
test_update-update[3.10.0]     554.7522 (1.06)     554.7522 (1.06)     554.7522 (1.06)     0.0000 (1.0)      554.7522 (1.06)     0.0000 (1.0)           0;0  1.8026 (0.95)          1           1
test_update-update[main]       525.3640 (1.0)      525.3640 (1.0)      525.3640 (1.0)      0.0000 (1.0)      525.3640 (1.0)      0.0000 (1.0)           0;0  1.9034 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     413.6211 (1.02)     413.6211 (1.02)     413.6211 (1.02)     0.0000 (1.0)      413.6211 (1.02)     0.0000 (1.0)           0;0  2.4177 (0.98)          1           1
test_update-update-noop[3.10.0]     406.5340 (1.0)      406.5340 (1.0)      406.5340 (1.0)      0.0000 (1.0)      406.5340 (1.0)      0.0000 (1.0)           0;0  2.4598 (1.0)           1           1
test_update-update-noop[main]       419.2198 (1.03)     419.2198 (1.03)     419.2198 (1.03)     0.0000 (1.0)      419.2198 (1.03)     0.0000 (1.0)           0;0  2.3854 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean