Fri Dec  8 19:26:23 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     610.1866 (1.04)     610.1866 (1.04)     610.1866 (1.04)     0.0000 (1.0)      610.1866 (1.04)     0.0000 (1.0)           0;0  1.6388 (0.96)          1           1
test_add-add[3.10.0]     625.9815 (1.07)     625.9815 (1.07)     625.9815 (1.07)     0.0000 (1.0)      625.9815 (1.07)     0.0000 (1.0)           0;0  1.5975 (0.93)          1           1
test_add-add[main]       585.2185 (1.0)      585.2185 (1.0)      585.2185 (1.0)      0.0000 (1.0)      585.2185 (1.0)      0.0000 (1.0)           0;0  1.7088 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     532.7100 (1.0)      532.7100 (1.0)      532.7100 (1.0)      0.0000 (1.0)      532.7100 (1.0)      0.0000 (1.0)           0;0  1.8772 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     563.3449 (1.06)     563.3449 (1.06)     563.3449 (1.06)     0.0000 (1.0)      563.3449 (1.06)     0.0000 (1.0)           0;0  1.7751 (0.95)          1           1
test_checkout_copy-checkout[main]       538.8524 (1.01)     538.8524 (1.01)     538.8524 (1.01)     0.0000 (1.0)      538.8524 (1.01)     0.0000 (1.0)           0;0  1.8558 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     365.0154 (1.0)      365.0154 (1.0)      365.0154 (1.0)      0.0000 (1.0)      365.0154 (1.0)      0.0000 (1.0)           0;0  2.7396 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     374.6234 (1.03)     374.6234 (1.03)     374.6234 (1.03)     0.0000 (1.0)      374.6234 (1.03)     0.0000 (1.0)           0;0  2.6693 (0.97)          1           1
test_checkout_copy-checkout-noop[main]       379.5765 (1.04)     379.5765 (1.04)     379.5765 (1.04)     0.0000 (1.0)      379.5765 (1.04)     0.0000 (1.0)           0;0  2.6345 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     403.3912 (1.0)      403.3912 (1.0)      403.3912 (1.0)      0.0000 (1.0)      403.3912 (1.0)      0.0000 (1.0)           0;0  2.4790 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     412.1287 (1.02)     412.1287 (1.02)     412.1287 (1.02)     0.0000 (1.0)      412.1287 (1.02)     0.0000 (1.0)           0;0  2.4264 (0.98)          1           1
test_checkout_copy-checkout-update[main]       415.4991 (1.03)     415.4991 (1.03)     415.4991 (1.03)     0.0000 (1.0)      415.4991 (1.03)     0.0000 (1.0)           0;0  2.4067 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     519.0142 (1.0)      519.0142 (1.0)      519.0142 (1.0)      0.0000 (1.0)      519.0142 (1.0)      0.0000 (1.0)           0;0  1.9267 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     541.9635 (1.04)     541.9635 (1.04)     541.9635 (1.04)     0.0000 (1.0)      541.9635 (1.04)     0.0000 (1.0)           0;0  1.8451 (0.96)          1           1
test_checkout_hardlink-checkout[main]       542.5842 (1.05)     542.5842 (1.05)     542.5842 (1.05)     0.0000 (1.0)      542.5842 (1.05)     0.0000 (1.0)           0;0  1.8430 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     380.6058 (1.0)      380.6058 (1.0)      380.6058 (1.0)      0.0000 (1.0)      380.6058 (1.0)      0.0000 (1.0)           0;0  2.6274 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     390.0241 (1.02)     390.0241 (1.02)     390.0241 (1.02)     0.0000 (1.0)      390.0241 (1.02)     0.0000 (1.0)           0;0  2.5639 (0.98)          1           1
test_checkout_hardlink-checkout-noop[main]       393.1151 (1.03)     393.1151 (1.03)     393.1151 (1.03)     0.0000 (1.0)      393.1151 (1.03)     0.0000 (1.0)           0;0  2.5438 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     410.0146 (1.0)      410.0146 (1.0)      410.0146 (1.0)      0.0000 (1.0)      410.0146 (1.0)      0.0000 (1.0)           0;0  2.4389 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     420.7195 (1.03)     420.7195 (1.03)     420.7195 (1.03)     0.0000 (1.0)      420.7195 (1.03)     0.0000 (1.0)           0;0  2.3769 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       429.1407 (1.05)     429.1407 (1.05)     429.1407 (1.05)     0.0000 (1.0)      429.1407 (1.05)     0.0000 (1.0)           0;0  2.3302 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     537.5825 (1.0)      537.5825 (1.0)      537.5825 (1.0)      0.0000 (1.0)      537.5825 (1.0)      0.0000 (1.0)           0;0  1.8602 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     575.0555 (1.07)     575.0555 (1.07)     575.0555 (1.07)     0.0000 (1.0)      575.0555 (1.07)     0.0000 (1.0)           0;0  1.7390 (0.93)          1           1
test_checkout_symlink-checkout[main]       556.8753 (1.04)     556.8753 (1.04)     556.8753 (1.04)     0.0000 (1.0)      556.8753 (1.04)     0.0000 (1.0)           0;0  1.7957 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     392.7281 (1.0)      392.7281 (1.0)      392.7281 (1.0)      0.0000 (1.0)      392.7281 (1.0)      0.0000 (1.0)           0;0  2.5463 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     415.2676 (1.06)     415.2676 (1.06)     415.2676 (1.06)     0.0000 (1.0)      415.2676 (1.06)     0.0000 (1.0)           0;0  2.4081 (0.95)          1           1
test_checkout_symlink-checkout-noop[main]       409.2764 (1.04)     409.2764 (1.04)     409.2764 (1.04)     0.0000 (1.0)      409.2764 (1.04)     0.0000 (1.0)           0;0  2.4433 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     446.9149 (1.0)      446.9149 (1.0)      446.9149 (1.0)      0.0000 (1.0)      446.9149 (1.0)      0.0000 (1.0)           0;0  2.2376 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     450.3638 (1.01)     450.3638 (1.01)     450.3638 (1.01)     0.0000 (1.0)      450.3638 (1.01)     0.0000 (1.0)           0;0  2.2204 (0.99)          1           1
test_checkout_symlink-checkout-update[main]       448.0169 (1.00)     448.0169 (1.00)     448.0169 (1.00)     0.0000 (1.0)      448.0169 (1.00)     0.0000 (1.0)           0;0  2.2321 (1.00)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     468.6279 (1.09)     468.6279 (1.09)     468.6279 (1.09)     0.0000 (1.0)      468.6279 (1.09)     0.0000 (1.0)           0;0  2.1339 (0.92)          1           1
test_data_status-data-changed[3.10.0]     429.1096 (1.0)      429.1096 (1.0)      429.1096 (1.0)      0.0000 (1.0)      429.1096 (1.0)      0.0000 (1.0)           0;0  2.3304 (1.0)           1           1
test_data_status-data-changed[main]       432.4447 (1.01)     432.4447 (1.01)     432.4447 (1.01)     0.0000 (1.0)      432.4447 (1.01)     0.0000 (1.0)           0;0  2.3124 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     460.9822 (1.04)     460.9822 (1.04)     460.9822 (1.04)     0.0000 (1.0)      460.9822 (1.04)     0.0000 (1.0)           0;0  2.1693 (0.96)          1           1
test_data_status-data-changed-noop[3.10.0]     461.4748 (1.04)     461.4748 (1.04)     461.4748 (1.04)     0.0000 (1.0)      461.4748 (1.04)     0.0000 (1.0)           0;0  2.1670 (0.96)          1           1
test_data_status-data-changed-noop[main]       444.0612 (1.0)      444.0612 (1.0)      444.0612 (1.0)      0.0000 (1.0)      444.0612 (1.0)      0.0000 (1.0)           0;0  2.2519 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     518.7330 (1.10)     518.7330 (1.10)     518.7330 (1.10)     0.0000 (1.0)      518.7330 (1.10)     0.0000 (1.0)           0;0  1.9278 (0.91)          1           1
test_data_status-data-new[3.10.0]     473.5450 (1.0)      473.5450 (1.0)      473.5450 (1.0)      0.0000 (1.0)      473.5450 (1.0)      0.0000 (1.0)           0;0  2.1117 (1.0)           1           1
test_data_status-data-new[main]       490.0887 (1.03)     490.0887 (1.03)     490.0887 (1.03)     0.0000 (1.0)      490.0887 (1.03)     0.0000 (1.0)           0;0  2.0404 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     457.2800 (1.09)     457.2800 (1.09)     457.2800 (1.09)     0.0000 (1.0)      457.2800 (1.09)     0.0000 (1.0)           0;0  2.1868 (0.92)          1           1
test_data_status-data-noop[3.10.0]     420.3129 (1.0)      420.3129 (1.0)      420.3129 (1.0)      0.0000 (1.0)      420.3129 (1.0)      0.0000 (1.0)           0;0  2.3792 (1.0)           1           1
test_data_status-data-noop[main]       429.9579 (1.02)     429.9579 (1.02)     429.9579 (1.02)     0.0000 (1.0)      429.9579 (1.02)     0.0000 (1.0)           0;0  2.3258 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     477.2267 (1.01)     477.2267 (1.01)     477.2267 (1.01)     0.0000 (1.0)      477.2267 (1.01)     0.0000 (1.0)           0;0  2.0954 (0.99)          1           1
test_data_status_all_flags-data-changed[3.10.0]     495.6910 (1.05)     495.6910 (1.05)     495.6910 (1.05)     0.0000 (1.0)      495.6910 (1.05)     0.0000 (1.0)           0;0  2.0174 (0.95)          1           1
test_data_status_all_flags-data-changed[main]       470.9436 (1.0)      470.9436 (1.0)      470.9436 (1.0)      0.0000 (1.0)      470.9436 (1.0)      0.0000 (1.0)           0;0  2.1234 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     483.1180 (1.00)     483.1180 (1.00)     483.1180 (1.00)     0.0000 (1.0)      483.1180 (1.00)     0.0000 (1.0)           0;0  2.0699 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     482.4577 (1.0)      482.4577 (1.0)      482.4577 (1.0)      0.0000 (1.0)      482.4577 (1.0)      0.0000 (1.0)           0;0  2.0727 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       485.5990 (1.01)     485.5990 (1.01)     485.5990 (1.01)     0.0000 (1.0)      485.5990 (1.01)     0.0000 (1.0)           0;0  2.0593 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     546.6859 (1.05)     546.6859 (1.05)     546.6859 (1.05)     0.0000 (1.0)      546.6859 (1.05)     0.0000 (1.0)           0;0  1.8292 (0.95)          1           1
test_data_status_all_flags-data-new[3.10.0]     519.5940 (1.0)      519.5940 (1.0)      519.5940 (1.0)      0.0000 (1.0)      519.5940 (1.0)      0.0000 (1.0)           0;0  1.9246 (1.0)           1           1
test_data_status_all_flags-data-new[main]       528.6725 (1.02)     528.6725 (1.02)     528.6725 (1.02)     0.0000 (1.0)      528.6725 (1.02)     0.0000 (1.0)           0;0  1.8915 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     473.4715 (1.01)     473.4715 (1.01)     473.4715 (1.01)     0.0000 (1.0)      473.4715 (1.01)     0.0000 (1.0)           0;0  2.1121 (0.99)          1           1
test_data_status_all_flags-data-noop[3.10.0]     509.5420 (1.08)     509.5420 (1.08)     509.5420 (1.08)     0.0000 (1.0)      509.5420 (1.08)     0.0000 (1.0)           0;0  1.9625 (0.92)          1           1
test_data_status_all_flags-data-noop[main]       470.7157 (1.0)      470.7157 (1.0)      470.7157 (1.0)      0.0000 (1.0)      470.7157 (1.0)      0.0000 (1.0)           0;0  2.1244 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     545.9119 (1.07)     545.9119 (1.07)     545.9119 (1.07)     0.0000 (1.0)      545.9119 (1.07)     0.0000 (1.0)           0;0  1.8318 (0.93)          1           1
test_diff-diff[3.10.0]     513.1819 (1.01)     513.1819 (1.01)     513.1819 (1.01)     0.0000 (1.0)      513.1819 (1.01)     0.0000 (1.0)           0;0  1.9486 (0.99)          1           1
test_diff-diff[main]       509.3930 (1.0)      509.3930 (1.0)      509.3930 (1.0)      0.0000 (1.0)      509.3930 (1.0)      0.0000 (1.0)           0;0  1.9631 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     504.8660 (1.10)     504.8660 (1.10)     504.8660 (1.10)     0.0000 (1.0)      504.8660 (1.10)     0.0000 (1.0)           0;0  1.9807 (0.91)          1           1
test_diff-diff-changed[3.10.0]     487.0651 (1.06)     487.0651 (1.06)     487.0651 (1.06)     0.0000 (1.0)      487.0651 (1.06)     0.0000 (1.0)           0;0  2.0531 (0.94)          1           1
test_diff-diff-changed[main]       457.7884 (1.0)      457.7884 (1.0)      457.7884 (1.0)      0.0000 (1.0)      457.7884 (1.0)      0.0000 (1.0)           0;0  2.1844 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     497.8991 (1.10)     497.8991 (1.10)     497.8991 (1.10)     0.0000 (1.0)      497.8991 (1.10)     0.0000 (1.0)           0;0  2.0084 (0.91)          1           1
test_diff-diff-changed-noop[3.10.0]     465.9971 (1.03)     465.9971 (1.03)     465.9971 (1.03)     0.0000 (1.0)      465.9971 (1.03)     0.0000 (1.0)           0;0  2.1459 (0.97)          1           1
test_diff-diff-changed-noop[main]       453.6729 (1.0)      453.6729 (1.0)      453.6729 (1.0)      0.0000 (1.0)      453.6729 (1.0)      0.0000 (1.0)           0;0  2.2042 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     481.8446 (1.07)     481.8446 (1.07)     481.8446 (1.07)     0.0000 (1.0)      481.8446 (1.07)     0.0000 (1.0)           0;0  2.0754 (0.94)          1           1
test_diff-diff-noop[3.10.0]     454.9915 (1.01)     454.9915 (1.01)     454.9915 (1.01)     0.0000 (1.0)      454.9915 (1.01)     0.0000 (1.0)           0;0  2.1978 (0.99)          1           1
test_diff-diff-noop[main]       451.6627 (1.0)      451.6627 (1.0)      451.6627 (1.0)      0.0000 (1.0)      451.6627 (1.0)      0.0000 (1.0)           0;0  2.2140 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       827.9472 (1.0)        827.9472 (1.0)        827.9472 (1.0)      0.0000 (1.0)        827.9472 (1.0)      0.0000 (1.0)           0;0  1.2078 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,382.4036 (5.29)     4,382.4036 (5.29)     4,382.4036 (5.29)     0.0000 (1.0)      4,382.4036 (5.29)     0.0000 (1.0)           0;0  0.2282 (0.19)          1           1
test_exp_show-exp[main]       3,784.2870 (4.57)     3,784.2870 (4.57)     3,784.2870 (4.57)     0.0000 (1.0)      3,784.2870 (4.57)     0.0000 (1.0)           0;0  0.2643 (0.22)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     492.1144 (1.04)     492.1144 (1.04)     492.1144 (1.04)     0.0000 (1.0)      492.1144 (1.04)     0.0000 (1.0)           0;0  2.0320 (0.97)          1           1
test_fetch-fetch[3.10.0]     520.8781 (1.10)     520.8781 (1.10)     520.8781 (1.10)     0.0000 (1.0)      520.8781 (1.10)     0.0000 (1.0)           0;0  1.9198 (0.91)          1           1
test_fetch-fetch[main]       475.2758 (1.0)      475.2758 (1.0)      475.2758 (1.0)      0.0000 (1.0)      475.2758 (1.0)      0.0000 (1.0)           0;0  2.1040 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     368.9078 (1.0)      368.9078 (1.0)      368.9078 (1.0)      0.0000 (1.0)      368.9078 (1.0)      0.0000 (1.0)           0;0  2.7107 (1.0)           1           1
test_gc-gc[3.10.0]     380.8499 (1.03)     380.8499 (1.03)     380.8499 (1.03)     0.0000 (1.0)      380.8499 (1.03)     0.0000 (1.0)           0;0  2.6257 (0.97)          1           1
test_gc-gc[main]       371.0132 (1.01)     371.0132 (1.01)     371.0132 (1.01)     0.0000 (1.0)      371.0132 (1.01)     0.0000 (1.0)           0;0  2.6953 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     485.5357 (1.0)      485.5357 (1.0)      485.5357 (1.0)      0.0000 (1.0)      485.5357 (1.0)      0.0000 (1.0)           0;0  2.0596 (1.0)           1           1
test_get-get[3.10.0]     491.0775 (1.01)     491.0775 (1.01)     491.0775 (1.01)     0.0000 (1.0)      491.0775 (1.01)     0.0000 (1.0)           0;0  2.0363 (0.99)          1           1
test_get-get[main]       528.0879 (1.09)     528.0879 (1.09)     528.0879 (1.09)     0.0000 (1.0)      528.0879 (1.09)     0.0000 (1.0)           0;0  1.8936 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     343.2813 (1.0)      343.2813 (1.0)      343.2813 (1.0)      0.0000 (1.0)      343.2813 (1.0)      0.0000 (1.0)           0;0  2.9131 (1.0)           1           1
test_get_url-get-url[3.10.0]     350.9921 (1.02)     350.9921 (1.02)     350.9921 (1.02)     0.0000 (1.0)      350.9921 (1.02)     0.0000 (1.0)           0;0  2.8491 (0.98)          1           1
test_get_url-get-url[main]       371.9690 (1.08)     371.9690 (1.08)     371.9690 (1.08)     0.0000 (1.0)      371.9690 (1.08)     0.0000 (1.0)           0;0  2.6884 (0.92)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     126.1369 (1.03)     130.9386 (1.0)      127.6844 (1.01)     0.9902 (1.0)      127.5164 (1.02)     1.2110 (1.0)          31;4  7.8318 (0.99)        100           1
test_help---help[3.10.0]     123.0021 (1.0)      175.3528 (1.34)     125.9933 (1.0)      5.3148 (5.37)     125.1994 (1.0)      1.4856 (1.23)          3;6  7.9369 (1.0)         100           1
test_help---help[main]       124.0466 (1.01)     147.3633 (1.13)     126.3152 (1.00)     2.5486 (2.57)     125.7828 (1.00)     1.3269 (1.10)          5;5  7.9167 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     697.5273 (1.0)      697.5273 (1.0)      697.5273 (1.0)      0.0000 (1.0)      697.5273 (1.0)      0.0000 (1.0)           0;0  1.4336 (1.0)           1           1
test_import-import[3.10.0]     700.8866 (1.00)     700.8866 (1.00)     700.8866 (1.00)     0.0000 (1.0)      700.8866 (1.00)     0.0000 (1.0)           0;0  1.4268 (1.00)          1           1
test_import-import[main]       725.9838 (1.04)     725.9838 (1.04)     725.9838 (1.04)     0.0000 (1.0)      725.9838 (1.04)     0.0000 (1.0)           0;0  1.3774 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     655.7084 (1.07)     655.7084 (1.07)     655.7084 (1.07)     0.0000 (1.0)      655.7084 (1.07)     0.0000 (1.0)           0;0  1.5251 (0.94)          1           1
test_import_url-import-url[3.10.0]     649.9636 (1.06)     649.9636 (1.06)     649.9636 (1.06)     0.0000 (1.0)      649.9636 (1.06)     0.0000 (1.0)           0;0  1.5385 (0.95)          1           1
test_import_url-import-url[main]       615.5682 (1.0)      615.5682 (1.0)      615.5682 (1.0)      0.0000 (1.0)      615.5682 (1.0)      0.0000 (1.0)           0;0  1.6245 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     356.6830 (1.0)      400.4916 (1.00)     363.8205 (1.0)      6.5516 (1.48)     362.4945 (1.0)      3.9675 (1.18)          7;5  2.7486 (1.0)         100           1
test_init-init[3.10.0]     365.1813 (1.02)     398.5381 (1.0)      371.4619 (1.02)     4.4415 (1.0)      370.4290 (1.02)     3.3534 (1.0)           9;6  2.6921 (0.98)        100           1
test_init-init[main]       376.0563 (1.05)     441.0799 (1.11)     383.2717 (1.05)     8.1202 (1.83)     381.4836 (1.05)     3.8238 (1.14)          5;6  2.6091 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     421.0008 (1.02)     421.0008 (1.02)     421.0008 (1.02)     0.0000 (1.0)      421.0008 (1.02)     0.0000 (1.0)           0;0  2.3753 (0.98)          1           1
test_list-list[3.10.0]     424.9695 (1.03)     424.9695 (1.03)     424.9695 (1.03)     0.0000 (1.0)      424.9695 (1.03)     0.0000 (1.0)           0;0  2.3531 (0.97)          1           1
test_list-list[main]       411.9859 (1.0)      411.9859 (1.0)      411.9859 (1.0)      0.0000 (1.0)      411.9859 (1.0)      0.0000 (1.0)           0;0  2.4273 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     415.2523 (1.05)     415.2523 (1.05)     415.2523 (1.05)     0.0000 (1.0)      415.2523 (1.05)     0.0000 (1.0)           0;0  2.4082 (0.96)          1           1
test_list-list-dvc-only[3.10.0]     397.1247 (1.0)      397.1247 (1.0)      397.1247 (1.0)      0.0000 (1.0)      397.1247 (1.0)      0.0000 (1.0)           0;0  2.5181 (1.0)           1           1
test_list-list-dvc-only[main]       405.9083 (1.02)     405.9083 (1.02)     405.9083 (1.02)     0.0000 (1.0)      405.9083 (1.02)     0.0000 (1.0)           0;0  2.4636 (0.98)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     409.0913 (1.01)     409.0913 (1.01)     409.0913 (1.01)     0.0000 (1.0)      409.0913 (1.01)     0.0000 (1.0)           0;0  2.4444 (0.99)          1           1
test_list-list-recursive[3.10.0]     405.0054 (1.0)      405.0054 (1.0)      405.0054 (1.0)      0.0000 (1.0)      405.0054 (1.0)      0.0000 (1.0)           0;0  2.4691 (1.0)           1           1
test_list-list-recursive[main]       410.3533 (1.01)     410.3533 (1.01)     410.3533 (1.01)     0.0000 (1.0)      410.3533 (1.01)     0.0000 (1.0)           0;0  2.4369 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     403.1037 (1.0)      403.1037 (1.0)      403.1037 (1.0)      0.0000 (1.0)      403.1037 (1.0)      0.0000 (1.0)           0;0  2.4808 (1.0)           1           1
test_list-list-shallow[3.10.0]     408.7535 (1.01)     408.7535 (1.01)     408.7535 (1.01)     0.0000 (1.0)      408.7535 (1.01)     0.0000 (1.0)           0;0  2.4465 (0.99)          1           1
test_list-list-shallow[main]       409.9311 (1.02)     409.9311 (1.02)     409.9311 (1.02)     0.0000 (1.0)      409.9311 (1.02)     0.0000 (1.0)           0;0  2.4394 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     569.7900 (1.01)     569.7900 (1.01)     569.7900 (1.01)     0.0000 (1.0)      569.7900 (1.01)     0.0000 (1.0)           0;0  1.7550 (0.99)          1           1
test_partial_add-add[3.10.0]     586.4646 (1.04)     586.4646 (1.04)     586.4646 (1.04)     0.0000 (1.0)      586.4646 (1.04)     0.0000 (1.0)           0;0  1.7051 (0.96)          1           1
test_partial_add-add[main]       565.5436 (1.0)      565.5436 (1.0)      565.5436 (1.0)      0.0000 (1.0)      565.5436 (1.0)      0.0000 (1.0)           0;0  1.7682 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     595.5757 (1.02)     595.5757 (1.02)     595.5757 (1.02)     0.0000 (1.0)      595.5757 (1.02)     0.0000 (1.0)           0;0  1.6790 (0.98)          1           1
test_partial_add-add-partial[3.10.0]     610.6552 (1.05)     610.6552 (1.05)     610.6552 (1.05)     0.0000 (1.0)      610.6552 (1.05)     0.0000 (1.0)           0;0  1.6376 (0.95)          1           1
test_partial_add-add-partial[main]       583.1497 (1.0)      583.1497 (1.0)      583.1497 (1.0)      0.0000 (1.0)      583.1497 (1.0)      0.0000 (1.0)           0;0  1.7148 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     399.1364 (1.0)      399.1364 (1.0)      399.1364 (1.0)      0.0000 (1.0)      399.1364 (1.0)      0.0000 (1.0)           0;0  2.5054 (1.0)           1           1
test_partial_add-gc-cloud-noop[3.10.0]     402.7346 (1.01)     402.7346 (1.01)     402.7346 (1.01)     0.0000 (1.0)      402.7346 (1.01)     0.0000 (1.0)           0;0  2.4830 (0.99)          1           1
test_partial_add-gc-cloud-noop[main]       404.2211 (1.01)     404.2211 (1.01)     404.2211 (1.01)     0.0000 (1.0)      404.2211 (1.01)     0.0000 (1.0)           0;0  2.4739 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     371.4896 (1.0)      371.4896 (1.0)      371.4896 (1.0)      0.0000 (1.0)      371.4896 (1.0)      0.0000 (1.0)           0;0  2.6919 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     397.2638 (1.07)     397.2638 (1.07)     397.2638 (1.07)     0.0000 (1.0)      397.2638 (1.07)     0.0000 (1.0)           0;0  2.5172 (0.94)          1           1
test_partial_add-gc-noop[main]       389.5754 (1.05)     389.5754 (1.05)     389.5754 (1.05)     0.0000 (1.0)      389.5754 (1.05)     0.0000 (1.0)           0;0  2.5669 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     426.9303 (1.00)     426.9303 (1.00)     426.9303 (1.00)     0.0000 (1.0)      426.9303 (1.00)     0.0000 (1.0)           0;0  2.3423 (1.00)          1           1
test_partial_add-push[3.10.0]     425.4874 (1.0)      425.4874 (1.0)      425.4874 (1.0)      0.0000 (1.0)      425.4874 (1.0)      0.0000 (1.0)           0;0  2.3502 (1.0)           1           1
test_partial_add-push[main]       449.8371 (1.06)     449.8371 (1.06)     449.8371 (1.06)     0.0000 (1.0)      449.8371 (1.06)     0.0000 (1.0)           0;0  2.2230 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     431.1773 (1.02)     431.1773 (1.02)     431.1773 (1.02)     0.0000 (1.0)      431.1773 (1.02)     0.0000 (1.0)           0;0  2.3192 (0.98)          1           1
test_partial_add-push-partial[3.10.0]     422.8103 (1.0)      422.8103 (1.0)      422.8103 (1.0)      0.0000 (1.0)      422.8103 (1.0)      0.0000 (1.0)           0;0  2.3651 (1.0)           1           1
test_partial_add-push-partial[main]       460.3329 (1.09)     460.3329 (1.09)     460.3329 (1.09)     0.0000 (1.0)      460.3329 (1.09)     0.0000 (1.0)           0;0  2.1723 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     586.0334 (1.0)      586.0334 (1.0)      586.0334 (1.0)      0.0000 (1.0)      586.0334 (1.0)      0.0000 (1.0)           0;0  1.7064 (1.0)           1           1
test_partial_remove-add[3.10.0]     608.8371 (1.04)     608.8371 (1.04)     608.8371 (1.04)     0.0000 (1.0)      608.8371 (1.04)     0.0000 (1.0)           0;0  1.6425 (0.96)          1           1
test_partial_remove-add[main]       590.8979 (1.01)     590.8979 (1.01)     590.8979 (1.01)     0.0000 (1.0)      590.8979 (1.01)     0.0000 (1.0)           0;0  1.6923 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     535.3788 (1.0)      535.3788 (1.0)      535.3788 (1.0)      0.0000 (1.0)      535.3788 (1.0)      0.0000 (1.0)           0;0  1.8678 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     553.9604 (1.03)     553.9604 (1.03)     553.9604 (1.03)     0.0000 (1.0)      553.9604 (1.03)     0.0000 (1.0)           0;0  1.8052 (0.97)          1           1
test_partial_remove-add-update[main]       536.6466 (1.00)     536.6466 (1.00)     536.6466 (1.00)     0.0000 (1.0)      536.6466 (1.00)     0.0000 (1.0)           0;0  1.8634 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     365.0522 (1.0)      365.0522 (1.0)      365.0522 (1.0)      0.0000 (1.0)      365.0522 (1.0)      0.0000 (1.0)           0;0  2.7393 (1.0)           1           1
test_partial_remove-gc[3.10.0]     387.2415 (1.06)     387.2415 (1.06)     387.2415 (1.06)     0.0000 (1.0)      387.2415 (1.06)     0.0000 (1.0)           0;0  2.5824 (0.94)          1           1
test_partial_remove-gc[main]       375.0526 (1.03)     375.0526 (1.03)     375.0526 (1.03)     0.0000 (1.0)      375.0526 (1.03)     0.0000 (1.0)           0;0  2.6663 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     388.0884 (1.01)     388.0884 (1.01)     388.0884 (1.01)     0.0000 (1.0)      388.0884 (1.01)     0.0000 (1.0)           0;0  2.5767 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     399.4753 (1.04)     399.4753 (1.04)     399.4753 (1.04)     0.0000 (1.0)      399.4753 (1.04)     0.0000 (1.0)           0;0  2.5033 (0.97)          1           1
test_partial_remove-gc-cloud[main]       385.8578 (1.0)      385.8578 (1.0)      385.8578 (1.0)      0.0000 (1.0)      385.8578 (1.0)      0.0000 (1.0)           0;0  2.5916 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     433.5100 (1.00)     433.5100 (1.00)     433.5100 (1.00)     0.0000 (1.0)      433.5100 (1.00)     0.0000 (1.0)           0;0  2.3068 (1.00)          1           1
test_partial_remove-push[3.10.0]     432.2409 (1.0)      432.2409 (1.0)      432.2409 (1.0)      0.0000 (1.0)      432.2409 (1.0)      0.0000 (1.0)           0;0  2.3135 (1.0)           1           1
test_partial_remove-push[main]       460.6360 (1.07)     460.6360 (1.07)     460.6360 (1.07)     0.0000 (1.0)      460.6360 (1.07)     0.0000 (1.0)           0;0  2.1709 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     388.3295 (1.0)      388.3295 (1.0)      388.3295 (1.0)      0.0000 (1.0)      388.3295 (1.0)      0.0000 (1.0)           0;0  2.5751 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     390.7767 (1.01)     390.7767 (1.01)     390.7767 (1.01)     0.0000 (1.0)      390.7767 (1.01)     0.0000 (1.0)           0;0  2.5590 (0.99)          1           1
test_partial_remove-push-update[main]       418.6847 (1.08)     418.6847 (1.08)     418.6847 (1.08)     0.0000 (1.0)      418.6847 (1.08)     0.0000 (1.0)           0;0  2.3884 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     421.9913 (1.0)      432.1548 (1.0)      426.3612 (1.0)      3.7273 (1.0)      425.9272 (1.0)      4.1247 (1.0)           2;0  2.3454 (1.0)           5           3
test_plots-plots-diff[3.10.0]     776.9612 (1.84)     788.6871 (1.83)     782.9921 (1.84)     4.2858 (1.15)     782.6758 (1.84)     5.1454 (1.25)          2;0  1.2772 (0.54)          5           3
test_plots-plots-diff[main]       755.2005 (1.79)     771.4853 (1.79)     761.2387 (1.79)     6.5646 (1.76)     758.6318 (1.78)     9.1410 (2.22)          1;0  1.3136 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       438.5417 (1.0)        446.0271 (1.0)        442.5388 (1.0)       3.0637 (1.0)        442.5564 (1.0)       5.1024 (1.0)           2;0  2.2597 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,037.9606 (2.37)     1,083.1183 (2.43)     1,048.1871 (2.37)     19.5983 (6.40)     1,038.8193 (2.35)     13.9363 (2.73)          1;1  0.9540 (0.42)          5           3
test_plots-plots-diff-json[main]         828.4003 (1.89)       845.9362 (1.90)       837.7732 (1.89)      8.0110 (2.61)       839.9512 (1.90)     14.8307 (2.91)          2;0  1.1936 (0.53)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     391.5559 (1.0)      401.4979 (1.0)      396.8558 (1.0)      4.3472 (1.0)      395.3081 (1.0)       7.3607 (1.0)           3;0  2.5198 (1.0)           5           3
test_plots-plots-show[3.10.0]     651.2777 (1.66)     672.4444 (1.67)     660.6632 (1.66)     9.2393 (2.13)     655.7480 (1.66)     15.1987 (2.06)          2;0  1.5136 (0.60)          5           3
test_plots-plots-show[main]       640.1443 (1.63)     664.3809 (1.65)     653.2251 (1.65)     9.3959 (2.16)     651.2902 (1.65)     13.2824 (1.80)          2;0  1.5309 (0.61)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     408.4295 (1.0)      417.6514 (1.0)      412.3675 (1.0)      3.6749 (1.0)      411.9799 (1.0)       5.6568 (1.0)           2;0  2.4250 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     796.4631 (1.95)     808.4912 (1.94)     802.4335 (1.95)     4.7568 (1.29)     801.4160 (1.95)      7.3412 (1.30)          2;0  1.2462 (0.51)          5           3
test_plots-plots-show-json[main]       688.7840 (1.69)     709.9684 (1.70)     700.5202 (1.70)     8.9832 (2.44)     702.7354 (1.71)     15.4071 (2.72)          2;0  1.4275 (0.59)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     450.2977 (1.02)     450.2977 (1.02)     450.2977 (1.02)     0.0000 (1.0)      450.2977 (1.02)     0.0000 (1.0)           0;0  2.2208 (0.98)          1           1
test_push-push[3.10.0]     442.4585 (1.0)      442.4585 (1.0)      442.4585 (1.0)      0.0000 (1.0)      442.4585 (1.0)      0.0000 (1.0)           0;0  2.2601 (1.0)           1           1
test_push-push[main]       468.6514 (1.06)     468.6514 (1.06)     468.6514 (1.06)     0.0000 (1.0)      468.6514 (1.06)     0.0000 (1.0)           0;0  2.1338 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     571.5244 (1.03)     571.5244 (1.03)     571.5244 (1.03)     0.0000 (1.0)      571.5244 (1.03)     0.0000 (1.0)           0;0  1.7497 (0.97)          1           1
test_sharing-add[3.10.0]     578.2739 (1.04)     578.2739 (1.04)     578.2739 (1.04)     0.0000 (1.0)      578.2739 (1.04)     0.0000 (1.0)           0;0  1.7293 (0.96)          1           1
test_sharing-add[main]       553.8320 (1.0)      553.8320 (1.0)      553.8320 (1.0)      0.0000 (1.0)      553.8320 (1.0)      0.0000 (1.0)           0;0  1.8056 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     541.6714 (1.04)     541.6714 (1.04)     541.6714 (1.04)     0.0000 (1.0)      541.6714 (1.04)     0.0000 (1.0)           0;0  1.8461 (0.96)          1           1
test_sharing-add-noop[3.10.0]     533.4674 (1.03)     533.4674 (1.03)     533.4674 (1.03)     0.0000 (1.0)      533.4674 (1.03)     0.0000 (1.0)           0;0  1.8745 (0.97)          1           1
test_sharing-add-noop[main]       519.2296 (1.0)      519.2296 (1.0)      519.2296 (1.0)      0.0000 (1.0)      519.2296 (1.0)      0.0000 (1.0)           0;0  1.9259 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     411.4460 (1.0)      411.4460 (1.0)      411.4460 (1.0)      0.0000 (1.0)      411.4460 (1.0)      0.0000 (1.0)           0;0  2.4305 (1.0)           1           1
test_sharing-checkout[3.10.0]     464.7645 (1.13)     464.7645 (1.13)     464.7645 (1.13)     0.0000 (1.0)      464.7645 (1.13)     0.0000 (1.0)           0;0  2.1516 (0.89)          1           1
test_sharing-checkout[main]       433.2586 (1.05)     433.2586 (1.05)     433.2586 (1.05)     0.0000 (1.0)      433.2586 (1.05)     0.0000 (1.0)           0;0  2.3081 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     354.9268 (1.0)      354.9268 (1.0)      354.9268 (1.0)      0.0000 (1.0)      354.9268 (1.0)      0.0000 (1.0)           0;0  2.8175 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     399.5722 (1.13)     399.5722 (1.13)     399.5722 (1.13)     0.0000 (1.0)      399.5722 (1.13)     0.0000 (1.0)           0;0  2.5027 (0.89)          1           1
test_sharing-checkout-noop[main]       371.8506 (1.05)     371.8506 (1.05)     371.8506 (1.05)     0.0000 (1.0)      371.8506 (1.05)     0.0000 (1.0)           0;0  2.6893 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     422.5126 (1.01)     422.5126 (1.01)     422.5126 (1.01)     0.0000 (1.0)      422.5126 (1.01)     0.0000 (1.0)           0;0  2.3668 (0.99)          1           1
test_sharing-fetch[3.10.0]     441.0612 (1.06)     441.0612 (1.06)     441.0612 (1.06)     0.0000 (1.0)      441.0612 (1.06)     0.0000 (1.0)           0;0  2.2673 (0.95)          1           1
test_sharing-fetch[main]       417.6533 (1.0)      417.6533 (1.0)      417.6533 (1.0)      0.0000 (1.0)      417.6533 (1.0)      0.0000 (1.0)           0;0  2.3943 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     374.0948 (1.00)     374.0948 (1.00)     374.0948 (1.00)     0.0000 (1.0)      374.0948 (1.00)     0.0000 (1.0)           0;0  2.6731 (1.00)          1           1
test_sharing-fetch-noop[3.10.0]     373.5215 (1.0)      373.5215 (1.0)      373.5215 (1.0)      0.0000 (1.0)      373.5215 (1.0)      0.0000 (1.0)           0;0  2.6772 (1.0)           1           1
test_sharing-fetch-noop[main]       398.5589 (1.07)     398.5589 (1.07)     398.5589 (1.07)     0.0000 (1.0)      398.5589 (1.07)     0.0000 (1.0)           0;0  2.5090 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     421.2035 (1.01)     421.2035 (1.01)     421.2035 (1.01)     0.0000 (1.0)      421.2035 (1.01)     0.0000 (1.0)           0;0  2.3741 (0.99)          1           1
test_sharing-push[3.10.0]     416.9210 (1.0)      416.9210 (1.0)      416.9210 (1.0)      0.0000 (1.0)      416.9210 (1.0)      0.0000 (1.0)           0;0  2.3985 (1.0)           1           1
test_sharing-push[main]       438.0253 (1.05)     438.0253 (1.05)     438.0253 (1.05)     0.0000 (1.0)      438.0253 (1.05)     0.0000 (1.0)           0;0  2.2830 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     361.4197 (1.0)      361.4197 (1.0)      361.4197 (1.0)      0.0000 (1.0)      361.4197 (1.0)      0.0000 (1.0)           0;0  2.7669 (1.0)           1           1
test_sharing-push-noop[3.10.0]     371.0471 (1.03)     371.0471 (1.03)     371.0471 (1.03)     0.0000 (1.0)      371.0471 (1.03)     0.0000 (1.0)           0;0  2.6951 (0.97)          1           1
test_sharing-push-noop[main]       399.2054 (1.10)     399.2054 (1.10)     399.2054 (1.10)     0.0000 (1.0)      399.2054 (1.10)     0.0000 (1.0)           0;0  2.5050 (0.91)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     425.2508 (1.0)      425.2508 (1.0)      425.2508 (1.0)      0.0000 (1.0)      425.2508 (1.0)      0.0000 (1.0)           0;0  2.3516 (1.0)           1           1
test_status-status[3.10.0]     431.1498 (1.01)     431.1498 (1.01)     431.1498 (1.01)     0.0000 (1.0)      431.1498 (1.01)     0.0000 (1.0)           0;0  2.3194 (0.99)          1           1
test_status-status[main]       431.3321 (1.01)     431.3321 (1.01)     431.3321 (1.01)     0.0000 (1.0)      431.3321 (1.01)     0.0000 (1.0)           0;0  2.3184 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     385.7933 (1.0)      385.7933 (1.0)      385.7933 (1.0)      0.0000 (1.0)      385.7933 (1.0)      0.0000 (1.0)           0;0  2.5921 (1.0)           1           1
test_status-status-changed[3.10.0]     395.6600 (1.03)     395.6600 (1.03)     395.6600 (1.03)     0.0000 (1.0)      395.6600 (1.03)     0.0000 (1.0)           0;0  2.5274 (0.98)          1           1
test_status-status-changed[main]       390.5871 (1.01)     390.5871 (1.01)     390.5871 (1.01)     0.0000 (1.0)      390.5871 (1.01)     0.0000 (1.0)           0;0  2.5602 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     374.4050 (1.0)      374.4050 (1.0)      374.4050 (1.0)      0.0000 (1.0)      374.4050 (1.0)      0.0000 (1.0)           0;0  2.6709 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     382.6096 (1.02)     382.6096 (1.02)     382.6096 (1.02)     0.0000 (1.0)      382.6096 (1.02)     0.0000 (1.0)           0;0  2.6136 (0.98)          1           1
test_status-status-changed-noop[main]       386.0125 (1.03)     386.0125 (1.03)     386.0125 (1.03)     0.0000 (1.0)      386.0125 (1.03)     0.0000 (1.0)           0;0  2.5906 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     377.3345 (1.0)      377.3345 (1.0)      377.3345 (1.0)      0.0000 (1.0)      377.3345 (1.0)      0.0000 (1.0)           0;0  2.6502 (1.0)           1           1
test_status-status-noop[3.10.0]     385.7104 (1.02)     385.7104 (1.02)     385.7104 (1.02)     0.0000 (1.0)      385.7104 (1.02)     0.0000 (1.0)           0;0  2.5926 (0.98)          1           1
test_status-status-noop[main]       400.3671 (1.06)     400.3671 (1.06)     400.3671 (1.06)     0.0000 (1.0)      400.3671 (1.06)     0.0000 (1.0)           0;0  2.4977 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     629.2013 (1.0)      629.2013 (1.0)      629.2013 (1.0)      0.0000 (1.0)      629.2013 (1.0)      0.0000 (1.0)           0;0  1.5893 (1.0)           1           1
test_update-import-url[3.10.0]     643.0739 (1.02)     643.0739 (1.02)     643.0739 (1.02)     0.0000 (1.0)      643.0739 (1.02)     0.0000 (1.0)           0;0  1.5550 (0.98)          1           1
test_update-import-url[main]       631.7820 (1.00)     631.7820 (1.00)     631.7820 (1.00)     0.0000 (1.0)      631.7820 (1.00)     0.0000 (1.0)           0;0  1.5828 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     520.5991 (1.0)      520.5991 (1.0)      520.5991 (1.0)      0.0000 (1.0)      520.5991 (1.0)      0.0000 (1.0)           0;0  1.9209 (1.0)           1           1
test_update-update[3.10.0]     522.7380 (1.00)     522.7380 (1.00)     522.7380 (1.00)     0.0000 (1.0)      522.7380 (1.00)     0.0000 (1.0)           0;0  1.9130 (1.00)          1           1
test_update-update[main]       533.3550 (1.02)     533.3550 (1.02)     533.3550 (1.02)     0.0000 (1.0)      533.3550 (1.02)     0.0000 (1.0)           0;0  1.8749 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     391.3797 (1.0)      391.3797 (1.0)      391.3797 (1.0)      0.0000 (1.0)      391.3797 (1.0)      0.0000 (1.0)           0;0  2.5551 (1.0)           1           1
test_update-update-noop[3.10.0]     397.4255 (1.02)     397.4255 (1.02)     397.4255 (1.02)     0.0000 (1.0)      397.4255 (1.02)     0.0000 (1.0)           0;0  2.5162 (0.98)          1           1
test_update-update-noop[main]       394.8231 (1.01)     394.8231 (1.01)     394.8231 (1.01)     0.0000 (1.0)      394.8231 (1.01)     0.0000 (1.0)           0;0  2.5328 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean