Fri Dec  8 20:26:54 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     573.1941 (1.01)     573.1941 (1.01)     573.1941 (1.01)     0.0000 (1.0)      573.1941 (1.01)     0.0000 (1.0)           0;0  1.7446 (0.99)          1           1
test_add-add[3.10.0]     586.8238 (1.03)     586.8238 (1.03)     586.8238 (1.03)     0.0000 (1.0)      586.8238 (1.03)     0.0000 (1.0)           0;0  1.7041 (0.97)          1           1
test_add-add[main]       569.7636 (1.0)      569.7636 (1.0)      569.7636 (1.0)      0.0000 (1.0)      569.7636 (1.0)      0.0000 (1.0)           0;0  1.7551 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     557.8921 (1.0)      557.8921 (1.0)      557.8921 (1.0)      0.0000 (1.0)      557.8921 (1.0)      0.0000 (1.0)           0;0  1.7925 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     610.0686 (1.09)     610.0686 (1.09)     610.0686 (1.09)     0.0000 (1.0)      610.0686 (1.09)     0.0000 (1.0)           0;0  1.6392 (0.91)          1           1
test_checkout_copy-checkout[main]       584.9410 (1.05)     584.9410 (1.05)     584.9410 (1.05)     0.0000 (1.0)      584.9410 (1.05)     0.0000 (1.0)           0;0  1.7096 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     403.9453 (1.01)     403.9453 (1.01)     403.9453 (1.01)     0.0000 (1.0)      403.9453 (1.01)     0.0000 (1.0)           0;0  2.4756 (0.99)          1           1
test_checkout_copy-checkout-noop[3.10.0]     398.1203 (1.0)      398.1203 (1.0)      398.1203 (1.0)      0.0000 (1.0)      398.1203 (1.0)      0.0000 (1.0)           0;0  2.5118 (1.0)           1           1
test_checkout_copy-checkout-noop[main]       410.6915 (1.03)     410.6915 (1.03)     410.6915 (1.03)     0.0000 (1.0)      410.6915 (1.03)     0.0000 (1.0)           0;0  2.4349 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     431.0217 (1.0)      431.0217 (1.0)      431.0217 (1.0)      0.0000 (1.0)      431.0217 (1.0)      0.0000 (1.0)           0;0  2.3201 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     439.6550 (1.02)     439.6550 (1.02)     439.6550 (1.02)     0.0000 (1.0)      439.6550 (1.02)     0.0000 (1.0)           0;0  2.2745 (0.98)          1           1
test_checkout_copy-checkout-update[main]       436.8160 (1.01)     436.8160 (1.01)     436.8160 (1.01)     0.0000 (1.0)      436.8160 (1.01)     0.0000 (1.0)           0;0  2.2893 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     518.5856 (1.0)      518.5856 (1.0)      518.5856 (1.0)      0.0000 (1.0)      518.5856 (1.0)      0.0000 (1.0)           0;0  1.9283 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     562.8792 (1.09)     562.8792 (1.09)     562.8792 (1.09)     0.0000 (1.0)      562.8792 (1.09)     0.0000 (1.0)           0;0  1.7766 (0.92)          1           1
test_checkout_hardlink-checkout[main]       533.5220 (1.03)     533.5220 (1.03)     533.5220 (1.03)     0.0000 (1.0)      533.5220 (1.03)     0.0000 (1.0)           0;0  1.8743 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     374.6343 (1.0)      374.6343 (1.0)      374.6343 (1.0)      0.0000 (1.0)      374.6343 (1.0)      0.0000 (1.0)           0;0  2.6693 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     385.9258 (1.03)     385.9258 (1.03)     385.9258 (1.03)     0.0000 (1.0)      385.9258 (1.03)     0.0000 (1.0)           0;0  2.5912 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       389.1293 (1.04)     389.1293 (1.04)     389.1293 (1.04)     0.0000 (1.0)      389.1293 (1.04)     0.0000 (1.0)           0;0  2.5698 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     413.3495 (1.0)      413.3495 (1.0)      413.3495 (1.0)      0.0000 (1.0)      413.3495 (1.0)      0.0000 (1.0)           0;0  2.4193 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     424.0023 (1.03)     424.0023 (1.03)     424.0023 (1.03)     0.0000 (1.0)      424.0023 (1.03)     0.0000 (1.0)           0;0  2.3585 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       433.5334 (1.05)     433.5334 (1.05)     433.5334 (1.05)     0.0000 (1.0)      433.5334 (1.05)     0.0000 (1.0)           0;0  2.3066 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     501.4435 (1.0)      501.4435 (1.0)      501.4435 (1.0)      0.0000 (1.0)      501.4435 (1.0)      0.0000 (1.0)           0;0  1.9942 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     531.4707 (1.06)     531.4707 (1.06)     531.4707 (1.06)     0.0000 (1.0)      531.4707 (1.06)     0.0000 (1.0)           0;0  1.8816 (0.94)          1           1
test_checkout_symlink-checkout[main]       524.3175 (1.05)     524.3175 (1.05)     524.3175 (1.05)     0.0000 (1.0)      524.3175 (1.05)     0.0000 (1.0)           0;0  1.9072 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     363.4165 (1.0)      363.4165 (1.0)      363.4165 (1.0)      0.0000 (1.0)      363.4165 (1.0)      0.0000 (1.0)           0;0  2.7517 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     377.1134 (1.04)     377.1134 (1.04)     377.1134 (1.04)     0.0000 (1.0)      377.1134 (1.04)     0.0000 (1.0)           0;0  2.6517 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       380.7030 (1.05)     380.7030 (1.05)     380.7030 (1.05)     0.0000 (1.0)      380.7030 (1.05)     0.0000 (1.0)           0;0  2.6267 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     402.4884 (1.0)      402.4884 (1.0)      402.4884 (1.0)      0.0000 (1.0)      402.4884 (1.0)      0.0000 (1.0)           0;0  2.4845 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     415.9493 (1.03)     415.9493 (1.03)     415.9493 (1.03)     0.0000 (1.0)      415.9493 (1.03)     0.0000 (1.0)           0;0  2.4041 (0.97)          1           1
test_checkout_symlink-checkout-update[main]       419.5187 (1.04)     419.5187 (1.04)     419.5187 (1.04)     0.0000 (1.0)      419.5187 (1.04)     0.0000 (1.0)           0;0  2.3837 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     477.4864 (1.10)     477.4864 (1.10)     477.4864 (1.10)     0.0000 (1.0)      477.4864 (1.10)     0.0000 (1.0)           0;0  2.0943 (0.91)          1           1
test_data_status-data-changed[3.10.0]     433.1631 (1.0)      433.1631 (1.0)      433.1631 (1.0)      0.0000 (1.0)      433.1631 (1.0)      0.0000 (1.0)           0;0  2.3086 (1.0)           1           1
test_data_status-data-changed[main]       446.2827 (1.03)     446.2827 (1.03)     446.2827 (1.03)     0.0000 (1.0)      446.2827 (1.03)     0.0000 (1.0)           0;0  2.2407 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     487.4177 (1.12)     487.4177 (1.12)     487.4177 (1.12)     0.0000 (1.0)      487.4177 (1.12)     0.0000 (1.0)           0;0  2.0516 (0.89)          1           1
test_data_status-data-changed-noop[3.10.0]     434.9873 (1.0)      434.9873 (1.0)      434.9873 (1.0)      0.0000 (1.0)      434.9873 (1.0)      0.0000 (1.0)           0;0  2.2989 (1.0)           1           1
test_data_status-data-changed-noop[main]       436.7867 (1.00)     436.7867 (1.00)     436.7867 (1.00)     0.0000 (1.0)      436.7867 (1.00)     0.0000 (1.0)           0;0  2.2894 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     524.1013 (1.06)     524.1013 (1.06)     524.1013 (1.06)     0.0000 (1.0)      524.1013 (1.06)     0.0000 (1.0)           0;0  1.9080 (0.95)          1           1
test_data_status-data-new[3.10.0]     499.6306 (1.01)     499.6306 (1.01)     499.6306 (1.01)     0.0000 (1.0)      499.6306 (1.01)     0.0000 (1.0)           0;0  2.0015 (0.99)          1           1
test_data_status-data-new[main]       496.3247 (1.0)      496.3247 (1.0)      496.3247 (1.0)      0.0000 (1.0)      496.3247 (1.0)      0.0000 (1.0)           0;0  2.0148 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     474.3674 (1.11)     474.3674 (1.11)     474.3674 (1.11)     0.0000 (1.0)      474.3674 (1.11)     0.0000 (1.0)           0;0  2.1081 (0.90)          1           1
test_data_status-data-noop[3.10.0]     428.1864 (1.0)      428.1864 (1.0)      428.1864 (1.0)      0.0000 (1.0)      428.1864 (1.0)      0.0000 (1.0)           0;0  2.3354 (1.0)           1           1
test_data_status-data-noop[main]       451.2016 (1.05)     451.2016 (1.05)     451.2016 (1.05)     0.0000 (1.0)      451.2016 (1.05)     0.0000 (1.0)           0;0  2.2163 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     478.9468 (1.05)     478.9468 (1.05)     478.9468 (1.05)     0.0000 (1.0)      478.9468 (1.05)     0.0000 (1.0)           0;0  2.0879 (0.96)          1           1
test_data_status_all_flags-data-changed[3.10.0]     457.5739 (1.0)      457.5739 (1.0)      457.5739 (1.0)      0.0000 (1.0)      457.5739 (1.0)      0.0000 (1.0)           0;0  2.1854 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       462.2720 (1.01)     462.2720 (1.01)     462.2720 (1.01)     0.0000 (1.0)      462.2720 (1.01)     0.0000 (1.0)           0;0  2.1632 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     472.1783 (1.03)     472.1783 (1.03)     472.1783 (1.03)     0.0000 (1.0)      472.1783 (1.03)     0.0000 (1.0)           0;0  2.1178 (0.97)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     482.6701 (1.05)     482.6701 (1.05)     482.6701 (1.05)     0.0000 (1.0)      482.6701 (1.05)     0.0000 (1.0)           0;0  2.0718 (0.95)          1           1
test_data_status_all_flags-data-changed-noop[main]       458.9339 (1.0)      458.9339 (1.0)      458.9339 (1.0)      0.0000 (1.0)      458.9339 (1.0)      0.0000 (1.0)           0;0  2.1790 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     553.0667 (1.07)     553.0667 (1.07)     553.0667 (1.07)     0.0000 (1.0)      553.0667 (1.07)     0.0000 (1.0)           0;0  1.8081 (0.94)          1           1
test_data_status_all_flags-data-new[3.10.0]     519.9128 (1.00)     519.9128 (1.00)     519.9128 (1.00)     0.0000 (1.0)      519.9128 (1.00)     0.0000 (1.0)           0;0  1.9234 (1.00)          1           1
test_data_status_all_flags-data-new[main]       517.7254 (1.0)      517.7254 (1.0)      517.7254 (1.0)      0.0000 (1.0)      517.7254 (1.0)      0.0000 (1.0)           0;0  1.9315 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     479.7363 (1.06)     479.7363 (1.06)     479.7363 (1.06)     0.0000 (1.0)      479.7363 (1.06)     0.0000 (1.0)           0;0  2.0845 (0.94)          1           1
test_data_status_all_flags-data-noop[3.10.0]     456.8018 (1.01)     456.8018 (1.01)     456.8018 (1.01)     0.0000 (1.0)      456.8018 (1.01)     0.0000 (1.0)           0;0  2.1891 (0.99)          1           1
test_data_status_all_flags-data-noop[main]       452.0298 (1.0)      452.0298 (1.0)      452.0298 (1.0)      0.0000 (1.0)      452.0298 (1.0)      0.0000 (1.0)           0;0  2.2122 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     506.2711 (1.02)     506.2711 (1.02)     506.2711 (1.02)     0.0000 (1.0)      506.2711 (1.02)     0.0000 (1.0)           0;0  1.9752 (0.98)          1           1
test_diff-diff[3.10.0]     496.9961 (1.0)      496.9961 (1.0)      496.9961 (1.0)      0.0000 (1.0)      496.9961 (1.0)      0.0000 (1.0)           0;0  2.0121 (1.0)           1           1
test_diff-diff[main]       502.3312 (1.01)     502.3312 (1.01)     502.3312 (1.01)     0.0000 (1.0)      502.3312 (1.01)     0.0000 (1.0)           0;0  1.9907 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     463.7783 (1.01)     463.7783 (1.01)     463.7783 (1.01)     0.0000 (1.0)      463.7783 (1.01)     0.0000 (1.0)           0;0  2.1562 (0.99)          1           1
test_diff-diff-changed[3.10.0]     465.4910 (1.01)     465.4910 (1.01)     465.4910 (1.01)     0.0000 (1.0)      465.4910 (1.01)     0.0000 (1.0)           0;0  2.1483 (0.99)          1           1
test_diff-diff-changed[main]       458.8427 (1.0)      458.8427 (1.0)      458.8427 (1.0)      0.0000 (1.0)      458.8427 (1.0)      0.0000 (1.0)           0;0  2.1794 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     454.5767 (1.00)     454.5767 (1.00)     454.5767 (1.00)     0.0000 (1.0)      454.5767 (1.00)     0.0000 (1.0)           0;0  2.1998 (1.00)          1           1
test_diff-diff-changed-noop[3.10.0]     453.7895 (1.0)      453.7895 (1.0)      453.7895 (1.0)      0.0000 (1.0)      453.7895 (1.0)      0.0000 (1.0)           0;0  2.2037 (1.0)           1           1
test_diff-diff-changed-noop[main]       456.8470 (1.01)     456.8470 (1.01)     456.8470 (1.01)     0.0000 (1.0)      456.8470 (1.01)     0.0000 (1.0)           0;0  2.1889 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     449.5383 (1.01)     449.5383 (1.01)     449.5383 (1.01)     0.0000 (1.0)      449.5383 (1.01)     0.0000 (1.0)           0;0  2.2245 (0.99)          1           1
test_diff-diff-noop[3.10.0]     444.3972 (1.0)      444.3972 (1.0)      444.3972 (1.0)      0.0000 (1.0)      444.3972 (1.0)      0.0000 (1.0)           0;0  2.2502 (1.0)           1           1
test_diff-diff-noop[main]       453.6099 (1.02)     453.6099 (1.02)     453.6099 (1.02)     0.0000 (1.0)      453.6099 (1.02)     0.0000 (1.0)           0;0  2.2045 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms)                     Min                    Max                   Mean            StdDev                 Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]        849.0491 (1.0)         849.0491 (1.0)         849.0491 (1.0)      0.0000 (1.0)         849.0491 (1.0)      0.0000 (1.0)           0;0  1.1778 (1.0)           1           1
test_exp_show-exp[3.10.0]     14,155.8935 (16.67)    14,155.8935 (16.67)    14,155.8935 (16.67)    0.0000 (1.0)      14,155.8935 (16.67)    0.0000 (1.0)           0;0  0.0706 (0.06)          1           1
test_exp_show-exp[main]       11,941.5831 (14.06)    11,941.5831 (14.06)    11,941.5831 (14.06)    0.0000 (1.0)      11,941.5831 (14.06)    0.0000 (1.0)           0;0  0.0837 (0.07)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     456.1583 (1.0)      456.1583 (1.0)      456.1583 (1.0)      0.0000 (1.0)      456.1583 (1.0)      0.0000 (1.0)           0;0  2.1922 (1.0)           1           1
test_fetch-fetch[3.10.0]     494.5654 (1.08)     494.5654 (1.08)     494.5654 (1.08)     0.0000 (1.0)      494.5654 (1.08)     0.0000 (1.0)           0;0  2.0220 (0.92)          1           1
test_fetch-fetch[main]       487.0874 (1.07)     487.0874 (1.07)     487.0874 (1.07)     0.0000 (1.0)      487.0874 (1.07)     0.0000 (1.0)           0;0  2.0530 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     359.9015 (1.0)      359.9015 (1.0)      359.9015 (1.0)      0.0000 (1.0)      359.9015 (1.0)      0.0000 (1.0)           0;0  2.7785 (1.0)           1           1
test_gc-gc[3.10.0]     369.7321 (1.03)     369.7321 (1.03)     369.7321 (1.03)     0.0000 (1.0)      369.7321 (1.03)     0.0000 (1.0)           0;0  2.7047 (0.97)          1           1
test_gc-gc[main]       367.9781 (1.02)     367.9781 (1.02)     367.9781 (1.02)     0.0000 (1.0)      367.9781 (1.02)     0.0000 (1.0)           0;0  2.7176 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     491.9756 (1.0)      491.9756 (1.0)      491.9756 (1.0)      0.0000 (1.0)      491.9756 (1.0)      0.0000 (1.0)           0;0  2.0326 (1.0)           1           1
test_get-get[3.10.0]     504.2622 (1.02)     504.2622 (1.02)     504.2622 (1.02)     0.0000 (1.0)      504.2622 (1.02)     0.0000 (1.0)           0;0  1.9831 (0.98)          1           1
test_get-get[main]       547.2414 (1.11)     547.2414 (1.11)     547.2414 (1.11)     0.0000 (1.0)      547.2414 (1.11)     0.0000 (1.0)           0;0  1.8273 (0.90)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     333.0287 (1.0)      333.0287 (1.0)      333.0287 (1.0)      0.0000 (1.0)      333.0287 (1.0)      0.0000 (1.0)           0;0  3.0027 (1.0)           1           1
test_get_url-get-url[3.10.0]     374.4021 (1.12)     374.4021 (1.12)     374.4021 (1.12)     0.0000 (1.0)      374.4021 (1.12)     0.0000 (1.0)           0;0  2.6709 (0.89)          1           1
test_get_url-get-url[main]       351.8493 (1.06)     351.8493 (1.06)     351.8493 (1.06)     0.0000 (1.0)      351.8493 (1.06)     0.0000 (1.0)           0;0  2.8421 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     126.0764 (1.02)     133.0578 (1.00)     128.8736 (1.02)     1.3676 (1.0)      128.9184 (1.02)     1.8317 (1.29)         27;2  7.7595 (0.98)        100           1
test_help---help[3.10.0]     124.0997 (1.0)      133.0019 (1.0)      126.7801 (1.0)      1.4912 (1.09)     126.4881 (1.0)      1.4163 (1.0)          20;6  7.8877 (1.0)         100           1
test_help---help[main]       124.8533 (1.01)     139.0070 (1.05)     127.4393 (1.01)     2.4639 (1.80)     126.9080 (1.00)     1.5352 (1.08)         12;7  7.8469 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     713.9777 (1.0)      713.9777 (1.0)      713.9777 (1.0)      0.0000 (1.0)      713.9777 (1.0)      0.0000 (1.0)           0;0  1.4006 (1.0)           1           1
test_import-import[3.10.0]     721.8191 (1.01)     721.8191 (1.01)     721.8191 (1.01)     0.0000 (1.0)      721.8191 (1.01)     0.0000 (1.0)           0;0  1.3854 (0.99)          1           1
test_import-import[main]       757.3974 (1.06)     757.3974 (1.06)     757.3974 (1.06)     0.0000 (1.0)      757.3974 (1.06)     0.0000 (1.0)           0;0  1.3203 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     621.9162 (1.01)     621.9162 (1.01)     621.9162 (1.01)     0.0000 (1.0)      621.9162 (1.01)     0.0000 (1.0)           0;0  1.6079 (0.99)          1           1
test_import_url-import-url[3.10.0]     634.9357 (1.03)     634.9357 (1.03)     634.9357 (1.03)     0.0000 (1.0)      634.9357 (1.03)     0.0000 (1.0)           0;0  1.5750 (0.97)          1           1
test_import_url-import-url[main]       613.5223 (1.0)      613.5223 (1.0)      613.5223 (1.0)      0.0000 (1.0)      613.5223 (1.0)      0.0000 (1.0)           0;0  1.6299 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     368.6903 (1.0)      424.7247 (1.01)     390.6065 (1.00)      9.5917 (1.22)     389.3194 (1.00)      8.3139 (1.0)          19;9  2.5601 (1.00)        100           1
test_init-init[3.10.0]     373.7267 (1.01)     435.6568 (1.04)     390.3620 (1.00)     10.9787 (1.40)     387.9870 (1.0)      10.3257 (1.24)         26;6  2.5617 (1.00)        100           1
test_init-init[main]       379.7888 (1.03)     420.8403 (1.0)      390.0976 (1.0)       7.8613 (1.0)      388.3090 (1.00)      9.0853 (1.09)         24;3  2.5635 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     411.8830 (1.01)     411.8830 (1.01)     411.8830 (1.01)     0.0000 (1.0)      411.8830 (1.01)     0.0000 (1.0)           0;0  2.4279 (0.99)          1           1
test_list-list[3.10.0]     412.4246 (1.01)     412.4246 (1.01)     412.4246 (1.01)     0.0000 (1.0)      412.4246 (1.01)     0.0000 (1.0)           0;0  2.4247 (0.99)          1           1
test_list-list[main]       406.9569 (1.0)      406.9569 (1.0)      406.9569 (1.0)      0.0000 (1.0)      406.9569 (1.0)      0.0000 (1.0)           0;0  2.4573 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     398.3697 (1.01)     398.3697 (1.01)     398.3697 (1.01)     0.0000 (1.0)      398.3697 (1.01)     0.0000 (1.0)           0;0  2.5102 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     397.1271 (1.01)     397.1271 (1.01)     397.1271 (1.01)     0.0000 (1.0)      397.1271 (1.01)     0.0000 (1.0)           0;0  2.5181 (0.99)          1           1
test_list-list-dvc-only[main]       394.8783 (1.0)      394.8783 (1.0)      394.8783 (1.0)      0.0000 (1.0)      394.8783 (1.0)      0.0000 (1.0)           0;0  2.5324 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     409.2995 (1.01)     409.2995 (1.01)     409.2995 (1.01)     0.0000 (1.0)      409.2995 (1.01)     0.0000 (1.0)           0;0  2.4432 (0.99)          1           1
test_list-list-recursive[3.10.0]     405.9602 (1.0)      405.9602 (1.0)      405.9602 (1.0)      0.0000 (1.0)      405.9602 (1.0)      0.0000 (1.0)           0;0  2.4633 (1.0)           1           1
test_list-list-recursive[main]       408.8866 (1.01)     408.8866 (1.01)     408.8866 (1.01)     0.0000 (1.0)      408.8866 (1.01)     0.0000 (1.0)           0;0  2.4457 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     400.4702 (1.02)     400.4702 (1.02)     400.4702 (1.02)     0.0000 (1.0)      400.4702 (1.02)     0.0000 (1.0)           0;0  2.4971 (0.98)          1           1
test_list-list-shallow[3.10.0]     394.5655 (1.00)     394.5655 (1.00)     394.5655 (1.00)     0.0000 (1.0)      394.5655 (1.00)     0.0000 (1.0)           0;0  2.5344 (1.00)          1           1
test_list-list-shallow[main]       394.0859 (1.0)      394.0859 (1.0)      394.0859 (1.0)      0.0000 (1.0)      394.0859 (1.0)      0.0000 (1.0)           0;0  2.5375 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     535.2614 (1.00)     535.2614 (1.00)     535.2614 (1.00)     0.0000 (1.0)      535.2614 (1.00)     0.0000 (1.0)           0;0  1.8682 (1.00)          1           1
test_partial_add-add[3.10.0]     551.6707 (1.03)     551.6707 (1.03)     551.6707 (1.03)     0.0000 (1.0)      551.6707 (1.03)     0.0000 (1.0)           0;0  1.8127 (0.97)          1           1
test_partial_add-add[main]       535.1304 (1.0)      535.1304 (1.0)      535.1304 (1.0)      0.0000 (1.0)      535.1304 (1.0)      0.0000 (1.0)           0;0  1.8687 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     569.0703 (1.00)     569.0703 (1.00)     569.0703 (1.00)     0.0000 (1.0)      569.0703 (1.00)     0.0000 (1.0)           0;0  1.7573 (1.00)          1           1
test_partial_add-add-partial[3.10.0]     574.6621 (1.01)     574.6621 (1.01)     574.6621 (1.01)     0.0000 (1.0)      574.6621 (1.01)     0.0000 (1.0)           0;0  1.7402 (0.99)          1           1
test_partial_add-add-partial[main]       568.8509 (1.0)      568.8509 (1.0)      568.8509 (1.0)      0.0000 (1.0)      568.8509 (1.0)      0.0000 (1.0)           0;0  1.7579 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     388.5678 (1.01)     388.5678 (1.01)     388.5678 (1.01)     0.0000 (1.0)      388.5678 (1.01)     0.0000 (1.0)           0;0  2.5736 (0.99)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     383.1989 (1.0)      383.1989 (1.0)      383.1989 (1.0)      0.0000 (1.0)      383.1989 (1.0)      0.0000 (1.0)           0;0  2.6096 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       384.2823 (1.00)     384.2823 (1.00)     384.2823 (1.00)     0.0000 (1.0)      384.2823 (1.00)     0.0000 (1.0)           0;0  2.6023 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     362.8671 (1.0)      362.8671 (1.0)      362.8671 (1.0)      0.0000 (1.0)      362.8671 (1.0)      0.0000 (1.0)           0;0  2.7558 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     372.4006 (1.03)     372.4006 (1.03)     372.4006 (1.03)     0.0000 (1.0)      372.4006 (1.03)     0.0000 (1.0)           0;0  2.6853 (0.97)          1           1
test_partial_add-gc-noop[main]       376.8668 (1.04)     376.8668 (1.04)     376.8668 (1.04)     0.0000 (1.0)      376.8668 (1.04)     0.0000 (1.0)           0;0  2.6535 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     413.1355 (1.02)     413.1355 (1.02)     413.1355 (1.02)     0.0000 (1.0)      413.1355 (1.02)     0.0000 (1.0)           0;0  2.4205 (0.98)          1           1
test_partial_add-push[3.10.0]     404.9696 (1.0)      404.9696 (1.0)      404.9696 (1.0)      0.0000 (1.0)      404.9696 (1.0)      0.0000 (1.0)           0;0  2.4693 (1.0)           1           1
test_partial_add-push[main]       433.2434 (1.07)     433.2434 (1.07)     433.2434 (1.07)     0.0000 (1.0)      433.2434 (1.07)     0.0000 (1.0)           0;0  2.3082 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     418.4730 (1.03)     418.4730 (1.03)     418.4730 (1.03)     0.0000 (1.0)      418.4730 (1.03)     0.0000 (1.0)           0;0  2.3896 (0.97)          1           1
test_partial_add-push-partial[3.10.0]     407.5611 (1.0)      407.5611 (1.0)      407.5611 (1.0)      0.0000 (1.0)      407.5611 (1.0)      0.0000 (1.0)           0;0  2.4536 (1.0)           1           1
test_partial_add-push-partial[main]       447.7469 (1.10)     447.7469 (1.10)     447.7469 (1.10)     0.0000 (1.0)      447.7469 (1.10)     0.0000 (1.0)           0;0  2.2334 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     593.1462 (1.01)     593.1462 (1.01)     593.1462 (1.01)     0.0000 (1.0)      593.1462 (1.01)     0.0000 (1.0)           0;0  1.6859 (0.99)          1           1
test_partial_remove-add[3.10.0]     614.6553 (1.05)     614.6553 (1.05)     614.6553 (1.05)     0.0000 (1.0)      614.6553 (1.05)     0.0000 (1.0)           0;0  1.6269 (0.96)          1           1
test_partial_remove-add[main]       587.0026 (1.0)      587.0026 (1.0)      587.0026 (1.0)      0.0000 (1.0)      587.0026 (1.0)      0.0000 (1.0)           0;0  1.7036 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     531.6136 (1.0)      531.6136 (1.0)      531.6136 (1.0)      0.0000 (1.0)      531.6136 (1.0)      0.0000 (1.0)           0;0  1.8811 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     573.5959 (1.08)     573.5959 (1.08)     573.5959 (1.08)     0.0000 (1.0)      573.5959 (1.08)     0.0000 (1.0)           0;0  1.7434 (0.93)          1           1
test_partial_remove-add-update[main]       535.2978 (1.01)     535.2978 (1.01)     535.2978 (1.01)     0.0000 (1.0)      535.2978 (1.01)     0.0000 (1.0)           0;0  1.8681 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     370.3127 (1.0)      370.3127 (1.0)      370.3127 (1.0)      0.0000 (1.0)      370.3127 (1.0)      0.0000 (1.0)           0;0  2.7004 (1.0)           1           1
test_partial_remove-gc[3.10.0]     394.5124 (1.07)     394.5124 (1.07)     394.5124 (1.07)     0.0000 (1.0)      394.5124 (1.07)     0.0000 (1.0)           0;0  2.5348 (0.94)          1           1
test_partial_remove-gc[main]       377.8429 (1.02)     377.8429 (1.02)     377.8429 (1.02)     0.0000 (1.0)      377.8429 (1.02)     0.0000 (1.0)           0;0  2.6466 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     393.8173 (1.02)     393.8173 (1.02)     393.8173 (1.02)     0.0000 (1.0)      393.8173 (1.02)     0.0000 (1.0)           0;0  2.5392 (0.98)          1           1
test_partial_remove-gc-cloud[3.10.0]     386.3781 (1.0)      386.3781 (1.0)      386.3781 (1.0)      0.0000 (1.0)      386.3781 (1.0)      0.0000 (1.0)           0;0  2.5881 (1.0)           1           1
test_partial_remove-gc-cloud[main]       393.4015 (1.02)     393.4015 (1.02)     393.4015 (1.02)     0.0000 (1.0)      393.4015 (1.02)     0.0000 (1.0)           0;0  2.5419 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     446.7644 (1.03)     446.7644 (1.03)     446.7644 (1.03)     0.0000 (1.0)      446.7644 (1.03)     0.0000 (1.0)           0;0  2.2383 (0.97)          1           1
test_partial_remove-push[3.10.0]     434.3408 (1.0)      434.3408 (1.0)      434.3408 (1.0)      0.0000 (1.0)      434.3408 (1.0)      0.0000 (1.0)           0;0  2.3023 (1.0)           1           1
test_partial_remove-push[main]       456.7930 (1.05)     456.7930 (1.05)     456.7930 (1.05)     0.0000 (1.0)      456.7930 (1.05)     0.0000 (1.0)           0;0  2.1892 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     392.5576 (1.00)     392.5576 (1.00)     392.5576 (1.00)     0.0000 (1.0)      392.5576 (1.00)     0.0000 (1.0)           0;0  2.5474 (1.00)          1           1
test_partial_remove-push-update[3.10.0]     391.3975 (1.0)      391.3975 (1.0)      391.3975 (1.0)      0.0000 (1.0)      391.3975 (1.0)      0.0000 (1.0)           0;0  2.5549 (1.0)           1           1
test_partial_remove-push-update[main]       419.1708 (1.07)     419.1708 (1.07)     419.1708 (1.07)     0.0000 (1.0)      419.1708 (1.07)     0.0000 (1.0)           0;0  2.3857 (0.93)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     424.9282 (1.0)      435.0329 (1.0)      427.5963 (1.0)       4.2203 (1.09)     425.6709 (1.0)       3.6249 (1.0)           1;1  2.3387 (1.0)           5           3
test_plots-plots-diff[3.10.0]     774.2206 (1.82)     798.6629 (1.84)     782.2666 (1.83)     10.3030 (2.66)     777.2050 (1.83)     14.3267 (3.95)          1;0  1.2783 (0.55)          5           3
test_plots-plots-diff[main]       739.5816 (1.74)     748.7401 (1.72)     743.2468 (1.74)      3.8687 (1.0)      742.0063 (1.74)      6.3351 (1.75)          1;0  1.3454 (0.58)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       432.0922 (1.0)        435.5779 (1.0)        433.6566 (1.0)      1.3854 (1.0)        433.2469 (1.0)      2.1124 (1.01)          2;0  2.3060 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,024.4162 (2.37)     1,030.9218 (2.37)     1,028.6000 (2.37)     2.4622 (1.78)     1,029.1995 (2.38)     2.0992 (1.0)           1;1  0.9722 (0.42)          5           3
test_plots-plots-diff-json[main]         827.1399 (1.91)       845.1663 (1.94)       834.4588 (1.92)     6.8471 (4.94)       834.1392 (1.93)     8.5456 (4.07)          2;0  1.1984 (0.52)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     389.8911 (1.0)      391.5200 (1.0)      390.7314 (1.0)      0.7334 (1.0)      391.1181 (1.0)      1.2410 (1.0)           2;0  2.5593 (1.0)           5           3
test_plots-plots-show[3.10.0]     638.3731 (1.64)     640.1903 (1.64)     639.2882 (1.64)     0.7462 (1.02)     639.2836 (1.63)     1.2592 (1.01)          2;0  1.5642 (0.61)          5           3
test_plots-plots-show[main]       634.1191 (1.63)     638.4215 (1.63)     635.8166 (1.63)     1.6225 (2.21)     635.2866 (1.62)     1.8340 (1.48)          2;0  1.5728 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     404.7086 (1.0)      412.6690 (1.0)      408.3004 (1.0)      3.0262 (1.26)     408.2028 (1.0)       4.2165 (1.02)          2;0  2.4492 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     787.3427 (1.95)     805.8483 (1.95)     798.1026 (1.95)     7.4890 (3.11)     799.0753 (1.96)     11.7838 (2.85)          2;0  1.2530 (0.51)          5           3
test_plots-plots-show-json[main]       679.8881 (1.68)     685.5618 (1.66)     683.1092 (1.67)     2.4060 (1.0)      683.2758 (1.67)      4.1341 (1.0)           2;0  1.4639 (0.60)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     453.0776 (1.04)     453.0776 (1.04)     453.0776 (1.04)     0.0000 (1.0)      453.0776 (1.04)     0.0000 (1.0)           0;0  2.2071 (0.96)          1           1
test_push-push[3.10.0]     436.0612 (1.0)      436.0612 (1.0)      436.0612 (1.0)      0.0000 (1.0)      436.0612 (1.0)      0.0000 (1.0)           0;0  2.2933 (1.0)           1           1
test_push-push[main]       455.3152 (1.04)     455.3152 (1.04)     455.3152 (1.04)     0.0000 (1.0)      455.3152 (1.04)     0.0000 (1.0)           0;0  2.1963 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     630.5217 (1.08)     630.5217 (1.08)     630.5217 (1.08)     0.0000 (1.0)      630.5217 (1.08)     0.0000 (1.0)           0;0  1.5860 (0.93)          1           1
test_sharing-add[3.10.0]     626.5581 (1.07)     626.5581 (1.07)     626.5581 (1.07)     0.0000 (1.0)      626.5581 (1.07)     0.0000 (1.0)           0;0  1.5960 (0.93)          1           1
test_sharing-add[main]       583.9670 (1.0)      583.9670 (1.0)      583.9670 (1.0)      0.0000 (1.0)      583.9670 (1.0)      0.0000 (1.0)           0;0  1.7124 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     574.9447 (1.07)     574.9447 (1.07)     574.9447 (1.07)     0.0000 (1.0)      574.9447 (1.07)     0.0000 (1.0)           0;0  1.7393 (0.93)          1           1
test_sharing-add-noop[3.10.0]     656.5473 (1.23)     656.5473 (1.23)     656.5473 (1.23)     0.0000 (1.0)      656.5473 (1.23)     0.0000 (1.0)           0;0  1.5231 (0.81)          1           1
test_sharing-add-noop[main]       534.9447 (1.0)      534.9447 (1.0)      534.9447 (1.0)      0.0000 (1.0)      534.9447 (1.0)      0.0000 (1.0)           0;0  1.8694 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     477.6544 (1.08)     477.6544 (1.08)     477.6544 (1.08)     0.0000 (1.0)      477.6544 (1.08)     0.0000 (1.0)           0;0  2.0936 (0.93)          1           1
test_sharing-checkout[3.10.0]     486.5283 (1.10)     486.5283 (1.10)     486.5283 (1.10)     0.0000 (1.0)      486.5283 (1.10)     0.0000 (1.0)           0;0  2.0554 (0.91)          1           1
test_sharing-checkout[main]       443.9030 (1.0)      443.9030 (1.0)      443.9030 (1.0)      0.0000 (1.0)      443.9030 (1.0)      0.0000 (1.0)           0;0  2.2527 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     398.9074 (1.04)     398.9074 (1.04)     398.9074 (1.04)     0.0000 (1.0)      398.9074 (1.04)     0.0000 (1.0)           0;0  2.5068 (0.97)          1           1
test_sharing-checkout-noop[3.10.0]     424.2929 (1.10)     424.2929 (1.10)     424.2929 (1.10)     0.0000 (1.0)      424.2929 (1.10)     0.0000 (1.0)           0;0  2.3569 (0.91)          1           1
test_sharing-checkout-noop[main]       385.2837 (1.0)      385.2837 (1.0)      385.2837 (1.0)      0.0000 (1.0)      385.2837 (1.0)      0.0000 (1.0)           0;0  2.5955 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     448.5666 (1.01)     448.5666 (1.01)     448.5666 (1.01)     0.0000 (1.0)      448.5666 (1.01)     0.0000 (1.0)           0;0  2.2293 (0.99)          1           1
test_sharing-fetch[3.10.0]     502.6056 (1.13)     502.6056 (1.13)     502.6056 (1.13)     0.0000 (1.0)      502.6056 (1.13)     0.0000 (1.0)           0;0  1.9896 (0.88)          1           1
test_sharing-fetch[main]       443.7686 (1.0)      443.7686 (1.0)      443.7686 (1.0)      0.0000 (1.0)      443.7686 (1.0)      0.0000 (1.0)           0;0  2.2534 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     402.1921 (1.03)     402.1921 (1.03)     402.1921 (1.03)     0.0000 (1.0)      402.1921 (1.03)     0.0000 (1.0)           0;0  2.4864 (0.97)          1           1
test_sharing-fetch-noop[3.10.0]     390.9645 (1.0)      390.9645 (1.0)      390.9645 (1.0)      0.0000 (1.0)      390.9645 (1.0)      0.0000 (1.0)           0;0  2.5578 (1.0)           1           1
test_sharing-fetch-noop[main]       409.4066 (1.05)     409.4066 (1.05)     409.4066 (1.05)     0.0000 (1.0)      409.4066 (1.05)     0.0000 (1.0)           0;0  2.4426 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     470.9722 (1.02)     470.9722 (1.02)     470.9722 (1.02)     0.0000 (1.0)      470.9722 (1.02)     0.0000 (1.0)           0;0  2.1233 (0.98)          1           1
test_sharing-push[3.10.0]     463.5200 (1.00)     463.5200 (1.00)     463.5200 (1.00)     0.0000 (1.0)      463.5200 (1.00)     0.0000 (1.0)           0;0  2.1574 (1.00)          1           1
test_sharing-push[main]       461.3502 (1.0)      461.3502 (1.0)      461.3502 (1.0)      0.0000 (1.0)      461.3502 (1.0)      0.0000 (1.0)           0;0  2.1676 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     403.4084 (1.0)      403.4084 (1.0)      403.4084 (1.0)      0.0000 (1.0)      403.4084 (1.0)      0.0000 (1.0)           0;0  2.4789 (1.0)           1           1
test_sharing-push-noop[3.10.0]     410.3271 (1.02)     410.3271 (1.02)     410.3271 (1.02)     0.0000 (1.0)      410.3271 (1.02)     0.0000 (1.0)           0;0  2.4371 (0.98)          1           1
test_sharing-push-noop[main]       410.6510 (1.02)     410.6510 (1.02)     410.6510 (1.02)     0.0000 (1.0)      410.6510 (1.02)     0.0000 (1.0)           0;0  2.4352 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     427.4062 (1.00)     427.4062 (1.00)     427.4062 (1.00)     0.0000 (1.0)      427.4062 (1.00)     0.0000 (1.0)           0;0  2.3397 (1.00)          1           1
test_status-status[3.10.0]     426.9036 (1.0)      426.9036 (1.0)      426.9036 (1.0)      0.0000 (1.0)      426.9036 (1.0)      0.0000 (1.0)           0;0  2.3424 (1.0)           1           1
test_status-status[main]       427.7065 (1.00)     427.7065 (1.00)     427.7065 (1.00)     0.0000 (1.0)      427.7065 (1.00)     0.0000 (1.0)           0;0  2.3381 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     370.9058 (1.0)      370.9058 (1.0)      370.9058 (1.0)      0.0000 (1.0)      370.9058 (1.0)      0.0000 (1.0)           0;0  2.6961 (1.0)           1           1
test_status-status-changed[3.10.0]     420.0585 (1.13)     420.0585 (1.13)     420.0585 (1.13)     0.0000 (1.0)      420.0585 (1.13)     0.0000 (1.0)           0;0  2.3806 (0.88)          1           1
test_status-status-changed[main]       390.8753 (1.05)     390.8753 (1.05)     390.8753 (1.05)     0.0000 (1.0)      390.8753 (1.05)     0.0000 (1.0)           0;0  2.5584 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     368.2179 (1.0)      368.2179 (1.0)      368.2179 (1.0)      0.0000 (1.0)      368.2179 (1.0)      0.0000 (1.0)           0;0  2.7158 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     394.2596 (1.07)     394.2596 (1.07)     394.2596 (1.07)     0.0000 (1.0)      394.2596 (1.07)     0.0000 (1.0)           0;0  2.5364 (0.93)          1           1
test_status-status-changed-noop[main]       389.8175 (1.06)     389.8175 (1.06)     389.8175 (1.06)     0.0000 (1.0)      389.8175 (1.06)     0.0000 (1.0)           0;0  2.5653 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     372.7247 (1.0)      372.7247 (1.0)      372.7247 (1.0)      0.0000 (1.0)      372.7247 (1.0)      0.0000 (1.0)           0;0  2.6829 (1.0)           1           1
test_status-status-noop[3.10.0]     383.1948 (1.03)     383.1948 (1.03)     383.1948 (1.03)     0.0000 (1.0)      383.1948 (1.03)     0.0000 (1.0)           0;0  2.6096 (0.97)          1           1
test_status-status-noop[main]       392.8640 (1.05)     392.8640 (1.05)     392.8640 (1.05)     0.0000 (1.0)      392.8640 (1.05)     0.0000 (1.0)           0;0  2.5454 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     630.2007 (1.02)     630.2007 (1.02)     630.2007 (1.02)     0.0000 (1.0)      630.2007 (1.02)     0.0000 (1.0)           0;0  1.5868 (0.98)          1           1
test_update-import-url[3.10.0]     639.5749 (1.04)     639.5749 (1.04)     639.5749 (1.04)     0.0000 (1.0)      639.5749 (1.04)     0.0000 (1.0)           0;0  1.5635 (0.96)          1           1
test_update-import-url[main]       616.3945 (1.0)      616.3945 (1.0)      616.3945 (1.0)      0.0000 (1.0)      616.3945 (1.0)      0.0000 (1.0)           0;0  1.6223 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     520.0887 (1.03)     520.0887 (1.03)     520.0887 (1.03)     0.0000 (1.0)      520.0887 (1.03)     0.0000 (1.0)           0;0  1.9227 (0.98)          1           1
test_update-update[3.10.0]     526.6444 (1.04)     526.6444 (1.04)     526.6444 (1.04)     0.0000 (1.0)      526.6444 (1.04)     0.0000 (1.0)           0;0  1.8988 (0.96)          1           1
test_update-update[main]       507.2359 (1.0)      507.2359 (1.0)      507.2359 (1.0)      0.0000 (1.0)      507.2359 (1.0)      0.0000 (1.0)           0;0  1.9715 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     383.2330 (1.0)      383.2330 (1.0)      383.2330 (1.0)      0.0000 (1.0)      383.2330 (1.0)      0.0000 (1.0)           0;0  2.6094 (1.0)           1           1
test_update-update-noop[3.10.0]     415.0504 (1.08)     415.0504 (1.08)     415.0504 (1.08)     0.0000 (1.0)      415.0504 (1.08)     0.0000 (1.0)           0;0  2.4093 (0.92)          1           1
test_update-update-noop[main]       402.4485 (1.05)     402.4485 (1.05)     402.4485 (1.05)     0.0000 (1.0)      402.4485 (1.05)     0.0000 (1.0)           0;0  2.4848 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean