Sat Dec  9 00:39:48 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     602.3017 (1.0)      602.3017 (1.0)      602.3017 (1.0)      0.0000 (1.0)      602.3017 (1.0)      0.0000 (1.0)           0;0  1.6603 (1.0)           1           1
test_add-add[3.10.0]     635.3626 (1.05)     635.3626 (1.05)     635.3626 (1.05)     0.0000 (1.0)      635.3626 (1.05)     0.0000 (1.0)           0;0  1.5739 (0.95)          1           1
test_add-add[main]       638.8697 (1.06)     638.8697 (1.06)     638.8697 (1.06)     0.0000 (1.0)      638.8697 (1.06)     0.0000 (1.0)           0;0  1.5653 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     551.0747 (1.0)      551.0747 (1.0)      551.0747 (1.0)      0.0000 (1.0)      551.0747 (1.0)      0.0000 (1.0)           0;0  1.8146 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     569.4164 (1.03)     569.4164 (1.03)     569.4164 (1.03)     0.0000 (1.0)      569.4164 (1.03)     0.0000 (1.0)           0;0  1.7562 (0.97)          1           1
test_checkout_copy-checkout[main]       559.5852 (1.02)     559.5852 (1.02)     559.5852 (1.02)     0.0000 (1.0)      559.5852 (1.02)     0.0000 (1.0)           0;0  1.7870 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     377.3917 (1.0)      377.3917 (1.0)      377.3917 (1.0)      0.0000 (1.0)      377.3917 (1.0)      0.0000 (1.0)           0;0  2.6498 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     392.5610 (1.04)     392.5610 (1.04)     392.5610 (1.04)     0.0000 (1.0)      392.5610 (1.04)     0.0000 (1.0)           0;0  2.5474 (0.96)          1           1
test_checkout_copy-checkout-noop[main]       392.4837 (1.04)     392.4837 (1.04)     392.4837 (1.04)     0.0000 (1.0)      392.4837 (1.04)     0.0000 (1.0)           0;0  2.5479 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     413.6524 (1.0)      413.6524 (1.0)      413.6524 (1.0)      0.0000 (1.0)      413.6524 (1.0)      0.0000 (1.0)           0;0  2.4175 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     427.3619 (1.03)     427.3619 (1.03)     427.3619 (1.03)     0.0000 (1.0)      427.3619 (1.03)     0.0000 (1.0)           0;0  2.3399 (0.97)          1           1
test_checkout_copy-checkout-update[main]       422.8541 (1.02)     422.8541 (1.02)     422.8541 (1.02)     0.0000 (1.0)      422.8541 (1.02)     0.0000 (1.0)           0;0  2.3649 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     522.3032 (1.0)      522.3032 (1.0)      522.3032 (1.0)      0.0000 (1.0)      522.3032 (1.0)      0.0000 (1.0)           0;0  1.9146 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     540.9667 (1.04)     540.9667 (1.04)     540.9667 (1.04)     0.0000 (1.0)      540.9667 (1.04)     0.0000 (1.0)           0;0  1.8485 (0.97)          1           1
test_checkout_hardlink-checkout[main]       537.8534 (1.03)     537.8534 (1.03)     537.8534 (1.03)     0.0000 (1.0)      537.8534 (1.03)     0.0000 (1.0)           0;0  1.8592 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     381.1993 (1.0)      381.1993 (1.0)      381.1993 (1.0)      0.0000 (1.0)      381.1993 (1.0)      0.0000 (1.0)           0;0  2.6233 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     390.7490 (1.03)     390.7490 (1.03)     390.7490 (1.03)     0.0000 (1.0)      390.7490 (1.03)     0.0000 (1.0)           0;0  2.5592 (0.98)          1           1
test_checkout_hardlink-checkout-noop[main]       393.0573 (1.03)     393.0573 (1.03)     393.0573 (1.03)     0.0000 (1.0)      393.0573 (1.03)     0.0000 (1.0)           0;0  2.5442 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     425.6163 (1.0)      425.6163 (1.0)      425.6163 (1.0)      0.0000 (1.0)      425.6163 (1.0)      0.0000 (1.0)           0;0  2.3495 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     425.7524 (1.00)     425.7524 (1.00)     425.7524 (1.00)     0.0000 (1.0)      425.7524 (1.00)     0.0000 (1.0)           0;0  2.3488 (1.00)          1           1
test_checkout_hardlink-checkout-update[main]       432.1068 (1.02)     432.1068 (1.02)     432.1068 (1.02)     0.0000 (1.0)      432.1068 (1.02)     0.0000 (1.0)           0;0  2.3142 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     568.9899 (1.07)     568.9899 (1.07)     568.9899 (1.07)     0.0000 (1.0)      568.9899 (1.07)     0.0000 (1.0)           0;0  1.7575 (0.93)          1           1
test_checkout_symlink-checkout[3.10.0]     632.7115 (1.19)     632.7115 (1.19)     632.7115 (1.19)     0.0000 (1.0)      632.7115 (1.19)     0.0000 (1.0)           0;0  1.5805 (0.84)          1           1
test_checkout_symlink-checkout[main]       531.0112 (1.0)      531.0112 (1.0)      531.0112 (1.0)      0.0000 (1.0)      531.0112 (1.0)      0.0000 (1.0)           0;0  1.8832 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     376.6161 (1.0)      376.6161 (1.0)      376.6161 (1.0)      0.0000 (1.0)      376.6161 (1.0)      0.0000 (1.0)           0;0  2.6552 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     424.2000 (1.13)     424.2000 (1.13)     424.2000 (1.13)     0.0000 (1.0)      424.2000 (1.13)     0.0000 (1.0)           0;0  2.3574 (0.89)          1           1
test_checkout_symlink-checkout-noop[main]       392.9968 (1.04)     392.9968 (1.04)     392.9968 (1.04)     0.0000 (1.0)      392.9968 (1.04)     0.0000 (1.0)           0;0  2.5446 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     427.0854 (1.0)      427.0854 (1.0)      427.0854 (1.0)      0.0000 (1.0)      427.0854 (1.0)      0.0000 (1.0)           0;0  2.3415 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     486.9809 (1.14)     486.9809 (1.14)     486.9809 (1.14)     0.0000 (1.0)      486.9809 (1.14)     0.0000 (1.0)           0;0  2.0535 (0.88)          1           1
test_checkout_symlink-checkout-update[main]       452.6027 (1.06)     452.6027 (1.06)     452.6027 (1.06)     0.0000 (1.0)      452.6027 (1.06)     0.0000 (1.0)           0;0  2.2094 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     443.7716 (1.07)     443.7716 (1.07)     443.7716 (1.07)     0.0000 (1.0)      443.7716 (1.07)     0.0000 (1.0)           0;0  2.2534 (0.93)          1           1
test_data_status-data-changed[3.10.0]     413.6145 (1.0)      413.6145 (1.0)      413.6145 (1.0)      0.0000 (1.0)      413.6145 (1.0)      0.0000 (1.0)           0;0  2.4177 (1.0)           1           1
test_data_status-data-changed[main]       424.9264 (1.03)     424.9264 (1.03)     424.9264 (1.03)     0.0000 (1.0)      424.9264 (1.03)     0.0000 (1.0)           0;0  2.3533 (0.97)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     446.7957 (1.08)     446.7957 (1.08)     446.7957 (1.08)     0.0000 (1.0)      446.7957 (1.08)     0.0000 (1.0)           0;0  2.2382 (0.92)          1           1
test_data_status-data-changed-noop[3.10.0]     412.8362 (1.0)      412.8362 (1.0)      412.8362 (1.0)      0.0000 (1.0)      412.8362 (1.0)      0.0000 (1.0)           0;0  2.4223 (1.0)           1           1
test_data_status-data-changed-noop[main]       431.1694 (1.04)     431.1694 (1.04)     431.1694 (1.04)     0.0000 (1.0)      431.1694 (1.04)     0.0000 (1.0)           0;0  2.3193 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     517.8081 (1.07)     517.8081 (1.07)     517.8081 (1.07)     0.0000 (1.0)      517.8081 (1.07)     0.0000 (1.0)           0;0  1.9312 (0.93)          1           1
test_data_status-data-new[3.10.0]     485.8998 (1.01)     485.8998 (1.01)     485.8998 (1.01)     0.0000 (1.0)      485.8998 (1.01)     0.0000 (1.0)           0;0  2.0580 (0.99)          1           1
test_data_status-data-new[main]       482.3587 (1.0)      482.3587 (1.0)      482.3587 (1.0)      0.0000 (1.0)      482.3587 (1.0)      0.0000 (1.0)           0;0  2.0731 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     452.4141 (1.11)     452.4141 (1.11)     452.4141 (1.11)     0.0000 (1.0)      452.4141 (1.11)     0.0000 (1.0)           0;0  2.2104 (0.90)          1           1
test_data_status-data-noop[3.10.0]     407.0391 (1.0)      407.0391 (1.0)      407.0391 (1.0)      0.0000 (1.0)      407.0391 (1.0)      0.0000 (1.0)           0;0  2.4568 (1.0)           1           1
test_data_status-data-noop[main]       421.4208 (1.04)     421.4208 (1.04)     421.4208 (1.04)     0.0000 (1.0)      421.4208 (1.04)     0.0000 (1.0)           0;0  2.3729 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     485.8558 (1.04)     485.8558 (1.04)     485.8558 (1.04)     0.0000 (1.0)      485.8558 (1.04)     0.0000 (1.0)           0;0  2.0582 (0.96)          1           1
test_data_status_all_flags-data-changed[3.10.0]     467.0832 (1.0)      467.0832 (1.0)      467.0832 (1.0)      0.0000 (1.0)      467.0832 (1.0)      0.0000 (1.0)           0;0  2.1409 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       487.8903 (1.04)     487.8903 (1.04)     487.8903 (1.04)     0.0000 (1.0)      487.8903 (1.04)     0.0000 (1.0)           0;0  2.0496 (0.96)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     482.9031 (1.0)      482.9031 (1.0)      482.9031 (1.0)      0.0000 (1.0)      482.9031 (1.0)      0.0000 (1.0)           0;0  2.0708 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     482.9926 (1.00)     482.9926 (1.00)     482.9926 (1.00)     0.0000 (1.0)      482.9926 (1.00)     0.0000 (1.0)           0;0  2.0704 (1.00)          1           1
test_data_status_all_flags-data-changed-noop[main]       489.5851 (1.01)     489.5851 (1.01)     489.5851 (1.01)     0.0000 (1.0)      489.5851 (1.01)     0.0000 (1.0)           0;0  2.0425 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     557.5932 (1.05)     557.5932 (1.05)     557.5932 (1.05)     0.0000 (1.0)      557.5932 (1.05)     0.0000 (1.0)           0;0  1.7934 (0.96)          1           1
test_data_status_all_flags-data-new[3.10.0]     532.6054 (1.0)      532.6054 (1.0)      532.6054 (1.0)      0.0000 (1.0)      532.6054 (1.0)      0.0000 (1.0)           0;0  1.8776 (1.0)           1           1
test_data_status_all_flags-data-new[main]       556.0533 (1.04)     556.0533 (1.04)     556.0533 (1.04)     0.0000 (1.0)      556.0533 (1.04)     0.0000 (1.0)           0;0  1.7984 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     484.2608 (1.03)     484.2608 (1.03)     484.2608 (1.03)     0.0000 (1.0)      484.2608 (1.03)     0.0000 (1.0)           0;0  2.0650 (0.97)          1           1
test_data_status_all_flags-data-noop[3.10.0]     471.3074 (1.0)      471.3074 (1.0)      471.3074 (1.0)      0.0000 (1.0)      471.3074 (1.0)      0.0000 (1.0)           0;0  2.1218 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       486.3213 (1.03)     486.3213 (1.03)     486.3213 (1.03)     0.0000 (1.0)      486.3213 (1.03)     0.0000 (1.0)           0;0  2.0563 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     492.1086 (1.0)      492.1086 (1.0)      492.1086 (1.0)      0.0000 (1.0)      492.1086 (1.0)      0.0000 (1.0)           0;0  2.0321 (1.0)           1           1
test_diff-diff[3.10.0]     496.5641 (1.01)     496.5641 (1.01)     496.5641 (1.01)     0.0000 (1.0)      496.5641 (1.01)     0.0000 (1.0)           0;0  2.0138 (0.99)          1           1
test_diff-diff[main]       532.0071 (1.08)     532.0071 (1.08)     532.0071 (1.08)     0.0000 (1.0)      532.0071 (1.08)     0.0000 (1.0)           0;0  1.8797 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     468.1261 (1.0)      468.1261 (1.0)      468.1261 (1.0)      0.0000 (1.0)      468.1261 (1.0)      0.0000 (1.0)           0;0  2.1362 (1.0)           1           1
test_diff-diff-changed[3.10.0]     469.0565 (1.00)     469.0565 (1.00)     469.0565 (1.00)     0.0000 (1.0)      469.0565 (1.00)     0.0000 (1.0)           0;0  2.1319 (1.00)          1           1
test_diff-diff-changed[main]       483.3014 (1.03)     483.3014 (1.03)     483.3014 (1.03)     0.0000 (1.0)      483.3014 (1.03)     0.0000 (1.0)           0;0  2.0691 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     456.9849 (1.0)      456.9849 (1.0)      456.9849 (1.0)      0.0000 (1.0)      456.9849 (1.0)      0.0000 (1.0)           0;0  2.1883 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     458.1090 (1.00)     458.1090 (1.00)     458.1090 (1.00)     0.0000 (1.0)      458.1090 (1.00)     0.0000 (1.0)           0;0  2.1829 (1.00)          1           1
test_diff-diff-changed-noop[main]       485.3516 (1.06)     485.3516 (1.06)     485.3516 (1.06)     0.0000 (1.0)      485.3516 (1.06)     0.0000 (1.0)           0;0  2.0604 (0.94)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     449.2994 (1.0)      449.2994 (1.0)      449.2994 (1.0)      0.0000 (1.0)      449.2994 (1.0)      0.0000 (1.0)           0;0  2.2257 (1.0)           1           1
test_diff-diff-noop[3.10.0]     453.7013 (1.01)     453.7013 (1.01)     453.7013 (1.01)     0.0000 (1.0)      453.7013 (1.01)     0.0000 (1.0)           0;0  2.2041 (0.99)          1           1
test_diff-diff-noop[main]       477.1885 (1.06)     477.1885 (1.06)     477.1885 (1.06)     0.0000 (1.0)      477.1885 (1.06)     0.0000 (1.0)           0;0  2.0956 (0.94)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       830.0893 (1.0)        830.0893 (1.0)        830.0893 (1.0)      0.0000 (1.0)        830.0893 (1.0)      0.0000 (1.0)           0;0  1.2047 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,053.9381 (6.09)     5,053.9381 (6.09)     5,053.9381 (6.09)     0.0000 (1.0)      5,053.9381 (6.09)     0.0000 (1.0)           0;0  0.1979 (0.16)          1           1
test_exp_show-exp[main]       4,725.0161 (5.69)     4,725.0161 (5.69)     4,725.0161 (5.69)     0.0000 (1.0)      4,725.0161 (5.69)     0.0000 (1.0)           0;0  0.2116 (0.18)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     485.3807 (1.03)     485.3807 (1.03)     485.3807 (1.03)     0.0000 (1.0)      485.3807 (1.03)     0.0000 (1.0)           0;0  2.0602 (0.97)          1           1
test_fetch-fetch[3.10.0]     498.0062 (1.05)     498.0062 (1.05)     498.0062 (1.05)     0.0000 (1.0)      498.0062 (1.05)     0.0000 (1.0)           0;0  2.0080 (0.95)          1           1
test_fetch-fetch[main]       472.7778 (1.0)      472.7778 (1.0)      472.7778 (1.0)      0.0000 (1.0)      472.7778 (1.0)      0.0000 (1.0)           0;0  2.1152 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     360.8953 (1.0)      360.8953 (1.0)      360.8953 (1.0)      0.0000 (1.0)      360.8953 (1.0)      0.0000 (1.0)           0;0  2.7709 (1.0)           1           1
test_gc-gc[3.10.0]     370.2534 (1.03)     370.2534 (1.03)     370.2534 (1.03)     0.0000 (1.0)      370.2534 (1.03)     0.0000 (1.0)           0;0  2.7009 (0.97)          1           1
test_gc-gc[main]       365.0546 (1.01)     365.0546 (1.01)     365.0546 (1.01)     0.0000 (1.0)      365.0546 (1.01)     0.0000 (1.0)           0;0  2.7393 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     492.5880 (1.02)     492.5880 (1.02)     492.5880 (1.02)     0.0000 (1.0)      492.5880 (1.02)     0.0000 (1.0)           0;0  2.0301 (0.98)          1           1
test_get-get[3.10.0]     481.6755 (1.0)      481.6755 (1.0)      481.6755 (1.0)      0.0000 (1.0)      481.6755 (1.0)      0.0000 (1.0)           0;0  2.0761 (1.0)           1           1
test_get-get[main]       516.9483 (1.07)     516.9483 (1.07)     516.9483 (1.07)     0.0000 (1.0)      516.9483 (1.07)     0.0000 (1.0)           0;0  1.9344 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     331.2707 (1.0)      331.2707 (1.0)      331.2707 (1.0)      0.0000 (1.0)      331.2707 (1.0)      0.0000 (1.0)           0;0  3.0187 (1.0)           1           1
test_get_url-get-url[3.10.0]     358.0580 (1.08)     358.0580 (1.08)     358.0580 (1.08)     0.0000 (1.0)      358.0580 (1.08)     0.0000 (1.0)           0;0  2.7928 (0.93)          1           1
test_get_url-get-url[main]       351.2772 (1.06)     351.2772 (1.06)     351.2772 (1.06)     0.0000 (1.0)      351.2772 (1.06)     0.0000 (1.0)           0;0  2.8468 (0.94)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     125.9092 (1.02)     138.1674 (1.06)     131.3007 (1.05)     2.9947 (3.47)     130.9652 (1.05)     4.4995 (4.69)         35;0  7.6161 (0.96)        100           1
test_help---help[3.10.0]     123.4731 (1.0)      135.1262 (1.04)     126.0356 (1.00)     2.4703 (2.86)     124.8606 (1.0)      2.3794 (2.48)        16;10  7.9343 (1.00)        100           1
test_help---help[main]       123.8594 (1.00)     129.7477 (1.0)      125.5247 (1.0)      0.8630 (1.0)      125.3584 (1.00)     0.9599 (1.0)          22;3  7.9666 (1.0)         100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     676.2491 (1.01)     676.2491 (1.01)     676.2491 (1.01)     0.0000 (1.0)      676.2491 (1.01)     0.0000 (1.0)           0;0  1.4787 (0.99)          1           1
test_import-import[3.10.0]     670.7430 (1.0)      670.7430 (1.0)      670.7430 (1.0)      0.0000 (1.0)      670.7430 (1.0)      0.0000 (1.0)           0;0  1.4909 (1.0)           1           1
test_import-import[main]       714.9699 (1.07)     714.9699 (1.07)     714.9699 (1.07)     0.0000 (1.0)      714.9699 (1.07)     0.0000 (1.0)           0;0  1.3987 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     651.0819 (1.06)     651.0819 (1.06)     651.0819 (1.06)     0.0000 (1.0)      651.0819 (1.06)     0.0000 (1.0)           0;0  1.5359 (0.95)          1           1
test_import_url-import-url[3.10.0]     633.4542 (1.03)     633.4542 (1.03)     633.4542 (1.03)     0.0000 (1.0)      633.4542 (1.03)     0.0000 (1.0)           0;0  1.5786 (0.97)          1           1
test_import_url-import-url[main]       615.5356 (1.0)      615.5356 (1.0)      615.5356 (1.0)      0.0000 (1.0)      615.5356 (1.0)      0.0000 (1.0)           0;0  1.6246 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     361.1112 (1.0)      397.0668 (1.0)      367.6556 (1.0)      4.8260 (1.0)      366.8295 (1.0)      4.3684 (1.0)          11;6  2.7199 (1.0)         100           1
test_init-init[3.10.0]     368.1448 (1.02)     411.4569 (1.04)     375.8683 (1.02)     5.6892 (1.18)     374.7284 (1.02)     5.0587 (1.16)         15;5  2.6605 (0.98)        100           1
test_init-init[main]       379.2431 (1.05)     447.1979 (1.13)     388.5933 (1.06)     7.8881 (1.63)     387.2498 (1.06)     5.4248 (1.24)          8;3  2.5734 (0.95)        100           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     418.1483 (1.01)     418.1483 (1.01)     418.1483 (1.01)     0.0000 (1.0)      418.1483 (1.01)     0.0000 (1.0)           0;0  2.3915 (0.99)          1           1
test_list-list[3.10.0]     413.5030 (1.00)     413.5030 (1.00)     413.5030 (1.00)     0.0000 (1.0)      413.5030 (1.00)     0.0000 (1.0)           0;0  2.4184 (1.00)          1           1
test_list-list[main]       413.2419 (1.0)      413.2419 (1.0)      413.2419 (1.0)      0.0000 (1.0)      413.2419 (1.0)      0.0000 (1.0)           0;0  2.4199 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     401.5257 (1.00)     401.5257 (1.00)     401.5257 (1.00)     0.0000 (1.0)      401.5257 (1.00)     0.0000 (1.0)           0;0  2.4905 (1.00)          1           1
test_list-list-dvc-only[3.10.0]     401.0430 (1.0)      401.0430 (1.0)      401.0430 (1.0)      0.0000 (1.0)      401.0430 (1.0)      0.0000 (1.0)           0;0  2.4935 (1.0)           1           1
test_list-list-dvc-only[main]       406.7025 (1.01)     406.7025 (1.01)     406.7025 (1.01)     0.0000 (1.0)      406.7025 (1.01)     0.0000 (1.0)           0;0  2.4588 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     411.9621 (1.03)     411.9621 (1.03)     411.9621 (1.03)     0.0000 (1.0)      411.9621 (1.03)     0.0000 (1.0)           0;0  2.4274 (0.97)          1           1
test_list-list-recursive[3.10.0]     401.6359 (1.0)      401.6359 (1.0)      401.6359 (1.0)      0.0000 (1.0)      401.6359 (1.0)      0.0000 (1.0)           0;0  2.4898 (1.0)           1           1
test_list-list-recursive[main]       419.4834 (1.04)     419.4834 (1.04)     419.4834 (1.04)     0.0000 (1.0)      419.4834 (1.04)     0.0000 (1.0)           0;0  2.3839 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     398.7382 (1.00)     398.7382 (1.00)     398.7382 (1.00)     0.0000 (1.0)      398.7382 (1.00)     0.0000 (1.0)           0;0  2.5079 (1.00)          1           1
test_list-list-shallow[3.10.0]     397.5984 (1.0)      397.5984 (1.0)      397.5984 (1.0)      0.0000 (1.0)      397.5984 (1.0)      0.0000 (1.0)           0;0  2.5151 (1.0)           1           1
test_list-list-shallow[main]       407.0351 (1.02)     407.0351 (1.02)     407.0351 (1.02)     0.0000 (1.0)      407.0351 (1.02)     0.0000 (1.0)           0;0  2.4568 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     551.2138 (1.01)     551.2138 (1.01)     551.2138 (1.01)     0.0000 (1.0)      551.2138 (1.01)     0.0000 (1.0)           0;0  1.8142 (0.99)          1           1
test_partial_add-add[3.10.0]     561.5375 (1.02)     561.5375 (1.02)     561.5375 (1.02)     0.0000 (1.0)      561.5375 (1.02)     0.0000 (1.0)           0;0  1.7808 (0.98)          1           1
test_partial_add-add[main]       547.9883 (1.0)      547.9883 (1.0)      547.9883 (1.0)      0.0000 (1.0)      547.9883 (1.0)      0.0000 (1.0)           0;0  1.8249 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     583.4706 (1.00)     583.4706 (1.00)     583.4706 (1.00)     0.0000 (1.0)      583.4706 (1.00)     0.0000 (1.0)           0;0  1.7139 (1.00)          1           1
test_partial_add-add-partial[3.10.0]     582.1309 (1.0)      582.1309 (1.0)      582.1309 (1.0)      0.0000 (1.0)      582.1309 (1.0)      0.0000 (1.0)           0;0  1.7178 (1.0)           1           1
test_partial_add-add-partial[main]       583.6641 (1.00)     583.6641 (1.00)     583.6641 (1.00)     0.0000 (1.0)      583.6641 (1.00)     0.0000 (1.0)           0;0  1.7133 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     399.4145 (1.02)     399.4145 (1.02)     399.4145 (1.02)     0.0000 (1.0)      399.4145 (1.02)     0.0000 (1.0)           0;0  2.5037 (0.98)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     391.2292 (1.0)      391.2292 (1.0)      391.2292 (1.0)      0.0000 (1.0)      391.2292 (1.0)      0.0000 (1.0)           0;0  2.5560 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       403.2532 (1.03)     403.2532 (1.03)     403.2532 (1.03)     0.0000 (1.0)      403.2532 (1.03)     0.0000 (1.0)           0;0  2.4798 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     381.3019 (1.0)      381.3019 (1.0)      381.3019 (1.0)      0.0000 (1.0)      381.3019 (1.0)      0.0000 (1.0)           0;0  2.6226 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     393.9933 (1.03)     393.9933 (1.03)     393.9933 (1.03)     0.0000 (1.0)      393.9933 (1.03)     0.0000 (1.0)           0;0  2.5381 (0.97)          1           1
test_partial_add-gc-noop[main]       388.8425 (1.02)     388.8425 (1.02)     388.8425 (1.02)     0.0000 (1.0)      388.8425 (1.02)     0.0000 (1.0)           0;0  2.5717 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     423.8838 (1.05)     423.8838 (1.05)     423.8838 (1.05)     0.0000 (1.0)      423.8838 (1.05)     0.0000 (1.0)           0;0  2.3591 (0.95)          1           1
test_partial_add-push[3.10.0]     403.7288 (1.0)      403.7288 (1.0)      403.7288 (1.0)      0.0000 (1.0)      403.7288 (1.0)      0.0000 (1.0)           0;0  2.4769 (1.0)           1           1
test_partial_add-push[main]       437.1639 (1.08)     437.1639 (1.08)     437.1639 (1.08)     0.0000 (1.0)      437.1639 (1.08)     0.0000 (1.0)           0;0  2.2875 (0.92)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     426.7582 (1.04)     426.7582 (1.04)     426.7582 (1.04)     0.0000 (1.0)      426.7582 (1.04)     0.0000 (1.0)           0;0  2.3432 (0.96)          1           1
test_partial_add-push-partial[3.10.0]     411.3605 (1.0)      411.3605 (1.0)      411.3605 (1.0)      0.0000 (1.0)      411.3605 (1.0)      0.0000 (1.0)           0;0  2.4310 (1.0)           1           1
test_partial_add-push-partial[main]       452.5027 (1.10)     452.5027 (1.10)     452.5027 (1.10)     0.0000 (1.0)      452.5027 (1.10)     0.0000 (1.0)           0;0  2.2099 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     615.2051 (1.04)     615.2051 (1.04)     615.2051 (1.04)     0.0000 (1.0)      615.2051 (1.04)     0.0000 (1.0)           0;0  1.6255 (0.97)          1           1
test_partial_remove-add[3.10.0]     594.0410 (1.0)      594.0410 (1.0)      594.0410 (1.0)      0.0000 (1.0)      594.0410 (1.0)      0.0000 (1.0)           0;0  1.6834 (1.0)           1           1
test_partial_remove-add[main]       627.1082 (1.06)     627.1082 (1.06)     627.1082 (1.06)     0.0000 (1.0)      627.1082 (1.06)     0.0000 (1.0)           0;0  1.5946 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     544.0051 (1.03)     544.0051 (1.03)     544.0051 (1.03)     0.0000 (1.0)      544.0051 (1.03)     0.0000 (1.0)           0;0  1.8382 (0.97)          1           1
test_partial_remove-add-update[3.10.0]     527.9892 (1.0)      527.9892 (1.0)      527.9892 (1.0)      0.0000 (1.0)      527.9892 (1.0)      0.0000 (1.0)           0;0  1.8940 (1.0)           1           1
test_partial_remove-add-update[main]       571.4324 (1.08)     571.4324 (1.08)     571.4324 (1.08)     0.0000 (1.0)      571.4324 (1.08)     0.0000 (1.0)           0;0  1.7500 (0.92)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     377.2485 (1.00)     377.2485 (1.00)     377.2485 (1.00)     0.0000 (1.0)      377.2485 (1.00)     0.0000 (1.0)           0;0  2.6508 (1.00)          1           1
test_partial_remove-gc[3.10.0]     376.0894 (1.0)      376.0894 (1.0)      376.0894 (1.0)      0.0000 (1.0)      376.0894 (1.0)      0.0000 (1.0)           0;0  2.6589 (1.0)           1           1
test_partial_remove-gc[main]       420.5976 (1.12)     420.5976 (1.12)     420.5976 (1.12)     0.0000 (1.0)      420.5976 (1.12)     0.0000 (1.0)           0;0  2.3776 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     398.0087 (1.03)     398.0087 (1.03)     398.0087 (1.03)     0.0000 (1.0)      398.0087 (1.03)     0.0000 (1.0)           0;0  2.5125 (0.97)          1           1
test_partial_remove-gc-cloud[3.10.0]     386.8737 (1.0)      386.8737 (1.0)      386.8737 (1.0)      0.0000 (1.0)      386.8737 (1.0)      0.0000 (1.0)           0;0  2.5848 (1.0)           1           1
test_partial_remove-gc-cloud[main]       431.9886 (1.12)     431.9886 (1.12)     431.9886 (1.12)     0.0000 (1.0)      431.9886 (1.12)     0.0000 (1.0)           0;0  2.3149 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     444.7829 (1.07)     444.7829 (1.07)     444.7829 (1.07)     0.0000 (1.0)      444.7829 (1.07)     0.0000 (1.0)           0;0  2.2483 (0.94)          1           1
test_partial_remove-push[3.10.0]     416.3422 (1.0)      416.3422 (1.0)      416.3422 (1.0)      0.0000 (1.0)      416.3422 (1.0)      0.0000 (1.0)           0;0  2.4019 (1.0)           1           1
test_partial_remove-push[main]       505.0811 (1.21)     505.0811 (1.21)     505.0811 (1.21)     0.0000 (1.0)      505.0811 (1.21)     0.0000 (1.0)           0;0  1.9799 (0.82)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     397.4417 (1.0)      397.4417 (1.0)      397.4417 (1.0)      0.0000 (1.0)      397.4417 (1.0)      0.0000 (1.0)           0;0  2.5161 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     407.2933 (1.02)     407.2933 (1.02)     407.2933 (1.02)     0.0000 (1.0)      407.2933 (1.02)     0.0000 (1.0)           0;0  2.4552 (0.98)          1           1
test_partial_remove-push-update[main]       468.1114 (1.18)     468.1114 (1.18)     468.1114 (1.18)     0.0000 (1.0)      468.1114 (1.18)     0.0000 (1.0)           0;0  2.1362 (0.85)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     410.1424 (1.0)      419.1447 (1.0)      414.1086 (1.0)      4.2208 (2.27)     412.0368 (1.0)      7.5932 (2.38)          1;0  2.4148 (1.0)           5           3
test_plots-plots-diff[3.10.0]     760.4964 (1.85)     764.9246 (1.82)     762.4677 (1.84)     1.8610 (1.0)      762.3837 (1.85)     3.1865 (1.0)           2;0  1.3115 (0.54)          5           3
test_plots-plots-diff[main]       731.1112 (1.78)     735.5200 (1.75)     733.1686 (1.77)     2.0035 (1.08)     733.1315 (1.78)     3.7558 (1.18)          2;0  1.3639 (0.56)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean             StdDev                Median                IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       424.0687 (1.0)        428.6093 (1.0)        425.6392 (1.0)       1.7441 (1.0)        425.3035 (1.0)       1.6105 (1.0)           1;0  2.3494 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,016.1632 (2.40)     1,032.7846 (2.41)     1,021.2253 (2.40)      6.5990 (3.78)     1,019.3362 (2.40)      5.0783 (3.15)          1;1  0.9792 (0.42)          5           3
test_plots-plots-diff-json[main]         806.2685 (1.90)       836.1786 (1.95)       815.1046 (1.92)     12.0541 (6.91)       809.9486 (1.90)     10.3531 (6.43)          1;1  1.2268 (0.52)          5           3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     381.0869 (1.0)      388.0722 (1.0)      384.0279 (1.0)      3.1988 (3.34)     383.1084 (1.0)      5.8625 (4.66)          1;0  2.6040 (1.0)           5           3
test_plots-plots-show[3.10.0]     629.0109 (1.65)     631.3447 (1.63)     630.5705 (1.64)     0.9569 (1.0)      630.7161 (1.65)     1.2584 (1.0)           1;0  1.5859 (0.61)          5           3
test_plots-plots-show[main]       623.9480 (1.64)     626.8374 (1.62)     625.1204 (1.63)     1.1304 (1.18)     624.7644 (1.63)     1.5738 (1.25)          2;0  1.5997 (0.61)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     395.3368 (1.0)      410.0589 (1.0)      398.7867 (1.0)      6.3227 (1.73)     396.4679 (1.0)      4.3647 (1.02)          1;1  2.5076 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     776.1552 (1.96)     793.9122 (1.94)     782.1806 (1.96)     6.9142 (1.89)     781.2278 (1.97)     6.8305 (1.60)          1;0  1.2785 (0.51)          5           3
test_plots-plots-show-json[main]       672.2702 (1.70)     681.5110 (1.66)     675.3847 (1.69)     3.6621 (1.0)      674.4268 (1.70)     4.2613 (1.0)           1;0  1.4806 (0.59)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     435.5945 (1.02)     435.5945 (1.02)     435.5945 (1.02)     0.0000 (1.0)      435.5945 (1.02)     0.0000 (1.0)           0;0  2.2957 (0.98)          1           1
test_push-push[3.10.0]     427.0933 (1.0)      427.0933 (1.0)      427.0933 (1.0)      0.0000 (1.0)      427.0933 (1.0)      0.0000 (1.0)           0;0  2.3414 (1.0)           1           1
test_push-push[main]       448.8844 (1.05)     448.8844 (1.05)     448.8844 (1.05)     0.0000 (1.0)      448.8844 (1.05)     0.0000 (1.0)           0;0  2.2277 (0.95)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     595.3433 (1.0)      595.3433 (1.0)      595.3433 (1.0)      0.0000 (1.0)      595.3433 (1.0)      0.0000 (1.0)           0;0  1.6797 (1.0)           1           1
test_sharing-add[3.10.0]     618.0385 (1.04)     618.0385 (1.04)     618.0385 (1.04)     0.0000 (1.0)      618.0385 (1.04)     0.0000 (1.0)           0;0  1.6180 (0.96)          1           1
test_sharing-add[main]       616.8996 (1.04)     616.8996 (1.04)     616.8996 (1.04)     0.0000 (1.0)      616.8996 (1.04)     0.0000 (1.0)           0;0  1.6210 (0.97)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     557.1042 (1.0)      557.1042 (1.0)      557.1042 (1.0)      0.0000 (1.0)      557.1042 (1.0)      0.0000 (1.0)           0;0  1.7950 (1.0)           1           1
test_sharing-add-noop[3.10.0]     577.0081 (1.04)     577.0081 (1.04)     577.0081 (1.04)     0.0000 (1.0)      577.0081 (1.04)     0.0000 (1.0)           0;0  1.7331 (0.97)          1           1
test_sharing-add-noop[main]       568.9808 (1.02)     568.9808 (1.02)     568.9808 (1.02)     0.0000 (1.0)      568.9808 (1.02)     0.0000 (1.0)           0;0  1.7575 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     452.6999 (1.0)      452.6999 (1.0)      452.6999 (1.0)      0.0000 (1.0)      452.6999 (1.0)      0.0000 (1.0)           0;0  2.2090 (1.0)           1           1
test_sharing-checkout[3.10.0]     474.6940 (1.05)     474.6940 (1.05)     474.6940 (1.05)     0.0000 (1.0)      474.6940 (1.05)     0.0000 (1.0)           0;0  2.1066 (0.95)          1           1
test_sharing-checkout[main]       475.4977 (1.05)     475.4977 (1.05)     475.4977 (1.05)     0.0000 (1.0)      475.4977 (1.05)     0.0000 (1.0)           0;0  2.1031 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     381.0837 (1.0)      381.0837 (1.0)      381.0837 (1.0)      0.0000 (1.0)      381.0837 (1.0)      0.0000 (1.0)           0;0  2.6241 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     398.1830 (1.04)     398.1830 (1.04)     398.1830 (1.04)     0.0000 (1.0)      398.1830 (1.04)     0.0000 (1.0)           0;0  2.5114 (0.96)          1           1
test_sharing-checkout-noop[main]       409.8706 (1.08)     409.8706 (1.08)     409.8706 (1.08)     0.0000 (1.0)      409.8706 (1.08)     0.0000 (1.0)           0;0  2.4398 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     435.6708 (1.0)      435.6708 (1.0)      435.6708 (1.0)      0.0000 (1.0)      435.6708 (1.0)      0.0000 (1.0)           0;0  2.2953 (1.0)           1           1
test_sharing-fetch[3.10.0]     468.5741 (1.08)     468.5741 (1.08)     468.5741 (1.08)     0.0000 (1.0)      468.5741 (1.08)     0.0000 (1.0)           0;0  2.1341 (0.93)          1           1
test_sharing-fetch[main]       462.5223 (1.06)     462.5223 (1.06)     462.5223 (1.06)     0.0000 (1.0)      462.5223 (1.06)     0.0000 (1.0)           0;0  2.1621 (0.94)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     401.9315 (1.0)      401.9315 (1.0)      401.9315 (1.0)      0.0000 (1.0)      401.9315 (1.0)      0.0000 (1.0)           0;0  2.4880 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     405.4404 (1.01)     405.4404 (1.01)     405.4404 (1.01)     0.0000 (1.0)      405.4404 (1.01)     0.0000 (1.0)           0;0  2.4665 (0.99)          1           1
test_sharing-fetch-noop[main]       433.6181 (1.08)     433.6181 (1.08)     433.6181 (1.08)     0.0000 (1.0)      433.6181 (1.08)     0.0000 (1.0)           0;0  2.3062 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     433.1591 (1.0)      433.1591 (1.0)      433.1591 (1.0)      0.0000 (1.0)      433.1591 (1.0)      0.0000 (1.0)           0;0  2.3086 (1.0)           1           1
test_sharing-push[3.10.0]     435.6392 (1.01)     435.6392 (1.01)     435.6392 (1.01)     0.0000 (1.0)      435.6392 (1.01)     0.0000 (1.0)           0;0  2.2955 (0.99)          1           1
test_sharing-push[main]       482.1834 (1.11)     482.1834 (1.11)     482.1834 (1.11)     0.0000 (1.0)      482.1834 (1.11)     0.0000 (1.0)           0;0  2.0739 (0.90)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     383.8527 (1.0)      383.8527 (1.0)      383.8527 (1.0)      0.0000 (1.0)      383.8527 (1.0)      0.0000 (1.0)           0;0  2.6052 (1.0)           1           1
test_sharing-push-noop[3.10.0]     396.2249 (1.03)     396.2249 (1.03)     396.2249 (1.03)     0.0000 (1.0)      396.2249 (1.03)     0.0000 (1.0)           0;0  2.5238 (0.97)          1           1
test_sharing-push-noop[main]       444.7560 (1.16)     444.7560 (1.16)     444.7560 (1.16)     0.0000 (1.0)      444.7560 (1.16)     0.0000 (1.0)           0;0  2.2484 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     427.2625 (1.02)     427.2625 (1.02)     427.2625 (1.02)     0.0000 (1.0)      427.2625 (1.02)     0.0000 (1.0)           0;0  2.3405 (0.98)          1           1
test_status-status[3.10.0]     443.7180 (1.05)     443.7180 (1.05)     443.7180 (1.05)     0.0000 (1.0)      443.7180 (1.05)     0.0000 (1.0)           0;0  2.2537 (0.95)          1           1
test_status-status[main]       420.7950 (1.0)      420.7950 (1.0)      420.7950 (1.0)      0.0000 (1.0)      420.7950 (1.0)      0.0000 (1.0)           0;0  2.3765 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     375.3042 (1.0)      375.3042 (1.0)      375.3042 (1.0)      0.0000 (1.0)      375.3042 (1.0)      0.0000 (1.0)           0;0  2.6645 (1.0)           1           1
test_status-status-changed[3.10.0]     410.9877 (1.10)     410.9877 (1.10)     410.9877 (1.10)     0.0000 (1.0)      410.9877 (1.10)     0.0000 (1.0)           0;0  2.4332 (0.91)          1           1
test_status-status-changed[main]       389.3535 (1.04)     389.3535 (1.04)     389.3535 (1.04)     0.0000 (1.0)      389.3535 (1.04)     0.0000 (1.0)           0;0  2.5684 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     389.5600 (1.02)     389.5600 (1.02)     389.5600 (1.02)     0.0000 (1.0)      389.5600 (1.02)     0.0000 (1.0)           0;0  2.5670 (0.98)          1           1
test_status-status-changed-noop[3.10.0]     404.4976 (1.05)     404.4976 (1.05)     404.4976 (1.05)     0.0000 (1.0)      404.4976 (1.05)     0.0000 (1.0)           0;0  2.4722 (0.95)          1           1
test_status-status-changed-noop[main]       383.6881 (1.0)      383.6881 (1.0)      383.6881 (1.0)      0.0000 (1.0)      383.6881 (1.0)      0.0000 (1.0)           0;0  2.6063 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     377.8910 (1.01)     377.8910 (1.01)     377.8910 (1.01)     0.0000 (1.0)      377.8910 (1.01)     0.0000 (1.0)           0;0  2.6463 (0.99)          1           1
test_status-status-noop[3.10.0]     410.0206 (1.10)     410.0206 (1.10)     410.0206 (1.10)     0.0000 (1.0)      410.0206 (1.10)     0.0000 (1.0)           0;0  2.4389 (0.91)          1           1
test_status-status-noop[main]       374.1042 (1.0)      374.1042 (1.0)      374.1042 (1.0)      0.0000 (1.0)      374.1042 (1.0)      0.0000 (1.0)           0;0  2.6731 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     623.9756 (1.0)      623.9756 (1.0)      623.9756 (1.0)      0.0000 (1.0)      623.9756 (1.0)      0.0000 (1.0)           0;0  1.6026 (1.0)           1           1
test_update-import-url[3.10.0]     664.6648 (1.07)     664.6648 (1.07)     664.6648 (1.07)     0.0000 (1.0)      664.6648 (1.07)     0.0000 (1.0)           0;0  1.5045 (0.94)          1           1
test_update-import-url[main]       631.2597 (1.01)     631.2597 (1.01)     631.2597 (1.01)     0.0000 (1.0)      631.2597 (1.01)     0.0000 (1.0)           0;0  1.5841 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     513.6172 (1.0)      513.6172 (1.0)      513.6172 (1.0)      0.0000 (1.0)      513.6172 (1.0)      0.0000 (1.0)           0;0  1.9470 (1.0)           1           1
test_update-update[3.10.0]     541.3532 (1.05)     541.3532 (1.05)     541.3532 (1.05)     0.0000 (1.0)      541.3532 (1.05)     0.0000 (1.0)           0;0  1.8472 (0.95)          1           1
test_update-update[main]       522.6830 (1.02)     522.6830 (1.02)     522.6830 (1.02)     0.0000 (1.0)      522.6830 (1.02)     0.0000 (1.0)           0;0  1.9132 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     384.4666 (1.0)      384.4666 (1.0)      384.4666 (1.0)      0.0000 (1.0)      384.4666 (1.0)      0.0000 (1.0)           0;0  2.6010 (1.0)           1           1
test_update-update-noop[3.10.0]     413.8463 (1.08)     413.8463 (1.08)     413.8463 (1.08)     0.0000 (1.0)      413.8463 (1.08)     0.0000 (1.0)           0;0  2.4164 (0.93)          1           1
test_update-update-noop[main]       405.7130 (1.06)     405.7130 (1.06)     405.7130 (1.06)     0.0000 (1.0)      405.7130 (1.06)     0.0000 (1.0)           0;0  2.4648 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean