Fri Dec  8 23:05:41 UTC 2023
dataset: tiny
project: example-get-started

---------------------------------------------------------------------------- benchmark 'test_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     590.4913 (1.0)      590.4913 (1.0)      590.4913 (1.0)      0.0000 (1.0)      590.4913 (1.0)      0.0000 (1.0)           0;0  1.6935 (1.0)           1           1
test_add-add[3.10.0]     614.3503 (1.04)     614.3503 (1.04)     614.3503 (1.04)     0.0000 (1.0)      614.3503 (1.04)     0.0000 (1.0)           0;0  1.6277 (0.96)          1           1
test_add-add[main]       605.0315 (1.02)     605.0315 (1.02)     605.0315 (1.02)     0.0000 (1.0)      605.0315 (1.02)     0.0000 (1.0)           0;0  1.6528 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     545.4431 (1.0)      545.4431 (1.0)      545.4431 (1.0)      0.0000 (1.0)      545.4431 (1.0)      0.0000 (1.0)           0;0  1.8334 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     614.1730 (1.13)     614.1730 (1.13)     614.1730 (1.13)     0.0000 (1.0)      614.1730 (1.13)     0.0000 (1.0)           0;0  1.6282 (0.89)          1           1
test_checkout_copy-checkout[main]       560.9020 (1.03)     560.9020 (1.03)     560.9020 (1.03)     0.0000 (1.0)      560.9020 (1.03)     0.0000 (1.0)           0;0  1.7828 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     381.8166 (1.0)      381.8166 (1.0)      381.8166 (1.0)      0.0000 (1.0)      381.8166 (1.0)      0.0000 (1.0)           0;0  2.6191 (1.0)           1           1
test_checkout_copy-checkout-noop[3.10.0]     394.0133 (1.03)     394.0133 (1.03)     394.0133 (1.03)     0.0000 (1.0)      394.0133 (1.03)     0.0000 (1.0)           0;0  2.5380 (0.97)          1           1
test_checkout_copy-checkout-noop[main]       393.6874 (1.03)     393.6874 (1.03)     393.6874 (1.03)     0.0000 (1.0)      393.6874 (1.03)     0.0000 (1.0)           0;0  2.5401 (0.97)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     416.4448 (1.0)      416.4448 (1.0)      416.4448 (1.0)      0.0000 (1.0)      416.4448 (1.0)      0.0000 (1.0)           0;0  2.4013 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     436.9720 (1.05)     436.9720 (1.05)     436.9720 (1.05)     0.0000 (1.0)      436.9720 (1.05)     0.0000 (1.0)           0;0  2.2885 (0.95)          1           1
test_checkout_copy-checkout-update[main]       425.7625 (1.02)     425.7625 (1.02)     425.7625 (1.02)     0.0000 (1.0)      425.7625 (1.02)     0.0000 (1.0)           0;0  2.3487 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]     501.3867 (1.0)      501.3867 (1.0)      501.3867 (1.0)      0.0000 (1.0)      501.3867 (1.0)      0.0000 (1.0)           0;0  1.9945 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]     534.7718 (1.07)     534.7718 (1.07)     534.7718 (1.07)     0.0000 (1.0)      534.7718 (1.07)     0.0000 (1.0)           0;0  1.8700 (0.94)          1           1
test_checkout_hardlink-checkout[main]       522.2340 (1.04)     522.2340 (1.04)     522.2340 (1.04)     0.0000 (1.0)      522.2340 (1.04)     0.0000 (1.0)           0;0  1.9149 (0.96)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     369.2629 (1.0)      369.2629 (1.0)      369.2629 (1.0)      0.0000 (1.0)      369.2629 (1.0)      0.0000 (1.0)           0;0  2.7081 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     380.1334 (1.03)     380.1334 (1.03)     380.1334 (1.03)     0.0000 (1.0)      380.1334 (1.03)     0.0000 (1.0)           0;0  2.6307 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       381.7652 (1.03)     381.7652 (1.03)     381.7652 (1.03)     0.0000 (1.0)      381.7652 (1.03)     0.0000 (1.0)           0;0  2.6194 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     405.1012 (1.0)      405.1012 (1.0)      405.1012 (1.0)      0.0000 (1.0)      405.1012 (1.0)      0.0000 (1.0)           0;0  2.4685 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     421.3185 (1.04)     421.3185 (1.04)     421.3185 (1.04)     0.0000 (1.0)      421.3185 (1.04)     0.0000 (1.0)           0;0  2.3735 (0.96)          1           1
test_checkout_hardlink-checkout-update[main]       411.1546 (1.01)     411.1546 (1.01)     411.1546 (1.01)     0.0000 (1.0)      411.1546 (1.01)     0.0000 (1.0)           0;0  2.4322 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]     516.3658 (1.0)      516.3658 (1.0)      516.3658 (1.0)      0.0000 (1.0)      516.3658 (1.0)      0.0000 (1.0)           0;0  1.9366 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]     535.2166 (1.04)     535.2166 (1.04)     535.2166 (1.04)     0.0000 (1.0)      535.2166 (1.04)     0.0000 (1.0)           0;0  1.8684 (0.96)          1           1
test_checkout_symlink-checkout[main]       545.7457 (1.06)     545.7457 (1.06)     545.7457 (1.06)     0.0000 (1.0)      545.7457 (1.06)     0.0000 (1.0)           0;0  1.8324 (0.95)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     365.2861 (1.0)      365.2861 (1.0)      365.2861 (1.0)      0.0000 (1.0)      365.2861 (1.0)      0.0000 (1.0)           0;0  2.7376 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     382.4458 (1.05)     382.4458 (1.05)     382.4458 (1.05)     0.0000 (1.0)      382.4458 (1.05)     0.0000 (1.0)           0;0  2.6147 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       390.6729 (1.07)     390.6729 (1.07)     390.6729 (1.07)     0.0000 (1.0)      390.6729 (1.07)     0.0000 (1.0)           0;0  2.5597 (0.94)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     407.7034 (1.0)      407.7034 (1.0)      407.7034 (1.0)      0.0000 (1.0)      407.7034 (1.0)      0.0000 (1.0)           0;0  2.4528 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     423.6371 (1.04)     423.6371 (1.04)     423.6371 (1.04)     0.0000 (1.0)      423.6371 (1.04)     0.0000 (1.0)           0;0  2.3605 (0.96)          1           1
test_checkout_symlink-checkout-update[main]       417.7265 (1.02)     417.7265 (1.02)     417.7265 (1.02)     0.0000 (1.0)      417.7265 (1.02)     0.0000 (1.0)           0;0  2.3939 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]     447.1266 (1.07)     447.1266 (1.07)     447.1266 (1.07)     0.0000 (1.0)      447.1266 (1.07)     0.0000 (1.0)           0;0  2.2365 (0.93)          1           1
test_data_status-data-changed[3.10.0]     416.6249 (1.0)      416.6249 (1.0)      416.6249 (1.0)      0.0000 (1.0)      416.6249 (1.0)      0.0000 (1.0)           0;0  2.4002 (1.0)           1           1
test_data_status-data-changed[main]       417.0759 (1.00)     417.0759 (1.00)     417.0759 (1.00)     0.0000 (1.0)      417.0759 (1.00)     0.0000 (1.0)           0;0  2.3976 (1.00)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     444.5632 (1.07)     444.5632 (1.07)     444.5632 (1.07)     0.0000 (1.0)      444.5632 (1.07)     0.0000 (1.0)           0;0  2.2494 (0.93)          1           1
test_data_status-data-changed-noop[3.10.0]     415.5785 (1.00)     415.5785 (1.00)     415.5785 (1.00)     0.0000 (1.0)      415.5785 (1.00)     0.0000 (1.0)           0;0  2.4063 (1.00)          1           1
test_data_status-data-changed-noop[main]       414.3124 (1.0)      414.3124 (1.0)      414.3124 (1.0)      0.0000 (1.0)      414.3124 (1.0)      0.0000 (1.0)           0;0  2.4136 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                          Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     501.8858 (1.09)     501.8858 (1.09)     501.8858 (1.09)     0.0000 (1.0)      501.8858 (1.09)     0.0000 (1.0)           0;0  1.9925 (0.92)          1           1
test_data_status-data-new[3.10.0]     459.4404 (1.0)      459.4404 (1.0)      459.4404 (1.0)      0.0000 (1.0)      459.4404 (1.0)      0.0000 (1.0)           0;0  2.1766 (1.0)           1           1
test_data_status-data-new[main]       469.9237 (1.02)     469.9237 (1.02)     469.9237 (1.02)     0.0000 (1.0)      469.9237 (1.02)     0.0000 (1.0)           0;0  2.1280 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     446.8447 (1.06)     446.8447 (1.06)     446.8447 (1.06)     0.0000 (1.0)      446.8447 (1.06)     0.0000 (1.0)           0;0  2.2379 (0.94)          1           1
test_data_status-data-noop[3.10.0]     420.4179 (1.0)      420.4179 (1.0)      420.4179 (1.0)      0.0000 (1.0)      420.4179 (1.0)      0.0000 (1.0)           0;0  2.3786 (1.0)           1           1
test_data_status-data-noop[main]       420.7584 (1.00)     420.7584 (1.00)     420.7584 (1.00)     0.0000 (1.0)      420.7584 (1.00)     0.0000 (1.0)           0;0  2.3767 (1.00)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     470.5229 (1.06)     470.5229 (1.06)     470.5229 (1.06)     0.0000 (1.0)      470.5229 (1.06)     0.0000 (1.0)           0;0  2.1253 (0.94)          1           1
test_data_status_all_flags-data-changed[3.10.0]     443.8640 (1.0)      443.8640 (1.0)      443.8640 (1.0)      0.0000 (1.0)      443.8640 (1.0)      0.0000 (1.0)           0;0  2.2529 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       457.8353 (1.03)     457.8353 (1.03)     457.8353 (1.03)     0.0000 (1.0)      457.8353 (1.03)     0.0000 (1.0)           0;0  2.1842 (0.97)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     470.8409 (1.06)     470.8409 (1.06)     470.8409 (1.06)     0.0000 (1.0)      470.8409 (1.06)     0.0000 (1.0)           0;0  2.1239 (0.94)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     444.7596 (1.0)      444.7596 (1.0)      444.7596 (1.0)      0.0000 (1.0)      444.7596 (1.0)      0.0000 (1.0)           0;0  2.2484 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       455.0141 (1.02)     455.0141 (1.02)     455.0141 (1.02)     0.0000 (1.0)      455.0141 (1.02)     0.0000 (1.0)           0;0  2.1977 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-new': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     527.4298 (1.04)     527.4298 (1.04)     527.4298 (1.04)     0.0000 (1.0)      527.4298 (1.04)     0.0000 (1.0)           0;0  1.8960 (0.96)          1           1
test_data_status_all_flags-data-new[3.10.0]     507.1330 (1.0)      507.1330 (1.0)      507.1330 (1.0)      0.0000 (1.0)      507.1330 (1.0)      0.0000 (1.0)           0;0  1.9719 (1.0)           1           1
test_data_status_all_flags-data-new[main]       512.2331 (1.01)     512.2331 (1.01)     512.2331 (1.01)     0.0000 (1.0)      512.2331 (1.01)     0.0000 (1.0)           0;0  1.9522 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     469.6308 (1.06)     469.6308 (1.06)     469.6308 (1.06)     0.0000 (1.0)      469.6308 (1.06)     0.0000 (1.0)           0;0  2.1293 (0.94)          1           1
test_data_status_all_flags-data-noop[3.10.0]     442.7024 (1.0)      442.7024 (1.0)      442.7024 (1.0)      0.0000 (1.0)      442.7024 (1.0)      0.0000 (1.0)           0;0  2.2589 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       451.9962 (1.02)     451.9962 (1.02)     451.9962 (1.02)     0.0000 (1.0)      451.9962 (1.02)     0.0000 (1.0)           0;0  2.2124 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_diff-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     509.4019 (1.0)      509.4019 (1.0)      509.4019 (1.0)      0.0000 (1.0)      509.4019 (1.0)      0.0000 (1.0)           0;0  1.9631 (1.0)           1           1
test_diff-diff[3.10.0]     569.5850 (1.12)     569.5850 (1.12)     569.5850 (1.12)     0.0000 (1.0)      569.5850 (1.12)     0.0000 (1.0)           0;0  1.7557 (0.89)          1           1
test_diff-diff[main]       513.2567 (1.01)     513.2567 (1.01)     513.2567 (1.01)     0.0000 (1.0)      513.2567 (1.01)     0.0000 (1.0)           0;0  1.9483 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     459.7426 (1.0)      459.7426 (1.0)      459.7426 (1.0)      0.0000 (1.0)      459.7426 (1.0)      0.0000 (1.0)           0;0  2.1751 (1.0)           1           1
test_diff-diff-changed[3.10.0]     506.0948 (1.10)     506.0948 (1.10)     506.0948 (1.10)     0.0000 (1.0)      506.0948 (1.10)     0.0000 (1.0)           0;0  1.9759 (0.91)          1           1
test_diff-diff-changed[main]       477.8604 (1.04)     477.8604 (1.04)     477.8604 (1.04)     0.0000 (1.0)      477.8604 (1.04)     0.0000 (1.0)           0;0  2.0927 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                            Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     445.3712 (1.0)      445.3712 (1.0)      445.3712 (1.0)      0.0000 (1.0)      445.3712 (1.0)      0.0000 (1.0)           0;0  2.2453 (1.0)           1           1
test_diff-diff-changed-noop[3.10.0]     490.6782 (1.10)     490.6782 (1.10)     490.6782 (1.10)     0.0000 (1.0)      490.6782 (1.10)     0.0000 (1.0)           0;0  2.0380 (0.91)          1           1
test_diff-diff-changed-noop[main]       478.3931 (1.07)     478.3931 (1.07)     478.3931 (1.07)     0.0000 (1.0)      478.3931 (1.07)     0.0000 (1.0)           0;0  2.0903 (0.93)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     439.0802 (1.0)      439.0802 (1.0)      439.0802 (1.0)      0.0000 (1.0)      439.0802 (1.0)      0.0000 (1.0)           0;0  2.2775 (1.0)           1           1
test_diff-diff-noop[3.10.0]     482.3005 (1.10)     482.3005 (1.10)     482.3005 (1.10)     0.0000 (1.0)      482.3005 (1.10)     0.0000 (1.0)           0;0  2.0734 (0.91)          1           1
test_diff-diff-noop[main]       461.5742 (1.05)     461.5742 (1.05)     461.5742 (1.05)     0.0000 (1.0)      461.5742 (1.05)     0.0000 (1.0)           0;0  2.1665 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       850.0259 (1.0)        850.0259 (1.0)        850.0259 (1.0)      0.0000 (1.0)        850.0259 (1.0)      0.0000 (1.0)           0;0  1.1764 (1.0)           1           1
test_exp_show-exp[3.10.0]     4,969.7050 (5.85)     4,969.7050 (5.85)     4,969.7050 (5.85)     0.0000 (1.0)      4,969.7050 (5.85)     0.0000 (1.0)           0;0  0.2012 (0.17)          1           1
test_exp_show-exp[main]       4,241.4490 (4.99)     4,241.4490 (4.99)     4,241.4490 (4.99)     0.0000 (1.0)      4,241.4490 (4.99)     0.0000 (1.0)           0;0  0.2358 (0.20)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_fetch-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     453.3292 (1.01)     453.3292 (1.01)     453.3292 (1.01)     0.0000 (1.0)      453.3292 (1.01)     0.0000 (1.0)           0;0  2.2059 (0.99)          1           1
test_fetch-fetch[3.10.0]     460.4161 (1.02)     460.4161 (1.02)     460.4161 (1.02)     0.0000 (1.0)      460.4161 (1.02)     0.0000 (1.0)           0;0  2.1719 (0.98)          1           1
test_fetch-fetch[main]       450.6099 (1.0)      450.6099 (1.0)      450.6099 (1.0)      0.0000 (1.0)      450.6099 (1.0)      0.0000 (1.0)           0;0  2.2192 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]     354.8076 (1.0)      354.8076 (1.0)      354.8076 (1.0)      0.0000 (1.0)      354.8076 (1.0)      0.0000 (1.0)           0;0  2.8184 (1.0)           1           1
test_gc-gc[3.10.0]     361.3504 (1.02)     361.3504 (1.02)     361.3504 (1.02)     0.0000 (1.0)      361.3504 (1.02)     0.0000 (1.0)           0;0  2.7674 (0.98)          1           1
test_gc-gc[main]       358.3560 (1.01)     358.3560 (1.01)     358.3560 (1.01)     0.0000 (1.0)      358.3560 (1.01)     0.0000 (1.0)           0;0  2.7905 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get-get': 3 tests ----------------------------------------------------------------------------
Name (time in ms)             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     485.2289 (1.01)     485.2289 (1.01)     485.2289 (1.01)     0.0000 (1.0)      485.2289 (1.01)     0.0000 (1.0)           0;0  2.0609 (0.99)          1           1
test_get-get[3.10.0]     481.0325 (1.0)      481.0325 (1.0)      481.0325 (1.0)      0.0000 (1.0)      481.0325 (1.0)      0.0000 (1.0)           0;0  2.0789 (1.0)           1           1
test_get-get[main]       515.8793 (1.07)     515.8793 (1.07)     515.8793 (1.07)     0.0000 (1.0)      515.8793 (1.07)     0.0000 (1.0)           0;0  1.9384 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_get_url-get-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     326.8068 (1.0)      326.8068 (1.0)      326.8068 (1.0)      0.0000 (1.0)      326.8068 (1.0)      0.0000 (1.0)           0;0  3.0599 (1.0)           1           1
test_get_url-get-url[3.10.0]     355.2739 (1.09)     355.2739 (1.09)     355.2739 (1.09)     0.0000 (1.0)      355.2739 (1.09)     0.0000 (1.0)           0;0  2.8147 (0.92)          1           1
test_get_url-get-url[main]       351.8634 (1.08)     351.8634 (1.08)     351.8634 (1.08)     0.0000 (1.0)      351.8634 (1.08)     0.0000 (1.0)           0;0  2.8420 (0.93)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     127.3500 (1.02)     132.4564 (1.00)     129.0214 (1.02)     1.0873 (1.0)      128.8657 (1.02)     1.2251 (1.05)         27;6  7.7507 (0.98)        100           1
test_help---help[3.10.0]     124.7951 (1.0)      135.3214 (1.02)     126.7219 (1.0)      1.2931 (1.19)     126.5021 (1.0)      1.1635 (1.0)          21;3  7.8913 (1.0)         100           1
test_help---help[main]       125.4223 (1.01)     132.3869 (1.0)      127.7376 (1.01)     1.3821 (1.27)     127.3920 (1.01)     1.7504 (1.50)         25;3  7.8285 (0.99)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     693.2878 (1.00)     693.2878 (1.00)     693.2878 (1.00)     0.0000 (1.0)      693.2878 (1.00)     0.0000 (1.0)           0;0  1.4424 (1.00)          1           1
test_import-import[3.10.0]     692.0617 (1.0)      692.0617 (1.0)      692.0617 (1.0)      0.0000 (1.0)      692.0617 (1.0)      0.0000 (1.0)           0;0  1.4450 (1.0)           1           1
test_import-import[main]       743.1682 (1.07)     743.1682 (1.07)     743.1682 (1.07)     0.0000 (1.0)      743.1682 (1.07)     0.0000 (1.0)           0;0  1.3456 (0.93)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     713.1749 (1.01)     713.1749 (1.01)     713.1749 (1.01)     0.0000 (1.0)      713.1749 (1.01)     0.0000 (1.0)           0;0  1.4022 (0.99)          1           1
test_import_url-import-url[3.10.0]     733.5811 (1.04)     733.5811 (1.04)     733.5811 (1.04)     0.0000 (1.0)      733.5811 (1.04)     0.0000 (1.0)           0;0  1.3632 (0.96)          1           1
test_import_url-import-url[main]       707.5134 (1.0)      707.5134 (1.0)      707.5134 (1.0)      0.0000 (1.0)      707.5134 (1.0)      0.0000 (1.0)           0;0  1.4134 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     357.3413 (1.0)      400.7855 (1.0)      364.1934 (1.0)      6.5527 (1.0)      361.9037 (1.0)       7.6983 (1.0)          16;3  2.7458 (1.0)         100           1
test_init-init[3.10.0]     375.2318 (1.05)     415.9656 (1.04)     388.2562 (1.07)     8.2774 (1.26)     386.1209 (1.07)     11.5439 (1.50)         22;2  2.5756 (0.94)        100           1
test_init-init[main]       389.3156 (1.09)     429.6215 (1.07)     404.9647 (1.11)     8.9226 (1.36)     405.3196 (1.12)     15.4690 (2.01)         39;0  2.4694 (0.90)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     412.3433 (1.02)     412.3433 (1.02)     412.3433 (1.02)     0.0000 (1.0)      412.3433 (1.02)     0.0000 (1.0)           0;0  2.4252 (0.98)          1           1
test_list-list[3.10.0]     407.5037 (1.00)     407.5037 (1.00)     407.5037 (1.00)     0.0000 (1.0)      407.5037 (1.00)     0.0000 (1.0)           0;0  2.4540 (1.00)          1           1
test_list-list[main]       405.4879 (1.0)      405.4879 (1.0)      405.4879 (1.0)      0.0000 (1.0)      405.4879 (1.0)      0.0000 (1.0)           0;0  2.4662 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     397.9739 (1.03)     397.9739 (1.03)     397.9739 (1.03)     0.0000 (1.0)      397.9739 (1.03)     0.0000 (1.0)           0;0  2.5127 (0.97)          1           1
test_list-list-dvc-only[3.10.0]     399.1748 (1.03)     399.1748 (1.03)     399.1748 (1.03)     0.0000 (1.0)      399.1748 (1.03)     0.0000 (1.0)           0;0  2.5052 (0.97)          1           1
test_list-list-dvc-only[main]       386.6727 (1.0)      386.6727 (1.0)      386.6727 (1.0)      0.0000 (1.0)      386.6727 (1.0)      0.0000 (1.0)           0;0  2.5862 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     396.2467 (1.0)      396.2467 (1.0)      396.2467 (1.0)      0.0000 (1.0)      396.2467 (1.0)      0.0000 (1.0)           0;0  2.5237 (1.0)           1           1
test_list-list-recursive[3.10.0]     403.9271 (1.02)     403.9271 (1.02)     403.9271 (1.02)     0.0000 (1.0)      403.9271 (1.02)     0.0000 (1.0)           0;0  2.4757 (0.98)          1           1
test_list-list-recursive[main]       405.0922 (1.02)     405.0922 (1.02)     405.0922 (1.02)     0.0000 (1.0)      405.0922 (1.02)     0.0000 (1.0)           0;0  2.4686 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     390.3065 (1.00)     390.3065 (1.00)     390.3065 (1.00)     0.0000 (1.0)      390.3065 (1.00)     0.0000 (1.0)           0;0  2.5621 (1.00)          1           1
test_list-list-shallow[3.10.0]     388.4949 (1.0)      388.4949 (1.0)      388.4949 (1.0)      0.0000 (1.0)      388.4949 (1.0)      0.0000 (1.0)           0;0  2.5740 (1.0)           1           1
test_list-list-shallow[main]       391.5975 (1.01)     391.5975 (1.01)     391.5975 (1.01)     0.0000 (1.0)      391.5975 (1.01)     0.0000 (1.0)           0;0  2.5536 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_add-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     551.9692 (1.02)     551.9692 (1.02)     551.9692 (1.02)     0.0000 (1.0)      551.9692 (1.02)     0.0000 (1.0)           0;0  1.8117 (0.98)          1           1
test_partial_add-add[3.10.0]     555.0745 (1.03)     555.0745 (1.03)     555.0745 (1.03)     0.0000 (1.0)      555.0745 (1.03)     0.0000 (1.0)           0;0  1.8016 (0.97)          1           1
test_partial_add-add[main]       538.9222 (1.0)      538.9222 (1.0)      538.9222 (1.0)      0.0000 (1.0)      538.9222 (1.0)      0.0000 (1.0)           0;0  1.8556 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     580.9975 (1.01)     580.9975 (1.01)     580.9975 (1.01)     0.0000 (1.0)      580.9975 (1.01)     0.0000 (1.0)           0;0  1.7212 (0.99)          1           1
test_partial_add-add-partial[3.10.0]     587.0518 (1.02)     587.0518 (1.02)     587.0518 (1.02)     0.0000 (1.0)      587.0518 (1.02)     0.0000 (1.0)           0;0  1.7034 (0.98)          1           1
test_partial_add-add-partial[main]       572.8300 (1.0)      572.8300 (1.0)      572.8300 (1.0)      0.0000 (1.0)      572.8300 (1.0)      0.0000 (1.0)           0;0  1.7457 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     393.3448 (1.01)     393.3448 (1.01)     393.3448 (1.01)     0.0000 (1.0)      393.3448 (1.01)     0.0000 (1.0)           0;0  2.5423 (0.99)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     390.7133 (1.01)     390.7133 (1.01)     390.7133 (1.01)     0.0000 (1.0)      390.7133 (1.01)     0.0000 (1.0)           0;0  2.5594 (0.99)          1           1
test_partial_add-gc-cloud-noop[main]       387.6673 (1.0)      387.6673 (1.0)      387.6673 (1.0)      0.0000 (1.0)      387.6673 (1.0)      0.0000 (1.0)           0;0  2.5795 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     372.1109 (1.0)      372.1109 (1.0)      372.1109 (1.0)      0.0000 (1.0)      372.1109 (1.0)      0.0000 (1.0)           0;0  2.6874 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     378.3348 (1.02)     378.3348 (1.02)     378.3348 (1.02)     0.0000 (1.0)      378.3348 (1.02)     0.0000 (1.0)           0;0  2.6432 (0.98)          1           1
test_partial_add-gc-noop[main]       380.4041 (1.02)     380.4041 (1.02)     380.4041 (1.02)     0.0000 (1.0)      380.4041 (1.02)     0.0000 (1.0)           0;0  2.6288 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     420.4270 (1.0)      420.4270 (1.0)      420.4270 (1.0)      0.0000 (1.0)      420.4270 (1.0)      0.0000 (1.0)           0;0  2.3785 (1.0)           1           1
test_partial_add-push[3.10.0]     442.6720 (1.05)     442.6720 (1.05)     442.6720 (1.05)     0.0000 (1.0)      442.6720 (1.05)     0.0000 (1.0)           0;0  2.2590 (0.95)          1           1
test_partial_add-push[main]       443.0921 (1.05)     443.0921 (1.05)     443.0921 (1.05)     0.0000 (1.0)      443.0921 (1.05)     0.0000 (1.0)           0;0  2.2569 (0.95)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     426.0519 (1.03)     426.0519 (1.03)     426.0519 (1.03)     0.0000 (1.0)      426.0519 (1.03)     0.0000 (1.0)           0;0  2.3471 (0.97)          1           1
test_partial_add-push-partial[3.10.0]     414.2576 (1.0)      414.2576 (1.0)      414.2576 (1.0)      0.0000 (1.0)      414.2576 (1.0)      0.0000 (1.0)           0;0  2.4140 (1.0)           1           1
test_partial_add-push-partial[main]       465.8904 (1.12)     465.8904 (1.12)     465.8904 (1.12)     0.0000 (1.0)      465.8904 (1.12)     0.0000 (1.0)           0;0  2.1464 (0.89)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     583.2913 (1.0)      583.2913 (1.0)      583.2913 (1.0)      0.0000 (1.0)      583.2913 (1.0)      0.0000 (1.0)           0;0  1.7144 (1.0)           1           1
test_partial_remove-add[3.10.0]     602.8880 (1.03)     602.8880 (1.03)     602.8880 (1.03)     0.0000 (1.0)      602.8880 (1.03)     0.0000 (1.0)           0;0  1.6587 (0.97)          1           1
test_partial_remove-add[main]       627.4835 (1.08)     627.4835 (1.08)     627.4835 (1.08)     0.0000 (1.0)      627.4835 (1.08)     0.0000 (1.0)           0;0  1.5937 (0.93)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     528.7705 (1.0)      528.7705 (1.0)      528.7705 (1.0)      0.0000 (1.0)      528.7705 (1.0)      0.0000 (1.0)           0;0  1.8912 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     535.0635 (1.01)     535.0635 (1.01)     535.0635 (1.01)     0.0000 (1.0)      535.0635 (1.01)     0.0000 (1.0)           0;0  1.8689 (0.99)          1           1
test_partial_remove-add-update[main]       549.8799 (1.04)     549.8799 (1.04)     549.8799 (1.04)     0.0000 (1.0)      549.8799 (1.04)     0.0000 (1.0)           0;0  1.8186 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     362.8885 (1.0)      362.8885 (1.0)      362.8885 (1.0)      0.0000 (1.0)      362.8885 (1.0)      0.0000 (1.0)           0;0  2.7557 (1.0)           1           1
test_partial_remove-gc[3.10.0]     371.3776 (1.02)     371.3776 (1.02)     371.3776 (1.02)     0.0000 (1.0)      371.3776 (1.02)     0.0000 (1.0)           0;0  2.6927 (0.98)          1           1
test_partial_remove-gc[main]       377.1099 (1.04)     377.1099 (1.04)     377.1099 (1.04)     0.0000 (1.0)      377.1099 (1.04)     0.0000 (1.0)           0;0  2.6517 (0.96)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     388.8855 (1.01)     388.8855 (1.01)     388.8855 (1.01)     0.0000 (1.0)      388.8855 (1.01)     0.0000 (1.0)           0;0  2.5715 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     384.5068 (1.0)      384.5068 (1.0)      384.5068 (1.0)      0.0000 (1.0)      384.5068 (1.0)      0.0000 (1.0)           0;0  2.6007 (1.0)           1           1
test_partial_remove-gc-cloud[main]       385.0259 (1.00)     385.0259 (1.00)     385.0259 (1.00)     0.0000 (1.0)      385.0259 (1.00)     0.0000 (1.0)           0;0  2.5972 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     438.2341 (1.05)     438.2341 (1.05)     438.2341 (1.05)     0.0000 (1.0)      438.2341 (1.05)     0.0000 (1.0)           0;0  2.2819 (0.95)          1           1
test_partial_remove-push[3.10.0]     417.8401 (1.0)      417.8401 (1.0)      417.8401 (1.0)      0.0000 (1.0)      417.8401 (1.0)      0.0000 (1.0)           0;0  2.3933 (1.0)           1           1
test_partial_remove-push[main]       467.6048 (1.12)     467.6048 (1.12)     467.6048 (1.12)     0.0000 (1.0)      467.6048 (1.12)     0.0000 (1.0)           0;0  2.1386 (0.89)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     388.9447 (1.02)     388.9447 (1.02)     388.9447 (1.02)     0.0000 (1.0)      388.9447 (1.02)     0.0000 (1.0)           0;0  2.5711 (0.98)          1           1
test_partial_remove-push-update[3.10.0]     382.7958 (1.0)      382.7958 (1.0)      382.7958 (1.0)      0.0000 (1.0)      382.7958 (1.0)      0.0000 (1.0)           0;0  2.6124 (1.0)           1           1
test_partial_remove-push-update[main]       442.7321 (1.16)     442.7321 (1.16)     442.7321 (1.16)     0.0000 (1.0)      442.7321 (1.16)     0.0000 (1.0)           0;0  2.2587 (0.86)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     416.3441 (1.0)      418.1515 (1.0)      417.5085 (1.0)      0.7876 (1.0)      417.8483 (1.0)      1.2596 (1.0)           1;0  2.3952 (1.0)           5           3
test_plots-plots-diff[3.10.0]     780.1549 (1.87)     798.0903 (1.91)     785.5275 (1.88)     7.1528 (9.08)     783.0138 (1.87)     5.3753 (4.27)          1;1  1.2730 (0.53)          5           3
test_plots-plots-diff[main]       779.1042 (1.87)     786.9908 (1.88)     782.8338 (1.88)     3.5961 (4.57)     781.6620 (1.87)     6.5812 (5.22)          2;0  1.2774 (0.53)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       428.5606 (1.0)        434.6854 (1.0)        431.8770 (1.0)      2.3595 (1.0)        432.0063 (1.0)      3.4564 (1.0)           2;0  2.3155 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,025.0354 (2.39)     1,039.3677 (2.39)     1,030.0248 (2.38)     5.9177 (2.51)     1,027.1861 (2.38)     8.1680 (2.36)          1;0  0.9709 (0.42)          5           3
test_plots-plots-diff-json[main]         849.3505 (1.98)       857.1149 (1.97)       852.5090 (1.97)     3.1760 (1.35)       852.5985 (1.97)     4.9350 (1.43)          1;0  1.1730 (0.51)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     385.9329 (1.0)      390.4786 (1.0)      388.5974 (1.0)      1.7438 (2.19)     388.6339 (1.0)      2.3198 (2.08)          2;0  2.5734 (1.0)           5           3
test_plots-plots-show[3.10.0]     648.6846 (1.68)     650.7656 (1.67)     649.8396 (1.67)     0.7970 (1.0)      650.0316 (1.67)     1.1127 (1.0)           2;0  1.5388 (0.60)          5           3
test_plots-plots-show[main]       662.9355 (1.72)     674.4056 (1.73)     667.7049 (1.72)     4.8933 (6.14)     667.1177 (1.72)     8.3671 (7.52)          1;0  1.4977 (0.58)          5           3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     401.8589 (1.0)      418.1594 (1.0)      406.8376 (1.0)      6.5558 (2.46)     403.7651 (1.0)      6.2372 (1.83)          1;0  2.4580 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     795.2944 (1.98)     805.6504 (1.93)     798.9857 (1.96)     4.2028 (1.57)     797.4201 (1.97)     5.8003 (1.70)          1;0  1.2516 (0.51)          5           3
test_plots-plots-show-json[main]       706.4087 (1.76)     712.9835 (1.71)     710.7810 (1.75)     2.6688 (1.0)      711.8474 (1.76)     3.4112 (1.0)           1;0  1.4069 (0.57)          5           3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_push-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     444.3016 (1.0)      444.3016 (1.0)      444.3016 (1.0)      0.0000 (1.0)      444.3016 (1.0)      0.0000 (1.0)           0;0  2.2507 (1.0)           1           1
test_push-push[3.10.0]     454.8040 (1.02)     454.8040 (1.02)     454.8040 (1.02)     0.0000 (1.0)      454.8040 (1.02)     0.0000 (1.0)           0;0  2.1987 (0.98)          1           1
test_push-push[main]       460.6438 (1.04)     460.6438 (1.04)     460.6438 (1.04)     0.0000 (1.0)      460.6438 (1.04)     0.0000 (1.0)           0;0  2.1709 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_sharing-add': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     595.4597 (1.0)      595.4597 (1.0)      595.4597 (1.0)      0.0000 (1.0)      595.4597 (1.0)      0.0000 (1.0)           0;0  1.6794 (1.0)           1           1
test_sharing-add[3.10.0]     607.5180 (1.02)     607.5180 (1.02)     607.5180 (1.02)     0.0000 (1.0)      607.5180 (1.02)     0.0000 (1.0)           0;0  1.6460 (0.98)          1           1
test_sharing-add[main]       601.3789 (1.01)     601.3789 (1.01)     601.3789 (1.01)     0.0000 (1.0)      601.3789 (1.01)     0.0000 (1.0)           0;0  1.6628 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     551.9070 (1.0)      551.9070 (1.0)      551.9070 (1.0)      0.0000 (1.0)      551.9070 (1.0)      0.0000 (1.0)           0;0  1.8119 (1.0)           1           1
test_sharing-add-noop[3.10.0]     556.3932 (1.01)     556.3932 (1.01)     556.3932 (1.01)     0.0000 (1.0)      556.3932 (1.01)     0.0000 (1.0)           0;0  1.7973 (0.99)          1           1
test_sharing-add-noop[main]       561.5115 (1.02)     561.5115 (1.02)     561.5115 (1.02)     0.0000 (1.0)      561.5115 (1.02)     0.0000 (1.0)           0;0  1.7809 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     442.7576 (1.0)      442.7576 (1.0)      442.7576 (1.0)      0.0000 (1.0)      442.7576 (1.0)      0.0000 (1.0)           0;0  2.2586 (1.0)           1           1
test_sharing-checkout[3.10.0]     471.1542 (1.06)     471.1542 (1.06)     471.1542 (1.06)     0.0000 (1.0)      471.1542 (1.06)     0.0000 (1.0)           0;0  2.1224 (0.94)          1           1
test_sharing-checkout[main]       452.2464 (1.02)     452.2464 (1.02)     452.2464 (1.02)     0.0000 (1.0)      452.2464 (1.02)     0.0000 (1.0)           0;0  2.2112 (0.98)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     379.8615 (1.0)      379.8615 (1.0)      379.8615 (1.0)      0.0000 (1.0)      379.8615 (1.0)      0.0000 (1.0)           0;0  2.6325 (1.0)           1           1
test_sharing-checkout-noop[3.10.0]     398.7657 (1.05)     398.7657 (1.05)     398.7657 (1.05)     0.0000 (1.0)      398.7657 (1.05)     0.0000 (1.0)           0;0  2.5077 (0.95)          1           1
test_sharing-checkout-noop[main]       394.5157 (1.04)     394.5157 (1.04)     394.5157 (1.04)     0.0000 (1.0)      394.5157 (1.04)     0.0000 (1.0)           0;0  2.5348 (0.96)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     487.9235 (1.08)     487.9235 (1.08)     487.9235 (1.08)     0.0000 (1.0)      487.9235 (1.08)     0.0000 (1.0)           0;0  2.0495 (0.93)          1           1
test_sharing-fetch[3.10.0]     465.1298 (1.03)     465.1298 (1.03)     465.1298 (1.03)     0.0000 (1.0)      465.1298 (1.03)     0.0000 (1.0)           0;0  2.1499 (0.97)          1           1
test_sharing-fetch[main]       452.2518 (1.0)      452.2518 (1.0)      452.2518 (1.0)      0.0000 (1.0)      452.2518 (1.0)      0.0000 (1.0)           0;0  2.2112 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     399.4815 (1.0)      399.4815 (1.0)      399.4815 (1.0)      0.0000 (1.0)      399.4815 (1.0)      0.0000 (1.0)           0;0  2.5032 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     415.0646 (1.04)     415.0646 (1.04)     415.0646 (1.04)     0.0000 (1.0)      415.0646 (1.04)     0.0000 (1.0)           0;0  2.4093 (0.96)          1           1
test_sharing-fetch-noop[main]       422.1741 (1.06)     422.1741 (1.06)     422.1741 (1.06)     0.0000 (1.0)      422.1741 (1.06)     0.0000 (1.0)           0;0  2.3687 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     440.9225 (1.02)     440.9225 (1.02)     440.9225 (1.02)     0.0000 (1.0)      440.9225 (1.02)     0.0000 (1.0)           0;0  2.2680 (0.99)          1           1
test_sharing-push[3.10.0]     434.3405 (1.0)      434.3405 (1.0)      434.3405 (1.0)      0.0000 (1.0)      434.3405 (1.0)      0.0000 (1.0)           0;0  2.3023 (1.0)           1           1
test_sharing-push[main]       470.9322 (1.08)     470.9322 (1.08)     470.9322 (1.08)     0.0000 (1.0)      470.9322 (1.08)     0.0000 (1.0)           0;0  2.1234 (0.92)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     396.0881 (1.02)     396.0881 (1.02)     396.0881 (1.02)     0.0000 (1.0)      396.0881 (1.02)     0.0000 (1.0)           0;0  2.5247 (0.98)          1           1
test_sharing-push-noop[3.10.0]     386.8402 (1.0)      386.8402 (1.0)      386.8402 (1.0)      0.0000 (1.0)      386.8402 (1.0)      0.0000 (1.0)           0;0  2.5850 (1.0)           1           1
test_sharing-push-noop[main]       431.1300 (1.11)     431.1300 (1.11)     431.1300 (1.11)     0.0000 (1.0)      431.1300 (1.11)     0.0000 (1.0)           0;0  2.3195 (0.90)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_status-status': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     424.8836 (1.04)     424.8836 (1.04)     424.8836 (1.04)     0.0000 (1.0)      424.8836 (1.04)     0.0000 (1.0)           0;0  2.3536 (0.96)          1           1
test_status-status[3.10.0]     425.0469 (1.04)     425.0469 (1.04)     425.0469 (1.04)     0.0000 (1.0)      425.0469 (1.04)     0.0000 (1.0)           0;0  2.3527 (0.96)          1           1
test_status-status[main]       409.2103 (1.0)      409.2103 (1.0)      409.2103 (1.0)      0.0000 (1.0)      409.2103 (1.0)      0.0000 (1.0)           0;0  2.4437 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     382.9058 (1.04)     382.9058 (1.04)     382.9058 (1.04)     0.0000 (1.0)      382.9058 (1.04)     0.0000 (1.0)           0;0  2.6116 (0.97)          1           1
test_status-status-changed[3.10.0]     378.9439 (1.02)     378.9439 (1.02)     378.9439 (1.02)     0.0000 (1.0)      378.9439 (1.02)     0.0000 (1.0)           0;0  2.6389 (0.98)          1           1
test_status-status-changed[main]       369.9334 (1.0)      369.9334 (1.0)      369.9334 (1.0)      0.0000 (1.0)      369.9334 (1.0)      0.0000 (1.0)           0;0  2.7032 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     364.9667 (1.0)      364.9667 (1.0)      364.9667 (1.0)      0.0000 (1.0)      364.9667 (1.0)      0.0000 (1.0)           0;0  2.7400 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     375.0851 (1.03)     375.0851 (1.03)     375.0851 (1.03)     0.0000 (1.0)      375.0851 (1.03)     0.0000 (1.0)           0;0  2.6661 (0.97)          1           1
test_status-status-changed-noop[main]       369.2834 (1.01)     369.2834 (1.01)     369.2834 (1.01)     0.0000 (1.0)      369.2834 (1.01)     0.0000 (1.0)           0;0  2.7079 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     388.3591 (1.05)     388.3591 (1.05)     388.3591 (1.05)     0.0000 (1.0)      388.3591 (1.05)     0.0000 (1.0)           0;0  2.5749 (0.95)          1           1
test_status-status-noop[3.10.0]     375.4229 (1.02)     375.4229 (1.02)     375.4229 (1.02)     0.0000 (1.0)      375.4229 (1.02)     0.0000 (1.0)           0;0  2.6637 (0.99)          1           1
test_status-status-noop[main]       369.8670 (1.0)      369.8670 (1.0)      369.8670 (1.0)      0.0000 (1.0)      369.8670 (1.0)      0.0000 (1.0)           0;0  2.7037 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     681.6742 (1.07)     681.6742 (1.07)     681.6742 (1.07)     0.0000 (1.0)      681.6742 (1.07)     0.0000 (1.0)           0;0  1.4670 (0.93)          1           1
test_update-import-url[3.10.0]     679.5306 (1.07)     679.5306 (1.07)     679.5306 (1.07)     0.0000 (1.0)      679.5306 (1.07)     0.0000 (1.0)           0;0  1.4716 (0.94)          1           1
test_update-import-url[main]       636.5896 (1.0)      636.5896 (1.0)      636.5896 (1.0)      0.0000 (1.0)      636.5896 (1.0)      0.0000 (1.0)           0;0  1.5709 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     544.5294 (1.04)     544.5294 (1.04)     544.5294 (1.04)     0.0000 (1.0)      544.5294 (1.04)     0.0000 (1.0)           0;0  1.8364 (0.96)          1           1
test_update-update[3.10.0]     566.0109 (1.08)     566.0109 (1.08)     566.0109 (1.08)     0.0000 (1.0)      566.0109 (1.08)     0.0000 (1.0)           0;0  1.7668 (0.93)          1           1
test_update-update[main]       523.8368 (1.0)      523.8368 (1.0)      523.8368 (1.0)      0.0000 (1.0)      523.8368 (1.0)      0.0000 (1.0)           0;0  1.9090 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     413.1036 (1.01)     413.1036 (1.01)     413.1036 (1.01)     0.0000 (1.0)      413.1036 (1.01)     0.0000 (1.0)           0;0  2.4207 (0.99)          1           1
test_update-update-noop[3.10.0]     435.8590 (1.07)     435.8590 (1.07)     435.8590 (1.07)     0.0000 (1.0)      435.8590 (1.07)     0.0000 (1.0)           0;0  2.2943 (0.94)          1           1
test_update-update-noop[main]       408.3033 (1.0)      408.3033 (1.0)      408.3033 (1.0)      0.0000 (1.0)      408.3033 (1.0)      0.0000 (1.0)           0;0  2.4492 (1.0)           1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean