Fri Dec  8 17:43:47 UTC 2023
dataset: used-cars
project: example-get-started

------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2]     6.6282 (1.33)     6.6282 (1.33)     6.6282 (1.33)     0.0000 (1.0)      6.6282 (1.33)     0.0000 (1.0)           0;0  0.1509 (0.75)          1           1
test_add-add[3.10.0]     4.9722 (1.0)      4.9722 (1.0)      4.9722 (1.0)      0.0000 (1.0)      4.9722 (1.0)      0.0000 (1.0)           0;0  0.2011 (1.0)           1           1
test_add-add[main]       5.7416 (1.15)     5.7416 (1.15)     5.7416 (1.15)     0.0000 (1.0)      5.7416 (1.15)     0.0000 (1.0)           0;0  0.1742 (0.87)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2]     3.1131 (1.0)      3.1131 (1.0)      3.1131 (1.0)      0.0000 (1.0)      3.1131 (1.0)      0.0000 (1.0)           0;0  0.3212 (1.0)           1           1
test_checkout_copy-checkout[3.10.0]     3.3782 (1.09)     3.3782 (1.09)     3.3782 (1.09)     0.0000 (1.0)      3.3782 (1.09)     0.0000 (1.0)           0;0  0.2960 (0.92)          1           1
test_checkout_copy-checkout[main]       4.2495 (1.37)     4.2495 (1.37)     4.2495 (1.37)     0.0000 (1.0)      4.2495 (1.37)     0.0000 (1.0)           0;0  0.2353 (0.73)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2]     747.9244 (1.74)     747.9244 (1.74)     747.9244 (1.74)     0.0000 (1.0)      747.9244 (1.74)     0.0000 (1.0)           0;0  1.3370 (0.57)          1           1
test_checkout_copy-checkout-noop[3.10.0]     503.8293 (1.17)     503.8293 (1.17)     503.8293 (1.17)     0.0000 (1.0)      503.8293 (1.17)     0.0000 (1.0)           0;0  1.9848 (0.85)          1           1
test_checkout_copy-checkout-noop[main]       428.8832 (1.0)      428.8832 (1.0)      428.8832 (1.0)      0.0000 (1.0)      428.8832 (1.0)      0.0000 (1.0)           0;0  2.3316 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                   Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2]     422.4680 (1.0)      422.4680 (1.0)      422.4680 (1.0)      0.0000 (1.0)      422.4680 (1.0)      0.0000 (1.0)           0;0  2.3670 (1.0)           1           1
test_checkout_copy-checkout-update[3.10.0]     436.0477 (1.03)     436.0477 (1.03)     436.0477 (1.03)     0.0000 (1.0)      436.0477 (1.03)     0.0000 (1.0)           0;0  2.2933 (0.97)          1           1
test_checkout_copy-checkout-update[main]       450.5506 (1.07)     450.5506 (1.07)     450.5506 (1.07)     0.0000 (1.0)      450.5506 (1.07)     0.0000 (1.0)           0;0  2.2195 (0.94)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                  Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2]       509.1180 (1.0)        509.1180 (1.0)        509.1180 (1.0)      0.0000 (1.0)        509.1180 (1.0)      0.0000 (1.0)           0;0  1.9642 (1.0)           1           1
test_checkout_hardlink-checkout[3.10.0]       525.1242 (1.03)       525.1242 (1.03)       525.1242 (1.03)     0.0000 (1.0)        525.1242 (1.03)     0.0000 (1.0)           0;0  1.9043 (0.97)          1           1
test_checkout_hardlink-checkout[main]       2,151.7160 (4.23)     2,151.7160 (4.23)     2,151.7160 (4.23)     0.0000 (1.0)      2,151.7160 (4.23)     0.0000 (1.0)           0;0  0.4647 (0.24)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2]     363.5724 (1.0)      363.5724 (1.0)      363.5724 (1.0)      0.0000 (1.0)      363.5724 (1.0)      0.0000 (1.0)           0;0  2.7505 (1.0)           1           1
test_checkout_hardlink-checkout-noop[3.10.0]     373.1831 (1.03)     373.1831 (1.03)     373.1831 (1.03)     0.0000 (1.0)      373.1831 (1.03)     0.0000 (1.0)           0;0  2.6797 (0.97)          1           1
test_checkout_hardlink-checkout-noop[main]       378.9371 (1.04)     378.9371 (1.04)     378.9371 (1.04)     0.0000 (1.0)      378.9371 (1.04)     0.0000 (1.0)           0;0  2.6390 (0.96)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2]     400.2932 (1.0)      400.2932 (1.0)      400.2932 (1.0)      0.0000 (1.0)      400.2932 (1.0)      0.0000 (1.0)           0;0  2.4982 (1.0)           1           1
test_checkout_hardlink-checkout-update[3.10.0]     413.5513 (1.03)     413.5513 (1.03)     413.5513 (1.03)     0.0000 (1.0)      413.5513 (1.03)     0.0000 (1.0)           0;0  2.4181 (0.97)          1           1
test_checkout_hardlink-checkout-update[main]       407.5879 (1.02)     407.5879 (1.02)     407.5879 (1.02)     0.0000 (1.0)      407.5879 (1.02)     0.0000 (1.0)           0;0  2.4535 (0.98)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                 Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2]       521.7941 (1.0)        521.7941 (1.0)        521.7941 (1.0)      0.0000 (1.0)        521.7941 (1.0)      0.0000 (1.0)           0;0  1.9165 (1.0)           1           1
test_checkout_symlink-checkout[3.10.0]       556.6388 (1.07)       556.6388 (1.07)       556.6388 (1.07)     0.0000 (1.0)        556.6388 (1.07)     0.0000 (1.0)           0;0  1.7965 (0.94)          1           1
test_checkout_symlink-checkout[main]       2,109.6377 (4.04)     2,109.6377 (4.04)     2,109.6377 (4.04)     0.0000 (1.0)      2,109.6377 (4.04)     0.0000 (1.0)           0;0  0.4740 (0.25)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2]     377.3633 (1.0)      377.3633 (1.0)      377.3633 (1.0)      0.0000 (1.0)      377.3633 (1.0)      0.0000 (1.0)           0;0  2.6500 (1.0)           1           1
test_checkout_symlink-checkout-noop[3.10.0]     393.9023 (1.04)     393.9023 (1.04)     393.9023 (1.04)     0.0000 (1.0)      393.9023 (1.04)     0.0000 (1.0)           0;0  2.5387 (0.96)          1           1
test_checkout_symlink-checkout-noop[main]       395.0994 (1.05)     395.0994 (1.05)     395.0994 (1.05)     0.0000 (1.0)      395.0994 (1.05)     0.0000 (1.0)           0;0  2.5310 (0.96)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                      Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2]     430.2868 (1.0)      430.2868 (1.0)      430.2868 (1.0)      0.0000 (1.0)      430.2868 (1.0)      0.0000 (1.0)           0;0  2.3240 (1.0)           1           1
test_checkout_symlink-checkout-update[3.10.0]     441.7540 (1.03)     441.7540 (1.03)     441.7540 (1.03)     0.0000 (1.0)      441.7540 (1.03)     0.0000 (1.0)           0;0  2.2637 (0.97)          1           1
test_checkout_symlink-checkout-update[main]       441.9457 (1.03)     441.9457 (1.03)     441.9457 (1.03)     0.0000 (1.0)      441.9457 (1.03)     0.0000 (1.0)           0;0  2.2627 (0.97)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                                Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2]       476.9917 (1.07)       476.9917 (1.07)       476.9917 (1.07)     0.0000 (1.0)        476.9917 (1.07)     0.0000 (1.0)           0;0  2.0965 (0.93)          1           1
test_data_status-data-changed[3.10.0]       445.3308 (1.0)        445.3308 (1.0)        445.3308 (1.0)      0.0000 (1.0)        445.3308 (1.0)      0.0000 (1.0)           0;0  2.2455 (1.0)           1           1
test_data_status-data-changed[main]       3,368.8057 (7.56)     3,368.8057 (7.56)     3,368.8057 (7.56)     0.0000 (1.0)      3,368.8057 (7.56)     0.0000 (1.0)           0;0  0.2968 (0.13)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2]     1.7958 (4.18)     1.7958 (4.18)     1.7958 (4.18)     0.0000 (1.0)      1.7958 (4.18)     0.0000 (1.0)           0;0  0.5569 (0.24)          1           1
test_data_status-data-changed-noop[3.10.0]     2.3387 (5.45)     2.3387 (5.45)     2.3387 (5.45)     0.0000 (1.0)      2.3387 (5.45)     0.0000 (1.0)           0;0  0.4276 (0.18)          1           1
test_data_status-data-changed-noop[main]       0.4295 (1.0)      0.4295 (1.0)      0.4295 (1.0)      0.0000 (1.0)      0.4295 (1.0)      0.0000 (1.0)           0;0  2.3283 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                         Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2]     6.0083 (1.04)     6.0083 (1.04)     6.0083 (1.04)     0.0000 (1.0)      6.0083 (1.04)     0.0000 (1.0)           0;0  0.1664 (0.96)          1           1
test_data_status-data-new[3.10.0]     5.7706 (1.0)      5.7706 (1.0)      5.7706 (1.0)      0.0000 (1.0)      5.7706 (1.0)      0.0000 (1.0)           0;0  0.1733 (1.0)           1           1
test_data_status-data-new[main]       6.3553 (1.10)     6.3553 (1.10)     6.3553 (1.10)     0.0000 (1.0)      6.3553 (1.10)     0.0000 (1.0)           0;0  0.1573 (0.91)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2]     473.1381 (1.10)     473.1381 (1.10)     473.1381 (1.10)     0.0000 (1.0)      473.1381 (1.10)     0.0000 (1.0)           0;0  2.1135 (0.91)          1           1
test_data_status-data-noop[3.10.0]     431.6500 (1.01)     431.6500 (1.01)     431.6500 (1.01)     0.0000 (1.0)      431.6500 (1.01)     0.0000 (1.0)           0;0  2.3167 (0.99)          1           1
test_data_status-data-noop[main]       428.3138 (1.0)      428.3138 (1.0)      428.3138 (1.0)      0.0000 (1.0)      428.3138 (1.0)      0.0000 (1.0)           0;0  2.3347 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s)                                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2]     1.3723 (3.01)     1.3723 (3.01)     1.3723 (3.01)     0.0000 (1.0)      1.3723 (3.01)     0.0000 (1.0)           0;0  0.7287 (0.33)          1           1
test_data_status_all_flags-data-changed[3.10.0]     0.4563 (1.0)      0.4563 (1.0)      0.4563 (1.0)      0.0000 (1.0)      0.4563 (1.0)      0.0000 (1.0)           0;0  2.1917 (1.0)           1           1
test_data_status_all_flags-data-changed[main]       2.0252 (4.44)     2.0252 (4.44)     2.0252 (4.44)     0.0000 (1.0)      2.0252 (4.44)     0.0000 (1.0)           0;0  0.4938 (0.23)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2]     2.3549 (5.21)     2.3549 (5.21)     2.3549 (5.21)     0.0000 (1.0)      2.3549 (5.21)     0.0000 (1.0)           0;0  0.4246 (0.19)          1           1
test_data_status_all_flags-data-changed-noop[3.10.0]     0.4523 (1.0)      0.4523 (1.0)      0.4523 (1.0)      0.0000 (1.0)      0.4523 (1.0)      0.0000 (1.0)           0;0  2.2111 (1.0)           1           1
test_data_status_all_flags-data-changed-noop[main]       0.4530 (1.00)     0.4530 (1.00)     0.4530 (1.00)     0.0000 (1.0)      0.4530 (1.00)     0.0000 (1.0)           0;0  2.2074 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s)                                   Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2]     5.8902 (1.03)     5.8902 (1.03)     5.8902 (1.03)     0.0000 (1.0)      5.8902 (1.03)     0.0000 (1.0)           0;0  0.1698 (0.97)          1           1
test_data_status_all_flags-data-new[3.10.0]     5.7261 (1.0)      5.7261 (1.0)      5.7261 (1.0)      0.0000 (1.0)      5.7261 (1.0)      0.0000 (1.0)           0;0  0.1746 (1.0)           1           1
test_data_status_all_flags-data-new[main]       6.6839 (1.17)     6.6839 (1.17)     6.6839 (1.17)     0.0000 (1.0)      6.6839 (1.17)     0.0000 (1.0)           0;0  0.1496 (0.86)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                     Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2]     496.5291 (1.11)     496.5291 (1.11)     496.5291 (1.11)     0.0000 (1.0)      496.5291 (1.11)     0.0000 (1.0)           0;0  2.0140 (0.90)          1           1
test_data_status_all_flags-data-noop[3.10.0]     448.1888 (1.0)      448.1888 (1.0)      448.1888 (1.0)      0.0000 (1.0)      448.1888 (1.0)      0.0000 (1.0)           0;0  2.2312 (1.0)           1           1
test_data_status_all_flags-data-noop[main]       457.4657 (1.02)     457.4657 (1.02)     457.4657 (1.02)     0.0000 (1.0)      457.4657 (1.02)     0.0000 (1.0)           0;0  2.1860 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2]     4.8660 (1.02)     4.8660 (1.02)     4.8660 (1.02)     0.0000 (1.0)      4.8660 (1.02)     0.0000 (1.0)           0;0  0.2055 (0.98)          1           1
test_diff-diff[3.10.0]     6.8184 (1.43)     6.8184 (1.43)     6.8184 (1.43)     0.0000 (1.0)      6.8184 (1.43)     0.0000 (1.0)           0;0  0.1467 (0.70)          1           1
test_diff-diff[main]       4.7558 (1.0)      4.7558 (1.0)      4.7558 (1.0)      0.0000 (1.0)      4.7558 (1.0)      0.0000 (1.0)           0;0  0.2103 (1.0)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2]     455.2036 (1.01)     455.2036 (1.01)     455.2036 (1.01)     0.0000 (1.0)      455.2036 (1.01)     0.0000 (1.0)           0;0  2.1968 (0.99)          1           1
test_diff-diff-changed[3.10.0]     450.7171 (1.0)      450.7171 (1.0)      450.7171 (1.0)      0.0000 (1.0)      450.7171 (1.0)      0.0000 (1.0)           0;0  2.2187 (1.0)           1           1
test_diff-diff-changed[main]       450.9370 (1.00)     450.9370 (1.00)     450.9370 (1.00)     0.0000 (1.0)      450.9370 (1.00)     0.0000 (1.0)           0;0  2.2176 (1.00)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_diff-diff-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                           Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2]     2.1983 (4.86)     2.1983 (4.86)     2.1983 (4.86)     0.0000 (1.0)      2.1983 (4.86)     0.0000 (1.0)           0;0  0.4549 (0.21)          1           1
test_diff-diff-changed-noop[3.10.0]     0.4519 (1.0)      0.4519 (1.0)      0.4519 (1.0)      0.0000 (1.0)      0.4519 (1.0)      0.0000 (1.0)           0;0  2.2127 (1.0)           1           1
test_diff-diff-changed-noop[main]       0.4564 (1.01)     0.4564 (1.01)     0.4564 (1.01)     0.0000 (1.0)      0.4564 (1.01)     0.0000 (1.0)           0;0  2.1911 (0.99)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                    Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2]     440.9305 (1.0)      440.9305 (1.0)      440.9305 (1.0)      0.0000 (1.0)      440.9305 (1.0)      0.0000 (1.0)           0;0  2.2679 (1.0)           1           1
test_diff-diff-noop[3.10.0]     445.7909 (1.01)     445.7909 (1.01)     445.7909 (1.01)     0.0000 (1.0)      445.7909 (1.01)     0.0000 (1.0)           0;0  2.2432 (0.99)          1           1
test_diff-diff-noop[main]       451.6204 (1.02)     451.6204 (1.02)     451.6204 (1.02)     0.0000 (1.0)      451.6204 (1.02)     0.0000 (1.0)           0;0  2.2142 (0.98)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                    Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2]       831.8317 (1.0)        831.8317 (1.0)        831.8317 (1.0)      0.0000 (1.0)        831.8317 (1.0)      0.0000 (1.0)           0;0  1.2022 (1.0)           1           1
test_exp_show-exp[3.10.0]     5,337.0517 (6.42)     5,337.0517 (6.42)     5,337.0517 (6.42)     0.0000 (1.0)      5,337.0517 (6.42)     0.0000 (1.0)           0;0  0.1874 (0.16)          1           1
test_exp_show-exp[main]       4,713.8319 (5.67)     4,713.8319 (5.67)     4,713.8319 (5.67)     0.0000 (1.0)      4,713.8319 (5.67)     0.0000 (1.0)           0;0  0.2121 (0.18)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2]     3.0418 (1.10)     3.0418 (1.10)     3.0418 (1.10)     0.0000 (1.0)      3.0418 (1.10)     0.0000 (1.0)           0;0  0.3287 (0.91)          1           1
test_fetch-fetch[3.10.0]     3.1787 (1.15)     3.1787 (1.15)     3.1787 (1.15)     0.0000 (1.0)      3.1787 (1.15)     0.0000 (1.0)           0;0  0.3146 (0.87)          1           1
test_fetch-fetch[main]       2.7711 (1.0)      2.7711 (1.0)      2.7711 (1.0)      0.0000 (1.0)      2.7711 (1.0)      0.0000 (1.0)           0;0  0.3609 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests --------------------------------------------------------------------------------
Name (time in ms)             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2]       643.2399 (1.0)        643.2399 (1.0)        643.2399 (1.0)      0.0000 (1.0)        643.2399 (1.0)      0.0000 (1.0)           0;0  1.5546 (1.0)           1           1
test_gc-gc[3.10.0]       662.1354 (1.03)       662.1354 (1.03)       662.1354 (1.03)     0.0000 (1.0)        662.1354 (1.03)     0.0000 (1.0)           0;0  1.5103 (0.97)          1           1
test_gc-gc[main]       1,411.9561 (2.20)     1,411.9561 (2.20)     1,411.9561 (2.20)     0.0000 (1.0)      1,411.9561 (2.20)     0.0000 (1.0)           0;0  0.7082 (0.46)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s)            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2]     2.8182 (1.44)     2.8182 (1.44)     2.8182 (1.44)     0.0000 (1.0)      2.8182 (1.44)     0.0000 (1.0)           0;0  0.3548 (0.69)          1           1
test_get-get[3.10.0]     2.5238 (1.29)     2.5238 (1.29)     2.5238 (1.29)     0.0000 (1.0)      2.5238 (1.29)     0.0000 (1.0)           0;0  0.3962 (0.77)          1           1
test_get-get[main]       1.9553 (1.0)      1.9553 (1.0)      1.9553 (1.0)      0.0000 (1.0)      1.9553 (1.0)      0.0000 (1.0)           0;0  0.5114 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2]     1.8199 (1.01)     1.8199 (1.01)     1.8199 (1.01)     0.0000 (1.0)      1.8199 (1.01)     0.0000 (1.0)           0;0  0.5495 (0.99)          1           1
test_get_url-get-url[3.10.0]     1.8004 (1.0)      1.8004 (1.0)      1.8004 (1.0)      0.0000 (1.0)      1.8004 (1.0)      0.0000 (1.0)           0;0  0.5554 (1.0)           1           1
test_get_url-get-url[main]       3.4275 (1.90)     3.4275 (1.90)     3.4275 (1.90)     0.0000 (1.0)      3.4275 (1.90)     0.0000 (1.0)           0;0  0.2918 (0.53)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                 Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2]     128.3949 (1.01)     134.6914 (1.00)     130.8236 (1.01)     1.2189 (1.0)      130.8009 (1.01)     1.7697 (1.0)          38;1  7.6439 (0.99)        100           1
test_help---help[3.10.0]     127.0145 (1.0)      134.1520 (1.0)      129.5132 (1.0)      1.4367 (1.18)     129.2026 (1.0)      1.9633 (1.11)         30;3  7.7212 (1.0)         100           1
test_help---help[main]       127.1496 (1.00)     140.5581 (1.05)     130.0807 (1.00)     1.9348 (1.59)     129.7316 (1.00)     1.9270 (1.09)         15;3  7.6875 (1.00)        100           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s)                   Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2]     11.2217 (1.40)     11.2217 (1.40)     11.2217 (1.40)     0.0000 (1.0)      11.2217 (1.40)     0.0000 (1.0)           0;0  0.0891 (0.71)          1           1
test_import-import[3.10.0]      8.3101 (1.04)      8.3101 (1.04)      8.3101 (1.04)     0.0000 (1.0)       8.3101 (1.04)     0.0000 (1.0)           0;0  0.1203 (0.96)          1           1
test_import-import[main]        8.0105 (1.0)       8.0105 (1.0)       8.0105 (1.0)      0.0000 (1.0)       8.0105 (1.0)      0.0000 (1.0)           0;0  0.1248 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                           Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2]     11.5790 (1.19)     11.5790 (1.19)     11.5790 (1.19)     0.0000 (1.0)      11.5790 (1.19)     0.0000 (1.0)           0;0  0.0864 (0.84)          1           1
test_import_url-import-url[3.10.0]     10.0738 (1.03)     10.0738 (1.03)     10.0738 (1.03)     0.0000 (1.0)      10.0738 (1.03)     0.0000 (1.0)           0;0  0.0993 (0.97)          1           1
test_import_url-import-url[main]        9.7570 (1.0)       9.7570 (1.0)       9.7570 (1.0)      0.0000 (1.0)       9.7570 (1.0)      0.0000 (1.0)           0;0  0.1025 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2]     378.1364 (1.0)      435.7596 (1.0)      394.4442 (1.0)      8.0188 (1.0)      393.3655 (1.0)       8.7641 (1.00)         25;4  2.5352 (1.0)         100           1
test_init-init[3.10.0]     385.7226 (1.02)     446.0401 (1.02)     399.8824 (1.01)     8.3283 (1.04)     398.7616 (1.01)      8.7453 (1.0)          25;4  2.5007 (0.99)        100           1
test_init-init[main]       398.2025 (1.05)     438.8001 (1.01)     414.4432 (1.05)     8.1937 (1.02)     413.7714 (1.05)     10.3545 (1.18)         28;2  2.4129 (0.95)        100           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms)               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2]     414.7072 (1.05)     414.7072 (1.05)     414.7072 (1.05)     0.0000 (1.0)      414.7072 (1.05)     0.0000 (1.0)           0;0  2.4113 (0.95)          1           1
test_list-list[3.10.0]     408.1498 (1.04)     408.1498 (1.04)     408.1498 (1.04)     0.0000 (1.0)      408.1498 (1.04)     0.0000 (1.0)           0;0  2.4501 (0.96)          1           1
test_list-list[main]       393.1161 (1.0)      393.1161 (1.0)      393.1161 (1.0)      0.0000 (1.0)      393.1161 (1.0)      0.0000 (1.0)           0;0  2.5438 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2]     387.4362 (1.01)     387.4362 (1.01)     387.4362 (1.01)     0.0000 (1.0)      387.4362 (1.01)     0.0000 (1.0)           0;0  2.5811 (0.99)          1           1
test_list-list-dvc-only[3.10.0]     385.0220 (1.0)      385.0220 (1.0)      385.0220 (1.0)      0.0000 (1.0)      385.0220 (1.0)      0.0000 (1.0)           0;0  2.5973 (1.0)           1           1
test_list-list-dvc-only[main]       389.3556 (1.01)     389.3556 (1.01)     389.3556 (1.01)     0.0000 (1.0)      389.3556 (1.01)     0.0000 (1.0)           0;0  2.5683 (0.99)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2]     395.4119 (1.00)     395.4119 (1.00)     395.4119 (1.00)     0.0000 (1.0)      395.4119 (1.00)     0.0000 (1.0)           0;0  2.5290 (1.00)          1           1
test_list-list-recursive[3.10.0]     394.8768 (1.0)      394.8768 (1.0)      394.8768 (1.0)      0.0000 (1.0)      394.8768 (1.0)      0.0000 (1.0)           0;0  2.5324 (1.0)           1           1
test_list-list-recursive[main]       397.2896 (1.01)     397.2896 (1.01)     397.2896 (1.01)     0.0000 (1.0)      397.2896 (1.01)     0.0000 (1.0)           0;0  2.5171 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2]     392.9222 (1.01)     392.9222 (1.01)     392.9222 (1.01)     0.0000 (1.0)      392.9222 (1.01)     0.0000 (1.0)           0;0  2.5450 (0.99)          1           1
test_list-list-shallow[3.10.0]     395.0229 (1.01)     395.0229 (1.01)     395.0229 (1.01)     0.0000 (1.0)      395.0229 (1.01)     0.0000 (1.0)           0;0  2.5315 (0.99)          1           1
test_list-list-shallow[main]       389.7063 (1.0)      389.7063 (1.0)      389.7063 (1.0)      0.0000 (1.0)      389.7063 (1.0)      0.0000 (1.0)           0;0  2.5660 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                    Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2]     7.2982 (1.30)     7.2982 (1.30)     7.2982 (1.30)     0.0000 (1.0)      7.2982 (1.30)     0.0000 (1.0)           0;0  0.1370 (0.77)          1           1
test_partial_add-add[3.10.0]     5.6234 (1.0)      5.6234 (1.0)      5.6234 (1.0)      0.0000 (1.0)      5.6234 (1.0)      0.0000 (1.0)           0;0  0.1778 (1.0)           1           1
test_partial_add-add[main]       5.7426 (1.02)     5.7426 (1.02)     5.7426 (1.02)     0.0000 (1.0)      5.7426 (1.02)     0.0000 (1.0)           0;0  0.1741 (0.98)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s)                            Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2]     3.1164 (1.35)     3.1164 (1.35)     3.1164 (1.35)     0.0000 (1.0)      3.1164 (1.35)     0.0000 (1.0)           0;0  0.3209 (0.74)          1           1
test_partial_add-add-partial[3.10.0]     4.2282 (1.83)     4.2282 (1.83)     4.2282 (1.83)     0.0000 (1.0)      4.2282 (1.83)     0.0000 (1.0)           0;0  0.2365 (0.55)          1           1
test_partial_add-add-partial[main]       2.3164 (1.0)      2.3164 (1.0)      2.3164 (1.0)      0.0000 (1.0)      2.3164 (1.0)      0.0000 (1.0)           0;0  0.4317 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2]     395.4151 (1.03)     395.4151 (1.03)     395.4151 (1.03)     0.0000 (1.0)      395.4151 (1.03)     0.0000 (1.0)           0;0  2.5290 (0.97)          1           1
test_partial_add-gc-cloud-noop[3.10.0]     385.2853 (1.0)      385.2853 (1.0)      385.2853 (1.0)      0.0000 (1.0)      385.2853 (1.0)      0.0000 (1.0)           0;0  2.5955 (1.0)           1           1
test_partial_add-gc-cloud-noop[main]       389.2430 (1.01)     389.2430 (1.01)     389.2430 (1.01)     0.0000 (1.0)      389.2430 (1.01)     0.0000 (1.0)           0;0  2.5691 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                         Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2]     379.4011 (1.0)      379.4011 (1.0)      379.4011 (1.0)      0.0000 (1.0)      379.4011 (1.0)      0.0000 (1.0)           0;0  2.6357 (1.0)           1           1
test_partial_add-gc-noop[3.10.0]     392.4425 (1.03)     392.4425 (1.03)     392.4425 (1.03)     0.0000 (1.0)      392.4425 (1.03)     0.0000 (1.0)           0;0  2.5481 (0.97)          1           1
test_partial_add-gc-noop[main]       389.4494 (1.03)     389.4494 (1.03)     389.4494 (1.03)     0.0000 (1.0)      389.4494 (1.03)     0.0000 (1.0)           0;0  2.5677 (0.97)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2]     3.5990 (1.06)     3.5990 (1.06)     3.5990 (1.06)     0.0000 (1.0)      3.5990 (1.06)     0.0000 (1.0)           0;0  0.2779 (0.95)          1           1
test_partial_add-push[3.10.0]     3.4042 (1.0)      3.4042 (1.0)      3.4042 (1.0)      0.0000 (1.0)      3.4042 (1.0)      0.0000 (1.0)           0;0  0.2938 (1.0)           1           1
test_partial_add-push[main]       5.3258 (1.56)     5.3258 (1.56)     5.3258 (1.56)     0.0000 (1.0)      5.3258 (1.56)     0.0000 (1.0)           0;0  0.1878 (0.64)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                              Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2]     396.5247 (1.00)     396.5247 (1.00)     396.5247 (1.00)     0.0000 (1.0)      396.5247 (1.00)     0.0000 (1.0)           0;0  2.5219 (1.00)          1           1
test_partial_add-push-partial[3.10.0]     396.1343 (1.0)      396.1343 (1.0)      396.1343 (1.0)      0.0000 (1.0)      396.1343 (1.0)      0.0000 (1.0)           0;0  2.5244 (1.0)           1           1
test_partial_add-push-partial[main]       735.9708 (1.86)     735.9708 (1.86)     735.9708 (1.86)     0.0000 (1.0)      735.9708 (1.86)     0.0000 (1.0)           0;0  1.3587 (0.54)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                       Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2]     7.4339 (1.44)     7.4339 (1.44)     7.4339 (1.44)     0.0000 (1.0)      7.4339 (1.44)     0.0000 (1.0)           0;0  0.1345 (0.69)          1           1
test_partial_remove-add[3.10.0]     6.1165 (1.19)     6.1165 (1.19)     6.1165 (1.19)     0.0000 (1.0)      6.1165 (1.19)     0.0000 (1.0)           0;0  0.1635 (0.84)          1           1
test_partial_remove-add[main]       5.1526 (1.0)      5.1526 (1.0)      5.1526 (1.0)      0.0000 (1.0)      5.1526 (1.0)      0.0000 (1.0)           0;0  0.1941 (1.0)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-add-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                               Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2]     500.0153 (1.0)      500.0153 (1.0)      500.0153 (1.0)      0.0000 (1.0)      500.0153 (1.0)      0.0000 (1.0)           0;0  1.9999 (1.0)           1           1
test_partial_remove-add-update[3.10.0]     507.9884 (1.02)     507.9884 (1.02)     507.9884 (1.02)     0.0000 (1.0)      507.9884 (1.02)     0.0000 (1.0)           0;0  1.9685 (0.98)          1           1
test_partial_remove-add-update[main]       505.0075 (1.01)     505.0075 (1.01)     505.0075 (1.01)     0.0000 (1.0)      505.0075 (1.01)     0.0000 (1.0)           0;0  1.9802 (0.99)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2]     587.1725 (1.0)      587.1725 (1.0)      587.1725 (1.0)      0.0000 (1.0)      587.1725 (1.0)      0.0000 (1.0)           0;0  1.7031 (1.0)           1           1
test_partial_remove-gc[3.10.0]     600.9020 (1.02)     600.9020 (1.02)     600.9020 (1.02)     0.0000 (1.0)      600.9020 (1.02)     0.0000 (1.0)           0;0  1.6642 (0.98)          1           1
test_partial_remove-gc[main]       598.8960 (1.02)     598.8960 (1.02)     598.8960 (1.02)     0.0000 (1.0)      598.8960 (1.02)     0.0000 (1.0)           0;0  1.6697 (0.98)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                             Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2]     636.6978 (1.01)     636.6978 (1.01)     636.6978 (1.01)     0.0000 (1.0)      636.6978 (1.01)     0.0000 (1.0)           0;0  1.5706 (0.99)          1           1
test_partial_remove-gc-cloud[3.10.0]     631.9643 (1.0)      631.9643 (1.0)      631.9643 (1.0)      0.0000 (1.0)      631.9643 (1.0)      0.0000 (1.0)           0;0  1.5824 (1.0)           1           1
test_partial_remove-gc-cloud[main]       640.5111 (1.01)     640.5111 (1.01)     640.5111 (1.01)     0.0000 (1.0)      640.5111 (1.01)     0.0000 (1.0)           0;0  1.5613 (0.99)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                        Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2]     3.6494 (1.15)     3.6494 (1.15)     3.6494 (1.15)     0.0000 (1.0)      3.6494 (1.15)     0.0000 (1.0)           0;0  0.2740 (0.87)          1           1
test_partial_remove-push[3.10.0]     3.1785 (1.0)      3.1785 (1.0)      3.1785 (1.0)      0.0000 (1.0)      3.1785 (1.0)      0.0000 (1.0)           0;0  0.3146 (1.0)           1           1
test_partial_remove-push[main]       3.7750 (1.19)     3.7750 (1.19)     3.7750 (1.19)     0.0000 (1.0)      3.7750 (1.19)     0.0000 (1.0)           0;0  0.2649 (0.84)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2]     382.7190 (1.0)      382.7190 (1.0)      382.7190 (1.0)      0.0000 (1.0)      382.7190 (1.0)      0.0000 (1.0)           0;0  2.6129 (1.0)           1           1
test_partial_remove-push-update[3.10.0]     385.1874 (1.01)     385.1874 (1.01)     385.1874 (1.01)     0.0000 (1.0)      385.1874 (1.01)     0.0000 (1.0)           0;0  2.5961 (0.99)          1           1
test_partial_remove-push-update[main]       403.2758 (1.05)     403.2758 (1.05)     403.2758 (1.05)     0.0000 (1.0)      403.2758 (1.05)     0.0000 (1.0)           0;0  2.4797 (0.95)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2]     431.3872 (1.0)      435.5606 (1.0)      433.8862 (1.0)       1.6225 (1.0)      434.1717 (1.0)       2.2314 (1.0)           2;0  2.3048 (1.0)           5           3
test_plots-plots-diff[3.10.0]     800.2802 (1.86)     831.9239 (1.91)     810.0128 (1.87)     13.1557 (8.11)     804.3600 (1.85)     16.4108 (7.35)          1;0  1.2345 (0.54)          5           3
test_plots-plots-diff[main]       762.1426 (1.77)     771.4842 (1.77)     767.9956 (1.77)      3.6768 (2.27)     767.9991 (1.77)      4.6739 (2.09)          1;0  1.3021 (0.56)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms)                             Min                   Max                  Mean            StdDev                Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2]       443.2354 (1.0)        451.0937 (1.0)        446.9493 (1.0)      2.9176 (1.0)        446.7855 (1.0)      3.8074 (1.0)           2;0  2.2374 (1.0)           5           3
test_plots-plots-diff-json[3.10.0]     1,047.3899 (2.36)     1,055.3836 (2.34)     1,051.9025 (2.35)     3.4926 (1.20)     1,053.0894 (2.36)     6.0912 (1.60)          1;0  0.9507 (0.42)          5           3
test_plots-plots-diff-json[main]         842.2375 (1.90)       854.2756 (1.89)       847.1611 (1.90)     4.3930 (1.51)       846.3965 (1.89)     3.9184 (1.03)          2;0  1.1804 (0.53)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                      Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2]     395.9825 (1.0)      403.6291 (1.0)      399.2564 (1.0)       3.0186 (1.0)      398.5557 (1.0)       4.5179 (1.0)           2;0  2.5047 (1.0)           5           3
test_plots-plots-show[3.10.0]     660.7488 (1.67)     691.6593 (1.71)     675.8485 (1.69)     12.3371 (4.09)     673.9622 (1.69)     19.6610 (4.35)          2;0  1.4796 (0.59)          5           3
test_plots-plots-show[main]       653.4116 (1.65)     662.2079 (1.64)     657.4115 (1.65)      3.6548 (1.21)     657.0666 (1.65)      6.1968 (1.37)          2;0  1.5211 (0.61)          5           3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2]     411.7202 (1.0)      437.9606 (1.0)      418.5525 (1.0)      10.9432 (1.25)     415.0046 (1.0)       8.1743 (1.0)           1;1  2.3892 (1.0)           5           3
test_plots-plots-show-json[3.10.0]     818.7971 (1.99)     853.3237 (1.95)     832.3199 (1.99)     15.7141 (1.80)     825.5121 (1.99)     27.5202 (3.37)          1;0  1.2015 (0.50)          5           3
test_plots-plots-show-json[main]       699.0308 (1.70)     722.5603 (1.65)     708.8575 (1.69)      8.7524 (1.0)      705.9465 (1.70)      9.7286 (1.19)          2;0  1.4107 (0.59)          5           3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s)              Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2]     3.1014 (1.0)      3.1014 (1.0)      3.1014 (1.0)      0.0000 (1.0)      3.1014 (1.0)      0.0000 (1.0)           0;0  0.3224 (1.0)           1           1
test_push-push[3.10.0]     3.6150 (1.17)     3.6150 (1.17)     3.6150 (1.17)     0.0000 (1.0)      3.6150 (1.17)     0.0000 (1.0)           0;0  0.2766 (0.86)          1           1
test_push-push[main]       5.4694 (1.76)     5.4694 (1.76)     5.4694 (1.76)     0.0000 (1.0)      5.4694 (1.76)     0.0000 (1.0)           0;0  0.1828 (0.57)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s)                Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2]     8.0921 (1.54)     8.0921 (1.54)     8.0921 (1.54)     0.0000 (1.0)      8.0921 (1.54)     0.0000 (1.0)           0;0  0.1236 (0.65)          1           1
test_sharing-add[3.10.0]     5.8414 (1.11)     5.8414 (1.11)     5.8414 (1.11)     0.0000 (1.0)      5.8414 (1.11)     0.0000 (1.0)           0;0  0.1712 (0.90)          1           1
test_sharing-add[main]       5.2606 (1.0)      5.2606 (1.0)      5.2606 (1.0)      0.0000 (1.0)      5.2606 (1.0)      0.0000 (1.0)           0;0  0.1901 (1.0)           1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2]     3.5019 (1.50)     3.5019 (1.50)     3.5019 (1.50)     0.0000 (1.0)      3.5019 (1.50)     0.0000 (1.0)           0;0  0.2856 (0.67)          1           1
test_sharing-add-noop[3.10.0]     3.0426 (1.30)     3.0426 (1.30)     3.0426 (1.30)     0.0000 (1.0)      3.0426 (1.30)     0.0000 (1.0)           0;0  0.3287 (0.77)          1           1
test_sharing-add-noop[main]       2.3366 (1.0)      2.3366 (1.0)      2.3366 (1.0)      0.0000 (1.0)      2.3366 (1.0)      0.0000 (1.0)           0;0  0.4280 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s)                     Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2]     2.7753 (1.43)     2.7753 (1.43)     2.7753 (1.43)     0.0000 (1.0)      2.7753 (1.43)     0.0000 (1.0)           0;0  0.3603 (0.70)          1           1
test_sharing-checkout[3.10.0]     3.4691 (1.79)     3.4691 (1.79)     3.4691 (1.79)     0.0000 (1.0)      3.4691 (1.79)     0.0000 (1.0)           0;0  0.2883 (0.56)          1           1
test_sharing-checkout[main]       1.9426 (1.0)      1.9426 (1.0)      1.9426 (1.0)      0.0000 (1.0)      1.9426 (1.0)      0.0000 (1.0)           0;0  0.5148 (1.0)           1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2]     953.2664 (2.30)     953.2664 (2.30)     953.2664 (2.30)     0.0000 (1.0)      953.2664 (2.30)     0.0000 (1.0)           0;0  1.0490 (0.43)          1           1
test_sharing-checkout-noop[3.10.0]     413.9077 (1.0)      413.9077 (1.0)      413.9077 (1.0)      0.0000 (1.0)      413.9077 (1.0)      0.0000 (1.0)           0;0  2.4160 (1.0)           1           1
test_sharing-checkout-noop[main]       419.3702 (1.01)     419.3702 (1.01)     419.3702 (1.01)     0.0000 (1.0)      419.3702 (1.01)     0.0000 (1.0)           0;0  2.3845 (0.99)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2]     2.4650 (1.0)      2.4650 (1.0)      2.4650 (1.0)      0.0000 (1.0)      2.4650 (1.0)      0.0000 (1.0)           0;0  0.4057 (1.0)           1           1
test_sharing-fetch[3.10.0]     2.7466 (1.11)     2.7466 (1.11)     2.7466 (1.11)     0.0000 (1.0)      2.7466 (1.11)     0.0000 (1.0)           0;0  0.3641 (0.90)          1           1
test_sharing-fetch[main]       2.7644 (1.12)     2.7644 (1.12)     2.7644 (1.12)     0.0000 (1.0)      2.7644 (1.12)     0.0000 (1.0)           0;0  0.3617 (0.89)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2]     390.1030 (1.0)      390.1030 (1.0)      390.1030 (1.0)      0.0000 (1.0)      390.1030 (1.0)      0.0000 (1.0)           0;0  2.5634 (1.0)           1           1
test_sharing-fetch-noop[3.10.0]     422.0153 (1.08)     422.0153 (1.08)     422.0153 (1.08)     0.0000 (1.0)      422.0153 (1.08)     0.0000 (1.0)           0;0  2.3696 (0.92)          1           1
test_sharing-fetch-noop[main]       447.7578 (1.15)     447.7578 (1.15)     447.7578 (1.15)     0.0000 (1.0)      447.7578 (1.15)     0.0000 (1.0)           0;0  2.2334 (0.87)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s)                 Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2]     3.6077 (1.0)      3.6077 (1.0)      3.6077 (1.0)      0.0000 (1.0)      3.6077 (1.0)      0.0000 (1.0)           0;0  0.2772 (1.0)           1           1
test_sharing-push[3.10.0]     3.7256 (1.03)     3.7256 (1.03)     3.7256 (1.03)     0.0000 (1.0)      3.7256 (1.03)     0.0000 (1.0)           0;0  0.2684 (0.97)          1           1
test_sharing-push[main]       3.6349 (1.01)     3.6349 (1.01)     3.6349 (1.01)     0.0000 (1.0)      3.6349 (1.01)     0.0000 (1.0)           0;0  0.2751 (0.99)          1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                       Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2]     424.1571 (1.07)     424.1571 (1.07)     424.1571 (1.07)     0.0000 (1.0)      424.1571 (1.07)     0.0000 (1.0)           0;0  2.3576 (0.94)          1           1
test_sharing-push-noop[3.10.0]     397.5791 (1.0)      397.5791 (1.0)      397.5791 (1.0)      0.0000 (1.0)      397.5791 (1.0)      0.0000 (1.0)           0;0  2.5152 (1.0)           1           1
test_sharing-push-noop[main]       420.2186 (1.06)     420.2186 (1.06)     420.2186 (1.06)     0.0000 (1.0)      420.2186 (1.06)     0.0000 (1.0)           0;0  2.3797 (0.95)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2]     6.9219 (1.28)     6.9219 (1.28)     6.9219 (1.28)     0.0000 (1.0)      6.9219 (1.28)     0.0000 (1.0)           0;0  0.1445 (0.78)          1           1
test_status-status[3.10.0]     5.6812 (1.05)     5.6812 (1.05)     5.6812 (1.05)     0.0000 (1.0)      5.6812 (1.05)     0.0000 (1.0)           0;0  0.1760 (0.95)          1           1
test_status-status[main]       5.4170 (1.0)      5.4170 (1.0)      5.4170 (1.0)      0.0000 (1.0)      5.4170 (1.0)      0.0000 (1.0)           0;0  0.1846 (1.0)           1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                           Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2]     371.4086 (1.0)      371.4086 (1.0)      371.4086 (1.0)      0.0000 (1.0)      371.4086 (1.0)      0.0000 (1.0)           0;0  2.6925 (1.0)           1           1
test_status-status-changed[3.10.0]     375.3545 (1.01)     375.3545 (1.01)     375.3545 (1.01)     0.0000 (1.0)      375.3545 (1.01)     0.0000 (1.0)           0;0  2.6641 (0.99)          1           1
test_status-status-changed[main]       439.0324 (1.18)     439.0324 (1.18)     439.0324 (1.18)     0.0000 (1.0)      439.0324 (1.18)     0.0000 (1.0)           0;0  2.2777 (0.85)          1           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                                Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2]     365.9201 (1.0)      365.9201 (1.0)      365.9201 (1.0)      0.0000 (1.0)      365.9201 (1.0)      0.0000 (1.0)           0;0  2.7328 (1.0)           1           1
test_status-status-changed-noop[3.10.0]     378.9889 (1.04)     378.9889 (1.04)     378.9889 (1.04)     0.0000 (1.0)      378.9889 (1.04)     0.0000 (1.0)           0;0  2.6386 (0.97)          1           1
test_status-status-changed-noop[main]       447.3757 (1.22)     447.3757 (1.22)     447.3757 (1.22)     0.0000 (1.0)      447.3757 (1.22)     0.0000 (1.0)           0;0  2.2353 (0.82)          1           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2]     368.0196 (1.0)      368.0196 (1.0)      368.0196 (1.0)      0.0000 (1.0)      368.0196 (1.0)      0.0000 (1.0)           0;0  2.7172 (1.0)           1           1
test_status-status-noop[3.10.0]     386.4666 (1.05)     386.4666 (1.05)     386.4666 (1.05)     0.0000 (1.0)      386.4666 (1.05)     0.0000 (1.0)           0;0  2.5875 (0.95)          1           1
test_status-status-noop[main]       425.7641 (1.16)     425.7641 (1.16)     425.7641 (1.16)     0.0000 (1.0)      425.7641 (1.16)     0.0000 (1.0)           0;0  2.3487 (0.86)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

-------------------------------------------------------------------------- benchmark 'test_update-import-url': 3 tests --------------------------------------------------------------------------
Name (time in s)                       Min                Max               Mean            StdDev             Median               IQR            Outliers     OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2]     11.7268 (1.17)     11.7268 (1.17)     11.7268 (1.17)     0.0000 (1.0)      11.7268 (1.17)     0.0000 (1.0)           0;0  0.0853 (0.85)          1           1
test_update-import-url[3.10.0]      9.9816 (1.0)       9.9816 (1.0)       9.9816 (1.0)      0.0000 (1.0)       9.9816 (1.0)      0.0000 (1.0)           0;0  0.1002 (1.0)           1           1
test_update-import-url[main]       10.0039 (1.00)     10.0039 (1.00)     10.0039 (1.00)     0.0000 (1.0)      10.0039 (1.00)     0.0000 (1.0)           0;0  0.1000 (1.00)          1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s)                  Min               Max              Mean            StdDev            Median               IQR            Outliers     OPS            Rounds  Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2]     9.8419 (1.58)     9.8419 (1.58)     9.8419 (1.58)     0.0000 (1.0)      9.8419 (1.58)     0.0000 (1.0)           0;0  0.1016 (0.63)          1           1
test_update-update[3.10.0]     6.2139 (1.0)      6.2139 (1.0)      6.2139 (1.0)      0.0000 (1.0)      6.2139 (1.0)      0.0000 (1.0)           0;0  0.1609 (1.0)           1           1
test_update-update[main]       7.1953 (1.16)     7.1953 (1.16)     7.1953 (1.16)     0.0000 (1.0)      7.1953 (1.16)     0.0000 (1.0)           0;0  0.1390 (0.86)          1           1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms)                        Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2]     493.6235 (1.21)     493.6235 (1.21)     493.6235 (1.21)     0.0000 (1.0)      493.6235 (1.21)     0.0000 (1.0)           0;0  2.0258 (0.83)          1           1
test_update-update-noop[3.10.0]     407.3595 (1.0)      407.3595 (1.0)      407.3595 (1.0)      0.0000 (1.0)      407.3595 (1.0)      0.0000 (1.0)           0;0  2.4548 (1.0)           1           1
test_update-update-noop[main]       430.9995 (1.06)     430.9995 (1.06)     430.9995 (1.06)     0.0000 (1.0)      430.9995 (1.06)     0.0000 (1.0)           0;0  2.3202 (0.95)          1           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean