Skip to content

Commit

Permalink
updated bench results
Browse files Browse the repository at this point in the history
  • Loading branch information
onionpancakes committed Apr 4, 2024
1 parent 9e688db commit 0d268b1
Show file tree
Hide file tree
Showing 15 changed files with 425 additions and 430 deletions.
87 changes: 44 additions & 43 deletions resources/bench/chassis_10.txt
Original file line number Diff line number Diff line change
@@ -1,80 +1,81 @@
Chassis
-------------------------------------
Evaluation count : 885240 in 60 samples of 14754 calls.
Execution time mean : 68.056262 µs
Execution time std-deviation : 260.039600 ns
Execution time lower quantile : 67.736004 µs ( 2.5%)
Execution time upper quantile : 68.405753 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 910020 in 60 samples of 15167 calls.
Execution time mean : 66.050219 µs
Execution time std-deviation : 393.517546 ns
Execution time lower quantile : 65.634209 µs ( 2.5%)
Execution time upper quantile : 66.833243 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 1573560 in 60 samples of 26226 calls.
Execution time mean : 37.996274 µs
Execution time std-deviation : 197.997485 ns
Execution time lower quantile : 37.795748 µs ( 2.5%)
Execution time upper quantile : 38.420016 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 1681200 in 60 samples of 28020 calls.
Execution time mean : 35.724023 µs
Execution time std-deviation : 165.387723 ns
Execution time lower quantile : 35.510662 µs ( 2.5%)
Execution time upper quantile : 35.997269 µs (97.5%)
Overhead used : 8.800242 ns

Found 3 outliers in 60 samples (5.0000 %)
low-severe 2 (3.3333 %)
low-mild 1 (1.6667 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 2028660 in 60 samples of 33811 calls.
Execution time mean : 29.669457 µs
Execution time std-deviation : 78.410523 ns
Execution time lower quantile : 29.579800 µs ( 2.5%)
Execution time upper quantile : 29.792475 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 2107200 in 60 samples of 35120 calls.
Execution time mean : 28.535700 µs
Execution time std-deviation : 157.417890 ns
Execution time lower quantile : 28.372222 µs ( 2.5%)
Execution time upper quantile : 28.718302 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 681900 in 60 samples of 11365 calls.
Execution time mean : 88.403360 µs
Execution time std-deviation : 292.067627 ns
Execution time lower quantile : 88.053555 µs ( 2.5%)
Execution time upper quantile : 88.928607 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 726540 in 60 samples of 12109 calls.
Execution time mean : 82.833472 µs
Execution time std-deviation : 261.914305 ns
Execution time lower quantile : 82.491204 µs ( 2.5%)
Execution time upper quantile : 83.278133 µs (97.5%)
Overhead used : 8.800242 ns

Found 4 outliers in 60 samples (6.6667 %)
low-severe 3 (5.0000 %)
Found 3 outliers in 60 samples (5.0000 %)
low-severe 2 (3.3333 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 1259460 in 60 samples of 20991 calls.
Execution time mean : 47.838020 µs
Execution time std-deviation : 159.492674 ns
Execution time lower quantile : 47.645186 µs ( 2.5%)
Execution time upper quantile : 48.068621 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 1416120 in 60 samples of 23602 calls.
Execution time mean : 42.216605 µs
Execution time std-deviation : 176.841235 ns
Execution time lower quantile : 41.910514 µs ( 2.5%)
Execution time upper quantile : 42.434410 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 1570560 in 60 samples of 26176 calls.
Execution time mean : 38.328536 µs
Execution time std-deviation : 109.698650 ns
Execution time lower quantile : 38.154973 µs ( 2.5%)
Execution time upper quantile : 38.466144 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 1709880 in 60 samples of 28498 calls.
Execution time mean : 35.198151 µs
Execution time std-deviation : 112.141770 ns
Execution time lower quantile : 35.078501 µs ( 2.5%)
Execution time upper quantile : 35.326738 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

83 changes: 42 additions & 41 deletions resources/bench/chassis_160.txt
Original file line number Diff line number Diff line change
@@ -1,78 +1,79 @@
Chassis
-------------------------------------
Evaluation count : 76860 in 60 samples of 1281 calls.
Execution time mean : 776.577675 µs
Execution time std-deviation : 3.256948 µs
Execution time lower quantile : 772.766794 µs ( 2.5%)
Execution time upper quantile : 781.360757 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 74340 in 60 samples of 1239 calls.
Execution time mean : 809.187472 µs
Execution time std-deviation : 6.988282 µs
Execution time lower quantile : 803.061895 µs ( 2.5%)
Execution time upper quantile : 830.270897 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Found 7 outliers in 60 samples (11.6667 %)
low-severe 2 (3.3333 %)
low-mild 5 (8.3333 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 125700 in 60 samples of 2095 calls.
Execution time mean : 477.658631 µs
Execution time std-deviation : 1.606660 µs
Execution time lower quantile : 475.926369 µs ( 2.5%)
Execution time upper quantile : 480.565975 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 127500 in 60 samples of 2125 calls.
Execution time mean : 471.857769 µs
Execution time std-deviation : 1.703398 µs
Execution time lower quantile : 469.222643 µs ( 2.5%)
Execution time upper quantile : 475.613107 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 150540 in 60 samples of 2509 calls.
Execution time mean : 397.327142 µs
Execution time std-deviation : 1.533050 µs
Execution time lower quantile : 395.255275 µs ( 2.5%)
Execution time upper quantile : 399.929499 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 149460 in 60 samples of 2491 calls.
Execution time mean : 403.808012 µs
Execution time std-deviation : 2.655810 µs
Execution time lower quantile : 400.880769 µs ( 2.5%)
Execution time upper quantile : 407.211456 µs (97.5%)
Overhead used : 8.800242 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 3 outliers in 60 samples (5.0000 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
high-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 49500 in 60 samples of 825 calls.
Execution time mean : 1.210601 ms
Execution time std-deviation : 3.721270 µs
Execution time lower quantile : 1.205412 ms ( 2.5%)
Execution time upper quantile : 1.217793 ms (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 51420 in 60 samples of 857 calls.
Execution time mean : 1.168478 ms
Execution time std-deviation : 4.190565 µs
Execution time lower quantile : 1.162379 ms ( 2.5%)
Execution time upper quantile : 1.176544 ms (97.5%)
Overhead used : 8.800242 ns

Found 2 outliers in 60 samples (3.3333 %)
Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 91320 in 60 samples of 1522 calls.
Execution time mean : 660.037381 µs
Execution time std-deviation : 2.446509 µs
Execution time lower quantile : 655.660447 µs ( 2.5%)
Execution time upper quantile : 665.074720 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 99000 in 60 samples of 1650 calls.
Execution time mean : 608.855902 µs
Execution time std-deviation : 2.162013 µs
Execution time lower quantile : 605.995227 µs ( 2.5%)
Execution time upper quantile : 612.144905 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 115440 in 60 samples of 1924 calls.
Execution time mean : 523.221086 µs
Execution time std-deviation : 2.348482 µs
Execution time lower quantile : 520.184163 µs ( 2.5%)
Execution time upper quantile : 527.025584 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 119220 in 60 samples of 1987 calls.
Execution time mean : 506.496734 µs
Execution time std-deviation : 1.518212 µs
Execution time lower quantile : 504.352904 µs ( 2.5%)
Execution time upper quantile : 508.555163 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Expand Down
84 changes: 41 additions & 43 deletions resources/bench/chassis_40.txt
Original file line number Diff line number Diff line change
@@ -1,79 +1,77 @@
Chassis
-------------------------------------
Evaluation count : 246660 in 60 samples of 4111 calls.
Execution time mean : 244.144826 µs
Execution time std-deviation : 868.185579 ns
Execution time lower quantile : 242.917445 µs ( 2.5%)
Execution time upper quantile : 245.247961 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 249120 in 60 samples of 4152 calls.
Execution time mean : 238.953313 µs
Execution time std-deviation : 975.023799 ns
Execution time lower quantile : 237.729612 µs ( 2.5%)
Execution time upper quantile : 240.205833 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled
-------------------------------------
Evaluation count : 424080 in 60 samples of 7068 calls.
Execution time mean : 142.064800 µs
Execution time std-deviation : 436.422493 ns
Execution time lower quantile : 141.351988 µs ( 2.5%)
Execution time upper quantile : 142.674186 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 447960 in 60 samples of 7466 calls.
Execution time mean : 133.956603 µs
Execution time std-deviation : 333.902528 ns
Execution time lower quantile : 133.582903 µs ( 2.5%)
Execution time upper quantile : 134.348392 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
low-severe 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Compiled Unambig
-------------------------------------
Evaluation count : 549420 in 60 samples of 9157 calls.
Execution time mean : 109.710883 µs
Execution time std-deviation : 325.206891 ns
Execution time lower quantile : 109.072121 µs ( 2.5%)
Execution time upper quantile : 110.329193 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 556980 in 60 samples of 9283 calls.
Execution time mean : 108.381749 µs
Execution time std-deviation : 356.382994 ns
Execution time lower quantile : 107.750507 µs ( 2.5%)
Execution time upper quantile : 109.208585 µs (97.5%)
Overhead used : 8.800242 ns

Found 5 outliers in 60 samples (8.3333 %)
low-severe 3 (5.0000 %)
low-mild 1 (1.6667 %)
high-mild 1 (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 2 (3.3333 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias
-------------------------------------
Evaluation count : 185760 in 60 samples of 3096 calls.
Execution time mean : 322.833008 µs
Execution time std-deviation : 937.786234 ns
Execution time lower quantile : 321.664457 µs ( 2.5%)
Execution time upper quantile : 324.181803 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 195780 in 60 samples of 3263 calls.
Execution time mean : 306.958545 µs
Execution time std-deviation : 1.037858 µs
Execution time lower quantile : 305.749474 µs ( 2.5%)
Execution time upper quantile : 308.610577 µs (97.5%)
Overhead used : 8.800242 ns

Found 1 outliers in 60 samples (1.6667 %)
Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled
-------------------------------------
Evaluation count : 341760 in 60 samples of 5696 calls.
Execution time mean : 176.149648 µs
Execution time std-deviation : 647.220818 ns
Execution time lower quantile : 175.411987 µs ( 2.5%)
Execution time upper quantile : 177.402579 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 380160 in 60 samples of 6336 calls.
Execution time mean : 158.560825 µs
Execution time std-deviation : 556.041891 ns
Execution time lower quantile : 157.844474 µs ( 2.5%)
Execution time upper quantile : 159.833762 µs (97.5%)
Overhead used : 8.800242 ns

Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
low-mild 1 (1.6667 %)
low-severe 2 (3.3333 %)
Variance from outliers : 1.6389 % Variance is slightly inflated by outliers

Chassis Alias Compiled Unambig
-------------------------------------
Evaluation count : 426780 in 60 samples of 7113 calls.
Execution time mean : 140.494776 µs
Execution time std-deviation : 523.248012 ns
Execution time lower quantile : 139.947837 µs ( 2.5%)
Execution time upper quantile : 141.090895 µs (97.5%)
Overhead used : 11.736096 ns
Evaluation count : 454680 in 60 samples of 7578 calls.
Execution time mean : 132.207600 µs
Execution time std-deviation : 663.761825 ns
Execution time lower quantile : 131.387478 µs ( 2.5%)
Execution time upper quantile : 133.238702 µs (97.5%)
Overhead used : 8.800242 ns

Found 2 outliers in 60 samples (3.3333 %)
low-severe 1 (1.6667 %)
Expand Down
Loading

0 comments on commit 0d268b1

Please sign in to comment.