[bpf, x64] de900a2419: kernel-selftests.net.test_bpf.sh.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: de900a24194807c73768a543f989161a1ee47c7e ("[PATCH] bpf, x64: add extra passes without size optimizations")
url: https://github.com/0day-ci/linux/commits/Gary-Lin/bpf-x64-add-extra-passe...
base: https://git.kernel.org/cgit/linux/kernel/git/bpf/bpf-next.git master
in testcase: kernel-selftests
version: kernel-selftests-x86_64-b5a583fb-1_20201015
with following parameters:
group: net
ucode: 0xe2
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: 8 threads Intel(R) Core(TM) i7-6770HQ CPU @ 2.60GHz with 32G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
user :notice: [ 218.215557] # selftests: net: test_bpf.sh
kern :info : [ 218.232063] test_bpf: #0 TAX jited:1 145 19 19 PASS
kern :info : [ 218.238259] test_bpf: #1 TXA jited:1 34 14 14 PASS
kern :info : [ 218.244288] test_bpf: #2 ADD_SUB_MUL_K jited:1 32 PASS
kern :info : [ 218.250691] test_bpf: #3 DIV_MOD_KX jited:1 42 PASS
kern :info : [ 218.256812] test_bpf: #4 AND_OR_LSH_K jited:1 29 15 PASS
kern :info : [ 218.263396] test_bpf: #5 LD_IMM_0 jited:1 17 PASS
kern :info : [ 218.269051] test_bpf: #6 LD_IND jited:1 36 67 35 PASS
kern :info : [ 218.275233] test_bpf: #7 LD_ABS jited:1 37 20 19 PASS
kern :info : [ 218.281410] test_bpf: #8 LD_ABS_LL jited:1 43 28 PASS
kern :info : [ 218.287744] test_bpf: #9 LD_IND_LL jited:1 36 20 20 PASS
kern :info : [ 218.294370] test_bpf: #10 LD_ABS_NET jited:1 54 24 PASS
kern :info : [ 218.300744] test_bpf: #11 LD_IND_NET jited:1 37 20 20 PASS
kern :info : [ 218.307363] test_bpf: #12 LD_PKTTYPE jited:1 32 18 PASS
kern :info : [ 218.313772] test_bpf: #13 LD_MARK jited:1 15 15 PASS
kern :info : [ 218.320015] test_bpf: #14 LD_RXHASH jited:1 15 15 PASS
kern :info : [ 218.326246] test_bpf: #15 LD_QUEUE jited:1 15 15 PASS
kern :info : [ 218.332407] test_bpf: #16 LD_PROTOCOL jited:1 20 19 PASS
kern :info : [ 218.338914] test_bpf: #17 LD_VLAN_TAG jited:1 15 15 PASS
kern :info : [ 218.345224] test_bpf: #18 LD_VLAN_TAG_PRESENT jited:1 15 15 PASS
kern :info : [ 218.352214] test_bpf: #19 LD_IFINDEX jited:1 16 16 PASS
kern :info : [ 218.358594] test_bpf: #20 LD_HATYPE jited:1 48 15 PASS
kern :info : [ 218.364883] test_bpf: #21 LD_CPU jited:1 18 51 PASS
kern :info : [ 218.371095] test_bpf: #22 LD_NLATTR jited:1 92 46 PASS
kern :info : [ 218.377537] test_bpf: #23 LD_NLATTR_NEST jited:1 60 61 PASS
kern :info : [ 218.384440] test_bpf: #24 LD_PAYLOAD_OFF jited:1 1355 1432 PASS
kern :info : [ 218.394149] test_bpf: #25 LD_ANC_XOR jited:1 15 27 PASS
kern :info : [ 218.400726] test_bpf: #26 SPILL_FILL jited:1 15 15 28 PASS
kern :info : [ 218.407298] test_bpf: #27 JEQ jited:1 36 17 16 PASS
kern :info : [ 218.413283] test_bpf: #28 JGT jited:1 21 16 17 PASS
kern :info : [ 218.419201] test_bpf: #29 JGE (jt 0), test 1 jited:1 46 16 15 PASS
kern :info : [ 218.426769] test_bpf: #30 JGE (jt 0), test 2 jited:1 23 23 24 PASS
kern :info : [ 218.435004] test_bpf: #31 JGE jited:1 28 30 30 PASS
kern :info : [ 218.441648] test_bpf: #32 JSET jited:1 30 28 32 PASS
kern :info : [ 218.448430] test_bpf: #33 tcpdump port 22 jited:1 48 37 39 PASS
kern :info : [ 218.456234] test_bpf: #34 tcpdump complex jited:1 20 27 34 PASS
kern :info : [ 218.463293] test_bpf: #35 RET_A jited:1 35 15 PASS
kern :info : [ 218.469127] test_bpf: #36 INT: ADD trivial jited:1 46 PASS
kern :info : [ 218.475707] test_bpf: #37 INT: MUL_X jited:1 33 PASS
kern :info : [ 218.481664] test_bpf: #38 INT: MUL_X2 jited:1 17 PASS
kern :info : [ 218.487740] test_bpf: #39 INT: MUL32_X jited:1 20 PASS
kern :info : [ 218.493882] test_bpf: #40 INT: ADD 64-bit jited:1 44 PASS
kern :info : [ 218.500321] test_bpf: #41 INT: ADD 32-bit jited:1 57 PASS
kern :info : [ 218.506784] test_bpf: #42 INT: SUB jited:1 28 PASS
kern :info : [ 218.512454] test_bpf: #43 INT: XOR jited:1 40 PASS
kern :info : [ 218.518286] test_bpf: #44 INT: MUL jited:1 62 PASS
kern :info : [ 218.524098] test_bpf: #45 MOV REG64 jited:1 16 PASS
kern :info : [ 218.530429] test_bpf: #46 MOV REG32 jited:1 23 PASS
kern :info : [ 218.536740] test_bpf: #47 LD IMM64 jited:1 23 PASS
kern :info : [ 218.543021] test_bpf: #48 INT: ALU MIX jited:1 40 PASS
kern :info : [ 218.549576] test_bpf: #49 INT: shifts by register jited:1 60 PASS
kern :info : [ 218.557539] test_bpf: #50 check: missing ret PASS
kern :info : [ 218.562972] test_bpf: #51 check: div_k_0 PASS
kern :info : [ 218.568248] test_bpf: #52 check: unknown insn PASS
kern :info : [ 218.573813] test_bpf: #53 check: out of range spill/fill PASS
kern :info : [ 218.580568] test_bpf: #54 JUMPS + HOLES jited:1 19 PASS
kern :info : [ 218.586923] test_bpf: #55 check: RET X PASS
kern :info : [ 218.591977] test_bpf: #56 check: LDX + RET X PASS
kern :info : [ 218.597444] test_bpf: #57 M[]: alt STX + LDX jited:1 26 PASS
kern :info : [ 218.603894] test_bpf: #58 M[]: full STX + full LDX jited:1 34 PASS
kern :info : [ 218.611067] test_bpf: #59 check: SKF_AD_MAX PASS
kern :info : [ 218.616502] test_bpf: #60 LD [SKF_AD_OFF-1] jited:1 19 PASS
kern :info : [ 218.623241] test_bpf: #61 load 64-bit immediate jited:1 17 PASS
kern :info : [ 218.630224] test_bpf: #62 ALU_MOV_X: dst = 2 jited:1 15 PASS
kern :info : [ 218.636885] test_bpf: #63 ALU_MOV_X: dst = 4294967295 jited:1 15 PASS
kern :info : [ 218.644414] test_bpf: #64 ALU64_MOV_X: dst = 2 jited:1 31 PASS
kern :info : [ 218.651401] test_bpf: #65 ALU64_MOV_X: dst = 4294967295 jited:1 30 PASS
kern :info : [ 218.659217] test_bpf: #66 ALU_MOV_K: dst = 2 jited:1 28 PASS
kern :info : [ 218.666039] test_bpf: #67 ALU_MOV_K: dst = 4294967295 jited:1 14 PASS
kern :info : [ 218.673587] test_bpf: #68 ALU_MOV_K: 0x0000ffffffff0000 = 0x00000000ffffffff jited:1 17 PASS
kern :info : [ 218.683051] test_bpf: #69 ALU64_MOV_K: dst = 2 jited:1 14 PASS
kern :info : [ 218.689936] test_bpf: #70 ALU64_MOV_K: dst = 2147483647 jited:1 14 PASS
kern :info : [ 218.697572] test_bpf: #71 ALU64_OR_K: dst = 0x0 jited:1 32 PASS
kern :info : [ 218.704558] test_bpf: #72 ALU64_MOV_K: dst = -1 jited:1 28 PASS
kern :info : [ 218.711567] test_bpf: #73 ALU_ADD_X: 1 + 2 = 3 jited:1 31 PASS
kern :info : [ 218.718530] test_bpf: #74 ALU_ADD_X: 1 + 4294967294 = 4294967295 jited:1 14 PASS
kern :info : [ 218.727050] test_bpf: #75 ALU_ADD_X: 2 + 4294967294 = 0 jited:1 30 PASS
kern :info : [ 218.734740] test_bpf: #76 ALU64_ADD_X: 1 + 2 = 3 jited:1 41 PASS
kern :info : [ 218.742061] test_bpf: #77 ALU64_ADD_X: 1 + 4294967294 = 4294967295 jited:1 17 PASS
kern :info : [ 218.750729] test_bpf: #78 ALU64_ADD_X: 2 + 4294967294 = 4294967296 jited:1 29 PASS
kern :info : [ 218.759582] test_bpf: #79 ALU_ADD_K: 1 + 2 = 3 jited:1 14 PASS
kern :info : [ 218.766585] test_bpf: #80 ALU_ADD_K: 3 + 0 = 3 jited:1 31 PASS
kern :info : [ 218.773557] test_bpf: #81 ALU_ADD_K: 1 + 4294967294 = 4294967295 jited:1 31 PASS
kern :info : [ 218.782151] test_bpf: #82 ALU_ADD_K: 4294967294 + 2 = 0 jited:1 28 PASS
kern :info : [ 218.790076] test_bpf: #83 ALU_ADD_K: 0 + (-1) = 0x00000000ffffffff jited:1 16 PASS
kern :info : [ 218.798570] test_bpf: #84 ALU_ADD_K: 0 + 0xffff = 0xffff jited:1 50 PASS
kern :info : [ 218.806619] test_bpf: #85 ALU_ADD_K: 0 + 0x7fffffff = 0x7fffffff jited:1 16 PASS
kern :info : [ 218.815366] test_bpf: #86 ALU_ADD_K: 0 + 0x80000000 = 0x80000000 jited:1 16 PASS
kern :info : [ 218.824105] test_bpf: #87 ALU_ADD_K: 0 + 0x80008000 = 0x80008000 jited:1 56 PASS
kern :info : [ 218.832577] test_bpf: #88 ALU64_ADD_K: 1 + 2 = 3 jited:1 31 PASS
kern :info : [ 218.839843] test_bpf: #89 ALU64_ADD_K: 3 + 0 = 3 jited:1 30 PASS
kern :info : [ 218.846934] test_bpf: #90 ALU64_ADD_K: 1 + 2147483646 = 2147483647 jited:1 14 PASS
kern :info : [ 218.855741] test_bpf: #91 ALU64_ADD_K: 4294967294 + 2 = 4294967296 jited:1 31 PASS
kern :info : [ 218.864473] test_bpf: #92 ALU64_ADD_K: 2147483646 + -2147483647 = -1 jited:1 15 PASS
kern :info : [ 218.873433] test_bpf: #93 ALU64_ADD_K: 1 + 0 = 1 jited:1 16 PASS
kern :info : [ 218.880638] test_bpf: #94 ALU64_ADD_K: 0 + (-1) = 0xffffffffffffffff jited:1 29 PASS
kern :info : [ 218.889476] test_bpf: #95 ALU64_ADD_K: 0 + 0xffff = 0xffff jited:1 47 PASS
kern :info : [ 218.897641] test_bpf: #96 ALU64_ADD_K: 0 + 0x7fffffff = 0x7fffffff jited:1 16 PASS
kern :info : [ 218.906600] test_bpf: #97 ALU64_ADD_K: 0 + 0x80000000 = 0xffffffff80000000 jited:1 32 PASS
kern :info : [ 218.916214] test_bpf: #98 ALU_ADD_K: 0 + 0x80008000 = 0xffffffff80008000 jited:1 17 PASS
kern :info : [ 218.925719] test_bpf: #99 ALU_SUB_X: 3 - 1 = 2 jited:1 14 PASS
kern :info : [ 218.932716] test_bpf: #100 ALU_SUB_X: 4294967295 - 4294967294 = 1 jited:1 14 PASS
kern :info : [ 218.941379] test_bpf: #101 ALU64_SUB_X: 3 - 1 = 2 jited:1 14 PASS
kern :info : [ 218.948550] test_bpf: #102 ALU64_SUB_X: 4294967295 - 4294967294 = 1 jited:1 30 PASS
kern :info : [ 218.957548] test_bpf: #103 ALU_SUB_K: 3 - 1 = 2 jited:1 28 PASS
kern :info : [ 218.964599] test_bpf: #104 ALU_SUB_K: 3 - 0 = 3 jited:1 15 PASS
kern :info : [ 218.971539] test_bpf: #105 ALU_SUB_K: 4294967295 - 4294967294 = 1 jited:1 42 PASS
kern :info : [ 218.980246] test_bpf: #106 ALU64_SUB_K: 3 - 1 = 2 jited:1 14 PASS
kern :info : [ 218.987424] test_bpf: #107 ALU64_SUB_K: 3 - 0 = 3 jited:1 14 PASS
kern :info : [ 218.994853] test_bpf: #108 ALU64_SUB_K: 4294967294 - 4294967295 = -1 jited:1 41 PASS
kern :info : [ 219.003967] test_bpf: #109 ALU64_ADD_K: 2147483646 - 2147483647 = -1 jited:1 14 PASS
kern :info : [ 219.012951] test_bpf: #110 ALU_MUL_X: 2 * 3 = 6 jited:1 15 PASS
kern :info : [ 219.019956] test_bpf: #111 ALU_MUL_X: 2 * 0x7FFFFFF8 = 0xFFFFFFF0 jited:1 15 PASS
kern :info : [ 219.028665] test_bpf: #112 ALU_MUL_X: -1 * -1 = 1 jited:1 16 PASS
kern :info : [ 219.036295] test_bpf: #113 ALU64_MUL_X: 2 * 3 = 6 jited:1 31 PASS
kern :info : [ 219.043546] test_bpf: #114 ALU64_MUL_X: 1 * 2147483647 = 2147483647 jited:1 20 PASS
kern :info : [ 219.053213] test_bpf: #115 ALU_MUL_K: 2 * 3 = 6 jited:1 28 PASS
kern :info : [ 219.060245] test_bpf: #116 ALU_MUL_K: 3 * 1 = 3 jited:1 16 PASS
kern :info : [ 219.067304] test_bpf: #117 ALU_MUL_K: 2 * 0x7FFFFFF8 = 0xFFFFFFF0 jited:1 15 PASS
kern :info : [ 219.076058] test_bpf: #118 ALU_MUL_K: 1 * (-1) = 0x00000000ffffffff jited:1 17 PASS
kern :info : [ 219.084931] test_bpf: #119 ALU64_MUL_K: 2 * 3 = 6 jited:1 15 PASS
kern :info : [ 219.092206] test_bpf: #120 ALU64_MUL_K: 3 * 1 = 3 jited:1 30 PASS
kern :info : [ 219.099622] test_bpf: #121 ALU64_MUL_K: 1 * 2147483647 = 2147483647 jited:1 28 PASS
kern :info : [ 219.108668] test_bpf: #122 ALU64_MUL_K: 1 * -2147483647 = -2147483647 jited:1 41 PASS
kern :info : [ 219.117828] test_bpf: #123 ALU64_MUL_K: 1 * (-1) = 0xffffffffffffffff jited:1 42 PASS
kern :info : [ 219.126857] test_bpf: #124 ALU_DIV_X: 6 / 2 = 3 jited:1 18 PASS
kern :info : [ 219.133963] test_bpf: #125 ALU_DIV_X: 4294967295 / 4294967295 = 1 jited:1 19 PASS
kern :info : [ 219.142635] test_bpf: #126 ALU64_DIV_X: 6 / 2 = 3 jited:1 51 PASS
kern :info : [ 219.150091] test_bpf: #127 ALU64_DIV_X: 2147483647 / 2147483647 = 1 jited:1 89 PASS
kern :info : [ 219.159082] test_bpf: #128 ALU64_DIV_X: 0xffffffffffffffff / (-1) = 0x0000000000000001 jited:1 22 PASS
kern :info : [ 219.169748] test_bpf: #129 ALU_DIV_K: 6 / 2 = 3 jited:1 18 PASS
kern :info : [ 219.176855] test_bpf: #130 ALU_DIV_K: 3 / 1 = 3 jited:1 45 PASS
kern :info : [ 219.183933] test_bpf: #131 ALU_DIV_K: 4294967295 / 4294967295 = 1 jited:1 18 PASS
kern :info : [ 219.192667] test_bpf: #132 ALU_DIV_K: 0xffffffffffffffff / (-1) = 0x1 jited:1 48 PASS
kern :info : [ 219.201806] test_bpf: #133 ALU64_DIV_K: 6 / 2 = 3 jited:1 36 PASS
kern :info : [ 219.209068] test_bpf: #134 ALU64_DIV_K: 3 / 1 = 3 jited:1 36 PASS
kern :info : [ 219.216189] test_bpf: #135 ALU64_DIV_K: 2147483647 / 2147483647 = 1 jited:1 23 PASS
kern :info : [ 219.225098] test_bpf: #136 ALU64_DIV_K: 0xffffffffffffffff / (-1) = 0x0000000000000001 jited:1 22 PASS
kern :info : [ 219.235723] test_bpf: #137 ALU_MOD_X: 3 % 2 = 1 jited:1 18 PASS
kern :info : [ 219.243052] test_bpf: #138 ALU_MOD_X: 4294967295 % 4294967293 = 2 jited:1 18 PASS
kern :info : [ 219.251780] test_bpf: #139 ALU64_MOD_X: 3 % 2 = 1 jited:1 23 PASS
kern :info : [ 219.259097] test_bpf: #140 ALU64_MOD_X: 2147483647 % 2147483645 = 2 jited:1 38 PASS
kern :info : [ 219.268039] test_bpf: #141 ALU_MOD_K: 3 % 2 = 1 jited:1 19 PASS
kern :info : [ 219.275114] test_bpf: #142 ALU_MOD_K: 3 % 1 = 0 jited:1 PASS
kern :info : [ 219.282033] test_bpf: #143 ALU_MOD_K: 4294967295 % 4294967293 = 2 jited:1 18 PASS
kern :info : [ 219.290795] test_bpf: #144 ALU64_MOD_K: 3 % 2 = 1 jited:1 35 PASS
kern :info : [ 219.298123] test_bpf: #145 ALU64_MOD_K: 3 % 1 = 0 jited:1 PASS
kern :info : [ 219.305093] test_bpf: #146 ALU64_MOD_K: 2147483647 % 2147483645 = 2 jited:1 23 PASS
kern :info : [ 219.314052] test_bpf: #147 ALU_AND_X: 3 & 2 = 2 jited:1 15 PASS
kern :info : [ 219.321278] test_bpf: #148 ALU_AND_X: 0xffffffff & 0xffffffff = 0xffffffff jited:1 31 PASS
kern :info : [ 219.330968] test_bpf: #149 ALU64_AND_X: 3 & 2 = 2 jited:1 15 PASS
kern :info : [ 219.338525] test_bpf: #150 ALU64_AND_X: 0xffffffff & 0xffffffff = 0xffffffff jited:1 27 PASS
kern :info : [ 219.348528] test_bpf: #151 ALU_AND_K: 3 & 2 = 2 jited:1 28 PASS
kern :info : [ 219.355735] test_bpf: #152 ALU_AND_K: 0xffffffff & 0xffffffff = 0xffffffff jited:1 14 PASS
kern :info : [ 219.365344] test_bpf: #153 ALU64_AND_K: 3 & 2 = 2 jited:1 30 PASS
kern :info : [ 219.372875] test_bpf: #154 ALU64_AND_K: 0xffffffff & 0xffffffff = 0xffffffff jited:1 43 PASS
kern :info : [ 219.382638] test_bpf: #155 ALU64_AND_K: 0x0000ffffffff0000 & 0x0 = 0x0000ffff00000000 jited:1 15 PASS
kern :info : [ 219.393475] test_bpf: #156 ALU64_AND_K: 0x0000ffffffff0000 & -1 = 0x0000ffffffffffff jited:1 16 PASS
kern :info : [ 219.403980] test_bpf: #157 ALU64_AND_K: 0xffffffffffffffff & -1 = 0xffffffffffffffff jited:1 43 PASS
kern :info : [ 219.414628] test_bpf: #158 ALU_OR_X: 1 | 2 = 3 jited:1 15 PASS
kern :info : [ 219.421746] test_bpf: #159 ALU_OR_X: 0x0 | 0xffffffff = 0xffffffff jited:1 32 PASS
kern :info : [ 219.430830] test_bpf: #160 ALU64_OR_X: 1 | 2 = 3 jited:1 14 PASS
kern :info : [ 219.438279] test_bpf: #161 ALU64_OR_X: 0 | 0xffffffff = 0xffffffff jited:1 14 PASS
kern :info : [ 219.447219] test_bpf: #162 ALU_OR_K: 1 | 2 = 3 jited:1 31 PASS
kern :info : [ 219.454225] test_bpf: #163 ALU_OR_K: 0 & 0xffffffff = 0xffffffff jited:1 31 PASS
kern :info : [ 219.463133] test_bpf: #164 ALU64_OR_K: 1 | 2 = 3 jited:1 15 PASS
kern :info : [ 219.470262] test_bpf: #165 ALU64_OR_K: 0 & 0xffffffff = 0xffffffff jited:1 30 PASS
kern :info : [ 219.479684] test_bpf: #166 ALU64_OR_K: 0x0000ffffffff0000 | 0x0 = 0x0000ffff00000000 jited:1 16 PASS
kern :info : [ 219.490378] test_bpf: #167 ALU64_OR_K: 0x0000ffffffff0000 | -1 = 0xffffffffffffffff jited:1 15 PASS
kern :info : [ 219.500792] test_bpf: #168 ALU64_OR_K: 0x000000000000000 | -1 = 0xffffffffffffffff jited:1 29 PASS
kern :info : [ 219.511157] test_bpf: #169 ALU_XOR_X: 5 ^ 6 = 3 jited:1 15 PASS
kern :info : [ 219.518457] test_bpf: #170 ALU_XOR_X: 0x1 ^ 0xffffffff = 0xfffffffe jited:1 15 PASS
kern :info : [ 219.527436] test_bpf: #171 ALU64_XOR_X: 5 ^ 6 = 3 jited:1 31 PASS
kern :info : [ 219.534936] test_bpf: #172 ALU64_XOR_X: 1 ^ 0xffffffff = 0xfffffffe jited:1 31 PASS
kern :info : [ 219.543997] test_bpf: #173 ALU_XOR_K: 5 ^ 6 = 3 jited:1 30 PASS
kern :info : [ 219.551584] test_bpf: #174 ALU_XOR_K: 1 ^ 0xffffffff = 0xfffffffe jited:1 14 PASS
kern :info : [ 219.560258] test_bpf: #175 ALU64_XOR_K: 5 ^ 6 = 3 jited:1 14 PASS
kern :info : [ 219.567736] test_bpf: #176 ALU64_XOR_K: 1 & 0xffffffff = 0xfffffffe jited:1 28 PASS
kern :info : [ 219.576870] test_bpf: #177 ALU64_XOR_K: 0x0000ffffffff0000 ^ 0x0 = 0x0000ffffffff0000 jited:1 16 PASS
kern :info : [ 219.587602] test_bpf: #178 ALU64_XOR_K: 0x0000ffffffff0000 ^ -1 = 0xffff00000000ffff jited:1 29 PASS
kern :info : [ 219.598272] test_bpf: #179 ALU64_XOR_K: 0x000000000000000 ^ -1 = 0xffffffffffffffff jited:1 32 PASS
kern :info : [ 219.608971] test_bpf: #180 ALU_LSH_X: 1 << 1 = 2 jited:1 15 PASS
kern :info : [ 219.616402] test_bpf: #181 ALU_LSH_X: 1 << 31 = 0x80000000 jited:1 15 PASS
kern :info : [ 219.624774] test_bpf: #182 ALU64_LSH_X: 1 << 1 = 2 jited:1 28 PASS
kern :info : [ 219.632477] test_bpf: #183 ALU64_LSH_X: 1 << 31 = 0x80000000 jited:1 31 PASS
kern :info : [ 219.640877] test_bpf: #184 ALU_LSH_K: 1 << 1 = 2 jited:1 15 PASS
kern :info : [ 219.648456] test_bpf: #185 ALU_LSH_K: 1 << 31 = 0x80000000 jited:1 27 PASS
kern :info : [ 219.656726] test_bpf: #186 ALU64_LSH_K: 1 << 1 = 2 jited:1 31 PASS
kern :info : [ 219.664348] test_bpf: #187 ALU64_LSH_K: 1 << 31 = 0x80000000 jited:1 30 PASS
kern :info : [ 219.672942] test_bpf: #188 ALU_RSH_X: 2 >> 1 = 1 jited:1 31 PASS
kern :info : [ 219.680337] test_bpf: #189 ALU_RSH_X: 0x80000000 >> 31 = 1 jited:1 31 PASS
kern :info : [ 219.688564] test_bpf: #190 ALU64_RSH_X: 2 >> 1 = 1 jited:1 28 PASS
kern :info : [ 219.696200] test_bpf: #191 ALU64_RSH_X: 0x80000000 >> 31 = 1 jited:1 15 PASS
kern :info : [ 219.704839] test_bpf: #192 ALU_RSH_K: 2 >> 1 = 1 jited:1 40 PASS
kern :info : [ 219.712278] test_bpf: #193 ALU_RSH_K: 0x80000000 >> 31 = 1 jited:1 28 PASS
kern :info : [ 219.720570] test_bpf: #194 ALU64_RSH_K: 2 >> 1 = 1 jited:1 14 PASS
kern :info : [ 219.728130] test_bpf: #195 ALU64_RSH_K: 0x80000000 >> 31 = 1 jited:1 96 PASS
kern :info : [ 219.736663] test_bpf: #196 ALU_ARSH_X: 0xff00ff0000000000 >> 40 = 0xffffffffffff00ff jited:1 43 PASS
kern :info : [ 219.747440] test_bpf: #197 ALU_ARSH_K: 0xff00ff0000000000 >> 40 = 0xffffffffffff00ff jited:1 30 PASS
kern :info : [ 219.758166] test_bpf: #198 ALU_NEG: -(3) = -3 jited:1 17 PASS
kern :info : [ 219.765372] test_bpf: #199 ALU_NEG: -(-3) = 3 jited:1 14 PASS
kern :info : [ 219.772531] test_bpf: #200 ALU64_NEG: -(3) = -3 jited:1 30 PASS
kern :info : [ 219.779645] test_bpf: #201 ALU64_NEG: -(-3) = 3 jited:1 27 PASS
kern :info : [ 219.786845] test_bpf: #202 ALU_END_FROM_BE 16: 0x0123456789abcdef -> 0xcdef jited:1 29 PASS
kern :info : [ 219.796701] test_bpf: #203 ALU_END_FROM_BE 32: 0x0123456789abcdef -> 0x89abcdef jited:1 41 PASS
kern :info : [ 219.806906] test_bpf: #204 ALU_END_FROM_BE 64: 0x0123456789abcdef -> 0x89abcdef jited:1 14 PASS
kern :info : [ 219.816957] test_bpf: #205 ALU_END_FROM_LE 16: 0x0123456789abcdef -> 0xefcd jited:1 14 PASS
kern :info : [ 219.826743] test_bpf: #206 ALU_END_FROM_LE 32: 0x0123456789abcdef -> 0xefcdab89 jited:1 15 PASS
kern :info : [ 219.836890] test_bpf: #207 ALU_END_FROM_LE 64: 0x0123456789abcdef -> 0x67452301 jited:1 14 PASS
kern :info : [ 219.846956] test_bpf: #208 ST_MEM_B: Store/Load byte: max negative jited:1 15 PASS
kern :info : [ 219.855815] test_bpf: #209 ST_MEM_B: Store/Load byte: max positive jited:1 15 PASS
kern :info : [ 219.864781] test_bpf: #210 STX_MEM_B: Store/Load byte: max negative jited:1 15 PASS
kern :info : [ 219.873935] test_bpf: #211 ST_MEM_H: Store/Load half word: max negative jited:1 99 PASS
kern :info : [ 219.883545] test_bpf: #212 ST_MEM_H: Store/Load half word: max positive jited:1 33 PASS
kern :info : [ 219.892812] test_bpf: #213 STX_MEM_H: Store/Load half word: max negative jited:1 16 PASS
kern :info : [ 219.902519] test_bpf: #214 ST_MEM_W: Store/Load word: max negative jited:1 31 PASS
kern :info : [ 219.911221] test_bpf: #215 ST_MEM_W: Store/Load word: max positive jited:1 30 PASS
kern :info : [ 219.920275] test_bpf: #216 STX_MEM_W: Store/Load word: max negative jited:1 15 PASS
kern :info : [ 219.929085] test_bpf: #217 ST_MEM_DW: Store/Load double word: max negative jited:1 15 PASS
kern :info : [ 219.938677] test_bpf: #218 ST_MEM_DW: Store/Load double word: max negative 2 jited:1 17 PASS
kern :info : [ 219.948518] test_bpf: #219 ST_MEM_DW: Store/Load double word: max positive jited:1 15 PASS
kern :info : [ 219.958086] test_bpf: #220 STX_MEM_DW: Store/Load double word: max negative jited:1 15 PASS
kern :info : [ 219.967727] test_bpf: #221 STX_XADD_W: Test: 0x12 + 0x10 = 0x22 jited:1 35 PASS
kern :info : [ 219.976311] test_bpf: #222 STX_XADD_W: Test side-effects, r10: 0x12 + 0x10 = 0x22 jited:1 PASS
kern :info : [ 219.986519] test_bpf: #223 STX_XADD_W: Test side-effects, r0: 0x12 + 0x10 = 0x22 jited:1 37 PASS
kern :info : [ 219.996645] test_bpf: #224 STX_XADD_W: X + 1 + 1 + 1 + ... jited:1 23331 PASS
kern :info : [ 220.028577] test_bpf: #225 STX_XADD_DW: Test: 0x12 + 0x10 = 0x22 jited:1 38 PASS
kern :info : [ 220.037256] test_bpf: #226 STX_XADD_DW: Test side-effects, r10: 0x12 + 0x10 = 0x22 jited:1 PASS
kern :info : [ 220.047387] test_bpf: #227 STX_XADD_DW: Test side-effects, r0: 0x12 + 0x10 = 0x22 jited:1 23 PASS
kern :info : [ 220.057627] test_bpf: #228 STX_XADD_DW: X + 1 + 1 + 1 + ... jited:1 23321 PASS
kern :info : [ 220.089670] test_bpf: #229 JMP_EXIT jited:1 30 PASS
kern :info : [ 220.095687] test_bpf: #230 JMP_JA: Unconditional jump: if (true) return 1 jited:1 16 PASS
kern :info : [ 220.105089] test_bpf: #231 JMP_JSLT_K: Signed jump: if (-2 < -1) return 1 jited:1 16 PASS
kern :info : [ 220.114639] test_bpf: #232 JMP_JSLT_K: Signed jump: if (-1 < -1) return 0 jited:1 31 PASS
kern :info : [ 220.124095] test_bpf: #233 JMP_JSGT_K: Signed jump: if (-1 > -2) return 1 jited:1 16 PASS
kern :info : [ 220.133667] test_bpf: #234 JMP_JSGT_K: Signed jump: if (-1 > -1) return 0 jited:1 15 PASS
kern :info : [ 220.143020] test_bpf: #235 JMP_JSLE_K: Signed jump: if (-2 <= -1) return 1 jited:1 29 PASS
kern :info : [ 220.152627] test_bpf: #236 JMP_JSLE_K: Signed jump: if (-1 <= -1) return 1 jited:1 30 PASS
kern :info : [ 220.162193] test_bpf: #237 JMP_JSLE_K: Signed jump: value walk 1 jited:1 17 PASS
kern :info : [ 220.170802] test_bpf: #238 JMP_JSLE_K: Signed jump: value walk 2 jited:1 44 PASS
kern :info : [ 220.179597] test_bpf: #239 JMP_JSGE_K: Signed jump: if (-1 >= -2) return 1 jited:1 16 PASS
kern :info : [ 220.189121] test_bpf: #240 JMP_JSGE_K: Signed jump: if (-1 >= -1) return 1 jited:1 35 PASS
kern :info : [ 220.198646] test_bpf: #241 JMP_JSGE_K: Signed jump: value walk 1 jited:1 16 PASS
kern :info : [ 220.207170] test_bpf: #242 JMP_JSGE_K: Signed jump: value walk 2 jited:1 33 PASS
kern :info : [ 220.215748] test_bpf: #243 JMP_JGT_K: if (3 > 2) return 1 jited:1 16 PASS
kern :info : [ 220.223806] test_bpf: #244 JMP_JGT_K: Unsigned jump: if (-1 > 1) return 1 jited:1 16 PASS
kern :info : [ 220.233118] test_bpf: #245 JMP_JLT_K: if (2 < 3) return 1 jited:1 16 PASS
kern :info : [ 220.241038] test_bpf: #246 JMP_JGT_K: Unsigned jump: if (1 < -1) return 1 jited:1 16 PASS
kern :info : [ 220.250449] test_bpf: #247 JMP_JGE_K: if (3 >= 2) return 1 jited:1 16 PASS
kern :info : [ 220.258656] test_bpf: #248 JMP_JLE_K: if (2 <= 3) return 1 jited:1 29 PASS
kern :info : [ 220.266785] test_bpf: #249 JMP_JGT_K: if (3 > 2) return 1 (jump backwards) jited:1 16 PASS
kern :info : [ 220.276386] test_bpf: #250 JMP_JGE_K: if (3 >= 3) return 1 jited:1 16 PASS
kern :info : [ 220.284520] test_bpf: #251 JMP_JGT_K: if (2 < 3) return 1 (jump backwards) jited:1 30 PASS
kern :info : [ 220.294064] test_bpf: #252 JMP_JLE_K: if (3 <= 3) return 1 jited:1 31 PASS
kern :info : [ 220.302112] test_bpf: #253 JMP_JNE_K: if (3 != 2) return 1 jited:1 16 PASS
kern :info : [ 220.310237] test_bpf: #254 JMP_JEQ_K: if (3 == 3) return 1 jited:1 48 PASS
kern :info : [ 220.318375] test_bpf: #255 JMP_JSET_K: if (0x3 & 0x2) return 1 jited:1 17 PASS
kern :info : [ 220.326768] test_bpf: #256 JMP_JSET_K: if (0x3 & 0xffffffff) return 1 jited:1 16 PASS
kern :info : [ 220.335896] test_bpf: #257 JMP_JSGT_X: Signed jump: if (-1 > -2) return 1 jited:1 30 PASS
kern :info : [ 220.345398] test_bpf: #258 JMP_JSGT_X: Signed jump: if (-1 > -1) return 0 jited:1 31 PASS
kern :info : [ 220.354824] test_bpf: #259 JMP_JSLT_X: Signed jump: if (-2 < -1) return 1 jited:1 15 PASS
kern :info : [ 220.364434] test_bpf: #260 JMP_JSLT_X: Signed jump: if (-1 < -1) return 0 jited:1 31 PASS
kern :info : [ 220.373940] test_bpf: #261 JMP_JSGE_X: Signed jump: if (-1 >= -2) return 1 jited:1 16 PASS
kern :info : [ 220.383575] test_bpf: #262 JMP_JSGE_X: Signed jump: if (-1 >= -1) return 1 jited:1 17 PASS
kern :info : [ 220.393028] test_bpf: #263 JMP_JSLE_X: Signed jump: if (-2 <= -1) return 1 jited:1 16 PASS
kern :info : [ 220.402676] test_bpf: #264 JMP_JSLE_X: Signed jump: if (-1 <= -1) return 1 jited:1 29 PASS
kern :info : [ 220.412314] test_bpf: #265 JMP_JGT_X: if (3 > 2) return 1 jited:1 32 PASS
kern :info : [ 220.420350] test_bpf: #266 JMP_JGT_X: Unsigned jump: if (-1 > 1) return 1 jited:1 33 PASS
kern :info : [ 220.429941] test_bpf: #267 JMP_JLT_X: if (2 < 3) return 1 jited:1 15 PASS
kern :info : [ 220.438007] test_bpf: #268 JMP_JLT_X: Unsigned jump: if (1 < -1) return 1 jited:1 16 PASS
kern :info : [ 220.447284] test_bpf: #269 JMP_JGE_X: if (3 >= 2) return 1 jited:1 15 PASS
kern :info : [ 220.455471] test_bpf: #270 JMP_JGE_X: if (3 >= 3) return 1 jited:1 16 PASS
kern :info : [ 220.463517] test_bpf: #271 JMP_JLE_X: if (2 <= 3) return 1 jited:1 47 PASS
kern :info : [ 220.471537] test_bpf: #272 JMP_JLE_X: if (3 <= 3) return 1 jited:1 48 PASS
kern :info : [ 220.479407] test_bpf: #273 JMP_JGE_X: ldimm64 test 1 jited:1 15 PASS
kern :info : [ 220.487041] test_bpf: #274 JMP_JGE_X: ldimm64 test 2 jited:1 16 PASS
kern :info : [ 220.494563] test_bpf: #275 JMP_JGE_X: ldimm64 test 3 jited:1 15 PASS
kern :info : [ 220.502257] test_bpf: #276 JMP_JLE_X: ldimm64 test 1 jited:1 15 PASS
kern :info : [ 220.509756] test_bpf: #277 JMP_JLE_X: ldimm64 test 2 jited:1 15 PASS
kern :info : [ 220.517118] test_bpf: #278 JMP_JLE_X: ldimm64 test 3 jited:1 46 PASS
kern :info : [ 220.524727] test_bpf: #279 JMP_JNE_X: if (3 != 2) return 1 jited:1 31 PASS
kern :info : [ 220.532981] test_bpf: #280 JMP_JEQ_X: if (3 == 3) return 1 jited:1 16 PASS
kern :info : [ 220.541029] test_bpf: #281 JMP_JSET_X: if (0x3 & 0x2) return 1 jited:1 32 PASS
kern :info : [ 220.549426] test_bpf: #282 JMP_JSET_X: if (0x3 & 0xffffffff) return 1 jited:1 16 PASS
kern :info : [ 220.558609] test_bpf: #283 JMP_JA: Jump, gap, jump, ... jited:1 15 PASS
kern :info : [ 220.566492] test_bpf: #284 BPF_MAXINSNS: Maximum possible literals jited:1 28 PASS
kern :info : [ 220.576482] test_bpf: #285 BPF_MAXINSNS: Single literal jited:1 31 PASS
kern :info : [ 220.585206] test_bpf: #286 BPF_MAXINSNS: Run/add until end jited:1 1270 PASS
kern :info : [ 220.595248] test_bpf: #287 BPF_MAXINSNS: Too many instructions PASS
kern :info : [ 220.602496] test_bpf: #288 BPF_MAXINSNS: Very long jump jited:1 16 PASS
kern :info : [ 220.611388] test_bpf: #289 BPF_MAXINSNS: Ctx heavy transformations jited:1 882 924 PASS
kern :info : [ 220.623139] test_bpf: #290 BPF_MAXINSNS: Call heavy transformations jited:1 15436 15275 PASS
kern :info : [ 220.664413] test_bpf: #291 BPF_MAXINSNS: Jump heavy test jited:1 1157 PASS
kern :info : [ 220.674935] test_bpf: #292 BPF_MAXINSNS: Very long jump backwards jited:1 28 PASS
kern :info : [ 220.683870] test_bpf: #293 BPF_MAXINSNS: Edge hopping nuthouse jited:1 9467 PASS
kern :info : [ 220.702435] test_bpf: #294 BPF_MAXINSNS: Jump, gap, jump, ...
kern :warn : [ 220.703470] bpf_jit: disable optimizations for further passes
kern :warn : [ 220.717031] UNEXPECTED_PASS
kern :info : [ 220.717046] test_bpf: #295 BPF_MAXINSNS: jump over MSH PASS
kern :info : [ 220.727738] test_bpf: #296 BPF_MAXINSNS: exec all MSH jited:1 7928 PASS
kern :info : [ 220.747560] test_bpf: #297 BPF_MAXINSNS: ld_abs+get_processor_id jited:1 7861 PASS
kern :info : [ 220.766620] test_bpf: #298 LD_IND byte frag jited:1 72 PASS
kern :info : [ 220.773561] test_bpf: #299 LD_IND halfword frag jited:1 61 PASS
kern :info : [ 220.780588] test_bpf: #300 LD_IND word frag jited:1 76 PASS
kern :info : [ 220.787401] test_bpf: #301 LD_IND halfword mixed head/frag jited:1 53 PASS
kern :info : [ 220.795281] test_bpf: #302 LD_IND word mixed head/frag jited:1 67 PASS
kern :info : [ 220.803442] test_bpf: #303 LD_ABS byte frag jited:1 77 PASS
kern :info : [ 220.810126] test_bpf: #304 LD_ABS halfword frag jited:1 46 PASS
kern :info : [ 220.817107] test_bpf: #305 LD_ABS word frag jited:1 92 PASS
kern :info : [ 220.823811] test_bpf: #306 LD_ABS halfword mixed head/frag jited:1 53 PASS
kern :info : [ 220.831918] test_bpf: #307 LD_ABS word mixed head/frag jited:1 66 PASS
kern :info : [ 220.839605] test_bpf: #308 LD_IND byte default X jited:1 21 PASS
kern :info : [ 220.846694] test_bpf: #309 LD_IND byte positive offset jited:1 52 PASS
kern :info : [ 220.854389] test_bpf: #310 LD_IND byte negative offset jited:1 20 PASS
kern :info : [ 220.862023] test_bpf: #311 LD_IND byte positive offset, all ff jited:1 20 PASS
kern :info : [ 220.870274] test_bpf: #312 LD_IND byte positive offset, out of bounds jited:1 36 PASS
kern :info : [ 220.879245] test_bpf: #313 LD_IND byte negative offset, out of bounds jited:1 22 PASS
kern :info : [ 220.888240] test_bpf: #314 LD_IND byte negative offset, multiple calls jited:1 67 PASS
kern :info : [ 220.897522] test_bpf: #315 LD_IND halfword positive offset jited:1 19 PASS
kern :info : [ 220.905500] test_bpf: #316 LD_IND halfword negative offset jited:1 19 PASS
kern :info : [ 220.913499] test_bpf: #317 LD_IND halfword unaligned jited:1 19 PASS
kern :info : [ 220.920943] test_bpf: #318 LD_IND halfword positive offset, all ff jited:1 19 PASS
kern :info : [ 220.929701] test_bpf: #319 LD_IND halfword positive offset, out of bounds jited:1 20 PASS
kern :info : [ 220.938959] test_bpf: #320 LD_IND halfword negative offset, out of bounds jited:1 46 PASS
kern :info : [ 220.948384] test_bpf: #321 LD_IND word positive offset jited:1 31 PASS
kern :info : [ 220.956441] test_bpf: #322 LD_IND word negative offset jited:1 58 PASS
kern :info : [ 220.964354] test_bpf: #323 LD_IND word unaligned (addr & 3 == 2) jited:1 18 PASS
kern :info : [ 220.972891] test_bpf: #324 LD_IND word unaligned (addr & 3 == 1) jited:1 19 PASS
kern :info : [ 220.981433] test_bpf: #325 LD_IND word unaligned (addr & 3 == 3) jited:1 23 PASS
kern :info : [ 220.990107] test_bpf: #326 LD_IND word positive offset, all ff jited:1 32 PASS
kern :info : [ 220.998522] test_bpf: #327 LD_IND word positive offset, out of bounds jited:1 21 PASS
kern :info : [ 221.007554] test_bpf: #328 LD_IND word negative offset, out of bounds jited:1 20 PASS
kern :info : [ 221.016508] test_bpf: #329 LD_ABS byte jited:1 32 PASS
kern :info : [ 221.022921] test_bpf: #330 LD_ABS byte positive offset, all ff jited:1 16 PASS
kern :info : [ 221.031363] test_bpf: #331 LD_ABS byte positive offset, out of bounds jited:1 19 PASS
kern :info : [ 221.040290] test_bpf: #332 LD_ABS byte negative offset, out of bounds load PASS
kern :info : [ 221.048546] test_bpf: #333 LD_ABS byte negative offset, in bounds jited:1 34 PASS
kern :info : [ 221.057356] test_bpf: #334 LD_ABS byte negative offset, out of bounds jited:1 21 PASS
kern :info : [ 221.066369] test_bpf: #335 LD_ABS byte negative offset, multiple calls jited:1 66 PASS
kern :info : [ 221.075602] test_bpf: #336 LD_ABS halfword jited:1 45 PASS
kern :info : [ 221.082310] test_bpf: #337 LD_ABS halfword unaligned jited:1 17 PASS
kern :info : [ 221.089952] test_bpf: #338 LD_ABS halfword positive offset, all ff jited:1 16 PASS
kern :info : [ 221.098623] test_bpf: #339 LD_ABS halfword positive offset, out of bounds jited:1 19 PASS
kern :info : [ 221.107986] test_bpf: #340 LD_ABS halfword negative offset, out of bounds load PASS
kern :info : [ 221.116747] test_bpf: #341 LD_ABS halfword negative offset, in bounds jited:1 21 PASS
kern :info : [ 221.125926] test_bpf: #342 LD_ABS halfword negative offset, out of bounds jited:1 34 PASS
kern :info : [ 221.135322] test_bpf: #343 LD_ABS word jited:1 32 PASS
kern :info : [ 221.141799] test_bpf: #344 LD_ABS word unaligned (addr & 3 == 2) jited:1 17 PASS
kern :info : [ 221.150380] test_bpf: #345 LD_ABS word unaligned (addr & 3 == 1) jited:1 48 PASS
kern :info : [ 221.158974] test_bpf: #346 LD_ABS word unaligned (addr & 3 == 3) jited:1 16 PASS
kern :info : [ 221.167594] test_bpf: #347 LD_ABS word positive offset, all ff jited:1 32 PASS
kern :info : [ 221.176128] test_bpf: #348 LD_ABS word positive offset, out of bounds jited:1 23 PASS
kern :info : [ 221.185273] test_bpf: #349 LD_ABS word negative offset, out of bounds load PASS
kern :info : [ 221.193698] test_bpf: #350 LD_ABS word negative offset, in bounds jited:1 21 PASS
kern :info : [ 221.202599] test_bpf: #351 LD_ABS word negative offset, out of bounds jited:1 22 PASS
kern :info : [ 221.211976] test_bpf: #352 LDX_MSH standalone, preserved A jited:1 16 PASS
kern :info : [ 221.220091] test_bpf: #353 LDX_MSH standalone, preserved A 2 jited:1 31 PASS
kern :info : [ 221.228501] test_bpf: #354 LDX_MSH standalone, test result 1 jited:1 18 PASS
kern :info : [ 221.236753] test_bpf: #355 LDX_MSH standalone, test result 2 jited:1 32 PASS
kern :info : [ 221.245028] test_bpf: #356 LDX_MSH standalone, negative offset jited:1 21 PASS
kern :info : [ 221.253567] test_bpf: #357 LDX_MSH standalone, negative offset 2 jited:1 37 PASS
kern :info : [ 221.262370] test_bpf: #358 LDX_MSH standalone, out of bounds jited:1 20 PASS
kern :info : [ 221.270645] test_bpf: #359 ADD default X jited:1 15 PASS
kern :info : [ 221.276943] test_bpf: #360 ADD default A jited:1 28 PASS
kern :info : [ 221.283444] test_bpf: #361 SUB default X jited:1 28 PASS
kern :info : [ 221.289940] test_bpf: #362 SUB default A jited:1 15 PASS
kern :info : [ 221.296293] test_bpf: #363 MUL default X jited:1 15 PASS
kern :info : [ 221.302735] test_bpf: #364 MUL default A jited:1 32 PASS
kern :info : [ 221.308930] test_bpf: #365 DIV default X jited:1 15 PASS
kern :info : [ 221.315126] test_bpf: #366 DIV default A jited:1 19 PASS
kern :info : [ 221.321567] test_bpf: #367 MOD default X jited:1 15 PASS
kern :info : [ 221.327878] test_bpf: #368 MOD default A jited:1 31 PASS
kern :info : [ 221.334163] test_bpf: #369 JMP EQ default A jited:1 30 PASS
kern :info : [ 221.340815] test_bpf: #370 JMP EQ default X jited:1 31 PASS
kern :info : [ 221.347547] test_bpf: #371 JNE signed compare, test 1 jited:1 44 PASS
kern :info : [ 221.355072] test_bpf: #372 JNE signed compare, test 2 jited:1 15 PASS
kern :info : [ 221.362663] test_bpf: #373 JNE signed compare, test 3 jited:1 16 PASS
kern :info : [ 221.370317] test_bpf: #374 JNE signed compare, test 4 jited:1 15 PASS
kern :info : [ 221.377885] test_bpf: #375 JNE signed compare, test 5 jited:1 15 PASS
kern :info : [ 221.385489] test_bpf: #376 JNE signed compare, test 6 jited:1 14 PASS
kern :info : [ 221.393195] test_bpf: #377 JNE signed compare, test 7 jited:1 46 PASS
kern :info : [ 221.400882] test_bpf: Summary: 377 PASSED, 1 FAILED, [365/365 JIT'ed]
user :notice: [ 221.434499] # test_bpf: [FAIL]
user :notice: [ 221.441834] not ok 9 selftests: net: test_bpf.sh # exit=1
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[fs/userfaultfd] fec9227821: will-it-scale.per_process_ops -5.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -5.5% regression of will-it-scale.per_process_ops due to commit:
commit: fec92278217ba01b4a3b9f9ec0f6a392069cdbd0 ("[RFC PATCH 12/13] fs/userfaultfd: kmem-cache for wait-queue objects")
url: https://github.com/0day-ci/linux/commits/Nadav-Amit/fs-userfaultfd-suppor...
base: https://git.kernel.org/cgit/linux/kernel/git/shuah/linux-kselftest.git next
in testcase: will-it-scale
on test machine: 104 threads Skylake with 192G memory
with following parameters:
nr_task: 50%
mode: process
test: brk1
cpufreq_governor: performance
ucode: 0x2006a08
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -11.0% regression |
| test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=16 |
| | test=brk1 |
| | ucode=0x5003003 |
+------------------+---------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/brk1/will-it-scale/0x2006a08
commit:
ddfa740e9c ("fs/userfaultfd: complete write asynchronously")
fec9227821 ("fs/userfaultfd: kmem-cache for wait-queue objects")
ddfa740e9caf7642 fec92278217ba01b4a3b9f9ec0f
---------------- ---------------------------
%stddev %change %stddev
\ | \
65219467 -5.5% 61607693 will-it-scale.52.processes
1254220 -5.5% 1184763 will-it-scale.per_process_ops
65219467 -5.5% 61607693 will-it-scale.workload
20.00 -5.0% 19.00 vmstat.cpu.us
34.22 -4.0% 32.85 ± 2% boot-time.boot
3146 -4.3% 3010 ± 2% boot-time.idle
654.25 ± 20% -39.0% 399.25 ± 25% numa-vmstat.node0.nr_active_anon
654.25 ± 20% -39.0% 399.25 ± 25% numa-vmstat.node0.nr_zone_active_anon
10140 ± 9% +27.1% 12889 ± 10% numa-vmstat.node1.nr_slab_reclaimable
21388 ± 3% +13.2% 24204 ± 7% numa-vmstat.node1.nr_slab_unreclaimable
1096 ± 8% +304.6% 4434 slabinfo.dmaengine-unmap-16.active_objs
1096 ± 8% +304.6% 4434 slabinfo.dmaengine-unmap-16.num_objs
4838 ± 4% -17.0% 4018 ± 3% slabinfo.eventpoll_pwq.active_objs
4838 ± 4% -17.0% 4018 ± 3% slabinfo.eventpoll_pwq.num_objs
2689 ± 18% -37.7% 1675 ± 22% numa-meminfo.node0.Active
2617 ± 20% -38.9% 1599 ± 25% numa-meminfo.node0.Active(anon)
40564 ± 9% +27.1% 51560 ± 10% numa-meminfo.node1.KReclaimable
40564 ± 9% +27.1% 51560 ± 10% numa-meminfo.node1.SReclaimable
85552 ± 3% +13.2% 96818 ± 7% numa-meminfo.node1.SUnreclaim
126118 ± 4% +17.7% 148380 ± 8% numa-meminfo.node1.Slab
7.12 ± 17% -87.9% 0.86 ±100% sched_debug.cfs_rq:/.removed.load_avg.avg
33.50 ± 8% -74.6% 8.50 ±100% sched_debug.cfs_rq:/.removed.load_avg.stddev
2.76 ± 27% -88.1% 0.33 ±102% sched_debug.cfs_rq:/.removed.runnable_avg.avg
80.58 ± 9% -60.1% 32.12 ±102% sched_debug.cfs_rq:/.removed.runnable_avg.max
13.39 ± 18% -75.9% 3.23 ±102% sched_debug.cfs_rq:/.removed.runnable_avg.stddev
2.76 ± 28% -88.1% 0.33 ±102% sched_debug.cfs_rq:/.removed.util_avg.avg
80.58 ± 9% -60.1% 32.12 ±102% sched_debug.cfs_rq:/.removed.util_avg.max
13.39 ± 18% -75.9% 3.23 ±102% sched_debug.cfs_rq:/.removed.util_avg.stddev
1036 ± 8% +14.0% 1181 ± 8% sched_debug.cpu.nr_switches.min
-22.25 -30.3% -15.50 sched_debug.cpu.nr_uninterruptible.min
2.50 ± 91% +7990.0% 202.25 ±166% interrupts.CPU1.TLB:TLB_shootdowns
451.00 +12.8% 508.75 ± 5% interrupts.CPU100.CAL:Function_call_interrupts
457.50 ± 3% +12.3% 514.00 ± 8% interrupts.CPU103.CAL:Function_call_interrupts
48.75 ±130% -89.7% 5.00 ±122% interrupts.CPU15.RES:Rescheduling_interrupts
3195 ± 18% +140.3% 7678 interrupts.CPU24.NMI:Non-maskable_interrupts
3195 ± 18% +140.3% 7678 interrupts.CPU24.PMI:Performance_monitoring_interrupts
8.25 ± 41% +1009.1% 91.50 ± 49% interrupts.CPU24.RES:Rescheduling_interrupts
694.25 ± 28% +89.6% 1316 ± 24% interrupts.CPU3.CAL:Function_call_interrupts
3946 ± 46% +86.3% 7352 ± 12% interrupts.CPU30.NMI:Non-maskable_interrupts
3946 ± 46% +86.3% 7352 ± 12% interrupts.CPU30.PMI:Performance_monitoring_interrupts
30.00 ±115% +200.8% 90.25 ± 51% interrupts.CPU36.RES:Rescheduling_interrupts
7.50 ± 14% +1123.3% 91.75 ± 51% interrupts.CPU40.RES:Rescheduling_interrupts
10.50 ± 38% +590.5% 72.50 ± 60% interrupts.CPU42.RES:Rescheduling_interrupts
449.00 +214.1% 1410 ±107% interrupts.CPU76.CAL:Function_call_interrupts
448.75 +99.8% 896.75 ± 51% interrupts.CPU82.CAL:Function_call_interrupts
453.25 +78.7% 809.75 ± 50% interrupts.CPU86.CAL:Function_call_interrupts
456.00 +145.0% 1117 ± 93% interrupts.CPU90.CAL:Function_call_interrupts
72.75 ± 82% -89.7% 7.50 ± 33% interrupts.CPU92.RES:Rescheduling_interrupts
2.00 ± 79% +1737.5% 36.75 ±146% interrupts.CPU92.TLB:TLB_shootdowns
5545 ± 32% +32.6% 7353 ± 12% interrupts.CPU93.NMI:Non-maskable_interrupts
5545 ± 32% +32.6% 7353 ± 12% interrupts.CPU93.PMI:Performance_monitoring_interrupts
10.50 ± 10% +514.3% 64.50 ± 76% interrupts.CPU93.RES:Rescheduling_interrupts
2.683e+10 +3.7% 2.781e+10 perf-stat.i.branch-instructions
0.68 -0.1 0.63 perf-stat.i.branch-miss-rate%
1.811e+08 -5.2% 1.718e+08 perf-stat.i.branch-misses
1.12 -4.6% 1.07 perf-stat.i.cpi
0.17 -0.0 0.15 perf-stat.i.dTLB-load-miss-rate%
64926279 -5.5% 61335249 perf-stat.i.dTLB-load-misses
3.779e+10 +5.6% 3.99e+10 perf-stat.i.dTLB-loads
2.1e+10 +2.7% 2.157e+10 perf-stat.i.dTLB-stores
1.292e+11 +4.6% 1.352e+11 perf-stat.i.instructions
1957 +3.7% 2029 perf-stat.i.instructions-per-iTLB-miss
0.89 +4.8% 0.94 perf-stat.i.ipc
823.71 +4.3% 858.87 perf-stat.i.metric.M/sec
0.67 -0.1 0.62 perf-stat.overall.branch-miss-rate%
1.12 -4.6% 1.07 perf-stat.overall.cpi
0.17 -0.0 0.15 perf-stat.overall.dTLB-load-miss-rate%
1933 +3.6% 2004 perf-stat.overall.instructions-per-iTLB-miss
0.89 +4.8% 0.94 perf-stat.overall.ipc
82.14 +1.7 83.85 perf-stat.overall.node-store-miss-rate%
597331 +10.8% 662119 perf-stat.overall.path-length
2.674e+10 +3.7% 2.772e+10 perf-stat.ps.branch-instructions
1.804e+08 -5.2% 1.71e+08 perf-stat.ps.branch-misses
64722645 -5.5% 61153001 perf-stat.ps.dTLB-load-misses
3.766e+10 +5.6% 3.976e+10 perf-stat.ps.dTLB-loads
2.093e+10 +2.7% 2.15e+10 perf-stat.ps.dTLB-stores
1.288e+11 +4.6% 1.347e+11 perf-stat.ps.instructions
3.896e+13 +4.7% 4.079e+13 perf-stat.total.instructions
19290 ± 14% -31.0% 13316 ± 5% softirqs.CPU13.RCU
22289 ± 79% -44.0% 12473 ±110% softirqs.CPU18.SCHED
19387 ± 12% -26.7% 14206 ± 6% softirqs.CPU21.RCU
14997 ± 5% +51.6% 22739 ± 2% softirqs.CPU24.RCU
39995 ± 3% -88.9% 4457 softirqs.CPU24.SCHED
22221 ± 79% -73.2% 5963 ± 42% softirqs.CPU28.SCHED
18559 ± 24% -28.7% 13237 ± 7% softirqs.CPU33.RCU
16004 ± 19% +31.9% 21107 ± 4% softirqs.CPU34.RCU
22675 ± 7% -31.0% 15655 ± 18% softirqs.CPU35.RCU
4273 ± 17% +620.7% 30798 ± 48% softirqs.CPU35.SCHED
20207 ± 16% -23.6% 15448 ± 19% softirqs.CPU37.RCU
15311 ± 19% +37.4% 21044 ± 7% softirqs.CPU4.RCU
30669 ± 48% -68.4% 9687 ± 89% softirqs.CPU40.SCHED
20195 ± 15% -23.5% 15442 ± 20% softirqs.CPU41.RCU
22191 ± 25% -37.8% 13806 ± 10% softirqs.CPU43.RCU
16782 ± 14% -21.8% 13122 ± 4% softirqs.CPU47.RCU
22290 ± 8% -22.0% 17381 ± 22% softirqs.CPU49.RCU
22338 ± 79% -79.7% 4526 softirqs.CPU61.SCHED
30860 ± 49% -85.3% 4533 softirqs.CPU65.SCHED
24975 ± 57% -82.2% 4447 softirqs.CPU73.SCHED
20318 ± 6% -39.8% 12236 ± 2% softirqs.CPU76.RCU
4615 ± 5% +761.7% 39773 ± 2% softirqs.CPU76.SCHED
21142 ± 3% -29.2% 14979 ± 9% softirqs.CPU82.RCU
13144 ±113% +199.0% 39305 ± 3% softirqs.CPU86.SCHED
39713 ± 4% -67.4% 12956 ±110% softirqs.CPU87.SCHED
17739 ± 16% -22.2% 13795 ± 4% softirqs.CPU88.RCU
18651 ± 15% -27.5% 13514 ± 11% softirqs.CPU92.RCU
30590 ± 48% -57.5% 12998 ±111% softirqs.CPU93.SCHED
15264 ± 17% +26.7% 19337 ± 5% softirqs.CPU95.RCU
1.33 ± 10% -0.1 1.20 ± 10% perf-profile.calltrace.cycles-pp.find_vma.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.80 ± 11% -0.1 0.69 ± 11% perf-profile.calltrace.cycles-pp.security_mmap_addr.get_unmapped_area.do_brk_flags.__x64_sys_brk.do_syscall_64
0.00 +0.8 0.76 ± 9% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64
0.00 +0.9 0.94 ± 4% perf-profile.calltrace.cycles-pp.kmem_cache_free.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
0.00 +2.3 2.29 ± 13% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.5 2.51 ± 12% perf-profile.calltrace.cycles-pp.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
0.55 ± 10% -0.3 0.28 ± 14% perf-profile.children.cycles-pp.vma_merge
1.81 ± 10% -0.2 1.59 ± 10% perf-profile.children.cycles-pp.get_unmapped_area
1.72 ± 10% -0.2 1.54 ± 10% perf-profile.children.cycles-pp.find_vma
0.30 ± 9% -0.1 0.15 ± 11% perf-profile.children.cycles-pp.cap_capable
0.82 ± 11% -0.1 0.70 ± 11% perf-profile.children.cycles-pp.security_mmap_addr
0.57 ± 11% -0.1 0.50 ± 9% perf-profile.children.cycles-pp.obj_cgroup_charge
0.32 ± 10% -0.1 0.25 ± 11% perf-profile.children.cycles-pp.__vm_enough_memory
0.32 ± 12% -0.1 0.26 ± 9% perf-profile.children.cycles-pp.__x86_retpoline_rax
0.46 ± 9% -0.1 0.41 ± 11% perf-profile.children.cycles-pp.vmacache_find
0.22 ± 11% -0.0 0.19 ± 10% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.24 ± 9% -0.0 0.21 ± 11% perf-profile.children.cycles-pp.free_pgd_range
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.should_failslab
2.83 ± 11% +0.7 3.49 ± 7% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +0.8 0.77 ± 9% perf-profile.children.cycles-pp.memset_erms
4.08 ± 11% +1.9 6.03 ± 11% perf-profile.children.cycles-pp.kmem_cache_alloc
0.21 ± 10% +2.3 2.52 ± 12% perf-profile.children.cycles-pp.userfaultfd_unmap_complete
0.53 ± 9% -0.3 0.27 ± 14% perf-profile.self.cycles-pp.vma_merge
0.28 ± 11% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.cap_capable
0.99 ± 10% -0.1 0.88 ± 11% perf-profile.self.cycles-pp.unmap_page_range
0.78 ± 11% -0.1 0.69 ± 9% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.70 ± 11% -0.1 0.62 ± 10% perf-profile.self.cycles-pp.vm_area_alloc
0.41 ± 11% -0.1 0.34 ± 12% perf-profile.self.cycles-pp.percpu_counter_add_batch
0.55 ± 12% -0.1 0.49 ± 9% perf-profile.self.cycles-pp.obj_cgroup_charge
0.44 ± 9% -0.1 0.39 ± 11% perf-profile.self.cycles-pp.vmacache_find
0.25 ± 12% -0.1 0.20 ± 10% perf-profile.self.cycles-pp.__x86_retpoline_rax
0.36 ± 11% -0.0 0.31 ± 10% perf-profile.self.cycles-pp.security_mmap_addr
0.19 ± 11% -0.0 0.16 ± 10% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.10 ± 12% -0.0 0.08 ± 13% perf-profile.self.cycles-pp.__vm_enough_memory
0.48 ± 10% +0.1 0.61 ± 9% perf-profile.self.cycles-pp.cap_vm_enough_memory
0.00 +0.7 0.73 ± 10% perf-profile.self.cycles-pp.memset_erms
1.86 ± 11% +0.8 2.62 ± 7% perf-profile.self.cycles-pp.kmem_cache_free
1.91 ± 11% +0.8 2.74 ± 12% perf-profile.self.cycles-pp.kmem_cache_alloc
will-it-scale.52.processes
6.6e+07 +----------------------------------------------------------------+
6.55e+07 |.+..+.+.+.. .+..+.+.+..+.+. |
| .+..+.+.+ +..+.+.+ |
6.5e+07 |-+ +.+. .+.+.+..+.+ |
6.45e+07 |-+ +. |
| |
6.4e+07 |-+ |
6.35e+07 |-+ |
6.3e+07 |-+ |
| |
6.25e+07 |-+ |
6.2e+07 |-+ |
| O O O O O O O O O O O O O O O O O |
6.15e+07 |-O O O O O O O O O |
6.1e+07 +----------------------------------------------------------------+
will-it-scale.per_process_ops
1.27e+06 +----------------------------------------------------------------+
1.26e+06 |.+..+.+.+.. .+..+.+.+..+.+. |
| .+..+.+.+ +..+.+.+ |
1.25e+06 |-+ +.+.+..+.+.+..+.+ |
1.24e+06 |-+ |
| |
1.23e+06 |-+ |
1.22e+06 |-+ |
1.21e+06 |-+ |
| |
1.2e+06 |-+ |
1.19e+06 |-+ O O |
| O O O O O O O O O O O O O O O O O O O O O O |
1.18e+06 |-O O O |
1.17e+06 +----------------------------------------------------------------+
will-it-scale.workload
6.6e+07 +----------------------------------------------------------------+
6.55e+07 |.+..+.+.+.. .+..+.+.+..+.+. |
| .+..+.+.+ +..+.+.+ |
6.5e+07 |-+ +.+. .+.+.+..+.+ |
6.45e+07 |-+ +. |
| |
6.4e+07 |-+ |
6.35e+07 |-+ |
6.3e+07 |-+ |
| |
6.25e+07 |-+ |
6.2e+07 |-+ |
| O O O O O O O O O O O O O O O O O |
6.15e+07 |-O O O O O O O O O |
6.1e+07 +----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2ap2: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/16/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap2/brk1/will-it-scale/0x5003003
commit:
ddfa740e9c ("fs/userfaultfd: complete write asynchronously")
fec9227821 ("fs/userfaultfd: kmem-cache for wait-queue objects")
ddfa740e9caf7642 fec92278217ba01b4a3b9f9ec0f
---------------- ---------------------------
%stddev %change %stddev
\ | \
46606610 -11.0% 41486565 will-it-scale.16.processes
2912912 -11.0% 2592909 will-it-scale.per_process_ops
46606610 -11.0% 41486565 will-it-scale.workload
0.72 -0.1 0.65 mpstat.cpu.all.usr%
17741 -4.4% 16964 proc-vmstat.nr_shmem
-116535 -515.3% 484006 ± 50% sched_debug.cfs_rq:/.spread0.avg
1380 ± 6% +495.6% 8222 slabinfo.dmaengine-unmap-16.active_objs
32.50 ± 7% +500.0% 195.00 slabinfo.dmaengine-unmap-16.active_slabs
1380 ± 6% +495.6% 8222 slabinfo.dmaengine-unmap-16.num_objs
32.50 ± 7% +500.0% 195.00 slabinfo.dmaengine-unmap-16.num_slabs
11962 ± 7% -17.3% 9891 ± 12% softirqs.CPU10.RCU
10075 ± 23% +28.9% 12985 ± 4% softirqs.CPU110.RCU
42801 ± 4% -5.8% 40327 ± 2% softirqs.CPU136.SCHED
42633 ± 4% -15.2% 36169 ± 18% softirqs.CPU137.SCHED
42786 ± 4% -6.8% 39864 softirqs.CPU156.SCHED
11795 ± 8% -16.6% 9835 ± 11% softirqs.CPU2.RCU
42004 ± 4% -5.9% 39537 ± 3% softirqs.CPU25.SCHED
39956 ± 4% -65.4% 13836 ±110% softirqs.CPU5.SCHED
9734 ± 8% -13.2% 8450 ± 8% softirqs.CPU68.RCU
41424 ± 4% -14.7% 35347 ± 19% softirqs.CPU87.SCHED
1.935e+10 -2.0% 1.895e+10 perf-stat.i.branch-instructions
0.61 +2.3% 0.62 perf-stat.i.cpi
1.494e+10 -2.9% 1.451e+10 perf-stat.i.dTLB-stores
9.271e+10 -1.1% 9.17e+10 perf-stat.i.instructions
1.64 -2.2% 1.61 perf-stat.i.ipc
320.23 -1.4% 315.65 perf-stat.i.metric.M/sec
0.61 +2.3% 0.62 perf-stat.overall.cpi
1.65 -2.2% 1.61 perf-stat.overall.ipc
601140 +10.9% 666775 perf-stat.overall.path-length
1.928e+10 -2.0% 1.889e+10 perf-stat.ps.branch-instructions
1.489e+10 -2.9% 1.446e+10 perf-stat.ps.dTLB-stores
9.24e+10 -1.1% 9.139e+10 perf-stat.ps.instructions
2.802e+13 -1.3% 2.766e+13 perf-stat.total.instructions
0.01 ± 25% +188.2% 0.02 ± 57% perf-sched.sch_delay.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
0.01 ± 15% -46.6% 0.01 ± 42% perf-sched.sch_delay.avg.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
0.01 ± 22% +324.4% 0.05 ± 67% perf-sched.sch_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read
0.01 ± 15% -43.1% 0.01 ± 41% perf-sched.sch_delay.max.ms.schedule_timeout.wait_for_completion.__flush_work.lru_add_drain_all
0.03 ± 23% -78.0% 0.01 ±173% perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
605.16 ± 7% +13.3% 685.54 ± 5% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
4.35 ± 10% +19.2% 5.19 ± 4% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
54.50 ± 9% -18.8% 44.25 ± 5% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
2295 ± 10% -17.2% 1900 ± 4% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.43 ±143% -92.6% 0.03 ±173% perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
85.77 ± 63% +111.9% 181.78 ± 16% perf-sched.wait_and_delay.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
0.03 ± 23% -25.0% 0.02 ± 11% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
605.15 ± 7% +13.3% 685.54 ± 5% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
4.34 ± 10% +19.1% 5.17 ± 4% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
4.24 ± 10% +64.4% 6.97 ± 49% perf-sched.wait_time.max.ms.rcu_gp_kthread.kthread.ret_from_fork
85.73 ± 63% +112.0% 181.73 ± 16% perf-sched.wait_time.max.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
8753 -54.6% 3974 ± 70% interrupts.CPU101.NMI:Non-maskable_interrupts
8753 -54.6% 3974 ± 70% interrupts.CPU101.PMI:Performance_monitoring_interrupts
1.75 ± 47% +8342.9% 147.75 ±168% interrupts.CPU137.RES:Rescheduling_interrupts
112.75 ± 8% +40.1% 158.00 ± 19% interrupts.CPU145.NMI:Non-maskable_interrupts
112.75 ± 8% +40.1% 158.00 ± 19% interrupts.CPU145.PMI:Performance_monitoring_interrupts
1251 ± 31% +151.4% 3145 ± 43% interrupts.CPU149.CAL:Function_call_interrupts
117.50 ± 7% +27.7% 150.00 ± 9% interrupts.CPU159.NMI:Non-maskable_interrupts
117.50 ± 7% +27.7% 150.00 ± 9% interrupts.CPU159.PMI:Performance_monitoring_interrupts
115.25 ± 9% -26.7% 84.50 ± 20% interrupts.CPU161.NMI:Non-maskable_interrupts
115.25 ± 9% -26.7% 84.50 ± 20% interrupts.CPU161.PMI:Performance_monitoring_interrupts
8756 -50.5% 4334 ± 58% interrupts.CPU2.NMI:Non-maskable_interrupts
8756 -50.5% 4334 ± 58% interrupts.CPU2.PMI:Performance_monitoring_interrupts
113.75 ± 8% +26.6% 144.00 ± 8% interrupts.CPU49.NMI:Non-maskable_interrupts
113.75 ± 8% +26.6% 144.00 ± 8% interrupts.CPU49.PMI:Performance_monitoring_interrupts
98.75 ± 22% +44.3% 142.50 ± 19% interrupts.CPU66.NMI:Non-maskable_interrupts
98.75 ± 22% +44.3% 142.50 ± 19% interrupts.CPU66.PMI:Performance_monitoring_interrupts
1.50 ±110% +4266.7% 65.50 ±129% interrupts.CPU98.RES:Rescheduling_interrupts
228023 ± 7% -16.3% 190922 ± 7% interrupts.NMI:Non-maskable_interrupts
228023 ± 7% -16.3% 190922 ± 7% interrupts.PMI:Performance_monitoring_interrupts
0.66 ± 31% +0.2 0.90 ± 30% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.87 ± 9% +0.3 1.18 ± 3% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.brk
1.06 ± 16% +0.4 1.42 ± 21% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
1.08 ± 16% +0.4 1.46 ± 22% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.09 ± 16% +0.4 1.47 ± 23% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.6 0.58 ± 3% perf-profile.calltrace.cycles-pp.___might_sleep.kmem_cache_alloc.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64
0.00 +1.7 1.67 ± 3% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64
0.00 +1.8 1.79 ± 4% perf-profile.calltrace.cycles-pp.kmem_cache_free.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
0.00 +4.5 4.46 ± 5% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +5.0 4.96 ± 4% perf-profile.calltrace.cycles-pp.userfaultfd_unmap_complete.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
47.85 ± 9% +7.2 55.00 ± 3% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
49.25 ± 9% +7.4 56.63 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
51.01 ± 9% +7.5 58.48 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk
0.44 ± 11% -0.2 0.27 ± 4% perf-profile.children.cycles-pp.cap_capable
0.05 ± 8% +0.0 0.07 ± 5% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.08 +0.0 0.10 ± 10% perf-profile.children.cycles-pp.sched_clock
0.08 ± 6% +0.0 0.10 ± 10% perf-profile.children.cycles-pp.native_sched_clock
0.09 ± 4% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.read_tsc
0.10 ± 14% +0.0 0.13 ± 8% perf-profile.children.cycles-pp.lapic_next_deadline
0.09 +0.0 0.12 ± 10% perf-profile.children.cycles-pp.sched_clock_cpu
0.04 ± 57% +0.0 0.07 ± 17% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.memset
0.04 ±115% +0.1 0.10 ± 31% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.26 ± 18% +0.1 0.33 ± 11% perf-profile.children.cycles-pp.clockevents_program_event
0.04 ± 58% +0.1 0.16 ± 2% perf-profile.children.cycles-pp.should_failslab
0.14 ± 42% +0.1 0.28 ± 19% perf-profile.children.cycles-pp.tick_nohz_next_event
0.21 ± 31% +0.2 0.36 ± 9% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.54 ± 21% +0.2 0.72 ± 17% perf-profile.children.cycles-pp.update_process_times
0.54 ± 10% +0.2 0.72 ± 4% perf-profile.children.cycles-pp.rcu_all_qs
0.65 ± 20% +0.2 0.84 ± 17% perf-profile.children.cycles-pp.tick_sched_timer
0.56 ± 24% +0.2 0.76 ± 20% perf-profile.children.cycles-pp.tick_sched_handle
0.93 ± 23% +0.3 1.20 ± 22% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.87 ± 10% +0.3 1.15 ± 2% perf-profile.children.cycles-pp.__might_sleep
1.09 ± 11% +0.4 1.46 ± 5% perf-profile.children.cycles-pp._cond_resched
1.39 ± 13% +0.4 1.79 ± 16% perf-profile.children.cycles-pp.hrtimer_interrupt
1.43 ± 13% +0.4 1.83 ± 17% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
1.68 ± 13% +0.5 2.15 ± 19% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
1.94 ± 10% +0.6 2.54 ± 3% perf-profile.children.cycles-pp.___might_sleep
0.00 +1.7 1.67 ± 3% perf-profile.children.cycles-pp.memset_erms
4.88 ± 8% +1.7 6.63 ± 4% perf-profile.children.cycles-pp.kmem_cache_free
6.56 ± 10% +4.6 11.13 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc
0.37 ± 9% +4.6 4.99 ± 4% perf-profile.children.cycles-pp.userfaultfd_unmap_complete
48.02 ± 9% +7.1 55.14 ± 3% perf-profile.children.cycles-pp.__x64_sys_brk
49.49 ± 9% +7.3 56.81 ± 3% perf-profile.children.cycles-pp.do_syscall_64
51.22 ± 9% +7.4 58.66 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.42 ± 11% -0.2 0.24 ± 6% perf-profile.self.cycles-pp.cap_capable
0.07 ± 5% +0.0 0.09 ± 14% perf-profile.self.cycles-pp.native_sched_clock
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.10 ± 14% +0.0 0.13 ± 8% perf-profile.self.cycles-pp.lapic_next_deadline
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.memset
0.01 ±173% +0.1 0.08 ± 23% perf-profile.self.cycles-pp.tick_nohz_next_event
0.34 ± 10% +0.1 0.41 ± 6% perf-profile.self.cycles-pp.userfaultfd_unmap_complete
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.should_failslab
0.40 ± 9% +0.1 0.48 ± 8% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.37 ± 12% +0.1 0.49 ± 5% perf-profile.self.cycles-pp.rcu_all_qs
0.53 ± 11% +0.2 0.70 ± 3% perf-profile.self.cycles-pp._cond_resched
0.21 ± 8% +0.2 0.44 ± 6% perf-profile.self.cycles-pp.do_syscall_64
0.46 ± 8% +0.2 0.70 ± 6% perf-profile.self.cycles-pp.cap_vm_enough_memory
0.81 ± 10% +0.3 1.09 ± 2% perf-profile.self.cycles-pp.__might_sleep
1.88 ± 10% +0.6 2.46 ± 3% perf-profile.self.cycles-pp.___might_sleep
0.00 +1.6 1.61 ± 3% perf-profile.self.cycles-pp.memset_erms
3.19 ± 10% +1.7 4.86 ± 6% perf-profile.self.cycles-pp.kmem_cache_alloc
3.31 ± 7% +1.7 5.05 ± 4% perf-profile.self.cycles-pp.kmem_cache_free
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[btrfs] ba7fa25e8c: fio.write_iops 2.7% improvement
by kernel test robot
Greeting,
FYI, we noticed a 2.7% improvement of fio.write_iops due to commit:
commit: ba7fa25e8c1ee440019f8e6292ebfbeaf82c55cf ("btrfs: track ordered bytes instead of just dio ordered bytes")
https://github.com/kdave/btrfs-devel.git for-next-20201127
in testcase: fio-basic
on test machine: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory
with following parameters:
runtime: 300s
disk: 1HDD
fs: btrfs
nr_task: 100%
test_size: 128G
rw: randwrite
bs: 4k
ioengine: sync
cpufreq_governor: performance
ucode: 0xde
test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode:
4k/gcc-9/performance/1HDD/btrfs/sync/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/300s/randwrite/lkp-cfl-e1/128G/fio-basic/0xde
commit:
f3f5c2fbe5 ("btrfs: add a trace point for reserve tickets")
ba7fa25e8c ("btrfs: track ordered bytes instead of just dio ordered bytes")
f3f5c2fbe5b0983e ba7fa25e8c1ee440019f8e6292e
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
0:4 0% 0:4 perf-profile.children.cycles-pp.error_return
0:4 5% 1:4 perf-profile.children.cycles-pp.error_entry
0:4 -1% 0:4 perf-profile.self.cycles-pp.error_return
0:4 1% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
0.00 ±173% +0.2 0.17 ± 27% fio.latency_1000ms%
0.15 -0.0 0.12 ± 6% fio.latency_1000us%
2.29 ± 4% +0.6 2.89 ± 6% fio.latency_100us%
0.20 ± 7% -0.1 0.09 ± 6% fio.latency_10ms%
0.38 ± 26% -0.3 0.03 ± 38% fio.latency_2000ms%
0.67 ± 9% +0.1 0.80 ± 8% fio.latency_20ms%
1.96 ± 5% -0.3 1.65 ± 3% fio.latency_20us%
0.71 ± 10% -0.5 0.20 ± 6% fio.latency_250ms%
0.15 ± 18% -0.1 0.08 ± 3% fio.latency_2ms%
0.15 ± 9% -0.1 0.02 ± 61% fio.latency_4ms%
0.02 ± 79% +0.1 0.16 ± 16% fio.latency_500ms%
43.69 -1.4 42.28 fio.latency_50ms%
5.03 ± 3% +2.4 7.46 ± 5% fio.latency_50us%
0.04 ± 9% +0.7 0.78 ± 7% fio.latency_750ms%
1732080 +2.5% 1775858 fio.time.file_system_outputs
149653 +3.9% 155465 fio.time.voluntary_context_switches
216510 +2.5% 221982 fio.workload
2.81 +2.7% 2.89 fio.write_bw_MBps
1.181e+08 ± 11% +305.8% 4.792e+08 ± 4% fio.write_clat_99%_us
22219310 -2.6% 21633552 fio.write_clat_mean_us
1.069e+08 ± 8% -31.4% 73269663 fio.write_clat_stddev
720.03 +2.7% 739.49 fio.write_iops
8.17 -1.8 6.38 mpstat.cpu.all.iowait%
37813 -18.0% 31018 softirqs.TIMER
1495144 ± 62% -70.7% 438459 ± 8% cpuidle.C8.time
1560 ± 61% -70.1% 467.25 ± 9% cpuidle.C8.usage
89.70 +2.0% 91.47 iostat.cpu.idle
8.14 -21.9% 6.35 iostat.cpu.iowait
109108 ± 3% -66.4% 36673 meminfo.Active
105428 ± 3% -68.7% 33029 meminfo.Active(file)
3761 ± 11% +143.5% 9158 ± 2% meminfo.Dirty
89.25 +2.0% 91.00 vmstat.cpu.id
5417 ± 2% -55.7% 2402 vmstat.io.bo
6902 +9.3% 7541 vmstat.system.cs
925.47 ± 9% -21.4% 727.11 ± 16% sched_debug.cfs_rq:/.exec_clock.min
3933 ± 6% -20.4% 3132 ± 13% sched_debug.cfs_rq:/.min_vruntime.min
0.00 ± 13% -33.3% 0.00 ± 25% sched_debug.cpu.next_balance.stddev
19952 ± 10% +19.5% 23853 ± 7% sched_debug.cpu.nr_switches.stddev
19552 ± 10% +17.2% 22918 ± 5% sched_debug.cpu.sched_count.stddev
2798 ± 2% -40.0% 1678 ± 2% slabinfo.btrfs_extent_buffer.active_objs
2805 ± 2% -40.2% 1678 ± 2% slabinfo.btrfs_extent_buffer.num_objs
3516 ± 2% -38.1% 2175 ± 2% slabinfo.fsnotify_mark_connector.active_objs
3516 ± 2% -38.1% 2175 ± 2% slabinfo.fsnotify_mark_connector.num_objs
1720 ± 11% -21.9% 1344 ± 21% slabinfo.skbuff_head_cache.active_objs
1720 ± 11% -20.0% 1376 ± 18% slabinfo.skbuff_head_cache.num_objs
26409 ± 3% -68.8% 8241 proc-vmstat.nr_active_file
380230 -30.8% 263123 proc-vmstat.nr_dirtied
924.75 ± 11% +147.4% 2287 ± 2% proc-vmstat.nr_dirty
744041 -2.5% 725562 proc-vmstat.nr_file_pages
279458 ± 2% -43.1% 158941 proc-vmstat.nr_written
26409 ± 3% -68.8% 8241 proc-vmstat.nr_zone_active_file
98612 +1.3% 99921 proc-vmstat.nr_zone_write_pending
1070929 -10.5% 958043 proc-vmstat.numa_hit
1070929 -10.5% 958043 proc-vmstat.numa_local
92075 ± 3% -75.7% 22411 proc-vmstat.pgactivate
1272377 -9.4% 1153335 proc-vmstat.pgalloc_normal
742581 -21.9% 579640 ± 24% proc-vmstat.pgfree
1649374 ± 2% -55.7% 731316 proc-vmstat.pgpgout
9619 ± 14% +122.3% 21389 ± 6% interrupts.CAL:Function_call_interrupts
429.75 ± 17% +85.6% 797.75 ± 24% interrupts.CPU0.CAL:Function_call_interrupts
639.00 ± 46% +122.0% 1418 ± 5% interrupts.CPU10.CAL:Function_call_interrupts
591.00 ± 33% +135.9% 1394 ± 23% interrupts.CPU13.CAL:Function_call_interrupts
407.00 ± 18% +27.0% 516.75 ± 6% interrupts.CPU13.RES:Rescheduling_interrupts
665.25 ± 60% +162.8% 1748 ± 49% interrupts.CPU14.CAL:Function_call_interrupts
489.50 ± 55% +106.3% 1010 ± 32% interrupts.CPU2.CAL:Function_call_interrupts
495.25 ± 22% +76.1% 872.00 ± 19% interrupts.CPU3.CAL:Function_call_interrupts
384.00 ± 10% +214.1% 1206 ± 30% interrupts.CPU4.CAL:Function_call_interrupts
426.50 ± 26% +117.5% 927.50 ± 31% interrupts.CPU5.CAL:Function_call_interrupts
679.50 ± 17% +181.3% 1911 ± 16% interrupts.CPU6.CAL:Function_call_interrupts
682.00 ± 24% +208.0% 2100 ± 12% interrupts.CPU7.CAL:Function_call_interrupts
687.25 ± 57% +121.1% 1519 ± 10% interrupts.CPU8.CAL:Function_call_interrupts
224.50 ± 6% -10.6% 200.75 interrupts.CPU8.NMI:Non-maskable_interrupts
224.50 ± 6% -10.6% 200.75 interrupts.CPU8.PMI:Performance_monitoring_interrupts
530.00 ± 35% +207.6% 1630 ± 22% interrupts.CPU9.CAL:Function_call_interrupts
6.43 ± 4% +0.6 6.98 ± 3% perf-stat.i.branch-miss-rate%
6931 +9.4% 7582 perf-stat.i.context-switches
3.26 ± 4% +8.6% 3.54 perf-stat.i.cpi
85.04 +9.9% 93.48 perf-stat.i.cpu-migrations
0.91 ± 6% +0.1 1.01 perf-stat.i.dTLB-load-miss-rate%
1.099e+08 -5.1% 1.043e+08 ± 4% perf-stat.i.dTLB-loads
51851843 -4.1% 49720490 ± 3% perf-stat.i.dTLB-stores
169056 ± 8% +8.6% 183538 ± 2% perf-stat.i.iTLB-loads
1051 ± 8% -13.7% 907.37 ± 3% perf-stat.i.instructions-per-iTLB-miss
0.33 ± 3% -8.9% 0.30 perf-stat.i.ipc
912.53 +1.1% 922.84 perf-stat.i.major-faults
0.57 +7.5% 0.61 perf-stat.i.metric.K/sec
18.98 -4.5% 18.13 ± 3% perf-stat.i.metric.M/sec
225984 ± 2% -10.4% 202462 perf-stat.i.node-stores
5.54 ± 3% +0.4 5.97 ± 2% perf-stat.overall.branch-miss-rate%
2.45 ± 3% +5.2% 2.58 perf-stat.overall.cpi
1180 ± 9% -11.5% 1044 ± 2% perf-stat.overall.instructions-per-iTLB-miss
0.41 ± 3% -5.1% 0.39 perf-stat.overall.ipc
646421 ± 2% -8.1% 593871 ± 3% perf-stat.overall.path-length
6914 +9.4% 7561 perf-stat.ps.context-switches
84.77 +9.9% 93.19 perf-stat.ps.cpu-migrations
1.098e+08 -5.1% 1.041e+08 ± 4% perf-stat.ps.dTLB-loads
51774128 -4.2% 49623698 ± 3% perf-stat.ps.dTLB-stores
168537 ± 8% +8.6% 182969 ± 2% perf-stat.ps.iTLB-loads
226987 ± 2% -10.7% 202714 ± 2% perf-stat.ps.node-stores
6.47 ± 7% -1.5 4.99 ± 23% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
6.48 ± 7% -1.5 5.00 ± 23% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
6.48 ± 7% -1.5 5.00 ± 23% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
0.56 ± 61% +0.4 0.97 ± 9% perf-profile.calltrace.cycles-pp.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
5.99 ± 4% +0.9 6.88 ± 7% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
6.68 ± 6% +1.0 7.65 ± 7% perf-profile.calltrace.cycles-pp.ret_from_fork
6.68 ± 6% +1.0 7.65 ± 7% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
6.28 ± 5% +1.0 7.26 ± 8% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
4.44 ± 4% +1.0 5.47 ± 12% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
79.35 -1.6 77.77 perf-profile.children.cycles-pp.cpuidle_enter_state
79.41 -1.5 77.86 perf-profile.children.cycles-pp.cpuidle_enter
6.48 ± 7% -1.5 5.00 ± 23% perf-profile.children.cycles-pp.start_kernel
0.68 ± 81% -0.4 0.28 ± 22% perf-profile.children.cycles-pp.execve
0.57 ± 10% -0.2 0.41 ± 25% perf-profile.children.cycles-pp.rcu_eqs_exit
0.19 ± 12% -0.1 0.07 ± 58% perf-profile.children.cycles-pp.walk_component
0.15 ± 26% -0.1 0.05 ± 62% perf-profile.children.cycles-pp.filename_lookup
0.15 ± 26% -0.1 0.05 ± 62% perf-profile.children.cycles-pp.path_lookupat
0.17 ± 25% -0.1 0.10 ± 47% perf-profile.children.cycles-pp.irqentry_exit
0.15 ± 23% -0.1 0.09 ± 44% perf-profile.children.cycles-pp.__do_sys_newstat
0.15 ± 23% -0.1 0.09 ± 44% perf-profile.children.cycles-pp.vfs_statx
0.24 ± 7% -0.1 0.17 ± 18% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.02 ±173% +0.1 0.09 ± 29% perf-profile.children.cycles-pp.__btrfs_tree_lock
0.24 ± 15% +0.1 0.33 ± 17% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.22 ± 21% +0.1 0.32 ± 14% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.07 ± 62% +0.1 0.16 ± 9% perf-profile.children.cycles-pp.ksys_mmap_pgoff
0.16 ± 22% +0.1 0.26 ± 24% perf-profile.children.cycles-pp.__tree_search
0.65 ± 9% +0.1 0.77 ± 5% perf-profile.children.cycles-pp.native_sched_clock
0.83 ± 6% +0.1 0.95 ± 4% perf-profile.children.cycles-pp.sched_clock_cpu
0.28 ± 24% +0.2 0.44 ± 21% perf-profile.children.cycles-pp.lock_extent_bits
0.60 ± 17% +0.2 0.76 ± 8% perf-profile.children.cycles-pp.btrfs_block_rsv_release
0.67 ± 11% +0.2 0.83 ± 5% perf-profile.children.cycles-pp.sched_clock
0.52 ± 9% +0.2 0.70 ± 11% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.06 ±104% +0.2 0.24 ± 33% perf-profile.children.cycles-pp.find_extent_buffer
0.47 ± 32% +0.2 0.67 ± 19% perf-profile.children.cycles-pp.delay_tsc
0.57 ± 22% +0.2 0.77 ± 9% perf-profile.children.cycles-pp.btrfs_inode_rsv_release
0.09 ±100% +0.2 0.33 ± 24% perf-profile.children.cycles-pp.read_block_for_search
0.60 ± 12% +0.3 0.89 ± 14% perf-profile.children.cycles-pp.btrfs_search_slot
0.67 ± 25% +0.3 0.97 ± 9% perf-profile.children.cycles-pp.btrfs_mark_extent_written
5.99 ± 4% +0.9 6.88 ± 7% perf-profile.children.cycles-pp.process_one_work
6.70 ± 6% +1.0 7.66 ± 7% perf-profile.children.cycles-pp.ret_from_fork
6.68 ± 6% +1.0 7.65 ± 7% perf-profile.children.cycles-pp.kthread
6.28 ± 5% +1.0 7.26 ± 8% perf-profile.children.cycles-pp.worker_thread
4.44 ± 4% +1.0 5.47 ± 12% perf-profile.children.cycles-pp.btrfs_work_helper
0.22 ± 15% -0.1 0.08 ± 70% perf-profile.self.cycles-pp.update_process_times
0.31 ± 12% -0.1 0.21 ± 35% perf-profile.self.cycles-pp.rcu_eqs_exit
0.16 ± 22% +0.1 0.24 ± 19% perf-profile.self.cycles-pp.__tree_search
0.02 ±173% +0.1 0.11 ± 38% perf-profile.self.cycles-pp.find_extent_buffer
0.16 ± 43% +0.1 0.27 ± 15% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.61 ± 11% +0.1 0.74 ± 6% perf-profile.self.cycles-pp.native_sched_clock
0.50 ± 6% +0.1 0.64 ± 9% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.47 ± 32% +0.2 0.67 ± 19% perf-profile.self.cycles-pp.delay_tsc
fio.write_iops
790 +---------------------------------------------------------------------+
| O |
780 |-+ |
770 |-+ |
| |
760 |-+ |
| |
750 |-+ |
| |
740 |-O OOOOO OOO O OOOO OOOOO OOO O OOOO OOO OOOO |
730 |O+ O O O |
| + + + +. +. + + |
720 |+++ + ++. ++ +. :+ .+ :++. + : + + : + + +. :+ +. :++.+++++.++ ++.++|
| + + + + + + + ++ + + + + + + + + + |
710 +---------------------------------------------------------------------+
fio.write_clat_stddev
1.6e+08 +-----------------------------------------------------------------+
| |
1.4e+08 |-++ + + + + + + |
| :: : : : : : : + |
1.2e+08 |-+:: :: : : : : :: :: :: : + |
|+: : +: : + : : + : : +: : +: : +: :: : + : |
1e+08 |-+ +++++++.+ + ++ + ++++ + ++ + +.+++ + +.+ + ++ +.+++++++ ++|
| O |
8e+07 |-+ O O O OO OO |
|OO OO OO OOOOOOOO OO O OOOOOOO OO OOO O |
6e+07 |-+ |
| |
4e+07 |-+ OO |
| |
2e+07 +-----------------------------------------------------------------+
fio.latency_4ms_
0.18 +--------------------------------------------------------------------+
| + + + +++ + ++ + ++++. + ++. + ++ .+ + +.+ + +. + +++ +|
0.16 |+++ :+ +.+ + + : + + : + :: + :: + + :: + :: + ++ +.+ : + |
0.14 |-+ + + + + + + + :: :+ |
| + + |
0.12 |-+ |
0.1 |-+ |
| |
0.08 |-+ |
0.06 |-+ |
| |
0.04 |-+ O O |
0.02 |-O O O O O OOO OO O O OO OOOO OO O O |
|O O O O OO OO O O O OO OO O |
0 +--------------------------------------------------------------------+
fio.latency_10ms_
0.24 +--------------------------------------------------------------------+
0.22 |-+ + + + + + + + |
| : : .++ : : : : :: :: :: :: + |
0.2 |-+: + + + : + : + : + : ++ : +. : +. + +. :+ +|
0.18 |++ : + +++ +++ + +.++ +.++ :.+++ +++ + +++ ++++ + |
| :: + + |
0.16 |-+ + |
0.14 |-+ |
0.12 |-+ |
| O O O O O |
0.1 |-+ O OO OO OOOO OOOOO OOOOO OO O |
0.08 |OO O OO O O O OO O |
| |
0.06 |-+ O |
0.04 +--------------------------------------------------------------------+
fio.workload
240000 +------------------------------------------------------------------+
| |
| O O |
235000 |-+ |
| |
| |
230000 |-+ |
| |
225000 |-+ |
| |
| OO OOO OO O OOOOO OOOOOO OO O O O O O OOOO |
220000 |O+ O O O O O O O |
| +. + + + + + + |
|++ + +++.+ ++ + .++ +++. ++ + .++ +++ .++ + +.+ ++++ .++++ +.+++|
215000 +------------------------------------------------------------------+
fio.time.voluntary_context_switches
175000 +------------------------------------------------------------------+
| |
170000 |-+ O |
| O |
| |
165000 |-+ |
| |
160000 |-+ |
| |
155000 |-+O OOO OO O OOOOO OOOOOO OO OOOO OOOO |
|OO O O OOOO OO |
| +. + + + + + + |
150000 |++ ++++++.+ ++ + .++ +++. ++ + .++ +++ .++ + +.+ +++++.++++ +.+++|
| + + + + + + + |
145000 +------------------------------------------------------------------+
fio.time.file_system_outputs
1.9e+06 +----------------------------------------------------------------+
| OO |
1.88e+06 |-+ |
1.86e+06 |-+ |
| |
1.84e+06 |-+ |
1.82e+06 |-+ |
| |
1.8e+06 |-+ |
1.78e+06 |-+ O |
|OOOO OOOOOO O OOOOOOOO OOOOOOOO OOOOOO O OO |
1.76e+06 |-+ O |
1.74e+06 |-++ + + + + .+ + .+ |
|++ +. ++++ +.+ + ++ +.++ ++ + .++ +++ ++ + ++ ++ ++++++ .++++|
1.72e+06 +----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[sched/fair] 8d86968ac3: netperf.Throughput_tps -29.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -29.5% regression of netperf.Throughput_tps due to commit:
commit: 8d86968ac36ea5bff487f70b5ffc252a87d44c51 ("[RFC PATCH v4] sched/fair: select idle cpu from idle cpumask for task wakeup")
url: https://github.com/0day-ci/linux/commits/Aubrey-Li/sched-fair-select-idle...
base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git 09162bc32c880a791c6c0668ce0745cf7958f576
in testcase: netperf
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
ip: ipv4
runtime: 300s
nr_threads: 50%
cluster: cs-localhost
test: UDP_RR
cpufreq_governor: performance
ucode: 0x5003003
test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------+
| testcase: change | hackbench: hackbench.throughput 51.7% improvement |
| test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters | cpufreq_governor=performance |
| | ipc=pipe |
| | iterations=4 |
| | mode=threads |
| | nr_threads=100% |
| | ucode=0x5003003 |
+------------------+---------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode:
cs-localhost/gcc-9/performance/ipv4/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap3/UDP_RR/netperf/0x5003003
commit:
v5.10-rc4
8d86968ac3 ("sched/fair: select idle cpu from idle cpumask for task wakeup")
v5.10-rc4 8d86968ac36ea5bff487f70b5ff
---------------- ---------------------------
%stddev %change %stddev
\ | \
6435510 -29.5% 4538527 ± 16% netperf.Throughput_total_tps
67036 -29.5% 47276 ± 16% netperf.Throughput_tps
27542 ± 3% +1221.7% 364031 ± 40% netperf.time.involuntary_context_switches
31127 ± 3% -8.5% 28478 netperf.time.minor_page_faults
4543 -5.3% 4303 ± 2% netperf.time.percent_of_cpu_this_job_got
12995 -4.0% 12475 netperf.time.system_time
744.93 ± 37% -35.2% 482.53 ± 17% netperf.time.user_time
1.914e+09 -29.8% 1.343e+09 ± 15% netperf.time.voluntary_context_switches
1.931e+09 -29.5% 1.362e+09 ± 16% netperf.workload
5295 ± 4% -12.8% 4619 ± 4% boot-time.idle
42.38 +5.2 47.56 mpstat.cpu.all.idle%
12.50 -1.5 10.96 mpstat.cpu.all.soft%
2.48 ± 36% -0.9 1.60 ± 14% mpstat.cpu.all.usr%
1.769e+10 -20.6% 1.404e+10 ± 14% cpuidle.C1.time
3.239e+09 -53.2% 1.516e+09 ± 10% cpuidle.C1.usage
1.573e+09 ± 6% +68.0% 2.643e+09 ± 24% cpuidle.POLL.time
5.111e+08 ± 6% +71.8% 8.779e+08 ± 24% cpuidle.POLL.usage
1119 ± 11% -21.4% 880.25 ± 8% slabinfo.file_lock_cache.active_objs
1119 ± 11% -21.4% 880.25 ± 8% slabinfo.file_lock_cache.num_objs
736.67 ± 11% +18.7% 874.75 ± 4% slabinfo.mnt_cache.active_objs
736.67 ± 11% +18.7% 874.75 ± 4% slabinfo.mnt_cache.num_objs
42.22 +12.5% 47.50 vmstat.cpu.id
54.44 -7.7% 50.25 vmstat.cpu.sy
24999287 -29.7% 17577090 ± 15% vmstat.system.cs
535220 ± 2% +104.3% 1093710 ± 11% vmstat.system.in
267806 +2.7% 275098 proc-vmstat.nr_file_pages
232781 +3.3% 240383 proc-vmstat.nr_unevictable
232781 +3.3% 240383 proc-vmstat.nr_zone_unevictable
1148875 +1.9% 1170390 proc-vmstat.pgalloc_normal
1198746 +1.5% 1216673 proc-vmstat.pgfree
62163 +4.1% 64725 proc-vmstat.pgreuse
5980 ± 66% +457.3% 33326 ± 34% numa-vmstat.node3.nr_anon_pages
88391 ± 4% +6.7% 94292 ± 5% numa-vmstat.node3.nr_file_pages
8797 ± 46% +310.1% 36074 ± 30% numa-vmstat.node3.nr_inactive_anon
305.22 ± 67% +133.1% 711.50 ± 47% numa-vmstat.node3.nr_page_table_pages
17135 ± 8% +24.7% 21361 ± 5% numa-vmstat.node3.nr_slab_unreclaimable
56546 ± 4% +10.6% 62560 ± 8% numa-vmstat.node3.nr_unevictable
8797 ± 46% +310.1% 36074 ± 30% numa-vmstat.node3.nr_zone_inactive_anon
56546 ± 4% +10.6% 62560 ± 8% numa-vmstat.node3.nr_zone_unevictable
646892 ± 12% +24.2% 803392 ± 20% sched_debug.cfs_rq:/.MIN_vruntime.avg
646892 ± 12% +24.2% 803392 ± 20% sched_debug.cfs_rq:/.max_vruntime.avg
6803725 ± 3% -12.0% 5985546 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg
6416050 ± 4% -12.1% 5642537 ± 2% sched_debug.cfs_rq:/.min_vruntime.min
11.33 ± 4% +22.8% 13.91 ± 5% sched_debug.cpu.clock.stddev
19705568 -30.6% 13666360 ± 14% sched_debug.cpu.nr_switches.avg
20297607 -28.4% 14542250 ± 15% sched_debug.cpu.nr_switches.max
18265217 ± 5% -36.4% 11619859 ± 8% sched_debug.cpu.nr_switches.min
7420 ±188% +1090.8% 88360 ± 41% numa-meminfo.node3.AnonHugePages
24002 ± 66% +455.2% 133268 ± 34% numa-meminfo.node3.AnonPages
353532 ± 4% +6.6% 376995 ± 5% numa-meminfo.node3.FilePages
35382 ± 46% +307.6% 144218 ± 30% numa-meminfo.node3.Inactive
35382 ± 46% +307.6% 144218 ± 30% numa-meminfo.node3.Inactive(anon)
689494 ± 3% +25.1% 862864 ± 7% numa-meminfo.node3.MemUsed
1222 ± 67% +133.6% 2855 ± 47% numa-meminfo.node3.PageTables
68543 ± 8% +24.7% 85450 ± 5% numa-meminfo.node3.SUnreclaim
90075 ± 9% +27.7% 115036 ± 10% numa-meminfo.node3.Slab
226187 ± 4% +10.6% 250243 ± 8% numa-meminfo.node3.Unevictable
12.18 ± 2% -44.7% 6.74 ± 14% perf-stat.i.MPKI
4.181e+10 -28.3% 2.999e+10 ± 16% perf-stat.i.branch-instructions
1.83 +0.0 1.86 perf-stat.i.branch-miss-rate%
7.593e+08 -27.2% 5.526e+08 ± 15% perf-stat.i.branch-misses
2.51 ± 7% +17.4 19.91 ± 30% perf-stat.i.cache-miss-rate%
60330073 ± 9% +185.8% 1.724e+08 ± 8% perf-stat.i.cache-misses
2.531e+09 ± 2% -61.0% 9.877e+08 ± 30% perf-stat.i.cache-references
25244027 -29.8% 17733510 ± 15% perf-stat.i.context-switches
2.16 +55.9% 3.37 ± 13% perf-stat.i.cpi
34147 ± 44% -84.0% 5447 ±141% perf-stat.i.cpu-migrations
7808 ± 10% -63.8% 2824 ± 12% perf-stat.i.cycles-between-cache-misses
0.01 ±113% -0.0 0.00 ± 5% perf-stat.i.dTLB-load-miss-rate%
5424859 ±121% -69.4% 1659555 ± 8% perf-stat.i.dTLB-load-misses
5.989e+10 -29.0% 4.253e+10 ± 16% perf-stat.i.dTLB-loads
0.00 ± 33% -0.0 0.00 ± 10% perf-stat.i.dTLB-store-miss-rate%
336031 ± 17% -56.3% 146755 ± 22% perf-stat.i.dTLB-store-misses
3.664e+10 -29.3% 2.59e+10 ± 15% perf-stat.i.dTLB-stores
60.69 +11.0 71.70 ± 2% perf-stat.i.iTLB-load-miss-rate%
4.987e+08 -25.2% 3.732e+08 ± 14% perf-stat.i.iTLB-load-misses
3.222e+08 -56.0% 1.418e+08 ± 10% perf-stat.i.iTLB-loads
2.079e+11 -28.6% 1.484e+11 ± 16% perf-stat.i.instructions
427.23 -5.5% 403.56 perf-stat.i.instructions-per-iTLB-miss
0.46 -33.5% 0.31 ± 12% perf-stat.i.ipc
0.51 ± 13% +72.4% 0.88 ± 22% perf-stat.i.metric.K/sec
735.55 -29.5% 518.65 ± 16% perf-stat.i.metric.M/sec
3980 +1.4% 4035 perf-stat.i.minor-faults
93.95 ± 2% -4.5 89.46 ± 2% perf-stat.i.node-load-miss-rate%
10301101 ± 23% +102.4% 20844338 ± 8% perf-stat.i.node-load-misses
620028 ± 18% +290.3% 2419720 ± 18% perf-stat.i.node-loads
6105310 ± 5% -26.3% 4502292 ± 10% perf-stat.i.node-store-misses
3980 +1.4% 4036 perf-stat.i.page-faults
12.17 -46.2% 6.55 ± 16% perf-stat.overall.MPKI
1.82 +0.0 1.84 perf-stat.overall.branch-miss-rate%
2.38 ± 8% +16.8 19.23 ± 30% perf-stat.overall.cache-miss-rate%
2.16 +51.9% 3.28 ± 12% perf-stat.overall.cpi
7499 ± 9% -62.7% 2800 ± 12% perf-stat.overall.cycles-between-cache-misses
0.01 ±123% -0.0 0.00 ± 9% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 18% -0.0 0.00 ± 7% perf-stat.overall.dTLB-store-miss-rate%
60.75 +11.6 72.35 ± 2% perf-stat.overall.iTLB-load-miss-rate%
416.92 -4.8% 396.80 perf-stat.overall.instructions-per-iTLB-miss
0.46 -33.2% 0.31 ± 12% perf-stat.overall.ipc
32566 +1.3% 33004 perf-stat.overall.path-length
4.167e+10 -28.2% 2.992e+10 ± 16% perf-stat.ps.branch-instructions
7.567e+08 -27.1% 5.514e+08 ± 15% perf-stat.ps.branch-misses
60126010 ± 9% +185.6% 1.717e+08 ± 8% perf-stat.ps.cache-misses
2.522e+09 ± 2% -61.0% 9.842e+08 ± 30% perf-stat.ps.cache-references
25154040 -29.7% 17694852 ± 15% perf-stat.ps.context-switches
34363 ± 44% -84.2% 5439 ±141% perf-stat.ps.cpu-migrations
5439495 ±121% -69.5% 1661354 ± 8% perf-stat.ps.dTLB-load-misses
5.968e+10 -28.9% 4.243e+10 ± 16% perf-stat.ps.dTLB-loads
336620 ± 17% -56.5% 146564 ± 22% perf-stat.ps.dTLB-store-misses
3.651e+10 -29.2% 2.584e+10 ± 15% perf-stat.ps.dTLB-stores
4.969e+08 -25.1% 3.723e+08 ± 14% perf-stat.ps.iTLB-load-misses
3.21e+08 -56.0% 1.412e+08 ± 10% perf-stat.ps.iTLB-loads
2.071e+11 -28.5% 1.481e+11 ± 16% perf-stat.ps.instructions
3968 +1.4% 4025 perf-stat.ps.minor-faults
10263866 ± 23% +102.2% 20752139 ± 8% perf-stat.ps.node-load-misses
619050 ± 18% +289.5% 2411394 ± 18% perf-stat.ps.node-loads
6083835 ± 5% -26.2% 4491466 ± 10% perf-stat.ps.node-store-misses
3968 +1.4% 4025 perf-stat.ps.page-faults
6.287e+13 -28.6% 4.49e+13 ± 16% perf-stat.total.instructions
9598062 ± 5% -30.1% 6706576 ± 16% softirqs.CPU0.NET_RX
10058114 ± 2% -30.8% 6965070 ± 17% softirqs.CPU1.NET_RX
10077199 ± 2% -30.9% 6964205 ± 17% softirqs.CPU10.NET_RX
10070125 ± 2% -31.1% 6943158 ± 18% softirqs.CPU100.NET_RX
10031200 -31.0% 6917056 ± 17% softirqs.CPU101.NET_RX
9991112 -30.6% 6932680 ± 17% softirqs.CPU102.NET_RX
10043320 ± 2% -27.9% 7244399 ± 22% softirqs.CPU103.NET_RX
10121662 -29.8% 7109724 ± 20% softirqs.CPU104.NET_RX
10093611 -31.2% 6942165 ± 17% softirqs.CPU105.NET_RX
10094809 ± 2% -31.1% 6955098 ± 17% softirqs.CPU106.NET_RX
10046133 ± 3% -28.7% 7165228 ± 21% softirqs.CPU107.NET_RX
10007488 ± 2% -30.8% 6929771 ± 17% softirqs.CPU108.NET_RX
10084499 ± 2% -29.1% 7152263 ± 21% softirqs.CPU109.NET_RX
10035925 ± 2% -28.8% 7148940 ± 21% softirqs.CPU11.NET_RX
10045773 -30.9% 6944080 ± 17% softirqs.CPU110.NET_RX
10048867 -30.9% 6939555 ± 16% softirqs.CPU111.NET_RX
10039974 -31.4% 6889597 ± 17% softirqs.CPU112.NET_RX
10012417 -30.5% 6956726 ± 18% softirqs.CPU113.NET_RX
10035866 -29.7% 7052422 ± 20% softirqs.CPU114.NET_RX
10064513 ± 2% -30.7% 6971345 ± 17% softirqs.CPU115.NET_RX
10100457 ± 2% -30.9% 6977884 ± 17% softirqs.CPU116.NET_RX
10002844 -30.7% 6927404 ± 17% softirqs.CPU117.NET_RX
9984454 ± 2% -30.6% 6925499 ± 18% softirqs.CPU119.NET_RX
10006109 -30.3% 6978624 ± 18% softirqs.CPU12.NET_RX
9931485 ± 2% -26.8% 7265254 ± 15% softirqs.CPU120.NET_RX
9985048 -26.6% 7329426 ± 14% softirqs.CPU121.NET_RX
10116183 ± 2% -27.1% 7375060 ± 16% softirqs.CPU122.NET_RX
10116005 -27.7% 7311564 ± 16% softirqs.CPU123.NET_RX
10133098 ± 2% -27.5% 7350965 ± 16% softirqs.CPU124.NET_RX
10059939 -28.4% 7199505 ± 15% softirqs.CPU125.NET_RX
10037180 ± 2% -27.8% 7245521 ± 15% softirqs.CPU126.NET_RX
10042994 -27.2% 7311871 ± 16% softirqs.CPU127.NET_RX
10118808 -27.8% 7303465 ± 15% softirqs.CPU128.NET_RX
10076652 -26.9% 7370082 ± 16% softirqs.CPU129.NET_RX
10033328 ± 2% -28.7% 7149044 ± 21% softirqs.CPU13.NET_RX
10046145 -27.7% 7259028 ± 15% softirqs.CPU130.NET_RX
9952067 ± 2% -26.1% 7351998 ± 17% softirqs.CPU131.NET_RX
10040127 ± 2% -27.0% 7332603 ± 15% softirqs.CPU132.NET_RX
10069591 ± 2% -26.3% 7420834 ± 18% softirqs.CPU133.NET_RX
10102760 -27.3% 7348336 ± 16% softirqs.CPU134.NET_RX
10090831 -26.9% 7374702 ± 17% softirqs.CPU135.NET_RX
10097478 -28.1% 7264904 ± 15% softirqs.CPU136.NET_RX
10034687 -27.9% 7230010 ± 15% softirqs.CPU137.NET_RX
10029853 -27.8% 7244713 ± 15% softirqs.CPU138.NET_RX
10012824 ± 2% -24.9% 7515913 ± 20% softirqs.CPU139.NET_RX
10048533 ± 2% -30.4% 6996419 ± 17% softirqs.CPU14.NET_RX
10100436 -27.1% 7365039 ± 17% softirqs.CPU140.NET_RX
9964276 -28.2% 7158208 ± 14% softirqs.CPU142.NET_RX
9899363 ± 2% -27.7% 7153366 ± 14% softirqs.CPU143.NET_RX
9877218 -26.3% 7283415 ± 16% softirqs.CPU144.NET_RX
9993949 -26.1% 7381228 ± 15% softirqs.CPU145.NET_RX
10061416 -26.9% 7351483 ± 15% softirqs.CPU146.NET_RX
10109881 ± 2% -27.3% 7347525 ± 15% softirqs.CPU147.NET_RX
10113334 ± 2% -27.4% 7343130 ± 15% softirqs.CPU148.NET_RX
10068577 ± 2% -27.7% 7283739 ± 15% softirqs.CPU149.NET_RX
10053691 -30.9% 6949341 ± 17% softirqs.CPU15.NET_RX
10075955 ± 2% -27.8% 7279008 ± 15% softirqs.CPU150.NET_RX
10223408 ± 5% -28.3% 7328591 ± 15% softirqs.CPU151.NET_RX
10106085 ± 2% -26.9% 7382688 ± 15% softirqs.CPU152.NET_RX
10078801 ± 2% -26.9% 7371962 ± 15% softirqs.CPU153.NET_RX
10105167 ± 2% -27.2% 7360219 ± 15% softirqs.CPU154.NET_RX
10018610 ± 2% -26.9% 7321955 ± 15% softirqs.CPU155.NET_RX
10020265 ± 2% -27.1% 7303252 ± 16% softirqs.CPU156.NET_RX
10104966 ± 2% -27.4% 7335896 ± 15% softirqs.CPU157.NET_RX
10078372 ± 2% -27.0% 7357868 ± 15% softirqs.CPU158.NET_RX
10124630 ± 2% -27.5% 7338490 ± 15% softirqs.CPU159.NET_RX
10069101 -31.4% 6907779 ± 17% softirqs.CPU16.NET_RX
10074374 ± 2% -27.1% 7348242 ± 15% softirqs.CPU160.NET_RX
10043490 ± 2% -27.4% 7295676 ± 16% softirqs.CPU161.NET_RX
10070364 ± 3% -27.9% 7265205 ± 15% softirqs.CPU162.NET_RX
10062017 ± 3% -27.2% 7328897 ± 15% softirqs.CPU163.NET_RX
10064603 -27.7% 7277705 ± 15% softirqs.CPU164.NET_RX
10029210 ± 2% -27.4% 7279040 ± 15% softirqs.CPU165.NET_RX
10035720 ± 3% -27.5% 7277267 ± 15% softirqs.CPU166.NET_RX
10017791 ± 3% -27.9% 7226422 ± 15% softirqs.CPU167.NET_RX
9892425 -32.8% 6650423 ± 15% softirqs.CPU168.NET_RX
10045312 -32.3% 6797865 ± 15% softirqs.CPU169.NET_RX
10024624 -30.5% 6970483 ± 18% softirqs.CPU17.NET_RX
10098246 ± 2% -32.7% 6799795 ± 15% softirqs.CPU170.NET_RX
10091183 -33.0% 6762929 ± 15% softirqs.CPU171.NET_RX
10154504 ± 3% -33.9% 6708947 ± 15% softirqs.CPU172.NET_RX
10080207 ± 2% -33.7% 6684853 ± 14% softirqs.CPU173.NET_RX
10020635 ± 2% -32.6% 6749610 ± 15% softirqs.CPU174.NET_RX
10047522 -32.7% 6757495 ± 15% softirqs.CPU175.NET_RX
10084647 ± 2% -32.9% 6768801 ± 15% softirqs.CPU176.NET_RX
10072430 -32.9% 6758682 ± 15% softirqs.CPU177.NET_RX
10105843 ± 3% -33.2% 6755418 ± 15% softirqs.CPU178.NET_RX
9982514 -32.7% 6720591 ± 14% softirqs.CPU179.NET_RX
10039626 ± 2% -29.5% 7074665 ± 20% softirqs.CPU18.NET_RX
9994378 -32.9% 6705741 ± 15% softirqs.CPU180.NET_RX
10081700 -33.2% 6730856 ± 14% softirqs.CPU181.NET_RX
10046284 -33.0% 6734675 ± 14% softirqs.CPU182.NET_RX
10091276 ± 3% -33.2% 6744658 ± 15% softirqs.CPU183.NET_RX
9983550 -32.4% 6750208 ± 15% softirqs.CPU184.NET_RX
73219 -12.5% 64037 ± 8% softirqs.CPU184.SCHED
10110846 ± 3% -33.5% 6727803 ± 15% softirqs.CPU185.NET_RX
10020237 -32.7% 6738713 ± 15% softirqs.CPU186.NET_RX
10060835 ± 3% -33.1% 6731440 ± 14% softirqs.CPU187.NET_RX
10080875 ± 2% -33.0% 6759013 ± 15% softirqs.CPU188.NET_RX
10274947 ± 8% -34.8% 6694522 ± 14% softirqs.CPU189.NET_RX
10025239 ± 2% -30.5% 6966182 ± 17% softirqs.CPU19.NET_RX
10020101 ± 2% -33.1% 6699231 ± 14% softirqs.CPU190.NET_RX
9760427 ± 2% -34.6% 6382362 ± 14% softirqs.CPU191.NET_RX
10072691 -30.7% 6980437 ± 17% softirqs.CPU2.NET_RX
10114432 ± 2% -31.2% 6960177 ± 17% softirqs.CPU20.NET_RX
10073217 -30.7% 6976906 ± 18% softirqs.CPU21.NET_RX
10048880 -30.0% 7034044 ± 18% softirqs.CPU23.NET_RX
9905488 -27.5% 7184688 ± 13% softirqs.CPU24.NET_RX
10059912 -27.1% 7338079 ± 14% softirqs.CPU25.NET_RX
10073332 -27.5% 7304795 ± 15% softirqs.CPU26.NET_RX
10076257 -28.1% 7246655 ± 15% softirqs.CPU27.NET_RX
10082942 -26.8% 7379877 ± 17% softirqs.CPU28.NET_RX
10050899 -27.7% 7263379 ± 16% softirqs.CPU29.NET_RX
10041118 -29.3% 7100348 ± 20% softirqs.CPU3.NET_RX
10014284 -28.0% 7209752 ± 14% softirqs.CPU30.NET_RX
10064681 -26.6% 7385060 ± 17% softirqs.CPU31.NET_RX
10100987 -27.3% 7344170 ± 16% softirqs.CPU32.NET_RX
10105051 -26.8% 7393874 ± 16% softirqs.CPU33.NET_RX
10090040 -27.9% 7272307 ± 15% softirqs.CPU34.NET_RX
9980548 ± 2% -26.3% 7351830 ± 17% softirqs.CPU35.NET_RX
10076549 ± 2% -26.5% 7405914 ± 16% softirqs.CPU36.NET_RX
10126275 ± 2% -26.1% 7487040 ± 19% softirqs.CPU37.NET_RX
10141998 ± 2% -28.0% 7306017 ± 15% softirqs.CPU38.NET_RX
10113154 -27.4% 7345485 ± 16% softirqs.CPU39.NET_RX
10111962 -31.7% 6904345 ± 18% softirqs.CPU4.NET_RX
10093619 -27.8% 7287927 ± 15% softirqs.CPU40.NET_RX
10072397 -27.4% 7314698 ± 16% softirqs.CPU41.NET_RX
10067799 -27.2% 7326554 ± 16% softirqs.CPU42.NET_RX
10092440 ± 2% -26.0% 7463769 ± 19% softirqs.CPU43.NET_RX
10182592 ± 3% -27.3% 7404142 ± 17% softirqs.CPU44.NET_RX
10064558 -27.5% 7298567 ± 16% softirqs.CPU46.NET_RX
9991852 -27.4% 7254731 ± 15% softirqs.CPU47.NET_RX
9858553 -26.5% 7242427 ± 15% softirqs.CPU48.NET_RX
10002429 -26.6% 7339189 ± 16% softirqs.CPU49.NET_RX
10053023 -31.4% 6894942 ± 16% softirqs.CPU5.NET_RX
10065927 ± 2% -27.1% 7342019 ± 15% softirqs.CPU50.NET_RX
10082190 ± 2% -27.2% 7338633 ± 16% softirqs.CPU51.NET_RX
10107664 ± 2% -27.5% 7330395 ± 15% softirqs.CPU52.NET_RX
10065018 ± 2% -27.4% 7311926 ± 15% softirqs.CPU53.NET_RX
10012735 ± 2% -27.3% 7283738 ± 15% softirqs.CPU54.NET_RX
10178892 ± 5% -27.8% 7353844 ± 14% softirqs.CPU55.NET_RX
10103580 ± 2% -26.9% 7384852 ± 15% softirqs.CPU56.NET_RX
10073431 ± 2% -26.9% 7360570 ± 15% softirqs.CPU57.NET_RX
10115712 ± 2% -27.2% 7367915 ± 15% softirqs.CPU58.NET_RX
10041211 -26.9% 7336973 ± 15% softirqs.CPU59.NET_RX
10015691 ± 2% -30.7% 6939025 ± 17% softirqs.CPU6.NET_RX
9998182 ± 2% -26.6% 7341640 ± 15% softirqs.CPU60.NET_RX
10108059 ± 2% -27.5% 7330898 ± 15% softirqs.CPU61.NET_RX
10082928 ± 2% -27.1% 7348358 ± 16% softirqs.CPU62.NET_RX
10100743 ± 2% -27.1% 7368320 ± 15% softirqs.CPU63.NET_RX
10099783 ± 2% -27.3% 7346339 ± 16% softirqs.CPU64.NET_RX
10022548 ± 2% -27.0% 7315201 ± 16% softirqs.CPU65.NET_RX
10108689 ± 2% -27.7% 7303707 ± 15% softirqs.CPU66.NET_RX
10079291 ± 3% -27.2% 7333041 ± 16% softirqs.CPU67.NET_RX
10059382 ± 2% -27.3% 7308795 ± 15% softirqs.CPU68.NET_RX
10088391 ± 2% -27.1% 7356629 ± 15% softirqs.CPU69.NET_RX
10041514 -28.0% 7225555 ± 21% softirqs.CPU7.NET_RX
10046334 ± 3% -27.1% 7322687 ± 15% softirqs.CPU70.NET_RX
10072672 ± 3% -27.2% 7328357 ± 15% softirqs.CPU71.NET_RX
9888770 ± 2% -33.1% 6611481 ± 15% softirqs.CPU72.NET_RX
74577 -13.7% 64379 ± 6% softirqs.CPU72.SCHED
10022409 -32.4% 6776525 ± 15% softirqs.CPU73.NET_RX
10065888 ± 2% -32.7% 6773508 ± 15% softirqs.CPU74.NET_RX
10062615 -32.9% 6748007 ± 15% softirqs.CPU75.NET_RX
10150804 ± 3% -34.0% 6704414 ± 15% softirqs.CPU76.NET_RX
10084714 ± 2% -33.5% 6702424 ± 14% softirqs.CPU77.NET_RX
10029958 ± 2% -32.7% 6750873 ± 15% softirqs.CPU78.NET_RX
10032633 -32.8% 6740672 ± 15% softirqs.CPU79.NET_RX
10105216 ± 2% -29.2% 7154492 ± 20% softirqs.CPU8.NET_RX
10065074 -32.6% 6782322 ± 15% softirqs.CPU80.NET_RX
10067765 -33.0% 6750045 ± 15% softirqs.CPU81.NET_RX
10087190 ± 3% -32.8% 6778822 ± 15% softirqs.CPU82.NET_RX
9995663 -32.9% 6709261 ± 14% softirqs.CPU83.NET_RX
9992905 -32.7% 6723146 ± 15% softirqs.CPU84.NET_RX
10082270 -33.3% 6726669 ± 14% softirqs.CPU85.NET_RX
10065484 -32.8% 6762441 ± 15% softirqs.CPU86.NET_RX
10086577 ± 3% -33.2% 6742547 ± 15% softirqs.CPU87.NET_RX
10000647 -32.6% 6735741 ± 15% softirqs.CPU88.NET_RX
10114983 ± 3% -33.4% 6737194 ± 15% softirqs.CPU89.NET_RX
10103325 -31.5% 6919292 ± 16% softirqs.CPU9.NET_RX
10037273 -32.8% 6748386 ± 15% softirqs.CPU90.NET_RX
10091021 ± 3% -33.3% 6731638 ± 14% softirqs.CPU91.NET_RX
10093519 ± 2% -32.8% 6778222 ± 15% softirqs.CPU92.NET_RX
10284999 ± 8% -34.4% 6745854 ± 15% softirqs.CPU93.NET_RX
10043189 -32.6% 6767875 ± 15% softirqs.CPU94.NET_RX
9996291 ± 2% -32.1% 6790144 ± 13% softirqs.CPU95.NET_RX
9962894 -30.6% 6915029 ± 16% softirqs.CPU96.NET_RX
10092463 ± 2% -30.7% 6991282 ± 17% softirqs.CPU97.NET_RX
10077768 -30.9% 6968609 ± 17% softirqs.CPU98.NET_RX
10101239 -29.7% 7096824 ± 20% softirqs.CPU99.NET_RX
1.931e+09 -29.3% 1.365e+09 ± 16% softirqs.NET_RX
1179 ± 85% -100.0% 0.00 interrupts.161:PCI-MSI.524289-edge.eth0-TxRx-0
7636 ±209% -100.0% 0.00 interrupts.162:PCI-MSI.524290-edge.eth0-TxRx-1
8411 ±106% -100.0% 0.00 interrupts.163:PCI-MSI.524291-edge.eth0-TxRx-2
5919 ±188% -100.0% 0.00 interrupts.164:PCI-MSI.524292-edge.eth0-TxRx-3
183711 ± 11% +463.8% 1035763 ± 20% interrupts.CPU0.RES:Rescheduling_interrupts
214569 ± 12% +394.3% 1060665 ± 19% interrupts.CPU1.RES:Rescheduling_interrupts
205359 ± 10% +417.7% 1063195 ± 19% interrupts.CPU10.RES:Rescheduling_interrupts
208516 ± 9% +411.1% 1065710 ± 20% interrupts.CPU100.RES:Rescheduling_interrupts
192211 ± 9% +448.5% 1054238 ± 19% interrupts.CPU101.RES:Rescheduling_interrupts
194848 ± 8% +442.5% 1057087 ± 19% interrupts.CPU102.RES:Rescheduling_interrupts
203159 ± 13% +411.4% 1038986 ± 17% interrupts.CPU103.RES:Rescheduling_interrupts
200256 ± 12% +423.0% 1047342 ± 18% interrupts.CPU104.RES:Rescheduling_interrupts
203041 ± 12% +421.4% 1058756 ± 19% interrupts.CPU105.RES:Rescheduling_interrupts
204183 ± 11% +419.1% 1059958 ± 19% interrupts.CPU106.RES:Rescheduling_interrupts
198487 ± 13% +418.4% 1029048 ± 17% interrupts.CPU107.RES:Rescheduling_interrupts
191276 ± 13% +452.0% 1055813 ± 19% interrupts.CPU108.RES:Rescheduling_interrupts
189509 ± 12% +447.6% 1037768 ± 18% interrupts.CPU109.RES:Rescheduling_interrupts
1179 ± 85% -100.0% 0.00 interrupts.CPU11.161:PCI-MSI.524289-edge.eth0-TxRx-0
196785 ± 7% +424.3% 1031798 ± 18% interrupts.CPU11.RES:Rescheduling_interrupts
195563 ± 10% +445.8% 1067316 ± 19% interrupts.CPU110.RES:Rescheduling_interrupts
189590 ± 12% +463.4% 1068207 ± 19% interrupts.CPU111.RES:Rescheduling_interrupts
185652 ± 12% +468.4% 1055308 ± 19% interrupts.CPU112.RES:Rescheduling_interrupts
198201 ± 11% +434.7% 1059705 ± 19% interrupts.CPU113.RES:Rescheduling_interrupts
203866 ± 11% +409.8% 1039329 ± 19% interrupts.CPU114.RES:Rescheduling_interrupts
199363 ± 12% +431.5% 1059537 ± 19% interrupts.CPU115.RES:Rescheduling_interrupts
197784 ± 16% +433.8% 1055682 ± 18% interrupts.CPU116.RES:Rescheduling_interrupts
192092 ± 14% +449.8% 1056150 ± 19% interrupts.CPU117.RES:Rescheduling_interrupts
186504 ± 12% +445.0% 1016404 ± 18% interrupts.CPU118.RES:Rescheduling_interrupts
191109 ± 11% +446.4% 1044147 ± 19% interrupts.CPU119.RES:Rescheduling_interrupts
7636 ±209% -100.0% 0.00 interrupts.CPU12.162:PCI-MSI.524290-edge.eth0-TxRx-1
193673 ± 14% +447.3% 1060022 ± 19% interrupts.CPU12.RES:Rescheduling_interrupts
222704 ± 14% +380.4% 1069979 ± 16% interrupts.CPU120.RES:Rescheduling_interrupts
205118 ± 11% +430.7% 1088584 ± 16% interrupts.CPU121.RES:Rescheduling_interrupts
207673 ± 14% +433.2% 1107299 ± 16% interrupts.CPU122.RES:Rescheduling_interrupts
208571 ± 11% +433.2% 1112049 ± 17% interrupts.CPU123.RES:Rescheduling_interrupts
205146 ± 11% +433.6% 1094593 ± 16% interrupts.CPU124.RES:Rescheduling_interrupts
191784 ± 11% +471.4% 1095924 ± 16% interrupts.CPU125.RES:Rescheduling_interrupts
197177 ± 14% +456.0% 1096391 ± 16% interrupts.CPU126.RES:Rescheduling_interrupts
209175 ± 13% +425.2% 1098671 ± 16% interrupts.CPU127.RES:Rescheduling_interrupts
203557 ± 15% +437.3% 1093722 ± 16% interrupts.CPU128.RES:Rescheduling_interrupts
205780 ± 11% +439.6% 1110462 ± 16% interrupts.CPU129.RES:Rescheduling_interrupts
8411 ±106% -100.0% 0.00 interrupts.CPU13.163:PCI-MSI.524291-edge.eth0-TxRx-2
192155 ± 9% +441.5% 1040425 ± 18% interrupts.CPU13.RES:Rescheduling_interrupts
200939 ± 12% +449.7% 1104506 ± 16% interrupts.CPU130.RES:Rescheduling_interrupts
199109 ± 12% +453.6% 1102272 ± 16% interrupts.CPU131.RES:Rescheduling_interrupts
205140 ± 11% +433.3% 1094078 ± 16% interrupts.CPU132.RES:Rescheduling_interrupts
207970 ± 13% +416.5% 1074163 ± 16% interrupts.CPU133.RES:Rescheduling_interrupts
207662 ± 11% +430.1% 1100813 ± 16% interrupts.CPU134.RES:Rescheduling_interrupts
208623 ± 13% +430.4% 1106573 ± 16% interrupts.CPU135.RES:Rescheduling_interrupts
210712 ± 14% +424.0% 1104075 ± 16% interrupts.CPU136.RES:Rescheduling_interrupts
202995 ± 9% +438.6% 1093305 ± 16% interrupts.CPU137.RES:Rescheduling_interrupts
208022 ± 9% +420.2% 1082080 ± 15% interrupts.CPU138.RES:Rescheduling_interrupts
206004 ± 14% +419.2% 1069583 ± 16% interrupts.CPU139.RES:Rescheduling_interrupts
5919 ±188% -100.0% 0.00 interrupts.CPU14.164:PCI-MSI.524292-edge.eth0-TxRx-3
198316 ± 9% +438.9% 1068795 ± 19% interrupts.CPU14.RES:Rescheduling_interrupts
204581 ± 11% +434.2% 1092828 ± 16% interrupts.CPU140.RES:Rescheduling_interrupts
194734 ± 12% +413.7% 1000344 ± 22% interrupts.CPU141.RES:Rescheduling_interrupts
186037 ± 10% +481.4% 1081618 ± 16% interrupts.CPU142.RES:Rescheduling_interrupts
181293 ± 13% +494.5% 1077813 ± 16% interrupts.CPU143.RES:Rescheduling_interrupts
216600 ± 11% +404.2% 1092036 ± 18% interrupts.CPU144.RES:Rescheduling_interrupts
206558 ± 9% +436.2% 1107558 ± 18% interrupts.CPU145.RES:Rescheduling_interrupts
31410 ±111% -84.3% 4920 ± 61% interrupts.CPU146.CAL:Function_call_interrupts
196111 ± 10% +469.2% 1116288 ± 18% interrupts.CPU146.RES:Rescheduling_interrupts
208249 ± 11% +435.0% 1114159 ± 19% interrupts.CPU147.RES:Rescheduling_interrupts
6010 ± 35% +42.5% 8563 ± 2% interrupts.CPU148.NMI:Non-maskable_interrupts
6010 ± 35% +42.5% 8563 ± 2% interrupts.CPU148.PMI:Performance_monitoring_interrupts
203103 ± 9% +448.2% 1113470 ± 18% interrupts.CPU148.RES:Rescheduling_interrupts
6050 ± 35% +42.7% 8635 interrupts.CPU149.NMI:Non-maskable_interrupts
6050 ± 35% +42.7% 8635 interrupts.CPU149.PMI:Performance_monitoring_interrupts
198479 ± 14% +461.8% 1115091 ± 18% interrupts.CPU149.RES:Rescheduling_interrupts
200884 ± 9% +431.2% 1067061 ± 19% interrupts.CPU15.RES:Rescheduling_interrupts
201538 ± 13% +450.0% 1108410 ± 18% interrupts.CPU150.RES:Rescheduling_interrupts
198635 ± 16% +457.0% 1106479 ± 18% interrupts.CPU151.RES:Rescheduling_interrupts
206185 ± 10% +437.5% 1108245 ± 19% interrupts.CPU152.RES:Rescheduling_interrupts
190921 ± 13% +482.8% 1112633 ± 18% interrupts.CPU153.RES:Rescheduling_interrupts
199951 ± 16% +462.7% 1125066 ± 18% interrupts.CPU154.RES:Rescheduling_interrupts
198700 ± 14% +462.5% 1117750 ± 18% interrupts.CPU155.RES:Rescheduling_interrupts
33481 ±121% -81.3% 6272 ± 84% interrupts.CPU156.CAL:Function_call_interrupts
206914 ± 12% +434.6% 1106114 ± 18% interrupts.CPU156.RES:Rescheduling_interrupts
205271 ± 9% +436.3% 1100884 ± 18% interrupts.CPU157.RES:Rescheduling_interrupts
205474 ± 12% +435.3% 1099845 ± 18% interrupts.CPU158.RES:Rescheduling_interrupts
36186 ±131% -85.3% 5325 ± 72% interrupts.CPU159.CAL:Function_call_interrupts
204019 ± 16% +447.2% 1116491 ± 18% interrupts.CPU159.RES:Rescheduling_interrupts
191152 ± 11% +454.9% 1060750 ± 19% interrupts.CPU16.RES:Rescheduling_interrupts
190038 ± 11% +478.0% 1098499 ± 19% interrupts.CPU160.RES:Rescheduling_interrupts
191203 ± 14% +480.4% 1109770 ± 18% interrupts.CPU161.RES:Rescheduling_interrupts
200786 ± 14% +449.3% 1102956 ± 18% interrupts.CPU162.RES:Rescheduling_interrupts
201575 ± 14% +444.8% 1098219 ± 19% interrupts.CPU163.RES:Rescheduling_interrupts
191046 ± 11% +486.5% 1120526 ± 18% interrupts.CPU164.RES:Rescheduling_interrupts
33248 ±142% -83.5% 5476 ± 74% interrupts.CPU165.CAL:Function_call_interrupts
189076 ± 10% +484.3% 1104760 ± 18% interrupts.CPU165.RES:Rescheduling_interrupts
185110 ± 13% +492.9% 1097520 ± 18% interrupts.CPU166.RES:Rescheduling_interrupts
179345 ± 10% +511.2% 1096142 ± 18% interrupts.CPU167.RES:Rescheduling_interrupts
15895 ± 94% -74.5% 4056 ± 40% interrupts.CPU168.CAL:Function_call_interrupts
211530 ± 7% +432.2% 1125757 ± 14% interrupts.CPU168.RES:Rescheduling_interrupts
19958 ±122% -79.8% 4040 ± 40% interrupts.CPU169.CAL:Function_call_interrupts
205636 ± 6% +452.5% 1136234 ± 14% interrupts.CPU169.RES:Rescheduling_interrupts
199389 ± 10% +432.0% 1060789 ± 19% interrupts.CPU17.RES:Rescheduling_interrupts
34.44 ±126% -88.4% 4.00 ± 30% interrupts.CPU17.TLB:TLB_shootdowns
30368 ±180% -86.3% 4166 ± 46% interrupts.CPU170.CAL:Function_call_interrupts
203515 ± 6% +469.4% 1158771 ± 15% interrupts.CPU170.RES:Rescheduling_interrupts
21877 ±124% -80.8% 4192 ± 42% interrupts.CPU171.CAL:Function_call_interrupts
211977 ± 6% +445.4% 1156136 ± 14% interrupts.CPU171.RES:Rescheduling_interrupts
19330 ±121% -76.7% 4496 ± 48% interrupts.CPU172.CAL:Function_call_interrupts
213412 ± 5% +440.0% 1152321 ± 15% interrupts.CPU172.RES:Rescheduling_interrupts
21830 ±137% -80.7% 4207 ± 44% interrupts.CPU173.CAL:Function_call_interrupts
203505 ± 8% +458.3% 1136106 ± 14% interrupts.CPU173.RES:Rescheduling_interrupts
21961 ±144% -80.6% 4249 ± 44% interrupts.CPU174.CAL:Function_call_interrupts
201959 ± 9% +469.7% 1150514 ± 15% interrupts.CPU174.RES:Rescheduling_interrupts
25967 ±159% -83.0% 4412 ± 35% interrupts.CPU175.CAL:Function_call_interrupts
205913 ± 7% +455.6% 1143994 ± 14% interrupts.CPU175.RES:Rescheduling_interrupts
20710 ±147% -79.8% 4179 ± 47% interrupts.CPU176.CAL:Function_call_interrupts
187550 ± 10% +515.4% 1154155 ± 14% interrupts.CPU176.RES:Rescheduling_interrupts
15651 ± 96% -73.7% 4118 ± 43% interrupts.CPU177.CAL:Function_call_interrupts
198145 ± 8% +482.6% 1154405 ± 14% interrupts.CPU177.RES:Rescheduling_interrupts
23622 ±154% -82.4% 4149 ± 41% interrupts.CPU178.CAL:Function_call_interrupts
197146 ± 10% +482.8% 1148911 ± 14% interrupts.CPU178.RES:Rescheduling_interrupts
21421 ±123% -80.6% 4153 ± 46% interrupts.CPU179.CAL:Function_call_interrupts
198341 ± 5% +481.7% 1153821 ± 14% interrupts.CPU179.RES:Rescheduling_interrupts
205261 ± 9% +410.6% 1048028 ± 19% interrupts.CPU18.RES:Rescheduling_interrupts
14207 ± 70% -69.9% 4271 ± 46% interrupts.CPU180.CAL:Function_call_interrupts
200931 ± 8% +470.9% 1147113 ± 14% interrupts.CPU180.RES:Rescheduling_interrupts
19819 ±133% -78.7% 4225 ± 47% interrupts.CPU181.CAL:Function_call_interrupts
204375 ± 8% +458.6% 1141649 ± 14% interrupts.CPU181.RES:Rescheduling_interrupts
18339 ±114% -76.1% 4391 ± 48% interrupts.CPU182.CAL:Function_call_interrupts
199187 ± 3% +473.7% 1142647 ± 14% interrupts.CPU182.RES:Rescheduling_interrupts
25537 ±162% -83.4% 4237 ± 45% interrupts.CPU183.CAL:Function_call_interrupts
196201 ± 11% +491.8% 1161105 ± 14% interrupts.CPU183.RES:Rescheduling_interrupts
19636 ±115% -79.2% 4085 ± 39% interrupts.CPU184.CAL:Function_call_interrupts
187489 ± 9% +514.1% 1151329 ± 14% interrupts.CPU184.RES:Rescheduling_interrupts
23677 ±140% -81.6% 4355 ± 40% interrupts.CPU185.CAL:Function_call_interrupts
196721 ± 7% +487.3% 1155305 ± 15% interrupts.CPU185.RES:Rescheduling_interrupts
20054 ±135% -80.0% 4007 ± 39% interrupts.CPU186.CAL:Function_call_interrupts
193472 ± 8% +494.8% 1150704 ± 14% interrupts.CPU186.RES:Rescheduling_interrupts
18953 ±122% -77.7% 4222 ± 41% interrupts.CPU187.CAL:Function_call_interrupts
198988 ± 9% +481.6% 1157343 ± 14% interrupts.CPU187.RES:Rescheduling_interrupts
24557 ±171% -83.4% 4087 ± 43% interrupts.CPU188.CAL:Function_call_interrupts
186299 ± 8% +520.9% 1156737 ± 14% interrupts.CPU188.RES:Rescheduling_interrupts
178562 ± 7% +539.0% 1141091 ± 15% interrupts.CPU189.RES:Rescheduling_interrupts
205716 ± 11% +420.3% 1070349 ± 19% interrupts.CPU19.RES:Rescheduling_interrupts
22098 ±151% -81.6% 4062 ± 42% interrupts.CPU190.CAL:Function_call_interrupts
178637 ± 11% +541.5% 1145917 ± 14% interrupts.CPU190.RES:Rescheduling_interrupts
19427 ±134% -77.4% 4383 ± 46% interrupts.CPU191.CAL:Function_call_interrupts
174493 ± 9% +509.6% 1063776 ± 15% interrupts.CPU191.RES:Rescheduling_interrupts
203036 ± 9% +428.5% 1073034 ± 19% interrupts.CPU2.RES:Rescheduling_interrupts
199252 ± 9% +433.4% 1062718 ± 19% interrupts.CPU20.RES:Rescheduling_interrupts
195878 ± 9% +442.2% 1062036 ± 19% interrupts.CPU21.RES:Rescheduling_interrupts
190273 ± 9% +439.0% 1025582 ± 18% interrupts.CPU22.RES:Rescheduling_interrupts
199754 ± 8% +427.1% 1052966 ± 19% interrupts.CPU23.RES:Rescheduling_interrupts
207185 ± 9% +414.1% 1065243 ± 16% interrupts.CPU24.RES:Rescheduling_interrupts
200476 ± 8% +442.1% 1086824 ± 16% interrupts.CPU25.RES:Rescheduling_interrupts
197385 ± 10% +461.3% 1107880 ± 16% interrupts.CPU26.RES:Rescheduling_interrupts
194339 ± 7% +459.9% 1088110 ± 15% interrupts.CPU27.RES:Rescheduling_interrupts
190029 ± 10% +475.9% 1094443 ± 16% interrupts.CPU28.RES:Rescheduling_interrupts
184345 ± 7% +491.9% 1091117 ± 16% interrupts.CPU29.RES:Rescheduling_interrupts
206712 ± 9% +406.4% 1046693 ± 18% interrupts.CPU3.RES:Rescheduling_interrupts
188400 ± 8% +480.4% 1093427 ± 16% interrupts.CPU30.RES:Rescheduling_interrupts
192929 ± 8% +466.2% 1092405 ± 16% interrupts.CPU31.RES:Rescheduling_interrupts
189482 ± 11% +477.6% 1094389 ± 16% interrupts.CPU32.RES:Rescheduling_interrupts
198521 ± 10% +457.6% 1107028 ± 16% interrupts.CPU33.RES:Rescheduling_interrupts
194475 ± 10% +468.5% 1105678 ± 16% interrupts.CPU34.RES:Rescheduling_interrupts
194196 ± 10% +472.2% 1111189 ± 16% interrupts.CPU35.RES:Rescheduling_interrupts
194721 ± 9% +461.8% 1094038 ± 16% interrupts.CPU36.RES:Rescheduling_interrupts
202194 ± 11% +410.8% 1032805 ± 16% interrupts.CPU37.RES:Rescheduling_interrupts
207136 ± 7% +433.8% 1105619 ± 16% interrupts.CPU38.RES:Rescheduling_interrupts
200302 ± 9% +453.1% 1107781 ± 16% interrupts.CPU39.RES:Rescheduling_interrupts
207930 ± 9% +407.6% 1055544 ± 20% interrupts.CPU4.RES:Rescheduling_interrupts
210776 ± 13% +425.9% 1108554 ± 16% interrupts.CPU40.RES:Rescheduling_interrupts
208079 ± 10% +430.8% 1104489 ± 16% interrupts.CPU41.RES:Rescheduling_interrupts
211581 ± 11% +411.3% 1081808 ± 16% interrupts.CPU42.RES:Rescheduling_interrupts
213523 ± 14% +404.0% 1076127 ± 16% interrupts.CPU43.RES:Rescheduling_interrupts
204667 ± 11% +429.5% 1083695 ± 16% interrupts.CPU44.RES:Rescheduling_interrupts
197804 ± 11% +410.0% 1008776 ± 21% interrupts.CPU45.RES:Rescheduling_interrupts
106.89 ±232% -97.0% 3.25 ± 88% interrupts.CPU45.TLB:TLB_shootdowns
195293 ± 10% +460.4% 1094418 ± 16% interrupts.CPU46.RES:Rescheduling_interrupts
188306 ± 13% +480.6% 1093235 ± 16% interrupts.CPU47.RES:Rescheduling_interrupts
24432 ± 96% -75.0% 6109 ± 89% interrupts.CPU48.CAL:Function_call_interrupts
209339 ± 9% +416.6% 1081517 ± 18% interrupts.CPU48.RES:Rescheduling_interrupts
192152 ± 6% +473.2% 1101467 ± 18% interrupts.CPU49.RES:Rescheduling_interrupts
198907 ± 11% +428.9% 1051941 ± 19% interrupts.CPU5.RES:Rescheduling_interrupts
32746 ±123% -88.1% 3892 ± 36% interrupts.CPU50.CAL:Function_call_interrupts
186397 ± 5% +499.2% 1116983 ± 18% interrupts.CPU50.RES:Rescheduling_interrupts
194978 ± 10% +468.6% 1108631 ± 19% interrupts.CPU51.RES:Rescheduling_interrupts
194279 ± 7% +472.9% 1113056 ± 18% interrupts.CPU52.RES:Rescheduling_interrupts
192472 ± 13% +478.9% 1114186 ± 18% interrupts.CPU53.RES:Rescheduling_interrupts
26810 ± 97% -78.4% 5794 ± 75% interrupts.CPU54.CAL:Function_call_interrupts
202383 ± 8% +447.1% 1107272 ± 18% interrupts.CPU54.RES:Rescheduling_interrupts
193533 ± 10% +471.7% 1106334 ± 18% interrupts.CPU55.RES:Rescheduling_interrupts
204595 ± 12% +442.0% 1108971 ± 18% interrupts.CPU56.RES:Rescheduling_interrupts
189183 ± 10% +489.1% 1114559 ± 18% interrupts.CPU57.RES:Rescheduling_interrupts
198880 ± 10% +465.4% 1124413 ± 18% interrupts.CPU58.RES:Rescheduling_interrupts
31343 ±133% -82.0% 5649 ± 73% interrupts.CPU59.CAL:Function_call_interrupts
189762 ± 12% +490.6% 1120777 ± 18% interrupts.CPU59.RES:Rescheduling_interrupts
196204 ± 11% +438.6% 1056809 ± 19% interrupts.CPU6.RES:Rescheduling_interrupts
200202 ± 8% +454.7% 1110442 ± 18% interrupts.CPU60.RES:Rescheduling_interrupts
201638 ± 8% +427.7% 1063980 ± 18% interrupts.CPU61.RES:Rescheduling_interrupts
36599 ±126% -85.4% 5350 ± 67% interrupts.CPU62.CAL:Function_call_interrupts
208768 ± 10% +429.1% 1104540 ± 18% interrupts.CPU62.RES:Rescheduling_interrupts
203591 ± 14% +450.5% 1120742 ± 18% interrupts.CPU63.RES:Rescheduling_interrupts
195363 ± 10% +466.2% 1106087 ± 18% interrupts.CPU64.RES:Rescheduling_interrupts
30876 ±121% -82.5% 5414 ± 63% interrupts.CPU65.CAL:Function_call_interrupts
199229 ± 11% +462.8% 1121254 ± 18% interrupts.CPU65.RES:Rescheduling_interrupts
203576 ± 10% +446.2% 1111947 ± 18% interrupts.CPU66.RES:Rescheduling_interrupts
202361 ± 14% +444.5% 1101943 ± 18% interrupts.CPU67.RES:Rescheduling_interrupts
201385 ± 9% +451.1% 1109781 ± 18% interrupts.CPU68.RES:Rescheduling_interrupts
200203 ± 9% +454.9% 1110899 ± 18% interrupts.CPU69.RES:Rescheduling_interrupts
202975 ± 11% +413.2% 1041696 ± 17% interrupts.CPU7.RES:Rescheduling_interrupts
193875 ± 10% +469.1% 1103348 ± 18% interrupts.CPU70.RES:Rescheduling_interrupts
192804 ± 9% +470.0% 1099025 ± 17% interrupts.CPU71.RES:Rescheduling_interrupts
17372 ±129% -76.9% 4007 ± 38% interrupts.CPU72.CAL:Function_call_interrupts
192877 ± 8% +479.8% 1118324 ± 14% interrupts.CPU72.RES:Rescheduling_interrupts
18852 ±114% -79.1% 3934 ± 39% interrupts.CPU73.CAL:Function_call_interrupts
194244 ± 10% +487.1% 1140315 ± 15% interrupts.CPU73.RES:Rescheduling_interrupts
18032 ±123% -77.4% 4070 ± 39% interrupts.CPU74.CAL:Function_call_interrupts
189923 ± 5% +504.9% 1148910 ± 14% interrupts.CPU74.RES:Rescheduling_interrupts
15470 ± 95% -72.6% 4244 ± 42% interrupts.CPU75.CAL:Function_call_interrupts
196358 ± 10% +486.7% 1152130 ± 14% interrupts.CPU75.RES:Rescheduling_interrupts
196639 ± 8% +485.5% 1151330 ± 14% interrupts.CPU76.RES:Rescheduling_interrupts
23314 ±153% -80.2% 4625 ± 46% interrupts.CPU77.CAL:Function_call_interrupts
190315 ± 12% +462.9% 1071223 ± 14% interrupts.CPU77.RES:Rescheduling_interrupts
20306 ±138% -78.1% 4449 ± 41% interrupts.CPU78.CAL:Function_call_interrupts
189243 ± 7% +509.6% 1153632 ± 15% interrupts.CPU78.RES:Rescheduling_interrupts
16695 ± 68% -75.8% 4038 ± 43% interrupts.CPU79.CAL:Function_call_interrupts
195625 ± 9% +478.3% 1131268 ± 16% interrupts.CPU79.RES:Rescheduling_interrupts
203243 ± 10% +415.6% 1047904 ± 18% interrupts.CPU8.RES:Rescheduling_interrupts
17266 ± 92% -76.3% 4100 ± 44% interrupts.CPU80.CAL:Function_call_interrupts
184337 ± 7% +526.6% 1155038 ± 14% interrupts.CPU80.RES:Rescheduling_interrupts
14758 ± 74% -71.4% 4218 ± 45% interrupts.CPU81.CAL:Function_call_interrupts
191225 ± 9% +503.2% 1153553 ± 14% interrupts.CPU81.RES:Rescheduling_interrupts
20026 ±131% -79.1% 4181 ± 36% interrupts.CPU82.CAL:Function_call_interrupts
192513 ± 12% +495.1% 1145557 ± 14% interrupts.CPU82.RES:Rescheduling_interrupts
22962 ±116% -81.2% 4320 ± 47% interrupts.CPU83.CAL:Function_call_interrupts
193517 ± 9% +493.7% 1148867 ± 14% interrupts.CPU83.RES:Rescheduling_interrupts
195756 ± 10% +482.7% 1140633 ± 14% interrupts.CPU84.RES:Rescheduling_interrupts
19845 ±131% -78.5% 4275 ± 45% interrupts.CPU85.CAL:Function_call_interrupts
207758 ± 9% +447.5% 1137462 ± 14% interrupts.CPU85.RES:Rescheduling_interrupts
200239 ± 7% +470.8% 1142950 ± 14% interrupts.CPU86.RES:Rescheduling_interrupts
23190 ±151% -81.9% 4193 ± 43% interrupts.CPU87.CAL:Function_call_interrupts
195480 ± 13% +492.0% 1157158 ± 14% interrupts.CPU87.RES:Rescheduling_interrupts
16073 ± 90% -74.4% 4112 ± 44% interrupts.CPU88.CAL:Function_call_interrupts
192317 ± 10% +499.8% 1153466 ± 14% interrupts.CPU88.RES:Rescheduling_interrupts
24243 ±148% -82.0% 4374 ± 42% interrupts.CPU89.CAL:Function_call_interrupts
206645 ± 6% +460.7% 1158657 ± 15% interrupts.CPU89.RES:Rescheduling_interrupts
203441 ± 8% +420.1% 1058131 ± 19% interrupts.CPU9.RES:Rescheduling_interrupts
23141 ±152% -82.6% 4028 ± 43% interrupts.CPU90.CAL:Function_call_interrupts
202101 ± 6% +465.4% 1142621 ± 14% interrupts.CPU90.RES:Rescheduling_interrupts
19906 ±116% -78.4% 4293 ± 47% interrupts.CPU91.CAL:Function_call_interrupts
212157 ± 7% +440.2% 1146093 ± 14% interrupts.CPU91.RES:Rescheduling_interrupts
26218 ±142% -83.8% 4238 ± 44% interrupts.CPU92.CAL:Function_call_interrupts
195027 ± 8% +493.5% 1157521 ± 14% interrupts.CPU92.RES:Rescheduling_interrupts
24463 ±159% -83.0% 4147 ± 45% interrupts.CPU93.CAL:Function_call_interrupts
189365 ± 3% +506.9% 1149315 ± 15% interrupts.CPU93.RES:Rescheduling_interrupts
19381 ±117% -76.0% 4647 ± 62% interrupts.CPU94.CAL:Function_call_interrupts
194038 ± 8% +494.1% 1152802 ± 14% interrupts.CPU94.RES:Rescheduling_interrupts
17859 ±116% -77.5% 4016 ± 43% interrupts.CPU95.CAL:Function_call_interrupts
187560 ± 7% +479.6% 1087163 ± 16% interrupts.CPU95.RES:Rescheduling_interrupts
180972 ± 11% +473.7% 1038195 ± 19% interrupts.CPU96.RES:Rescheduling_interrupts
214277 ± 8% +395.9% 1062672 ± 19% interrupts.CPU97.RES:Rescheduling_interrupts
208440 ± 11% +415.3% 1074097 ± 19% interrupts.CPU98.RES:Rescheduling_interrupts
209626 ± 8% +403.2% 1054865 ± 18% interrupts.CPU99.RES:Rescheduling_interrupts
38124911 ± 6% +453.2% 2.109e+08 ± 16% interrupts.RES:Rescheduling_interrupts
29.66 -17.6 12.08 ± 17% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
34.14 -6.6 27.56 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
34.20 -6.4 27.83 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
52.20 -5.2 47.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
51.04 -4.8 46.26 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.92 -3.0 10.93 ± 5% perf-profile.calltrace.cycles-pp.udp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
10.27 -2.9 7.40 ± 8% perf-profile.calltrace.cycles-pp.__skb_recv_udp.udp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
14.03 -2.9 11.17 ± 5% perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.56 -2.7 12.82 ± 4% perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.44 -2.7 12.72 ± 4% perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.31 ± 2% -2.7 5.63 ± 9% perf-profile.calltrace.cycles-pp.__udp_enqueue_schedule_skb.udp_queue_rcv_one_skb.udp_unicast_rcv_skb.__udp4_lib_rcv.ip_protocol_deliver_rcu
9.38 ± 2% -2.7 6.70 ± 7% perf-profile.calltrace.cycles-pp.udp_unicast_rcv_skb.__udp4_lib_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
9.20 ± 2% -2.6 6.58 ± 7% perf-profile.calltrace.cycles-pp.udp_queue_rcv_one_skb.udp_unicast_rcv_skb.__udp4_lib_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
10.16 ± 2% -2.6 7.60 ± 5% perf-profile.calltrace.cycles-pp.__udp4_lib_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
7.72 ± 2% -2.5 5.22 ± 9% perf-profile.calltrace.cycles-pp.sock_def_readable.__udp_enqueue_schedule_skb.udp_queue_rcv_one_skb.udp_unicast_rcv_skb.__udp4_lib_rcv
10.36 ± 2% -2.5 7.86 ± 5% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
10.40 ± 2% -2.4 7.97 ± 5% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
13.53 -2.4 11.14 ± 2% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
18.09 -2.4 15.71 perf-profile.calltrace.cycles-pp.ip_output.ip_send_skb.udp_send_skb.udp_sendmsg.sock_sendmsg
10.51 ± 2% -2.4 8.16 ± 5% perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
13.77 -2.3 11.43 ± 2% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
14.10 -2.3 11.75 ± 2% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.ip_send_skb
12.60 -2.3 10.25 ± 2% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq
13.66 -2.3 11.31 ± 2% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
14.18 -2.3 11.85 ± 2% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.ip_send_skb.udp_send_skb
18.36 -2.3 16.04 perf-profile.calltrace.cycles-pp.ip_send_skb.udp_send_skb.udp_sendmsg.sock_sendmsg.__sys_sendto
10.98 -2.3 8.66 ± 4% perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
7.38 ± 2% -2.3 5.07 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.__udp_enqueue_schedule_skb.udp_queue_rcv_one_skb.udp_unicast_rcv_skb
18.66 -2.3 16.37 perf-profile.calltrace.cycles-pp.udp_send_skb.udp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
17.01 -2.2 14.77 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.ip_send_skb.udp_send_skb.udp_sendmsg
12.17 -2.2 9.93 ± 2% perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
11.58 -2.2 9.38 ± 2% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack
34.07 ± 2% -2.1 32.01 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.85 ± 2% -2.1 4.79 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.__udp_enqueue_schedule_skb.udp_queue_rcv_one_skb
35.12 ± 2% -2.0 33.08 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.58 ± 2% -2.0 4.54 ± 9% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable
8.38 -2.0 6.36 ± 6% perf-profile.calltrace.cycles-pp.__skb_wait_for_more_packets.__skb_recv_udp.udp_recvmsg.inet_recvmsg.__sys_recvfrom
34.97 ± 2% -2.0 32.97 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.67 ± 2% -2.0 4.68 ± 8% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable.__udp_enqueue_schedule_skb
33.50 ± 2% -2.0 31.52 perf-profile.calltrace.cycles-pp.udp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64
4.70 -1.7 3.02 ± 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
4.54 -1.7 2.87 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
7.19 -1.5 5.70 ± 5% perf-profile.calltrace.cycles-pp.schedule_timeout.__skb_wait_for_more_packets.__skb_recv_udp.udp_recvmsg.inet_recvmsg
7.04 -1.5 5.56 ± 5% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.__skb_wait_for_more_packets.__skb_recv_udp.udp_recvmsg
6.59 -1.3 5.32 ± 5% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.__skb_wait_for_more_packets.__skb_recv_udp
3.42 ± 2% -1.2 2.26 ± 10% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
3.47 ± 2% -1.1 2.38 ± 10% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
2.86 ± 2% -1.0 1.89 ± 11% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
2.24 -0.8 1.46 ± 11% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry
3.41 -0.7 2.69 ± 7% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.__skb_wait_for_more_packets
1.64 -0.7 0.97 ± 13% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle
1.01 ± 2% -0.6 0.44 ± 60% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
2.92 ± 2% -0.6 2.35 ± 6% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout
0.84 -0.4 0.41 ± 58% perf-profile.calltrace.cycles-pp.update_load_avg.set_next_entity.pick_next_task_fair.__schedule.schedule_idle
2.30 -0.4 1.94 ± 2% perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.__ip_append_data.ip_make_skb.udp_sendmsg.sock_sendmsg
1.66 -0.3 1.31 ± 2% perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.__ip_append_data.ip_make_skb
0.73 -0.3 0.40 ± 58% perf-profile.calltrace.cycles-pp._copy_to_iter.udp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
3.57 -0.3 3.26 perf-profile.calltrace.cycles-pp.__ip_append_data.ip_make_skb.udp_sendmsg.sock_sendmsg.__sys_sendto
0.93 -0.3 0.65 ± 10% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule
1.18 ± 2% -0.2 0.96 ± 4% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.61 ± 2% -0.2 0.41 ± 58% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
1.74 -0.2 1.54 perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.__ip_append_data.ip_make_skb.udp_sendmsg
0.86 -0.2 0.69 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_idle_exit.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.63 -0.2 1.47 ± 3% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.95 ± 2% -0.2 0.80 perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.96 ± 2% -0.1 0.81 ± 3% perf-profile.calltrace.cycles-pp.__consume_stateless_skb.udp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
1.10 -0.1 1.01 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
1.46 ± 2% -0.1 1.37 perf-profile.calltrace.cycles-pp.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output
0.61 ± 5% -0.1 0.56 ± 4% perf-profile.calltrace.cycles-pp.fib_table_lookup.ip_route_output_key_hash_rcu.ip_route_output_key_hash.ip_route_output_flow.udp_sendmsg
0.52 +0.0 0.56 perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.57 ± 2% +0.1 0.65 ± 4% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.__ip_append_data
0.53 ± 3% +0.2 0.70 ± 8% perf-profile.calltrace.cycles-pp.netif_rx.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2
0.42 ± 53% +0.3 0.67 ± 8% perf-profile.calltrace.cycles-pp.netif_rx_internal.netif_rx.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit
1.12 ± 2% +0.3 1.42 ± 14% perf-profile.calltrace.cycles-pp.ip_route_output_key_hash_rcu.ip_route_output_key_hash.ip_route_output_flow.udp_sendmsg.sock_sendmsg
1.26 ± 2% +0.3 1.56 ± 12% perf-profile.calltrace.cycles-pp.ip_route_output_key_hash.ip_route_output_flow.udp_sendmsg.sock_sendmsg.__sys_sendto
0.17 ±141% +0.4 0.54 ± 3% perf-profile.calltrace.cycles-pp.__udp4_lib_lookup.__udp4_lib_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
1.29 ± 2% +0.4 1.68 ± 13% perf-profile.calltrace.cycles-pp.ip_route_output_flow.udp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
0.00 +0.7 0.75 ± 5% perf-profile.calltrace.cycles-pp.rcu_dynticks_eqs_enter.rcu_eqs_enter.cpuidle_enter_state.cpuidle_enter.do_idle
0.00 +0.8 0.82 ± 5% perf-profile.calltrace.cycles-pp.rcu_eqs_enter.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
2.98 ± 10% +3.8 6.78 ± 5% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
45.24 +5.0 50.29 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
45.32 +5.1 50.38 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
45.30 +5.1 50.37 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
45.57 +5.1 50.67 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
3.46 ± 6% +13.5 17.01 ± 13% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
29.83 -17.7 12.17 ± 17% perf-profile.children.cycles-pp.intel_idle
34.37 -6.4 27.98 ± 3% perf-profile.children.cycles-pp.cpuidle_enter_state
34.39 -6.4 28.01 ± 3% perf-profile.children.cycles-pp.cpuidle_enter
52.24 -5.2 47.03 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
51.07 -4.8 46.29 perf-profile.children.cycles-pp.do_syscall_64
11.30 -3.0 8.31 ± 7% perf-profile.children.cycles-pp.__schedule
13.93 -3.0 10.95 ± 5% perf-profile.children.cycles-pp.udp_recvmsg
10.29 -2.9 7.44 ± 8% perf-profile.children.cycles-pp.__skb_recv_udp
14.03 -2.8 11.19 ± 5% perf-profile.children.cycles-pp.inet_recvmsg
15.58 -2.7 12.83 ± 4% perf-profile.children.cycles-pp.__x64_sys_recvfrom
15.46 -2.7 12.74 ± 4% perf-profile.children.cycles-pp.__sys_recvfrom
8.32 ± 2% -2.7 5.63 ± 9% perf-profile.children.cycles-pp.__udp_enqueue_schedule_skb
9.39 ± 2% -2.7 6.71 ± 7% perf-profile.children.cycles-pp.udp_unicast_rcv_skb
9.22 ± 2% -2.6 6.61 ± 7% perf-profile.children.cycles-pp.udp_queue_rcv_one_skb
10.17 ± 2% -2.6 7.62 ± 5% perf-profile.children.cycles-pp.__udp4_lib_rcv
7.73 ± 2% -2.5 5.22 ± 9% perf-profile.children.cycles-pp.sock_def_readable
10.37 ± 2% -2.5 7.88 ± 5% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu
10.40 ± 2% -2.4 7.98 ± 5% perf-profile.children.cycles-pp.ip_local_deliver_finish
18.11 -2.4 15.71 perf-profile.children.cycles-pp.ip_output
14.29 -2.4 11.90 ± 2% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
10.52 ± 2% -2.4 8.16 ± 5% perf-profile.children.cycles-pp.ip_local_deliver
13.66 -2.3 11.32 ± 2% perf-profile.children.cycles-pp.__softirqentry_text_start
14.11 -2.3 11.77 ± 2% perf-profile.children.cycles-pp.do_softirq
18.37 -2.3 16.04 perf-profile.children.cycles-pp.ip_send_skb
10.99 -2.3 8.68 ± 4% perf-profile.children.cycles-pp.ip_rcv
7.38 ± 2% -2.3 5.07 ± 8% perf-profile.children.cycles-pp.__wake_up_common_lock
13.90 -2.3 11.60 ± 2% perf-profile.children.cycles-pp.do_softirq_own_stack
12.61 -2.3 10.31 ± 2% perf-profile.children.cycles-pp.net_rx_action
14.32 -2.3 12.03 ± 2% perf-profile.children.cycles-pp.__local_bh_enable_ip
18.66 -2.3 16.38 perf-profile.children.cycles-pp.udp_send_skb
17.01 -2.2 14.78 perf-profile.children.cycles-pp.ip_finish_output2
12.18 -2.2 9.95 ± 2% perf-profile.children.cycles-pp.process_backlog
11.59 -2.2 9.38 ± 2% perf-profile.children.cycles-pp.__netif_receive_skb_one_core
34.08 ± 2% -2.1 32.01 perf-profile.children.cycles-pp.sock_sendmsg
6.85 ± 2% -2.1 4.79 ± 8% perf-profile.children.cycles-pp.__wake_up_common
35.15 ± 2% -2.1 33.10 perf-profile.children.cycles-pp.__x64_sys_sendto
6.59 ± 2% -2.0 4.56 ± 9% perf-profile.children.cycles-pp.try_to_wake_up
8.39 -2.0 6.36 ± 6% perf-profile.children.cycles-pp.__skb_wait_for_more_packets
34.98 ± 2% -2.0 32.98 perf-profile.children.cycles-pp.__sys_sendto
33.54 ± 2% -2.0 31.54 perf-profile.children.cycles-pp.udp_sendmsg
6.68 ± 2% -2.0 4.68 ± 8% perf-profile.children.cycles-pp.autoremove_wake_function
4.74 -1.7 3.04 ± 11% perf-profile.children.cycles-pp.schedule_idle
7.20 -1.5 5.70 ± 5% perf-profile.children.cycles-pp.schedule_timeout
7.05 -1.5 5.57 ± 5% perf-profile.children.cycles-pp.schedule
3.43 ± 2% -1.2 2.27 ± 10% perf-profile.children.cycles-pp.enqueue_task_fair
3.47 ± 2% -1.1 2.38 ± 10% perf-profile.children.cycles-pp.ttwu_do_activate
2.88 -1.1 1.80 ± 13% perf-profile.children.cycles-pp.update_load_avg
2.89 ± 2% -1.0 1.92 ± 11% perf-profile.children.cycles-pp.enqueue_entity
1.69 ± 2% -0.8 0.89 ± 21% perf-profile.children.cycles-pp._raw_spin_lock
1.59 ± 2% -0.8 0.81 ± 23% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
3.41 -0.7 2.70 ± 7% perf-profile.children.cycles-pp.dequeue_task_fair
1.67 -0.7 1.02 ± 13% perf-profile.children.cycles-pp.set_next_entity
1.24 ± 2% -0.6 0.60 ± 20% perf-profile.children.cycles-pp.update_rq_clock
2.46 -0.6 1.85 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair
2.93 ± 2% -0.6 2.37 ± 6% perf-profile.children.cycles-pp.dequeue_entity
0.83 ±140% -0.4 0.39 ± 3% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.90 ± 2% -0.4 0.48 ± 17% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
2.30 -0.4 1.94 ± 2% perf-profile.children.cycles-pp.sock_alloc_send_pskb
0.54 ± 2% -0.3 0.21 ± 35% perf-profile.children.cycles-pp.udp_rmem_release
3.57 -0.3 3.26 perf-profile.children.cycles-pp.__ip_append_data
0.46 ± 2% -0.3 0.17 ± 27% perf-profile.children.cycles-pp.__ksize
0.65 ± 2% -0.3 0.37 ± 16% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.37 -0.3 0.12 ± 43% perf-profile.children.cycles-pp.nr_iowait_cpu
1.66 -0.3 1.41 perf-profile.children.cycles-pp.__alloc_skb
0.60 ± 3% -0.3 0.35 ± 11% perf-profile.children.cycles-pp.select_idle_sibling
0.38 -0.3 0.13 ± 36% perf-profile.children.cycles-pp.update_ts_time_stats
0.58 ± 3% -0.2 0.33 ± 21% perf-profile.children.cycles-pp.prepare_to_wait_exclusive
0.37 ± 2% -0.2 0.12 ± 32% perf-profile.children.cycles-pp.cpus_share_cache
0.65 ± 4% -0.2 0.41 ± 14% perf-profile.children.cycles-pp.sock_wfree
0.36 ± 2% -0.2 0.12 ± 38% perf-profile.children.cycles-pp.place_entity
0.42 ± 3% -0.2 0.18 ± 29% perf-profile.children.cycles-pp.sock_def_write_space
0.49 ± 2% -0.2 0.26 ± 20% perf-profile.children.cycles-pp.copyout
0.74 -0.2 0.52 ± 9% perf-profile.children.cycles-pp._copy_to_iter
1.74 -0.2 1.55 perf-profile.children.cycles-pp.alloc_skb_with_frags
0.37 ± 4% -0.2 0.18 ± 28% perf-profile.children.cycles-pp.skb_set_owner_w
1.26 ± 2% -0.2 1.08 ± 3% perf-profile.children.cycles-pp.update_curr
0.62 ± 2% -0.2 0.45 ± 9% perf-profile.children.cycles-pp.__update_load_avg_se
0.42 ± 3% -0.2 0.25 ± 10% perf-profile.children.cycles-pp.skb_release_data
1.64 -0.2 1.48 ± 3% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.47 -0.2 0.31 ± 3% perf-profile.children.cycles-pp.ip_finish_output
0.41 -0.2 0.25 ± 12% perf-profile.children.cycles-pp.pick_next_entity
0.36 ± 3% -0.2 0.21 ± 15% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.88 -0.1 0.73 ± 5% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.60 ± 2% -0.1 0.45 ± 4% perf-profile.children.cycles-pp.__slab_free
0.95 ± 2% -0.1 0.81 perf-profile.children.cycles-pp.select_task_rq_fair
0.96 -0.1 0.82 ± 3% perf-profile.children.cycles-pp.__consume_stateless_skb
0.58 ± 2% -0.1 0.46 ± 2% perf-profile.children.cycles-pp.hrtimer_interrupt
0.59 -0.1 0.47 ± 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.19 ± 2% -0.1 0.09 ± 21% perf-profile.children.cycles-pp.__list_del_entry_valid
1.12 -0.1 1.02 ± 2% perf-profile.children.cycles-pp.tick_nohz_next_event
0.68 ± 6% -0.1 0.59 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_bh
1.46 ± 2% -0.1 1.38 ± 2% perf-profile.children.cycles-pp.loopback_xmit
0.56 ± 4% -0.1 0.48 ± 2% perf-profile.children.cycles-pp.___perf_sw_event
0.62 ± 2% -0.1 0.54 ± 6% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.37 -0.1 0.29 ± 9% perf-profile.children.cycles-pp.reweight_entity
0.83 ± 2% -0.1 0.76 perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.29 ± 2% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.rcu_idle_exit
0.46 ± 3% -0.1 0.39 ± 5% perf-profile.children.cycles-pp.__cgroup_bpf_run_filter_skb
0.37 -0.1 0.30 ± 3% perf-profile.children.cycles-pp._copy_from_iter_full
0.09 -0.1 0.03 ±100% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.30 ± 2% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.resched_curr
0.10 ± 10% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.16 ± 3% -0.1 0.10 ± 10% perf-profile.children.cycles-pp.clockevents_program_event
0.44 ± 2% -0.1 0.39 ± 4% perf-profile.children.cycles-pp.finish_task_switch
0.29 -0.1 0.23 perf-profile.children.cycles-pp.ip_setup_cork
0.12 ± 5% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.61 ± 5% -0.1 0.56 ± 3% perf-profile.children.cycles-pp.fib_table_lookup
0.20 ± 9% -0.1 0.15 ± 11% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.10 ± 4% -0.0 0.05 perf-profile.children.cycles-pp.rcu_needs_cpu
0.18 ± 5% -0.0 0.13 ± 14% perf-profile.children.cycles-pp.available_idle_cpu
0.18 ± 4% -0.0 0.14 ± 8% perf-profile.children.cycles-pp.rcu_eqs_exit
0.07 ± 4% -0.0 0.03 ±100% perf-profile.children.cycles-pp.inet_sendmsg
0.15 ± 4% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.nf_hook_slow
0.17 ± 2% -0.0 0.13 perf-profile.children.cycles-pp.copyin
0.11 ± 4% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.menu_reflect
0.13 ± 2% -0.0 0.10 ± 9% perf-profile.children.cycles-pp.ip_rcv_finish_core
0.20 ± 2% -0.0 0.17 ± 2% perf-profile.children.cycles-pp.ipv4_pktinfo_prepare
0.22 -0.0 0.18 ± 6% perf-profile.children.cycles-pp.tick_sched_timer
0.29 ± 2% -0.0 0.26 ± 4% perf-profile.children.cycles-pp.security_socket_sendmsg
0.45 -0.0 0.42 ± 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.09 ± 12% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.10 ± 11% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.45 -0.0 0.42 ± 2% perf-profile.children.cycles-pp.irqtime_account_irq
0.22 ± 2% -0.0 0.19 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.18 ± 3% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.update_min_vruntime
0.10 ± 7% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.41 ± 2% -0.0 0.38 ± 3% perf-profile.children.cycles-pp.__might_fault
0.24 -0.0 0.22 ± 5% perf-profile.children.cycles-pp.siphash_3u32
0.22 ± 3% -0.0 0.20 ± 3% perf-profile.children.cycles-pp.__ip_finish_output
0.09 ± 5% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.scheduler_tick
0.08 ± 5% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.update_irq_load_avg
0.22 ± 4% +0.0 0.23 ± 2% perf-profile.children.cycles-pp.security_socket_recvmsg
0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.rcu_note_context_switch
0.15 ± 3% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.call_cpuidle
0.26 ± 2% +0.0 0.28 ± 2% perf-profile.children.cycles-pp.move_addr_to_kernel
0.12 ± 3% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.ksoftirqd_running
0.07 ± 6% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.validate_xmit_xfrm
0.06 ± 7% +0.0 0.08 ± 8% perf-profile.children.cycles-pp.__enqueue_entity
0.12 ± 3% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.rcu_read_unlock_strict
0.12 ± 3% +0.0 0.15 ± 4% perf-profile.children.cycles-pp._cond_resched
0.18 ± 5% +0.0 0.21 ± 8% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.24 ± 4% +0.0 0.27 ± 4% perf-profile.children.cycles-pp.sock_recvmsg
0.10 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.kmalloc_slab
0.16 ± 4% +0.0 0.19 ± 3% perf-profile.children.cycles-pp.ip_rcv_core
0.22 ± 2% +0.0 0.25 ± 5% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.29 +0.0 0.32 ± 4% perf-profile.children.cycles-pp.__might_sleep
0.07 ± 7% +0.0 0.10 ± 4% perf-profile.children.cycles-pp._raw_spin_trylock
0.14 ± 2% +0.0 0.18 ± 12% perf-profile.children.cycles-pp.__ip_local_out
0.09 ± 5% +0.0 0.12 perf-profile.children.cycles-pp.rebalance_domains
0.37 ± 2% +0.0 0.40 perf-profile.children.cycles-pp.__fget_light
0.10 ± 5% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.put_prev_entity
0.08 ± 6% +0.0 0.12 ± 9% perf-profile.children.cycles-pp.security_sock_rcv_skb
0.17 ± 2% +0.0 0.20 ± 5% perf-profile.children.cycles-pp.__entry_text_start
0.25 ± 17% +0.0 0.29 ± 4% perf-profile.children.cycles-pp.start_kernel
0.07 ± 13% +0.0 0.11 perf-profile.children.cycles-pp.raw_local_deliver
0.19 ± 3% +0.0 0.23 perf-profile.children.cycles-pp.put_prev_task_fair
0.53 +0.0 0.57 perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.04 ± 54% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.rb_erase
0.06 ± 5% +0.0 0.11 ± 10% perf-profile.children.cycles-pp.check_stack_object
0.21 ± 3% +0.0 0.26 ± 4% perf-profile.children.cycles-pp.__check_heap_object
0.05 ± 57% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.skb_consume_udp
0.00 +0.1 0.05 perf-profile.children.cycles-pp._raw_spin_unlock_bh
0.17 ± 6% +0.1 0.22 ± 3% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.security_sk_classify_flow
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.udp4_hwcsum
0.54 +0.1 0.59 ± 4% perf-profile.children.cycles-pp.sockfd_lookup_light
0.42 +0.1 0.47 ± 4% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.48 ± 5% +0.1 0.54 ± 3% perf-profile.children.cycles-pp.__udp4_lib_lookup
0.16 ± 4% +0.1 0.23 ± 16% perf-profile.children.cycles-pp.set_next_task_idle
0.14 ± 4% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.__update_idle_core
0.05 ± 9% +0.1 0.12 ± 9% perf-profile.children.cycles-pp.__kfree_skb_flush
0.38 ± 7% +0.1 0.44 ± 2% perf-profile.children.cycles-pp.lock_sock_nested
0.16 ± 3% +0.1 0.23 ± 11% perf-profile.children.cycles-pp.ip_local_out
0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.clear_buddies
0.15 ± 6% +0.1 0.22 ± 6% perf-profile.children.cycles-pp.irq_exit_rcu
0.13 ± 3% +0.1 0.20 ± 7% perf-profile.children.cycles-pp.ip4_datagram_release_cb
0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.apparmor_socket_sock_rcv_skb
0.58 ± 2% +0.1 0.66 ± 4% perf-profile.children.cycles-pp.__kmalloc_reserve
0.15 ± 5% +0.1 0.23 ± 13% perf-profile.children.cycles-pp.xfrm_lookup_route
0.23 ± 9% +0.1 0.31 ± 3% perf-profile.children.cycles-pp.ktime_get_with_offset
0.12 ± 5% +0.1 0.20 ± 13% perf-profile.children.cycles-pp.xfrm_lookup_with_ifid
0.14 ± 6% +0.1 0.24 ± 10% perf-profile.children.cycles-pp.newidle_balance
0.27 ± 3% +0.1 0.37 ± 12% perf-profile.children.cycles-pp.pick_next_task_idle
0.15 ± 4% +0.1 0.25 ± 3% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.20 ± 3% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.__virt_addr_valid
0.13 ± 5% +0.1 0.25 ± 8% perf-profile.children.cycles-pp.kfree
0.00 +0.1 0.13 ± 20% perf-profile.children.cycles-pp.native_irq_return_iret
0.53 ± 3% +0.1 0.67 ± 8% perf-profile.children.cycles-pp.netif_rx_internal
0.54 ± 3% +0.2 0.71 ± 7% perf-profile.children.cycles-pp.netif_rx
0.26 ± 5% +0.2 0.44 ± 9% perf-profile.children.cycles-pp.sk_filter_trim_cap
0.67 +0.3 0.92 ± 3% perf-profile.children.cycles-pp.__check_object_size
1.26 ± 2% +0.3 1.56 ± 12% perf-profile.children.cycles-pp.ip_route_output_key_hash
1.13 ± 2% +0.3 1.44 ± 14% perf-profile.children.cycles-pp.ip_route_output_key_hash_rcu
0.00 +0.4 0.37 ± 26% perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
1.30 +0.4 1.68 ± 13% perf-profile.children.cycles-pp.ip_route_output_flow
0.25 ± 5% +0.6 0.82 ± 5% perf-profile.children.cycles-pp.rcu_eqs_enter
0.17 ± 10% +0.6 0.76 ± 5% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
3.00 ± 10% +3.9 6.88 ± 5% perf-profile.children.cycles-pp.poll_idle
45.32 +5.1 50.38 perf-profile.children.cycles-pp.start_secondary
45.52 +5.1 50.61 perf-profile.children.cycles-pp.do_idle
45.57 +5.1 50.67 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
45.57 +5.1 50.67 perf-profile.children.cycles-pp.cpu_startup_entry
3.49 ± 6% +13.6 17.12 ± 13% perf-profile.children.cycles-pp.menu_select
29.82 -17.7 12.17 ± 17% perf-profile.self.cycles-pp.intel_idle
2.30 -1.2 1.15 ± 17% perf-profile.self.cycles-pp.__schedule
1.66 ± 2% -0.8 0.87 ± 21% perf-profile.self.cycles-pp._raw_spin_lock
1.58 ± 2% -0.8 0.80 ± 24% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.95 ± 2% -0.6 0.30 ± 39% perf-profile.self.cycles-pp.update_rq_clock
1.43 ± 2% -0.5 0.89 ± 14% perf-profile.self.cycles-pp.update_load_avg
0.61 ±191% -0.5 0.14 ± 5% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.88 -0.4 0.45 ± 19% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.74 -0.4 0.36 ± 22% perf-profile.self.cycles-pp.set_next_entity
0.53 ± 2% -0.3 0.20 ± 34% perf-profile.self.cycles-pp.udp_rmem_release
0.46 ± 2% -0.3 0.17 ± 27% perf-profile.self.cycles-pp.__ksize
0.85 -0.3 0.57 ± 9% perf-profile.self.cycles-pp.enqueue_entity
0.63 -0.3 0.36 ± 16% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.50 ± 2% -0.3 0.23 ± 23% perf-profile.self.cycles-pp.__skb_wait_for_more_packets
0.37 -0.3 0.11 ± 46% perf-profile.self.cycles-pp.nr_iowait_cpu
0.36 ± 2% -0.2 0.12 ± 41% perf-profile.self.cycles-pp.place_entity
0.36 ± 3% -0.2 0.12 ± 33% perf-profile.self.cycles-pp.cpus_share_cache
0.41 ± 3% -0.2 0.18 ± 28% perf-profile.self.cycles-pp.sock_def_write_space
0.60 ± 2% -0.2 0.37 ± 7% perf-profile.self.cycles-pp.__skb_recv_udp
0.39 ± 2% -0.2 0.19 ± 16% perf-profile.self.cycles-pp.schedule
0.34 ± 3% -0.2 0.14 ± 27% perf-profile.self.cycles-pp.sock_def_readable
0.37 ± 4% -0.2 0.18 ± 30% perf-profile.self.cycles-pp.skb_set_owner_w
0.77 ± 2% -0.2 0.58 ± 9% perf-profile.self.cycles-pp.do_idle
0.53 -0.2 0.34 ± 8% perf-profile.self.cycles-pp.enqueue_task_fair
0.40 ± 2% -0.2 0.21 ± 15% perf-profile.self.cycles-pp.pick_next_entity
0.67 ± 5% -0.2 0.49 ± 5% perf-profile.self.cycles-pp.udp_recvmsg
0.40 ± 3% -0.2 0.24 ± 10% perf-profile.self.cycles-pp.skb_release_data
0.46 ± 2% -0.2 0.29 ± 15% perf-profile.self.cycles-pp.dequeue_task_fair
0.48 -0.2 0.32 ± 7% perf-profile.self.cycles-pp.__udp_enqueue_schedule_skb
0.78 ± 3% -0.2 0.63 ± 6% perf-profile.self.cycles-pp.update_curr
0.60 ± 3% -0.1 0.45 ± 5% perf-profile.self.cycles-pp.__slab_free
0.57 -0.1 0.44 ± 8% perf-profile.self.cycles-pp.__update_load_avg_se
0.30 ± 4% -0.1 0.19 ± 11% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.18 ± 2% -0.1 0.08 ± 19% perf-profile.self.cycles-pp.__list_del_entry_valid
0.66 ± 7% -0.1 0.57 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_bh
0.21 ± 2% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.tick_nohz_next_event
0.36 -0.1 0.29 ± 9% perf-profile.self.cycles-pp.reweight_entity
0.14 ± 5% -0.1 0.08 ± 20% perf-profile.self.cycles-pp.__wake_up_common
0.12 ± 5% -0.1 0.05 ± 58% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.52 ± 6% -0.1 0.45 ± 2% perf-profile.self.cycles-pp.fib_table_lookup
0.39 ± 3% -0.1 0.33 ± 2% perf-profile.self.cycles-pp.udp_queue_rcv_one_skb
0.49 ± 4% -0.1 0.43 perf-profile.self.cycles-pp.___perf_sw_event
0.42 ± 3% -0.1 0.36 ± 5% perf-profile.self.cycles-pp.__cgroup_bpf_run_filter_skb
0.29 ± 2% -0.1 0.23 ± 8% perf-profile.self.cycles-pp.resched_curr
0.33 ± 2% -0.1 0.27 ± 6% perf-profile.self.cycles-pp.finish_task_switch
0.10 ± 11% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.09 ± 8% -0.1 0.03 ±100% perf-profile.self.cycles-pp.nf_hook_slow
0.11 ± 13% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.udp_unicast_rcv_skb
0.15 ± 3% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.ip_setup_cork
0.17 ± 5% -0.1 0.12 ± 16% perf-profile.self.cycles-pp.available_idle_cpu
0.15 ± 4% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.16 ± 3% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.__x64_sys_sendto
0.09 ± 5% -0.0 0.05 perf-profile.self.cycles-pp.rcu_needs_cpu
0.12 ± 4% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.ip_finish_output
0.06 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.29 ± 2% -0.0 0.25 perf-profile.self.cycles-pp.__kmalloc_node_track_caller
0.20 ± 2% -0.0 0.17 ± 5% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.13 ± 4% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.ip_rcv_finish_core
0.20 ± 2% -0.0 0.16 ± 5% perf-profile.self.cycles-pp.loopback_xmit
0.18 ± 4% -0.0 0.15 ± 3% perf-profile.self.cycles-pp.update_min_vruntime
0.07 ± 6% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.ipv4_pktinfo_prepare
0.16 ± 3% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.__ip_finish_output
0.11 ± 6% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.rcu_idle_exit
0.10 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.__might_fault
0.19 ± 2% -0.0 0.16 ± 5% perf-profile.self.cycles-pp.sock_sendmsg
0.12 ± 2% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.__x64_sys_recvfrom
0.13 ± 3% -0.0 0.11 perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.10 ± 6% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.12 ± 4% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.ip_make_skb
0.05 +0.0 0.06 perf-profile.self.cycles-pp.sched_clock
0.05 +0.0 0.06 perf-profile.self.cycles-pp.rcu_all_qs
0.11 ± 3% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.ksoftirqd_running
0.09 ± 6% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.schedule_idle
0.08 ± 5% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.update_irq_load_avg
0.12 ± 3% +0.0 0.14 ± 5% perf-profile.self.cycles-pp.sockfd_lookup_light
0.09 ± 3% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.ip_send_skb
0.13 +0.0 0.15 ± 4% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu
0.34 ± 2% +0.0 0.36 perf-profile.self.cycles-pp.___might_sleep
0.07 ± 4% +0.0 0.09 ± 8% perf-profile.self.cycles-pp.validate_xmit_xfrm
0.25 +0.0 0.28 ± 5% perf-profile.self.cycles-pp.__might_sleep
0.05 ± 7% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.__enqueue_entity
0.06 ± 5% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.cpuidle_governor_latency_req
0.06 ± 7% +0.0 0.09 ± 7% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.10 +0.0 0.13 ± 6% perf-profile.self.cycles-pp.kmalloc_slab
0.07 ± 7% +0.0 0.10 ± 5% perf-profile.self.cycles-pp._raw_spin_trylock
0.18 ± 8% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.sock_alloc_send_pskb
0.16 ± 4% +0.0 0.19 ± 2% perf-profile.self.cycles-pp.ip_rcv_core
0.22 ± 3% +0.0 0.26 perf-profile.self.cycles-pp.__udp4_lib_lookup
0.02 ±111% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.__cgroup_account_cputime
0.13 ± 3% +0.0 0.17 ± 5% perf-profile.self.cycles-pp.prepare_to_wait_exclusive
0.36 +0.0 0.39 perf-profile.self.cycles-pp.__fget_light
0.07 ± 4% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.ip_generic_getfrag
0.08 ± 5% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.put_prev_entity
0.05 ± 36% +0.0 0.08 ± 21% perf-profile.self.cycles-pp.__ip_local_out
0.03 ± 70% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.__kfree_skb_flush
0.14 ± 3% +0.0 0.17 ± 8% perf-profile.self.cycles-pp.ip_rcv
0.17 ± 2% +0.0 0.20 ± 5% perf-profile.self.cycles-pp.__entry_text_start
0.21 ± 4% +0.0 0.25 ± 3% perf-profile.self.cycles-pp.__check_object_size
0.06 ± 15% +0.0 0.10 perf-profile.self.cycles-pp.raw_local_deliver
0.05 ± 7% +0.0 0.10 ± 9% perf-profile.self.cycles-pp.check_stack_object
0.13 ± 3% +0.0 0.18 ± 6% perf-profile.self.cycles-pp.asm_call_sysvec_on_stack
0.26 ± 2% +0.0 0.31 ± 5% perf-profile.self.cycles-pp.ip_output
0.02 ±142% +0.0 0.07 ± 6% perf-profile.self.cycles-pp._copy_to_user
0.20 ± 3% +0.0 0.25 perf-profile.self.cycles-pp.__local_bh_enable_ip
0.00 +0.1 0.05 perf-profile.self.cycles-pp.security_sk_classify_flow
0.00 +0.1 0.05 perf-profile.self.cycles-pp.udp4_hwcsum
0.04 ± 73% +0.1 0.09 ± 8% perf-profile.self.cycles-pp.skb_consume_udp
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.ip_local_out
0.37 ± 3% +0.1 0.42 ± 3% perf-profile.self.cycles-pp.__ip_make_skb
0.21 ± 3% +0.1 0.26 ± 4% perf-profile.self.cycles-pp.__check_heap_object
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.copyout
0.07 ± 6% +0.1 0.13 ± 10% perf-profile.self.cycles-pp.alloc_skb_with_frags
0.42 ± 2% +0.1 0.47 ± 4% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.13 ± 6% +0.1 0.19 ± 9% perf-profile.self.cycles-pp.newidle_balance
0.08 ± 5% +0.1 0.14 ± 15% perf-profile.self.cycles-pp.pick_next_task_idle
0.08 ± 6% +0.1 0.14 ± 13% perf-profile.self.cycles-pp.select_idle_sibling
0.01 ±187% +0.1 0.08 ± 11% perf-profile.self.cycles-pp.rb_erase
0.17 ± 2% +0.1 0.24 ± 6% perf-profile.self.cycles-pp.__sys_recvfrom
0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.apparmor_socket_sock_rcv_skb
0.11 ± 3% +0.1 0.18 ± 6% perf-profile.self.cycles-pp.ip_local_deliver
0.11 ± 3% +0.1 0.18 ± 6% perf-profile.self.cycles-pp.ip4_datagram_release_cb
0.00 +0.1 0.07 perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.01 ±282% +0.1 0.08 ± 5% perf-profile.self.cycles-pp.ttwu_do_activate
0.17 ± 8% +0.1 0.24 ± 5% perf-profile.self.cycles-pp.ktime_get_with_offset
0.13 ± 5% +0.1 0.20 ± 6% perf-profile.self.cycles-pp.kmem_cache_free
0.16 ± 4% +0.1 0.23 ± 9% perf-profile.self.cycles-pp.__alloc_skb
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.ttwu_do_wakeup
0.33 ± 3% +0.1 0.41 ± 8% perf-profile.self.cycles-pp.select_task_rq_fair
0.12 ± 4% +0.1 0.20 ± 13% perf-profile.self.cycles-pp.xfrm_lookup_with_ifid
0.24 ± 8% +0.1 0.33 ± 23% perf-profile.self.cycles-pp.__dev_queue_xmit
0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.ip_local_deliver_finish
0.14 ± 4% +0.1 0.24 ± 4% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.06 ± 7% +0.1 0.17 ± 15% perf-profile.self.cycles-pp.sk_filter_trim_cap
0.19 ± 3% +0.1 0.30 ± 4% perf-profile.self.cycles-pp.__virt_addr_valid
0.13 ± 5% +0.1 0.24 ± 9% perf-profile.self.cycles-pp.kfree
0.00 +0.1 0.12 ± 23% perf-profile.self.cycles-pp.ip_route_output_flow
0.00 +0.1 0.13 ± 20% perf-profile.self.cycles-pp.native_irq_return_iret
0.11 ± 7% +0.1 0.24 ± 11% perf-profile.self.cycles-pp.pick_next_task_fair
0.11 ± 10% +0.1 0.25 ± 9% perf-profile.self.cycles-pp.inet_recvmsg
0.50 ± 8% +0.3 0.84 ± 21% perf-profile.self.cycles-pp.ip_route_output_key_hash_rcu
0.17 ± 10% +0.6 0.76 ± 5% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
2.83 ± 11% +3.8 6.58 ± 5% perf-profile.self.cycles-pp.poll_idle
0.53 ± 20% +6.9 7.42 ± 15% perf-profile.self.cycles-pp.cpuidle_enter_state
1.60 ± 12% +13.8 15.36 ± 15% perf-profile.self.cycles-pp.menu_select
netperf.Throughput_tps
70000 +-------------------------------------------------------------------+
65000 |-+.++.+.+.+.++ + +.+ +.+.+ +.+.+.+.++.+.+ +.+.+.+.++.+.|
| |
60000 |-+ O O O O |
55000 |-+ O |
| |
50000 |-+ O O O |
45000 |-+ O O |
40000 |-O O |
| O O O O |
35000 |-+ |
30000 |-+ O O |
| O O |
25000 |-+ O |
20000 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2ap4: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
gcc-9/performance/pipe/4/x86_64-rhel-8.3/threads/100%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap4/hackbench/0x5003003
commit:
v5.10-rc4
8d86968ac3 ("sched/fair: select idle cpu from idle cpumask for task wakeup")
v5.10-rc4 8d86968ac36ea5bff487f70b5ff
---------------- ---------------------------
%stddev %change %stddev
\ | \
572871 ± 3% +51.7% 869183 hackbench.throughput
164.05 ± 2% -32.1% 111.38 ± 2% hackbench.time.elapsed_time
164.05 ± 2% -32.1% 111.38 ± 2% hackbench.time.elapsed_time.max
1.817e+09 ± 2% -22.3% 1.411e+09 hackbench.time.involuntary_context_switches
1323 ± 17% -42.0% 767.50 ± 18% hackbench.time.major_page_faults
513216 ± 8% -60.3% 203595 ± 7% hackbench.time.minor_page_faults
18525 -1.3% 18278 hackbench.time.percent_of_cpu_this_job_got
28532 ± 2% -34.9% 18561 ± 2% hackbench.time.system_time
1860 -3.3% 1798 hackbench.time.user_time
2.856e+09 ± 2% -26.7% 2.094e+09 hackbench.time.voluntary_context_switches
199.54 ± 2% -26.2% 147.24 ± 2% uptime.boot
89.62 -4.6% 85.50 vmstat.cpu.sy
27980099 +10.3% 30870803 ± 2% vmstat.system.cs
1916677 -24.1% 1453990 ± 2% vmstat.system.in
10676879 ± 10% +17.6% 12555262 ± 6% cpuidle.C1.usage
2629890 ± 16% +51.0% 3971486 cpuidle.C1E.usage
9177750 ± 11% +318.5% 38407578 ± 8% cpuidle.POLL.time
3649369 ± 11% +415.0% 18792454 ± 9% cpuidle.POLL.usage
2.76 ± 9% +1.2 4.00 ± 4% mpstat.cpu.all.idle%
1.42 ± 2% +0.2 1.66 ± 2% mpstat.cpu.all.irq%
0.04 ± 5% +0.0 0.06 ± 2% mpstat.cpu.all.soft%
5.94 ± 2% +2.5 8.39 ± 2% mpstat.cpu.all.usr%
12617673 ± 21% +38.4% 17469164 ± 12% numa-numastat.node0.local_node
12639382 ± 21% +38.4% 17492395 ± 12% numa-numastat.node0.numa_hit
13323975 ± 15% +34.4% 17913328 ± 6% numa-numastat.node3.local_node
13355052 ± 15% +34.2% 17928946 ± 6% numa-numastat.node3.numa_hit
8731 ± 5% +6.8% 9327 ± 2% slabinfo.Acpi-State.active_objs
8731 ± 5% +6.8% 9327 ± 2% slabinfo.Acpi-State.num_objs
21715 -13.6% 18772 ± 3% slabinfo.kmalloc-256.active_objs
21771 -13.3% 18873 ± 2% slabinfo.kmalloc-256.num_objs
54258 ± 10% -92.9% 3853 ± 13% meminfo.Active
54258 ± 10% -92.9% 3853 ± 13% meminfo.Active(anon)
135989 -24.6% 102492 ± 7% meminfo.AnonHugePages
55308 ± 3% -41.3% 32484 ± 2% meminfo.Mapped
5930 ± 2% +9.6% 6497 ± 3% meminfo.PageTables
82739 ± 8% -80.8% 15878 ± 6% meminfo.Shmem
25620 ± 3% +42.8% 36576 ± 6% meminfo.max_used_kB
11018 ± 16% -39.4% 6674 ± 4% numa-meminfo.node0.Mapped
12131 ± 18% -43.5% 6851 ± 5% numa-meminfo.node2.Mapped
49284 ± 23% -96.9% 1534 ±104% numa-meminfo.node3.Active
49284 ± 23% -96.9% 1534 ±104% numa-meminfo.node3.Active(anon)
294918 ± 4% -16.1% 247401 ± 8% numa-meminfo.node3.FilePages
19066 ± 15% -56.3% 8326 ± 29% numa-meminfo.node3.Mapped
68214 ± 21% -92.6% 5078 ± 91% numa-meminfo.node3.Shmem
2797 ± 15% -39.3% 1697 ± 7% numa-vmstat.node0.nr_mapped
3047 ± 19% -41.8% 1773 ± 7% numa-vmstat.node2.nr_mapped
77617 ± 35% +43.0% 110999 numa-vmstat.node2.numa_other
12118 ± 22% -96.8% 382.00 ±104% numa-vmstat.node3.nr_active_anon
73570 ± 3% -15.9% 61852 ± 8% numa-vmstat.node3.nr_file_pages
4888 ± 19% -57.4% 2082 ± 29% numa-vmstat.node3.nr_mapped
16894 ± 20% -92.5% 1271 ± 91% numa-vmstat.node3.nr_shmem
12118 ± 22% -96.8% 382.00 ±104% numa-vmstat.node3.nr_zone_active_anon
7440822 ± 16% +34.7% 10020536 ± 7% numa-vmstat.node3.numa_hit
7333100 ± 17% +35.7% 9954413 ± 7% numa-vmstat.node3.numa_local
13240 ± 11% -92.7% 960.00 ± 13% proc-vmstat.nr_active_anon
82428 +4.4% 86092 proc-vmstat.nr_anon_pages
253193 -3.4% 244488 proc-vmstat.nr_file_pages
129244 +1.7% 131385 proc-vmstat.nr_kernel_stack
13899 ± 2% -40.7% 8248 ± 2% proc-vmstat.nr_mapped
1482 ± 2% +11.6% 1654 ± 3% proc-vmstat.nr_page_table_pages
20307 ± 8% -80.4% 3974 ± 6% proc-vmstat.nr_shmem
232911 +3.3% 240524 proc-vmstat.nr_unevictable
13240 ± 11% -92.7% 960.00 ± 13% proc-vmstat.nr_zone_active_anon
232911 +3.3% 240524 proc-vmstat.nr_zone_unevictable
425103 ± 10% -71.9% 119596 ± 17% proc-vmstat.numa_hint_faults
349617 ± 11% -83.7% 56946 ± 24% proc-vmstat.numa_hint_faults_local
55991641 ± 4% +24.5% 69695914 proc-vmstat.numa_hit
55898341 ± 4% +24.5% 69602609 proc-vmstat.numa_local
523298 ± 10% -65.7% 179518 ± 26% proc-vmstat.numa_pte_updates
55330 ± 7% -99.2% 459.00 ± 11% proc-vmstat.pgactivate
56176549 ± 4% +24.4% 69873586 proc-vmstat.pgalloc_normal
1092076 ± 4% -44.8% 602975 ± 6% proc-vmstat.pgfault
56227641 ± 4% +24.3% 69892824 proc-vmstat.pgfree
30412 ± 2% -26.9% 22235 ± 2% proc-vmstat.pgreuse
5815 ± 16% -37.0% 3665 ± 21% sched_debug.cfs_rq:/.load.avg
11898206 -53.4% 5543777 ± 2% sched_debug.cfs_rq:/.min_vruntime.avg
13497261 ± 2% -51.6% 6535378 ± 4% sched_debug.cfs_rq:/.min_vruntime.max
10447952 ± 2% -54.8% 4722727 ± 4% sched_debug.cfs_rq:/.min_vruntime.min
682890 ± 16% -43.9% 383185 ± 24% sched_debug.cfs_rq:/.min_vruntime.stddev
0.65 ± 8% -39.0% 0.40 ± 51% sched_debug.cfs_rq:/.nr_running.avg
662547 ± 15% -42.1% 383420 ± 22% sched_debug.cfs_rq:/.spread0.stddev
320.13 ± 16% -52.4% 152.33 ± 52% sched_debug.cfs_rq:/.util_est_enqueued.avg
181.35 ± 5% -19.0% 146.91 ± 20% sched_debug.cfs_rq:/.util_est_enqueued.stddev
318910 ± 5% +77.3% 565341 ± 9% sched_debug.cpu.avg_idle.avg
150913 ± 33% +105.1% 309571 ± 19% sched_debug.cpu.avg_idle.stddev
96499 -32.1% 65475 sched_debug.cpu.clock.avg
97014 ± 2% -32.2% 65740 sched_debug.cpu.clock.max
95518 -32.2% 64800 sched_debug.cpu.clock.min
95508 -32.1% 64822 sched_debug.cpu.clock_task.avg
96186 ± 2% -32.2% 65234 sched_debug.cpu.clock_task.max
86092 -34.9% 56017 sched_debug.cpu.clock_task.min
18465 ± 6% -19.4% 14885 ± 11% sched_debug.cpu.curr->pid.max
9251180 ± 2% -46.6% 4937756 ± 4% sched_debug.cpu.nr_switches.avg
10542199 ± 3% -44.8% 5822427 ± 4% sched_debug.cpu.nr_switches.max
8110905 ± 2% -47.2% 4284323 ± 7% sched_debug.cpu.nr_switches.min
483044 ± 14% -42.8% 276136 ± 18% sched_debug.cpu.nr_switches.stddev
95500 -32.2% 64757 sched_debug.cpu_clk
94626 -32.5% 63883 sched_debug.ktime
95873 -32.1% 65124 sched_debug.sched_clk
10.23 -38.8% 6.27 ± 3% perf-stat.i.MPKI
5.548e+10 +23.0% 6.825e+10 ± 2% perf-stat.i.branch-instructions
1.15 -0.1 1.08 perf-stat.i.branch-miss-rate%
6.022e+08 +11.9% 6.739e+08 ± 2% perf-stat.i.branch-misses
4.20 ± 4% +13.2 17.43 ± 3% perf-stat.i.cache-miss-rate%
1.025e+08 ± 5% +167.5% 2.743e+08 ± 3% perf-stat.i.cache-misses
2.568e+09 -35.5% 1.657e+09 perf-stat.i.cache-references
28334089 +10.1% 31190600 ± 2% perf-stat.i.context-switches
2.40 ± 2% -14.7% 2.05 ± 4% perf-stat.i.cpi
5.767e+11 -2.9% 5.599e+11 perf-stat.i.cpu-cycles
2916124 ± 2% -45.6% 1584932 ± 6% perf-stat.i.cpu-migrations
6909 ± 6% -64.8% 2435 ± 8% perf-stat.i.cycles-between-cache-misses
0.01 ± 9% -0.0 0.00 ± 12% perf-stat.i.dTLB-load-miss-rate%
4382174 ± 4% -29.0% 3113515 ± 8% perf-stat.i.dTLB-load-misses
7.717e+10 +24.7% 9.62e+10 ± 2% perf-stat.i.dTLB-loads
375709 ± 2% -17.2% 311193 ± 3% perf-stat.i.dTLB-store-misses
4.567e+10 +26.3% 5.768e+10 ± 2% perf-stat.i.dTLB-stores
3.502e+08 ± 3% +15.1% 4.031e+08 ± 3% perf-stat.i.iTLB-load-misses
2.65e+11 +23.0% 3.26e+11 ± 2% perf-stat.i.instructions
768.32 ± 2% +6.3% 816.80 perf-stat.i.instructions-per-iTLB-miss
0.46 +26.3% 0.58 ± 3% perf-stat.i.ipc
3.00 -2.9% 2.91 perf-stat.i.metric.GHz
0.13 ± 13% +180.5% 0.36 ± 32% perf-stat.i.metric.K/sec
942.12 +23.9% 1167 ± 2% perf-stat.i.metric.M/sec
6621 ± 3% -18.3% 5408 ± 4% perf-stat.i.minor-faults
89.09 +4.2 93.26 perf-stat.i.node-load-miss-rate%
27200395 ± 6% +105.6% 55915796 ± 2% perf-stat.i.node-load-misses
71.21 +12.7 83.89 perf-stat.i.node-store-miss-rate%
11769833 ± 6% +142.3% 28519715 perf-stat.i.node-store-misses
5279062 ± 8% +16.1% 6131469 ± 2% perf-stat.i.node-stores
6631 ± 3% -18.3% 5417 ± 4% perf-stat.i.page-faults
9.61 -48.9% 4.92 ± 2% perf-stat.overall.MPKI
1.08 -0.1 0.98 perf-stat.overall.branch-miss-rate%
4.02 ± 4% +13.0 17.05 ± 3% perf-stat.overall.cache-miss-rate%
2.14 ± 2% -22.0% 1.67 ± 2% perf-stat.overall.cpi
5559 ± 5% -64.1% 1998 ± 4% perf-stat.overall.cycles-between-cache-misses
0.01 ± 5% -0.0 0.00 ± 9% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 3% -0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate%
759.51 ± 2% +6.7% 810.38 perf-stat.overall.instructions-per-iTLB-miss
0.47 ± 2% +28.2% 0.60 ± 2% perf-stat.overall.ipc
89.21 +3.9 93.11 perf-stat.overall.node-load-miss-rate%
68.42 ± 2% +13.5 81.89 perf-stat.overall.node-store-miss-rate%
5.596e+10 +24.2% 6.952e+10 ± 2% perf-stat.ps.branch-instructions
6.034e+08 +12.6% 6.797e+08 ± 2% perf-stat.ps.branch-misses
1.034e+08 ± 5% +169.1% 2.782e+08 ± 3% perf-stat.ps.cache-misses
2.569e+09 -36.5% 1.631e+09 perf-stat.ps.cache-references
28329305 +10.9% 31418770 ± 2% perf-stat.ps.context-switches
5.729e+11 -3.1% 5.551e+11 perf-stat.ps.cpu-cycles
2861035 ± 2% -48.8% 1463484 ± 6% perf-stat.ps.cpu-migrations
4585673 ± 4% -35.2% 2973169 ± 8% perf-stat.ps.dTLB-load-misses
7.786e+10 +25.9% 9.805e+10 ± 2% perf-stat.ps.dTLB-loads
375322 ± 2% -20.6% 298148 ± 3% perf-stat.ps.dTLB-store-misses
4.608e+10 +27.6% 5.881e+10 ± 2% perf-stat.ps.dTLB-stores
3.522e+08 ± 3% +16.4% 4.099e+08 ± 3% perf-stat.ps.iTLB-load-misses
4616193 ± 10% -13.2% 4006021 ± 4% perf-stat.ps.iTLB-loads
2.673e+11 +24.2% 3.321e+11 ± 2% perf-stat.ps.instructions
6403 ± 3% -21.5% 5027 ± 4% perf-stat.ps.minor-faults
27179360 ± 6% +104.0% 55440463 perf-stat.ps.node-load-misses
11786339 ± 5% +142.7% 28603077 perf-stat.ps.node-store-misses
5443927 ± 8% +16.2% 6323526 perf-stat.ps.node-stores
6412 ± 3% -21.5% 5035 ± 4% perf-stat.ps.page-faults
4.418e+13 -15.5% 3.734e+13 perf-stat.total.instructions
4.76 ± 26% -2.2 2.51 ± 58% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
3.56 ± 36% -1.9 1.61 ± 58% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.61 ± 11% +0.6 1.20 ± 62% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write
0.86 ± 41% +0.6 1.50 ± 36% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.07 ±264% +1.1 1.13 ± 31% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.pipe_read.new_sync_read
0.00 +1.2 1.21 ± 45% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +1.2 1.23 ± 46% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.57 ±102% +10.4 10.96 ±105% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.69 ± 86% +13.7 14.34 ±115% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
0.69 ± 86% +14.2 14.93 ±116% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.97 ± 84% +18.6 19.53 ±116% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.97 ± 84% +18.6 19.53 ±116% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.97 ± 84% +18.6 19.53 ±116% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
0.97 ± 84% +18.6 19.60 ±115% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
4.91 ± 25% -2.3 2.66 ± 48% perf-profile.children.cycles-pp.select_task_rq_fair
3.72 ± 35% -2.0 1.75 ± 47% perf-profile.children.cycles-pp.select_idle_sibling
1.48 ± 48% -1.1 0.41 ± 42% perf-profile.children.cycles-pp.available_idle_cpu
2.67 ± 7% -0.9 1.81 ± 45% perf-profile.children.cycles-pp.update_curr
1.74 ± 5% -0.7 0.99 ± 50% perf-profile.children.cycles-pp.reweight_entity
0.95 ± 24% -0.3 0.63 ± 12% perf-profile.children.cycles-pp.syscall_return_via_sysret
1.03 ± 5% -0.3 0.72 ± 28% perf-profile.children.cycles-pp.__update_load_avg_se
0.54 ± 12% -0.3 0.26 ± 63% perf-profile.children.cycles-pp.__enqueue_entity
0.62 ± 7% -0.3 0.36 ± 40% perf-profile.children.cycles-pp.pick_next_entity
0.92 ± 5% -0.2 0.68 ± 30% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.62 ± 7% -0.2 0.38 ± 59% perf-profile.children.cycles-pp.put_prev_entity
0.73 ± 20% -0.2 0.49 ± 15% perf-profile.children.cycles-pp.___might_sleep
0.60 ± 4% -0.2 0.37 ± 49% perf-profile.children.cycles-pp.___perf_sw_event
0.94 ± 4% -0.2 0.71 ± 22% perf-profile.children.cycles-pp.__switch_to_asm
0.60 ± 15% -0.2 0.41 ± 12% perf-profile.children.cycles-pp.__might_sleep
0.51 ± 17% -0.2 0.34 ± 18% perf-profile.children.cycles-pp.file_update_time
0.53 ± 7% -0.2 0.35 ± 45% perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
0.43 ± 25% -0.2 0.27 ± 11% perf-profile.children.cycles-pp.current_time
0.41 ± 6% -0.1 0.26 ± 44% perf-profile.children.cycles-pp.__calc_delta
0.26 ± 13% -0.1 0.13 ± 61% perf-profile.children.cycles-pp.set_next_buddy
0.33 ± 28% -0.1 0.22 ± 13% perf-profile.children.cycles-pp.__might_fault
0.24 ± 8% -0.1 0.13 ± 59% perf-profile.children.cycles-pp.clear_buddies
0.17 ± 17% -0.1 0.07 ± 61% perf-profile.children.cycles-pp.__cgroup_account_cputime
0.20 ± 9% -0.1 0.10 ± 61% perf-profile.children.cycles-pp.rb_insert_color
0.32 ± 21% -0.1 0.23 ± 10% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.21 ± 7% -0.1 0.13 ± 58% perf-profile.children.cycles-pp.__wrgsbase_inactive
0.15 ± 6% -0.1 0.08 ± 57% perf-profile.children.cycles-pp.perf_swevent_event
0.09 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.cgroup_rstat_updated
0.14 ± 30% -0.1 0.08 ± 19% perf-profile.children.cycles-pp.timestamp_truncate
0.10 ± 21% -0.1 0.05 ± 58% perf-profile.children.cycles-pp.find_next_bit
0.09 ± 15% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.rw_verify_area
0.12 ± 16% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64
0.27 ± 5% -0.0 0.23 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid
0.00 +0.1 0.06 ± 26% perf-profile.children.cycles-pp.kill_fasync
0.12 ± 13% +0.1 0.19 ± 18% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.llist_add_batch
0.01 ±173% +0.1 0.15 ± 47% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.34 ± 4% +0.2 0.55 ± 16% perf-profile.children.cycles-pp.sched_clock
0.32 ± 4% +0.2 0.54 ± 15% perf-profile.children.cycles-pp.native_sched_clock
0.37 ± 4% +0.2 0.61 ± 18% perf-profile.children.cycles-pp.sched_clock_cpu
0.03 ± 77% +0.3 0.31 ±117% perf-profile.children.cycles-pp.do_softirq_own_stack
0.03 ± 77% +0.3 0.31 ±117% perf-profile.children.cycles-pp.__softirqentry_text_start
0.07 ± 7% +0.3 0.39 ±111% perf-profile.children.cycles-pp.irq_exit_rcu
0.12 ± 9% +0.5 0.58 ±124% perf-profile.children.cycles-pp.ktime_get
0.32 ± 47% +0.7 1.02 ± 53% perf-profile.children.cycles-pp.sched_ttwu_pending
0.83 ± 9% +0.9 1.75 ± 16% perf-profile.children.cycles-pp.finish_task_switch
0.24 ± 49% +1.0 1.23 ± 46% perf-profile.children.cycles-pp.schedule_idle
0.73 ± 5% +1.4 2.12 ±101% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
1.08 ± 11% +1.8 2.83 ± 41% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
0.77 ± 5% +2.0 2.78 ±112% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.01 ±174% +2.8 2.80 ±150% perf-profile.children.cycles-pp.menu_select
0.67 ± 76% +10.3 11.01 ±104% perf-profile.children.cycles-pp.intel_idle
0.74 ± 75% +14.2 14.98 ±116% perf-profile.children.cycles-pp.cpuidle_enter_state
0.74 ± 75% +14.2 14.98 ±116% perf-profile.children.cycles-pp.cpuidle_enter
1.05 ± 68% +18.5 19.53 ±116% perf-profile.children.cycles-pp.start_secondary
1.06 ± 67% +18.5 19.60 ±115% perf-profile.children.cycles-pp.do_idle
1.06 ± 67% +18.5 19.60 ±115% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
1.06 ± 67% +18.5 19.60 ±115% perf-profile.children.cycles-pp.cpu_startup_entry
1.46 ± 48% -1.1 0.40 ± 42% perf-profile.self.cycles-pp.available_idle_cpu
1.23 ± 34% -0.7 0.52 ± 52% perf-profile.self.cycles-pp.select_idle_sibling
1.28 ± 8% -0.4 0.86 ± 46% perf-profile.self.cycles-pp.update_curr
0.76 ± 6% -0.4 0.40 ± 34% perf-profile.self.cycles-pp.reweight_entity
1.07 ± 7% -0.3 0.73 ± 18% perf-profile.self.cycles-pp._raw_spin_lock
0.95 ± 24% -0.3 0.63 ± 12% perf-profile.self.cycles-pp.syscall_return_via_sysret
1.01 ± 5% -0.3 0.70 ± 31% perf-profile.self.cycles-pp.__update_load_avg_se
0.52 ± 12% -0.3 0.26 ± 62% perf-profile.self.cycles-pp.__enqueue_entity
0.89 ± 6% -0.2 0.65 ± 29% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.71 ± 21% -0.2 0.48 ± 15% perf-profile.self.cycles-pp.___might_sleep
0.93 ± 4% -0.2 0.71 ± 22% perf-profile.self.cycles-pp.__switch_to_asm
0.49 ± 4% -0.2 0.29 ± 59% perf-profile.self.cycles-pp.___perf_sw_event
0.72 ± 19% -0.2 0.53 ± 10% perf-profile.self.cycles-pp.common_file_perm
0.71 ± 3% -0.2 0.53 ± 6% perf-profile.self.cycles-pp.update_rq_clock
0.52 ± 7% -0.2 0.35 ± 45% perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
0.54 ± 14% -0.2 0.37 ± 11% perf-profile.self.cycles-pp.__might_sleep
0.80 ± 3% -0.2 0.63 ± 24% perf-profile.self.cycles-pp.__switch_to
0.58 ± 6% -0.2 0.42 ± 29% perf-profile.self.cycles-pp.enqueue_task_fair
0.43 ± 4% -0.2 0.27 ± 29% perf-profile.self.cycles-pp.dequeue_task_fair
0.62 ± 12% -0.2 0.47 ± 13% perf-profile.self.cycles-pp.vfs_read
0.45 ± 7% -0.1 0.30 ± 48% perf-profile.self.cycles-pp.update_min_vruntime
0.40 ± 6% -0.1 0.26 ± 44% perf-profile.self.cycles-pp.__calc_delta
0.40 ± 16% -0.1 0.26 ± 20% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.25 ± 13% -0.1 0.12 ± 61% perf-profile.self.cycles-pp.set_next_buddy
0.21 ± 46% -0.1 0.09 ± 59% perf-profile.self.cycles-pp.cpumask_next_wrap
0.32 ± 6% -0.1 0.21 ± 28% perf-profile.self.cycles-pp.pick_next_entity
0.20 ± 9% -0.1 0.10 ± 61% perf-profile.self.cycles-pp.rb_insert_color
0.21 ± 9% -0.1 0.11 ± 59% perf-profile.self.cycles-pp.clear_buddies
0.30 ± 21% -0.1 0.21 ± 9% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.22 ± 15% -0.1 0.13 ± 38% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.31 ± 18% -0.1 0.22 ± 10% perf-profile.self.cycles-pp.copy_page_to_iter
0.21 ± 7% -0.1 0.13 ± 58% perf-profile.self.cycles-pp.__wrgsbase_inactive
0.19 ± 29% -0.1 0.12 ± 21% perf-profile.self.cycles-pp.current_time
0.19 ± 5% -0.1 0.12 ± 58% perf-profile.self.cycles-pp.anon_pipe_buf_release
0.09 ± 20% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__cgroup_account_cputime
0.08 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.cgroup_rstat_updated
0.12 ± 28% -0.1 0.07 ± 15% perf-profile.self.cycles-pp.timestamp_truncate
0.08 ± 14% -0.1 0.03 ±100% perf-profile.self.cycles-pp.rw_verify_area
0.19 ± 12% -0.0 0.14 ± 13% perf-profile.self.cycles-pp.ksys_read
0.07 ± 11% -0.0 0.03 ±100% perf-profile.self.cycles-pp.find_next_bit
0.10 ± 11% -0.0 0.05 ± 61% perf-profile.self.cycles-pp.wakeup_preempt_entity
0.07 ± 6% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.perf_swevent_event
0.24 ± 4% -0.0 0.22 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid
0.25 ± 13% +0.1 0.32 ± 17% perf-profile.self.cycles-pp.aa_file_perm
0.01 ±173% +0.1 0.09 ± 34% perf-profile.self.cycles-pp.flush_smp_call_function_queue
0.00 +0.1 0.09 ± 27% perf-profile.self.cycles-pp.llist_add_batch
1.58 ± 2% +0.2 1.75 ± 4% perf-profile.self.cycles-pp.__schedule
0.30 ± 4% +0.2 0.50 ± 13% perf-profile.self.cycles-pp.native_sched_clock
0.10 ± 10% +0.4 0.49 ±125% perf-profile.self.cycles-pp.ktime_get
0.08 ± 49% +0.6 0.63 ±119% perf-profile.self.cycles-pp.__mutex_lock
0.30 ± 10% +0.6 0.88 ± 64% perf-profile.self.cycles-pp.finish_task_switch
0.00 +1.8 1.77 ±155% perf-profile.self.cycles-pp.cpuidle_enter_state
0.00 +2.4 2.37 ±152% perf-profile.self.cycles-pp.menu_select
0.67 ± 76% +10.3 11.01 ±104% perf-profile.self.cycles-pp.intel_idle
31351 ± 12% -35.9% 20103 ± 13% softirqs.CPU0.RCU
30180 ± 12% -38.9% 18425 ± 7% softirqs.CPU1.RCU
29060 ± 10% -36.6% 18435 ± 7% softirqs.CPU10.RCU
28973 ± 9% -38.5% 17815 ± 8% softirqs.CPU100.RCU
28910 ± 10% -38.4% 17820 ± 8% softirqs.CPU101.RCU
28751 ± 9% -37.9% 17860 ± 9% softirqs.CPU102.RCU
28899 ± 10% -36.5% 18337 ± 10% softirqs.CPU103.RCU
28939 ± 9% -38.3% 17845 ± 8% softirqs.CPU104.RCU
28791 ± 9% -38.0% 17848 ± 8% softirqs.CPU105.RCU
28812 ± 9% -38.4% 17748 ± 8% softirqs.CPU106.RCU
28857 ± 9% -37.6% 18013 ± 9% softirqs.CPU107.RCU
29082 ± 9% -37.7% 18107 ± 9% softirqs.CPU108.RCU
28989 ± 9% -38.1% 17956 ± 8% softirqs.CPU109.RCU
29414 ± 10% -38.6% 18059 ± 7% softirqs.CPU11.RCU
28880 ± 9% -37.7% 18000 ± 8% softirqs.CPU110.RCU
28737 ± 10% -38.1% 17786 ± 8% softirqs.CPU111.RCU
29112 ± 10% -38.6% 17862 ± 8% softirqs.CPU112.RCU
29119 ± 10% -37.6% 18179 ± 10% softirqs.CPU113.RCU
29204 ± 9% -39.2% 17758 ± 8% softirqs.CPU114.RCU
29189 ± 9% -37.8% 18150 ± 6% softirqs.CPU115.RCU
29199 ± 9% -38.8% 17872 ± 8% softirqs.CPU116.RCU
29242 ± 9% -39.1% 17797 ± 8% softirqs.CPU117.RCU
29088 ± 9% -39.0% 17740 ± 8% softirqs.CPU118.RCU
29040 ± 9% -39.2% 17661 ± 8% softirqs.CPU119.RCU
28928 ± 10% -36.8% 18272 ± 8% softirqs.CPU12.RCU
29405 ± 7% -37.2% 18468 ± 8% softirqs.CPU120.RCU
29588 ± 7% -37.2% 18567 ± 8% softirqs.CPU121.RCU
29393 ± 7% -37.4% 18404 ± 8% softirqs.CPU122.RCU
29161 ± 7% -36.5% 18516 ± 8% softirqs.CPU123.RCU
29332 ± 7% -37.0% 18484 ± 8% softirqs.CPU124.RCU
29085 ± 7% -37.1% 18292 ± 8% softirqs.CPU125.RCU
29024 ± 7% -36.5% 18417 ± 9% softirqs.CPU126.RCU
29446 ± 8% -36.8% 18617 ± 10% softirqs.CPU127.RCU
28800 ± 6% -35.3% 18644 ± 11% softirqs.CPU128.RCU
28672 ± 7% -36.0% 18349 ± 7% softirqs.CPU129.RCU
29306 ± 10% -36.4% 18632 ± 8% softirqs.CPU13.RCU
29016 ± 6% -36.4% 18452 ± 7% softirqs.CPU130.RCU
28927 ± 6% -35.1% 18783 ± 8% softirqs.CPU131.RCU
29043 ± 7% -38.5% 17863 ± 9% softirqs.CPU132.RCU
28256 ± 5% -35.5% 18233 ± 7% softirqs.CPU133.RCU
28818 ± 7% -36.5% 18295 ± 7% softirqs.CPU134.RCU
28743 ± 7% -36.1% 18370 ± 7% softirqs.CPU135.RCU
29117 ± 8% -36.3% 18544 ± 7% softirqs.CPU136.RCU
29105 ± 7% -36.3% 18532 ± 7% softirqs.CPU137.RCU
29047 ± 6% -36.4% 18486 ± 7% softirqs.CPU138.RCU
28118 ± 6% -35.6% 18119 ± 8% softirqs.CPU139.RCU
5299 ±177% -100.0% 0.00 softirqs.CPU14.NET_RX
29229 ± 10% -36.1% 18664 ± 7% softirqs.CPU14.RCU
28377 ± 8% -35.3% 18348 ± 7% softirqs.CPU140.RCU
28864 ± 7% -36.4% 18364 ± 7% softirqs.CPU141.RCU
28917 ± 7% -36.2% 18446 ± 7% softirqs.CPU142.RCU
29133 ± 8% -36.3% 18551 ± 7% softirqs.CPU143.RCU
29522 ± 9% -37.8% 18359 ± 8% softirqs.CPU144.RCU
29215 ± 9% -37.7% 18214 ± 8% softirqs.CPU145.RCU
29271 ± 9% -37.0% 18427 ± 9% softirqs.CPU146.RCU
28811 ± 11% -36.8% 18212 ± 9% softirqs.CPU147.RCU
29274 ± 9% -36.7% 18544 ± 7% softirqs.CPU148.RCU
29473 ± 9% -37.4% 18448 ± 9% softirqs.CPU149.RCU
29260 ± 9% -37.5% 18273 ± 8% softirqs.CPU15.RCU
29410 ± 9% -37.3% 18431 ± 9% softirqs.CPU150.RCU
29043 ± 9% -37.0% 18283 ± 8% softirqs.CPU151.RCU
29434 ± 8% -37.4% 18416 ± 8% softirqs.CPU152.RCU
29298 ± 8% -37.6% 18279 ± 9% softirqs.CPU153.RCU
29359 ± 9% -37.1% 18455 ± 9% softirqs.CPU154.RCU
29440 ± 9% -37.7% 18346 ± 9% softirqs.CPU155.RCU
29069 ± 9% -37.7% 18107 ± 9% softirqs.CPU156.RCU
29242 ± 9% -37.7% 18215 ± 9% softirqs.CPU157.RCU
29731 ± 9% -38.5% 18270 ± 9% softirqs.CPU158.RCU
29309 ± 8% -37.3% 18369 ± 9% softirqs.CPU159.RCU
1869 ±199% -100.0% 0.00 softirqs.CPU16.NET_RX
29658 ± 10% -35.0% 19265 ± 8% softirqs.CPU16.RCU
29436 ± 9% -37.5% 18398 ± 9% softirqs.CPU160.RCU
29406 ± 9% -36.5% 18661 ± 7% softirqs.CPU161.RCU
29529 ± 8% -37.2% 18541 ± 8% softirqs.CPU162.RCU
29484 ± 9% -37.1% 18556 ± 8% softirqs.CPU163.RCU
29296 ± 9% -37.4% 18343 ± 9% softirqs.CPU164.RCU
29260 ± 9% -37.3% 18348 ± 9% softirqs.CPU165.RCU
29236 ± 9% -37.0% 18416 ± 9% softirqs.CPU166.RCU
29324 ± 9% -37.0% 18476 ± 9% softirqs.CPU167.RCU
28460 ± 8% -36.4% 18097 ± 6% softirqs.CPU168.RCU
28247 ± 8% -37.7% 17588 ± 8% softirqs.CPU169.RCU
29853 ± 9% -36.6% 18937 ± 11% softirqs.CPU17.RCU
28215 ± 8% -37.7% 17571 ± 8% softirqs.CPU170.RCU
28305 ± 9% -37.9% 17575 ± 8% softirqs.CPU171.RCU
28342 ± 8% -38.0% 17565 ± 8% softirqs.CPU172.RCU
28230 ± 9% -38.6% 17327 ± 11% softirqs.CPU173.RCU
28226 ± 9% -37.2% 17733 ± 9% softirqs.CPU174.RCU
28319 ± 8% -37.8% 17613 ± 8% softirqs.CPU175.RCU
28677 ± 8% -37.3% 17984 ± 7% softirqs.CPU176.RCU
28881 ± 9% -38.0% 17910 ± 7% softirqs.CPU177.RCU
28889 ± 8% -38.1% 17896 ± 8% softirqs.CPU178.RCU
28812 ± 9% -37.8% 17928 ± 8% softirqs.CPU179.RCU
29338 ± 11% -38.5% 18051 ± 11% softirqs.CPU18.RCU
28956 ± 8% -37.5% 18094 ± 8% softirqs.CPU180.RCU
28847 ± 8% -37.2% 18127 ± 8% softirqs.CPU181.RCU
28801 ± 9% -37.5% 17996 ± 7% softirqs.CPU182.RCU
28766 ± 8% -37.5% 17967 ± 8% softirqs.CPU183.RCU
28939 ± 9% -37.9% 17985 ± 7% softirqs.CPU184.RCU
28576 ± 8% -37.7% 17798 ± 8% softirqs.CPU185.RCU
28914 ± 8% -37.2% 18155 ± 8% softirqs.CPU186.RCU
28916 ± 9% -37.1% 18193 ± 8% softirqs.CPU187.RCU
28709 ± 9% -37.4% 17967 ± 8% softirqs.CPU188.RCU
28622 ± 9% -36.9% 18048 ± 9% softirqs.CPU189.RCU
29532 ± 9% -38.4% 18203 ± 8% softirqs.CPU19.RCU
28733 ± 8% -37.7% 17895 ± 9% softirqs.CPU190.RCU
28334 ± 9% -34.6% 18528 ± 7% softirqs.CPU191.RCU
29312 ± 10% -37.4% 18335 ± 8% softirqs.CPU2.RCU
29638 ± 9% -37.0% 18669 ± 10% softirqs.CPU20.RCU
29566 ± 9% -38.5% 18170 ± 8% softirqs.CPU21.RCU
29802 ± 9% -38.6% 18290 ± 8% softirqs.CPU22.RCU
29642 ± 9% -39.2% 18030 ± 7% softirqs.CPU23.RCU
29557 ± 7% -36.3% 18830 ± 8% softirqs.CPU24.RCU
29566 ± 7% -36.5% 18767 ± 7% softirqs.CPU25.RCU
29706 ± 7% -37.8% 18479 ± 8% softirqs.CPU26.RCU
29766 ± 8% -37.4% 18639 ± 8% softirqs.CPU27.RCU
29430 ± 7% -37.0% 18530 ± 9% softirqs.CPU28.RCU
29467 ± 7% -37.3% 18475 ± 8% softirqs.CPU29.RCU
29627 ± 9% -37.0% 18658 ± 8% softirqs.CPU3.RCU
29410 ± 7% -36.9% 18547 ± 8% softirqs.CPU30.RCU
29316 ± 7% -35.9% 18802 ± 6% softirqs.CPU31.RCU
28331 ± 8% -35.3% 18331 ± 6% softirqs.CPU32.RCU
28364 ± 6% -36.3% 18066 ± 7% softirqs.CPU33.RCU
28611 ± 6% -36.6% 18132 ± 7% softirqs.CPU34.RCU
28659 ± 6% -35.3% 18535 ± 7% softirqs.CPU35.RCU
28711 ± 6% -36.4% 18261 ± 7% softirqs.CPU36.RCU
28669 ± 6% -36.3% 18272 ± 7% softirqs.CPU37.RCU
28769 ± 6% -36.6% 18244 ± 7% softirqs.CPU38.RCU
28454 ± 6% -36.1% 18169 ± 8% softirqs.CPU39.RCU
29322 ± 10% -37.3% 18383 ± 8% softirqs.CPU4.RCU
28686 ± 7% -36.5% 18224 ± 8% softirqs.CPU40.RCU
28873 ± 6% -36.5% 18333 ± 8% softirqs.CPU41.RCU
28702 ± 6% -36.0% 18367 ± 8% softirqs.CPU42.RCU
28831 ± 8% -36.6% 18288 ± 7% softirqs.CPU43.RCU
28419 ± 6% -36.7% 17994 ± 7% softirqs.CPU44.RCU
28573 ± 6% -36.7% 18100 ± 7% softirqs.CPU45.RCU
28607 ± 6% -35.8% 18353 ± 7% softirqs.CPU46.RCU
28835 ± 6% -36.5% 18303 ± 8% softirqs.CPU47.RCU
30463 ± 9% -38.4% 18763 ± 7% softirqs.CPU48.RCU
30299 ± 9% -37.8% 18835 ± 7% softirqs.CPU49.RCU
28991 ± 10% -37.4% 18137 ± 7% softirqs.CPU5.RCU
30202 ± 9% -38.2% 18651 ± 9% softirqs.CPU50.RCU
30569 ± 9% -38.3% 18855 ± 8% softirqs.CPU51.RCU
30507 ± 9% -38.5% 18775 ± 9% softirqs.CPU52.RCU
30682 ± 9% -38.6% 18826 ± 9% softirqs.CPU53.RCU
30624 ± 9% -38.1% 18943 ± 9% softirqs.CPU54.RCU
30425 ± 9% -38.7% 18646 ± 9% softirqs.CPU55.RCU
30362 ± 9% -38.3% 18737 ± 9% softirqs.CPU56.RCU
30383 ± 9% -38.8% 18590 ± 9% softirqs.CPU57.RCU
30498 ± 9% -38.4% 18799 ± 9% softirqs.CPU58.RCU
30551 ± 9% -38.5% 18796 ± 9% softirqs.CPU59.RCU
28931 ± 9% -36.8% 18286 ± 8% softirqs.CPU6.RCU
30423 ± 9% -38.8% 18609 ± 9% softirqs.CPU60.RCU
30378 ± 9% -38.6% 18642 ± 8% softirqs.CPU61.RCU
30269 ± 9% -38.8% 18520 ± 9% softirqs.CPU62.RCU
30185 ± 9% -38.3% 18618 ± 9% softirqs.CPU63.RCU
30264 ± 9% -37.1% 19050 ± 9% softirqs.CPU64.RCU
30110 ± 9% -37.1% 18932 ± 9% softirqs.CPU65.RCU
30773 ± 8% -37.7% 19160 ± 8% softirqs.CPU66.RCU
30501 ± 9% -37.4% 19106 ± 8% softirqs.CPU67.RCU
30256 ± 8% -37.5% 18902 ± 9% softirqs.CPU68.RCU
30332 ± 8% -37.4% 18974 ± 8% softirqs.CPU69.RCU
29367 ± 10% -36.1% 18777 ± 10% softirqs.CPU7.RCU
30172 ± 9% -37.0% 19023 ± 9% softirqs.CPU70.RCU
30588 ± 9% -37.9% 19004 ± 9% softirqs.CPU71.RCU
29699 ± 8% -35.1% 19282 ± 7% softirqs.CPU72.RCU
29291 ± 8% -37.7% 18245 ± 8% softirqs.CPU73.RCU
29110 ± 8% -36.8% 18405 ± 9% softirqs.CPU74.RCU
29054 ± 8% -37.3% 18210 ± 8% softirqs.CPU75.RCU
29056 ± 8% -37.7% 18100 ± 8% softirqs.CPU76.RCU
29116 ± 8% -38.3% 17974 ± 9% softirqs.CPU77.RCU
29140 ± 8% -37.6% 18192 ± 8% softirqs.CPU78.RCU
29206 ± 9% -37.8% 18164 ± 8% softirqs.CPU79.RCU
29385 ± 10% -37.8% 18286 ± 8% softirqs.CPU8.RCU
28867 ± 8% -36.3% 18383 ± 8% softirqs.CPU80.RCU
28846 ± 8% -36.5% 18316 ± 8% softirqs.CPU81.RCU
28859 ± 8% -35.3% 18674 ± 10% softirqs.CPU82.RCU
29002 ± 8% -37.1% 18241 ± 8% softirqs.CPU83.RCU
29053 ± 8% -36.9% 18330 ± 8% softirqs.CPU84.RCU
29048 ± 8% -37.1% 18280 ± 8% softirqs.CPU85.RCU
28868 ± 8% -36.7% 18278 ± 7% softirqs.CPU86.RCU
28939 ± 9% -36.5% 18383 ± 8% softirqs.CPU87.RCU
29176 ± 9% -37.3% 18281 ± 8% softirqs.CPU88.RCU
29127 ± 9% -37.3% 18255 ± 8% softirqs.CPU89.RCU
29101 ± 9% -37.1% 18297 ± 8% softirqs.CPU9.RCU
29058 ± 9% -37.0% 18315 ± 8% softirqs.CPU90.RCU
29049 ± 9% -36.7% 18393 ± 8% softirqs.CPU91.RCU
28872 ± 9% -32.8% 19396 ± 16% softirqs.CPU92.RCU
28782 ± 8% -36.7% 18213 ± 8% softirqs.CPU93.RCU
28844 ± 9% -37.2% 18115 ± 7% softirqs.CPU94.RCU
28828 ± 8% -36.5% 18316 ± 8% softirqs.CPU95.RCU
29304 ± 8% -38.4% 18041 ± 7% softirqs.CPU96.RCU
28771 ± 11% -36.1% 18397 ± 6% softirqs.CPU97.RCU
28918 ± 9% -37.6% 18033 ± 8% softirqs.CPU98.RCU
28970 ± 9% -37.7% 18060 ± 8% softirqs.CPU99.RCU
5610692 ± 8% -37.2% 3520779 ± 8% softirqs.RCU
45173 ± 5% -30.4% 31448 ± 5% softirqs.TIMER
972.88 ± 91% -100.0% 0.00 interrupts.170:PCI-MSI.524289-edge.eth0-TxRx-0
9984 ±174% -100.0% 0.00 interrupts.171:PCI-MSI.524290-edge.eth0-TxRx-1
2684 ±130% -100.0% 0.00 interrupts.172:PCI-MSI.524291-edge.eth0-TxRx-2
3306 ±200% -100.0% 0.00 interrupts.173:PCI-MSI.524292-edge.eth0-TxRx-3
332.50 ± 2% -31.7% 227.00 ± 2% interrupts.9:IO-APIC.9-fasteoi.acpi
56431209 ± 7% -50.2% 28124418 ± 10% interrupts.CAL:Function_call_interrupts
344969 ± 12% -39.8% 207676 ± 12% interrupts.CPU0.CAL:Function_call_interrupts
327871 ± 4% -31.0% 226377 ± 2% interrupts.CPU0.LOC:Local_timer_interrupts
7410 ± 26% -67.0% 2446 ± 70% interrupts.CPU0.NMI:Non-maskable_interrupts
7410 ± 26% -67.0% 2446 ± 70% interrupts.CPU0.PMI:Performance_monitoring_interrupts
1030244 ± 12% -57.5% 437927 ± 22% interrupts.CPU0.RES:Rescheduling_interrupts
257608 ± 8% -60.8% 100991 ± 8% interrupts.CPU0.TLB:TLB_shootdowns
332.50 ± 2% -31.7% 227.00 ± 2% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
333049 ± 12% -54.9% 150312 ± 19% interrupts.CPU1.CAL:Function_call_interrupts
325522 ± 5% -30.4% 226464 ± 2% interrupts.CPU1.LOC:Local_timer_interrupts
7923 ± 19% -71.8% 2233 ± 82% interrupts.CPU1.NMI:Non-maskable_interrupts
7923 ± 19% -71.8% 2233 ± 82% interrupts.CPU1.PMI:Performance_monitoring_interrupts
945769 ± 15% -45.5% 515869 ± 28% interrupts.CPU1.RES:Rescheduling_interrupts
257965 ± 8% -60.5% 101776 ± 8% interrupts.CPU1.TLB:TLB_shootdowns
284308 ± 11% -47.2% 150090 ± 24% interrupts.CPU10.CAL:Function_call_interrupts
328119 ± 4% -31.0% 226527 ± 2% interrupts.CPU10.LOC:Local_timer_interrupts
7408 ± 26% -67.2% 2430 ± 71% interrupts.CPU10.NMI:Non-maskable_interrupts
7408 ± 26% -67.2% 2430 ± 71% interrupts.CPU10.PMI:Performance_monitoring_interrupts
1063093 ± 11% -55.7% 470654 ± 34% interrupts.CPU10.RES:Rescheduling_interrupts
257678 ± 8% -60.8% 100896 ± 9% interrupts.CPU10.TLB:TLB_shootdowns
304328 ± 14% -53.0% 143085 ± 7% interrupts.CPU100.CAL:Function_call_interrupts
327933 ± 4% -31.0% 226309 ± 2% interrupts.CPU100.LOC:Local_timer_interrupts
8399 ± 3% -71.2% 2422 ± 71% interrupts.CPU100.NMI:Non-maskable_interrupts
8399 ± 3% -71.2% 2422 ± 71% interrupts.CPU100.PMI:Performance_monitoring_interrupts
991319 ± 12% -52.5% 471290 ± 19% interrupts.CPU100.RES:Rescheduling_interrupts
257973 ± 8% -61.2% 100045 ± 9% interrupts.CPU100.TLB:TLB_shootdowns
302580 ± 17% -57.1% 129755 ± 20% interrupts.CPU101.CAL:Function_call_interrupts
328146 ± 4% -31.0% 226467 ± 2% interrupts.CPU101.LOC:Local_timer_interrupts
8401 ± 3% -76.6% 1963 ± 77% interrupts.CPU101.NMI:Non-maskable_interrupts
8401 ± 3% -76.6% 1963 ± 77% interrupts.CPU101.PMI:Performance_monitoring_interrupts
1047233 ± 11% -55.0% 471399 ± 32% interrupts.CPU101.RES:Rescheduling_interrupts
258163 ± 8% -61.9% 98395 ± 9% interrupts.CPU101.TLB:TLB_shootdowns
291861 ± 12% -51.0% 142870 ± 13% interrupts.CPU102.CAL:Function_call_interrupts
328185 ± 4% -31.0% 226512 ± 2% interrupts.CPU102.LOC:Local_timer_interrupts
8399 ± 3% -76.9% 1938 ± 79% interrupts.CPU102.NMI:Non-maskable_interrupts
8399 ± 3% -76.9% 1938 ± 79% interrupts.CPU102.PMI:Performance_monitoring_interrupts
1060656 ± 19% -57.2% 453709 ± 34% interrupts.CPU102.RES:Rescheduling_interrupts
258371 ± 8% -61.3% 99867 ± 9% interrupts.CPU102.TLB:TLB_shootdowns
292106 ± 13% -49.5% 147368 ± 25% interrupts.CPU103.CAL:Function_call_interrupts
328054 ± 4% -31.0% 226485 ± 2% interrupts.CPU103.LOC:Local_timer_interrupts
8407 ± 3% -76.7% 1963 ± 79% interrupts.CPU103.NMI:Non-maskable_interrupts
8407 ± 3% -76.7% 1963 ± 79% interrupts.CPU103.PMI:Performance_monitoring_interrupts
1104428 ± 10% -56.5% 480820 ± 13% interrupts.CPU103.RES:Rescheduling_interrupts
258094 ± 8% -60.9% 100968 ± 8% interrupts.CPU103.TLB:TLB_shootdowns
315218 ± 15% -50.0% 157626 ± 18% interrupts.CPU104.CAL:Function_call_interrupts
328253 ± 4% -31.1% 226257 ± 2% interrupts.CPU104.LOC:Local_timer_interrupts
7860 ± 17% -75.1% 1954 ± 80% interrupts.CPU104.NMI:Non-maskable_interrupts
7860 ± 17% -75.1% 1954 ± 80% interrupts.CPU104.PMI:Performance_monitoring_interrupts
1037770 ± 11% -52.9% 488886 ± 31% interrupts.CPU104.RES:Rescheduling_interrupts
258328 ± 8% -60.8% 101360 ± 9% interrupts.CPU104.TLB:TLB_shootdowns
290824 ± 8% -52.6% 137900 ± 9% interrupts.CPU105.CAL:Function_call_interrupts
328279 ± 4% -31.0% 226465 ± 2% interrupts.CPU105.LOC:Local_timer_interrupts
7390 ± 25% -73.5% 1956 ± 79% interrupts.CPU105.NMI:Non-maskable_interrupts
7390 ± 25% -73.5% 1956 ± 79% interrupts.CPU105.PMI:Performance_monitoring_interrupts
1075707 ± 11% -55.1% 482742 ± 19% interrupts.CPU105.RES:Rescheduling_interrupts
257822 ± 8% -60.5% 101826 ± 9% interrupts.CPU105.TLB:TLB_shootdowns
291762 ± 14% -43.3% 165476 ± 32% interrupts.CPU106.CAL:Function_call_interrupts
328104 ± 4% -31.0% 226496 ± 2% interrupts.CPU106.LOC:Local_timer_interrupts
7862 ± 17% -75.1% 1961 ± 79% interrupts.CPU106.NMI:Non-maskable_interrupts
7862 ± 17% -75.1% 1961 ± 79% interrupts.CPU106.PMI:Performance_monitoring_interrupts
1078729 ± 11% -55.8% 477185 ± 29% interrupts.CPU106.RES:Rescheduling_interrupts
258996 ± 8% -60.7% 101704 ± 9% interrupts.CPU106.TLB:TLB_shootdowns
282632 ± 11% -52.1% 135323 ± 24% interrupts.CPU107.CAL:Function_call_interrupts
328282 ± 4% -31.0% 226465 ± 2% interrupts.CPU107.LOC:Local_timer_interrupts
7862 ± 17% -75.1% 1958 ± 79% interrupts.CPU107.NMI:Non-maskable_interrupts
7862 ± 17% -75.1% 1958 ± 79% interrupts.CPU107.PMI:Performance_monitoring_interrupts
995251 ± 13% -55.8% 439566 ± 18% interrupts.CPU107.RES:Rescheduling_interrupts
258320 ± 8% -60.9% 100912 ± 9% interrupts.CPU107.TLB:TLB_shootdowns
309909 ± 13% -63.1% 114509 ± 18% interrupts.CPU108.CAL:Function_call_interrupts
328098 ± 4% -31.0% 226480 ± 2% interrupts.CPU108.LOC:Local_timer_interrupts
7315 ± 23% -73.2% 1962 ± 79% interrupts.CPU108.NMI:Non-maskable_interrupts
7315 ± 23% -73.2% 1962 ± 79% interrupts.CPU108.PMI:Performance_monitoring_interrupts
1071940 ± 5% -55.5% 477150 ± 31% interrupts.CPU108.RES:Rescheduling_interrupts
257943 ± 8% -60.8% 101233 ± 10% interrupts.CPU108.TLB:TLB_shootdowns
272870 ± 10% -48.9% 139492 ± 16% interrupts.CPU109.CAL:Function_call_interrupts
328321 ± 4% -31.0% 226449 ± 2% interrupts.CPU109.LOC:Local_timer_interrupts
7319 ± 23% -69.3% 2247 ± 82% interrupts.CPU109.NMI:Non-maskable_interrupts
7319 ± 23% -69.3% 2247 ± 82% interrupts.CPU109.PMI:Performance_monitoring_interrupts
1008976 ± 8% -57.2% 431846 ± 21% interrupts.CPU109.RES:Rescheduling_interrupts
257919 ± 8% -61.2% 100009 ± 9% interrupts.CPU109.TLB:TLB_shootdowns
281236 ± 9% -58.3% 117395 ± 15% interrupts.CPU11.CAL:Function_call_interrupts
328299 ± 4% -31.0% 226494 ± 2% interrupts.CPU11.LOC:Local_timer_interrupts
7406 ± 26% -67.2% 2427 ± 71% interrupts.CPU11.NMI:Non-maskable_interrupts
7406 ± 26% -67.2% 2427 ± 71% interrupts.CPU11.PMI:Performance_monitoring_interrupts
1024948 ± 10% -56.2% 448543 ± 18% interrupts.CPU11.RES:Rescheduling_interrupts
257784 ± 8% -60.5% 101796 ± 10% interrupts.CPU11.TLB:TLB_shootdowns
308206 ± 23% -57.9% 129807 ± 21% interrupts.CPU110.CAL:Function_call_interrupts
328265 ± 4% -31.0% 226488 ± 2% interrupts.CPU110.LOC:Local_timer_interrupts
8400 ± 3% -76.6% 1964 ± 78% interrupts.CPU110.NMI:Non-maskable_interrupts
8400 ± 3% -76.6% 1964 ± 78% interrupts.CPU110.PMI:Performance_monitoring_interrupts
1077188 ± 8% -50.1% 537841 ± 23% interrupts.CPU110.RES:Rescheduling_interrupts
257714 ± 8% -61.0% 100514 ± 9% interrupts.CPU110.TLB:TLB_shootdowns
307496 ± 9% -51.9% 148021 ± 23% interrupts.CPU111.CAL:Function_call_interrupts
328482 ± 3% -31.0% 226508 ± 2% interrupts.CPU111.LOC:Local_timer_interrupts
7315 ± 23% -73.3% 1953 ± 79% interrupts.CPU111.NMI:Non-maskable_interrupts
7315 ± 23% -73.3% 1953 ± 79% interrupts.CPU111.PMI:Performance_monitoring_interrupts
1044697 ± 10% -53.1% 490195 ± 28% interrupts.CPU111.RES:Rescheduling_interrupts
258148 ± 8% -61.1% 100485 ± 9% interrupts.CPU111.TLB:TLB_shootdowns
281837 ± 17% -56.7% 121957 ± 16% interrupts.CPU112.CAL:Function_call_interrupts
328242 ± 4% -31.0% 226514 ± 2% interrupts.CPU112.LOC:Local_timer_interrupts
8401 ± 3% -76.8% 1949 ± 79% interrupts.CPU112.NMI:Non-maskable_interrupts
8401 ± 3% -76.8% 1949 ± 79% interrupts.CPU112.PMI:Performance_monitoring_interrupts
1066811 ± 7% -59.8% 428973 ± 24% interrupts.CPU112.RES:Rescheduling_interrupts
257987 ± 8% -60.3% 102322 ± 10% interrupts.CPU112.TLB:TLB_shootdowns
266879 ± 13% -43.5% 150693 ± 20% interrupts.CPU113.CAL:Function_call_interrupts
328392 ± 3% -31.0% 226514 ± 2% interrupts.CPU113.LOC:Local_timer_interrupts
7866 ± 17% -75.2% 1949 ± 79% interrupts.CPU113.NMI:Non-maskable_interrupts
7866 ± 17% -75.2% 1949 ± 79% interrupts.CPU113.PMI:Performance_monitoring_interrupts
1010868 ± 8% -54.0% 464563 ± 33% interrupts.CPU113.RES:Rescheduling_interrupts
258696 ± 8% -61.2% 100352 ± 9% interrupts.CPU113.TLB:TLB_shootdowns
272385 ± 9% -52.1% 130457 ± 14% interrupts.CPU114.CAL:Function_call_interrupts
328428 ± 3% -31.0% 226513 ± 2% interrupts.CPU114.LOC:Local_timer_interrupts
7886 ± 18% -77.7% 1762 ± 92% interrupts.CPU114.NMI:Non-maskable_interrupts
7886 ± 18% -77.7% 1762 ± 92% interrupts.CPU114.PMI:Performance_monitoring_interrupts
1033951 ± 13% -49.6% 521007 ± 34% interrupts.CPU114.RES:Rescheduling_interrupts
258084 ± 8% -61.1% 100346 ± 9% interrupts.CPU114.TLB:TLB_shootdowns
279416 ± 11% -47.7% 146051 ± 12% interrupts.CPU115.CAL:Function_call_interrupts
328240 ± 4% -31.0% 226489 ± 2% interrupts.CPU115.LOC:Local_timer_interrupts
8401 ± 3% -76.7% 1960 ± 78% interrupts.CPU115.NMI:Non-maskable_interrupts
8401 ± 3% -76.7% 1960 ± 78% interrupts.CPU115.PMI:Performance_monitoring_interrupts
1024106 ± 11% -52.4% 487029 ± 28% interrupts.CPU115.RES:Rescheduling_interrupts
257987 ± 8% -60.9% 100800 ± 9% interrupts.CPU115.TLB:TLB_shootdowns
287971 ± 12% -50.9% 141280 ± 24% interrupts.CPU116.CAL:Function_call_interrupts
328105 ± 4% -31.0% 226430 ± 2% interrupts.CPU116.LOC:Local_timer_interrupts
8412 ± 3% -71.1% 2427 ± 70% interrupts.CPU116.NMI:Non-maskable_interrupts
8412 ± 3% -71.1% 2427 ± 70% interrupts.CPU116.PMI:Performance_monitoring_interrupts
1047073 ± 14% -58.4% 435809 ± 26% interrupts.CPU116.RES:Rescheduling_interrupts
258022 ± 8% -61.2% 100225 ± 9% interrupts.CPU116.TLB:TLB_shootdowns
285809 ± 11% -54.7% 129370 ± 20% interrupts.CPU117.CAL:Function_call_interrupts
328304 ± 4% -31.0% 226478 ± 2% interrupts.CPU117.LOC:Local_timer_interrupts
8408 ± 3% -77.7% 1879 ± 71% interrupts.CPU117.NMI:Non-maskable_interrupts
8408 ± 3% -77.7% 1879 ± 71% interrupts.CPU117.PMI:Performance_monitoring_interrupts
1054831 ± 9% -43.7% 594331 ± 27% interrupts.CPU117.RES:Rescheduling_interrupts
258157 ± 8% -61.4% 99627 ± 9% interrupts.CPU117.TLB:TLB_shootdowns
294131 ± 10% -45.4% 160709 ± 38% interrupts.CPU118.CAL:Function_call_interrupts
328513 ± 3% -31.1% 226477 ± 2% interrupts.CPU118.LOC:Local_timer_interrupts
7895 ± 18% -82.1% 1409 ± 59% interrupts.CPU118.NMI:Non-maskable_interrupts
7895 ± 18% -82.1% 1409 ± 59% interrupts.CPU118.PMI:Performance_monitoring_interrupts
995055 ± 10% -53.8% 459356 ± 22% interrupts.CPU118.RES:Rescheduling_interrupts
258172 ± 8% -60.7% 101376 ± 9% interrupts.CPU118.TLB:TLB_shootdowns
296482 ± 12% -55.1% 133134 ± 12% interrupts.CPU119.CAL:Function_call_interrupts
328202 ± 4% -31.0% 226505 ± 2% interrupts.CPU119.LOC:Local_timer_interrupts
7321 ± 23% -80.6% 1419 ± 59% interrupts.CPU119.NMI:Non-maskable_interrupts
7321 ± 23% -80.6% 1419 ± 59% interrupts.CPU119.PMI:Performance_monitoring_interrupts
1015954 ± 10% -57.7% 429505 ± 22% interrupts.CPU119.RES:Rescheduling_interrupts
257514 ± 8% -60.8% 100946 ± 9% interrupts.CPU119.TLB:TLB_shootdowns
276018 ± 13% -47.7% 144494 ± 33% interrupts.CPU12.CAL:Function_call_interrupts
328091 ± 4% -31.0% 226479 ± 2% interrupts.CPU12.LOC:Local_timer_interrupts
7915 ± 19% -69.3% 2429 ± 71% interrupts.CPU12.NMI:Non-maskable_interrupts
7915 ± 19% -69.3% 2429 ± 71% interrupts.CPU12.PMI:Performance_monitoring_interrupts
1074262 ± 7% -55.6% 477000 ± 29% interrupts.CPU12.RES:Rescheduling_interrupts
257933 ± 8% -61.0% 100488 ± 9% interrupts.CPU12.TLB:TLB_shootdowns
303497 ± 9% -42.8% 173624 ± 21% interrupts.CPU120.CAL:Function_call_interrupts
329334 ± 3% -31.2% 226474 ± 2% interrupts.CPU120.LOC:Local_timer_interrupts
6308 ± 32% -77.8% 1398 ± 57% interrupts.CPU120.NMI:Non-maskable_interrupts
6308 ± 32% -77.8% 1398 ± 57% interrupts.CPU120.PMI:Performance_monitoring_interrupts
918449 ± 15% -48.2% 476052 ± 6% interrupts.CPU120.RES:Rescheduling_interrupts
257575 ± 8% -61.6% 98884 ± 9% interrupts.CPU120.TLB:TLB_shootdowns
299611 ± 14% -54.3% 136839 ± 13% interrupts.CPU121.CAL:Function_call_interrupts
329228 ± 3% -31.2% 226470 ± 2% interrupts.CPU121.LOC:Local_timer_interrupts
7391 ± 25% -83.7% 1204 ± 69% interrupts.CPU121.NMI:Non-maskable_interrupts
7391 ± 25% -83.7% 1204 ± 69% interrupts.CPU121.PMI:Performance_monitoring_interrupts
952284 ± 14% -43.3% 539757 ± 18% interrupts.CPU121.RES:Rescheduling_interrupts
257840 ± 8% -61.5% 99327 ± 9% interrupts.CPU121.TLB:TLB_shootdowns
322333 ± 12% -52.2% 154058 ± 9% interrupts.CPU122.CAL:Function_call_interrupts
329288 ± 3% -31.2% 226451 ± 2% interrupts.CPU122.LOC:Local_timer_interrupts
7405 ± 25% -81.1% 1398 ± 55% interrupts.CPU122.NMI:Non-maskable_interrupts
7405 ± 25% -81.1% 1398 ± 55% interrupts.CPU122.PMI:Performance_monitoring_interrupts
961796 ± 12% -51.4% 467163 ± 23% interrupts.CPU122.RES:Rescheduling_interrupts
258089 ± 8% -61.7% 98876 ± 9% interrupts.CPU122.TLB:TLB_shootdowns
290729 ± 9% -44.4% 161595 ± 6% interrupts.CPU123.CAL:Function_call_interrupts
329342 ± 3% -31.3% 226391 ± 2% interrupts.CPU123.LOC:Local_timer_interrupts
7889 ± 17% -82.3% 1394 ± 56% interrupts.CPU123.NMI:Non-maskable_interrupts
7889 ± 17% -82.3% 1394 ± 56% interrupts.CPU123.PMI:Performance_monitoring_interrupts
928180 ± 13% -47.9% 483522 ± 7% interrupts.CPU123.RES:Rescheduling_interrupts
257528 ± 8% -61.6% 98764 ± 8% interrupts.CPU123.TLB:TLB_shootdowns
288221 ± 14% -54.1% 132347 ± 19% interrupts.CPU124.CAL:Function_call_interrupts
329450 ± 3% -31.3% 226332 ± 2% interrupts.CPU124.LOC:Local_timer_interrupts
7895 ± 17% -82.4% 1390 ± 57% interrupts.CPU124.NMI:Non-maskable_interrupts
7895 ± 17% -82.4% 1390 ± 57% interrupts.CPU124.PMI:Performance_monitoring_interrupts
925478 ± 10% -42.9% 528114 ± 8% interrupts.CPU124.RES:Rescheduling_interrupts
257802 ± 8% -61.4% 99431 ± 9% interrupts.CPU124.TLB:TLB_shootdowns
294022 ± 9% -55.1% 131965 ± 12% interrupts.CPU125.CAL:Function_call_interrupts
329172 ± 3% -31.2% 226496 ± 2% interrupts.CPU125.LOC:Local_timer_interrupts
7372 ± 24% -81.1% 1396 ± 57% interrupts.CPU125.NMI:Non-maskable_interrupts
7372 ± 24% -81.1% 1396 ± 57% interrupts.CPU125.PMI:Performance_monitoring_interrupts
1026100 ± 18% -43.7% 577219 ± 8% interrupts.CPU125.RES:Rescheduling_interrupts
257902 ± 8% -61.8% 98549 ± 9% interrupts.CPU125.TLB:TLB_shootdowns
284948 ± 11% -50.9% 139811 ± 14% interrupts.CPU126.CAL:Function_call_interrupts
329243 ± 3% -31.2% 226409 ± 2% interrupts.CPU126.LOC:Local_timer_interrupts
7343 ± 23% -80.8% 1408 ± 55% interrupts.CPU126.NMI:Non-maskable_interrupts
7343 ± 23% -80.8% 1408 ± 55% interrupts.CPU126.PMI:Performance_monitoring_interrupts
942100 ± 13% -39.4% 571182 ± 21% interrupts.CPU126.RES:Rescheduling_interrupts
257785 ± 8% -61.1% 100329 ± 8% interrupts.CPU126.TLB:TLB_shootdowns
293825 ± 9% -47.0% 155800 ± 13% interrupts.CPU127.CAL:Function_call_interrupts
329377 ± 3% -31.2% 226453 ± 2% interrupts.CPU127.LOC:Local_timer_interrupts
7393 ± 24% -74.8% 1861 ± 71% interrupts.CPU127.NMI:Non-maskable_interrupts
7393 ± 24% -74.8% 1861 ± 71% interrupts.CPU127.PMI:Performance_monitoring_interrupts
867576 ± 14% -31.4% 595150 ± 14% interrupts.CPU127.RES:Rescheduling_interrupts
257825 ± 8% -61.5% 99176 ± 9% interrupts.CPU127.TLB:TLB_shootdowns
299248 ± 10% -41.8% 174117 ± 25% interrupts.CPU128.CAL:Function_call_interrupts
329354 ± 3% -31.2% 226463 ± 2% interrupts.CPU128.LOC:Local_timer_interrupts
8436 ± 3% -77.7% 1881 ± 70% interrupts.CPU128.NMI:Non-maskable_interrupts
8436 ± 3% -77.7% 1881 ± 70% interrupts.CPU128.PMI:Performance_monitoring_interrupts
954047 ± 14% -42.6% 547424 ± 4% interrupts.CPU128.RES:Rescheduling_interrupts
258038 ± 8% -61.9% 98213 ± 10% interrupts.CPU128.TLB:TLB_shootdowns
311750 ± 14% -49.0% 158993 ± 12% interrupts.CPU129.CAL:Function_call_interrupts
329280 ± 3% -31.2% 226407 ± 2% interrupts.CPU129.LOC:Local_timer_interrupts
7344 ± 23% -67.3% 2404 ± 69% interrupts.CPU129.NMI:Non-maskable_interrupts
7344 ± 23% -67.3% 2404 ± 69% interrupts.CPU129.PMI:Performance_monitoring_interrupts
979000 ± 13% -43.3% 555050 ± 16% interrupts.CPU129.RES:Rescheduling_interrupts
257878 ± 8% -62.0% 98039 ± 9% interrupts.CPU129.TLB:TLB_shootdowns
972.88 ± 91% -100.0% 0.00 interrupts.CPU13.170:PCI-MSI.524289-edge.eth0-TxRx-0
272050 ± 11% -47.0% 144250 ± 17% interrupts.CPU13.CAL:Function_call_interrupts
328108 ± 4% -31.0% 226457 ± 2% interrupts.CPU13.LOC:Local_timer_interrupts
7918 ± 19% -69.1% 2443 ± 70% interrupts.CPU13.NMI:Non-maskable_interrupts
7918 ± 19% -69.1% 2443 ± 70% interrupts.CPU13.PMI:Performance_monitoring_interrupts
1049394 ± 6% -56.8% 453843 ± 17% interrupts.CPU13.RES:Rescheduling_interrupts
258048 ± 8% -61.1% 100309 ± 9% interrupts.CPU13.TLB:TLB_shootdowns
286832 ± 9% -48.9% 146564 ± 12% interrupts.CPU130.CAL:Function_call_interrupts
329453 ± 3% -31.3% 226442 ± 2% interrupts.CPU130.LOC:Local_timer_interrupts
7892 ± 17% -69.6% 2399 ± 70% interrupts.CPU130.NMI:Non-maskable_interrupts
7892 ± 17% -69.6% 2399 ± 70% interrupts.CPU130.PMI:Performance_monitoring_interrupts
967627 ± 11% -44.3% 539211 ± 3% interrupts.CPU130.RES:Rescheduling_interrupts
257660 ± 8% -61.5% 99197 ± 8% interrupts.CPU130.TLB:TLB_shootdowns
286497 ± 10% -47.2% 151321 ± 23% interrupts.CPU131.CAL:Function_call_interrupts
329300 ± 3% -31.2% 226452 ± 2% interrupts.CPU131.LOC:Local_timer_interrupts
7894 ± 17% -69.3% 2421 ± 69% interrupts.CPU131.NMI:Non-maskable_interrupts
7894 ± 17% -69.3% 2421 ± 69% interrupts.CPU131.PMI:Performance_monitoring_interrupts
1006471 ± 15% -53.6% 466521 ± 4% interrupts.CPU131.RES:Rescheduling_interrupts
257806 ± 8% -61.5% 99214 ± 9% interrupts.CPU131.TLB:TLB_shootdowns
292173 ± 6% -51.1% 142808 ± 19% interrupts.CPU132.CAL:Function_call_interrupts
329216 ± 3% -31.2% 226354 ± 2% interrupts.CPU132.LOC:Local_timer_interrupts
7391 ± 25% -67.3% 2413 ± 69% interrupts.CPU132.NMI:Non-maskable_interrupts
7391 ± 25% -67.3% 2413 ± 69% interrupts.CPU132.PMI:Performance_monitoring_interrupts
1028667 ± 16% -51.8% 495816 ± 22% interrupts.CPU132.RES:Rescheduling_interrupts
257710 ± 8% -62.0% 97921 ± 11% interrupts.CPU132.TLB:TLB_shootdowns
279891 ± 10% -40.9% 165537 ± 6% interrupts.CPU133.CAL:Function_call_interrupts
329306 ± 3% -31.2% 226498 ± 2% interrupts.CPU133.LOC:Local_timer_interrupts
7936 ± 18% -69.8% 2396 ± 69% interrupts.CPU133.NMI:Non-maskable_interrupts
7936 ± 18% -69.8% 2396 ± 69% interrupts.CPU133.PMI:Performance_monitoring_interrupts
945794 ± 10% -41.3% 554812 ± 12% interrupts.CPU133.RES:Rescheduling_interrupts
257638 ± 8% -61.8% 98527 ± 9% interrupts.CPU133.TLB:TLB_shootdowns
303125 ± 10% -46.2% 163141 ± 13% interrupts.CPU134.CAL:Function_call_interrupts
329315 ± 3% -31.2% 226406 ± 2% interrupts.CPU134.LOC:Local_timer_interrupts
7931 ± 18% -69.4% 2426 ± 69% interrupts.CPU134.NMI:Non-maskable_interrupts
7931 ± 18% -69.4% 2426 ± 69% interrupts.CPU134.PMI:Performance_monitoring_interrupts
954594 ± 14% -41.8% 555606 ± 18% interrupts.CPU134.RES:Rescheduling_interrupts
257276 ± 8% -61.6% 98830 ± 9% interrupts.CPU134.TLB:TLB_shootdowns
315168 ± 10% -55.0% 141888 ± 13% interrupts.CPU135.CAL:Function_call_interrupts
329191 ± 3% -31.2% 226429 ± 2% interrupts.CPU135.LOC:Local_timer_interrupts
7393 ± 25% -69.9% 2225 ± 80% interrupts.CPU135.NMI:Non-maskable_interrupts
7393 ± 25% -69.9% 2225 ± 80% interrupts.CPU135.PMI:Performance_monitoring_interrupts
1014119 ± 16% -52.4% 482232 ± 9% interrupts.CPU135.RES:Rescheduling_interrupts
257609 ± 8% -60.9% 100686 ± 8% interrupts.CPU135.TLB:TLB_shootdowns
283021 ± 7% -34.8% 184415 ± 21% interrupts.CPU136.CAL:Function_call_interrupts
329353 ± 3% -31.3% 226397 ± 2% interrupts.CPU136.LOC:Local_timer_interrupts
7936 ± 18% -69.5% 2420 ± 70% interrupts.CPU136.NMI:Non-maskable_interrupts
7936 ± 18% -69.5% 2420 ± 70% interrupts.CPU136.PMI:Performance_monitoring_interrupts
991124 ± 14% -53.5% 460731 ± 27% interrupts.CPU136.RES:Rescheduling_interrupts
257834 ± 8% -61.2% 99996 ± 9% interrupts.CPU136.TLB:TLB_shootdowns
298832 ± 15% -50.3% 148585 ± 20% interrupts.CPU137.CAL:Function_call_interrupts
329401 ± 3% -31.3% 226421 ± 2% interrupts.CPU137.LOC:Local_timer_interrupts
6845 ± 29% -64.7% 2416 ± 69% interrupts.CPU137.NMI:Non-maskable_interrupts
6845 ± 29% -64.7% 2416 ± 69% interrupts.CPU137.PMI:Performance_monitoring_interrupts
942528 ± 12% -38.5% 579261 ± 10% interrupts.CPU137.RES:Rescheduling_interrupts
257716 ± 8% -61.7% 98816 ± 9% interrupts.CPU137.TLB:TLB_shootdowns
289646 ± 7% -41.3% 170096 ± 29% interrupts.CPU138.CAL:Function_call_interrupts
329286 ± 3% -31.2% 226458 ± 2% interrupts.CPU138.LOC:Local_timer_interrupts
7388 ± 25% -67.0% 2439 ± 68% interrupts.CPU138.NMI:Non-maskable_interrupts
7388 ± 25% -67.0% 2439 ± 68% interrupts.CPU138.PMI:Performance_monitoring_interrupts
978150 ± 16% -46.2% 526563 ± 8% interrupts.CPU138.RES:Rescheduling_interrupts
257657 ± 8% -61.6% 98903 ± 9% interrupts.CPU138.TLB:TLB_shootdowns
289493 ± 13% -48.8% 148270 ± 22% interrupts.CPU139.CAL:Function_call_interrupts
329173 ± 3% -31.2% 226452 ± 2% interrupts.CPU139.LOC:Local_timer_interrupts
7388 ± 25% -67.3% 2417 ± 70% interrupts.CPU139.NMI:Non-maskable_interrupts
7388 ± 25% -67.3% 2417 ± 70% interrupts.CPU139.PMI:Performance_monitoring_interrupts
1027026 ± 14% -52.0% 493279 ± 12% interrupts.CPU139.RES:Rescheduling_interrupts
257290 ± 8% -61.7% 98435 ± 8% interrupts.CPU139.TLB:TLB_shootdowns
9984 ±174% -100.0% 0.00 interrupts.CPU14.171:PCI-MSI.524290-edge.eth0-TxRx-1
279501 ± 11% -54.8% 126381 ± 14% interrupts.CPU14.CAL:Function_call_interrupts
328220 ± 4% -31.0% 226484 ± 2% interrupts.CPU14.LOC:Local_timer_interrupts
7856 ± 17% -69.0% 2433 ± 70% interrupts.CPU14.NMI:Non-maskable_interrupts
7856 ± 17% -69.0% 2433 ± 70% interrupts.CPU14.PMI:Performance_monitoring_interrupts
1098244 ± 10% -52.4% 522697 ± 25% interrupts.CPU14.RES:Rescheduling_interrupts
258007 ± 8% -61.3% 99781 ± 9% interrupts.CPU14.TLB:TLB_shootdowns
284830 ± 12% -42.4% 164177 ± 16% interrupts.CPU140.CAL:Function_call_interrupts
329357 ± 3% -31.2% 226449 ± 2% interrupts.CPU140.LOC:Local_timer_interrupts
7348 ± 23% -67.2% 2410 ± 70% interrupts.CPU140.NMI:Non-maskable_interrupts
7348 ± 23% -67.2% 2410 ± 70% interrupts.CPU140.PMI:Performance_monitoring_interrupts
998982 ± 14% -44.7% 552877 ± 12% interrupts.CPU140.RES:Rescheduling_interrupts
257796 ± 8% -61.5% 99375 ± 9% interrupts.CPU140.TLB:TLB_shootdowns
286371 ± 8% -44.7% 158489 ± 26% interrupts.CPU141.CAL:Function_call_interrupts
329315 ± 3% -31.2% 226449 ± 2% interrupts.CPU141.LOC:Local_timer_interrupts
7889 ± 17% -72.1% 2203 ± 83% interrupts.CPU141.NMI:Non-maskable_interrupts
7889 ± 17% -72.1% 2203 ± 83% interrupts.CPU141.PMI:Performance_monitoring_interrupts
990139 ± 16% -43.3% 561079 ± 14% interrupts.CPU141.RES:Rescheduling_interrupts
257859 ± 8% -61.8% 98627 ± 9% interrupts.CPU141.TLB:TLB_shootdowns
282077 ± 8% -42.9% 161190 ± 16% interrupts.CPU142.CAL:Function_call_interrupts
329188 ± 3% -31.2% 226373 ± 2% interrupts.CPU142.LOC:Local_timer_interrupts
7345 ± 23% -67.5% 2387 ± 71% interrupts.CPU142.NMI:Non-maskable_interrupts
7345 ± 23% -67.5% 2387 ± 71% interrupts.CPU142.PMI:Performance_monitoring_interrupts
957095 ± 14% -43.8% 538050 ± 14% interrupts.CPU142.RES:Rescheduling_interrupts
256620 ± 8% -61.6% 98593 ± 9% interrupts.CPU142.TLB:TLB_shootdowns
272670 ± 9% -47.5% 143237 ± 13% interrupts.CPU143.CAL:Function_call_interrupts
329352 ± 3% -31.2% 226463 ± 2% interrupts.CPU143.LOC:Local_timer_interrupts
7893 ± 17% -72.2% 2192 ± 83% interrupts.CPU143.NMI:Non-maskable_interrupts
7893 ± 17% -72.2% 2192 ± 83% interrupts.CPU143.PMI:Performance_monitoring_interrupts
1005022 ± 12% -48.1% 521140 ± 9% interrupts.CPU143.RES:Rescheduling_interrupts
258876 ± 8% -61.8% 98770 ± 9% interrupts.CPU143.TLB:TLB_shootdowns
333694 ± 14% -52.1% 159821 ± 11% interrupts.CPU144.CAL:Function_call_interrupts
329297 ± 3% -31.2% 226475 ± 2% interrupts.CPU144.LOC:Local_timer_interrupts
7885 ± 17% -71.7% 2228 ± 83% interrupts.CPU144.NMI:Non-maskable_interrupts
7885 ± 17% -71.7% 2228 ± 83% interrupts.CPU144.PMI:Performance_monitoring_interrupts
964316 ± 11% -52.7% 455662 ± 46% interrupts.CPU144.RES:Rescheduling_interrupts
257414 ± 8% -61.2% 99829 ± 9% interrupts.CPU144.TLB:TLB_shootdowns
306949 ± 12% -54.9% 138333 ± 10% interrupts.CPU145.CAL:Function_call_interrupts
329353 ± 3% -31.2% 226504 ± 2% interrupts.CPU145.LOC:Local_timer_interrupts
7891 ± 17% -71.9% 2217 ± 83% interrupts.CPU145.NMI:Non-maskable_interrupts
7891 ± 17% -71.9% 2217 ± 83% interrupts.CPU145.PMI:Performance_monitoring_interrupts
986613 ± 10% -55.5% 439028 ± 26% interrupts.CPU145.RES:Rescheduling_interrupts
257503 ± 8% -61.6% 98923 ± 9% interrupts.CPU145.TLB:TLB_shootdowns
291522 ± 10% -46.6% 155603 ± 27% interrupts.CPU146.CAL:Function_call_interrupts
329487 ± 3% -31.3% 226461 ± 2% interrupts.CPU146.LOC:Local_timer_interrupts
7879 ± 17% -71.7% 2226 ± 83% interrupts.CPU146.NMI:Non-maskable_interrupts
7879 ± 17% -71.7% 2226 ± 83% interrupts.CPU146.PMI:Performance_monitoring_interrupts
1056100 ± 5% -54.3% 483086 ± 21% interrupts.CPU146.RES:Rescheduling_interrupts
257402 ± 8% -61.4% 99328 ± 8% interrupts.CPU146.TLB:TLB_shootdowns
310580 ± 10% -50.9% 152542 ± 18% interrupts.CPU147.CAL:Function_call_interrupts
329264 ± 3% -31.2% 226524 ± 2% interrupts.CPU147.LOC:Local_timer_interrupts
7882 ± 17% -84.6% 1216 ± 70% interrupts.CPU147.NMI:Non-maskable_interrupts
7882 ± 17% -84.6% 1216 ± 70% interrupts.CPU147.PMI:Performance_monitoring_interrupts
1024842 ± 11% -49.8% 513970 ± 36% interrupts.CPU147.RES:Rescheduling_interrupts
257282 ± 8% -61.3% 99621 ± 8% interrupts.CPU147.TLB:TLB_shootdowns
296930 ± 7% -48.6% 152670 ± 20% interrupts.CPU148.CAL:Function_call_interrupts
329427 ± 3% -31.3% 226477 ± 2% interrupts.CPU148.LOC:Local_timer_interrupts
7881 ± 17% -71.8% 2219 ± 83% interrupts.CPU148.NMI:Non-maskable_interrupts
7881 ± 17% -71.8% 2219 ± 83% interrupts.CPU148.PMI:Performance_monitoring_interrupts
983707 ± 16% -60.5% 388783 ± 31% interrupts.CPU148.RES:Rescheduling_interrupts
257310 ± 8% -61.5% 99032 ± 9% interrupts.CPU148.TLB:TLB_shootdowns
304935 ± 5% -53.2% 142577 ± 22% interrupts.CPU149.CAL:Function_call_interrupts
329359 ± 3% -31.2% 226480 ± 2% interrupts.CPU149.LOC:Local_timer_interrupts
7878 ± 17% -71.7% 2226 ± 83% interrupts.CPU149.NMI:Non-maskable_interrupts
7878 ± 17% -71.7% 2226 ± 83% interrupts.CPU149.PMI:Performance_monitoring_interrupts
990812 ± 10% -55.0% 446287 ± 18% interrupts.CPU149.RES:Rescheduling_interrupts
257249 ± 8% -61.6% 98690 ± 8% interrupts.CPU149.TLB:TLB_shootdowns
2684 ±130% -100.0% 0.00 interrupts.CPU15.172:PCI-MSI.524291-edge.eth0-TxRx-2
291825 ± 15% -49.9% 146328 ± 13% interrupts.CPU15.CAL:Function_call_interrupts
328319 ± 4% -31.0% 226489 ± 2% interrupts.CPU15.LOC:Local_timer_interrupts
7855 ± 17% -69.1% 2425 ± 71% interrupts.CPU15.NMI:Non-maskable_interrupts
7855 ± 17% -69.1% 2425 ± 71% interrupts.CPU15.PMI:Performance_monitoring_interrupts
1052306 ± 10% -52.6% 498301 ± 29% interrupts.CPU15.RES:Rescheduling_interrupts
258202 ± 8% -61.4% 99681 ± 9% interrupts.CPU15.TLB:TLB_shootdowns
289410 ± 8% -46.9% 153589 ± 24% interrupts.CPU150.CAL:Function_call_interrupts
329409 ± 3% -31.2% 226535 ± 2% interrupts.CPU150.LOC:Local_timer_interrupts
7876 ± 17% -71.8% 2220 ± 83% interrupts.CPU150.NMI:Non-maskable_interrupts
7876 ± 17% -71.8% 2220 ± 83% interrupts.CPU150.PMI:Performance_monitoring_interrupts
1006334 ± 10% -54.7% 455495 ± 26% interrupts.CPU150.RES:Rescheduling_interrupts
257079 ± 8% -61.3% 99585 ± 8% interrupts.CPU150.TLB:TLB_shootdowns
293734 ± 11% -52.5% 139392 ± 19% interrupts.CPU151.CAL:Function_call_interrupts
329425 ± 3% -31.2% 226512 ± 2% interrupts.CPU151.LOC:Local_timer_interrupts
7892 ± 17% -71.8% 2223 ± 83% interrupts.CPU151.NMI:Non-maskable_interrupts
7892 ± 17% -71.8% 2223 ± 83% interrupts.CPU151.PMI:Performance_monitoring_interrupts
1081623 ± 11% -54.9% 487397 ± 30% interrupts.CPU151.RES:Rescheduling_interrupts
257625 ± 8% -61.6% 98925 ± 9% interrupts.CPU151.TLB:TLB_shootdowns
295784 ± 7% -47.6% 154959 ± 14% interrupts.CPU152.CAL:Function_call_interrupts
329440 ± 3% -31.3% 226472 ± 2% interrupts.CPU152.LOC:Local_timer_interrupts
7876 ± 17% -75.4% 1936 ± 79% interrupts.CPU152.NMI:Non-maskable_interrupts
7876 ± 17% -75.4% 1936 ± 79% interrupts.CPU152.PMI:Performance_monitoring_interrupts
1006135 ± 10% -54.5% 457786 ± 26% interrupts.CPU152.RES:Rescheduling_interrupts
257236 ± 8% -61.4% 99257 ± 8% interrupts.CPU152.TLB:TLB_shootdowns
296450 ± 10% -59.1% 121298 ± 7% interrupts.CPU153.CAL:Function_call_interrupts
329395 ± 3% -31.2% 226481 ± 2% interrupts.CPU153.LOC:Local_timer_interrupts
8421 ± 3% -71.5% 2400 ± 72% interrupts.CPU153.NMI:Non-maskable_interrupts
8421 ± 3% -71.5% 2400 ± 72% interrupts.CPU153.PMI:Performance_monitoring_interrupts
1061117 ± 14% -60.9% 415225 ± 36% interrupts.CPU153.RES:Rescheduling_interrupts
257379 ± 8% -61.2% 99953 ± 9% interrupts.CPU153.TLB:TLB_shootdowns
293891 ± 6% -55.7% 130282 ± 16% interrupts.CPU154.CAL:Function_call_interrupts
329419 ± 3% -31.2% 226477 ± 2% interrupts.CPU154.LOC:Local_timer_interrupts
8424 ± 3% -71.5% 2401 ± 72% interrupts.CPU154.NMI:Non-maskable_interrupts
8424 ± 3% -71.5% 2401 ± 72% interrupts.CPU154.PMI:Performance_monitoring_interrupts
1073314 ± 10% -51.3% 523189 ± 25% interrupts.CPU154.RES:Rescheduling_interrupts
257474 ± 8% -61.3% 99694 ± 9% interrupts.CPU154.TLB:TLB_shootdowns
306511 ± 11% -48.3% 158404 ± 30% interrupts.CPU155.CAL:Function_call_interrupts
329321 ± 3% -31.2% 226493 ± 2% interrupts.CPU155.LOC:Local_timer_interrupts
8418 ± 3% -71.2% 2423 ± 71% interrupts.CPU155.NMI:Non-maskable_interrupts
8418 ± 3% -71.2% 2423 ± 71% interrupts.CPU155.PMI:Performance_monitoring_interrupts
1027476 ± 16% -52.6% 486519 ± 22% interrupts.CPU155.RES:Rescheduling_interrupts
257029 ± 8% -61.5% 98896 ± 9% interrupts.CPU155.TLB:TLB_shootdowns
289626 ± 8% -48.5% 149187 ± 14% interrupts.CPU156.CAL:Function_call_interrupts
329396 ± 3% -31.2% 226498 ± 2% interrupts.CPU156.LOC:Local_timer_interrupts
8420 ± 3% -71.4% 2407 ± 71% interrupts.CPU156.NMI:Non-maskable_interrupts
8420 ± 3% -71.4% 2407 ± 71% interrupts.CPU156.PMI:Performance_monitoring_interrupts
979138 ± 14% -50.8% 482044 ± 17% interrupts.CPU156.RES:Rescheduling_interrupts
257193 ± 8% -61.3% 99558 ± 8% interrupts.CPU156.TLB:TLB_shootdowns
308705 ± 7% -48.2% 159907 ± 18% interrupts.CPU157.CAL:Function_call_interrupts
329315 ± 3% -31.2% 226463 ± 2% interrupts.CPU157.LOC:Local_timer_interrupts
7911 ± 18% -69.6% 2407 ± 72% interrupts.CPU157.NMI:Non-maskable_interrupts
7911 ± 18% -69.6% 2407 ± 72% interrupts.CPU157.PMI:Performance_monitoring_interrupts
1032768 ± 14% -51.5% 500819 ± 30% interrupts.CPU157.RES:Rescheduling_interrupts
257145 ± 8% -61.4% 99178 ± 9% interrupts.CPU157.TLB:TLB_shootdowns
291081 ± 9% -45.8% 157839 ± 24% interrupts.CPU158.CAL:Function_call_interrupts
329470 ± 3% -31.3% 226459 ± 2% interrupts.CPU158.LOC:Local_timer_interrupts
7877 ± 17% -69.5% 2404 ± 71% interrupts.CPU158.NMI:Non-maskable_interrupts
7877 ± 17% -69.5% 2404 ± 71% interrupts.CPU158.PMI:Performance_monitoring_interrupts
997795 ± 15% -53.4% 465124 ± 24% interrupts.CPU158.RES:Rescheduling_interrupts
257394 ± 8% -61.8% 98357 ± 9% interrupts.CPU158.TLB:TLB_shootdowns
295300 ± 6% -47.0% 156466 ± 19% interrupts.CPU159.CAL:Function_call_interrupts
329477 ± 3% -31.3% 226464 ± 2% interrupts.CPU159.LOC:Local_timer_interrupts
7881 ± 17% -69.4% 2413 ± 72% interrupts.CPU159.NMI:Non-maskable_interrupts
7881 ± 17% -69.4% 2413 ± 72% interrupts.CPU159.PMI:Performance_monitoring_interrupts
1047788 ± 13% -52.0% 502721 ± 34% interrupts.CPU159.RES:Rescheduling_interrupts
257095 ± 8% -61.4% 99289 ± 9% interrupts.CPU159.TLB:TLB_shootdowns
3306 ±200% -100.0% 0.00 interrupts.CPU16.173:PCI-MSI.524292-edge.eth0-TxRx-3
270647 ± 9% -55.2% 121375 ± 10% interrupts.CPU16.CAL:Function_call_interrupts
328319 ± 4% -31.0% 226486 ± 2% interrupts.CPU16.LOC:Local_timer_interrupts
7855 ± 17% -76.0% 1885 ± 70% interrupts.CPU16.NMI:Non-maskable_interrupts
7855 ± 17% -76.0% 1885 ± 70% interrupts.CPU16.PMI:Performance_monitoring_interrupts
1058465 ± 12% -56.8% 456887 ± 22% interrupts.CPU16.RES:Rescheduling_interrupts
258524 ± 8% -61.5% 99449 ± 9% interrupts.CPU16.TLB:TLB_shootdowns
320020 ± 11% -55.6% 141993 ± 13% interrupts.CPU160.CAL:Function_call_interrupts
329435 ± 3% -31.3% 226471 ± 2% interrupts.CPU160.LOC:Local_timer_interrupts
7882 ± 17% -71.8% 2222 ± 83% interrupts.CPU160.NMI:Non-maskable_interrupts
7882 ± 17% -71.8% 2222 ± 83% interrupts.CPU160.PMI:Performance_monitoring_interrupts
999170 ± 9% -53.7% 462173 ± 18% interrupts.CPU160.RES:Rescheduling_interrupts
257011 ± 8% -61.5% 99011 ± 9% interrupts.CPU160.TLB:TLB_shootdowns
290965 ± 7% -53.3% 135949 ± 19% interrupts.CPU161.CAL:Function_call_interrupts
329364 ± 3% -31.2% 226534 ± 2% interrupts.CPU161.LOC:Local_timer_interrupts
7870 ± 17% -71.8% 2221 ± 83% interrupts.CPU161.NMI:Non-maskable_interrupts
7870 ± 17% -71.8% 2221 ± 83% interrupts.CPU161.PMI:Performance_monitoring_interrupts
1035236 ± 12% -54.6% 469741 ± 38% interrupts.CPU161.RES:Rescheduling_interrupts
257584 ± 8% -61.6% 98980 ± 8% interrupts.CPU161.TLB:TLB_shootdowns
289576 ± 12% -47.6% 151710 ± 17% interrupts.CPU162.CAL:Function_call_interrupts
329380 ± 3% -31.2% 226508 ± 2% interrupts.CPU162.LOC:Local_timer_interrupts
7881 ± 17% -71.7% 2231 ± 83% interrupts.CPU162.NMI:Non-maskable_interrupts
7881 ± 17% -71.7% 2231 ± 83% interrupts.CPU162.PMI:Performance_monitoring_interrupts
1060995 ± 13% -55.6% 471084 ± 23% interrupts.CPU162.RES:Rescheduling_interrupts
257082 ± 8% -61.1% 99952 ± 8% interrupts.CPU162.TLB:TLB_shootdowns
292754 ± 14% -40.8% 173417 ± 39% interrupts.CPU163.CAL:Function_call_interrupts
329473 ± 3% -31.3% 226452 ± 2% interrupts.CPU163.LOC:Local_timer_interrupts
7869 ± 17% -77.8% 1747 ± 93% interrupts.CPU163.NMI:Non-maskable_interrupts
7869 ± 17% -77.8% 1747 ± 93% interrupts.CPU163.PMI:Performance_monitoring_interrupts
1013247 ± 5% -59.7% 408037 ± 17% interrupts.CPU163.RES:Rescheduling_interrupts
257251 ± 8% -61.6% 98910 ± 9% interrupts.CPU163.TLB:TLB_shootdowns
310402 ± 9% -53.5% 144203 ± 18% interrupts.CPU164.CAL:Function_call_interrupts
329394 ± 3% -31.2% 226485 ± 2% interrupts.CPU164.LOC:Local_timer_interrupts
7868 ± 17% -71.9% 2211 ± 83% interrupts.CPU164.NMI:Non-maskable_interrupts
7868 ± 17% -71.9% 2211 ± 83% interrupts.CPU164.PMI:Performance_monitoring_interrupts
952350 ± 9% -46.0% 514018 ± 38% interrupts.CPU164.RES:Rescheduling_interrupts
257237 ± 8% -61.5% 99093 ± 9% interrupts.CPU164.TLB:TLB_shootdowns
299644 ± 11% -53.2% 140357 ± 27% interrupts.CPU165.CAL:Function_call_interrupts
329336 ± 3% -31.3% 226285 ± 2% interrupts.CPU165.LOC:Local_timer_interrupts
7873 ± 17% -71.9% 2214 ± 83% interrupts.CPU165.NMI:Non-maskable_interrupts
7873 ± 17% -71.9% 2214 ± 83% interrupts.CPU165.PMI:Performance_monitoring_interrupts
992780 ± 12% -51.8% 478666 ± 24% interrupts.CPU165.RES:Rescheduling_interrupts
256840 ± 8% -61.2% 99550 ± 8% interrupts.CPU165.TLB:TLB_shootdowns
300387 ± 15% -55.5% 133531 ± 17% interrupts.CPU166.CAL:Function_call_interrupts
329358 ± 3% -31.2% 226490 ± 2% interrupts.CPU166.LOC:Local_timer_interrupts
7873 ± 17% -71.9% 2210 ± 83% interrupts.CPU166.NMI:Non-maskable_interrupts
7873 ± 17% -71.9% 2210 ± 83% interrupts.CPU166.PMI:Performance_monitoring_interrupts
1061795 ± 13% -55.7% 470542 ± 30% interrupts.CPU166.RES:Rescheduling_interrupts
257476 ± 8% -61.5% 99027 ± 8% interrupts.CPU166.TLB:TLB_shootdowns
296889 ± 10% -48.7% 152252 ± 18% interrupts.CPU167.CAL:Function_call_interrupts
329351 ± 3% -31.2% 226476 ± 2% interrupts.CPU167.LOC:Local_timer_interrupts
7888 ± 17% -71.9% 2214 ± 83% interrupts.CPU167.NMI:Non-maskable_interrupts
7888 ± 17% -71.9% 2214 ± 83% interrupts.CPU167.PMI:Performance_monitoring_interrupts
1049449 ± 11% -56.9% 452527 ± 27% interrupts.CPU167.RES:Rescheduling_interrupts
257447 ± 8% -61.4% 99269 ± 8% interrupts.CPU167.TLB:TLB_shootdowns
312722 ± 10% -56.4% 136385 ± 10% interrupts.CPU168.CAL:Function_call_interrupts
329175 ± 3% -31.2% 226394 ± 2% interrupts.CPU168.LOC:Local_timer_interrupts
8375 ± 4% -73.5% 2223 ± 82% interrupts.CPU168.NMI:Non-maskable_interrupts
8375 ± 4% -73.5% 2223 ± 82% interrupts.CPU168.PMI:Performance_monitoring_interrupts
1024940 ± 12% -57.2% 438712 ± 11% interrupts.CPU168.RES:Rescheduling_interrupts
256700 ± 8% -61.2% 99632 ± 9% interrupts.CPU168.TLB:TLB_shootdowns
319671 ± 13% -62.6% 119600 ± 8% interrupts.CPU169.CAL:Function_call_interrupts
329318 ± 3% -31.2% 226496 ± 2% interrupts.CPU169.LOC:Local_timer_interrupts
7818 ± 17% -71.8% 2206 ± 83% interrupts.CPU169.NMI:Non-maskable_interrupts
7818 ± 17% -71.8% 2206 ± 83% interrupts.CPU169.PMI:Performance_monitoring_interrupts
1095397 ± 15% -57.0% 471273 ± 21% interrupts.CPU169.RES:Rescheduling_interrupts
257355 ± 8% -61.4% 99445 ± 9% interrupts.CPU169.TLB:TLB_shootdowns
273560 ± 10% -44.1% 153053 ± 17% interrupts.CPU17.CAL:Function_call_interrupts
328254 ± 4% -31.0% 226461 ± 2% interrupts.CPU17.LOC:Local_timer_interrupts
7856 ± 17% -78.6% 1679 ± 84% interrupts.CPU17.NMI:Non-maskable_interrupts
7856 ± 17% -78.6% 1679 ± 84% interrupts.CPU17.PMI:Performance_monitoring_interrupts
1018839 ± 5% -54.4% 464970 ± 26% interrupts.CPU17.RES:Rescheduling_interrupts
257926 ± 8% -60.7% 101414 ± 9% interrupts.CPU17.TLB:TLB_shootdowns
308997 ± 11% -57.8% 130283 ± 16% interrupts.CPU170.CAL:Function_call_interrupts
329149 ± 3% -31.2% 226439 ± 2% interrupts.CPU170.LOC:Local_timer_interrupts
7829 ± 17% -71.8% 2207 ± 83% interrupts.CPU170.NMI:Non-maskable_interrupts
7829 ± 17% -71.8% 2207 ± 83% interrupts.CPU170.PMI:Performance_monitoring_interrupts
1096744 ± 9% -53.9% 506118 ± 16% interrupts.CPU170.RES:Rescheduling_interrupts
257144 ± 8% -61.1% 100109 ± 9% interrupts.CPU170.TLB:TLB_shootdowns
296392 ± 10% -38.6% 182053 ± 11% interrupts.CPU171.CAL:Function_call_interrupts
329319 ± 3% -31.2% 226463 ± 2% interrupts.CPU171.LOC:Local_timer_interrupts
8365 ± 4% -80.1% 1667 ± 86% interrupts.CPU171.NMI:Non-maskable_interrupts
8365 ± 4% -80.1% 1667 ± 86% interrupts.CPU171.PMI:Performance_monitoring_interrupts
1069493 ± 11% -55.6% 474322 ± 21% interrupts.CPU171.RES:Rescheduling_interrupts
257448 ± 8% -61.1% 100102 ± 9% interrupts.CPU171.TLB:TLB_shootdowns
294710 ± 14% -54.4% 134362 ± 15% interrupts.CPU172.CAL:Function_call_interrupts
329207 ± 3% -31.2% 226455 ± 2% interrupts.CPU172.LOC:Local_timer_interrupts
8367 ± 4% -73.5% 2216 ± 82% interrupts.CPU172.NMI:Non-maskable_interrupts
8367 ± 4% -73.5% 2216 ± 82% interrupts.CPU172.PMI:Performance_monitoring_interrupts
1063522 ± 10% -52.1% 509395 ± 15% interrupts.CPU172.RES:Rescheduling_interrupts
257163 ± 8% -61.5% 99015 ± 9% interrupts.CPU172.TLB:TLB_shootdowns
282972 ± 5% -48.8% 144901 ± 15% interrupts.CPU173.CAL:Function_call_interrupts
329208 ± 3% -31.3% 226312 ± 2% interrupts.CPU173.LOC:Local_timer_interrupts
7830 ± 17% -71.8% 2206 ± 83% interrupts.CPU173.NMI:Non-maskable_interrupts
7830 ± 17% -71.8% 2206 ± 83% interrupts.CPU173.PMI:Performance_monitoring_interrupts
1135213 ± 16% -59.7% 457769 ± 22% interrupts.CPU173.RES:Rescheduling_interrupts
257312 ± 8% -61.1% 100176 ± 10% interrupts.CPU173.TLB:TLB_shootdowns
297394 ± 13% -51.2% 145259 ± 12% interrupts.CPU174.CAL:Function_call_interrupts
329131 ± 3% -31.2% 226437 ± 2% interrupts.CPU174.LOC:Local_timer_interrupts
8367 ± 4% -79.2% 1743 ± 91% interrupts.CPU174.NMI:Non-maskable_interrupts
8367 ± 4% -79.2% 1743 ± 91% interrupts.CPU174.PMI:Performance_monitoring_interrupts
1153439 ± 14% -62.7% 430348 ± 12% interrupts.CPU174.RES:Rescheduling_interrupts
257250 ± 8% -61.0% 100223 ± 9% interrupts.CPU174.TLB:TLB_shootdowns
286662 ± 9% -51.7% 138571 ± 12% interrupts.CPU175.CAL:Function_call_interrupts
329128 ± 3% -31.2% 226454 ± 2% interrupts.CPU175.LOC:Local_timer_interrupts
8371 ± 4% -73.6% 2210 ± 83% interrupts.CPU175.NMI:Non-maskable_interrupts
8371 ± 4% -73.6% 2210 ± 83% interrupts.CPU175.PMI:Performance_monitoring_interrupts
1097418 ± 11% -59.5% 444522 ± 20% interrupts.CPU175.RES:Rescheduling_interrupts
257248 ± 8% -60.8% 100896 ± 8% interrupts.CPU175.TLB:TLB_shootdowns
293618 ± 14% -49.2% 149139 ± 24% interrupts.CPU176.CAL:Function_call_interrupts
329176 ± 3% -31.2% 226433 ± 2% interrupts.CPU176.LOC:Local_timer_interrupts
7825 ± 17% -69.6% 2375 ± 72% interrupts.CPU176.NMI:Non-maskable_interrupts
7825 ± 17% -69.6% 2375 ± 72% interrupts.CPU176.PMI:Performance_monitoring_interrupts
1146663 ± 9% -61.0% 446744 ± 14% interrupts.CPU176.RES:Rescheduling_interrupts
257793 ± 8% -61.5% 99369 ± 9% interrupts.CPU176.TLB:TLB_shootdowns
287853 ± 9% -54.2% 131856 ± 5% interrupts.CPU177.CAL:Function_call_interrupts
329142 ± 3% -31.2% 226455 ± 2% interrupts.CPU177.LOC:Local_timer_interrupts
8364 ± 4% -79.3% 1735 ± 93% interrupts.CPU177.NMI:Non-maskable_interrupts
8364 ± 4% -79.3% 1735 ± 93% interrupts.CPU177.PMI:Performance_monitoring_interrupts
1101639 ± 10% -55.6% 489252 ± 23% interrupts.CPU177.RES:Rescheduling_interrupts
256796 ± 8% -61.2% 99752 ± 7% interrupts.CPU177.TLB:TLB_shootdowns
283212 ± 11% -47.1% 149689 ± 18% interrupts.CPU178.CAL:Function_call_interrupts
329153 ± 3% -31.2% 226443 ± 2% interrupts.CPU178.LOC:Local_timer_interrupts
7824 ± 17% -71.8% 2207 ± 83% interrupts.CPU178.NMI:Non-maskable_interrupts
7824 ± 17% -71.8% 2207 ± 83% interrupts.CPU178.PMI:Performance_monitoring_interrupts
1043935 ± 10% -49.7% 525200 ± 21% interrupts.CPU178.RES:Rescheduling_interrupts
257173 ± 8% -61.1% 99923 ± 8% interrupts.CPU178.TLB:TLB_shootdowns
297677 ± 13% -53.0% 139782 ± 18% interrupts.CPU179.CAL:Function_call_interrupts
329121 ± 3% -31.2% 226458 ± 2% interrupts.CPU179.LOC:Local_timer_interrupts
8364 ± 4% -79.1% 1745 ± 92% interrupts.CPU179.NMI:Non-maskable_interrupts
8364 ± 4% -79.1% 1745 ± 92% interrupts.CPU179.PMI:Performance_monitoring_interrupts
1115011 ± 8% -57.8% 470826 ± 28% interrupts.CPU179.RES:Rescheduling_interrupts
257108 ± 8% -61.4% 99154 ± 8% interrupts.CPU179.TLB:TLB_shootdowns
273378 ± 12% -47.4% 143670 ± 16% interrupts.CPU18.CAL:Function_call_interrupts
328300 ± 4% -31.0% 226402 ± 2% interrupts.CPU18.LOC:Local_timer_interrupts
8399 ± 3% -79.9% 1684 ± 84% interrupts.CPU18.NMI:Non-maskable_interrupts
8399 ± 3% -79.9% 1684 ± 84% interrupts.CPU18.PMI:Performance_monitoring_interrupts
1010309 ± 15% -48.8% 517159 ± 26% interrupts.CPU18.RES:Rescheduling_interrupts
258131 ± 8% -61.0% 100640 ± 9% interrupts.CPU18.TLB:TLB_shootdowns
289941 ± 10% -44.7% 160438 ± 14% interrupts.CPU180.CAL:Function_call_interrupts
329160 ± 3% -31.2% 226483 ± 2% interrupts.CPU180.LOC:Local_timer_interrupts
8365 ± 4% -73.6% 2211 ± 83% interrupts.CPU180.NMI:Non-maskable_interrupts
8365 ± 4% -73.6% 2211 ± 83% interrupts.CPU180.PMI:Performance_monitoring_interrupts
1133848 ± 15% -57.9% 477476 ± 26% interrupts.CPU180.RES:Rescheduling_interrupts
257103 ± 8% -61.6% 98725 ± 9% interrupts.CPU180.TLB:TLB_shootdowns
290956 ± 8% -48.2% 150665 ± 6% interrupts.CPU181.CAL:Function_call_interrupts
329283 ± 3% -31.2% 226457 ± 2% interrupts.CPU181.LOC:Local_timer_interrupts
7821 ± 17% -77.7% 1742 ± 93% interrupts.CPU181.NMI:Non-maskable_interrupts
7821 ± 17% -77.7% 1742 ± 93% interrupts.CPU181.PMI:Performance_monitoring_interrupts
1062850 ± 13% -56.4% 463337 ± 13% interrupts.CPU181.RES:Rescheduling_interrupts
256985 ± 8% -61.5% 98889 ± 9% interrupts.CPU181.TLB:TLB_shootdowns
278524 ± 8% -52.2% 133170 ± 16% interrupts.CPU182.CAL:Function_call_interrupts
329290 ± 3% -31.2% 226426 ± 2% interrupts.CPU182.LOC:Local_timer_interrupts
8363 ± 4% -73.6% 2211 ± 82% interrupts.CPU182.NMI:Non-maskable_interrupts
8363 ± 4% -73.6% 2211 ± 82% interrupts.CPU182.PMI:Performance_monitoring_interrupts
1094478 ± 14% -54.0% 503737 ± 7% interrupts.CPU182.RES:Rescheduling_interrupts
257187 ± 8% -61.3% 99443 ± 8% interrupts.CPU182.TLB:TLB_shootdowns
306456 ± 16% -54.3% 139945 ± 32% interrupts.CPU183.CAL:Function_call_interrupts
329283 ± 3% -31.2% 226431 ± 2% interrupts.CPU183.LOC:Local_timer_interrupts
8364 ± 4% -73.8% 2195 ± 84% interrupts.CPU183.NMI:Non-maskable_interrupts
8364 ± 4% -73.8% 2195 ± 84% interrupts.CPU183.PMI:Performance_monitoring_interrupts
1096037 ± 11% -60.2% 435748 ± 27% interrupts.CPU183.RES:Rescheduling_interrupts
257472 ± 8% -61.3% 99566 ± 8% interrupts.CPU183.TLB:TLB_shootdowns
297657 ± 9% -48.4% 153688 ± 48% interrupts.CPU184.CAL:Function_call_interrupts
329311 ± 3% -31.2% 226425 ± 2% interrupts.CPU184.LOC:Local_timer_interrupts
7824 ± 17% -71.9% 2197 ± 84% interrupts.CPU184.NMI:Non-maskable_interrupts
7824 ± 17% -71.9% 2197 ± 84% interrupts.CPU184.PMI:Performance_monitoring_interrupts
1101357 ± 11% -57.9% 463168 ± 12% interrupts.CPU184.RES:Rescheduling_interrupts
257297 ± 8% -60.9% 100533 ± 9% interrupts.CPU184.TLB:TLB_shootdowns
289406 ± 7% -57.8% 122117 ± 4% interrupts.CPU185.CAL:Function_call_interrupts
329310 ± 3% -31.3% 226364 ± 2% interrupts.CPU185.LOC:Local_timer_interrupts
8363 ± 4% -73.7% 2199 ± 84% interrupts.CPU185.NMI:Non-maskable_interrupts
8363 ± 4% -73.7% 2199 ± 84% interrupts.CPU185.PMI:Performance_monitoring_interrupts
1115253 ± 12% -62.2% 421254 ± 14% interrupts.CPU185.RES:Rescheduling_interrupts
257474 ± 8% -61.0% 100401 ± 8% interrupts.CPU185.TLB:TLB_shootdowns
291984 ± 9% -47.2% 154267 ± 7% interrupts.CPU186.CAL:Function_call_interrupts
329326 ± 3% -31.2% 226462 ± 2% interrupts.CPU186.LOC:Local_timer_interrupts
7820 ± 17% -71.8% 2202 ± 83% interrupts.CPU186.NMI:Non-maskable_interrupts
7820 ± 17% -71.8% 2202 ± 83% interrupts.CPU186.PMI:Performance_monitoring_interrupts
1116715 ± 9% -57.0% 480404 ± 23% interrupts.CPU186.RES:Rescheduling_interrupts
257850 ± 8% -61.1% 100362 ± 8% interrupts.CPU186.TLB:TLB_shootdowns
299234 ± 8% -57.1% 128488 ± 8% interrupts.CPU187.CAL:Function_call_interrupts
329261 ± 3% -31.2% 226391 ± 2% interrupts.CPU187.LOC:Local_timer_interrupts
7827 ± 17% -71.8% 2209 ± 82% interrupts.CPU187.NMI:Non-maskable_interrupts
7827 ± 17% -71.8% 2209 ± 82% interrupts.CPU187.PMI:Performance_monitoring_interrupts
1118693 ± 12% -61.2% 433950 ± 27% interrupts.CPU187.RES:Rescheduling_interrupts
257264 ± 8% -61.0% 100388 ± 8% interrupts.CPU187.TLB:TLB_shootdowns
288815 ± 14% -47.9% 150509 ± 15% interrupts.CPU188.CAL:Function_call_interrupts
329307 ± 3% -31.2% 226441 ± 2% interrupts.CPU188.LOC:Local_timer_interrupts
7821 ± 17% -71.8% 2204 ± 83% interrupts.CPU188.NMI:Non-maskable_interrupts
7821 ± 17% -71.8% 2204 ± 83% interrupts.CPU188.PMI:Performance_monitoring_interrupts
1143534 ± 11% -58.1% 479338 ± 12% interrupts.CPU188.RES:Rescheduling_interrupts
257672 ± 8% -61.2% 99883 ± 8% interrupts.CPU188.TLB:TLB_shootdowns
304402 ± 15% -57.2% 130260 ± 6% interrupts.CPU189.CAL:Function_call_interrupts
329369 ± 3% -31.2% 226469 ± 2% interrupts.CPU189.LOC:Local_timer_interrupts
7817 ± 17% -71.7% 2212 ± 82% interrupts.CPU189.NMI:Non-maskable_interrupts
7817 ± 17% -71.7% 2212 ± 82% interrupts.CPU189.PMI:Performance_monitoring_interrupts
1149327 ± 10% -52.5% 545933 ± 15% interrupts.CPU189.RES:Rescheduling_interrupts
257257 ± 8% -60.9% 100556 ± 8% interrupts.CPU189.TLB:TLB_shootdowns
281903 ± 9% -50.9% 138479 ± 14% interrupts.CPU19.CAL:Function_call_interrupts
328060 ± 4% -31.0% 226520 ± 2% interrupts.CPU19.LOC:Local_timer_interrupts
7853 ± 17% -76.0% 1882 ± 71% interrupts.CPU19.NMI:Non-maskable_interrupts
7853 ± 17% -76.0% 1882 ± 71% interrupts.CPU19.PMI:Performance_monitoring_interrupts
1007298 ± 8% -48.4% 519793 ± 31% interrupts.CPU19.RES:Rescheduling_interrupts
258189 ± 8% -61.0% 100654 ± 9% interrupts.CPU19.TLB:TLB_shootdowns
300493 ± 14% -46.6% 160462 ± 15% interrupts.CPU190.CAL:Function_call_interrupts
329349 ± 3% -31.2% 226445 ± 2% interrupts.CPU190.LOC:Local_timer_interrupts
7818 ± 17% -71.7% 2211 ± 82% interrupts.CPU190.NMI:Non-maskable_interrupts
7818 ± 17% -71.7% 2211 ± 82% interrupts.CPU190.PMI:Performance_monitoring_interrupts
1128451 ± 12% -55.4% 503204 ± 13% interrupts.CPU190.RES:Rescheduling_interrupts
257252 ± 8% -61.3% 99642 ± 8% interrupts.CPU190.TLB:TLB_shootdowns
302260 ± 20% -58.5% 125397 ± 11% interrupts.CPU191.CAL:Function_call_interrupts
329295 ± 3% -31.2% 226461 ± 2% interrupts.CPU191.LOC:Local_timer_interrupts
7828 ± 17% -71.8% 2205 ± 83% interrupts.CPU191.NMI:Non-maskable_interrupts
7828 ± 17% -71.8% 2205 ± 83% interrupts.CPU191.PMI:Performance_monitoring_interrupts
1027516 ± 10% -55.1% 461708 ± 23% interrupts.CPU191.RES:Rescheduling_interrupts
255962 ± 8% -61.1% 99477 ± 9% interrupts.CPU191.TLB:TLB_shootdowns
338572 ± 12% -56.5% 147446 ± 22% interrupts.CPU2.CAL:Function_call_interrupts
328298 ± 4% -31.0% 226501 ± 2% interrupts.CPU2.LOC:Local_timer_interrupts
7924 ± 19% -69.5% 2415 ± 71% interrupts.CPU2.NMI:Non-maskable_interrupts
7924 ± 19% -69.5% 2415 ± 71% interrupts.CPU2.PMI:Performance_monitoring_interrupts
1044432 ± 15% -58.6% 432098 ± 20% interrupts.CPU2.RES:Rescheduling_interrupts
257579 ± 8% -60.5% 101798 ± 8% interrupts.CPU2.TLB:TLB_shootdowns
277965 ± 7% -51.7% 134187 ± 19% interrupts.CPU20.CAL:Function_call_interrupts
328074 ± 4% -31.0% 226453 ± 2% interrupts.CPU20.LOC:Local_timer_interrupts
7864 ± 17% -76.1% 1882 ± 70% interrupts.CPU20.NMI:Non-maskable_interrupts
7864 ± 17% -76.1% 1882 ± 70% interrupts.CPU20.PMI:Performance_monitoring_interrupts
1042296 ± 16% -57.9% 438903 ± 16% interrupts.CPU20.RES:Rescheduling_interrupts
257729 ± 8% -61.4% 99553 ± 8% interrupts.CPU20.TLB:TLB_shootdowns
297439 ± 11% -57.5% 126478 ± 16% interrupts.CPU21.CAL:Function_call_interrupts
328182 ± 4% -31.0% 226471 ± 2% interrupts.CPU21.LOC:Local_timer_interrupts
8404 ± 3% -77.6% 1878 ± 71% interrupts.CPU21.NMI:Non-maskable_interrupts
8404 ± 3% -77.6% 1878 ± 71% interrupts.CPU21.PMI:Performance_monitoring_interrupts
1049628 ± 10% -45.4% 572675 ± 26% interrupts.CPU21.RES:Rescheduling_interrupts
258195 ± 8% -61.4% 99641 ± 9% interrupts.CPU21.TLB:TLB_shootdowns
287527 ± 9% -52.7% 136005 ± 24% interrupts.CPU22.CAL:Function_call_interrupts
328366 ± 4% -31.0% 226484 ± 2% interrupts.CPU22.LOC:Local_timer_interrupts
7862 ± 17% -78.6% 1680 ± 85% interrupts.CPU22.NMI:Non-maskable_interrupts
7862 ± 17% -78.6% 1680 ± 85% interrupts.CPU22.PMI:Performance_monitoring_interrupts
1025426 ± 9% -53.2% 479897 ± 26% interrupts.CPU22.RES:Rescheduling_interrupts
258008 ± 8% -61.0% 100740 ± 9% interrupts.CPU22.TLB:TLB_shootdowns
293860 ± 11% -53.9% 135590 ± 16% interrupts.CPU23.CAL:Function_call_interrupts
328262 ± 4% -31.0% 226481 ± 2% interrupts.CPU23.LOC:Local_timer_interrupts
7339 ± 24% -77.1% 1683 ± 85% interrupts.CPU23.NMI:Non-maskable_interrupts
7339 ± 24% -77.1% 1683 ± 85% interrupts.CPU23.PMI:Performance_monitoring_interrupts
992607 ± 15% -54.9% 447403 ± 20% interrupts.CPU23.RES:Rescheduling_interrupts
257592 ± 8% -61.1% 100080 ± 9% interrupts.CPU23.TLB:TLB_shootdowns
325403 ± 10% -43.0% 185384 ± 20% interrupts.CPU24.CAL:Function_call_interrupts
329373 ± 3% -31.2% 226469 ± 2% interrupts.CPU24.LOC:Local_timer_interrupts
6884 ± 30% -71.8% 1943 ± 77% interrupts.CPU24.NMI:Non-maskable_interrupts
6884 ± 30% -71.8% 1943 ± 77% interrupts.CPU24.PMI:Performance_monitoring_interrupts
917989 ± 14% -46.3% 492660 ± 10% interrupts.CPU24.RES:Rescheduling_interrupts
257861 ± 8% -60.7% 101288 ± 8% interrupts.CPU24.TLB:TLB_shootdowns
296975 ± 12% -51.0% 145416 ± 9% interrupts.CPU25.CAL:Function_call_interrupts
329350 ± 3% -31.2% 226475 ± 2% interrupts.CPU25.LOC:Local_timer_interrupts
6852 ± 29% -71.9% 1922 ± 78% interrupts.CPU25.NMI:Non-maskable_interrupts
6852 ± 29% -71.9% 1922 ± 78% interrupts.CPU25.PMI:Performance_monitoring_interrupts
947588 ± 15% -39.6% 572182 ± 14% interrupts.CPU25.RES:Rescheduling_interrupts
258058 ± 8% -61.6% 99016 ± 9% interrupts.CPU25.TLB:TLB_shootdowns
317336 ± 17% -46.7% 169172 ± 19% interrupts.CPU26.CAL:Function_call_interrupts
329352 ± 3% -31.2% 226467 ± 2% interrupts.CPU26.LOC:Local_timer_interrupts
7406 ± 25% -74.0% 1926 ± 77% interrupts.CPU26.NMI:Non-maskable_interrupts
7406 ± 25% -74.0% 1926 ± 77% interrupts.CPU26.PMI:Performance_monitoring_interrupts
961402 ± 12% -49.9% 481353 ± 25% interrupts.CPU26.RES:Rescheduling_interrupts
257884 ± 8% -61.4% 99593 ± 8% interrupts.CPU26.TLB:TLB_shootdowns
291767 ± 11% -55.2% 130639 ± 13% interrupts.CPU27.CAL:Function_call_interrupts
329436 ± 3% -31.3% 226340 ± 2% interrupts.CPU27.LOC:Local_timer_interrupts
7887 ± 17% -75.7% 1914 ± 78% interrupts.CPU27.NMI:Non-maskable_interrupts
7887 ± 17% -75.7% 1914 ± 78% interrupts.CPU27.PMI:Performance_monitoring_interrupts
946201 ± 11% -43.1% 538306 ± 7% interrupts.CPU27.RES:Rescheduling_interrupts
257513 ± 8% -62.5% 96565 ± 6% interrupts.CPU27.TLB:TLB_shootdowns
282775 ± 14% -51.9% 136105 ± 27% interrupts.CPU28.CAL:Function_call_interrupts
329443 ± 3% -31.4% 226089 ± 2% interrupts.CPU28.LOC:Local_timer_interrupts
7890 ± 17% -76.2% 1874 ± 71% interrupts.CPU28.NMI:Non-maskable_interrupts
7890 ± 17% -76.2% 1874 ± 71% interrupts.CPU28.PMI:Performance_monitoring_interrupts
950744 ± 11% -43.5% 537112 ± 9% interrupts.CPU28.RES:Rescheduling_interrupts
257641 ± 8% -61.5% 99244 ± 10% interrupts.CPU28.TLB:TLB_shootdowns
278409 ± 11% -45.9% 150484 ± 25% interrupts.CPU29.CAL:Function_call_interrupts
329230 ± 3% -31.2% 226476 ± 2% interrupts.CPU29.LOC:Local_timer_interrupts
7349 ± 23% -67.4% 2399 ± 71% interrupts.CPU29.NMI:Non-maskable_interrupts
7349 ± 23% -67.4% 2399 ± 71% interrupts.CPU29.PMI:Performance_monitoring_interrupts
1000968 ± 16% -41.1% 589809 ± 11% interrupts.CPU29.RES:Rescheduling_interrupts
257552 ± 8% -61.5% 99039 ± 9% interrupts.CPU29.TLB:TLB_shootdowns
316541 ± 12% -44.9% 174481 ± 25% interrupts.CPU3.CAL:Function_call_interrupts
328327 ± 4% -31.0% 226509 ± 2% interrupts.CPU3.LOC:Local_timer_interrupts
6861 ± 31% -64.6% 2429 ± 71% interrupts.CPU3.NMI:Non-maskable_interrupts
6861 ± 31% -64.6% 2429 ± 71% interrupts.CPU3.PMI:Performance_monitoring_interrupts
984816 ± 9% -56.0% 433664 ± 24% interrupts.CPU3.RES:Rescheduling_interrupts
257601 ± 8% -60.5% 101857 ± 8% interrupts.CPU3.TLB:TLB_shootdowns
281084 ± 6% -54.2% 128694 ± 8% interrupts.CPU30.CAL:Function_call_interrupts
329408 ± 3% -31.3% 226420 ± 2% interrupts.CPU30.LOC:Local_timer_interrupts
7888 ± 17% -77.8% 1747 ± 90% interrupts.CPU30.NMI:Non-maskable_interrupts
7888 ± 17% -77.8% 1747 ± 90% interrupts.CPU30.PMI:Performance_monitoring_interrupts
997082 ± 12% -43.0% 568591 ± 13% interrupts.CPU30.RES:Rescheduling_interrupts
257479 ± 8% -61.4% 99269 ± 8% interrupts.CPU30.TLB:TLB_shootdowns
279858 ± 10% -48.1% 145307 ± 11% interrupts.CPU31.CAL:Function_call_interrupts
329413 ± 3% -31.2% 226476 ± 2% interrupts.CPU31.LOC:Local_timer_interrupts
6875 ± 29% -74.9% 1727 ± 92% interrupts.CPU31.NMI:Non-maskable_interrupts
6875 ± 29% -74.9% 1727 ± 92% interrupts.CPU31.PMI:Performance_monitoring_interrupts
257625 ± 8% -61.7% 98704 ± 9% interrupts.CPU31.TLB:TLB_shootdowns
288220 ± 8% -42.5% 165655 ± 27% interrupts.CPU32.CAL:Function_call_interrupts
329427 ± 3% -31.2% 226504 ± 2% interrupts.CPU32.LOC:Local_timer_interrupts
6826 ± 29% -74.4% 1745 ± 90% interrupts.CPU32.NMI:Non-maskable_interrupts
6826 ± 29% -74.4% 1745 ± 90% interrupts.CPU32.PMI:Performance_monitoring_interrupts
1006176 ± 15% -45.4% 549214 ± 6% interrupts.CPU32.RES:Rescheduling_interrupts
257518 ± 8% -61.4% 99351 ± 8% interrupts.CPU32.TLB:TLB_shootdowns
297454 ± 18% -45.8% 161171 ± 17% interrupts.CPU33.CAL:Function_call_interrupts
329361 ± 3% -31.3% 226426 ± 2% interrupts.CPU33.LOC:Local_timer_interrupts
7345 ± 23% -76.4% 1733 ± 91% interrupts.CPU33.NMI:Non-maskable_interrupts
7345 ± 23% -76.4% 1733 ± 91% interrupts.CPU33.PMI:Performance_monitoring_interrupts
989218 ± 16% -41.0% 583512 ± 16% interrupts.CPU33.RES:Rescheduling_interrupts
258002 ± 8% -61.6% 99027 ± 8% interrupts.CPU33.TLB:TLB_shootdowns
290851 ± 15% -50.3% 144475 ± 11% interrupts.CPU34.CAL:Function_call_interrupts
329450 ± 3% -31.3% 226482 ± 2% interrupts.CPU34.LOC:Local_timer_interrupts
7889 ± 17% -84.7% 1203 ± 69% interrupts.CPU34.NMI:Non-maskable_interrupts
7889 ± 17% -84.7% 1203 ± 69% interrupts.CPU34.PMI:Performance_monitoring_interrupts
1003841 ± 10% -43.2% 570172 ± 5% interrupts.CPU34.RES:Rescheduling_interrupts
257792 ± 8% -61.8% 98381 ± 8% interrupts.CPU34.TLB:TLB_shootdowns
294443 ± 12% -49.0% 150045 ± 26% interrupts.CPU35.CAL:Function_call_interrupts
329437 ± 3% -31.3% 226356 ± 2% interrupts.CPU35.LOC:Local_timer_interrupts
7893 ± 17% -77.8% 1753 ± 89% interrupts.CPU35.NMI:Non-maskable_interrupts
7893 ± 17% -77.8% 1753 ± 89% interrupts.CPU35.PMI:Performance_monitoring_interrupts
1036804 ± 13% -50.2% 516591 ± 7% interrupts.CPU35.RES:Rescheduling_interrupts
257543 ± 8% -61.5% 99160 ± 9% interrupts.CPU35.TLB:TLB_shootdowns
295820 ± 13% -52.9% 139410 ± 21% interrupts.CPU36.CAL:Function_call_interrupts
329349 ± 3% -31.2% 226430 ± 2% interrupts.CPU36.LOC:Local_timer_interrupts
6863 ± 30% -74.5% 1751 ± 90% interrupts.CPU36.NMI:Non-maskable_interrupts
6863 ± 30% -74.5% 1751 ± 90% interrupts.CPU36.PMI:Performance_monitoring_interrupts
1071023 ± 15% -47.8% 558971 ± 16% interrupts.CPU36.RES:Rescheduling_interrupts
258012 ± 8% -63.1% 95251 ± 13% interrupts.CPU36.TLB:TLB_shootdowns
277783 ± 16% -43.6% 156565 ± 11% interrupts.CPU37.CAL:Function_call_interrupts
329400 ± 3% -31.2% 226474 ± 2% interrupts.CPU37.LOC:Local_timer_interrupts
7896 ± 17% -84.8% 1200 ± 70% interrupts.CPU37.NMI:Non-maskable_interrupts
7896 ± 17% -84.8% 1200 ± 70% interrupts.CPU37.PMI:Performance_monitoring_interrupts
952802 ± 13% -38.7% 583980 ± 17% interrupts.CPU37.RES:Rescheduling_interrupts
257311 ± 8% -61.5% 99059 ± 9% interrupts.CPU37.TLB:TLB_shootdowns
286325 ± 11% -48.4% 147670 ± 18% interrupts.CPU38.CAL:Function_call_interrupts
329327 ± 3% -31.2% 226534 ± 2% interrupts.CPU38.LOC:Local_timer_interrupts
7910 ± 18% -77.8% 1752 ± 90% interrupts.CPU38.NMI:Non-maskable_interrupts
7910 ± 18% -77.8% 1752 ± 90% interrupts.CPU38.PMI:Performance_monitoring_interrupts
973888 ± 12% -40.7% 577819 ± 14% interrupts.CPU38.RES:Rescheduling_interrupts
256325 ± 9% -61.2% 99546 ± 8% interrupts.CPU38.TLB:TLB_shootdowns
297398 ± 12% -52.3% 141876 ± 18% interrupts.CPU39.CAL:Function_call_interrupts
329263 ± 3% -31.2% 226451 ± 2% interrupts.CPU39.LOC:Local_timer_interrupts
6834 ± 29% -79.2% 1422 ± 55% interrupts.CPU39.NMI:Non-maskable_interrupts
6834 ± 29% -79.2% 1422 ± 55% interrupts.CPU39.PMI:Performance_monitoring_interrupts
1024629 ± 13% -53.0% 481818 ± 10% interrupts.CPU39.RES:Rescheduling_interrupts
257640 ± 8% -61.8% 98515 ± 9% interrupts.CPU39.TLB:TLB_shootdowns
301038 ± 11% -53.0% 141491 ± 11% interrupts.CPU4.CAL:Function_call_interrupts
328002 ± 4% -31.0% 226275 ± 2% interrupts.CPU4.LOC:Local_timer_interrupts
6860 ± 31% -67.5% 2227 ± 83% interrupts.CPU4.NMI:Non-maskable_interrupts
6860 ± 31% -67.5% 2227 ± 83% interrupts.CPU4.PMI:Performance_monitoring_interrupts
1024213 ± 9% -54.6% 465200 ± 19% interrupts.CPU4.RES:Rescheduling_interrupts
258641 ± 8% -61.3% 100129 ± 9% interrupts.CPU4.TLB:TLB_shootdowns
267397 ± 8% -40.9% 157964 ± 19% interrupts.CPU40.CAL:Function_call_interrupts
329392 ± 3% -31.3% 226382 ± 2% interrupts.CPU40.LOC:Local_timer_interrupts
7917 ± 18% -69.4% 2419 ± 70% interrupts.CPU40.NMI:Non-maskable_interrupts
7917 ± 18% -69.4% 2419 ± 70% interrupts.CPU40.PMI:Performance_monitoring_interrupts
970946 ± 12% -50.4% 481375 ± 19% interrupts.CPU40.RES:Rescheduling_interrupts
257705 ± 8% -61.5% 99200 ± 9% interrupts.CPU40.TLB:TLB_shootdowns
286029 ± 11% -53.9% 131765 ± 12% interrupts.CPU41.CAL:Function_call_interrupts
329404 ± 3% -31.3% 226432 ± 2% interrupts.CPU41.LOC:Local_timer_interrupts
7889 ± 17% -76.1% 1883 ± 69% interrupts.CPU41.NMI:Non-maskable_interrupts
7889 ± 17% -76.1% 1883 ± 69% interrupts.CPU41.PMI:Performance_monitoring_interrupts
952892 ± 10% -36.1% 609302 ± 9% interrupts.CPU41.RES:Rescheduling_interrupts
257852 ± 8% -61.8% 98397 ± 8% interrupts.CPU41.TLB:TLB_shootdowns
291135 ± 6% -53.2% 136354 ± 11% interrupts.CPU42.CAL:Function_call_interrupts
329260 ± 3% -31.2% 226408 ± 2% interrupts.CPU42.LOC:Local_timer_interrupts
7887 ± 17% -76.0% 1889 ± 69% interrupts.CPU42.NMI:Non-maskable_interrupts
7887 ± 17% -76.0% 1889 ± 69% interrupts.CPU42.PMI:Performance_monitoring_interrupts
975110 ± 12% -42.6% 560002 ± 3% interrupts.CPU42.RES:Rescheduling_interrupts
257712 ± 8% -61.8% 98479 ± 9% interrupts.CPU42.TLB:TLB_shootdowns
273777 ± 12% -47.3% 144400 ± 18% interrupts.CPU43.CAL:Function_call_interrupts
329270 ± 3% -31.3% 226347 ± 2% interrupts.CPU43.LOC:Local_timer_interrupts
7343 ± 23% -67.1% 2416 ± 70% interrupts.CPU43.NMI:Non-maskable_interrupts
7343 ± 23% -67.1% 2416 ± 70% interrupts.CPU43.PMI:Performance_monitoring_interrupts
1000825 ± 15% -50.0% 500857 ± 15% interrupts.CPU43.RES:Rescheduling_interrupts
257617 ± 8% -60.6% 101485 ± 8% interrupts.CPU43.TLB:TLB_shootdowns
268947 ± 10% -43.2% 152684 ± 23% interrupts.CPU44.CAL:Function_call_interrupts
329293 ± 3% -31.2% 226471 ± 2% interrupts.CPU44.LOC:Local_timer_interrupts
7889 ± 17% -69.4% 2415 ± 69% interrupts.CPU44.NMI:Non-maskable_interrupts
7889 ± 17% -69.4% 2415 ± 69% interrupts.CPU44.PMI:Performance_monitoring_interrupts
1048726 ± 12% -48.5% 539647 ± 12% interrupts.CPU44.RES:Rescheduling_interrupts
257971 ± 8% -61.7% 98891 ± 9% interrupts.CPU44.TLB:TLB_shootdowns
261929 ± 10% -35.7% 168427 ± 28% interrupts.CPU45.CAL:Function_call_interrupts
329304 ± 3% -31.2% 226467 ± 2% interrupts.CPU45.LOC:Local_timer_interrupts
7343 ± 23% -67.4% 2392 ± 71% interrupts.CPU45.NMI:Non-maskable_interrupts
7343 ± 23% -67.4% 2392 ± 71% interrupts.CPU45.PMI:Performance_monitoring_interrupts
981783 ± 13% -39.7% 591701 ± 11% interrupts.CPU45.RES:Rescheduling_interrupts
258214 ± 8% -61.0% 100609 ± 8% interrupts.CPU45.TLB:TLB_shootdowns
275744 ± 13% -47.3% 145433 ± 10% interrupts.CPU46.CAL:Function_call_interrupts
329209 ± 3% -31.2% 226487 ± 2% interrupts.CPU46.LOC:Local_timer_interrupts
8432 ± 3% -71.6% 2391 ± 71% interrupts.CPU46.NMI:Non-maskable_interrupts
8432 ± 3% -71.6% 2391 ± 71% interrupts.CPU46.PMI:Performance_monitoring_interrupts
1001431 ± 14% -46.5% 535429 ± 12% interrupts.CPU46.RES:Rescheduling_interrupts
257389 ± 8% -61.5% 99138 ± 9% interrupts.CPU46.TLB:TLB_shootdowns
270093 ± 8% -42.6% 154963 ± 10% interrupts.CPU47.CAL:Function_call_interrupts
329361 ± 3% -31.2% 226468 ± 2% interrupts.CPU47.LOC:Local_timer_interrupts
7916 ± 18% -76.6% 1855 ± 71% interrupts.CPU47.NMI:Non-maskable_interrupts
7916 ± 18% -76.6% 1855 ± 71% interrupts.CPU47.PMI:Performance_monitoring_interrupts
960885 ± 12% -40.0% 576882 ± 10% interrupts.CPU47.RES:Rescheduling_interrupts
257681 ± 8% -61.4% 99569 ± 9% interrupts.CPU47.TLB:TLB_shootdowns
333803 ± 13% -47.2% 176387 ± 12% interrupts.CPU48.CAL:Function_call_interrupts
329199 ± 3% -31.2% 226522 ± 2% interrupts.CPU48.LOC:Local_timer_interrupts
7427 ± 26% -67.5% 2415 ± 71% interrupts.CPU48.NMI:Non-maskable_interrupts
7427 ± 26% -67.5% 2415 ± 71% interrupts.CPU48.PMI:Performance_monitoring_interrupts
925571 ± 10% -48.8% 474040 ± 47% interrupts.CPU48.RES:Rescheduling_interrupts
257709 ± 8% -61.4% 99585 ± 8% interrupts.CPU48.TLB:TLB_shootdowns
316629 ± 13% -49.1% 161269 ± 14% interrupts.CPU49.CAL:Function_call_interrupts
329413 ± 3% -31.2% 226514 ± 2% interrupts.CPU49.LOC:Local_timer_interrupts
7919 ± 18% -69.6% 2410 ± 71% interrupts.CPU49.NMI:Non-maskable_interrupts
7919 ± 18% -69.6% 2410 ± 71% interrupts.CPU49.PMI:Performance_monitoring_interrupts
1018515 ± 9% -57.0% 437749 ± 31% interrupts.CPU49.RES:Rescheduling_interrupts
257205 ± 8% -61.1% 100067 ± 9% interrupts.CPU49.TLB:TLB_shootdowns
296317 ± 11% -50.5% 146753 ± 14% interrupts.CPU5.CAL:Function_call_interrupts
328304 ± 4% -31.0% 226500 ± 2% interrupts.CPU5.LOC:Local_timer_interrupts
7886 ± 18% -69.3% 2424 ± 71% interrupts.CPU5.NMI:Non-maskable_interrupts
7886 ± 18% -69.3% 2424 ± 71% interrupts.CPU5.PMI:Performance_monitoring_interrupts
1050724 ± 9% -53.5% 488807 ± 30% interrupts.CPU5.RES:Rescheduling_interrupts
258389 ± 8% -61.2% 100275 ± 9% interrupts.CPU5.TLB:TLB_shootdowns
294043 ± 10% -47.8% 153480 ± 17% interrupts.CPU50.CAL:Function_call_interrupts
329467 ± 3% -31.3% 226298 ± 2% interrupts.CPU50.LOC:Local_timer_interrupts
8429 ± 3% -71.2% 2428 ± 71% interrupts.CPU50.NMI:Non-maskable_interrupts
8429 ± 3% -71.2% 2428 ± 71% interrupts.CPU50.PMI:Performance_monitoring_interrupts
1052143 ± 6% -55.2% 470958 ± 23% interrupts.CPU50.RES:Rescheduling_interrupts
257377 ± 8% -61.1% 100132 ± 8% interrupts.CPU50.TLB:TLB_shootdowns
309467 ± 9% -47.8% 161585 ± 17% interrupts.CPU51.CAL:Function_call_interrupts
329355 ± 3% -31.2% 226545 ± 2% interrupts.CPU51.LOC:Local_timer_interrupts
8431 ± 3% -71.3% 2416 ± 71% interrupts.CPU51.NMI:Non-maskable_interrupts
8431 ± 3% -71.3% 2416 ± 71% interrupts.CPU51.PMI:Performance_monitoring_interrupts
1031318 ± 10% -47.6% 540847 ± 36% interrupts.CPU51.RES:Rescheduling_interrupts
256974 ± 8% -61.1% 99865 ± 8% interrupts.CPU51.TLB:TLB_shootdowns
295006 ± 9% -54.6% 133974 ± 10% interrupts.CPU52.CAL:Function_call_interrupts
329391 ± 3% -31.2% 226512 ± 2% interrupts.CPU52.LOC:Local_timer_interrupts
7884 ± 17% -69.5% 2408 ± 71% interrupts.CPU52.NMI:Non-maskable_interrupts
7884 ± 17% -69.5% 2408 ± 71% interrupts.CPU52.PMI:Performance_monitoring_interrupts
1000151 ± 15% -54.5% 454805 ± 28% interrupts.CPU52.RES:Rescheduling_interrupts
256899 ± 8% -61.4% 99244 ± 9% interrupts.CPU52.TLB:TLB_shootdowns
300829 ± 9% -53.8% 139104 ± 25% interrupts.CPU53.CAL:Function_call_interrupts
329397 ± 3% -31.2% 226488 ± 2% interrupts.CPU53.LOC:Local_timer_interrupts
7879 ± 17% -69.3% 2419 ± 71% interrupts.CPU53.NMI:Non-maskable_interrupts
7879 ± 17% -69.3% 2419 ± 71% interrupts.CPU53.PMI:Performance_monitoring_interrupts
1004034 ± 14% -57.0% 432029 ± 20% interrupts.CPU53.RES:Rescheduling_interrupts
257083 ± 8% -61.4% 99221 ± 8% interrupts.CPU53.TLB:TLB_shootdowns
301215 ± 10% -52.1% 144334 ± 14% interrupts.CPU54.CAL:Function_call_interrupts
329443 ± 3% -31.3% 226479 ± 2% interrupts.CPU54.LOC:Local_timer_interrupts
7917 ± 18% -69.6% 2410 ± 71% interrupts.CPU54.NMI:Non-maskable_interrupts
7917 ± 18% -69.6% 2410 ± 71% interrupts.CPU54.PMI:Performance_monitoring_interrupts
1005736 ± 11% -53.5% 467956 ± 24% interrupts.CPU54.RES:Rescheduling_interrupts
257364 ± 8% -61.4% 99411 ± 9% interrupts.CPU54.TLB:TLB_shootdowns
292699 ± 11% -53.1% 137364 ± 16% interrupts.CPU55.CAL:Function_call_interrupts
329296 ± 3% -31.2% 226486 ± 2% interrupts.CPU55.LOC:Local_timer_interrupts
7899 ± 17% -69.5% 2408 ± 71% interrupts.CPU55.NMI:Non-maskable_interrupts
7899 ± 17% -69.5% 2408 ± 71% interrupts.CPU55.PMI:Performance_monitoring_interrupts
1043666 ± 13% -52.8% 492283 ± 31% interrupts.CPU55.RES:Rescheduling_interrupts
257128 ± 8% -61.5% 98903 ± 8% interrupts.CPU55.TLB:TLB_shootdowns
297590 ± 11% -43.1% 169347 ± 27% interrupts.CPU56.CAL:Function_call_interrupts
329367 ± 3% -31.2% 226493 ± 2% interrupts.CPU56.LOC:Local_timer_interrupts
7333 ± 23% -67.0% 2418 ± 72% interrupts.CPU56.NMI:Non-maskable_interrupts
7333 ± 23% -67.0% 2418 ± 72% interrupts.CPU56.PMI:Performance_monitoring_interrupts
988101 ± 11% -53.2% 462172 ± 32% interrupts.CPU56.RES:Rescheduling_interrupts
257398 ± 8% -61.0% 100483 ± 7% interrupts.CPU56.TLB:TLB_shootdowns
285497 ± 8% -52.6% 135451 ± 8% interrupts.CPU57.CAL:Function_call_interrupts
329383 ± 3% -31.2% 226509 ± 2% interrupts.CPU57.LOC:Local_timer_interrupts
7878 ± 17% -69.4% 2409 ± 71% interrupts.CPU57.NMI:Non-maskable_interrupts
7878 ± 17% -69.4% 2409 ± 71% interrupts.CPU57.PMI:Performance_monitoring_interrupts
1046177 ± 13% -59.4% 424329 ± 29% interrupts.CPU57.RES:Rescheduling_interrupts
257193 ± 8% -61.4% 99168 ± 8% interrupts.CPU57.TLB:TLB_shootdowns
284270 ± 8% -53.0% 133640 ± 8% interrupts.CPU58.CAL:Function_call_interrupts
329492 ± 3% -31.3% 226495 ± 2% interrupts.CPU58.LOC:Local_timer_interrupts
8424 ± 3% -71.4% 2410 ± 72% interrupts.CPU58.NMI:Non-maskable_interrupts
8424 ± 3% -71.4% 2410 ± 72% interrupts.CPU58.PMI:Performance_monitoring_interrupts
1066560 ± 13% -49.6% 537666 ± 25% interrupts.CPU58.RES:Rescheduling_interrupts
257266 ± 8% -61.2% 99768 ± 9% interrupts.CPU58.TLB:TLB_shootdowns
287464 ± 9% -48.0% 149555 ± 10% interrupts.CPU59.CAL:Function_call_interrupts
329182 ± 3% -31.2% 226469 ± 2% interrupts.CPU59.LOC:Local_timer_interrupts
7872 ± 17% -69.2% 2423 ± 71% interrupts.CPU59.NMI:Non-maskable_interrupts
7872 ± 17% -69.2% 2423 ± 71% interrupts.CPU59.PMI:Performance_monitoring_interrupts
1016616 ± 17% -48.6% 522716 ± 21% interrupts.CPU59.RES:Rescheduling_interrupts
257464 ± 8% -61.5% 99009 ± 9% interrupts.CPU59.TLB:TLB_shootdowns
304035 ± 22% -54.3% 139042 ± 16% interrupts.CPU6.CAL:Function_call_interrupts
328186 ± 4% -31.0% 226507 ± 2% interrupts.CPU6.LOC:Local_timer_interrupts
7881 ± 18% -69.4% 2411 ± 72% interrupts.CPU6.NMI:Non-maskable_interrupts
7881 ± 18% -69.4% 2411 ± 72% interrupts.CPU6.PMI:Performance_monitoring_interrupts
1075794 ± 15% -53.2% 503712 ± 29% interrupts.CPU6.RES:Rescheduling_interrupts
257714 ± 8% -60.7% 101232 ± 9% interrupts.CPU6.TLB:TLB_shootdowns
282725 ± 10% -50.1% 141050 ± 16% interrupts.CPU60.CAL:Function_call_interrupts
329414 ± 3% -31.2% 226516 ± 2% interrupts.CPU60.LOC:Local_timer_interrupts
7915 ± 18% -69.5% 2412 ± 71% interrupts.CPU60.NMI:Non-maskable_interrupts
7915 ± 18% -69.5% 2412 ± 71% interrupts.CPU60.PMI:Performance_monitoring_interrupts
966735 ± 16% -49.4% 489326 ± 19% interrupts.CPU60.RES:Rescheduling_interrupts
257175 ± 8% -61.2% 99782 ± 7% interrupts.CPU60.TLB:TLB_shootdowns
296081 ± 7% -46.9% 157345 ± 12% interrupts.CPU61.CAL:Function_call_interrupts
329339 ± 3% -31.2% 226498 ± 2% interrupts.CPU61.LOC:Local_timer_interrupts
8418 ± 3% -71.4% 2410 ± 72% interrupts.CPU61.NMI:Non-maskable_interrupts
8418 ± 3% -71.4% 2410 ± 72% interrupts.CPU61.PMI:Performance_monitoring_interrupts
1037288 ± 11% -47.9% 540345 ± 27% interrupts.CPU61.RES:Rescheduling_interrupts
257015 ± 8% -61.1% 99901 ± 8% interrupts.CPU61.TLB:TLB_shootdowns
286040 ± 9% -36.3% 182157 ± 20% interrupts.CPU62.CAL:Function_call_interrupts
329479 ± 3% -31.3% 226490 ± 2% interrupts.CPU62.LOC:Local_timer_interrupts
8422 ± 3% -71.3% 2416 ± 71% interrupts.CPU62.NMI:Non-maskable_interrupts
8422 ± 3% -71.3% 2416 ± 71% interrupts.CPU62.PMI:Performance_monitoring_interrupts
1021421 ± 11% -54.1% 468444 ± 19% interrupts.CPU62.RES:Rescheduling_interrupts
257466 ± 8% -61.5% 99173 ± 9% interrupts.CPU62.TLB:TLB_shootdowns
287996 ± 11% -44.4% 160138 ± 25% interrupts.CPU63.CAL:Function_call_interrupts
329424 ± 3% -31.3% 226460 ± 2% interrupts.CPU63.LOC:Local_timer_interrupts
8422 ± 3% -71.3% 2420 ± 71% interrupts.CPU63.NMI:Non-maskable_interrupts
8422 ± 3% -71.3% 2420 ± 71% interrupts.CPU63.PMI:Performance_monitoring_interrupts
1041051 ± 8% -48.8% 533367 ± 33% interrupts.CPU63.RES:Rescheduling_interrupts
257423 ± 8% -61.5% 99140 ± 8% interrupts.CPU63.TLB:TLB_shootdowns
303408 ± 11% -58.1% 126986 ± 7% interrupts.CPU64.CAL:Function_call_interrupts
329441 ± 3% -31.2% 226495 ± 2% interrupts.CPU64.LOC:Local_timer_interrupts
8427 ± 3% -71.4% 2413 ± 71% interrupts.CPU64.NMI:Non-maskable_interrupts
8427 ± 3% -71.4% 2413 ± 71% interrupts.CPU64.PMI:Performance_monitoring_interrupts
1023620 ± 14% -52.2% 489259 ± 22% interrupts.CPU64.RES:Rescheduling_interrupts
257388 ± 8% -60.9% 100648 ± 9% interrupts.CPU64.TLB:TLB_shootdowns
298638 ± 9% -59.3% 121396 ± 13% interrupts.CPU65.CAL:Function_call_interrupts
329338 ± 3% -31.2% 226497 ± 2% interrupts.CPU65.LOC:Local_timer_interrupts
8415 ± 3% -71.3% 2417 ± 71% interrupts.CPU65.NMI:Non-maskable_interrupts
8415 ± 3% -71.3% 2417 ± 71% interrupts.CPU65.PMI:Performance_monitoring_interrupts
1072871 ± 13% -54.2% 491802 ± 34% interrupts.CPU65.RES:Rescheduling_interrupts
257271 ± 8% -61.0% 100415 ± 7% interrupts.CPU65.TLB:TLB_shootdowns
267627 ± 11% -47.0% 141834 ± 3% interrupts.CPU66.CAL:Function_call_interrupts
329362 ± 3% -31.2% 226476 ± 2% interrupts.CPU66.LOC:Local_timer_interrupts
7909 ± 18% -69.5% 2410 ± 71% interrupts.CPU66.NMI:Non-maskable_interrupts
7909 ± 18% -69.5% 2410 ± 71% interrupts.CPU66.PMI:Performance_monitoring_interrupts
1068255 ± 15% -55.3% 477200 ± 27% interrupts.CPU66.RES:Rescheduling_interrupts
257065 ± 8% -61.6% 98789 ± 8% interrupts.CPU66.TLB:TLB_shootdowns
285488 ± 8% -42.5% 164131 ± 34% interrupts.CPU67.CAL:Function_call_interrupts
329471 ± 3% -31.3% 226498 ± 2% interrupts.CPU67.LOC:Local_timer_interrupts
7907 ± 18% -69.5% 2413 ± 71% interrupts.CPU67.NMI:Non-maskable_interrupts
7907 ± 18% -69.5% 2413 ± 71% interrupts.CPU67.PMI:Performance_monitoring_interrupts
1018171 ± 9% -57.1% 437172 ± 21% interrupts.CPU67.RES:Rescheduling_interrupts
257191 ± 8% -61.3% 99498 ± 8% interrupts.CPU67.TLB:TLB_shootdowns
291580 ± 9% -44.0% 163268 ± 28% interrupts.CPU68.CAL:Function_call_interrupts
329441 ± 3% -31.2% 226491 ± 2% interrupts.CPU68.LOC:Local_timer_interrupts
7872 ± 17% -69.5% 2400 ± 71% interrupts.CPU68.NMI:Non-maskable_interrupts
7872 ± 17% -69.5% 2400 ± 71% interrupts.CPU68.PMI:Performance_monitoring_interrupts
993675 ± 8% -49.5% 501893 ± 34% interrupts.CPU68.RES:Rescheduling_interrupts
256790 ± 8% -61.3% 99334 ± 9% interrupts.CPU68.TLB:TLB_shootdowns
288171 ± 7% -53.0% 135561 ± 23% interrupts.CPU69.CAL:Function_call_interrupts
329245 ± 3% -31.2% 226517 ± 2% interrupts.CPU69.LOC:Local_timer_interrupts
7401 ± 25% -67.5% 2408 ± 71% interrupts.CPU69.NMI:Non-maskable_interrupts
7401 ± 25% -67.5% 2408 ± 71% interrupts.CPU69.PMI:Performance_monitoring_interrupts
1008007 ± 10% -49.4% 510423 ± 22% interrupts.CPU69.RES:Rescheduling_interrupts
257543 ± 8% -61.5% 99175 ± 9% interrupts.CPU69.TLB:TLB_shootdowns
303511 ± 19% -58.8% 125186 ± 12% interrupts.CPU7.CAL:Function_call_interrupts
328114 ± 4% -31.0% 226525 ± 2% interrupts.CPU7.LOC:Local_timer_interrupts
7887 ± 18% -69.1% 2437 ± 71% interrupts.CPU7.NMI:Non-maskable_interrupts
7887 ± 18% -69.1% 2437 ± 71% interrupts.CPU7.PMI:Performance_monitoring_interrupts
1081532 ± 10% -52.8% 510480 ± 12% interrupts.CPU7.RES:Rescheduling_interrupts
257903 ± 8% -61.0% 100505 ± 9% interrupts.CPU7.TLB:TLB_shootdowns
294871 ± 14% -54.9% 133029 ± 10% interrupts.CPU70.CAL:Function_call_interrupts
329243 ± 3% -31.2% 226504 ± 2% interrupts.CPU70.LOC:Local_timer_interrupts
7370 ± 25% -67.4% 2402 ± 71% interrupts.CPU70.NMI:Non-maskable_interrupts
7370 ± 25% -67.4% 2402 ± 71% interrupts.CPU70.PMI:Performance_monitoring_interrupts
1082787 ± 10% -56.4% 472071 ± 25% interrupts.CPU70.RES:Rescheduling_interrupts
257511 ± 8% -61.4% 99483 ± 9% interrupts.CPU70.TLB:TLB_shootdowns
289341 ± 9% -52.5% 137405 ± 15% interrupts.CPU71.CAL:Function_call_interrupts
329291 ± 3% -31.2% 226506 ± 2% interrupts.CPU71.LOC:Local_timer_interrupts
7928 ± 18% -69.6% 2407 ± 71% interrupts.CPU71.NMI:Non-maskable_interrupts
7928 ± 18% -69.6% 2407 ± 71% interrupts.CPU71.PMI:Performance_monitoring_interrupts
1071804 ± 12% -58.0% 450286 ± 28% interrupts.CPU71.RES:Rescheduling_interrupts
257379 ± 8% -61.4% 99269 ± 8% interrupts.CPU71.TLB:TLB_shootdowns
352011 ± 16% -60.4% 139515 ± 8% interrupts.CPU72.CAL:Function_call_interrupts
329306 ± 3% -31.3% 226378 ± 2% interrupts.CPU72.LOC:Local_timer_interrupts
7859 ± 18% -69.3% 2409 ± 70% interrupts.CPU72.NMI:Non-maskable_interrupts
7859 ± 18% -69.3% 2409 ± 70% interrupts.CPU72.PMI:Performance_monitoring_interrupts
1001903 ± 11% -57.8% 422805 ± 13% interrupts.CPU72.RES:Rescheduling_interrupts
257277 ± 8% -61.3% 99500 ± 9% interrupts.CPU72.TLB:TLB_shootdowns
295284 ± 10% -54.2% 135118 ± 14% interrupts.CPU73.CAL:Function_call_interrupts
329333 ± 3% -31.2% 226514 ± 2% interrupts.CPU73.LOC:Local_timer_interrupts
7887 ± 19% -69.7% 2386 ± 71% interrupts.CPU73.NMI:Non-maskable_interrupts
7887 ± 19% -69.7% 2386 ± 71% interrupts.CPU73.PMI:Performance_monitoring_interrupts
1074423 ± 13% -55.1% 482615 ± 20% interrupts.CPU73.RES:Rescheduling_interrupts
257618 ± 8% -61.4% 99385 ± 8% interrupts.CPU73.TLB:TLB_shootdowns
328933 ± 16% -56.9% 141806 ± 21% interrupts.CPU74.CAL:Function_call_interrupts
329258 ± 3% -31.2% 226518 ± 2% interrupts.CPU74.LOC:Local_timer_interrupts
6865 ± 32% -65.4% 2375 ± 72% interrupts.CPU74.NMI:Non-maskable_interrupts
6865 ± 32% -65.4% 2375 ± 72% interrupts.CPU74.PMI:Performance_monitoring_interrupts
1131617 ± 10% -53.4% 527448 ± 20% interrupts.CPU74.RES:Rescheduling_interrupts
257663 ± 8% -61.5% 99248 ± 8% interrupts.CPU74.TLB:TLB_shootdowns
289524 ± 7% -42.6% 166273 ± 8% interrupts.CPU75.CAL:Function_call_interrupts
329410 ± 3% -31.3% 226455 ± 2% interrupts.CPU75.LOC:Local_timer_interrupts
7846 ± 18% -69.6% 2389 ± 72% interrupts.CPU75.NMI:Non-maskable_interrupts
7846 ± 18% -69.6% 2389 ± 72% interrupts.CPU75.PMI:Performance_monitoring_interrupts
1105068 ± 11% -56.3% 482737 ± 19% interrupts.CPU75.RES:Rescheduling_interrupts
257342 ± 8% -61.0% 100403 ± 8% interrupts.CPU75.TLB:TLB_shootdowns
290573 ± 10% -53.8% 134186 ± 21% interrupts.CPU76.CAL:Function_call_interrupts
329278 ± 3% -31.2% 226464 ± 2% interrupts.CPU76.LOC:Local_timer_interrupts
7851 ± 18% -69.7% 2380 ± 73% interrupts.CPU76.NMI:Non-maskable_interrupts
7851 ± 18% -69.7% 2380 ± 73% interrupts.CPU76.PMI:Performance_monitoring_interrupts
1109115 ± 10% -52.7% 524334 ± 17% interrupts.CPU76.RES:Rescheduling_interrupts
257599 ± 8% -61.4% 99465 ± 8% interrupts.CPU76.TLB:TLB_shootdowns
290588 ± 8% -53.6% 134740 ± 3% interrupts.CPU77.CAL:Function_call_interrupts
329325 ± 3% -31.2% 226419 ± 2% interrupts.CPU77.LOC:Local_timer_interrupts
7340 ± 25% -67.7% 2370 ± 73% interrupts.CPU77.NMI:Non-maskable_interrupts
7340 ± 25% -67.7% 2370 ± 73% interrupts.CPU77.PMI:Performance_monitoring_interrupts
1122768 ± 13% -59.6% 453390 ± 18% interrupts.CPU77.RES:Rescheduling_interrupts
257333 ± 8% -61.3% 99709 ± 9% interrupts.CPU77.TLB:TLB_shootdowns
291902 ± 9% -50.1% 145786 ± 7% interrupts.CPU78.CAL:Function_call_interrupts
329296 ± 3% -31.2% 226480 ± 2% interrupts.CPU78.LOC:Local_timer_interrupts
7341 ± 25% -67.7% 2373 ± 72% interrupts.CPU78.NMI:Non-maskable_interrupts
7341 ± 25% -67.7% 2373 ± 72% interrupts.CPU78.PMI:Performance_monitoring_interrupts
1145273 ± 17% -61.7% 438903 ± 16% interrupts.CPU78.RES:Rescheduling_interrupts
257346 ± 8% -61.3% 99501 ± 8% interrupts.CPU78.TLB:TLB_shootdowns
286476 ± 10% -56.5% 124692 ± 9% interrupts.CPU79.CAL:Function_call_interrupts
329250 ± 3% -31.2% 226469 ± 2% interrupts.CPU79.LOC:Local_timer_interrupts
7853 ± 18% -69.7% 2377 ± 73% interrupts.CPU79.NMI:Non-maskable_interrupts
7853 ± 18% -69.7% 2377 ± 73% interrupts.CPU79.PMI:Performance_monitoring_interrupts
1097859 ± 10% -58.0% 460706 ± 17% interrupts.CPU79.RES:Rescheduling_interrupts
257417 ± 8% -61.2% 99895 ± 8% interrupts.CPU79.TLB:TLB_shootdowns
294225 ± 19% -52.1% 140922 ± 25% interrupts.CPU8.CAL:Function_call_interrupts
328318 ± 4% -31.0% 226418 ± 2% interrupts.CPU8.LOC:Local_timer_interrupts
7885 ± 18% -69.2% 2429 ± 71% interrupts.CPU8.NMI:Non-maskable_interrupts
7885 ± 18% -69.2% 2429 ± 71% interrupts.CPU8.PMI:Performance_monitoring_interrupts
1034349 ± 9% -47.7% 540931 ± 31% interrupts.CPU8.RES:Rescheduling_interrupts
258139 ± 8% -61.5% 99447 ± 9% interrupts.CPU8.TLB:TLB_shootdowns
276733 ± 11% -53.8% 127867 ± 14% interrupts.CPU80.CAL:Function_call_interrupts
329272 ± 3% -31.2% 226498 ± 2% interrupts.CPU80.LOC:Local_timer_interrupts
6865 ± 32% -65.4% 2372 ± 73% interrupts.CPU80.NMI:Non-maskable_interrupts
6865 ± 32% -65.4% 2372 ± 73% interrupts.CPU80.PMI:Performance_monitoring_interrupts
1102910 ± 10% -59.1% 450673 ± 16% interrupts.CPU80.RES:Rescheduling_interrupts
257250 ± 8% -61.6% 98796 ± 8% interrupts.CPU80.TLB:TLB_shootdowns
298508 ± 11% -50.9% 146709 ± 13% interrupts.CPU81.CAL:Function_call_interrupts
329151 ± 3% -31.2% 226486 ± 2% interrupts.CPU81.LOC:Local_timer_interrupts
7374 ± 27% -67.8% 2376 ± 73% interrupts.CPU81.NMI:Non-maskable_interrupts
7374 ± 27% -67.8% 2376 ± 73% interrupts.CPU81.PMI:Performance_monitoring_interrupts
1124367 ± 11% -57.3% 479652 ± 22% interrupts.CPU81.RES:Rescheduling_interrupts
257286 ± 8% -61.2% 99748 ± 8% interrupts.CPU81.TLB:TLB_shootdowns
277822 ± 6% -46.9% 147408 ± 10% interrupts.CPU82.CAL:Function_call_interrupts
329142 ± 3% -31.2% 226542 ± 2% interrupts.CPU82.LOC:Local_timer_interrupts
7377 ± 27% -67.5% 2395 ± 71% interrupts.CPU82.NMI:Non-maskable_interrupts
7377 ± 27% -67.5% 2395 ± 71% interrupts.CPU82.PMI:Performance_monitoring_interrupts
1030318 ± 8% -49.5% 520348 ± 29% interrupts.CPU82.RES:Rescheduling_interrupts
257167 ± 8% -60.8% 100892 ± 7% interrupts.CPU82.TLB:TLB_shootdowns
294150 ± 15% -51.7% 142121 ± 28% interrupts.CPU83.CAL:Function_call_interrupts
329272 ± 3% -31.2% 226497 ± 2% interrupts.CPU83.LOC:Local_timer_interrupts
7378 ± 27% -67.8% 2377 ± 72% interrupts.CPU83.NMI:Non-maskable_interrupts
7378 ± 27% -67.8% 2377 ± 72% interrupts.CPU83.PMI:Performance_monitoring_interrupts
1075132 ± 9% -53.9% 495366 ± 26% interrupts.CPU83.RES:Rescheduling_interrupts
257296 ± 8% -61.5% 99156 ± 8% interrupts.CPU83.TLB:TLB_shootdowns
284501 ± 10% -46.9% 151164 ± 14% interrupts.CPU84.CAL:Function_call_interrupts
329202 ± 3% -31.2% 226484 ± 2% interrupts.CPU84.LOC:Local_timer_interrupts
7380 ± 27% -67.7% 2383 ± 72% interrupts.CPU84.NMI:Non-maskable_interrupts
7380 ± 27% -67.7% 2383 ± 72% interrupts.CPU84.PMI:Performance_monitoring_interrupts
1078161 ± 15% -55.3% 482044 ± 25% interrupts.CPU84.RES:Rescheduling_interrupts
257133 ± 8% -61.2% 99769 ± 8% interrupts.CPU84.TLB:TLB_shootdowns
276188 ± 10% -39.5% 167212 ± 18% interrupts.CPU85.CAL:Function_call_interrupts
329199 ± 3% -31.2% 226439 ± 2% interrupts.CPU85.LOC:Local_timer_interrupts
7378 ± 27% -67.6% 2391 ± 72% interrupts.CPU85.NMI:Non-maskable_interrupts
7378 ± 27% -67.6% 2391 ± 72% interrupts.CPU85.PMI:Performance_monitoring_interrupts
1092682 ± 14% -56.6% 474517 ± 11% interrupts.CPU85.RES:Rescheduling_interrupts
256696 ± 8% -60.4% 101532 ± 8% interrupts.CPU85.TLB:TLB_shootdowns
287225 ± 8% -55.9% 126591 ± 22% interrupts.CPU86.CAL:Function_call_interrupts
329214 ± 3% -31.2% 226373 ± 2% interrupts.CPU86.LOC:Local_timer_interrupts
7307 ± 24% -67.4% 2382 ± 71% interrupts.CPU86.NMI:Non-maskable_interrupts
7307 ± 24% -67.4% 2382 ± 71% interrupts.CPU86.PMI:Performance_monitoring_interrupts
1103865 ± 9% -56.1% 484786 ± 6% interrupts.CPU86.RES:Rescheduling_interrupts
257415 ± 8% -61.3% 99504 ± 8% interrupts.CPU86.TLB:TLB_shootdowns
290123 ± 14% -50.8% 142784 ± 29% interrupts.CPU87.CAL:Function_call_interrupts
329335 ± 3% -31.2% 226531 ± 2% interrupts.CPU87.LOC:Local_timer_interrupts
7854 ± 18% -69.7% 2378 ± 72% interrupts.CPU87.NMI:Non-maskable_interrupts
7854 ± 18% -69.7% 2378 ± 72% interrupts.CPU87.PMI:Performance_monitoring_interrupts
1140827 ± 11% -57.3% 487678 ± 20% interrupts.CPU87.RES:Rescheduling_interrupts
257236 ± 8% -61.0% 100445 ± 9% interrupts.CPU87.TLB:TLB_shootdowns
294640 ± 7% -48.5% 151734 ± 42% interrupts.CPU88.CAL:Function_call_interrupts
329190 ± 3% -31.2% 226451 ± 2% interrupts.CPU88.LOC:Local_timer_interrupts
7824 ± 17% -69.5% 2385 ± 72% interrupts.CPU88.NMI:Non-maskable_interrupts
7824 ± 17% -69.5% 2385 ± 72% interrupts.CPU88.PMI:Performance_monitoring_interrupts
1089044 ± 6% -55.4% 485846 ± 14% interrupts.CPU88.RES:Rescheduling_interrupts
257098 ± 8% -60.8% 100701 ± 8% interrupts.CPU88.TLB:TLB_shootdowns
292981 ± 10% -50.2% 145843 ± 17% interrupts.CPU89.CAL:Function_call_interrupts
329288 ± 3% -31.2% 226464 ± 2% interrupts.CPU89.LOC:Local_timer_interrupts
8363 ± 4% -71.4% 2390 ± 71% interrupts.CPU89.NMI:Non-maskable_interrupts
8363 ± 4% -71.4% 2390 ± 71% interrupts.CPU89.PMI:Performance_monitoring_interrupts
1113421 ± 10% -59.0% 456503 ± 18% interrupts.CPU89.RES:Rescheduling_interrupts
257323 ± 8% -61.2% 99727 ± 8% interrupts.CPU89.TLB:TLB_shootdowns
287972 ± 8% -49.4% 145832 ± 15% interrupts.CPU9.CAL:Function_call_interrupts
328322 ± 4% -31.0% 226489 ± 2% interrupts.CPU9.LOC:Local_timer_interrupts
7350 ± 24% -67.1% 2419 ± 71% interrupts.CPU9.NMI:Non-maskable_interrupts
7350 ± 24% -67.1% 2419 ± 71% interrupts.CPU9.PMI:Performance_monitoring_interrupts
1064529 ± 11% -53.6% 494023 ± 23% interrupts.CPU9.RES:Rescheduling_interrupts
257793 ± 8% -60.9% 100812 ± 9% interrupts.CPU9.TLB:TLB_shootdowns
294642 ± 16% -46.3% 158295 ± 11% interrupts.CPU90.CAL:Function_call_interrupts
329237 ± 3% -31.2% 226507 ± 2% interrupts.CPU90.LOC:Local_timer_interrupts
7314 ± 24% -67.2% 2398 ± 70% interrupts.CPU90.NMI:Non-maskable_interrupts
7314 ± 24% -67.2% 2398 ± 70% interrupts.CPU90.PMI:Performance_monitoring_interrupts
1170880 ± 11% -58.1% 490032 ± 17% interrupts.CPU90.RES:Rescheduling_interrupts
257726 ± 8% -60.7% 101321 ± 8% interrupts.CPU90.TLB:TLB_shootdowns
282677 ± 7% -56.8% 122230 ± 9% interrupts.CPU91.CAL:Function_call_interrupts
329228 ± 3% -31.2% 226480 ± 2% interrupts.CPU91.LOC:Local_timer_interrupts
7827 ± 17% -69.5% 2388 ± 71% interrupts.CPU91.NMI:Non-maskable_interrupts
7827 ± 17% -69.5% 2388 ± 71% interrupts.CPU91.PMI:Performance_monitoring_interrupts
1132881 ± 11% -59.4% 459916 ± 25% interrupts.CPU91.RES:Rescheduling_interrupts
257380 ± 8% -61.2% 99805 ± 8% interrupts.CPU91.TLB:TLB_shootdowns
280792 ± 8% -51.7% 135605 ± 15% interrupts.CPU92.CAL:Function_call_interrupts
329306 ± 3% -31.2% 226497 ± 2% interrupts.CPU92.LOC:Local_timer_interrupts
7824 ± 17% -69.6% 2379 ± 72% interrupts.CPU92.NMI:Non-maskable_interrupts
7824 ± 17% -69.6% 2379 ± 72% interrupts.CPU92.PMI:Performance_monitoring_interrupts
1116902 ± 11% -57.8% 471493 ± 13% interrupts.CPU92.RES:Rescheduling_interrupts
257189 ± 8% -61.2% 99816 ± 8% interrupts.CPU92.TLB:TLB_shootdowns
294998 ± 10% -49.3% 149595 ± 8% interrupts.CPU93.CAL:Function_call_interrupts
329320 ± 3% -31.2% 226475 ± 2% interrupts.CPU93.LOC:Local_timer_interrupts
7819 ± 17% -69.3% 2397 ± 70% interrupts.CPU93.NMI:Non-maskable_interrupts
7819 ± 17% -69.3% 2397 ± 70% interrupts.CPU93.PMI:Performance_monitoring_interrupts
1139150 ± 10% -51.9% 547841 ± 18% interrupts.CPU93.RES:Rescheduling_interrupts
257094 ± 8% -60.9% 100400 ± 9% interrupts.CPU93.TLB:TLB_shootdowns
277886 ± 10% -47.2% 146614 ± 24% interrupts.CPU94.CAL:Function_call_interrupts
329231 ± 3% -31.2% 226472 ± 2% interrupts.CPU94.LOC:Local_timer_interrupts
7819 ± 17% -69.6% 2379 ± 71% interrupts.CPU94.NMI:Non-maskable_interrupts
7819 ± 17% -69.6% 2379 ± 71% interrupts.CPU94.PMI:Performance_monitoring_interrupts
1138310 ± 11% -54.8% 514545 ± 16% interrupts.CPU94.RES:Rescheduling_interrupts
257491 ± 8% -61.1% 100254 ± 8% interrupts.CPU94.TLB:TLB_shootdowns
282333 ± 8% -53.3% 131952 ± 18% interrupts.CPU95.CAL:Function_call_interrupts
329304 ± 3% -31.2% 226485 ± 2% interrupts.CPU95.LOC:Local_timer_interrupts
7824 ± 17% -69.7% 2372 ± 72% interrupts.CPU95.NMI:Non-maskable_interrupts
7824 ± 17% -69.7% 2372 ± 72% interrupts.CPU95.PMI:Performance_monitoring_interrupts
1106751 ± 12% -56.2% 484957 ± 24% interrupts.CPU95.RES:Rescheduling_interrupts
257610 ± 8% -61.0% 100417 ± 8% interrupts.CPU95.TLB:TLB_shootdowns
311942 ± 13% -39.7% 187988 ± 19% interrupts.CPU96.CAL:Function_call_interrupts
328191 ± 4% -31.0% 226456 ± 2% interrupts.CPU96.LOC:Local_timer_interrupts
7869 ± 17% -69.1% 2435 ± 70% interrupts.CPU96.NMI:Non-maskable_interrupts
7869 ± 17% -69.1% 2435 ± 70% interrupts.CPU96.PMI:Performance_monitoring_interrupts
945943 ± 14% -56.2% 414699 ± 18% interrupts.CPU96.RES:Rescheduling_interrupts
258163 ± 8% -61.1% 100538 ± 9% interrupts.CPU96.TLB:TLB_shootdowns
316444 ± 12% -49.2% 160607 ± 20% interrupts.CPU97.CAL:Function_call_interrupts
328296 ± 3% -31.0% 226459 ± 2% interrupts.CPU97.LOC:Local_timer_interrupts
8403 ± 3% -76.7% 1957 ± 78% interrupts.CPU97.NMI:Non-maskable_interrupts
8403 ± 3% -76.7% 1957 ± 78% interrupts.CPU97.PMI:Performance_monitoring_interrupts
952147 ± 18% -48.3% 491918 ± 30% interrupts.CPU97.RES:Rescheduling_interrupts
257618 ± 8% -60.9% 100731 ± 9% interrupts.CPU97.TLB:TLB_shootdowns
300845 ± 9% -55.4% 134094 ± 11% interrupts.CPU98.CAL:Function_call_interrupts
327854 ± 4% -30.9% 226516 ± 2% interrupts.CPU98.LOC:Local_timer_interrupts
7892 ± 18% -75.4% 1941 ± 79% interrupts.CPU98.NMI:Non-maskable_interrupts
7892 ± 18% -75.4% 1941 ± 79% interrupts.CPU98.PMI:Performance_monitoring_interrupts
1043756 ± 13% -59.1% 426407 ± 24% interrupts.CPU98.RES:Rescheduling_interrupts
257590 ± 8% -60.9% 100652 ± 8% interrupts.CPU98.TLB:TLB_shootdowns
300265 ± 6% -47.5% 157738 ± 21% interrupts.CPU99.CAL:Function_call_interrupts
328218 ± 4% -31.0% 226496 ± 2% interrupts.CPU99.LOC:Local_timer_interrupts
8407 ± 3% -76.8% 1949 ± 79% interrupts.CPU99.NMI:Non-maskable_interrupts
8407 ± 3% -76.8% 1949 ± 79% interrupts.CPU99.PMI:Performance_monitoring_interrupts
1003079 ± 7% -57.9% 421849 ± 21% interrupts.CPU99.RES:Rescheduling_interrupts
258167 ± 8% -61.1% 100362 ± 9% interrupts.CPU99.TLB:TLB_shootdowns
359.75 ± 3% -78.0% 79.25 ± 98% interrupts.IWI:IRQ_work_interrupts
63173825 ± 3% -31.2% 43480379 ± 2% interrupts.LOC:Local_timer_interrupts
1499268 ± 3% -72.4% 413311 ± 72% interrupts.NMI:Non-maskable_interrupts
1499268 ± 3% -72.4% 413311 ± 72% interrupts.PMI:Performance_monitoring_interrupts
1.986e+08 ± 3% -52.4% 94474633 ± 4% interrupts.RES:Rescheduling_interrupts
49453077 ± 8% -61.3% 19148289 ± 8% interrupts.TLB:TLB_shootdowns
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 5 months
- 5
- 5
[fs/select.c] c191bb1b91: will-it-scale.per_thread_ops -2.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -2.3% regression of will-it-scale.per_thread_ops due to commit:
commit: c191bb1b91be4744f0cdf595dccbd4036cf24f5f ("[PATCH RESEND v2] fs/select.c: batch user writes in do_sys_poll")
url: https://github.com/0day-ci/linux/commits/Daniel-Axtens/fs-select-c-batch-...
base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git c2e7554e1b85935d962127efa3c2a76483b0b3b6
in testcase: will-it-scale
on test machine: 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory
with following parameters:
nr_task: 16
mode: thread
test: poll1
cpufreq_governor: performance
ucode: 0x16
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 6.7% improvement |
| test machine | 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=100% |
| | test=poll2 |
| | ucode=0x16 |
+------------------+------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/thread/16/debian-10.4-x86_64-20200603.cgz/lkp-hsw-4ex1/poll1/will-it-scale/0x16
commit:
c2e7554e1b ("Merge tag 'gfs2-v5.10-rc4-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/gfs2/linux-gfs2")
c191bb1b91 ("fs/select.c: batch user writes in do_sys_poll")
c2e7554e1b85935d c191bb1b91be4744f0cdf595dcc
---------------- ---------------------------
%stddev %change %stddev
\ | \
1321041 -2.3% 1290627 will-it-scale.per_thread_ops
21136668 -2.3% 20650046 will-it-scale.workload
166093 ± 28% +89.3% 314338 ± 56% numa-numastat.node3.numa_hit
4844 -11.4% 4293 ± 11% proc-vmstat.pgactivate
461.00 +10.7% 510.50 syscalls.sys_poll.med
4.427e+09 +14.7% 5.077e+09 perf-stat.i.branch-instructions
53850560 ± 51% +35.5% 72945539 ± 4% perf-stat.i.cache-references
2.44 ± 3% -9.3% 2.21 perf-stat.i.cpi
6.426e+09 +6.8% 6.86e+09 perf-stat.i.dTLB-loads
0.39 -0.0 0.36 perf-stat.i.dTLB-store-miss-rate%
5.616e+09 ± 2% +5.4% 5.918e+09 perf-stat.i.dTLB-stores
92.10 -10.8 81.26 ± 2% perf-stat.i.iTLB-load-miss-rate%
28795351 ± 6% +16.8% 33645430 ± 6% perf-stat.i.iTLB-load-misses
2374389 ± 17% +230.8% 7853686 ± 12% perf-stat.i.iTLB-loads
2.18e+10 +11.7% 2.435e+10 perf-stat.i.instructions
0.42 ± 3% +9.3% 0.46 perf-stat.i.ipc
114.91 +8.5% 124.71 perf-stat.i.metric.M/sec
2.39 ± 2% -8.5% 2.18 perf-stat.overall.cpi
0.39 -0.0 0.36 perf-stat.overall.dTLB-store-miss-rate%
92.41 -11.3 81.08 ± 2% perf-stat.overall.iTLB-load-miss-rate%
0.42 ± 3% +9.2% 0.46 perf-stat.overall.ipc
312367 +14.1% 356394 perf-stat.overall.path-length
4.412e+09 +14.7% 5.061e+09 perf-stat.ps.branch-instructions
53671657 ± 51% +35.5% 72700879 ± 4% perf-stat.ps.cache-references
6.405e+09 +6.8% 6.837e+09 perf-stat.ps.dTLB-loads
5.598e+09 ± 2% +5.4% 5.898e+09 perf-stat.ps.dTLB-stores
28698099 ± 6% +16.8% 33530337 ± 6% perf-stat.ps.iTLB-load-misses
2366699 ± 17% +230.7% 7827623 ± 12% perf-stat.ps.iTLB-loads
2.173e+10 +11.7% 2.427e+10 perf-stat.ps.instructions
6.602e+12 +11.5% 7.36e+12 perf-stat.total.instructions
39.25 ±111% -88.5% 4.50 ± 45% interrupts.CPU110.RES:Rescheduling_interrupts
96.75 ± 4% +61.5% 156.25 ± 32% interrupts.CPU124.NMI:Non-maskable_interrupts
96.75 ± 4% +61.5% 156.25 ± 32% interrupts.CPU124.PMI:Performance_monitoring_interrupts
96.50 ± 35% +79.0% 172.75 ± 20% interrupts.CPU127.NMI:Non-maskable_interrupts
96.50 ± 35% +79.0% 172.75 ± 20% interrupts.CPU127.PMI:Performance_monitoring_interrupts
2.75 ± 69% +2118.2% 61.00 ±153% interrupts.CPU138.RES:Rescheduling_interrupts
99.50 ± 14% +52.8% 152.00 ± 35% interrupts.CPU139.NMI:Non-maskable_interrupts
99.50 ± 14% +52.8% 152.00 ± 35% interrupts.CPU139.PMI:Performance_monitoring_interrupts
121.25 ± 34% +41.4% 171.50 ± 25% interrupts.CPU142.NMI:Non-maskable_interrupts
121.25 ± 34% +41.4% 171.50 ± 25% interrupts.CPU142.PMI:Performance_monitoring_interrupts
3435 ± 7% +44.2% 4954 ± 20% interrupts.CPU15.NMI:Non-maskable_interrupts
3435 ± 7% +44.2% 4954 ± 20% interrupts.CPU15.PMI:Performance_monitoring_interrupts
7029 ± 8% -47.0% 3728 ± 13% interrupts.CPU5.NMI:Non-maskable_interrupts
7029 ± 8% -47.0% 3728 ± 13% interrupts.CPU5.PMI:Performance_monitoring_interrupts
112.50 ± 15% +50.7% 169.50 ± 21% interrupts.CPU71.NMI:Non-maskable_interrupts
112.50 ± 15% +50.7% 169.50 ± 21% interrupts.CPU71.PMI:Performance_monitoring_interrupts
5583 ± 27% -35.2% 3617 ± 34% interrupts.CPU75.NMI:Non-maskable_interrupts
5583 ± 27% -35.2% 3617 ± 34% interrupts.CPU75.PMI:Performance_monitoring_interrupts
233.50 ± 8% -37.6% 145.75 ± 39% interrupts.CPU81.TLB:TLB_shootdowns
4074 ± 22% +27.2% 5182 ± 21% interrupts.CPU9.NMI:Non-maskable_interrupts
4074 ± 22% +27.2% 5182 ± 21% interrupts.CPU9.PMI:Performance_monitoring_interrupts
291.00 ± 9% +25.4% 365.00 ± 14% interrupts.CPU9.TLB:TLB_shootdowns
4.25 ± 67% +764.7% 36.75 ±108% interrupts.CPU91.RES:Rescheduling_interrupts
87.75 ± 32% +125.4% 197.75 ± 14% interrupts.CPU94.NMI:Non-maskable_interrupts
87.75 ± 32% +125.4% 197.75 ± 14% interrupts.CPU94.PMI:Performance_monitoring_interrupts
9830 ± 12% -12.0% 8650 ± 3% interrupts.TLB:TLB_shootdowns
0.00 +0.7 0.68 ± 10% perf-profile.calltrace.cycles-pp._copy_to_user.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.02 ± 9% +1.0 5.97 ± 10% perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
6.37 ± 9% +1.1 7.46 ± 10% perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
13.52 ± 8% +1.5 15.05 ± 10% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
0.05 ± 8% +0.1 0.11 ± 14% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.15 ± 20% +0.1 0.24 ± 10% perf-profile.children.cycles-pp.check_stack_object
0.14 ± 9% +0.1 0.23 ± 11% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.33 ± 11% +0.1 0.47 ± 9% perf-profile.children.cycles-pp.___might_sleep
0.19 ± 11% +0.1 0.33 ± 14% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.19 ± 13% +0.2 0.35 ± 9% perf-profile.children.cycles-pp.__might_sleep
0.32 ± 7% +0.2 0.56 ± 12% perf-profile.children.cycles-pp.__check_object_size
0.64 ± 12% +0.4 1.00 ± 9% perf-profile.children.cycles-pp.__might_fault
0.00 +0.7 0.70 ± 10% perf-profile.children.cycles-pp._copy_to_user
5.14 ± 9% +1.0 6.15 ± 10% perf-profile.children.cycles-pp.do_sys_poll
6.39 ± 9% +1.1 7.51 ± 10% perf-profile.children.cycles-pp.__x64_sys_poll
13.59 ± 8% +1.5 15.12 ± 10% perf-profile.children.cycles-pp.do_syscall_64
0.13 ± 11% +0.0 0.16 ± 11% perf-profile.self.cycles-pp.poll_freewait
0.15 ± 19% +0.1 0.21 ± 12% perf-profile.self.cycles-pp.check_stack_object
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.17 ± 13% +0.1 0.22 ± 12% perf-profile.self.cycles-pp.do_syscall_64
0.11 ± 11% +0.1 0.17 ± 9% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.13 ± 18% +0.1 0.21 ± 13% perf-profile.self.cycles-pp.__might_fault
0.16 ± 10% +0.1 0.30 ± 8% perf-profile.self.cycles-pp.__might_sleep
0.32 ± 11% +0.1 0.46 ± 11% perf-profile.self.cycles-pp.___might_sleep
0.60 ± 14% +0.1 0.74 ± 10% perf-profile.self.cycles-pp.ftrace_syscall_exit
0.16 ± 11% +0.1 0.30 ± 14% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.17 ± 4% +0.2 0.33 ± 12% perf-profile.self.cycles-pp.__check_object_size
0.00 +0.2 0.21 ± 8% perf-profile.self.cycles-pp._copy_to_user
10910 ± 13% -17.9% 8955 ± 7% softirqs.CPU109.RCU
9932 ± 15% -17.0% 8240 ± 7% softirqs.CPU110.RCU
17714 ± 20% -53.4% 8261 ± 33% softirqs.CPU12.SCHED
11377 ± 27% -23.7% 8680 ± 5% softirqs.CPU128.RCU
18811 ± 3% -25.8% 13967 ± 13% softirqs.CPU13.SCHED
13684 ± 11% -21.6% 10728 ± 13% softirqs.CPU132.RCU
10948 ± 29% -24.8% 8238 ± 9% softirqs.CPU16.RCU
13961 ± 13% -19.8% 11198 ± 6% softirqs.CPU19.RCU
12708 ± 18% -18.8% 10318 ± 5% softirqs.CPU20.RCU
15297 ± 22% -30.5% 10629 ± 2% softirqs.CPU21.RCU
16571 ± 9% -20.1% 13236 ± 14% softirqs.CPU23.RCU
14472 ± 10% -16.3% 12114 ± 7% softirqs.CPU26.RCU
11203 ± 8% -22.4% 8688 ± 14% softirqs.CPU32.RCU
13804 ± 11% -19.1% 11171 ± 9% softirqs.CPU38.RCU
12160 ± 23% -20.9% 9618 ± 3% softirqs.CPU42.RCU
13930 ± 5% -15.6% 11758 ± 13% softirqs.CPU48.RCU
14228 ± 4% -23.0% 10954 ± 19% softirqs.CPU51.RCU
12704 ± 12% -21.0% 10038 ± 7% softirqs.CPU55.RCU
11699 ± 17% -18.1% 9583 ± 7% softirqs.CPU56.RCU
12408 ± 8% -22.6% 9598 ± 8% softirqs.CPU64.RCU
13203 ± 4% -17.2% 10926 ± 14% softirqs.CPU68.RCU
14688 ± 5% -9.7% 13269 ± 6% softirqs.CPU74.RCU
14748 ± 3% -13.0% 12829 ± 9% softirqs.CPU79.RCU
21729 ± 12% +30.0% 28254 ± 17% softirqs.CPU82.SCHED
20503 ± 10% +33.5% 27374 ± 23% softirqs.CPU83.SCHED
21808 ± 15% +59.9% 34871 ± 4% softirqs.CPU84.SCHED
20813 ± 2% +42.9% 29732 ± 15% softirqs.CPU85.SCHED
16729 ± 38% +49.6% 25033 ± 18% softirqs.CPU86.SCHED
10712 ± 23% -27.6% 7750 ± 3% softirqs.CPU89.RCU
9737 ± 16% -17.8% 8004 ± 7% softirqs.CPU92.RCU
13145 ± 12% -25.3% 9817 ± 12% softirqs.CPU96.RCU
14061 ± 7% -24.4% 10632 ± 15% softirqs.CPU97.RCU
will-it-scale.per_thread_ops
1.325e+06 +---------------------------------------------------------------+
| .+ +.+ +..+.+.+ + + .|
1.32e+06 |.+ .+.+. : : + + : .+ +..+ |
1.315e+06 |-+..+.+ : : +.+..+.+ : .+.+.+..+ |
| + : +. |
1.31e+06 |-+ + : |
1.305e+06 |-+ + |
| |
1.3e+06 |-+ |
1.295e+06 |-+ |
| O O O O O O O O |
1.29e+06 |-+ O O O O O O O O O |
1.285e+06 |-+ O O |
| O O O |
1.28e+06 +---------------------------------------------------------------+
syscalls.sys_poll.med
520 +---------------------------------------------------------------------+
| |
510 |-+O O O O O O O O O O O O O O O O O O O |
| O |
500 |-+ |
| O O |
490 |-+ |
| |
480 |-+ |
| |
470 |-+ |
| .+. .+.+ .+.. .+..+.+..+.+..+.+.. |
460 |-.+.+..+.+. +. + .+ + +.+..+.|
|. + .+.+..+.+. |
450 +---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-hsw-4ex1: 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/100%/debian-10.4-x86_64-20200603.cgz/lkp-hsw-4ex1/poll2/will-it-scale/0x16
commit:
c2e7554e1b ("Merge tag 'gfs2-v5.10-rc4-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/gfs2/linux-gfs2")
c191bb1b91 ("fs/select.c: batch user writes in do_sys_poll")
c2e7554e1b85935d c191bb1b91be4744f0cdf595dcc
---------------- ---------------------------
%stddev %change %stddev
\ | \
274620 +6.7% 292996 will-it-scale.per_process_ops
39545400 +6.7% 42191543 will-it-scale.workload
5419 +8.5% 5882 ± 6% numa-meminfo.node3.KernelStack
239172 ± 3% -8.5% 218745 ± 7% numa-numastat.node0.numa_hit
135.64 ± 18% -33.2% 90.55 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.stddev
18.00 +5.6% 19.00 vmstat.cpu.us
42108 ± 61% +57.4% 66280 ± 42% numa-vmstat.node0.numa_other
5420 +8.5% 5881 ± 6% numa-vmstat.node3.nr_kernel_stack
5691 ± 7% -17.4% 4702 ± 4% slabinfo.eventpoll_pwq.active_objs
5691 ± 7% -17.4% 4702 ± 4% slabinfo.eventpoll_pwq.num_objs
38.09 ± 9% -6.6% 35.57 boot-time.boot
26.35 -1.5% 25.96 boot-time.dhcp
4631 ± 10% -7.8% 4271 boot-time.idle
19539 ± 74% -86.7% 2595 ±103% syscalls.sys_close.max
592.00 ± 4% -53.4% 275.75 ±100% syscalls.sys_close.min
38616838 ± 24% -2.2e+07 16663575 ±102% syscalls.sys_close.noise.50%
1.829e+08 ± 12% +9.5e+07 2.781e+08 ± 17% syscalls.sys_mmap.noise.100%
2.962e+08 ± 11% +9.1e+07 3.87e+08 ± 10% syscalls.sys_mmap.noise.2%
2.757e+08 ± 13% +9.2e+07 3.678e+08 ± 11% syscalls.sys_mmap.noise.25%
2.952e+08 ± 12% +9.1e+07 3.858e+08 ± 10% syscalls.sys_mmap.noise.5%
2.397e+08 ± 17% +9.8e+07 3.377e+08 ± 11% syscalls.sys_mmap.noise.50%
82708 ± 19% +38.2% 114327 ± 14% syscalls.sys_openat.max
5465 ± 6% +7.6% 5881 ± 4% syscalls.sys_openat.min
1.735e+08 ± 11% +7.3e+07 2.463e+08 ± 15% syscalls.sys_openat.noise.100%
2.604e+08 ± 9% +8.8e+07 3.481e+08 ± 12% syscalls.sys_openat.noise.2%
2.389e+08 ± 8% +8.5e+07 3.244e+08 ± 12% syscalls.sys_openat.noise.25%
2.588e+08 ± 9% +8.9e+07 3.475e+08 ± 12% syscalls.sys_openat.noise.5%
2.139e+08 ± 14% +9.3e+07 3.07e+08 ± 13% syscalls.sys_openat.noise.50%
1.909e+08 ± 13% +8.3e+07 2.736e+08 ± 11% syscalls.sys_openat.noise.75%
5197 -10.2% 4667 syscalls.sys_poll.min
1.075e+11 -9.8% 9.693e+10 perf-stat.i.branch-instructions
0.30 -0.0 0.25 ± 2% perf-stat.i.branch-miss-rate%
3.112e+08 -24.3% 2.355e+08 perf-stat.i.branch-misses
0.81 +7.0% 0.87 perf-stat.i.cpi
1.081e+11 -3.3% 1.046e+11 perf-stat.i.dTLB-loads
0.07 +0.0 0.08 ± 2% perf-stat.i.dTLB-store-miss-rate%
39690700 +8.2% 42933145 ± 2% perf-stat.i.dTLB-store-misses
6.008e+10 -5.4% 5.683e+10 perf-stat.i.dTLB-stores
40551436 +27.0% 51498580 ± 2% perf-stat.i.iTLB-load-misses
4.92e+11 -6.5% 4.6e+11 perf-stat.i.instructions
12115 -26.2% 8944 ± 2% perf-stat.i.instructions-per-iTLB-miss
1.23 -6.7% 1.15 perf-stat.i.ipc
0.95 ± 2% -9.9% 0.85 perf-stat.i.metric.K/sec
1914 -6.3% 1794 perf-stat.i.metric.M/sec
861498 +5.0% 904380 perf-stat.i.node-stores
0.29 -0.0 0.24 perf-stat.overall.branch-miss-rate%
0.81 +7.3% 0.87 perf-stat.overall.cpi
0.07 +0.0 0.08 ± 2% perf-stat.overall.dTLB-store-miss-rate%
12138 -26.4% 8937 ± 2% perf-stat.overall.instructions-per-iTLB-miss
1.24 -6.8% 1.15 perf-stat.overall.ipc
3752635 -12.3% 3291386 perf-stat.overall.path-length
1.071e+11 -9.8% 9.659e+10 perf-stat.ps.branch-instructions
3.101e+08 -24.3% 2.347e+08 perf-stat.ps.branch-misses
1.078e+11 -3.3% 1.042e+11 perf-stat.ps.dTLB-loads
39554490 +8.2% 42784025 ± 2% perf-stat.ps.dTLB-store-misses
5.988e+10 -5.4% 5.664e+10 perf-stat.ps.dTLB-stores
40411523 +27.0% 51320791 ± 2% perf-stat.ps.iTLB-load-misses
4.904e+11 -6.5% 4.585e+11 perf-stat.ps.instructions
873555 +5.2% 918647 perf-stat.ps.node-stores
1.484e+14 -6.4% 1.389e+14 perf-stat.total.instructions
1034 ± 18% -25.0% 776.50 ± 21% interrupts.CPU0.CAL:Function_call_interrupts
3102 ± 29% -32.4% 2096 ± 31% interrupts.CPU109.CAL:Function_call_interrupts
309.00 +16.7% 360.75 ± 11% interrupts.CPU11.RES:Rescheduling_interrupts
3896 +51.8% 5915 ± 33% interrupts.CPU112.NMI:Non-maskable_interrupts
3896 +51.8% 5915 ± 33% interrupts.CPU112.PMI:Performance_monitoring_interrupts
3896 +76.3% 6870 ± 24% interrupts.CPU116.NMI:Non-maskable_interrupts
3896 +76.3% 6870 ± 24% interrupts.CPU116.PMI:Performance_monitoring_interrupts
3897 +77.1% 6900 ± 25% interrupts.CPU117.NMI:Non-maskable_interrupts
3897 +77.1% 6900 ± 25% interrupts.CPU117.PMI:Performance_monitoring_interrupts
403.00 ± 26% -25.6% 299.75 interrupts.CPU118.RES:Rescheduling_interrupts
4886 ± 34% +61.2% 7879 interrupts.CPU120.NMI:Non-maskable_interrupts
4886 ± 34% +61.2% 7879 interrupts.CPU120.PMI:Performance_monitoring_interrupts
4892 ± 34% +40.8% 6886 ± 24% interrupts.CPU122.NMI:Non-maskable_interrupts
4892 ± 34% +40.8% 6886 ± 24% interrupts.CPU122.PMI:Performance_monitoring_interrupts
303.00 ± 2% +122.4% 673.75 ± 66% interrupts.CPU130.RES:Rescheduling_interrupts
874.75 ± 22% -21.7% 685.00 interrupts.CPU133.CAL:Function_call_interrupts
6892 ± 24% -43.0% 3930 interrupts.CPU143.NMI:Non-maskable_interrupts
6892 ± 24% -43.0% 3930 interrupts.CPU143.PMI:Performance_monitoring_interrupts
4840 ± 34% +23.8% 5990 ± 29% interrupts.CPU15.NMI:Non-maskable_interrupts
4840 ± 34% +23.8% 5990 ± 29% interrupts.CPU15.PMI:Performance_monitoring_interrupts
4912 ± 31% +57.1% 7717 interrupts.CPU25.NMI:Non-maskable_interrupts
4912 ± 31% +57.1% 7717 interrupts.CPU25.PMI:Performance_monitoring_interrupts
852.25 ± 27% -19.7% 684.50 interrupts.CPU3.CAL:Function_call_interrupts
4913 ± 34% +30.2% 6396 ± 23% interrupts.CPU43.NMI:Non-maskable_interrupts
4913 ± 34% +30.2% 6396 ± 23% interrupts.CPU43.PMI:Performance_monitoring_interrupts
505.00 ± 27% -34.8% 329.25 ± 3% interrupts.CPU56.RES:Rescheduling_interrupts
4816 ± 34% +41.5% 6814 ± 24% interrupts.CPU74.NMI:Non-maskable_interrupts
4816 ± 34% +41.5% 6814 ± 24% interrupts.CPU74.PMI:Performance_monitoring_interrupts
4360 ± 19% +60.5% 6997 ± 19% interrupts.CPU78.NMI:Non-maskable_interrupts
4360 ± 19% +60.5% 6997 ± 19% interrupts.CPU78.PMI:Performance_monitoring_interrupts
570.25 ± 43% -44.1% 318.50 ± 7% interrupts.CPU79.RES:Rescheduling_interrupts
3887 +50.0% 5832 ± 32% interrupts.CPU8.NMI:Non-maskable_interrupts
3887 +50.0% 5832 ± 32% interrupts.CPU8.PMI:Performance_monitoring_interrupts
4831 ± 35% +61.6% 7807 interrupts.CPU81.NMI:Non-maskable_interrupts
4831 ± 35% +61.6% 7807 interrupts.CPU81.PMI:Performance_monitoring_interrupts
4828 ± 33% +55.5% 7508 ± 5% interrupts.CPU88.NMI:Non-maskable_interrupts
4828 ± 33% +55.5% 7508 ± 5% interrupts.CPU88.PMI:Performance_monitoring_interrupts
688.25 +37.5% 946.00 ± 38% interrupts.CPU94.CAL:Function_call_interrupts
6463 ± 24% -40.4% 3852 interrupts.CPU98.NMI:Non-maskable_interrupts
6463 ± 24% -40.4% 3852 interrupts.CPU98.PMI:Performance_monitoring_interrupts
24015 ± 3% -20.1% 19190 ± 11% softirqs.CPU0.RCU
23795 ± 13% -24.6% 17932 ± 11% softirqs.CPU1.RCU
20222 ± 4% -18.7% 16444 ± 11% softirqs.CPU10.RCU
19790 ± 5% -13.9% 17031 ± 12% softirqs.CPU100.RCU
20600 ± 7% -14.5% 17608 ± 13% softirqs.CPU103.RCU
19617 ± 5% -14.4% 16800 ± 12% softirqs.CPU104.RCU
20111 ± 4% -17.0% 16698 ± 11% softirqs.CPU105.RCU
20401 ± 4% -15.6% 17213 ± 12% softirqs.CPU106.RCU
20290 ± 5% -13.3% 17601 ± 9% softirqs.CPU107.RCU
15162 ± 8% -13.9% 13048 ± 7% softirqs.CPU111.RCU
19858 ± 7% -17.1% 16469 ± 13% softirqs.CPU112.RCU
21004 ± 4% -17.0% 17424 ± 16% softirqs.CPU113.RCU
20941 ± 6% -18.3% 17111 ± 13% softirqs.CPU114.RCU
20866 ± 5% -18.6% 16994 ± 14% softirqs.CPU115.RCU
20680 ± 8% -15.4% 17486 ± 16% softirqs.CPU116.RCU
20294 ± 6% -16.8% 16893 ± 14% softirqs.CPU118.RCU
18823 ± 7% -13.5% 16284 ± 13% softirqs.CPU119.RCU
18999 -19.2% 15347 ± 9% softirqs.CPU12.RCU
19549 ± 5% -12.9% 17033 ± 15% softirqs.CPU120.RCU
19347 ± 6% -14.9% 16459 ± 12% softirqs.CPU121.RCU
20077 -15.0% 17076 ± 11% softirqs.CPU122.RCU
18921 ± 6% -14.6% 16161 ± 13% softirqs.CPU123.RCU
19733 ± 7% -16.6% 16447 ± 14% softirqs.CPU124.RCU
18747 ± 7% -14.2% 16081 ± 12% softirqs.CPU125.RCU
19576 ± 2% -21.5% 15364 ± 15% softirqs.CPU13.RCU
19633 ± 6% -17.8% 16136 ± 11% softirqs.CPU14.RCU
19474 -17.0% 16157 ± 8% softirqs.CPU15.RCU
13032 ± 5% -13.3% 11296 ± 4% softirqs.CPU16.RCU
21118 ± 4% -24.6% 15931 ± 15% softirqs.CPU18.RCU
21481 ± 6% -21.6% 16848 ± 13% softirqs.CPU19.RCU
20905 ± 5% -18.9% 16950 ± 8% softirqs.CPU2.RCU
20451 ± 5% -19.4% 16484 ± 14% softirqs.CPU20.RCU
21874 ± 13% -22.6% 16931 ± 13% softirqs.CPU21.RCU
20134 ± 6% -19.9% 16132 ± 11% softirqs.CPU22.RCU
21091 ± 8% -19.1% 17072 ± 13% softirqs.CPU23.RCU
20274 ± 7% -16.0% 17021 ± 15% softirqs.CPU24.RCU
20052 ± 5% -19.0% 16238 ± 12% softirqs.CPU25.RCU
20312 ± 6% -17.6% 16742 ± 13% softirqs.CPU26.RCU
19908 ± 4% -17.9% 16344 ± 14% softirqs.CPU27.RCU
19007 ± 4% -14.6% 16225 ± 13% softirqs.CPU28.RCU
18961 ± 2% -14.8% 16153 ± 12% softirqs.CPU29.RCU
19179 ± 7% -14.1% 16480 ± 14% softirqs.CPU31.RCU
15175 ± 6% -14.3% 13008 ± 8% softirqs.CPU33.RCU
15497 ± 7% -15.5% 13091 ± 9% softirqs.CPU34.RCU
20075 ± 7% -18.6% 16337 ± 13% softirqs.CPU36.RCU
19733 ± 7% -16.6% 16461 ± 12% softirqs.CPU37.RCU
19773 ± 9% -18.5% 16109 ± 14% softirqs.CPU38.RCU
20016 ± 9% -18.7% 16264 ± 12% softirqs.CPU39.RCU
19876 ± 2% -15.4% 16818 ± 11% softirqs.CPU4.RCU
19783 ± 8% -17.9% 16241 ± 13% softirqs.CPU40.RCU
19899 ± 7% -18.7% 16184 ± 15% softirqs.CPU41.RCU
19607 ± 7% -19.6% 15756 ± 13% softirqs.CPU42.RCU
20270 ± 9% -20.1% 16197 ± 14% softirqs.CPU43.RCU
20019 ± 7% -17.8% 16447 ± 13% softirqs.CPU46.RCU
19490 ± 7% -13.7% 16826 ± 14% softirqs.CPU47.RCU
21764 ± 3% -21.0% 17185 ± 13% softirqs.CPU5.RCU
21386 ± 2% -20.0% 17107 ± 11% softirqs.CPU6.RCU
17298 ± 3% -12.3% 15177 ± 12% softirqs.CPU61.RCU
20348 ± 3% -17.5% 16796 ± 9% softirqs.CPU7.RCU
17202 ± 5% -12.7% 15017 ± 9% softirqs.CPU70.RCU
21532 ± 2% -12.9% 18755 ± 4% softirqs.CPU72.RCU
19809 ± 4% -14.8% 16880 ± 10% softirqs.CPU73.RCU
17594 ± 3% -14.4% 15055 ± 10% softirqs.CPU76.RCU
18105 ± 6% -16.7% 15084 ± 10% softirqs.CPU79.RCU
19810 ± 2% -17.1% 16424 ± 9% softirqs.CPU8.RCU
19135 ± 10% -21.5% 15018 ± 9% softirqs.CPU80.RCU
19213 ± 3% -18.4% 15684 ± 13% softirqs.CPU81.RCU
19420 ± 5% -18.6% 15806 ± 9% softirqs.CPU84.RCU
19353 ± 6% -17.9% 15894 ± 13% softirqs.CPU85.RCU
20126 ± 6% -21.3% 15845 ± 12% softirqs.CPU86.RCU
19408 ± 5% -17.9% 15934 ± 11% softirqs.CPU87.RCU
23453 ± 14% -32.5% 15824 ± 11% softirqs.CPU88.RCU
19281 ± 6% -19.8% 15460 ± 12% softirqs.CPU89.RCU
19960 ± 3% -19.2% 16124 ± 11% softirqs.CPU9.RCU
18900 ± 4% -17.5% 15590 ± 10% softirqs.CPU91.RCU
16433 ± 5% -16.2% 13779 ± 13% softirqs.CPU92.RCU
16210 ± 4% -15.2% 13750 ± 11% softirqs.CPU93.RCU
16136 ± 3% -15.3% 13664 ± 10% softirqs.CPU94.RCU
16855 ± 7% -15.3% 14283 ± 11% softirqs.CPU95.RCU
20517 ± 7% -16.2% 17190 ± 10% softirqs.CPU96.RCU
20516 ± 7% -19.7% 16468 ± 11% softirqs.CPU97.RCU
20661 ± 6% -18.1% 16923 ± 13% softirqs.CPU98.RCU
20716 ± 5% -18.2% 16952 ± 13% softirqs.CPU99.RCU
2696425 ± 3% -14.0% 2318720 ± 11% softirqs.RCU
6.06 -6.1 0.00 perf-profile.calltrace.cycles-pp.__put_user_nocheck_2.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
68.49 -1.9 66.62 perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
74.30 -1.6 72.68 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
65.03 -1.1 63.96 perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
86.64 -0.9 85.74 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__poll
92.74 -0.3 92.46 perf-profile.calltrace.cycles-pp.__poll
1.18 ± 2% -0.2 0.99 perf-profile.calltrace.cycles-pp.kfree.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.56 +0.0 0.59 perf-profile.calltrace.cycles-pp.trace_clock_x86_tsc.__rb_reserve_next.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_exit
0.71 +0.0 0.74 ± 2% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.__poll
0.63 +0.0 0.68 perf-profile.calltrace.cycles-pp.memcpy_erms.ftrace_syscall_enter.syscall_trace_enter.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.60 +0.0 0.65 ± 2% perf-profile.calltrace.cycles-pp.trace_clock_x86_tsc.__rb_reserve_next.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_enter
1.27 +0.1 1.34 ± 2% perf-profile.calltrace.cycles-pp.__rb_reserve_next.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_exit.syscall_exit_to_user_mode
1.76 +0.1 1.87 perf-profile.calltrace.cycles-pp.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_exit.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
1.29 +0.1 1.41 ± 2% perf-profile.calltrace.cycles-pp.__rb_reserve_next.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_enter.syscall_trace_enter
2.15 +0.1 2.27 perf-profile.calltrace.cycles-pp.trace_buffer_lock_reserve.ftrace_syscall_exit.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.__poll
2.43 +0.1 2.56 perf-profile.calltrace.cycles-pp.__entry_text_start.__poll
1.76 +0.1 1.90 ± 2% perf-profile.calltrace.cycles-pp.ring_buffer_lock_reserve.trace_buffer_lock_reserve.ftrace_syscall_enter.syscall_trace_enter.do_syscall_64
2.16 +0.2 2.32 ± 2% perf-profile.calltrace.cycles-pp.trace_buffer_lock_reserve.ftrace_syscall_enter.syscall_trace_enter.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.70 +0.2 2.85 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.__poll
4.65 +0.2 4.84 perf-profile.calltrace.cycles-pp.__fdget.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.30 +0.2 5.51 perf-profile.calltrace.cycles-pp.syscall_trace_enter.do_syscall_64.entry_SYSCALL_64_after_hwframe.__poll
3.58 +0.3 3.83 ± 2% perf-profile.calltrace.cycles-pp.ftrace_syscall_exit.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.__poll
6.68 ± 2% +0.3 6.94 perf-profile.calltrace.cycles-pp.testcase
2.39 ± 5% +0.3 2.66 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64
3.48 ± 4% +0.3 3.79 perf-profile.calltrace.cycles-pp._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.52 ± 3% +0.4 0.92 ± 5% perf-profile.calltrace.cycles-pp.__virt_addr_valid.__check_object_size.do_sys_poll.__x64_sys_poll.do_syscall_64
0.00 +0.5 0.52 perf-profile.calltrace.cycles-pp.check_stack_object.__check_object_size.do_sys_poll.__x64_sys_poll.do_syscall_64
11.81 +0.7 12.52 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.__poll
0.00 +0.7 0.72 perf-profile.calltrace.cycles-pp.__might_fault._copy_to_user.do_sys_poll.__x64_sys_poll.do_syscall_64
0.00 +1.1 1.07 perf-profile.calltrace.cycles-pp.__check_heap_object.__check_object_size.do_sys_poll.__x64_sys_poll.do_syscall_64
0.70 ± 2% +1.1 1.79 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_safe_stack.__poll
24.95 +1.6 26.52 perf-profile.calltrace.cycles-pp.__fget_light.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.79 +2.1 3.93 perf-profile.calltrace.cycles-pp.__check_object_size.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.2 2.25 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_to_user.do_sys_poll.__x64_sys_poll.do_syscall_64
0.00 +3.3 3.29 perf-profile.calltrace.cycles-pp._copy_to_user.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.23 -5.2 0.00 perf-profile.children.cycles-pp.__put_user_nocheck_2
67.28 -1.9 65.34 perf-profile.children.cycles-pp.do_sys_poll
68.53 -1.9 66.66 perf-profile.children.cycles-pp.__x64_sys_poll
74.38 -1.6 72.75 perf-profile.children.cycles-pp.do_syscall_64
86.71 -0.9 85.80 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
93.32 -0.3 93.05 perf-profile.children.cycles-pp.__poll
1.19 -0.2 0.99 perf-profile.children.cycles-pp.kfree
0.23 ± 3% -0.0 0.21 ± 2% perf-profile.children.cycles-pp.poll_freewait
0.22 +0.0 0.23 perf-profile.children.cycles-pp.poll@plt
0.22 +0.0 0.23 perf-profile.children.cycles-pp.__x86_retpoline_rax
0.52 ± 2% +0.0 0.54 ± 2% perf-profile.children.cycles-pp.tracing_generic_entry_update
0.27 +0.0 0.29 perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.72 +0.0 0.77 perf-profile.children.cycles-pp.exit_to_user_mode_prepare
1.18 +0.1 1.27 perf-profile.children.cycles-pp.trace_clock_x86_tsc
3.10 +0.2 3.27 perf-profile.children.cycles-pp.syscall_return_via_sysret
3.99 +0.2 4.17 perf-profile.children.cycles-pp.__fdget
2.59 +0.2 2.79 ± 2% perf-profile.children.cycles-pp.__rb_reserve_next
5.31 +0.2 5.53 perf-profile.children.cycles-pp.syscall_trace_enter
3.55 +0.2 3.80 ± 2% perf-profile.children.cycles-pp.ring_buffer_lock_reserve
3.63 +0.3 3.89 ± 2% perf-profile.children.cycles-pp.ftrace_syscall_exit
6.75 ± 2% +0.3 7.01 perf-profile.children.cycles-pp.testcase
0.34 +0.3 0.61 perf-profile.children.cycles-pp.__might_sleep
4.39 +0.3 4.67 ± 2% perf-profile.children.cycles-pp.trace_buffer_lock_reserve
0.71 ± 2% +0.3 1.04 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
3.58 ± 3% +0.3 3.91 perf-profile.children.cycles-pp._copy_from_user
0.22 ± 3% +0.3 0.56 perf-profile.children.cycles-pp.check_stack_object
0.49 +0.4 0.87 perf-profile.children.cycles-pp.___might_sleep
0.52 ± 3% +0.4 0.92 ± 5% perf-profile.children.cycles-pp.__virt_addr_valid
2.88 +0.4 3.32 perf-profile.children.cycles-pp.__entry_text_start
0.48 +0.6 1.10 perf-profile.children.cycles-pp.__check_heap_object
11.91 +0.7 12.62 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.80 +0.8 1.60 perf-profile.children.cycles-pp.__might_fault
24.36 +1.7 26.05 perf-profile.children.cycles-pp.__fget_light
1.89 +2.3 4.14 perf-profile.children.cycles-pp.__check_object_size
2.43 ± 5% +2.5 4.97 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.00 +3.4 3.37 perf-profile.children.cycles-pp._copy_to_user
30.87 -5.8 25.09 perf-profile.self.cycles-pp.do_sys_poll
1.17 ± 2% -0.2 0.98 perf-profile.self.cycles-pp.kfree
0.21 ± 2% -0.0 0.19 perf-profile.self.cycles-pp.poll_freewait
0.48 +0.0 0.50 ± 2% perf-profile.self.cycles-pp.tracing_generic_entry_update
0.23 ± 3% +0.0 0.26 perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.40 ± 2% +0.0 0.43 perf-profile.self.cycles-pp._copy_from_user
0.60 +0.0 0.64 perf-profile.self.cycles-pp.exit_to_user_mode_prepare
1.08 +0.1 1.15 ± 2% perf-profile.self.cycles-pp.__x64_sys_poll
1.13 +0.1 1.20 ± 2% perf-profile.self.cycles-pp.trace_clock_x86_tsc
0.59 ± 3% +0.1 0.68 ± 3% perf-profile.self.cycles-pp.ftrace_syscall_exit
1.70 +0.1 1.80 perf-profile.self.cycles-pp.__fdget
1.29 +0.1 1.40 ± 2% perf-profile.self.cycles-pp.__rb_reserve_next
0.23 ± 2% +0.2 0.40 ± 2% perf-profile.self.cycles-pp.__might_fault
3.08 +0.2 3.26 perf-profile.self.cycles-pp.syscall_return_via_sysret
0.31 +0.3 0.56 perf-profile.self.cycles-pp.__might_sleep
6.56 ± 2% +0.3 6.83 perf-profile.self.cycles-pp.testcase
0.17 ± 2% +0.3 0.46 perf-profile.self.cycles-pp.check_stack_object
0.00 +0.4 0.35 perf-profile.self.cycles-pp._copy_to_user
0.48 +0.4 0.86 perf-profile.self.cycles-pp.___might_sleep
0.49 ± 3% +0.4 0.87 ± 6% perf-profile.self.cycles-pp.__virt_addr_valid
2.44 +0.4 2.86 perf-profile.self.cycles-pp.__entry_text_start
7.64 +0.4 8.07 perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.46 +0.6 1.07 perf-profile.self.cycles-pp.__check_heap_object
0.71 ± 4% +0.9 1.66 perf-profile.self.cycles-pp.__check_object_size
22.62 +1.6 24.22 perf-profile.self.cycles-pp.__fget_light
2.35 ± 6% +2.5 4.81 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 5 months
- 3
- 2
[mm/swap.c] 1032493500: WARNING:at_kernel/locking/lockdep.c:#register_lock_class
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 1032493500cfbb05c7d89879468b5f878fab714a ("mm/swap.c: extend the usage to pagevec_lru_add")
https://github.com/alexshi/linux.git next
in testcase: locktorture
version:
with following parameters:
runtime: 300s
test: default
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------+------------+------------+
| | 316449c771 | 1032493500 |
+----------------------------------------------------------+------------+------------+
| boot_successes | 28 | 0 |
| WARNING:at_kernel/locking/lockdep.c:#register_lock_class | 0 | 36 |
| EIP:register_lock_class | 0 | 36 |
| WARNING:possible_recursive_locking_detected | 0 | 36 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 36 |
| Oops:#[##] | 0 | 36 |
| EIP:__list_add_valid | 0 | 36 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 36 |
+----------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 0.845111] WARNING: CPU: 0 PID: 1 at kernel/locking/lockdep.c:894 register_lock_class+0xe5/0x337
[ 0.845326] Modules linked in:
[ 0.845326] CPU: 0 PID: 1 Comm: swapper Not tainted 5.10.0-rc5-next-20201126-00004-g1032493500cf #1
[ 0.845326] EIP: register_lock_class+0xe5/0x337
[ 0.845326] Code: eb 33 8b 1c 95 20 da f6 bf 85 db 74 28 3b 43 20 75 1f 8b 46 0c 39 43 5c 0f 84 02 02 00 00 81 3e 40 79 b5 bf 0f 84 f6 01 00 00 <0f> 0b e9 ef 01 00 00 8b 1b eb d4 8b 1e 85 db 75 62 8d 55 f0 89 f0
[ 0.845326] EAX: 00000000 EBX: bff80238 ECX: 00000046 EDX: 0000095a
[ 0.845326] ESI: b011459c EDI: 00000000 EBP: b0117b78 ESP: b0117b50
[ 0.845326] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00010087
[ 0.845326] CR0: 80050033 CR2: 00000000 CR3: 0fb40000 CR4: 000406d0
[ 0.845326] Call Trace:
[ 0.845326] ? kvm_sched_clock_read+0x8/0x16
[ 0.845326] ? paravirt_sched_clock+0x8/0xb
[ 0.845326] __lock_acquire+0x5d/0x804
[ 0.845326] ? kvm_sched_clock_read+0x8/0x16
[ 0.845326] ? paravirt_sched_clock+0x8/0xb
[ 0.845326] lock_acquire+0x1ec/0x267
[ 0.845326] ? pagevec_lru_move_fn+0x29/0xae
[ 0.845326] ? __lock_acquire+0x768/0x804
[ 0.845326] ? sched_clock_local+0xe/0x12b
[ 0.845326] _raw_spin_lock_irqsave+0x33/0x66
[ 0.845326] ? pagevec_lru_move_fn+0x29/0xae
[ 0.845326] pagevec_lru_move_fn+0x29/0xae
[ 0.845326] ? mark_page_accessed+0x1ed/0x1ed
[ 0.845326] ? rcu_read_lock_sched_held+0x20/0x3d
[ 0.845326] ? local_lock_acquire+0x1a/0x5e
[ 0.845326] __pagevec_lru_add+0xd/0xf
[ 0.845326] lru_cache_add+0xec/0xff
[ 0.845326] add_to_page_cache_lru+0xee/0xf8
[ 0.845326] pagecache_get_page+0x1e2/0x21a
[ 0.845326] grab_cache_page_write_begin+0x1c/0x2e
[ 0.845326] simple_write_begin+0x2d/0x79
[ 0.845326] generic_perform_write+0x8c/0x141
[ 0.845326] ? find_held_lock+0x22/0x5f
[ 0.845326] __generic_file_write_iter+0x137/0x170
[ 0.845326] generic_file_write_iter+0x43/0xa3
[ 0.845326] __kernel_write+0xa0/0xcd
[ 0.845326] kernel_write+0x40/0x55
[ 0.845326] xwrite+0x22/0x50
[ 0.845326] do_copy+0x3a/0xca
[ 0.845326] write_buffer+0x1d/0x2c
[ 0.845326] flush_buffer+0x21/0x6f
[ 0.845326] __gunzip+0x1e9/0x267
[ 0.845326] ? bunzip2+0x2dc/0x2dc
[ 0.845326] ? __gunzip+0x267/0x267
[ 0.845326] gunzip+0x16/0x18
[ 0.845326] ? write_buffer+0x2c/0x2c
[ 0.845326] ? initrd_load+0x38/0x38
[ 0.845326] unpack_to_rootfs+0x164/0x264
[ 0.845326] ? write_buffer+0x2c/0x2c
[ 0.845326] ? initrd_load+0x38/0x38
[ 0.845326] ? do_name+0x272/0x272
[ 0.845326] populate_rootfs+0x4a/0xe3
[ 0.845326] ? do_name+0x272/0x272
[ 0.845326] do_one_initcall+0x98/0x1ad
[ 0.845326] ? rcu_read_lock_sched_held+0x20/0x3d
[ 0.845326] ? trace_initcall_level+0x4d/0x74
[ 0.845326] ? kernel_init_freeable+0xfa/0x15e
[ 0.845326] kernel_init_freeable+0x11c/0x15e
[ 0.845326] ? rest_init+0xa1/0xa1
[ 0.845326] kernel_init+0x8/0xd5
[ 0.845326] ret_from_fork+0x19/0x30
[ 0.845326] irq event stamp: 217572
[ 0.845326] hardirqs last enabled at (217571): [<befc1368>] _raw_spin_unlock_irq+0x1d/0x27
[ 0.845326] hardirqs last disabled at (217572): [<befc11ee>] _raw_spin_lock_irqsave+0x16/0x66
[ 0.845326] softirqs last enabled at (215408): [<bef2a2f3>] raw_unhash_sk+0x69/0x6d
[ 0.845326] softirqs last disabled at (215406): [<bef2a2a1>] raw_unhash_sk+0x17/0x6d
[ 0.845326] ---[ end trace 2f2b367129db7acd ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc5-next-20201126-00004-g1032493500cf .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[net/af_unix] 556d816147: WARNING:lock_held_when_returning_to_user_space
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 556d816147c0037356a73ecd04b56f7f88f8fd6c ("[PATCH v2] net/af_unix: don't create a path for a binded socket")
url: https://github.com/0day-ci/linux/commits/Denis-Kirjanov/net-af_unix-don-t...
base: https://git.kernel.org/cgit/linux/kernel/git/davem/net.git 4d521943f76bd0d1e68ea5e02df7aadd30b2838a
in testcase: trinity
version: trinity-static-i386-x86_64-f93256fb_2019-08-28
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------+------------+------------+
| | 4d521943f7 | 556d816147 |
+------------------------------------------------+------------+------------+
| WARNING:lock_held_when_returning_to_user_space | 0 | 6 |
| is_leaving_the_kernel_with_locks_still_held | 0 | 6 |
+------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 168.905018] WARNING: lock held when returning to user space!
[ 168.905959] 5.10.0-rc5-00345-g556d816147c0 #2 Not tainted
[ 168.906832] ------------------------------------------------
[ 168.907688] trinity-c2/2496 is leaving the kernel with locks still held!
[ 168.908760] 1 lock held by trinity-c2/2496:
[ 168.909447] #0: 421dc410 (&u->bindlock){....}-{3:3}, at: unix_bind+0xed/0x4c7
[ 176.087761] init: tty4 main process (2507) terminated with status 1
[ 176.090757] init: tty4 main process ended, respawning
[ 176.183929] init: tty5 main process (2510) terminated with status 1
[ 176.185225] init: tty5 main process ended, respawning
[ 176.197560] init: tty2 main process (2511) terminated with status 1
[ 176.198808] init: tty2 main process ended, respawning
[ 176.313912] init: tty3 main process (2517) terminated with status 1
[ 176.315179] init: tty3 main process ended, respawning
[ 176.343943] init: tty6 main process (2518) terminated with status 1
[ 176.345145] init: tty6 main process ended, respawning
[ 177.775764] [main] 116496 iterations. [F:86641 S:29411 HI:6256]
[ 177.775774]
[ 186.109795] init: tty4 main process (2702) terminated with status 1
[ 186.112880] init: tty4 main process ended, respawning
[ 186.207775] init: tty5 main process (2703) terminated with status 1
[ 186.208931] init: tty5 main process ended, respawning
[ 186.220373] init: tty2 main process (2704) terminated with status 1
[ 186.221503] init: tty2 main process ended, respawning
[ 186.337715] init: tty3 main process (2705) terminated with status 1
[ 186.339086] init: tty3 main process ended, respawning
[ 186.357629] init: tty6 main process (2706) terminated with status 1
[ 186.358989] init: tty6 main process ended, respawning
[ 191.008519] futex_wake_op: trinity-c3 tries to shift op by -1607; fix this program
[ 191.929811] [main] 126550 iterations. [F:94187 S:31885 HI:6256]
[ 191.929822]
[ 196.134002] init: tty4 main process (2825) terminated with status 1
[ 196.135420] init: tty4 main process ended, respawning
[ 196.244209] init: tty5 main process (2829) terminated with status 1
[ 196.245619] init: tty5 main process ended, respawning
[ 196.251326] init: tty2 main process (2830) terminated with status 1
[ 196.252673] init: tty2 main process ended, respawning
[ 196.357686] init: tty3 main process (2831) terminated with status 1
[ 196.359087] init: tty3 main process ended, respawning
[ 196.387854] init: tty6 main process (2832) terminated with status 1
[ 196.389207] init: tty6 main process ended, respawning
[ 202.998987] [main] 136876 iterations. [F:101871 S:34499 HI:6256]
[ 202.999000]
[ 206.157463] init: tty4 main process (2962) terminated with status 1
[ 206.163696] init: tty4 main process ended, respawning
[ 206.278220] init: tty5 main process (2963) terminated with status 1
[ 206.278928] init: tty5 main process ended, respawning
[ 206.280981] init: tty2 main process (2964) terminated with status 1
[ 206.281659] init: tty2 main process ended, respawning
[ 206.387845] init: tty3 main process (2966) terminated with status 1
[ 206.388527] init: tty3 main process ended, respawning
[ 206.427813] init: tty6 main process (2971) terminated with status 1
[ 206.428470] init: tty6 main process ended, respawning
[ 212.579273] [main] 147488 iterations. [F:109823 S:37124 HI:6607]
[ 212.579281]
[ 216.183874] init: tty4 main process (3142) terminated with status 1
[ 216.185161] init: tty4 main process ended, respawning
[ 216.293768] init: tty5 main process (3143) terminated with status 1
[ 216.294828] init: tty5 main process ended, respawning
[ 216.299943] init: tty2 main process (3144) terminated with status 1
[ 216.300976] init: tty2 main process ended, respawning
[ 216.397783] init: tty3 main process (3147) terminated with status 1
[ 216.399510] init: tty3 main process ended, respawning
[ 216.443459] init: tty6 main process (3148) terminated with status 1
[ 216.444113] init: tty6 main process ended, respawning
[ 219.779234] [main] 157599 iterations. [F:117378 S:39654 HI:7346]
[ 219.779243]
[ 226.207416] init: tty4 main process (3391) terminated with status 1
[ 226.208093] init: tty4 main process ended, respawning
[ 226.317687] init: tty5 main process (3392) terminated with status 1
[ 226.318384] init: tty5 main process ended, respawning
[ 226.320583] init: tty2 main process (3393) terminated with status 1
[ 226.321232] init: tty2 main process ended, respawning
[ 226.417465] init: tty3 main process (3395) terminated with status 1
[ 226.418163] init: tty3 main process ended, respawning
[ 226.457388] init: tty6 main process (3396) terminated with status 1
[ 226.458074] init: tty6 main process ended, respawning
[ 231.591603] [main] 168030 iterations. [F:125172 S:42250 HI:7346]
[ 231.591610]
[ 236.224759] init: tty4 main process (3549) terminated with status 1
[ 236.237822] init: tty4 main process ended, respawning
[ 236.343557] init: tty5 main process (3550) terminated with status 1
[ 236.344269] init: tty5 main process ended, respawning
[ 236.349639] init: tty2 main process (3551) terminated with status 1
[ 236.350290] init: tty2 main process ended, respawning
[ 236.443704] init: tty3 main process (3552) terminated with status 1
[ 236.444426] init: tty3 main process ended, respawning
[ 236.473608] init: tty6 main process (3553) terminated with status 1
[ 236.474288] init: tty6 main process ended, respawning
[ 240.424978] [main] 179511 iterations. [F:133832 S:45042 HI:7346]
[ 240.424985]
[ 246.249597] init: tty4 main process (3729) terminated with status 1
[ 246.251721] init: tty4 main process ended, respawning
[ 246.358025] init: tty5 main process (3740) terminated with status 1
[ 246.358733] init: tty5 main process ended, respawning
[ 246.368360] init: tty2 main process (3741) terminated with status 1
[ 246.369005] init: tty2 main process ended, respawning
[ 246.458022] init: tty3 main process (3742) terminated with status 1
[ 246.460142] init: tty3 main process ended, respawning
[ 246.487940] init: tty6 main process (3743) terminated with status 1
[ 246.488606] init: tty6 main process ended, respawning
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc5-00345-g556d816147c0 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 2
- 1
[mm] ca43f9047e: WARNING:at_include/linux/pgtable.h:#pmd_none_or_trans_huge_or_clear_bad
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: ca43f9047eae743bae4914949d9e13cc93208215 ("mm: Fix pmd_read_atomic()")
https://git.kernel.org/cgit/linux/kernel/git/peterz/queue.git perf/core
in testcase: boot
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------------------------------+------------+------------+
| | 4db675c5f6 | ca43f9047e |
+-------------------------------------------------------------------------+------------+------------+
| boot_successes | 12 | 0 |
| boot_failures | 0 | 30 |
| WARNING:at_include/linux/pgtable.h:#pmd_none_or_trans_huge_or_clear_bad | 0 | 30 |
| EIP:pmd_none_or_trans_huge_or_clear_bad | 0 | 30 |
| WARNING:at_include/linux/pgtable.h:#pmdp_get_lockless | 0 | 30 |
| EIP:pmdp_get_lockless | 0 | 30 |
| WARNING:at_include/linux/pgtable.h:#mincore_pte_range | 0 | 8 |
| EIP:mincore_pte_range | 0 | 8 |
+-------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 15.024978] WARNING: CPU: 0 PID: 128 at include/linux/pgtable.h:319 pmd_none_or_trans_huge_or_clear_bad+0x24/0x9a
[ 15.027021] Modules linked in:
[ 15.027710] CPU: 0 PID: 128 Comm: kworker/u2:1 Not tainted 5.10.0-rc6-00023-gca43f9047eae #1
[ 15.029436] EIP: pmd_none_or_trans_huge_or_clear_bad+0x24/0x9a
[ 15.030634] Code: 00 89 c8 5b 5d c3 55 89 e5 57 56 53 51 83 3d f0 e6 9f 42 00 74 16 8b 15 34 66 54 42 85 d2 75 0c 8b 15 88 ab 53 42 85 d2 74 02 <0f> 0b 8b 18 8b 70 04 89 75 f0 3b 18 75 f4 ba 01 00 00 00 f7 c3 9f
[ 15.034403] EAX: bf443ff8 EBX: bf5efe34 ECX: 00000000 EDX: 00000001
[ 15.035685] ESI: 00000000 EDI: bf44a958 EBP: bf5efe00 ESP: bf5efdf0
[ 15.036894] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00010202
[ 15.038257] CR0: 80050033 CR2: 00000000 CR3: 02aa6000 CR4: 000006f0
[ 15.039542] Call Trace:
[ 15.040046] do_anonymous_page+0x2c/0x219
[ 15.040897] ? arch_stack_walk+0x57/0x76
[ 15.041705] __handle_mm_fault+0x29a/0x2ac
[ 15.042534] handle_mm_fault+0x66/0xee
[ 15.043328] __get_user_pages+0x1d9/0x319
[ 15.044148] __get_user_pages_remote+0xad/0x1b5
[ 15.045100] get_user_pages_remote+0x2d/0x3e
[ 15.045941] get_arg_page+0x23/0x4e
[ 15.046642] copy_string_kernel+0xa7/0x101
[ 15.047482] kernel_execve+0x77/0xd4
[ 15.048200] call_usermodehelper_exec_async+0xbd/0xdf
[ 15.049253] ? call_usermodehelper+0x3d/0x3d
[ 15.050118] ret_from_fork+0x19/0x30
[ 15.050853] irq event stamp: 231
[ 15.051550] hardirqs last enabled at (239): [<41073cd7>] console_unlock+0x3e2/0x3ff
[ 15.053101] hardirqs last disabled at (248): [<4107395f>] console_unlock+0x6a/0x3ff
[ 15.054617] softirqs last enabled at (0): [<4103b8f8>] copy_process+0x40c/0x1456
[ 15.056116] softirqs last disabled at (0): [<00000000>] 0x0
[ 15.057271] ---[ end trace d0f7e86d0f964219 ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc6-00023-gca43f9047eae .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[drm/vkms] b6c9ddb8c4: WARNING:at_drivers/gpu/drm/drm_probe_helper.c:#drm_helper_probe_single_connector_modes
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: b6c9ddb8c427706c12a28944d95bbade47f17554 ("[PATCH] drm/vkms: detect modes during output initialization")
url: https://github.com/0day-ci/linux/commits/Leandro-Ribeiro/drm-vkms-detect-...
base: git://anongit.freedesktop.org/drm-intel for-linux-next
in testcase: trinity
version: trinity-x86_64-af355e9-1_2019-12-03
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------------------------------------+------------+------------+
| | 5cc2b61fb2 | b6c9ddb8c4 |
+----------------------------------------------------------------------------------------+------------+------------+
| WARNING:at_drivers/gpu/drm/drm_probe_helper.c:#drm_helper_probe_single_connector_modes | 0 | 2 |
| RIP:drm_helper_probe_single_connector_modes | 0 | 2 |
| WARNING:at_drivers/gpu/drm/drm_modes.c:#drm_mode_probed_add | 0 | 2 |
| RIP:drm_mode_probed_add | 0 | 2 |
| WARNING:at_drivers/gpu/drm/drm_modes.c:#drm_connector_list_update | 0 | 2 |
| RIP:drm_connector_list_update | 0 | 2 |
+----------------------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 26.025573] WARNING: CPU: 0 PID: 1 at drivers/gpu/drm/drm_probe_helper.c:429 drm_helper_probe_single_connector_modes+0xd0/0x11fc
[ 26.026322] Modules linked in:
[ 26.027751] CPU: 0 PID: 1 Comm: swapper Not tainted 5.10.0-rc2-00482-gb6c9ddb8c427 #1
[ 26.028271] RIP: 0010:drm_helper_probe_single_connector_modes+0xd0/0x11fc
[ 26.028722] Code: ea 03 80 3c 02 00 74 05 e8 40 78 f7 fe 48 8b 83 88 03 00 00 49 8d bc 24 80 04 00 00 48 89 44 24 28 e8 3c 4e d4 fe 84 c0 75 02 <0f> 0b 31 f6 48 8d bc 24 a0 00 00 00 e8 c0 3c 05 00 48 8d 43 48 48
[ 26.029931] RSP: 0018:ffff88810020fb70 EFLAGS: 00010246
[ 26.030286] RAX: 0000000000000000 RBX: ffff88815f8295a8 RCX: ffffffffa1faee29
[ 26.030780] RDX: 1ffff1102bf05090 RSI: 0000000000000008 RDI: ffff88815f828480
[ 26.031255] RBP: ffff88815f828000 R08: ffffed102bf05091 R09: 0000000000000002
[ 26.031727] R10: ffffed102bf05091 R11: ffff88815f828487 R12: ffff88815f828000
[ 26.032207] R13: ffff88815f6d7000 R14: ffff88815f6d6800 R15: ffff88815f8295a8
[ 26.032681] FS: 0000000000000000(0000) GS:ffffffffa5ca1000(0000) knlGS:0000000000000000
[ 26.033214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 26.033601] CR2: 00007f3a14e77860 CR3: 0000000158c34000 CR4: 00000000000406f0
[ 26.034089] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 26.034577] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 26.035050] Call Trace:
[ 26.035228] ? kasprintf+0x8c/0xa8
[ 26.035466] ? drm_connector_mode_valid+0x12a/0x12a
[ 26.035796] ? drm_encoder_init+0x231/0x434
[ 26.036082] ? drm_atomic_normalize_zpos+0x76f/0x76f
[ 26.036418] ? drm_connector_init+0xcc2/0xd5b
[ 26.036714] ? drm_connector_list_iter_next+0x16c/0x16c
[ 26.037067] vkms_output_init+0x1a9/0x24f
[ 26.037362] vkms_init+0x3d2/0x43e
[ 26.037599] ? drm_core_init+0xc5/0xc5
[ 26.037858] ? drm_core_init+0xc5/0xc5
[ 26.038115] ? drm_core_init+0xc5/0xc5
[ 26.038373] do_one_initcall+0x111/0x28f
[ 26.038649] ? rcu_read_unlock+0x1e/0x1e
[ 26.038921] ? parameq+0x28/0x28
[ 26.039147] do_basic_setup+0x1b6/0x1e5
[ 26.039411] kernel_init_freeable+0x126/0x155
[ 26.039709] ? rest_init+0x10c/0x10c
[ 26.039956] kernel_init+0x8/0x107
[ 26.040191] ret_from_fork+0x1f/0x30
[ 26.040455] CPU: 0 PID: 1 Comm: swapper Not tainted 5.10.0-rc2-00482-gb6c9ddb8c427 #1
[ 26.040973] Call Trace:
[ 26.041150] __warn+0x133/0x16d
[ 26.041371] ? drm_helper_probe_single_connector_modes+0xd0/0x11fc
[ 26.041785] report_bug+0x151/0x192
[ 26.042028] handle_bug+0x3c/0x5d
[ 26.042258] exc_invalid_op+0x14/0x3d
[ 26.042545] asm_exc_invalid_op+0x12/0x20
[ 26.042825] RIP: 0010:drm_helper_probe_single_connector_modes+0xd0/0x11fc
[ 26.043279] Code: ea 03 80 3c 02 00 74 05 e8 40 78 f7 fe 48 8b 83 88 03 00 00 49 8d bc 24 80 04 00 00 48 89 44 24 28 e8 3c 4e d4 fe 84 c0 75 02 <0f> 0b 31 f6 48 8d bc 24 a0 00 00 00 e8 c0 3c 05 00 48 8d 43 48 48
[ 26.044511] RSP: 0018:ffff88810020fb70 EFLAGS: 00010246
[ 26.044871] RAX: 0000000000000000 RBX: ffff88815f8295a8 RCX: ffffffffa1faee29
[ 26.045346] RDX: 1ffff1102bf05090 RSI: 0000000000000008 RDI: ffff88815f828480
[ 26.045821] RBP: ffff88815f828000 R08: ffffed102bf05091 R09: 0000000000000002
[ 26.046295] R10: ffffed102bf05091 R11: ffff88815f828487 R12: ffff88815f828000
[ 26.046790] R13: ffff88815f6d7000 R14: ffff88815f6d6800 R15: ffff88815f8295a8
[ 26.047283] ? mutex_is_locked+0xe/0x3a
[ 26.047551] ? kasprintf+0x8c/0xa8
[ 26.047789] ? drm_connector_mode_valid+0x12a/0x12a
[ 26.048121] ? drm_encoder_init+0x231/0x434
[ 26.048408] ? drm_atomic_normalize_zpos+0x76f/0x76f
[ 26.048744] ? drm_connector_init+0xcc2/0xd5b
[ 26.049042] ? drm_connector_list_iter_next+0x16c/0x16c
[ 26.049396] vkms_output_init+0x1a9/0x24f
[ 26.049672] vkms_init+0x3d2/0x43e
[ 26.049909] ? drm_core_init+0xc5/0xc5
[ 26.050169] ? drm_core_init+0xc5/0xc5
[ 26.050450] ? drm_core_init+0xc5/0xc5
[ 26.050707] do_one_initcall+0x111/0x28f
[ 26.050975] ? rcu_read_unlock+0x1e/0x1e
[ 26.051244] ? parameq+0x28/0x28
[ 26.051469] do_basic_setup+0x1b6/0x1e5
[ 26.051732] kernel_init_freeable+0x126/0x155
[ 26.052027] ? rest_init+0x10c/0x10c
[ 26.052273] kernel_init+0x8/0x107
[ 26.052507] ret_from_fork+0x1f/0x30
[ 26.052753] irq event stamp: 4080453
[ 26.053000] hardirqs last enabled at (4080461): [<ffffffffa1fcecfa>] console_unlock+0x651/0x69a
[ 26.053577] hardirqs last disabled at (4080468): [<ffffffffa1fce784>] console_unlock+0xdb/0x69a
[ 26.054161] softirqs last enabled at (4068892): [<ffffffffa4600516>] __do_softirq+0x516/0x5b1
[ 26.054732] softirqs last disabled at (4068887): [<ffffffffa4400e1f>] asm_call_irq_on_stack+0xf/0x20
[ 26.055333] ---[ end trace f71b1d00dc6fce64 ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc2-00482-gb6c9ddb8c427 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0