[sched/fair] 680b57ec48: hackbench.throughput 48.0% improvement
by kernel test robot
Greeting,
FYI, we noticed a 48.0% improvement of hackbench.throughput due to commit:
commit: 680b57ec4805a2a7e0f8c861da18bb2ef9a01d14 ("sched/fair: use load instead of runnable load in wakeup path")
https://git.linaro.org/people/vincent.guittot/kernel.git sched/pelt
in testcase: hackbench
on test machine: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory
with following parameters:
nr_threads: 100%
mode: threads
ipc: pipe
ucode: 0xb8
cpufreq_governor: performance
test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler.
test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc...
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
gcc-7/performance/pipe/x86_64-rhel-7.6/threads/100%/debian-x86_64-2019-09-23.cgz/lkp-cfl-e1/hackbench/0xb8
commit:
0e2ed82fa5 ("sched/fair: use utilization to select misfit task")
680b57ec48 ("sched/fair: use load instead of runnable load in wakeup path")
0e2ed82fa5dac96d 680b57ec4805a2a7e0f8c861da1
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
2:4 -50% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
%stddev %change %stddev
\ | \
48092 +48.0% 71170 hackbench.throughput
625.17 -2.8% 607.84 hackbench.time.elapsed_time
625.17 -2.8% 607.84 hackbench.time.elapsed_time.max
9.792e+08 -62.9% 3.634e+08 hackbench.time.involuntary_context_switches
93646 +43.6% 134456 hackbench.time.minor_page_faults
9199 -4.1% 8818 hackbench.time.system_time
759.98 +1.7% 772.92 hackbench.time.user_time
1.676e+09 -36.6% 1.062e+09 hackbench.time.voluntary_context_switches
3.072e+08 +43.8% 4.416e+08 hackbench.workload
14.20 -5.1% 13.47 ± 3% boot-time.dhcp
3316 -16.9% 2756 meminfo.max_used_kB
0.47 ± 7% +0.8 1.28 mpstat.cpu.all.idle%
91.00 -1.1% 90.00 vmstat.cpu.sy
308.75 -11.8% 272.25 vmstat.procs.r
4234830 -43.7% 2383454 vmstat.system.cs
384643 -20.9% 304132 vmstat.system.in
5972 -0.8% 5924 proc-vmstat.nr_mapped
23143682 +163.8% 61059361 proc-vmstat.numa_hit
23143682 +163.8% 61059361 proc-vmstat.numa_local
23211150 +163.4% 61143820 proc-vmstat.pgalloc_normal
686632 +21.5% 834458 proc-vmstat.pgfault
23192402 +163.6% 61124034 proc-vmstat.pgfree
8462 +10.9% 9383 ± 2% slabinfo.lsm_file_cache.active_objs
8462 +10.9% 9383 ± 2% slabinfo.lsm_file_cache.num_objs
4827 +25.2% 6043 ± 2% slabinfo.pid.active_objs
4827 +25.3% 6048 ± 2% slabinfo.pid.num_objs
4835 +28.5% 6213 ± 2% slabinfo.task_delay_info.active_objs
4835 +28.5% 6213 ± 2% slabinfo.task_delay_info.num_objs
5505860 ± 12% +287.3% 21326721 ± 5% cpuidle.C1.time
763688 ± 7% +508.4% 4646019 ± 3% cpuidle.C1.usage
592720 ± 75% +325.1% 2519791 ± 24% cpuidle.C1E.time
9509 ± 64% +241.6% 32481 ± 10% cpuidle.C1E.usage
27392742 ± 13% +39.8% 38281442 ± 10% cpuidle.C6.time
1796894 +1390.9% 26789708 cpuidle.POLL.time
1325263 +1621.0% 22807808 cpuidle.POLL.usage
763162 ± 7% +508.7% 4645446 ± 3% turbostat.C1
0.06 ± 15% +0.2 0.22 ± 5% turbostat.C1%
9360 ± 65% +245.4% 32327 ± 10% turbostat.C1E
0.00 ±173% +0.0 0.03 ± 19% turbostat.C1E%
0.27 ± 14% +0.1 0.39 ± 10% turbostat.C6%
0.59 +35.3% 0.80 ± 2% turbostat.CPU%c1
0.22 ± 13% +43.8% 0.32 ± 9% turbostat.CPU%c6
2.414e+08 -23.1% 1.857e+08 turbostat.IRQ
0.04 ± 45% +105.9% 0.09 ± 30% turbostat.Pkg%pc3
82.58 +8.0% 89.19 ± 4% sched_debug.cfs_rq:/.load_avg.avg
190.89 +19.0% 227.09 ± 10% sched_debug.cfs_rq:/.load_avg.max
42.61 ± 4% +23.9% 52.78 ± 7% sched_debug.cfs_rq:/.load_avg.stddev
99.34 ± 4% +19.1% 118.36 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.max
24.32 ± 21% -70.3% 7.23 ± 19% sched_debug.cfs_rq:/.runnable_load_avg.min
18.65 ± 8% +69.5% 31.61 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.stddev
19797 ± 37% -65.8% 6771 ± 14% sched_debug.cfs_rq:/.runnable_weight.min
629.84 ± 3% -22.9% 485.72 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg
304.07 ± 17% -79.7% 61.68 ± 27% sched_debug.cfs_rq:/.util_est_enqueued.min
185.15 ± 7% +56.9% 290.51 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.stddev
9212 +32.4% 12198 sched_debug.cpu.curr->pid.avg
9807 +31.7% 12919 sched_debug.cpu.curr->pid.max
565.32 ± 34% +98.5% 1122 ± 16% sched_debug.cpu.curr->pid.stddev
16.47 ± 3% -12.4% 14.42 ± 5% sched_debug.cpu.nr_running.avg
26.11 ± 8% +17.2% 30.61 ± 5% sched_debug.cpu.nr_running.max
7.84 ± 13% -75.1% 1.95 ± 24% sched_debug.cpu.nr_running.min
4.82 ± 10% +73.0% 8.33 ± 6% sched_debug.cpu.nr_running.stddev
78427619 -42.6% 45034852 sched_debug.cpu.nr_switches.avg
80761819 -43.0% 46038156 sched_debug.cpu.nr_switches.max
76514776 -42.3% 44124418 sched_debug.cpu.nr_switches.min
1143181 ± 9% -50.8% 562758 ± 13% sched_debug.cpu.nr_switches.stddev
2346 ± 51% -66.0% 798.75 ± 32% interrupts.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0
86188 -3.3% 83353 interrupts.CAL:Function_call_interrupts
5735 -11.5% 5076 ± 7% interrupts.CPU0.CAL:Function_call_interrupts
13262098 -23.5% 10144275 interrupts.CPU0.RES:Rescheduling_interrupts
13362912 -23.8% 10180279 interrupts.CPU1.RES:Rescheduling_interrupts
5702 -12.5% 4990 ± 6% interrupts.CPU10.CAL:Function_call_interrupts
13691162 -24.5% 10332146 interrupts.CPU10.RES:Rescheduling_interrupts
14119611 -27.1% 10298723 interrupts.CPU11.RES:Rescheduling_interrupts
13913998 -24.8% 10458947 interrupts.CPU12.RES:Rescheduling_interrupts
13778673 -23.5% 10537027 interrupts.CPU13.RES:Rescheduling_interrupts
13820583 -24.5% 10438652 interrupts.CPU14.RES:Rescheduling_interrupts
2346 ± 51% -66.0% 798.75 ± 32% interrupts.CPU15.132:IR-PCI-MSI.2097153-edge.eth1-TxRx-0
5715 -9.8% 5155 ± 5% interrupts.CPU15.CAL:Function_call_interrupts
14241567 -27.6% 10308392 interrupts.CPU15.RES:Rescheduling_interrupts
5667 -9.3% 5139 ± 4% interrupts.CPU2.CAL:Function_call_interrupts
13841989 ± 3% -25.7% 10280913 interrupts.CPU2.RES:Rescheduling_interrupts
14004905 -25.9% 10379482 interrupts.CPU3.RES:Rescheduling_interrupts
13855109 -24.8% 10417385 interrupts.CPU4.RES:Rescheduling_interrupts
14025702 -25.9% 10388882 interrupts.CPU5.RES:Rescheduling_interrupts
5731 -12.7% 5004 ± 6% interrupts.CPU6.CAL:Function_call_interrupts
13782586 -24.9% 10345812 interrupts.CPU6.RES:Rescheduling_interrupts
13558940 -24.8% 10192996 interrupts.CPU7.RES:Rescheduling_interrupts
5727 -17.4% 4733 ± 16% interrupts.CPU8.CAL:Function_call_interrupts
13367438 ± 2% -24.6% 10075799 interrupts.CPU8.RES:Rescheduling_interrupts
13505356 -24.4% 10212494 interrupts.CPU9.RES:Rescheduling_interrupts
2.201e+08 -25.0% 1.65e+08 interrupts.RES:Rescheduling_interrupts
155.50 ± 5% +48.1% 230.25 ± 5% interrupts.TLB:TLB_shootdowns
74155 ± 2% -10.2% 66574 softirqs.CPU0.RCU
9599 +288.2% 37271 softirqs.CPU0.SCHED
75773 ± 3% -12.6% 66191 ± 2% softirqs.CPU1.RCU
7457 ± 4% +393.7% 36818 softirqs.CPU1.SCHED
70778 ± 6% -10.3% 63478 softirqs.CPU10.RCU
7588 ± 4% +375.2% 36061 softirqs.CPU10.SCHED
72198 -11.6% 63841 softirqs.CPU11.RCU
7283 ± 3% +402.0% 36567 softirqs.CPU11.SCHED
71919 ± 2% -11.2% 63884 softirqs.CPU12.RCU
7215 ± 2% +405.3% 36461 softirqs.CPU12.SCHED
6899 +422.1% 36022 softirqs.CPU13.SCHED
69927 -10.0% 62920 softirqs.CPU14.RCU
7193 ± 5% +400.5% 36006 softirqs.CPU14.SCHED
70411 -11.3% 62458 ± 2% softirqs.CPU15.RCU
7169 +400.3% 35869 softirqs.CPU15.SCHED
7127 +402.6% 35826 softirqs.CPU2.SCHED
71668 -10.4% 64183 softirqs.CPU3.RCU
7255 ± 4% +401.6% 36395 softirqs.CPU3.SCHED
71752 -9.6% 64870 ± 4% softirqs.CPU4.RCU
7126 ± 4% +409.4% 36296 softirqs.CPU4.SCHED
7079 ± 2% +404.7% 35730 ± 2% softirqs.CPU5.SCHED
7152 +401.2% 35843 softirqs.CPU6.SCHED
71391 -10.4% 63971 softirqs.CPU7.RCU
7227 ± 6% +393.5% 35667 softirqs.CPU7.SCHED
73318 -9.7% 66240 softirqs.CPU8.RCU
6918 ± 2% +413.5% 35525 softirqs.CPU8.SCHED
72911 ± 2% -10.7% 65138 softirqs.CPU9.RCU
6895 +418.8% 35774 softirqs.CPU9.SCHED
1141202 -9.8% 1029087 softirqs.RCU
117192 +393.3% 578141 softirqs.SCHED
56.57 -20.4% 45.04 perf-stat.i.MPKI
6.65e+09 +2.1% 6.792e+09 perf-stat.i.branch-instructions
1.35 -0.2 1.14 perf-stat.i.branch-miss-rate%
89499386 -14.3% 76701413 perf-stat.i.branch-misses
0.11 ± 2% +0.2 0.35 ± 2% perf-stat.i.cache-miss-rate%
1598096 ± 2% +223.2% 5164571 ± 2% perf-stat.i.cache-misses
1.875e+09 -17.7% 1.543e+09 perf-stat.i.cache-references
4245658 -43.7% 2391391 perf-stat.i.context-switches
1.37 -3.0% 1.33 perf-stat.i.cpi
374390 -65.0% 131167 perf-stat.i.cpu-migrations
39856 ± 3% -75.2% 9884 ± 4% perf-stat.i.cycles-between-cache-misses
0.01 ± 6% +0.0 0.01 ± 4% perf-stat.i.dTLB-load-miss-rate%
793812 ± 6% +81.5% 1440594 ± 3% perf-stat.i.dTLB-load-misses
9.931e+09 +4.6% 1.039e+10 perf-stat.i.dTLB-loads
0.00 ± 7% +0.0 0.00 ± 4% perf-stat.i.dTLB-store-miss-rate%
21029 ± 7% +77.1% 37251 ± 4% perf-stat.i.dTLB-store-misses
6.022e+09 +3.5% 6.234e+09 perf-stat.i.dTLB-stores
31215695 +13.4% 35397182 perf-stat.i.iTLB-load-misses
70300 ± 9% +132.0% 163083 ± 3% perf-stat.i.iTLB-loads
3.323e+10 +3.6% 3.444e+10 perf-stat.i.instructions
1069 -8.8% 975.86 perf-stat.i.instructions-per-iTLB-miss
0.73 +3.2% 0.75 perf-stat.i.ipc
1060 +25.5% 1331 perf-stat.i.minor-faults
66640 ± 3% +196.5% 197609 ± 2% perf-stat.i.node-loads
113302 ± 2% +188.8% 327186 ± 3% perf-stat.i.node-stores
1060 +25.5% 1331 perf-stat.i.page-faults
56.41 -20.6% 44.79 perf-stat.overall.MPKI
1.35 -0.2 1.13 perf-stat.overall.branch-miss-rate%
0.09 ± 2% +0.2 0.33 ± 3% perf-stat.overall.cache-miss-rate%
1.37 -3.1% 1.33 perf-stat.overall.cpi
28509 ± 2% -68.9% 8854 ± 2% perf-stat.overall.cycles-between-cache-misses
0.01 ± 6% +0.0 0.01 ± 4% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 7% +0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate%
1064 -8.6% 972.93 perf-stat.overall.instructions-per-iTLB-miss
0.73 +3.2% 0.75 perf-stat.overall.ipc
67603 -29.9% 47371 perf-stat.overall.path-length
6.64e+09 +2.1% 6.781e+09 perf-stat.ps.branch-instructions
89356230 -14.3% 76575546 perf-stat.ps.branch-misses
1595586 ± 2% +223.2% 5156339 ± 2% perf-stat.ps.cache-misses
1.872e+09 -17.7% 1.54e+09 perf-stat.ps.cache-references
4238829 -43.7% 2387408 perf-stat.ps.context-switches
373796 -65.0% 130943 perf-stat.ps.cpu-migrations
792535 ± 6% +81.5% 1438198 ± 3% perf-stat.ps.dTLB-load-misses
9.915e+09 +4.6% 1.037e+10 perf-stat.ps.dTLB-loads
20995 ± 7% +77.1% 37190 ± 4% perf-stat.ps.dTLB-store-misses
6.013e+09 +3.5% 6.224e+09 perf-stat.ps.dTLB-stores
31165424 +13.4% 35338848 perf-stat.ps.iTLB-load-misses
70190 ± 9% +132.0% 162817 ± 3% perf-stat.ps.iTLB-loads
3.318e+10 +3.6% 3.438e+10 perf-stat.ps.instructions
1058 +25.5% 1329 perf-stat.ps.minor-faults
66535 ± 3% +196.5% 197289 ± 2% perf-stat.ps.node-loads
113127 ± 2% +188.8% 326670 ± 3% perf-stat.ps.node-stores
1058 +25.5% 1329 perf-stat.ps.page-faults
25.38 -6.8 18.60 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
24.82 -6.8 18.07 ± 5% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write
24.46 -6.7 17.77 ± 5% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
28.27 -5.8 22.48 ± 4% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write
18.23 ± 2% -5.5 12.76 ± 4% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read
15.73 ± 2% -4.7 11.04 ± 5% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read
15.38 ± 2% -4.6 10.77 ± 5% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read
26.90 -3.3 23.63 ± 2% perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
27.87 -3.0 24.83 ± 2% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.88 ± 7% -3.0 1.90 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.37 ± 2% -2.8 6.59 ± 5% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
9.31 -2.8 6.54 ± 5% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
9.07 -2.7 6.39 ± 6% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
6.91 ± 3% -2.4 4.47 ± 4% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read
6.45 ± 4% -2.4 4.08 ± 6% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
3.02 ± 23% -2.2 0.81 ±123% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.89 ± 23% -2.1 0.77 ±123% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.04 ± 4% -1.9 3.15 ± 6% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common
2.36 ± 8% -1.5 0.87 ± 21% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64
4.83 -1.4 3.44 ± 9% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
2.63 ± 2% -1.0 1.68 ± 6% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read
2.76 ± 4% -0.9 1.82 ± 8% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_wait
1.90 ± 3% -0.8 1.08 ± 17% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function
1.57 -0.7 0.85 ± 14% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait
1.64 ± 2% -0.7 0.95 ± 13% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
1.63 ± 2% -0.6 1.00 ± 13% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
1.38 ± 6% -0.6 0.77 ± 14% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
1.48 ± 3% -0.6 0.89 ± 13% perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.70 ± 18% +0.4 1.06 ± 18% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule.pipe_wait
0.28 ±100% +0.4 0.68 ± 14% perf-profile.calltrace.cycles-pp.__lock_text_start.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
0.79 ± 23% +0.4 1.19 ± 15% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.32 ± 17% +0.6 1.92 ± 13% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read
0.41 ± 57% +0.6 1.02 ± 15% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.61 ± 11% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.new_sync_read.vfs_read.ksys_read
0.51 ± 57% +0.6 1.14 ± 11% perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read
0.00 +0.7 0.67 ± 14% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_write.ksys_write
2.02 ± 5% +0.7 2.72 ± 5% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.25 ± 15% +0.7 1.96 ± 11% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write
1.79 ± 5% +0.7 2.50 ± 6% perf-profile.calltrace.cycles-pp.__fget.__fget_light.__fdget_pos.ksys_write.do_syscall_64
0.86 ± 16% +0.7 1.58 ± 11% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write
0.13 ±173% +0.7 0.85 ± 12% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write
0.00 +0.7 0.72 ± 10% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_read.ksys_read
0.00 +0.7 0.73 ± 13% perf-profile.calltrace.cycles-pp.avc_has_perm.file_has_perm.security_file_permission.vfs_read.ksys_read
0.00 +0.7 0.74 ± 14% perf-profile.calltrace.cycles-pp.avc_has_perm.file_has_perm.security_file_permission.vfs_write.ksys_write
1.06 ± 14% +0.7 1.81 ± 10% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64
0.45 ± 57% +0.7 1.20 ± 11% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read
0.00 +0.8 0.76 ± 14% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_read.new_sync_read.vfs_read.ksys_read
0.00 +0.8 0.80 ± 11% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.new_sync_read.vfs_read
0.48 ± 57% +0.8 1.30 ± 13% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64
0.50 ± 57% +0.8 1.33 ± 12% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64
0.51 ± 57% +0.8 1.35 ± 11% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write
0.00 +0.9 0.90 ± 16% perf-profile.calltrace.cycles-pp.__fget.__fget_light.__fdget_pos.ksys_read.do_syscall_64
2.43 ± 3% +0.9 3.36 ± 6% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.27 +1.0 3.26 ± 5% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write
2.92 ± 3% +1.0 3.93 ± 6% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read
0.00 +1.1 1.07 ± 14% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_write.new_sync_write
0.16 ±173% +1.1 1.24 ± 15% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.16 ±173% +1.1 1.24 ± 14% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
0.16 ±173% +1.1 1.24 ± 14% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
0.00 +1.1 1.11 ± 13% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_write.new_sync_write.vfs_write
0.17 ±173% +1.2 1.33 ± 14% perf-profile.calltrace.cycles-pp.secondary_startup_64
2.85 ± 3% +1.2 4.08 ± 4% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.49 ± 22% +1.3 2.78 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
0.54 ± 62% +1.5 2.08 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write
0.00 +1.9 1.87 ± 13% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_write.new_sync_write.vfs_write.ksys_write
21.10 ± 3% -6.6 14.46 ± 4% perf-profile.children.cycles-pp.schedule
25.54 -6.4 19.11 ± 4% perf-profile.children.cycles-pp.__wake_up_common
24.93 -6.4 18.52 ± 4% perf-profile.children.cycles-pp.autoremove_wake_function
24.87 -6.3 18.55 ± 4% perf-profile.children.cycles-pp.try_to_wake_up
20.97 ± 3% -6.2 14.78 ± 4% perf-profile.children.cycles-pp.__schedule
28.94 -5.5 23.41 ± 3% perf-profile.children.cycles-pp.__wake_up_common_lock
18.65 -3.9 14.74 ± 4% perf-profile.children.cycles-pp.pipe_wait
26.98 -3.2 23.80 ± 2% perf-profile.children.cycles-pp.pipe_read
5.34 ± 7% -3.0 2.32 ± 4% perf-profile.children.cycles-pp.exit_to_usermode_loop
27.91 -3.0 24.93 ± 2% perf-profile.children.cycles-pp.new_sync_read
9.43 -2.6 6.82 ± 5% perf-profile.children.cycles-pp.ttwu_do_activate
9.37 -2.6 6.77 ± 5% perf-profile.children.cycles-pp.activate_task
9.14 -2.5 6.63 ± 5% perf-profile.children.cycles-pp.enqueue_task_fair
6.50 ± 4% -2.2 4.32 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair
7.07 ± 3% -2.1 4.97 ± 4% perf-profile.children.cycles-pp.dequeue_task_fair
5.33 ± 4% -1.9 3.38 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair
5.12 ± 4% -1.7 3.38 ± 4% perf-profile.children.cycles-pp.select_idle_sibling
3.53 ± 5% -1.2 2.34 ± 3% perf-profile.children.cycles-pp.update_load_avg
4.89 -1.2 3.71 ± 5% perf-profile.children.cycles-pp.enqueue_entity
4.07 -1.1 2.93 ± 4% perf-profile.children.cycles-pp.update_curr
3.30 -1.0 2.26 ± 6% perf-profile.children.cycles-pp.reweight_entity
2.24 ± 5% -1.0 1.27 ± 3% perf-profile.children.cycles-pp.switch_fpu_return
2.15 ± 3% -0.7 1.42 ± 6% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
2.82 ± 4% -0.7 2.09 ± 3% perf-profile.children.cycles-pp.dequeue_entity
2.04 ± 5% -0.7 1.32 ± 4% perf-profile.children.cycles-pp.__switch_to
1.95 ± 3% -0.7 1.29 ± 4% perf-profile.children.cycles-pp.available_idle_cpu
1.64 ± 6% -0.6 1.05 ± 3% perf-profile.children.cycles-pp.native_write_msr
1.13 ± 8% -0.6 0.56 ± 9% perf-profile.children.cycles-pp.put_prev_entity
1.62 ± 3% -0.5 1.08 ± 2% perf-profile.children.cycles-pp.__switch_to_asm
1.13 ± 5% -0.5 0.62 ± 7% perf-profile.children.cycles-pp.pick_next_entity
1.47 -0.5 0.98 ± 6% perf-profile.children.cycles-pp.__enqueue_entity
1.20 ± 7% -0.5 0.72 ± 5% perf-profile.children.cycles-pp.___perf_sw_event
1.64 ± 2% -0.5 1.18 ± 4% perf-profile.children.cycles-pp.ttwu_do_wakeup
1.49 ± 3% -0.4 1.04 ± 4% perf-profile.children.cycles-pp.check_preempt_curr
1.90 ± 2% -0.4 1.46 ± 3% perf-profile.children.cycles-pp.__lock_text_start
1.23 ± 3% -0.4 0.79 ± 4% perf-profile.children.cycles-pp.check_preempt_wakeup
1.55 ± 8% -0.4 1.13 ± 3% perf-profile.children.cycles-pp.update_cfs_group
1.52 ± 4% -0.4 1.11 ± 3% perf-profile.children.cycles-pp.set_next_entity
1.27 ± 2% -0.3 0.95 ± 3% perf-profile.children.cycles-pp.__update_load_avg_se
0.51 ± 14% -0.3 0.18 ± 11% perf-profile.children.cycles-pp.set_task_cpu
1.53 -0.3 1.26 ± 2% perf-profile.children.cycles-pp.update_rq_clock
0.89 -0.2 0.65 ± 4% perf-profile.children.cycles-pp.__calc_delta
0.79 ± 7% -0.2 0.55 ± 3% perf-profile.children.cycles-pp.finish_task_switch
0.34 ± 14% -0.2 0.12 ± 11% perf-profile.children.cycles-pp.migrate_task_rq_fair
0.43 ± 10% -0.2 0.22 ± 5% perf-profile.children.cycles-pp.set_next_buddy
0.75 ± 7% -0.2 0.54 ± 7% perf-profile.children.cycles-pp.reschedule_interrupt
0.44 ± 6% -0.2 0.24 ± 10% perf-profile.children.cycles-pp.clear_buddies
0.70 ± 4% -0.2 0.50 ± 7% perf-profile.children.cycles-pp.account_entity_dequeue
0.77 ± 6% -0.2 0.58 perf-profile.children.cycles-pp.sched_clock_cpu
0.72 ± 6% -0.2 0.55 perf-profile.children.cycles-pp.sched_clock
0.33 ± 9% -0.2 0.16 ± 5% perf-profile.children.cycles-pp.cpus_share_cache
0.44 ± 3% -0.2 0.29 ± 4% perf-profile.children.cycles-pp.anon_pipe_buf_release
0.64 ± 5% -0.1 0.50 perf-profile.children.cycles-pp.native_sched_clock
0.58 ± 3% -0.1 0.45 ± 5% perf-profile.children.cycles-pp.update_min_vruntime
0.53 -0.1 0.40 ± 8% perf-profile.children.cycles-pp.account_entity_enqueue
0.23 ± 3% -0.1 0.11 perf-profile.children.cycles-pp.wakeup_preempt_entity
0.49 ± 6% -0.1 0.37 ± 5% perf-profile.children.cycles-pp.cpuacct_charge
0.42 ± 8% -0.1 0.31 ± 5% perf-profile.children.cycles-pp.cpumask_next_wrap
0.16 ± 10% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.remove_entity_load_avg
0.26 ± 3% -0.1 0.16 ± 5% perf-profile.children.cycles-pp.resched_curr
0.31 ± 4% -0.1 0.22 ± 5% perf-profile.children.cycles-pp.rb_erase
0.20 ± 14% -0.1 0.11 ± 23% perf-profile.children.cycles-pp.update_cfs_rq_h_load
0.37 ± 7% -0.1 0.29 ± 11% perf-profile.children.cycles-pp.find_next_bit
0.21 ± 8% -0.1 0.14 ± 8% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.21 ± 7% -0.1 0.14 ± 3% perf-profile.children.cycles-pp.finish_wait
0.20 ± 10% -0.1 0.15 ± 5% perf-profile.children.cycles-pp.smp_reschedule_interrupt
0.10 ± 11% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.rcu_note_context_switch
0.19 ± 10% -0.1 0.14 ± 8% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.22 ± 8% -0.0 0.17 ± 9% perf-profile.children.cycles-pp.cpumask_next
0.21 ± 4% -0.0 0.16 ± 5% perf-profile.children.cycles-pp.deactivate_task
0.23 ± 4% -0.0 0.19 ± 9% perf-profile.children.cycles-pp.native_irq_return_iret
0.11 ± 7% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.check_cfs_rq_runtime
0.21 ± 6% -0.0 0.17 ± 10% perf-profile.children.cycles-pp.__list_add_valid
0.11 ± 8% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.perf_exclude_event
0.10 ± 8% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.is_cpu_allowed
0.20 ± 5% -0.0 0.17 ± 7% perf-profile.children.cycles-pp.rb_next
0.14 ± 5% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.__x2apic_send_IPI_dest
0.12 ± 7% -0.0 0.10 ± 9% perf-profile.children.cycles-pp.generic_update_time
0.09 ± 4% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.__mark_inode_dirty
0.06 ± 26% +0.0 0.09 ± 24% perf-profile.children.cycles-pp.pkg_thermal_notify
0.07 ± 27% +0.0 0.11 ± 23% perf-profile.children.cycles-pp.intel_thermal_interrupt
0.22 ± 9% +0.0 0.25 ± 3% perf-profile.children.cycles-pp.__x64_sys_read
0.21 ± 8% +0.0 0.24 ± 6% perf-profile.children.cycles-pp.__x64_sys_write
0.12 ± 4% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.kill_fasync
0.18 ± 12% +0.0 0.23 ± 7% perf-profile.children.cycles-pp.generic_pipe_buf_confirm
0.01 ±173% +0.0 0.06 ± 11% perf-profile.children.cycles-pp.fput
0.21 ± 7% +0.0 0.26 ± 2% perf-profile.children.cycles-pp.fpregs_assert_state_consistent
0.20 ± 5% +0.0 0.24 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.07 ± 12% +0.0 0.12 ± 7% perf-profile.children.cycles-pp.bpf_fd_pass
0.12 ± 10% +0.1 0.17 ± 7% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.tick_nohz_next_event
0.21 ± 5% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.rw_verify_area
0.32 ± 7% +0.1 0.38 ± 9% perf-profile.children.cycles-pp.__sb_start_write
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.schedule_preempt_disabled
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.free_unref_page
0.01 ±173% +0.1 0.09 ± 21% perf-profile.children.cycles-pp.start_kernel
0.04 ± 57% +0.1 0.11 ± 7% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.get_page_from_freelist
0.22 ± 9% +0.1 0.32 ± 5% perf-profile.children.cycles-pp.timespec64_trunc
0.21 ± 3% +0.1 0.32 ± 3% perf-profile.children.cycles-pp.__sb_end_write
0.22 ± 10% +0.1 0.33 ± 6% perf-profile.children.cycles-pp.preempt_schedule_common
0.22 ± 4% +0.1 0.34 ± 6% perf-profile.children.cycles-pp.iov_iter_init
0.32 ± 5% +0.1 0.44 ± 7% perf-profile.children.cycles-pp.rcu_all_qs
0.00 +0.1 0.14 ± 11% perf-profile.children.cycles-pp.menu_select
0.10 ± 27% +0.1 0.25 ± 4% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.27 ± 4% +0.2 0.43 ± 7% perf-profile.children.cycles-pp.inode_has_perm
0.72 ± 7% +0.2 0.96 ± 3% perf-profile.children.cycles-pp.file_update_time
0.62 ± 3% +0.2 0.86 ± 3% perf-profile.children.cycles-pp.atime_needs_update
0.99 ± 2% +0.3 1.25 ± 2% perf-profile.children.cycles-pp.touch_atime
0.74 ± 2% +0.3 0.99 ± 8% perf-profile.children.cycles-pp.prepare_to_wait
0.04 ± 58% +0.3 0.30 ± 12% perf-profile.children.cycles-pp.schedule_idle
0.58 ± 8% +0.3 0.91 ± 4% perf-profile.children.cycles-pp.current_time
0.83 ± 2% +0.3 1.16 ± 2% perf-profile.children.cycles-pp._cond_resched
0.77 ± 5% +0.3 1.12 ± 4% perf-profile.children.cycles-pp.__might_fault
0.08 ± 23% +0.4 0.44 ± 11% perf-profile.children.cycles-pp.poll_idle
1.41 ± 3% +0.4 1.83 ± 2% perf-profile.children.cycles-pp.fput_many
1.05 ± 2% +0.4 1.47 ± 3% perf-profile.children.cycles-pp.__fsnotify_parent
0.65 ± 16% +0.4 1.07 ± 5% perf-profile.children.cycles-pp.__mutex_lock
0.34 ± 42% +0.4 0.76 ± 19% perf-profile.children.cycles-pp.cpuidle_enter
0.34 ± 42% +0.4 0.76 ± 19% perf-profile.children.cycles-pp.cpuidle_enter_state
1.05 ± 5% +0.4 1.49 ± 4% perf-profile.children.cycles-pp.__might_sleep
2.06 ± 3% +0.5 2.52 perf-profile.children.cycles-pp.mutex_unlock
1.10 ± 4% +0.5 1.60 ± 5% perf-profile.children.cycles-pp.avc_has_perm
1.14 ± 4% +0.5 1.65 ± 6% perf-profile.children.cycles-pp.fsnotify
1.03 ± 5% +0.5 1.56 ± 5% perf-profile.children.cycles-pp.__inode_security_revalidate
1.55 ± 5% +0.5 2.09 ± 4% perf-profile.children.cycles-pp.copyout
1.13 +0.6 1.70 ± 4% perf-profile.children.cycles-pp.copyin
1.54 ± 3% +0.7 2.26 ± 5% perf-profile.children.cycles-pp.___might_sleep
1.71 ± 5% +0.8 2.47 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.40 ± 37% +0.8 1.24 ± 14% perf-profile.children.cycles-pp.start_secondary
0.44 ± 37% +0.9 1.32 ± 15% perf-profile.children.cycles-pp.do_idle
0.44 ± 37% +0.9 1.33 ± 14% perf-profile.children.cycles-pp.secondary_startup_64
0.44 ± 37% +0.9 1.33 ± 14% perf-profile.children.cycles-pp.cpu_startup_entry
3.09 ± 2% +0.9 4.01 ± 2% perf-profile.children.cycles-pp.mutex_lock
3.16 ± 3% +1.0 4.17 ± 3% perf-profile.children.cycles-pp.__fget_light
2.53 ± 2% +1.0 3.54 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
1.91 ± 2% +1.0 2.93 ± 4% perf-profile.children.cycles-pp.file_has_perm
2.77 ± 3% +1.0 3.78 ± 3% perf-profile.children.cycles-pp.selinux_file_permission
2.54 ± 4% +1.0 3.58 ± 4% perf-profile.children.cycles-pp.__fget
3.26 ± 3% +1.0 4.30 ± 3% perf-profile.children.cycles-pp.__fdget_pos
2.31 +1.1 3.39 ± 3% perf-profile.children.cycles-pp.copy_page_from_iter
2.98 ± 3% +1.1 4.10 ± 4% perf-profile.children.cycles-pp.copy_page_to_iter
3.28 ± 6% +1.3 4.60 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
5.94 ± 9% +1.4 7.39 ± 7% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
41.96 +1.6 43.56 ± 2% perf-profile.children.cycles-pp.vfs_write
5.33 ± 2% +2.3 7.67 ± 3% perf-profile.children.cycles-pp.security_file_permission
44.96 +2.8 47.81 perf-profile.children.cycles-pp.ksys_write
2.23 ± 5% -1.0 1.26 ± 3% perf-profile.self.cycles-pp.switch_fpu_return
2.79 ± 2% -0.8 2.04 ± 6% perf-profile.self.cycles-pp.__schedule
2.11 ± 3% -0.7 1.39 ± 6% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
1.96 ± 5% -0.7 1.26 ± 5% perf-profile.self.cycles-pp.__switch_to
2.00 ± 4% -0.7 1.32 ± 6% perf-profile.self.cycles-pp.select_idle_sibling
2.15 -0.7 1.50 ± 6% perf-profile.self.cycles-pp.update_curr
1.93 ± 3% -0.7 1.28 ± 4% perf-profile.self.cycles-pp.available_idle_cpu
1.64 ± 6% -0.6 1.03 ± 3% perf-profile.self.cycles-pp.native_write_msr
1.66 ± 4% -0.6 1.07 ± 4% perf-profile.self.cycles-pp._raw_spin_lock
1.62 ± 3% -0.5 1.08 ± 2% perf-profile.self.cycles-pp.__switch_to_asm
1.46 -0.5 0.97 ± 6% perf-profile.self.cycles-pp.__enqueue_entity
1.31 ± 9% -0.5 0.83 ± 6% perf-profile.self.cycles-pp.update_load_avg
1.06 ± 7% -0.5 0.61 ± 5% perf-profile.self.cycles-pp.___perf_sw_event
1.53 ± 8% -0.4 1.11 ± 4% perf-profile.self.cycles-pp.update_cfs_group
1.29 ± 5% -0.4 0.91 ± 5% perf-profile.self.cycles-pp.reweight_entity
1.17 ± 4% -0.4 0.81 ± 7% perf-profile.self.cycles-pp.select_task_rq_fair
1.10 ± 2% -0.3 0.77 ± 6% perf-profile.self.cycles-pp.enqueue_task_fair
1.24 ± 2% -0.3 0.92 ± 2% perf-profile.self.cycles-pp.__update_load_avg_se
1.05 ± 2% -0.3 0.74 ± 3% perf-profile.self.cycles-pp.pick_next_task_fair
0.89 -0.2 0.64 ± 4% perf-profile.self.cycles-pp.__calc_delta
0.88 ± 4% -0.2 0.64 ± 5% perf-profile.self.cycles-pp.dequeue_task_fair
1.38 ± 2% -0.2 1.15 ± 3% perf-profile.self.cycles-pp.__lock_text_start
0.55 ± 7% -0.2 0.32 ± 6% perf-profile.self.cycles-pp.pick_next_entity
0.38 ± 9% -0.2 0.19 ± 4% perf-profile.self.cycles-pp.set_next_buddy
0.55 ± 3% -0.2 0.38 ± 6% perf-profile.self.cycles-pp.account_entity_dequeue
0.39 ± 5% -0.2 0.21 ± 10% perf-profile.self.cycles-pp.clear_buddies
0.79 -0.2 0.62 ± 5% perf-profile.self.cycles-pp.enqueue_entity
0.33 ± 8% -0.2 0.15 ± 3% perf-profile.self.cycles-pp.cpus_share_cache
0.52 ± 3% -0.2 0.36 ± 8% perf-profile.self.cycles-pp.check_preempt_wakeup
0.44 ± 4% -0.1 0.29 ± 4% perf-profile.self.cycles-pp.anon_pipe_buf_release
0.74 -0.1 0.60 ± 4% perf-profile.self.cycles-pp.try_to_wake_up
0.62 ± 5% -0.1 0.49 perf-profile.self.cycles-pp.native_sched_clock
0.47 ± 4% -0.1 0.34 ± 2% perf-profile.self.cycles-pp.finish_task_switch
1.01 -0.1 0.88 ± 4% perf-profile.self.cycles-pp.update_rq_clock
0.56 ± 3% -0.1 0.43 ± 5% perf-profile.self.cycles-pp.update_min_vruntime
0.45 ± 2% -0.1 0.32 ± 7% perf-profile.self.cycles-pp.account_entity_enqueue
0.22 ± 14% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.exit_to_usermode_loop
0.16 ± 13% -0.1 0.06 ± 14% perf-profile.self.cycles-pp.set_task_cpu
2.00 -0.1 1.90 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.42 ± 4% -0.1 0.31 ± 4% perf-profile.self.cycles-pp.schedule
0.47 ± 7% -0.1 0.37 ± 6% perf-profile.self.cycles-pp.cpuacct_charge
0.20 ± 2% -0.1 0.10 perf-profile.self.cycles-pp.wakeup_preempt_entity
0.34 ± 4% -0.1 0.24 ± 4% perf-profile.self.cycles-pp.set_next_entity
0.14 ± 19% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.migrate_task_rq_fair
0.25 ± 4% -0.1 0.15 ± 3% perf-profile.self.cycles-pp.resched_curr
0.35 ± 7% -0.1 0.26 ± 6% perf-profile.self.cycles-pp.dequeue_entity
0.53 ± 4% -0.1 0.44 perf-profile.self.cycles-pp.pipe_wait
0.21 ± 11% -0.1 0.12 ± 8% perf-profile.self.cycles-pp.put_prev_entity
0.30 ± 6% -0.1 0.21 ± 6% perf-profile.self.cycles-pp.rb_erase
0.22 ± 8% -0.1 0.14 ± 13% perf-profile.self.cycles-pp.activate_task
0.19 ± 14% -0.1 0.11 ± 20% perf-profile.self.cycles-pp.update_cfs_rq_h_load
0.35 ± 8% -0.1 0.27 ± 11% perf-profile.self.cycles-pp.find_next_bit
0.19 ± 9% -0.1 0.12 ± 12% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.36 ± 5% -0.1 0.30 ± 8% perf-profile.self.cycles-pp.prepare_to_wait
0.24 ± 9% -0.1 0.18 ± 6% perf-profile.self.cycles-pp.cpumask_next_wrap
0.19 ± 10% -0.1 0.14 ± 8% perf-profile.self.cycles-pp.native_apic_msr_eoi_write
0.16 ± 9% -0.1 0.11 ± 3% perf-profile.self.cycles-pp.finish_wait
0.23 ± 4% -0.0 0.19 ± 9% perf-profile.self.cycles-pp.native_irq_return_iret
0.20 ± 6% -0.0 0.15 ± 5% perf-profile.self.cycles-pp.deactivate_task
0.17 ± 4% -0.0 0.13 ± 9% perf-profile.self.cycles-pp.autoremove_wake_function
0.10 ± 7% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.is_cpu_allowed
0.19 ± 3% -0.0 0.16 ± 9% perf-profile.self.cycles-pp.__list_add_valid
0.19 ± 6% -0.0 0.16 ± 7% perf-profile.self.cycles-pp.rb_next
0.08 ± 17% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.sched_clock
0.09 ± 4% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.__mark_inode_dirty
0.13 ± 9% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.20 ± 10% +0.0 0.23 ± 2% perf-profile.self.cycles-pp.__x64_sys_read
0.19 ± 7% +0.0 0.23 ± 5% perf-profile.self.cycles-pp.__x64_sys_write
0.10 ± 4% +0.0 0.14 ± 5% perf-profile.self.cycles-pp.kill_fasync
0.12 ± 5% +0.0 0.16 ± 7% perf-profile.self.cycles-pp.__fdget_pos
0.17 ± 11% +0.0 0.21 ± 8% perf-profile.self.cycles-pp.generic_pipe_buf_confirm
0.18 ± 8% +0.0 0.23 ± 3% perf-profile.self.cycles-pp.fpregs_assert_state_consistent
0.08 ± 19% +0.0 0.13 ± 16% perf-profile.self.cycles-pp.copyout
0.08 ± 8% +0.1 0.13 ± 10% perf-profile.self.cycles-pp.copyin
0.10 ± 11% +0.1 0.15 ± 3% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64
0.29 ± 3% +0.1 0.35 ± 3% perf-profile.self.cycles-pp.__wake_up_common_lock
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.get_page_from_freelist
0.03 ±100% +0.1 0.08 ± 5% perf-profile.self.cycles-pp.bpf_fd_pass
0.21 ± 7% +0.1 0.27 ± 3% perf-profile.self.cycles-pp.rw_verify_area
0.36 ± 2% +0.1 0.43 ± 5% perf-profile.self.cycles-pp.atime_needs_update
0.25 ± 3% +0.1 0.31 ± 3% perf-profile.self.cycles-pp.__might_fault
0.31 ± 8% +0.1 0.38 ± 10% perf-profile.self.cycles-pp.__sb_start_write
0.28 ± 5% +0.1 0.36 ± 6% perf-profile.self.cycles-pp.ksys_read
0.20 ± 10% +0.1 0.30 ± 4% perf-profile.self.cycles-pp.timespec64_trunc
0.23 ± 6% +0.1 0.33 ± 7% perf-profile.self.cycles-pp.rcu_all_qs
0.32 ± 4% +0.1 0.42 ± 6% perf-profile.self.cycles-pp.file_update_time
0.26 ± 3% +0.1 0.36 ± 3% perf-profile.self.cycles-pp.ksys_write
0.21 ± 3% +0.1 0.31 ± 3% perf-profile.self.cycles-pp.__sb_end_write
1.07 +0.1 1.18 ± 2% perf-profile.self.cycles-pp.vfs_read
0.28 ± 6% +0.1 0.38 ± 5% perf-profile.self.cycles-pp._cond_resched
0.21 ± 3% +0.1 0.32 ± 5% perf-profile.self.cycles-pp.iov_iter_init
0.71 ± 3% +0.1 0.84 ± 3% perf-profile.self.cycles-pp.do_syscall_64
0.23 ± 4% +0.1 0.37 ± 7% perf-profile.self.cycles-pp.inode_has_perm
0.10 ± 27% +0.1 0.24 ± 4% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.81 +0.1 0.95 ± 2% perf-profile.self.cycles-pp.new_sync_read
0.65 ± 2% +0.2 0.80 ± 6% perf-profile.self.cycles-pp.copy_page_to_iter
0.35 ± 5% +0.2 0.51 ± 6% perf-profile.self.cycles-pp.__inode_security_revalidate
1.55 +0.2 1.72 ± 2% perf-profile.self.cycles-pp.pipe_read
0.65 +0.2 0.81 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.41 ± 9% +0.2 0.57 ± 5% perf-profile.self.cycles-pp.security_file_permission
0.31 ± 10% +0.2 0.47 ± 7% perf-profile.self.cycles-pp.__mutex_lock
0.26 ± 11% +0.2 0.43 ± 4% perf-profile.self.cycles-pp.current_time
0.44 ± 4% +0.2 0.62 ± 3% perf-profile.self.cycles-pp.copy_page_from_iter
0.53 ± 4% +0.2 0.75 ± 5% perf-profile.self.cycles-pp.vfs_write
0.63 ± 2% +0.3 0.89 ± 2% perf-profile.self.cycles-pp.new_sync_write
0.52 ± 4% +0.3 0.86 ± 7% perf-profile.self.cycles-pp.file_has_perm
0.08 ± 23% +0.3 0.43 ± 11% perf-profile.self.cycles-pp.poll_idle
0.98 ± 2% +0.4 1.35 ± 4% perf-profile.self.cycles-pp.__fsnotify_parent
0.94 ± 4% +0.4 1.34 ± 3% perf-profile.self.cycles-pp.__might_sleep
1.39 ± 3% +0.4 1.81 perf-profile.self.cycles-pp.fput_many
0.97 ± 3% +0.4 1.41 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64
2.01 ± 3% +0.4 2.46 perf-profile.self.cycles-pp.mutex_unlock
1.71 ± 5% +0.5 2.18 ± 4% perf-profile.self.cycles-pp.selinux_file_permission
1.09 ± 3% +0.5 1.57 ± 6% perf-profile.self.cycles-pp.avc_has_perm
1.11 ± 4% +0.5 1.60 ± 6% perf-profile.self.cycles-pp.fsnotify
1.88 ± 2% +0.6 2.43 ± 2% perf-profile.self.cycles-pp.mutex_lock
1.49 ± 3% +0.7 2.18 ± 4% perf-profile.self.cycles-pp.___might_sleep
1.70 ± 4% +0.8 2.46 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret
1.24 ± 6% +0.9 2.10 ± 2% perf-profile.self.cycles-pp.pipe_write
2.49 ± 2% +1.0 3.49 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
2.50 ± 4% +1.0 3.51 ± 5% perf-profile.self.cycles-pp.__fget
5.92 ± 9% +1.4 7.36 ± 7% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
hackbench.throughput
75000 +-+-----------------------------------------------------------------+
O O O O O O O O O O O |
70000 +-O O O O O O O O O O O O O O O O O O O O O O
| |
| |
65000 +-+ |
| |
60000 +-+ |
| |
55000 +-+ |
| |
| +.+.+..+. |
50000 +-+ + +. .+. .+.. .+.+. |
|.+.+.+..+.+.+.+.+ +.+ +.+ +.+ + |
45000 +-+-----------------------------------------------------------------+
hackbench.workload
4.8e+08 +-+---------------------------------------------------------------+
4.6e+08 +-+ O O O O O O O O |
| |
4.4e+08 O-O O O O O O O O O O O O O O O O O O O O O O O O
4.2e+08 +-+ |
| |
4e+08 +-+ |
3.8e+08 +-+ |
3.6e+08 +-+ |
| |
3.4e+08 +-+ |
3.2e+08 +-+ .+.+.+.+. |
|.+.+. .+.+.+.+..+ +.+.+.+.+.+.+.+.+.+.+..+ |
3e+08 +-+ + |
2.8e+08 +-+---------------------------------------------------------------+
hackbench.time.percent_of_cpu_this_job_got
1594 +-+------------------------------------------------------------------+
|.+. .+.+.+. .+.+.+.. .+.+. .+.+.+..+. |
1592 +-+ +.+..+.+ +..+.+.+ + + + |
1590 +-+ |
| |
1588 +-+ |
1586 +-+ |
| |
1584 +-+ |
1582 +-+ |
| |
1580 +-+ |
1578 +-+ O O O O O O O |
| O O O O O O O O O O O O O O O O O O O O O
1576 O-O-O----------O-O---------------------------------------------------+
hackbench.time.minor_page_faults
150000 +-+----------------------------------------------------------------+
| |
140000 +-+ O O O O O O O O |
O O O O O O O O O O O O O O O O O O O O O O O O O
130000 +-+ |
| |
120000 +-+ |
| |
110000 +-+ |
| |
100000 +-+ .+.+.+.+. |
|.+.+. .+.+..+.+.+ +.+.+..+.+.+.+.+.+.+.+.+ |
90000 +-+ + |
| |
80000 +-+----------------------------------------------------------------+
hackbench.time.voluntary_context_switches
1.8e+09 +-+---------------------------------------------------------------+
| .+.+. |
1.7e+09 +-+.+. .+.+.+.+..+. .+.+.+.+ +.+.+.+.+..+ |
1.6e+09 +-+ + +.+.+.+ |
| |
1.5e+09 +-+ |
| |
1.4e+09 +-+ |
| |
1.3e+09 +-+ |
1.2e+09 +-+ |
| |
1.1e+09 +-+ |
| O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
1e+09 O-+-----------O---------------------------------------------------+
hackbench.time.involuntary_context_switches
1.1e+09 +-+---------------------------------------------------------------+
|.+. .+. .+.. .+. .+.+. |
1e+09 +-+ +.+ +.+ +. +.+ + +.+.+.+.+..+ |
9e+08 +-+ +. .+. + |
| + + |
8e+08 +-+ |
| |
7e+08 +-+ |
| |
6e+08 +-+ |
5e+08 +-+ |
| |
4e+08 +-+ |
O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O O
3e+08 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[treewide] c9562c0dbb: general_protection_fault:#[##]
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: c9562c0dbbeadf2b5305253a01fca27590a9c302 ("treewide: Replace zero-length and one-element arrays with flexible array member")
https://git.kernel.org/cgit/linux/kernel/git/gustavoars/linux.git for-next/FAM
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------------------------------------------------+----------+------------+
| | v5.4-rc2 | c9562c0dbb |
+-----------------------------------------------------------------------------------------------------+----------+------------+
| boot_successes | 6535 | 1 |
| boot_failures | 135 | 17 |
| WARNING:at_fs/btrfs/space-info.h:#btrfs_free_reserved_data_space_noquota[btrfs] | 3 | |
| RIP:btrfs_free_reserved_data_space_noquota[btrfs] | 3 | |
| WARNING:at_fs/btrfs/space-info.h:#btrfs_add_reserved_bytes[btrfs] | 2 | |
| RIP:btrfs_add_reserved_bytes[btrfs] | 2 | |
| WARNING:at_fs/iomap/direct-io.c:#iomap_dio_actor | 9 | |
| RIP:iomap_dio_actor | 9 | |
| BUG:soft_lockup-CPU##stuck_for#s | 8 | |
| RIP:smp_call_function_single | 4 | |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 8 | |
| Assertion_failed | 9 | |
| WARNING:at_fs/xfs/xfs_message.c:#assfail[xfs] | 9 | |
| RIP:assfail[xfs] | 9 | |
| invoked_oom-killer:gfp_mask=0x | 4 | |
| Mem-Info | 4 | |
| page_allocation_failure:order:#,mode:#(GFP_HIGHUSER_MOVABLE),nodemask=(null),cpuset=/,mems_allowed= | 1 | |
| RIP:copy_user_generic_string | 3 | |
| INFO:rcu_sched_self-detected_stall_on_CPU | 2 | |
| RIP:ata_sff_pio_task[libata] | 1 | |
| RIP:e1000_xmit_frame | 1 | |
| BUG:kernel_hang_in_boot_stage | 9 | |
| BUG:kernel_hang_in_test_stage | 3 | |
| WARNING:at_net/mac80211/tx.c:#__ieee80211_csa_update_counter[mac80211] | 1 | |
| RIP:__ieee80211_csa_update_counter[mac80211] | 1 | |
| RIP:_raw_spin_unlock_irqrestore | 2 | |
| WARNING:at_fs/btrfs/block-group.c:#btrfs_free_block_groups[btrfs] | 2 | |
| RIP:btrfs_free_block_groups[btrfs] | 2 | |
| RIP:__d_lookup | 1 | |
| BUG:kernel_NULL_pointer_dereference,address | 6 | |
| Oops:#[##] | 2 | |
| RIP:ieee80211_subif_start_xmit[mac80211] | 1 | |
| RIP:__memcpy | 2 | |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 1 | |
| WARNING:at_kernel/trace/trace_hwlat.c:#start_kthread | 63 | |
| RIP:start_kthread | 63 | |
| WARNING:at_kernel/trace/ring_buffer.c:#rb_update_pages | 4 | |
| RIP:rb_update_pages | 4 | |
| WARNING:at_kernel/trace/ring_buffer.c:#rb_iter_peek | 2 | |
| RIP:rb_iter_peek | 2 | |
| WARNING:at_kernel/trace/ring_buffer.c:#rb_set_head_page | 3 | |
| RIP:rb_set_head_page | 3 | |
| WARNING:at_kernel/trace/ftrace.c:#ftrace_bug | 1 | |
| RIP:ftrace_bug | 1 | |
| WARNING:at_kernel/trace/trace.c:#trace_buffered_event_disable | 1 | |
| RIP:trace_buffered_event_disable | 1 | |
| RIP:memchr_inv | 1 | |
| BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/rwsem.c | 10 | |
| BUG:unable_to_handle_page_fault_for_address | 1 | |
| RIP:__kmalloc | 1 | |
| Kernel_panic-not_syncing:Fatal_exception | 1 | 17 |
| IP-Config:Auto-configuration_of_network_failed | 9 | |
| general_protection_fault:#[##] | 0 | 17 |
| RIP:kmem_cache_alloc_trace | 0 | 17 |
+-----------------------------------------------------------------------------------------------------+----------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 0.984422] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 0.985456] NetLabel: unlabeled traffic allowed by default
[ 0.986653] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 0.987424] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 0.992511] clocksource: Switched to clocksource kvm-clock
[ 0.994347] general protection fault: 0000 [#1] SMP PTI
[ 0.994804] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.4.0-rc2-00001-gc9562c0dbbead #1
[ 0.994804] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 0.994804] RIP: 0010:kmem_cache_alloc_trace+0x7b/0x230
[ 0.994804] Code: 01 00 00 4d 8b 01 65 49 8b 50 08 65 4c 03 05 e4 25 98 71 4d 8b 38 4d 85 ff 0f 84 69 01 00 00 41 8b 41 20 49 8b 39 48 8d 4a 01 <49> 8b 1c 07 4c 89 f8 65 48 0f c7 0f 0f 94 c0 84 c0 74 c6 41 8b 41
[ 0.994804] RSP: 0000:ffffb5a4c0013d40 EFLAGS: 00010202
[ 0.994804] RAX: 0000000000000000 RBX: 0000000000000dc0 RCX: 000000000000012c
[ 0.994804] RDX: 000000000000012b RSI: 0000000000000dc0 RDI: 000000000002f120
[ 0.994804] RBP: 0000000000000dc0 R08: ffff92abbfc2f120 R09: ffff92ab87c02fc0
[ 0.994804] R10: ffffffff8f769f68 R11: 0000000000000006 R12: ffff92ab87c02fc0
[ 0.994804] R13: 0000000000000100 R14: ffffffff8e7ac9aa R15: 009896808086a201
[ 0.994804] FS: 0000000000000000(0000) GS:ffff92abbfc00000(0000) knlGS:0000000000000000
[ 0.994804] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 0.994804] CR2: 0000000000000000 CR3: 000000003bc0a000 CR4: 00000000000406f0
[ 0.994804] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 0.994804] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 0.994804] Call Trace:
[ 0.994804] tracefs_create_file+0x6a/0x150
[ 0.994804] ? set_debug_rodata+0x11/0x11
[ 0.994804] trace_create_file+0xd/0x30
[ 0.994804] create_event_toplevel_files+0x6a/0x160
[ 0.994804] event_trace_init+0x22f/0x2d5
[ 0.994804] tracer_init_tracefs+0x60/0x1b8
[ 0.994804] ? register_tracer+0x1b4/0x1b4
[ 0.994804] do_one_initcall+0x46/0x214
[ 0.994804] kernel_init_freeable+0x1c2/0x26d
[ 0.994804] ? rest_init+0xd0/0xd0
[ 0.994804] kernel_init+0xa/0x110
[ 0.994804] ret_from_fork+0x35/0x40
[ 0.994804] Modules linked in:
[ 1.033786] ---[ end trace 63c605268a5d50fc ]---
[ 1.034901] RIP: 0010:kmem_cache_alloc_trace+0x7b/0x230
[ 1.036059] Code: 01 00 00 4d 8b 01 65 49 8b 50 08 65 4c 03 05 e4 25 98 71 4d 8b 38 4d 85 ff 0f 84 69 01 00 00 41 8b 41 20 49 8b 39 48 8d 4a 01 <49> 8b 1c 07 4c 89 f8 65 48 0f c7 0f 0f 94 c0 84 c0 74 c6 41 8b 41
[ 1.040102] RSP: 0000:ffffb5a4c0013d40 EFLAGS: 00010202
[ 1.041227] RAX: 0000000000000000 RBX: 0000000000000dc0 RCX: 000000000000012c
[ 1.042766] RDX: 000000000000012b RSI: 0000000000000dc0 RDI: 000000000002f120
[ 1.044198] RBP: 0000000000000dc0 R08: ffff92abbfc2f120 R09: ffff92ab87c02fc0
[ 1.045736] R10: ffffffff8f769f68 R11: 0000000000000006 R12: ffff92ab87c02fc0
[ 1.047213] R13: 0000000000000100 R14: ffffffff8e7ac9aa R15: 009896808086a201
[ 1.048706] FS: 0000000000000000(0000) GS:ffff92abbfc00000(0000) knlGS:0000000000000000
[ 1.050570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1.051850] CR2: 0000000000000000 CR3: 000000003bc0a000 CR4: 00000000000406f0
[ 1.053412] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1.055077] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1.056561] Kernel panic - not syncing: Fatal exception
Elapsed time: 10
qemu-img create -f qcow2 disk-vm-snb-4G-0b07b46be002-0 256G
qemu-img create -f qcow2 disk-vm-snb-4G-0b07b46be002-1 256G
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc2-00001-gc9562c0dbbead .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
1 year, 3 months
- 1
- 0
[selftests] e858ef1cd4: kernel_selftests.net.l2tp.sh.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: e858ef1cd4bc1bdfcd18114a8195236e336cee42 ("selftests: Add l2tp tests")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: kernel_selftests
with following parameters:
group: kselftests-02
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
# selftests: net: l2tp.sh
# Warning: file l2tp.sh is not executable, correct this.
not ok 32 selftests: net: l2tp.sh
To reproduce:
# build kernel
cd linux
cp config-5.3.0-rc3-00696-ge858ef1cd4bc1 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[sched/fair] f2500eb7cb: unixbench.score -10.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -10.6% regression of unixbench.score due to commit:
commit: f2500eb7cb334ac2dabc7a6f6b5ada7b28890034 ("sched/fair: rework find_idlest_group")
https://git.linaro.org/people/vincent.guittot/kernel.git sched-rework-load_balance-v4
in testcase: unixbench
on test machine: 104 threads Skylake with 192G memory
with following parameters:
runtime: 300s
nr_task: 1
test: shell8
cpufreq_governor: performance
test-description: UnixBench is the original BYTE UNIX benchmark suite aims to test performance of Unix-like system.
test-url: https://github.com/kdlucas/byte-unixbench
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------+
| testcase: change | unixbench: unixbench.score -31.4% regression |
| test machine | 104 threads Skylake with 192G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=1 |
| | runtime=300s |
| | test=shell1 |
+------------------+----------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/1/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-fpga01/shell8/unixbench
commit:
da6c7505e6 ("sched/fair: optimize find_idlest_group")
f2500eb7cb ("sched/fair: rework find_idlest_group")
da6c7505e6e37c22 f2500eb7cb334ac2dabc7a6f6b5
---------------- ---------------------------
%stddev %change %stddev
\ | \
8783 -10.6% 7854 unixbench.score
235560 +47.6% 347609 unixbench.time.involuntary_context_switches
40502023 -10.6% 36191982 unixbench.time.minor_page_faults
170.81 +19.1% 203.38 unixbench.time.system_time
197.86 -21.0% 156.23 unixbench.time.user_time
1172417 -11.2% 1041423 unixbench.time.voluntary_context_switches
332014 -10.2% 298072 unixbench.workload
17514 +15.9% 20307 ± 4% meminfo.KernelStack
0.00 ±129% -0.0 0.00 ±173% mpstat.cpu.all.soft%
9161 ± 2% +16.5% 10668 ± 2% numa-meminfo.node0.KernelStack
9290 ± 3% +14.9% 10676 ± 2% numa-vmstat.node0.nr_kernel_stack
192194 ± 12% +8.3% 208166 vmstat.system.in
16573454 ± 11% -15.8% 13950734 numa-numastat.node1.local_node
16597171 ± 11% -15.8% 13970945 numa-numastat.node1.numa_hit
203.56 ± 2% +6.7% 217.23 turbostat.PkgWatt
87.13 ± 3% +21.9% 106.20 turbostat.RAMWatt
20026 ± 8% -42.1% 11599 ± 2% slabinfo.cred_jar.active_objs
476.25 ± 8% -42.1% 275.75 ± 2% slabinfo.cred_jar.active_slabs
20026 ± 8% -42.1% 11599 ± 2% slabinfo.cred_jar.num_objs
476.25 ± 8% -42.1% 275.75 ± 2% slabinfo.cred_jar.num_slabs
28801 -10.0% 25924 slabinfo.filp.active_objs
28980 -10.0% 26071 slabinfo.filp.num_objs
7642 ± 5% -12.3% 6705 ± 2% slabinfo.pid.active_objs
7642 ± 5% -12.3% 6705 ± 2% slabinfo.pid.num_objs
65290 -2.1% 63926 proc-vmstat.nr_anon_pages
17712 +14.1% 20210 ± 4% proc-vmstat.nr_kernel_stack
46454 -1.6% 45716 proc-vmstat.nr_slab_unreclaimable
31535766 -11.4% 27929687 proc-vmstat.numa_hit
31501943 -11.4% 27896004 proc-vmstat.numa_local
36107 ± 29% -63.3% 13234 ± 93% proc-vmstat.numa_pte_updates
33490202 -11.6% 29594216 proc-vmstat.pgalloc_normal
40716008 -10.6% 36391917 proc-vmstat.pgfault
33428091 -11.6% 29535838 proc-vmstat.pgfree
1418 -9.8% 1279 ± 2% proc-vmstat.thp_deferred_split_page
1418 -10.2% 1274 ± 2% proc-vmstat.thp_fault_alloc
590486 -10.6% 528024 proc-vmstat.unevictable_pgs_culled
6.22 ±107% -3.4 2.78 ±173% perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.22 ±107% -3.4 2.78 ±173% perf-profile.calltrace.cycles-pp.seq_read.proc_reg_read.vfs_read.ksys_read.do_syscall_64
6.22 ±107% -3.4 2.78 ±173% perf-profile.calltrace.cycles-pp.show_interrupts.seq_read.proc_reg_read.vfs_read.ksys_read
3.24 ±103% +8.9 12.12 ± 50% perf-profile.calltrace.cycles-pp.perf_release.__fput.task_work_run.do_exit.do_group_exit
3.24 ±103% +8.9 12.12 ± 50% perf-profile.calltrace.cycles-pp.perf_event_release_kernel.perf_release.__fput.task_work_run.do_exit
5.51 ± 62% +8.9 14.40 ± 32% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.31 ±173% +9.3 10.57 ± 69% perf-profile.calltrace.cycles-pp._free_event.perf_event_release_kernel.perf_release.__fput.task_work_run
3.24 ±103% +9.4 12.68 ± 48% perf-profile.calltrace.cycles-pp.__fput.task_work_run.do_exit.do_group_exit.get_signal
3.24 ±103% +10.9 14.15 ± 34% perf-profile.calltrace.cycles-pp.task_work_run.do_exit.do_group_exit.get_signal.do_signal
3.24 ±103% +11.2 14.40 ± 32% perf-profile.calltrace.cycles-pp.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.24 ±103% +11.2 14.40 ± 32% perf-profile.calltrace.cycles-pp.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.24 ±103% +11.2 14.40 ± 32% perf-profile.calltrace.cycles-pp.do_group_exit.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64
3.24 ±103% +11.2 14.40 ± 32% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.get_signal.do_signal.exit_to_usermode_loop
6.22 ±107% -3.4 2.78 ±173% perf-profile.children.cycles-pp.proc_reg_read
6.22 ±107% -3.4 2.78 ±173% perf-profile.children.cycles-pp.show_interrupts
3.24 ±103% +8.9 12.12 ± 50% perf-profile.children.cycles-pp.perf_release
3.24 ±103% +8.9 12.12 ± 50% perf-profile.children.cycles-pp.perf_event_release_kernel
5.51 ± 62% +8.9 14.40 ± 32% perf-profile.children.cycles-pp.exit_to_usermode_loop
1.31 ±173% +9.3 10.57 ± 69% perf-profile.children.cycles-pp._free_event
3.24 ±103% +11.2 14.40 ± 32% perf-profile.children.cycles-pp.do_signal
3.24 ±103% +11.2 14.40 ± 32% perf-profile.children.cycles-pp.get_signal
3.44 ± 16% +10.8 14.29 perf-stat.i.cache-miss-rate%
5279501 ± 10% +398.1% 26295466 ± 3% perf-stat.i.cache-misses
4618 ± 8% +78.1% 8225 ± 3% perf-stat.i.cpu-migrations
3738 ± 8% -73.9% 975.02 ± 18% perf-stat.i.cycles-between-cache-misses
87.21 +6.2 93.41 perf-stat.i.node-load-miss-rate%
1366551 ± 12% +532.9% 8648387 ± 3% perf-stat.i.node-load-misses
193999 ± 8% +180.4% 543909 ± 2% perf-stat.i.node-loads
48.52 ± 7% +32.1 80.59 perf-stat.i.node-store-miss-rate%
221228 ± 10% +529.2% 1391949 ± 3% perf-stat.i.node-store-misses
252135 ± 9% +25.2% 315648 ± 3% perf-stat.i.node-stores
2.87 ± 8% +11.6 14.47 perf-stat.overall.cache-miss-rate%
1.06 ± 2% +8.3% 1.15 perf-stat.overall.cpi
3588 ± 5% -79.8% 725.27 perf-stat.overall.cycles-between-cache-misses
0.94 ± 2% -7.7% 0.87 perf-stat.overall.ipc
87.50 +6.6 94.08 perf-stat.overall.node-load-miss-rate%
46.72 ± 3% +34.8 81.49 perf-stat.overall.node-store-miss-rate%
5198253 ± 10% +397.7% 25873473 ± 3% perf-stat.ps.cache-misses
4546 ± 8% +78.0% 8093 ± 3% perf-stat.ps.cpu-migrations
1345467 ± 12% +532.5% 8509537 ± 3% perf-stat.ps.node-load-misses
191010 ± 8% +180.2% 535190 ± 2% perf-stat.ps.node-loads
217813 ± 10% +528.8% 1369600 ± 3% perf-stat.ps.node-store-misses
248238 ± 9% +25.1% 310596 ± 3% perf-stat.ps.node-stores
1.182e+12 -9.6% 1.068e+12 perf-stat.total.instructions
358.01 ±173% +295.0% 1414 ± 4% sched_debug.cfs_rq:/.exec_clock.min
37.80 ± 51% +81.0% 68.41 ± 20% sched_debug.cfs_rq:/.removed.util_avg.stddev
1.70 ± 27% +187.5% 4.90 ± 58% sched_debug.cfs_rq:/.runnable_load_avg.avg
23.75 ± 51% +796.8% 213.00 ±106% sched_debug.cfs_rq:/.runnable_load_avg.max
5.40 ± 34% +396.0% 26.80 ± 87% sched_debug.cfs_rq:/.runnable_load_avg.stddev
222.31 ± 8% +23.4% 274.33 ± 13% sched_debug.cfs_rq:/.util_avg.stddev
30073 ±122% +238.0% 101637 ± 9% sched_debug.cpu.avg_idle.min
48319 ± 26% +50.6% 72755 ± 3% sched_debug.cpu.clock.avg
48324 ± 26% +50.6% 72760 ± 3% sched_debug.cpu.clock.max
48312 ± 26% +50.6% 72750 ± 3% sched_debug.cpu.clock.min
48319 ± 26% +50.6% 72755 ± 3% sched_debug.cpu.clock_task.avg
48324 ± 26% +50.6% 72760 ± 3% sched_debug.cpu.clock_task.max
48312 ± 26% +50.6% 72750 ± 3% sched_debug.cpu.clock_task.min
5954 ±117% +211.5% 18544 sched_debug.cpu.nr_switches.avg
3863 ±158% +300.0% 15451 ± 3% sched_debug.cpu.nr_switches.min
21.25 ± 20% +137.6% 50.50 ± 26% sched_debug.cpu.nr_uninterruptible.max
-19.25 +53.9% -29.62 sched_debug.cpu.nr_uninterruptible.min
7.37 ± 8% +34.8% 9.93 ± 15% sched_debug.cpu.nr_uninterruptible.stddev
4033 ±172% +312.2% 16625 sched_debug.cpu.sched_count.avg
3387 ±173% +319.9% 14220 ± 3% sched_debug.cpu.sched_count.min
1739 ±172% +330.0% 7479 sched_debug.cpu.sched_goidle.avg
1456 ±173% +340.5% 6414 ± 3% sched_debug.cpu.sched_goidle.min
617.26 ±173% +324.5% 2620 sched_debug.cpu.ttwu_local.avg
766.38 ±173% +294.4% 3022 ± 3% sched_debug.cpu.ttwu_local.max
521.50 ±173% +322.2% 2201 ± 4% sched_debug.cpu.ttwu_local.min
48315 ± 26% +50.6% 72751 ± 3% sched_debug.cpu_clk
45453 ± 28% +53.8% 69889 ± 3% sched_debug.ktime
48676 ± 26% +50.3% 73174 ± 3% sched_debug.sched_clk
20437 ± 4% -9.8% 18427 ± 2% softirqs.CPU100.RCU
35172 ± 6% -20.8% 27870 ± 3% softirqs.CPU100.TIMER
19972 ± 2% -10.4% 17900 ± 2% softirqs.CPU101.RCU
34585 ± 7% -21.2% 27256 ± 4% softirqs.CPU101.TIMER
20761 ± 3% -11.0% 18486 softirqs.CPU102.RCU
35028 ± 6% -22.7% 27090 ± 3% softirqs.CPU102.TIMER
10375 ± 7% -11.1% 9222 ± 8% softirqs.CPU103.SCHED
35046 ± 6% -21.2% 27605 ± 4% softirqs.CPU103.TIMER
20804 ± 7% -10.5% 18623 softirqs.CPU2.RCU
36383 ± 6% -21.6% 28514 ± 6% softirqs.CPU26.TIMER
35739 ± 6% -22.3% 27761 ± 6% softirqs.CPU27.TIMER
36245 ± 5% -23.5% 27733 ± 3% softirqs.CPU28.TIMER
36895 ± 4% -19.0% 29889 ± 5% softirqs.CPU29.TIMER
22576 ± 8% -16.3% 18893 ± 2% softirqs.CPU30.RCU
37926 ± 7% -23.6% 28969 ± 3% softirqs.CPU30.TIMER
22679 ± 10% -15.1% 19244 ± 2% softirqs.CPU31.RCU
37104 ± 9% -19.9% 29709 ± 7% softirqs.CPU31.TIMER
22154 ± 12% -14.2% 19017 ± 2% softirqs.CPU32.RCU
39188 ± 11% -25.8% 29086 ± 5% softirqs.CPU32.TIMER
20966 ± 3% -10.2% 18823 softirqs.CPU33.RCU
35740 ± 6% -21.8% 27953 ± 5% softirqs.CPU33.TIMER
36014 ± 6% -21.1% 28412 ± 6% softirqs.CPU34.TIMER
35641 ± 4% -22.6% 27598 ± 8% softirqs.CPU35.TIMER
35253 ± 6% -18.4% 28784 ± 3% softirqs.CPU36.TIMER
35737 ± 5% -19.1% 28898 ± 5% softirqs.CPU37.TIMER
21063 ± 2% -9.6% 19047 ± 3% softirqs.CPU38.RCU
35837 ± 5% -18.9% 29071 ± 7% softirqs.CPU38.TIMER
20978 ± 2% -11.3% 18600 ± 3% softirqs.CPU40.RCU
35474 ± 5% -18.9% 28761 ± 6% softirqs.CPU40.TIMER
21276 -11.1% 18913 ± 2% softirqs.CPU41.RCU
35649 ± 4% -19.5% 28691 ± 5% softirqs.CPU41.TIMER
35413 ± 4% -19.6% 28479 ± 5% softirqs.CPU42.TIMER
35323 ± 6% -16.6% 29461 ± 3% softirqs.CPU43.TIMER
36010 ± 5% -14.8% 30689 ± 6% softirqs.CPU44.TIMER
35682 ± 3% -16.5% 29793 ± 5% softirqs.CPU45.TIMER
35289 ± 4% -17.9% 28983 ± 7% softirqs.CPU46.TIMER
35957 ± 5% -19.9% 28789 ± 5% softirqs.CPU47.TIMER
35425 ± 5% -15.3% 30018 ± 9% softirqs.CPU48.TIMER
35546 ± 5% -20.1% 28384 ± 2% softirqs.CPU49.TIMER
36158 ± 4% -20.8% 28642 ± 3% softirqs.CPU50.TIMER
37220 ± 5% -21.6% 29165 ± 3% softirqs.CPU51.TIMER
20357 ± 5% -7.8% 18776 softirqs.CPU62.RCU
20608 ± 4% -9.0% 18752 softirqs.CPU64.RCU
21233 ± 6% -13.3% 18405 softirqs.CPU67.RCU
20225 ± 5% -9.1% 18392 softirqs.CPU7.RCU
20580 ± 6% -7.8% 18981 softirqs.CPU70.RCU
21311 ± 9% -11.6% 18844 softirqs.CPU71.RCU
20529 ± 6% -10.6% 18349 ± 4% softirqs.CPU72.RCU
20657 ± 6% -9.7% 18649 softirqs.CPU74.RCU
15874 ± 3% +9.1% 17322 ± 2% softirqs.CPU77.RCU
36065 ± 5% -24.5% 27245 ± 3% softirqs.CPU78.TIMER
21342 ± 8% -11.8% 18818 ± 2% softirqs.CPU79.RCU
41390 ± 19% -33.9% 27342 ± 4% softirqs.CPU79.TIMER
20036 ± 5% -12.8% 17463 ± 7% softirqs.CPU8.RCU
36748 ± 7% -23.9% 27969 ± 3% softirqs.CPU80.TIMER
21271 ± 4% -9.3% 19300 ± 4% softirqs.CPU81.RCU
36635 ± 6% -24.7% 27578 ± 7% softirqs.CPU81.TIMER
34373 ± 9% -17.4% 28401 ± 9% softirqs.CPU82.TIMER
11144 ± 10% -12.4% 9765 ± 6% softirqs.CPU83.SCHED
35947 ± 5% -25.0% 26969 ± 4% softirqs.CPU83.TIMER
34655 ± 8% -22.2% 26963 ± 6% softirqs.CPU84.TIMER
36121 ± 5% -24.4% 27316 ± 3% softirqs.CPU85.TIMER
35609 ± 5% -19.0% 28828 ± 6% softirqs.CPU87.TIMER
34382 ± 6% -18.9% 27877 ± 2% softirqs.CPU88.TIMER
34718 ± 5% -19.6% 27931 ± 3% softirqs.CPU89.TIMER
20385 ± 5% -9.5% 18444 ± 3% softirqs.CPU9.RCU
34796 ± 6% -20.8% 27567 ± 4% softirqs.CPU90.TIMER
33968 ± 7% -20.6% 26964 ± 6% softirqs.CPU91.TIMER
34982 ± 7% -18.0% 28694 ± 8% softirqs.CPU92.TIMER
20680 ± 2% -11.6% 18284 softirqs.CPU93.RCU
35315 ± 6% -22.1% 27517 ± 4% softirqs.CPU93.TIMER
34794 ± 8% -20.6% 27615 ± 5% softirqs.CPU94.TIMER
35054 ± 7% -20.9% 27716 ± 5% softirqs.CPU95.TIMER
20847 ± 5% -11.5% 18443 softirqs.CPU96.RCU
34978 ± 7% -22.8% 26997 ± 3% softirqs.CPU96.TIMER
20904 ± 4% -10.8% 18636 softirqs.CPU97.RCU
34574 ± 6% -19.6% 27807 softirqs.CPU97.TIMER
34323 ± 7% -20.4% 27331 ± 4% softirqs.CPU98.TIMER
3446915 ± 8% -15.0% 2928211 ± 3% softirqs.TIMER
353626 ± 8% +35.6% 479367 ± 7% interrupts.CAL:Function_call_interrupts
3330 ± 6% +45.5% 4845 ± 7% interrupts.CPU0.CAL:Function_call_interrupts
1578 ± 12% +122.7% 3516 ± 6% interrupts.CPU0.TLB:TLB_shootdowns
3350 ± 4% +41.9% 4756 ± 6% interrupts.CPU1.CAL:Function_call_interrupts
1584 ± 12% +116.1% 3423 ± 2% interrupts.CPU1.TLB:TLB_shootdowns
3355 ± 5% +34.4% 4508 ± 8% interrupts.CPU10.CAL:Function_call_interrupts
1595 ± 15% +100.4% 3197 ± 5% interrupts.CPU10.TLB:TLB_shootdowns
3401 ± 12% +35.8% 4618 ± 8% interrupts.CPU100.CAL:Function_call_interrupts
1633 ± 14% +100.6% 3276 interrupts.CPU100.TLB:TLB_shootdowns
3393 ± 12% +34.2% 4555 ± 7% interrupts.CPU101.CAL:Function_call_interrupts
134.50 ± 20% +24.3% 167.25 ± 3% interrupts.CPU101.RES:Rescheduling_interrupts
1625 ± 12% +97.8% 3214 ± 2% interrupts.CPU101.TLB:TLB_shootdowns
3407 ± 13% +40.8% 4798 ± 5% interrupts.CPU102.CAL:Function_call_interrupts
1639 ± 18% +110.8% 3456 ± 5% interrupts.CPU102.TLB:TLB_shootdowns
3343 ± 12% +41.3% 4723 ± 8% interrupts.CPU103.CAL:Function_call_interrupts
127.00 ± 16% +25.4% 159.25 ± 7% interrupts.CPU103.RES:Rescheduling_interrupts
1575 ± 14% +114.8% 3385 ± 2% interrupts.CPU103.TLB:TLB_shootdowns
3396 ± 5% +32.9% 4513 ± 12% interrupts.CPU11.CAL:Function_call_interrupts
1634 ± 11% +99.6% 3262 ± 3% interrupts.CPU11.TLB:TLB_shootdowns
3295 ± 6% +40.2% 4619 ± 8% interrupts.CPU12.CAL:Function_call_interrupts
127.00 ± 9% +34.8% 171.25 ± 6% interrupts.CPU12.RES:Rescheduling_interrupts
1535 ± 7% +114.4% 3291 ± 3% interrupts.CPU12.TLB:TLB_shootdowns
3336 ± 5% +34.4% 4483 ± 9% interrupts.CPU13.CAL:Function_call_interrupts
1575 ± 18% +103.2% 3200 ± 5% interrupts.CPU13.TLB:TLB_shootdowns
3306 ± 5% +37.9% 4560 ± 9% interrupts.CPU14.CAL:Function_call_interrupts
1552 ± 10% +108.6% 3237 ± 4% interrupts.CPU14.TLB:TLB_shootdowns
3412 ± 3% +34.7% 4595 ± 10% interrupts.CPU15.CAL:Function_call_interrupts
1652 ± 16% +97.8% 3267 ± 7% interrupts.CPU15.TLB:TLB_shootdowns
3309 ± 5% +41.5% 4681 ± 9% interrupts.CPU16.CAL:Function_call_interrupts
1552 ± 14% +116.0% 3352 ± 4% interrupts.CPU16.TLB:TLB_shootdowns
3429 ± 5% +35.0% 4630 ± 9% interrupts.CPU17.CAL:Function_call_interrupts
137.75 ± 22% +28.9% 177.50 ± 8% interrupts.CPU17.RES:Rescheduling_interrupts
1673 ± 15% +97.3% 3301 ± 3% interrupts.CPU17.TLB:TLB_shootdowns
3291 ± 5% +38.7% 4563 ± 8% interrupts.CPU18.CAL:Function_call_interrupts
148.25 ± 15% +55.0% 229.75 ± 43% interrupts.CPU18.RES:Rescheduling_interrupts
1545 ± 14% +109.3% 3235 ± 4% interrupts.CPU18.TLB:TLB_shootdowns
3460 ± 12% +30.1% 4501 ± 10% interrupts.CPU19.CAL:Function_call_interrupts
1702 ± 22% +86.4% 3173 ± 3% interrupts.CPU19.TLB:TLB_shootdowns
3337 ± 4% +41.4% 4718 ± 4% interrupts.CPU2.CAL:Function_call_interrupts
1572 ± 12% +115.3% 3385 ± 5% interrupts.CPU2.TLB:TLB_shootdowns
3084 ± 8% +41.1% 4351 ± 2% interrupts.CPU20.CAL:Function_call_interrupts
1592 ± 14% +106.5% 3289 ± 2% interrupts.CPU20.TLB:TLB_shootdowns
3452 ± 6% +33.4% 4606 ± 8% interrupts.CPU21.CAL:Function_call_interrupts
131.75 ± 21% +47.1% 193.75 ± 30% interrupts.CPU21.RES:Rescheduling_interrupts
1698 ± 13% +93.1% 3280 ± 4% interrupts.CPU21.TLB:TLB_shootdowns
3322 ± 6% +35.8% 4513 ± 6% interrupts.CPU22.CAL:Function_call_interrupts
1563 ± 16% +103.8% 3185 ± 5% interrupts.CPU22.TLB:TLB_shootdowns
3272 ± 8% +41.5% 4630 ± 10% interrupts.CPU23.CAL:Function_call_interrupts
1514 ± 10% +118.1% 3303 ± 4% interrupts.CPU23.TLB:TLB_shootdowns
3321 ± 8% +33.3% 4428 ± 9% interrupts.CPU24.CAL:Function_call_interrupts
129.00 ± 22% +50.2% 193.75 ± 28% interrupts.CPU24.RES:Rescheduling_interrupts
1563 ± 11% +98.4% 3101 ± 2% interrupts.CPU24.TLB:TLB_shootdowns
3293 ± 7% +37.9% 4542 ± 6% interrupts.CPU25.CAL:Function_call_interrupts
128.50 ± 18% +62.8% 209.25 ± 41% interrupts.CPU25.RES:Rescheduling_interrupts
1535 ± 11% +109.6% 3218 ± 3% interrupts.CPU25.TLB:TLB_shootdowns
3384 ± 13% +38.4% 4685 ± 7% interrupts.CPU26.CAL:Function_call_interrupts
133.75 ± 29% +42.8% 191.00 ± 8% interrupts.CPU26.RES:Rescheduling_interrupts
1639 ± 17% +105.1% 3362 ± 5% interrupts.CPU26.TLB:TLB_shootdowns
2108 ± 34% +53.5% 3237 ± 5% interrupts.CPU27.TLB:TLB_shootdowns
2007 ± 29% +62.4% 3258 ± 2% interrupts.CPU28.TLB:TLB_shootdowns
1898 ± 24% +70.5% 3237 ± 5% interrupts.CPU29.TLB:TLB_shootdowns
3310 ± 2% +37.3% 4543 ± 7% interrupts.CPU3.CAL:Function_call_interrupts
1546 ± 15% +107.6% 3210 ± 2% interrupts.CPU3.TLB:TLB_shootdowns
3557 ± 17% +27.6% 4539 ± 9% interrupts.CPU30.CAL:Function_call_interrupts
1799 ± 18% +79.7% 3233 interrupts.CPU30.TLB:TLB_shootdowns
3459 ± 16% +36.2% 4710 ± 9% interrupts.CPU31.CAL:Function_call_interrupts
150.00 ± 4% +18.0% 177.00 ± 10% interrupts.CPU31.RES:Rescheduling_interrupts
1701 ± 15% +98.0% 3369 ± 2% interrupts.CPU31.TLB:TLB_shootdowns
3451 ± 16% +30.7% 4511 ± 11% interrupts.CPU32.CAL:Function_call_interrupts
1763 ± 15% +79.6% 3168 ± 4% interrupts.CPU32.TLB:TLB_shootdowns
3506 ± 15% +29.9% 4556 ± 7% interrupts.CPU33.CAL:Function_call_interrupts
1765 ± 13% +82.4% 3220 interrupts.CPU33.TLB:TLB_shootdowns
3394 ± 13% +33.8% 4542 ± 10% interrupts.CPU34.CAL:Function_call_interrupts
1699 ± 13% +88.3% 3199 ± 3% interrupts.CPU34.TLB:TLB_shootdowns
3321 ± 13% +37.5% 4566 ± 7% interrupts.CPU35.CAL:Function_call_interrupts
1633 ± 12% +97.4% 3224 ± 5% interrupts.CPU35.TLB:TLB_shootdowns
3387 ± 14% +36.2% 4612 ± 9% interrupts.CPU36.CAL:Function_call_interrupts
1646 ± 15% +98.9% 3273 ± 2% interrupts.CPU36.TLB:TLB_shootdowns
3477 ± 14% +32.7% 4613 ± 9% interrupts.CPU37.CAL:Function_call_interrupts
1720 ± 12% +90.1% 3270 ± 3% interrupts.CPU37.TLB:TLB_shootdowns
3465 ± 15% +30.3% 4515 ± 8% interrupts.CPU38.CAL:Function_call_interrupts
1706 ± 16% +85.9% 3172 ± 3% interrupts.CPU38.TLB:TLB_shootdowns
3679 ± 6% +25.2% 4605 ± 8% interrupts.CPU39.CAL:Function_call_interrupts
1924 ± 11% +69.5% 3261 ± 3% interrupts.CPU39.TLB:TLB_shootdowns
2832 ± 18% +62.7% 4607 ± 7% interrupts.CPU4.CAL:Function_call_interrupts
1599 ± 12% +104.8% 3275 ± 6% interrupts.CPU4.TLB:TLB_shootdowns
3593 ± 4% +25.3% 4504 ± 9% interrupts.CPU40.CAL:Function_call_interrupts
1894 ± 9% +69.9% 3218 interrupts.CPU40.TLB:TLB_shootdowns
3600 ± 9% +27.3% 4583 ± 9% interrupts.CPU41.CAL:Function_call_interrupts
1844 ± 12% +75.6% 3238 ± 3% interrupts.CPU41.TLB:TLB_shootdowns
3535 ± 10% +29.6% 4582 ± 5% interrupts.CPU42.CAL:Function_call_interrupts
1779 ± 6% +82.0% 3239 ± 4% interrupts.CPU42.TLB:TLB_shootdowns
3545 ± 10% +27.6% 4525 ± 7% interrupts.CPU43.CAL:Function_call_interrupts
1786 ± 10% +79.4% 3204 ± 2% interrupts.CPU43.TLB:TLB_shootdowns
1769 ± 11% +79.2% 3170 ± 7% interrupts.CPU44.TLB:TLB_shootdowns
3506 ± 13% +32.3% 4638 ± 9% interrupts.CPU45.CAL:Function_call_interrupts
125.50 ± 7% +41.8% 178.00 ± 7% interrupts.CPU45.RES:Rescheduling_interrupts
1744 ± 13% +88.8% 3293 ± 4% interrupts.CPU45.TLB:TLB_shootdowns
1684 ± 12% +90.6% 3210 ± 3% interrupts.CPU46.TLB:TLB_shootdowns
3354 ± 12% +32.8% 4456 ± 5% interrupts.CPU47.CAL:Function_call_interrupts
1594 ± 14% +99.2% 3176 ± 3% interrupts.CPU47.TLB:TLB_shootdowns
3363 ± 10% +30.6% 4392 ± 6% interrupts.CPU48.CAL:Function_call_interrupts
121.00 ± 16% +34.5% 162.75 ± 12% interrupts.CPU48.RES:Rescheduling_interrupts
1606 ± 12% +94.6% 3127 ± 3% interrupts.CPU48.TLB:TLB_shootdowns
3451 ± 13% +29.0% 4453 ± 3% interrupts.CPU49.CAL:Function_call_interrupts
1691 ± 17% +87.9% 3178 ± 8% interrupts.CPU49.TLB:TLB_shootdowns
3299 ± 3% +40.1% 4621 ± 8% interrupts.CPU5.CAL:Function_call_interrupts
1537 ± 16% +112.2% 3263 interrupts.CPU5.TLB:TLB_shootdowns
3308 ± 12% +37.6% 4553 ± 8% interrupts.CPU50.CAL:Function_call_interrupts
1547 ± 13% +109.0% 3234 ± 2% interrupts.CPU50.TLB:TLB_shootdowns
3321 ± 13% +35.8% 4509 ± 7% interrupts.CPU51.CAL:Function_call_interrupts
1613 ± 14% +97.0% 3178 ± 3% interrupts.CPU51.TLB:TLB_shootdowns
3302 ± 3% +26.8% 4187 ± 11% interrupts.CPU52.CAL:Function_call_interrupts
117.50 ± 21% +37.0% 161.00 ± 14% interrupts.CPU52.RES:Rescheduling_interrupts
1515 ± 13% +87.7% 2845 ± 5% interrupts.CPU52.TLB:TLB_shootdowns
3323 ± 5% +39.7% 4643 ± 9% interrupts.CPU53.CAL:Function_call_interrupts
127.50 ± 16% +31.2% 167.25 ± 6% interrupts.CPU53.RES:Rescheduling_interrupts
1563 ± 13% +109.6% 3277 interrupts.CPU53.TLB:TLB_shootdowns
3268 ± 5% +43.1% 4676 ± 9% interrupts.CPU54.CAL:Function_call_interrupts
1496 ± 11% +122.7% 3333 ± 3% interrupts.CPU54.TLB:TLB_shootdowns
3273 ± 7% +40.3% 4591 ± 6% interrupts.CPU55.CAL:Function_call_interrupts
1500 ± 14% +116.5% 3248 ± 3% interrupts.CPU55.TLB:TLB_shootdowns
3375 ± 6% +34.1% 4527 ± 7% interrupts.CPU56.CAL:Function_call_interrupts
111.25 ± 27% +43.8% 160.00 ± 7% interrupts.CPU56.RES:Rescheduling_interrupts
1551 ± 7% +105.3% 3185 ± 3% interrupts.CPU56.TLB:TLB_shootdowns
3265 ± 5% +42.9% 4665 ± 7% interrupts.CPU57.CAL:Function_call_interrupts
1494 ± 15% +122.4% 3323 ± 3% interrupts.CPU57.TLB:TLB_shootdowns
3295 ± 5% +37.6% 4535 ± 7% interrupts.CPU58.CAL:Function_call_interrupts
118.50 ± 22% +44.1% 170.75 ± 10% interrupts.CPU58.RES:Rescheduling_interrupts
1525 ± 13% +110.1% 3204 ± 5% interrupts.CPU58.TLB:TLB_shootdowns
3276 ± 3% +43.0% 4686 ± 7% interrupts.CPU59.CAL:Function_call_interrupts
131.50 ± 14% +41.4% 186.00 ± 6% interrupts.CPU59.RES:Rescheduling_interrupts
1504 ± 12% +122.2% 3342 ± 3% interrupts.CPU59.TLB:TLB_shootdowns
3297 ± 4% +37.0% 4518 ± 8% interrupts.CPU6.CAL:Function_call_interrupts
1532 ± 17% +112.0% 3248 ± 2% interrupts.CPU6.TLB:TLB_shootdowns
3392 ± 9% +39.1% 4717 ± 4% interrupts.CPU60.CAL:Function_call_interrupts
131.75 ± 21% +41.4% 186.25 ± 11% interrupts.CPU60.RES:Rescheduling_interrupts
1622 ± 11% +107.9% 3373 ± 7% interrupts.CPU60.TLB:TLB_shootdowns
3313 ± 6% +39.7% 4628 ± 7% interrupts.CPU61.CAL:Function_call_interrupts
1542 ± 10% +112.9% 3284 interrupts.CPU61.TLB:TLB_shootdowns
3338 ± 7% +37.5% 4589 ± 7% interrupts.CPU62.CAL:Function_call_interrupts
132.25 ± 16% +33.1% 176.00 ± 14% interrupts.CPU62.RES:Rescheduling_interrupts
1568 ± 15% +106.9% 3245 ± 5% interrupts.CPU62.TLB:TLB_shootdowns
3330 ± 6% +37.2% 4570 ± 7% interrupts.CPU63.CAL:Function_call_interrupts
1559 ± 5% +106.9% 3225 ± 3% interrupts.CPU63.TLB:TLB_shootdowns
3322 ± 6% +43.1% 4754 ± 8% interrupts.CPU64.CAL:Function_call_interrupts
137.75 ± 13% +25.8% 173.25 ± 11% interrupts.CPU64.RES:Rescheduling_interrupts
1552 ± 14% +119.5% 3406 ± 7% interrupts.CPU64.TLB:TLB_shootdowns
3314 ± 5% +40.4% 4654 ± 9% interrupts.CPU65.CAL:Function_call_interrupts
1542 ± 9% +114.4% 3308 ± 5% interrupts.CPU65.TLB:TLB_shootdowns
3324 ± 4% +44.5% 4804 ± 9% interrupts.CPU66.CAL:Function_call_interrupts
138.25 ± 21% +31.8% 182.25 ± 8% interrupts.CPU66.RES:Rescheduling_interrupts
1553 ± 13% +122.8% 3461 ± 6% interrupts.CPU66.TLB:TLB_shootdowns
3394 ± 4% +34.8% 4575 ± 9% interrupts.CPU67.CAL:Function_call_interrupts
1630 ± 12% +98.1% 3228 ± 5% interrupts.CPU67.TLB:TLB_shootdowns
3300 ± 6% +40.6% 4639 ± 8% interrupts.CPU68.CAL:Function_call_interrupts
1531 ± 19% +115.2% 3294 interrupts.CPU68.TLB:TLB_shootdowns
3425 ± 4% +36.5% 4673 ± 8% interrupts.CPU69.CAL:Function_call_interrupts
1658 ± 17% +101.1% 3334 ± 6% interrupts.CPU69.TLB:TLB_shootdowns
3354 +37.7% 4618 ± 6% interrupts.CPU7.CAL:Function_call_interrupts
1590 ± 17% +106.7% 3287 ± 4% interrupts.CPU7.TLB:TLB_shootdowns
3385 ± 5% +38.2% 4679 ± 6% interrupts.CPU70.CAL:Function_call_interrupts
146.75 ± 14% +22.3% 179.50 ± 5% interrupts.CPU70.RES:Rescheduling_interrupts
1616 ± 7% +106.3% 3333 ± 3% interrupts.CPU70.TLB:TLB_shootdowns
3394 ± 8% +34.1% 4552 ± 10% interrupts.CPU71.CAL:Function_call_interrupts
142.75 ± 21% +18.9% 169.75 ± 5% interrupts.CPU71.RES:Rescheduling_interrupts
1626 ± 14% +97.2% 3206 ± 6% interrupts.CPU71.TLB:TLB_shootdowns
3326 ± 8% +38.9% 4618 ± 8% interrupts.CPU72.CAL:Function_call_interrupts
1531 ± 11% +113.8% 3272 interrupts.CPU72.TLB:TLB_shootdowns
3226 ± 5% +45.5% 4694 ± 10% interrupts.CPU73.CAL:Function_call_interrupts
127.00 ± 14% +32.3% 168.00 ± 10% interrupts.CPU73.RES:Rescheduling_interrupts
1456 ± 16% +128.1% 3322 ± 4% interrupts.CPU73.TLB:TLB_shootdowns
3333 ± 8% +42.2% 4738 ± 7% interrupts.CPU74.CAL:Function_call_interrupts
141.75 ± 8% +15.0% 163.00 ± 3% interrupts.CPU74.RES:Rescheduling_interrupts
1565 ± 14% +116.7% 3392 ± 3% interrupts.CPU74.TLB:TLB_shootdowns
3362 ± 4% +35.9% 4568 ± 8% interrupts.CPU75.CAL:Function_call_interrupts
120.75 ± 14% +41.8% 171.25 ± 11% interrupts.CPU75.RES:Rescheduling_interrupts
1594 ± 14% +102.2% 3224 ± 6% interrupts.CPU75.TLB:TLB_shootdowns
3294 ± 5% +42.7% 4700 ± 8% interrupts.CPU76.CAL:Function_call_interrupts
121.00 ± 15% +38.4% 167.50 ± 6% interrupts.CPU76.RES:Rescheduling_interrupts
1533 ± 10% +118.7% 3353 ± 2% interrupts.CPU76.TLB:TLB_shootdowns
3294 ± 6% +39.1% 4582 ± 6% interrupts.CPU77.CAL:Function_call_interrupts
117.50 ± 24% +49.6% 175.75 ± 11% interrupts.CPU77.RES:Rescheduling_interrupts
1528 ± 16% +111.9% 3238 ± 4% interrupts.CPU77.TLB:TLB_shootdowns
3216 ± 15% +44.4% 4643 ± 9% interrupts.CPU78.CAL:Function_call_interrupts
127.25 ± 13% +35.0% 171.75 ± 9% interrupts.CPU78.RES:Rescheduling_interrupts
1523 ± 10% +116.6% 3299 ± 5% interrupts.CPU78.TLB:TLB_shootdowns
2069 ± 34% +59.8% 3307 ± 2% interrupts.CPU79.TLB:TLB_shootdowns
3438 ± 11% +33.7% 4595 ± 8% interrupts.CPU8.CAL:Function_call_interrupts
1680 ± 25% +94.3% 3265 interrupts.CPU8.TLB:TLB_shootdowns
2081 ± 30% +52.2% 3168 ± 3% interrupts.CPU80.TLB:TLB_shootdowns
3613 ± 20% +31.5% 4750 ± 8% interrupts.CPU81.CAL:Function_call_interrupts
152.75 ± 17% +21.4% 185.50 ± 7% interrupts.CPU81.RES:Rescheduling_interrupts
1918 ± 24% +77.5% 3405 ± 3% interrupts.CPU81.TLB:TLB_shootdowns
3577 ± 17% +36.2% 4872 ± 7% interrupts.CPU82.CAL:Function_call_interrupts
1820 ± 18% +93.7% 3526 ± 4% interrupts.CPU82.TLB:TLB_shootdowns
3368 ± 23% +39.0% 4680 ± 5% interrupts.CPU83.CAL:Function_call_interrupts
131.25 ± 10% +38.1% 181.25 ± 13% interrupts.CPU83.RES:Rescheduling_interrupts
1737 ± 17% +92.3% 3341 ± 4% interrupts.CPU83.TLB:TLB_shootdowns
3463 ± 15% +33.3% 4617 ± 8% interrupts.CPU84.CAL:Function_call_interrupts
132.25 ± 12% +59.5% 211.00 ± 30% interrupts.CPU84.RES:Rescheduling_interrupts
1706 ± 14% +91.8% 3273 interrupts.CPU84.TLB:TLB_shootdowns
3477 ± 14% +36.3% 4739 ± 6% interrupts.CPU85.CAL:Function_call_interrupts
127.75 ± 18% +43.1% 182.75 ± 6% interrupts.CPU85.RES:Rescheduling_interrupts
1707 ± 13% +98.8% 3394 ± 5% interrupts.CPU85.TLB:TLB_shootdowns
3445 ± 13% +38.8% 4781 ± 7% interrupts.CPU86.CAL:Function_call_interrupts
135.25 ± 9% +29.8% 175.50 ± 8% interrupts.CPU86.RES:Rescheduling_interrupts
1678 ± 11% +104.8% 3437 ± 2% interrupts.CPU86.TLB:TLB_shootdowns
3398 ± 13% +42.4% 4840 ± 5% interrupts.CPU87.CAL:Function_call_interrupts
123.25 ± 11% +48.5% 183.00 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts
1630 ± 13% +114.8% 3500 ± 4% interrupts.CPU87.TLB:TLB_shootdowns
3423 ± 15% +41.0% 4826 ± 6% interrupts.CPU88.CAL:Function_call_interrupts
133.75 ± 17% +26.2% 168.75 ± 4% interrupts.CPU88.RES:Rescheduling_interrupts
1657 ± 16% +113.2% 3533 ± 5% interrupts.CPU88.TLB:TLB_shootdowns
3461 ± 14% +35.8% 4700 ± 6% interrupts.CPU89.CAL:Function_call_interrupts
121.50 ± 17% +30.9% 159.00 ± 8% interrupts.CPU89.RES:Rescheduling_interrupts
1700 ± 13% +97.4% 3356 ± 4% interrupts.CPU89.TLB:TLB_shootdowns
3415 ± 6% +29.4% 4420 ± 6% interrupts.CPU9.CAL:Function_call_interrupts
1652 ± 21% +88.4% 3114 ± 4% interrupts.CPU9.TLB:TLB_shootdowns
3408 ± 13% +40.0% 4771 ± 6% interrupts.CPU90.CAL:Function_call_interrupts
1640 ± 11% +108.9% 3427 ± 3% interrupts.CPU90.TLB:TLB_shootdowns
3537 ± 9% +36.5% 4829 ± 5% interrupts.CPU91.CAL:Function_call_interrupts
139.75 ± 6% +21.5% 169.75 ± 6% interrupts.CPU91.RES:Rescheduling_interrupts
1770 ± 4% +96.8% 3484 ± 3% interrupts.CPU91.TLB:TLB_shootdowns
3686 ± 2% +26.2% 4650 ± 7% interrupts.CPU92.CAL:Function_call_interrupts
1970 ± 16% +70.5% 3359 ± 3% interrupts.CPU92.TLB:TLB_shootdowns
3487 ± 7% +37.2% 4783 ± 6% interrupts.CPU93.CAL:Function_call_interrupts
130.00 ± 13% +38.5% 180.00 ± 11% interrupts.CPU93.RES:Rescheduling_interrupts
1721 ± 9% +99.8% 3439 ± 3% interrupts.CPU93.TLB:TLB_shootdowns
3460 ± 9% +39.1% 4812 ± 4% interrupts.CPU94.CAL:Function_call_interrupts
1692 ± 8% +104.9% 3469 ± 7% interrupts.CPU94.TLB:TLB_shootdowns
3262 ± 9% +40.1% 4569 ± 6% interrupts.CPU95.CAL:Function_call_interrupts
139.25 ± 7% +19.9% 167.00 ± 5% interrupts.CPU95.RES:Rescheduling_interrupts
1611 ± 4% +100.2% 3225 ± 3% interrupts.CPU95.TLB:TLB_shootdowns
3368 ± 8% +33.1% 4482 ± 10% interrupts.CPU96.CAL:Function_call_interrupts
1653 ± 7% +93.1% 3192 ± 5% interrupts.CPU96.TLB:TLB_shootdowns
3430 ± 10% +35.8% 4659 ± 10% interrupts.CPU97.CAL:Function_call_interrupts
1662 ± 10% +99.5% 3316 ± 5% interrupts.CPU97.TLB:TLB_shootdowns
3400 ± 11% +35.0% 4589 ± 11% interrupts.CPU98.CAL:Function_call_interrupts
1632 ± 8% +99.0% 3248 ± 7% interrupts.CPU98.TLB:TLB_shootdowns
3350 ± 9% +37.2% 4597 ± 7% interrupts.CPU99.CAL:Function_call_interrupts
122.00 ± 8% +30.7% 159.50 ± 5% interrupts.CPU99.RES:Rescheduling_interrupts
1591 ± 7% +105.3% 3267 ± 4% interrupts.CPU99.TLB:TLB_shootdowns
171942 ± 2% +98.6% 341413 interrupts.TLB:TLB_shootdowns
unixbench.score
10000 +-+-----------------------------------------------------------------+
9000 +-+ +.+ + ++.++.+ : : : : : : ++ + |
| : : : : : : : ++.+|
8000 OO+OO OO OO OO OO OO OO OO OO OO OOO : : |
7000 +-+ : : : :: : : : |
| : : : :: : : : |
6000 +-+ : : : :: : : : |
5000 +-+ : : :: :: : : |
4000 +-+ :: :: : :: |
| :: :: : :: |
3000 +-+ :: :: : :: |
2000 +-+ : : : : |
| : : : : |
1000 +-+ : : : : |
0 +-+-----------------------------------------------------------------+
unixbench.time.user_time
250 +-+-------------------------------------------------------------------+
| |
|.++.++.++.++.++.++ +.++.++.++ + ++.++.++.+ ++.++. +.++.++.+ |
200 +-+ : : : : : : : + +.++.|
| : : : : : : : |
O OO OO OO OO OO OO:OO OO OO OO:OO:O O : : |
150 +-+ : : : :: : : : |
| : : : :: : : : |
100 +-+ : : : :: : :: |
| :: :: : : :: |
| :: :: : : :: |
50 +-+ : : :: :: |
| : : : : |
| : : : : |
0 +-+-------------------------------------------------------------------+
unixbench.time.system_time
250 +-+-------------------------------------------------------------------+
| |
| O O O O |
200 O-O OO O O OO OO OO O OO OO OO O O |
| .++.|
|.++.++.++.++.++.++ +.++.++.++ + ++.++.++.+ ++.++.++.++.++.++ |
150 +-+ : : : : : : : |
| : : : : : : : |
100 +-+ : : : :: : : : |
| : : : :: : : : |
| :: :: : : :: |
50 +-+ :: :: : : :: |
| : : : : |
| : : : : |
0 +-+-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-skl-fpga01: 104 threads Skylake with 192G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/1/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-fpga01/shell1/unixbench
commit:
da6c7505e6 ("sched/fair: optimize find_idlest_group")
f2500eb7cb ("sched/fair: rework find_idlest_group")
da6c7505e6e37c22 f2500eb7cb334ac2dabc7a6f6b5
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:2 25% 2:4 perf-profile.children.cycles-pp.error_entry
0:2 12% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
2716 -31.4% 1863 unixbench.score
26903 ± 5% +2835.9% 789839 unixbench.time.involuntary_context_switches
1.174e+08 -31.3% 80639525 unixbench.time.minor_page_faults
145.50 -4.6% 138.75 unixbench.time.percent_of_cpu_this_job_got
361.69 +39.6% 504.88 unixbench.time.system_time
561.98 -33.1% 375.80 unixbench.time.user_time
3489499 -31.2% 2399443 unixbench.time.voluntary_context_switches
7285987 -31.5% 4989666 unixbench.workload
0.59 -0.1 0.47 mpstat.cpu.all.usr%
480807 ± 3% -22.7% 371617 meminfo.Committed_AS
31782 -9.5% 28767 meminfo.Mapped
98.00 +1.0% 99.00 vmstat.cpu.id
15070 -4.8% 14351 vmstat.system.cs
3665885 +52.1% 5576867 ± 8% cpuidle.C1.time
645209 ± 4% +15.5% 744925 cpuidle.POLL.time
119052 ± 2% +12.9% 134368 cpuidle.POLL.usage
77.00 ± 2% -8.8% 70.25 turbostat.Avg_MHz
189.51 +2.0% 193.32 turbostat.PkgWatt
77.12 +30.5% 100.62 turbostat.RAMWatt
53176 ± 2% -46.9% 28217 ± 63% numa-vmstat.node0.nr_active_anon
48799 ± 2% -47.0% 25848 ± 68% numa-vmstat.node0.nr_anon_pages
53175 ± 2% -46.9% 28217 ± 63% numa-vmstat.node0.nr_zone_active_anon
4910 ± 20% -26.0% 3635 ± 16% numa-vmstat.node1.nr_inactive_anon
10020 ± 7% -11.9% 8831 ± 14% numa-vmstat.node1.nr_slab_reclaimable
4910 ± 20% -26.0% 3635 ± 16% numa-vmstat.node1.nr_zone_inactive_anon
212811 ± 2% -46.9% 113070 ± 63% numa-meminfo.node0.Active
212711 ± 2% -46.9% 112949 ± 63% numa-meminfo.node0.Active(anon)
163158 ± 6% -53.3% 76154 ± 78% numa-meminfo.node0.AnonHugePages
195225 ± 2% -47.1% 103294 ± 68% numa-meminfo.node0.AnonPages
119812 ± 2% +11.8% 133900 ± 7% numa-meminfo.node0.Slab
19927 ± 19% -26.5% 14649 ± 16% numa-meminfo.node1.Inactive
19641 ± 20% -26.0% 14537 ± 16% numa-meminfo.node1.Inactive(anon)
40081 ± 7% -11.9% 35321 ± 14% numa-meminfo.node1.KReclaimable
40081 ± 7% -11.9% 35321 ± 14% numa-meminfo.node1.SReclaimable
68017 -1.6% 66908 proc-vmstat.nr_active_anon
63036 -1.2% 62278 proc-vmstat.nr_anon_pages
15994 +7.5% 17188 proc-vmstat.nr_kernel_stack
8056 -9.2% 7312 proc-vmstat.nr_mapped
1377 +9.4% 1506 ± 6% proc-vmstat.nr_page_table_pages
11633 -7.0% 10816 proc-vmstat.nr_shmem
68017 -1.6% 66908 proc-vmstat.nr_zone_active_anon
93248783 -31.7% 63733680 proc-vmstat.numa_hit
93215019 -31.7% 63699979 proc-vmstat.numa_local
4278 -5.0% 4062 proc-vmstat.pgactivate
98218116 -31.9% 66853552 proc-vmstat.pgalloc_normal
1.191e+08 -30.9% 82296619 proc-vmstat.pgfault
98198263 -31.9% 66831748 proc-vmstat.pgfree
3821 -31.3% 2626 proc-vmstat.thp_deferred_split_page
3811 -31.4% 2615 proc-vmstat.thp_fault_alloc
1608263 -31.3% 1104382 proc-vmstat.unevictable_pgs_culled
31957 +12.5% 35937 slabinfo.Acpi-Namespace.active_objs
31957 +12.5% 35937 slabinfo.Acpi-Namespace.num_objs
31180 +34.9% 42053 ± 2% slabinfo.anon_vma.active_objs
681.50 +34.3% 915.00 ± 2% slabinfo.anon_vma.active_slabs
31380 +34.2% 42110 ± 2% slabinfo.anon_vma.num_objs
681.50 +34.3% 915.00 ± 2% slabinfo.anon_vma.num_slabs
52095 +32.2% 68879 slabinfo.anon_vma_chain.active_objs
817.50 +32.0% 1078 slabinfo.anon_vma_chain.active_slabs
52370 +31.9% 69052 slabinfo.anon_vma_chain.num_objs
817.50 +32.0% 1078 slabinfo.anon_vma_chain.num_slabs
7267 -12.7% 6342 ± 2% slabinfo.cred_jar.active_objs
7267 -12.7% 6342 ± 2% slabinfo.cred_jar.num_objs
25240 -9.4% 22875 slabinfo.filp.active_objs
25401 -9.3% 23029 slabinfo.filp.num_objs
5164 -10.6% 4617 slabinfo.pid.active_objs
5164 -10.6% 4617 slabinfo.pid.num_objs
926.50 +16.4% 1078 ± 5% slabinfo.pool_workqueue.active_objs
926.50 +16.4% 1078 ± 5% slabinfo.pool_workqueue.num_objs
9.04 +9.0% 9.85 perf-stat.i.MPKI
1.186e+09 -26.1% 8.758e+08 perf-stat.i.branch-instructions
2.23 +0.1 2.34 perf-stat.i.branch-miss-rate%
26389039 -22.3% 20498617 perf-stat.i.branch-misses
3.14 ± 34% +11.3 14.48 ± 2% perf-stat.i.cache-miss-rate%
1345669 ± 30% +368.0% 6298157 perf-stat.i.cache-misses
54261758 -19.5% 43655065 perf-stat.i.cache-references
15118 -4.7% 14404 perf-stat.i.context-switches
1.28 ± 4% +22.8% 1.57 perf-stat.i.cpi
7.125e+09 ± 4% -7.2% 6.611e+09 perf-stat.i.cpu-cycles
204.98 ± 2% +848.3% 1943 perf-stat.i.cpu-migrations
5800 ± 26% -79.6% 1183 ± 4% perf-stat.i.cycles-between-cache-misses
2575303 ± 13% -30.1% 1801089 perf-stat.i.dTLB-load-misses
1.505e+09 -25.1% 1.127e+09 perf-stat.i.dTLB-loads
0.07 ± 9% -0.0 0.06 ± 3% perf-stat.i.dTLB-store-miss-rate%
593875 ± 7% -32.0% 403696 perf-stat.i.dTLB-store-misses
8.826e+08 -25.8% 6.553e+08 perf-stat.i.dTLB-stores
30.62 ± 6% -5.6 25.02 ± 2% perf-stat.i.iTLB-load-miss-rate%
1171692 ± 7% -33.1% 784247 perf-stat.i.iTLB-load-misses
2585991 -11.3% 2294652 perf-stat.i.iTLB-loads
5.925e+09 -26.1% 4.378e+09 perf-stat.i.instructions
0.82 ± 3% -20.3% 0.65 perf-stat.i.ipc
184643 -31.0% 127406 perf-stat.i.minor-faults
91.61 +1.7 93.29 perf-stat.i.node-load-miss-rate%
269396 +725.5% 2223749 perf-stat.i.node-load-misses
25619 ± 6% +507.4% 155615 perf-stat.i.node-loads
70.26 +12.4 82.65 perf-stat.i.node-store-miss-rate%
31389 ± 3% +1021.5% 352035 ± 2% perf-stat.i.node-store-misses
14377 +417.5% 74407 ± 3% perf-stat.i.node-stores
184642 -31.0% 127405 perf-stat.i.page-faults
9.16 +8.9% 9.97 perf-stat.overall.MPKI
2.23 +0.1 2.34 perf-stat.overall.branch-miss-rate%
2.47 ± 29% +12.0 14.43 perf-stat.overall.cache-miss-rate%
1.20 ± 3% +25.6% 1.51 perf-stat.overall.cpi
5747 ± 26% -81.7% 1049 perf-stat.overall.cycles-between-cache-misses
0.07 ± 6% -0.0 0.06 perf-stat.overall.dTLB-store-miss-rate%
31.15 ± 5% -5.7 25.47 perf-stat.overall.iTLB-load-miss-rate%
5081 ± 6% +9.9% 5582 perf-stat.overall.instructions-per-iTLB-miss
0.83 ± 3% -20.5% 0.66 perf-stat.overall.ipc
91.32 +2.1 93.46 perf-stat.overall.node-load-miss-rate%
68.57 +14.0 82.54 perf-stat.overall.node-store-miss-rate%
513654 +8.1% 555310 perf-stat.overall.path-length
1.184e+09 -26.1% 8.744e+08 perf-stat.ps.branch-instructions
26345326 -22.3% 20464928 perf-stat.ps.branch-misses
1343530 ± 30% +368.0% 6287327 perf-stat.ps.cache-misses
54171145 -19.6% 43580100 perf-stat.ps.cache-references
15093 -4.7% 14379 perf-stat.ps.context-switches
7.113e+09 ± 4% -7.2% 6.6e+09 perf-stat.ps.cpu-cycles
204.64 ± 2% +848.2% 1940 perf-stat.ps.cpu-migrations
2571025 ± 13% -30.1% 1797992 perf-stat.ps.dTLB-load-misses
1.503e+09 -25.1% 1.125e+09 perf-stat.ps.dTLB-loads
592885 ± 7% -32.0% 402999 perf-stat.ps.dTLB-store-misses
8.812e+08 -25.8% 6.541e+08 perf-stat.ps.dTLB-stores
1169738 ± 7% -33.1% 782902 perf-stat.ps.iTLB-load-misses
2581762 -11.3% 2290837 perf-stat.ps.iTLB-loads
5.915e+09 -26.1% 4.371e+09 perf-stat.ps.instructions
184333 -31.0% 127184 perf-stat.ps.minor-faults
268953 +725.4% 2219893 perf-stat.ps.node-load-misses
25578 ± 6% +507.3% 155348 perf-stat.ps.node-loads
31339 ± 3% +1021.4% 351425 ± 2% perf-stat.ps.node-store-misses
14354 +417.5% 74280 ± 3% perf-stat.ps.node-stores
184332 -31.0% 127184 perf-stat.ps.page-faults
3.742e+12 -26.0% 2.771e+12 perf-stat.total.instructions
211069 ± 4% -16.6% 175960 ± 2% softirqs.CPU0.RCU
218367 ± 9% -17.0% 181336 ± 5% softirqs.CPU1.RCU
208159 ± 7% -13.4% 180198 ± 4% softirqs.CPU10.RCU
203463 ± 6% -12.4% 178308 ± 4% softirqs.CPU100.RCU
198809 ± 2% -11.5% 175890 ± 3% softirqs.CPU101.RCU
206112 ± 6% -11.6% 182256 ± 5% softirqs.CPU102.RCU
208369 ± 6% -12.9% 181593 ± 4% softirqs.CPU103.RCU
201673 ± 2% -11.1% 179201 ± 2% softirqs.CPU12.RCU
214797 ± 7% -18.7% 174711 ± 10% softirqs.CPU13.RCU
213096 ± 6% -14.7% 181732 ± 5% softirqs.CPU14.RCU
191376 ± 3% -7.3% 177428 ± 2% softirqs.CPU15.RCU
199568 ± 6% -8.6% 182385 ± 3% softirqs.CPU16.RCU
204579 ± 7% -10.2% 183645 ± 3% softirqs.CPU17.RCU
216637 ± 10% -15.6% 182929 ± 3% softirqs.CPU2.RCU
202177 ± 7% -10.9% 180182 ± 4% softirqs.CPU21.RCU
200889 ± 8% -10.6% 179568 ± 2% softirqs.CPU24.RCU
202338 ± 7% -11.5% 179146 ± 2% softirqs.CPU25.RCU
213793 ± 8% -15.2% 181395 ± 3% softirqs.CPU3.RCU
204519 ± 4% -10.7% 182658 ± 5% softirqs.CPU30.RCU
209677 ± 6% -11.5% 185550 ± 4% softirqs.CPU31.RCU
211847 ± 5% -13.5% 183161 ± 7% softirqs.CPU32.RCU
209452 ± 6% -17.3% 173224 ± 8% softirqs.CPU33.RCU
316756 ± 2% -31.0% 218484 ± 7% softirqs.CPU34.TIMER
207213 ± 5% -10.3% 185943 ± 5% softirqs.CPU35.RCU
211450 ± 7% -13.4% 183160 ± 4% softirqs.CPU36.RCU
215359 ± 9% -13.9% 185523 ± 4% softirqs.CPU37.RCU
214729 ± 7% -14.2% 184327 ± 4% softirqs.CPU38.RCU
216878 ± 9% -15.9% 182296 ± 4% softirqs.CPU4.RCU
217001 ± 6% -15.3% 183752 ± 4% softirqs.CPU40.RCU
215370 ± 9% -15.4% 182248 ± 4% softirqs.CPU41.RCU
209313 ± 6% -12.3% 183540 ± 5% softirqs.CPU42.RCU
215853 ± 7% -13.4% 186831 ± 5% softirqs.CPU44.RCU
217878 ± 8% -15.9% 183172 ± 4% softirqs.CPU5.RCU
219536 ± 7% -16.2% 184006 ± 4% softirqs.CPU6.RCU
203449 ± 4% -10.7% 181601 ± 5% softirqs.CPU60.RCU
217364 ± 8% -14.3% 186383 ± 4% softirqs.CPU61.RCU
213851 ± 7% -12.9% 186334 ± 4% softirqs.CPU62.RCU
318502 -34.4% 208789 ± 8% softirqs.CPU63.TIMER
204087 ± 3% -10.3% 183088 ± 2% softirqs.CPU64.RCU
216685 ± 8% -14.5% 185315 ± 6% softirqs.CPU65.RCU
214301 ± 7% -12.9% 186609 ± 5% softirqs.CPU66.RCU
203546 ± 5% -11.0% 181087 softirqs.CPU67.RCU
213449 ± 8% -12.5% 186785 ± 4% softirqs.CPU68.RCU
201016 ± 3% -11.4% 178071 ± 3% softirqs.CPU7.RCU
219363 ± 9% -14.2% 188124 ± 5% softirqs.CPU70.RCU
216835 ± 8% -14.3% 185774 ± 6% softirqs.CPU72.RCU
216979 ± 8% -13.8% 187041 ± 6% softirqs.CPU73.RCU
216059 ± 9% -13.9% 185956 ± 4% softirqs.CPU74.RCU
193885 -9.8% 174960 ± 4% softirqs.CPU79.RCU
198157 ± 2% -10.2% 177919 ± 2% softirqs.CPU8.RCU
207628 ± 4% -11.4% 183894 ± 4% softirqs.CPU80.RCU
203391 ± 4% -9.6% 183883 ± 5% softirqs.CPU83.RCU
205195 ± 4% -13.9% 176622 ± 3% softirqs.CPU85.RCU
207328 ± 6% -13.4% 179637 ± 4% softirqs.CPU88.RCU
208950 ± 8% -13.4% 181000 ± 5% softirqs.CPU89.RCU
215540 ± 8% -15.4% 182448 ± 4% softirqs.CPU9.RCU
210354 ± 5% -13.3% 182380 ± 5% softirqs.CPU90.RCU
208497 ± 6% -14.4% 178506 ± 4% softirqs.CPU92.RCU
209914 ± 7% -15.7% 176914 ± 4% softirqs.CPU93.RCU
204889 ± 5% -12.2% 179969 ± 5% softirqs.CPU94.RCU
210117 ± 6% -12.5% 183944 ± 5% softirqs.CPU95.RCU
208765 ± 6% -12.2% 183257 ± 5% softirqs.CPU96.RCU
207117 ± 5% -11.4% 183508 ± 5% softirqs.CPU97.RCU
20849446 -11.2% 18508378 softirqs.RCU
26024122 -14.3% 22303675 ± 3% softirqs.TIMER
105.93 ± 99% -88.2% 12.49 ±173% sched_debug.cfs_rq:/.MIN_vruntime.avg
7689 ± 8% -49.6% 3876 ± 4% sched_debug.cfs_rq:/.exec_clock.avg
29794 -76.4% 7032 ± 8% sched_debug.cfs_rq:/.exec_clock.max
51.18 ± 10% +5687.9% 2962 ± 8% sched_debug.cfs_rq:/.exec_clock.min
9497 ± 2% -95.0% 473.51 ± 18% sched_debug.cfs_rq:/.exec_clock.stddev
16000 ± 11% -55.1% 7190 ± 5% sched_debug.cfs_rq:/.load.avg
59501 ± 6% -35.1% 38632 ± 8% sched_debug.cfs_rq:/.load.stddev
57.39 ± 11% -55.6% 25.47 ± 15% sched_debug.cfs_rq:/.load_avg.avg
927.00 ± 7% -12.7% 809.18 ± 8% sched_debug.cfs_rq:/.load_avg.max
180.32 ± 2% -36.0% 115.33 ± 12% sched_debug.cfs_rq:/.load_avg.stddev
105.93 ± 99% -88.2% 12.49 ±173% sched_debug.cfs_rq:/.max_vruntime.avg
42829 ± 6% -19.2% 34618 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg
127378 -59.8% 51197 ± 7% sched_debug.cfs_rq:/.min_vruntime.max
9367 +167.4% 25053 ± 8% sched_debug.cfs_rq:/.min_vruntime.min
36371 ± 5% -88.8% 4080 ± 12% sched_debug.cfs_rq:/.min_vruntime.stddev
0.08 ± 9% -42.5% 0.04 ± 3% sched_debug.cfs_rq:/.nr_running.avg
0.26 ± 4% -25.4% 0.19 ± 3% sched_debug.cfs_rq:/.nr_running.stddev
1.64 +85.1% 3.03 ± 60% sched_debug.cfs_rq:/.nr_spread_over.max
33.87 ± 13% -58.9% 13.91 ± 28% sched_debug.cfs_rq:/.removed.load_avg.avg
869.77 ± 5% -21.7% 681.17 ± 11% sched_debug.cfs_rq:/.removed.load_avg.max
161.08 ± 3% -43.4% 91.13 ± 18% sched_debug.cfs_rq:/.removed.load_avg.stddev
1562 ± 13% -58.9% 642.04 ± 28% sched_debug.cfs_rq:/.removed.runnable_sum.avg
40166 ± 5% -21.6% 31485 ± 11% sched_debug.cfs_rq:/.removed.runnable_sum.max
7432 ± 3% -43.4% 4207 ± 18% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
16.75 ± 11% -59.5% 6.79 ± 26% sched_debug.cfs_rq:/.removed.util_avg.avg
439.23 ± 5% -21.6% 344.46 ± 11% sched_debug.cfs_rq:/.removed.util_avg.max
79.77 -43.3% 45.21 ± 17% sched_debug.cfs_rq:/.removed.util_avg.stddev
10.06 ± 5% -52.5% 4.77 ± 10% sched_debug.cfs_rq:/.runnable_load_avg.avg
44.08 ± 2% -35.1% 28.60 ± 5% sched_debug.cfs_rq:/.runnable_load_avg.stddev
15980 ± 11% -57.1% 6862 ± 5% sched_debug.cfs_rq:/.runnable_weight.avg
59403 ± 6% -37.9% 36880 ± 7% sched_debug.cfs_rq:/.runnable_weight.stddev
36373 ± 5% -88.8% 4080 ± 12% sched_debug.cfs_rq:/.spread0.stddev
89.30 ± 11% -31.5% 61.15 ± 5% sched_debug.cfs_rq:/.util_avg.avg
568.36 +36.6% 776.24 ± 7% sched_debug.cfs_rq:/.util_avg.max
179.94 ± 5% -18.5% 146.62 ± 4% sched_debug.cfs_rq:/.util_avg.stddev
5.77 ± 4% -30.3% 4.02 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.avg
32.89 ± 4% -25.1% 24.62 ± 12% sched_debug.cfs_rq:/.util_est_enqueued.stddev
30294 ± 32% +143.6% 73783 ± 19% sched_debug.cpu.avg_idle.min
251654 ± 7% -24.5% 189894 sched_debug.cpu.avg_idle.stddev
345101 -7.7% 318595 ± 3% sched_debug.cpu.clock.avg
345105 -7.7% 318600 ± 3% sched_debug.cpu.clock.max
345097 -7.7% 318590 ± 3% sched_debug.cpu.clock.min
2.09 ± 2% +34.3% 2.80 sched_debug.cpu.clock.stddev
345101 -7.7% 318595 ± 3% sched_debug.cpu.clock_task.avg
345105 -7.7% 318600 ± 3% sched_debug.cpu.clock_task.max
345097 -7.7% 318590 ± 3% sched_debug.cpu.clock_task.min
2.09 ± 2% +34.3% 2.80 sched_debug.cpu.clock_task.stddev
508.53 ± 9% +134.5% 1192 ± 16% sched_debug.cpu.curr->pid.avg
23978 ± 4% +100.2% 47996 sched_debug.cpu.curr->pid.max
3282 ± 6% +118.4% 7168 ± 8% sched_debug.cpu.curr->pid.stddev
0.00 ± 4% +51.3% 0.00 ± 5% sched_debug.cpu.next_balance.stddev
0.04 ± 3% +19.3% 0.04 ± 5% sched_debug.cpu.nr_running.avg
45354 -11.0% 40362 ± 4% sched_debug.cpu.nr_switches.avg
281894 ± 2% -80.0% 56470 ± 5% sched_debug.cpu.nr_switches.max
1214 ± 33% +2446.1% 30913 ± 9% sched_debug.cpu.nr_switches.min
71486 -92.9% 5105 ± 22% sched_debug.cpu.nr_switches.stddev
18.50 ± 2% +187.9% 53.26 ± 12% sched_debug.cpu.nr_uninterruptible.max
-17.50 +106.4% -36.11 sched_debug.cpu.nr_uninterruptible.min
6.94 ± 3% +60.4% 11.13 ± 11% sched_debug.cpu.nr_uninterruptible.stddev
43459 -11.6% 38431 ± 4% sched_debug.cpu.sched_count.avg
278105 ± 2% -81.3% 52060 ± 5% sched_debug.cpu.sched_count.max
572.68 ± 26% +5077.4% 29649 ± 9% sched_debug.cpu.sched_count.min
71381 -93.7% 4505 ± 23% sched_debug.cpu.sched_count.stddev
21296 -17.8% 17504 ± 4% sched_debug.cpu.sched_goidle.avg
136829 ± 2% -82.5% 23964 ± 5% sched_debug.cpu.sched_goidle.max
260.91 ± 26% +5043.1% 13418 ± 9% sched_debug.cpu.sched_goidle.min
35064 -94.0% 2119 ± 22% sched_debug.cpu.sched_goidle.stddev
16840 -15.8% 14177 ± 4% sched_debug.cpu.ttwu_count.avg
113761 -82.0% 20525 ± 4% sched_debug.cpu.ttwu_count.max
416.14 ± 5% +2327.2% 10100 ± 15% sched_debug.cpu.ttwu_count.min
28890 -93.2% 1960 ± 19% sched_debug.cpu.ttwu_count.stddev
4868 +28.7% 6267 ± 4% sched_debug.cpu.ttwu_local.avg
31216 ± 2% -72.5% 8585 ± 4% sched_debug.cpu.ttwu_local.max
140.82 ± 11% +3150.1% 4576 ± 9% sched_debug.cpu.ttwu_local.min
7642 ± 2% -88.8% 854.11 ± 18% sched_debug.cpu.ttwu_local.stddev
345098 -7.7% 318590 ± 3% sched_debug.cpu_clk
342236 -7.7% 315728 ± 3% sched_debug.ktime
345460 -7.6% 319068 ± 3% sched_debug.sched_clk
5.15 -0.9 4.23 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.16 -0.9 4.24 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
3.81 ± 8% -0.9 2.94 ± 4% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
6.17 ± 6% -0.8 5.40 ± 10% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
3.27 ± 11% -0.8 2.50 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
3.15 -0.6 2.56 ± 2% perf-profile.calltrace.cycles-pp.page_fault
2.05 ± 2% -0.6 1.48 ± 5% perf-profile.calltrace.cycles-pp.setlocale
3.02 ± 2% -0.6 2.45 ± 2% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
2.96 ± 3% -0.5 2.41 ± 2% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
2.45 -0.5 1.92 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.45 -0.5 1.92 ± 6% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.45 -0.5 1.92 ± 6% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.21 ± 3% -0.5 0.71 ± 4% perf-profile.calltrace.cycles-pp._dl_addr
0.76 -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mmap64
0.75 -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
3.97 -0.5 3.50 perf-profile.calltrace.cycles-pp.execve
3.95 -0.5 3.48 perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
3.96 -0.5 3.49 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
3.96 -0.5 3.49 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
3.96 -0.5 3.49 perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
2.58 ± 4% -0.4 2.13 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
2.47 ± 4% -0.4 2.04 ± 3% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
2.68 ± 2% -0.4 2.26 ± 2% perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.67 ± 2% -0.4 2.25 ± 2% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
1.88 -0.4 1.46 ± 4% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
1.88 -0.4 1.48 ± 4% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
1.35 ± 5% -0.4 0.95 ± 4% perf-profile.calltrace.cycles-pp.__vsnprintf_chk
1.44 -0.3 1.15 ± 3% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.83 -0.3 0.57 ± 7% perf-profile.calltrace.cycles-pp.mmap64
0.82 ± 5% -0.3 0.57 ± 4% perf-profile.calltrace.cycles-pp.vfprintf.__vsnprintf_chk
1.21 ± 7% -0.2 0.98 ± 4% perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.96 ± 2% -0.2 0.74 ± 10% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit
0.64 -0.2 0.41 ± 58% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
1.00 ± 2% -0.2 0.78 ± 9% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit
0.87 -0.2 0.67 ± 5% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.84 -0.2 0.68 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.setlocale
0.84 -0.2 0.68 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
1.92 ± 2% -0.1 1.77 ± 3% perf-profile.calltrace.cycles-pp.__libc_fork
0.88 -0.0 0.84 ± 2% perf-profile.calltrace.cycles-pp.native_write_msr.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt
1.22 ± 8% +0.4 1.64 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.18 ± 9% +0.4 1.61 ± 6% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
0.64 +0.6 1.26 ± 6% perf-profile.calltrace.cycles-pp.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.64 ± 2% +0.7 1.30 ± 8% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.00 +0.7 0.72 ± 8% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +0.8 0.76 ± 14% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
4.58 ± 6% +0.9 5.51 ± 6% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.79 ± 3% +1.0 2.77 ± 3% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
1.73 ± 3% +1.0 2.71 ± 3% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.00 +1.1 1.08 ± 7% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
2.25 +1.4 3.66 perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
3.68 +1.5 5.15 ± 2% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.27 ± 13% +1.6 2.88 ± 3% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
2.44 ± 7% +1.6 4.08 perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
7.09 ± 2% +3.6 10.69 perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
12.62 ± 3% +5.1 17.76 perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
71.14 +6.1 77.24 perf-profile.calltrace.cycles-pp.secondary_startup_64
70.42 +6.2 76.61 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
70.42 +6.2 76.62 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
70.39 +6.2 76.59 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
61.77 +6.2 68.00 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
15.53 ± 2% +7.0 22.50 perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
62.30 +7.0 69.31 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
14.55 -2.3 12.22 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
14.52 -2.3 12.20 perf-profile.children.cycles-pp.do_syscall_64
5.72 -1.2 4.52 ± 2% perf-profile.children.cycles-pp.page_fault
5.28 -1.1 4.21 perf-profile.children.cycles-pp.do_page_fault
5.16 -1.0 4.14 perf-profile.children.cycles-pp.__do_page_fault
3.84 ± 8% -0.9 2.99 ± 3% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
4.61 ± 2% -0.8 3.76 ± 2% perf-profile.children.cycles-pp.handle_mm_fault
4.41 ± 2% -0.8 3.62 ± 2% perf-profile.children.cycles-pp.__handle_mm_fault
6.25 ± 6% -0.8 5.48 ± 10% perf-profile.children.cycles-pp.menu_select
3.31 ± 11% -0.8 2.54 ± 5% perf-profile.children.cycles-pp.tick_nohz_next_event
2.30 -0.7 1.64 ± 4% perf-profile.children.cycles-pp.setlocale
2.50 -0.5 1.97 ± 6% perf-profile.children.cycles-pp.do_exit
2.50 -0.5 1.98 ± 6% perf-profile.children.cycles-pp.__x64_sys_exit_group
2.50 -0.5 1.98 ± 6% perf-profile.children.cycles-pp.do_group_exit
1.21 ± 3% -0.5 0.71 ± 4% perf-profile.children.cycles-pp._dl_addr
3.97 -0.5 3.50 perf-profile.children.cycles-pp.execve
2.91 ± 3% -0.4 2.47 perf-profile.children.cycles-pp.load_elf_binary
4.38 -0.4 3.95 perf-profile.children.cycles-pp.__x64_sys_execve
4.38 -0.4 3.94 perf-profile.children.cycles-pp.__do_execve_file
3.08 ± 2% -0.4 2.65 ± 2% perf-profile.children.cycles-pp.exit_mmap
2.39 -0.4 1.96 perf-profile.children.cycles-pp.filemap_map_pages
2.95 ± 3% -0.4 2.53 perf-profile.children.cycles-pp.search_binary_handler
1.48 ± 2% -0.4 1.06 ± 5% perf-profile.children.cycles-pp.vm_mmap_pgoff
1.39 ± 5% -0.4 0.98 ± 4% perf-profile.children.cycles-pp.__vsnprintf_chk
3.09 ± 2% -0.4 2.68 ± 2% perf-profile.children.cycles-pp.mmput
1.35 -0.4 0.97 ± 5% perf-profile.children.cycles-pp.do_mmap
1.25 ± 3% -0.4 0.88 ± 7% perf-profile.children.cycles-pp.ksys_mmap_pgoff
1.06 ± 5% -0.4 0.71 ± 8% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.15 ± 2% -0.3 0.83 ± 4% perf-profile.children.cycles-pp.mmap_region
1.01 ± 2% -0.3 0.70 ± 7% perf-profile.children.cycles-pp.vfprintf
0.71 ± 3% -0.3 0.41 ± 12% perf-profile.children.cycles-pp.alloc_set_pte
1.46 -0.3 1.18 ± 4% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.84 -0.3 0.58 ± 7% perf-profile.children.cycles-pp.mmap64
1.56 ± 2% -0.2 1.32 ± 6% perf-profile.children.cycles-pp.unmap_page_range
1.24 -0.2 1.01 ± 3% perf-profile.children.cycles-pp.do_sys_open
0.45 ± 9% -0.2 0.23 ± 2% perf-profile.children.cycles-pp.unlock_page
1.64 ± 2% -0.2 1.42 ± 5% perf-profile.children.cycles-pp.unmap_vmas
0.42 ± 3% -0.2 0.21 ± 13% perf-profile.children.cycles-pp.page_add_file_rmap
0.97 ± 3% -0.2 0.77 ± 5% perf-profile.children.cycles-pp.__next_timer_interrupt
0.66 ± 4% -0.2 0.46 ± 10% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.52 -0.2 0.32 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.85 -0.2 0.67 ± 2% perf-profile.children.cycles-pp.tlb_finish_mmu
0.83 -0.2 0.65 ± 2% perf-profile.children.cycles-pp.tlb_flush_mmu
0.58 ± 5% -0.2 0.41 ± 2% perf-profile.children.cycles-pp.__strcoll_l
0.54 ± 6% -0.2 0.38 ± 6% perf-profile.children.cycles-pp.__do_munmap
0.80 -0.2 0.63 ± 3% perf-profile.children.cycles-pp.copy_strings
0.72 ± 4% -0.2 0.56 ± 6% perf-profile.children.cycles-pp.do_wp_page
0.48 ± 8% -0.2 0.33 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret
1.23 -0.2 1.08 ± 2% perf-profile.children.cycles-pp.do_filp_open
0.61 -0.2 0.46 ± 4% perf-profile.children.cycles-pp.release_pages
1.22 -0.1 1.07 ± 2% perf-profile.children.cycles-pp.path_openat
0.65 ± 6% -0.1 0.50 ± 4% perf-profile.children.cycles-pp.wp_page_copy
1.95 ± 2% -0.1 1.81 ± 3% perf-profile.children.cycles-pp.__libc_fork
0.52 ± 3% -0.1 0.38 ± 6% perf-profile.children.cycles-pp.link_path_walk
0.65 ± 3% -0.1 0.51 ± 7% perf-profile.children.cycles-pp.find_next_bit
0.44 -0.1 0.30 ± 11% perf-profile.children.cycles-pp.perf_event_mmap
0.91 ± 5% -0.1 0.77 ± 10% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.38 ± 2% -0.1 0.25 ± 10% perf-profile.children.cycles-pp._IO_default_xsputn
0.34 -0.1 0.21 ± 7% perf-profile.children.cycles-pp.ksys_write
0.37 -0.1 0.25 ± 9% perf-profile.children.cycles-pp.write
0.36 ± 4% -0.1 0.25 ± 4% perf-profile.children.cycles-pp.sync_regs
0.84 ± 4% -0.1 0.73 ± 10% perf-profile.children.cycles-pp.get_page_from_freelist
0.44 -0.1 0.33 ± 4% perf-profile.children.cycles-pp.elf_map
0.32 ± 21% -0.1 0.21 ± 8% perf-profile.children.cycles-pp.create_elf_tables
0.32 -0.1 0.21 ± 7% perf-profile.children.cycles-pp.vfs_write
0.33 ± 4% -0.1 0.22 ± 5% perf-profile.children.cycles-pp.unmap_region
0.28 ± 10% -0.1 0.17 ± 9% perf-profile.children.cycles-pp._fini
0.30 ± 3% -0.1 0.20 ± 10% perf-profile.children.cycles-pp.new_sync_write
0.44 ± 11% -0.1 0.34 ± 5% perf-profile.children.cycles-pp.vma_link
0.49 ± 5% -0.1 0.40 ± 10% perf-profile.children.cycles-pp.page_remove_rmap
0.23 -0.1 0.14 ± 21% perf-profile.children.cycles-pp._IO_fwrite
0.35 -0.1 0.26 ± 3% perf-profile.children.cycles-pp.__fxstat64
0.57 -0.1 0.48 ± 6% perf-profile.children.cycles-pp.vfs_read
0.29 -0.1 0.20 ± 9% perf-profile.children.cycles-pp.native_flush_tlb_one_user
0.31 -0.1 0.22 ± 9% perf-profile.children.cycles-pp.flush_tlb_func_common
0.32 ± 12% -0.1 0.23 ± 15% perf-profile.children.cycles-pp.filename_lookup
0.41 -0.1 0.33 ± 5% perf-profile.children.cycles-pp.new_sync_read
0.35 ± 4% -0.1 0.27 ± 13% perf-profile.children.cycles-pp.walk_component
0.28 -0.1 0.19 ± 9% perf-profile.children.cycles-pp.___might_sleep
0.17 ± 3% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.free_pages_and_swap_cache
0.31 ± 9% -0.1 0.23 ± 15% perf-profile.children.cycles-pp.path_lookupat
0.52 ± 4% -0.1 0.43 ± 4% perf-profile.children.cycles-pp.note_gp_changes
0.26 ± 5% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.security_inode_permission
0.35 ± 7% -0.1 0.28 ± 6% perf-profile.children.cycles-pp.__vm_munmap
0.26 ± 5% -0.1 0.18 ± 10% perf-profile.children.cycles-pp.__clear_user
0.27 ± 14% -0.1 0.20 ± 5% perf-profile.children.cycles-pp.malloc
0.12 -0.1 0.04 ± 59% perf-profile.children.cycles-pp.generic_file_write_iter
0.21 ± 2% -0.1 0.14 ± 14% perf-profile.children.cycles-pp.lru_add_drain
0.24 ± 8% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.selinux_inode_permission
0.20 ± 12% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.strlen
0.17 ± 19% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.31 ± 12% -0.1 0.24 ± 17% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.21 ± 2% -0.1 0.14 ± 10% perf-profile.children.cycles-pp.__perf_sw_event
0.14 -0.1 0.07 ± 14% perf-profile.children.cycles-pp._init
0.11 ± 4% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.__generic_file_write_iter
0.21 ± 2% -0.1 0.15 ± 14% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.47 ± 2% -0.1 0.40 ± 9% perf-profile.children.cycles-pp.ksys_read
0.32 ± 11% -0.1 0.25 ± 16% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.18 ± 5% -0.1 0.11 ± 15% perf-profile.children.cycles-pp._IO_padn
0.47 -0.1 0.41 ± 4% perf-profile.children.cycles-pp.do_mprotect_pkey
0.43 ± 11% -0.1 0.36 ± 8% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.24 ± 12% -0.1 0.17 ± 13% perf-profile.children.cycles-pp.perf_iterate_sb
0.24 -0.1 0.17 ± 13% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.21 ± 4% -0.1 0.15 ± 25% perf-profile.children.cycles-pp.schedule_tail
0.47 -0.1 0.41 ± 4% perf-profile.children.cycles-pp.__x64_sys_mprotect
0.30 ± 14% -0.1 0.24 ± 11% perf-profile.children.cycles-pp.kmem_cache_alloc
0.25 ± 4% -0.1 0.19 ± 10% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.33 ± 3% -0.1 0.27 ± 5% perf-profile.children.cycles-pp.__vma_adjust
0.28 -0.1 0.22 ± 5% perf-profile.children.cycles-pp.__xstat64
0.16 -0.1 0.10 ± 12% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.18 ± 5% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.___perf_sw_event
0.08 ± 5% -0.1 0.03 ±100% perf-profile.children.cycles-pp._setjmp
0.34 ± 2% -0.1 0.28 ± 6% perf-profile.children.cycles-pp.strnlen_user
0.13 ± 23% -0.1 0.07 ± 22% perf-profile.children.cycles-pp.__check_object_size
0.10 ± 5% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.free
0.20 ± 7% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.ptep_clear_flush
0.22 ± 9% -0.1 0.17 ± 10% perf-profile.children.cycles-pp.do_faccessat
0.17 ± 5% -0.1 0.11 ± 26% perf-profile.children.cycles-pp.__put_user_4
0.12 -0.1 0.07 ± 13% perf-profile.children.cycles-pp.vma_compute_subtree_gap
0.48 ± 3% -0.1 0.43 ± 8% perf-profile.children.cycles-pp.prep_new_page
0.47 -0.1 0.42 ± 5% perf-profile.children.cycles-pp.mprotect_fixup
0.35 ± 7% -0.1 0.30 ± 4% perf-profile.children.cycles-pp.__split_vma
0.23 ± 2% -0.1 0.18 ± 11% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.18 ± 8% -0.1 0.13 ± 15% perf-profile.children.cycles-pp.dput
0.22 ± 6% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.pipe_read
0.29 ± 3% -0.1 0.24 ± 11% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.12 -0.0 0.07 ± 14% perf-profile.children.cycles-pp.__vma_link_rb
0.21 ± 17% -0.0 0.16 ± 9% perf-profile.children.cycles-pp.setup_arg_pages
0.17 ± 3% -0.0 0.12 ± 16% perf-profile.children.cycles-pp._copy_from_user
0.10 ± 14% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.mem_cgroup_try_charge
0.20 ± 4% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.__x64_sys_munmap
0.15 ± 6% -0.0 0.10 ± 14% perf-profile.children.cycles-pp.up_write
0.14 ± 11% -0.0 0.09 ± 13% perf-profile.children.cycles-pp.lookup_slow
0.10 ± 5% -0.0 0.05 ± 60% perf-profile.children.cycles-pp.getenv
0.14 ± 11% -0.0 0.09 ± 14% perf-profile.children.cycles-pp.shift_arg_pages
0.14 ± 3% -0.0 0.09 ± 11% perf-profile.children.cycles-pp.mark_page_accessed
0.14 ± 11% -0.0 0.09 ± 23% perf-profile.children.cycles-pp.strncpy_from_user
0.07 -0.0 0.03 ±100% perf-profile.children.cycles-pp.move_page_tables
0.08 ± 5% -0.0 0.04 ± 60% perf-profile.children.cycles-pp.lock_page_memcg
0.20 ± 10% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.__do_sys_newstat
0.11 ± 4% -0.0 0.07 ± 20% perf-profile.children.cycles-pp.terminate_walk
0.26 ± 5% -0.0 0.21 ± 9% perf-profile.children.cycles-pp.task_work_run
0.17 ± 17% -0.0 0.13 ± 16% perf-profile.children.cycles-pp.get_unmapped_area
0.15 ± 3% -0.0 0.11 ± 8% perf-profile.children.cycles-pp.__rb_insert_augmented
0.12 ± 13% -0.0 0.08 ± 22% perf-profile.children.cycles-pp.__lookup_slow
0.11 ± 9% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.pipe_wait
0.22 ± 6% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.__get_user_pages
0.20 ± 4% -0.0 0.16 ± 7% perf-profile.children.cycles-pp.menu_reflect
0.17 ± 2% -0.0 0.14 ± 11% perf-profile.children.cycles-pp.__wake_up_common_lock
0.20 ± 10% -0.0 0.16 ± 7% perf-profile.children.cycles-pp.vfs_statx
0.17 ± 8% -0.0 0.14 ± 13% perf-profile.children.cycles-pp.getname_flags
0.29 ± 5% -0.0 0.25 ± 11% perf-profile.children.cycles-pp.pte_alloc_one
0.13 ± 15% -0.0 0.09 ± 20% perf-profile.children.cycles-pp.__send_signal
0.12 ± 13% -0.0 0.08 ± 23% perf-profile.children.cycles-pp.signal_wake_up_state
0.08 ± 6% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.trailing_symlink
0.08 ± 12% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.free_work
0.07 ± 20% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.prepend_path
0.33 ± 4% -0.0 0.29 ± 10% perf-profile.children.cycles-pp.find_vma
0.22 ± 6% -0.0 0.19 ± 6% perf-profile.children.cycles-pp.get_user_pages_remote
0.12 -0.0 0.09 ± 21% perf-profile.children.cycles-pp.pagecache_get_page
0.08 ± 5% -0.0 0.05 ± 61% perf-profile.children.cycles-pp.unmapped_area_topdown
0.08 ± 5% -0.0 0.05 ± 61% perf-profile.children.cycles-pp._IO_file_close
0.17 ± 8% -0.0 0.14 ± 11% perf-profile.children.cycles-pp.pipe_write
0.08 ± 6% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.__vunmap
0.14 ± 7% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.stack_trace_save_tsk
0.11 ± 4% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.avc_has_perm_noaudit
0.21 ± 2% -0.0 0.17 ± 11% perf-profile.children.cycles-pp.__fput
0.16 ± 6% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.__account_scheduler_latency
0.11 ± 4% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__libc_sigaction
0.14 ± 3% -0.0 0.11 ± 17% perf-profile.children.cycles-pp.open64
0.12 ± 12% -0.0 0.10 ± 11% perf-profile.children.cycles-pp.arch_stack_walk
0.10 ± 14% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.perf_event_mmap_output
0.17 ± 8% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.generic_file_read_iter
0.14 ± 14% -0.0 0.11 ± 14% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay
0.15 ± 3% -0.0 0.13 ± 14% perf-profile.children.cycles-pp.do_notify_parent
0.09 -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__sysconf
0.12 ± 13% -0.0 0.09 ± 20% perf-profile.children.cycles-pp.__strcasecmp
0.12 ± 8% -0.0 0.10 ± 18% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.10 ± 26% -0.0 0.07 ± 24% perf-profile.children.cycles-pp._IO_file_xsputn
0.17 ± 5% -0.0 0.15 ± 3% perf-profile.children.cycles-pp.remove_vma
0.12 ± 13% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.memmem
0.08 ± 12% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.xas_load
0.10 ± 5% -0.0 0.07 ± 20% perf-profile.children.cycles-pp.d_alloc_parallel
0.10 ± 5% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.fput_many
0.09 ± 11% -0.0 0.07 ± 16% perf-profile.children.cycles-pp.__x64_sys_close
0.08 ± 12% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.brk
0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.unwind_next_frame
0.11 ± 4% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.__get_user_8
0.08 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.free_pgd_range
0.07 +0.0 0.09 ± 9% perf-profile.children.cycles-pp.memcpy_toio
0.07 +0.0 0.09 ± 9% perf-profile.children.cycles-pp.fb_flashcursor
0.07 +0.0 0.09 ± 9% perf-profile.children.cycles-pp.ast_dirty_update
0.07 +0.0 0.09 ± 13% perf-profile.children.cycles-pp.bit_cursor
0.07 +0.0 0.09 ± 13% perf-profile.children.cycles-pp.soft_cursor
0.06 ± 9% +0.0 0.08 ± 13% perf-profile.children.cycles-pp.tick_sched_do_timer
0.06 +0.0 0.10 ± 15% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.x86_pmu_disable
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.move_queued_task
0.00 +0.1 0.06 ± 22% perf-profile.children.cycles-pp.put_cred_rcu
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.cpu_stopper_thread
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.migration_cpu_stop
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.timekeeping_advance
0.00 +0.1 0.07 ± 29% perf-profile.children.cycles-pp.stop_one_cpu
0.14 ± 14% +0.1 0.22 ± 12% perf-profile.children.cycles-pp.__list_del_entry_valid
0.17 ± 15% +0.1 0.25 ± 8% perf-profile.children.cycles-pp.update_rq_clock
0.23 ± 10% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.wake_up_new_task
0.07 ± 23% +0.1 0.16 ± 30% perf-profile.children.cycles-pp.account_process_tick
0.03 ±100% +0.1 0.12 ± 27% perf-profile.children.cycles-pp.free_ldt_pgtables
0.03 ±100% +0.1 0.14 ± 26% perf-profile.children.cycles-pp.smp_call_function_single
0.19 ± 5% +0.1 0.32 ± 11% perf-profile.children.cycles-pp.schedule
0.09 ± 17% +0.1 0.22 ± 18% perf-profile.children.cycles-pp.newidle_balance
0.04 ±100% +0.1 0.19 ± 14% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.21 ± 4% +0.2 0.37 ± 3% perf-profile.children.cycles-pp.nr_iowait_cpu
0.17 ± 5% +0.2 0.33 ± 8% perf-profile.children.cycles-pp.sched_exec
0.00 +0.2 0.16 ± 47% perf-profile.children.cycles-pp.call_function_single_interrupt
0.17 ± 5% +0.2 0.33 ± 8% perf-profile.children.cycles-pp.update_ts_time_stats
0.40 +0.2 0.57 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair
0.34 ± 7% +0.2 0.52 ± 8% perf-profile.children.cycles-pp.run_rebalance_domains
0.32 ± 4% +0.2 0.49 ± 10% perf-profile.children.cycles-pp.update_blocked_averages
0.48 ± 4% +0.2 0.66 ± 4% perf-profile.children.cycles-pp.ret_from_fork
0.43 ± 5% +0.2 0.65 ± 4% perf-profile.children.cycles-pp.__schedule
0.17 ± 17% +0.2 0.39 ± 9% perf-profile.children.cycles-pp.run_local_timers
0.00 +0.2 0.23 ± 14% perf-profile.children.cycles-pp.smpboot_thread_fn
0.23 ± 4% +0.3 0.48 ± 6% perf-profile.children.cycles-pp.kthread
0.21 ± 11% +0.3 0.48 ± 21% perf-profile.children.cycles-pp.calc_global_load_tick
0.81 +0.3 1.09 ± 3% perf-profile.children.cycles-pp._raw_spin_lock
0.16 ± 12% +0.4 0.55 ± 10% perf-profile.children.cycles-pp.idle_cpu
1.25 ± 8% +0.4 1.66 ± 6% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.00 +0.5 0.46 ± 7% perf-profile.children.cycles-pp.find_idlest_group
0.29 ± 6% +0.5 0.77 ± 14% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.49 +0.6 1.11 ± 8% perf-profile.children.cycles-pp.tick_irq_enter
0.66 +0.6 1.28 ± 5% perf-profile.children.cycles-pp.irq_enter
0.70 ± 3% +0.7 1.38 ± 7% perf-profile.children.cycles-pp.scheduler_tick
4.74 ± 6% +0.9 5.62 ± 6% perf-profile.children.cycles-pp.irq_exit
1.94 +0.9 2.85 ± 3% perf-profile.children.cycles-pp.tick_sched_handle
1.88 +0.9 2.81 ± 3% perf-profile.children.cycles-pp.update_process_times
2.42 +1.3 3.76 perf-profile.children.cycles-pp.tick_sched_timer
3.90 +1.4 5.31 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
2.50 ± 7% +1.7 4.17 perf-profile.children.cycles-pp.clockevents_program_event
3.17 ± 9% +2.9 6.05 ± 2% perf-profile.children.cycles-pp.ktime_get
7.38 +3.6 10.96 perf-profile.children.cycles-pp.hrtimer_interrupt
13.05 ± 3% +5.1 18.12 perf-profile.children.cycles-pp.smp_apic_timer_interrupt
14.58 ± 2% +6.0 20.59 perf-profile.children.cycles-pp.apic_timer_interrupt
71.14 +6.1 77.24 perf-profile.children.cycles-pp.secondary_startup_64
71.14 +6.1 77.24 perf-profile.children.cycles-pp.cpu_startup_entry
71.20 +6.1 77.31 perf-profile.children.cycles-pp.do_idle
70.42 +6.2 76.62 perf-profile.children.cycles-pp.start_secondary
62.93 +6.9 69.85 perf-profile.children.cycles-pp.cpuidle_enter_state
62.94 +6.9 69.88 perf-profile.children.cycles-pp.cpuidle_enter
1.20 ± 3% -0.5 0.70 ± 4% perf-profile.self.cycles-pp._dl_addr
0.86 -0.3 0.53 ± 6% perf-profile.self.cycles-pp.do_syscall_64
0.84 ± 5% -0.3 0.57 ± 8% perf-profile.self.cycles-pp.vfprintf
0.72 ± 6% -0.3 0.45 ± 9% perf-profile.self.cycles-pp.tick_nohz_next_event
0.32 ± 4% -0.3 0.06 ± 11% perf-profile.self.cycles-pp.select_task_rq_fair
0.66 ± 5% -0.2 0.45 ± 10% perf-profile.self.cycles-pp.prepare_exit_to_usermode
0.41 -0.2 0.22 perf-profile.self.cycles-pp.unlock_page
0.48 -0.2 0.31 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.34 ± 2% -0.2 0.16 ± 13% perf-profile.self.cycles-pp.page_add_file_rmap
0.57 ± 6% -0.2 0.40 ± 3% perf-profile.self.cycles-pp.__strcoll_l
0.41 ± 6% -0.2 0.25 ± 5% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.48 ± 8% -0.2 0.33 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.55 ± 2% -0.1 0.42 ± 5% perf-profile.self.cycles-pp.find_next_bit
0.36 ± 4% -0.1 0.24 ± 4% perf-profile.self.cycles-pp.sync_regs
0.34 ± 2% -0.1 0.22 ± 10% perf-profile.self.cycles-pp._IO_default_xsputn
0.36 ± 4% -0.1 0.26 ± 5% perf-profile.self.cycles-pp.release_pages
0.22 -0.1 0.13 ± 23% perf-profile.self.cycles-pp._IO_fwrite
0.29 -0.1 0.20 ± 9% perf-profile.self.cycles-pp.native_flush_tlb_one_user
0.43 ± 5% -0.1 0.35 ± 13% perf-profile.self.cycles-pp.page_remove_rmap
0.47 ± 7% -0.1 0.39 ± 9% perf-profile.self.cycles-pp.__next_timer_interrupt
0.19 ± 5% -0.1 0.11 ± 13% perf-profile.self.cycles-pp.get_page_from_freelist
0.16 ± 6% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.20 ± 15% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.rebalance_domains
0.26 ± 3% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.___might_sleep
0.28 ± 12% -0.1 0.21 ± 8% perf-profile.self.cycles-pp.__handle_mm_fault
0.17 -0.1 0.10 ± 10% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.12 -0.1 0.05 ± 9% perf-profile.self.cycles-pp._init
0.17 ± 5% -0.1 0.11 ± 14% perf-profile.self.cycles-pp._IO_padn
0.33 -0.1 0.27 ± 7% perf-profile.self.cycles-pp.strnlen_user
0.72 -0.1 0.67 ± 5% perf-profile.self.cycles-pp.unmap_page_range
0.14 ± 3% -0.1 0.08 ± 10% perf-profile.self.cycles-pp.__do_page_fault
0.18 -0.1 0.13 ± 6% perf-profile.self.cycles-pp.alloc_set_pte
0.11 ± 4% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.vma_compute_subtree_gap
0.08 -0.1 0.03 ±100% perf-profile.self.cycles-pp.perf_event_mmap
0.13 -0.0 0.08 ± 23% perf-profile.self.cycles-pp.strlen
0.15 ± 6% -0.0 0.10 ± 17% perf-profile.self.cycles-pp.___perf_sw_event
0.14 ± 3% -0.0 0.09 ± 9% perf-profile.self.cycles-pp.mark_page_accessed
0.15 ± 6% -0.0 0.10 ± 14% perf-profile.self.cycles-pp.up_write
0.28 -0.0 0.24 ± 5% perf-profile.self.cycles-pp.note_gp_changes
0.08 ± 5% -0.0 0.04 ± 60% perf-profile.self.cycles-pp.lock_page_memcg
0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__fput
0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.link_path_walk
0.14 ± 14% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.selinux_inode_permission
0.13 ± 7% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.__rb_insert_augmented
0.06 -0.0 0.03 ±100% perf-profile.self.cycles-pp.strncpy_from_user
0.08 ± 5% -0.0 0.05 ± 61% perf-profile.self.cycles-pp.unmapped_area_topdown
0.09 ± 33% -0.0 0.06 ± 15% perf-profile.self.cycles-pp._IO_file_xsputn
0.17 ± 5% -0.0 0.14 ± 11% perf-profile.self.cycles-pp.menu_reflect
0.11 ± 4% -0.0 0.07 ± 11% perf-profile.self.cycles-pp.avc_has_perm_noaudit
0.11 ± 4% -0.0 0.07 ± 15% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.11 ± 4% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.07 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.__hrtimer_get_next_event
0.12 ± 8% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.__vsnprintf_chk
0.11 ± 4% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.handle_mm_fault
0.07 +0.0 0.09 ± 10% perf-profile.self.cycles-pp.memcpy_toio
0.07 ± 7% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.__alloc_file
0.13 ± 15% +0.0 0.17 ± 2% perf-profile.self.cycles-pp.trigger_load_balance
0.07 ± 7% +0.0 0.11 ± 22% perf-profile.self.cycles-pp.scheduler_tick
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.x86_pmu_disable
0.00 +0.1 0.06 ± 26% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.08 ± 25% +0.1 0.15 ± 8% perf-profile.self.cycles-pp.update_rq_clock
0.14 ± 14% +0.1 0.22 ± 12% perf-profile.self.cycles-pp.__list_del_entry_valid
0.07 ± 23% +0.1 0.15 ± 28% perf-profile.self.cycles-pp.account_process_tick
0.03 ±100% +0.1 0.13 ± 32% perf-profile.self.cycles-pp.smp_call_function_single
0.04 ±100% +0.1 0.18 ± 11% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.21 ± 4% +0.1 0.36 ± 2% perf-profile.self.cycles-pp.nr_iowait_cpu
0.15 ± 17% +0.2 0.37 ± 8% perf-profile.self.cycles-pp.run_local_timers
0.21 ± 9% +0.3 0.47 ± 21% perf-profile.self.cycles-pp.calc_global_load_tick
0.79 +0.3 1.07 ± 4% perf-profile.self.cycles-pp._raw_spin_lock
0.00 +0.3 0.31 ± 10% perf-profile.self.cycles-pp.find_idlest_group
0.16 ± 12% +0.4 0.54 ± 9% perf-profile.self.cycles-pp.idle_cpu
0.17 ± 21% +0.5 0.62 ± 17% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
1.86 ± 6% +1.1 2.92 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state
2.30 ± 11% +2.9 5.19 ± 2% perf-profile.self.cycles-pp.ktime_get
686413 ± 6% +129.3% 1574243 interrupts.CAL:Function_call_interrupts
6202 ± 8% +159.9% 16122 interrupts.CPU0.CAL:Function_call_interrupts
117.00 ± 4% +8312.0% 9842 ± 3% interrupts.CPU0.TLB:TLB_shootdowns
6457 ± 4% +143.7% 15740 ± 2% interrupts.CPU1.CAL:Function_call_interrupts
4782 ± 28% -77.1% 1094 ± 61% interrupts.CPU1.RES:Rescheduling_interrupts
8.50 ± 88% +1.1e+05% 9527 ± 4% interrupts.CPU1.TLB:TLB_shootdowns
6137 ± 9% +155.8% 15701 ± 4% interrupts.CPU10.CAL:Function_call_interrupts
133.00 ± 7% +165.4% 353.00 ± 3% interrupts.CPU10.NMI:Non-maskable_interrupts
133.00 ± 7% +165.4% 353.00 ± 3% interrupts.CPU10.PMI:Performance_monitoring_interrupts
15.50 ±100% +60700.0% 9424 ± 7% interrupts.CPU10.TLB:TLB_shootdowns
6676 ± 5% +123.5% 14918 interrupts.CPU100.CAL:Function_call_interrupts
170.50 +102.6% 345.50 ± 8% interrupts.CPU100.NMI:Non-maskable_interrupts
170.50 +102.6% 345.50 ± 8% interrupts.CPU100.PMI:Performance_monitoring_interrupts
7.50 ± 60% +1.1e+05% 8612 interrupts.CPU100.TLB:TLB_shootdowns
6680 ± 5% +122.0% 14832 ± 2% interrupts.CPU101.CAL:Function_call_interrupts
177.50 ± 4% +97.3% 350.25 ± 5% interrupts.CPU101.NMI:Non-maskable_interrupts
177.50 ± 4% +97.3% 350.25 ± 5% interrupts.CPU101.PMI:Performance_monitoring_interrupts
155.00 ± 59% +105.8% 319.00 ± 6% interrupts.CPU101.RES:Rescheduling_interrupts
12.50 ± 84% +68118.0% 8527 ± 4% interrupts.CPU101.TLB:TLB_shootdowns
6672 ± 5% +120.7% 14726 ± 2% interrupts.CPU102.CAL:Function_call_interrupts
179.00 ± 2% +88.0% 336.50 ± 8% interrupts.CPU102.NMI:Non-maskable_interrupts
179.00 ± 2% +88.0% 336.50 ± 8% interrupts.CPU102.PMI:Performance_monitoring_interrupts
667.50 -54.1% 306.25 ± 3% interrupts.CPU102.RES:Rescheduling_interrupts
9.00 ± 55% +93491.7% 8423 ± 5% interrupts.CPU102.TLB:TLB_shootdowns
6674 ± 5% +128.4% 15245 ± 2% interrupts.CPU103.CAL:Function_call_interrupts
171.00 ± 6% +83.5% 313.75 ± 9% interrupts.CPU103.NMI:Non-maskable_interrupts
171.00 ± 6% +83.5% 313.75 ± 9% interrupts.CPU103.PMI:Performance_monitoring_interrupts
11.00 ± 18% +81736.4% 9002 ± 6% interrupts.CPU103.TLB:TLB_shootdowns
6434 ± 4% +145.1% 15771 ± 4% interrupts.CPU11.CAL:Function_call_interrupts
136.50 ± 12% +162.3% 358.00 ± 12% interrupts.CPU11.NMI:Non-maskable_interrupts
136.50 ± 12% +162.3% 358.00 ± 12% interrupts.CPU11.PMI:Performance_monitoring_interrupts
7.00 ± 42% +5371.4% 383.00 ± 6% interrupts.CPU11.RES:Rescheduling_interrupts
3.50 ± 71% +2.7e+05% 9547 ± 8% interrupts.CPU11.TLB:TLB_shootdowns
6431 ± 4% +147.5% 15916 ± 4% interrupts.CPU12.CAL:Function_call_interrupts
133.00 ± 12% +160.5% 346.50 ± 9% interrupts.CPU12.NMI:Non-maskable_interrupts
133.00 ± 12% +160.5% 346.50 ± 9% interrupts.CPU12.PMI:Performance_monitoring_interrupts
122.00 ± 97% +241.2% 416.25 ± 21% interrupts.CPU12.RES:Rescheduling_interrupts
3.00 ± 66% +3.2e+05% 9642 ± 7% interrupts.CPU12.TLB:TLB_shootdowns
6486 ± 5% +149.7% 16199 ± 4% interrupts.CPU13.CAL:Function_call_interrupts
138.00 ± 15% +160.1% 359.00 ± 11% interrupts.CPU13.NMI:Non-maskable_interrupts
138.00 ± 15% +160.1% 359.00 ± 11% interrupts.CPU13.PMI:Performance_monitoring_interrupts
3.50 ± 42% +2.8e+05% 9928 ± 9% interrupts.CPU13.TLB:TLB_shootdowns
6738 ± 8% +142.9% 16368 ± 4% interrupts.CPU14.CAL:Function_call_interrupts
142.00 ± 21% +143.0% 345.00 ± 3% interrupts.CPU14.NMI:Non-maskable_interrupts
142.00 ± 21% +143.0% 345.00 ± 3% interrupts.CPU14.PMI:Performance_monitoring_interrupts
113.00 ± 96% +279.6% 429.00 ± 17% interrupts.CPU14.RES:Rescheduling_interrupts
3.50 ± 42% +2.9e+05% 10101 ± 8% interrupts.CPU14.TLB:TLB_shootdowns
6735 ± 8% +136.7% 15941 ± 4% interrupts.CPU15.CAL:Function_call_interrupts
137.50 ± 13% +168.4% 369.00 ± 13% interrupts.CPU15.NMI:Non-maskable_interrupts
137.50 ± 13% +168.4% 369.00 ± 13% interrupts.CPU15.PMI:Performance_monitoring_interrupts
5.50 ± 27% +1.8e+05% 9699 ± 8% interrupts.CPU15.TLB:TLB_shootdowns
6734 ± 8% +131.6% 15600 ± 4% interrupts.CPU16.CAL:Function_call_interrupts
137.50 ± 17% +161.8% 360.00 ± 14% interrupts.CPU16.NMI:Non-maskable_interrupts
137.50 ± 17% +161.8% 360.00 ± 14% interrupts.CPU16.PMI:Performance_monitoring_interrupts
9.00 ±100% +1e+05% 9373 ± 9% interrupts.CPU16.TLB:TLB_shootdowns
6728 ± 8% +132.4% 15634 ± 4% interrupts.CPU17.CAL:Function_call_interrupts
152.50 ± 8% +155.2% 389.25 ± 15% interrupts.CPU17.NMI:Non-maskable_interrupts
152.50 ± 8% +155.2% 389.25 ± 15% interrupts.CPU17.PMI:Performance_monitoring_interrupts
111.50 ± 13% +318.2% 466.25 ± 46% interrupts.CPU17.RES:Rescheduling_interrupts
7.50 ±100% +1.2e+05% 9374 ± 8% interrupts.CPU17.TLB:TLB_shootdowns
6972 ± 4% +122.1% 15486 ± 3% interrupts.CPU18.CAL:Function_call_interrupts
133.00 ± 18% +178.8% 370.75 ± 12% interrupts.CPU18.NMI:Non-maskable_interrupts
133.00 ± 18% +178.8% 370.75 ± 12% interrupts.CPU18.PMI:Performance_monitoring_interrupts
2338 ± 77% -83.5% 384.75 ± 7% interrupts.CPU18.RES:Rescheduling_interrupts
255.50 ±100% +3512.8% 9230 ± 7% interrupts.CPU18.TLB:TLB_shootdowns
6832 ± 6% +126.3% 15464 ± 4% interrupts.CPU19.CAL:Function_call_interrupts
135.00 ± 18% +186.7% 387.00 ± 9% interrupts.CPU19.NMI:Non-maskable_interrupts
135.00 ± 18% +186.7% 387.00 ± 9% interrupts.CPU19.PMI:Performance_monitoring_interrupts
117.50 ±100% +7739.6% 9211 ± 7% interrupts.CPU19.TLB:TLB_shootdowns
6153 ± 9% +161.4% 16086 ± 2% interrupts.CPU2.CAL:Function_call_interrupts
2278 ± 45% -47.1% 1204 ± 55% interrupts.CPU2.RES:Rescheduling_interrupts
12.50 ±100% +78314.0% 9801 ± 5% interrupts.CPU2.TLB:TLB_shootdowns
6780 ± 7% +124.3% 15206 ± 3% interrupts.CPU20.CAL:Function_call_interrupts
134.00 ± 14% +173.5% 366.50 ± 9% interrupts.CPU20.NMI:Non-maskable_interrupts
134.00 ± 14% +173.5% 366.50 ± 9% interrupts.CPU20.PMI:Performance_monitoring_interrupts
908.50 ± 58% -61.7% 348.25 ± 14% interrupts.CPU20.RES:Rescheduling_interrupts
68.50 ±100% +12983.6% 8962 ± 6% interrupts.CPU20.TLB:TLB_shootdowns
6761 ± 7% +124.5% 15178 ± 3% interrupts.CPU21.CAL:Function_call_interrupts
1097 ± 57% -67.4% 357.75 ± 10% interrupts.CPU21.RES:Rescheduling_interrupts
52.50 ±100% +17154.8% 9058 ± 7% interrupts.CPU21.TLB:TLB_shootdowns
6737 ± 8% +123.6% 15066 interrupts.CPU22.CAL:Function_call_interrupts
33.50 ± 97% +27113.4% 9116 ± 5% interrupts.CPU22.TLB:TLB_shootdowns
6728 ± 8% +128.7% 15388 interrupts.CPU23.CAL:Function_call_interrupts
28.00 ±100% +32858.0% 9228 ± 5% interrupts.CPU23.TLB:TLB_shootdowns
6609 ± 10% +139.0% 15797 ± 2% interrupts.CPU24.CAL:Function_call_interrupts
24.00 ± 95% +39251.0% 9444 ± 5% interrupts.CPU24.TLB:TLB_shootdowns
6590 ± 10% +137.2% 15632 ± 3% interrupts.CPU25.CAL:Function_call_interrupts
10.00 ±100% +94125.0% 9422 ± 6% interrupts.CPU25.TLB:TLB_shootdowns
5606 ± 29% +160.5% 14603 interrupts.CPU26.CAL:Function_call_interrupts
167.00 +101.6% 336.75 ± 10% interrupts.CPU26.NMI:Non-maskable_interrupts
167.00 +101.6% 336.75 ± 10% interrupts.CPU26.PMI:Performance_monitoring_interrupts
69.00 ± 82% +11866.7% 8257 ± 2% interrupts.CPU26.TLB:TLB_shootdowns
6692 ± 8% +113.9% 14315 ± 4% interrupts.CPU27.CAL:Function_call_interrupts
168.50 ± 2% +83.2% 308.75 ± 8% interrupts.CPU27.NMI:Non-maskable_interrupts
168.50 ± 2% +83.2% 308.75 ± 8% interrupts.CPU27.PMI:Performance_monitoring_interrupts
4.00 +2.1e+05% 8264 ± 4% interrupts.CPU27.TLB:TLB_shootdowns
6587 ± 7% +115.9% 14223 ± 2% interrupts.CPU28.CAL:Function_call_interrupts
173.50 +103.3% 352.75 ± 10% interrupts.CPU28.NMI:Non-maskable_interrupts
173.50 +103.3% 352.75 ± 10% interrupts.CPU28.PMI:Performance_monitoring_interrupts
10.50 ± 61% +6719.0% 716.00 ±102% interrupts.CPU28.RES:Rescheduling_interrupts
5.00 ± 40% +1.6e+05% 8205 ± 3% interrupts.CPU28.TLB:TLB_shootdowns
6688 ± 8% +112.1% 14185 interrupts.CPU29.CAL:Function_call_interrupts
167.00 ± 6% +104.9% 342.25 ± 9% interrupts.CPU29.NMI:Non-maskable_interrupts
167.00 ± 6% +104.9% 342.25 ± 9% interrupts.CPU29.PMI:Performance_monitoring_interrupts
13.00 ± 7% +4625.0% 614.25 ± 94% interrupts.CPU29.RES:Rescheduling_interrupts
5.00 +1.6e+05% 8013 ± 3% interrupts.CPU29.TLB:TLB_shootdowns
6418 ± 4% +147.8% 15904 ± 3% interrupts.CPU3.CAL:Function_call_interrupts
18.00 ±100% +53351.4% 9621 ± 6% interrupts.CPU3.TLB:TLB_shootdowns
6677 ± 8% +123.6% 14932 ± 3% interrupts.CPU30.CAL:Function_call_interrupts
164.50 ± 2% +76.4% 290.25 ± 24% interrupts.CPU30.NMI:Non-maskable_interrupts
164.50 ± 2% +76.4% 290.25 ± 24% interrupts.CPU30.PMI:Performance_monitoring_interrupts
8.50 ±100% +1e+05% 8851 interrupts.CPU30.TLB:TLB_shootdowns
6660 ± 10% +130.7% 15365 ± 4% interrupts.CPU31.CAL:Function_call_interrupts
151.50 +99.7% 302.50 ± 23% interrupts.CPU31.NMI:Non-maskable_interrupts
151.50 +99.7% 302.50 ± 23% interrupts.CPU31.PMI:Performance_monitoring_interrupts
120.50 ± 46% +267.4% 442.75 ± 9% interrupts.CPU31.RES:Rescheduling_interrupts
56.50 ± 89% +16373.5% 9307 ± 7% interrupts.CPU31.TLB:TLB_shootdowns
3973 ± 53% +294.8% 15686 ± 4% interrupts.CPU32.CAL:Function_call_interrupts
175.00 ± 11% +104.1% 357.25 ± 7% interrupts.CPU32.NMI:Non-maskable_interrupts
175.00 ± 11% +104.1% 357.25 ± 7% interrupts.CPU32.PMI:Performance_monitoring_interrupts
194.50 ± 97% +4814.3% 9558 ± 3% interrupts.CPU32.TLB:TLB_shootdowns
6752 ± 9% +134.0% 15802 ± 4% interrupts.CPU33.CAL:Function_call_interrupts
1167 ± 37% -67.4% 380.75 ± 13% interrupts.CPU33.RES:Rescheduling_interrupts
80.50 ± 90% +11678.0% 9481 ± 5% interrupts.CPU33.TLB:TLB_shootdowns
6730 ± 10% +135.6% 15856 ± 3% interrupts.CPU34.CAL:Function_call_interrupts
95.50 ± 93% +9932.2% 9580 ± 5% interrupts.CPU34.TLB:TLB_shootdowns
6736 ± 9% +127.9% 15354 ± 3% interrupts.CPU35.CAL:Function_call_interrupts
66.00 ± 96% +13787.9% 9166 ± 2% interrupts.CPU35.TLB:TLB_shootdowns
6732 ± 9% +130.6% 15522 ± 2% interrupts.CPU36.CAL:Function_call_interrupts
1740 ± 68% -80.2% 345.25 ± 11% interrupts.CPU36.RES:Rescheduling_interrupts
64.00 ± 90% +14357.4% 9252 ± 3% interrupts.CPU36.TLB:TLB_shootdowns
6736 ± 9% +129.7% 15475 ± 4% interrupts.CPU37.CAL:Function_call_interrupts
1885 ± 59% -80.5% 367.50 ± 7% interrupts.CPU37.RES:Rescheduling_interrupts
70.50 ± 90% +13089.7% 9298 ± 4% interrupts.CPU37.TLB:TLB_shootdowns
6514 ± 6% +135.8% 15362 ± 3% interrupts.CPU38.CAL:Function_call_interrupts
2231 ± 80% -83.9% 359.50 ± 10% interrupts.CPU38.RES:Rescheduling_interrupts
52.00 ± 82% +17687.0% 9249 ± 4% interrupts.CPU38.TLB:TLB_shootdowns
6680 ± 8% +134.4% 15661 ± 2% interrupts.CPU39.CAL:Function_call_interrupts
19.50 ± 64% +47476.9% 9277 ± 4% interrupts.CPU39.TLB:TLB_shootdowns
5898 ± 14% +167.1% 15752 ± 4% interrupts.CPU4.CAL:Function_call_interrupts
193.50 ± 34% +92.4% 372.25 ± 6% interrupts.CPU4.NMI:Non-maskable_interrupts
193.50 ± 34% +92.4% 372.25 ± 6% interrupts.CPU4.PMI:Performance_monitoring_interrupts
76.50 ± 97% +12277.5% 9468 ± 9% interrupts.CPU4.TLB:TLB_shootdowns
6673 ± 8% +135.3% 15705 ± 2% interrupts.CPU40.CAL:Function_call_interrupts
1721 ± 74% -79.7% 348.75 ± 5% interrupts.CPU40.RES:Rescheduling_interrupts
20.50 ± 21% +45386.6% 9324 ± 3% interrupts.CPU40.TLB:TLB_shootdowns
6670 ± 8% +135.7% 15720 ± 3% interrupts.CPU41.CAL:Function_call_interrupts
1479 ± 66% -75.3% 364.75 ± 9% interrupts.CPU41.RES:Rescheduling_interrupts
12.00 ± 25% +77572.9% 9320 ± 5% interrupts.CPU41.TLB:TLB_shootdowns
6676 ± 8% +134.4% 15649 interrupts.CPU42.CAL:Function_call_interrupts
172.00 ± 11% +126.5% 389.50 ± 19% interrupts.CPU42.NMI:Non-maskable_interrupts
172.00 ± 11% +126.5% 389.50 ± 19% interrupts.CPU42.PMI:Performance_monitoring_interrupts
884.50 ± 50% -58.7% 365.25 ± 7% interrupts.CPU42.RES:Rescheduling_interrupts
23.00 ± 60% +40164.1% 9260 ± 2% interrupts.CPU42.TLB:TLB_shootdowns
6667 ± 8% +138.6% 15907 ± 2% interrupts.CPU43.CAL:Function_call_interrupts
180.00 +114.9% 386.75 ± 14% interrupts.CPU43.NMI:Non-maskable_interrupts
180.00 +114.9% 386.75 ± 14% interrupts.CPU43.PMI:Performance_monitoring_interrupts
1089 ± 24% -64.8% 383.00 ± 6% interrupts.CPU43.RES:Rescheduling_interrupts
16.00 ± 56% +59354.7% 9512 ± 4% interrupts.CPU43.TLB:TLB_shootdowns
6656 ± 8% +142.5% 16140 ± 2% interrupts.CPU44.CAL:Function_call_interrupts
184.50 +104.6% 377.50 ± 4% interrupts.CPU44.NMI:Non-maskable_interrupts
184.50 +104.6% 377.50 ± 4% interrupts.CPU44.PMI:Performance_monitoring_interrupts
477.00 ± 12% -16.9% 396.25 ± 7% interrupts.CPU44.RES:Rescheduling_interrupts
6.50 ± 53% +1.5e+05% 9748 ± 5% interrupts.CPU44.TLB:TLB_shootdowns
6656 ± 8% +136.4% 15736 ± 2% interrupts.CPU45.CAL:Function_call_interrupts
174.50 ± 10% +100.3% 349.50 ± 7% interrupts.CPU45.NMI:Non-maskable_interrupts
174.50 ± 10% +100.3% 349.50 ± 7% interrupts.CPU45.PMI:Performance_monitoring_interrupts
8.50 ± 17% +1.1e+05% 9345 ± 4% interrupts.CPU45.TLB:TLB_shootdowns
6313 ± 3% +144.2% 15413 ± 2% interrupts.CPU46.CAL:Function_call_interrupts
151.50 ± 5% +119.6% 332.75 ± 5% interrupts.CPU46.NMI:Non-maskable_interrupts
151.50 ± 5% +119.6% 332.75 ± 5% interrupts.CPU46.PMI:Performance_monitoring_interrupts
4.50 ± 11% +2e+05% 9026 ± 4% interrupts.CPU46.TLB:TLB_shootdowns
6654 ± 8% +129.6% 15279 ± 2% interrupts.CPU47.CAL:Function_call_interrupts
157.00 ± 3% +110.7% 330.75 ± 9% interrupts.CPU47.NMI:Non-maskable_interrupts
157.00 ± 3% +110.7% 330.75 ± 9% interrupts.CPU47.PMI:Performance_monitoring_interrupts
50.00 ±100% +598.5% 349.25 ± 4% interrupts.CPU47.RES:Rescheduling_interrupts
9.00 ± 33% +99416.7% 8956 ± 5% interrupts.CPU47.TLB:TLB_shootdowns
6647 ± 8% +128.9% 15212 ± 2% interrupts.CPU48.CAL:Function_call_interrupts
170.00 +101.8% 343.00 ± 12% interrupts.CPU48.NMI:Non-maskable_interrupts
170.00 +101.8% 343.00 ± 12% interrupts.CPU48.PMI:Performance_monitoring_interrupts
36.00 ± 72% +903.5% 361.25 ± 23% interrupts.CPU48.RES:Rescheduling_interrupts
4.50 ± 11% +2e+05% 8829 ± 4% interrupts.CPU48.TLB:TLB_shootdowns
6646 ± 8% +128.4% 15180 interrupts.CPU49.CAL:Function_call_interrupts
159.00 ± 3% +111.9% 337.00 ± 7% interrupts.CPU49.NMI:Non-maskable_interrupts
159.00 ± 3% +111.9% 337.00 ± 7% interrupts.CPU49.PMI:Performance_monitoring_interrupts
72.00 ± 37% +358.3% 330.00 ± 5% interrupts.CPU49.RES:Rescheduling_interrupts
8.00 ± 12% +1.1e+05% 8799 ± 3% interrupts.CPU49.TLB:TLB_shootdowns
6426 ± 4% +148.2% 15950 ± 5% interrupts.CPU5.CAL:Function_call_interrupts
141.50 ± 22% +154.4% 360.00 ± 8% interrupts.CPU5.NMI:Non-maskable_interrupts
141.50 ± 22% +154.4% 360.00 ± 8% interrupts.CPU5.PMI:Performance_monitoring_interrupts
637.50 ± 30% -38.7% 390.75 ± 18% interrupts.CPU5.RES:Rescheduling_interrupts
7.50 ± 86% +1.3e+05% 9664 ± 9% interrupts.CPU5.TLB:TLB_shootdowns
6645 ± 8% +125.4% 14978 ± 2% interrupts.CPU50.CAL:Function_call_interrupts
173.00 +88.4% 326.00 ± 8% interrupts.CPU50.NMI:Non-maskable_interrupts
173.00 +88.4% 326.00 ± 8% interrupts.CPU50.PMI:Performance_monitoring_interrupts
7.00 ± 28% +1.2e+05% 8601 ± 6% interrupts.CPU50.TLB:TLB_shootdowns
6555 ± 8% +130.3% 15098 ± 6% interrupts.CPU51.CAL:Function_call_interrupts
170.00 ± 4% +95.9% 333.00 ± 16% interrupts.CPU51.NMI:Non-maskable_interrupts
170.00 ± 4% +95.9% 333.00 ± 16% interrupts.CPU51.PMI:Performance_monitoring_interrupts
126.50 ± 6% +227.1% 413.75 ± 8% interrupts.CPU51.RES:Rescheduling_interrupts
7.50 ± 33% +1.2e+05% 8863 ± 11% interrupts.CPU51.TLB:TLB_shootdowns
6644 ± 8% +106.6% 13726 ± 3% interrupts.CPU52.CAL:Function_call_interrupts
13.00 ± 92% +56463.5% 7353 ± 5% interrupts.CPU52.TLB:TLB_shootdowns
6637 ± 8% +114.0% 14207 ± 7% interrupts.CPU53.CAL:Function_call_interrupts
8.50 ± 88% +95967.6% 8165 ± 5% interrupts.CPU53.TLB:TLB_shootdowns
6573 ± 9% +116.4% 14226 ± 7% interrupts.CPU54.CAL:Function_call_interrupts
12.00 ± 91% +66520.8% 7994 ± 8% interrupts.CPU54.TLB:TLB_shootdowns
6623 ± 8% +117.9% 14432 ± 7% interrupts.CPU55.CAL:Function_call_interrupts
5.50 ± 63% +2.1e+05% 11582 ± 44% interrupts.CPU55.TLB:TLB_shootdowns
6625 ± 8% +118.8% 14495 ± 6% interrupts.CPU56.CAL:Function_call_interrupts
186.00 ± 37% +93.0% 359.00 ± 6% interrupts.CPU56.NMI:Non-maskable_interrupts
186.00 ± 37% +93.0% 359.00 ± 6% interrupts.CPU56.PMI:Performance_monitoring_interrupts
10.50 ± 90% +78366.7% 8239 ± 8% interrupts.CPU56.TLB:TLB_shootdowns
6621 ± 8% +119.2% 14517 ± 4% interrupts.CPU57.CAL:Function_call_interrupts
149.00 ± 16% +139.8% 357.25 ± 7% interrupts.CPU57.NMI:Non-maskable_interrupts
149.00 ± 16% +139.8% 357.25 ± 7% interrupts.CPU57.PMI:Performance_monitoring_interrupts
5.50 ± 9% +1.5e+05% 8158 ± 6% interrupts.CPU57.TLB:TLB_shootdowns
6613 ± 8% +120.4% 14579 ± 5% interrupts.CPU58.CAL:Function_call_interrupts
145.00 ± 15% +144.8% 355.00 ± 10% interrupts.CPU58.NMI:Non-maskable_interrupts
145.00 ± 15% +144.8% 355.00 ± 10% interrupts.CPU58.PMI:Performance_monitoring_interrupts
2.50 ± 20% +3.3e+05% 8185 ± 8% interrupts.CPU58.TLB:TLB_shootdowns
6511 ± 10% +124.9% 14644 ± 5% interrupts.CPU59.CAL:Function_call_interrupts
125.00 ± 7% +181.4% 351.75 ± 5% interrupts.CPU59.NMI:Non-maskable_interrupts
125.00 ± 7% +181.4% 351.75 ± 5% interrupts.CPU59.PMI:Performance_monitoring_interrupts
3.50 ± 71% +2.4e+05% 8283 ± 8% interrupts.CPU59.TLB:TLB_shootdowns
6446 ± 4% +143.8% 15717 ± 5% interrupts.CPU6.CAL:Function_call_interrupts
146.00 ± 10% +136.8% 345.75 ± 9% interrupts.CPU6.NMI:Non-maskable_interrupts
146.00 ± 10% +136.8% 345.75 ± 9% interrupts.CPU6.PMI:Performance_monitoring_interrupts
3.00 ±100% +3.1e+05% 9434 ± 9% interrupts.CPU6.TLB:TLB_shootdowns
6613 ± 8% +124.9% 14871 ± 4% interrupts.CPU60.CAL:Function_call_interrupts
153.50 +124.1% 344.00 ± 12% interrupts.CPU60.NMI:Non-maskable_interrupts
153.50 +124.1% 344.00 ± 12% interrupts.CPU60.PMI:Performance_monitoring_interrupts
4.00 ± 25% +2.1e+05% 8515 ± 6% interrupts.CPU60.TLB:TLB_shootdowns
6609 ± 8% +123.1% 14746 ± 6% interrupts.CPU61.CAL:Function_call_interrupts
133.00 ± 17% +155.1% 339.25 ± 8% interrupts.CPU61.NMI:Non-maskable_interrupts
133.00 ± 17% +155.1% 339.25 ± 8% interrupts.CPU61.PMI:Performance_monitoring_interrupts
150.50 ± 62% +105.0% 308.50 ± 6% interrupts.CPU61.RES:Rescheduling_interrupts
3.50 ± 71% +2.4e+05% 8394 ± 10% interrupts.CPU61.TLB:TLB_shootdowns
6607 ± 8% +121.0% 14605 ± 4% interrupts.CPU62.CAL:Function_call_interrupts
140.50 ± 13% +151.1% 352.75 ± 3% interrupts.CPU62.NMI:Non-maskable_interrupts
140.50 ± 13% +151.1% 352.75 ± 3% interrupts.CPU62.PMI:Performance_monitoring_interrupts
100.50 ± 83% +215.2% 316.75 ± 9% interrupts.CPU62.RES:Rescheduling_interrupts
4.00 ± 75% +2.1e+05% 8368 ± 7% interrupts.CPU62.TLB:TLB_shootdowns
6077 +139.3% 14544 ± 5% interrupts.CPU63.CAL:Function_call_interrupts
126.00 ± 10% +191.1% 366.75 ± 11% interrupts.CPU63.NMI:Non-maskable_interrupts
126.00 ± 10% +191.1% 366.75 ± 11% interrupts.CPU63.PMI:Performance_monitoring_interrupts
54.50 ± 81% +476.1% 314.00 ± 5% interrupts.CPU63.RES:Rescheduling_interrupts
7.00 ± 42% +1.2e+05% 8421 ± 7% interrupts.CPU63.TLB:TLB_shootdowns
6595 ± 8% +125.5% 14872 ± 5% interrupts.CPU64.CAL:Function_call_interrupts
120.50 ± 11% +185.3% 343.75 ± 10% interrupts.CPU64.NMI:Non-maskable_interrupts
120.50 ± 11% +185.3% 343.75 ± 10% interrupts.CPU64.PMI:Performance_monitoring_interrupts
3.00 +2.8e+05% 8532 ± 9% interrupts.CPU64.TLB:TLB_shootdowns
6593 ± 8% +123.5% 14735 ± 4% interrupts.CPU65.CAL:Function_call_interrupts
128.50 ± 20% +176.3% 355.00 ± 8% interrupts.CPU65.NMI:Non-maskable_interrupts
128.50 ± 20% +176.3% 355.00 ± 8% interrupts.CPU65.PMI:Performance_monitoring_interrupts
2.50 ± 20% +3.5e+05% 8705 ± 8% interrupts.CPU65.TLB:TLB_shootdowns
6591 ± 8% +126.5% 14929 ± 4% interrupts.CPU66.CAL:Function_call_interrupts
137.50 ± 7% +153.5% 348.50 ± 3% interrupts.CPU66.NMI:Non-maskable_interrupts
137.50 ± 7% +153.5% 348.50 ± 3% interrupts.CPU66.PMI:Performance_monitoring_interrupts
2.50 ± 20% +3.5e+05% 8810 ± 7% interrupts.CPU66.TLB:TLB_shootdowns
6592 ± 8% +123.5% 14730 ± 5% interrupts.CPU67.CAL:Function_call_interrupts
143.00 ± 18% +160.0% 371.75 ± 11% interrupts.CPU67.NMI:Non-maskable_interrupts
143.00 ± 18% +160.0% 371.75 ± 11% interrupts.CPU67.PMI:Performance_monitoring_interrupts
5.00 ± 60% +1.7e+05% 8506 ± 8% interrupts.CPU67.TLB:TLB_shootdowns
6592 ± 8% +124.7% 14815 ± 3% interrupts.CPU68.CAL:Function_call_interrupts
130.00 ± 13% +180.0% 364.00 ± 7% interrupts.CPU68.NMI:Non-maskable_interrupts
130.00 ± 13% +180.0% 364.00 ± 7% interrupts.CPU68.PMI:Performance_monitoring_interrupts
7.50 ± 73% +1.1e+05% 8531 ± 5% interrupts.CPU68.TLB:TLB_shootdowns
6590 ± 8% +122.4% 14654 ± 2% interrupts.CPU69.CAL:Function_call_interrupts
143.50 ± 10% +178.7% 400.00 ± 11% interrupts.CPU69.NMI:Non-maskable_interrupts
143.50 ± 10% +178.7% 400.00 ± 11% interrupts.CPU69.PMI:Performance_monitoring_interrupts
4.50 ± 55% +1.9e+05% 8451 ± 4% interrupts.CPU69.TLB:TLB_shootdowns
6308 ± 6% +144.6% 15428 ± 4% interrupts.CPU7.CAL:Function_call_interrupts
132.00 +172.9% 360.25 ± 4% interrupts.CPU7.NMI:Non-maskable_interrupts
132.00 +172.9% 360.25 ± 4% interrupts.CPU7.PMI:Performance_monitoring_interrupts
6.50 ± 69% +1.4e+05% 9204 ± 8% interrupts.CPU7.TLB:TLB_shootdowns
6766 ± 5% +117.5% 14716 interrupts.CPU70.CAL:Function_call_interrupts
138.50 ± 11% +162.6% 363.75 ± 12% interrupts.CPU70.NMI:Non-maskable_interrupts
138.50 ± 11% +162.6% 363.75 ± 12% interrupts.CPU70.PMI:Performance_monitoring_interrupts
182.50 ± 98% +4545.2% 8477 ± 3% interrupts.CPU70.TLB:TLB_shootdowns
6750 ± 5% +116.7% 14630 interrupts.CPU71.CAL:Function_call_interrupts
150.00 ± 16% +157.5% 386.25 ± 9% interrupts.CPU71.NMI:Non-maskable_interrupts
150.00 ± 16% +157.5% 386.25 ± 9% interrupts.CPU71.PMI:Performance_monitoring_interrupts
2169 ± 16% -85.1% 322.50 ± 3% interrupts.CPU71.RES:Rescheduling_interrupts
171.00 ± 99% +4792.3% 8365 ± 2% interrupts.CPU71.TLB:TLB_shootdowns
6706 ± 6% +115.1% 14424 ± 4% interrupts.CPU72.CAL:Function_call_interrupts
127.00 ± 9% +195.3% 375.00 ± 10% interrupts.CPU72.NMI:Non-maskable_interrupts
127.00 ± 9% +195.3% 375.00 ± 10% interrupts.CPU72.PMI:Performance_monitoring_interrupts
801.00 ± 55% -58.1% 335.75 ± 7% interrupts.CPU72.RES:Rescheduling_interrupts
132.00 ± 99% +6302.8% 8451 ± 2% interrupts.CPU72.TLB:TLB_shootdowns
6866 ± 3% +116.8% 14883 ± 2% interrupts.CPU73.CAL:Function_call_interrupts
926.50 ± 50% -62.5% 347.25 ± 4% interrupts.CPU73.RES:Rescheduling_interrupts
106.00 ± 95% +7963.2% 8547 ± 2% interrupts.CPU73.TLB:TLB_shootdowns
6784 ± 4% +113.4% 14478 ± 4% interrupts.CPU74.CAL:Function_call_interrupts
1373 ± 56% -76.0% 329.00 ± 12% interrupts.CPU74.RES:Rescheduling_interrupts
30.00 ± 93% +27808.3% 8372 ± 5% interrupts.CPU74.TLB:TLB_shootdowns
6781 ± 4% +116.1% 14653 ± 3% interrupts.CPU75.CAL:Function_call_interrupts
33.50 ± 97% +24810.4% 8345 ± 5% interrupts.CPU75.TLB:TLB_shootdowns
6767 ± 4% +116.4% 14646 ± 5% interrupts.CPU76.CAL:Function_call_interrupts
24.50 ± 91% +33854.1% 8318 ± 7% interrupts.CPU76.TLB:TLB_shootdowns
6751 ± 4% +116.2% 14596 ± 4% interrupts.CPU77.CAL:Function_call_interrupts
16.00 ±100% +51582.8% 8269 ± 7% interrupts.CPU77.TLB:TLB_shootdowns
6738 ± 5% +122.4% 14986 ± 3% interrupts.CPU78.CAL:Function_call_interrupts
169.50 ± 3% +98.7% 336.75 ± 13% interrupts.CPU78.NMI:Non-maskable_interrupts
169.50 ± 3% +98.7% 336.75 ± 13% interrupts.CPU78.PMI:Performance_monitoring_interrupts
178.00 ± 50% +99.9% 355.75 ± 11% interrupts.CPU78.RES:Rescheduling_interrupts
5.00 +1.7e+05% 8662 ± 7% interrupts.CPU78.TLB:TLB_shootdowns
6742 ± 5% +124.1% 15107 ± 4% interrupts.CPU79.CAL:Function_call_interrupts
153.00 ± 6% +110.1% 321.50 ± 7% interrupts.CPU79.NMI:Non-maskable_interrupts
153.00 ± 6% +110.1% 321.50 ± 7% interrupts.CPU79.PMI:Performance_monitoring_interrupts
154.50 ± 87% +114.2% 331.00 ± 6% interrupts.CPU79.RES:Rescheduling_interrupts
12.50 ± 52% +69930.0% 8753 ± 9% interrupts.CPU79.TLB:TLB_shootdowns
6351 ± 5% +146.8% 15673 ± 4% interrupts.CPU8.CAL:Function_call_interrupts
145.50 ± 4% +132.3% 338.00 ± 13% interrupts.CPU8.NMI:Non-maskable_interrupts
145.50 ± 4% +132.3% 338.00 ± 13% interrupts.CPU8.PMI:Performance_monitoring_interrupts
854.00 ± 25% -38.4% 526.00 ± 56% interrupts.CPU8.RES:Rescheduling_interrupts
6735 ± 5% +119.5% 14786 ± 3% interrupts.CPU80.CAL:Function_call_interrupts
164.00 +107.3% 340.00 ± 7% interrupts.CPU80.NMI:Non-maskable_interrupts
164.00 +107.3% 340.00 ± 7% interrupts.CPU80.PMI:Performance_monitoring_interrupts
61.50 ± 83% +454.1% 340.75 ± 7% interrupts.CPU80.RES:Rescheduling_interrupts
8.50 ± 29% +1e+05% 8885 ± 5% interrupts.CPU80.TLB:TLB_shootdowns
6730 ± 5% +125.5% 15173 ± 3% interrupts.CPU81.CAL:Function_call_interrupts
180.00 ± 7% +91.0% 343.75 ± 5% interrupts.CPU81.NMI:Non-maskable_interrupts
180.00 ± 7% +91.0% 343.75 ± 5% interrupts.CPU81.PMI:Performance_monitoring_interrupts
7.00 ± 57% +1.3e+05% 8868 ± 5% interrupts.CPU81.TLB:TLB_shootdowns
6732 ± 5% +120.7% 14855 interrupts.CPU82.CAL:Function_call_interrupts
149.50 +133.6% 349.25 ± 7% interrupts.CPU82.NMI:Non-maskable_interrupts
149.50 +133.6% 349.25 ± 7% interrupts.CPU82.PMI:Performance_monitoring_interrupts
140.50 ± 94% +138.4% 335.00 ± 2% interrupts.CPU82.RES:Rescheduling_interrupts
9.00 ± 22% +96591.7% 8702 ± 3% interrupts.CPU82.TLB:TLB_shootdowns
6742 ± 5% +122.2% 14985 interrupts.CPU83.CAL:Function_call_interrupts
157.50 ± 2% +123.3% 351.75 ± 3% interrupts.CPU83.NMI:Non-maskable_interrupts
157.50 ± 2% +123.3% 351.75 ± 3% interrupts.CPU83.PMI:Performance_monitoring_interrupts
137.00 ± 24% +328.6% 587.25 ± 73% interrupts.CPU83.RES:Rescheduling_interrupts
24.50 ± 63% +35336.7% 8682 ± 2% interrupts.CPU83.TLB:TLB_shootdowns
6773 ± 5% +124.6% 15211 ± 3% interrupts.CPU84.CAL:Function_call_interrupts
183.00 ± 4% +104.9% 375.00 ± 15% interrupts.CPU84.NMI:Non-maskable_interrupts
183.00 ± 4% +104.9% 375.00 ± 15% interrupts.CPU84.PMI:Performance_monitoring_interrupts
56.50 ± 92% +15808.8% 8988 ± 7% interrupts.CPU84.TLB:TLB_shootdowns
6789 ± 6% +118.5% 14833 ± 5% interrupts.CPU85.CAL:Function_call_interrupts
78.50 ± 94% +11096.8% 8789 ± 4% interrupts.CPU85.TLB:TLB_shootdowns
6967 ± 8% +116.2% 15065 ± 4% interrupts.CPU86.CAL:Function_call_interrupts
256.00 ± 98% +3368.3% 8878 ± 6% interrupts.CPU86.TLB:TLB_shootdowns
6801 ± 6% +119.0% 14894 ± 3% interrupts.CPU87.CAL:Function_call_interrupts
1592 ± 73% -79.8% 321.50 ± 7% interrupts.CPU87.RES:Rescheduling_interrupts
94.00 ± 92% +9118.4% 8665 ± 4% interrupts.CPU87.TLB:TLB_shootdowns
6688 ± 4% +119.5% 14679 ± 4% interrupts.CPU88.CAL:Function_call_interrupts
54.50 ± 85% +15662.4% 8590 ± 4% interrupts.CPU88.TLB:TLB_shootdowns
6752 ± 5% +119.0% 14784 ± 3% interrupts.CPU89.CAL:Function_call_interrupts
46.00 ± 97% +18483.7% 8548 ± 3% interrupts.CPU89.TLB:TLB_shootdowns
6421 ± 4% +146.4% 15824 ± 5% interrupts.CPU9.CAL:Function_call_interrupts
138.50 ± 19% +154.2% 352.00 ± 10% interrupts.CPU9.NMI:Non-maskable_interrupts
138.50 ± 19% +154.2% 352.00 ± 10% interrupts.CPU9.PMI:Performance_monitoring_interrupts
1345 ± 58% -71.5% 383.00 ± 10% interrupts.CPU9.RES:Rescheduling_interrupts
4.00 ±100% +2.4e+05% 9545 ± 9% interrupts.CPU9.TLB:TLB_shootdowns
6754 ± 5% +120.1% 14869 ± 2% interrupts.CPU90.CAL:Function_call_interrupts
2441 ± 80% -86.1% 339.25 ± 4% interrupts.CPU90.RES:Rescheduling_interrupts
50.00 ± 82% +17182.5% 8641 ± 3% interrupts.CPU90.TLB:TLB_shootdowns
6716 ± 5% +121.3% 14860 ± 2% interrupts.CPU91.CAL:Function_call_interrupts
2223 ± 79% -85.6% 320.75 ± 10% interrupts.CPU91.RES:Rescheduling_interrupts
12.50 ± 52% +68238.0% 8542 ± 4% interrupts.CPU91.TLB:TLB_shootdowns
6715 ± 5% +121.7% 14885 ± 4% interrupts.CPU92.CAL:Function_call_interrupts
1838 ± 76% -76.9% 424.25 ± 49% interrupts.CPU92.RES:Rescheduling_interrupts
19.50 ± 69% +44153.8% 8629 ± 6% interrupts.CPU92.TLB:TLB_shootdowns
6761 ± 4% +122.6% 15051 ± 3% interrupts.CPU93.CAL:Function_call_interrupts
17.00 ± 70% +51295.6% 8737 ± 5% interrupts.CPU93.TLB:TLB_shootdowns
6911 ± 7% +114.6% 14834 ± 3% interrupts.CPU94.CAL:Function_call_interrupts
178.00 ± 3% +123.7% 398.25 ± 17% interrupts.CPU94.NMI:Non-maskable_interrupts
178.00 ± 3% +123.7% 398.25 ± 17% interrupts.CPU94.PMI:Performance_monitoring_interrupts
937.50 ± 54% -63.1% 345.50 ± 17% interrupts.CPU94.RES:Rescheduling_interrupts
223.00 ± 95% +3721.4% 8521 ± 4% interrupts.CPU94.TLB:TLB_shootdowns
6696 ± 5% +119.9% 14724 ± 4% interrupts.CPU95.CAL:Function_call_interrupts
182.50 ± 3% +99.7% 364.50 ± 14% interrupts.CPU95.NMI:Non-maskable_interrupts
182.50 ± 3% +99.7% 364.50 ± 14% interrupts.CPU95.PMI:Performance_monitoring_interrupts
864.00 ± 59% -61.9% 329.00 ± 3% interrupts.CPU95.RES:Rescheduling_interrupts
15.50 ± 80% +54167.7% 8411 ± 5% interrupts.CPU95.TLB:TLB_shootdowns
6686 ± 5% +121.8% 14831 ± 3% interrupts.CPU96.CAL:Function_call_interrupts
186.00 +105.9% 383.00 ± 4% interrupts.CPU96.NMI:Non-maskable_interrupts
186.00 +105.9% 383.00 ± 4% interrupts.CPU96.PMI:Performance_monitoring_interrupts
437.00 ± 5% -28.6% 312.00 ± 9% interrupts.CPU96.RES:Rescheduling_interrupts
11.00 ± 45% +77365.9% 8521 ± 4% interrupts.CPU96.TLB:TLB_shootdowns
6685 ± 5% +122.6% 14879 ± 2% interrupts.CPU97.CAL:Function_call_interrupts
173.50 +117.0% 376.50 ± 6% interrupts.CPU97.NMI:Non-maskable_interrupts
173.50 +117.0% 376.50 ± 6% interrupts.CPU97.PMI:Performance_monitoring_interrupts
10.00 ± 60% +85600.0% 8570 ± 3% interrupts.CPU97.TLB:TLB_shootdowns
6678 ± 5% +123.7% 14941 ± 2% interrupts.CPU98.CAL:Function_call_interrupts
153.50 ± 2% +132.6% 357.00 ± 4% interrupts.CPU98.NMI:Non-maskable_interrupts
153.50 ± 2% +132.6% 357.00 ± 4% interrupts.CPU98.PMI:Performance_monitoring_interrupts
6.00 ± 50% +1.4e+05% 8634 ± 4% interrupts.CPU98.TLB:TLB_shootdowns
6683 ± 5% +124.4% 14995 ± 2% interrupts.CPU99.CAL:Function_call_interrupts
167.50 ± 3% +104.6% 342.75 ± 8% interrupts.CPU99.NMI:Non-maskable_interrupts
167.50 ± 3% +104.6% 342.75 ± 8% interrupts.CPU99.PMI:Performance_monitoring_interrupts
12.00 ± 33% +72308.3% 8689 ± 5% interrupts.CPU99.TLB:TLB_shootdowns
96213 -57.4% 40965 interrupts.RES:Rescheduling_interrupts
13211 ± 72% +6920.2% 927443 interrupts.TLB:TLB_shootdowns
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[xfs] 8c56189541: Assertion_failed
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 8c56189541951dc6b092b16b40bbf6bdbb4563c6 ("xfs: simplify xlog_state_do_callback")
git://git.infradead.org/users/hch/xfs xfs-log-cleanups
in testcase: xfstests
with following parameters:
disk: 4HDD
fs: xfs
test: generic-group17
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------+------------+------------+
| | d0065476bc | 8c56189541 |
+------------------------------------------+------------+------------+
| boot_successes | 0 | 1 |
| boot_failures | 0 | 21 |
| Assertion_failed | 0 | 21 |
| kernel_BUG_at_fs/xfs/xfs_message.c | 0 | 21 |
| invalid_opcode:#[##] | 0 | 21 |
| RIP:assfail[xfs] | 0 | 21 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 21 |
+------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 60.775271] Mounted xfs file system at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 61.065891] XFS (vdd): Unmounting Filesystem
[ 61.087518] XFS (vdd): Mounting V5 Filesystem
[ 61.098322] XFS (vdd): Ending clean mount
[ 61.105604] Mounted xfs file system at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 110.756329] XFS: Assertion failed: iclog->ic_state == XLOG_STATE_IOERROR, file: fs/xfs/xfs_log.c, line: 2927
[ 110.759804] ------------[ cut here ]------------
[ 110.761186] kernel BUG at fs/xfs/xfs_message.c:102!
[ 110.762819] invalid opcode: 0000 [#1] SMP PTI
[ 110.764111] CPU: 1 PID: 150 Comm: kworker/1:1H Not tainted 5.4.0-rc2-00020-g8c56189541951 #1
[ 110.766022] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 110.769170] Workqueue: xfs-log/vdd xlog_ioend_work [xfs]
[ 110.771372] RIP: 0010:assfail+0x28/0x30 [xfs]
[ 110.773333] Code: c3 90 66 66 66 66 90 48 89 f1 41 89 d0 48 c7 c6 f0 f9 56 c0 48 89 fa 31 ff e8 64 f9 ff ff 80 3d e9 c4 0d 00 00 75 03 0f 0b c3 <0f> 0b 66 0f 1f 44 00 00 66 66 66 66 90 48 63 f6 6a 01 49 89 f9 56
[ 110.780041] RSP: 0018:ffffada80015fe40 EFLAGS: 00010202
[ 110.782224] RAX: 0000000000000000 RBX: ffff9b0ebfda1400 RCX: 0000000000000000
[ 110.785653] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc056249a
[ 110.788860] RBP: ffff9b0ebfda28e8 R08: 0000000000000000 R09: 0000000000000000
[ 110.791732] R10: 0000000000000010 R11: f000000000000000 R12: 0000000000000000
[ 110.793553] R13: ffff9b0ebfda2800 R14: ffff9b0ebf809d80 R15: ffff9b0ebfda14f8
[ 110.795322] FS: 0000000000000000(0000) GS:ffff9b0f7fd00000(0000) knlGS:0000000000000000
[ 110.797359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 110.800361] CR2: 00007f63aaeac5d8 CR3: 000000001d00a000 CR4: 00000000000406e0
[ 110.803083] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 110.805884] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 110.808625] Call Trace:
[ 110.810499] xlog_state_done_syncing+0xab/0xb0 [xfs]
[ 110.812836] xlog_ioend_work+0x70/0xe0 [xfs]
[ 110.814955] process_one_work+0x1ae/0x3d0
[ 110.817085] worker_thread+0x3c/0x3b0
[ 110.819081] ? process_one_work+0x3d0/0x3d0
[ 110.821212] kthread+0x11e/0x140
[ 110.823118] ? kthread_park+0x90/0x90
[ 110.825005] ret_from_fork+0x35/0x40
[ 110.826920] Modules linked in: dm_flakey xfs libcrc32c dm_mod intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sr_mod cdrom sg ata_generic pata_acpi bochs_drm drm_vram_helper ttm drm_kms_helper ppdev syscopyarea sysfillrect snd_pcm sysimgblt fb_sys_fops snd_timer drm snd aesni_intel crypto_simd cryptd glue_helper soundcore ata_piix pcspkr joydev parport_pc serio_raw libata i2c_piix4 floppy parport ip_tables
[ 110.838725] ---[ end trace b823e8ae730ee77e ]---
[ 110.840284] RIP: 0010:assfail+0x28/0x30 [xfs]
[ 110.841741] Code: c3 90 66 66 66 66 90 48 89 f1 41 89 d0 48 c7 c6 f0 f9 56 c0 48 89 fa 31 ff e8 64 f9 ff ff 80 3d e9 c4 0d 00 00 75 03 0f 0b c3 <0f> 0b 66 0f 1f 44 00 00 66 66 66 66 90 48 63 f6 6a 01 49 89 f9 56
[ 110.848264] RSP: 0018:ffffada80015fe40 EFLAGS: 00010202
[ 110.850256] RAX: 0000000000000000 RBX: ffff9b0ebfda1400 RCX: 0000000000000000
[ 110.852828] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc056249a
[ 110.855397] RBP: ffff9b0ebfda28e8 R08: 0000000000000000 R09: 0000000000000000
[ 110.858948] R10: 0000000000000010 R11: f000000000000000 R12: 0000000000000000
[ 110.862680] R13: ffff9b0ebfda2800 R14: ffff9b0ebf809d80 R15: ffff9b0ebfda14f8
[ 110.865912] FS: 0000000000000000(0000) GS:ffff9b0f7fd00000(0000) knlGS:0000000000000000
[ 110.869922] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 110.873389] CR2: 00007f63aaeac5d8 CR3: 000000001d00a000 CR4: 00000000000406e0
[ 110.876645] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 110.878449] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 110.880221] Kernel panic - not syncing: Fatal exception
[ 110.882948] Kernel Offset: 0x2c600000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
Elapsed time: 120
qemu-img create -f qcow2 disk-vm-snb-4G-3ee6a1e7afe7-0 256G
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc2-00020-g8c56189541951 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[bpf] 5cb2f57d87: ltp.bpf_prog01.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 5cb2f57d87d6b6295bf73d72279ad02988007bc9 ("bpf: process in-kernel BTF")
https://git.kernel.org/cgit/linux/kernel/git/ast/bpf.git btf_vmlinux
in testcase: ltp
with following parameters:
disk: 1HDD
fs: btrfs
test: syscalls_part1
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2019-10-08 09:44:51 ln -sf /usr/bin/genisoimage /usr/bin/mkisofs
2019-10-08 09:44:51 ./runltp -f syscalls_part1 -d /fs/vda/tmpdir
INFO: creating /lkp/benchmarks/ltp/output directory
INFO: creating /lkp/benchmarks/ltp/results directory
Checking for required user/group ids
'nobody' user id and group found.
'bin' user id and group found.
'daemon' user id and group found.
Users group found.
Sys group found.
Required users/groups exist.
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
/etc/os-release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
uname:
Linux vm-snb-4G-a597cf1f9fd6 5.3.0-13208-g5cb2f57d87d6b #1 SMP Tue Oct 8 07:12:13 CST 2019 x86_64 GNU/Linux
/proc/cmdline
ip=::::vm-snb-4G-a597cf1f9fd6::dhcp root=/dev/ram0 user=lkp job=/lkp/jobs/scheduled/vm-snb-4G-a597cf1f9fd6/ltp-1HDD-btrfs-syscalls_part1-debian-x86_64-2019-05-14.cgz-5cb2f57d-20191008-19007-1ptmai9-3.yaml ARCH=x86_64 kconfig=x86_64-rhel-7.6 branch=linux-devel/devel-hourly-2019100713 commit=5cb2f57d87d6b6295bf73d72279ad02988007bc9 BOOT_IMAGE=/pkg/linux/x86_64-rhel-7.6/gcc-7/5cb2f57d87d6b6295bf73d72279ad02988007bc9/vmlinuz-5.3.0-13208-g5cb2f57d87d6b max_uptime=3600 RESULT_ROOT=/result/ltp/1HDD-btrfs-syscalls_part1/vm-snb-4G/debian-x86_64-2019-05-14.cgz/x86_64-rhel-7.6/gcc-7/5cb2f57d87d6b6295bf73d72279ad02988007bc9/3 LKP_SERVER=inn debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 net.ifnames=0 printk.devkmsg=on panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 drbd.minor_count=8 systemd.log_level=err ignore_loglevel console=tty0 earlyprintk=ttyS0,115200 console=ttyS0,115200 vga=normal rw rcuperf.shutdown=0
Gnu C gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516
Clang
Gnu make 4.1
util-linux 2.29.2
mount linux 2.29.2 (libmount 2.29.2: selinux, btrfs, assert, debug)
modutils 23
e2fsprogs 1.43.4
Linux C Library > libc.2.24
Dynamic linker (ldd) 2.24
Procps 3.3.12
Net-tools 2.10-alpha
iproute2 iproute2-ss161212
iputils iputils-s20161105
Kbd 116:
Sh-utils 8.26
Modules Loaded btrfs xor zstd_decompress zstd_compress raid6_pq libcrc32c dm_mod intel_rapl_msr intel_rapl_common sr_mod cdrom crct10dif_pclmul sg ata_generic pata_acpi crc32_pclmul crc32c_intel ghash_clmulni_intel bochs_drm drm_vram_helper ttm ppdev drm_kms_helper syscopyarea sysfillrect snd_pcm sysimgblt fb_sys_fops snd_timer aesni_intel drm snd crypto_simd cryptd soundcore glue_helper pcspkr joydev serio_raw ata_piix libata i2c_piix4 parport_pc floppy parport ip_tables
free reports:
total used free shared buff/cache available
Mem: 4026748 271584 1598452 11624 2156712 1506880
Swap: 0 0 0
cpuinfo:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 42
Model name: Intel Xeon E312xx (Sandy Bridge)
Stepping: 1
CPU MHz: 2493.990
BogoMIPS: 4987.98
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 4096K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx rdtscp lm constant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx hypervisor lahf_lm cpuid_fault pti xsaveopt arat
AppArmor disabled
SELinux mode: unknown
no big block device was specified on commandline.
Tests which require a big block device are disabled.
You can specify it with option -z
COMMAND: /lkp/benchmarks/ltp/bin/ltp-pan -e -S -a 2239 -n 2239 -p -f /fs/vda/tmpdir/ltp-bEI9wpCoun/alltests -l /lkp/benchmarks/ltp/results/LTP_RUN_ON-2019_10_08-09h_44m_52s.log -C /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-09h_44m_52s.failed -T /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-09h_44m_52s.tconf
LOG File: /lkp/benchmarks/ltp/results/LTP_RUN_ON-2019_10_08-09h_44m_52s.log
FAILED COMMAND File: /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-09h_44m_52s.failed
TCONF COMMAND File: /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-09h_44m_52s.tconf
Running tests.......
<<<test_start>>>
tag=bpf_prog01 stime=1570499103
cmdline="bpf_prog01"
contacts=""
analysis=exit
<<<test_output>>>
tst_buffers.c:55: INFO: Test is using guarded buffers
tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
bpf_common.h:18: INFO: Raising RLIMIT_MEMLOCK to 327680
bpf_prog01.c:85: FAIL: Failed verification: in-kernel BTF is malformed
: EINVAL (22)
Summary:
passed 0
failed 0
skipped 0
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=1 corefile=no
cutime=0 cstime=0
<<<test_end>>>
To reproduce:
# build kernel
cd linux
cp config-5.3.0-13208-g5cb2f57d87d6b .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[mm/swap] 67d8662d2d: ltp.madvise01.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 67d8662d2db619257554cef5b464014895102b95 ("mm/swap: Access struct pagevec remotely")
https://git.kernel.org/cgit/linux/kernel/git/bigeasy/staging.git mm_swap
in testcase: ltp
with following parameters:
disk: 1HDD
fs: ext4
test: syscalls_part4
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2019-10-08 00:55:34 ln -sf /usr/bin/genisoimage /usr/bin/mkisofs
2019-10-08 00:55:34 ./runltp -f syscalls_part4 -d /fs/vda/tmpdir
INFO: creating /lkp/benchmarks/ltp/output directory
INFO: creating /lkp/benchmarks/ltp/results directory
Checking for required user/group ids
'nobody' user id and group found.
'bin' user id and group found.
'daemon' user id and group found.
Users group found.
Sys group found.
Required users/groups exist.
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.
/etc/os-release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
uname:
Linux vm-snb-4G-65d32b273b58 5.4.0-rc1-00003-g67d8662d2db61 #1 SMP Mon Oct 7 07:58:06 CST 2019 x86_64 GNU/Linux
/proc/cmdline
ip=::::vm-snb-4G-65d32b273b58::dhcp root=/dev/ram0 user=lkp job=/lkp/jobs/scheduled/vm-snb-4G-65d32b273b58/ltp-1HDD-ext4-syscalls_part4-debian-x86_64-2019-05-14.cgz-67d8662d2-20191008-19987-1llxwye-8.yaml ARCH=x86_64 kconfig=x86_64-rhel-7.6 branch=linux-devel/devel-hourly-2019100708 commit=67d8662d2db619257554cef5b464014895102b95 BOOT_IMAGE=/pkg/linux/x86_64-rhel-7.6/gcc-7/67d8662d2db619257554cef5b464014895102b95/vmlinuz-5.4.0-rc1-00003-g67d8662d2db61 max_uptime=3600 RESULT_ROOT=/result/ltp/1HDD-ext4-syscalls_part4/vm-snb-4G/debian-x86_64-2019-05-14.cgz/x86_64-rhel-7.6/gcc-7/67d8662d2db619257554cef5b464014895102b95/8 LKP_SERVER=inn debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 net.ifnames=0 printk.devkmsg=on panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 drbd.minor_count=8 systemd.log_level=err ignore_loglevel console=tty0 earlyprintk=ttyS0,115200 console=ttyS0,115200 vga=normal rw rcuperf.shutdown=0
Gnu C gcc (Debian 6.3.0-18+deb9u1) 6.3.0 20170516
Clang
Gnu make 4.1
util-linux 2.29.2
mount linux 2.29.2 (libmount 2.29.2: selinux, btrfs, assert, debug)
modutils 23
e2fsprogs 1.43.4
Linux C Library > libc.2.24
Dynamic linker (ldd) 2.24
Procps 3.3.12
Net-tools 2.10-alpha
iproute2 iproute2-ss161212
iputils iputils-s20161105
Kbd 116:
Sh-utils 8.26
Modules Loaded ext4 mbcache jbd2 dm_mod intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul crc32c_intel sr_mod ghash_clmulni_intel cdrom sg bochs_drm drm_vram_helper ttm ppdev drm_kms_helper ata_generic pata_acpi aesni_intel syscopyarea snd_pcm sysfillrect sysimgblt crypto_simd snd_timer snd cryptd glue_helper fb_sys_fops soundcore pcspkr drm joydev serio_raw ata_piix libata i2c_piix4 floppy parport_pc parport ip_tables
free reports:
total used free shared buff/cache available
Mem: 4026760 284636 1585268 11608 2156856 1493916
Swap: 0 0 0
cpuinfo:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 2
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 42
Model name: Intel Xeon E312xx (Sandy Bridge)
Stepping: 1
CPU MHz: 2893.028
BogoMIPS: 5786.05
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 4096K
L3 cache: 16384K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx rdtscp lm constant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx hypervisor lahf_lm cpuid_fault pti xsaveopt arat
AppArmor disabled
SELinux mode: unknown
no big block device was specified on commandline.
Tests which require a big block device are disabled.
You can specify it with option -z
COMMAND: /lkp/benchmarks/ltp/bin/ltp-pan -e -S -a 2231 -n 2231 -p -f /fs/vda/tmpdir/ltp-5VaMUvbWBn/alltests -l /lkp/benchmarks/ltp/results/LTP_RUN_ON-2019_10_08-00h_55m_34s.log -C /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-00h_55m_34s.failed -T /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-00h_55m_34s.tconf
LOG File: /lkp/benchmarks/ltp/results/LTP_RUN_ON-2019_10_08-00h_55m_34s.log
FAILED COMMAND File: /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-00h_55m_34s.failed
TCONF COMMAND File: /lkp/benchmarks/ltp/output/LTP_RUN_ON-2019_10_08-00h_55m_34s.tconf
Running tests.......
<<<test_start>>>
tag=madvise01 stime=1570467354
cmdline="madvise01"
contacts=""
analysis=exit
<<<test_output>>>
tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
madvise01.c:112: PASS: madvise test for MADV_NORMAL PASSED
madvise01.c:112: PASS: madvise test for MADV_RANDOM PASSED
madvise01.c:112: PASS: madvise test for MADV_SEQUENTIAL PASSED
madvise01.c:112: PASS: madvise test for MADV_WILLNEED PASSED
madvise01.c:112: PASS: madvise test for MADV_DONTNEED PASSED
madvise01.c:112: PASS: madvise test for MADV_REMOVE PASSED
madvise01.c:112: PASS: madvise test for MADV_DONTFORK PASSED
madvise01.c:112: PASS: madvise test for MADV_DOFORK PASSED
madvise01.c:109: FAIL: madvise test for MADV_HWPOISON failed with return = -1, errno = 16 : ???
madvise01.c:112: PASS: madvise test for MADV_MERGEABLE PASSED
madvise01.c:112: PASS: madvise test for MADV_UNMERGEABLE PASSED
madvise01.c:112: PASS: madvise test for MADV_HUGEPAGE PASSED
madvise01.c:112: PASS: madvise test for MADV_NOHUGEPAGE PASSED
madvise01.c:112: PASS: madvise test for MADV_DONTDUMP PASSED
madvise01.c:112: PASS: madvise test for MADV_DODUMP PASSED
madvise01.c:112: PASS: madvise test for MADV_FREE PASSED
madvise01.c:112: PASS: madvise test for MADV_WIPEONFORK PASSED
madvise01.c:112: PASS: madvise test for MADV_KEEPONFORK PASSED
Summary:
passed 17
failed 1
skipped 0
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=1 corefile=no
cutime=0 cstime=1
<<<test_end>>>
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc1-00003-g67d8662d2db61 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[mm/page_alloc.c] 550521d945: will-it-scale.per_process_ops 13.4% improvement
by kernel test robot
Greeting,
FYI, we noticed a 13.4% improvement of will-it-scale.per_process_ops due to commit:
commit: 550521d9458c5ee99a0069d556b0f2d5d55b7660 ("mm/page_alloc.c: Set ppc->high fraction default to 512")
https://git.kernel.org/cgit/linux/kernel/git/saeed/linux.git net-next-mlx4
in testcase: will-it-scale
on test machine: 72 threads Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz with 192G memory
with following parameters:
nr_task: 100%
mode: process
test: page_fault2
ucode: 0x200005e
cpufreq_governor: performance
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-2019-05-14.cgz/lkp-skl-2sp8/page_fault2/will-it-scale/0x200005e
commit:
2dda728f89 ("net/mlx4: Change number of max MSIXs from 64 to 1024")
550521d945 ("mm/page_alloc.c: Set ppc->high fraction default to 512")
2dda728f8934286c 550521d9458c5ee99a0069d556b
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x
3:4 16% 4:4 perf-profile.calltrace.cycles-pp.sync_regs.error_entry.testcase
6:4 30% 8:4 perf-profile.calltrace.cycles-pp.error_entry.testcase
7:4 31% 8:4 perf-profile.children.cycles-pp.error_entry
3:4 14% 3:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
101707 +13.4% 115314 will-it-scale.per_process_ops
7323005 +13.4% 8302687 will-it-scale.workload
4.49 +0.7 5.21 ± 4% mpstat.cpu.all.usr%
265.40 +2.3% 271.52 turbostat.PkgWatt
144.04 +4.7% 150.84 turbostat.RAMWatt
1.106e+09 +12.8% 1.248e+09 numa-numastat.node0.local_node
1.106e+09 +12.8% 1.248e+09 numa-numastat.node0.numa_hit
1.108e+09 +14.0% 1.263e+09 numa-numastat.node1.local_node
1.108e+09 +14.0% 1.263e+09 numa-numastat.node1.numa_hit
5.527e+08 +13.0% 6.246e+08 numa-vmstat.node0.numa_hit
5.526e+08 +13.0% 6.246e+08 numa-vmstat.node0.numa_local
5.533e+08 +14.3% 6.324e+08 numa-vmstat.node1.numa_hit
5.532e+08 +14.3% 6.322e+08 numa-vmstat.node1.numa_local
2.212e+09 +13.4% 2.509e+09 proc-vmstat.numa_hit
2.212e+09 +13.4% 2.509e+09 proc-vmstat.numa_local
2.214e+09 +13.4% 2.511e+09 proc-vmstat.pgalloc_normal
2.206e+09 +13.4% 2.502e+09 proc-vmstat.pgfault
2.212e+09 +13.4% 2.509e+09 proc-vmstat.pgfree
6.43 ± 30% +56.0% 10.03 ± 19% sched_debug.cfs_rq:/.removed.load_avg.avg
31.86 ± 14% +25.0% 39.82 ± 9% sched_debug.cfs_rq:/.removed.load_avg.stddev
297.52 ± 30% +56.0% 464.13 ± 19% sched_debug.cfs_rq:/.removed.runnable_sum.avg
1474 ± 14% +24.9% 1841 ± 9% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
2.18 ± 33% +78.7% 3.90 ± 15% sched_debug.cfs_rq:/.removed.util_avg.avg
66.04 ± 19% +31.8% 87.04 sched_debug.cfs_rq:/.removed.util_avg.max
10.93 ± 21% +48.3% 16.21 ± 9% sched_debug.cfs_rq:/.removed.util_avg.stddev
8.77 ± 26% -46.3% 4.71 ± 10% sched_debug.cpu.clock.stddev
8.77 ± 26% -46.3% 4.71 ± 10% sched_debug.cpu.clock_task.stddev
57.81 ± 5% +15.7% 66.89 sched_debug.cpu.sched_goidle.avg
211.13 ± 5% +31.2% 277.09 ± 15% sched_debug.cpu.sched_goidle.stddev
3308 ± 6% -13.3% 2867 ± 7% interrupts.CPU10.CAL:Function_call_interrupts
3346 ± 7% -16.6% 2790 ± 8% interrupts.CPU13.CAL:Function_call_interrupts
3384 ± 3% -12.7% 2954 ± 9% interrupts.CPU15.CAL:Function_call_interrupts
3466 ± 3% -15.2% 2938 ± 9% interrupts.CPU16.CAL:Function_call_interrupts
3331 ± 4% -12.0% 2931 ± 9% interrupts.CPU18.CAL:Function_call_interrupts
3534 ± 2% -11.5% 3129 ± 9% interrupts.CPU2.CAL:Function_call_interrupts
3294 ± 5% -25.1% 2468 ± 22% interrupts.CPU20.CAL:Function_call_interrupts
3250 ± 5% -28.8% 2315 ± 37% interrupts.CPU23.CAL:Function_call_interrupts
218.00 ± 29% -69.5% 66.50 ± 39% interrupts.CPU34.RES:Rescheduling_interrupts
2619 +26.4% 3311 ± 14% interrupts.CPU48.CAL:Function_call_interrupts
3502 ± 2% -15.1% 2972 ± 11% interrupts.CPU5.CAL:Function_call_interrupts
3470 ± 3% -13.8% 2993 ± 4% interrupts.CPU6.CAL:Function_call_interrupts
150.50 ± 61% -83.2% 25.25 ± 44% interrupts.CPU67.RES:Rescheduling_interrupts
3456 ± 3% -10.6% 3090 ± 6% interrupts.CPU7.CAL:Function_call_interrupts
24.30 -5.5% 22.97 perf-stat.i.MPKI
6.757e+09 +10.2% 7.446e+09 perf-stat.i.branch-instructions
0.59 -0.0 0.55 perf-stat.i.branch-miss-rate%
39782002 +2.6% 40812744 perf-stat.i.branch-misses
74.55 +4.1 78.63 perf-stat.i.cache-miss-rate%
6.318e+08 +10.4% 6.976e+08 perf-stat.i.cache-misses
8.467e+08 +4.7% 8.863e+08 perf-stat.i.cache-references
6.13 -9.6% 5.54 perf-stat.i.cpi
35.81 -3.2% 34.67 perf-stat.i.cpu-migrations
340.25 -9.2% 308.80 perf-stat.i.cycles-between-cache-misses
9.404e+09 +11.0% 1.044e+10 perf-stat.i.dTLB-loads
59703505 +13.3% 67644724 perf-stat.i.dTLB-store-misses
4.96e+09 +12.5% 5.579e+09 perf-stat.i.dTLB-stores
14580552 +13.9% 16604112 ± 4% perf-stat.i.iTLB-load-misses
22932 +58.6% 36361 ± 29% perf-stat.i.iTLB-loads
3.483e+10 +10.7% 3.855e+10 perf-stat.i.instructions
0.16 +10.7% 0.18 perf-stat.i.ipc
7291321 +13.4% 8265503 perf-stat.i.minor-faults
0.34 ± 2% -0.0 0.32 ± 2% perf-stat.i.node-load-miss-rate%
473794 +9.0% 516246 perf-stat.i.node-load-misses
1.427e+08 +17.8% 1.68e+08 perf-stat.i.node-loads
1.70 +0.3 2.02 perf-stat.i.node-store-miss-rate%
713762 +19.5% 852629 perf-stat.i.node-store-misses
7290334 +13.4% 8264774 perf-stat.i.page-faults
24.31 -5.4% 22.99 perf-stat.overall.MPKI
0.59 -0.0 0.55 perf-stat.overall.branch-miss-rate%
74.62 +4.1 78.71 perf-stat.overall.cache-miss-rate%
6.13 -9.6% 5.54 perf-stat.overall.cpi
337.74 -9.4% 305.98 perf-stat.overall.cycles-between-cache-misses
0.16 +10.7% 0.18 perf-stat.overall.ipc
0.33 -0.0 0.31 perf-stat.overall.node-load-miss-rate%
1.69 +0.3 2.01 perf-stat.overall.node-store-miss-rate%
1435634 -2.4% 1401739 perf-stat.overall.path-length
6.734e+09 +10.2% 7.421e+09 perf-stat.ps.branch-instructions
39637288 +2.6% 40671871 perf-stat.ps.branch-misses
6.297e+08 +10.4% 6.952e+08 perf-stat.ps.cache-misses
8.438e+08 +4.7% 8.833e+08 perf-stat.ps.cache-references
35.67 -3.2% 34.55 perf-stat.ps.cpu-migrations
9.372e+09 +11.0% 1.04e+10 perf-stat.ps.dTLB-loads
59499750 +13.3% 67418791 perf-stat.ps.dTLB-store-misses
4.943e+09 +12.5% 5.56e+09 perf-stat.ps.dTLB-stores
14530941 +13.9% 16548827 ± 4% perf-stat.ps.iTLB-load-misses
22817 +58.8% 36244 ± 29% perf-stat.ps.iTLB-loads
3.471e+10 +10.7% 3.842e+10 perf-stat.ps.instructions
7266007 +13.4% 8237390 perf-stat.ps.minor-faults
472128 +9.0% 514466 perf-stat.ps.node-load-misses
1.422e+08 +17.8% 1.675e+08 perf-stat.ps.node-loads
711299 +19.5% 849751 perf-stat.ps.node-store-misses
7265524 +13.4% 8237264 perf-stat.ps.page-faults
1.051e+13 +10.7% 1.164e+13 perf-stat.total.instructions
32.66 -4.2 28.45 perf-profile.calltrace.cycles-pp._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.__handle_mm_fault
32.54 -4.2 28.38 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma
34.85 -4.0 30.80 perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.__handle_mm_fault.handle_mm_fault
35.16 -4.0 31.15 perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.alloc_pages_vma.__handle_mm_fault.handle_mm_fault.__do_page_fault
35.50 -4.0 31.53 perf-profile.calltrace.cycles-pp.alloc_pages_vma.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
31.82 -3.3 28.48 perf-profile.calltrace.cycles-pp._raw_spin_lock.free_pcppages_bulk.free_unref_page_list.release_pages.tlb_flush_mmu
31.72 -3.3 28.42 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_pcppages_bulk.free_unref_page_list.release_pages
29.32 -2.8 26.47 perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.tlb_flush_mmu.unmap_page_range
29.77 -2.8 26.97 perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.tlb_flush_mmu.unmap_page_range.unmap_vmas
31.59 -1.9 29.70 perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.unmap_page_range.unmap_vmas.unmap_region
37.37 -1.9 35.51 perf-profile.calltrace.cycles-pp.munmap
37.36 -1.9 35.50 perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
37.36 -1.9 35.50 perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
37.36 -1.9 35.50 perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
37.36 -1.9 35.50 perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64
37.36 -1.9 35.51 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.munmap
37.36 -1.9 35.51 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
31.80 -1.8 29.96 perf-profile.calltrace.cycles-pp.tlb_flush_mmu.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
33.26 -1.6 31.64 perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
33.25 -1.6 31.63 perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap
3.76 -0.4 3.40 perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.tlb_flush_mmu.tlb_finish_mmu
3.82 -0.4 3.46 perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.tlb_flush_mmu.tlb_finish_mmu.unmap_region
4.05 -0.2 3.81 perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap
4.10 -0.2 3.86 perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
4.07 -0.2 3.84 perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__vm_munmap
1.29 -0.1 1.22 perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault
1.56 -0.0 1.52 perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault
1.69 -0.0 1.66 perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.92 +0.2 1.07 perf-profile.calltrace.cycles-pp.__pagevec_lru_add_fn.pagevec_lru_move_fn.__lru_cache_add.alloc_set_pte.finish_fault
52.28 +0.2 52.44 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.96 +0.2 1.16 perf-profile.calltrace.cycles-pp.__list_del_entry_valid.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.__handle_mm_fault
1.27 +0.2 1.47 perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
52.80 +0.2 53.05 perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.testcase
1.92 +0.3 2.25 perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode.testcase
53.77 +0.4 54.16 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.testcase
54.05 +0.4 54.48 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.testcase
2.77 +0.5 3.23 perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode.testcase
1.08 ± 4% +0.8 1.85 ± 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.release_pages.tlb_flush_mmu.unmap_page_range
1.10 ± 4% +0.8 1.86 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.release_pages.tlb_flush_mmu.unmap_page_range.unmap_vmas
58.66 +1.2 59.87 perf-profile.calltrace.cycles-pp.page_fault.testcase
7.99 +1.4 9.38 perf-profile.calltrace.cycles-pp.copy_page.copy_user_highpage.__handle_mm_fault.handle_mm_fault.__do_page_fault
8.09 +1.4 9.49 perf-profile.calltrace.cycles-pp.copy_user_highpage.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
61.41 +1.6 63.06 perf-profile.calltrace.cycles-pp.testcase
2.00 ± 2% +1.9 3.93 ± 4% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.alloc_set_pte
2.05 ± 2% +1.9 3.98 ± 4% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.alloc_set_pte.finish_fault
3.27 +2.2 5.42 ± 3% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.alloc_set_pte.finish_fault.__handle_mm_fault
3.38 +2.2 5.55 ± 3% perf-profile.calltrace.cycles-pp.__lru_cache_add.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
5.59 +2.5 8.13 ± 2% perf-profile.calltrace.cycles-pp.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
5.66 +2.6 8.21 ± 2% perf-profile.calltrace.cycles-pp.finish_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
65.88 -7.4 58.52 perf-profile.children.cycles-pp._raw_spin_lock
67.60 -4.7 62.95 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
34.99 -4.0 30.95 perf-profile.children.cycles-pp.get_page_from_freelist
35.29 -4.0 31.28 perf-profile.children.cycles-pp.__alloc_pages_nodemask
35.52 -4.0 31.56 perf-profile.children.cycles-pp.alloc_pages_vma
33.11 -3.2 29.89 perf-profile.children.cycles-pp.free_pcppages_bulk
33.62 -3.2 30.46 perf-profile.children.cycles-pp.free_unref_page_list
35.77 -2.1 33.67 perf-profile.children.cycles-pp.release_pages
35.89 -2.1 33.81 perf-profile.children.cycles-pp.tlb_flush_mmu
37.37 -1.9 35.51 perf-profile.children.cycles-pp.munmap
37.36 -1.9 35.50 perf-profile.children.cycles-pp.__vm_munmap
37.36 -1.9 35.50 perf-profile.children.cycles-pp.unmap_region
37.36 -1.9 35.50 perf-profile.children.cycles-pp.__x64_sys_munmap
37.36 -1.9 35.51 perf-profile.children.cycles-pp.__do_munmap
37.44 -1.8 35.60 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
37.44 -1.8 35.60 perf-profile.children.cycles-pp.do_syscall_64
33.26 -1.6 31.64 perf-profile.children.cycles-pp.unmap_vmas
33.26 -1.6 31.64 perf-profile.children.cycles-pp.unmap_page_range
4.10 -0.2 3.87 perf-profile.children.cycles-pp.tlb_finish_mmu
1.29 -0.1 1.22 perf-profile.children.cycles-pp.find_get_entry
1.58 -0.0 1.54 perf-profile.children.cycles-pp.find_lock_entry
1.71 -0.0 1.67 perf-profile.children.cycles-pp.shmem_getpage_gfp
0.08 ± 5% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__inc_numa_state
0.05 +0.0 0.06 perf-profile.children.cycles-pp.get_task_policy
0.09 ± 4% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.up_read
0.08 ± 5% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__might_sleep
0.05 +0.0 0.06 ± 6% perf-profile.children.cycles-pp.uncharge_page
0.11 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.vmacache_find
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.xas_start
0.10 ± 5% +0.0 0.11 perf-profile.children.cycles-pp._cond_resched
0.09 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.mem_cgroup_update_lru_size
0.08 ± 8% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.pmd_devmap_trans_unstable
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.unlock_page
0.18 ± 3% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.___might_sleep
0.14 ± 3% +0.0 0.16 ± 2% perf-profile.children.cycles-pp.__mod_zone_page_state
0.11 ± 3% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.find_vma
0.08 +0.0 0.10 ± 4% perf-profile.children.cycles-pp.mem_cgroup_page_lruvec
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
0.14 ± 3% +0.0 0.16 ± 6% perf-profile.children.cycles-pp.page_add_new_anon_rmap
0.08 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate
0.21 ± 2% +0.0 0.24 ± 6% perf-profile.children.cycles-pp.__mod_node_page_state
0.18 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.mem_cgroup_try_charge
0.23 +0.0 0.27 ± 2% perf-profile.children.cycles-pp.page_remove_rmap
0.23 +0.0 0.28 ± 3% perf-profile.children.cycles-pp.free_pages_and_swap_cache
0.29 ± 2% +0.1 0.34 ± 3% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.41 ± 2% +0.1 0.47 perf-profile.children.cycles-pp.__mod_lruvec_state
0.27 ± 3% +0.1 0.33 ± 2% perf-profile.children.cycles-pp.__count_memcg_events
0.29 +0.1 0.36 ± 3% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
0.39 ± 3% +0.1 0.46 perf-profile.children.cycles-pp.xas_load
0.56 +0.1 0.64 ± 4% perf-profile.children.cycles-pp.__perf_sw_event
0.38 ± 2% +0.1 0.47 perf-profile.children.cycles-pp.__mod_memcg_state
0.41 +0.1 0.50 ± 2% perf-profile.children.cycles-pp.mem_cgroup_commit_charge
0.93 +0.1 1.08 perf-profile.children.cycles-pp.__pagevec_lru_add_fn
52.31 +0.2 52.47 perf-profile.children.cycles-pp.__handle_mm_fault
0.94 +0.2 1.11 perf-profile.children.cycles-pp.sync_regs
1.16 ± 2% +0.2 1.35 perf-profile.children.cycles-pp.native_irq_return_iret
1.20 +0.2 1.44 perf-profile.children.cycles-pp.__list_del_entry_valid
52.84 +0.3 53.09 perf-profile.children.cycles-pp.handle_mm_fault
1.93 +0.3 2.26 perf-profile.children.cycles-pp.prepare_exit_to_usermode
53.80 +0.4 54.20 perf-profile.children.cycles-pp.__do_page_fault
54.05 +0.4 54.49 perf-profile.children.cycles-pp.do_page_fault
2.77 +0.5 3.23 perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
56.45 +0.8 57.28 perf-profile.children.cycles-pp.page_fault
8.01 +1.4 9.40 perf-profile.children.cycles-pp.copy_page
8.09 +1.4 9.49 perf-profile.children.cycles-pp.copy_user_highpage
62.53 +1.8 64.37 perf-profile.children.cycles-pp.testcase
3.28 +2.2 5.44 ± 3% perf-profile.children.cycles-pp.pagevec_lru_move_fn
3.39 +2.2 5.56 ± 3% perf-profile.children.cycles-pp.__lru_cache_add
5.62 +2.5 8.17 ± 2% perf-profile.children.cycles-pp.alloc_set_pte
5.66 +2.6 8.22 ± 2% perf-profile.children.cycles-pp.finish_fault
3.29 ± 3% +2.8 6.11 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
67.60 -4.7 62.95 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.90 -0.1 0.76 perf-profile.self.cycles-pp.find_get_entry
0.08 ± 6% -0.0 0.06 perf-profile.self.cycles-pp.__inc_numa_state
0.05 +0.0 0.06 perf-profile.self.cycles-pp.perf_exclude_event
0.08 +0.0 0.09 ± 4% perf-profile.self.cycles-pp.alloc_pages_vma
0.08 +0.0 0.09 ± 4% perf-profile.self.cycles-pp.mem_cgroup_commit_charge
0.07 ± 6% +0.0 0.08 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.uncharge_page
0.14 +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__mod_zone_page_state
0.11 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.__lru_cache_add
0.11 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.vmacache_find
0.10 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.pagevec_lru_move_fn
0.10 ± 7% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.page_mapping
0.08 ± 6% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.mem_cgroup_throttle_swaprate
0.07 ± 5% +0.0 0.09 perf-profile.self.cycles-pp.pmd_devmap_trans_unstable
0.08 ± 10% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.unlock_page
0.17 ± 4% +0.0 0.19 ± 3% perf-profile.self.cycles-pp.___might_sleep
0.07 ± 6% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.xas_start
0.11 +0.0 0.13 ± 8% perf-profile.self.cycles-pp.find_lock_entry
0.08 ± 5% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.mem_cgroup_page_lruvec
0.21 ± 3% +0.0 0.24 ± 2% perf-profile.self.cycles-pp.shmem_fault
0.18 ± 3% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.__alloc_pages_nodemask
0.20 +0.0 0.23 ± 3% perf-profile.self.cycles-pp.page_remove_rmap
0.27 ± 4% +0.0 0.30 ± 2% perf-profile.self.cycles-pp.handle_mm_fault
0.20 +0.0 0.23 ± 4% perf-profile.self.cycles-pp.__mod_node_page_state
0.19 ± 2% +0.0 0.23 ± 2% perf-profile.self.cycles-pp.__do_page_fault
0.11 ± 4% +0.0 0.15 ± 2% perf-profile.self.cycles-pp.__perf_sw_event
0.24 ± 3% +0.0 0.28 ± 4% perf-profile.self.cycles-pp.alloc_set_pte
0.21 ± 5% +0.0 0.26 ± 6% perf-profile.self.cycles-pp.free_unref_page_list
0.23 +0.0 0.28 ± 4% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.32 ± 3% +0.0 0.36 ± 2% perf-profile.self.cycles-pp.xas_load
0.26 ± 2% +0.1 0.33 perf-profile.self.cycles-pp.__count_memcg_events
0.37 +0.1 0.45 ± 2% perf-profile.self.cycles-pp.release_pages
0.52 ± 2% +0.1 0.60 perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.37 ± 2% +0.1 0.46 perf-profile.self.cycles-pp.__mod_memcg_state
0.52 +0.1 0.61 ± 3% perf-profile.self.cycles-pp.__handle_mm_fault
1.49 +0.1 1.59 perf-profile.self.cycles-pp._raw_spin_lock
1.08 +0.1 1.21 perf-profile.self.cycles-pp.free_pcppages_bulk
0.84 +0.1 0.97 perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.93 ± 2% +0.2 1.10 perf-profile.self.cycles-pp.sync_regs
1.17 +0.2 1.34 perf-profile.self.cycles-pp.unmap_page_range
1.16 ± 2% +0.2 1.34 perf-profile.self.cycles-pp.native_irq_return_iret
1.19 +0.2 1.43 perf-profile.self.cycles-pp.__list_del_entry_valid
1.90 +0.3 2.23 perf-profile.self.cycles-pp.prepare_exit_to_usermode
2.61 +0.4 3.04 perf-profile.self.cycles-pp.testcase
7.98 +1.4 9.37 perf-profile.self.cycles-pp.copy_page
will-it-scale.per_process_ops
118000 +-+----------------------------------------------------------------+
116000 +-+ O O |
| O O O O O O |
114000 +-+ O O |
112000 O-O O O O O O OO O |
| O O O |
110000 +-+ |
108000 +-+ |
106000 +-+ |
| |
104000 +-+ |
102000 +-+.+.++ +.+.+.++.+.+.+.+.+. .+. .+.++.+.+.|
| + + ++.+.+ + |
100000 +-+ +.+.+.+.+.++.+.+.+ |
98000 +-+----------------------------------------------------------------+
will-it-scale.workload
8.6e+06 +-+---------------------------------------------------------------+
| |
8.4e+06 +-+ O O |
| O O O O O OO |
8.2e+06 O-O O O O O O |
8e+06 +-+ OO OO O O O |
| |
7.8e+06 +-+ |
| |
7.6e+06 +-+ |
7.4e+06 +-+ |
|.+.+.++ ++.+.+.+.+.++.+.+.+.+.++.+.+.+.+.++.+.|
7.2e+06 +-+ + + |
| +.+.+.+.++.+.+.+.+ |
7e+06 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-skl-fpga01: 104 threads Skylake with 192G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-2019-05-14.cgz/lkp-skl-fpga01/page_fault3/will-it-scale
commit:
2dda728f89 ("net/mlx4: Change number of max MSIXs from 64 to 1024")
550521d945 ("mm/page_alloc.c: Set ppc->high fraction default to 512")
2dda728f8934286c 550521d9458c5ee99a0069d556b
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:2 -50% :4 dmesg.WARNING:at_ip___perf_sw_event/0x
9:2 467% 18:4 perf-profile.calltrace.cycles-pp.sync_regs.error_entry.testcase
28:2 1254% 53:4 perf-profile.calltrace.cycles-pp.error_entry.testcase
0:2 8% 0:4 perf-profile.children.cycles-pp.error_exit
26:2 1202% 50:4 perf-profile.children.cycles-pp.error_entry
0:2 7% 0:4 perf-profile.self.cycles-pp.error_exit
13:2 638% 26:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
311.00 ± 63% +432.2% 1655 ± 3% meminfo.Mlocked
16.47 ± 29% -12.0 4.50 ±156% mpstat.cpu.all.idle%
16.00 ± 31% -73.4% 4.25 ±159% vmstat.cpu.id
132.50 ± 63% +575.3% 894.75 ± 14% numa-meminfo.node1.Mlocked
11287 ± 4% +23.8% 13976 ± 8% numa-meminfo.node1.PageTables
18139 ± 25% -33.0% 12159 ± 34% cpuidle.C1.usage
6.091e+09 ± 35% -74.4% 1.56e+09 ±165% cpuidle.C1E.time
12653834 ± 35% -74.3% 3253891 ±163% cpuidle.C1E.usage
410399 ± 41% -77.5% 92338 ±121% cpuidle.POLL.time
8636 ± 18% -60.6% 3400 ± 65% cpuidle.POLL.usage
601.00 ± 4% +25.4% 753.75 ± 10% slabinfo.file_lock_cache.active_objs
601.00 ± 4% +25.4% 753.75 ± 10% slabinfo.file_lock_cache.num_objs
3968 -11.9% 3496 slabinfo.skbuff_head_cache.active_objs
4048 -11.7% 3576 slabinfo.skbuff_head_cache.num_objs
13557 ± 3% -5.4% 12827 ± 2% slabinfo.vmap_area.active_objs
13559 ± 3% -5.4% 12828 ± 2% slabinfo.vmap_area.num_objs
12035 ± 45% -55.6% 5343 ± 89% turbostat.C1
12650801 ± 35% -74.3% 3252780 ±164% turbostat.C1E
15.85 ± 30% -11.7 4.17 ±163% turbostat.C1E%
16.14 ± 29% -72.1% 4.51 ±149% turbostat.CPU%c1
0.15 ± 3% +41.4% 0.21 ± 14% turbostat.CPU%c6
77347456 ± 6% -12.3% 67829116 ± 7% turbostat.IRQ
44.50 ± 64% +325.3% 189.25 ± 12% numa-vmstat.node0.nr_mlock
10949273 ± 3% -9.7% 9888275 ± 5% numa-vmstat.node0.numa_hit
10925709 ± 3% -9.6% 9876358 ± 5% numa-vmstat.node0.numa_local
32.50 ± 66% +586.9% 223.25 ± 14% numa-vmstat.node1.nr_mlock
2827 ± 4% +23.8% 3499 ± 8% numa-vmstat.node1.nr_page_table_pages
10707745 ± 4% -8.5% 9794295 ± 5% numa-vmstat.node1.numa_hit
10528564 ± 4% -8.8% 9603220 ± 5% numa-vmstat.node1.numa_local
4554881 -0.9% 4512342 proc-vmstat.nr_dirty_background_threshold
9120899 -0.9% 9035717 proc-vmstat.nr_dirty_threshold
45833887 -0.9% 45407874 proc-vmstat.nr_free_pages
76.50 ± 64% +440.5% 413.50 ± 3% proc-vmstat.nr_mlock
32980721 -1.2% 32587696 proc-vmstat.numa_hit
32947028 -1.2% 32553981 proc-vmstat.numa_local
33051089 -1.1% 32681015 proc-vmstat.pgalloc_normal
33009803 -6.3% 30929552 ± 5% proc-vmstat.pgfree
0.05 +12.1% 0.06 ± 6% sched_debug.cfs_rq:/.nr_running.stddev
1141 ± 5% -6.6% 1065 ± 4% sched_debug.cfs_rq:/.util_avg.max
54.39 ± 9% -11.1% 48.34 ± 11% sched_debug.cfs_rq:/.util_avg.stddev
513147 +14.7% 588379 ± 2% sched_debug.cpu.avg_idle.min
9.97 ± 13% +25.2% 12.48 ± 6% sched_debug.cpu.clock.stddev
9.97 ± 13% +25.2% 12.48 ± 6% sched_debug.cpu.clock_task.stddev
15876 ± 2% -10.5% 14206 ± 7% sched_debug.cpu.nr_switches.max
2513 -11.9% 2213 ± 3% sched_debug.cpu.nr_switches.stddev
10334 ± 4% -13.0% 8990 ± 2% sched_debug.cpu.sched_count.max
0.97 ± 8% -0.2 0.77 ± 14% perf-stat.i.branch-miss-rate%
1.341e+08 ± 6% +28.2% 1.72e+08 ± 7% perf-stat.i.cache-misses
1.946e+08 ± 5% +26.7% 2.466e+08 ± 7% perf-stat.i.cache-references
2.43 -2.8% 2.37 ± 2% perf-stat.i.cpi
2661 ± 13% -30.2% 1858 ± 25% perf-stat.i.cycles-between-cache-misses
262715 ± 24% -59.9% 105327 ± 84% perf-stat.i.iTLB-loads
9679 ± 27% -65.7% 3323 ±120% perf-stat.i.instructions-per-iTLB-miss
15.68 ± 30% -10.5 5.15 ±123% perf-stat.i.node-load-miss-rate%
163544 ± 4% +36.1% 222590 ± 7% perf-stat.i.node-load-misses
16988491 ± 3% -14.6% 14510740 ± 9% perf-stat.i.node-loads
18.69 ± 23% -10.4 8.27 ± 74% perf-stat.i.node-store-miss-rate%
1.88 +11.9% 2.11 perf-stat.overall.MPKI
68.92 +0.8 69.70 perf-stat.overall.cache-miss-rate%
2.31 +1.0% 2.33 perf-stat.overall.cpi
1777 -10.7% 1587 perf-stat.overall.cycles-between-cache-misses
0.95 +0.6 1.53 ± 13% perf-stat.overall.node-load-miss-rate%
1.338e+08 ± 6% +28.1% 1.714e+08 ± 7% perf-stat.ps.cache-misses
1.94e+08 ± 5% +26.7% 2.458e+08 ± 7% perf-stat.ps.cache-references
262065 ± 24% -59.9% 105042 ± 84% perf-stat.ps.iTLB-loads
163103 ± 4% +36.0% 221881 ± 7% perf-stat.ps.node-load-misses
16939816 ± 3% -14.6% 14463619 ± 9% perf-stat.ps.node-loads
3.717e+13 -1.1% 3.675e+13 perf-stat.total.instructions
6.22 -0.5 5.73 perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault
7.20 -0.5 6.72 perf-profile.calltrace.cycles-pp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
5.60 -0.5 5.12 perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault
7.46 -0.5 6.99 perf-profile.calltrace.cycles-pp.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
4.23 -0.4 3.78 perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_fault.__do_fault
16.95 -0.4 16.54 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
24.93 -0.4 24.56 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.testcase
26.49 -0.4 26.13 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.testcase
76.62 -0.4 76.27 perf-profile.calltrace.cycles-pp.testcase
6.56 -0.4 6.21 perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.56 -0.4 6.21 perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
6.56 -0.4 6.21 perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
6.59 -0.3 6.25 perf-profile.calltrace.cycles-pp.munmap
6.56 -0.3 6.21 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.munmap
6.56 -0.3 6.21 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
6.48 -0.3 6.13 perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap
6.55 -0.3 6.21 perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64
6.54 -0.3 6.19 perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
0.52 -0.1 0.38 ± 57% perf-profile.calltrace.cycles-pp._raw_spin_lock.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
1.81 -0.0 1.77 perf-profile.calltrace.cycles-pp.__perf_sw_event.__do_page_fault.do_page_fault.page_fault.testcase
0.68 -0.0 0.66 perf-profile.calltrace.cycles-pp.tlb_flush_mmu.unmap_page_range.unmap_vmas.unmap_region.__do_munmap
1.81 +0.1 1.96 ± 4% perf-profile.calltrace.cycles-pp.page_add_file_rmap.alloc_set_pte.finish_fault.__handle_mm_fault.handle_mm_fault
0.58 +0.2 0.80 ± 8% perf-profile.calltrace.cycles-pp.__count_memcg_events.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
18.09 +0.6 18.64 perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode.testcase
13.57 +0.6 14.15 perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode.testcase
77.02 +1.0 78.03 perf-profile.calltrace.cycles-pp.page_fault.testcase
6.22 -0.5 5.73 perf-profile.children.cycles-pp.shmem_getpage_gfp
7.22 -0.5 6.74 perf-profile.children.cycles-pp.shmem_fault
5.67 -0.5 5.19 perf-profile.children.cycles-pp.find_lock_entry
7.48 -0.5 7.01 perf-profile.children.cycles-pp.__do_fault
4.24 -0.4 3.80 perf-profile.children.cycles-pp.find_get_entry
17.02 -0.4 16.62 perf-profile.children.cycles-pp.__handle_mm_fault
26.52 -0.4 26.15 perf-profile.children.cycles-pp.do_page_fault
25.05 -0.4 24.67 perf-profile.children.cycles-pp.__do_page_fault
6.62 -0.4 6.26 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
6.62 -0.4 6.26 perf-profile.children.cycles-pp.do_syscall_64
6.56 -0.4 6.21 perf-profile.children.cycles-pp.__do_munmap
6.56 -0.4 6.21 perf-profile.children.cycles-pp.__x64_sys_munmap
6.56 -0.4 6.21 perf-profile.children.cycles-pp.__vm_munmap
6.59 -0.3 6.25 perf-profile.children.cycles-pp.munmap
6.54 -0.3 6.19 perf-profile.children.cycles-pp.unmap_vmas
6.54 -0.3 6.19 perf-profile.children.cycles-pp.unmap_page_range
6.55 -0.3 6.21 perf-profile.children.cycles-pp.unmap_region
6.25 -0.3 5.91 perf-profile.children.cycles-pp.sync_regs
6.45 -0.1 6.37 perf-profile.children.cycles-pp.native_irq_return_iret
0.28 ± 25% -0.1 0.22 ± 26% perf-profile.children.cycles-pp.mem_cgroup_from_task
3.04 -0.0 2.99 perf-profile.children.cycles-pp.__perf_sw_event
0.26 ± 3% -0.0 0.24 ± 2% perf-profile.children.cycles-pp.__might_sleep
0.69 -0.0 0.67 perf-profile.children.cycles-pp.tlb_flush_mmu
0.56 -0.0 0.54 perf-profile.children.cycles-pp._raw_spin_lock
0.21 -0.0 0.20 ± 4% perf-profile.children.cycles-pp.rcu_all_qs
0.09 +0.0 0.10 perf-profile.children.cycles-pp.pte_alloc_one
0.09 +0.0 0.10 perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.09 +0.0 0.10 perf-profile.children.cycles-pp.timespec64_trunc
0.06 +0.0 0.07 ± 5% perf-profile.children.cycles-pp.clear_page_erms
1.83 +0.1 1.98 ± 4% perf-profile.children.cycles-pp.page_add_file_rmap
0.29 +0.2 0.45 ± 10% perf-profile.children.cycles-pp.lock_page_memcg
0.59 +0.2 0.81 ± 7% perf-profile.children.cycles-pp.__count_memcg_events
93.34 +0.3 93.69 perf-profile.children.cycles-pp.testcase
54.12 +0.4 54.51 perf-profile.children.cycles-pp.page_fault
18.09 +0.6 18.64 perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
13.60 +0.6 14.17 perf-profile.children.cycles-pp.prepare_exit_to_usermode
2.29 ± 2% -0.5 1.83 perf-profile.self.cycles-pp.find_get_entry
2.18 -0.3 1.83 ± 3% perf-profile.self.cycles-pp.unmap_page_range
6.19 -0.3 5.84 perf-profile.self.cycles-pp.sync_regs
6.43 -0.1 6.35 perf-profile.self.cycles-pp.native_irq_return_iret
0.28 ± 23% -0.1 0.22 ± 27% perf-profile.self.cycles-pp.mem_cgroup_from_task
1.55 -0.1 1.50 perf-profile.self.cycles-pp.handle_mm_fault
0.82 -0.0 0.78 perf-profile.self.cycles-pp.page_remove_rmap
1.85 -0.0 1.82 perf-profile.self.cycles-pp.___perf_sw_event
0.77 -0.0 0.74 ± 2% perf-profile.self.cycles-pp.alloc_set_pte
0.58 -0.0 0.56 perf-profile.self.cycles-pp.find_lock_entry
1.26 -0.0 1.24 perf-profile.self.cycles-pp.__do_page_fault
0.92 -0.0 0.90 perf-profile.self.cycles-pp.__perf_sw_event
0.46 -0.0 0.45 perf-profile.self.cycles-pp.up_read
0.54 -0.0 0.52 perf-profile.self.cycles-pp._raw_spin_lock
0.18 -0.0 0.17 perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.06 +0.0 0.07 ± 5% perf-profile.self.cycles-pp.clear_page_erms
0.67 ± 2% +0.0 0.70 perf-profile.self.cycles-pp.__mod_memcg_state
0.26 +0.2 0.42 ± 12% perf-profile.self.cycles-pp.lock_page_memcg
0.57 +0.2 0.79 ± 8% perf-profile.self.cycles-pp.__count_memcg_events
13.43 +0.6 14.00 perf-profile.self.cycles-pp.prepare_exit_to_usermode
24.54 +0.7 25.20 perf-profile.self.cycles-pp.testcase
427.00 ± 31% +424.4% 2239 ± 88% interrupts.38:PCI-MSI.67633153-edge.eth0-TxRx-0
544.50 ± 36% -40.2% 325.50 ± 65% interrupts.39:PCI-MSI.67633154-edge.eth0-TxRx-1
725.00 ± 5% -12.3% 635.50 ± 8% interrupts.9:IO-APIC.9-fasteoi.acpi
411296 ± 4% -7.9% 378608 ± 8% interrupts.CAL:Function_call_interrupts
725242 ± 6% -12.5% 634834 ± 8% interrupts.CPU0.LOC:Local_timer_interrupts
1992 ± 30% -38.3% 1229 ± 23% interrupts.CPU0.RES:Rescheduling_interrupts
725.00 ± 5% -12.3% 635.50 ± 8% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
725071 ± 6% -12.5% 634550 ± 8% interrupts.CPU1.LOC:Local_timer_interrupts
4044 ± 5% -9.9% 3644 ± 7% interrupts.CPU10.CAL:Function_call_interrupts
724841 ± 6% -12.5% 634533 ± 8% interrupts.CPU10.LOC:Local_timer_interrupts
4050 ± 3% -9.3% 3672 ± 9% interrupts.CPU100.CAL:Function_call_interrupts
724763 ± 6% -12.4% 634638 ± 8% interrupts.CPU100.LOC:Local_timer_interrupts
4052 ± 3% -9.3% 3674 ± 8% interrupts.CPU101.CAL:Function_call_interrupts
724769 ± 6% -12.4% 634553 ± 8% interrupts.CPU101.LOC:Local_timer_interrupts
4052 ± 3% -9.4% 3672 ± 8% interrupts.CPU102.CAL:Function_call_interrupts
724806 ± 6% -12.5% 634538 ± 8% interrupts.CPU102.LOC:Local_timer_interrupts
4048 ± 3% -9.3% 3671 ± 8% interrupts.CPU103.CAL:Function_call_interrupts
724750 ± 6% -12.4% 634546 ± 8% interrupts.CPU103.LOC:Local_timer_interrupts
724826 ± 6% -12.4% 634786 ± 7% interrupts.CPU11.LOC:Local_timer_interrupts
4038 ± 5% -9.2% 3667 ± 6% interrupts.CPU12.CAL:Function_call_interrupts
724871 ± 6% -12.4% 634634 ± 8% interrupts.CPU12.LOC:Local_timer_interrupts
4039 ± 5% -14.8% 3442 ± 7% interrupts.CPU13.CAL:Function_call_interrupts
725164 ± 5% -12.5% 634572 ± 8% interrupts.CPU13.LOC:Local_timer_interrupts
724880 ± 6% -12.4% 634656 ± 8% interrupts.CPU14.LOC:Local_timer_interrupts
724880 ± 6% -12.5% 634589 ± 8% interrupts.CPU15.LOC:Local_timer_interrupts
724884 ± 6% -12.5% 634514 ± 8% interrupts.CPU16.LOC:Local_timer_interrupts
725008 ± 6% -12.5% 634500 ± 8% interrupts.CPU17.LOC:Local_timer_interrupts
725041 ± 6% -12.5% 634556 ± 8% interrupts.CPU18.LOC:Local_timer_interrupts
4029 ± 5% -13.3% 3492 ± 5% interrupts.CPU19.CAL:Function_call_interrupts
724892 ± 6% -12.5% 634513 ± 8% interrupts.CPU19.LOC:Local_timer_interrupts
725165 ± 5% -12.5% 634782 ± 7% interrupts.CPU2.LOC:Local_timer_interrupts
545.50 ± 11% -38.6% 335.00 ± 51% interrupts.CPU2.RES:Rescheduling_interrupts
725019 ± 6% -12.5% 634581 ± 8% interrupts.CPU20.LOC:Local_timer_interrupts
172.50 ± 15% +340.4% 759.75 ± 31% interrupts.CPU20.RES:Rescheduling_interrupts
725111 ± 6% -12.5% 634576 ± 8% interrupts.CPU21.LOC:Local_timer_interrupts
724890 ± 6% -12.5% 634586 ± 8% interrupts.CPU22.LOC:Local_timer_interrupts
711.00 ± 29% -55.5% 316.25 ± 25% interrupts.CPU22.RES:Rescheduling_interrupts
725034 ± 6% -12.5% 634589 ± 8% interrupts.CPU23.LOC:Local_timer_interrupts
724851 ± 6% -12.5% 634591 ± 8% interrupts.CPU24.LOC:Local_timer_interrupts
461.50 ± 16% -47.3% 243.00 ± 31% interrupts.CPU24.RES:Rescheduling_interrupts
724830 ± 6% -12.5% 634580 ± 8% interrupts.CPU25.LOC:Local_timer_interrupts
724793 ± 6% -12.4% 634613 ± 8% interrupts.CPU26.LOC:Local_timer_interrupts
724848 ± 6% -12.4% 634606 ± 8% interrupts.CPU27.LOC:Local_timer_interrupts
3957 ± 7% -12.1% 3479 ± 5% interrupts.CPU28.CAL:Function_call_interrupts
725000 ± 6% -12.5% 634516 ± 8% interrupts.CPU28.LOC:Local_timer_interrupts
724847 ± 6% -12.4% 634606 ± 8% interrupts.CPU29.LOC:Local_timer_interrupts
4056 ± 5% -9.9% 3653 ± 7% interrupts.CPU3.CAL:Function_call_interrupts
724920 ± 6% -12.5% 634575 ± 8% interrupts.CPU3.LOC:Local_timer_interrupts
787.50 ± 3% -73.2% 210.75 ± 65% interrupts.CPU3.RES:Rescheduling_interrupts
427.00 ± 31% +424.4% 2239 ± 88% interrupts.CPU30.38:PCI-MSI.67633153-edge.eth0-TxRx-0
724792 ± 6% -12.5% 634553 ± 8% interrupts.CPU30.LOC:Local_timer_interrupts
544.50 ± 36% -40.2% 325.50 ± 65% interrupts.CPU31.39:PCI-MSI.67633154-edge.eth0-TxRx-1
724881 ± 6% -12.5% 634558 ± 8% interrupts.CPU31.LOC:Local_timer_interrupts
724794 ± 6% -12.4% 634842 ± 7% interrupts.CPU32.LOC:Local_timer_interrupts
724836 ± 6% -12.4% 634815 ± 7% interrupts.CPU33.LOC:Local_timer_interrupts
725007 ± 6% -12.5% 634561 ± 8% interrupts.CPU34.LOC:Local_timer_interrupts
724828 ± 6% -12.5% 634578 ± 8% interrupts.CPU35.LOC:Local_timer_interrupts
725291 ± 5% -12.5% 634807 ± 8% interrupts.CPU36.LOC:Local_timer_interrupts
725043 ± 6% -12.5% 634628 ± 8% interrupts.CPU37.LOC:Local_timer_interrupts
724998 ± 6% -12.5% 634585 ± 8% interrupts.CPU38.LOC:Local_timer_interrupts
724865 ± 6% -12.5% 634533 ± 8% interrupts.CPU39.LOC:Local_timer_interrupts
4054 ± 5% -9.9% 3651 ± 7% interrupts.CPU4.CAL:Function_call_interrupts
724900 ± 6% -12.5% 634638 ± 8% interrupts.CPU4.LOC:Local_timer_interrupts
724827 ± 6% -12.4% 634647 ± 8% interrupts.CPU40.LOC:Local_timer_interrupts
725025 ± 6% -12.5% 634591 ± 8% interrupts.CPU41.LOC:Local_timer_interrupts
724811 ± 6% -12.5% 634566 ± 8% interrupts.CPU42.LOC:Local_timer_interrupts
724840 ± 6% -12.5% 634559 ± 8% interrupts.CPU43.LOC:Local_timer_interrupts
724882 ± 6% -12.5% 634572 ± 8% interrupts.CPU44.LOC:Local_timer_interrupts
473.00 ± 43% -66.0% 161.00 ± 35% interrupts.CPU44.RES:Rescheduling_interrupts
724788 ± 6% -12.5% 634544 ± 8% interrupts.CPU45.LOC:Local_timer_interrupts
724827 ± 6% -12.5% 634554 ± 8% interrupts.CPU46.LOC:Local_timer_interrupts
725262 ± 6% -12.5% 634563 ± 8% interrupts.CPU47.LOC:Local_timer_interrupts
942.00 ± 54% -79.5% 193.00 ± 32% interrupts.CPU47.RES:Rescheduling_interrupts
724996 ± 6% -12.4% 634889 ± 8% interrupts.CPU48.LOC:Local_timer_interrupts
725065 ± 6% -12.5% 634729 ± 8% interrupts.CPU49.LOC:Local_timer_interrupts
4050 ± 5% -11.6% 3580 ± 9% interrupts.CPU5.CAL:Function_call_interrupts
724911 ± 6% -12.5% 634550 ± 8% interrupts.CPU5.LOC:Local_timer_interrupts
724793 ± 6% -12.4% 634636 ± 8% interrupts.CPU50.LOC:Local_timer_interrupts
725070 ± 6% -12.4% 634880 ± 8% interrupts.CPU51.LOC:Local_timer_interrupts
724979 ± 6% -12.5% 634487 ± 8% interrupts.CPU52.LOC:Local_timer_interrupts
724845 ± 6% -12.5% 634552 ± 8% interrupts.CPU53.LOC:Local_timer_interrupts
724855 ± 6% -12.5% 634517 ± 8% interrupts.CPU54.LOC:Local_timer_interrupts
724872 ± 6% -12.5% 634550 ± 8% interrupts.CPU55.LOC:Local_timer_interrupts
547.00 ± 71% -86.4% 74.25 ± 14% interrupts.CPU55.RES:Rescheduling_interrupts
725210 ± 6% -12.5% 634545 ± 8% interrupts.CPU56.LOC:Local_timer_interrupts
724839 ± 6% -12.5% 634520 ± 8% interrupts.CPU57.LOC:Local_timer_interrupts
724849 ± 6% -12.5% 634549 ± 8% interrupts.CPU58.LOC:Local_timer_interrupts
724848 ± 6% -12.5% 634537 ± 8% interrupts.CPU59.LOC:Local_timer_interrupts
4046 ± 5% -29.1% 2867 ± 39% interrupts.CPU6.CAL:Function_call_interrupts
724899 ± 6% -12.4% 634893 ± 7% interrupts.CPU6.LOC:Local_timer_interrupts
724852 ± 6% -12.5% 634541 ± 8% interrupts.CPU60.LOC:Local_timer_interrupts
724835 ± 6% -12.5% 634558 ± 8% interrupts.CPU61.LOC:Local_timer_interrupts
724836 ± 6% -12.5% 634537 ± 8% interrupts.CPU62.LOC:Local_timer_interrupts
356.50 ± 79% -79.1% 74.50 ± 34% interrupts.CPU62.RES:Rescheduling_interrupts
724814 ± 6% -12.5% 634530 ± 8% interrupts.CPU63.LOC:Local_timer_interrupts
724832 ± 6% -12.5% 634540 ± 8% interrupts.CPU64.LOC:Local_timer_interrupts
291.50 ± 27% -59.9% 116.75 ± 73% interrupts.CPU64.RES:Rescheduling_interrupts
724836 ± 6% -12.5% 634527 ± 8% interrupts.CPU65.LOC:Local_timer_interrupts
393.50 ± 68% -79.4% 81.00 ± 85% interrupts.CPU65.RES:Rescheduling_interrupts
724816 ± 6% -12.5% 634517 ± 8% interrupts.CPU66.LOC:Local_timer_interrupts
724797 ± 6% -12.5% 634531 ± 8% interrupts.CPU67.LOC:Local_timer_interrupts
724859 ± 6% -12.5% 634603 ± 8% interrupts.CPU68.LOC:Local_timer_interrupts
724857 ± 6% -12.5% 634528 ± 8% interrupts.CPU69.LOC:Local_timer_interrupts
207.00 ± 14% -62.3% 78.00 ± 17% interrupts.CPU69.RES:Rescheduling_interrupts
4048 ± 5% -9.9% 3647 ± 7% interrupts.CPU7.CAL:Function_call_interrupts
724885 ± 6% -12.5% 634628 ± 8% interrupts.CPU7.LOC:Local_timer_interrupts
3957 ± 4% -31.5% 2712 ± 51% interrupts.CPU70.CAL:Function_call_interrupts
724851 ± 6% -12.4% 634910 ± 8% interrupts.CPU70.LOC:Local_timer_interrupts
724846 ± 6% -12.4% 634757 ± 8% interrupts.CPU71.LOC:Local_timer_interrupts
724934 ± 6% -12.4% 634715 ± 8% interrupts.CPU72.LOC:Local_timer_interrupts
207.50 ± 42% -53.9% 95.75 ± 30% interrupts.CPU72.RES:Rescheduling_interrupts
724851 ± 6% -12.5% 634521 ± 8% interrupts.CPU73.LOC:Local_timer_interrupts
724839 ± 6% -12.4% 634662 ± 8% interrupts.CPU74.LOC:Local_timer_interrupts
36.50 ± 45% +189.7% 105.75 ± 63% interrupts.CPU74.RES:Rescheduling_interrupts
724804 ± 6% -12.5% 634475 ± 8% interrupts.CPU75.LOC:Local_timer_interrupts
724844 ± 6% -12.5% 634542 ± 8% interrupts.CPU76.LOC:Local_timer_interrupts
724793 ± 6% -12.5% 634521 ± 8% interrupts.CPU77.LOC:Local_timer_interrupts
724810 ± 6% -12.5% 634558 ± 8% interrupts.CPU78.LOC:Local_timer_interrupts
725383 ± 5% -12.5% 634554 ± 8% interrupts.CPU79.LOC:Local_timer_interrupts
4047 ± 5% -9.9% 3646 ± 7% interrupts.CPU8.CAL:Function_call_interrupts
725001 ± 6% -12.5% 634592 ± 8% interrupts.CPU8.LOC:Local_timer_interrupts
724741 ± 6% -12.4% 634550 ± 8% interrupts.CPU80.LOC:Local_timer_interrupts
724804 ± 6% -12.4% 634590 ± 8% interrupts.CPU81.LOC:Local_timer_interrupts
136.00 ± 20% -46.1% 73.25 ± 46% interrupts.CPU81.RES:Rescheduling_interrupts
724814 ± 6% -12.4% 634663 ± 8% interrupts.CPU82.LOC:Local_timer_interrupts
724798 ± 6% -12.4% 634580 ± 8% interrupts.CPU83.LOC:Local_timer_interrupts
724776 ± 6% -12.4% 634573 ± 8% interrupts.CPU84.LOC:Local_timer_interrupts
724799 ± 6% -12.5% 634509 ± 8% interrupts.CPU85.LOC:Local_timer_interrupts
724813 ± 6% -12.4% 634585 ± 8% interrupts.CPU86.LOC:Local_timer_interrupts
724825 ± 6% -12.4% 634632 ± 8% interrupts.CPU87.LOC:Local_timer_interrupts
724795 ± 6% -12.4% 634576 ± 8% interrupts.CPU88.LOC:Local_timer_interrupts
724770 ± 6% -12.5% 634536 ± 8% interrupts.CPU89.LOC:Local_timer_interrupts
4047 ± 5% -9.9% 3645 ± 7% interrupts.CPU9.CAL:Function_call_interrupts
724892 ± 6% -12.5% 634619 ± 8% interrupts.CPU9.LOC:Local_timer_interrupts
376.50 ± 16% -34.8% 245.50 ± 36% interrupts.CPU9.RES:Rescheduling_interrupts
724994 ± 6% -12.5% 634556 ± 8% interrupts.CPU90.LOC:Local_timer_interrupts
4056 ± 3% -9.3% 3679 ± 9% interrupts.CPU91.CAL:Function_call_interrupts
725105 ± 6% -12.5% 634555 ± 8% interrupts.CPU91.LOC:Local_timer_interrupts
1244 ± 14% -93.0% 87.25 ± 46% interrupts.CPU91.RES:Rescheduling_interrupts
4055 ± 3% -9.3% 3680 ± 9% interrupts.CPU92.CAL:Function_call_interrupts
724815 ± 6% -12.5% 634562 ± 8% interrupts.CPU92.LOC:Local_timer_interrupts
4055 ± 3% -11.2% 3600 ± 11% interrupts.CPU93.CAL:Function_call_interrupts
724766 ± 6% -12.4% 634625 ± 8% interrupts.CPU93.LOC:Local_timer_interrupts
4055 ± 3% -9.3% 3678 ± 9% interrupts.CPU94.CAL:Function_call_interrupts
724774 ± 6% -12.4% 634595 ± 8% interrupts.CPU94.LOC:Local_timer_interrupts
4056 ± 3% -9.3% 3678 ± 9% interrupts.CPU95.CAL:Function_call_interrupts
724821 ± 6% -12.5% 634538 ± 8% interrupts.CPU95.LOC:Local_timer_interrupts
4054 ± 3% -9.3% 3677 ± 9% interrupts.CPU96.CAL:Function_call_interrupts
724843 ± 6% -12.5% 634588 ± 8% interrupts.CPU96.LOC:Local_timer_interrupts
4052 ± 3% -9.3% 3676 ± 9% interrupts.CPU97.CAL:Function_call_interrupts
724768 ± 6% -12.5% 634487 ± 8% interrupts.CPU97.LOC:Local_timer_interrupts
4052 ± 3% -9.3% 3674 ± 9% interrupts.CPU98.CAL:Function_call_interrupts
724755 ± 6% -12.5% 634475 ± 8% interrupts.CPU98.LOC:Local_timer_interrupts
4049 ± 3% -9.3% 3673 ± 9% interrupts.CPU99.CAL:Function_call_interrupts
724805 ± 6% -12.5% 634549 ± 8% interrupts.CPU99.LOC:Local_timer_interrupts
131.50 ± 17% -64.4% 46.75 ± 53% interrupts.CPU99.RES:Rescheduling_interrupts
75388998 ± 6% -12.5% 65998072 ± 8% interrupts.LOC:Local_timer_interrupts
25004 ± 9% -21.2% 19700 ± 7% softirqs.CPU0.RCU
15669 ± 18% -37.9% 9737 ± 34% softirqs.CPU0.SCHED
126083 ± 2% -11.1% 112142 ± 8% softirqs.CPU0.TIMER
25411 ± 8% -23.0% 19570 ± 9% softirqs.CPU1.RCU
11537 ± 20% -44.6% 6395 ± 56% softirqs.CPU1.SCHED
120730 ± 3% -11.2% 107226 ± 8% softirqs.CPU1.TIMER
24824 ± 8% -21.7% 19434 ± 8% softirqs.CPU10.RCU
10474 ± 26% -52.6% 4961 ± 62% softirqs.CPU10.SCHED
121764 ± 4% -11.8% 107392 ± 9% softirqs.CPU10.TIMER
23424 ± 5% -18.9% 18987 ± 9% softirqs.CPU100.RCU
10156 ± 27% -51.7% 4908 ± 60% softirqs.CPU100.SCHED
116809 ± 8% -10.8% 104157 ± 6% softirqs.CPU100.TIMER
23590 ± 5% -21.0% 18625 ± 11% softirqs.CPU101.RCU
9993 ± 26% -50.3% 4963 ± 58% softirqs.CPU101.SCHED
23660 ± 5% -19.1% 19132 ± 8% softirqs.CPU102.RCU
10152 ± 25% -50.0% 5075 ± 57% softirqs.CPU102.SCHED
116880 ± 7% -10.3% 104784 ± 6% softirqs.CPU102.TIMER
23908 ± 5% -20.9% 18901 ± 9% softirqs.CPU103.RCU
10194 ± 27% -53.1% 4784 ± 59% softirqs.CPU103.SCHED
117200 ± 7% -10.5% 104886 ± 6% softirqs.CPU103.TIMER
25032 ± 7% -17.5% 20650 ± 11% softirqs.CPU11.RCU
10329 ± 26% -52.3% 4925 ± 62% softirqs.CPU11.SCHED
121537 ± 4% -12.0% 106948 ± 7% softirqs.CPU11.TIMER
25394 ± 6% -21.4% 19952 ± 9% softirqs.CPU12.RCU
10418 ± 26% -49.5% 5262 ± 60% softirqs.CPU12.SCHED
122403 ± 3% -11.3% 108568 ± 8% softirqs.CPU12.TIMER
24900 ± 8% -19.4% 20062 ± 7% softirqs.CPU13.RCU
10518 ± 25% -52.8% 4963 ± 60% softirqs.CPU13.SCHED
122812 ± 3% -12.4% 107590 ± 8% softirqs.CPU13.TIMER
25186 ± 6% -21.6% 19757 ± 7% softirqs.CPU14.RCU
10375 ± 25% -50.0% 5192 ± 56% softirqs.CPU14.SCHED
121797 ± 3% -11.5% 107780 ± 8% softirqs.CPU14.TIMER
26656 ± 4% -20.5% 21185 ± 11% softirqs.CPU15.RCU
10403 ± 27% -52.9% 4899 ± 62% softirqs.CPU15.SCHED
122923 ± 3% -12.2% 107916 ± 8% softirqs.CPU15.TIMER
26886 ± 5% -20.3% 21439 ± 8% softirqs.CPU16.RCU
10392 ± 25% -52.4% 4949 ± 62% softirqs.CPU16.SCHED
120183 ± 3% -10.8% 107215 ± 8% softirqs.CPU16.TIMER
27151 ± 5% -20.2% 21667 ± 8% softirqs.CPU17.RCU
10435 ± 26% -53.1% 4890 ± 64% softirqs.CPU17.SCHED
121575 ± 4% -11.4% 107716 ± 9% softirqs.CPU17.TIMER
27796 ± 5% -25.5% 20714 ± 3% softirqs.CPU18.RCU
10724 ± 26% -52.9% 5056 ± 64% softirqs.CPU18.SCHED
27455 ± 5% -21.5% 21563 ± 9% softirqs.CPU19.RCU
10306 ± 27% -52.5% 4893 ± 62% softirqs.CPU19.SCHED
121891 ± 4% -11.4% 107976 ± 8% softirqs.CPU19.TIMER
24607 ± 8% -22.6% 19047 ± 11% softirqs.CPU2.RCU
10438 ± 22% -51.5% 5063 ± 62% softirqs.CPU2.SCHED
151408 ± 17% -19.4% 122005 ± 19% softirqs.CPU2.TIMER
27248 ± 6% -21.9% 21269 ± 8% softirqs.CPU20.RCU
10352 ± 26% -52.2% 4951 ± 64% softirqs.CPU20.SCHED
121220 ± 3% -11.5% 107331 ± 9% softirqs.CPU20.TIMER
27187 ± 6% -22.4% 21099 ± 9% softirqs.CPU21.RCU
10328 ± 26% -52.6% 4891 ± 64% softirqs.CPU21.SCHED
121129 ± 3% -11.1% 107655 ± 8% softirqs.CPU21.TIMER
27567 ± 5% -24.1% 20916 ± 9% softirqs.CPU22.RCU
10754 ± 27% -54.7% 4869 ± 65% softirqs.CPU22.SCHED
122570 ± 4% -12.5% 107275 ± 9% softirqs.CPU22.TIMER
26933 ± 3% -21.0% 21277 ± 9% softirqs.CPU23.RCU
10370 ± 25% -51.6% 5022 ± 60% softirqs.CPU23.SCHED
121107 ± 3% -10.8% 107975 ± 8% softirqs.CPU23.TIMER
27660 ± 6% -22.3% 21493 ± 8% softirqs.CPU24.RCU
10798 ± 27% -54.9% 4871 ± 64% softirqs.CPU24.SCHED
122703 ± 4% -12.4% 107531 ± 9% softirqs.CPU24.TIMER
27310 ± 4% -20.8% 21633 ± 8% softirqs.CPU25.RCU
10250 ± 26% -51.7% 4954 ± 63% softirqs.CPU25.SCHED
121256 ± 4% -11.6% 107135 ± 8% softirqs.CPU25.TIMER
23740 ± 8% -18.6% 19321 ± 5% softirqs.CPU26.RCU
10945 ± 31% -51.1% 5355 ± 55% softirqs.CPU26.SCHED
121341 ± 9% -10.3% 108813 ± 7% softirqs.CPU26.TIMER
23828 ± 5% -20.6% 18923 ± 8% softirqs.CPU27.RCU
10228 ± 27% -47.0% 5426 ± 60% softirqs.CPU27.SCHED
120251 ± 8% -10.9% 107084 ± 7% softirqs.CPU27.TIMER
23084 ± 8% -18.8% 18747 ± 7% softirqs.CPU28.RCU
10381 ± 26% -50.6% 5130 ± 60% softirqs.CPU28.SCHED
120139 ± 8% -10.9% 107007 ± 8% softirqs.CPU28.TIMER
23702 ± 7% -20.6% 18811 ± 7% softirqs.CPU29.RCU
10527 ± 27% -52.4% 5015 ± 60% softirqs.CPU29.SCHED
120596 ± 9% -12.3% 105794 ± 7% softirqs.CPU29.TIMER
30315 ± 6% -23.5% 23191 ± 2% softirqs.CPU3.RCU
9571 ± 27% -55.8% 4229 ± 84% softirqs.CPU3.SCHED
123426 ± 4% -11.4% 109383 ± 7% softirqs.CPU3.TIMER
25358 ± 4% -20.3% 20206 ± 10% softirqs.CPU30.RCU
10496 ± 26% -51.6% 5078 ± 57% softirqs.CPU30.SCHED
120553 ± 9% -12.6% 105383 ± 6% softirqs.CPU30.TIMER
25501 ± 4% -17.2% 21106 ± 9% softirqs.CPU31.RCU
10459 ± 26% -49.6% 5270 ± 55% softirqs.CPU31.SCHED
25381 ± 4% -16.0% 21317 ± 10% softirqs.CPU32.RCU
10391 ± 26% -51.0% 5096 ± 57% softirqs.CPU32.SCHED
25123 ± 5% -16.8% 20896 ± 11% softirqs.CPU33.RCU
10283 ± 28% -51.1% 5027 ± 59% softirqs.CPU33.SCHED
120195 ± 8% -11.6% 106230 ± 7% softirqs.CPU33.TIMER
25878 ± 9% -23.9% 19702 ± 9% softirqs.CPU34.RCU
10216 ± 26% -52.0% 4901 ± 62% softirqs.CPU34.SCHED
117515 ± 8% -10.8% 104855 ± 7% softirqs.CPU34.TIMER
24878 ± 5% -19.2% 20112 ± 11% softirqs.CPU35.RCU
10257 ± 25% -52.6% 4858 ± 63% softirqs.CPU35.SCHED
118125 ± 7% -10.6% 105629 ± 7% softirqs.CPU35.TIMER
10428 ± 26% -52.8% 4921 ± 60% softirqs.CPU36.SCHED
121534 ± 10% -13.2% 105520 ± 6% softirqs.CPU36.TIMER
25396 ± 4% -17.7% 20905 ± 13% softirqs.CPU37.RCU
10349 ± 26% -52.2% 4951 ± 58% softirqs.CPU37.SCHED
119384 ± 8% -10.1% 107347 ± 9% softirqs.CPU37.TIMER
25347 ± 4% -20.2% 20217 ± 10% softirqs.CPU38.RCU
10228 ± 25% -52.0% 4909 ± 63% softirqs.CPU38.SCHED
118248 ± 9% -11.6% 104555 ± 7% softirqs.CPU38.TIMER
24401 ± 5% -18.9% 19797 ± 9% softirqs.CPU39.RCU
10282 ± 28% -52.4% 4894 ± 63% softirqs.CPU39.SCHED
118684 ± 9% -10.9% 105689 ± 6% softirqs.CPU39.TIMER
25348 ± 8% -23.4% 19411 ± 7% softirqs.CPU4.RCU
10572 ± 24% -55.7% 4683 ± 53% softirqs.CPU4.SCHED
121683 ± 3% -11.9% 107223 ± 6% softirqs.CPU4.TIMER
24886 ± 4% -18.8% 20196 ± 9% softirqs.CPU40.RCU
10243 ± 29% -52.4% 4871 ± 66% softirqs.CPU40.SCHED
119709 ± 8% -12.6% 104654 ± 6% softirqs.CPU40.TIMER
24894 ± 4% -19.9% 19949 ± 9% softirqs.CPU41.RCU
10387 ± 26% -52.5% 4935 ± 61% softirqs.CPU41.SCHED
119698 ± 9% -11.9% 105492 ± 7% softirqs.CPU41.TIMER
24643 ± 5% -19.6% 19814 ± 9% softirqs.CPU42.RCU
10331 ± 27% -52.8% 4872 ± 62% softirqs.CPU42.SCHED
118951 ± 9% -11.3% 105479 ± 7% softirqs.CPU42.TIMER
25101 ± 5% -20.4% 19986 ± 10% softirqs.CPU43.RCU
10389 ± 27% -52.4% 4946 ± 63% softirqs.CPU43.SCHED
119396 ± 9% -10.7% 106657 ± 6% softirqs.CPU43.TIMER
25028 ± 5% -20.4% 19921 ± 11% softirqs.CPU44.RCU
10417 ± 27% -52.4% 4963 ± 63% softirqs.CPU44.SCHED
119507 ± 8% -11.6% 105654 ± 7% softirqs.CPU44.TIMER
24740 ± 7% -20.7% 19623 ± 9% softirqs.CPU45.RCU
10271 ± 27% -52.0% 4928 ± 63% softirqs.CPU45.SCHED
120900 ± 10% -12.7% 105515 ± 7% softirqs.CPU45.TIMER
24194 ± 5% -20.0% 19365 ± 9% softirqs.CPU46.RCU
10215 ± 27% -52.9% 4813 ± 63% softirqs.CPU46.SCHED
117717 ± 8% -10.3% 105546 ± 6% softirqs.CPU46.TIMER
26363 ± 14% -26.8% 19288 ± 8% softirqs.CPU47.RCU
10630 ± 28% -53.3% 4959 ± 62% softirqs.CPU47.SCHED
153681 ± 29% -30.7% 106520 ± 6% softirqs.CPU47.TIMER
24560 ± 6% -17.6% 20234 ± 9% softirqs.CPU48.RCU
10522 ± 28% -50.1% 5246 ± 65% softirqs.CPU48.SCHED
119773 ± 9% -11.1% 106465 ± 8% softirqs.CPU48.TIMER
24248 ± 6% -16.5% 20257 ± 9% softirqs.CPU49.RCU
10304 ± 26% -49.2% 5236 ± 64% softirqs.CPU49.SCHED
25508 ± 5% -23.1% 19625 ± 6% softirqs.CPU5.RCU
11240 ± 18% -55.0% 5054 ± 63% softirqs.CPU5.SCHED
122918 ± 3% -12.1% 108038 ± 8% softirqs.CPU5.TIMER
24209 ± 6% -20.1% 19336 ± 8% softirqs.CPU50.RCU
10363 ± 27% -52.3% 4938 ± 63% softirqs.CPU50.SCHED
119407 ± 8% -11.7% 105413 ± 7% softirqs.CPU50.TIMER
24871 ± 6% -21.3% 19561 ± 8% softirqs.CPU51.RCU
10335 ± 26% -52.3% 4929 ± 60% softirqs.CPU51.SCHED
118866 ± 8% -11.4% 105277 ± 6% softirqs.CPU51.TIMER
26596 -20.8% 21071 ± 8% softirqs.CPU52.RCU
9943 ± 28% -53.9% 4584 ± 66% softirqs.CPU52.SCHED
122270 -11.5% 108169 ± 6% softirqs.CPU52.TIMER
26168 ± 2% -22.0% 20422 ± 10% softirqs.CPU53.RCU
10015 ± 24% -52.0% 4808 ± 60% softirqs.CPU53.SCHED
119599 ± 3% -10.9% 106546 ± 7% softirqs.CPU53.TIMER
26676 ± 9% -21.7% 20898 ± 9% softirqs.CPU54.RCU
9878 ± 24% -50.8% 4862 ± 59% softirqs.CPU54.SCHED
131558 -16.4% 109981 ± 7% softirqs.CPU54.TIMER
26496 ± 2% -22.1% 20638 ± 9% softirqs.CPU55.RCU
11106 ± 19% -55.5% 4938 ± 61% softirqs.CPU55.SCHED
122412 ± 2% -12.6% 106958 ± 7% softirqs.CPU55.TIMER
26037 ± 2% -21.6% 20406 ± 9% softirqs.CPU56.RCU
10665 ± 20% -47.9% 5560 ± 71% softirqs.CPU56.SCHED
25791 ± 7% -17.8% 21196 ± 9% softirqs.CPU57.RCU
10431 ± 25% -52.4% 4962 ± 61% softirqs.CPU57.SCHED
120641 ± 3% -11.6% 106603 ± 7% softirqs.CPU57.TIMER
26681 ± 5% -21.4% 20959 ± 8% softirqs.CPU58.RCU
11205 ± 32% -45.8% 6077 ± 42% softirqs.CPU58.SCHED
122037 ± 5% -10.5% 109250 ± 6% softirqs.CPU58.TIMER
23683 ± 8% -14.3% 20296 ± 10% softirqs.CPU59.RCU
10111 ± 27% -46.3% 5429 ± 48% softirqs.CPU59.SCHED
120125 ± 3% -9.9% 108220 ± 6% softirqs.CPU59.TIMER
25325 ± 7% -19.6% 20370 ± 7% softirqs.CPU6.RCU
10533 ± 25% -51.9% 5068 ± 62% softirqs.CPU6.SCHED
122777 ± 4% -11.8% 108335 ± 9% softirqs.CPU6.TIMER
24520 ± 5% -22.1% 19089 ± 5% softirqs.CPU60.RCU
9912 ± 25% -49.8% 4973 ± 55% softirqs.CPU60.SCHED
119523 ± 3% -10.9% 106500 ± 7% softirqs.CPU60.TIMER
25488 ± 3% -24.0% 19368 ± 7% softirqs.CPU61.RCU
10657 ± 21% -53.7% 4934 ± 61% softirqs.CPU61.SCHED
121466 ± 2% -12.7% 106013 ± 7% softirqs.CPU61.TIMER
25616 ± 2% -23.3% 19639 ± 6% softirqs.CPU62.RCU
10458 ± 22% -53.0% 4911 ± 61% softirqs.CPU62.SCHED
121001 ± 2% -12.0% 106490 ± 8% softirqs.CPU62.TIMER
24904 ± 6% -19.8% 19964 ± 7% softirqs.CPU63.RCU
10133 ± 26% -52.5% 4817 ± 60% softirqs.CPU63.SCHED
120377 ± 3% -11.1% 107060 ± 7% softirqs.CPU63.TIMER
25300 ± 6% -22.9% 19502 ± 7% softirqs.CPU64.RCU
10339 ± 25% -53.4% 4818 ± 59% softirqs.CPU64.SCHED
121065 ± 3% -12.0% 106536 ± 7% softirqs.CPU64.TIMER
24390 ± 6% -21.2% 19219 ± 7% softirqs.CPU65.RCU
10243 ± 26% -52.8% 4835 ± 58% softirqs.CPU65.SCHED
120361 ± 3% -11.6% 106361 ± 7% softirqs.CPU65.TIMER
24294 ± 5% -21.5% 19076 ± 6% softirqs.CPU66.RCU
10087 ± 26% -52.1% 4830 ± 61% softirqs.CPU66.SCHED
119195 ± 3% -11.3% 105682 ± 7% softirqs.CPU66.TIMER
24897 ± 6% -22.6% 19270 ± 6% softirqs.CPU67.RCU
10195 ± 26% -53.4% 4749 ± 61% softirqs.CPU67.SCHED
120417 ± 3% -11.6% 106408 ± 7% softirqs.CPU67.TIMER
24781 ± 6% -21.3% 19494 ± 7% softirqs.CPU68.RCU
9903 ± 24% -51.1% 4843 ± 61% softirqs.CPU68.SCHED
119069 ± 3% -11.0% 106000 ± 7% softirqs.CPU68.TIMER
25233 ± 7% -22.9% 19443 ± 6% softirqs.CPU69.RCU
10296 ± 28% -52.5% 4885 ± 61% softirqs.CPU69.SCHED
121138 ± 3% -12.1% 106433 ± 7% softirqs.CPU69.TIMER
25059 ± 6% -22.6% 19392 ± 7% softirqs.CPU7.RCU
10369 ± 25% -52.2% 4957 ± 62% softirqs.CPU7.SCHED
120311 ± 3% -10.2% 107998 ± 7% softirqs.CPU7.TIMER
25219 ± 7% -21.1% 19906 ± 11% softirqs.CPU70.RCU
10439 ± 27% -51.8% 5036 ± 66% softirqs.CPU70.SCHED
25498 ± 5% -23.3% 19550 ± 7% softirqs.CPU71.RCU
10221 ± 28% -51.4% 4967 ± 62% softirqs.CPU71.SCHED
120633 ± 3% -10.8% 107627 ± 8% softirqs.CPU71.TIMER
24800 ± 9% -23.3% 19030 ± 6% softirqs.CPU72.RCU
10200 ± 26% -52.5% 4849 ± 63% softirqs.CPU72.SCHED
119784 ± 3% -11.1% 106521 ± 7% softirqs.CPU72.TIMER
24282 ± 6% -21.3% 19121 ± 7% softirqs.CPU73.RCU
10077 ± 27% -52.2% 4814 ± 60% softirqs.CPU73.SCHED
119472 ± 3% -10.4% 107099 ± 7% softirqs.CPU73.TIMER
24644 ± 7% -20.9% 19481 ± 5% softirqs.CPU74.RCU
10184 ± 26% -51.9% 4896 ± 64% softirqs.CPU74.SCHED
120642 ± 3% -10.6% 107823 ± 7% softirqs.CPU74.TIMER
23779 -18.5% 19386 ± 11% softirqs.CPU75.RCU
10152 ± 25% -50.2% 5057 ± 57% softirqs.CPU75.SCHED
119828 ± 3% -10.7% 107037 ± 7% softirqs.CPU75.TIMER
24147 -21.0% 19071 ± 11% softirqs.CPU76.RCU
10219 ± 27% -52.1% 4891 ± 63% softirqs.CPU76.SCHED
120303 ± 3% -11.2% 106870 ± 7% softirqs.CPU76.TIMER
23978 ± 2% -19.5% 19297 ± 11% softirqs.CPU77.RCU
10049 ± 26% -52.1% 4812 ± 63% softirqs.CPU77.SCHED
120569 ± 4% -11.2% 107013 ± 7% softirqs.CPU77.TIMER
26025 ± 7% -19.3% 21013 ± 7% softirqs.CPU78.RCU
10316 ± 27% -52.4% 4913 ± 62% softirqs.CPU78.SCHED
118629 ± 8% -11.5% 104972 ± 6% softirqs.CPU78.TIMER
28161 -26.1% 20805 ± 8% softirqs.CPU79.RCU
10220 ± 27% -52.5% 4852 ± 59% softirqs.CPU79.SCHED
118619 ± 6% -10.6% 106003 ± 5% softirqs.CPU79.TIMER
24943 ± 8% -18.3% 20366 ± 14% softirqs.CPU8.RCU
10225 ± 25% -51.3% 4981 ± 62% softirqs.CPU8.SCHED
26077 ± 5% -19.4% 21025 ± 7% softirqs.CPU80.RCU
10158 ± 27% -51.2% 4952 ± 61% softirqs.CPU80.SCHED
116931 ± 7% -10.5% 104696 ± 6% softirqs.CPU80.TIMER
25822 ± 5% -18.5% 21057 ± 8% softirqs.CPU81.RCU
10243 ± 27% -50.1% 5107 ± 60% softirqs.CPU81.SCHED
117806 ± 8% -10.5% 105440 ± 6% softirqs.CPU81.TIMER
26239 ± 3% -20.0% 20989 ± 8% softirqs.CPU82.RCU
10380 ± 25% -52.6% 4923 ± 59% softirqs.CPU82.SCHED
118098 ± 7% -11.5% 104476 ± 5% softirqs.CPU82.TIMER
25775 ± 5% -19.1% 20863 ± 9% softirqs.CPU83.RCU
10281 ± 27% -52.9% 4846 ± 62% softirqs.CPU83.SCHED
117693 ± 7% -10.9% 104919 ± 5% softirqs.CPU83.TIMER
26236 ± 3% -22.8% 20262 ± 10% softirqs.CPU84.RCU
10342 ± 24% -53.6% 4801 ± 63% softirqs.CPU84.SCHED
25691 ± 5% -19.6% 20659 ± 7% softirqs.CPU85.RCU
10028 ± 25% -51.8% 4835 ± 61% softirqs.CPU85.SCHED
117679 ± 7% -11.5% 104180 ± 6% softirqs.CPU85.TIMER
25817 ± 5% -20.2% 20600 ± 7% softirqs.CPU86.RCU
9970 ± 24% -51.4% 4845 ± 61% softirqs.CPU86.SCHED
116540 ± 7% -10.7% 104114 ± 6% softirqs.CPU86.TIMER
25592 ± 5% -18.8% 20772 ± 7% softirqs.CPU87.RCU
9972 ± 25% -52.2% 4771 ± 63% softirqs.CPU87.SCHED
25677 ± 4% -18.1% 21026 ± 11% softirqs.CPU88.RCU
10068 ± 26% -51.9% 4846 ± 62% softirqs.CPU88.SCHED
116101 ± 8% -11.1% 103165 ± 5% softirqs.CPU88.TIMER
25912 ± 4% -19.8% 20791 ± 9% softirqs.CPU89.RCU
10031 ± 25% -51.3% 4887 ± 61% softirqs.CPU89.SCHED
116645 ± 8% -10.7% 104109 ± 6% softirqs.CPU89.TIMER
25175 ± 7% -22.7% 19468 ± 7% softirqs.CPU9.RCU
10432 ± 25% -52.3% 4976 ± 64% softirqs.CPU9.SCHED
122050 ± 4% -11.0% 108685 ± 9% softirqs.CPU9.TIMER
23732 ± 5% -21.0% 18753 ± 10% softirqs.CPU90.RCU
9933 ± 26% -50.4% 4923 ± 62% softirqs.CPU90.SCHED
117366 ± 8% -11.0% 104449 ± 6% softirqs.CPU90.TIMER
23143 ± 6% -19.7% 18585 ± 11% softirqs.CPU91.RCU
10167 ± 27% -51.8% 4896 ± 62% softirqs.CPU91.SCHED
117601 ± 7% -10.5% 105247 ± 6% softirqs.CPU91.TIMER
23210 ± 5% -20.0% 18557 ± 11% softirqs.CPU92.RCU
10021 ± 27% -51.1% 4902 ± 64% softirqs.CPU92.SCHED
117214 ± 7% -11.0% 104328 ± 6% softirqs.CPU92.TIMER
23205 ± 5% -18.8% 18833 ± 11% softirqs.CPU93.RCU
10266 ± 26% -53.0% 4829 ± 64% softirqs.CPU93.SCHED
117639 ± 8% -11.6% 104015 ± 6% softirqs.CPU93.TIMER
23380 ± 6% -19.9% 18733 ± 9% softirqs.CPU94.RCU
10121 ± 27% -51.6% 4895 ± 58% softirqs.CPU94.SCHED
116999 ± 8% -10.7% 104443 ± 6% softirqs.CPU94.TIMER
23557 ± 6% -20.0% 18841 ± 10% softirqs.CPU95.RCU
10149 ± 27% -52.5% 4821 ± 61% softirqs.CPU95.SCHED
117289 ± 7% -10.0% 105603 ± 5% softirqs.CPU95.TIMER
23878 ± 5% -20.4% 19012 ± 10% softirqs.CPU96.RCU
10229 ± 26% -52.0% 4908 ± 61% softirqs.CPU96.SCHED
117016 ± 7% -10.7% 104510 ± 6% softirqs.CPU96.TIMER
23850 ± 5% -20.0% 19072 ± 11% softirqs.CPU97.RCU
10190 ± 26% -52.1% 4883 ± 62% softirqs.CPU97.SCHED
117524 ± 7% -11.1% 104466 ± 6% softirqs.CPU97.TIMER
23372 ± 6% -19.9% 18727 ± 10% softirqs.CPU98.RCU
9963 ± 26% -52.8% 4703 ± 62% softirqs.CPU98.SCHED
116603 ± 8% -10.7% 104085 ± 6% softirqs.CPU98.TIMER
23132 ± 3% -19.4% 18635 ± 10% softirqs.CPU99.RCU
10125 ± 27% -51.9% 4871 ± 60% softirqs.CPU99.SCHED
124560 ± 12% -15.4% 105347 ± 5% softirqs.CPU99.TIMER
2624078 ± 5% -20.7% 2081456 ± 8% softirqs.RCU
1078525 ± 26% -51.7% 521298 ± 60% softirqs.SCHED
12549277 ± 6% -11.3% 11135773 ± 7% softirqs.TIMER
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0