[x86/entry] 8c5045f89b: will-it-scale.per_process_ops -12.9% regression
by kernel test robot
Greeting,
FYI, we noticed a -12.9% regression of will-it-scale.per_process_ops due to commit:
commit: 8c5045f89b181a4412b698cafc9dc257192a3a65 ("x86/entry: Enable random_kstack_offset support")
https://git.kernel.org/cgit/linux/kernel/git/kees/linux.git kspp/stack/offset/agnostic/v1
in testcase: will-it-scale
on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory
with following parameters:
nr_task: 100%
mode: process
test: lseek1
cpufreq_governor: performance
ucode: 0x11
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-20191114.cgz/lkp-knm01/lseek1/will-it-scale/0x11
commit:
3dd7e7ac5e ("stack: Optionally randomize kernel stack offset each syscall")
8c5045f89b ("x86/entry: Enable random_kstack_offset support")
3dd7e7ac5ef51bef 8c5045f89b181a4412b698cafc9
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:4 50% 2:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
%stddev %change %stddev
\ | \
334540 -12.9% 291311 will-it-scale.per_process_ops
311.95 +1.5% 316.63 will-it-scale.time.elapsed_time
311.95 +1.5% 316.63 will-it-scale.time.elapsed_time.max
96347834 -12.9% 83897839 will-it-scale.workload
867.00 ± 68% -45.4% 473.25 ± 2% cpuidle.POLL.usage
0.00 ± 22% +0.0 0.00 ± 29% mpstat.cpu.all.soft%
33673 ± 4% +27.5% 42950 numa-meminfo.node0.Mapped
8519 ± 4% +26.3% 10759 numa-vmstat.node0.nr_mapped
44724 ± 3% +20.7% 53969 meminfo.Mapped
11436 ± 4% +5.8% 12104 ± 5% meminfo.max_used_kB
52.25 +2.9% 53.75 vmstat.cpu.sy
45.50 -4.9% 43.25 vmstat.cpu.us
1242 ± 8% +39.1% 1728 ± 9% slabinfo.pool_workqueue.active_objs
1258 ± 7% +38.6% 1744 ± 9% slabinfo.pool_workqueue.num_objs
798.25 ± 8% +32.3% 1056 ± 9% slabinfo.skbuff_fclone_cache.active_objs
798.25 ± 8% +32.3% 1056 ± 9% slabinfo.skbuff_fclone_cache.num_objs
133626 +2.2% 136556 proc-vmstat.nr_active_anon
11260 ± 3% +20.2% 13540 proc-vmstat.nr_mapped
133626 +2.2% 136556 proc-vmstat.nr_zone_active_anon
935337 -1.4% 922644 proc-vmstat.numa_hit
935337 -1.4% 922644 proc-vmstat.numa_local
2356 ± 2% +14.0% 2685 ± 5% proc-vmstat.pgactivate
1020296 -2.8% 991613 proc-vmstat.pgalloc_normal
870609 -2.3% 850589 proc-vmstat.pgfault
1990 ± 4% +43.4% 2853 ± 4% sched_debug.cfs_rq:/.exec_clock.stddev
851835 ± 3% +36.6% 1163841 ± 4% sched_debug.cfs_rq:/.min_vruntime.stddev
0.03 ± 23% +35.9% 0.05 ± 11% sched_debug.cfs_rq:/.nr_running.stddev
1.83 ± 6% +20.0% 2.20 sched_debug.cfs_rq:/.nr_spread_over.avg
-6622421 +30.1% -8616279 sched_debug.cfs_rq:/.spread0.min
497607 ± 6% +29.5% 644599 ± 7% sched_debug.cfs_rq:/.spread0.stddev
1942 ± 2% +41.1% 2741 ± 3% sched_debug.cpu.clock.stddev
1942 ± 2% +41.1% 2741 ± 3% sched_debug.cpu.clock_task.stddev
349394 ± 11% +20.8% 422164 ± 7% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 ± 2% +41.6% 0.00 ± 3% sched_debug.cpu.next_balance.stddev
0.10 ± 13% +18.1% 0.12 ± 8% sched_debug.cpu.nr_running.stddev
17187 ± 7% +67.7% 28831 ± 38% sched_debug.cpu.nr_switches.max
1836 ± 5% +34.3% 2467 ± 16% sched_debug.cpu.nr_switches.stddev
11711 ± 13% +107.1% 24250 ± 47% sched_debug.cpu.sched_count.max
1413 ± 5% +46.2% 2066 ± 22% sched_debug.cpu.sched_count.stddev
5063 ± 13% +122.3% 11254 ± 44% sched_debug.cpu.ttwu_count.max
639.38 ± 8% +52.2% 972.84 ± 23% sched_debug.cpu.ttwu_count.stddev
4213 ± 12% +149.2% 10499 ± 48% sched_debug.cpu.ttwu_local.max
504.61 ± 6% +71.7% 866.25 ± 26% sched_debug.cpu.ttwu_local.stddev
6.236e+09 -10.9% 5.556e+09 perf-stat.i.branch-instructions
8.35 -0.5 7.86 perf-stat.i.branch-miss-rate%
5.211e+08 -16.1% 4.373e+08 perf-stat.i.branch-misses
50328901 ± 2% -6.3% 47148698 ± 3% perf-stat.i.cache-misses
1.261e+09 -6.7% 1.176e+09 ± 2% perf-stat.i.cache-references
14.96 +8.9% 16.29 perf-stat.i.cpi
258.22 -7.3% 239.33 ± 3% perf-stat.i.cpu-migrations
8795 +6.4% 9362 ± 3% perf-stat.i.cycles-between-cache-misses
1.44 -0.0 1.40 perf-stat.i.iTLB-load-miss-rate%
4.339e+08 -11.5% 3.841e+08 perf-stat.i.iTLB-load-misses
2.961e+10 -8.5% 2.711e+10 perf-stat.i.iTLB-loads
2.957e+10 -8.4% 2.707e+10 perf-stat.i.instructions
68.40 +3.3% 70.68 perf-stat.i.instructions-per-iTLB-miss
0.07 -7.8% 0.06 perf-stat.i.ipc
2747 -1.8% 2697 perf-stat.i.minor-faults
2747 -1.8% 2697 perf-stat.i.page-faults
42.73 +2.0% 43.59 perf-stat.overall.MPKI
8.35 -0.5 7.87 perf-stat.overall.branch-miss-rate%
15.00 +9.1% 16.37 perf-stat.overall.cpi
8793 +6.7% 9386 ± 3% perf-stat.overall.cycles-between-cache-misses
1.45 -0.0 1.40 perf-stat.overall.iTLB-load-miss-rate%
68.14 +3.4% 70.46 perf-stat.overall.instructions-per-iTLB-miss
0.07 -8.3% 0.06 perf-stat.overall.ipc
95291 +6.9% 101893 perf-stat.overall.path-length
6.22e+09 -10.9% 5.539e+09 perf-stat.ps.branch-instructions
5.192e+08 -16.1% 4.358e+08 perf-stat.ps.branch-misses
50344143 -6.4% 47117613 ± 3% perf-stat.ps.cache-misses
1.26e+09 -6.6% 1.177e+09 ± 2% perf-stat.ps.cache-references
240.97 -10.5% 215.71 ± 4% perf-stat.ps.cpu-migrations
4.328e+08 -11.5% 3.83e+08 perf-stat.ps.iTLB-load-misses
2.951e+10 -8.5% 2.699e+10 perf-stat.ps.iTLB-loads
2.949e+10 -8.5% 2.698e+10 perf-stat.ps.instructions
2675 -3.7% 2577 perf-stat.ps.minor-faults
2675 -3.7% 2577 perf-stat.ps.page-faults
9.181e+12 -6.9% 8.548e+12 perf-stat.total.instructions
26.34 ± 16% -7.4 18.91 ± 16% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.lseek64
6.32 -1.1 5.20 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_lseek.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.80 ± 22% +0.4 1.22 ± 26% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.lseek64
1.29 ± 21% +0.6 1.84 ± 26% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.lseek64
0.83 ± 15% +0.8 1.60 ± 25% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.do_syscall_64
1.75 ± 4% +0.8 2.56 ± 13% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.91 ± 14% +1.1 2.97 ± 27% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.do_syscall_64.entry_SYSCALL_64_after_hwframe.lseek64
1.77 ± 14% +1.1 2.84 ± 27% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.do_syscall_64.entry_SYSCALL_64_after_hwframe.lseek64
27.02 ± 17% +18.1 45.13 ± 17% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.lseek64
24.70 ± 17% +18.4 43.07 ± 17% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.lseek64
32.19 -11.6 20.58 ± 4% perf-profile.children.cycles-pp.entry_SYSCALL_64
20.79 ± 2% -5.8 14.99 ± 5% perf-profile.children.cycles-pp.syscall_return_via_sysret
14.12 ± 2% -2.5 11.62 perf-profile.children.cycles-pp.ksys_lseek
6.94 -1.2 5.72 perf-profile.children.cycles-pp.__fdget_pos
6.40 -1.1 5.26 perf-profile.children.cycles-pp.__fget_light
4.47 ± 2% -0.8 3.62 ± 2% perf-profile.children.cycles-pp.shmem_file_llseek
3.12 -0.7 2.39 ± 3% perf-profile.children.cycles-pp.fpregs_assert_state_consistent
0.55 ± 2% -0.1 0.43 ± 3% perf-profile.children.cycles-pp.generic_file_llseek_size
0.40 ± 5% -0.1 0.29 ± 14% perf-profile.children.cycles-pp.interrupt_entry
0.75 -0.1 0.66 perf-profile.children.cycles-pp.__x64_sys_lseek
0.51 -0.0 0.46 ± 3% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.09 ± 8% -0.0 0.07 perf-profile.children.cycles-pp.rb_next
0.15 ± 5% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.timerqueue_del
0.09 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.04 ± 58% +0.0 0.07 ± 15% perf-profile.children.cycles-pp.do_page_fault
0.01 ±173% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.ret_from_intr
0.06 ± 6% +0.0 0.11 ± 23% perf-profile.children.cycles-pp.raise_softirq
0.12 ± 8% +0.0 0.17 ± 11% perf-profile.children.cycles-pp.clockevents_program_event
0.13 ± 8% +0.0 0.18 ± 16% perf-profile.children.cycles-pp.ktime_get
0.08 ± 8% +0.1 0.13 ± 19% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.vfs_read
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.ksys_read
0.00 +0.1 0.06 ± 28% perf-profile.children.cycles-pp.rcu_irq_exit
0.07 ± 7% +0.1 0.13 ± 28% perf-profile.children.cycles-pp.timerqueue_add
0.08 ± 5% +0.1 0.15 ± 27% perf-profile.children.cycles-pp.enqueue_hrtimer
0.07 ± 12% +0.1 0.14 ± 23% perf-profile.children.cycles-pp.native_irq_return_iret
0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.rcu_segcblist_ready_cbs
0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.perf_event_task_tick
0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.idle_cpu
0.01 ±173% +0.1 0.10 ± 17% perf-profile.children.cycles-pp.ksoftirqd_running
0.10 ± 4% +0.1 0.20 ± 20% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.06 ± 11% +0.1 0.16 ± 20% perf-profile.children.cycles-pp.run_timer_softirq
0.09 ± 8% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.rcu_core
0.00 +0.1 0.13 ± 19% perf-profile.children.cycles-pp.run_posix_cpu_timers
0.56 ± 3% +0.1 0.70 ± 7% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.21 ± 7% +0.2 0.36 ± 25% perf-profile.children.cycles-pp.update_load_avg
0.65 ± 4% +0.2 0.83 ± 8% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.04 ± 3% +0.2 1.29 ± 2% perf-profile.children.cycles-pp.change_protection
1.03 ± 3% +0.3 1.28 ± 2% perf-profile.children.cycles-pp.change_prot_numa
1.03 ± 3% +0.3 1.28 ± 2% perf-profile.children.cycles-pp.change_p4d_range
1.04 ± 3% +0.3 1.29 ± 2% perf-profile.children.cycles-pp.task_numa_work
1.04 ± 3% +0.3 1.29 ± 2% perf-profile.children.cycles-pp.task_work_run
1.05 ± 3% +0.3 1.32 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.23 ± 9% +0.3 0.53 ± 18% perf-profile.children.cycles-pp.__softirqentry_text_start
0.45 ± 7% +0.4 0.90 ± 15% perf-profile.children.cycles-pp.irq_exit
1.23 ± 9% +0.9 2.14 ± 25% perf-profile.children.cycles-pp.tick_sched_handle
1.36 ± 9% +1.0 2.37 ± 25% perf-profile.children.cycles-pp.tick_sched_timer
2.84 ± 4% +1.1 3.95 ± 15% perf-profile.children.cycles-pp.__hrtimer_run_queues
4.62 ± 3% +1.5 6.09 ± 12% perf-profile.children.cycles-pp.hrtimer_interrupt
6.52 ± 4% +1.6 8.12 ± 12% perf-profile.children.cycles-pp.apic_timer_interrupt
5.98 ± 4% +1.7 7.72 ± 12% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
36.69 +17.2 53.84 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
33.69 +17.9 51.58 ± 2% perf-profile.children.cycles-pp.do_syscall_64
30.42 -11.4 19.00 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64
20.75 ± 2% -5.8 14.98 ± 5% perf-profile.self.cycles-pp.syscall_return_via_sysret
5.97 -1.2 4.82 perf-profile.self.cycles-pp.__fget_light
4.16 ± 2% -0.9 3.31 ± 2% perf-profile.self.cycles-pp.shmem_file_llseek
3.00 -0.7 2.28 ± 3% perf-profile.self.cycles-pp.fpregs_assert_state_consistent
2.81 -0.7 2.13 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
2.09 ± 2% -0.3 1.75 ± 3% perf-profile.self.cycles-pp.ksys_lseek
0.52 ± 23% -0.1 0.38 ± 16% perf-profile.self.cycles-pp.smp_apic_timer_interrupt
0.40 ± 5% -0.1 0.29 ± 15% perf-profile.self.cycles-pp.interrupt_entry
0.52 ± 2% -0.1 0.40 ± 3% perf-profile.self.cycles-pp.generic_file_llseek_size
0.42 -0.1 0.33 ± 3% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.50 ± 2% -0.1 0.41 ± 4% perf-profile.self.cycles-pp.__fdget_pos
0.22 ± 12% -0.1 0.17 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.59 -0.0 0.56 perf-profile.self.cycles-pp.__x64_sys_lseek
0.09 ± 4% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.rb_next
0.09 ± 14% +0.0 0.13 ± 14% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.06 ± 6% +0.0 0.11 ± 23% perf-profile.self.cycles-pp.raise_softirq
0.05 ± 8% +0.1 0.11 ± 28% perf-profile.self.cycles-pp.timerqueue_add
0.07 ± 12% +0.1 0.12 ± 24% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.1 0.06 ± 28% perf-profile.self.cycles-pp.rcu_irq_exit
0.01 ±173% +0.1 0.07 ± 19% perf-profile.self.cycles-pp.task_tick_fair
0.06 ± 7% +0.1 0.12 ± 15% perf-profile.self.cycles-pp.__softirqentry_text_start
0.07 ± 12% +0.1 0.14 ± 23% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.rcu_segcblist_ready_cbs
0.00 +0.1 0.08 ± 26% perf-profile.self.cycles-pp.perf_event_task_tick
0.00 +0.1 0.08 ± 19% perf-profile.self.cycles-pp.idle_cpu
0.01 ±173% +0.1 0.10 ± 30% perf-profile.self.cycles-pp.prepare_exit_to_usermode
0.01 ±173% +0.1 0.10 ± 17% perf-profile.self.cycles-pp.ksoftirqd_running
0.10 ± 4% +0.1 0.20 ± 21% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.04 ± 57% +0.1 0.14 ± 20% perf-profile.self.cycles-pp.run_timer_softirq
0.00 +0.1 0.13 ± 19% perf-profile.self.cycles-pp.run_posix_cpu_timers
0.91 ± 3% +0.2 1.14 ± 2% perf-profile.self.cycles-pp.change_p4d_range
1.23 ± 5% +0.4 1.60 ± 13% perf-profile.self.cycles-pp.hrtimer_interrupt
12.36 ± 2% +19.9 32.29 ± 3% perf-profile.self.cycles-pp.do_syscall_64
1234 ± 23% -49.9% 617.75 ± 30% interrupts.CPU1.RES:Rescheduling_interrupts
1494 ± 49% -67.1% 492.25 ± 23% interrupts.CPU10.RES:Rescheduling_interrupts
5500 ± 33% -22.6% 4256 ± 37% interrupts.CPU108.NMI:Non-maskable_interrupts
5500 ± 33% -22.6% 4256 ± 37% interrupts.CPU108.PMI:Performance_monitoring_interrupts
18.75 ± 39% +365.3% 87.25 ± 93% interrupts.CPU113.RES:Rescheduling_interrupts
40.75 ± 37% +501.8% 245.25 ± 55% interrupts.CPU114.RES:Rescheduling_interrupts
44.25 ± 35% +226.0% 144.25 ± 35% interrupts.CPU118.RES:Rescheduling_interrupts
4559 ± 34% -26.9% 3334 interrupts.CPU121.NMI:Non-maskable_interrupts
4559 ± 34% -26.9% 3334 interrupts.CPU121.PMI:Performance_monitoring_interrupts
5472 ± 33% -37.8% 3404 interrupts.CPU122.NMI:Non-maskable_interrupts
5472 ± 33% -37.8% 3404 interrupts.CPU122.PMI:Performance_monitoring_interrupts
6396 ± 24% -32.5% 4318 ± 35% interrupts.CPU126.NMI:Non-maskable_interrupts
6396 ± 24% -32.5% 4318 ± 35% interrupts.CPU126.PMI:Performance_monitoring_interrupts
7304 -51.7% 3531 interrupts.CPU127.NMI:Non-maskable_interrupts
7304 -51.7% 3531 interrupts.CPU127.PMI:Performance_monitoring_interrupts
10.00 ± 22% +435.0% 53.50 ± 87% interrupts.CPU127.RES:Rescheduling_interrupts
5516 ± 32% -21.7% 4317 ± 35% interrupts.CPU128.NMI:Non-maskable_interrupts
5516 ± 32% -21.7% 4317 ± 35% interrupts.CPU128.PMI:Performance_monitoring_interrupts
5498 ± 33% -21.8% 4297 ± 34% interrupts.CPU132.NMI:Non-maskable_interrupts
5498 ± 33% -21.8% 4297 ± 34% interrupts.CPU132.PMI:Performance_monitoring_interrupts
5527 ± 33% -22.0% 4313 ± 34% interrupts.CPU137.NMI:Non-maskable_interrupts
5527 ± 33% -22.0% 4313 ± 34% interrupts.CPU137.PMI:Performance_monitoring_interrupts
5534 ± 33% -22.6% 4281 ± 34% interrupts.CPU138.NMI:Non-maskable_interrupts
5534 ± 33% -22.6% 4281 ± 34% interrupts.CPU138.PMI:Performance_monitoring_interrupts
1298 ± 41% -60.1% 518.75 ± 14% interrupts.CPU14.RES:Rescheduling_interrupts
6374 ± 24% -45.4% 3481 interrupts.CPU141.NMI:Non-maskable_interrupts
6374 ± 24% -45.4% 3481 interrupts.CPU141.PMI:Performance_monitoring_interrupts
5454 ± 33% -36.8% 3446 interrupts.CPU146.NMI:Non-maskable_interrupts
5454 ± 33% -36.8% 3446 interrupts.CPU146.PMI:Performance_monitoring_interrupts
451.75 ± 23% -54.6% 205.25 ± 43% interrupts.CPU15.RES:Rescheduling_interrupts
5486 ± 33% -23.2% 4214 ± 34% interrupts.CPU154.NMI:Non-maskable_interrupts
5486 ± 33% -23.2% 4214 ± 34% interrupts.CPU154.PMI:Performance_monitoring_interrupts
43.00 ± 14% +113.4% 91.75 ± 14% interrupts.CPU154.RES:Rescheduling_interrupts
7360 -42.4% 4239 ± 33% interrupts.CPU156.NMI:Non-maskable_interrupts
7360 -42.4% 4239 ± 33% interrupts.CPU156.PMI:Performance_monitoring_interrupts
5509 ± 33% -22.2% 4288 ± 31% interrupts.CPU158.NMI:Non-maskable_interrupts
5509 ± 33% -22.2% 4288 ± 31% interrupts.CPU158.PMI:Performance_monitoring_interrupts
6490 ± 25% -33.4% 4322 ± 33% interrupts.CPU161.NMI:Non-maskable_interrupts
6490 ± 25% -33.4% 4322 ± 33% interrupts.CPU161.PMI:Performance_monitoring_interrupts
69.25 ± 60% -75.1% 17.25 ± 59% interrupts.CPU169.RES:Rescheduling_interrupts
775.00 ± 16% -72.7% 211.75 ± 35% interrupts.CPU17.RES:Rescheduling_interrupts
6399 ± 25% -46.3% 3435 interrupts.CPU170.NMI:Non-maskable_interrupts
6399 ± 25% -46.3% 3435 interrupts.CPU170.PMI:Performance_monitoring_interrupts
5511 ± 33% -21.2% 4343 ± 34% interrupts.CPU175.NMI:Non-maskable_interrupts
5511 ± 33% -21.2% 4343 ± 34% interrupts.CPU175.PMI:Performance_monitoring_interrupts
6487 ± 24% -47.0% 3438 interrupts.CPU177.NMI:Non-maskable_interrupts
6487 ± 24% -47.0% 3438 interrupts.CPU177.PMI:Performance_monitoring_interrupts
5527 ± 33% -37.3% 3463 interrupts.CPU178.NMI:Non-maskable_interrupts
5527 ± 33% -37.3% 3463 interrupts.CPU178.PMI:Performance_monitoring_interrupts
6414 ± 24% -32.8% 4307 ± 33% interrupts.CPU191.NMI:Non-maskable_interrupts
6414 ± 24% -32.8% 4307 ± 33% interrupts.CPU191.PMI:Performance_monitoring_interrupts
5465 ± 33% -22.1% 4259 ± 36% interrupts.CPU192.NMI:Non-maskable_interrupts
5465 ± 33% -22.1% 4259 ± 36% interrupts.CPU192.PMI:Performance_monitoring_interrupts
6464 ± 24% -46.0% 3488 interrupts.CPU193.NMI:Non-maskable_interrupts
6464 ± 24% -46.0% 3488 interrupts.CPU193.PMI:Performance_monitoring_interrupts
5482 ± 33% -21.9% 4284 ± 32% interrupts.CPU205.NMI:Non-maskable_interrupts
5482 ± 33% -21.9% 4284 ± 32% interrupts.CPU205.PMI:Performance_monitoring_interrupts
24.25 ± 28% +581.4% 165.25 ±119% interrupts.CPU206.RES:Rescheduling_interrupts
5503 ± 34% -20.8% 4357 ± 34% interrupts.CPU207.NMI:Non-maskable_interrupts
5503 ± 34% -20.8% 4357 ± 34% interrupts.CPU207.PMI:Performance_monitoring_interrupts
5512 ± 33% -37.5% 3443 interrupts.CPU208.NMI:Non-maskable_interrupts
5512 ± 33% -37.5% 3443 interrupts.CPU208.PMI:Performance_monitoring_interrupts
5542 ± 33% -20.4% 4412 ± 34% interrupts.CPU209.NMI:Non-maskable_interrupts
5542 ± 33% -20.4% 4412 ± 34% interrupts.CPU209.PMI:Performance_monitoring_interrupts
5558 ± 33% -20.5% 4418 ± 33% interrupts.CPU211.NMI:Non-maskable_interrupts
5558 ± 33% -20.5% 4418 ± 33% interrupts.CPU211.PMI:Performance_monitoring_interrupts
5485 ± 33% -22.4% 4255 ± 33% interrupts.CPU213.NMI:Non-maskable_interrupts
5485 ± 33% -22.4% 4255 ± 33% interrupts.CPU213.PMI:Performance_monitoring_interrupts
5491 ± 33% -21.1% 4330 ± 35% interrupts.CPU218.NMI:Non-maskable_interrupts
5491 ± 33% -21.1% 4330 ± 35% interrupts.CPU218.PMI:Performance_monitoring_interrupts
5548 ± 33% -37.3% 3479 ± 2% interrupts.CPU219.NMI:Non-maskable_interrupts
5548 ± 33% -37.3% 3479 ± 2% interrupts.CPU219.PMI:Performance_monitoring_interrupts
6396 ± 25% -46.2% 3441 interrupts.CPU222.NMI:Non-maskable_interrupts
6396 ± 25% -46.2% 3441 interrupts.CPU222.PMI:Performance_monitoring_interrupts
5477 ± 32% -22.7% 4232 ± 36% interrupts.CPU227.NMI:Non-maskable_interrupts
5477 ± 32% -22.7% 4232 ± 36% interrupts.CPU227.PMI:Performance_monitoring_interrupts
149.75 ± 98% -90.0% 15.00 ± 16% interrupts.CPU229.RES:Rescheduling_interrupts
29.25 ± 21% +1021.4% 328.00 ±131% interrupts.CPU230.RES:Rescheduling_interrupts
5536 ± 33% -38.3% 3416 interrupts.CPU232.NMI:Non-maskable_interrupts
5536 ± 33% -38.3% 3416 interrupts.CPU232.PMI:Performance_monitoring_interrupts
76.25 ± 67% -85.9% 10.75 ± 36% interrupts.CPU235.RES:Rescheduling_interrupts
6409 ± 24% -33.3% 4277 ± 36% interrupts.CPU236.NMI:Non-maskable_interrupts
6409 ± 24% -33.3% 4277 ± 36% interrupts.CPU236.PMI:Performance_monitoring_interrupts
119.25 ± 63% -80.5% 23.25 ± 28% interrupts.CPU240.RES:Rescheduling_interrupts
6353 ± 24% -46.4% 3402 interrupts.CPU241.NMI:Non-maskable_interrupts
6353 ± 24% -46.4% 3402 interrupts.CPU241.PMI:Performance_monitoring_interrupts
5491 ± 33% -22.3% 4266 ± 33% interrupts.CPU242.NMI:Non-maskable_interrupts
5491 ± 33% -22.3% 4266 ± 33% interrupts.CPU242.PMI:Performance_monitoring_interrupts
5496 ± 33% -37.1% 3455 interrupts.CPU243.NMI:Non-maskable_interrupts
5496 ± 33% -37.1% 3455 interrupts.CPU243.PMI:Performance_monitoring_interrupts
5500 ± 34% -23.1% 4229 ± 35% interrupts.CPU245.NMI:Non-maskable_interrupts
5500 ± 34% -23.1% 4229 ± 35% interrupts.CPU245.PMI:Performance_monitoring_interrupts
5481 ± 32% -36.9% 3458 interrupts.CPU246.NMI:Non-maskable_interrupts
5481 ± 32% -36.9% 3458 interrupts.CPU246.PMI:Performance_monitoring_interrupts
227.25 ± 43% -55.6% 101.00 ± 16% interrupts.CPU25.RES:Rescheduling_interrupts
5447 ± 33% -22.1% 4242 ± 33% interrupts.CPU250.NMI:Non-maskable_interrupts
5447 ± 33% -22.1% 4242 ± 33% interrupts.CPU250.PMI:Performance_monitoring_interrupts
6428 ± 24% -47.1% 3398 interrupts.CPU254.NMI:Non-maskable_interrupts
6428 ± 24% -47.1% 3398 interrupts.CPU254.PMI:Performance_monitoring_interrupts
14.25 ± 48% +715.8% 116.25 ± 72% interrupts.CPU257.RES:Rescheduling_interrupts
5523 ± 33% -37.8% 3436 interrupts.CPU259.NMI:Non-maskable_interrupts
5523 ± 33% -37.8% 3436 interrupts.CPU259.PMI:Performance_monitoring_interrupts
1072 ± 69% -82.8% 184.25 ± 62% interrupts.CPU26.RES:Rescheduling_interrupts
5595 ± 33% -19.4% 4510 ± 33% interrupts.CPU267.NMI:Non-maskable_interrupts
5595 ± 33% -19.4% 4510 ± 33% interrupts.CPU267.PMI:Performance_monitoring_interrupts
163.00 ± 29% -69.5% 49.75 ± 48% interrupts.CPU270.RES:Rescheduling_interrupts
5610 ± 33% -35.5% 3616 interrupts.CPU272.NMI:Non-maskable_interrupts
5610 ± 33% -35.5% 3616 interrupts.CPU272.PMI:Performance_monitoring_interrupts
5582 ± 33% -37.8% 3472 interrupts.CPU273.NMI:Non-maskable_interrupts
5582 ± 33% -37.8% 3472 interrupts.CPU273.PMI:Performance_monitoring_interrupts
5606 ± 33% -20.5% 4454 ± 35% interrupts.CPU274.NMI:Non-maskable_interrupts
5606 ± 33% -20.5% 4454 ± 35% interrupts.CPU274.PMI:Performance_monitoring_interrupts
5581 ± 33% -19.6% 4487 ± 34% interrupts.CPU275.NMI:Non-maskable_interrupts
5581 ± 33% -19.6% 4487 ± 34% interrupts.CPU275.PMI:Performance_monitoring_interrupts
14.50 ± 15% +456.9% 80.75 ±100% interrupts.CPU277.RES:Rescheduling_interrupts
6529 ± 24% -31.0% 4506 ± 32% interrupts.CPU279.NMI:Non-maskable_interrupts
6529 ± 24% -31.0% 4506 ± 32% interrupts.CPU279.PMI:Performance_monitoring_interrupts
5582 ± 33% -36.0% 3573 interrupts.CPU284.NMI:Non-maskable_interrupts
5582 ± 33% -36.0% 3573 interrupts.CPU284.PMI:Performance_monitoring_interrupts
16.25 ± 23% +1187.7% 209.25 ± 89% interrupts.CPU287.TLB:TLB_shootdowns
5595 ± 33% -20.1% 4470 ± 36% interrupts.CPU43.NMI:Non-maskable_interrupts
5595 ± 33% -20.1% 4470 ± 36% interrupts.CPU43.PMI:Performance_monitoring_interrupts
6542 ± 24% -44.5% 3627 interrupts.CPU50.NMI:Non-maskable_interrupts
6542 ± 24% -44.5% 3627 interrupts.CPU50.PMI:Performance_monitoring_interrupts
5611 ± 33% -35.3% 3630 ± 2% interrupts.CPU51.NMI:Non-maskable_interrupts
5611 ± 33% -35.3% 3630 ± 2% interrupts.CPU51.PMI:Performance_monitoring_interrupts
218.50 ± 29% +162.4% 573.25 ± 55% interrupts.CPU53.RES:Rescheduling_interrupts
1495 ± 50% -65.8% 511.75 ± 24% interrupts.CPU6.RES:Rescheduling_interrupts
5614 ± 33% -20.6% 4457 ± 34% interrupts.CPU62.NMI:Non-maskable_interrupts
5614 ± 33% -20.6% 4457 ± 34% interrupts.CPU62.PMI:Performance_monitoring_interrupts
554.50 ± 33% -58.0% 233.00 ± 20% interrupts.CPU62.RES:Rescheduling_interrupts
5605 ± 33% -19.3% 4521 ± 33% interrupts.CPU63.NMI:Non-maskable_interrupts
5605 ± 33% -19.3% 4521 ± 33% interrupts.CPU63.PMI:Performance_monitoring_interrupts
5516 ± 33% -36.7% 3491 interrupts.CPU72.NMI:Non-maskable_interrupts
5516 ± 33% -36.7% 3491 interrupts.CPU72.PMI:Performance_monitoring_interrupts
7386 -53.1% 3467 interrupts.CPU73.NMI:Non-maskable_interrupts
7386 -53.1% 3467 interrupts.CPU73.PMI:Performance_monitoring_interrupts
5475 ± 33% -21.2% 4314 ± 34% interrupts.CPU75.NMI:Non-maskable_interrupts
5475 ± 33% -21.2% 4314 ± 34% interrupts.CPU75.PMI:Performance_monitoring_interrupts
15.00 ± 47% +295.0% 59.25 ± 67% interrupts.CPU75.RES:Rescheduling_interrupts
5502 ± 33% -21.6% 4311 ± 35% interrupts.CPU76.NMI:Non-maskable_interrupts
5502 ± 33% -21.6% 4311 ± 35% interrupts.CPU76.PMI:Performance_monitoring_interrupts
5536 ± 34% -21.6% 4338 ± 33% interrupts.CPU77.NMI:Non-maskable_interrupts
5536 ± 34% -21.6% 4338 ± 33% interrupts.CPU77.PMI:Performance_monitoring_interrupts
1095 ± 66% -56.9% 471.75 ± 35% interrupts.CPU8.RES:Rescheduling_interrupts
5487 ± 33% -38.2% 3388 interrupts.CPU81.NMI:Non-maskable_interrupts
5487 ± 33% -38.2% 3388 interrupts.CPU81.PMI:Performance_monitoring_interrupts
5614 ± 33% -34.0% 3705 interrupts.CPU9.NMI:Non-maskable_interrupts
5614 ± 33% -34.0% 3705 interrupts.CPU9.PMI:Performance_monitoring_interrupts
1409 ± 93% -79.8% 284.75 ± 18% interrupts.CPU9.RES:Rescheduling_interrupts
426.75 ± 48% -91.3% 37.00 ± 46% interrupts.CPU92.RES:Rescheduling_interrupts
6436 ± 25% -31.0% 4442 ± 35% interrupts.CPU94.NMI:Non-maskable_interrupts
6436 ± 25% -31.0% 4442 ± 35% interrupts.CPU94.PMI:Performance_monitoring_interrupts
5477 ± 33% -36.4% 3483 interrupts.CPU96.NMI:Non-maskable_interrupts
5477 ± 33% -36.4% 3483 interrupts.CPU96.PMI:Performance_monitoring_interrupts
46.75 ± 74% -77.0% 10.75 ± 45% interrupts.CPU97.RES:Rescheduling_interrupts
136.25 ± 67% -77.8% 30.25 ± 25% interrupts.CPU98.RES:Rescheduling_interrupts
64096 ± 4% -20.2% 51160 ± 4% interrupts.RES:Rescheduling_interrupts
1147 ± 3% +48.3% 1701 ± 22% interrupts.TLB:TLB_shootdowns
132024 +14.3% 150947 ± 2% softirqs.CPU0.RCU
9306 ± 21% -19.9% 7456 ± 5% softirqs.CPU0.SCHED
134070 ± 3% +12.5% 150780 ± 3% softirqs.CPU1.RCU
133661 +14.8% 153386 ± 5% softirqs.CPU10.RCU
132307 +15.0% 152108 ± 2% softirqs.CPU100.RCU
132603 +13.3% 150262 ± 2% softirqs.CPU101.RCU
131269 +13.5% 149009 ± 2% softirqs.CPU102.RCU
130873 +14.4% 149753 ± 2% softirqs.CPU103.RCU
133305 +13.4% 151223 ± 2% softirqs.CPU104.RCU
134079 +13.7% 152466 ± 3% softirqs.CPU105.RCU
133189 +13.5% 151170 ± 2% softirqs.CPU106.RCU
133518 +14.0% 152197 ± 2% softirqs.CPU107.RCU
131420 +14.1% 149940 ± 2% softirqs.CPU108.RCU
131999 +13.9% 150367 ± 2% softirqs.CPU109.RCU
133435 +12.7% 150399 ± 2% softirqs.CPU11.RCU
135866 ± 6% +12.6% 152943 ± 4% softirqs.CPU110.RCU
131917 +13.0% 149068 ± 2% softirqs.CPU111.RCU
130445 +14.5% 149396 ± 2% softirqs.CPU112.RCU
130778 +14.4% 149649 ± 2% softirqs.CPU113.RCU
131832 +13.4% 149477 ± 2% softirqs.CPU114.RCU
131101 +16.6% 152883 ± 5% softirqs.CPU115.RCU
130414 +14.0% 148720 ± 2% softirqs.CPU116.RCU
133604 +13.3% 151434 ± 2% softirqs.CPU117.RCU
133959 +12.8% 151143 softirqs.CPU118.RCU
133158 +13.4% 150943 ± 2% softirqs.CPU119.RCU
132153 +13.7% 150297 ± 2% softirqs.CPU12.RCU
131245 +13.9% 149434 ± 2% softirqs.CPU120.RCU
131301 +14.2% 150000 ± 2% softirqs.CPU121.RCU
131357 +13.4% 149008 ± 2% softirqs.CPU122.RCU
130888 +14.7% 150097 ± 2% softirqs.CPU123.RCU
133574 +13.0% 150877 ± 2% softirqs.CPU124.RCU
132738 +13.5% 150675 ± 2% softirqs.CPU125.RCU
129995 +14.6% 148930 ± 2% softirqs.CPU126.RCU
132559 +13.8% 150859 ± 2% softirqs.CPU127.RCU
132611 +13.2% 150099 ± 2% softirqs.CPU128.RCU
133130 +13.5% 151138 softirqs.CPU129.RCU
132941 +12.7% 149857 softirqs.CPU13.RCU
132399 +14.5% 151641 ± 2% softirqs.CPU130.RCU
133664 +13.1% 151195 softirqs.CPU131.RCU
131354 +13.1% 148547 ± 2% softirqs.CPU132.RCU
132153 +11.5% 147333 softirqs.CPU133.RCU
141243 ± 4% -8.5% 129259 ± 7% softirqs.CPU133.TIMER
130923 +13.8% 148929 ± 2% softirqs.CPU134.RCU
130658 +14.9% 150185 ± 2% softirqs.CPU135.RCU
131314 +14.6% 150465 ± 2% softirqs.CPU136.RCU
131704 +13.5% 149451 ± 2% softirqs.CPU137.RCU
129988 +14.6% 148913 ± 2% softirqs.CPU138.RCU
129204 +15.2% 148810 ± 2% softirqs.CPU139.RCU
132909 +14.0% 151509 ± 3% softirqs.CPU14.RCU
133858 +14.4% 153150 ± 3% softirqs.CPU140.RCU
133023 +13.6% 151136 ± 2% softirqs.CPU141.RCU
131085 +13.8% 149216 ± 2% softirqs.CPU142.RCU
132866 +13.8% 151258 ± 2% softirqs.CPU143.RCU
134532 +12.5% 151294 ± 2% softirqs.CPU144.RCU
132923 +12.9% 150024 ± 3% softirqs.CPU145.RCU
132467 +14.3% 151369 softirqs.CPU146.RCU
135143 ± 2% +11.8% 151071 ± 2% softirqs.CPU147.RCU
131448 +13.5% 149199 ± 2% softirqs.CPU148.RCU
131553 +15.4% 151852 ± 2% softirqs.CPU149.RCU
132807 +13.8% 151080 ± 2% softirqs.CPU15.RCU
131249 +13.8% 149339 ± 2% softirqs.CPU150.RCU
130798 +14.6% 149901 ± 2% softirqs.CPU151.RCU
133363 +13.4% 151240 ± 2% softirqs.CPU152.RCU
133910 +12.9% 151190 ± 2% softirqs.CPU153.RCU
133644 +14.0% 152403 ± 3% softirqs.CPU154.RCU
134555 ± 2% +13.1% 152144 ± 2% softirqs.CPU155.RCU
131692 +13.6% 149559 softirqs.CPU156.RCU
131710 +13.3% 149247 softirqs.CPU157.RCU
131528 +12.9% 148436 ± 2% softirqs.CPU158.RCU
131543 +13.9% 149886 ± 2% softirqs.CPU159.RCU
134455 +14.0% 153325 ± 2% softirqs.CPU16.RCU
131850 +13.8% 150009 ± 2% softirqs.CPU160.RCU
131062 +14.2% 149698 ± 2% softirqs.CPU161.RCU
132570 +13.8% 150822 ± 3% softirqs.CPU162.RCU
131238 +13.5% 148951 ± 2% softirqs.CPU163.RCU
130720 +15.4% 150870 ± 2% softirqs.CPU164.RCU
133626 +13.0% 151048 ± 2% softirqs.CPU165.RCU
132741 +13.5% 150710 ± 2% softirqs.CPU166.RCU
133569 +13.0% 150960 ± 2% softirqs.CPU167.RCU
133292 +12.9% 150530 ± 2% softirqs.CPU168.RCU
132312 +14.2% 151081 ± 2% softirqs.CPU169.RCU
132191 +14.0% 150726 ± 2% softirqs.CPU17.RCU
133180 +13.1% 150618 ± 2% softirqs.CPU170.RCU
132649 +13.7% 150799 ± 2% softirqs.CPU171.RCU
131676 +13.7% 149778 ± 2% softirqs.CPU172.RCU
131322 +13.9% 149532 ± 2% softirqs.CPU173.RCU
131163 +14.2% 149810 ± 2% softirqs.CPU174.RCU
130944 +14.2% 149603 ± 2% softirqs.CPU175.RCU
129591 +15.0% 149026 ± 2% softirqs.CPU176.RCU
130486 +13.8% 148500 ± 2% softirqs.CPU177.RCU
130598 +18.8% 155156 ± 6% softirqs.CPU178.RCU
131102 +14.3% 149901 ± 2% softirqs.CPU179.RCU
131114 +14.3% 149803 ± 3% softirqs.CPU18.RCU
130612 +14.0% 148920 ± 2% softirqs.CPU180.RCU
130515 +13.6% 148273 ± 2% softirqs.CPU181.RCU
132363 +13.9% 150790 ± 2% softirqs.CPU182.RCU
132913 +13.5% 150826 ± 2% softirqs.CPU183.RCU
130724 +14.4% 149546 ± 2% softirqs.CPU184.RCU
131396 +14.0% 149794 ± 2% softirqs.CPU185.RCU
129872 +14.3% 148465 ± 2% softirqs.CPU186.RCU
130017 +14.0% 148230 ± 2% softirqs.CPU187.RCU
132362 +14.3% 151245 ± 2% softirqs.CPU188.RCU
132501 +12.3% 148740 ± 4% softirqs.CPU189.RCU
132251 +13.9% 150597 ± 2% softirqs.CPU19.RCU
132333 +13.7% 150397 ± 2% softirqs.CPU190.RCU
132550 +13.2% 150073 ± 2% softirqs.CPU191.RCU
132411 +13.2% 149860 ± 2% softirqs.CPU192.RCU
131767 +14.6% 151069 softirqs.CPU193.RCU
131753 +13.7% 149865 ± 2% softirqs.CPU194.RCU
132231 +13.8% 150493 ± 2% softirqs.CPU195.RCU
131283 +13.4% 148824 ± 2% softirqs.CPU196.RCU
130720 +13.8% 148785 ± 2% softirqs.CPU197.RCU
130623 +14.4% 149390 ± 2% softirqs.CPU198.RCU
130459 +14.4% 149267 ± 2% softirqs.CPU199.RCU
134212 +12.7% 151215 ± 3% softirqs.CPU2.RCU
132200 +13.6% 150117 ± 2% softirqs.CPU20.RCU
130250 +14.8% 149565 ± 2% softirqs.CPU200.RCU
128798 ± 2% +15.2% 148334 softirqs.CPU201.RCU
129002 +14.8% 148109 ± 2% softirqs.CPU202.RCU
131094 +13.4% 148596 ± 2% softirqs.CPU203.RCU
132435 +13.5% 150322 ± 2% softirqs.CPU204.RCU
132906 +12.5% 149513 softirqs.CPU205.RCU
130337 +13.7% 148175 ± 2% softirqs.CPU206.RCU
130426 +13.5% 148063 ± 2% softirqs.CPU207.RCU
132917 +13.1% 150361 softirqs.CPU208.RCU
131949 +14.1% 150618 ± 2% softirqs.CPU209.RCU
133425 +11.5% 148749 softirqs.CPU21.RCU
132555 +14.0% 151127 ± 2% softirqs.CPU210.RCU
131608 +13.9% 149918 softirqs.CPU211.RCU
131712 ± 2% +12.5% 148170 softirqs.CPU212.RCU
140958 ± 3% -12.7% 122999 ± 9% softirqs.CPU212.TIMER
130072 +14.5% 148916 ± 2% softirqs.CPU213.RCU
131160 +13.4% 148799 ± 2% softirqs.CPU214.RCU
130097 +14.3% 148700 ± 2% softirqs.CPU215.RCU
132972 +13.4% 150844 ± 2% softirqs.CPU216.RCU
131734 +13.8% 149933 ± 2% softirqs.CPU217.RCU
133271 +12.7% 150173 ± 2% softirqs.CPU218.RCU
133210 +12.9% 150446 ± 2% softirqs.CPU219.RCU
132730 +13.8% 151064 ± 3% softirqs.CPU22.RCU
130710 +14.6% 149773 ± 2% softirqs.CPU220.RCU
130833 +14.5% 149782 ± 2% softirqs.CPU221.RCU
131452 +12.3% 147634 ± 2% softirqs.CPU222.RCU
132072 +12.6% 148695 ± 2% softirqs.CPU223.RCU
129537 +14.4% 148227 ± 2% softirqs.CPU224.RCU
130864 +13.1% 148068 softirqs.CPU225.RCU
131474 +14.2% 150083 ± 2% softirqs.CPU226.RCU
131937 +13.0% 149088 ± 2% softirqs.CPU227.RCU
132212 +15.3% 152414 ± 4% softirqs.CPU228.RCU
133658 +12.7% 150657 ± 2% softirqs.CPU229.RCU
132266 +13.3% 149869 ± 2% softirqs.CPU23.RCU
131339 +14.6% 150485 ± 2% softirqs.CPU230.RCU
134228 +12.5% 151031 ± 3% softirqs.CPU231.RCU
131295 +12.8% 148120 ± 3% softirqs.CPU232.RCU
131788 +13.1% 149003 ± 2% softirqs.CPU233.RCU
130486 +14.5% 149383 ± 2% softirqs.CPU234.RCU
131931 +13.3% 149470 ± 2% softirqs.CPU235.RCU
133346 +13.9% 151861 softirqs.CPU236.RCU
133503 ± 2% +12.4% 150084 ± 2% softirqs.CPU237.RCU
132637 +14.0% 151182 ± 2% softirqs.CPU238.RCU
132414 +13.5% 150287 ± 2% softirqs.CPU239.RCU
132078 +14.0% 150592 ± 2% softirqs.CPU24.RCU
132587 +13.8% 150929 ± 2% softirqs.CPU240.RCU
133633 +12.4% 150261 ± 2% softirqs.CPU241.RCU
132100 +12.9% 149140 ± 2% softirqs.CPU242.RCU
130211 +13.6% 147971 ± 2% softirqs.CPU243.RCU
131395 +13.2% 148675 ± 2% softirqs.CPU244.RCU
130520 +13.7% 148422 ± 2% softirqs.CPU245.RCU
130539 +13.2% 147709 ± 2% softirqs.CPU246.RCU
129679 +14.0% 147792 ± 2% softirqs.CPU247.RCU
132242 +14.0% 150693 ± 2% softirqs.CPU248.RCU
129827 +14.0% 147949 ± 2% softirqs.CPU249.RCU
132214 +14.0% 150747 ± 2% softirqs.CPU25.RCU
132146 +13.7% 150270 ± 2% softirqs.CPU250.RCU
132573 +13.2% 150111 ± 2% softirqs.CPU251.RCU
130670 +13.5% 148323 ± 2% softirqs.CPU252.RCU
131169 +13.6% 149045 ± 2% softirqs.CPU253.RCU
131213 +13.7% 149147 ± 2% softirqs.CPU254.RCU
131876 +12.9% 148887 ± 2% softirqs.CPU255.RCU
145390 ± 6% -16.0% 122070 ± 10% softirqs.CPU255.TIMER
130441 +14.0% 148724 ± 2% softirqs.CPU256.RCU
130541 +14.3% 149242 ± 2% softirqs.CPU257.RCU
130412 +13.5% 147957 ± 2% softirqs.CPU258.RCU
130939 +13.8% 149027 ± 2% softirqs.CPU259.RCU
132247 +10.1% 145539 ± 4% softirqs.CPU26.RCU
132713 +14.1% 151424 ± 3% softirqs.CPU260.RCU
130372 +15.2% 150132 softirqs.CPU261.RCU
139063 ± 5% -12.5% 121745 ± 6% softirqs.CPU261.TIMER
132238 +13.7% 150338 ± 3% softirqs.CPU262.RCU
132405 +13.2% 149908 ± 2% softirqs.CPU263.RCU
131146 +15.1% 151008 softirqs.CPU264.RCU
129868 +14.4% 148607 ± 2% softirqs.CPU265.RCU
130238 +13.7% 148059 ± 2% softirqs.CPU266.RCU
131558 +13.4% 149125 softirqs.CPU267.RCU
129436 +14.0% 147543 ± 2% softirqs.CPU268.RCU
129664 +13.3% 146860 ± 2% softirqs.CPU269.RCU
132316 +14.3% 151225 softirqs.CPU27.RCU
129376 +14.4% 147985 ± 2% softirqs.CPU270.RCU
129746 +14.0% 147954 ± 2% softirqs.CPU271.RCU
129390 +14.0% 147473 ± 3% softirqs.CPU272.RCU
129961 +13.0% 146904 softirqs.CPU273.RCU
129042 +14.3% 147517 ± 3% softirqs.CPU274.RCU
129282 +13.7% 147048 softirqs.CPU275.RCU
121447 ± 5% -11.0% 108069 ± 6% softirqs.CPU275.TIMER
131507 +13.1% 148787 softirqs.CPU276.RCU
130103 +12.4% 146298 softirqs.CPU277.RCU
131346 +12.9% 148242 ± 2% softirqs.CPU278.RCU
133451 ± 4% +11.0% 148191 ± 2% softirqs.CPU279.RCU
132401 +13.4% 150129 softirqs.CPU28.RCU
129114 +14.4% 147756 ± 3% softirqs.CPU280.RCU
129304 +14.4% 147976 ± 2% softirqs.CPU281.RCU
128958 +15.2% 148558 ± 2% softirqs.CPU282.RCU
129597 +14.2% 147985 ± 2% softirqs.CPU283.RCU
130854 +13.4% 148398 ± 2% softirqs.CPU284.RCU
130129 +13.6% 147888 ± 2% softirqs.CPU285.RCU
131388 +13.4% 148994 ± 2% softirqs.CPU286.RCU
132027 +14.0% 150525 ± 2% softirqs.CPU29.RCU
132235 +14.2% 150987 ± 2% softirqs.CPU3.RCU
131972 +13.7% 150055 ± 2% softirqs.CPU30.RCU
131795 +14.1% 150411 ± 2% softirqs.CPU31.RCU
131619 +13.9% 149920 ± 2% softirqs.CPU32.RCU
131760 +14.0% 150270 ± 2% softirqs.CPU33.RCU
131864 +13.3% 149344 ± 2% softirqs.CPU34.RCU
131591 +12.9% 148559 ± 2% softirqs.CPU35.RCU
131895 +13.5% 149693 ± 2% softirqs.CPU36.RCU
131357 +14.1% 149850 ± 2% softirqs.CPU38.RCU
132021 +13.8% 150194 ± 3% softirqs.CPU39.RCU
133632 +13.3% 151405 ± 2% softirqs.CPU4.RCU
131366 +14.6% 150518 ± 2% softirqs.CPU40.RCU
131452 +13.7% 149430 ± 2% softirqs.CPU41.RCU
131478 +13.8% 149572 ± 2% softirqs.CPU42.RCU
135354 ± 4% +10.6% 149742 ± 2% softirqs.CPU43.RCU
131654 +14.0% 150146 ± 2% softirqs.CPU44.RCU
132262 +12.2% 148338 ± 3% softirqs.CPU46.RCU
136692 ± 5% +13.4% 154967 ± 3% softirqs.CPU47.RCU
136604 ± 4% +10.5% 150893 ± 2% softirqs.CPU48.RCU
132229 +13.6% 150147 ± 2% softirqs.CPU49.RCU
132467 +14.5% 151716 ± 2% softirqs.CPU5.RCU
129686 ± 3% +15.3% 149577 ± 2% softirqs.CPU50.RCU
131517 +14.0% 149876 ± 2% softirqs.CPU51.RCU
132539 +16.2% 153959 ± 7% softirqs.CPU52.RCU
131675 +14.9% 151237 ± 2% softirqs.CPU53.RCU
134982 ± 3% +10.8% 149589 ± 2% softirqs.CPU54.RCU
131038 +13.9% 149199 ± 2% softirqs.CPU55.RCU
133004 +13.6% 151081 softirqs.CPU56.RCU
133103 +12.3% 149447 ± 2% softirqs.CPU57.RCU
135835 ± 3% +11.7% 151672 softirqs.CPU58.RCU
132457 +12.7% 149299 softirqs.CPU59.RCU
133946 +11.9% 149888 ± 2% softirqs.CPU6.RCU
131223 +15.6% 151658 ± 6% softirqs.CPU60.RCU
131146 +13.0% 148142 softirqs.CPU61.RCU
131056 +13.8% 149166 ± 2% softirqs.CPU62.RCU
129886 +19.0% 154563 ± 5% softirqs.CPU63.RCU
131105 +14.5% 150073 ± 2% softirqs.CPU64.RCU
130771 +14.6% 149818 ± 3% softirqs.CPU65.RCU
130747 +14.9% 150212 ± 2% softirqs.CPU66.RCU
131216 +13.8% 149365 ± 2% softirqs.CPU67.RCU
131888 +14.0% 150393 ± 2% softirqs.CPU68.RCU
132903 +13.9% 151410 ± 2% softirqs.CPU69.RCU
132795 +13.3% 150435 ± 2% softirqs.CPU7.RCU
132412 +12.5% 148953 ± 2% softirqs.CPU70.RCU
135771 ± 3% +13.8% 154540 ± 3% softirqs.CPU71.RCU
131184 +14.1% 149660 ± 2% softirqs.CPU73.RCU
133242 +13.8% 151687 softirqs.CPU74.RCU
133801 +14.1% 152658 ± 2% softirqs.CPU75.RCU
131638 +13.5% 149365 ± 2% softirqs.CPU76.RCU
132076 +13.1% 149420 softirqs.CPU77.RCU
133424 +11.6% 148961 softirqs.CPU78.RCU
132259 +13.6% 150242 ± 2% softirqs.CPU79.RCU
132414 +13.7% 150602 ± 2% softirqs.CPU8.RCU
132706 +13.2% 150235 ± 2% softirqs.CPU80.RCU
132689 +13.1% 150073 ± 2% softirqs.CPU81.RCU
132558 +13.4% 150348 ± 2% softirqs.CPU82.RCU
132705 +14.0% 151310 ± 2% softirqs.CPU83.RCU
133075 +14.2% 151919 ± 2% softirqs.CPU84.RCU
135186 +12.5% 152030 ± 2% softirqs.CPU85.RCU
132708 +14.3% 151710 ± 2% softirqs.CPU86.RCU
133908 +12.9% 151248 ± 2% softirqs.CPU87.RCU
132576 +14.5% 151806 ± 2% softirqs.CPU88.RCU
132458 +13.8% 150732 ± 3% softirqs.CPU89.RCU
132319 +13.4% 150009 softirqs.CPU9.RCU
131982 +14.0% 150437 ± 2% softirqs.CPU90.RCU
132408 +13.9% 150777 ± 2% softirqs.CPU91.RCU
133616 +13.6% 151830 ± 2% softirqs.CPU92.RCU
133573 +13.6% 151719 softirqs.CPU93.RCU
133491 +13.2% 151128 ± 2% softirqs.CPU94.RCU
134313 +13.1% 151971 ± 2% softirqs.CPU95.RCU
134118 +13.0% 151568 ± 2% softirqs.CPU96.RCU
133913 +13.3% 151766 ± 2% softirqs.CPU97.RCU
134677 +12.9% 152025 ± 2% softirqs.CPU98.RCU
134115 +13.5% 152168 ± 2% softirqs.CPU99.RCU
38007998 +13.6% 43194149 ± 2% softirqs.RCU
will-it-scale.per_process_ops
350000 +------------------------------------------------------------------+
| |
340000 |.+.+. .+. .+.+. .+.+. .+. .+. .+. |
330000 |-+ + +.+ +.+.+ +.+.+. + +.+ +.+ |
| |
320000 |-+ |
| |
310000 |-+ |
| O O |
300000 |-+ O O O O O |
290000 |-+ O O O O O O O |
| O O O O O O O |
280000 |-+ O O O O O O O |
| O O O O |
270000 +------------------------------------------------------------------+
will-it-scale.workload
1e+08 +-----------------------------------------------------------------+
9.8e+07 |.+. .+. +. |
| +. .+. .+ +.+. + +.+. .+. .+. .+.+.+ |
9.6e+07 |-+ + + +.+ +.+ + +.+ |
9.4e+07 |-+ |
9.2e+07 |-+ |
9e+07 |-+ |
| O |
8.8e+07 |-+ O |
8.6e+07 |-+ O O O O O O |
8.4e+07 |-+ O O O O O O |
8.2e+07 |-+ O O O O O |
| O O O O O O O O O |
8e+07 |-O O O O |
7.8e+07 +-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 4 months
- 2
- 1
[sched/fair] 59901cb452: netperf.Throughput_Mbps -27.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -27.3% regression of netperf.Throughput_Mbps due to commit:
commit: 59901cb4520c44bfce81f523bc61e7284a931ad1 ("[PATCH] sched/fair: Don't pull task if local group is more loaded than busiest group")
url: https://github.com/0day-ci/linux/commits/Aubrey-Li/sched-fair-Don-t-pull-...
in testcase: netperf
on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
with following parameters:
ip: ipv4
runtime: 300s
nr_threads: 25%
cluster: cs-localhost
send_size: 5K
test: TCP_SENDFILE
cpufreq_governor: performance
ucode: 0x2000065
test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/
In addition to that, the commit also has significant impact on the following tests:
+------------------+------------------------------------------------------------------------+
| testcase: change | netperf: netperf.Throughput_Mbps -31.1% regression |
| test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory |
| test parameters | cluster=cs-localhost |
| | cpufreq_governor=performance |
| | ip=ipv4 |
| | nr_threads=25% |
| | runtime=300s |
| | send_size=10K |
| | test=SCTP_STREAM_MANY |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score -4.0% regression |
| test machine | 104 threads Skylake with 192G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=30% |
| | runtime=300s |
| | test=whetstone-double |
| | ucode=0x2000065 |
+------------------+------------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score 29.1% improvement |
| test machine | 104 threads Skylake with 192G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=30% |
| | runtime=300s |
| | test=context1 |
| | ucode=0x2000065 |
+------------------+------------------------------------------------------------------------+
| testcase: change | kbuild: kbuild.buildtime_per_iteration 7.5% regression |
| test machine | 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=50% |
| | runtime=300s |
| | target=vmlinux_prereq |
| | ucode=0x27 |
+------------------+------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/25%/debian-x86_64-20191114.cgz/300s/5K/lkp-skl-2sp7/TCP_SENDFILE/netperf/0x2000065
commit:
9c40365a65 ("threads: Update PID limit comment according to futex UAPI change")
59901cb452 ("sched/fair: Don't pull task if local group is more loaded than busiest group")
9c40365a65d62d7c 59901cb4520c44bfce81f523bc6
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:4 50% 2:4 dmesg.WARNING:at_ip__fsnotify_parent/0x
%stddev %change %stddev
\ | \
18708 -27.3% 13593 netperf.Throughput_Mbps
336757 -27.3% 244677 netperf.Throughput_total_Mbps
8293 ± 2% +82.7% 15156 ± 57% netperf.time.involuntary_context_switches
2291 +2.6% 2350 netperf.time.maximum_resident_set_size
5103 -8.9% 4651 netperf.time.minor_page_faults
4704 +1.4% 4771 netperf.time.system_time
695.32 -9.7% 627.59 netperf.time.user_time
431.25 ± 51% +394.1% 2131 ± 59% netperf.time.voluntary_context_switches
2.466e+09 -27.3% 1.792e+09 netperf.workload
526188 ± 5% -21.3% 414060 ± 7% meminfo.DirectMap4k
53993 ± 3% -13.9% 46507 ± 5% meminfo.Shmem
1482325 ± 2% -24.4% 1120083 vmstat.system.cs
150508 -1.5% 148218 vmstat.system.in
3999 ± 8% -10.8% 3566 ± 5% slabinfo.kmalloc-rcl-64.active_objs
3999 ± 8% -10.8% 3566 ± 5% slabinfo.kmalloc-rcl-64.num_objs
10897 +12.6% 12274 ± 4% slabinfo.vmap_area.active_objs
10898 +12.7% 12277 ± 4% slabinfo.vmap_area.num_objs
2.208e+08 -20.9% 1.746e+08 cpuidle.C1.usage
5894730 ± 24% +7005.1% 4.188e+08 ± 25% cpuidle.C6.time
19279 ± 3% +2594.5% 519470 ± 17% cpuidle.C6.usage
35085456 ± 9% -39.3% 21307532 ± 7% cpuidle.POLL.time
4822644 ± 12% -49.7% 2423791 ± 9% cpuidle.POLL.usage
76807 -2.7% 74740 proc-vmstat.nr_active_anon
13500 ± 3% -13.8% 11639 ± 5% proc-vmstat.nr_shmem
76807 -2.7% 74740 proc-vmstat.nr_zone_active_anon
15013 ± 91% -86.2% 2071 ±151% proc-vmstat.numa_hint_faults
13589 ± 5% -15.5% 11476 ± 11% proc-vmstat.pgactivate
833769 -2.1% 815970 proc-vmstat.pgfault
754892 +1.1% 762828 proc-vmstat.pgfree
152278 ± 42% -96.3% 5569 ± 23% sched_debug.cfs_rq:/.min_vruntime.min
1169341 +30.4% 1524450 ± 7% sched_debug.cfs_rq:/.min_vruntime.stddev
1169341 +30.4% 1524462 ± 7% sched_debug.cfs_rq:/.spread0.stddev
1.58 ± 6% +22.0% 1.93 ± 7% sched_debug.cpu.clock.stddev
1.58 ± 6% +22.1% 1.93 ± 7% sched_debug.cpu.clock_task.stddev
3098435 -28.6% 2211323 ± 9% sched_debug.cpu.nr_switches.avg
1573 ± 16% -21.6% 1233 ± 9% sched_debug.cpu.nr_switches.min
56.75 ± 11% +18.5% 67.25 ± 4% sched_debug.cpu.nr_uninterruptible.max
6543 ± 8% +16.6% 7631 ± 5% numa-vmstat.node0.nr_kernel_stack
574.25 ± 30% +86.8% 1072 ± 22% numa-vmstat.node0.nr_page_table_pages
8042 ± 19% +23.3% 9919 ± 13% numa-vmstat.node0.nr_slab_reclaimable
34409 ± 22% -56.6% 14946 ± 54% numa-vmstat.node1.nr_active_anon
25847 ± 30% -67.3% 8458 ± 93% numa-vmstat.node1.nr_anon_pages
6123 ± 8% -18.0% 5022 ± 8% numa-vmstat.node1.nr_kernel_stack
854.50 ± 19% -56.5% 372.00 ± 65% numa-vmstat.node1.nr_page_table_pages
18421 ± 7% -17.9% 15125 ± 7% numa-vmstat.node1.nr_slab_unreclaimable
34409 ± 22% -56.6% 14946 ± 54% numa-vmstat.node1.nr_zone_active_anon
21046 ± 47% +55.4% 32703 ± 30% numa-vmstat.node1.numa_other
32169 ± 19% +23.3% 39680 ± 13% numa-meminfo.node0.KReclaimable
6543 ± 8% +16.6% 7630 ± 5% numa-meminfo.node0.KernelStack
1001821 ± 9% +14.4% 1145780 ± 4% numa-meminfo.node0.MemUsed
2299 ± 30% +86.6% 4290 ± 22% numa-meminfo.node0.PageTables
32169 ± 19% +23.3% 39680 ± 13% numa-meminfo.node0.SReclaimable
102778 ± 7% +19.9% 123222 ± 6% numa-meminfo.node0.Slab
137587 ± 22% -56.6% 59688 ± 54% numa-meminfo.node1.Active
137493 ± 22% -56.6% 59648 ± 54% numa-meminfo.node1.Active(anon)
52091 ± 42% -68.4% 16453 ±161% numa-meminfo.node1.AnonHugePages
103405 ± 30% -67.3% 33836 ± 93% numa-meminfo.node1.AnonPages
6116 ± 8% -18.0% 5017 ± 8% numa-meminfo.node1.KernelStack
1050635 ± 8% -13.4% 909860 ± 5% numa-meminfo.node1.MemUsed
3416 ± 19% -56.6% 1483 ± 65% numa-meminfo.node1.PageTables
73684 ± 7% -17.9% 60503 ± 7% numa-meminfo.node1.SUnreclaim
108980 ± 7% -19.1% 88152 ± 10% numa-meminfo.node1.Slab
81937 ± 6% +25.2% 102562 ± 9% softirqs.CPU16.RCU
21615 ± 70% +204.7% 65858 ± 22% softirqs.CPU16.SCHED
5010947 ± 28% -67.3% 1637461 ±148% softirqs.CPU25.NET_RX
45054 ± 5% -21.6% 35310 ± 26% softirqs.CPU25.SCHED
4691793 ± 34% -69.2% 1444457 ±170% softirqs.CPU26.NET_RX
48190 ± 9% -29.8% 33825 ± 34% softirqs.CPU26.SCHED
5045331 ± 36% -77.2% 1148265 ±171% softirqs.CPU29.NET_RX
51391 ± 23% -69.3% 15752 ±133% softirqs.CPU36.SCHED
52040 ± 11% -73.0% 14042 ±111% softirqs.CPU46.SCHED
37936 ± 50% -78.3% 8234 ±104% softirqs.CPU47.SCHED
46988 ± 16% -67.0% 15513 ± 99% softirqs.CPU52.SCHED
5967380 ± 30% -80.4% 1169737 ±173% softirqs.CPU54.NET_RX
6170696 ± 42% -76.1% 1472055 ±173% softirqs.CPU57.NET_RX
6718083 ± 40% -77.3% 1528221 ±173% softirqs.CPU58.NET_RX
6397847 ± 27% -74.5% 1629273 ±173% softirqs.CPU59.NET_RX
57352 ± 5% -35.6% 36922 ± 10% softirqs.CPU63.SCHED
4947229 ± 28% -76.6% 1159904 ±173% softirqs.CPU64.NET_RX
4902059 ± 41% -72.8% 1331256 ±169% softirqs.CPU68.NET_RX
3.636e+08 -23.0% 2.799e+08 softirqs.NET_RX
106.50 ± 96% -96.7% 3.50 ±125% interrupts.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
24013 -1.8% 23590 interrupts.CAL:Function_call_interrupts
14701 ± 60% -99.2% 123.75 ± 89% interrupts.CPU11.RES:Rescheduling_interrupts
106.00 ± 97% -97.2% 3.00 ±135% interrupts.CPU19.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19
23189 ± 24% -94.6% 1242 ±139% interrupts.CPU25.RES:Rescheduling_interrupts
23527 ± 34% -95.2% 1129 ±152% interrupts.CPU26.RES:Rescheduling_interrupts
13122 ± 50% -98.4% 207.50 ±143% interrupts.CPU29.RES:Rescheduling_interrupts
21974 ± 29% -77.8% 4872 ±172% interrupts.CPU3.RES:Rescheduling_interrupts
28365 ± 52% -79.1% 5941 ±171% interrupts.CPU36.RES:Rescheduling_interrupts
27230 ± 58% -98.1% 518.00 ± 98% interrupts.CPU46.RES:Rescheduling_interrupts
21075 ± 63% -99.0% 205.25 ± 58% interrupts.CPU47.RES:Rescheduling_interrupts
6718 ± 19% -43.9% 3772 ± 63% interrupts.CPU48.NMI:Non-maskable_interrupts
6718 ± 19% -43.9% 3772 ± 63% interrupts.CPU48.PMI:Performance_monitoring_interrupts
7806 ± 72% -73.1% 2100 ±147% interrupts.CPU52.RES:Rescheduling_interrupts
7343 ± 23% -57.7% 3106 ± 96% interrupts.CPU54.NMI:Non-maskable_interrupts
7343 ± 23% -57.7% 3106 ± 96% interrupts.CPU54.PMI:Performance_monitoring_interrupts
7679 ± 84% -98.4% 123.75 ±104% interrupts.CPU54.RES:Rescheduling_interrupts
35789 ± 57% -75.5% 8758 ±173% interrupts.CPU56.RES:Rescheduling_interrupts
23882 ± 72% -94.9% 1212 ±172% interrupts.CPU57.RES:Rescheduling_interrupts
21256 ± 72% -94.7% 1134 ±170% interrupts.CPU58.RES:Rescheduling_interrupts
73.50 ±145% -90.8% 6.75 ± 72% interrupts.CPU6.TLB:TLB_shootdowns
32631 ± 47% -68.2% 10387 ± 72% interrupts.CPU61.RES:Rescheduling_interrupts
29653 ± 29% -81.4% 5518 ±171% interrupts.CPU62.RES:Rescheduling_interrupts
25421 ± 21% -91.3% 2218 ±165% interrupts.CPU63.RES:Rescheduling_interrupts
14735 ± 54% -98.6% 200.50 ±155% interrupts.CPU64.RES:Rescheduling_interrupts
11691 ± 85% -64.2% 4184 ±172% interrupts.CPU66.RES:Rescheduling_interrupts
6240 ± 32% -68.2% 1982 ±140% interrupts.CPU67.NMI:Non-maskable_interrupts
6240 ± 32% -68.2% 1982 ±140% interrupts.CPU67.PMI:Performance_monitoring_interrupts
6781 ±120% -93.8% 423.50 ±145% interrupts.CPU68.RES:Rescheduling_interrupts
12981 ± 64% -98.7% 174.50 ±105% interrupts.CPU70.RES:Rescheduling_interrupts
14238 ± 44% -65.1% 4975 ±168% interrupts.CPU71.RES:Rescheduling_interrupts
107.00 ± 5% -17.1% 88.75 ± 11% interrupts.IWI:IRQ_work_interrupts
389189 ± 4% -31.5% 266460 ± 8% interrupts.NMI:Non-maskable_interrupts
389189 ± 4% -31.5% 266460 ± 8% interrupts.PMI:Performance_monitoring_interrupts
1296392 ± 4% -34.6% 847860 ± 22% interrupts.RES:Rescheduling_interrupts
1588 ± 29% -61.8% 607.25 ± 35% interrupts.TLB:TLB_shootdowns
10.18 -4.0% 9.77 perf-stat.i.MPKI
1.552e+10 -25.5% 1.157e+10 perf-stat.i.branch-instructions
3.48e+08 -25.2% 2.605e+08 perf-stat.i.branch-misses
1.52 ± 28% -1.1 0.43 ± 27% perf-stat.i.cache-miss-rate%
11586741 ± 29% -83.7% 1894187 ± 32% perf-stat.i.cache-misses
8.042e+08 -28.5% 5.749e+08 perf-stat.i.cache-references
1492579 ± 2% -24.4% 1127729 perf-stat.i.context-switches
1.22 +23.5% 1.51 ± 2% perf-stat.i.cpi
9.616e+10 -7.9% 8.853e+10 perf-stat.i.cpu-cycles
162.88 ± 9% +39.8% 227.77 ± 4% perf-stat.i.cpu-migrations
10318 ± 43% +758.6% 88595 ± 30% perf-stat.i.cycles-between-cache-misses
10338031 -26.2% 7628495 perf-stat.i.dTLB-load-misses
2.437e+10 -25.5% 1.815e+10 perf-stat.i.dTLB-loads
0.00 ± 5% +0.0 0.00 ± 2% perf-stat.i.dTLB-store-miss-rate%
12952 ± 3% +12.2% 14538 ± 2% perf-stat.i.dTLB-store-misses
1.401e+10 -25.6% 1.041e+10 perf-stat.i.dTLB-stores
49.00 -13.4 35.64 ± 6% perf-stat.i.iTLB-load-miss-rate%
11130067 ± 2% -29.9% 7798895 ± 3% perf-stat.i.iTLB-load-misses
11481481 +22.6% 14080265 ± 7% perf-stat.i.iTLB-loads
7.868e+10 -25.5% 5.862e+10 perf-stat.i.instructions
7290 ± 2% +6.5% 7762 perf-stat.i.instructions-per-iTLB-miss
0.82 -18.9% 0.66 ± 2% perf-stat.i.ipc
2680 -2.2% 2621 perf-stat.i.minor-faults
95.89 -3.7 92.22 perf-stat.i.node-load-miss-rate%
1617319 ± 41% -83.8% 262514 ± 32% perf-stat.i.node-load-misses
53805 ± 29% -57.3% 22960 ± 19% perf-stat.i.node-loads
96.01 -7.8 88.18 ± 2% perf-stat.i.node-store-miss-rate%
213867 ± 31% -86.0% 29841 ± 10% perf-stat.i.node-store-misses
6788 ± 7% -22.0% 5294 ± 12% perf-stat.i.node-stores
2680 -2.2% 2621 perf-stat.i.page-faults
10.22 -4.1% 9.81 perf-stat.overall.MPKI
1.44 ± 29% -1.1 0.33 ± 32% perf-stat.overall.cache-miss-rate%
1.22 +23.6% 1.51 ± 2% perf-stat.overall.cpi
9226 ± 34% +470.3% 52623 ± 35% perf-stat.overall.cycles-between-cache-misses
0.00 ± 3% +0.0 0.00 ± 3% perf-stat.overall.dTLB-store-miss-rate%
49.22 -13.5 35.72 ± 6% perf-stat.overall.iTLB-load-miss-rate%
7072 ± 2% +6.3% 7520 perf-stat.overall.instructions-per-iTLB-miss
0.82 -19.0% 0.66 ± 2% perf-stat.overall.ipc
96.27 -4.6 91.64 perf-stat.overall.node-load-miss-rate%
96.53 -11.8 84.69 ± 3% perf-stat.overall.node-store-miss-rate%
9587 +2.7% 9844 perf-stat.overall.path-length
1.547e+10 -25.5% 1.153e+10 perf-stat.ps.branch-instructions
3.468e+08 -25.1% 2.596e+08 perf-stat.ps.branch-misses
11548381 ± 29% -83.6% 1888636 ± 32% perf-stat.ps.cache-misses
8.015e+08 -28.5% 5.73e+08 perf-stat.ps.cache-references
1487561 ± 2% -24.4% 1123929 perf-stat.ps.context-switches
9.583e+10 -7.9% 8.823e+10 perf-stat.ps.cpu-cycles
162.41 ± 9% +40.1% 227.57 ± 4% perf-stat.ps.cpu-migrations
10302904 -26.2% 7603035 perf-stat.ps.dTLB-load-misses
2.429e+10 -25.5% 1.809e+10 perf-stat.ps.dTLB-loads
12914 ± 3% +12.4% 14511 ± 2% perf-stat.ps.dTLB-store-misses
1.396e+10 -25.6% 1.038e+10 perf-stat.ps.dTLB-stores
11092764 ± 2% -29.9% 7772733 ± 3% perf-stat.ps.iTLB-load-misses
11443703 +22.6% 14033574 ± 7% perf-stat.ps.iTLB-loads
7.841e+10 -25.5% 5.843e+10 perf-stat.ps.instructions
2671 -2.2% 2612 perf-stat.ps.minor-faults
1611848 ± 41% -83.8% 261634 ± 32% perf-stat.ps.node-load-misses
53714 ± 29% -57.3% 22938 ± 19% perf-stat.ps.node-loads
213258 ± 31% -86.0% 29755 ± 10% perf-stat.ps.node-store-misses
6777 ± 7% -21.8% 5301 ± 12% perf-stat.ps.node-stores
2671 -2.2% 2612 perf-stat.ps.page-faults
2.365e+13 -25.4% 1.764e+13 perf-stat.total.instructions
37.98 ± 2% -20.6 17.33 ± 5% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
38.08 ± 2% -20.1 17.96 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
38.03 ± 2% -20.1 17.91 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
40.82 ± 2% -19.6 21.26 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64
40.23 ± 2% -19.3 20.91 ± 4% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
40.24 ± 2% -19.3 20.93 ± 4% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
40.24 ± 2% -19.3 20.94 ± 4% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
0.89 ± 3% +0.1 1.03 ± 2% perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established
0.62 ± 4% +0.1 0.77 ± 3% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.do_sendfile.__x64_sys_sendfile64.do_syscall_64
0.59 ± 5% +0.2 0.75 ± 6% perf-profile.calltrace.cycles-pp.__inet_lookup_established.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
0.54 ± 4% +0.2 0.73 ± 4% perf-profile.calltrace.cycles-pp.page_cache_pipe_buf_release.__splice_from_pipe.splice_from_pipe.direct_splice_actor.splice_direct_to_actor
0.42 ± 57% +0.2 0.62 ± 2% perf-profile.calltrace.cycles-pp.page_cache_pipe_buf_confirm.__splice_from_pipe.splice_from_pipe.direct_splice_actor.splice_direct_to_actor
0.58 ± 5% +0.2 0.80 ± 4% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout.wait_woken
1.74 +0.2 1.96 perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg
0.57 ± 4% +0.2 0.79 ± 3% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
0.68 ± 2% +0.3 0.94 perf-profile.calltrace.cycles-pp.do_splice_to.splice_direct_to_actor.do_splice_direct.do_sendfile.__x64_sys_sendfile64
0.63 ± 4% +0.3 0.89 ± 2% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.68 ± 4% +0.3 0.93 ± 3% perf-profile.calltrace.cycles-pp.release_sock.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
1.09 ± 4% +0.3 1.37 perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv
2.04 ± 2% +0.3 2.31 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
0.61 ± 5% +0.3 0.89 perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_read_iter.generic_file_splice_read.splice_direct_to_actor.do_splice_direct
0.63 ± 6% +0.3 0.91 ± 3% perf-profile.calltrace.cycles-pp.ipv4_mtu.tcp_current_mss.tcp_send_mss.do_tcp_sendpages.tcp_sendpage_locked
1.91 ± 2% +0.3 2.19 ± 2% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.83 ± 4% +0.3 1.14 perf-profile.calltrace.cycles-pp.security_file_permission.do_sendfile.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.69 ± 2% +0.3 1.02 perf-profile.calltrace.cycles-pp.__alloc_skb.sk_stream_alloc_skb.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage
2.07 ± 6% +0.3 2.40 ± 4% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.generic_file_read_iter.generic_file_splice_read.splice_direct_to_actor
0.72 ± 3% +0.3 1.06 perf-profile.calltrace.cycles-pp.sk_stream_alloc_skb.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage.inet_sendpage
2.17 ± 6% +0.4 2.53 ± 3% perf-profile.calltrace.cycles-pp.pagecache_get_page.generic_file_read_iter.generic_file_splice_read.splice_direct_to_actor.do_splice_direct
2.04 +0.4 2.41 perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg
0.84 ± 3% +0.4 1.21 ± 4% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.87 ± 3% +0.4 1.24 ± 4% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.15 ± 3% +0.4 1.59 ± 3% perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg
1.03 ± 3% +0.4 1.48 ± 3% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.wait_woken.sk_wait_data
1.06 ± 3% +0.5 1.52 ± 3% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg
0.13 ±173% +0.5 0.60 ± 3% perf-profile.calltrace.cycles-pp._copy_from_user.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.13 ±173% +0.5 0.64 perf-profile.calltrace.cycles-pp.security_file_permission.do_splice_to.splice_direct_to_actor.do_splice_direct.do_sendfile
1.70 ± 4% +0.5 2.20 perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
1.25 ± 3% +0.5 1.76 ± 3% perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
1.38 ± 3% +0.5 1.90 ± 3% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv
0.00 +0.5 0.53 perf-profile.calltrace.cycles-pp.security_file_permission.do_splice_direct.do_sendfile.__x64_sys_sendfile64.do_syscall_64
0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.__x86_indirect_thunk_rax
3.01 ± 2% +0.5 3.55 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
0.00 +0.5 0.54 ± 4% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_recvmsg
1.50 ± 3% +0.5 2.04 ± 3% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
1.25 +0.6 1.81 ± 2% perf-profile.calltrace.cycles-pp.tcp_current_mss.tcp_send_mss.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage
0.00 +0.6 0.56 ± 4% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.13 ±173% +0.6 0.69 ± 5% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout
1.60 ± 3% +0.6 2.16 ± 3% perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
0.00 +0.6 0.57 ± 3% perf-profile.calltrace.cycles-pp.fsnotify.do_sendfile.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.15 ± 2% +0.6 3.74 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg
1.20 ± 21% +0.6 1.78 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established
1.66 ± 3% +0.6 2.26 ± 3% perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
0.00 +0.6 0.60 ± 2% perf-profile.calltrace.cycles-pp.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output
0.00 +0.6 0.61 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.release_sock.tcp_sendpage.inet_sendpage.kernel_sendpage
0.00 +0.6 0.62 ± 13% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
1.41 +0.6 2.03 ± 2% perf-profile.calltrace.cycles-pp.tcp_send_mss.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage.inet_sendpage
0.00 +0.6 0.64 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry
0.00 +0.7 0.68 ± 3% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_recvmsg.inet_recvmsg
1.30 ± 8% +0.7 2.00 ± 9% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendpage
1.82 ± 2% +0.7 2.52 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.do_tcp_sendpages
2.09 ± 4% +0.7 2.79 perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
1.33 ± 9% +0.7 2.04 ± 9% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendpage.inet_sendpage
0.98 ± 28% +0.7 1.73 perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
2.00 +0.8 2.77 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.do_tcp_sendpages.tcp_sendpage_locked
3.62 ± 3% +0.8 4.41 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg
1.57 ± 9% +0.8 2.37 ± 9% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
1.57 ± 9% +0.8 2.38 ± 9% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
0.00 +0.9 0.90 ± 29% perf-profile.calltrace.cycles-pp.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit
2.21 ± 9% +1.1 3.30 ± 9% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendpage.inet_sendpage.kernel_sendpage
2.56 ± 4% +1.1 3.65 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
2.33 ± 3% +1.1 3.43 ± 5% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established
2.57 ± 4% +1.1 3.68 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
4.25 ± 2% +1.1 5.36 perf-profile.calltrace.cycles-pp.generic_file_read_iter.generic_file_splice_read.splice_direct_to_actor.do_splice_direct.do_sendfile
3.06 ± 2% +1.2 4.27 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage
3.09 +1.2 4.32 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage.inet_sendpage
3.83 ± 4% +1.4 5.18 ± 4% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_bh.lock_sock_nested.tcp_sendpage.inet_sendpage
6.54 ± 2% +1.4 7.91 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
6.57 ± 2% +1.4 7.96 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
2.85 ± 7% +1.4 4.27 ± 7% perf-profile.calltrace.cycles-pp.release_sock.tcp_sendpage.inet_sendpage.kernel_sendpage.sock_sendpage
4.88 ± 2% +1.5 6.33 perf-profile.calltrace.cycles-pp.generic_file_splice_read.splice_direct_to_actor.do_splice_direct.do_sendfile.__x64_sys_sendfile64
3.58 +1.5 5.04 ± 2% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
4.26 ± 3% +1.5 5.76 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.lock_sock_nested.tcp_sendpage.inet_sendpage.kernel_sendpage
3.34 +1.5 4.88 ± 4% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv
3.74 +1.6 5.38 ± 2% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
4.67 ± 4% +1.7 6.36 ± 2% perf-profile.calltrace.cycles-pp.lock_sock_nested.tcp_sendpage.inet_sendpage.kernel_sendpage.sock_sendpage
7.08 +2.7 9.80 perf-profile.calltrace.cycles-pp.do_tcp_sendpages.tcp_sendpage_locked.tcp_sendpage.inet_sendpage.kernel_sendpage
7.22 ± 2% +2.7 9.96 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
7.26 ± 2% +2.8 10.01 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
7.66 +2.8 10.47 perf-profile.calltrace.cycles-pp.tcp_sendpage_locked.tcp_sendpage.inet_sendpage.kernel_sendpage.sock_sendpage
8.00 ± 2% +3.2 11.16 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
8.20 ± 2% +3.3 11.50 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg
8.45 ± 2% +3.3 11.79 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
8.32 ± 2% +3.3 11.65 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg
9.22 +3.5 12.69 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
9.33 +3.5 12.84 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
9.37 +3.5 12.90 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
9.48 +3.6 13.05 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
9.67 +3.7 13.39 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
9.87 +3.9 13.76 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack
10.15 +4.0 14.14 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq
10.35 +4.1 14.43 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
10.48 +4.2 14.65 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
10.46 +4.2 14.64 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
10.55 +4.2 14.76 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit
10.55 +4.2 14.78 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
15.87 ± 2% +6.1 21.99 ± 2% perf-profile.calltrace.cycles-pp.tcp_sendpage.inet_sendpage.kernel_sendpage.sock_sendpage.pipe_to_sendpage
16.60 ± 2% +6.3 22.89 ± 2% perf-profile.calltrace.cycles-pp.inet_sendpage.kernel_sendpage.sock_sendpage.pipe_to_sendpage.__splice_from_pipe
16.70 ± 2% +6.4 23.05 ± 2% perf-profile.calltrace.cycles-pp.kernel_sendpage.sock_sendpage.pipe_to_sendpage.__splice_from_pipe.splice_from_pipe
17.05 ± 2% +6.4 23.46 ± 2% perf-profile.calltrace.cycles-pp.sock_sendpage.pipe_to_sendpage.__splice_from_pipe.splice_from_pipe.direct_splice_actor
17.48 ± 2% +6.5 24.01 ± 2% perf-profile.calltrace.cycles-pp.pipe_to_sendpage.__splice_from_pipe.splice_from_pipe.direct_splice_actor.splice_direct_to_actor
20.28 +6.8 27.05 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
20.33 +6.8 27.13 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.76 +6.9 27.67 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.80 +6.9 27.72 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
19.00 ± 2% +7.0 26.05 ± 2% perf-profile.calltrace.cycles-pp.__splice_from_pipe.splice_from_pipe.direct_splice_actor.splice_direct_to_actor.do_splice_direct
19.36 ± 2% +7.1 26.49 ± 2% perf-profile.calltrace.cycles-pp.splice_from_pipe.direct_splice_actor.splice_direct_to_actor.do_splice_direct.do_sendfile
19.67 ± 2% +7.3 26.97 ± 2% perf-profile.calltrace.cycles-pp.direct_splice_actor.splice_direct_to_actor.do_splice_direct.do_sendfile.__x64_sys_sendfile64
25.77 ± 2% +9.3 35.08 perf-profile.calltrace.cycles-pp.splice_direct_to_actor.do_splice_direct.do_sendfile.__x64_sys_sendfile64.do_syscall_64
26.29 ± 2% +9.5 35.75 perf-profile.calltrace.cycles-pp.do_splice_direct.do_sendfile.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
28.65 ± 2% +10.4 39.06 perf-profile.calltrace.cycles-pp.do_sendfile.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
29.77 ± 2% +10.7 40.51 perf-profile.calltrace.cycles-pp.__x64_sys_sendfile64.do_syscall_64.entry_SYSCALL_64_after_hwframe
54.03 +18.5 72.54 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
54.22 +18.5 72.75 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
37.98 ± 2% -20.6 17.34 ± 5% perf-profile.children.cycles-pp.intel_idle
38.62 ± 2% -20.4 18.26 ± 5% perf-profile.children.cycles-pp.cpuidle_enter
38.62 ± 2% -20.4 18.26 ± 5% perf-profile.children.cycles-pp.cpuidle_enter_state
40.82 ± 2% -19.6 21.26 ± 4% perf-profile.children.cycles-pp.secondary_startup_64
40.82 ± 2% -19.6 21.26 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
40.82 ± 2% -19.6 21.26 ± 4% perf-profile.children.cycles-pp.do_idle
40.24 ± 2% -19.3 20.94 ± 4% perf-profile.children.cycles-pp.start_secondary
0.05 +0.0 0.06 ± 6% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.08 +0.0 0.10 ± 5% perf-profile.children.cycles-pp.tcp_update_skb_after_send
0.11 ± 3% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.nr_iowait_cpu
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.05 +0.0 0.07 ± 12% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.rb_next
0.07 ± 10% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.10 ± 10% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.09 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64
0.16 ± 6% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.tcp_check_space
0.05 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.__x86_indirect_thunk_r14
0.11 ± 8% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.rcu_idle_exit
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.pick_next_entity
0.09 ± 7% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.sock_rfree
0.05 ± 8% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.tcp_tx_timestamp
0.12 ± 7% +0.0 0.14 ± 5% perf-profile.children.cycles-pp.remove_wait_queue
0.11 ± 11% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.native_write_msr
0.20 ± 2% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.05 ± 9% +0.0 0.08 ± 8% perf-profile.children.cycles-pp.tcp_recv_timestamp
0.23 ± 2% +0.0 0.25 ± 6% perf-profile.children.cycles-pp.ip_send_check
0.08 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.__x86_indirect_thunk_r10
0.07 ± 6% +0.0 0.10 ± 9% perf-profile.children.cycles-pp.cpus_share_cache
0.11 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.check_stack_object
0.09 ± 8% +0.0 0.12 ± 10% perf-profile.children.cycles-pp.update_cfs_group
0.07 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.finish_task_switch
0.18 ± 4% +0.0 0.21 ± 5% perf-profile.children.cycles-pp.generic_splice_sendpage
0.12 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.aa_sk_perm
0.12 ± 4% +0.0 0.16 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.11 ± 8% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.update_ts_time_stats
0.10 ± 8% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.sched_clock
0.06 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.tcp_event_data_recv
0.04 ± 57% +0.0 0.07 perf-profile.children.cycles-pp.task_tick_fair
0.04 ± 58% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.bictcp_acked
0.10 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.native_sched_clock
0.08 ± 8% +0.0 0.12 ± 7% perf-profile.children.cycles-pp.check_preempt_curr
0.05 ± 8% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.fpregs_assert_state_consistent
0.05 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.kfree_skbmem
0.06 ± 9% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.__copy_skb_header
0.16 ± 2% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.tcp_wfree
0.14 ± 3% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.sockfd_lookup_light
0.06 +0.0 0.10 ± 4% perf-profile.children.cycles-pp.newidle_balance
0.11 ± 7% +0.0 0.15 ± 6% perf-profile.children.cycles-pp.sched_clock_cpu
0.15 ± 3% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.sock_recvmsg
0.07 +0.0 0.11 perf-profile.children.cycles-pp.inet_ehashfn
0.07 ± 11% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.tcp_update_pacing_rate
0.03 ±100% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.tcp_chrono_stop
0.13 ± 3% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.security_socket_recvmsg
0.10 ± 5% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.18 ± 4% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.inet_send_prepare
0.06 ± 9% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.tcp_push
0.22 ± 3% +0.0 0.26 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair
0.12 ± 4% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.__switch_to_asm
0.09 ± 7% +0.0 0.13 ± 6% perf-profile.children.cycles-pp.__tcp_select_window
0.21 ± 4% +0.0 0.26 ± 4% perf-profile.children.cycles-pp.tcp_rcv_space_adjust
0.07 ± 10% +0.0 0.12 ± 9% perf-profile.children.cycles-pp.netif_skb_features
0.01 ±173% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.raw_local_deliver
0.21 ± 6% +0.0 0.26 ± 6% perf-profile.children.cycles-pp.__put_user_8
0.05 ± 8% +0.0 0.10 perf-profile.children.cycles-pp.___perf_sw_event
0.32 ± 3% +0.0 0.36 perf-profile.children.cycles-pp.tcp_rate_check_app_limited
0.00 +0.1 0.05 perf-profile.children.cycles-pp.default_wake_function
0.08 ± 10% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.sanity
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.tcp_v4_inbound_md5_hash
0.03 ±100% +0.1 0.08 ± 10% perf-profile.children.cycles-pp.ip_queue_xmit
0.21 ± 3% +0.1 0.26 ± 3% perf-profile.children.cycles-pp.aa_file_perm
0.15 ± 5% +0.1 0.20 ± 5% perf-profile.children.cycles-pp.__switch_to
0.15 ± 3% +0.1 0.20 ± 7% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.iov_iter_pipe
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.__usecs_to_jiffies
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.bictcp_cong_avoid
0.07 ± 6% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.__list_del_entry_valid
0.01 ±173% +0.1 0.07 ± 10% perf-profile.children.cycles-pp.resched_curr
0.15 ± 9% +0.1 0.21 ± 3% perf-profile.children.cycles-pp.rcu_all_qs
0.09 ± 7% +0.1 0.15 ± 12% perf-profile.children.cycles-pp._find_next_bit
0.07 ± 12% +0.1 0.13 ± 6% perf-profile.children.cycles-pp.kfree
0.07 ± 7% +0.1 0.12 ± 6% perf-profile.children.cycles-pp.tcp_ack_update_rtt
0.04 ± 57% +0.1 0.10 ± 4% perf-profile.children.cycles-pp.apparmor_ipv4_postroute
0.00 +0.1 0.06 perf-profile.children.cycles-pp.tcp_v4_fill_cb
0.00 +0.1 0.06 perf-profile.children.cycles-pp._raw_spin_unlock_bh
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.tcp_options_write
0.08 ± 10% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.scheduler_tick
0.26 +0.1 0.32 ± 4% perf-profile.children.cycles-pp.__ip_local_out
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.eth_type_trans
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.tcp_stream_memory_free
0.28 +0.1 0.34 ± 5% perf-profile.children.cycles-pp.ip_local_out
0.07 ± 10% +0.1 0.14 ± 8% perf-profile.children.cycles-pp.ip_rcv_finish
0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.ksoftirqd_running
0.11 ± 4% +0.1 0.17 ± 6% perf-profile.children.cycles-pp.tcp_v4_send_check
0.35 +0.1 0.42 ± 5% perf-profile.children.cycles-pp.__ksize
0.12 ± 7% +0.1 0.18 ± 6% perf-profile.children.cycles-pp.validate_xmit_skb
0.09 ± 4% +0.1 0.16 ± 5% perf-profile.children.cycles-pp.skb_entail
0.24 ± 2% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.__sk_dst_check
0.20 ± 5% +0.1 0.27 ± 4% perf-profile.children.cycles-pp.sock_put
0.00 +0.1 0.07 perf-profile.children.cycles-pp.put_prev_task_fair
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.account_entity_dequeue
0.09 +0.1 0.16 ± 7% perf-profile.children.cycles-pp.ip_rcv_core
0.42 +0.1 0.49 ± 3% perf-profile.children.cycles-pp.skb_release_head_state
0.24 ± 4% +0.1 0.31 ± 2% perf-profile.children.cycles-pp.rw_verify_area
0.21 ± 2% +0.1 0.28 ± 3% perf-profile.children.cycles-pp.ipv4_dst_check
0.44 +0.1 0.51 ± 3% perf-profile.children.cycles-pp.skb_release_all
0.04 ± 57% +0.1 0.11 ± 7% perf-profile.children.cycles-pp.tcp_rearm_rto
0.01 ±173% +0.1 0.09 ± 4% perf-profile.children.cycles-pp.ip_rcv_finish_core
0.23 ± 6% +0.1 0.30 ± 2% perf-profile.children.cycles-pp.update_curr
0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.__tcp_ack_snd_check
0.17 ± 7% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.skb_clone
0.11 ± 17% +0.1 0.19 ± 3% perf-profile.children.cycles-pp.xas_start
0.17 ± 4% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.tcp_rack_advance
0.55 ± 4% +0.1 0.64 ± 2% perf-profile.children.cycles-pp.page_cache_pipe_buf_confirm
0.12 ± 4% +0.1 0.21 ± 3% perf-profile.children.cycles-pp.timestamp_truncate
0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.rb_first
0.30 ± 8% +0.1 0.39 ± 2% perf-profile.children.cycles-pp._cond_resched
0.16 ± 2% +0.1 0.25 ± 7% perf-profile.children.cycles-pp.tcp_add_backlog
0.17 ± 4% +0.1 0.26 ± 9% perf-profile.children.cycles-pp.__next_timer_interrupt
0.38 +0.1 0.47 ± 5% perf-profile.children.cycles-pp.__skb_clone
0.17 ± 2% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.ktime_get_with_offset
0.12 ± 4% +0.1 0.22 ± 11% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.tcp_cleanup_rbuf
0.11 ± 6% +0.1 0.20 ± 7% perf-profile.children.cycles-pp.__update_load_avg_se
0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.apparmor_socket_sock_rcv_skb
0.37 +0.1 0.47 ± 3% perf-profile.children.cycles-pp.dst_release
0.25 ± 3% +0.1 0.35 ± 2% perf-profile.children.cycles-pp.enqueue_to_backlog
0.17 ± 6% +0.1 0.28 ± 3% perf-profile.children.cycles-pp.__ip_finish_output
0.11 ± 6% +0.1 0.22 ± 8% perf-profile.children.cycles-pp.nf_hook_slow
0.36 ± 3% +0.1 0.47 ± 4% perf-profile.children.cycles-pp.set_next_entity
0.20 ± 2% +0.1 0.31 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc_node
0.12 ± 5% +0.1 0.23 ± 4% perf-profile.children.cycles-pp.update_process_times
0.00 +0.1 0.11 ± 15% perf-profile.children.cycles-pp.rcu_core
0.04 ± 57% +0.1 0.15 ± 13% perf-profile.children.cycles-pp.security_sock_rcv_skb
0.26 ± 4% +0.1 0.38 ± 6% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.49 ± 3% +0.1 0.61 ± 3% perf-profile.children.cycles-pp._copy_from_user
0.12 ± 5% +0.1 0.24 ± 5% perf-profile.children.cycles-pp.tick_sched_handle
0.27 ± 8% +0.1 0.39 perf-profile.children.cycles-pp.xas_load
0.24 ± 8% +0.1 0.37 ± 4% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.21 ± 2% +0.1 0.34 perf-profile.children.cycles-pp.tcp_schedule_loss_probe
0.48 ± 4% +0.1 0.60 perf-profile.children.cycles-pp.__fget_light
0.21 ± 3% +0.1 0.34 ± 5% perf-profile.children.cycles-pp.__kmalloc_node_track_caller
0.23 ± 3% +0.1 0.36 ± 6% perf-profile.children.cycles-pp.__kmalloc_reserve
0.32 ± 3% +0.1 0.46 ± 6% perf-profile.children.cycles-pp.__tcp_send_ack
0.32 ± 4% +0.1 0.45 ± 5% perf-profile.children.cycles-pp.tick_nohz_next_event
0.10 ± 11% +0.1 0.24 ± 8% perf-profile.children.cycles-pp.sk_filter_trim_cap
0.18 ± 10% +0.1 0.32 ± 2% perf-profile.children.cycles-pp.__netif_receive_skb_core
0.12 ± 10% +0.1 0.27 ± 14% perf-profile.children.cycles-pp.clockevents_program_event
0.53 +0.1 0.68 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.31 ± 3% +0.1 0.45 ± 4% perf-profile.children.cycles-pp.tcp_established_options
0.14 ± 5% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.tick_sched_timer
0.10 ± 4% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.tcp_release_cb
0.35 ± 2% +0.2 0.50 perf-profile.children.cycles-pp.__might_sleep
0.30 ± 8% +0.2 0.45 ± 7% perf-profile.children.cycles-pp.__virt_addr_valid
0.34 ± 2% +0.2 0.50 ± 6% perf-profile.children.cycles-pp.tcp_mstamp_refresh
0.41 ± 5% +0.2 0.57 ± 4% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.29 ± 2% +0.2 0.46 perf-profile.children.cycles-pp.__fsnotify_parent
0.26 ± 2% +0.2 0.43 ± 4% perf-profile.children.cycles-pp.__slab_free
0.34 ± 5% +0.2 0.52 ± 2% perf-profile.children.cycles-pp.mod_timer
0.08 ± 13% +0.2 0.26 ± 15% perf-profile.children.cycles-pp.irq_exit
0.18 ± 8% +0.2 0.36 ± 3% perf-profile.children.cycles-pp.apparmor_file_permission
0.33 ± 4% +0.2 0.51 ± 4% perf-profile.children.cycles-pp.current_time
0.35 ± 5% +0.2 0.54 ± 2% perf-profile.children.cycles-pp.sk_reset_timer
0.55 ± 4% +0.2 0.73 ± 4% perf-profile.children.cycles-pp.page_cache_pipe_buf_release
0.31 ± 6% +0.2 0.51 ± 2% perf-profile.children.cycles-pp.tcp_event_new_data_sent
0.78 ± 4% +0.2 0.97 ± 3% perf-profile.children.cycles-pp.__inet_lookup_established
1.16 +0.2 1.37 ± 2% perf-profile.children.cycles-pp.skb_release_data
0.44 +0.2 0.65 perf-profile.children.cycles-pp.netif_rx_internal
0.45 ± 2% +0.2 0.66 ± 2% perf-profile.children.cycles-pp.netif_rx
0.48 ± 5% +0.2 0.70 ± 5% perf-profile.children.cycles-pp.dequeue_entity
0.48 ± 3% +0.2 0.70 ± 3% perf-profile.children.cycles-pp.__might_fault
0.59 ± 5% +0.2 0.81 ± 3% perf-profile.children.cycles-pp.dequeue_task_fair
0.76 +0.2 0.99 ± 4% perf-profile.children.cycles-pp.read_tsc
0.53 ± 2% +0.2 0.76 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair
1.77 +0.2 2.00 perf-profile.children.cycles-pp.__check_object_size
0.48 ± 4% +0.2 0.72 ± 3% perf-profile.children.cycles-pp.enqueue_entity
1.24 ± 4% +0.2 1.48 perf-profile.children.cycles-pp.common_file_perm
0.69 ± 2% +0.2 0.94 perf-profile.children.cycles-pp.do_splice_to
0.65 ± 5% +0.3 0.90 ± 2% perf-profile.children.cycles-pp.menu_select
0.49 ± 5% +0.3 0.76 ± 2% perf-profile.children.cycles-pp.fsnotify
0.62 ± 5% +0.3 0.90 perf-profile.children.cycles-pp.copy_page_to_iter
0.63 ± 2% +0.3 0.90 perf-profile.children.cycles-pp._raw_spin_lock
2.04 ± 2% +0.3 2.32 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.42 ± 10% +0.3 0.71 ± 10% perf-profile.children.cycles-pp.hrtimer_interrupt
0.44 ± 4% +0.3 0.74 ± 4% perf-profile.children.cycles-pp.update_load_avg
0.89 ± 2% +0.3 1.20 perf-profile.children.cycles-pp.___might_sleep
0.57 ± 3% +0.3 0.90 ± 4% perf-profile.children.cycles-pp.enqueue_task_fair
2.17 ± 2% +0.3 2.49 perf-profile.children.cycles-pp.syscall_return_via_sysret
0.58 ± 3% +0.3 0.93 ± 3% perf-profile.children.cycles-pp.ttwu_do_activate
0.58 ± 3% +0.3 0.92 ± 3% perf-profile.children.cycles-pp.activate_task
0.53 ± 4% +0.3 0.87 ± 2% perf-profile.children.cycles-pp.atime_needs_update
0.72 ± 2% +0.3 1.07 perf-profile.children.cycles-pp.sk_stream_alloc_skb
2.08 ± 6% +0.3 2.42 ± 4% perf-profile.children.cycles-pp.find_get_entry
0.77 ± 6% +0.4 1.13 ± 3% perf-profile.children.cycles-pp.ipv4_mtu
2.06 +0.4 2.42 perf-profile.children.cycles-pp.simple_copy_to_iter
2.19 ± 6% +0.4 2.55 ± 3% perf-profile.children.cycles-pp.pagecache_get_page
0.88 ± 3% +0.4 1.25 ± 3% perf-profile.children.cycles-pp.schedule_idle
0.96 ± 2% +0.4 1.37 perf-profile.children.cycles-pp.loopback_xmit
1.16 ± 3% +0.4 1.59 ± 3% perf-profile.children.cycles-pp.schedule_timeout
1.01 ± 2% +0.4 1.46 perf-profile.children.cycles-pp.dev_hard_start_xmit
0.98 +0.4 1.43 ± 2% perf-profile.children.cycles-pp.__alloc_skb
0.66 ± 4% +0.5 1.12 ± 2% perf-profile.children.cycles-pp.touch_atime
1.06 ± 3% +0.5 1.52 ± 3% perf-profile.children.cycles-pp.schedule
1.32 ± 3% +0.5 1.78 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
0.98 ± 2% +0.5 1.45 perf-profile.children.cycles-pp.ktime_get
1.84 +0.5 2.31 ± 2% perf-profile.children.cycles-pp.__kfree_skb
0.77 ± 2% +0.5 1.25 perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.56 ± 11% +0.5 1.04 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.65 ± 12% +0.5 1.12 ± 6% perf-profile.children.cycles-pp.apic_timer_interrupt
1.25 ± 3% +0.5 1.76 ± 3% perf-profile.children.cycles-pp.wait_woken
1.38 ± 3% +0.5 1.91 ± 3% perf-profile.children.cycles-pp.__wake_up_common
1.49 ± 3% +0.6 2.04 ± 2% perf-profile.children.cycles-pp.__wake_up_common_lock
1.77 ± 3% +0.6 2.33 perf-profile.children.cycles-pp.security_file_permission
3.19 ± 2% +0.6 3.78 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
1.66 ± 3% +0.6 2.25 ± 2% perf-profile.children.cycles-pp.sock_def_readable
3.17 ± 2% +0.6 3.75 perf-profile.children.cycles-pp.copyout
1.67 ± 3% +0.6 2.27 ± 3% perf-profile.children.cycles-pp.sk_wait_data
1.36 +0.6 1.97 ± 2% perf-profile.children.cycles-pp.tcp_current_mss
1.41 +0.6 2.05 ± 2% perf-profile.children.cycles-pp.tcp_send_mss
2.01 ± 2% +0.7 2.66 ± 2% perf-profile.children.cycles-pp.tcp_clean_rtx_queue
1.54 ± 2% +0.7 2.21 perf-profile.children.cycles-pp.__dev_queue_xmit
3.65 ± 3% +0.8 4.44 perf-profile.children.cycles-pp._copy_to_iter
1.91 ± 3% +0.8 2.73 ± 3% perf-profile.children.cycles-pp.__sched_text_start
2.45 ± 2% +0.9 3.35 ± 2% perf-profile.children.cycles-pp.tcp_ack
4.28 ± 2% +1.1 5.41 perf-profile.children.cycles-pp.generic_file_read_iter
2.78 ± 7% +1.3 4.10 ± 7% perf-profile.children.cycles-pp.__release_sock
6.55 ± 2% +1.4 7.93 perf-profile.children.cycles-pp.__skb_datagram_iter
6.57 ± 2% +1.4 7.96 perf-profile.children.cycles-pp.skb_copy_datagram_iter
3.92 ± 4% +1.4 5.33 ± 3% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
4.88 ± 2% +1.5 6.34 perf-profile.children.cycles-pp.generic_file_splice_read
3.58 ± 6% +1.7 5.26 ± 6% perf-profile.children.cycles-pp.release_sock
4.98 ± 3% +1.7 6.70 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_bh
4.96 ± 3% +1.8 6.72 ± 2% perf-profile.children.cycles-pp.lock_sock_nested
7.11 +2.7 9.84 perf-profile.children.cycles-pp.do_tcp_sendpages
7.67 +2.8 10.50 perf-profile.children.cycles-pp.tcp_sendpage_locked
7.20 +3.1 10.33 ± 2% perf-profile.children.cycles-pp.tcp_write_xmit
7.25 +3.1 10.39 ± 2% perf-profile.children.cycles-pp.__tcp_push_pending_frames
9.24 +3.5 12.71 perf-profile.children.cycles-pp.tcp_v4_rcv
9.33 +3.5 12.84 perf-profile.children.cycles-pp.ip_protocol_deliver_rcu
9.37 +3.5 12.90 perf-profile.children.cycles-pp.ip_local_deliver_finish
9.49 +3.6 13.07 perf-profile.children.cycles-pp.ip_local_deliver
8.91 +3.6 12.53 ± 2% perf-profile.children.cycles-pp.tcp_rcv_established
9.07 +3.7 12.73 ± 2% perf-profile.children.cycles-pp.tcp_v4_do_rcv
9.67 +3.7 13.41 perf-profile.children.cycles-pp.ip_rcv
9.88 +3.9 13.77 perf-profile.children.cycles-pp.__netif_receive_skb_one_core
10.16 +4.0 14.16 perf-profile.children.cycles-pp.process_backlog
10.36 +4.1 14.44 perf-profile.children.cycles-pp.net_rx_action
10.48 +4.2 14.66 perf-profile.children.cycles-pp.do_softirq_own_stack
10.56 +4.2 14.79 perf-profile.children.cycles-pp.do_softirq
10.52 +4.3 14.84 perf-profile.children.cycles-pp.__softirqentry_text_start
10.80 +4.3 15.14 perf-profile.children.cycles-pp.__local_bh_enable_ip
11.79 +4.8 16.56 perf-profile.children.cycles-pp.ip_finish_output2
12.06 +5.0 17.04 perf-profile.children.cycles-pp.ip_output
12.61 +5.1 17.74 perf-profile.children.cycles-pp.__ip_queue_xmit
13.35 +5.5 18.82 perf-profile.children.cycles-pp.__tcp_transmit_skb
15.91 ± 2% +6.1 22.05 ± 2% perf-profile.children.cycles-pp.tcp_sendpage
16.62 ± 2% +6.3 22.92 ± 2% perf-profile.children.cycles-pp.inet_sendpage
16.71 ± 2% +6.4 23.07 ± 2% perf-profile.children.cycles-pp.kernel_sendpage
17.06 ± 2% +6.4 23.48 ± 2% perf-profile.children.cycles-pp.sock_sendpage
17.48 ± 2% +6.5 24.02 ± 2% perf-profile.children.cycles-pp.pipe_to_sendpage
20.29 +6.8 27.07 perf-profile.children.cycles-pp.tcp_recvmsg
20.33 +6.8 27.13 perf-profile.children.cycles-pp.inet_recvmsg
20.76 +6.9 27.67 perf-profile.children.cycles-pp.__sys_recvfrom
20.81 +6.9 27.73 perf-profile.children.cycles-pp.__x64_sys_recvfrom
19.04 ± 2% +7.1 26.10 ± 2% perf-profile.children.cycles-pp.__splice_from_pipe
19.37 ± 2% +7.1 26.51 ± 2% perf-profile.children.cycles-pp.splice_from_pipe
19.68 ± 2% +7.3 26.97 ± 2% perf-profile.children.cycles-pp.direct_splice_actor
25.77 ± 2% +9.3 35.09 perf-profile.children.cycles-pp.splice_direct_to_actor
26.31 ± 2% +9.5 35.77 perf-profile.children.cycles-pp.do_splice_direct
28.69 ± 2% +10.4 39.12 perf-profile.children.cycles-pp.do_sendfile
29.79 ± 2% +10.7 40.54 perf-profile.children.cycles-pp.__x64_sys_sendfile64
54.10 +18.5 72.61 perf-profile.children.cycles-pp.do_syscall_64
54.27 +18.5 72.80 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
37.98 ± 2% -20.6 17.34 ± 5% perf-profile.self.cycles-pp.intel_idle
0.10 ± 4% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.schedule_timeout
0.09 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.check_stack_object
0.06 +0.0 0.08 ± 6% perf-profile.self.cycles-pp.finish_task_switch
0.08 ± 5% +0.0 0.10 ± 10% perf-profile.self.cycles-pp.tcp_rcv_space_adjust
0.06 ± 6% +0.0 0.08 perf-profile.self.cycles-pp.pick_next_entity
0.06 ± 9% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.do_softirq
0.05 ± 9% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.tcp_recv_timestamp
0.11 ± 6% +0.0 0.13 ± 5% perf-profile.self.cycles-pp.nr_iowait_cpu
0.09 ± 7% +0.0 0.11 ± 6% perf-profile.self.cycles-pp.sock_rfree
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__x86_indirect_thunk_r10
0.17 ± 4% +0.0 0.19 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.10 ± 5% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.__sk_dst_check
0.11 ± 11% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.native_write_msr
0.10 ± 5% +0.0 0.12 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair
0.05 +0.0 0.08 ± 6% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu
0.11 ± 4% +0.0 0.14 ± 5% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.10 ± 9% +0.0 0.12 ± 8% perf-profile.self.cycles-pp.__sys_recvfrom
0.08 ± 6% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.do_splice_direct
0.07 ± 10% +0.0 0.10 ± 11% perf-profile.self.cycles-pp.kmem_cache_free
0.07 ± 6% +0.0 0.10 ± 9% perf-profile.self.cycles-pp.cpus_share_cache
0.09 ± 9% +0.0 0.12 ± 7% perf-profile.self.cycles-pp.update_cfs_group
0.22 ± 3% +0.0 0.25 ± 4% perf-profile.self.cycles-pp.ip_send_check
0.17 ± 4% +0.0 0.20 ± 3% perf-profile.self.cycles-pp.inet_send_prepare
0.09 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.aa_sk_perm
0.10 ± 4% +0.0 0.13 ± 6% perf-profile.self.cycles-pp.native_sched_clock
0.06 +0.0 0.09 ± 7% perf-profile.self.cycles-pp.do_splice_to
0.11 ± 7% +0.0 0.14 ± 5% perf-profile.self.cycles-pp.pagecache_get_page
0.15 ± 5% +0.0 0.18 perf-profile.self.cycles-pp._cond_resched
0.05 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.kfree_skbmem
0.15 ± 3% +0.0 0.19 ± 4% perf-profile.self.cycles-pp.tcp_wfree
0.15 ± 4% +0.0 0.18 ± 5% perf-profile.self.cycles-pp.generic_splice_sendpage
0.05 ± 9% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.ktime_get_with_offset
0.05 ± 8% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.fpregs_assert_state_consistent
0.04 ± 57% +0.0 0.07 ± 10% perf-profile.self.cycles-pp._copy_from_user
0.04 ± 57% +0.0 0.07 perf-profile.self.cycles-pp.validate_xmit_skb
0.04 ± 58% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.rb_next
0.07 ± 10% +0.0 0.10 ± 10% perf-profile.self.cycles-pp.__next_timer_interrupt
0.05 ± 8% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.dev_hard_start_xmit
0.16 ± 2% +0.0 0.20 ± 5% perf-profile.self.cycles-pp.sock_def_readable
0.07 ± 7% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.copyout
0.06 +0.0 0.10 ± 5% perf-profile.self.cycles-pp.newidle_balance
0.04 ± 57% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.skb_release_head_state
0.04 ± 58% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.bictcp_acked
0.05 +0.0 0.09 ± 9% perf-profile.self.cycles-pp.tcp_push
0.05 ± 8% +0.0 0.09 ± 7% perf-profile.self.cycles-pp.tcp_event_data_recv
0.05 +0.0 0.09 ± 14% perf-profile.self.cycles-pp.nf_hook_slow
0.06 ± 9% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.__copy_skb_header
0.06 ± 6% +0.0 0.10 perf-profile.self.cycles-pp.tcp_schedule_loss_probe
0.07 ± 6% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.inet_ehashfn
0.11 ± 4% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.ip_local_deliver
0.01 ±173% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.raw_local_deliver
0.04 ± 58% +0.0 0.08 ± 10% perf-profile.self.cycles-pp.netif_skb_features
0.12 ± 4% +0.0 0.17 ± 2% perf-profile.self.cycles-pp.__switch_to_asm
0.09 ± 7% +0.0 0.13 ± 6% perf-profile.self.cycles-pp.__tcp_select_window
0.20 ± 4% +0.0 0.24 ± 2% perf-profile.self.cycles-pp.set_next_entity
0.08 ± 8% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.skb_entail
0.07 ± 6% +0.0 0.11 ± 3% perf-profile.self.cycles-pp.tcp_update_pacing_rate
0.32 ± 3% +0.0 0.36 perf-profile.self.cycles-pp.tcp_rate_check_app_limited
0.23 ± 4% +0.0 0.28 ± 6% perf-profile.self.cycles-pp.security_file_permission
0.21 ± 6% +0.0 0.26 ± 4% perf-profile.self.cycles-pp.__put_user_8
0.01 ±173% +0.0 0.06 perf-profile.self.cycles-pp.__x86_indirect_thunk_r14
0.24 ± 2% +0.0 0.29 ± 6% perf-profile.self.cycles-pp.tcp_sendpage_locked
0.10 ± 8% +0.0 0.15 ± 2% perf-profile.self.cycles-pp.rcu_all_qs
0.04 ± 58% +0.0 0.09 perf-profile.self.cycles-pp.sk_filter_trim_cap
0.06 ± 9% +0.1 0.11 ± 8% perf-profile.self.cycles-pp.tcp_ack_update_rtt
0.21 ± 3% +0.1 0.26 ± 2% perf-profile.self.cycles-pp.aa_file_perm
0.07 ± 5% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.tcp_event_new_data_sent
0.09 ± 5% +0.1 0.14 ± 9% perf-profile.self.cycles-pp.kernel_sendpage
0.01 ±173% +0.1 0.07 ± 13% perf-profile.self.cycles-pp.inet_recvmsg
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.tcp_v4_fill_cb
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.ip_local_deliver_finish
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp._raw_spin_unlock_bh
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.iov_iter_pipe
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.bictcp_cong_avoid
0.33 +0.1 0.38 ± 6% perf-profile.self.cycles-pp.__skb_clone
0.17 +0.1 0.23 ± 3% perf-profile.self.cycles-pp.net_rx_action
0.14 ± 7% +0.1 0.20 ± 4% perf-profile.self.cycles-pp.__switch_to
0.07 ± 6% +0.1 0.12 ± 8% perf-profile.self.cycles-pp.sanity
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.tcp_rack_advance
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.tcp_chrono_stop
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.__tcp_send_ack
0.08 ± 5% +0.1 0.13 ± 6% perf-profile.self.cycles-pp.__ip_finish_output
0.15 ± 4% +0.1 0.21 ± 2% perf-profile.self.cycles-pp.xas_load
0.15 ± 4% +0.1 0.21 ± 2% perf-profile.self.cycles-pp.enqueue_to_backlog
0.09 ± 7% +0.1 0.15 ± 15% perf-profile.self.cycles-pp._find_next_bit
0.14 ± 14% +0.1 0.20 ± 2% perf-profile.self.cycles-pp.lock_sock_nested
0.07 ± 7% +0.1 0.12 ± 8% perf-profile.self.cycles-pp.__list_del_entry_valid
0.07 ± 7% +0.1 0.12 ± 12% perf-profile.self.cycles-pp.kfree
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.tcp_options_write
0.01 ±173% +0.1 0.07 ± 10% perf-profile.self.cycles-pp.resched_curr
0.16 ± 5% +0.1 0.22 perf-profile.self.cycles-pp.process_backlog
0.15 ± 5% +0.1 0.21 ± 7% perf-profile.self.cycles-pp.release_sock
0.00 +0.1 0.06 perf-profile.self.cycles-pp.__ip_local_out
0.00 +0.1 0.06 perf-profile.self.cycles-pp.tcp_tx_timestamp
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.netif_rx_internal
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.tcp_stream_memory_free
0.10 ± 4% +0.1 0.16 ± 6% perf-profile.self.cycles-pp.tcp_v4_send_check
0.13 ± 8% +0.1 0.19 ± 3% perf-profile.self.cycles-pp.update_curr
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.eth_type_trans
0.09 ± 7% +0.1 0.15 ± 5% perf-profile.self.cycles-pp.ip_output
0.35 +0.1 0.42 ± 5% perf-profile.self.cycles-pp.__ksize
0.11 ± 17% +0.1 0.17 ± 4% perf-profile.self.cycles-pp.xas_start
0.20 ± 2% +0.1 0.26 ± 3% perf-profile.self.cycles-pp.ipv4_dst_check
0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.ksoftirqd_running
0.20 ± 3% +0.1 0.27 ± 5% perf-profile.self.cycles-pp.sock_put
0.17 ± 7% +0.1 0.24 ± 5% perf-profile.self.cycles-pp.menu_select
0.09 +0.1 0.16 ± 5% perf-profile.self.cycles-pp.ip_rcv_core
0.00 +0.1 0.07 ± 16% perf-profile.self.cycles-pp.account_entity_dequeue
0.14 ± 5% +0.1 0.21 ± 6% perf-profile.self.cycles-pp.enqueue_entity
0.15 ± 7% +0.1 0.22 ± 12% perf-profile.self.cycles-pp.__might_fault
0.00 +0.1 0.07 perf-profile.self.cycles-pp.__tcp_push_pending_frames
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.__tcp_ack_snd_check
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.ip_queue_xmit
0.01 ±173% +0.1 0.08 ± 5% perf-profile.self.cycles-pp.ip_rcv_finish_core
0.53 ± 5% +0.1 0.60 ± 2% perf-profile.self.cycles-pp.page_cache_pipe_buf_confirm
0.22 ± 5% +0.1 0.29 ± 2% perf-profile.self.cycles-pp.rw_verify_area
0.13 ± 6% +0.1 0.21 ± 3% perf-profile.self.cycles-pp.mod_timer
0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.rb_first
0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.tcp_mstamp_refresh
0.29 +0.1 0.36 perf-profile.self.cycles-pp.sock_sendpage
0.28 ± 2% +0.1 0.36 ± 4% perf-profile.self.cycles-pp.__x64_sys_sendfile64
0.11 ± 4% +0.1 0.19 ± 4% perf-profile.self.cycles-pp.timestamp_truncate
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.apparmor_ipv4_postroute
0.16 ± 10% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.skb_clone
0.14 ± 3% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.kmem_cache_alloc_node
0.10 ± 8% +0.1 0.18 ± 8% perf-profile.self.cycles-pp.enqueue_task_fair
0.00 +0.1 0.08 perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.1 0.08 ± 8% perf-profile.self.cycles-pp.tcp_rearm_rto
0.14 +0.1 0.22 ± 3% perf-profile.self.cycles-pp.tcp_send_mss
0.13 ± 3% +0.1 0.22 ± 6% perf-profile.self.cycles-pp.__kmalloc_node_track_caller
0.08 ± 5% +0.1 0.17 ± 9% perf-profile.self.cycles-pp.wait_woken
0.11 ± 6% +0.1 0.20 ± 7% perf-profile.self.cycles-pp.__update_load_avg_se
0.13 ± 6% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.current_time
0.00 +0.1 0.09 ± 14% perf-profile.self.cycles-pp.apparmor_socket_sock_rcv_skb
0.12 ± 3% +0.1 0.21 ± 11% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.tcp_cleanup_rbuf
0.52 +0.1 0.61 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.15 ± 8% +0.1 0.24 ± 4% perf-profile.self.cycles-pp.direct_splice_actor
0.36 +0.1 0.45 ± 4% perf-profile.self.cycles-pp.dst_release
0.16 ± 5% +0.1 0.25 perf-profile.self.cycles-pp.loopback_xmit
0.10 ± 8% +0.1 0.19 ± 7% perf-profile.self.cycles-pp.__softirqentry_text_start
0.40 +0.1 0.50 ± 2% perf-profile.self.cycles-pp.pipe_to_sendpage
0.26 ± 4% +0.1 0.36 ± 2% perf-profile.self.cycles-pp.splice_from_pipe
0.35 ± 5% +0.1 0.46 ± 4% perf-profile.self.cycles-pp.__sched_text_start
0.28 ± 2% +0.1 0.39 ± 2% perf-profile.self.cycles-pp.simple_copy_to_iter
0.13 ± 5% +0.1 0.24 ± 5% perf-profile.self.cycles-pp.touch_atime
0.26 ± 7% +0.1 0.37 perf-profile.self.cycles-pp.__local_bh_enable_ip
0.28 +0.1 0.39 ± 3% perf-profile.self.cycles-pp.__ip_queue_xmit
0.27 ± 7% +0.1 0.38 ± 3% perf-profile.self.cycles-pp.ip_finish_output2
0.40 ± 2% +0.1 0.52 ± 3% perf-profile.self.cycles-pp.tcp_rcv_established
0.35 ± 2% +0.1 0.47 ± 4% perf-profile.self.cycles-pp.tcp_clean_rtx_queue
0.44 ± 4% +0.1 0.56 perf-profile.self.cycles-pp.tcp_sendpage
0.48 ± 3% +0.1 0.60 ± 2% perf-profile.self.cycles-pp.inet_sendpage
0.29 ± 4% +0.1 0.41 ± 2% perf-profile.self.cycles-pp._copy_to_iter
0.21 ± 6% +0.1 0.34 ± 2% perf-profile.self.cycles-pp.update_load_avg
0.46 ± 4% +0.1 0.59 perf-profile.self.cycles-pp.__fget_light
0.38 ± 2% +0.1 0.51 ± 3% perf-profile.self.cycles-pp.tcp_v4_rcv
0.41 +0.1 0.55 ± 3% perf-profile.self.cycles-pp.tcp_recvmsg
0.20 ± 4% +0.1 0.33 ± 3% perf-profile.self.cycles-pp.__alloc_skb
0.35 ± 3% +0.1 0.49 ± 2% perf-profile.self.cycles-pp.generic_file_splice_read
0.29 ± 4% +0.1 0.43 ± 4% perf-profile.self.cycles-pp.tcp_established_options
0.24 ± 3% +0.1 0.38 ± 4% perf-profile.self.cycles-pp.tcp_ack
0.09 ± 4% +0.1 0.23 ± 6% perf-profile.self.cycles-pp.tcp_release_cb
0.33 +0.1 0.47 ± 2% perf-profile.self.cycles-pp.__might_sleep
0.38 ± 4% +0.1 0.52 ± 4% perf-profile.self.cycles-pp.__dev_queue_xmit
0.17 ± 8% +0.1 0.32 ± 2% perf-profile.self.cycles-pp.__netif_receive_skb_core
0.60 +0.1 0.75 perf-profile.self.cycles-pp.__skb_datagram_iter
0.28 ± 3% +0.1 0.43 ± 2% perf-profile.self.cycles-pp.__fsnotify_parent
0.28 ± 7% +0.2 0.44 ± 7% perf-profile.self.cycles-pp.__virt_addr_valid
0.15 ± 12% +0.2 0.30 ± 5% perf-profile.self.cycles-pp.apparmor_file_permission
0.70 ± 4% +0.2 0.86 ± 4% perf-profile.self.cycles-pp.__inet_lookup_established
0.20 ± 6% +0.2 0.36 ± 4% perf-profile.self.cycles-pp.atime_needs_update
0.52 ± 3% +0.2 0.69 ± 3% perf-profile.self.cycles-pp.page_cache_pipe_buf_release
0.25 ± 11% +0.2 0.42 ± 3% perf-profile.self.cycles-pp.splice_direct_to_actor
0.26 ± 3% +0.2 0.43 ± 4% perf-profile.self.cycles-pp.__slab_free
0.45 ± 9% +0.2 0.63 ± 5% perf-profile.self.cycles-pp.tcp_current_mss
1.00 ± 5% +0.2 1.20 perf-profile.self.cycles-pp.common_file_perm
0.33 ± 3% +0.2 0.53 ± 3% perf-profile.self.cycles-pp.__splice_from_pipe
0.73 ± 2% +0.2 0.93 ± 4% perf-profile.self.cycles-pp.read_tsc
1.15 +0.2 1.36 perf-profile.self.cycles-pp.skb_release_data
1.77 ± 5% +0.2 1.98 ± 4% perf-profile.self.cycles-pp.find_get_entry
0.54 ± 5% +0.2 0.77 perf-profile.self.cycles-pp.copy_page_to_iter
0.51 ± 4% +0.2 0.75 perf-profile.self.cycles-pp.do_sendfile
0.59 +0.3 0.84 ± 3% perf-profile.self.cycles-pp.__tcp_transmit_skb
0.47 ± 3% +0.3 0.73 perf-profile.self.cycles-pp.fsnotify
0.93 ± 3% +0.3 1.19 perf-profile.self.cycles-pp.generic_file_read_iter
0.59 +0.3 0.85 perf-profile.self.cycles-pp._raw_spin_lock
2.04 ± 2% +0.3 2.32 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.34 ± 6% +0.3 0.63 ± 5% perf-profile.self.cycles-pp.ktime_get
0.86 ± 2% +0.3 1.15 perf-profile.self.cycles-pp.___might_sleep
2.17 ± 2% +0.3 2.49 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.74 ± 6% +0.3 1.07 ± 4% perf-profile.self.cycles-pp.ipv4_mtu
1.08 +0.3 1.42 perf-profile.self.cycles-pp._raw_spin_lock_bh
1.67 ± 2% +0.3 2.01 ± 2% perf-profile.self.cycles-pp.do_tcp_sendpages
0.81 ± 2% +0.4 1.18 ± 2% perf-profile.self.cycles-pp.tcp_write_xmit
0.72 ± 3% +0.4 1.16 perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
3.17 ± 2% +0.6 3.75 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
3.36 +0.8 4.15 perf-profile.self.cycles-pp.do_syscall_64
3.89 ± 4% +1.4 5.29 ± 4% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
netperf.Throughput_Mbps
20000 +-------------------------------------------------------------------+
18000 |.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.|
| |
16000 |-+ |
14000 |-O O O O O O |
| O O O O O O O O O O O O |
12000 |-+ |
10000 |-+ |
8000 |-+ |
| |
6000 |-+ |
4000 |-+ |
| |
2000 |-+ |
0 +-------------------------------------------------------------------+
netperf.Throughput_total_Mbps
350000 +------------------------------------------------------------------+
|.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+.+..+.+ +..+.+.+ +.+.|
300000 |-+ |
| |
250000 |-O O O O O O O O O O O |
| O O O O O O O |
200000 |-+ |
| |
150000 |-+ |
| |
100000 |-+ |
| |
50000 |-+ |
| |
0 +------------------------------------------------------------------+
netperf.workload
2.5e+09 +-----------------------------------------------------------------+
| +.+. |
| |
2e+09 |-+ |
| O O O O O O O O O O O O O O |
| O O O O |
1.5e+09 |-+ |
| |
1e+09 |-+ |
| |
| |
5e+08 |-+ |
| |
| |
0 +-----------------------------------------------------------------+
netperf.time.user_time
700 +---------------------------------------------------------------------+
| O O + O O O O O O |
600 |-+ O O O O O O O O O O |
| |
500 |-+ |
| |
400 |-+ |
| |
300 |-+ |
| |
200 |-+ |
| |
100 |-+ |
| |
0 +---------------------------------------------------------------------+
netperf.time.system_time
5000 +--------------------------------------------------------------------+
4500 |.+..+.+.+..+.+.+.+..+.+.+..+.+.+..+.+.+.+..+.+.+..+.+.+..+.+.+.+..+.|
| |
4000 |-+ |
3500 |-+ |
| |
3000 |-+ |
2500 |-+ |
2000 |-+ |
| |
1500 |-+ |
1000 |-+ |
| |
500 |-+ |
0 +--------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/25%/debian-x86_64-20191114.cgz/300s/10K/lkp-bdw-ex2/SCTP_STREAM_MANY/netperf/0xb000038
commit:
9c40365a65 ("threads: Update PID limit comment according to futex UAPI change")
59901cb452 ("sched/fair: Don't pull task if local group is more loaded than busiest group")
9c40365a65d62d7c 59901cb4520c44bfce81f523bc6
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
8310 -31.1% 5723 ± 8% netperf.Throughput_Mbps
332426 -31.1% 228942 ± 8% netperf.Throughput_total_Mbps
13748 ± 2% -15.8% 11583 ± 7% netperf.time.minor_page_faults
587.05 -26.0% 434.31 ± 6% netperf.time.user_time
1.217e+09 -31.1% 8.384e+08 ± 8% netperf.workload
763112 ± 5% +19.0% 908201 ± 4% meminfo.Committed_AS
10662925 ± 10% +16.3% 12404278 meminfo.DirectMap2M
3.24 -0.8 2.48 ± 11% mpstat.cpu.all.soft%
2.02 -0.5 1.50 ± 6% mpstat.cpu.all.usr%
72.00 +2.1% 73.50 vmstat.cpu.id
2290192 -31.3% 1573919 ± 8% vmstat.system.cs
6.88e+09 ± 6% -54.1% 3.157e+09 ± 16% cpuidle.C1.time
3.412e+08 ± 2% -50.4% 1.691e+08 ± 17% cpuidle.C1.usage
45203190 ± 48% +165.0% 1.198e+08 ± 22% cpuidle.C1E.usage
25963 -4.1% 24904 proc-vmstat.nr_slab_reclaimable
66104 -6.4% 61871 proc-vmstat.nr_slab_unreclaimable
9019 ± 34% -77.7% 2009 ± 72% proc-vmstat.numa_hint_faults_local
1.565e+09 -31.1% 1.078e+09 ± 8% proc-vmstat.numa_hit
1.565e+09 -31.1% 1.078e+09 ± 8% proc-vmstat.numa_local
9.044e+09 -31.1% 6.228e+09 ± 8% proc-vmstat.pgalloc_normal
9.044e+09 -31.1% 6.228e+09 ± 8% proc-vmstat.pgfree
39376 ± 22% -56.0% 17319 ± 38% sched_debug.cfs_rq:/.MIN_vruntime.avg
3360482 ± 13% -57.8% 1416646 ± 30% sched_debug.cfs_rq:/.MIN_vruntime.max
333186 ± 18% -56.4% 145249 ± 31% sched_debug.cfs_rq:/.MIN_vruntime.stddev
39376 ± 22% -56.0% 17319 ± 38% sched_debug.cfs_rq:/.max_vruntime.avg
3360482 ± 13% -57.8% 1416646 ± 30% sched_debug.cfs_rq:/.max_vruntime.max
333186 ± 18% -56.4% 145249 ± 31% sched_debug.cfs_rq:/.max_vruntime.stddev
54158 ± 49% -81.3% 10104 ± 32% sched_debug.cfs_rq:/.min_vruntime.min
1726678 ± 2% +32.7% 2291681 ± 13% sched_debug.cfs_rq:/.min_vruntime.stddev
1387 ± 7% +21.8% 1689 ± 12% sched_debug.cfs_rq:/.runnable_avg.max
460.02 ± 2% +11.2% 511.65 ± 4% sched_debug.cfs_rq:/.runnable_avg.stddev
1726688 ± 2% +32.7% 2291718 ± 13% sched_debug.cfs_rq:/.spread0.stddev
14277 ± 28% -30.3% 9949 ± 4% sched_debug.cpu.avg_idle.min
1784858 -34.9% 1161189 ± 4% sched_debug.cpu.nr_switches.avg
6522465 ± 11% +32.0% 8612184 ± 16% sched_debug.cpu.nr_switches.max
2464 ± 11% -21.9% 1924 ± 2% sched_debug.cpu.nr_switches.min
7868 ± 7% +10.8% 8717 ± 5% numa-vmstat.node0.nr_kernel_stack
677.50 ± 50% +88.2% 1274 ± 29% numa-vmstat.node0.nr_page_table_pages
5910 ± 22% +56.5% 9251 ± 7% numa-vmstat.node0.nr_slab_reclaimable
4052 ± 9% -77.4% 917.50 ± 98% numa-vmstat.node1.nr_inactive_anon
6752 ± 2% -16.2% 5660 numa-vmstat.node1.nr_kernel_stack
2939 ± 17% -39.0% 1793 ± 20% numa-vmstat.node1.nr_mapped
434.25 ± 54% -90.8% 39.75 ± 53% numa-vmstat.node1.nr_page_table_pages
4467 ± 8% -75.3% 1102 ± 82% numa-vmstat.node1.nr_shmem
6931 ± 22% -49.3% 3517 ± 13% numa-vmstat.node1.nr_slab_reclaimable
17688 ± 8% -37.7% 11019 ± 7% numa-vmstat.node1.nr_slab_unreclaimable
4052 ± 9% -77.4% 917.50 ± 98% numa-vmstat.node1.nr_zone_inactive_anon
1.873e+08 ± 2% -51.3% 91255968 ± 63% numa-vmstat.node1.numa_hit
1.872e+08 ± 2% -51.3% 91208577 ± 63% numa-vmstat.node1.numa_local
25632 ± 87% -75.5% 6288 ±130% numa-vmstat.node2.nr_active_anon
25596 ± 87% -75.5% 6267 ±131% numa-vmstat.node2.nr_anon_pages
25632 ± 87% -75.5% 6288 ±130% numa-vmstat.node2.nr_zone_active_anon
23643 ± 22% +56.5% 37005 ± 7% numa-meminfo.node0.KReclaimable
7871 ± 7% +10.7% 8713 ± 5% numa-meminfo.node0.KernelStack
7269 ± 24% +24.6% 9060 ± 20% numa-meminfo.node0.Mapped
737950 ± 7% +23.2% 909436 numa-meminfo.node0.MemUsed
2710 ± 50% +88.1% 5098 ± 29% numa-meminfo.node0.PageTables
23643 ± 22% +56.5% 37005 ± 7% numa-meminfo.node0.SReclaimable
98061 ± 8% +26.1% 123682 ± 6% numa-meminfo.node0.Slab
16278 ± 10% -77.1% 3725 ± 96% numa-meminfo.node1.Inactive
16210 ± 9% -77.3% 3672 ± 98% numa-meminfo.node1.Inactive(anon)
27728 ± 22% -49.3% 14069 ± 13% numa-meminfo.node1.KReclaimable
6748 ± 2% -16.0% 5670 numa-meminfo.node1.KernelStack
11640 ± 18% -39.3% 7065 ± 21% numa-meminfo.node1.Mapped
593633 ± 3% -10.8% 529651 ± 5% numa-meminfo.node1.MemUsed
1736 ± 55% -90.4% 167.00 ± 51% numa-meminfo.node1.PageTables
27728 ± 22% -49.3% 14069 ± 13% numa-meminfo.node1.SReclaimable
70762 ± 8% -37.7% 44079 ± 7% numa-meminfo.node1.SUnreclaim
17873 ± 8% -75.3% 4415 ± 82% numa-meminfo.node1.Shmem
98490 ± 5% -41.0% 58148 ± 8% numa-meminfo.node1.Slab
102626 ± 86% -75.4% 25195 ±130% numa-meminfo.node2.Active
102494 ± 87% -75.4% 25163 ±130% numa-meminfo.node2.Active(anon)
71781 ±102% -84.3% 11236 ±162% numa-meminfo.node2.AnonHugePages
102350 ± 87% -75.5% 25082 ±131% numa-meminfo.node2.AnonPages
9418 ± 4% -25.7% 6997 ± 9% slabinfo.Acpi-State.active_objs
9418 ± 4% -25.7% 6997 ± 9% slabinfo.Acpi-State.num_objs
10164 -9.7% 9182 ± 3% slabinfo.cred_jar.active_objs
10164 -9.7% 9182 ± 3% slabinfo.cred_jar.num_objs
7263 ± 6% -30.8% 5027 ± 10% slabinfo.files_cache.active_objs
7263 ± 6% -30.8% 5027 ± 10% slabinfo.files_cache.num_objs
52454 ± 5% -16.9% 43590 ± 4% slabinfo.filp.active_objs
820.50 ± 5% -16.6% 684.50 ± 4% slabinfo.filp.active_slabs
52535 ± 5% -16.6% 43839 ± 4% slabinfo.filp.num_objs
820.50 ± 5% -16.6% 684.50 ± 4% slabinfo.filp.num_slabs
5691 ± 2% -25.7% 4226 ± 7% slabinfo.mm_struct.active_objs
5691 ± 2% -25.7% 4226 ± 7% slabinfo.mm_struct.num_objs
18729 -13.4% 16227 ± 6% slabinfo.pde_opener.active_objs
18729 -13.4% 16227 ± 6% slabinfo.pde_opener.num_objs
11365 -23.0% 8755 ± 12% slabinfo.pool_workqueue.active_objs
11366 -23.0% 8756 ± 12% slabinfo.pool_workqueue.num_objs
3857 ± 4% -18.9% 3126 ± 5% slabinfo.sighand_cache.active_objs
3859 ± 4% -18.8% 3135 ± 4% slabinfo.sighand_cache.num_objs
6370 ± 5% -22.4% 4942 ± 6% slabinfo.signal_cache.active_objs
6372 ± 5% -22.3% 4950 ± 6% slabinfo.signal_cache.num_objs
9525 ± 4% -24.2% 7218 ± 9% slabinfo.task_delay_info.active_objs
9525 ± 4% -24.2% 7218 ± 9% slabinfo.task_delay_info.num_objs
2720 ± 3% -12.5% 2379 slabinfo.task_struct.active_objs
909.25 ± 3% -11.9% 801.00 slabinfo.task_struct.active_slabs
2728 ± 3% -11.9% 2403 slabinfo.task_struct.num_objs
909.25 ± 3% -11.9% 801.00 slabinfo.task_struct.num_slabs
62.27 -6.7% 58.10 perf-stat.i.MPKI
1.506e+10 -18.1% 1.233e+10 ± 4% perf-stat.i.branch-instructions
1.93 -0.2 1.68 ± 4% perf-stat.i.branch-miss-rate%
2.872e+08 -28.3% 2.058e+08 ± 8% perf-stat.i.branch-misses
0.75 ± 11% -0.4 0.38 ± 30% perf-stat.i.cache-miss-rate%
34087325 ± 11% -61.2% 13229676 ± 41% perf-stat.i.cache-misses
4.561e+09 -25.3% 3.405e+09 ± 6% perf-stat.i.cache-references
2306970 -31.2% 1587675 ± 8% perf-stat.i.context-switches
2.02 +21.0% 2.44 ± 2% perf-stat.i.cpi
1.472e+11 -4.0% 1.413e+11 ± 2% perf-stat.i.cpu-cycles
778.21 ± 23% +1447.9% 12045 ± 71% perf-stat.i.cpu-migrations
4566 ± 11% +244.8% 15744 ± 36% perf-stat.i.cycles-between-cache-misses
23558623 -23.0% 18146040 ± 8% perf-stat.i.dTLB-load-misses
2.475e+10 -23.0% 1.905e+10 ± 5% perf-stat.i.dTLB-loads
0.06 +0.0 0.09 ± 9% perf-stat.i.dTLB-store-miss-rate%
1.639e+10 -29.7% 1.153e+10 ± 8% perf-stat.i.dTLB-stores
32.24 ± 6% -7.0 25.20 ± 6% perf-stat.i.iTLB-load-miss-rate%
17483265 ± 6% -24.0% 13290898 ± 7% perf-stat.i.iTLB-load-misses
36909400 ± 4% +7.2% 39555285 perf-stat.i.iTLB-loads
7.295e+10 -20.2% 5.82e+10 ± 4% perf-stat.i.instructions
0.50 -17.0% 0.41 ± 3% perf-stat.i.ipc
7892760 ± 14% -56.1% 3466546 ± 33% perf-stat.i.node-load-misses
82559 ± 5% -49.5% 41717 ± 30% perf-stat.i.node-loads
85.39 ± 2% -21.2 64.20 ± 12% perf-stat.i.node-store-miss-rate%
4935653 ± 12% -64.6% 1747970 ± 45% perf-stat.i.node-store-misses
62.52 -6.5% 58.45 ± 2% perf-stat.overall.MPKI
1.91 -0.2 1.67 ± 4% perf-stat.overall.branch-miss-rate%
0.75 ± 11% -0.4 0.38 ± 34% perf-stat.overall.cache-miss-rate%
2.02 +20.6% 2.43 ± 3% perf-stat.overall.cpi
4380 ± 12% +188.2% 12623 ± 39% perf-stat.overall.cycles-between-cache-misses
0.06 +0.0 0.09 ± 10% perf-stat.overall.dTLB-store-miss-rate%
32.16 ± 6% -7.0 25.13 ± 6% perf-stat.overall.iTLB-load-miss-rate%
0.50 -17.0% 0.41 ± 3% perf-stat.overall.ipc
85.86 ± 2% -19.6 66.27 ± 14% perf-stat.overall.node-store-miss-rate%
18033 +16.1% 20929 ± 3% perf-stat.overall.path-length
1.501e+10 -18.2% 1.228e+10 ± 4% perf-stat.ps.branch-instructions
2.862e+08 -28.4% 2.048e+08 ± 8% perf-stat.ps.branch-misses
33952691 ± 11% -61.3% 13129750 ± 41% perf-stat.ps.cache-misses
4.544e+09 -25.4% 3.39e+09 ± 6% perf-stat.ps.cache-references
2298503 -31.3% 1580015 ± 8% perf-stat.ps.context-switches
1.466e+11 -4.0% 1.408e+11 ± 2% perf-stat.ps.cpu-cycles
794.78 ± 24% +1419.0% 12072 ± 70% perf-stat.ps.cpu-migrations
23475449 -23.0% 18074421 ± 8% perf-stat.ps.dTLB-load-misses
2.466e+10 -23.1% 1.896e+10 ± 5% perf-stat.ps.dTLB-loads
1.633e+10 -29.8% 1.147e+10 ± 8% perf-stat.ps.dTLB-stores
17419953 ± 6% -24.0% 13232122 ± 7% perf-stat.ps.iTLB-load-misses
36786011 ± 4% +7.1% 39405794 ± 2% perf-stat.ps.iTLB-loads
7.268e+10 -20.3% 5.795e+10 ± 4% perf-stat.ps.instructions
7861951 ± 14% -56.2% 3443289 ± 33% perf-stat.ps.node-load-misses
82432 ± 5% -49.5% 41606 ± 30% perf-stat.ps.node-loads
4916204 ± 12% -64.7% 1734707 ± 45% perf-stat.ps.node-store-misses
2.195e+13 -20.3% 1.75e+13 ± 4% perf-stat.total.instructions
3037 ± 66% +68.9% 5130 ± 41% interrupts.CPU10.NMI:Non-maskable_interrupts
3037 ± 66% +68.9% 5130 ± 41% interrupts.CPU10.PMI:Performance_monitoring_interrupts
2687 ± 97% +145.3% 6592 ± 13% interrupts.CPU103.NMI:Non-maskable_interrupts
2687 ± 97% +145.3% 6592 ± 13% interrupts.CPU103.PMI:Performance_monitoring_interrupts
2179 ± 35% +216.1% 6887 ± 2% interrupts.CPU106.NMI:Non-maskable_interrupts
2179 ± 35% +216.1% 6887 ± 2% interrupts.CPU106.PMI:Performance_monitoring_interrupts
3006 ± 56% +126.1% 6798 ± 9% interrupts.CPU107.RES:Rescheduling_interrupts
1996 ± 27% +197.3% 5935 ± 31% interrupts.CPU108.NMI:Non-maskable_interrupts
1996 ± 27% +197.3% 5935 ± 31% interrupts.CPU108.PMI:Performance_monitoring_interrupts
2101 ± 92% +151.9% 5294 ± 49% interrupts.CPU109.RES:Rescheduling_interrupts
1580 ± 57% +330.4% 6801 ± 38% interrupts.CPU118.RES:Rescheduling_interrupts
1362 ± 14% +274.5% 5101 ± 39% interrupts.CPU119.RES:Rescheduling_interrupts
3530 ± 35% -83.7% 574.75 ±115% interrupts.CPU122.RES:Rescheduling_interrupts
1343 ± 43% -74.1% 348.00 ±147% interrupts.CPU137.RES:Rescheduling_interrupts
2221 ± 39% -60.7% 874.25 ±131% interrupts.CPU141.NMI:Non-maskable_interrupts
2221 ± 39% -60.7% 874.25 ±131% interrupts.CPU141.PMI:Performance_monitoring_interrupts
3578 ± 57% -80.8% 688.00 ±134% interrupts.CPU142.NMI:Non-maskable_interrupts
3578 ± 57% -80.8% 688.00 ±134% interrupts.CPU142.PMI:Performance_monitoring_interrupts
2935 ± 38% -73.7% 772.00 ±171% interrupts.CPU146.RES:Rescheduling_interrupts
3052 ± 84% +1035.4% 34656 ±135% interrupts.CPU15.RES:Rescheduling_interrupts
2687 ± 13% -59.0% 1102 ± 98% interrupts.CPU157.RES:Rescheduling_interrupts
4192 ± 70% -65.3% 1455 ±141% interrupts.CPU166.NMI:Non-maskable_interrupts
4192 ± 70% -65.3% 1455 ±141% interrupts.CPU166.PMI:Performance_monitoring_interrupts
3234 ± 75% -72.2% 898.25 ±139% interrupts.CPU167.NMI:Non-maskable_interrupts
3234 ± 75% -72.2% 898.25 ±139% interrupts.CPU167.PMI:Performance_monitoring_interrupts
3496 ± 55% -74.3% 897.00 ±133% interrupts.CPU172.NMI:Non-maskable_interrupts
3496 ± 55% -74.3% 897.00 ±133% interrupts.CPU172.PMI:Performance_monitoring_interrupts
3794 ± 51% -88.5% 435.00 ± 68% interrupts.CPU173.NMI:Non-maskable_interrupts
3794 ± 51% -88.5% 435.00 ± 68% interrupts.CPU173.PMI:Performance_monitoring_interrupts
4717 ± 56% -79.4% 972.75 ±136% interrupts.CPU174.NMI:Non-maskable_interrupts
4717 ± 56% -79.4% 972.75 ±136% interrupts.CPU174.PMI:Performance_monitoring_interrupts
4786 ± 13% -95.5% 213.25 ± 87% interrupts.CPU175.RES:Rescheduling_interrupts
3500 ± 64% -76.2% 832.50 ±107% interrupts.CPU184.NMI:Non-maskable_interrupts
3500 ± 64% -76.2% 832.50 ±107% interrupts.CPU184.PMI:Performance_monitoring_interrupts
2748 ± 4% -71.9% 772.25 ± 95% interrupts.CPU185.NMI:Non-maskable_interrupts
2748 ± 4% -71.9% 772.25 ± 95% interrupts.CPU185.PMI:Performance_monitoring_interrupts
3896 ± 50% -84.2% 616.50 ±115% interrupts.CPU186.NMI:Non-maskable_interrupts
3896 ± 50% -84.2% 616.50 ±115% interrupts.CPU186.PMI:Performance_monitoring_interrupts
6332 ± 22% -90.6% 597.50 ±110% interrupts.CPU187.NMI:Non-maskable_interrupts
6332 ± 22% -90.6% 597.50 ±110% interrupts.CPU187.PMI:Performance_monitoring_interrupts
2798 ± 62% -91.2% 246.25 ±163% interrupts.CPU188.RES:Rescheduling_interrupts
7445 ± 30% -89.6% 776.00 ±126% interrupts.CPU33.RES:Rescheduling_interrupts
2500 ± 31% -88.3% 293.75 ±158% interrupts.CPU35.RES:Rescheduling_interrupts
3157 ± 15% -81.9% 572.25 ±164% interrupts.CPU36.RES:Rescheduling_interrupts
4402 ± 61% -80.8% 844.50 ±168% interrupts.CPU39.RES:Rescheduling_interrupts
6686 ± 71% -91.7% 553.00 ±169% interrupts.CPU41.RES:Rescheduling_interrupts
5143 ± 37% -64.2% 1841 ±149% interrupts.CPU42.NMI:Non-maskable_interrupts
5143 ± 37% -64.2% 1841 ±149% interrupts.CPU42.PMI:Performance_monitoring_interrupts
5837 ± 32% -68.2% 1855 ±159% interrupts.CPU43.NMI:Non-maskable_interrupts
5837 ± 32% -68.2% 1855 ±159% interrupts.CPU43.PMI:Performance_monitoring_interrupts
3557 ± 47% -97.9% 75.25 ±126% interrupts.CPU44.RES:Rescheduling_interrupts
3370 ± 37% +130.1% 7754 ± 39% interrupts.CPU5.RES:Rescheduling_interrupts
4376 ± 37% -78.9% 924.75 ± 65% interrupts.CPU58.RES:Rescheduling_interrupts
2807 ± 64% +108.3% 5847 ± 36% interrupts.CPU6.RES:Rescheduling_interrupts
7502 ± 52% -83.6% 1226 ±112% interrupts.CPU61.RES:Rescheduling_interrupts
3688 ± 67% -88.3% 430.75 ±167% interrupts.CPU65.RES:Rescheduling_interrupts
2911 ± 16% -51.7% 1405 ± 62% interrupts.CPU75.NMI:Non-maskable_interrupts
2911 ± 16% -51.7% 1405 ± 62% interrupts.CPU75.PMI:Performance_monitoring_interrupts
2318 ± 21% -66.1% 786.25 ±117% interrupts.CPU76.NMI:Non-maskable_interrupts
2318 ± 21% -66.1% 786.25 ±117% interrupts.CPU76.PMI:Performance_monitoring_interrupts
2279 ± 27% -86.4% 310.75 ± 34% interrupts.CPU77.NMI:Non-maskable_interrupts
2279 ± 27% -86.4% 310.75 ± 34% interrupts.CPU77.PMI:Performance_monitoring_interrupts
5185 ± 35% -91.0% 465.00 ± 34% interrupts.CPU77.RES:Rescheduling_interrupts
4118 ± 34% -74.6% 1047 ± 87% interrupts.CPU79.RES:Rescheduling_interrupts
5165 ± 22% -63.7% 1875 ±107% interrupts.CPU86.RES:Rescheduling_interrupts
3514 ± 65% -70.4% 1041 ±106% interrupts.CPU88.NMI:Non-maskable_interrupts
3514 ± 65% -70.4% 1041 ±106% interrupts.CPU88.PMI:Performance_monitoring_interrupts
4784 ± 50% -78.3% 1037 ± 96% interrupts.CPU89.NMI:Non-maskable_interrupts
4784 ± 50% -78.3% 1037 ± 96% interrupts.CPU89.PMI:Performance_monitoring_interrupts
2389 ± 60% +193.3% 7009 ± 21% interrupts.CPU9.RES:Rescheduling_interrupts
3639 ± 19% -78.3% 789.75 ±128% interrupts.CPU90.NMI:Non-maskable_interrupts
3639 ± 19% -78.3% 789.75 ±128% interrupts.CPU90.PMI:Performance_monitoring_interrupts
2414 ± 45% -68.2% 768.50 ±126% interrupts.CPU91.NMI:Non-maskable_interrupts
2414 ± 45% -68.2% 768.50 ±126% interrupts.CPU91.PMI:Performance_monitoring_interrupts
3940 ± 28% -99.7% 11.00 ± 94% interrupts.CPU93.RES:Rescheduling_interrupts
4768 ± 51% -82.2% 849.75 ±136% interrupts.CPU94.NMI:Non-maskable_interrupts
4768 ± 51% -82.2% 849.75 ±136% interrupts.CPU94.PMI:Performance_monitoring_interrupts
3071 ± 51% -96.3% 114.25 ±129% interrupts.CPU94.RES:Rescheduling_interrupts
2672 ± 40% -73.5% 707.25 ±171% interrupts.CPU95.RES:Rescheduling_interrupts
644992 ± 20% +28.1% 826353 ± 9% interrupts.RES:Rescheduling_interrupts
141316 ± 2% -10.7% 126249 ± 8% softirqs.CPU10.RCU
38660 ± 4% -39.7% 23314 ± 40% softirqs.CPU10.SCHED
40648 -24.3% 30768 ± 18% softirqs.CPU101.SCHED
135335 ± 2% -10.6% 120927 ± 7% softirqs.CPU102.RCU
39708 ± 24% -48.1% 20612 ± 50% softirqs.CPU102.SCHED
357756 ± 92% +233.0% 1191209 ± 45% softirqs.CPU108.NET_RX
140033 ± 4% -11.5% 123936 ± 10% softirqs.CPU108.RCU
39682 ± 2% -40.4% 23651 ± 53% softirqs.CPU108.SCHED
1162992 ± 22% -62.5% 436694 ± 91% softirqs.CPU113.NET_RX
36929 ± 7% -37.5% 23090 ± 43% softirqs.CPU114.SCHED
39419 ± 15% -29.6% 27760 ± 23% softirqs.CPU116.SCHED
37471 ± 14% -20.4% 29821 ± 8% softirqs.CPU117.SCHED
38725 ± 4% -29.5% 27287 ± 24% softirqs.CPU122.SCHED
380987 ±112% -100.0% 4.75 ± 60% softirqs.CPU124.NET_RX
684082 ±108% -100.0% 6.50 ± 82% softirqs.CPU126.NET_RX
35779 ± 14% +17.7% 42122 ± 5% softirqs.CPU126.SCHED
136179 ± 4% -7.4% 126126 ± 5% softirqs.CPU136.RCU
136482 ± 3% -10.7% 121892 ± 3% softirqs.CPU137.RCU
37701 ± 13% -19.4% 30389 ± 19% softirqs.CPU14.SCHED
138037 ± 5% -7.9% 127161 ± 6% softirqs.CPU143.RCU
135813 ± 4% -11.1% 120675 ± 2% softirqs.CPU144.RCU
136752 ± 3% -9.5% 123693 ± 2% softirqs.CPU146.RCU
140989 ± 2% -7.0% 131118 ± 4% softirqs.CPU147.RCU
140477 ± 4% -7.0% 130636 ± 5% softirqs.CPU151.RCU
140183 ± 3% -9.2% 127229 ± 4% softirqs.CPU157.RCU
41010 ± 3% -41.3% 24083 ± 51% softirqs.CPU157.SCHED
34115 ± 11% +19.5% 40766 ± 12% softirqs.CPU159.SCHED
1225282 ± 94% -94.6% 66471 ±173% softirqs.CPU160.NET_RX
38414 ± 9% -38.0% 23813 ± 45% softirqs.CPU161.SCHED
137423 ± 4% -7.0% 127861 ± 3% softirqs.CPU162.RCU
30810 ± 31% +27.3% 39228 ± 6% softirqs.CPU164.SCHED
138560 ± 3% -13.0% 120523 ± 5% softirqs.CPU165.RCU
42022 ± 5% -24.5% 31709 ± 38% softirqs.CPU165.SCHED
973700 ± 95% -96.8% 30927 ±173% softirqs.CPU172.NET_RX
977062 ± 77% -100.0% 2.75 ± 69% softirqs.CPU173.NET_RX
547399 ±162% -100.0% 2.75 ± 86% softirqs.CPU179.NET_RX
64145 ±114% -100.0% 7.00 ± 66% softirqs.CPU183.NET_RX
39496 +10.4% 43614 ± 6% softirqs.CPU183.SCHED
26478 ± 28% +53.6% 40670 softirqs.CPU186.SCHED
1601031 ± 85% -100.0% 477.00 ±173% softirqs.CPU187.NET_RX
133259 ± 2% -6.6% 124422 ± 4% softirqs.CPU189.RCU
137106 ± 2% -8.4% 125547 ± 2% softirqs.CPU190.RCU
102176 ± 68% -72.1% 28546 ±173% softirqs.CPU191.NET_RX
1500188 ± 32% -71.1% 433553 ± 99% softirqs.CPU23.NET_RX
1456825 ± 48% -78.7% 310211 ±145% softirqs.CPU27.NET_RX
30211 ± 21% +32.5% 40018 ± 16% softirqs.CPU27.SCHED
1249314 ± 45% -83.4% 207506 ±173% softirqs.CPU28.NET_RX
32688 ± 12% +22.9% 40167 ± 10% softirqs.CPU28.SCHED
614013 ± 33% -91.8% 50330 ±172% softirqs.CPU31.NET_RX
856129 ± 54% -92.1% 67308 ±172% softirqs.CPU32.NET_RX
826453 ± 88% -92.6% 61272 ±153% softirqs.CPU33.NET_RX
572160 ± 58% -92.0% 45490 ±172% softirqs.CPU34.NET_RX
1198932 ± 26% -80.2% 237504 ±173% softirqs.CPU35.NET_RX
764186 ± 42% -98.9% 8411 ±170% softirqs.CPU36.NET_RX
1957332 ± 39% -97.6% 47130 ±172% softirqs.CPU38.NET_RX
25563 ± 24% +51.2% 38644 ± 12% softirqs.CPU38.SCHED
1904800 ± 68% -69.5% 581766 ±173% softirqs.CPU39.NET_RX
136554 -10.5% 122273 ± 3% softirqs.CPU41.RCU
1937742 ± 65% -83.7% 316430 ±173% softirqs.CPU42.NET_RX
1965972 ± 41% -84.5% 305614 ±173% softirqs.CPU43.NET_RX
138112 ± 5% -8.5% 126429 ± 4% softirqs.CPU44.RCU
938187 ± 79% -88.1% 111510 ±172% softirqs.CPU45.NET_RX
1859081 ± 63% -100.0% 142.50 ± 6% softirqs.CPU47.NET_RX
1418766 ± 55% -96.3% 51993 ±172% softirqs.CPU56.NET_RX
31415 ± 16% +33.4% 41922 ± 8% softirqs.CPU56.SCHED
1608741 ± 92% -93.1% 110943 ±172% softirqs.CPU57.NET_RX
1185884 ± 49% -52.3% 565791 ±113% softirqs.CPU58.NET_RX
2280687 ± 64% -86.8% 301429 ±153% softirqs.CPU60.NET_RX
989103 ± 66% -84.0% 158376 ±173% softirqs.CPU63.NET_RX
1357266 ± 62% -87.3% 172102 ±173% softirqs.CPU64.NET_RX
1353050 ± 14% -77.5% 305024 ±170% softirqs.CPU67.NET_RX
1061562 ± 62% -70.1% 317101 ±173% softirqs.CPU68.NET_RX
135927 ± 4% -9.8% 122670 ± 7% softirqs.CPU70.RCU
1219305 ± 63% -66.8% 404442 ±163% softirqs.CPU71.NET_RX
138945 ± 3% -12.6% 121504 ± 7% softirqs.CPU71.RCU
1342914 ± 22% -57.5% 570854 ±101% softirqs.CPU75.NET_RX
1370885 ± 17% -60.3% 543996 ±107% softirqs.CPU76.NET_RX
38700 ± 6% -20.6% 30718 ± 21% softirqs.CPU77.SCHED
37200 ± 11% -32.2% 25215 ± 53% softirqs.CPU8.SCHED
2042132 ± 26% -76.3% 484633 ±140% softirqs.CPU84.NET_RX
1162850 ± 36% -69.4% 355800 ±116% softirqs.CPU85.NET_RX
1454966 ± 30% -92.4% 109880 ±173% softirqs.CPU87.NET_RX
29191 ± 28% +48.1% 43243 ± 10% softirqs.CPU87.SCHED
1982705 ± 30% -90.8% 181832 ± 87% softirqs.CPU88.NET_RX
26016 ± 21% +60.9% 41872 ± 10% softirqs.CPU88.SCHED
2230453 ± 9% -92.5% 166989 ±173% softirqs.CPU89.NET_RX
23850 ± 15% +65.7% 39517 ± 6% softirqs.CPU89.SCHED
1324547 ± 34% -100.0% 3.25 ± 70% softirqs.CPU90.NET_RX
30624 ± 11% +34.9% 41296 ± 10% softirqs.CPU90.SCHED
392004 ±131% -100.0% 3.75 ± 87% softirqs.CPU91.NET_RX
716600 ± 98% -97.2% 20120 ±173% softirqs.CPU92.NET_RX
1.739e+08 -31.1% 1.198e+08 ± 8% softirqs.NET_RX
35.60 -2.7 32.88 ± 4% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
38.93 -2.7 36.26 ± 4% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
38.93 -2.7 36.26 ± 4% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
38.91 -2.7 36.25 ± 4% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
39.06 -2.6 36.42 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64
36.62 -2.5 34.09 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
36.69 -2.5 34.17 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
7.72 ± 2% -1.7 5.99 ± 4% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
7.62 ± 2% -1.7 5.91 ± 4% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter
7.53 ± 2% -1.7 5.83 ± 4% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush
7.26 ± 2% -1.7 5.60 ± 4% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.sctp_packet_transmit
7.24 ± 2% -1.7 5.58 ± 4% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit
7.16 ± 2% -1.6 5.52 ± 4% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
7.18 ± 2% -1.6 5.54 ± 4% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
7.06 ± 2% -1.6 5.45 ± 4% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
6.98 ± 2% -1.6 5.36 ± 4% perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq
6.87 ± 2% -1.6 5.27 ± 4% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack
6.71 ± 2% -1.6 5.14 ± 4% perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
6.57 ± 2% -1.6 5.01 ± 4% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
6.51 ± 2% -1.6 4.96 ± 4% perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
6.62 ± 2% -1.6 5.07 ± 4% perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
6.58 ± 2% -1.5 5.03 ± 4% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
10.09 ± 2% -1.4 8.72 ± 3% perf-profile.calltrace.cycles-pp.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg
8.06 -1.3 6.75 ± 4% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
5.28 ± 2% -1.2 4.05 ± 4% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
5.26 -1.2 4.09 ± 5% perf-profile.calltrace.cycles-pp.memcpy_erms.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
4.95 ± 2% -1.2 3.78 ± 4% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
8.95 ± 2% -1.1 7.82 ± 3% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc
4.45 ± 2% -1.1 3.36 ± 4% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu
4.45 -1.0 3.45 ± 5% perf-profile.calltrace.cycles-pp.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg
4.31 -1.0 3.33 ± 5% perf-profile.calltrace.cycles-pp._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg
4.20 -1.0 3.23 ± 5% perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc
4.17 -0.9 3.22 ± 5% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user
8.12 -0.9 7.23 ± 4% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv
7.75 -0.9 6.87 ± 3% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND
3.15 ± 2% -0.8 2.36 ± 5% perf-profile.calltrace.cycles-pp.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv
7.22 ± 2% -0.7 6.56 ± 3% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg
7.06 ± 2% -0.6 6.44 ± 3% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg
4.18 ± 3% -0.6 3.59 ± 7% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
4.17 ± 3% -0.6 3.57 ± 7% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
1.42 -0.6 0.86 ± 57% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event
1.39 -0.6 0.84 ± 57% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready
3.76 ± 3% -0.5 3.21 ± 7% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg
2.45 -0.5 1.90 ± 3% perf-profile.calltrace.cycles-pp.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
3.66 ± 3% -0.5 3.12 ± 7% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg
3.63 ± 3% -0.5 3.10 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
1.92 -0.5 1.44 ± 5% perf-profile.calltrace.cycles-pp.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
1.75 -0.4 1.33 ± 5% perf-profile.calltrace.cycles-pp.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm
1.08 -0.4 0.72 ± 5% perf-profile.calltrace.cycles-pp.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
1.56 -0.4 1.21 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter
1.46 -0.3 1.14 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data
0.96 -0.3 0.64 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg
0.72 ± 2% -0.3 0.40 ± 57% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv
0.93 -0.3 0.62 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg
0.65 ± 2% -0.2 0.41 ± 57% perf-profile.calltrace.cycles-pp.copy_msghdr_from_user.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64
0.65 ± 2% -0.2 0.41 ± 57% perf-profile.calltrace.cycles-pp.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.92 ± 2% -0.2 0.70 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
0.87 ± 2% -0.2 0.67 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.76 ± 4% -0.2 0.57 ± 4% perf-profile.calltrace.cycles-pp.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
0.87 ± 3% -0.1 0.74 ± 6% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.85 ± 3% -0.1 0.72 ± 7% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
1.00 ± 3% -0.1 0.89 ± 3% perf-profile.calltrace.cycles-pp.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
0.98 ± 3% -0.1 0.88 ± 3% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg
0.96 ± 3% -0.1 0.86 ± 3% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg
2.75 ± 5% +0.9 3.69 ± 13% perf-profile.calltrace.cycles-pp.kfree_skb.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg
2.07 ± 5% +1.1 3.14 ± 14% perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.kfree_skb.sctp_recvmsg.inet_recvmsg
2.21 ± 6% +1.1 3.27 ± 14% perf-profile.calltrace.cycles-pp.__free_pages_ok.kfree_skb.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
1.90 ± 6% +1.1 3.02 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.kfree_skb.sctp_recvmsg
1.75 ± 6% +1.2 2.92 ± 15% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.kfree_skb
1.99 +1.3 3.29 ± 3% perf-profile.calltrace.cycles-pp.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
1.85 +1.3 3.19 ± 3% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter
1.82 ± 2% +1.4 3.17 ± 3% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit.sctp_outq_flush
1.81 +1.4 3.17 ± 3% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit
23.40 +2.0 25.38 ± 2% perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
58.47 +3.2 61.64 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
58.27 +3.2 61.47 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
16.29 +3.2 19.53 ± 2% perf-profile.calltrace.cycles-pp.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
16.19 +3.3 19.45 ± 2% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg
16.10 +3.3 19.40 ± 2% perf-profile.calltrace.cycles-pp.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg
12.86 +3.4 16.27 ± 2% perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg
14.14 +3.7 17.89 ± 2% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock
13.93 +3.8 17.70 ± 2% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg
13.93 +3.8 17.70 ± 2% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock
7.65 ± 2% +4.2 11.90 perf-profile.calltrace.cycles-pp.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv
6.70 ± 2% +4.5 11.22 perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
6.50 ± 2% +4.6 11.08 perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm
42.95 +4.6 47.55 ± 2% perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.73 +4.6 12.34 ± 2% perf-profile.calltrace.cycles-pp.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg
42.69 +4.7 47.35 ± 2% perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.90 ± 2% +4.7 10.56 ± 2% perf-profile.calltrace.cycles-pp.__free_pages_ok.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter
5.67 ± 2% +4.7 10.33 ± 2% perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.consume_skb.sctp_chunk_put.sctp_outq_sack
7.36 +4.7 12.04 ± 2% perf-profile.calltrace.cycles-pp._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg
41.99 +4.8 46.77 ± 2% perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.82 +4.8 11.62 ± 2% perf-profile.calltrace.cycles-pp.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc
5.18 ± 2% +4.8 9.99 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.consume_skb.sctp_chunk_put
41.20 +4.9 46.11 ± 2% perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64
4.89 ± 2% +4.9 9.80 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.consume_skb
40.83 +5.0 45.80 ± 2% perf-profile.calltrace.cycles-pp.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg
5.99 +5.1 11.06 ± 2% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user
5.96 +5.1 11.03 ± 2% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb._sctp_make_chunk
5.97 +5.1 11.05 ± 2% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty
7.63 +6.5 14.09 ± 3% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb
7.33 +6.5 13.86 ± 3% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve
5.58 ± 2% +6.9 12.47 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller
5.26 ± 2% +7.0 12.24 ± 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node
35.73 -2.7 33.02 ± 5% perf-profile.children.cycles-pp.intel_idle
38.93 -2.7 36.26 ± 4% perf-profile.children.cycles-pp.start_secondary
39.06 -2.6 36.42 ± 4% perf-profile.children.cycles-pp.do_idle
39.06 -2.6 36.42 ± 4% perf-profile.children.cycles-pp.secondary_startup_64
39.06 -2.6 36.42 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
36.82 -2.5 34.32 ± 4% perf-profile.children.cycles-pp.cpuidle_enter
36.81 -2.5 34.32 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
17.84 ± 2% -2.2 15.63 ± 4% perf-profile.children.cycles-pp.sctp_outq_flush
7.99 ± 2% -1.8 6.19 ± 4% perf-profile.children.cycles-pp.__ip_queue_xmit
15.83 -1.8 14.03 ± 4% perf-profile.children.cycles-pp.sctp_packet_transmit
7.83 ± 2% -1.8 6.07 ± 4% perf-profile.children.cycles-pp.ip_output
7.69 ± 2% -1.7 5.95 ± 4% perf-profile.children.cycles-pp.ip_finish_output2
7.33 ± 2% -1.7 5.66 ± 4% perf-profile.children.cycles-pp.__local_bh_enable_ip
7.25 ± 2% -1.7 5.59 ± 4% perf-profile.children.cycles-pp.do_softirq
7.19 ± 2% -1.6 5.54 ± 4% perf-profile.children.cycles-pp.do_softirq_own_stack
7.07 ± 2% -1.6 5.45 ± 4% perf-profile.children.cycles-pp.net_rx_action
6.98 ± 2% -1.6 5.37 ± 4% perf-profile.children.cycles-pp.process_backlog
6.87 ± 2% -1.6 5.28 ± 4% perf-profile.children.cycles-pp.__netif_receive_skb_one_core
7.43 ± 2% -1.6 5.85 ± 5% perf-profile.children.cycles-pp.__softirqentry_text_start
6.71 ± 2% -1.6 5.15 ± 4% perf-profile.children.cycles-pp.ip_rcv
6.63 ± 2% -1.6 5.07 ± 4% perf-profile.children.cycles-pp.ip_local_deliver
6.59 ± 2% -1.6 5.04 ± 4% perf-profile.children.cycles-pp.ip_local_deliver_finish
6.52 ± 2% -1.6 4.97 ± 4% perf-profile.children.cycles-pp.sctp_rcv
6.57 ± 2% -1.5 5.02 ± 4% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu
8.00 -1.5 6.48 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
10.09 ± 2% -1.4 8.72 ± 3% perf-profile.children.cycles-pp.sctp_primitive_SEND
5.45 -1.2 4.23 ± 5% perf-profile.children.cycles-pp.memcpy_erms
4.45 -1.0 3.46 ± 5% perf-profile.children.cycles-pp.sctp_user_addto_chunk
4.32 -1.0 3.33 ± 5% perf-profile.children.cycles-pp._copy_from_iter_full
4.21 -1.0 3.24 ± 5% perf-profile.children.cycles-pp.copyin
3.16 ± 2% -0.8 2.37 ± 5% perf-profile.children.cycles-pp.sctp_ulpq_tail_data
4.19 ± 3% -0.6 3.59 ± 7% perf-profile.children.cycles-pp.skb_copy_datagram_iter
4.17 ± 3% -0.6 3.58 ± 7% perf-profile.children.cycles-pp.__skb_datagram_iter
3.77 ± 3% -0.5 3.22 ± 7% perf-profile.children.cycles-pp._copy_to_iter
2.45 -0.5 1.91 ± 3% perf-profile.children.cycles-pp.sctp_skb_recv_datagram
3.66 ± 3% -0.5 3.12 ± 7% perf-profile.children.cycles-pp.copyout
1.93 -0.5 1.46 ± 5% perf-profile.children.cycles-pp.sctp_ulpq_tail_event
1.75 -0.4 1.33 ± 5% perf-profile.children.cycles-pp.sctp_data_ready
1.33 -0.4 0.93 ± 4% perf-profile.children.cycles-pp.lock_sock_nested
1.22 -0.4 0.85 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_bh
1.57 -0.4 1.21 ± 6% perf-profile.children.cycles-pp.__wake_up_common_lock
1.46 -0.3 1.14 ± 6% perf-profile.children.cycles-pp.__wake_up_common
1.42 -0.3 1.10 ± 6% perf-profile.children.cycles-pp.autoremove_wake_function
1.39 -0.3 1.08 ± 6% perf-profile.children.cycles-pp.try_to_wake_up
1.07 ± 6% -0.3 0.77 ± 5% perf-profile.children.cycles-pp.sctp_ulpevent_make_rcvmsg
0.83 ± 2% -0.2 0.58 ± 5% perf-profile.children.cycles-pp.__list_del_entry_valid
1.84 ± 3% -0.2 1.61 ± 4% perf-profile.children.cycles-pp.__sched_text_start
0.56 ± 3% -0.2 0.33 ± 7% perf-profile.children.cycles-pp.sctp_datamsg_put
1.00 -0.2 0.77 perf-profile.children.cycles-pp.syscall_return_via_sysret
0.53 ± 3% -0.2 0.31 ± 7% perf-profile.children.cycles-pp.sctp_chunk_free
0.74 ± 8% -0.2 0.52 ± 4% perf-profile.children.cycles-pp.sctp_outq_select_transport
0.92 ± 2% -0.2 0.70 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.67 ± 9% -0.2 0.46 ± 2% perf-profile.children.cycles-pp.sctp_packet_config
0.77 ± 4% -0.2 0.57 ± 4% perf-profile.children.cycles-pp.sctp_ulpevent_free
0.73 -0.2 0.54 ± 3% perf-profile.children.cycles-pp.kmem_cache_free
0.85 -0.2 0.67 perf-profile.children.cycles-pp.skb_release_all
0.84 -0.2 0.66 perf-profile.children.cycles-pp.skb_release_head_state
1.10 -0.2 0.92 ± 4% perf-profile.children.cycles-pp.copy_msghdr_from_user
0.54 ± 8% -0.2 0.37 ± 5% perf-profile.children.cycles-pp.__skb_clone
0.89 -0.1 0.74 ± 3% perf-profile.children.cycles-pp._copy_from_user
0.55 ± 2% -0.1 0.41 ± 6% perf-profile.children.cycles-pp.enqueue_entity
0.65 ± 2% -0.1 0.51 ± 7% perf-profile.children.cycles-pp.ttwu_do_activate
0.64 -0.1 0.50 ± 7% perf-profile.children.cycles-pp.enqueue_task_fair
0.87 ± 3% -0.1 0.74 ± 6% perf-profile.children.cycles-pp.schedule_idle
0.64 -0.1 0.51 ± 8% perf-profile.children.cycles-pp.activate_task
0.58 -0.1 0.45 ± 5% perf-profile.children.cycles-pp.sctp_chunkify
0.40 -0.1 0.28 ± 5% perf-profile.children.cycles-pp.__list_add_valid
0.66 ± 2% -0.1 0.54 ± 5% perf-profile.children.cycles-pp.sendmsg_copy_msghdr
0.41 ± 2% -0.1 0.29 ± 5% perf-profile.children.cycles-pp.__slab_free
0.31 ± 14% -0.1 0.20 ± 4% perf-profile.children.cycles-pp.ipv4_dst_check
1.00 ± 3% -0.1 0.89 ± 3% perf-profile.children.cycles-pp.schedule_timeout
0.41 ± 7% -0.1 0.30 ± 5% perf-profile.children.cycles-pp.sctp_hash_cmp
0.99 ± 3% -0.1 0.88 ± 3% perf-profile.children.cycles-pp.schedule
0.28 ± 15% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.__copy_skb_header
0.39 ± 2% -0.1 0.28 ± 4% perf-profile.children.cycles-pp.sctp_addrs_lookup_transport
0.42 ± 2% -0.1 0.32 ± 3% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.22 ± 12% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.sctp_transport_hold
0.41 ± 8% -0.1 0.33 ± 6% perf-profile.children.cycles-pp.sctp_endpoint_lookup_assoc
0.39 ± 7% -0.1 0.30 ± 8% perf-profile.children.cycles-pp.sctp_epaddr_lookup_transport
0.45 -0.1 0.36 ± 4% perf-profile.children.cycles-pp.__dev_queue_xmit
0.48 -0.1 0.40 ± 7% perf-profile.children.cycles-pp.kmem_cache_alloc
0.41 -0.1 0.34 ± 5% perf-profile.children.cycles-pp.___might_sleep
0.32 ± 2% -0.1 0.24 ± 6% perf-profile.children.cycles-pp.sctp_addto_chunk
0.32 ± 4% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.sctp_eat_data
0.47 ± 2% -0.1 0.40 ± 4% perf-profile.children.cycles-pp.import_iovec
0.36 -0.1 0.29 ± 4% perf-profile.children.cycles-pp.sockfd_lookup_light
0.36 ± 2% -0.1 0.29 ± 3% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.32 -0.1 0.25 ± 4% perf-profile.children.cycles-pp.security_socket_sendmsg
0.48 -0.1 0.41 ± 4% perf-profile.children.cycles-pp.update_load_avg
0.43 -0.1 0.36 ± 3% perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2
0.23 ± 4% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.skb_release_data
0.35 ± 3% -0.1 0.28 ± 4% perf-profile.children.cycles-pp.sctp_wfree
0.41 ± 3% -0.1 0.35 ± 5% perf-profile.children.cycles-pp.rw_copy_check_uvector
0.23 ± 3% -0.1 0.17 ± 5% perf-profile.children.cycles-pp.memset_erms
0.25 ± 2% -0.1 0.19 ± 9% perf-profile.children.cycles-pp.sctp_sock_rfree
0.21 ± 3% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.__switch_to
0.15 ± 9% -0.1 0.09 ± 8% perf-profile.children.cycles-pp.ip_local_out
0.22 ± 5% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.skb_set_owner_w
0.46 ± 5% -0.1 0.40 ± 8% perf-profile.children.cycles-pp.recvmsg_copy_msghdr
0.52 ± 3% -0.1 0.46 ± 3% perf-profile.children.cycles-pp.dequeue_task_fair
0.29 ± 2% -0.1 0.23 ± 2% perf-profile.children.cycles-pp.__might_sleep
0.36 ± 5% -0.1 0.31 ± 3% perf-profile.children.cycles-pp.aa_sk_perm
0.29 -0.1 0.24 ± 5% perf-profile.children.cycles-pp.__fget_light
0.16 ± 2% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.36 ± 3% -0.1 0.30 ± 3% perf-profile.children.cycles-pp.sctp_sched_fcfs_dequeue
0.15 ± 5% -0.1 0.10 ± 5% perf-profile.children.cycles-pp.rcu_idle_exit
0.16 ± 2% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.60 ± 2% -0.1 0.55 ± 2% perf-profile.children.cycles-pp.__check_object_size
0.30 -0.1 0.24 ± 3% perf-profile.children.cycles-pp.dev_hard_start_xmit
0.26 ± 3% -0.1 0.21 ± 5% perf-profile.children.cycles-pp.sctp_make_sack
0.27 ± 4% -0.1 0.22 perf-profile.children.cycles-pp.loopback_xmit
0.16 ± 9% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.ipv4_mtu
0.13 ± 6% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.rcu_eqs_exit
0.22 -0.0 0.17 ± 6% perf-profile.children.cycles-pp.sctp_inq_pop
0.15 ± 3% -0.0 0.11 ± 8% perf-profile.children.cycles-pp.check_preempt_curr
0.12 ± 5% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.ip_send_check
0.17 ± 4% -0.0 0.12 ± 8% perf-profile.children.cycles-pp.sctp_outq_flush_ctrl
0.11 ± 3% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.resched_curr
0.22 ± 3% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.sock_kmalloc
0.14 ± 5% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.sock_wfree
0.14 ± 8% -0.0 0.09 ± 7% perf-profile.children.cycles-pp.__ip_local_out
0.25 ± 3% -0.0 0.20 ± 7% perf-profile.children.cycles-pp.sctp_check_transmitted
0.15 ± 3% -0.0 0.11 ± 3% perf-profile.children.cycles-pp.sctp_transport_put
0.22 ± 3% -0.0 0.18 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc_node
0.44 ± 5% -0.0 0.40 ± 3% perf-profile.children.cycles-pp.dequeue_entity
0.18 ± 6% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.__update_load_avg_se
0.12 ± 8% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.sctp_chunk_hold
0.11 ± 15% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__ip_finish_output
0.07 ± 7% -0.0 0.03 ±100% perf-profile.children.cycles-pp.sctp_hash_key
0.14 ± 11% -0.0 0.10 ± 11% perf-profile.children.cycles-pp.dst_release
0.23 ± 2% -0.0 0.20 ± 4% perf-profile.children.cycles-pp.move_addr_to_kernel
0.19 ± 5% -0.0 0.15 ± 4% perf-profile.children.cycles-pp.sctp_ulpevent_receive_data
0.24 ± 2% -0.0 0.21 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair
0.17 ± 2% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.sctp_v4_addr_valid
0.08 ± 6% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.06 ± 6% -0.0 0.03 ±100% perf-profile.children.cycles-pp.sctp_bind_addr_match
0.17 ± 5% -0.0 0.13 perf-profile.children.cycles-pp.sctp_association_put
0.16 ± 2% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.sock_kfree_s
0.19 -0.0 0.16 ± 7% perf-profile.children.cycles-pp.update_rq_clock
0.17 -0.0 0.14 ± 6% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.18 ± 2% -0.0 0.15 ± 8% perf-profile.children.cycles-pp.__zone_watermark_ok
0.13 ± 9% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.__netif_receive_skb_core
0.36 -0.0 0.33 ± 5% perf-profile.children.cycles-pp.kfree
0.20 ± 4% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.sctp_sched_dequeue_common
0.11 ± 4% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.sctp_association_hold
0.07 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.sctp_v4_from_skb
0.07 ± 6% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.pick_next_entity
0.07 ± 7% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.validate_xmit_skb
0.30 -0.0 0.28 ± 5% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk
0.20 ± 4% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.update_curr
0.14 -0.0 0.12 ± 7% perf-profile.children.cycles-pp.sctp_sockaddr_af
0.14 ± 3% -0.0 0.11 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.10 ± 7% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.del_timer
0.09 ± 9% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.sctp_transport_reset_t3_rtx
0.12 ± 8% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.09 ± 4% -0.0 0.07 ± 14% perf-profile.children.cycles-pp.sctp_assoc_rwnd_increase
0.13 ± 6% -0.0 0.11 ± 10% perf-profile.children.cycles-pp.skb_clone
0.08 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.sctp_v4_ecn_capable
0.12 ± 5% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.mod_timer
0.14 ± 6% -0.0 0.12 ± 5% perf-profile.children.cycles-pp.__kmalloc
0.08 ± 6% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.account_entity_dequeue
0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.nr_iowait_cpu
0.09 ± 4% -0.0 0.07 perf-profile.children.cycles-pp.lock_timer_base
0.14 ± 6% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.mod_node_page_state
0.10 ± 4% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.sctp_validate_data
0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.enqueue_to_backlog
0.11 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.__switch_to_asm
0.09 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.netif_rx
0.09 -0.0 0.08 ± 6% perf-profile.children.cycles-pp.netif_rx_internal
0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.07 -0.0 0.06 perf-profile.children.cycles-pp.__x64_sys_sendmsg
0.06 -0.0 0.05 perf-profile.children.cycles-pp.__free_pages
0.07 ± 10% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.___perf_sw_event
0.05 ± 60% +0.0 0.09 ± 15% perf-profile.children.cycles-pp.irq_enter
0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.tick_irq_enter
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.load_balance
2.75 ± 5% +0.9 3.69 ± 13% perf-profile.children.cycles-pp.kfree_skb
25.85 +2.0 27.81 ± 2% perf-profile.children.cycles-pp.sctp_cmd_interpreter
23.41 +2.0 25.38 ± 2% perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc
25.96 +2.0 27.94 ± 2% perf-profile.children.cycles-pp.sctp_do_sm
19.22 +2.5 21.76 ± 2% perf-profile.children.cycles-pp.sctp_assoc_bh_rcv
58.51 +3.2 61.68 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
58.31 +3.2 61.52 ± 2% perf-profile.children.cycles-pp.do_syscall_64
16.37 +3.2 19.60 ± 2% perf-profile.children.cycles-pp.release_sock
16.19 +3.3 19.46 ± 2% perf-profile.children.cycles-pp.__release_sock
16.11 +3.3 19.40 ± 2% perf-profile.children.cycles-pp.sctp_backlog_rcv
12.87 +3.4 16.28 ± 2% perf-profile.children.cycles-pp.sctp_datamsg_from_user
7.65 ± 2% +4.3 11.90 perf-profile.children.cycles-pp.sctp_outq_sack
7.37 ± 2% +4.4 11.72 perf-profile.children.cycles-pp.sctp_chunk_put
6.81 ± 2% +4.5 11.31 perf-profile.children.cycles-pp.consume_skb
42.95 +4.6 47.55 ± 2% perf-profile.children.cycles-pp.__sys_sendmsg
7.74 +4.6 12.34 ± 2% perf-profile.children.cycles-pp.sctp_make_datafrag_empty
42.70 +4.6 47.35 ± 2% perf-profile.children.cycles-pp.___sys_sendmsg
7.52 +4.7 12.17 ± 2% perf-profile.children.cycles-pp._sctp_make_chunk
42.00 +4.8 46.78 ± 2% perf-profile.children.cycles-pp.____sys_sendmsg
41.21 +4.9 46.12 ± 2% perf-profile.children.cycles-pp.sock_sendmsg
40.84 +5.0 45.82 ± 2% perf-profile.children.cycles-pp.sctp_sendmsg
7.75 ± 2% +5.7 13.48 ± 4% perf-profile.children.cycles-pp.free_one_page
8.12 ± 2% +5.7 13.86 ± 4% perf-profile.children.cycles-pp.__free_pages_ok
7.47 ± 2% +5.8 13.30 ± 4% perf-profile.children.cycles-pp._raw_spin_lock
8.98 +6.1 15.05 ± 2% perf-profile.children.cycles-pp.__alloc_skb
7.92 +6.4 14.31 ± 3% perf-profile.children.cycles-pp.__kmalloc_reserve
7.87 +6.4 14.29 ± 2% perf-profile.children.cycles-pp.__kmalloc_node_track_caller
7.77 +6.4 14.21 ± 2% perf-profile.children.cycles-pp.kmalloc_large_node
7.64 +6.5 14.10 ± 3% perf-profile.children.cycles-pp.__alloc_pages_nodemask
7.35 +6.5 13.88 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist
6.01 ± 2% +6.8 12.84 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
12.88 ± 2% +12.8 25.66 ± 4% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
35.73 -2.7 33.02 ± 5% perf-profile.self.cycles-pp.intel_idle
7.95 -1.5 6.43 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
5.40 -1.2 4.20 ± 5% perf-profile.self.cycles-pp.memcpy_erms
2.65 -0.6 2.05 perf-profile.self.cycles-pp.do_syscall_64
0.78 -0.3 0.50 ± 4% perf-profile.self.cycles-pp.__alloc_skb
0.81 -0.3 0.56 perf-profile.self.cycles-pp._raw_spin_lock
0.81 ± 2% -0.2 0.56 ± 5% perf-profile.self.cycles-pp.__list_del_entry_valid
1.00 -0.2 0.77 perf-profile.self.cycles-pp.syscall_return_via_sysret
0.92 ± 2% -0.2 0.70 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.51 ± 4% -0.2 0.29 ± 7% perf-profile.self.cycles-pp.sctp_datamsg_put
0.57 -0.2 0.38 ± 2% perf-profile.self.cycles-pp.sctp_datamsg_from_user
0.70 ± 3% -0.2 0.53 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.75 ± 2% -0.1 0.61 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist
0.38 -0.1 0.26 ± 7% perf-profile.self.cycles-pp.__list_add_valid
0.41 -0.1 0.30 ± 6% perf-profile.self.cycles-pp.sctp_recvmsg
0.30 ± 14% -0.1 0.19 ± 6% perf-profile.self.cycles-pp.ipv4_dst_check
0.28 ± 15% -0.1 0.17 ± 7% perf-profile.self.cycles-pp.__copy_skb_header
0.40 ± 2% -0.1 0.29 ± 5% perf-profile.self.cycles-pp.__slab_free
0.33 ± 2% -0.1 0.24 ± 7% perf-profile.self.cycles-pp.free_one_page
0.39 ± 2% -0.1 0.30 ± 3% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.34 ± 13% -0.1 0.25 perf-profile.self.cycles-pp.sctp_cmd_interpreter
0.21 ± 13% -0.1 0.12 ± 4% perf-profile.self.cycles-pp.sctp_transport_hold
0.39 ± 5% -0.1 0.31 ± 5% perf-profile.self.cycles-pp.sctp_packet_transmit
0.46 ± 2% -0.1 0.38 ± 5% perf-profile.self.cycles-pp.sctp_outq_flush
0.30 ± 2% -0.1 0.22 ± 3% perf-profile.self.cycles-pp.sctp_chunk_put
0.33 -0.1 0.25 ± 7% perf-profile.self.cycles-pp.kmem_cache_free
0.40 -0.1 0.33 ± 6% perf-profile.self.cycles-pp.___might_sleep
0.27 ± 5% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.sctp_rcv
0.26 ± 7% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.sctp_packet_config
0.18 ± 3% -0.1 0.11 ± 11% perf-profile.self.cycles-pp.sctp_ulpq_tail_event
0.18 ± 2% -0.1 0.11 perf-profile.self.cycles-pp.sctp_chunkify
0.23 ± 4% -0.1 0.16 ± 6% perf-profile.self.cycles-pp.skb_release_data
0.23 ± 6% -0.1 0.16 ± 5% perf-profile.self.cycles-pp.__alloc_pages_nodemask
0.33 ± 3% -0.1 0.27 ± 7% perf-profile.self.cycles-pp.__sched_text_start
0.26 ± 2% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__skb_clone
0.22 ± 3% -0.1 0.16 ± 4% perf-profile.self.cycles-pp.memset_erms
0.22 ± 5% -0.1 0.16 ± 5% perf-profile.self.cycles-pp.skb_set_owner_w
0.20 ± 4% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.__switch_to
0.15 ± 3% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.24 -0.1 0.18 ± 9% perf-profile.self.cycles-pp.sctp_sock_rfree
0.28 -0.1 0.22 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_bh
0.31 ± 2% -0.1 0.26 ± 3% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.18 ± 10% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.sctp_data_ready
0.27 ± 2% -0.1 0.21 ± 4% perf-profile.self.cycles-pp.__might_sleep
0.29 ± 2% -0.1 0.24 ± 5% perf-profile.self.cycles-pp.__fget_light
0.12 ± 7% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.ip_send_check
0.29 ± 6% -0.0 0.24 ± 4% perf-profile.self.cycles-pp.__check_object_size
0.27 ± 4% -0.0 0.22 perf-profile.self.cycles-pp.sctp_wfree
0.26 ± 7% -0.0 0.21 ± 5% perf-profile.self.cycles-pp.sctp_sendmsg
0.15 ± 10% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.ipv4_mtu
0.11 ± 3% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.resched_curr
0.22 ± 9% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.sctp_skb_recv_datagram
0.14 ± 5% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.sock_wfree
0.15 ± 3% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.sctp_eat_data
0.13 ± 13% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.dst_release
0.15 ± 4% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.sctp_transport_put
0.08 ± 12% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.sctp_ulpevent_free
0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.pick_next_entity
0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.sctp_hash_key
0.33 ± 2% -0.0 0.29 ± 6% perf-profile.self.cycles-pp.__free_pages_ok
0.12 ± 5% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.sctp_chunk_hold
0.08 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.14 ± 3% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.enqueue_entity
0.18 ± 7% -0.0 0.14 ± 5% perf-profile.self.cycles-pp.__update_load_avg_se
0.17 ± 5% -0.0 0.13 perf-profile.self.cycles-pp.sctp_association_put
0.21 ± 5% -0.0 0.18 ± 7% perf-profile.self.cycles-pp.____sys_recvmsg
0.20 ± 2% -0.0 0.17 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.15 ± 3% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.sctp_v4_addr_valid
0.14 ± 8% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.sctp_epaddr_lookup_transport
0.14 ± 3% -0.0 0.11 ± 3% perf-profile.self.cycles-pp.set_next_entity
0.16 ± 4% -0.0 0.13 perf-profile.self.cycles-pp.do_idle
0.16 ± 2% -0.0 0.13 ± 8% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.13 ± 9% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.__netif_receive_skb_core
0.18 ± 2% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.__zone_watermark_ok
0.20 ± 4% -0.0 0.17 ± 7% perf-profile.self.cycles-pp.sctp_sendmsg_to_asoc
0.09 ± 7% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.sctp_assoc_rwnd_increase
0.15 ± 4% -0.0 0.12 ± 12% perf-profile.self.cycles-pp.kmem_cache_alloc_node
0.12 ± 7% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.__softirqentry_text_start
0.11 ± 4% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.sctp_check_transmitted
0.10 ± 7% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.sctp_ulpevent_make_rcvmsg
0.14 ± 3% -0.0 0.11 ± 6% perf-profile.self.cycles-pp.__skb_datagram_iter
0.16 ± 2% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.sctp_sched_fcfs_dequeue
0.12 ± 4% -0.0 0.10 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.12 ± 5% -0.0 0.10 ± 11% perf-profile.self.cycles-pp.ip_finish_output2
0.08 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.sock_kmalloc
0.06 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.sockfd_lookup_light
0.10 ± 7% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.sctp_association_hold
0.09 ± 4% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.__local_bh_enable_ip
0.11 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.sctp_ulpevent_receive_data
0.11 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.sctp_make_datafrag_empty
0.09 ± 4% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.consume_skb
0.09 ± 4% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.sctp_inq_pop
0.08 ± 5% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.__kmalloc_node_track_caller
0.14 ± 3% -0.0 0.12 ± 3% perf-profile.self.cycles-pp.mod_node_page_state
0.07 ± 5% -0.0 0.05 ± 9% perf-profile.self.cycles-pp.account_entity_dequeue
0.08 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.sctp_v4_ecn_capable
0.09 ± 10% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.rw_copy_check_uvector
0.11 ± 3% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.__switch_to_asm
0.11 ± 4% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.sctp_sched_dequeue_common
0.08 ± 5% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.nr_iowait_cpu
0.11 ± 4% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.update_curr
0.09 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.copy_msghdr_from_user
0.08 -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__sctp_packet_append_chunk
0.08 ± 5% -0.0 0.07 perf-profile.self.cycles-pp.sctp_addrs_lookup_transport
0.06 -0.0 0.05 perf-profile.self.cycles-pp.__free_pages
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.___perf_sw_event
12.88 ± 2% +12.8 25.66 ± 4% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
***************************************************************************************************
lkp-skl-fpga01: 104 threads Skylake with 192G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/30%/debian-x86_64-20191114.cgz/300s/lkp-skl-fpga01/whetstone-double/unixbench/0x2000065
commit:
9c40365a65 ("threads: Update PID limit comment according to futex UAPI change")
59901cb452 ("sched/fair: Don't pull task if local group is more loaded than busiest group")
9c40365a65d62d7c 59901cb4520c44bfce81f523bc6
---------------- ---------------------------
%stddev %change %stddev
\ | \
23098 -4.0% 22179 unixbench.score
474.19 +2.0% 483.52 unixbench.time.elapsed_time
474.19 +2.0% 483.52 unixbench.time.elapsed_time.max
20407 -15.6% 17220 unixbench.time.involuntary_context_switches
11653 +2.5% 11940 unixbench.time.user_time
6674 -2.7% 6494 unixbench.time.voluntary_context_switches
60218701 -2.2% 58918844 unixbench.workload
51504 ± 2% +61.4% 83147 ± 16% cpuidle.C1.usage
45407 ± 4% +9.0% 49503 ± 6% meminfo.Shmem
0.00 ±117% +0.0 0.03 ± 78% mpstat.cpu.all.soft%
1505 +5.3% 1584 vmstat.system.cs
9163 -9.2% 8320 ± 6% numa-meminfo.node0.KernelStack
992.75 ± 12% -49.9% 497.00 ± 65% numa-meminfo.node1.Mlocked
535099 ± 2% -7.3% 496178 ± 3% numa-meminfo.node1.Unevictable
9165 -9.1% 8327 ± 6% numa-vmstat.node0.nr_kernel_stack
133774 ± 2% -7.3% 124044 ± 3% numa-vmstat.node1.nr_unevictable
133774 ± 2% -7.3% 124044 ± 3% numa-vmstat.node1.nr_zone_unevictable
1.24 ± 16% -0.7 0.49 ± 32% perf-profile.children.cycles-pp.ktime_get
0.94 ± 18% -0.5 0.43 ± 29% perf-profile.children.cycles-pp.clockevents_program_event
0.11 ± 36% +0.1 0.20 ± 32% perf-profile.children.cycles-pp.tick_irq_enter
1.12 ± 17% -0.7 0.38 ± 49% perf-profile.self.cycles-pp.ktime_get
842912 ± 13% -42.0% 489022 ± 36% numa-numastat.node0.local_node
851323 ± 14% -39.6% 514237 ± 31% numa-numastat.node0.numa_hit
8420 ±172% +199.5% 25221 ± 57% numa-numastat.node0.other_node
780061 ± 13% +47.3% 1149237 ± 15% numa-numastat.node1.local_node
805331 ± 14% +43.8% 1157736 ± 14% numa-numastat.node1.numa_hit
92.00 ± 6% -5.4% 87.00 proc-vmstat.nr_dirtied
11349 ± 4% +9.0% 12374 ± 6% proc-vmstat.nr_shmem
19448 -1.5% 19147 proc-vmstat.nr_slab_reclaimable
44561 -3.1% 43181 proc-vmstat.nr_slab_unreclaimable
13330 ± 44% -84.1% 2121 ± 82% proc-vmstat.numa_hint_faults
5558 ±107% -99.3% 37.25 ±148% proc-vmstat.numa_hint_faults_local
51552 ± 33% -54.6% 23426 ± 53% proc-vmstat.numa_pte_updates
5345 ± 12% +24.6% 6662 ± 16% proc-vmstat.pgactivate
1739692 +1.0% 1756902 proc-vmstat.pgfree
1018 ± 7% -16.4% 850.75 ± 5% slabinfo.file_lock_cache.active_objs
1018 ± 7% -16.4% 850.75 ± 5% slabinfo.file_lock_cache.num_objs
4826 -11.2% 4285 ± 3% slabinfo.files_cache.active_objs
4826 -11.2% 4285 ± 3% slabinfo.files_cache.num_objs
2826 ± 2% -11.0% 2515 slabinfo.sighand_cache.active_objs
2828 ± 2% -11.0% 2517 slabinfo.sighand_cache.num_objs
1151 ± 2% -24.1% 873.25 ± 22% slabinfo.task_group.active_objs
1151 ± 2% -24.1% 873.25 ± 22% slabinfo.task_group.num_objs
59534 ± 2% -9.2% 54079 ± 3% slabinfo.vm_area_struct.active_objs
1490 ± 2% -9.1% 1354 ± 3% slabinfo.vm_area_struct.active_slabs
59640 ± 2% -9.1% 54195 ± 3% slabinfo.vm_area_struct.num_objs
1490 ± 2% -9.1% 1354 ± 3% slabinfo.vm_area_struct.num_slabs
7.107e+09 -2.7% 6.915e+09 perf-stat.i.branch-instructions
12.39 ± 15% -6.0 6.37 ± 23% perf-stat.i.cache-miss-rate%
1477 +5.5% 1558 perf-stat.i.context-switches
111.88 -1.3% 110.46 perf-stat.i.cpu-migrations
1.099e+10 -2.5% 1.071e+10 perf-stat.i.dTLB-loads
3.823e+09 -2.6% 3.724e+09 perf-stat.i.dTLB-stores
2132180 -20.1% 1703908 ± 14% perf-stat.i.iTLB-loads
6.802e+10 -2.7% 6.618e+10 perf-stat.i.instructions
0.88 -4.5% 0.84 ± 2% perf-stat.i.ipc
4076 -1.5% 4014 perf-stat.i.minor-faults
107204 ± 2% -31.1% 73884 ± 11% perf-stat.i.node-load-misses
14357 ± 5% -9.6% 12974 ± 3% perf-stat.i.node-loads
26949 ± 4% -51.0% 13212 ± 18% perf-stat.i.node-store-misses
4076 -1.5% 4014 perf-stat.i.page-faults
12.57 ± 16% -6.1 6.42 ± 24% perf-stat.overall.cache-miss-rate%
1.04 +3.8% 1.08 perf-stat.overall.cpi
0.96 -3.6% 0.93 perf-stat.overall.ipc
88.19 -3.3 84.92 perf-stat.overall.node-load-miss-rate%
78.98 -11.9 67.04 ± 8% perf-stat.overall.node-store-miss-rate%
536500 +1.3% 543249 perf-stat.overall.path-length
7.106e+09 -2.8% 6.907e+09 perf-stat.ps.branch-instructions
1474 +5.5% 1554 perf-stat.ps.context-switches
111.66 -1.3% 110.22 perf-stat.ps.cpu-migrations
1.098e+10 -2.6% 1.07e+10 perf-stat.ps.dTLB-loads
3.823e+09 -2.7% 3.719e+09 perf-stat.ps.dTLB-stores
2128273 -20.1% 1700626 ± 14% perf-stat.ps.iTLB-loads
6.801e+10 -2.8% 6.61e+10 perf-stat.ps.instructions
4061 -1.4% 4004 perf-stat.ps.minor-faults
107032 ± 2% -31.1% 73785 ± 11% perf-stat.ps.node-load-misses
14320 ± 5% -9.5% 12960 ± 3% perf-stat.ps.node-loads
26906 ± 4% -51.0% 13193 ± 18% perf-stat.ps.node-store-misses
4061 -1.4% 4004 perf-stat.ps.page-faults
51615 ± 9% +38.7% 71599 ± 14% sched_debug.cfs_rq:/.exec_clock.avg
89952 ± 7% +79.0% 160981 ± 14% sched_debug.cfs_rq:/.exec_clock.max
6590 ± 39% -88.3% 770.93 ±168% sched_debug.cfs_rq:/.exec_clock.min
21438 ± 5% +140.7% 51593 ± 19% sched_debug.cfs_rq:/.exec_clock.stddev
1649313 ± 8% +39.8% 2305637 ± 14% sched_debug.cfs_rq:/.min_vruntime.avg
2846100 ± 7% +82.5% 5195365 ± 14% sched_debug.cfs_rq:/.min_vruntime.max
225248 ± 36% -87.1% 29096 ±143% sched_debug.cfs_rq:/.min_vruntime.min
677866 ± 5% +145.1% 1661129 ± 19% sched_debug.cfs_rq:/.min_vruntime.stddev
130.54 ± 7% -54.9% 58.93 ±100% sched_debug.cfs_rq:/.removed.load_avg.max
19.52 ± 32% -67.2% 6.41 ±100% sched_debug.cfs_rq:/.removed.load_avg.stddev
130.54 ± 7% -54.9% 58.93 ±100% sched_debug.cfs_rq:/.removed.runnable_avg.max
19.52 ± 32% -67.2% 6.41 ±100% sched_debug.cfs_rq:/.removed.runnable_avg.stddev
-1075371 -254.5% 1660977 ± 63% sched_debug.cfs_rq:/.spread0.avg
121453 ± 95% +3646.9% 4550704 ± 34% sched_debug.cfs_rq:/.spread0.max
-2499411 -75.4% -615566 sched_debug.cfs_rq:/.spread0.min
677861 ± 5% +145.1% 1661130 ± 19% sched_debug.cfs_rq:/.spread0.stddev
6.00 ± 7% -31.6% 4.10 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.avg
25.29 ± 7% -22.8% 19.52 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.stddev
241338 ± 5% +12.8% 272122 ± 4% sched_debug.cpu.clock.avg
241342 ± 5% +12.8% 272127 ± 4% sched_debug.cpu.clock.max
241333 ± 5% +12.8% 272117 ± 4% sched_debug.cpu.clock.min
2.47 ± 2% +12.0% 2.76 ± 4% sched_debug.cpu.clock.stddev
241338 ± 5% +12.8% 272122 ± 4% sched_debug.cpu.clock_task.avg
241342 ± 5% +12.8% 272127 ± 4% sched_debug.cpu.clock_task.max
241333 ± 5% +12.8% 272117 ± 4% sched_debug.cpu.clock_task.min
2.47 ± 2% +12.0% 2.76 ± 4% sched_debug.cpu.clock_task.stddev
4932 ± 3% +12.7% 5557 ± 3% sched_debug.cpu.nr_switches.avg
3525 ± 5% +43.7% 5065 ± 17% sched_debug.cpu.nr_switches.stddev
2933 ± 5% +20.6% 3536 ± 5% sched_debug.cpu.sched_count.avg
19139 ± 27% +56.8% 30011 ± 48% sched_debug.cpu.sched_count.max
2773 ± 10% +55.8% 4320 ± 18% sched_debug.cpu.sched_count.stddev
1280 ± 5% +22.6% 1568 ± 6% sched_debug.cpu.sched_goidle.avg
9370 ± 27% +57.8% 14789 ± 48% sched_debug.cpu.sched_goidle.max
1374 ± 10% +56.0% 2144 ± 19% sched_debug.cpu.sched_goidle.stddev
1302 ± 5% +21.4% 1581 ± 6% sched_debug.cpu.ttwu_count.avg
1455 ± 4% +56.4% 2276 ± 19% sched_debug.cpu.ttwu_count.stddev
594.81 ± 4% +28.4% 763.77 ± 7% sched_debug.cpu.ttwu_local.avg
2311 ± 24% +79.3% 4143 ± 10% sched_debug.cpu.ttwu_local.max
345.75 ± 7% +105.0% 708.72 ± 4% sched_debug.cpu.ttwu_local.stddev
241334 ± 5% +12.8% 272118 ± 4% sched_debug.cpu_clk
240831 ± 5% +12.8% 271615 ± 4% sched_debug.ktime
241752 ± 5% +12.7% 272537 ± 4% sched_debug.sched_clk
74.25 ±159% -97.0% 2.25 ±101% interrupts.CPU1.TLB:TLB_shootdowns
105.75 ± 40% +3409.2% 3711 ± 64% interrupts.CPU100.NMI:Non-maskable_interrupts
105.75 ± 40% +3409.2% 3711 ± 64% interrupts.CPU100.PMI:Performance_monitoring_interrupts
159.00 ± 10% +64.2% 261.00 ± 22% interrupts.CPU100.RES:Rescheduling_interrupts
1558 ±163% +190.8% 4532 ± 53% interrupts.CPU101.NMI:Non-maskable_interrupts
1558 ±163% +190.8% 4532 ± 53% interrupts.CPU101.PMI:Performance_monitoring_interrupts
179.25 ± 6% +48.5% 266.25 ± 12% interrupts.CPU101.RES:Rescheduling_interrupts
143.00 ± 82% +2066.4% 3098 ± 83% interrupts.CPU102.NMI:Non-maskable_interrupts
143.00 ± 82% +2066.4% 3098 ± 83% interrupts.CPU102.PMI:Performance_monitoring_interrupts
173.50 ± 19% +66.9% 289.50 ± 9% interrupts.CPU102.RES:Rescheduling_interrupts
193.75 ± 6% +68.5% 326.50 ± 17% interrupts.CPU103.RES:Rescheduling_interrupts
3261 ±140% -96.0% 129.00 ±128% interrupts.CPU12.RES:Rescheduling_interrupts
398.25 ±110% -99.4% 2.50 ±103% interrupts.CPU16.TLB:TLB_shootdowns
146.25 ±160% -97.9% 3.00 ± 62% interrupts.CPU26.TLB:TLB_shootdowns
372.25 ± 79% -99.0% 3.75 ± 51% interrupts.CPU29.TLB:TLB_shootdowns
101.50 ±107% -97.0% 3.00 ± 84% interrupts.CPU3.TLB:TLB_shootdowns
98.75 ± 21% +6523.3% 6540 ±168% interrupts.CPU31.RES:Rescheduling_interrupts
94.50 ± 38% +110.3% 198.75 ± 22% interrupts.CPU33.RES:Rescheduling_interrupts
100.25 ± 38% +114.2% 214.75 ± 31% interrupts.CPU34.RES:Rescheduling_interrupts
81.50 ± 18% +140.8% 196.25 ± 49% interrupts.CPU35.RES:Rescheduling_interrupts
88.75 ± 45% +5932.7% 5354 ±167% interrupts.CPU36.RES:Rescheduling_interrupts
71.25 ± 26% +111.2% 150.50 ± 16% interrupts.CPU38.RES:Rescheduling_interrupts
65.25 ± 28% +136.8% 154.50 ± 20% interrupts.CPU39.RES:Rescheduling_interrupts
45.75 ± 12% +288.0% 177.50 ± 51% interrupts.CPU40.RES:Rescheduling_interrupts
75.00 ± 21% +69.0% 126.75 ± 7% interrupts.CPU41.RES:Rescheduling_interrupts
618.25 ±144% +554.8% 4048 ± 51% interrupts.CPU42.NMI:Non-maskable_interrupts
618.25 ±144% +554.8% 4048 ± 51% interrupts.CPU42.PMI:Performance_monitoring_interrupts
80.25 ± 16% +132.1% 186.25 ± 23% interrupts.CPU42.RES:Rescheduling_interrupts
861.75 ± 99% +596.3% 6000 ± 30% interrupts.CPU43.NMI:Non-maskable_interrupts
861.75 ± 99% +596.3% 6000 ± 30% interrupts.CPU43.PMI:Performance_monitoring_interrupts
69.25 ± 17% +173.6% 189.50 ± 10% interrupts.CPU43.RES:Rescheduling_interrupts
96.25 ± 50% +99.0% 191.50 ± 13% interrupts.CPU44.RES:Rescheduling_interrupts
1133 ± 91% +246.8% 3931 ± 27% interrupts.CPU45.NMI:Non-maskable_interrupts
1133 ± 91% +246.8% 3931 ± 27% interrupts.CPU45.PMI:Performance_monitoring_interrupts
617.00 ±146% +614.5% 4408 ± 38% interrupts.CPU47.NMI:Non-maskable_interrupts
617.00 ±146% +614.5% 4408 ± 38% interrupts.CPU47.PMI:Performance_monitoring_interrupts
617.00 ±146% +945.3% 6449 ± 22% interrupts.CPU49.NMI:Non-maskable_interrupts
617.00 ±146% +945.3% 6449 ± 22% interrupts.CPU49.PMI:Performance_monitoring_interrupts
81.00 ± 55% +2323.5% 1963 ±159% interrupts.CPU49.RES:Rescheduling_interrupts
3679 ± 63% -96.8% 116.25 ± 40% interrupts.CPU5.NMI:Non-maskable_interrupts
3679 ± 63% -96.8% 116.25 ± 40% interrupts.CPU5.PMI:Performance_monitoring_interrupts
3501 ± 37% -96.4% 124.50 ± 43% interrupts.CPU57.NMI:Non-maskable_interrupts
3501 ± 37% -96.4% 124.50 ± 43% interrupts.CPU57.PMI:Performance_monitoring_interrupts
4911 ± 6% -72.3% 1362 ±157% interrupts.CPU62.NMI:Non-maskable_interrupts
4911 ± 6% -72.3% 1362 ±157% interrupts.CPU62.PMI:Performance_monitoring_interrupts
4086 ± 36% -67.1% 1342 ±157% interrupts.CPU64.NMI:Non-maskable_interrupts
4086 ± 36% -67.1% 1342 ±157% interrupts.CPU64.PMI:Performance_monitoring_interrupts
245.25 ± 44% -85.4% 35.75 ± 97% interrupts.CPU7.RES:Rescheduling_interrupts
63.00 ± 71% -94.4% 3.50 ± 95% interrupts.CPU77.RES:Rescheduling_interrupts
2334 ± 51% +217.0% 7399 ± 6% interrupts.CPU78.NMI:Non-maskable_interrupts
2334 ± 51% +217.0% 7399 ± 6% interrupts.CPU78.PMI:Performance_monitoring_interrupts
132.75 ± 21% +157.6% 342.00 ± 22% interrupts.CPU78.RES:Rescheduling_interrupts
128.25 ± 27% +103.5% 261.00 ± 14% interrupts.CPU79.RES:Rescheduling_interrupts
3236 ±143% -99.0% 33.00 ±101% interrupts.CPU8.RES:Rescheduling_interrupts
2481 ± 43% +179.1% 6924 ± 17% interrupts.CPU80.NMI:Non-maskable_interrupts
2481 ± 43% +179.1% 6924 ± 17% interrupts.CPU80.PMI:Performance_monitoring_interrupts
132.50 ± 9% +100.9% 266.25 ± 14% interrupts.CPU80.RES:Rescheduling_interrupts
131.50 ± 33% +90.3% 250.25 ± 20% interrupts.CPU81.RES:Rescheduling_interrupts
1570 ± 63% +371.1% 7400 ± 6% interrupts.CPU82.NMI:Non-maskable_interrupts
1570 ± 63% +371.1% 7400 ± 6% interrupts.CPU82.PMI:Performance_monitoring_interrupts
131.75 ± 13% +2020.3% 2793 ±159% interrupts.CPU82.RES:Rescheduling_interrupts
769.50 ±130% -87.3% 97.50 ±105% interrupts.CPU9.RES:Rescheduling_interrupts
147.50 ± 19% +79.3% 264.50 ± 21% interrupts.CPU90.RES:Rescheduling_interrupts
180.50 ± 9% +1677.8% 3209 ±158% interrupts.CPU91.RES:Rescheduling_interrupts
164.50 ± 20% +119.1% 360.50 ± 26% interrupts.CPU93.RES:Rescheduling_interrupts
1573 ±162% +307.6% 6411 ± 23% interrupts.CPU94.NMI:Non-maskable_interrupts
1573 ±162% +307.6% 6411 ± 23% interrupts.CPU94.PMI:Performance_monitoring_interrupts
148.25 ± 20% +76.9% 262.25 ± 17% interrupts.CPU94.RES:Rescheduling_interrupts
143.75 ± 8% +68.5% 242.25 ± 16% interrupts.CPU95.RES:Rescheduling_interrupts
168.75 ± 6% +127.0% 383.00 ± 48% interrupts.CPU96.RES:Rescheduling_interrupts
2281 ±106% +181.2% 6415 ± 23% interrupts.CPU97.NMI:Non-maskable_interrupts
2281 ±106% +181.2% 6415 ± 23% interrupts.CPU97.PMI:Performance_monitoring_interrupts
163.75 ± 17% +71.3% 280.50 ± 16% interrupts.CPU97.RES:Rescheduling_interrupts
84.75 ± 27% +5459.6% 4711 ± 64% interrupts.CPU98.NMI:Non-maskable_interrupts
84.75 ± 27% +5459.6% 4711 ± 64% interrupts.CPU98.PMI:Performance_monitoring_interrupts
176.25 ± 8% +91.2% 337.00 ± 23% interrupts.CPU98.RES:Rescheduling_interrupts
164.25 ± 8% +61.5% 265.25 ± 20% interrupts.CPU99.RES:Rescheduling_interrupts
242630 ± 11% +27.8% 310009 ± 13% interrupts.NMI:Non-maskable_interrupts
242630 ± 11% +27.8% 310009 ± 13% interrupts.PMI:Performance_monitoring_interrupts
3842 ± 14% -81.4% 714.00 ± 62% interrupts.TLB:TLB_shootdowns
39213 ± 2% +59.4% 62496 ± 8% softirqs.CPU1.SCHED
112479 ± 3% +11.6% 125580 ± 6% softirqs.CPU10.RCU
47544 ± 5% +34.8% 64105 ± 6% softirqs.CPU10.SCHED
115525 ± 5% +34.5% 155325 ± 5% softirqs.CPU100.RCU
42079 ± 4% -34.4% 27593 ± 14% softirqs.CPU100.SCHED
115645 ± 4% +33.4% 154231 ± 4% softirqs.CPU101.RCU
42390 ± 5% -32.4% 28661 ± 9% softirqs.CPU101.SCHED
113237 ± 5% +37.9% 156145 ± 4% softirqs.CPU102.RCU
43877 ± 3% -42.3% 25316 ± 19% softirqs.CPU102.SCHED
115048 ± 4% +35.3% 155692 ± 6% softirqs.CPU103.RCU
42057 ± 2% -34.8% 27428 ± 19% softirqs.CPU103.SCHED
50287 ± 2% +26.8% 63739 ± 2% softirqs.CPU12.SCHED
51055 ± 3% +24.5% 63567 ± 2% softirqs.CPU13.SCHED
111557 ± 4% +15.1% 128441 ± 6% softirqs.CPU14.RCU
51201 ± 8% +21.9% 62437 ± 6% softirqs.CPU14.SCHED
106509 ± 4% +31.4% 139927 ± 7% softirqs.CPU15.RCU
106554 ± 5% +31.4% 140038 ± 10% softirqs.CPU16.RCU
102888 ± 3% +22.9% 126467 ± 7% softirqs.CPU17.RCU
102645 ± 4% +23.8% 127097 ± 8% softirqs.CPU18.RCU
103074 ± 3% +27.2% 131067 ± 8% softirqs.CPU19.RCU
40123 ± 2% +64.7% 66094 ± 16% softirqs.CPU2.SCHED
105947 ± 4% +31.3% 139080 ± 11% softirqs.CPU20.RCU
56698 ± 3% +10.3% 62534 ± 4% softirqs.CPU20.SCHED
107845 ± 4% +25.5% 135380 ± 7% softirqs.CPU21.RCU
104635 ± 2% +22.9% 128563 ± 7% softirqs.CPU22.RCU
57459 ± 2% +9.0% 62636 ± 4% softirqs.CPU22.SCHED
107558 ± 4% +26.9% 136472 ± 9% softirqs.CPU23.RCU
103404 ± 2% +21.9% 126077 ± 9% softirqs.CPU24.RCU
57845 +8.9% 63018 ± 3% softirqs.CPU24.SCHED
103795 ± 3% +27.4% 132281 ± 10% softirqs.CPU25.RCU
116855 ± 3% +39.2% 162714 ± 3% softirqs.CPU26.RCU
40401 ± 3% +14.5% 46275 ± 10% softirqs.CPU26.SCHED
117905 ± 5% +38.2% 163001 ± 3% softirqs.CPU27.RCU
119161 +36.5% 162677 ± 2% softirqs.CPU28.RCU
155833 ± 4% +31.8% 205398 ± 11% softirqs.CPU28.TIMER
120298 ± 6% +39.4% 167637 ± 3% softirqs.CPU29.RCU
165459 ± 5% +28.9% 213346 ± 9% softirqs.CPU29.TIMER
41776 ± 2% +47.3% 61528 ± 12% softirqs.CPU3.SCHED
111332 ± 3% +27.8% 142261 ± 3% softirqs.CPU30.RCU
109782 ± 4% +19.3% 130961 ± 4% softirqs.CPU31.RCU
163967 ± 3% +27.8% 209524 ± 10% softirqs.CPU31.TIMER
110345 ± 4% +25.3% 138304 ± 12% softirqs.CPU32.RCU
110912 ± 4% +27.2% 141121 ± 4% softirqs.CPU33.RCU
111899 ± 5% +27.5% 142697 ± 8% softirqs.CPU34.RCU
164801 ± 4% +25.8% 207277 ± 10% softirqs.CPU34.TIMER
110069 ± 3% +27.6% 140414 ± 11% softirqs.CPU35.RCU
166154 ± 2% +26.4% 210021 ± 9% softirqs.CPU35.TIMER
107927 ± 3% +26.8% 136882 ± 4% softirqs.CPU36.RCU
167316 ± 2% +23.4% 206530 ± 11% softirqs.CPU36.TIMER
107149 ± 3% +28.0% 137185 ± 7% softirqs.CPU37.RCU
52823 ± 5% -24.0% 40128 ± 16% softirqs.CPU37.SCHED
172148 ± 2% +20.5% 207427 ± 11% softirqs.CPU37.TIMER
106831 ± 4% +18.7% 126777 ± 6% softirqs.CPU38.RCU
169088 ± 3% +24.9% 211164 ± 9% softirqs.CPU38.TIMER
109008 ± 4% +29.2% 140872 ± 10% softirqs.CPU39.RCU
52842 ± 4% -12.9% 46051 ± 3% softirqs.CPU39.SCHED
168352 ± 2% +25.8% 211848 ± 8% softirqs.CPU39.TIMER
43344 ± 5% +40.9% 61065 ± 9% softirqs.CPU4.SCHED
109019 ± 4% +29.5% 141157 ± 8% softirqs.CPU40.RCU
53829 ± 2% -23.8% 41002 ± 25% softirqs.CPU40.SCHED
107752 ± 9% +19.7% 128985 ± 5% softirqs.CPU41.RCU
57665 -16.3% 48293 ± 5% softirqs.CPU41.SCHED
104372 ± 4% +29.1% 134762 ± 6% softirqs.CPU42.RCU
56657 -22.2% 44093 ± 8% softirqs.CPU42.SCHED
176519 ± 2% +18.9% 209864 ± 9% softirqs.CPU42.TIMER
102140 ± 4% +30.8% 133570 ± 3% softirqs.CPU43.RCU
57875 ± 2% -28.5% 41392 ± 6% softirqs.CPU43.SCHED
177283 ± 3% +17.1% 207557 ± 9% softirqs.CPU43.TIMER
102750 ± 4% +27.6% 131155 ± 6% softirqs.CPU44.RCU
57039 ± 5% -22.0% 44481 ± 7% softirqs.CPU44.SCHED
180258 ± 3% +17.0% 210978 ± 8% softirqs.CPU44.TIMER
103951 ± 3% +47.1% 152906 ± 2% softirqs.CPU45.RCU
57950 ± 2% -19.4% 46698 ± 7% softirqs.CPU45.SCHED
180059 ± 2% +17.5% 211546 ± 8% softirqs.CPU45.TIMER
106543 ± 4% +46.6% 156185 ± 3% softirqs.CPU46.RCU
58936 ± 3% -24.8% 44309 ± 6% softirqs.CPU46.SCHED
175875 ± 2% +16.8% 205464 ± 11% softirqs.CPU46.TIMER
107599 ± 4% +45.6% 156681 ± 2% softirqs.CPU47.RCU
61135 ± 11% -26.8% 44767 ± 9% softirqs.CPU47.SCHED
175037 ± 3% +18.6% 207548 ± 10% softirqs.CPU47.TIMER
104196 ± 4% +47.8% 154014 ± 3% softirqs.CPU48.RCU
56551 ± 6% -19.3% 45611 ± 16% softirqs.CPU48.SCHED
178334 ± 5% +18.4% 211119 ± 8% softirqs.CPU48.TIMER
105321 ± 4% +46.8% 154628 ± 3% softirqs.CPU49.RCU
176284 ± 2% +18.9% 209524 ± 9% softirqs.CPU49.TIMER
43643 ± 3% +40.7% 61423 ± 11% softirqs.CPU5.SCHED
104189 ± 4% +46.2% 152326 ± 3% softirqs.CPU50.RCU
58720 ± 2% -15.3% 49718 ± 11% softirqs.CPU50.SCHED
180182 ± 3% +16.7% 210254 ± 9% softirqs.CPU50.TIMER
105511 ± 3% +46.2% 154243 ± 2% softirqs.CPU51.RCU
106737 ± 4% +39.1% 148420 ± 10% softirqs.CPU52.RCU
108068 ± 4% +35.5% 146416 ± 11% softirqs.CPU53.RCU
50659 ± 3% +21.0% 61284 ± 9% softirqs.CPU53.SCHED
110776 ± 5% +29.5% 143423 ± 8% softirqs.CPU54.RCU
49820 ± 3% +24.6% 62062 ± 6% softirqs.CPU54.SCHED
108892 ± 4% +29.6% 141149 ± 9% softirqs.CPU55.RCU
48807 ± 3% +28.1% 62502 ± 6% softirqs.CPU55.SCHED
109303 ± 4% +30.2% 142335 ± 10% softirqs.CPU56.RCU
48744 ± 4% +29.7% 63244 ± 4% softirqs.CPU56.SCHED
107665 ± 4% +32.4% 142500 ± 8% softirqs.CPU57.RCU
46939 ± 4% +32.8% 62320 ± 6% softirqs.CPU57.SCHED
107899 ± 5% +32.1% 142541 ± 9% softirqs.CPU58.RCU
47890 ± 6% +29.7% 62112 ± 10% softirqs.CPU58.SCHED
112252 ± 5% +31.6% 147720 ± 9% softirqs.CPU59.RCU
45201 ± 5% +33.9% 60536 ± 11% softirqs.CPU59.SCHED
43271 ± 3% +44.9% 62698 ± 5% softirqs.CPU6.SCHED
42947 ± 4% +41.6% 60815 ± 10% softirqs.CPU60.SCHED
41118 ± 3% +48.2% 60919 ± 10% softirqs.CPU61.SCHED
43558 ± 9% +41.0% 61422 ± 8% softirqs.CPU62.SCHED
42404 ± 5% +45.0% 61473 ± 8% softirqs.CPU63.SCHED
44782 ± 6% +35.2% 60539 ± 11% softirqs.CPU65.SCHED
45270 ± 8% +34.9% 61049 ± 9% softirqs.CPU67.SCHED
46135 ± 6% +32.4% 61099 ± 12% softirqs.CPU69.SCHED
114120 ± 4% +13.0% 128950 ± 9% softirqs.CPU7.RCU
43859 ± 4% +42.6% 62558 ± 4% softirqs.CPU7.SCHED
45007 ± 4% +42.1% 63939 ± 2% softirqs.CPU70.SCHED
46279 ± 4% +31.2% 60706 ± 10% softirqs.CPU71.SCHED
47194 ± 7% +29.5% 61097 ± 9% softirqs.CPU72.SCHED
45037 ± 4% +37.5% 61916 ± 7% softirqs.CPU73.SCHED
44473 ± 7% +38.4% 61533 ± 8% softirqs.CPU74.SCHED
116513 ± 5% +32.7% 154642 ± 7% softirqs.CPU75.RCU
43065 ± 8% +41.5% 60952 ± 10% softirqs.CPU75.SCHED
114917 ± 4% +33.8% 153786 ± 7% softirqs.CPU76.RCU
44462 +40.3% 62390 ± 14% softirqs.CPU76.SCHED
114722 ± 3% +34.1% 153870 ± 7% softirqs.CPU77.RCU
46507 ± 2% +31.3% 61066 ± 8% softirqs.CPU77.SCHED
109126 ± 4% +39.8% 152515 ± 3% softirqs.CPU78.RCU
52943 ± 4% -44.1% 29615 ± 22% softirqs.CPU78.SCHED
113274 ± 2% +34.9% 152829 ± 3% softirqs.CPU79.RCU
49330 ± 4% -39.3% 29950 ± 19% softirqs.CPU79.SCHED
114525 ± 4% +10.7% 126743 ± 6% softirqs.CPU8.RCU
45993 ± 5% +35.6% 62367 ± 5% softirqs.CPU8.SCHED
107326 ± 4% +40.3% 150622 ± 3% softirqs.CPU80.RCU
51636 ± 4% -40.0% 30997 ± 16% softirqs.CPU80.SCHED
103564 ± 4% +48.3% 153578 ± 3% softirqs.CPU81.RCU
54621 ± 3% -45.0% 30058 ± 18% softirqs.CPU81.SCHED
106692 ± 5% +38.1% 147383 ± 6% softirqs.CPU82.RCU
107429 ± 4% +38.3% 148549 ± 3% softirqs.CPU83.RCU
48429 ± 3% -29.7% 34026 ± 15% softirqs.CPU83.SCHED
109037 ± 3% +30.6% 142391 ± 11% softirqs.CPU84.RCU
111642 ± 5% +30.6% 145830 ± 7% softirqs.CPU85.RCU
110949 ± 5% +33.3% 147882 ± 3% softirqs.CPU86.RCU
110815 ± 5% +31.2% 145429 ± 7% softirqs.CPU87.RCU
111916 ± 5% +34.2% 150213 ± 3% softirqs.CPU88.RCU
42154 ± 5% -22.1% 32856 ± 15% softirqs.CPU88.SCHED
111872 ± 4% +33.9% 149766 ± 3% softirqs.CPU89.RCU
47628 ± 3% +32.5% 63122 ± 3% softirqs.CPU9.SCHED
112803 ± 5% +38.3% 155970 ± 5% softirqs.CPU90.RCU
45236 ± 5% -37.4% 28321 ± 23% softirqs.CPU90.SCHED
117379 ± 5% +32.4% 155399 ± 4% softirqs.CPU91.RCU
116981 ± 3% +26.6% 148101 ± 6% softirqs.CPU92.RCU
113561 ± 5% +39.4% 158341 ± 4% softirqs.CPU93.RCU
45469 ± 3% -43.2% 25823 ± 27% softirqs.CPU93.SCHED
112230 ± 5% +38.5% 155456 ± 3% softirqs.CPU94.RCU
113604 ± 4% +34.2% 152470 ± 5% softirqs.CPU95.RCU
45422 ± 4% -33.9% 30021 ± 17% softirqs.CPU95.SCHED
112933 ± 4% +38.3% 156199 ± 4% softirqs.CPU96.RCU
44320 ± 6% -40.9% 26191 ± 20% softirqs.CPU96.SCHED
113319 ± 5% +36.9% 155146 ± 6% softirqs.CPU97.RCU
43834 ± 2% -40.0% 26290 ± 19% softirqs.CPU97.SCHED
116386 ± 6% +32.5% 154262 ± 7% softirqs.CPU98.RCU
41001 ± 8% -31.1% 28239 ± 22% softirqs.CPU98.SCHED
116165 ± 5% +33.7% 155277 ± 5% softirqs.CPU99.RCU
41299 ± 5% -33.7% 27372 ± 20% softirqs.CPU99.SCHED
11518008 ± 4% +25.8% 14489368 ± 4% softirqs.RCU
17583486 ± 3% +16.4% 20469522 ± 4% softirqs.TIMER
***************************************************************************************************
lkp-skl-fpga01: 104 threads Skylake with 192G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/30%/debian-x86_64-20191114.cgz/300s/lkp-skl-fpga01/context1/unixbench/0x2000065
commit:
9c40365a65 ("threads: Update PID limit comment according to futex UAPI change")
59901cb452 ("sched/fair: Don't pull task if local group is more loaded than busiest group")
9c40365a65d62d7c 59901cb4520c44bfce81f523bc6
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 kmsg.ipmi_si_dmi-ipmi-si.#:IRQ_index#not_found
%stddev %change %stddev
\ | \
3115 +29.1% 4022 ± 3% unixbench.score
15433 ± 2% -36.2% 9850 ± 12% unixbench.time.involuntary_context_switches
2114 -15.0% 1797 ± 3% unixbench.time.percent_of_cpu_this_job_got
7797 -17.5% 6433 ± 3% unixbench.time.system_time
477.52 +24.2% 593.20 unixbench.time.user_time
3.69e+08 +23.6% 4.561e+08 ± 2% unixbench.time.voluntary_context_switches
4.873e+08 +29.0% 6.288e+08 ± 3% unixbench.workload
747856 ± 6% -13.1% 649552 ± 6% meminfo.DirectMap4k
1.40 +0.6 1.99 ± 3% mpstat.cpu.all.usr%
181.50 ± 14% +205.5% 554.50 ± 61% numa-meminfo.node0.Mlocked
45.00 ± 14% +207.2% 138.25 ± 61% numa-vmstat.node0.nr_mlock
76.00 +1.3% 77.00 vmstat.cpu.id
3747208 +20.0% 4498355 ± 2% vmstat.system.cs
237644 -4.2% 227776 vmstat.system.in
2932 ± 2% -11.5% 2596 ± 5% slabinfo.khugepaged_mm_slot.active_objs
2932 ± 2% -11.5% 2596 ± 5% slabinfo.khugepaged_mm_slot.num_objs
1160 ± 8% -22.8% 895.75 ± 10% slabinfo.task_group.active_objs
1160 ± 8% -22.8% 895.75 ± 10% slabinfo.task_group.num_objs
7.874e+09 -24.7% 5.932e+09 ± 5% cpuidle.C1.time
8.948e+09 ± 82% +99.3% 1.783e+10 ± 30% cpuidle.C1E.time
28927686 ± 31% +37.6% 39802094 ± 20% cpuidle.C1E.usage
32968312 +1040.8% 3.761e+08 ± 16% cpuidle.POLL.time
3321066 +3571.2% 1.219e+08 ± 17% cpuidle.POLL.usage
77470 -1.2% 76570 proc-vmstat.nr_active_anon
44723 -1.6% 44026 proc-vmstat.nr_slab_unreclaimable
77470 -1.2% 76570 proc-vmstat.nr_zone_active_anon
11008 ± 26% -56.0% 4844 ± 56% proc-vmstat.numa_hint_faults
1806 ± 10% -87.9% 218.75 ± 52% proc-vmstat.numa_hint_faults_local
10143 ± 5% -11.1% 9016 ± 3% proc-vmstat.pgactivate
3687542 ± 3% -16.9% 3066128 ± 10% sched_debug.cfs_rq:/.MIN_vruntime.max
1247933 ± 4% -15.6% 1053151 ± 11% sched_debug.cfs_rq:/.MIN_vruntime.stddev
73039 -14.6% 62394 ± 5% sched_debug.cfs_rq:/.exec_clock.avg
46502 -38.8% 28463 ± 28% sched_debug.cfs_rq:/.exec_clock.min
10133 ± 6% +94.8% 19737 ± 27% sched_debug.cfs_rq:/.exec_clock.stddev
12925 ± 8% +37.1% 17715 ± 27% sched_debug.cfs_rq:/.load.avg
3687542 ± 3% -16.9% 3066129 ± 10% sched_debug.cfs_rq:/.max_vruntime.max
1247933 ± 4% -15.6% 1053152 ± 11% sched_debug.cfs_rq:/.max_vruntime.stddev
3425325 -21.7% 2680459 ± 5% sched_debug.cfs_rq:/.min_vruntime.avg
2191093 -44.6% 1213462 ± 28% sched_debug.cfs_rq:/.min_vruntime.min
471746 ± 6% +77.8% 838686 ± 25% sched_debug.cfs_rq:/.min_vruntime.stddev
0.24 ± 26% +90.8% 0.46 ± 19% sched_debug.cfs_rq:/.nr_spread_over.avg
2.64 ± 36% +151.8% 6.65 ± 55% sched_debug.cfs_rq:/.nr_spread_over.max
0.51 ± 26% +137.0% 1.20 ± 44% sched_debug.cfs_rq:/.nr_spread_over.stddev
1437 ± 3% +37.1% 1970 ± 6% sched_debug.cfs_rq:/.runnable_avg.max
375.43 ± 2% +15.1% 432.07 ± 4% sched_debug.cfs_rq:/.runnable_avg.stddev
-96957 +1058.8% -1123518 sched_debug.cfs_rq:/.spread0.min
471746 ± 6% +77.8% 838694 ± 25% sched_debug.cfs_rq:/.spread0.stddev
858.93 ± 5% +45.9% 1253 ± 13% sched_debug.cfs_rq:/.util_avg.max
649.39 ± 6% +56.7% 1017 ± 15% sched_debug.cfs_rq:/.util_est_enqueued.max
442164 ± 3% +19.3% 527581 ± 3% sched_debug.cpu.avg_idle.avg
514800 ± 4% +15.5% 594740 ± 13% sched_debug.cpu.max_idle_balance_cost.max
1444 ±148% +613.0% 10298 ± 72% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 ± 3% -16.2% 0.00 ± 8% sched_debug.cpu.next_balance.stddev
1.04 ± 5% +81.0% 1.88 ± 22% sched_debug.cpu.nr_running.max
0.41 +12.1% 0.46 ± 6% sched_debug.cpu.nr_running.stddev
8064604 ± 2% +33.5% 10769101 ± 11% sched_debug.cpu.nr_switches.max
915034 ± 6% +206.7% 2806624 ± 32% sched_debug.cpu.nr_switches.stddev
8061279 ± 2% +33.5% 10761752 ± 11% sched_debug.cpu.sched_count.max
914923 ± 6% +206.7% 2806145 ± 32% sched_debug.cpu.sched_count.stddev
4029443 ± 2% +29.7% 5227316 ± 11% sched_debug.cpu.sched_goidle.max
457354 ± 6% +196.6% 1356319 ± 31% sched_debug.cpu.sched_goidle.stddev
3230031 +17.6% 3799652 ± 8% sched_debug.cpu.ttwu_count.avg
4032123 +37.2% 5533499 ± 11% sched_debug.cpu.ttwu_count.max
457261 ± 6% +217.1% 1449903 ± 33% sched_debug.cpu.ttwu_count.stddev
497.05 +952.2% 5229 ± 17% sched_debug.cpu.ttwu_local.avg
1512 +449.7% 8311 ± 24% sched_debug.cpu.ttwu_local.max
354.64 ± 4% +688.8% 2797 ± 29% sched_debug.cpu.ttwu_local.min
130.66 ± 6% +1584.8% 2201 ± 49% sched_debug.cpu.ttwu_local.stddev
97364 ± 2% -15.3% 82438 ± 10% softirqs.CPU100.SCHED
95732 -13.2% 83091 ± 10% softirqs.CPU101.SCHED
98020 -15.3% 83044 ± 11% softirqs.CPU102.SCHED
134854 ± 2% +9.5% 147696 ± 3% softirqs.CPU33.TIMER
100296 ± 4% -9.8% 90488 ± 8% softirqs.CPU34.SCHED
98665 ± 4% -10.0% 88752 ± 8% softirqs.CPU36.SCHED
101562 ± 2% -12.5% 88834 ± 8% softirqs.CPU37.SCHED
103241 -14.5% 88256 ± 10% softirqs.CPU38.SCHED
102016 -15.1% 86641 ± 9% softirqs.CPU39.SCHED
103072 ± 2% -15.9% 86642 ± 11% softirqs.CPU40.SCHED
103642 -16.7% 86299 ± 10% softirqs.CPU41.SCHED
136281 +8.1% 147364 ± 3% softirqs.CPU41.TIMER
104080 -18.4% 84916 ± 11% softirqs.CPU42.SCHED
104161 -25.6% 77445 ± 19% softirqs.CPU43.SCHED
103794 ± 2% -18.3% 84779 ± 11% softirqs.CPU44.SCHED
104881 -19.0% 84947 ± 12% softirqs.CPU45.SCHED
106249 -21.7% 83209 ± 11% softirqs.CPU46.SCHED
105901 -21.9% 82708 ± 12% softirqs.CPU47.SCHED
106109 -21.0% 83838 ± 10% softirqs.CPU48.SCHED
104208 ± 3% -20.5% 82800 ± 11% softirqs.CPU49.SCHED
105449 -20.8% 83521 ± 10% softirqs.CPU50.SCHED
106650 -12.8% 92988 ± 6% softirqs.CPU52.SCHED
110131 -23.6% 84129 ± 11% softirqs.CPU78.SCHED
107950 ± 3% -22.3% 83897 ± 11% softirqs.CPU79.SCHED
110414 -23.5% 84412 ± 10% softirqs.CPU80.SCHED
107954 ± 2% -21.3% 84966 ± 10% softirqs.CPU81.SCHED
107635 -22.6% 83318 ± 13% softirqs.CPU82.SCHED
107434 ± 2% -22.4% 83344 ± 11% softirqs.CPU83.SCHED
106151 ± 2% -21.5% 83345 ± 12% softirqs.CPU84.SCHED
104935 ± 5% -20.0% 83933 ± 11% softirqs.CPU85.SCHED
103760 ± 2% -19.3% 83770 ± 11% softirqs.CPU86.SCHED
103250 ± 4% -18.6% 84093 ± 11% softirqs.CPU87.SCHED
104851 ± 2% -20.2% 83629 ± 12% softirqs.CPU88.SCHED
104007 -19.5% 83676 ± 12% softirqs.CPU89.SCHED
101221 -17.8% 83192 ± 11% softirqs.CPU90.SCHED
103382 ± 2% -19.4% 83322 ± 11% softirqs.CPU91.SCHED
99759 ± 3% -16.9% 82889 ± 12% softirqs.CPU92.SCHED
99723 -15.8% 84012 ± 11% softirqs.CPU93.SCHED
99706 ± 2% -15.8% 83927 ± 11% softirqs.CPU94.SCHED
100802 -17.3% 83351 ± 11% softirqs.CPU95.SCHED
99622 ± 2% -16.3% 83351 ± 10% softirqs.CPU96.SCHED
98714 ± 2% -16.4% 82483 ± 11% softirqs.CPU97.SCHED
99272 -16.5% 82919 ± 11% softirqs.CPU98.SCHED
97699 ± 2% -15.7% 82320 ± 11% softirqs.CPU99.SCHED
30.70 ± 17% -41.8% 17.86 ± 2% perf-stat.i.MPKI
6.229e+09 +21.0% 7.537e+09 ± 2% perf-stat.i.branch-instructions
87521494 ± 2% +26.1% 1.103e+08 ± 2% perf-stat.i.branch-misses
26161990 -61.0% 10190442 ± 20% perf-stat.i.cache-misses
7.094e+08 -3.2% 6.866e+08 perf-stat.i.cache-references
3766575 +20.0% 4520959 ± 2% perf-stat.i.context-switches
3.51 ± 8% -22.6% 2.72 ± 3% perf-stat.i.cpi
8.561e+10 +2.8% 8.8e+10 perf-stat.i.cpu-cycles
1199 ± 10% +12547.8% 151679 ± 18% perf-stat.i.cpu-migrations
3326 ± 8% +1896.7% 66426 ± 59% perf-stat.i.cycles-between-cache-misses
4368880 ± 5% +260.9% 15765930 ± 11% perf-stat.i.dTLB-load-misses
7.644e+09 +21.3% 9.275e+09 ± 2% perf-stat.i.dTLB-loads
83528 ± 41% +1345.4% 1207309 ± 15% perf-stat.i.dTLB-store-misses
4.5e+09 +22.5% 5.512e+09 ± 2% perf-stat.i.dTLB-stores
4412580 +49.5% 6597934 ± 4% perf-stat.i.iTLB-load-misses
29081328 +25.9% 36603347 perf-stat.i.iTLB-loads
2.835e+10 +21.5% 3.444e+10 ± 2% perf-stat.i.instructions
0.31 ± 4% +21.5% 0.38 ± 3% perf-stat.i.ipc
94.83 -2.4 92.45 perf-stat.i.node-load-miss-rate%
4078999 -58.8% 1678711 ± 18% perf-stat.i.node-load-misses
146125 -60.1% 58372 ± 13% perf-stat.i.node-loads
95.95 -10.6 85.36 perf-stat.i.node-store-miss-rate%
3822185 -59.7% 1539813 ± 20% perf-stat.i.node-store-misses
11551 ± 3% -8.5% 10571 ± 5% perf-stat.i.node-stores
25.02 -20.3% 19.94 ± 2% perf-stat.overall.MPKI
1.41 +0.1 1.46 perf-stat.overall.branch-miss-rate%
3.69 -2.2 1.49 ± 21% perf-stat.overall.cache-miss-rate%
3.02 -15.4% 2.56 ± 2% perf-stat.overall.cpi
3272 +178.9% 9127 ± 25% perf-stat.overall.cycles-between-cache-misses
0.06 ± 5% +0.1 0.17 ± 9% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 41% +0.0 0.02 ± 13% perf-stat.overall.dTLB-store-miss-rate%
13.18 +2.1 15.27 ± 3% perf-stat.overall.iTLB-load-miss-rate%
6425 -18.7% 5224 ± 2% perf-stat.overall.instructions-per-iTLB-miss
0.33 +18.2% 0.39 ± 2% perf-stat.overall.ipc
22735 -5.8% 21419 perf-stat.overall.path-length
6.21e+09 +21.1% 7.518e+09 ± 2% perf-stat.ps.branch-instructions
87263324 ± 2% +26.1% 1.101e+08 ± 2% perf-stat.ps.branch-misses
26081704 -61.1% 10158408 ± 20% perf-stat.ps.cache-misses
7.072e+08 -3.2% 6.848e+08 perf-stat.ps.cache-references
3754979 +20.1% 4509479 ± 2% perf-stat.ps.context-switches
8.535e+10 +2.8% 8.777e+10 perf-stat.ps.cpu-cycles
1197 ± 10% +12540.5% 151373 ± 18% perf-stat.ps.cpu-migrations
4356788 ± 5% +261.1% 15731108 ± 11% perf-stat.ps.dTLB-load-misses
7.621e+09 +21.4% 9.251e+09 ± 2% perf-stat.ps.dTLB-loads
83463 ± 41% +1343.5% 1204761 ± 15% perf-stat.ps.dTLB-store-misses
4.487e+09 +22.5% 5.498e+09 ± 2% perf-stat.ps.dTLB-stores
4399472 +49.6% 6581866 ± 4% perf-stat.ps.iTLB-load-misses
28993919 +25.9% 36508403 perf-stat.ps.iTLB-loads
2.826e+10 +21.6% 3.436e+10 ± 2% perf-stat.ps.instructions
4066345 -58.8% 1673367 ± 18% perf-stat.ps.node-load-misses
145705 -60.0% 58229 ± 13% perf-stat.ps.node-loads
3810301 -59.7% 1534753 ± 20% perf-stat.ps.node-store-misses
11533 ± 3% -8.5% 10555 ± 5% perf-stat.ps.node-stores
1.108e+13 +21.5% 1.346e+13 ± 2% perf-stat.total.instructions
49518 -1.5% 48784 interrupts.CAL:Function_call_interrupts
75573 ± 2% -21.1% 59624 ± 19% interrupts.CPU0.RES:Rescheduling_interrupts
293.50 ± 46% -83.7% 47.75 ± 39% interrupts.CPU0.TLB:TLB_shootdowns
1651 ± 43% -90.6% 155.75 ± 89% interrupts.CPU1.TLB:TLB_shootdowns
107991 ± 2% -25.4% 80516 ± 13% interrupts.CPU10.RES:Rescheduling_interrupts
53.00 ± 95% -70.3% 15.75 ± 34% interrupts.CPU10.TLB:TLB_shootdowns
104860 ± 3% -45.3% 57407 ± 29% interrupts.CPU100.RES:Rescheduling_interrupts
101815 ± 3% -42.4% 58608 ± 28% interrupts.CPU101.RES:Rescheduling_interrupts
104224 ± 3% -45.2% 57146 ± 32% interrupts.CPU102.RES:Rescheduling_interrupts
3026 ± 8% -70.6% 891.00 ±149% interrupts.CPU103.NMI:Non-maskable_interrupts
3026 ± 8% -70.6% 891.00 ±149% interrupts.CPU103.PMI:Performance_monitoring_interrupts
97748 ± 3% -43.9% 54866 ± 25% interrupts.CPU103.RES:Rescheduling_interrupts
106274 ± 2% -25.2% 79442 ± 18% interrupts.CPU11.RES:Rescheduling_interrupts
109794 ± 3% -26.2% 81077 ± 13% interrupts.CPU12.RES:Rescheduling_interrupts
110641 ± 4% -28.4% 79170 ± 17% interrupts.CPU13.RES:Rescheduling_interrupts
112578 ± 4% -28.9% 80064 ± 13% interrupts.CPU14.RES:Rescheduling_interrupts
203.50 ±101% -92.1% 16.00 ± 76% interrupts.CPU14.TLB:TLB_shootdowns
115653 ± 3% -29.9% 81035 ± 16% interrupts.CPU15.RES:Rescheduling_interrupts
2336 ± 30% +56.1% 3646 ± 24% interrupts.CPU16.NMI:Non-maskable_interrupts
2336 ± 30% +56.1% 3646 ± 24% interrupts.CPU16.PMI:Performance_monitoring_interrupts
113166 ± 4% -31.0% 78040 ± 14% interrupts.CPU16.RES:Rescheduling_interrupts
117545 ± 6% -34.2% 77376 ± 15% interrupts.CPU17.RES:Rescheduling_interrupts
119816 ± 5% -35.9% 76821 ± 18% interrupts.CPU18.RES:Rescheduling_interrupts
208.00 ±115% -93.0% 14.50 ± 51% interrupts.CPU18.TLB:TLB_shootdowns
116298 ± 5% -33.1% 77798 ± 18% interrupts.CPU19.RES:Rescheduling_interrupts
118.50 ± 93% -87.8% 14.50 ± 51% interrupts.CPU19.TLB:TLB_shootdowns
471.50 ± 54% -97.1% 13.75 ± 37% interrupts.CPU2.TLB:TLB_shootdowns
119931 ± 4% -34.2% 78873 ± 16% interrupts.CPU20.RES:Rescheduling_interrupts
119193 ± 3% -33.7% 79035 ± 10% interrupts.CPU21.RES:Rescheduling_interrupts
119705 ± 4% -33.6% 79531 ± 21% interrupts.CPU22.RES:Rescheduling_interrupts
119224 -33.6% 79145 ± 15% interrupts.CPU23.RES:Rescheduling_interrupts
239.50 ± 82% -94.8% 12.50 ± 47% interrupts.CPU23.TLB:TLB_shootdowns
114268 ± 5% -32.0% 77747 ± 18% interrupts.CPU24.RES:Rescheduling_interrupts
130.75 ± 54% -87.2% 16.75 ± 80% interrupts.CPU24.TLB:TLB_shootdowns
114570 ± 2% -27.4% 83205 ± 15% interrupts.CPU25.RES:Rescheduling_interrupts
401.00 ± 34% -90.8% 36.75 ± 37% interrupts.CPU26.TLB:TLB_shootdowns
2215 ± 26% -81.2% 417.25 ± 96% interrupts.CPU27.TLB:TLB_shootdowns
1056 ± 71% -76.4% 249.75 ± 54% interrupts.CPU29.TLB:TLB_shootdowns
94273 ± 4% -14.7% 80458 ± 17% interrupts.CPU3.RES:Rescheduling_interrupts
438.75 ± 54% -80.6% 85.25 ±138% interrupts.CPU3.TLB:TLB_shootdowns
297.75 ± 52% -69.4% 91.00 ±123% interrupts.CPU30.TLB:TLB_shootdowns
99323 ± 4% -17.3% 82125 ± 18% interrupts.CPU31.RES:Rescheduling_interrupts
101813 ± 4% -22.1% 79310 ± 22% interrupts.CPU32.RES:Rescheduling_interrupts
104108 ± 4% -23.9% 79216 ± 21% interrupts.CPU33.RES:Rescheduling_interrupts
108408 ± 6% -30.2% 75649 ± 19% interrupts.CPU34.RES:Rescheduling_interrupts
107851 ± 7% -30.2% 75255 ± 22% interrupts.CPU35.RES:Rescheduling_interrupts
3050 ± 5% -38.5% 1875 ± 56% interrupts.CPU36.NMI:Non-maskable_interrupts
3050 ± 5% -38.5% 1875 ± 56% interrupts.CPU36.PMI:Performance_monitoring_interrupts
110860 ± 5% -36.0% 70961 ± 21% interrupts.CPU36.RES:Rescheduling_interrupts
2994 ± 5% -47.5% 1573 ± 56% interrupts.CPU37.NMI:Non-maskable_interrupts
2994 ± 5% -47.5% 1573 ± 56% interrupts.CPU37.PMI:Performance_monitoring_interrupts
110701 ± 6% -35.9% 70912 ± 21% interrupts.CPU37.RES:Rescheduling_interrupts
2950 ± 3% -60.7% 1158 ± 70% interrupts.CPU38.NMI:Non-maskable_interrupts
2950 ± 3% -60.7% 1158 ± 70% interrupts.CPU38.PMI:Performance_monitoring_interrupts
114683 ± 2% -39.3% 69605 ± 27% interrupts.CPU38.RES:Rescheduling_interrupts
2959 ± 3% -53.1% 1387 ± 64% interrupts.CPU39.NMI:Non-maskable_interrupts
2959 ± 3% -53.1% 1387 ± 64% interrupts.CPU39.PMI:Performance_monitoring_interrupts
112794 ± 3% -41.0% 66597 ± 21% interrupts.CPU39.RES:Rescheduling_interrupts
96299 ± 6% -19.1% 77895 ± 15% interrupts.CPU4.RES:Rescheduling_interrupts
3084 ± 6% -62.4% 1158 ± 67% interrupts.CPU40.NMI:Non-maskable_interrupts
3084 ± 6% -62.4% 1158 ± 67% interrupts.CPU40.PMI:Performance_monitoring_interrupts
115740 ± 6% -42.7% 66275 ± 28% interrupts.CPU40.RES:Rescheduling_interrupts
336.75 ± 73% -94.3% 19.25 ± 40% interrupts.CPU40.TLB:TLB_shootdowns
3109 ± 5% -59.0% 1273 ± 57% interrupts.CPU41.NMI:Non-maskable_interrupts
3109 ± 5% -59.0% 1273 ± 57% interrupts.CPU41.PMI:Performance_monitoring_interrupts
117515 ± 3% -45.4% 64133 ± 26% interrupts.CPU41.RES:Rescheduling_interrupts
3074 ± 12% -64.3% 1097 ± 89% interrupts.CPU42.NMI:Non-maskable_interrupts
3074 ± 12% -64.3% 1097 ± 89% interrupts.CPU42.PMI:Performance_monitoring_interrupts
118729 ± 3% -47.7% 62131 ± 30% interrupts.CPU42.RES:Rescheduling_interrupts
3026 ± 7% -70.3% 898.50 ± 83% interrupts.CPU43.NMI:Non-maskable_interrupts
3026 ± 7% -70.3% 898.50 ± 83% interrupts.CPU43.PMI:Performance_monitoring_interrupts
116750 ± 3% -48.2% 60473 ± 29% interrupts.CPU43.RES:Rescheduling_interrupts
2999 ± 13% -71.5% 853.50 ±116% interrupts.CPU44.NMI:Non-maskable_interrupts
2999 ± 13% -71.5% 853.50 ±116% interrupts.CPU44.PMI:Performance_monitoring_interrupts
119184 -48.6% 61233 ± 30% interrupts.CPU44.RES:Rescheduling_interrupts
119035 ± 2% -48.7% 61050 ± 32% interrupts.CPU45.RES:Rescheduling_interrupts
122760 ± 3% -52.1% 58842 ± 30% interrupts.CPU46.RES:Rescheduling_interrupts
122662 ± 2% -53.5% 57035 ± 33% interrupts.CPU47.RES:Rescheduling_interrupts
123349 ± 2% -51.7% 59540 ± 29% interrupts.CPU48.RES:Rescheduling_interrupts
123.00 ±107% -88.6% 14.00 ± 36% interrupts.CPU48.TLB:TLB_shootdowns
123038 ± 2% -53.4% 57374 ± 32% interrupts.CPU49.RES:Rescheduling_interrupts
174.50 ± 70% -92.3% 13.50 ± 24% interrupts.CPU49.TLB:TLB_shootdowns
94491 ± 3% -16.2% 79161 ± 17% interrupts.CPU5.RES:Rescheduling_interrupts
120948 ± 2% -51.3% 58853 ± 28% interrupts.CPU50.RES:Rescheduling_interrupts
121202 ± 3% -53.5% 56355 ± 35% interrupts.CPU51.RES:Rescheduling_interrupts
127597 ± 3% -32.8% 85784 ± 14% interrupts.CPU52.RES:Rescheduling_interrupts
122288 ± 4% -33.4% 81461 ± 14% interrupts.CPU53.RES:Rescheduling_interrupts
119757 ± 3% -32.0% 81484 ± 19% interrupts.CPU54.RES:Rescheduling_interrupts
232.50 ± 97% -94.3% 13.25 ± 86% interrupts.CPU54.TLB:TLB_shootdowns
114657 ± 4% -27.8% 82728 ± 16% interrupts.CPU55.RES:Rescheduling_interrupts
91.50 ±132% -84.7% 14.00 ± 59% interrupts.CPU55.TLB:TLB_shootdowns
112537 ± 6% -28.0% 80980 ± 19% interrupts.CPU56.RES:Rescheduling_interrupts
180.00 ± 94% -95.1% 8.75 ± 74% interrupts.CPU56.TLB:TLB_shootdowns
110747 ± 4% -26.4% 81457 ± 17% interrupts.CPU57.RES:Rescheduling_interrupts
309.25 ± 99% -97.1% 9.00 ± 73% interrupts.CPU57.TLB:TLB_shootdowns
108297 -26.4% 79689 ± 20% interrupts.CPU58.RES:Rescheduling_interrupts
96801 ± 2% -18.7% 78664 ± 16% interrupts.CPU6.RES:Rescheduling_interrupts
104449 ± 5% -21.7% 81825 ± 18% interrupts.CPU60.RES:Rescheduling_interrupts
150.50 ± 85% -93.7% 9.50 ± 28% interrupts.CPU60.TLB:TLB_shootdowns
103863 ± 5% -21.9% 81091 ± 19% interrupts.CPU61.RES:Rescheduling_interrupts
99849 ± 5% -18.8% 81035 ± 19% interrupts.CPU62.RES:Rescheduling_interrupts
99399 ± 4% -18.8% 80732 ± 16% interrupts.CPU63.RES:Rescheduling_interrupts
134.50 ± 88% -92.8% 9.75 ± 38% interrupts.CPU64.TLB:TLB_shootdowns
94400 ± 3% -21.2% 74427 ± 22% interrupts.CPU66.RES:Rescheduling_interrupts
96.75 ±136% -89.1% 10.50 ± 86% interrupts.CPU66.TLB:TLB_shootdowns
93400 ± 6% -21.2% 73562 ± 23% interrupts.CPU68.RES:Rescheduling_interrupts
147.25 ±147% -94.2% 8.50 ± 55% interrupts.CPU69.TLB:TLB_shootdowns
101127 ± 6% -21.5% 79428 ± 17% interrupts.CPU7.RES:Rescheduling_interrupts
43.25 ±101% -76.9% 10.00 ± 86% interrupts.CPU71.TLB:TLB_shootdowns
93.00 ±134% -90.6% 8.75 ± 45% interrupts.CPU73.TLB:TLB_shootdowns
73.50 ±129% -86.4% 10.00 ± 57% interrupts.CPU74.TLB:TLB_shootdowns
78700 ± 4% -18.1% 64461 ± 26% interrupts.CPU75.RES:Rescheduling_interrupts
82332 ± 5% -23.2% 63213 ± 19% interrupts.CPU76.RES:Rescheduling_interrupts
80750 ± 3% -20.5% 64217 ± 21% interrupts.CPU77.RES:Rescheduling_interrupts
167.00 ± 86% -53.9% 77.00 ±158% interrupts.CPU77.TLB:TLB_shootdowns
132925 ± 2% -55.5% 59127 ± 32% interrupts.CPU78.RES:Rescheduling_interrupts
130753 ± 3% -52.1% 62630 ± 28% interrupts.CPU79.RES:Rescheduling_interrupts
2129 ± 28% +106.7% 4402 ± 20% interrupts.CPU8.NMI:Non-maskable_interrupts
2129 ± 28% +106.7% 4402 ± 20% interrupts.CPU8.PMI:Performance_monitoring_interrupts
102071 ± 3% -20.1% 81537 ± 15% interrupts.CPU8.RES:Rescheduling_interrupts
130307 ± 5% -54.5% 59229 ± 29% interrupts.CPU80.RES:Rescheduling_interrupts
130176 ± 3% -52.9% 61349 ± 29% interrupts.CPU81.RES:Rescheduling_interrupts
125592 ± 2% -52.8% 59330 ± 35% interrupts.CPU82.RES:Rescheduling_interrupts
126379 ± 2% -53.4% 58871 ± 30% interrupts.CPU83.RES:Rescheduling_interrupts
122387 ± 4% -52.3% 58375 ± 32% interrupts.CPU84.RES:Rescheduling_interrupts
123520 ± 5% -51.6% 59756 ± 29% interrupts.CPU85.RES:Rescheduling_interrupts
122586 ± 6% -50.6% 60556 ± 30% interrupts.CPU86.RES:Rescheduling_interrupts
119406 ± 5% -49.8% 59963 ± 29% interrupts.CPU87.RES:Rescheduling_interrupts
119861 ± 4% -51.1% 58631 ± 33% interrupts.CPU88.RES:Rescheduling_interrupts
117115 ± 4% -50.0% 58574 ± 32% interrupts.CPU89.RES:Rescheduling_interrupts
104723 ± 2% -25.1% 78456 ± 20% interrupts.CPU9.RES:Rescheduling_interrupts
113197 ± 3% -49.1% 57667 ± 31% interrupts.CPU90.RES:Rescheduling_interrupts
117511 ± 3% -49.1% 59777 ± 31% interrupts.CPU91.RES:Rescheduling_interrupts
113502 ± 2% -48.6% 58311 ± 35% interrupts.CPU92.RES:Rescheduling_interrupts
111247 -46.3% 59729 ± 29% interrupts.CPU93.RES:Rescheduling_interrupts
109067 ± 4% -45.0% 60027 ± 29% interrupts.CPU94.RES:Rescheduling_interrupts
109639 ± 2% -46.4% 58724 ± 29% interrupts.CPU95.RES:Rescheduling_interrupts
107661 ± 3% -45.2% 59031 ± 29% interrupts.CPU96.RES:Rescheduling_interrupts
2987 ± 7% -69.8% 900.75 ±117% interrupts.CPU97.NMI:Non-maskable_interrupts
2987 ± 7% -69.8% 900.75 ±117% interrupts.CPU97.PMI:Performance_monitoring_interrupts
107034 ± 2% -47.6% 56109 ± 29% interrupts.CPU97.RES:Rescheduling_interrupts
96.00 ±125% -86.5% 13.00 ± 12% interrupts.CPU97.TLB:TLB_shootdowns
107585 ± 2% -46.3% 57788 ± 31% interrupts.CPU98.RES:Rescheduling_interrupts
104668 ± 5% -46.5% 55991 ± 33% interrupts.CPU99.RES:Rescheduling_interrupts
93.25 ±108% -84.2% 14.75 ± 14% interrupts.CPU99.TLB:TLB_shootdowns
11221741 -34.2% 7378335 ± 9% interrupts.RES:Rescheduling_interrupts
19833 ± 39% -56.4% 8648 ± 38% interrupts.TLB:TLB_shootdowns
30.31 -8.5 21.77 ± 28% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
31.04 -8.5 22.53 ± 27% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task
34.59 -6.9 27.65 ± 18% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
36.44 -6.3 30.10 ± 15% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
36.85 -6.1 30.70 ± 14% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
36.88 -6.1 30.77 ± 14% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
36.89 -6.1 30.79 ± 14% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
39.76 -5.9 33.83 ± 14% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
40.65 -4.6 36.05 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
40.72 -4.6 36.15 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
38.95 -4.4 34.52 ± 8% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
39.08 -4.4 34.68 ± 8% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write
39.31 -4.4 34.93 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
39.59 -4.3 35.27 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write
40.70 -3.9 36.76 ± 7% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
40.77 -3.9 36.87 ± 7% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
46.74 -1.8 44.95 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
46.77 -1.8 45.00 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
46.78 -1.8 45.02 ± 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
47.29 -1.5 45.81 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
6.01 ± 7% -1.3 4.68 ± 9% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
6.03 ± 7% -1.3 4.73 ± 9% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
6.17 ± 7% -1.2 4.99 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
6.16 ± 6% -1.2 4.98 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
6.33 ± 6% -1.1 5.26 ± 9% perf-profile.calltrace.cycles-pp.write
0.53 ± 2% +0.1 0.63 ± 14% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read.ksys_read
0.55 ± 2% +0.2 0.74 ± 23% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
0.70 ± 2% +0.2 0.91 ± 19% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.70 ± 2% +0.2 0.93 ± 21% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
0.54 +0.2 0.79 ± 24% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
1.16 +0.3 1.43 ± 11% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle
0.64 ± 4% +0.3 0.95 ± 22% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.78 ± 3% +0.3 1.12 ± 21% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
1.53 +0.4 1.94 ± 10% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry
1.02 ± 2% +0.4 1.43 ± 21% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
1.27 ± 2% +0.5 1.73 ± 22% perf-profile.calltrace.cycles-pp.unwind_next_frame.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity
0.26 ±100% +0.6 0.85 ± 46% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
1.60 ± 3% +0.7 2.28 ± 21% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.02 ± 6% +0.8 1.83 ± 9% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.05 ± 6% +0.8 1.87 ± 9% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.24 +0.8 2.08 ± 38% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.pipe_read
1.22 ± 7% +0.9 2.16 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
1.23 ± 7% +0.9 2.18 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
1.44 ± 7% +1.1 2.56 ± 9% perf-profile.calltrace.cycles-pp.read
1.46 +1.4 2.90 ± 25% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.pipe_read.new_sync_read
2.73 +1.5 4.22 ± 28% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
2.78 +1.5 4.30 ± 27% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +1.6 1.55 ± 85% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
3.23 ± 6% +1.6 4.84 ± 21% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task
2.29 ± 2% +1.8 4.12 ± 23% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
3.08 ± 7% +2.1 5.15 ± 26% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.pipe_read.new_sync_read.vfs_read
3.17 ± 6% +2.1 5.27 ± 26% perf-profile.calltrace.cycles-pp.schedule.pipe_read.new_sync_read.vfs_read.ksys_read
5.35 +2.2 7.56 ± 25% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.50 +2.3 7.76 ± 25% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.79 +2.7 8.48 ± 21% perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
5.90 +2.8 8.67 ± 22% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
31.89 -8.3 23.59 ± 25% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
34.59 -6.9 27.66 ± 18% perf-profile.children.cycles-pp.__account_scheduler_latency
30.51 -6.9 23.60 ± 19% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
36.58 -6.3 30.26 ± 15% perf-profile.children.cycles-pp.enqueue_entity
36.85 -6.1 30.71 ± 14% perf-profile.children.cycles-pp.enqueue_task_fair
36.88 -6.1 30.77 ± 14% perf-profile.children.cycles-pp.activate_task
36.90 -6.1 30.80 ± 14% perf-profile.children.cycles-pp.ttwu_do_activate
39.93 -6.0 33.95 ± 13% perf-profile.children.cycles-pp.intel_idle
38.96 -4.4 34.52 ± 8% perf-profile.children.cycles-pp.try_to_wake_up
39.09 -4.4 34.69 ± 8% perf-profile.children.cycles-pp.autoremove_wake_function
41.17 -4.4 36.79 ± 8% perf-profile.children.cycles-pp.cpuidle_enter_state
39.31 -4.4 34.93 ± 8% perf-profile.children.cycles-pp.__wake_up_common
41.18 -4.4 36.81 ± 8% perf-profile.children.cycles-pp.cpuidle_enter
39.59 -4.3 35.28 ± 8% perf-profile.children.cycles-pp.__wake_up_common_lock
40.71 -3.9 36.77 ± 7% perf-profile.children.cycles-pp.pipe_write
40.79 -3.9 36.89 ± 7% perf-profile.children.cycles-pp.new_sync_write
41.10 -3.8 37.30 ± 6% perf-profile.children.cycles-pp.vfs_write
41.23 -3.7 37.53 ± 6% perf-profile.children.cycles-pp.ksys_write
46.78 -1.8 45.02 ± 2% perf-profile.children.cycles-pp.start_secondary
47.29 -1.5 45.81 ± 2% perf-profile.children.cycles-pp.secondary_startup_64
47.29 -1.5 45.81 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
47.29 -1.5 45.82 ± 2% perf-profile.children.cycles-pp.do_idle
6.34 ± 6% -1.1 5.29 ± 9% perf-profile.children.cycles-pp.write
0.34 ± 5% -0.1 0.29 ± 12% perf-profile.children.cycles-pp.tick_sched_handle
0.33 ± 5% -0.0 0.29 ± 11% perf-profile.children.cycles-pp.update_process_times
0.24 ± 3% -0.0 0.20 ± 14% perf-profile.children.cycles-pp.scheduler_tick
0.05 ± 8% +0.0 0.08 ± 16% perf-profile.children.cycles-pp.generic_pipe_buf_confirm
0.23 +0.0 0.26 ± 4% perf-profile.children.cycles-pp.nr_iowait_cpu
0.12 ± 4% +0.0 0.16 ± 7% perf-profile.children.cycles-pp.cpus_share_cache
0.06 +0.0 0.09 ± 26% perf-profile.children.cycles-pp.atime_needs_update
0.26 ± 4% +0.0 0.30 ± 9% perf-profile.children.cycles-pp.rcu_idle_exit
0.08 ± 5% +0.0 0.12 ± 26% perf-profile.children.cycles-pp.copyin
0.09 ± 7% +0.0 0.13 ± 25% perf-profile.children.cycles-pp.stack_access_ok
0.09 +0.0 0.13 ± 20% perf-profile.children.cycles-pp.__calc_delta
0.04 ± 57% +0.0 0.08 ± 20% perf-profile.children.cycles-pp.is_bpf_text_address
0.23 +0.0 0.27 ± 6% perf-profile.children.cycles-pp.update_ts_time_stats
0.12 ± 7% +0.0 0.16 ± 19% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.09 ± 4% +0.0 0.13 ± 25% perf-profile.children.cycles-pp.touch_atime
0.06 ± 6% +0.0 0.10 ± 31% perf-profile.children.cycles-pp.__might_fault
0.03 ±100% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.rcu_core
0.12 ± 6% +0.0 0.17 ± 13% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.21 ± 3% +0.0 0.26 ± 10% perf-profile.children.cycles-pp.newidle_balance
0.11 +0.0 0.16 ± 23% perf-profile.children.cycles-pp.in_sched_functions
0.09 ± 5% +0.0 0.13 ± 26% perf-profile.children.cycles-pp.__fsnotify_parent
0.01 ±173% +0.0 0.06 ± 11% perf-profile.children.cycles-pp.lapic_next_deadline
0.01 ±173% +0.1 0.06 ± 26% perf-profile.children.cycles-pp.__x64_sys_write
0.04 ± 57% +0.1 0.09 ± 40% perf-profile.children.cycles-pp.set_next_task_idle
0.06 ± 6% +0.1 0.12 ± 39% perf-profile.children.cycles-pp.pick_next_task_idle
0.09 ± 7% +0.1 0.14 ± 26% perf-profile.children.cycles-pp.menu_reflect
0.06 ± 7% +0.1 0.11 ± 25% perf-profile.children.cycles-pp.find_next_bit
0.01 ±173% +0.1 0.07 ± 19% perf-profile.children.cycles-pp.sched_ttwu_pending
0.00 +0.1 0.06 ± 15% perf-profile.children.cycles-pp.bpf_prog_kallsyms_find
0.00 +0.1 0.06 ± 15% perf-profile.children.cycles-pp.get_cpu_device
0.29 ± 4% +0.1 0.35 ± 8% perf-profile.children.cycles-pp.copyout
0.00 +0.1 0.06 ± 28% perf-profile.children.cycles-pp.in_lock_functions
0.09 ± 5% +0.1 0.15 ± 26% perf-profile.children.cycles-pp.current_time
0.23 +0.1 0.29 ± 10% perf-profile.children.cycles-pp.mutex_unlock
0.12 ± 5% +0.1 0.18 ± 25% perf-profile.children.cycles-pp.fsnotify
0.08 ± 5% +0.1 0.15 ± 30% perf-profile.children.cycles-pp.file_update_time
0.20 ± 2% +0.1 0.26 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid
0.07 +0.1 0.13 ± 38% perf-profile.children.cycles-pp.__x86_indirect_thunk_rbx
0.04 ± 57% +0.1 0.11 ± 24% perf-profile.children.cycles-pp.put_prev_entity
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.00 +0.1 0.06 ± 17% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.14 ± 3% +0.1 0.21 ± 21% perf-profile.children.cycles-pp.resched_curr
0.00 +0.1 0.07 ± 31% perf-profile.children.cycles-pp.timestamp_truncate
0.00 +0.1 0.07 ± 30% perf-profile.children.cycles-pp.apparmor_file_permission
0.11 ± 6% +0.1 0.18 ± 21% perf-profile.children.cycles-pp.rcu_eqs_enter
0.32 ± 6% +0.1 0.39 ± 11% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.11 ± 4% +0.1 0.19 ± 23% perf-profile.children.cycles-pp.account_entity_dequeue
0.00 +0.1 0.07 ± 43% perf-profile.children.cycles-pp.__update_idle_core
0.28 ± 3% +0.1 0.35 ± 6% perf-profile.children.cycles-pp.irq_exit
0.17 ± 4% +0.1 0.25 ± 24% perf-profile.children.cycles-pp.__fget_light
0.23 ± 3% +0.1 0.31 ± 20% perf-profile.children.cycles-pp.reweight_entity
0.19 ± 4% +0.1 0.27 ± 13% perf-profile.children.cycles-pp.pick_next_entity
0.23 ± 2% +0.1 0.30 ± 16% perf-profile.children.cycles-pp.check_preempt_curr
0.27 ± 4% +0.1 0.35 ± 14% perf-profile.children.cycles-pp.native_write_msr
0.11 ± 11% +0.1 0.19 ± 21% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.11 ± 3% +0.1 0.20 ± 25% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.38 +0.1 0.46 ± 9% perf-profile.children.cycles-pp.___might_sleep
0.19 ± 3% +0.1 0.28 ± 22% perf-profile.children.cycles-pp.__fdget_pos
0.13 ± 9% +0.1 0.22 ± 15% perf-profile.children.cycles-pp.clockevents_program_event
0.13 ± 6% +0.1 0.23 ± 25% perf-profile.children.cycles-pp.__might_sleep
0.53 ± 3% +0.1 0.63 ± 11% perf-profile.children.cycles-pp.update_rq_clock
0.19 ± 5% +0.1 0.29 ± 17% perf-profile.children.cycles-pp.read_tsc
0.26 ± 2% +0.1 0.36 ± 17% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.26 ± 3% +0.1 0.36 ± 22% perf-profile.children.cycles-pp.common_file_perm
0.18 ± 2% +0.1 0.28 ± 16% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.09 ± 8% +0.1 0.19 ± 28% perf-profile.children.cycles-pp.put_prev_task_fair
0.16 ± 4% +0.1 0.26 ± 32% perf-profile.children.cycles-pp.switch_fpu_return
0.16 ± 2% +0.1 0.28 ± 30% perf-profile.children.cycles-pp.___perf_sw_event
0.25 +0.1 0.38 ± 20% perf-profile.children.cycles-pp.native_sched_clock
0.19 ± 4% +0.1 0.32 ± 31% perf-profile.children.cycles-pp.orc_find
0.34 +0.1 0.47 ± 16% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.29 ± 2% +0.1 0.43 ± 21% perf-profile.children.cycles-pp.__orc_find
0.26 +0.1 0.40 ± 20% perf-profile.children.cycles-pp.sched_clock
0.24 ± 3% +0.1 0.38 ± 27% perf-profile.children.cycles-pp.finish_task_switch
0.23 ± 7% +0.1 0.37 ± 22% perf-profile.children.cycles-pp.kernel_text_address
0.28 ± 3% +0.1 0.42 ± 22% perf-profile.children.cycles-pp.__update_load_avg_se
0.74 +0.1 0.89 ± 6% perf-profile.children.cycles-pp.mutex_lock
0.23 +0.1 0.38 ± 26% perf-profile.children.cycles-pp.copy_page_from_iter
0.56 ± 5% +0.2 0.71 ± 11% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.28 +0.2 0.43 ± 21% perf-profile.children.cycles-pp.sched_clock_cpu
0.45 ± 3% +0.2 0.60 ± 13% perf-profile.children.cycles-pp.copy_page_to_iter
0.63 +0.2 0.79 ± 13% perf-profile.children.cycles-pp.prepare_to_wait_event
0.52 ± 4% +0.2 0.69 ± 19% perf-profile.children.cycles-pp.__switch_to
0.39 ± 2% +0.2 0.55 ± 18% perf-profile.children.cycles-pp.__switch_to_asm
0.35 ± 3% +0.2 0.52 ± 23% perf-profile.children.cycles-pp.security_file_permission
0.24 +0.2 0.41 ± 32% perf-profile.children.cycles-pp._find_next_bit
1.16 ± 5% +0.2 1.33 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt
0.35 ± 4% +0.2 0.53 ± 28% perf-profile.children.cycles-pp.update_cfs_group
0.28 ± 5% +0.2 0.45 ± 24% perf-profile.children.cycles-pp.__kernel_text_address
0.44 +0.2 0.65 ± 23% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
0.16 ± 2% +0.2 0.38 ± 51% perf-profile.children.cycles-pp.available_idle_cpu
0.33 ± 3% +0.2 0.55 ± 26% perf-profile.children.cycles-pp.unwind_get_return_address
0.43 ± 4% +0.2 0.67 ± 24% perf-profile.children.cycles-pp.__next_timer_interrupt
0.35 ± 4% +0.3 0.61 ± 13% perf-profile.children.cycles-pp.ktime_get
0.60 ± 2% +0.3 0.88 ± 16% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.40 ± 2% +0.3 0.69 ± 28% perf-profile.children.cycles-pp.__unwind_start
0.85 +0.3 1.17 ± 19% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.65 ± 3% +0.3 0.97 ± 22% perf-profile.children.cycles-pp.get_next_timer_interrupt
1.18 +0.3 1.50 ± 12% perf-profile.children.cycles-pp.set_next_entity
0.94 +0.3 1.28 ± 17% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.79 ± 3% +0.4 1.15 ± 21% perf-profile.children.cycles-pp.tick_nohz_next_event
1.03 ± 2% +0.4 1.45 ± 21% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.74 ± 2% +0.4 1.17 ± 24% perf-profile.children.cycles-pp.update_curr
0.59 ± 2% +0.5 1.13 ± 37% perf-profile.children.cycles-pp.select_task_rq_fair
1.77 +0.6 2.33 ± 13% perf-profile.children.cycles-pp.pick_next_task_fair
1.62 ± 3% +0.7 2.33 ± 21% perf-profile.children.cycles-pp.menu_select
1.73 +0.8 2.57 ± 22% perf-profile.children.cycles-pp.unwind_next_frame
1.52 ± 2% +0.9 2.44 ± 24% perf-profile.children.cycles-pp.update_load_avg
1.51 +0.9 2.46 ± 25% perf-profile.children.cycles-pp.dequeue_entity
1.46 ± 6% +1.1 2.59 ± 9% perf-profile.children.cycles-pp.read
1.76 +1.1 2.91 ± 25% perf-profile.children.cycles-pp.dequeue_task_fair
2.76 +1.4 4.17 ± 23% perf-profile.children.cycles-pp.arch_stack_walk
0.14 ± 5% +1.4 1.59 ± 85% perf-profile.children.cycles-pp.poll_idle
3.35 +1.5 4.84 ± 21% perf-profile.children.cycles-pp.stack_trace_save_tsk
2.80 +1.6 4.37 ± 28% perf-profile.children.cycles-pp.schedule_idle
0.55 ± 2% +1.8 2.33 ± 71% perf-profile.children.cycles-pp._raw_spin_lock
3.29 +2.0 5.28 ± 26% perf-profile.children.cycles-pp.schedule
5.81 +2.7 8.51 ± 21% perf-profile.children.cycles-pp.pipe_read
5.91 +2.8 8.68 ± 22% perf-profile.children.cycles-pp.new_sync_read
6.38 +3.0 9.40 ± 21% perf-profile.children.cycles-pp.vfs_read
6.56 +3.1 9.63 ± 21% perf-profile.children.cycles-pp.ksys_read
5.99 +3.5 9.51 ± 27% perf-profile.children.cycles-pp.__sched_text_start
30.51 -6.9 23.59 ± 19% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
39.93 -6.0 33.94 ± 13% perf-profile.self.cycles-pp.intel_idle
0.05 +0.0 0.07 ± 13% perf-profile.self.cycles-pp.tick_nohz_next_event
0.08 ± 5% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.check_preempt_curr
0.23 +0.0 0.26 ± 4% perf-profile.self.cycles-pp.nr_iowait_cpu
0.08 +0.0 0.11 ± 19% perf-profile.self.cycles-pp.in_sched_functions
0.06 ± 6% +0.0 0.09 ± 16% perf-profile.self.cycles-pp.schedule
0.05 +0.0 0.08 ± 20% perf-profile.self.cycles-pp.generic_pipe_buf_confirm
0.05 +0.0 0.08 ± 30% perf-profile.self.cycles-pp.__kernel_text_address
0.05 ± 8% +0.0 0.08 ± 27% perf-profile.self.cycles-pp.put_task_stack
0.12 ± 4% +0.0 0.16 ± 7% perf-profile.self.cycles-pp.cpus_share_cache
0.08 ± 5% +0.0 0.11 ± 23% perf-profile.self.cycles-pp.stack_access_ok
0.08 ± 5% +0.0 0.11 ± 17% perf-profile.self.cycles-pp.ksys_read
0.06 ± 11% +0.0 0.09 ± 23% perf-profile.self.cycles-pp.kernel_text_address
0.06 ± 6% +0.0 0.10 ± 21% perf-profile.self.cycles-pp.menu_reflect
0.04 ± 58% +0.0 0.08 ± 19% perf-profile.self.cycles-pp.copy_page_from_iter
0.20 ± 4% +0.0 0.24 ± 9% perf-profile.self.cycles-pp.newidle_balance
0.12 ± 6% +0.0 0.16 ± 14% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.05 ± 8% +0.0 0.10 ± 39% perf-profile.self.cycles-pp.unwind_get_return_address
0.10 ± 4% +0.0 0.15 ± 27% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.08 ± 8% +0.0 0.13 ± 24% perf-profile.self.cycles-pp.__fsnotify_parent
0.01 ±173% +0.0 0.06 ± 20% perf-profile.self.cycles-pp.security_file_permission
0.05 ± 9% +0.1 0.10 ± 35% perf-profile.self.cycles-pp.__x86_indirect_thunk_rbx
0.18 ± 2% +0.1 0.24 ± 15% perf-profile.self.cycles-pp.prepare_to_wait_event
0.04 ± 57% +0.1 0.09 ± 27% perf-profile.self.cycles-pp.put_prev_entity
0.09 ± 5% +0.1 0.14 ± 19% perf-profile.self.cycles-pp.copy_page_to_iter
0.05 ± 8% +0.1 0.11 ± 40% perf-profile.self.cycles-pp.pick_next_task_fair
0.01 ±173% +0.1 0.07 ± 19% perf-profile.self.cycles-pp.sched_ttwu_pending
0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.bpf_prog_kallsyms_find
0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.get_cpu_device
0.23 ± 3% +0.1 0.29 ± 14% perf-profile.self.cycles-pp.reweight_entity
0.20 ± 2% +0.1 0.25 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid
0.18 ± 3% +0.1 0.24 ± 9% perf-profile.self.cycles-pp.pick_next_entity
0.00 +0.1 0.06 ± 22% perf-profile.self.cycles-pp.activate_task
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.__is_insn_slot_addr
0.08 ± 8% +0.1 0.14 ± 32% perf-profile.self.cycles-pp.arch_stack_walk
0.00 +0.1 0.06 ± 28% perf-profile.self.cycles-pp.__x64_sys_write
0.23 +0.1 0.29 ± 10% perf-profile.self.cycles-pp.mutex_unlock
0.11 ± 7% +0.1 0.18 ± 25% perf-profile.self.cycles-pp.fsnotify
0.30 ± 2% +0.1 0.36 ± 16% perf-profile.self.cycles-pp.try_to_wake_up
0.11 ± 4% +0.1 0.17 ± 23% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.cpuidle_governor_latency_req
0.17 ± 2% +0.1 0.24 ± 24% perf-profile.self.cycles-pp.__unwind_start
0.14 ± 3% +0.1 0.21 ± 21% perf-profile.self.cycles-pp.resched_curr
0.09 ± 7% +0.1 0.15 ± 33% perf-profile.self.cycles-pp.new_sync_read
0.00 +0.1 0.07 ± 31% perf-profile.self.cycles-pp.timestamp_truncate
0.17 ± 2% +0.1 0.24 ± 17% perf-profile.self.cycles-pp.__account_scheduler_latency
0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.ksys_write
0.11 ± 6% +0.1 0.18 ± 24% perf-profile.self.cycles-pp.account_entity_dequeue
0.31 ± 6% +0.1 0.38 ± 11% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.00 +0.1 0.07 ± 39% perf-profile.self.cycles-pp.__update_idle_core
0.39 ± 4% +0.1 0.46 ± 8% perf-profile.self.cycles-pp.mutex_lock
0.17 ± 2% +0.1 0.24 ± 23% perf-profile.self.cycles-pp.__fget_light
0.11 ± 4% +0.1 0.18 ± 24% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.12 ± 10% +0.1 0.20 ± 25% perf-profile.self.cycles-pp.__might_sleep
0.08 ± 8% +0.1 0.16 ± 28% perf-profile.self.cycles-pp.dequeue_entity
0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.put_prev_task_fair
0.37 +0.1 0.46 ± 9% perf-profile.self.cycles-pp.___might_sleep
0.15 ± 3% +0.1 0.24 ± 17% perf-profile.self.cycles-pp.vfs_read
0.26 ± 4% +0.1 0.35 ± 14% perf-profile.self.cycles-pp.native_write_msr
0.23 ± 2% +0.1 0.31 ± 21% perf-profile.self.cycles-pp.common_file_perm
0.20 ± 2% +0.1 0.28 ± 24% perf-profile.self.cycles-pp.finish_task_switch
0.18 ± 4% +0.1 0.27 ± 16% perf-profile.self.cycles-pp.read_tsc
0.17 ± 8% +0.1 0.26 ± 22% perf-profile.self.cycles-pp.__next_timer_interrupt
0.15 ± 4% +0.1 0.25 ± 31% perf-profile.self.cycles-pp.switch_fpu_return
0.42 +0.1 0.53 ± 17% perf-profile.self.cycles-pp.do_idle
0.12 ± 4% +0.1 0.24 ± 31% perf-profile.self.cycles-pp.___perf_sw_event
0.38 ± 2% +0.1 0.49 ± 16% perf-profile.self.cycles-pp.pipe_read
0.27 ± 3% +0.1 0.39 ± 19% perf-profile.self.cycles-pp.enqueue_task_fair
0.18 ± 4% +0.1 0.31 ± 29% perf-profile.self.cycles-pp.orc_find
0.24 +0.1 0.37 ± 19% perf-profile.self.cycles-pp.native_sched_clock
0.28 ± 2% +0.1 0.41 ± 21% perf-profile.self.cycles-pp.__orc_find
0.30 +0.1 0.44 ± 24% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched
0.21 ± 2% +0.1 0.34 ± 22% perf-profile.self.cycles-pp.dequeue_task_fair
0.38 ± 3% +0.1 0.52 ± 17% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.27 ± 3% +0.1 0.41 ± 22% perf-profile.self.cycles-pp.__update_load_avg_se
0.48 ± 4% +0.2 0.64 ± 18% perf-profile.self.cycles-pp.__switch_to
0.74 +0.2 0.91 ± 11% perf-profile.self.cycles-pp.enqueue_entity
0.39 ± 2% +0.2 0.55 ± 19% perf-profile.self.cycles-pp.__switch_to_asm
0.23 +0.2 0.40 ± 32% perf-profile.self.cycles-pp._find_next_bit
0.16 ± 14% +0.2 0.34 ± 13% perf-profile.self.cycles-pp.ktime_get
0.37 ± 3% +0.2 0.55 ± 20% perf-profile.self.cycles-pp._raw_spin_lock
0.44 ± 6% +0.2 0.62 ± 22% perf-profile.self.cycles-pp.menu_select
0.28 ± 4% +0.2 0.46 ± 37% perf-profile.self.cycles-pp.update_cfs_group
0.16 ± 2% +0.2 0.37 ± 51% perf-profile.self.cycles-pp.available_idle_cpu
1.55 +0.2 1.76 ± 9% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.30 ± 3% +0.2 0.53 ± 28% perf-profile.self.cycles-pp.select_task_rq_fair
1.09 ± 2% +0.2 1.32 ± 15% perf-profile.self.cycles-pp.__sched_text_start
0.59 ± 3% +0.3 0.86 ± 17% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.83 +0.3 1.14 ± 19% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.94 ± 2% +0.3 1.27 ± 17% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.55 ± 2% +0.3 0.90 ± 24% perf-profile.self.cycles-pp.update_curr
0.62 ± 2% +0.4 1.07 ± 29% perf-profile.self.cycles-pp.update_load_avg
1.15 +0.5 1.68 ± 21% perf-profile.self.cycles-pp.unwind_next_frame
1.58 +0.8 2.35 ± 22% perf-profile.self.cycles-pp.do_syscall_64
0.09 ± 5% +1.4 1.50 ± 89% perf-profile.self.cycles-pp.poll_idle
***************************************************************************************************
lkp-hsw-d01: 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/target/tbox_group/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/50%/debian-x86_64-20191114.cgz/300s/vmlinux_prereq/lkp-hsw-d01/kbuild/0x27
commit:
9c40365a65 ("threads: Update PID limit comment according to futex UAPI change")
59901cb452 ("sched/fair: Don't pull task if local group is more loaded than busiest group")
9c40365a65d62d7c 59901cb4520c44bfce81f523bc6
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.BUG:Bad_page_map_in_process
1:4 -25% :4 dmesg.BUG:Bad_rss-counter_state_mm:#type:MM_ANONPAGES_val
1:4 -25% :4 dmesg.BUG:Bad_rss-counter_state_mm:#type:MM_SWAPENTS_val
:4 25% 1:4 dmesg.Kernel_panic-not_syncing:Fatal_exception
:4 25% 1:4 dmesg.RIP:__d_lookup_rcu
:4 25% 1:4 dmesg.canonical_address#:#[##]
1:4 -25% :4 kmsg.file:libuuid.so.#fault:filemap_fault_mmap:generic_file_mmap_readpage:simple_readpage
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a07fffffa0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a17fffffa1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a27fffffa2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a37fffffa3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a47fffffa4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a57fffffa5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a67fffffa6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a77fffffa7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a7fffff8aff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a7fffff9aff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a87fffffa8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#a97fffffa9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#aa7fffffaaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ab7fffffabff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ac7fffffacff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ad7fffffadff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ae7fffffaeff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#af7fffffafff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b07fffffb0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b17fffffb1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b27fffffb2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b37fffffb3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b47fffffb4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b57fffffb5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b67fffffb6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b77fffffb7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b7fffff8bff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b7fffff9bff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b87fffffb8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#b97fffffb9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ba7fffffbaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#bb7fffffbbff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#bc7fffffbcff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#bd7fffffbdff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#be7fffffbeff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#bf7fffffbfff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c07fffffc0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c17fffffc1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c27fffffc2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c37fffffc3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c47fffffc4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c57fffffc5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c67fffffc6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c77fffffc7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c7fffff8cff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c7fffff9cff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c87fffffc8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#c97fffffc9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ca7fffffcaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#cb7fffffcbff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#cc7fffffccff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#cd7fffffcdff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ce7fffffceff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#cf7fffffcfff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d07fffffd0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d17fffffd1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d27fffffd2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d37fffffd3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d47fffffd4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d57fffffd5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d67fffffd6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d77fffffd7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d7fffff8dff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d7fffff9dff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d87fffffd8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#d97fffffd9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#da7fffffdaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#db7fffffdbff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#dc7fffffdcff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#dd7fffffddff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#de7fffffdeff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#df7fffffdfff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e07fffffe0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e17fffffe1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e27fffffe2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e37fffffe3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e47fffffe4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e57fffffe5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e67fffffe6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e77fffffe7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e7fffff8eff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e7fffff9eff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e87fffffe8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#e97fffffe9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ea7fffffeaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#eb7fffffebff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ec7fffffecff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ed7fffffedff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ee7fffffeeff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ef7fffffefff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f07ffffff0ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f17ffffff1ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f27ffffff2ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f37ffffff3ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f47ffffff4ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f57ffffff5ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f67ffffff6ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f77ffffff7ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f7fffff8fff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f7fffff9fff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f87ffffff8ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#f97ffffff9ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fa7ffffffaff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fb7ffffffbff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fc7ffffffcff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fd7ffffffdff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fe7ffffffeff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#ff7fffffffff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff80ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff81ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff82ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff83ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff84ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff85ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff86ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff87ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff88ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff89ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff90ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff91ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff92ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff93ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff94ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff95ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff96ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff97ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff98ff
1:4 -25% :4 kmsg.swap_info_get:Bad_swap_file_entry#fffff99ff
0:4 0% 0:4 perf-profile.children.cycles-pp.warning_at
0:4 3% 0:4 perf-profile.children.cycles-pp.warning
0:4 4% 1:4 perf-profile.children.cycles-pp.error_entry
0:4 4% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
173.17 +7.5% 186.17 kbuild.buildtime_per_iteration
346.13 +7.5% 372.13 kbuild.time.elapsed_time
346.13 +7.5% 372.13 kbuild.time.elapsed_time.max
62328 -4.4% 59613 kbuild.time.involuntary_context_switches
119.99 +3.7% 124.42 kbuild.time.system_time
1258 +7.8% 1357 kbuild.time.user_time
3976 ± 2% -5.2% 3768 ± 2% proc-vmstat.pgactivate
8581 -7.6% 7925 vmstat.system.cs
29.08 ± 6% +27.4% 37.06 ± 21% boot-time.boot
190.33 ± 5% +31.2% 249.80 ± 20% boot-time.idle
2.474e+08 ± 62% +85.2% 4.58e+08 ± 21% cpuidle.C6.time
361421 ± 60% +70.5% 616268 ± 5% cpuidle.C6.usage
2265 ± 6% -16.4% 1895 ± 10% slabinfo.cred_jar.active_objs
2301 ± 5% -15.3% 1950 ± 9% slabinfo.cred_jar.num_objs
793.33 +14.3% 907.00 ± 4% slabinfo.task_delay_info.active_objs
793.33 +14.3% 907.00 ± 4% slabinfo.task_delay_info.num_objs
249422 +10.7% 276098 ± 4% softirqs.CPU0.RCU
138168 +30.3% 180101 ± 12% softirqs.CPU0.TIMER
139666 +9.2% 152539 ± 2% softirqs.CPU2.TIMER
138194 ± 2% +11.1% 153534 ± 2% softirqs.CPU4.TIMER
139323 ± 2% +11.9% 155966 softirqs.CPU7.TIMER
1153221 +10.4% 1273097 softirqs.TIMER
267.67 ± 15% -37.9% 166.33 ± 9% interrupts.CPU0.CAL:Function_call_interrupts
3697 ± 14% -17.8% 3040 ± 9% interrupts.CPU0.RES:Rescheduling_interrupts
245.00 ± 19% -48.6% 126.00 ± 8% interrupts.CPU0.TLB:TLB_shootdowns
188.67 ± 19% -39.2% 114.67 ± 22% interrupts.CPU1.TLB:TLB_shootdowns
292.33 ± 9% -13.1% 254.00 ± 12% interrupts.CPU2.CAL:Function_call_interrupts
241.67 ± 23% -31.6% 165.33 ± 7% interrupts.CPU2.TLB:TLB_shootdowns
7195 ± 19% -37.5% 4497 ± 29% interrupts.CPU4.NMI:Non-maskable_interrupts
7195 ± 19% -37.5% 4497 ± 29% interrupts.CPU4.PMI:Performance_monitoring_interrupts
1361 ± 5% -16.8% 1132 ± 10% interrupts.TLB:TLB_shootdowns
0.00 +1.4e+11% 1382 ±114% sched_debug.cfs_rq:/.MIN_vruntime.avg
0.00 +1.1e+12% 11058 ±114% sched_debug.cfs_rq:/.MIN_vruntime.max
77852 +20.1% 93480 sched_debug.cfs_rq:/.exec_clock.avg
82443 +20.3% 99210 sched_debug.cfs_rq:/.exec_clock.max
72993 +18.4% 86426 sched_debug.cfs_rq:/.exec_clock.min
2882 ± 6% +33.9% 3858 ± 9% sched_debug.cfs_rq:/.exec_clock.stddev
119503 ± 2% +20.2% 143687 ± 8% sched_debug.cfs_rq:/.load.avg
0.00 +1.4e+11% 1382 ±114% sched_debug.cfs_rq:/.max_vruntime.avg
0.00 +1.1e+12% 11058 ±114% sched_debug.cfs_rq:/.max_vruntime.max
463036 +18.8% 549986 sched_debug.cfs_rq:/.min_vruntime.avg
489987 +18.7% 581626 sched_debug.cfs_rq:/.min_vruntime.max
434924 +17.3% 510306 sched_debug.cfs_rq:/.min_vruntime.min
17242 +24.4% 21446 ± 6% sched_debug.cfs_rq:/.min_vruntime.stddev
0.68 ± 6% +18.1% 0.80 ± 3% sched_debug.cfs_rq:/.nr_running.avg
0.44 ± 3% -18.2% 0.36 ± 5% sched_debug.cfs_rq:/.nr_running.stddev
17242 +24.4% 21446 ± 6% sched_debug.cfs_rq:/.spread0.stddev
180483 +21.0% 218362 ± 3% sched_debug.cpu.clock.avg
180483 +21.0% 218363 ± 3% sched_debug.cpu.clock.max
180482 +21.0% 218361 ± 3% sched_debug.cpu.clock.min
180483 +21.0% 218362 ± 3% sched_debug.cpu.clock_task.avg
180483 +21.0% 218363 ± 3% sched_debug.cpu.clock_task.max
180482 +21.0% 218361 ± 3% sched_debug.cpu.clock_task.min
9075 ± 6% +37.6% 12486 sched_debug.cpu.curr->pid.avg
13910 +37.2% 19088 sched_debug.cpu.curr->pid.max
6416 ± 2% +37.6% 8831 sched_debug.cpu.curr->pid.stddev
1.83 ± 19% -24.7% 1.38 ± 12% sched_debug.cpu.nr_running.max
0.66 ± 18% -30.6% 0.46 ± 4% sched_debug.cpu.nr_running.stddev
22.33 ± 28% -53.9% 10.29 ± 11% sched_debug.cpu.nr_uninterruptible.max
10.96 ± 9% -35.3% 7.10 ± 7% sched_debug.cpu.nr_uninterruptible.stddev
180482 +21.0% 218362 ± 3% sched_debug.cpu_clk
179957 +21.0% 217836 ± 3% sched_debug.ktime
181437 +20.8% 219109 ± 3% sched_debug.sched_clk
13.61 +6.4% 14.47 perf-stat.i.MPKI
3.762e+09 -7.5% 3.478e+09 perf-stat.i.branch-instructions
3.00 +0.1 3.08 perf-stat.i.branch-miss-rate%
1.126e+08 -5.5% 1.064e+08 perf-stat.i.branch-misses
8.73 -0.6 8.17 ± 2% perf-stat.i.cache-miss-rate%
20492578 -10.3% 18373371 perf-stat.i.cache-misses
2.365e+08 -2.6% 2.303e+08 perf-stat.i.cache-references
8639 -7.7% 7977 perf-stat.i.context-switches
0.92 +9.1% 1.00 ± 2% perf-stat.i.cpi
1.582e+10 -1.2% 1.562e+10 perf-stat.i.cpu-cycles
182.40 -11.9% 160.76 perf-stat.i.cpu-migrations
799.50 +9.7% 877.23 perf-stat.i.cycles-between-cache-misses
0.31 +0.0 0.33 perf-stat.i.dTLB-load-miss-rate%
14810335 -4.5% 14149852 perf-stat.i.dTLB-load-misses
4.694e+09 -7.5% 4.341e+09 perf-stat.i.dTLB-loads
2.55e+09 -7.0% 2.373e+09 perf-stat.i.dTLB-stores
4617509 +8.3% 4998953 ± 2% perf-stat.i.iTLB-load-misses
17720319 +7.6% 19060873 perf-stat.i.iTLB-loads
1.731e+10 -7.5% 1.601e+10 perf-stat.i.instructions
3841 -13.1% 3339 ± 2% perf-stat.i.instructions-per-iTLB-miss
1.09 -6.6% 1.02 perf-stat.i.ipc
164253 -7.3% 152206 perf-stat.i.minor-faults
13452948 -11.3% 11934691 perf-stat.i.node-loads
1875909 ± 3% -11.5% 1659475 ± 3% perf-stat.i.node-stores
164253 -7.3% 152206 perf-stat.i.page-faults
13.66 +5.3% 14.38 perf-stat.overall.MPKI
2.99 +0.1 3.06 perf-stat.overall.branch-miss-rate%
8.67 -0.7 7.98 perf-stat.overall.cache-miss-rate%
0.91 +6.8% 0.98 perf-stat.overall.cpi
771.90 +10.2% 850.28 perf-stat.overall.cycles-between-cache-misses
0.31 +0.0 0.32 perf-stat.overall.dTLB-load-miss-rate%
3749 -14.5% 3205 ± 3% perf-stat.overall.instructions-per-iTLB-miss
1.09 -6.4% 1.02 perf-stat.overall.ipc
3.751e+09 -7.5% 3.469e+09 perf-stat.ps.branch-instructions
1.123e+08 -5.5% 1.062e+08 perf-stat.ps.branch-misses
20432412 -10.3% 18323590 perf-stat.ps.cache-misses
2.358e+08 -2.6% 2.297e+08 perf-stat.ps.cache-references
8613 -7.6% 7955 perf-stat.ps.context-switches
1.577e+10 -1.2% 1.558e+10 perf-stat.ps.cpu-cycles
181.89 -11.9% 160.32 perf-stat.ps.cpu-migrations
14766724 -4.4% 14111258 perf-stat.ps.dTLB-load-misses
4.68e+09 -7.5% 4.33e+09 perf-stat.ps.dTLB-loads
2.543e+09 -6.9% 2.366e+09 perf-stat.ps.dTLB-stores
4603933 +8.3% 4985424 ± 2% perf-stat.ps.iTLB-load-misses
17668225 +7.6% 19009302 perf-stat.ps.iTLB-loads
1.726e+10 -7.5% 1.597e+10 perf-stat.ps.instructions
163774 -7.3% 151790 perf-stat.ps.minor-faults
13413384 -11.3% 11902353 perf-stat.ps.node-loads
1870377 ± 3% -11.5% 1654965 ± 3% perf-stat.ps.node-stores
163774 -7.3% 151790 perf-stat.ps.page-faults
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.write._fini
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp._fini
4.07 ± 13% -1.8 2.30 ± 21% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.new_sync_write
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write._fini
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write._fini
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.new_sync_write.vfs_write
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write._fini
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.devkmsg_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.new_sync_write.vfs_write.ksys_write
3.46 ± 14% -1.4 2.03 ± 21% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write
3.27 ± 13% -1.4 1.90 ± 20% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit
3.20 ± 14% -1.1 2.08 ± 29% perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
3.20 ± 14% -1.1 2.08 ± 29% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
2.16 ± 14% -0.9 1.27 ± 18% perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
1.02 ± 14% -0.6 0.45 ± 72% perf-profile.calltrace.cycles-pp.delay_tsc.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write
1.24 ± 2% -0.3 0.95 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
1.24 ± 2% -0.3 0.95 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.56 ± 3% -0.2 0.36 ± 70% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.80 ± 8% -0.2 0.63 ± 3% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.80 ± 8% -0.2 0.63 ± 3% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
0.79 ± 3% -0.1 0.71 ± 6% perf-profile.calltrace.cycles-pp.read
0.73 ± 3% -0.1 0.65 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
0.73 ± 3% -0.1 0.65 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.63 ± 4% -0.1 0.56 ± 6% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.98 ± 3% -0.1 0.91 ± 6% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.65 ± 4% -0.1 0.58 ± 4% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.58 ± 2% +0.1 0.67 ± 7% perf-profile.calltrace.cycles-pp.wide_int_to_tree
0.66 ± 11% +0.1 0.78 ± 11% perf-profile.calltrace.cycles-pp.c_lex_with_flags
0.65 ± 6% +0.2 0.81 ± 7% perf-profile.calltrace.cycles-pp.linemap_lookup
0.34 ± 70% +0.2 0.54 ± 2% perf-profile.calltrace.cycles-pp.pop_scope
2.11 ± 5% +0.2 2.36 ± 3% perf-profile.calltrace.cycles-pp._cpp_lex_direct
1.14 ± 2% +0.3 1.44 ± 11% perf-profile.calltrace.cycles-pp.memchr
8.11 ± 5% -2.4 5.75 ± 11% perf-profile.children.cycles-pp.do_syscall_64
8.13 ± 5% -2.4 5.77 ± 11% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
4.19 ± 12% -1.8 2.36 ± 20% perf-profile.children.cycles-pp.ksys_write
4.21 ± 12% -1.8 2.38 ± 20% perf-profile.children.cycles-pp.write
4.18 ± 12% -1.8 2.36 ± 20% perf-profile.children.cycles-pp.vfs_write
4.17 ± 13% -1.8 2.36 ± 20% perf-profile.children.cycles-pp.new_sync_write
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.children.cycles-pp._fini
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.children.cycles-pp.devkmsg_write
4.07 ± 13% -1.8 2.30 ± 20% perf-profile.children.cycles-pp.devkmsg_emit
4.65 ± 13% -1.5 3.13 ± 20% perf-profile.children.cycles-pp.vprintk_emit
4.73 ± 14% -1.5 3.25 ± 16% perf-profile.children.cycles-pp.console_unlock
4.09 ± 15% -1.2 2.94 ± 16% perf-profile.children.cycles-pp.serial8250_console_write
3.99 ± 15% -1.1 2.88 ± 16% perf-profile.children.cycles-pp.wait_for_xmitr
3.89 ± 15% -1.1 2.80 ± 16% perf-profile.children.cycles-pp.uart_console_write
3.80 ± 15% -1.0 2.75 ± 15% perf-profile.children.cycles-pp.serial8250_console_putchar
2.71 ± 15% -0.8 1.94 ± 15% perf-profile.children.cycles-pp.io_serial_in
1.27 ± 15% -0.3 0.94 ± 18% perf-profile.children.cycles-pp.delay_tsc
0.63 ± 7% -0.3 0.31 ± 18% perf-profile.children.cycles-pp.vt_console_print
0.62 ± 9% -0.3 0.31 ± 18% perf-profile.children.cycles-pp.lf
0.62 ± 9% -0.3 0.31 ± 18% perf-profile.children.cycles-pp.con_scroll
0.62 ± 9% -0.3 0.31 ± 18% perf-profile.children.cycles-pp.fbcon_scroll
0.61 ± 8% -0.3 0.30 ± 17% perf-profile.children.cycles-pp.fbcon_redraw
0.59 ± 7% -0.3 0.29 ± 18% perf-profile.children.cycles-pp.fbcon_putcs
0.59 ± 7% -0.3 0.29 ± 18% perf-profile.children.cycles-pp.bit_putcs
0.50 ± 4% -0.3 0.24 ± 22% perf-profile.children.cycles-pp.drm_fb_helper_cfb_imageblit
0.49 ± 3% -0.2 0.24 ± 22% perf-profile.children.cycles-pp.cfb_imageblit
0.86 ± 7% -0.2 0.66 ± 3% perf-profile.children.cycles-pp.mmput
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.children.cycles-pp.do_group_exit
0.84 ± 8% -0.2 0.66 ± 3% perf-profile.children.cycles-pp.do_exit
0.85 ± 7% -0.2 0.66 ± 3% perf-profile.children.cycles-pp.exit_mmap
0.62 ± 6% -0.2 0.47 ± 3% perf-profile.children.cycles-pp.unmap_vmas
0.61 ± 7% -0.1 0.47 ± 3% perf-profile.children.cycles-pp.unmap_page_range
0.52 ± 11% -0.1 0.41 ± 7% perf-profile.children.cycles-pp.tlb_flush_mmu
0.84 ± 3% -0.1 0.73 ± 6% perf-profile.children.cycles-pp.read
0.92 ± 7% -0.1 0.82 ± 5% perf-profile.children.cycles-pp.do_sys_open
0.70 ± 5% -0.1 0.61 ± 4% perf-profile.children.cycles-pp.ksys_read
0.90 ± 7% -0.1 0.81 ± 5% perf-profile.children.cycles-pp.do_sys_openat2
0.69 ± 7% -0.1 0.59 ± 5% perf-profile.children.cycles-pp.vfs_read
1.25 -0.1 1.16 ± 4% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.49 ± 9% -0.1 0.41 ± 7% perf-profile.children.cycles-pp.release_pages
0.45 -0.1 0.37 ± 11% perf-profile.children.cycles-pp.bitmap_clear_bit
0.22 ± 9% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.execve
0.24 ± 5% -0.1 0.17 ± 12% perf-profile.children.cycles-pp.__x64_sys_execve
0.24 ± 5% -0.1 0.17 ± 12% perf-profile.children.cycles-pp.__do_execve_file
0.20 ± 8% -0.1 0.13 ± 24% perf-profile.children.cycles-pp.statistics_fini_pass
0.10 ± 16% -0.1 0.04 ± 70% perf-profile.children.cycles-pp.__libc_fork
0.20 ± 8% -0.1 0.14 ± 17% perf-profile.children.cycles-pp.filemap_map_pages
0.32 ± 7% -0.1 0.26 ± 9% perf-profile.children.cycles-pp.__list_del_entry_valid
0.29 ± 9% -0.1 0.24 ± 5% perf-profile.children.cycles-pp.irq_exit
0.27 ± 7% -0.1 0.21 ± 17% perf-profile.children.cycles-pp.bitmap_bit_p
0.12 ± 6% -0.1 0.07 ± 25% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.20 ± 8% -0.0 0.16 ± 13% perf-profile.children.cycles-pp.side_effects_p
0.12 ± 25% -0.0 0.08 ± 30% perf-profile.children.cycles-pp.alloc_empty_file
0.09 ± 13% -0.0 0.05 ± 72% perf-profile.children.cycles-pp.io_serial_out
0.17 ± 10% -0.0 0.13 ± 9% perf-profile.children.cycles-pp.note_stores
0.18 ± 10% -0.0 0.13 ± 16% perf-profile.children.cycles-pp.bitmap_copy
0.14 ± 8% -0.0 0.10 ± 24% perf-profile.children.cycles-pp.kmem_cache_alloc
0.24 ± 7% -0.0 0.19 ± 14% perf-profile.children.cycles-pp.rcu_core
0.14 ± 14% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.load_elf_binary
0.09 ± 24% -0.0 0.05 ± 78% perf-profile.children.cycles-pp.copy_page
0.25 ± 5% -0.0 0.20 ± 6% perf-profile.children.cycles-pp.init_alias_analysis
0.12 ± 14% -0.0 0.07 ± 28% perf-profile.children.cycles-pp.find_unreachable_blocks
0.16 ± 10% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.14 ± 14% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.search_binary_handler
0.11 ± 25% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.ret_from_fork
0.11 ± 27% -0.0 0.07 ± 35% perf-profile.children.cycles-pp.__alloc_file
0.09 ± 14% -0.0 0.05 ± 72% perf-profile.children.cycles-pp.lra_inheritance
0.09 ± 5% -0.0 0.05 ± 72% perf-profile.children.cycles-pp.page_remove_rmap
0.19 ± 11% -0.0 0.15 ± 16% perf-profile.children.cycles-pp.get_attribute_name
0.12 ± 10% -0.0 0.08 ± 32% perf-profile.children.cycles-pp.for_each_inc_dec
0.15 ± 8% -0.0 0.11 ± 22% perf-profile.children.cycles-pp.update_stmt_operands
0.07 ± 6% -0.0 0.04 ± 71% perf-profile.children.cycles-pp.wrapup_global_declaration_2
0.18 ± 9% -0.0 0.15 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.12 ± 14% -0.0 0.08 ± 20% perf-profile.children.cycles-pp.gimple_simplify
0.10 ± 25% -0.0 0.06 ± 19% perf-profile.children.cycles-pp.kthread
0.16 ± 10% -0.0 0.13 ± 10% perf-profile.children.cycles-pp.free_pcppages_bulk
0.17 ± 9% -0.0 0.14 ± 17% perf-profile.children.cycles-pp.walk_stmt_load_store_addr_ops
0.11 ± 7% -0.0 0.08 ± 22% perf-profile.children.cycles-pp.execute_update_addresses_taken
0.09 ± 14% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.bitmap_and
0.08 ± 5% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.alloc_set_pte
0.10 ± 14% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.et_set_father
0.12 ± 7% -0.0 0.10 ± 14% perf-profile.children.cycles-pp.hash_rtx_cb
0.09 ± 15% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__do_munmap
0.13 ± 6% -0.0 0.11 ± 11% perf-profile.children.cycles-pp.is_gimple_reg
0.09 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.find_get_entry
0.10 ± 8% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.pagecache_get_page
0.10 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.substitute_and_fold_dom_walker::before_dom_children
0.09 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.realloc
0.09 ± 10% +0.0 0.11 ± 12% perf-profile.children.cycles-pp.rtx_equal_p
0.07 ± 6% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.c_fully_fold
0.05 ± 8% +0.0 0.08 ± 12% perf-profile.children.cycles-pp._cond_resched
0.09 ± 5% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.build_unary_op
0.04 ± 71% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.cpp_interpret_integer
0.13 ± 6% +0.0 0.16 ± 5% perf-profile.children.cycles-pp.declspecs_add_type
0.10 ± 17% +0.0 0.13 ± 6% perf-profile.children.cycles-pp.task_work_run
0.09 ± 9% +0.0 0.12 ± 13% perf-profile.children.cycles-pp.pushdecl
0.08 ± 16% +0.0 0.11 ± 12% perf-profile.children.cycles-pp.force_fit_type
0.04 ± 73% +0.0 0.07 ± 12% perf-profile.children.cycles-pp.__fput
0.09 ± 13% +0.0 0.13 ± 13% perf-profile.children.cycles-pp.is_typedef_decl
0.11 ± 14% +0.0 0.15 ± 11% perf-profile.children.cycles-pp.convert
0.03 ± 70% +0.0 0.07 ± 20% perf-profile.children.cycles-pp.__mod_node_page_state
0.03 ± 70% +0.0 0.07 perf-profile.children.cycles-pp.do_dentry_open
0.04 ± 73% +0.0 0.08 ± 16% perf-profile.children.cycles-pp.page_add_new_anon_rmap
0.04 ± 70% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.start_function
0.16 ± 11% +0.0 0.21 ± 6% perf-profile.children.cycles-pp.decl_attributes
0.04 ± 71% +0.0 0.08 perf-profile.children.cycles-pp.alloc_stmt_list
0.02 ±141% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.tree_int_cst_sgn
0.02 ±141% +0.0 0.06 ± 13% perf-profile.children.cycles-pp.gimple_call_flags
0.02 ±141% +0.0 0.06 ± 13% perf-profile.children.cycles-pp.build_asm_expr
0.08 ± 11% +0.0 0.13 ± 12% perf-profile.children.cycles-pp.wi::divmod_internal
0.49 ± 4% +0.0 0.54 ± 2% perf-profile.children.cycles-pp.pop_scope
0.03 ± 70% +0.1 0.09 ± 19% perf-profile.children.cycles-pp.pop_stmt_list
0.10 ± 4% +0.1 0.16 ± 10% perf-profile.children.cycles-pp.get_range_from_loc
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.build_component_ref
0.16 ± 10% +0.1 0.23 ± 6% perf-profile.children.cycles-pp.build_null_declspecs
0.00 +0.1 0.07 ± 35% perf-profile.children.cycles-pp.vma_merge
0.34 ± 13% +0.1 0.41 ± 6% perf-profile.children.cycles-pp.fold_binary_loc
0.59 ± 3% +0.1 0.69 ± 7% perf-profile.children.cycles-pp.wide_int_to_tree
0.17 ± 14% +0.1 0.28 ± 12% perf-profile.children.cycles-pp.linemap_add_macro_token
0.72 ± 10% +0.1 0.85 ± 11% perf-profile.children.cycles-pp.c_lex_with_flags
0.58 ± 5% +0.2 0.74 ± 16% perf-profile.children.cycles-pp.htab_find_slot_with_hash
0.76 ± 4% +0.2 0.96 ± 10% perf-profile.children.cycles-pp.linemap_lookup
0.58 ± 11% +0.2 0.83 ± 22% perf-profile.children.cycles-pp.irq_work_interrupt
0.58 ± 11% +0.2 0.83 ± 22% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.58 ± 11% +0.2 0.83 ± 22% perf-profile.children.cycles-pp.irq_work_run
0.58 ± 11% +0.2 0.83 ± 22% perf-profile.children.cycles-pp.printk
2.21 ± 5% +0.3 2.47 ± 3% perf-profile.children.cycles-pp._cpp_lex_direct
1.16 ± 3% +0.3 1.46 ± 12% perf-profile.children.cycles-pp.memchr
0.66 ± 26% +0.3 0.97 ± 9% perf-profile.children.cycles-pp.irq_work_run_list
2.71 ± 15% -0.8 1.94 ± 15% perf-profile.self.cycles-pp.io_serial_in
1.27 ± 15% -0.3 0.94 ± 18% perf-profile.self.cycles-pp.delay_tsc
0.49 ± 3% -0.2 0.24 ± 22% perf-profile.self.cycles-pp.cfb_imageblit
0.43 ± 3% -0.1 0.35 ± 12% perf-profile.self.cycles-pp.bitmap_clear_bit
0.20 ± 8% -0.1 0.13 ± 24% perf-profile.self.cycles-pp.statistics_fini_pass
0.22 ± 5% -0.1 0.16 ± 8% perf-profile.self.cycles-pp.unmap_page_range
0.32 ± 7% -0.1 0.26 ± 11% perf-profile.self.cycles-pp.__list_del_entry_valid
0.26 ± 8% -0.1 0.21 ± 19% perf-profile.self.cycles-pp.bitmap_bit_p
0.09 ± 18% -0.1 0.04 ± 73% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.18 ± 10% -0.1 0.12 ± 19% perf-profile.self.cycles-pp.bitmap_copy
0.20 ± 8% -0.1 0.15 ± 13% perf-profile.self.cycles-pp.side_effects_p
0.09 ± 13% -0.0 0.05 ± 72% perf-profile.self.cycles-pp.io_serial_out
0.17 ± 5% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.note_stores
0.16 ± 10% -0.0 0.12 ± 10% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.09 ± 24% -0.0 0.05 ± 78% perf-profile.self.cycles-pp.copy_page
0.17 ± 9% -0.0 0.13 ± 9% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.18 ± 12% -0.0 0.14 ± 9% perf-profile.self.cycles-pp.get_attribute_name
0.09 ± 14% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.lra_inheritance
0.24 ± 5% -0.0 0.20 ± 8% perf-profile.self.cycles-pp.init_alias_analysis
0.11 ± 18% -0.0 0.07 ± 28% perf-profile.self.cycles-pp.find_unreachable_blocks
0.12 ± 10% -0.0 0.08 ± 32% perf-profile.self.cycles-pp.for_each_inc_dec
0.07 ± 6% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.wrapup_global_declaration_2
0.13 ± 12% -0.0 0.10 ± 14% perf-profile.self.cycles-pp.free_pcppages_bulk
0.09 ± 14% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.bitmap_and
0.07 ± 7% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.page_remove_rmap
0.10 ± 8% -0.0 0.07 ± 23% perf-profile.self.cycles-pp.update_stmt_operands
0.12 ± 7% -0.0 0.10 ± 14% perf-profile.self.cycles-pp.hash_rtx_cb
0.10 ± 9% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.et_set_father
0.10 ± 4% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.substitute_and_fold_dom_walker::before_dom_children
0.08 +0.0 0.09 perf-profile.self.cycles-pp.realloc
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.htab_traverse
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.build_unary_op
0.08 ± 5% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.rtx_equal_p
0.07 ± 11% +0.0 0.10 ± 9% perf-profile.self.cycles-pp.force_fit_type
0.07 ± 7% +0.0 0.09 ± 10% perf-profile.self.cycles-pp.c_fully_fold
0.13 ± 6% +0.0 0.16 ± 5% perf-profile.self.cycles-pp.declspecs_add_type
0.10 ± 12% +0.0 0.13 ± 6% perf-profile.self.cycles-pp.convert
0.08 ± 10% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.pushdecl
0.04 ± 71% +0.0 0.07 ± 11% perf-profile.self.cycles-pp.start_function
0.15 ± 11% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.decl_attributes
0.03 ± 70% +0.0 0.07 ± 11% perf-profile.self.cycles-pp.malloc@plt
0.09 ± 10% +0.0 0.13 ± 13% perf-profile.self.cycles-pp.is_typedef_decl
0.04 ± 71% +0.0 0.08 perf-profile.self.cycles-pp.alloc_stmt_list
0.02 ±141% +0.0 0.06 ± 13% perf-profile.self.cycles-pp.mark_irreducible_loops
0.08 ± 17% +0.1 0.13 ± 12% perf-profile.self.cycles-pp.wi::divmod_internal
0.02 ±141% +0.1 0.07 ± 25% perf-profile.self.cycles-pp.__mod_node_page_state
0.49 ± 3% +0.1 0.54 ± 2% perf-profile.self.cycles-pp.pop_scope
0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.build_component_ref
0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.gimple_call_flags
0.09 ± 5% +0.1 0.15 ± 12% perf-profile.self.cycles-pp.get_range_from_loc
0.02 ±141% +0.1 0.08 ± 12% perf-profile.self.cycles-pp.pop_stmt_list
0.16 ± 10% +0.1 0.23 ± 4% perf-profile.self.cycles-pp.build_null_declspecs
0.29 ± 9% +0.1 0.35 ± 9% perf-profile.self.cycles-pp.fold_binary_loc
0.13 ± 6% +0.1 0.20 ± 2% perf-profile.self.cycles-pp.linemap_add_macro_token
0.57 ± 4% +0.1 0.67 ± 8% perf-profile.self.cycles-pp.wide_int_to_tree
0.70 ± 3% +0.2 0.89 ± 10% perf-profile.self.cycles-pp.linemap_lookup
2.14 ± 6% +0.2 2.39 ± 3% perf-profile.self.cycles-pp._cpp_lex_direct
1.12 ± 2% +0.3 1.40 ± 12% perf-profile.self.cycles-pp.memchr
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
[tracing] ff895103a8: BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: ff895103a84abc85a5f43ecabc7f67cf36e1348f ("tracing: Save off entry when peeking at next entry")
https://git.kernel.org/cgit/linux/kernel/git/rostedt/linux-trace.git ftrace/core
in testcase: rcuperf
with following parameters:
runtime: 300s
perf_type: srcud
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------------+------------+------------+
| | 8c77f0ba41 | ff895103a8 |
+----------------------------------------------------------------+------------+------------+
| boot_successes | 4 | 4 |
| boot_failures | 0 | 4 |
| BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h | 0 | 4 |
+----------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 19.755781] BUG: sleeping function called from invalid context at mm/slab.h:565
[ 19.757001] in_atomic(): 0, irqs_disabled(): 1, non_block: 0, pid: 597, name: rcu_perf_writer
[ 19.758163] no locks held by rcu_perf_writer/597.
[ 19.758798] CPU: 1 PID: 597 Comm: rcu_perf_writer Tainted: G T 5.6.0-rc4-00008-gff895103a84ab #2
[ 19.760123] Call Trace:
[ 19.760473] ? dump_stack+0x6b/0xa1
[ 19.760955] ? ___might_sleep+0x146/0x170
[ 19.761507] ? __kmalloc+0x73/0x300
[ 19.762010] ? trace_find_next_entry+0x5c/0x120
[ 19.762626] ? trace_find_next_entry+0x5c/0x120
[ 19.763243] ? trace_print_lat_context+0x29/0x3b0
[ 19.763885] ? find_next_bit+0x29/0x40
[ 19.764398] ? __find_next_entry+0x10d/0x170
[ 19.764979] ? print_trace_line+0x475/0x570
[ 19.765551] ? ftrace_dump+0x173/0x250
[ 19.766027] ? rcu_perf_writer+0x345/0x480 [rcuperf]
[ 19.766457] ? kthread+0xf7/0x100
[ 19.766747] ? rcu_perf_wait_shutdown+0x60/0x60 [rcuperf]
[ 19.767208] ? kthread_stop+0x210/0x210
[ 19.767542] ? ret_from_fork+0x1e/0x28
[ 19.767883] rb_produ-167 1.... 1976130us : ring_buffer_producer_thread: Starting ring buffer hammer
[ 19.768684] rb_produ-167 0.... 11977103us : ring_buffer_producer_thread: End ring buffer hammer
[ 19.769457] rb_produ-167 0.... 12023757us : ring_buffer_producer_thread: Running Consumer at nice: 19
[ 19.770282] rb_produ-167 0.... 12023758us : ring_buffer_producer_thread: Running Producer at nice: 19
[ 19.771094] rb_produ-167 0.... 12023758us : ring_buffer_producer_thread: WARNING!!! This test is running at lowest priority.
[ 19.772075] rb_produ-167 0.... 12023758us : ring_buffer_producer_thread: Time: 10000957 (usecs)
[ 19.772874] rb_produ-167 0.... 12023759us : ring_buffer_producer_thread: Overruns: 34670819
[ 19.773620] rb_produ-167 0.... 12023759us : ring_buffer_producer_thread: Read: 7743031 (by events)
[ 19.774451] rb_produ-167 0.... 12023760us : ring_buffer_producer_thread: Entries: 0
[ 19.775140] rb_produ-167 0.... 12023760us : ring_buffer_producer_thread: Total: 42413850
[ 19.775878] rb_produ-167 0.... 12023760us : ring_buffer_producer_thread: Missed: 0
[ 19.776576] rb_produ-167 0.... 12023760us : ring_buffer_producer_thread: Hit: 42413850
[ 19.777313] rb_produ-167 0.... 12023760us : ring_buffer_producer_thread: Entries per millisec: 4241
[ 19.778118] rb_produ-167 0.... 12023761us : ring_buffer_producer_thread: 235 ns per entry
[ 19.778849] rb_produ-167 0.... 12023761us : ring_buffer_producer_thread: Sleeping for 10 secs
[ 19.779600] ---------------------------------
[ 19.791139] random: fast init done
[ 19.791524] srcud-perf: Test complete
Elapsed time: 60
qemu-img create -f qcow2 disk-vm-snb-i386-37-0 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-1 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-2 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-3 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-4 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-5 256G
qemu-img create -f qcow2 disk-vm-snb-i386-37-6 256G
kvm=(
qemu-system-i386
-enable-kvm
-cpu SandyBridge
-kernel $kernel
-initrd initrd-vm-snb-i386-37.cgz
-m 8192
-smp 2
-device e1000,netdev=net0
-netdev user,id=net0,hostfwd=tcp::32032-:22
-boot order=nc
-no-reboot
-watchdog i6300esb
-watchdog-action debug
-rtc base=localtime
-drive file=disk-vm-snb-i386-37-0,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-1,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-2,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-3,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-4,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-5,media=disk,if=virtio
-drive file=disk-vm-snb-i386-37-6,media=disk,if=virtio
-serial stdio
-display none
-monitor null
)
append=(
ip=::::vm-snb-i386-37::dhcp
root=/dev/ram0
user=lkp
job=/job-script
ARCH=i386
kconfig=i386-randconfig-b003-20200324
branch=linux-devel/devel-hourly-2020032506
commit=ff895103a84abc85a5f43ecabc7f67cf36e1348f
BOOT_IMAGE=/pkg/linux/i386-randconfig-b003-20200324/gcc-7/ff895103a84abc85a5f43ecabc7f67cf36e1348f/vmlinuz-5.6.0-rc4-00008-gff895103a84ab
max_uptime=1500
RESULT_ROOT=/result/rcuperf/srcud-300s/vm-snb-i386/yocto-i386-minimal-20190520.cgz/i386-randconfig-b003-20200324/gcc-7/ff895103a84abc85a5f43ecabc7f67cf36e1348f/3
result_service=tmpfs
selinux=0
debug
apic=debug
sysrq_always_enabled
rcupdate.rcu_cpu_stall_timeout=100
net.ifnames=0
printk.devkmsg=on
panic=-1
softlockup_panic=1
nmi_watchdog=panic
oops=panic
load_ramdisk=2
To reproduce:
# build kernel
cd linux
cp config-5.6.0-rc4-00008-gff895103a84ab .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
IOZone error
by Deepa B
Hello,
Iozone benchmark is run through LKP on X86 (Linux kernel - 5.3.0,
Intel(R) Pentium(R) CPU N3710 @ 1.60GHz) & RISC-V U540(Yocto Linux
kernel - 5.4.3). Get same error with HDD disks on both.
Command: lkp run ./iozone-2HDD-ext4-kyber.yaml
rm due to not enough HDD disks
need: 2, has: 0
Traceback (most recent call last):
6: from /home/test/Ankita/lkp-tests/bin/run-local:131:in
' 5: from /home/test/Ankita/lkp-tests/lib/job.rb:691:in expand_params'
4: from /home/test/Ankita/lkp-tests/lib/job.rb:77:in for_each_in' 3:
from /home/test/Ankita/lkp-tests/lib/job.rb:77:in each'
2: from /home/test/Ankita/lkp-tests/lib/job.rb:78:in block in
for_each_in' 1: from /home/test/Ankita/lkp-tests/lib/job.rb:694:in
block in expand_params'
/home/test/Ankita/lkp-tests/lib/job.rb:669:in `run_filter':
/home/test/Ankita/lkp-tests/filters/disk: exitstatus 1
(Job::ParamError)
Could you please help us resolve this?
Thanks,
Deepa
2 years, 4 months
- 3
- 4
[drm] 4d7883fabf: WARNING:at_drivers/gpu/drm/drm_managed.c:#drmm_add_final_kfree[drm]
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 4d7883fabfdc73e271e75c9b0b7866ea7e7ae699 ("drm: Set final_kfree in drm_dev_alloc")
url: https://github.com/0day-ci/linux/commits/UPDATE-20200326-004731/Daniel-Ve...
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------------------------+------------+------------+
| | 7f89874a78 | 4d7883fabf |
+-----------------------------------------------------------------------------+------------+------------+
| boot_successes | 11 | 0 |
| boot_failures | 1 | 11 |
| BUG:kernel_hang_in_early-boot_stage,last_printk:early_console_in_setup_code | 1 | |
| WARNING:at_drivers/gpu/drm/drm_managed.c:#drmm_add_final_kfree[drm] | 0 | 11 |
| RIP:drmm_add_final_kfree[drm] | 0 | 11 |
+-----------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 249.726375] WARNING: CPU: 0 PID: 334 at drivers/gpu/drm/drm_managed.c:119 drmm_add_final_kfree+0x3d/0x50 [drm]
[ 249.728604] Modules linked in: bochs_drm(+) drm_vram_helper drm_ttm_helper ttm drm_kms_helper drm psmouse i6300esb qemu_fw_cfg drm_panel_orientation_quirks
[ 249.731136] CPU: 0 PID: 334 Comm: udevd Not tainted 5.6.0-rc7-01663-g4d7883fabfdc7 #1
[ 249.732599] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 249.734188] RIP: 0010:drmm_add_final_kfree+0x3d/0x50 [drm]
[ 249.735169] Code: 25 48 89 ef e8 f4 42 18 e1 48 8d 93 c0 05 00 00 48 01 e8 48 39 c2 73 12 48 89 6b 30 5b 5d c3 0f 0b 48 39 eb 73 db 0f 0b eb d7 <0f> 0b 48 89 6b 30 5b 5d c3 66 2e 0f 1f 84 00 00 00 00 00 41 54 55
[ 249.738423] RSP: 0018:ffff888220fe3b58 EFLAGS: 00010246
[ 249.739410] RAX: ffff88822199ade0 RBX: ffff88822199a820 RCX: 0000000000000000
[ 249.740764] RDX: ffff88822199ade0 RSI: ffff88822199a820 RDI: ffff88822199a820
[ 249.742147] RBP: ffff88822199a820 R08: 3a30303a30303030 R09: 00302e32303a3030
[ 249.743487] R10: ffff888220beb000 R11: 000000000000000b R12: ffff888236b1a0b0
[ 249.744866] R13: ffffffffa0107000 R14: 0000000000000005 R15: ffffffffa01072c0
[ 249.746231] FS: 00007fe4e9609300(0000) GS:ffffffff82a2d000(0000) knlGS:0000000000000000
[ 249.747730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 249.748839] CR2: 0000000000243000 CR3: 0000000220fb8000 CR4: 00000000000406b0
[ 249.752487] Call Trace:
[ 249.752944] drm_dev_alloc+0x47/0x70 [drm]
[ 249.753713] bochs_pci_probe+0x65/0x130 [bochs_drm]
[ 249.754653] ? pci_match_device+0xc5/0xf0
[ 249.755432] pci_device_probe+0xb3/0x120
[ 249.756164] really_probe+0xe4/0x320
[ 249.756870] device_driver_attach+0x4a/0x50
[ 249.757689] __driver_attach+0x67/0xb0
[ 249.758426] ? device_driver_attach+0x50/0x50
[ 249.759270] bus_for_each_dev+0x60/0x90
[ 249.759984] bus_add_driver+0x170/0x1f0
[ 249.760726] ? 0xffffffffa010a000
[ 249.761391] driver_register+0x56/0xf0
[ 249.762115] ? 0xffffffffa010a000
[ 249.762451] do_one_initcall+0x49/0x1e0
[ 249.762834] ? do_init_module+0x16/0x1de
[ 249.763236] ? __kmalloc+0x57/0x180
[ 249.763586] ? trace_hardirqs_on+0x2a/0xc0
[ 249.763993] do_init_module+0x4e/0x1de
[ 249.764366] load_module+0x16d5/0x1cc0
[ 249.764739] ? __do_sys_finit_module+0x96/0xb0
[ 249.765178] __do_sys_finit_module+0x96/0xb0
[ 249.765603] do_syscall_64+0x6a/0x240
[ 249.765969] entry_SYSCALL_64_after_hwframe+0x49/0xbe
[ 249.766484] RIP: 0033:0x7fe4e971eb99
[ 249.766842] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c7 12 0c 00 f7 d8 64 89 01 48
[ 249.768639] RSP: 002b:00007ffe2c279298 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 249.769372] RAX: ffffffffffffffda RBX: 0000558a63e342b0 RCX: 00007fe4e971eb99
[ 249.770078] RDX: 0000000000000000 RSI: 00007fe4e97f71e3 RDI: 000000000000000f
[ 249.771197] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[ 249.772544] R10: 000000000000000f R11: 0000000000000246 R12: 00007fe4e97f71e3
[ 249.773896] R13: 0000000000020000 R14: 00007ffe2c279390 R15: 0000000000000000
[ 249.775227] ---[ end trace f8d95502aef0064a ]---
To reproduce:
# build kernel
cd linux
cp config-5.6.0-rc7-01663-g4d7883fabfdc7 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
[mm/debug] d157503f6f: WARNING:at_mm/debug_vm_pgtable.c:#debug_vm_pgtable
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: d157503f6ff935d0ab4e0c3f324099a458597b5d ("[PATCH V2 2/3] mm/debug: Add tests validating arch advanced page table helpers")
url: https://github.com/0day-ci/linux/commits/Anshuman-Khandual/mm-debug-Add-m...
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------+------------+------------+
| | f675f2f91d | d157503f6f |
+-----------------------------------------------------------+------------+------------+
| boot_successes | 0 | 0 |
| boot_failures | 4 | 4 |
| Kernel_panic-not_syncing:Attempted_to_kill_init!exitcode= | 4 | 4 |
| WARNING:at_mm/debug_vm_pgtable.c:#debug_vm_pgtable | 0 | 4 |
| EIP:debug_vm_pgtable | 0 | 4 |
+-----------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 25.884391] WARNING: CPU: 0 PID: 1 at mm/debug_vm_pgtable.c:203 debug_vm_pgtable+0x320/0x51a
[ 25.886281] Modules linked in:
[ 25.886838] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.6.0-rc7-next-20200323-00002-gd157503f6ff93 #1
[ 25.888378] EIP: debug_vm_pgtable+0x320/0x51a
[ 25.889113] Code: 00 00 00 83 f8 01 19 c0 25 00 f0 3f 00 2d 00 00 40 00 f7 d0 21 d0 a8 20 74 02 0f 0b 8b 45 f0 e8 3b ff 31 fe c7 03 00 00 00 00 <0f> 0b 0f 0b 8b 03 85 c0 74 02 0f 0b 8b 45 f0 e8 21 ff 31 fe 8b 45
[ 25.892453] EAX: 00000025 EBX: e9160444 ECX: e9160444 EDX: 00000000
[ 25.893652] ESI: 44800000 EDI: 16800080 EBP: c0265fa4 ESP: c0265f7c
[ 25.894842] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246
[ 25.900205] CR0: 80050033 CR2: b7d17b20 CR3: 16ae4000 CR4: 000006d0
[ 25.901289] Call Trace:
[ 25.901728] ? rest_init+0x110/0x110
[ 25.902395] kernel_init+0x12/0x110
[ 25.903065] ret_from_fork+0x2e/0x40
[ 25.903797] ---[ end trace a6228a4356840124 ]---
To reproduce:
# build kernel
cd linux
cp config-5.6.0-rc7-next-20200323-00002-gd157503f6ff93 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
[perf] 64a7f64478: perf-event-tests.check_reset_mpx.failed
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 64a7f64478e47ef861dc0d7a82c761489c89939a ("[PATCH v11] perf: Sharing PMU counters across compatible events")
url: https://github.com/0day-ci/linux/commits/Song-Liu/perf-Sharing-PMU-counte...
in testcase: perf-event-tests
with following parameters:
paranoid: disallow_raw_tracepoint
ucode: 0x27
test-description: The Perf Event Testsuite.
test-url: https://github.com/deater/perf_event_tests
on test machine: 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
* Checking for corner-cases in the ABI (not necessarily bugs)
+ tests/corner_cases/multiple_active
Testing multiple simultaneous measurements... PASSED
+ tests/corner_cases/max_num_events
Testing max events that can be created... PASSED
+ tests/corner_cases/max_multiplex
Testing limit of multiplexing... PASSED
+ tests/corner_cases/reset_leader
Testing reset on group leader... PASSED
+ tests/corner_cases/check_reset_mpx
Testing if reset clears multiplex fields... FAILED
+ tests/corner_cases/huge_events_start
Testing start of max events... PASSED
+ tests/corner_cases/huge_group_start
Testing start of max event group... PASSED
+ tests/corner_cases/signal_after_close
Testing signal after close... PASSED
* Checking for fast RDPMC support
+ tests/rdpmc/rdpmc_support
Testing if userspace rdpmc reads are supported... PASSED
+ tests/rdpmc/rdpmc_validation
Testing if userspace rdpmc reads give expected results... PASSED
+ tests/rdpmc/rdpmc_multiplexing
Testing if userspace rdpmc multiplexing works... PASSED
+ tests/rdpmc/rdpmc_reset
Testing if resetting while using rdpmc works... FAILED
+ tests/rdpmc/rdpmc_group
Testing if rdpmc works with event groups... FAILED
+ tests/rdpmc/rdpmc_attach
Testing if rdpmc attach works... PASSED
+ tests/rdpmc/rdpmc_attach_cpu
Testing if rdpmc behavior on attach CPU... FAILED
+ tests/rdpmc/rdpmc_attach_global_cpu
Running on CPU 4
Testing if rdpmc behavior on attach all procs on other CPU... FAILED
+ tests/rdpmc/rdpmc_attach_other_cpu
Testing if rdpmc behavior on attach other CPU... FAILED
+ tests/rdpmc/rdpmc_multiattach
Testing if rdpmc multi-attach works... PASSED
+ tests/rdpmc/rdpmc_multiattach_papi
Testing if rdpmc papi-multi-attach works... PASSED
+ tests/rdpmc/rdpmc_pthreads
Testing if rdpmc with pthreads works... PASSED
+ tests/rdpmc/rdpmc_pthreads_group
Testing if rdpmc with pthreads works... PASSED
+ tests/rdpmc/rdpmc_attach_multi_enable
Testing if minimized rdpmc papi-multi-attach works... PASSED
+ tests/rdpmc/rdpmc_exec
Testing if we can rdpmc in execed process... PASSED
+ tests/rdpmc/rdpmc_exec_papi
Testing if we can rdpmc in execed process (PAPI) ... PASSED
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
2 years, 4 months
- 2
- 1
[sched/fair] d1d0625967: suspend-stress.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: d1d06259672ab8c396fa9b294af17e7e2d69318e ("sched/fair: Start scan for an idle sibling on the next available CPU")
https://git.kernel.org/cgit/linux/kernel/git/mel/linux.git sched-sisoptimise-v1r23
in testcase: suspend-stress
with following parameters:
mode: mem
iterations: 10
on test machine: 8 threads KabyLake-r with 8G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
test started
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
[kernel] 2a8b6290ee: netperf.Throughput_Mbps 12.6% improvement
by kernel test robot
Greeting,
FYI, we noticed a 12.6% improvement of netperf.Throughput_Mbps due to commit:
commit: 2a8b6290eeb099d80ddfd958368c71693aa16519 ("kernel-hacking: Make DEBUG_{LIST,PLIST,SG,NOTIFIERS} non-debug options")
https://git.kernel.org/cgit/linux/kernel/git/will/linux.git debug-list
in testcase: netperf
on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
with following parameters:
ip: ipv4
runtime: 300s
nr_threads: 25%
cluster: cs-localhost
send_size: 10K
test: SCTP_STREAM_MANY
cpufreq_governor: performance
ucode: 0x2000065
test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.brk.ops_per_sec 10.8% improvement |
| test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory |
| test parameters | class=os |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | fs=ext4 |
| | nr_threads=100% |
| | testtime=1s |
| | ucode=0x500002c |
+------------------+----------------------------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/25%/debian-x86_64-20191114.cgz/300s/10K/lkp-skl-2sp7/SCTP_STREAM_MANY/netperf/0x2000065
commit:
faf6f40bfb ("list: Remove unnecessary WRITE_ONCE() from hlist_bl_add_before()")
2a8b6290ee ("kernel-hacking: Make DEBUG_{LIST,PLIST,SG,NOTIFIERS} non-debug options")
faf6f40bfbf9e7b6 2a8b6290eeb099d80ddfd958368
---------------- ---------------------------
%stddev %change %stddev
\ | \
9251 +12.6% 10414 netperf.Throughput_Mbps
166527 +12.6% 187463 netperf.Throughput_total_Mbps
1125 ± 3% +42.5% 1603 ± 11% netperf.time.voluntary_context_switches
6.098e+08 +12.6% 6.865e+08 netperf.workload
1.79 ± 4% +0.2 2.02 mpstat.cpu.all.usr%
1.8e+08 ± 2% +11.2% 2e+08 cpuidle.C1.usage
757162 ± 2% +13.8% 861385 cpuidle.POLL.usage
53876 ± 60% +131.6% 124784 ± 25% sched_debug.cfs_rq:/.min_vruntime.min
2271450 ± 9% +18.5% 2691264 sched_debug.cpu.nr_switches.avg
67.25 -1.9% 66.00 vmstat.cpu.id
1145809 +12.7% 1291008 vmstat.system.cs
3.931e+08 +10.2% 4.334e+08 numa-numastat.node0.local_node
3.931e+08 +10.2% 4.334e+08 numa-numastat.node0.numa_hit
3.915e+08 +14.8% 4.493e+08 numa-numastat.node1.local_node
3.915e+08 +14.8% 4.493e+08 numa-numastat.node1.numa_hit
35653 +1.0% 36001 proc-vmstat.nr_slab_unreclaimable
7.843e+08 +12.5% 8.821e+08 proc-vmstat.numa_hit
7.843e+08 +12.5% 8.821e+08 proc-vmstat.numa_local
4.529e+09 +12.5% 5.097e+09 proc-vmstat.pgalloc_normal
4.529e+09 +12.5% 5.097e+09 proc-vmstat.pgfree
11337 ± 49% -88.4% 1315 ± 28% numa-meminfo.node0.Inactive
11170 ± 50% -89.8% 1139 ± 30% numa-meminfo.node0.Inactive(anon)
12186 ± 41% -74.5% 3112 ± 32% numa-meminfo.node0.Shmem
7352 ± 76% +137.2% 17439 ± 2% numa-meminfo.node1.Inactive
7185 ± 78% +140.4% 17275 ± 2% numa-meminfo.node1.Inactive(anon)
13371 ± 16% +27.8% 17089 numa-meminfo.node1.Mapped
34955 ± 14% +28.6% 44936 ± 4% numa-meminfo.node1.Shmem
2792 ± 50% -89.8% 284.50 ± 30% numa-vmstat.node0.nr_inactive_anon
3046 ± 41% -74.4% 778.50 ± 33% numa-vmstat.node0.nr_shmem
2792 ± 50% -89.8% 284.50 ± 30% numa-vmstat.node0.nr_zone_inactive_anon
1.942e+08 +11.5% 2.164e+08 numa-vmstat.node0.numa_hit
1.94e+08 +11.5% 2.163e+08 numa-vmstat.node0.numa_local
1764 ± 79% +142.9% 4285 ± 2% numa-vmstat.node1.nr_inactive_anon
8727 ± 14% +28.7% 11234 ± 4% numa-vmstat.node1.nr_shmem
1764 ± 79% +142.9% 4285 ± 2% numa-vmstat.node1.nr_zone_inactive_anon
1.959e+08 +13.5% 2.223e+08 numa-vmstat.node1.numa_hit
1.958e+08 +13.5% 2.222e+08 numa-vmstat.node1.numa_local
26583 ± 18% +21.2% 32218 ± 8% softirqs.CPU10.SCHED
28612 ± 15% +25.0% 35754 ± 10% softirqs.CPU14.SCHED
1785731 ± 21% -78.7% 380903 ± 76% softirqs.CPU20.NET_RX
26443 ± 22% +52.9% 40429 softirqs.CPU20.SCHED
35800 ± 7% -19.8% 28704 ± 19% softirqs.CPU27.SCHED
443444 ± 83% +184.7% 1262583 ± 23% softirqs.CPU3.NET_RX
39905 ± 4% -7.9% 36764 ± 6% softirqs.CPU3.SCHED
100379 ±107% +1872.2% 1979692 ± 36% softirqs.CPU30.NET_RX
40296 ± 2% -21.2% 31761 ± 15% softirqs.CPU30.SCHED
250441 ± 88% +822.5% 2310440 ± 30% softirqs.CPU31.NET_RX
39814 ± 6% -26.9% 29116 ± 18% softirqs.CPU31.SCHED
497248 ± 67% +294.4% 1961289 ± 11% softirqs.CPU32.NET_RX
201926 ±101% +560.9% 1334478 ± 33% softirqs.CPU33.NET_RX
1774815 ± 87% -90.1% 175969 ±141% softirqs.CPU39.NET_RX
93083 +23.6% 115062 ± 21% softirqs.CPU39.TIMER
30741 ±173% +3112.4% 987511 ±140% softirqs.CPU44.NET_RX
111973 ± 4% -5.5% 105858 ± 3% softirqs.CPU47.RCU
191848 ±146% +1263.2% 2615275 ± 66% softirqs.CPU55.NET_RX
22.25 ±106% +3.7e+06% 828201 ±149% softirqs.CPU61.NET_RX
91032 ± 2% +7.4% 97788 ± 4% softirqs.CPU69.TIMER
87122553 +12.6% 98074976 softirqs.NET_RX
38.87 +1.4% 39.42 perf-stat.i.MPKI
6.952e+09 +5.4% 7.33e+09 perf-stat.i.branch-instructions
1.75 +0.1 1.82 perf-stat.i.branch-miss-rate%
1.198e+08 +10.2% 1.321e+08 perf-stat.i.branch-misses
1.338e+09 +9.1% 1.46e+09 perf-stat.i.cache-references
1155221 +12.5% 1299713 perf-stat.i.context-switches
2.27 -4.8% 2.16 perf-stat.i.cpi
7.792e+10 +2.4% 7.977e+10 perf-stat.i.cpu-cycles
200.49 ± 4% -10.8% 178.90 ± 6% perf-stat.i.cpu-migrations
0.04 +0.0 0.04 perf-stat.i.dTLB-load-miss-rate%
4155421 +12.5% 4676024 perf-stat.i.dTLB-load-misses
9.802e+09 +7.7% 1.056e+10 perf-stat.i.dTLB-loads
5.822e+09 +9.4% 6.367e+09 perf-stat.i.dTLB-stores
18611263 +12.6% 20957731 perf-stat.i.iTLB-loads
3.425e+10 +7.6% 3.685e+10 perf-stat.i.instructions
0.44 +5.1% 0.46 perf-stat.i.ipc
39.05 +1.4% 39.61 perf-stat.overall.MPKI
1.72 +0.1 1.80 perf-stat.overall.branch-miss-rate%
2.27 -4.8% 2.16 perf-stat.overall.cpi
0.04 +0.0 0.04 perf-stat.overall.dTLB-load-miss-rate%
0.44 +5.1% 0.46 perf-stat.overall.ipc
16933 -4.5% 16169 perf-stat.overall.path-length
6.928e+09 +5.5% 7.306e+09 perf-stat.ps.branch-instructions
1.194e+08 +10.2% 1.316e+08 perf-stat.ps.branch-misses
1.333e+09 +9.1% 1.455e+09 perf-stat.ps.cache-references
1151345 +12.5% 1295307 perf-stat.ps.context-switches
7.766e+10 +2.4% 7.95e+10 perf-stat.ps.cpu-cycles
199.81 ± 4% -10.7% 178.45 ± 6% perf-stat.ps.cpu-migrations
4141514 +12.5% 4660268 perf-stat.ps.dTLB-load-misses
9.769e+09 +7.7% 1.052e+10 perf-stat.ps.dTLB-loads
5.803e+09 +9.4% 6.345e+09 perf-stat.ps.dTLB-stores
18548528 +12.6% 20888960 perf-stat.ps.iTLB-loads
3.414e+10 +7.6% 3.673e+10 perf-stat.ps.instructions
1.033e+13 +7.5% 1.11e+13 perf-stat.total.instructions
9608 ± 14% -53.4% 4482 ± 73% interrupts.CPU19.RES:Rescheduling_interrupts
2741 ± 13% +104.8% 5616 ± 47% interrupts.CPU23.NMI:Non-maskable_interrupts
2741 ± 13% +104.8% 5616 ± 47% interrupts.CPU23.PMI:Performance_monitoring_interrupts
2376 ± 17% +168.8% 6389 ± 36% interrupts.CPU26.NMI:Non-maskable_interrupts
2376 ± 17% +168.8% 6389 ± 36% interrupts.CPU26.PMI:Performance_monitoring_interrupts
3004 ± 8% +120.5% 6625 ± 31% interrupts.CPU27.NMI:Non-maskable_interrupts
3004 ± 8% +120.5% 6625 ± 31% interrupts.CPU27.PMI:Performance_monitoring_interrupts
3947 ± 53% +57.7% 6227 ± 33% interrupts.CPU28.NMI:Non-maskable_interrupts
3947 ± 53% +57.7% 6227 ± 33% interrupts.CPU28.PMI:Performance_monitoring_interrupts
3651 ± 35% +81.2% 6617 ± 18% interrupts.CPU29.NMI:Non-maskable_interrupts
3651 ± 35% +81.2% 6617 ± 18% interrupts.CPU29.PMI:Performance_monitoring_interrupts
3268 ± 48% +124.1% 7322 ± 20% interrupts.CPU30.RES:Rescheduling_interrupts
3260 ± 30% +93.0% 6292 ± 26% interrupts.CPU33.NMI:Non-maskable_interrupts
3260 ± 30% +93.0% 6292 ± 26% interrupts.CPU33.PMI:Performance_monitoring_interrupts
863.25 ± 43% +541.7% 5539 ± 22% interrupts.CPU33.RES:Rescheduling_interrupts
6403 ± 25% -48.2% 3314 ± 23% interrupts.CPU4.RES:Rescheduling_interrupts
3194 ± 18% +112.1% 6773 ± 26% interrupts.CPU42.NMI:Non-maskable_interrupts
3194 ± 18% +112.1% 6773 ± 26% interrupts.CPU42.PMI:Performance_monitoring_interrupts
1707 ± 80% +190.6% 4961 ± 27% interrupts.CPU46.RES:Rescheduling_interrupts
2735 ± 56% +142.0% 6618 ± 35% interrupts.CPU5.NMI:Non-maskable_interrupts
2735 ± 56% +142.0% 6618 ± 35% interrupts.CPU5.PMI:Performance_monitoring_interrupts
5957 ± 37% -53.3% 2781 ± 50% interrupts.CPU50.NMI:Non-maskable_interrupts
5957 ± 37% -53.3% 2781 ± 50% interrupts.CPU50.PMI:Performance_monitoring_interrupts
2546 ± 30% +136.4% 6021 ± 43% interrupts.CPU51.NMI:Non-maskable_interrupts
2546 ± 30% +136.4% 6021 ± 43% interrupts.CPU51.PMI:Performance_monitoring_interrupts
1442 ± 86% +190.2% 4185 ± 37% interrupts.CPU52.RES:Rescheduling_interrupts
4038 ± 51% +144.5% 9875 ± 13% interrupts.CPU54.RES:Rescheduling_interrupts
2703 ± 38% +170.3% 7307 ± 30% interrupts.CPU55.NMI:Non-maskable_interrupts
2703 ± 38% +170.3% 7307 ± 30% interrupts.CPU55.PMI:Performance_monitoring_interrupts
2287 ± 53% +280.0% 8689 ± 38% interrupts.CPU57.RES:Rescheduling_interrupts
4992 ± 42% -37.2% 3135 ± 9% interrupts.CPU58.NMI:Non-maskable_interrupts
4992 ± 42% -37.2% 3135 ± 9% interrupts.CPU58.PMI:Performance_monitoring_interrupts
2499 ±135% +394.5% 12359 ± 74% interrupts.CPU59.RES:Rescheduling_interrupts
214.25 ± 35% +1479.1% 3383 ± 40% interrupts.CPU63.RES:Rescheduling_interrupts
6186 ± 40% -30.1% 4322 ± 54% interrupts.CPU68.NMI:Non-maskable_interrupts
6186 ± 40% -30.1% 4322 ± 54% interrupts.CPU68.PMI:Performance_monitoring_interrupts
305911 ± 4% +15.6% 353552 interrupts.RES:Rescheduling_interrupts
10.03 ± 5% -1.7 8.29 ± 6% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve
10.35 ± 5% -1.7 8.64 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb
7.60 ± 4% -1.7 5.94 ± 6% perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.consume_skb.sctp_chunk_put.sctp_outq_sack
7.81 ± 4% -1.6 6.20 ± 6% perf-profile.calltrace.cycles-pp.__free_pages_ok.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter
7.61 ± 5% -1.6 6.00 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node
8.29 ± 5% -1.6 6.70 ± 6% perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm
8.54 ± 5% -1.6 6.99 ± 6% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv
9.52 ± 5% -1.5 7.99 ± 6% perf-profile.calltrace.cycles-pp.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv
7.98 ± 5% -1.5 6.45 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.kmalloc_large_node.__kmalloc_node_track_caller
6.71 ± 4% -1.5 5.26 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.consume_skb
7.12 ± 4% -1.4 5.73 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.consume_skb.sctp_chunk_put
8.10 ± 5% -1.3 6.78 ± 6% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb._sctp_make_chunk
8.14 ± 5% -1.3 6.82 ± 6% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user
8.12 ± 5% -1.3 6.80 ± 6% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty
8.78 ± 5% -1.3 7.47 ± 6% perf-profile.calltrace.cycles-pp.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc
2.69 ± 4% -0.4 2.24 ± 8% perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.kfree_skb.sctp_recvmsg.inet_recvmsg
2.82 ± 4% -0.4 2.39 ± 8% perf-profile.calltrace.cycles-pp.__free_pages_ok.kfree_skb.sctp_recvmsg.inet_recvmsg.____sys_recvmsg
2.37 ± 3% -0.4 1.94 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.kfree_skb
2.52 ± 4% -0.4 2.13 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.kfree_skb.sctp_recvmsg
2.50 ± 4% -0.4 2.12 ± 6% perf-profile.calltrace.cycles-pp.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm
2.37 ± 5% -0.4 2.00 ± 6% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit
2.38 ± 4% -0.4 2.01 ± 6% perf-profile.calltrace.cycles-pp.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter
2.37 ± 4% -0.4 2.00 ± 6% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.__kmalloc_reserve.__alloc_skb.sctp_packet_transmit.sctp_outq_flush
0.00 +0.6 0.60 ± 7% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram
4.92 ± 6% +0.8 5.76 ± 5% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user
4.95 ± 6% +0.8 5.80 ± 5% perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc
0.00 +0.9 0.85 ± 8% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
5.05 ± 6% +0.9 5.91 ± 5% perf-profile.calltrace.cycles-pp._copy_from_iter_full.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg
5.23 ± 6% +0.9 6.11 ± 5% perf-profile.calltrace.cycles-pp.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg
0.00 +1.1 1.11 ± 8% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg
17.30 ± 4% -3.5 13.83 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
10.29 ± 4% -2.1 8.19 ± 6% perf-profile.children.cycles-pp.free_one_page
10.65 ± 4% -2.0 8.61 ± 6% perf-profile.children.cycles-pp.__free_pages_ok
10.04 ± 5% -1.7 8.31 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist
9.97 ± 4% -1.7 8.26 ± 6% perf-profile.children.cycles-pp._raw_spin_lock
10.37 ± 5% -1.7 8.65 ± 6% perf-profile.children.cycles-pp.__alloc_pages_nodemask
10.47 ± 5% -1.7 8.78 ± 6% perf-profile.children.cycles-pp.kmalloc_large_node
10.53 ± 5% -1.7 8.84 ± 6% perf-profile.children.cycles-pp.__kmalloc_node_track_caller
10.55 ± 5% -1.7 8.87 ± 6% perf-profile.children.cycles-pp.__kmalloc_reserve
11.39 ± 5% -1.7 9.73 ± 6% perf-profile.children.cycles-pp.__alloc_skb
8.56 ± 4% -1.6 7.00 ± 6% perf-profile.children.cycles-pp.consume_skb
9.53 ± 5% -1.5 7.99 ± 6% perf-profile.children.cycles-pp.sctp_outq_sack
9.17 ± 5% -1.5 7.68 ± 6% perf-profile.children.cycles-pp.sctp_chunk_put
8.42 ± 5% -1.5 6.94 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.15 ± 7% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.sctp_auth_send_cid
0.11 ± 6% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.sctp_outq_tail
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.check_stack_object
0.09 ± 4% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.sctp_chunk_assign_ssn
0.09 ± 4% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.update_ts_time_stats
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.sctp_packet_append_chunk
0.09 ± 7% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.nr_iowait_cpu
0.07 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.finish_task_switch
0.07 ± 7% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.sctp_v4_from_skb
0.14 ± 5% +0.0 0.16 ± 5% perf-profile.children.cycles-pp.__ip_local_out
0.15 ± 4% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.sctp_sock_rfree
0.10 ± 4% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.sctp_chunk_hold
0.08 ± 11% +0.0 0.10 ± 13% perf-profile.children.cycles-pp.__genradix_ptr
0.14 ± 7% +0.0 0.16 ± 5% perf-profile.children.cycles-pp.mod_node_page_state
0.13 ± 8% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.ip_send_check
0.04 ± 57% +0.0 0.06 ± 6% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.14 ± 3% +0.0 0.17 ± 7% perf-profile.children.cycles-pp.__switch_to
0.07 ± 13% +0.0 0.09 ± 8% perf-profile.children.cycles-pp.check_preempt_curr
0.17 ± 4% +0.0 0.20 ± 7% perf-profile.children.cycles-pp.sctp_ulpevent_receive_data
0.27 ± 3% +0.0 0.30 ± 6% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk
0.29 ± 3% +0.0 0.33 ± 5% perf-profile.children.cycles-pp.set_next_entity
0.26 ± 9% +0.0 0.30 ± 5% perf-profile.children.cycles-pp.__fget_light
0.23 ± 4% +0.0 0.28 ± 7% perf-profile.children.cycles-pp.skb_release_data
0.07 ± 15% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.reweight_entity
0.39 ± 3% +0.1 0.45 ± 5% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.26 ± 8% +0.1 0.32 ± 7% perf-profile.children.cycles-pp.sctp_addto_chunk
0.32 ± 5% +0.1 0.38 ± 8% perf-profile.children.cycles-pp.sctp_chunkify
0.65 ± 5% +0.1 0.73 ± 4% perf-profile.children.cycles-pp.__check_object_size
4.96 ± 6% +0.8 5.80 ± 5% perf-profile.children.cycles-pp.copyin
5.05 ± 6% +0.9 5.91 ± 5% perf-profile.children.cycles-pp._copy_from_iter_full
5.23 ± 6% +0.9 6.12 ± 5% perf-profile.children.cycles-pp.sctp_user_addto_chunk
8.27 ± 6% +1.3 9.56 ± 5% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.00 +2.0 1.99 ± 8% perf-profile.children.cycles-pp.__schedule
17.30 ± 4% -3.5 13.83 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.sock_kmalloc
0.09 ± 7% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.nr_iowait_cpu
0.06 ± 11% +0.0 0.08 ± 10% perf-profile.self.cycles-pp.sctp_v4_from_skb
0.15 ± 4% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.sctp_sock_rfree
0.24 ± 5% +0.0 0.26 ± 3% perf-profile.self.cycles-pp.sctp_sendmsg
0.15 ± 5% +0.0 0.18 ± 4% perf-profile.self.cycles-pp.update_load_avg
0.09 ± 7% +0.0 0.11 ± 9% perf-profile.self.cycles-pp.sctp_ulpevent_receive_data
0.14 ± 6% +0.0 0.16 ± 8% perf-profile.self.cycles-pp.__switch_to
0.04 ± 58% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.sctp_chunkify
0.07 ± 13% +0.0 0.09 ± 11% perf-profile.self.cycles-pp.__genradix_ptr
0.12 ± 5% +0.0 0.15 ± 11% perf-profile.self.cycles-pp.sctp_ulpq_tail_event
0.11 ± 13% +0.0 0.14 ± 6% perf-profile.self.cycles-pp.sctp_ulpevent_make_rcvmsg
0.19 ± 3% +0.0 0.22 ± 6% perf-profile.self.cycles-pp.prep_new_page
0.07 ± 6% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.sctp_addto_chunk
0.15 ± 9% +0.0 0.18 ± 8% perf-profile.self.cycles-pp.kmem_cache_alloc_node
0.23 ± 10% +0.0 0.27 ± 3% perf-profile.self.cycles-pp.sctp_skb_recv_datagram
0.34 ± 4% +0.0 0.38 ± 5% perf-profile.self.cycles-pp.__check_object_size
0.25 ± 10% +0.0 0.30 ± 5% perf-profile.self.cycles-pp.__fget_light
0.07 ± 12% +0.1 0.12 ± 5% perf-profile.self.cycles-pp.reweight_entity
0.39 ± 3% +0.1 0.44 ± 5% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.check_preempt_curr
0.26 ± 5% +0.1 0.32 ± 5% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.06 ± 7% +0.1 0.12 ± 5% perf-profile.self.cycles-pp.dequeue_task_fair
0.79 ± 6% +0.1 0.89 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.77 ± 7% +0.1 0.88 ± 6% perf-profile.self.cycles-pp.sctp_datamsg_from_user
0.14 ± 10% +0.1 0.28 ± 7% perf-profile.self.cycles-pp.sctp_sched_fcfs_dequeue
0.89 ± 6% +0.2 1.06 ± 5% perf-profile.self.cycles-pp._raw_spin_lock
0.00 +0.4 0.44 ± 9% perf-profile.self.cycles-pp.__schedule
0.76 ± 7% +0.5 1.26 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist
8.22 ± 6% +1.3 9.50 ± 5% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
netperf.Throughput_Mbps
12000 +-------------------------------------------------------------------+
| |
10000 |-+O O O O O O O O O O O O O O O O O O O O O O |
| +..+.+..+..+.+..+..+.+..+.+..+..+.+..+.+..+..+.+..+..+.+..+.+..|
| : |
8000 |:+ : |
|: : |
6000 |:+ : |
|: : |
4000 |-: : |
| : : |
| : : |
2000 |-:: |
| : |
0 +-------------------------------------------------------------------+
netperf.Throughput_total_Mbps
200000 +------------------------------------------------------------------+
180000 |-+O O O O O O O O O O O O O O O O O O O O O O |
| +..+.+..+.+..+..+.+..+.+..+..+.+..+.+..+.+..+..+.+..+.+..+.+..|
160000 |-+ : |
140000 |:+ : |
|: : |
120000 |:+ : |
100000 |:+ : |
80000 |-: : |
| : : |
60000 |-: : |
40000 |-: : |
| : |
20000 |-+: |
0 +------------------------------------------------------------------+
netperf.workload
7e+08 +-------------------------------------------------------------------+
| |
6e+08 |-+ +..+.+..+..+.+..+..+.+..+.+..+..+.+..+.+..+..+.+..+..+.+..+.+..|
| : |
5e+08 |:+ : |
|: : |
4e+08 |:+ : |
|: : |
3e+08 |-: : |
| : : |
2e+08 |-: : |
| : : |
1e+08 |-+: |
| : |
0 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2sp5: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode:
os/gcc-7/performance/1HDD/ext4/x86_64-rhel-7.6/100%/debian-x86_64-20191114.cgz/lkp-csl-2sp5/stress-ng/1s/0x500002c
commit:
faf6f40bfb ("list: Remove unnecessary WRITE_ONCE() from hlist_bl_add_before()")
2a8b6290ee ("kernel-hacking: Make DEBUG_{LIST,PLIST,SG,NOTIFIERS} non-debug options")
faf6f40bfbf9e7b6 2a8b6290eeb099d80ddfd958368
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:2 -50% :3 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:2 100% 2:3 kmsg.debugfs:Directory'loop#'with_parent'block'already_present
0:2 6% 0:3 perf-profile.children.cycles-pp.error_entry
%stddev %change %stddev
\ | \
10033115 +10.8% 11120407 stress-ng.brk.ops_per_sec
6509 ± 12% -63.2% 2396 ±135% stress-ng.dentry.ops
6468 ± 12% -63.9% 2336 ±139% stress-ng.dentry.ops_per_sec
13656 -31.4% 9368 ± 31% stress-ng.io.ops
13635 -32.3% 9228 ± 32% stress-ng.io.ops_per_sec
238.50 ± 3% -6.4% 223.33 stress-ng.klog.ops
214.48 ± 4% -8.6% 196.03 stress-ng.klog.ops_per_sec
44.06 ± 11% +36.6% 60.19 ± 16% stress-ng.loop.ops_per_sec
8452 ± 11% -14.7% 7210 ± 9% stress-ng.resources.ops
3845 ± 11% -27.8% 2778 ± 11% stress-ng.resources.ops_per_sec
18641 +10.3% 20554 stress-ng.shm.ops
18631 +10.4% 20571 stress-ng.shm.ops_per_sec
901931 +16.6% 1051430 ± 5% stress-ng.sigsuspend.ops
900529 +16.6% 1049947 ± 5% stress-ng.sigsuspend.ops_per_sec
6222 ± 8% -19.1% 5036 ± 6% stress-ng.sysfs.ops
6222 ± 8% -19.1% 5035 ± 6% stress-ng.sysfs.ops_per_sec
8990 -30.0% 6295 ± 33% stress-ng.sysinfo.ops
8988 -30.1% 6278 ± 33% stress-ng.sysinfo.ops_per_sec
1.747e+08 ± 2% +4.3% 1.822e+08 stress-ng.time.minor_page_faults
40254095 +3.5% 41651588 stress-ng.time.voluntary_context_switches
6730 ± 8% -6.9% 6265 ± 11% vmstat.io.bo
62341 ± 5% +21.1% 75526 ± 10% numa-numastat.node0.other_node
84869 ± 4% -17.6% 69905 ± 11% numa-numastat.node1.other_node
47710561 ± 2% -6.3% 44680987 ± 2% meminfo.DirectMap2M
731.50 +80.5% 1320 ± 29% meminfo.Inactive(file)
122763 ± 2% -42.8% 70277 meminfo.Percpu
8.48 ± 2% +125.7% 19.15 ±113% iostat.sda.r_await.max
670.32 ± 5% -40.1% 401.69 ± 72% iostat.sda.w/s
6869 ± 8% -37.0% 4330 ± 72% iostat.sda.wkB/s
37.13 -35.0% 24.12 ± 70% iostat.sda.wrqm/s
1.384e+09 ± 52% +194.7% 4.077e+09 ± 16% cpuidle.C1E.time
10146729 ± 19% +52.3% 15452880 ± 8% cpuidle.C1E.usage
2.129e+09 ± 29% -99.6% 8058777 ± 6% cpuidle.C6.time
2875308 ± 2% -98.8% 34435 ± 6% cpuidle.C6.usage
11096262 ± 32% -33.8% 7341252 ± 2% cpuidle.POLL.time
599732 ± 6% -21.4% 471655 ± 23% numa-meminfo.node1.AnonHugePages
123966 ± 4% -5.6% 116986 ± 3% numa-meminfo.node1.KReclaimable
463254 ± 15% -24.8% 348494 ± 35% numa-meminfo.node1.Mapped
11512 ± 4% +31.3% 15111 ± 9% numa-meminfo.node1.Mlocked
123966 ± 4% -5.6% 116986 ± 3% numa-meminfo.node1.SReclaimable
69.50 ± 78% +132.6% 161.67 ± 17% numa-vmstat.node0.nr_inactive_file
337.00 ± 10% -38.1% 208.67 ± 15% numa-vmstat.node0.nr_isolated_anon
69.50 ± 78% +132.6% 161.67 ± 17% numa-vmstat.node0.nr_zone_inactive_file
120755 ± 16% -27.9% 87089 ± 36% numa-vmstat.node1.nr_mapped
30907 ± 4% -5.3% 29263 ± 3% numa-vmstat.node1.nr_slab_reclaimable
95627 ± 3% -14.6% 81620 ± 10% numa-vmstat.node1.numa_other
662.15 -20.5% 526.25 ± 14% sched_debug.cfs_rq:/.exec_clock.stddev
24123 ± 27% -36.4% 15352 ± 35% sched_debug.cfs_rq:/.load.avg
89243 ± 44% -50.5% 44141 ± 71% sched_debug.cfs_rq:/.load.stddev
68.25 ± 13% +46.8% 100.17 ± 13% sched_debug.cfs_rq:/.nr_spread_over.min
51.40 ± 15% -38.5% 31.63 ± 19% sched_debug.cfs_rq:/.nr_spread_over.stddev
182.25 ± 49% -48.8% 93.36 ± 89% sched_debug.cfs_rq:/.runnable_load_avg.max
29.27 ± 61% -59.2% 11.93 ± 66% sched_debug.cfs_rq:/.runnable_load_avg.stddev
23160 ± 30% -37.6% 14454 ± 36% sched_debug.cfs_rq:/.runnable_weight.avg
88811 ± 44% -51.1% 43457 ± 74% sched_debug.cfs_rq:/.runnable_weight.stddev
729.50 ± 9% +35.9% 991.58 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.max
160595 ± 7% -76.0% 38463 ± 89% sched_debug.cpu.avg_idle.min
173509 ± 6% +33.1% 230964 ± 15% sched_debug.cpu.avg_idle.stddev
147.12 ± 15% +33.1% 195.86 ± 2% sched_debug.cpu.nr_uninterruptible.max
145247 ± 6% -14.0% 124844 ± 12% softirqs.CPU22.NET_RX
134798 +8.1% 145752 ± 4% softirqs.CPU4.NET_RX
16916 ± 3% -5.2% 16039 ± 3% softirqs.CPU4.SCHED
84004 ± 17% -16.9% 69839 ± 3% softirqs.CPU5.TIMER
115275 ± 8% +19.9% 138177 softirqs.CPU53.NET_RX
125185 ± 8% +19.3% 149299 ± 6% softirqs.CPU54.NET_RX
111020 ± 8% +31.3% 145821 ± 3% softirqs.CPU63.NET_RX
134765 ± 4% +19.7% 161351 ± 2% softirqs.CPU65.NET_RX
124865 -17.6% 102848 ± 13% softirqs.CPU79.NET_RX
127048 ± 4% -12.2% 111544 ± 6% softirqs.CPU83.NET_RX
133678 -6.7% 124678 ± 3% softirqs.CPU84.NET_RX
134026 ± 7% -6.6% 125175 ± 4% softirqs.CPU88.NET_RX
125834 ± 4% -11.0% 112006 ± 9% softirqs.CPU89.NET_RX
740548 ± 3% -4.6% 706648 ± 6% perf-stat.i.context-switches
5.13 -1.4% 5.06 perf-stat.i.cpi
0.09 ± 6% -0.0 0.07 ± 3% perf-stat.i.dTLB-load-miss-rate%
10384399 ± 3% -5.2% 9848079 ± 4% perf-stat.i.dTLB-load-misses
81.08 -1.9 79.21 perf-stat.i.iTLB-load-miss-rate%
8226856 ± 4% -12.2% 7223576 ± 6% perf-stat.i.iTLB-loads
5906 -4.1% 5664 ± 2% perf-stat.i.instructions-per-iTLB-miss
0.37 +6.7% 0.40 ± 4% perf-stat.i.ipc
14862073 -4.3% 14221330 ± 4% perf-stat.i.node-load-misses
5.11 +1.1% 5.16 perf-stat.overall.MPKI
2.79 -0.7% 2.77 perf-stat.overall.cpi
1767 -1.3% 1744 perf-stat.overall.cycles-between-cache-misses
0.05 -0.0 0.05 perf-stat.overall.dTLB-load-miss-rate%
0.03 +0.0 0.04 perf-stat.overall.dTLB-store-miss-rate%
86.14 +1.9 88.00 perf-stat.overall.iTLB-load-miss-rate%
1448 -3.0% 1404 perf-stat.overall.instructions-per-iTLB-miss
10359389 -5.6% 9783872 ± 3% perf-stat.ps.dTLB-load-misses
8303344 -14.6% 7089134 ± 5% perf-stat.ps.iTLB-loads
14876992 -4.9% 14146480 ± 3% perf-stat.ps.node-load-misses
19117936 -4.6% 18230885 ± 3% perf-stat.ps.node-loads
283072 ± 6% +78.2% 504461 ± 56% proc-vmstat.nr_inactive_anon
182.50 +81.0% 330.33 ± 29% proc-vmstat.nr_inactive_file
60404 -1.2% 59673 proc-vmstat.nr_slab_reclaimable
131236 -2.6% 127802 ± 2% proc-vmstat.nr_slab_unreclaimable
283072 ± 6% +78.2% 504461 ± 56% proc-vmstat.nr_zone_inactive_anon
182.50 +81.0% 330.33 ± 29% proc-vmstat.nr_zone_inactive_file
5.307e+08 +4.9% 5.566e+08 proc-vmstat.numa_hit
5.306e+08 +4.9% 5.564e+08 proc-vmstat.numa_local
6.615e+08 +3.9% 6.87e+08 proc-vmstat.pgalloc_normal
1.954e+08 ± 2% +4.3% 2.039e+08 proc-vmstat.pgfault
6.612e+08 +3.9% 6.868e+08 proc-vmstat.pgfree
408265 +6.8% 435864 proc-vmstat.pglazyfree
3497 +6.8% 3734 proc-vmstat.thp_deferred_split_page
153269 -2.8% 149041 proc-vmstat.thp_fault_alloc
3497 +6.8% 3734 proc-vmstat.thp_split_page
3497 +6.8% 3734 proc-vmstat.thp_split_pmd
24768773 +7.8% 26699971 proc-vmstat.unevictable_pgs_culled
2298700 ± 2% +8.0% 2482063 ± 2% proc-vmstat.unevictable_pgs_mlocked
2297941 ± 2% +8.0% 2481826 ± 2% proc-vmstat.unevictable_pgs_munlocked
2297808 ± 2% +8.0% 2481690 ± 2% proc-vmstat.unevictable_pgs_rescued
25861 -35.3% 16726 ± 45% slabinfo.Acpi-State.active_objs
25945 -35.4% 16766 ± 45% slabinfo.Acpi-State.num_objs
10782 ± 8% -38.1% 6676 ± 7% slabinfo.RAW.active_objs
345.00 ± 8% -37.2% 216.67 ± 7% slabinfo.RAW.active_slabs
11057 ± 8% -37.2% 6948 ± 7% slabinfo.RAW.num_objs
345.00 ± 8% -37.2% 216.67 ± 7% slabinfo.RAW.num_slabs
6222 ± 3% -34.3% 4086 ± 3% slabinfo.RAWv6.active_objs
6427 ± 2% -33.5% 4273 ± 2% slabinfo.RAWv6.num_objs
2689 ± 5% -25.0% 2017 ± 38% slabinfo.TCP.active_objs
2730 ± 5% -24.9% 2049 ± 38% slabinfo.TCP.num_objs
12200 ± 7% -28.8% 8691 ± 29% slabinfo.UNIX.active_objs
393.00 ± 7% -28.5% 281.00 ± 29% slabinfo.UNIX.active_slabs
12590 ± 7% -28.4% 9008 ± 29% slabinfo.UNIX.num_objs
393.00 ± 7% -28.5% 281.00 ± 29% slabinfo.UNIX.num_slabs
5316 ± 5% +19.1% 6330 ± 9% slabinfo.ccid2_hc_tx_sock.active_objs
43534 ± 3% -12.5% 38107 ± 9% slabinfo.cred_jar.active_objs
1048 ± 3% -12.4% 918.00 ± 10% slabinfo.cred_jar.active_slabs
44061 ± 3% -12.4% 38580 ± 10% slabinfo.cred_jar.num_objs
1048 ± 3% -12.4% 918.00 ± 10% slabinfo.cred_jar.num_slabs
14076 ± 7% -44.9% 7754 ± 20% slabinfo.eventpoll_pwq.active_objs
251.00 ± 7% -45.0% 138.00 ± 20% slabinfo.eventpoll_pwq.active_slabs
14076 ± 7% -44.9% 7754 ± 20% slabinfo.eventpoll_pwq.num_objs
251.00 ± 7% -45.0% 138.00 ± 20% slabinfo.eventpoll_pwq.num_slabs
12445 ± 6% -11.9% 10970 ± 9% slabinfo.fsnotify_mark_connector.active_objs
12445 ± 6% -11.9% 10970 ± 9% slabinfo.fsnotify_mark_connector.num_objs
102916 ± 3% -11.8% 90744 ± 7% slabinfo.ftrace_event_field.active_objs
1211 ± 3% -11.8% 1068 ± 7% slabinfo.ftrace_event_field.active_slabs
102988 ± 3% -11.8% 90837 ± 7% slabinfo.ftrace_event_field.num_objs
1211 ± 3% -11.8% 1068 ± 7% slabinfo.ftrace_event_field.num_slabs
189531 ± 2% -24.0% 144058 ± 26% slabinfo.kmalloc-16.active_objs
194789 -21.0% 153852 ± 23% slabinfo.kmalloc-16.num_objs
21747 ± 2% -18.2% 17792 ± 22% slabinfo.kmalloc-192.active_objs
625.00 ± 6% -16.9% 519.33 ± 21% slabinfo.kmalloc-256.active_slabs
20005 ± 6% -16.8% 16635 ± 21% slabinfo.kmalloc-256.num_objs
625.00 ± 6% -16.9% 519.33 ± 21% slabinfo.kmalloc-256.num_slabs
11318 ± 3% -10.4% 10136 ± 4% slabinfo.kmalloc-2k.num_objs
2730 ± 5% -11.8% 2409 ± 2% slabinfo.kmalloc-4k.active_objs
404.00 ± 9% -19.5% 325.33 ± 2% slabinfo.kmalloc-4k.active_slabs
3235 ± 9% -19.5% 2605 ± 2% slabinfo.kmalloc-4k.num_objs
404.00 ± 9% -19.5% 325.33 ± 2% slabinfo.kmalloc-4k.num_slabs
31144 ± 6% -19.6% 25030 ± 24% slabinfo.kmalloc-512.active_objs
1015 ± 6% -19.1% 821.33 ± 24% slabinfo.kmalloc-512.active_slabs
32487 ± 6% -19.0% 26302 ± 24% slabinfo.kmalloc-512.num_objs
1015 ± 6% -19.1% 821.33 ± 24% slabinfo.kmalloc-512.num_slabs
201643 ± 2% -30.4% 140266 ± 35% slabinfo.kmalloc-8.active_objs
201783 ± 2% -30.5% 140266 ± 35% slabinfo.kmalloc-8.num_objs
17959 ± 4% -9.8% 16191 ± 6% slabinfo.kmalloc-96.num_objs
68411 ± 18% -8.0% 62937 ± 17% slabinfo.kmalloc-rcl-64.active_objs
1093 ± 18% -8.0% 1005 ± 17% slabinfo.kmalloc-rcl-64.active_slabs
69989 ± 18% -8.0% 64378 ± 17% slabinfo.kmalloc-rcl-64.num_objs
1093 ± 18% -8.0% 1005 ± 17% slabinfo.kmalloc-rcl-64.num_slabs
29342 ± 2% -9.2% 26640 ± 9% slabinfo.kmalloc-rcl-96.active_objs
29342 ± 2% -9.2% 26640 ± 9% slabinfo.kmalloc-rcl-96.num_objs
676.00 ± 64% -51.2% 330.00 ± 45% slabinfo.nfs_commit_data.active_objs
676.00 ± 64% -51.2% 330.00 ± 45% slabinfo.nfs_commit_data.num_objs
12088 ± 10% -18.9% 9809 ± 11% slabinfo.proc_dir_entry.active_objs
12606 ± 10% -18.2% 10306 ± 11% slabinfo.proc_dir_entry.num_objs
24949 ± 8% -13.0% 21700 ± 19% slabinfo.skbuff_head_cache.active_objs
784.00 ± 8% -12.8% 684.00 ± 19% slabinfo.skbuff_head_cache.active_slabs
25100 ± 8% -12.7% 21901 ± 19% slabinfo.skbuff_head_cache.num_objs
784.00 ± 8% -12.8% 684.00 ± 19% slabinfo.skbuff_head_cache.num_slabs
43024 ± 3% -19.1% 34786 ± 4% slabinfo.sock_inode_cache.active_objs
1122 ± 2% -18.9% 910.33 ± 3% slabinfo.sock_inode_cache.active_slabs
43794 ± 2% -18.9% 35518 ± 3% slabinfo.sock_inode_cache.num_objs
1122 ± 2% -18.9% 910.33 ± 3% slabinfo.sock_inode_cache.num_slabs
5489 ± 4% -20.2% 4378 ± 11% slabinfo.taskstats.active_objs
5489 ± 4% -20.2% 4378 ± 11% slabinfo.taskstats.num_objs
127682 ± 3% +14.6% 146296 ± 7% slabinfo.vm_area_struct.active_objs
3209 ± 3% +14.8% 3683 ± 7% slabinfo.vm_area_struct.active_slabs
128391 ± 3% +14.8% 147334 ± 7% slabinfo.vm_area_struct.num_objs
3209 ± 3% +14.8% 3683 ± 7% slabinfo.vm_area_struct.num_slabs
189.50 ± 13% -23.3% 145.33 ± 3% interrupts.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
247.00 ± 14% -55.7% 109.33 ± 35% interrupts.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
209.50 ± 10% -15.0% 178.00 ± 14% interrupts.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
281.00 -41.9% 163.33 ± 18% interrupts.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
239.50 ± 16% -22.5% 185.67 ± 18% interrupts.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
258.00 ± 18% -24.7% 194.33 ± 31% interrupts.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
266.50 ± 7% -9.1% 242.33 ± 13% interrupts.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
255.00 ± 9% -28.4% 182.67 ± 32% interrupts.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
237.50 ± 25% -32.5% 160.33 ± 46% interrupts.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
249.50 ± 2% -36.7% 158.00 ± 14% interrupts.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
246.50 ± 7% -38.3% 152.00 ± 37% interrupts.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
223.50 ± 21% -30.4% 155.67 ± 36% interrupts.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
208.50 ± 11% -26.9% 152.33 ± 39% interrupts.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
236.00 ± 18% -41.7% 137.67 ± 24% interrupts.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
223.00 ± 2% -44.1% 124.67 ± 20% interrupts.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
209.00 ± 21% -19.6% 168.00 ± 33% interrupts.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
245.00 ± 19% -39.9% 147.33 ± 30% interrupts.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
283.50 ± 5% -24.2% 215.00 ± 12% interrupts.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
234.00 ± 19% -19.1% 189.33 ± 29% interrupts.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
266.00 ± 16% -48.5% 137.00 ± 40% interrupts.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
228.50 ± 7% -21.5% 179.33 ± 4% interrupts.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
497.00 ± 48% -69.8% 150.00 ± 45% interrupts.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
238.00 ± 11% -31.5% 163.00 ± 29% interrupts.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
222.50 ± 24% -35.4% 143.67 ± 44% interrupts.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
216.50 ± 28% -27.6% 156.67 ± 34% interrupts.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
362.50 ± 34% -49.1% 184.67 ± 15% interrupts.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
339.50 ± 21% -54.7% 153.67 ± 23% interrupts.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
265.50 ± 14% -36.5% 168.67 ± 40% interrupts.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
334.50 ± 37% -42.3% 193.00 ± 38% interrupts.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
252.00 ± 9% -28.6% 180.00 ± 20% interrupts.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
220.50 ± 9% -44.2% 123.00 ± 45% interrupts.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
272.50 ± 11% -45.3% 149.00 ± 34% interrupts.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
224.00 ± 6% -38.5% 137.67 ± 52% interrupts.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
254.00 ± 3% -49.9% 127.33 ± 47% interrupts.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
252.50 ± 12% -17.1% 209.33 ± 21% interrupts.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
474.50 ± 31% -59.0% 194.33 ± 32% interrupts.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
188.00 ± 10% -22.0% 146.67 ± 33% interrupts.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
252.00 -24.6% 190.00 ± 15% interrupts.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
277.50 ± 18% -43.2% 157.67 ± 27% interrupts.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
288.00 ± 22% -51.2% 140.67 ± 40% interrupts.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
277.50 ± 10% -42.2% 160.33 ± 54% interrupts.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
233.00 ± 16% -34.2% 153.33 ± 45% interrupts.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
239.50 ± 4% +134.8% 562.33 ± 47% interrupts.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
252.50 ± 7% -27.8% 182.33 ± 31% interrupts.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
237.00 ± 8% -37.1% 149.00 ± 31% interrupts.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
5196641 -1.5% 5119586 interrupts.CAL:Function_call_interrupts
207.50 ± 11% -26.9% 151.67 ± 40% interrupts.CPU0.36:PCI-MSI.31981569-edge.i40e-eth0-TxRx-0
11528 ± 12% +43.7% 16565 ± 14% interrupts.CPU0.RES:Rescheduling_interrupts
338.00 ± 99% -42.8% 193.33 ±139% interrupts.CPU1.IWI:IRQ_work_interrupts
265.00 ± 16% -48.6% 136.33 ± 40% interrupts.CPU10.46:PCI-MSI.31981579-edge.i40e-eth0-TxRx-10
228.50 ± 7% -21.8% 178.67 ± 4% interrupts.CPU11.47:PCI-MSI.31981580-edge.i40e-eth0-TxRx-11
36249 ± 38% -47.3% 19095 ± 51% interrupts.CPU13.RES:Rescheduling_interrupts
496.50 ± 48% -69.9% 149.33 ± 45% interrupts.CPU14.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
49124 ± 65% -29.3% 34751 ± 88% interrupts.CPU14.RES:Rescheduling_interrupts
237.50 ± 11% -31.6% 162.33 ± 29% interrupts.CPU15.51:PCI-MSI.31981584-edge.i40e-eth0-TxRx-15
11385 ± 6% +130.0% 26186 ± 29% interrupts.CPU15.RES:Rescheduling_interrupts
10280 ± 9% -16.5% 8585 ± 5% interrupts.CPU15.TLB:TLB_shootdowns
222.00 ± 24% -35.6% 143.00 ± 44% interrupts.CPU16.52:PCI-MSI.31981585-edge.i40e-eth0-TxRx-16
216.00 ± 28% -27.8% 156.00 ± 34% interrupts.CPU17.53:PCI-MSI.31981586-edge.i40e-eth0-TxRx-17
11024 ± 4% -16.9% 9158 ± 9% interrupts.CPU18.TLB:TLB_shootdowns
11979 ± 6% -14.1% 10293 ± 2% interrupts.CPU2.TLB:TLB_shootdowns
15214 ± 3% -100.0% 0.00 interrupts.CPU20.316:PCI-MSI.376832-edge.ahci[0000:00:17.0]
34975 ± 32% -63.1% 12916 ± 17% interrupts.CPU21.RES:Rescheduling_interrupts
361.50 ± 34% -49.2% 183.67 ± 15% interrupts.CPU22.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
10851 ± 9% -15.1% 9210 ± 5% interrupts.CPU23.TLB:TLB_shootdowns
338.50 ± 22% -54.9% 152.67 ± 23% interrupts.CPU25.61:PCI-MSI.31981594-edge.i40e-eth0-TxRx-25
8723 ± 5% +60.3% 13986 ± 12% interrupts.CPU26.TLB:TLB_shootdowns
9499 ± 8% +35.0% 12828 ± 9% interrupts.CPU27.TLB:TLB_shootdowns
15026 ± 3% +108.6% 31337 ± 42% interrupts.CPU28.RES:Rescheduling_interrupts
236.00 ± 18% -41.7% 137.67 ± 24% interrupts.CPU3.39:PCI-MSI.31981572-edge.i40e-eth0-TxRx-3
265.00 ± 15% -36.6% 168.00 ± 40% interrupts.CPU30.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
9192 +47.3% 13540 ± 26% interrupts.CPU32.TLB:TLB_shootdowns
49344 ± 17% -36.8% 31186 ± 27% interrupts.CPU33.RES:Rescheduling_interrupts
334.00 ± 37% -42.4% 192.33 ± 38% interrupts.CPU34.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34
8832 ± 6% +39.9% 12360 ± 10% interrupts.CPU34.TLB:TLB_shootdowns
251.00 ± 9% -28.6% 179.33 ± 21% interrupts.CPU35.71:PCI-MSI.31981604-edge.i40e-eth0-TxRx-35
54182 ± 4% -4.7% 51644 interrupts.CPU35.CAL:Function_call_interrupts
66589 ± 21% -31.2% 45839 ± 43% interrupts.CPU35.RES:Rescheduling_interrupts
220.00 ± 9% -44.4% 122.33 ± 45% interrupts.CPU37.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
9638 +36.3% 13140 ± 14% interrupts.CPU37.TLB:TLB_shootdowns
272.00 ± 12% -45.6% 148.00 ± 35% interrupts.CPU38.74:PCI-MSI.31981607-edge.i40e-eth0-TxRx-38
223.50 ± 6% -38.7% 137.00 ± 52% interrupts.CPU39.75:PCI-MSI.31981608-edge.i40e-eth0-TxRx-39
222.50 ± 2% -44.4% 123.67 ± 20% interrupts.CPU4.40:PCI-MSI.31981573-edge.i40e-eth0-TxRx-4
48771 ± 20% -54.5% 22178 ± 69% interrupts.CPU4.RES:Rescheduling_interrupts
253.50 ± 3% -50.0% 126.67 ± 48% interrupts.CPU40.76:PCI-MSI.31981609-edge.i40e-eth0-TxRx-40
20806 ± 44% +169.1% 55997 ± 27% interrupts.CPU41.RES:Rescheduling_interrupts
252.00 ± 11% -16.9% 209.33 ± 21% interrupts.CPU42.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
3579 ± 2% +104.6% 7322 interrupts.CPU43.NMI:Non-maskable_interrupts
3579 ± 2% +104.6% 7322 interrupts.CPU43.PMI:Performance_monitoring_interrupts
474.00 ± 31% -59.1% 193.67 ± 33% interrupts.CPU44.80:PCI-MSI.31981613-edge.i40e-eth0-TxRx-44
5428 ± 33% -33.7% 3598 interrupts.CPU45.NMI:Non-maskable_interrupts
5428 ± 33% -33.7% 3598 interrupts.CPU45.PMI:Performance_monitoring_interrupts
187.00 ± 10% -21.9% 146.00 ± 34% interrupts.CPU46.82:PCI-MSI.31981615-edge.i40e-eth0-TxRx-46
44491 ± 32% -58.3% 18541 ± 18% interrupts.CPU47.RES:Rescheduling_interrupts
251.50 -24.9% 189.00 ± 15% interrupts.CPU49.85:PCI-MSI.31981618-edge.i40e-eth0-TxRx-49
52555 ± 9% -47.1% 27784 ± 36% interrupts.CPU5.RES:Rescheduling_interrupts
17185 ± 8% +280.0% 65295 ± 59% interrupts.CPU50.RES:Rescheduling_interrupts
11869 ± 16% -22.4% 9213 ± 5% interrupts.CPU50.TLB:TLB_shootdowns
277.50 ± 18% -43.4% 157.00 ± 27% interrupts.CPU51.87:PCI-MSI.31981620-edge.i40e-eth0-TxRx-51
287.50 ± 22% -51.3% 140.00 ± 40% interrupts.CPU52.88:PCI-MSI.31981621-edge.i40e-eth0-TxRx-52
7279 -32.6% 4904 ± 35% interrupts.CPU52.NMI:Non-maskable_interrupts
7279 -32.6% 4904 ± 35% interrupts.CPU52.PMI:Performance_monitoring_interrupts
11162 ± 12% -17.9% 9161 ± 5% interrupts.CPU53.TLB:TLB_shootdowns
64556 ± 34% -56.4% 28141 ± 65% interrupts.CPU54.RES:Rescheduling_interrupts
277.00 ± 11% -42.5% 159.33 ± 54% interrupts.CPU55.91:PCI-MSI.31981624-edge.i40e-eth0-TxRx-55
60234 ± 7% -56.1% 26417 ± 52% interrupts.CPU56.RES:Rescheduling_interrupts
9718 ± 2% -9.6% 8787 ± 5% interrupts.CPU56.TLB:TLB_shootdowns
232.50 ± 16% -34.5% 152.33 ± 45% interrupts.CPU57.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57
52441 ± 71% -54.9% 23644 ± 72% interrupts.CPU58.RES:Rescheduling_interrupts
239.00 ± 4% +135.1% 562.00 ± 47% interrupts.CPU59.95:PCI-MSI.31981628-edge.i40e-eth0-TxRx-59
208.00 ± 21% -19.7% 167.00 ± 34% interrupts.CPU6.42:PCI-MSI.31981575-edge.i40e-eth0-TxRx-6
251.50 ± 7% -27.8% 181.67 ± 31% interrupts.CPU60.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
236.00 ± 8% -37.3% 148.00 ± 32% interrupts.CPU61.97:PCI-MSI.31981630-edge.i40e-eth0-TxRx-61
10474 ± 4% +261.6% 37874 ± 31% interrupts.CPU61.RES:Rescheduling_interrupts
65859 ± 19% -61.5% 25369 ± 58% interrupts.CPU62.RES:Rescheduling_interrupts
188.50 ± 13% -23.4% 144.33 ± 3% interrupts.CPU64.100:PCI-MSI.31981633-edge.i40e-eth0-TxRx-64
11472 ± 2% +37.6% 15784 ± 14% interrupts.CPU67.RES:Rescheduling_interrupts
246.50 ± 14% -56.1% 108.33 ± 35% interrupts.CPU68.104:PCI-MSI.31981637-edge.i40e-eth0-TxRx-68
208.50 ± 10% -15.1% 177.00 ± 14% interrupts.CPU69.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69
244.00 ± 19% -39.8% 147.00 ± 30% interrupts.CPU7.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
22442 ± 8% +67.5% 37588 ± 4% interrupts.CPU70.RES:Rescheduling_interrupts
12712 ± 15% -31.2% 8743 ± 11% interrupts.CPU71.TLB:TLB_shootdowns
280.00 -42.0% 162.33 ± 18% interrupts.CPU73.109:PCI-MSI.31981642-edge.i40e-eth0-TxRx-73
53387 ± 44% -52.5% 25361 ± 71% interrupts.CPU73.RES:Rescheduling_interrupts
239.00 ± 16% -22.6% 185.00 ± 17% interrupts.CPU74.110:PCI-MSI.31981643-edge.i40e-eth0-TxRx-74
8696 ± 7% +44.6% 12576 ± 6% interrupts.CPU74.TLB:TLB_shootdowns
257.00 ± 19% -24.8% 193.33 ± 31% interrupts.CPU75.111:PCI-MSI.31981644-edge.i40e-eth0-TxRx-75
265.50 ± 7% -9.1% 241.33 ± 13% interrupts.CPU76.112:PCI-MSI.31981645-edge.i40e-eth0-TxRx-76
254.50 ± 8% -28.5% 182.00 ± 32% interrupts.CPU77.113:PCI-MSI.31981646-edge.i40e-eth0-TxRx-77
11264 ± 6% -9.9% 10148 ± 15% interrupts.CPU77.TLB:TLB_shootdowns
283.00 ± 4% -24.3% 214.33 ± 12% interrupts.CPU8.44:PCI-MSI.31981577-edge.i40e-eth0-TxRx-8
45550 -67.7% 14725 ± 27% interrupts.CPU8.RES:Rescheduling_interrupts
237.00 ± 25% -32.5% 160.00 ± 46% interrupts.CPU80.116:PCI-MSI.31981649-edge.i40e-eth0-TxRx-80
7287 -33.0% 4879 ± 35% interrupts.CPU80.NMI:Non-maskable_interrupts
7287 -33.0% 4879 ± 35% interrupts.CPU80.PMI:Performance_monitoring_interrupts
249.00 ± 2% -36.9% 157.00 ± 14% interrupts.CPU81.117:PCI-MSI.31981650-edge.i40e-eth0-TxRx-81
31280 ± 2% -43.2% 17755 ± 17% interrupts.CPU81.RES:Rescheduling_interrupts
223.00 ± 5% -26.0% 165.00 ± 36% interrupts.CPU82.118:PCI-MSI.31981651-edge.i40e-eth0-TxRx-82
18648 ± 9% +194.1% 54837 ± 49% interrupts.CPU82.RES:Rescheduling_interrupts
28294 ± 47% -55.4% 12605 ± 13% interrupts.CPU83.RES:Rescheduling_interrupts
8396 ± 5% +36.6% 11470 ± 17% interrupts.CPU84.TLB:TLB_shootdowns
245.50 ± 7% -38.5% 151.00 ± 38% interrupts.CPU85.121:PCI-MSI.31981654-edge.i40e-eth0-TxRx-85
223.00 ± 21% -30.2% 155.67 ± 36% interrupts.CPU87.123:PCI-MSI.31981656-edge.i40e-eth0-TxRx-87
35786 ± 8% +167.3% 95668 ± 31% interrupts.CPU87.RES:Rescheduling_interrupts
234.00 ± 19% -19.2% 189.00 ± 29% interrupts.CPU9.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9
49224 ± 3% -40.4% 29349 ± 29% interrupts.CPU9.RES:Rescheduling_interrupts
9201 +27.4% 11724 ± 7% interrupts.CPU90.TLB:TLB_shootdowns
7248 -33.0% 4859 ± 35% interrupts.CPU91.NMI:Non-maskable_interrupts
7248 -33.0% 4859 ± 35% interrupts.CPU91.PMI:Performance_monitoring_interrupts
40308 ± 50% -39.3% 24465 ± 66% interrupts.CPU91.RES:Rescheduling_interrupts
22340 ± 24% -21.4% 17561 ± 39% interrupts.CPU94.RES:Rescheduling_interrupts
17.84 ± 45% -10.5 7.38 ± 15% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
17.70 ± 46% -10.4 7.32 ± 15% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.51 ±100% -8.5 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_move_pages.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.51 ±100% -8.5 0.00 perf-profile.calltrace.cycles-pp.kernel_move_pages.__x64_sys_move_pages.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.93 -3.8 7.14 ± 70% perf-profile.calltrace.cycles-pp.personality
11.08 ± 33% -3.3 7.79 ± 70% perf-profile.calltrace.cycles-pp.__GI___libc_read
10.79 ± 33% -3.2 7.55 ± 72% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read
10.74 ± 34% -3.2 7.51 ± 72% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
10.53 ± 34% -3.2 7.31 ± 73% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
10.63 ± 34% -3.2 7.43 ± 72% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
9.39 ± 9% -2.9 6.51 ± 53% perf-profile.calltrace.cycles-pp.__GI___libc_open
9.38 ± 9% -2.9 6.50 ± 53% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_open
9.38 ± 9% -2.9 6.50 ± 53% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open
2.88 ±100% -2.9 0.00 perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.44 ± 10% -2.6 5.82 ± 53% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open
8.44 ± 10% -2.6 5.83 ± 53% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open
8.38 ± 10% -2.6 5.79 ± 53% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.38 ± 10% -2.6 5.79 ± 53% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
6.42 -2.2 4.18 ± 70% perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
6.52 -2.0 4.49 ± 59% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.37 ±100% -2.0 1.39 ±141% perf-profile.calltrace.cycles-pp.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.96 ±100% -1.7 1.23 ±141% perf-profile.calltrace.cycles-pp.schedule.__x64_sys_sched_yield.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.40 -1.6 2.81 ± 70% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_read.new_sync_read.vfs_read.ksys_read
4.08 -1.5 2.60 ± 70% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_read.new_sync_read.vfs_read
4.06 -1.5 2.59 ± 70% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_read.new_sync_read
4.05 -1.5 2.59 ± 70% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_read
3.80 -1.4 2.42 ± 70% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up
3.67 -1.3 2.34 ± 70% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate
3.34 -1.2 2.13 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task
3.29 -1.2 2.10 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
3.12 ± 2% -1.1 1.98 ± 70% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.personality
3.81 ± 2% -1.1 2.69 ± 56% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.31 -1.1 2.19 ± 70% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
3.76 -1.1 2.67 ± 51% perf-profile.calltrace.cycles-pp.vfs_tmpfile.path_openat.do_filp_open.do_sys_openat2.do_sys_open
3.71 -1.1 2.62 ± 56% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
3.44 ±100% -1.1 2.36 ±141% perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.92 -1.1 1.85 ± 70% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
2.92 -1.1 1.85 ± 70% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
2.91 -1.1 1.85 ± 70% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
2.92 ± 3% -0.8 2.10 ± 51% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_close
2.02 -0.7 1.27 ± 70% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.personality
1.91 -0.7 1.23 ± 70% perf-profile.calltrace.cycles-pp.shmem_tmpfile.vfs_tmpfile.path_openat.do_filp_open.do_sys_openat2
1.83 -0.7 1.18 ± 70% perf-profile.calltrace.cycles-pp.path_lookupat.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.83 -0.6 1.19 ± 70% perf-profile.calltrace.cycles-pp.d_alloc.vfs_tmpfile.path_openat.do_filp_open.do_sys_openat2
1.84 -0.6 1.19 ± 70% perf-profile.calltrace.cycles-pp.d_tmpfile.shmem_tmpfile.vfs_tmpfile.path_openat.do_filp_open
1.83 -0.6 1.18 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock.d_tmpfile.shmem_tmpfile.vfs_tmpfile.path_openat
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.d_tmpfile.shmem_tmpfile.vfs_tmpfile
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.unlazy_walk.complete_walk.path_lookupat.path_openat.do_filp_open
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.complete_walk.path_lookupat.path_openat.do_filp_open.do_sys_openat2
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.legitimize_path.unlazy_walk.complete_walk.path_lookupat.path_openat
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.lockref_get_not_dead.legitimize_path.unlazy_walk.complete_walk.path_lookupat
1.80 -0.6 1.16 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.lockref_get_not_dead.legitimize_path.unlazy_walk
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock.lockref_get_not_dead.legitimize_path.unlazy_walk.complete_walk
1.81 -0.6 1.18 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock.d_alloc.vfs_tmpfile.path_openat.do_filp_open
1.81 -0.6 1.17 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.d_alloc.vfs_tmpfile.path_openat
1.40 -0.5 0.88 ± 70% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
1.40 -0.5 0.89 ± 70% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
1.31 -0.5 0.83 ± 70% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.29 -0.5 0.82 ± 70% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.36 -0.5 0.89 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock.__lock_parent.dput.__fput.task_work_run
1.36 -0.5 0.89 ± 70% perf-profile.calltrace.cycles-pp.__lock_parent.dput.__fput.task_work_run.exit_to_usermode_loop
1.35 -0.5 0.89 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__lock_parent.dput.__fput
1.20 ± 3% -0.4 0.75 ± 70% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.23 -0.4 0.78 ± 70% perf-profile.calltrace.cycles-pp.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
1.23 -0.4 0.78 ± 70% perf-profile.calltrace.cycles-pp.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.08 -0.4 0.71 ± 70% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.personality
0.96 -0.3 0.61 ± 70% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues
0.96 -0.3 0.61 ± 70% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup
0.96 -0.3 0.61 ± 70% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.hrtimer_wakeup.__hrtimer_run_queues.hrtimer_interrupt
0.94 -0.3 0.61 ± 70% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open
0.94 -0.3 0.61 ± 70% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open
0.86 -0.3 0.55 ± 70% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.85 -0.3 0.55 ± 70% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common
1.83 ± 2% -0.2 1.66 ± 10% perf-profile.calltrace.cycles-pp._vm_unmap_aliases.change_page_attr_set_clr.set_memory_x.bpf_int_jit_compile.bpf_prog_select_runtime
1.75 ± 2% -0.2 1.58 ± 10% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock._vm_unmap_aliases.change_page_attr_set_clr.set_memory_x
1.79 ± 2% -0.2 1.64 ± 10% perf-profile.calltrace.cycles-pp.__mutex_lock._vm_unmap_aliases.change_page_attr_set_clr.set_memory_x.bpf_int_jit_compile
1.86 ± 2% -0.2 1.71 ± 9% perf-profile.calltrace.cycles-pp.change_page_attr_set_clr.set_memory_x.bpf_int_jit_compile.bpf_prog_select_runtime.bpf_prepare_filter
1.86 ± 2% -0.2 1.71 ± 9% perf-profile.calltrace.cycles-pp.set_memory_x.bpf_int_jit_compile.bpf_prog_select_runtime.bpf_prepare_filter.bpf_prog_create_from_user
0.58 ± 5% +0.1 0.73 ± 6% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
0.59 ± 5% +0.2 0.75 ± 6% perf-profile.calltrace.cycles-pp.page_fault
0.26 ±100% +0.4 0.62 ± 6% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_page_fault.page_fault
0.26 ±100% +0.4 0.64 ± 6% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_page_fault.page_fault
0.00 +0.6 0.58 ± 7% perf-profile.calltrace.cycles-pp.handle_pte_fault.__handle_mm_fault.handle_mm_fault.do_page_fault.page_fault
5.03 ± 53% -5.0 0.00 perf-profile.children.cycles-pp.__sched_text_start
11.17 ± 32% -3.3 7.87 ± 70% perf-profile.children.cycles-pp.__GI___libc_read
10.54 ± 34% -3.2 7.33 ± 73% perf-profile.children.cycles-pp.vfs_read
10.64 ± 34% -3.2 7.44 ± 72% perf-profile.children.cycles-pp.ksys_read
14.98 ± 4% -3.2 11.83 ± 31% perf-profile.children.cycles-pp._raw_spin_lock
9.39 ± 9% -2.9 6.51 ± 53% perf-profile.children.cycles-pp.__GI___libc_open
8.44 ± 10% -2.6 5.83 ± 53% perf-profile.children.cycles-pp.do_sys_open
8.44 ± 10% -2.6 5.83 ± 53% perf-profile.children.cycles-pp.do_sys_openat2
8.39 ± 10% -2.6 5.79 ± 53% perf-profile.children.cycles-pp.do_filp_open
8.38 ± 10% -2.6 5.79 ± 53% perf-profile.children.cycles-pp.path_openat
6.43 -2.2 4.19 ± 70% perf-profile.children.cycles-pp.pipe_read
28.86 ± 2% -2.1 26.78 ± 2% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
6.53 -2.0 4.49 ± 59% perf-profile.children.cycles-pp.new_sync_read
6.62 ± 3% -1.9 4.77 ± 43% perf-profile.children.cycles-pp.try_to_wake_up
4.94 -1.8 3.17 ± 69% perf-profile.children.cycles-pp.__wake_up_common_lock
4.54 -1.6 2.90 ± 70% perf-profile.children.cycles-pp.autoremove_wake_function
4.60 -1.6 2.96 ± 69% perf-profile.children.cycles-pp.__wake_up_common
4.56 -1.5 3.04 ± 68% perf-profile.children.cycles-pp.__GI___libc_write
4.75 ± 3% -1.4 3.38 ± 45% perf-profile.children.cycles-pp.enqueue_task_fair
4.75 ± 3% -1.4 3.38 ± 45% perf-profile.children.cycles-pp.activate_task
4.73 ± 3% -1.4 3.38 ± 45% perf-profile.children.cycles-pp.ttwu_do_activate
4.64 ± 3% -1.3 3.31 ± 45% perf-profile.children.cycles-pp.enqueue_entity
3.95 -1.3 2.64 ± 68% perf-profile.children.cycles-pp.ksys_write
3.83 -1.3 2.56 ± 68% perf-profile.children.cycles-pp.vfs_write
4.44 ± 2% -1.3 3.18 ± 45% perf-profile.children.cycles-pp.__account_scheduler_latency
3.45 -1.2 2.28 ± 70% perf-profile.children.cycles-pp.new_sync_write
3.33 -1.1 2.20 ± 70% perf-profile.children.cycles-pp.pipe_write
4.69 ± 3% -1.1 3.58 ± 42% perf-profile.children.cycles-pp.entry_SYSCALL_64
3.76 -1.1 2.67 ± 51% perf-profile.children.cycles-pp.vfs_tmpfile
3.87 ± 3% -1.1 2.79 ± 52% perf-profile.children.cycles-pp.task_work_run
3.85 ± 3% -1.1 2.78 ± 52% perf-profile.children.cycles-pp.__fput
3.44 ±100% -1.1 2.36 ±141% perf-profile.children.cycles-pp.proc_reg_read
3.91 ± 3% -1.1 2.85 ± 49% perf-profile.children.cycles-pp.exit_to_usermode_loop
3.87 ± 9% -1.0 2.84 ± 42% perf-profile.children.cycles-pp.syscall_return_via_sysret
2.86 ± 2% -0.7 2.15 ± 39% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
1.88 -0.7 1.20 ± 70% perf-profile.children.cycles-pp.hrtimer_wakeup
2.29 -0.7 1.63 ± 52% perf-profile.children.cycles-pp.__hrtimer_run_queues
3.08 -0.6 2.45 ± 34% perf-profile.children.cycles-pp.apic_timer_interrupt
2.45 -0.6 1.82 ± 45% perf-profile.children.cycles-pp.hrtimer_interrupt
1.91 -0.6 1.35 ± 51% perf-profile.children.cycles-pp.shmem_tmpfile
1.85 ± 2% -0.5 1.31 ± 52% perf-profile.children.cycles-pp.lockref_get_not_dead
1.83 -0.5 1.30 ± 51% perf-profile.children.cycles-pp.path_lookupat
1.84 -0.5 1.31 ± 51% perf-profile.children.cycles-pp.d_alloc
1.83 -0.5 1.30 ± 51% perf-profile.children.cycles-pp.legitimize_path
1.84 -0.5 1.31 ± 51% perf-profile.children.cycles-pp.d_tmpfile
1.83 -0.5 1.30 ± 51% perf-profile.children.cycles-pp.unlazy_walk
1.83 -0.5 1.30 ± 51% perf-profile.children.cycles-pp.complete_walk
1.81 -0.5 1.31 ± 52% perf-profile.children.cycles-pp.__lock_parent
1.21 ± 3% -0.3 0.87 ± 43% perf-profile.children.cycles-pp.schedule_idle
1.86 ± 2% -0.2 1.71 ± 9% perf-profile.children.cycles-pp.set_memory_x
0.47 ± 19% -0.1 0.35 ± 42% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.23 ± 2% -0.0 0.21 ± 6% perf-profile.children.cycles-pp.scheduler_tick
0.30 -0.0 0.29 perf-profile.children.cycles-pp.tick_sched_handle
0.14 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret
0.03 ±100% +0.0 0.07 ± 14% perf-profile.children.cycles-pp.isolate_lru_page
0.24 ± 16% +0.0 0.29 perf-profile.children.cycles-pp.rmap_walk_anon
0.00 +0.1 0.05 perf-profile.children.cycles-pp.vm_normal_page
0.00 +4.9 4.87 ± 44% perf-profile.children.cycles-pp.__schedule
28.77 ± 2% -2.1 26.72 ± 2% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
3.83 ± 8% -1.0 2.82 ± 41% perf-profile.self.cycles-pp.syscall_return_via_sysret
1.38 ± 7% -0.4 0.94 ± 43% perf-profile.self.cycles-pp.do_syscall_64
1.30 ± 7% -0.4 0.93 ± 33% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.31 ± 3% -0.1 0.20 ± 70% perf-profile.self.cycles-pp.__mutex_lock
0.08 ± 6% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.14 ± 3% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret
0.03 ±100% +0.0 0.06 perf-profile.self.cycles-pp.migrate_page_copy
0.00 +0.5 0.46 ± 62% perf-profile.self.cycles-pp.__schedule
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 4 months
- 1
- 0
[cpufreq] 06c4d00466: will-it-scale.per_process_ops -53.4% regression
by kernel test robot
Greeting,
FYI, we noticed a -53.4% regression of will-it-scale.per_process_ops due to commit:
commit: 06c4d00466eb374841bc84c39af19b3161ff6917 ("[patch 09/22] cpufreq: Convert to new X86 CPU match macros")
url: https://github.com/0day-ci/linux/commits/Thomas-Gleixner/x86-devicetable-...
base: https://git.kernel.org/cgit/linux/kernel/git/rafael/linux-pm.git linux-next
in testcase: will-it-scale
on test machine: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
with following parameters:
nr_task: 16
mode: process
test: read2
cpufreq_governor: performance
ucode: 0x21
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
+------------------+------------------------------------------------------------------------+
| testcase: change | hackbench: hackbench.throughput -50.9% regression |
| test machine | 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory |
| test parameters | cpufreq_governor=performance |
| | ipc=socket |
| | mode=process |
| | nr_threads=100% |
| | ucode=0x21 |
+------------------+------------------------------------------------------------------------+
| testcase: change | fio-basic: fio.write_bw_MBps -15.4% regression |
| test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory |
| test parameters | bs=4k |
| | cpufreq_governor=performance |
| | disk=1SSD |
| | fs2=nfsv4 |
| | fs=ext4 |
| | ioengine=sync |
| | nr_task=100% |
| | runtime=300s |
| | rw=write |
| | test_size=128G |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -53.4% regression |
| test machine | 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=16 |
| | test=malloc2 |
| | ucode=0x21 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -57.9% regression |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=16 |
| | test=pthread_mutex1 |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_thread_ops -53.5% regression |
| test machine | 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory |
| test parameters | cpufreq_governor=performance |
| | mode=thread |
| | nr_task=16 |
| | test=pipe1 |
| | ucode=0x21 |
+------------------+------------------------------------------------------------------------+
| testcase: change | lmbench3: lmbench3.MMAP.read.bandwidth.MB/sec -36.3% regression |
| test machine | 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory |
| test parameters | cpufreq_governor=performance |
| | mode=development |
| | nr_threads=50% |
| | test=MMAP |
| | test_memory_size=50% |
| | ucode=0x7000019 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_thread_ops -58.4% regression |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=thread |
| | nr_task=16 |
| | test=signal1 |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | reaim: reaim.jobs_per_min -51.7% regression |
| test machine | 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=100% |
| | runtime=300s |
| | test=shared |
| | ucode=0x21 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -58.3% regression |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=16 |
| | test=pread2 |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -52.9% regression |
| test machine | 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory |
| test parameters | cpufreq_governor=performance |
| | test=pthread_mutex1 |
| | ucode=0x21 |
+------------------+------------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score -56.4% regression |
| test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=1 |
| | runtime=300s |
| | test=fstime |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -56.6% regression |
| test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory |
| test parameters | cpufreq_governor=performance |
| | test=pread3 |
| | ucode=0xb000038 |
+------------------+------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/16/debian-x86_64-20191114.cgz/lkp-ivb-d02/read2/will-it-scale/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.RIP:__do_softirq
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:load_balance
1:4 -25% :4 dmesg.WARNING:at_ip__fsnotify_parent/0x
%stddev %change %stddev
\ | \
200508 -53.4% 93351 will-it-scale.per_process_ops
3208147 -53.4% 1493629 will-it-scale.workload
18743 ± 2% -9.3% 17000 ± 2% meminfo.Shmem
1906 ± 2% -10.5% 1705 ± 2% slabinfo.filp.num_objs
52213 ± 4% +11.5% 58205 ± 3% softirqs.CPU0.RCU
15301 +17.3% 17947 ± 2% softirqs.SCHED
561369 ± 3% -19.7% 450502 ± 5% cpuidle.C1E.time
9353 ± 4% -18.5% 7621 ± 6% cpuidle.C1E.usage
75.00 ± 41% -84.0% 12.00 ± 55% cpuidle.POLL.usage
75.00 -3.0% 72.75 vmstat.cpu.sy
24.00 +8.3% 26.00 vmstat.cpu.us
7333 -9.6% 6627 vmstat.system.cs
10892 -3.5% 10507 vmstat.system.in
65590 -4.6% 62541 proc-vmstat.nr_active_anon
63949 -4.1% 61328 proc-vmstat.nr_anon_pages
4685 ± 2% -9.3% 4251 ± 2% proc-vmstat.nr_shmem
65565 -4.6% 62523 proc-vmstat.nr_zone_active_anon
1619 ± 12% -38.8% 990.75 ± 14% proc-vmstat.pgactivate
347948 -1.0% 344441 proc-vmstat.pgfree
9529 ± 32% -59.2% 3888 ± 33% interrupts.CPU0.NMI:Non-maskable_interrupts
9529 ± 32% -59.2% 3888 ± 33% interrupts.CPU0.PMI:Performance_monitoring_interrupts
8786 ± 30% -56.2% 3851 ± 34% interrupts.CPU1.NMI:Non-maskable_interrupts
8786 ± 30% -56.2% 3851 ± 34% interrupts.CPU1.PMI:Performance_monitoring_interrupts
612263 +61.8% 990932 ± 33% interrupts.CPU2.LOC:Local_timer_interrupts
9495 ± 32% -57.1% 4074 ± 29% interrupts.CPU2.NMI:Non-maskable_interrupts
9495 ± 32% -57.1% 4074 ± 29% interrupts.CPU2.PMI:Performance_monitoring_interrupts
9584 ± 33% -59.9% 3840 ± 34% interrupts.CPU3.NMI:Non-maskable_interrupts
9584 ± 33% -59.9% 3840 ± 34% interrupts.CPU3.PMI:Performance_monitoring_interrupts
2763 ± 26% +61.8% 4472 ± 39% interrupts.CPU3.RES:Rescheduling_interrupts
37394 ± 19% -58.1% 15654 ± 33% interrupts.NMI:Non-maskable_interrupts
37394 ± 19% -58.1% 15654 ± 33% interrupts.PMI:Performance_monitoring_interrupts
8.09 ± 6% +95.0% 15.78 ± 6% sched_debug.cfs_rq:/.nr_spread_over.avg
2.80 ± 22% +76.7% 4.95 ± 11% sched_debug.cpu.clock.stddev
2.80 ± 22% +76.7% 4.95 ± 11% sched_debug.cpu.clock_task.stddev
438229 -10.4% 392443 sched_debug.cpu.nr_switches.avg
1517352 -21.2% 1195573 ± 21% sched_debug.cpu.nr_switches.max
623414 -24.4% 471096 ± 28% sched_debug.cpu.nr_switches.stddev
14.88 ± 24% -37.5% 9.29 ± 27% sched_debug.cpu.nr_uninterruptible.max
12.00 ± 17% -36.2% 7.65 ± 31% sched_debug.cpu.nr_uninterruptible.stddev
427216 -10.8% 381061 sched_debug.cpu.sched_count.avg
1504714 -21.4% 1183009 ± 21% sched_debug.cpu.sched_count.max
622334 -24.4% 470248 ± 28% sched_debug.cpu.sched_count.stddev
2092 ± 5% -17.1% 1733 ± 8% sched_debug.cpu.sched_goidle.avg
7392 ± 2% -22.0% 5765 ± 8% sched_debug.cpu.sched_goidle.max
3068 ± 2% -23.3% 2353 ± 8% sched_debug.cpu.sched_goidle.stddev
201296 -11.7% 177691 sched_debug.cpu.ttwu_count.avg
745070 -21.8% 582561 ± 21% sched_debug.cpu.ttwu_count.max
314071 -24.4% 237534 ± 28% sched_debug.cpu.ttwu_count.stddev
199498 -11.9% 175832 sched_debug.cpu.ttwu_local.avg
742719 -21.8% 580797 ± 22% sched_debug.cpu.ttwu_local.max
313751 -24.3% 237514 ± 28% sched_debug.cpu.ttwu_local.stddev
9.32 ± 2% +4.2% 9.71 perf-stat.i.MPKI
1.086e+09 -50.2% 5.413e+08 perf-stat.i.branch-instructions
1.15 +0.4 1.54 perf-stat.i.branch-miss-rate%
12695088 -33.1% 8486745 perf-stat.i.branch-misses
0.54 ± 3% +0.6 1.13 ± 8% perf-stat.i.cache-miss-rate%
246256 ± 2% +19.2% 293546 ± 6% perf-stat.i.cache-misses
52411761 ± 2% -48.3% 27076758 perf-stat.i.cache-references
7390 -9.7% 6670 perf-stat.i.context-switches
2.33 -2.6% 2.27 perf-stat.i.cpi
1.307e+10 -51.8% 6.306e+09 perf-stat.i.cpu-cycles
34220176 ± 18% -57.3% 14615385 perf-stat.i.dTLB-load-misses
2.468e+09 -52.0% 1.184e+09 perf-stat.i.dTLB-loads
7490630 ± 22% -58.6% 3104328 ± 2% perf-stat.i.dTLB-store-misses
1.986e+09 -52.7% 9.391e+08 perf-stat.i.dTLB-stores
3025273 ± 12% -54.1% 1388723 ± 8% perf-stat.i.iTLB-load-misses
2588287 ± 15% -52.3% 1233650 ± 10% perf-stat.i.iTLB-loads
5.623e+09 -50.4% 2.788e+09 perf-stat.i.instructions
0.43 +2.7% 0.44 perf-stat.i.ipc
9.32 ± 2% +4.2% 9.71 perf-stat.overall.MPKI
1.17 +0.4 1.57 perf-stat.overall.branch-miss-rate%
0.47 ± 4% +0.6 1.09 ± 7% perf-stat.overall.cache-miss-rate%
2.33 -2.7% 2.26 perf-stat.overall.cpi
53132 ± 2% -59.5% 21545 ± 5% perf-stat.overall.cycles-between-cache-misses
0.43 +2.8% 0.44 perf-stat.overall.ipc
527736 +6.7% 563118 perf-stat.overall.path-length
1.082e+09 -50.2% 5.395e+08 perf-stat.ps.branch-instructions
12653139 -33.1% 8460228 perf-stat.ps.branch-misses
245442 ± 2% +19.3% 292736 ± 6% perf-stat.ps.cache-misses
52238268 ± 2% -48.3% 26985343 perf-stat.ps.cache-references
7365 -9.8% 6644 perf-stat.ps.context-switches
1.303e+10 -51.8% 6.285e+09 perf-stat.ps.cpu-cycles
34106851 ± 18% -57.3% 14566371 perf-stat.ps.dTLB-load-misses
2.459e+09 -52.0% 1.18e+09 perf-stat.ps.dTLB-loads
7465822 ± 22% -58.6% 3094548 ± 2% perf-stat.ps.dTLB-store-misses
1.979e+09 -52.7% 9.36e+08 perf-stat.ps.dTLB-stores
3015254 ± 12% -54.1% 1384053 ± 8% perf-stat.ps.iTLB-load-misses
2579716 ± 15% -52.3% 1229518 ± 10% perf-stat.ps.iTLB-loads
5.604e+09 -50.4% 2.779e+09 perf-stat.ps.instructions
1.693e+12 -50.3% 8.411e+11 perf-stat.total.instructions
46.68 -1.2 45.47 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
62.98 -1.0 61.99 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
43.51 -0.9 42.59 perf-profile.calltrace.cycles-pp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
79.65 -0.8 78.83 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
80.71 -0.8 79.91 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
14.02 ± 4% -0.8 13.27 ± 2% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_read
99.08 -0.7 98.38 perf-profile.calltrace.cycles-pp.read
0.14 ±173% +0.4 0.56 ± 4% perf-profile.calltrace.cycles-pp.timestamp_truncate.current_time.atime_needs_update.touch_atime.shmem_file_read_iter
46.81 -1.2 45.59 perf-profile.children.cycles-pp.new_sync_read
63.05 -1.0 62.07 perf-profile.children.cycles-pp.ksys_read
43.70 -0.9 42.76 perf-profile.children.cycles-pp.shmem_file_read_iter
14.12 ± 4% -0.8 13.36 ± 2% perf-profile.children.cycles-pp.shmem_getpage_gfp
80.09 -0.5 79.54 perf-profile.children.cycles-pp.do_syscall_64
99.44 -0.5 98.90 perf-profile.children.cycles-pp.read
81.11 -0.5 80.58 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.03 ±100% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.01 ±173% +0.1 0.07 ± 15% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.03 ±100% +0.1 0.10 ± 24% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.04 ± 58% +0.1 0.11 ± 23% perf-profile.children.cycles-pp.handle_pte_fault
0.06 ± 11% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.__sched_text_start
0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.04 ± 58% +0.1 0.12 ± 25% perf-profile.children.cycles-pp.__handle_mm_fault
0.03 ±100% +0.1 0.10 ± 25% perf-profile.children.cycles-pp.schedule
0.03 ±102% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.search_binary_handler
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.load_elf_binary
0.04 ± 58% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.handle_mm_fault
0.03 ±100% +0.1 0.12 ± 24% perf-profile.children.cycles-pp.__do_execve_file
0.03 ±100% +0.1 0.12 ± 21% perf-profile.children.cycles-pp.__x64_sys_execve
0.07 ± 17% +0.1 0.16 ± 19% perf-profile.children.cycles-pp.page_fault
0.03 ±100% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.execve
0.05 ± 58% +0.1 0.14 ± 19% perf-profile.children.cycles-pp.do_page_fault
0.00 +0.1 0.10 ± 22% perf-profile.children.cycles-pp.write
0.47 ± 24% +0.1 0.58 ± 3% perf-profile.children.cycles-pp.timestamp_truncate
0.09 ± 7% +0.1 0.20 ± 5% perf-profile.children.cycles-pp.task_tick_fair
0.11 ± 4% +0.1 0.22 ± 6% perf-profile.children.cycles-pp.scheduler_tick
0.04 ± 60% +0.2 0.22 ± 28% perf-profile.children.cycles-pp.irq_work_run
0.04 ± 60% +0.2 0.22 ± 28% perf-profile.children.cycles-pp.printk
0.04 ± 60% +0.2 0.22 ± 28% perf-profile.children.cycles-pp.vprintk_emit
0.04 ± 60% +0.2 0.23 ± 26% perf-profile.children.cycles-pp.irq_work_interrupt
0.04 ± 60% +0.2 0.23 ± 26% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.04 ± 59% +0.2 0.24 ± 26% perf-profile.children.cycles-pp.drm_fb_helper_cfb_imageblit
0.04 ± 58% +0.2 0.24 ± 26% perf-profile.children.cycles-pp.cfb_imageblit
0.06 ± 13% +0.2 0.26 ± 26% perf-profile.children.cycles-pp.fbcon_putcs
0.07 ± 13% +0.2 0.27 ± 28% perf-profile.children.cycles-pp.lf
0.07 ± 13% +0.2 0.27 ± 28% perf-profile.children.cycles-pp.con_scroll
0.07 ± 13% +0.2 0.27 ± 28% perf-profile.children.cycles-pp.fbcon_scroll
0.07 ± 13% +0.2 0.27 ± 28% perf-profile.children.cycles-pp.fbcon_redraw
0.15 ± 9% +0.2 0.36 ± 16% perf-profile.children.cycles-pp.update_process_times
0.07 ± 13% +0.2 0.27 ± 29% perf-profile.children.cycles-pp.vt_console_print
0.07 ± 13% +0.2 0.28 ± 30% perf-profile.children.cycles-pp.console_unlock
0.15 ± 9% +0.2 0.36 ± 18% perf-profile.children.cycles-pp.tick_sched_handle
0.05 ± 58% +0.2 0.26 ± 26% perf-profile.children.cycles-pp.bit_putcs
0.07 ± 17% +0.2 0.29 ± 27% perf-profile.children.cycles-pp.irq_work_run_list
0.18 ± 10% +0.2 0.42 ± 17% perf-profile.children.cycles-pp.tick_sched_timer
2.16 ± 6% +0.3 2.44 ± 7% perf-profile.children.cycles-pp.__fsnotify_parent
0.27 ± 12% +0.3 0.59 ± 16% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.38 ± 10% +0.4 0.73 ± 12% perf-profile.children.cycles-pp.hrtimer_interrupt
0.48 ± 17% +0.4 0.89 ± 12% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.53 ± 15% +0.5 0.98 ± 10% perf-profile.children.cycles-pp.apic_timer_interrupt
0.58 ± 11% -0.1 0.46 ± 2% perf-profile.self.cycles-pp.touch_atime
0.57 ± 6% -0.1 0.48 ± 9% perf-profile.self.cycles-pp.aa_file_perm
0.42 ± 22% +0.1 0.53 ± 4% perf-profile.self.cycles-pp.timestamp_truncate
1.02 ± 11% +0.1 1.17 ± 5% perf-profile.self.cycles-pp.security_file_permission
0.04 ± 58% +0.2 0.24 ± 26% perf-profile.self.cycles-pp.cfb_imageblit
will-it-scale.per_process_ops
220000 +------------------------------------------------------------------+
| |
200000 |.+.+..+.+.+.+..+.+.+.+..+.+.+.+..+.+.+.+.+..+.+.+.+..+.+.+.+..+.+.|
| |
180000 |-+ |
| |
160000 |-+ |
| |
140000 |-+ |
| |
120000 |-+ |
| |
100000 |-+ |
| O O O O O O O O O O O O O O O O O O O O O O O O |
80000 +------------------------------------------------------------------+
will-it-scale.workload
3.4e+06 +-----------------------------------------------------------------+
3.2e+06 |.+.+..+.+.+.+.+..+.+.+.+.+..+.+.+.+.+..+.+.+.+.+..+.+.+.+.+..+.+.|
| |
3e+06 |-+ |
2.8e+06 |-+ |
2.6e+06 |-+ |
2.4e+06 |-+ |
| |
2.2e+06 |-+ |
2e+06 |-+ |
1.8e+06 |-+ |
1.6e+06 |-+ |
| O O O O O O O O O O O O O O O O O O O O O O O O |
1.4e+06 |-O O O O |
1.2e+06 +-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-ivb-d04: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory
=========================================================================================
compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
gcc-7/performance/socket/x86_64-rhel-7.6/process/100%/debian-x86_64-20191114.cgz/lkp-ivb-d04/hackbench/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:__bitmap_and
:4 50% 2:4 dmesg.RIP:__do_softirq
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:rebalance_domains
:4 25% 1:4 dmesg.RIP:update_group_capacity
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:4 25% 1:4 dmesg.WARNING:at_ip__slab_free/0x
%stddev %change %stddev
\ | \
10652 -50.9% 5226 hackbench.throughput
616.45 +1.9% 628.27 hackbench.time.elapsed_time
616.45 +1.9% 628.27 hackbench.time.elapsed_time.max
26183210 -52.6% 12416370 hackbench.time.involuntary_context_switches
133947 -49.6% 67461 hackbench.time.minor_page_faults
462.13 +2.6% 473.97 hackbench.time.user_time
82356140 -47.7% 43050586 hackbench.time.voluntary_context_switches
67200000 -50.0% 33600000 hackbench.workload
29592 ± 3% -8.4% 27109 meminfo.Shmem
1.45 ± 8% -0.6 0.87 ± 13% mpstat.cpu.all.idle%
28.95 ± 2% +18.3% 34.23 ± 4% boot-time.boot
10.58 ± 3% +22.1% 12.93 ± 13% boot-time.dhcp
78.27 +12.4% 88.00 ± 5% boot-time.idle
19.00 +5.3% 20.00 vmstat.cpu.us
58.00 +18.5% 68.75 vmstat.procs.r
180350 -49.3% 91464 vmstat.system.cs
42160 -42.9% 24058 vmstat.system.in
19833 ± 6% -30.1% 13870 ± 13% softirqs.CPU0.SCHED
19573 ± 5% -34.8% 12762 ± 16% softirqs.CPU1.SCHED
20252 ± 8% -30.6% 14056 ± 11% softirqs.CPU2.SCHED
18589 ± 2% -28.1% 13361 ± 10% softirqs.CPU3.SCHED
78249 -30.9% 54050 ± 2% softirqs.SCHED
15428247 -41.1% 9093566 cpuidle.C1.time
741881 -46.2% 399347 ± 2% cpuidle.C1.usage
9236605 ± 7% -48.0% 4805448 ± 16% cpuidle.C1E.time
206514 ± 3% -67.0% 68057 ± 13% cpuidle.C1E.usage
4812772 ± 24% -54.1% 2207098 ± 6% cpuidle.C3.time
66794 ± 10% -80.2% 13243 ± 16% cpuidle.C3.usage
440850 ± 2% -85.1% 65487 cpuidle.POLL.time
346018 ± 3% -93.2% 23631 cpuidle.POLL.usage
66449 -5.4% 62844 proc-vmstat.nr_active_anon
64201 -4.7% 61203 proc-vmstat.nr_anon_pages
7397 ± 3% -8.3% 6781 proc-vmstat.nr_shmem
8621 -2.4% 8411 proc-vmstat.nr_slab_unreclaimable
66456 -5.4% 62852 proc-vmstat.nr_zone_active_anon
4483913 -46.2% 2411000 proc-vmstat.numa_hit
4483913 -46.2% 2411000 proc-vmstat.numa_local
1889 ± 18% -36.0% 1209 ± 12% proc-vmstat.pgactivate
5162998 ± 3% -54.1% 2367999 proc-vmstat.pgalloc_dma32
1233551 ± 13% -20.8% 977411 ± 2% proc-vmstat.pgalloc_normal
848575 -13.5% 733782 proc-vmstat.pgfault
6375521 -47.8% 3325722 proc-vmstat.pgfree
1061 ± 2% -11.7% 936.75 ± 4% slabinfo.cred_jar.num_objs
639.00 ± 4% -13.5% 552.50 slabinfo.files_cache.num_objs
2357 ± 4% -25.7% 1751 slabinfo.filp.num_objs
5718 ± 2% -8.9% 5207 slabinfo.kmalloc-64.active_objs
5718 ± 2% -8.9% 5207 slabinfo.kmalloc-64.num_objs
504.00 ± 8% -25.0% 378.00 ± 13% slabinfo.kmalloc-rcl-96.active_objs
504.00 ± 8% -25.0% 378.00 ± 13% slabinfo.kmalloc-rcl-96.num_objs
999.50 ± 3% -15.0% 849.25 ± 2% slabinfo.pid.active_objs
1005 ± 3% -15.5% 849.25 ± 2% slabinfo.pid.num_objs
1005 ± 2% -22.7% 776.75 ± 6% slabinfo.task_delay_info.active_objs
1005 ± 2% -22.7% 776.75 ± 6% slabinfo.task_delay_info.num_objs
4627 -28.4% 3312 slabinfo.vmap_area.active_objs
4627 -28.4% 3312 slabinfo.vmap_area.num_objs
105.25 ± 18% -47.7% 55.00 ± 6% interrupts.CPU0.CAL:Function_call_interrupts
5147603 -52.0% 2471968 interrupts.CPU0.RES:Rescheduling_interrupts
8503 ± 26% -53.6% 3942 ± 32% interrupts.CPU1.NMI:Non-maskable_interrupts
8503 ± 26% -53.6% 3942 ± 32% interrupts.CPU1.PMI:Performance_monitoring_interrupts
5150886 -52.1% 2469304 ± 2% interrupts.CPU1.RES:Rescheduling_interrupts
8809 ± 30% -65.1% 3073 interrupts.CPU2.NMI:Non-maskable_interrupts
8809 ± 30% -65.1% 3073 interrupts.CPU2.PMI:Performance_monitoring_interrupts
5323969 -52.9% 2509857 ± 2% interrupts.CPU2.RES:Rescheduling_interrupts
9425 ± 32% -43.6% 5312 ± 24% interrupts.CPU3.NMI:Non-maskable_interrupts
9425 ± 32% -43.6% 5312 ± 24% interrupts.CPU3.PMI:Performance_monitoring_interrupts
5218416 -52.1% 2502172 ± 2% interrupts.CPU3.RES:Rescheduling_interrupts
34610 ± 19% -49.4% 17508 ± 17% interrupts.NMI:Non-maskable_interrupts
34610 ± 19% -49.4% 17508 ± 17% interrupts.PMI:Performance_monitoring_interrupts
20840876 -52.2% 9953302 interrupts.RES:Rescheduling_interrupts
138.00 ± 10% -76.8% 32.00 ± 21% interrupts.TLB:TLB_shootdowns
221.11 ± 5% -9.6% 199.95 ± 3% sched_debug.cfs_rq:/.load_avg.min
17205 ± 13% +39.0% 23921 ± 14% sched_debug.cfs_rq:/.min_vruntime.stddev
88.73 ± 4% +15.8% 102.75 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.stddev
11838 ± 74% +97.7% 23405 ± 9% sched_debug.cfs_rq:/.spread0.avg
36932 ± 29% +60.6% 59303 ± 10% sched_debug.cfs_rq:/.spread0.max
17191 ± 13% +39.0% 23899 ± 14% sched_debug.cfs_rq:/.spread0.stddev
312.17 ± 17% +47.3% 459.76 ± 17% sched_debug.cfs_rq:/.util_est_enqueued.avg
599.45 ± 11% +49.6% 896.68 ± 15% sched_debug.cfs_rq:/.util_est_enqueued.max
207.23 ± 10% +47.4% 305.45 ± 11% sched_debug.cfs_rq:/.util_est_enqueued.stddev
192714 ± 5% +35.9% 261993 ± 19% sched_debug.cpu.avg_idle.max
62207 ± 7% +41.7% 88152 ± 18% sched_debug.cpu.avg_idle.stddev
8.93 ± 23% +156.3% 22.88 ± 41% sched_debug.cpu.clock.stddev
8.93 ± 23% +156.3% 22.88 ± 41% sched_debug.cpu.clock_task.stddev
5421 ± 4% -20.3% 4320 ± 3% sched_debug.cpu.curr->pid.avg
6032 -17.4% 4985 sched_debug.cpu.curr->pid.max
4386 ± 13% -21.2% 3455 ± 16% sched_debug.cpu.curr->pid.min
0.00 ± 5% +32.5% 0.00 ± 21% sched_debug.cpu.next_balance.stddev
13635331 -49.5% 6886404 sched_debug.cpu.nr_switches.avg
13949714 -48.8% 7142472 sched_debug.cpu.nr_switches.max
13214558 -49.6% 6655528 sched_debug.cpu.nr_switches.min
8.74 +6.1% 9.27 perf-stat.i.MPKI
1.157e+09 -49.3% 5.864e+08 perf-stat.i.branch-instructions
2.25 +0.1 2.40 perf-stat.i.branch-miss-rate%
26103488 -45.9% 14110500 perf-stat.i.branch-misses
20.51 -1.1 19.42 perf-stat.i.cache-miss-rate%
10183776 -49.0% 5191242 perf-stat.i.cache-misses
52006330 -46.4% 27886153 perf-stat.i.cache-references
180002 -49.2% 91520 perf-stat.i.context-switches
2.17 -4.2% 2.08 perf-stat.i.cpi
1.292e+10 -51.5% 6.268e+09 perf-stat.i.cpu-cycles
1278 -33.4% 851.81 ± 17% perf-stat.i.cpu-migrations
1459 ± 3% -6.0% 1371 perf-stat.i.cycles-between-cache-misses
3.19 ± 4% -0.3 2.87 ± 7% perf-stat.i.dTLB-load-miss-rate%
57028288 ± 4% -55.1% 25620015 ± 7% perf-stat.i.dTLB-load-misses
1.73e+09 -49.8% 8.68e+08 perf-stat.i.dTLB-loads
0.57 -0.0 0.56 perf-stat.i.dTLB-store-miss-rate%
7290773 -51.5% 3539051 perf-stat.i.dTLB-store-misses
1.269e+09 -50.1% 6.333e+08 perf-stat.i.dTLB-stores
4136276 -50.5% 2047504 perf-stat.i.iTLB-load-misses
159476 ± 4% -47.5% 83773 ± 4% perf-stat.i.iTLB-loads
5.963e+09 -49.3% 3.021e+09 perf-stat.i.instructions
1509 +2.2% 1542 perf-stat.i.instructions-per-iTLB-miss
0.46 +4.4% 0.48 perf-stat.i.ipc
1338 -15.5% 1131 perf-stat.i.minor-faults
1338 -15.5% 1131 perf-stat.i.page-faults
8.72 +5.8% 9.23 perf-stat.overall.MPKI
2.26 +0.1 2.41 perf-stat.overall.branch-miss-rate%
19.58 -1.0 18.62 perf-stat.overall.cache-miss-rate%
2.17 -4.3% 2.08 perf-stat.overall.cpi
1269 -4.9% 1207 perf-stat.overall.cycles-between-cache-misses
3.19 ± 4% -0.3 2.87 ± 7% perf-stat.overall.dTLB-load-miss-rate%
0.57 -0.0 0.56 perf-stat.overall.dTLB-store-miss-rate%
1441 +2.4% 1475 perf-stat.overall.instructions-per-iTLB-miss
0.46 +4.4% 0.48 perf-stat.overall.ipc
54691 +3.3% 56503 perf-stat.overall.path-length
1.155e+09 -49.3% 5.855e+08 perf-stat.ps.branch-instructions
26062433 -45.9% 14088880 perf-stat.ps.branch-misses
10167610 -49.0% 5183840 perf-stat.ps.cache-misses
51918727 -46.4% 27836233 perf-stat.ps.cache-references
179688 -49.2% 91329 perf-stat.ps.context-switches
1.29e+10 -51.5% 6.258e+09 perf-stat.ps.cpu-cycles
1276 -33.4% 849.56 ± 17% perf-stat.ps.cpu-migrations
56934513 ± 4% -55.1% 25577876 ± 7% perf-stat.ps.dTLB-load-misses
1.727e+09 -49.8% 8.667e+08 perf-stat.ps.dTLB-loads
7278857 -51.5% 3533338 perf-stat.ps.dTLB-store-misses
1.267e+09 -50.1% 6.323e+08 perf-stat.ps.dTLB-stores
4129263 -50.5% 2043682 perf-stat.ps.iTLB-load-misses
159193 ± 4% -47.5% 83601 ± 4% perf-stat.ps.iTLB-loads
5.954e+09 -49.3% 3.016e+09 perf-stat.ps.instructions
1336 -15.5% 1129 perf-stat.ps.minor-faults
1336 -15.5% 1129 perf-stat.ps.page-faults
3.675e+12 -48.3% 1.899e+12 perf-stat.total.instructions
1.12 ± 11% -0.7 0.39 ± 57% perf-profile.calltrace.cycles-pp.secondary_startup_64
2.75 -0.7 2.06 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
2.84 -0.7 2.15 ± 5% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
3.82 ± 2% -0.6 3.18 ± 2% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
9.99 -0.5 9.44 perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
1.40 ± 8% -0.5 0.90 ± 5% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
1.53 ± 4% -0.5 1.03 ± 7% perf-profile.calltrace.cycles-pp.skb_set_owner_w.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
7.46 -0.5 7.00 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg
5.44 ± 3% -0.4 4.99 ± 3% perf-profile.calltrace.cycles-pp.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
28.44 -0.4 28.02 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.70 -0.4 7.28 perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
7.60 -0.4 7.18 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
1.18 ± 6% -0.2 1.01 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
1.54 +0.1 1.62 ± 3% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
1.69 +0.1 1.81 ± 5% perf-profile.calltrace.cycles-pp.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
0.86 ± 5% +0.1 1.00 ± 7% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.77 ± 4% +0.2 1.97 ± 8% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.95 ± 3% +0.2 4.19 ± 2% perf-profile.calltrace.cycles-pp.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
4.12 ± 3% +0.7 4.84 ± 8% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg
2.85 -0.7 2.16 ± 6% perf-profile.children.cycles-pp.copyout
3.61 ± 2% -0.7 2.95 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
3.85 ± 2% -0.7 3.20 ± 2% perf-profile.children.cycles-pp._copy_to_iter
1.12 ± 11% -0.6 0.51 ± 6% perf-profile.children.cycles-pp.secondary_startup_64
1.12 ± 11% -0.6 0.51 ± 6% perf-profile.children.cycles-pp.cpu_startup_entry
1.12 ± 11% -0.6 0.51 ± 6% perf-profile.children.cycles-pp.do_idle
10.01 -0.5 9.46 perf-profile.children.cycles-pp.sock_alloc_send_pskb
0.97 ± 8% -0.5 0.44 ± 10% perf-profile.children.cycles-pp.cpuidle_enter
0.97 ± 8% -0.5 0.44 ± 10% perf-profile.children.cycles-pp.cpuidle_enter_state
1.41 ± 8% -0.5 0.90 ± 4% perf-profile.children.cycles-pp.skb_release_data
0.88 ± 20% -0.5 0.38 ± 4% perf-profile.children.cycles-pp.start_secondary
28.59 -0.5 28.09 perf-profile.children.cycles-pp.new_sync_write
1.54 ± 4% -0.5 1.05 ± 8% perf-profile.children.cycles-pp.skb_set_owner_w
0.90 ± 4% -0.5 0.42 ± 9% perf-profile.children.cycles-pp.intel_idle
7.48 -0.5 7.03 perf-profile.children.cycles-pp.__skb_datagram_iter
5.45 ± 3% -0.4 5.00 ± 3% perf-profile.children.cycles-pp.consume_skb
7.72 -0.4 7.30 perf-profile.children.cycles-pp.unix_stream_read_actor
7.62 -0.4 7.21 perf-profile.children.cycles-pp.skb_copy_datagram_iter
0.24 ± 22% -0.1 0.13 ± 14% perf-profile.children.cycles-pp.start_kernel
0.10 ± 9% -0.0 0.06 ± 20% perf-profile.children.cycles-pp.should_failslab
0.06 ± 17% +0.0 0.09 ± 17% perf-profile.children.cycles-pp.interrupt_entry
0.08 +0.0 0.12 ± 13% perf-profile.children.cycles-pp.native_irq_return_iret
0.11 ± 11% +0.0 0.16 ± 7% perf-profile.children.cycles-pp.rw_verify_area
0.33 ± 7% +0.0 0.38 ± 8% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.04 ± 58% +0.1 0.09 ± 14% perf-profile.children.cycles-pp.__handle_mm_fault
0.04 ± 57% +0.1 0.10 ± 18% perf-profile.children.cycles-pp.__x64_sys_execve
0.04 ± 57% +0.1 0.10 ± 18% perf-profile.children.cycles-pp.__do_execve_file
0.04 ± 58% +0.1 0.10 ± 13% perf-profile.children.cycles-pp.handle_mm_fault
0.04 ± 58% +0.1 0.10 ± 20% perf-profile.children.cycles-pp.execve
0.03 ±100% +0.1 0.09 ± 21% perf-profile.children.cycles-pp.handle_pte_fault
0.01 ±173% +0.1 0.07 ± 22% perf-profile.children.cycles-pp.search_binary_handler
0.01 ±173% +0.1 0.07 ± 22% perf-profile.children.cycles-pp.load_elf_binary
0.01 ±173% +0.1 0.07 ± 30% perf-profile.children.cycles-pp.exit_mmap
0.05 ± 61% +0.1 0.12 ± 15% perf-profile.children.cycles-pp.do_page_fault
0.01 ±173% +0.1 0.08 ± 27% perf-profile.children.cycles-pp.mmput
0.00 +0.1 0.07 ± 28% perf-profile.children.cycles-pp.clockevents_program_event
0.28 ± 10% +0.1 0.35 ± 8% perf-profile.children.cycles-pp.update_rq_clock
0.07 ± 21% +0.1 0.14 ± 18% perf-profile.children.cycles-pp.task_tick_fair
0.05 ± 61% +0.1 0.13 ± 6% perf-profile.children.cycles-pp.page_fault
0.00 +0.1 0.08 ± 13% perf-profile.children.cycles-pp.read
1.64 +0.1 1.73 ± 4% perf-profile.children.cycles-pp.activate_task
1.59 +0.1 1.69 ± 4% perf-profile.children.cycles-pp.enqueue_task_fair
0.62 ± 8% +0.1 0.72 ± 4% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.08 ± 17% +0.1 0.19 ± 15% perf-profile.children.cycles-pp.scheduler_tick
0.18 ± 23% +0.1 0.30 ± 19% perf-profile.children.cycles-pp.update_process_times
0.19 ± 23% +0.1 0.32 ± 20% perf-profile.children.cycles-pp.tick_sched_handle
0.14 ± 27% +0.2 0.30 ± 7% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.22 ± 17% +0.2 0.38 ± 10% perf-profile.children.cycles-pp.tick_sched_timer
3.24 ± 2% +0.2 3.42 ± 3% perf-profile.children.cycles-pp.simple_copy_to_iter
0.16 ± 24% +0.2 0.37 ± 7% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.29 ± 3% +0.2 1.52 ± 9% perf-profile.children.cycles-pp.fsnotify
4.65 ± 2% +0.2 4.88 perf-profile.children.cycles-pp.__check_object_size
3.98 ± 3% +0.2 4.22 ± 2% perf-profile.children.cycles-pp.skb_copy_datagram_from_iter
0.30 ± 13% +0.3 0.56 ± 10% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.34 ± 34% +0.3 0.62 ± 38% perf-profile.children.cycles-pp.io_serial_in
0.51 ± 20% +0.3 0.80 ± 23% perf-profile.children.cycles-pp.irq_work_run_list
0.46 ± 28% +0.3 0.76 ± 20% perf-profile.children.cycles-pp.irq_work_interrupt
0.46 ± 28% +0.3 0.76 ± 20% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.46 ± 28% +0.3 0.76 ± 20% perf-profile.children.cycles-pp.irq_work_run
0.46 ± 28% +0.3 0.76 ± 20% perf-profile.children.cycles-pp.printk
0.38 ± 11% +0.3 0.72 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt
0.49 ± 3% +0.4 0.89 ± 4% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.52 ± 3% +0.4 0.97 ± 4% perf-profile.children.cycles-pp.apic_timer_interrupt
3.58 ± 2% -0.7 2.89 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
3.50 ± 3% -0.6 2.91 perf-profile.self.cycles-pp.unix_stream_read_generic
0.90 ± 4% -0.5 0.42 ± 9% perf-profile.self.cycles-pp.intel_idle
1.50 ± 3% -0.5 1.02 ± 9% perf-profile.self.cycles-pp.skb_set_owner_w
1.35 ± 6% -0.5 0.89 ± 4% perf-profile.self.cycles-pp.skb_release_data
0.67 ± 7% -0.1 0.56 ± 5% perf-profile.self.cycles-pp.new_sync_write
0.25 ± 2% -0.0 0.22 ± 4% perf-profile.self.cycles-pp.___perf_sw_event
0.12 +0.0 0.14 ± 9% perf-profile.self.cycles-pp.pick_next_entity
0.06 ± 17% +0.0 0.09 ± 14% perf-profile.self.cycles-pp.interrupt_entry
0.13 ± 5% +0.0 0.16 ± 7% perf-profile.self.cycles-pp.security_socket_recvmsg
0.22 ± 5% +0.0 0.26 ± 6% perf-profile.self.cycles-pp.enqueue_task_fair
0.08 +0.0 0.12 ± 13% perf-profile.self.cycles-pp.native_irq_return_iret
0.11 ± 11% +0.0 0.16 ± 7% perf-profile.self.cycles-pp.rw_verify_area
0.01 ±173% +0.1 0.08 ± 11% perf-profile.self.cycles-pp.prepare_exit_to_usermode
0.19 ± 6% +0.1 0.26 ± 11% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.53 ± 4% +0.1 0.61 ± 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.84 ± 4% +0.1 0.96 ± 5% perf-profile.self.cycles-pp.sock_write_iter
***************************************************************************************************
lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs2/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode:
4k/gcc-7/performance/1SSD/nfsv4/ext4/sync/x86_64-rhel-7.6/100%/debian-x86_64-20191114.cgz/300s/write/lkp-bdw-ex2/128G/fio-basic/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 100% 4:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:find_busiest_group
%stddev %change %stddev
\ | \
0.01 +0.0 0.03 ± 11% fio.latency_1000us%
50.49 -41.2 9.26 ± 8% fio.latency_100us%
11.47 ± 2% +0.8 12.25 ± 2% fio.latency_10us%
5.50 ± 7% +0.6 6.10 ± 5% fio.latency_20us%
14.81 ± 6% +39.7 54.48 fio.latency_250us%
0.01 ± 15% +0.0 0.05 ± 3% fio.latency_2ms%
0.01 +0.0 0.03 ± 8% fio.latency_4ms%
6.11 ± 6% -6.1 0.00 fio.latency_4us%
0.22 ± 7% +14.1 14.32 ± 6% fio.latency_500us%
0.26 ± 2% -0.0 0.22 ± 7% fio.latency_50ms%
11.03 ± 9% -8.2 2.81 ± 21% fio.latency_50us%
0.01 ± 10% +0.3 0.36 ± 35% fio.latency_750us%
62.93 +19.0% 74.91 fio.time.elapsed_time
62.93 +19.0% 74.91 fio.time.elapsed_time.max
10763 ± 19% +47.6% 15884 ± 13% fio.time.involuntary_context_switches
3480 ± 2% +93.5% 6735 ± 2% fio.time.percent_of_cpu_this_job_got
2071 ± 2% +128.0% 4723 ± 3% fio.time.system_time
118.74 ± 9% +171.0% 321.75 ± 6% fio.time.user_time
118071 ± 2% -11.8% 104102 ± 6% fio.time.voluntary_context_switches
2111 -15.4% 1785 fio.write_bw_MBps
115712 +156.6% 296960 ± 2% fio.write_clat_90%_us
149504 ± 2% +137.7% 355328 ± 2% fio.write_clat_95%_us
218112 +116.4% 472064 ± 3% fio.write_clat_99%_us
236227 ± 2% +26.0% 297561 ± 3% fio.write_clat_mean_us
3218913 ± 2% -6.0% 3025229 ± 3% fio.write_clat_stddev
540447 -15.4% 457198 fio.write_iops
28.64 ± 11% +15.3% 33.03 ± 10% boot-time.dhcp
38.57 ± 4% -6.3 32.30 ± 2% mpstat.cpu.all.idle%
43.75 ± 4% -11.2 32.52 ± 3% mpstat.cpu.all.iowait%
16.67 ± 2% +16.1 32.74 ± 2% mpstat.cpu.all.sys%
1.01 ± 9% +1.4 2.44 ± 6% mpstat.cpu.all.usr%
39.75 ± 4% -15.1% 33.75 ± 2% vmstat.cpu.id
42.00 ± 4% -25.6% 31.25 ± 4% vmstat.cpu.wa
825875 -14.9% 703107 vmstat.io.bo
1.042e+08 -10.6% 93215832 vmstat.memory.cache
88.25 ± 3% -26.9% 64.50 ± 6% vmstat.procs.b
32.25 ± 4% +104.7% 66.00 ± 3% vmstat.procs.r
9068 -20.3% 7223 ± 2% vmstat.system.cs
1.008e+08 -10.3% 90403887 meminfo.Cached
75666224 -9.9% 68204627 meminfo.Dirty
99657811 -10.4% 89290981 meminfo.Inactive
99231982 -10.4% 88863754 meminfo.Inactive(file)
2862205 -10.2% 2569201 meminfo.KReclaimable
1.053e+08 -10.1% 94642730 meminfo.Memused
2862205 -10.2% 2569201 meminfo.SReclaimable
137009 -30.5% 95289 meminfo.Writeback
2187195 -14.8% 1863029 meminfo.max_used_kB
40.38 ± 4% -15.8% 34.00 ± 2% iostat.cpu.idle
42.44 ± 4% -25.3% 31.70 ± 3% iostat.cpu.iowait
16.19 ± 2% +97.2% 31.92 ± 2% iostat.cpu.system
0.99 ± 9% +141.7% 2.38 ± 6% iostat.cpu.user
890.43 -33.8% 589.25 iostat.nvme0n1.avgqu-sz
725.23 +48.7% 1078 iostat.nvme0n1.avgrq-sz
121.86 -32.9% 81.81 iostat.nvme0n1.await
80.82 -11.9% 71.24 iostat.nvme0n1.util
6454 -14.7% 5508 iostat.nvme0n1.w/s
121.96 -32.9% 81.87 iostat.nvme0n1.w_await
862871 -10.2% 775064 iostat.nvme0n1.wkB/s
87.47 ± 4% -16.5% 73.08 ± 6% iostat.nvme0n1.wrqm/s
0.26 ± 21% +629.3% 1.89 ± 47% sched_debug.cfs_rq:/.exec_clock.avg
10.52 ± 19% +190.0% 30.50 ± 13% sched_debug.cfs_rq:/.exec_clock.max
1.28 ± 10% +320.4% 5.39 ± 29% sched_debug.cfs_rq:/.exec_clock.stddev
38450 ± 21% +54.7% 59472 ± 15% sched_debug.cfs_rq:/.min_vruntime.avg
65419 ± 12% +45.9% 95454 ± 11% sched_debug.cfs_rq:/.min_vruntime.max
5839 ± 10% +57.4% 9193 ± 9% sched_debug.cfs_rq:/.min_vruntime.stddev
19196 ± 32% +46.5% 28121 ± 19% sched_debug.cfs_rq:/.spread0.max
5825 ± 11% +57.8% 9192 ± 9% sched_debug.cfs_rq:/.spread0.stddev
6.80 ± 21% +85.0% 12.58 ± 5% sched_debug.cpu.clock.stddev
6.80 ± 21% +85.0% 12.58 ± 5% sched_debug.cpu.clock_task.stddev
1045 ± 10% -72.5% 287.75 ± 21% sched_debug.cpu.nr_switches.min
-38.75 +34.8% -52.25 sched_debug.cpu.nr_uninterruptible.min
18926599 -9.9% 17057835 proc-vmstat.nr_dirty
25229381 -10.5% 22587355 proc-vmstat.nr_file_pages
97433647 +2.8% 1.002e+08 proc-vmstat.nr_free_pages
24843018 -10.6% 22199587 proc-vmstat.nr_inactive_file
29311 +1.5% 29745 proc-vmstat.nr_kernel_stack
47.75 ± 63% +196.9% 141.75 ± 18% proc-vmstat.nr_mlock
4409 +4.2% 4592 ± 2% proc-vmstat.nr_page_table_pages
716303 -10.4% 642043 proc-vmstat.nr_slab_reclaimable
34293 -31.3% 23568 ± 2% proc-vmstat.nr_writeback
24843018 -10.6% 22199585 proc-vmstat.nr_zone_inactive_file
18965005 -9.9% 17085522 proc-vmstat.nr_zone_write_pending
11693 ± 12% -45.8% 6342 ± 19% proc-vmstat.numa_hint_faults
13169 ± 16% -58.1% 5515 ± 38% proc-vmstat.numa_pages_migrated
483092 +6.9% 516333 proc-vmstat.pgfault
13169 ± 16% -58.1% 5515 ± 38% proc-vmstat.pgmigrate_success
24821824 -10.5% 22205493 slabinfo.buffer_head.active_objs
636457 -10.5% 569371 slabinfo.buffer_head.active_slabs
24821835 -10.5% 22205507 slabinfo.buffer_head.num_objs
636457 -10.5% 569371 slabinfo.buffer_head.num_slabs
771.50 ± 14% -67.1% 254.00 ± 37% slabinfo.ext4_io_end.active_objs
771.50 ± 14% -67.1% 254.00 ± 37% slabinfo.ext4_io_end.num_objs
992.75 ± 7% +16.4% 1156 ± 3% slabinfo.file_lock_cache.active_objs
992.75 ± 7% +16.4% 1156 ± 3% slabinfo.file_lock_cache.num_objs
3624 ± 4% -27.3% 2635 ± 3% slabinfo.fsnotify_mark_connector.active_objs
3624 ± 4% -27.3% 2635 ± 3% slabinfo.fsnotify_mark_connector.num_objs
1530 +38.2% 2115 ± 6% slabinfo.jbd2_journal_head.active_objs
1530 +38.2% 2115 ± 6% slabinfo.jbd2_journal_head.num_objs
1215 ± 6% +12.5% 1368 ± 4% slabinfo.khugepaged_mm_slot.active_objs
1215 ± 6% +12.5% 1368 ± 4% slabinfo.khugepaged_mm_slot.num_objs
640.00 ± 18% +42.5% 912.00 ± 5% slabinfo.kmalloc-rcl-128.active_objs
640.00 ± 18% +42.5% 912.00 ± 5% slabinfo.kmalloc-rcl-128.num_objs
1165 ± 5% +17.1% 1365 ± 7% slabinfo.kmalloc-rcl-96.active_objs
1165 ± 5% +17.1% 1365 ± 7% slabinfo.kmalloc-rcl-96.num_objs
416192 -10.0% 374491 slabinfo.radix_tree_node.active_objs
7432 -10.0% 6687 slabinfo.radix_tree_node.active_slabs
416205 -10.0% 374510 slabinfo.radix_tree_node.num_objs
7432 -10.0% 6687 slabinfo.radix_tree_node.num_slabs
9065 ± 12% -23.8% 6906 ± 12% slabinfo.skbuff_ext_cache.active_objs
9129 ± 12% -24.2% 6921 ± 12% slabinfo.skbuff_ext_cache.num_objs
13150 ± 55% -98.5% 202.25 ±134% numa-meminfo.node0.Active(file)
28557438 ± 6% -11.3% 25340135 ± 3% numa-meminfo.node0.FilePages
28265712 ± 6% -11.3% 25064013 ± 3% numa-meminfo.node0.Inactive
28154197 ± 6% -11.0% 25054378 ± 3% numa-meminfo.node0.Inactive(file)
29724574 ± 6% -11.0% 26464625 ± 3% numa-meminfo.node0.MemUsed
39327 ± 8% -19.9% 31504 ± 12% numa-meminfo.node0.Writeback
24343329 ± 5% -14.1% 20913850 ± 2% numa-meminfo.node1.Dirty
98253 ± 53% -76.1% 23496 ± 66% numa-meminfo.node2.Active
98128 ± 53% -80.6% 19045 ± 48% numa-meminfo.node2.Active(anon)
38395 ± 27% -86.9% 5025 ±168% numa-meminfo.node2.AnonHugePages
97719 ± 54% -81.0% 18553 ± 48% numa-meminfo.node2.AnonPages
20150614 ± 4% -14.4% 17239545 ± 4% numa-meminfo.node2.Dirty
26193001 ± 3% -13.1% 22756026 ± 3% numa-meminfo.node2.FilePages
25918744 ± 3% -13.3% 22480655 ± 3% numa-meminfo.node2.Inactive
4474 ± 81% +4519.1% 206691 ± 95% numa-meminfo.node2.Inactive(anon)
25914269 ± 3% -14.0% 22273961 ± 4% numa-meminfo.node2.Inactive(file)
756380 ± 4% -15.3% 640377 ± 4% numa-meminfo.node2.KReclaimable
7431 ± 23% +2677.9% 206443 ± 95% numa-meminfo.node2.Mapped
27352641 ± 3% -13.3% 23716734 ± 3% numa-meminfo.node2.MemUsed
756380 ± 4% -15.3% 640377 ± 4% numa-meminfo.node2.SReclaimable
4989 ± 68% +4054.7% 207278 ± 95% numa-meminfo.node2.Shmem
820481 ± 3% -13.5% 709868 ± 3% numa-meminfo.node2.Slab
35510 ± 19% -31.5% 24329 ± 9% numa-meminfo.node2.Writeback
108489 ±154% -96.8% 3454 ±113% numa-meminfo.node3.Inactive(anon)
108947 ±153% -96.4% 3886 ±101% numa-meminfo.node3.Shmem
853184 ± 6% -13.7% 735941 ± 4% numa-meminfo.node3.Slab
37242 ± 15% -64.4% 13262 ± 21% numa-meminfo.node3.Writeback
3287 ± 55% -98.5% 50.50 ±134% numa-vmstat.node0.nr_active_file
7156844 ± 6% -11.1% 6363900 ± 3% numa-vmstat.node0.nr_file_pages
7056253 ± 6% -10.8% 6292548 ± 3% numa-vmstat.node0.nr_inactive_file
3287 ± 55% -98.5% 50.50 ±134% numa-vmstat.node0.nr_zone_active_file
7056204 ± 6% -10.8% 6292474 ± 3% numa-vmstat.node0.nr_zone_inactive_file
6099489 ± 5% -13.8% 5258753 ± 2% numa-vmstat.node1.nr_dirty
6108384 ± 5% -13.8% 5266944 ± 2% numa-vmstat.node1.nr_zone_write_pending
24521 ± 53% -80.6% 4761 ± 48% numa-vmstat.node2.nr_active_anon
24415 ± 54% -81.0% 4636 ± 48% numa-vmstat.node2.nr_anon_pages
6492301 ± 3% -12.8% 5664449 ± 5% numa-vmstat.node2.nr_dirtied
5044238 ± 4% -14.2% 4326756 ± 4% numa-vmstat.node2.nr_dirty
6560936 ± 3% -12.9% 5717787 ± 3% numa-vmstat.node2.nr_file_pages
1118 ± 81% +4579.8% 52343 ± 95% numa-vmstat.node2.nr_inactive_anon
6491277 ± 3% -13.8% 5596555 ± 4% numa-vmstat.node2.nr_inactive_file
1890 ± 22% +2667.7% 52316 ± 95% numa-vmstat.node2.nr_mapped
1247 ± 68% +4108.6% 52492 ± 95% numa-vmstat.node2.nr_shmem
189719 ± 4% -15.2% 160931 ± 4% numa-vmstat.node2.nr_slab_reclaimable
24521 ± 53% -80.6% 4761 ± 48% numa-vmstat.node2.nr_zone_active_anon
1118 ± 81% +4579.8% 52343 ± 95% numa-vmstat.node2.nr_zone_inactive_anon
6491249 ± 3% -13.8% 5596490 ± 4% numa-vmstat.node2.nr_zone_inactive_file
5054299 ± 4% -14.3% 4333422 ± 4% numa-vmstat.node2.nr_zone_write_pending
6960453 ± 3% -10.9% 6204543 ± 2% numa-vmstat.node2.numa_hit
6854850 ± 3% -11.0% 6097739 ± 2% numa-vmstat.node2.numa_local
27129 ±154% -96.8% 863.00 ±113% numa-vmstat.node3.nr_inactive_anon
27244 ±153% -96.4% 971.25 ±101% numa-vmstat.node3.nr_shmem
6778 ± 30% -53.4% 3159 ± 32% numa-vmstat.node3.nr_writeback
27128 ±154% -96.8% 863.00 ±113% numa-vmstat.node3.nr_zone_inactive_anon
1.499e+09 -9.9% 1.35e+09 perf-stat.i.branch-instructions
22610189 ± 9% -21.1% 17834843 ± 5% perf-stat.i.cache-misses
9070 -19.3% 7317 ± 2% perf-stat.i.context-switches
6.88 +28.9% 8.87 ± 3% perf-stat.i.cpi
9.411e+10 -13.8% 8.115e+10 ± 3% perf-stat.i.cpu-cycles
229.46 -3.1% 222.39 perf-stat.i.cpu-migrations
2522 ± 8% +27.0% 3204 ± 5% perf-stat.i.cycles-between-cache-misses
2.104e+09 -11.1% 1.871e+09 perf-stat.i.dTLB-loads
1.241e+09 ± 3% -13.1% 1.079e+09 ± 4% perf-stat.i.dTLB-stores
7.319e+09 -10.2% 6.576e+09 perf-stat.i.instructions
0.28 ± 4% -7.1% 0.26 ± 6% perf-stat.i.ipc
5743 -6.3% 5380 perf-stat.i.minor-faults
2832251 ± 11% -10.9% 2522769 ± 4% perf-stat.i.node-load-misses
360798 ± 8% -9.9% 324943 perf-stat.i.node-loads
56.99 +2.7 59.74 perf-stat.i.node-store-miss-rate%
1866852 -16.9% 1550725 ± 2% perf-stat.i.node-stores
5743 -6.3% 5380 perf-stat.i.page-faults
59.19 +4.3 63.45 perf-stat.overall.node-store-miss-rate%
13890 +7.8% 14967 ± 2% perf-stat.overall.path-length
1.497e+09 -8.5% 1.37e+09 perf-stat.ps.branch-instructions
22771549 ± 9% -19.2% 18399566 ± 4% perf-stat.ps.cache-misses
8877 -21.2% 6997 ± 2% perf-stat.ps.context-switches
9.549e+10 -10.3% 8.568e+10 ± 2% perf-stat.ps.cpu-cycles
225.91 -3.0% 219.18 perf-stat.ps.cpu-migrations
2.104e+09 -9.6% 1.901e+09 perf-stat.ps.dTLB-loads
1.239e+09 ± 3% -11.9% 1.092e+09 ± 4% perf-stat.ps.dTLB-stores
7.311e+09 -8.7% 6.677e+09 perf-stat.ps.instructions
5652 -7.3% 5240 perf-stat.ps.minor-faults
1882547 ± 2% -14.3% 1613747 ± 2% perf-stat.ps.node-stores
5652 -7.3% 5240 perf-stat.ps.page-faults
4.661e+11 +7.8% 5.022e+11 ± 2% perf-stat.total.instructions
15.70 ± 22% -9.0 6.67 ± 48% perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.70 ± 22% -9.0 6.67 ± 48% perf-profile.calltrace.cycles-pp.seq_read.proc_reg_read.vfs_read.ksys_read.do_syscall_64
3.70 ±101% -2.7 0.97 ±173% perf-profile.calltrace.cycles-pp.mpage_map_and_submit_buffers.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
3.70 ±101% -2.7 0.97 ±173% perf-profile.calltrace.cycles-pp.mpage_submit_page.mpage_map_and_submit_buffers.ext4_writepages.do_writepages.__writeback_single_inode
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work.worker_thread
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback.wb_workfn.process_one_work
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb.wb_writeback
3.70 ±101% -1.7 1.95 ±173% perf-profile.calltrace.cycles-pp.ext4_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.__writeback_inodes_wb
3.70 ±101% -1.4 2.27 ±173% perf-profile.calltrace.cycles-pp.ret_from_fork
3.70 ±101% -1.4 2.27 ±173% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
3.70 ±101% -1.4 2.27 ±173% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
3.70 ±101% -1.4 2.27 ±173% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
33.51 ± 50% +29.7 63.22 ± 14% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
35.32 ± 48% +31.5 66.84 ± 16% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
35.32 ± 48% +31.5 66.84 ± 16% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
35.32 ± 48% +31.5 66.84 ± 16% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
33.51 ± 50% +31.8 65.33 ± 15% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
33.51 ± 50% +31.8 65.33 ± 15% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
35.32 ± 48% +33.0 68.31 ± 14% perf-profile.calltrace.cycles-pp.secondary_startup_64
47.96 ± 14% -22.3 25.70 ± 37% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
47.96 ± 14% -22.3 25.70 ± 37% perf-profile.children.cycles-pp.do_syscall_64
24.81 ± 30% -15.1 9.74 ± 24% perf-profile.children.cycles-pp.do_group_exit
24.81 ± 30% -15.1 9.74 ± 24% perf-profile.children.cycles-pp.do_exit
16.51 ± 23% -9.8 6.67 ± 48% perf-profile.children.cycles-pp.seq_read
15.70 ± 22% -9.0 6.67 ± 48% perf-profile.children.cycles-pp.proc_reg_read
10.03 ± 46% -7.0 3.07 ± 69% perf-profile.children.cycles-pp.vsnprintf
3.70 ±101% -2.7 0.97 ±173% perf-profile.children.cycles-pp.mpage_map_and_submit_buffers
3.70 ±101% -2.7 0.97 ±173% perf-profile.children.cycles-pp.mpage_submit_page
3.70 ±101% -2.7 0.97 ±173% perf-profile.children.cycles-pp.ext4_bio_write_page
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.__writeback_inodes_wb
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.__writeback_single_inode
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.wb_workfn
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.wb_writeback
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.writeback_sb_inodes
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.do_writepages
3.70 ±101% -1.7 1.95 ±173% perf-profile.children.cycles-pp.ext4_writepages
3.70 ±101% -1.4 2.27 ±173% perf-profile.children.cycles-pp.ret_from_fork
3.70 ±101% -1.4 2.27 ±173% perf-profile.children.cycles-pp.kthread
3.70 ±101% -1.4 2.27 ±173% perf-profile.children.cycles-pp.worker_thread
3.70 ±101% -1.4 2.27 ±173% perf-profile.children.cycles-pp.process_one_work
33.51 ± 50% +29.7 63.22 ± 14% perf-profile.children.cycles-pp.intel_idle
35.32 ± 48% +31.5 66.84 ± 16% perf-profile.children.cycles-pp.start_secondary
35.32 ± 48% +33.0 68.31 ± 14% perf-profile.children.cycles-pp.secondary_startup_64
35.32 ± 48% +33.0 68.31 ± 14% perf-profile.children.cycles-pp.cpu_startup_entry
35.32 ± 48% +33.0 68.31 ± 14% perf-profile.children.cycles-pp.do_idle
33.51 ± 50% +33.3 66.80 ± 12% perf-profile.children.cycles-pp.cpuidle_enter
33.51 ± 50% +33.3 66.80 ± 12% perf-profile.children.cycles-pp.cpuidle_enter_state
33.51 ± 50% +29.7 63.22 ± 14% perf-profile.self.cycles-pp.intel_idle
31.75 +118.1% 69.25 ± 65% interrupts.108:PCI-MSI.1572921-edge.eth0-TxRx-57
2.00 ±173% +7.8e+06% 156028 ±100% interrupts.233:PCI-MSI.69206027-edge.nvme0q11
37.50 ± 19% +119.3% 82.25 ± 66% interrupts.63:PCI-MSI.1572876-edge.eth0-TxRx-12
34.25 ± 5% +797.1% 307.25 ±148% interrupts.64:PCI-MSI.1572877-edge.eth0-TxRx-13
31.50 +81.0% 57.00 ± 57% interrupts.75:PCI-MSI.1572888-edge.eth0-TxRx-24
31.50 +92.1% 60.50 ± 67% interrupts.98:PCI-MSI.1572911-edge.eth0-TxRx-47
128437 +14.6% 147138 ± 7% interrupts.CPU0.LOC:Local_timer_interrupts
128402 +16.5% 149524 ± 4% interrupts.CPU1.LOC:Local_timer_interrupts
128343 +14.9% 147506 ± 6% interrupts.CPU103.LOC:Local_timer_interrupts
128335 +16.3% 149243 ± 4% interrupts.CPU105.LOC:Local_timer_interrupts
128367 +16.1% 149069 ± 4% interrupts.CPU110.LOC:Local_timer_interrupts
128349 +14.8% 147307 ± 6% interrupts.CPU113.LOC:Local_timer_interrupts
128333 +14.9% 147459 ± 6% interrupts.CPU114.LOC:Local_timer_interrupts
128351 +15.6% 148435 ± 5% interrupts.CPU118.LOC:Local_timer_interrupts
128307 +14.5% 146967 ± 7% interrupts.CPU119.LOC:Local_timer_interrupts
37.50 ± 19% +119.3% 82.25 ± 66% interrupts.CPU12.63:PCI-MSI.1572876-edge.eth0-TxRx-12
100.00 ± 48% -76.0% 24.00 ± 29% interrupts.CPU12.RES:Rescheduling_interrupts
77.50 ± 76% +124.2% 173.75 ± 37% interrupts.CPU12.TLB:TLB_shootdowns
128354 +15.0% 147654 ± 6% interrupts.CPU120.LOC:Local_timer_interrupts
128358 +16.1% 149045 ± 4% interrupts.CPU121.LOC:Local_timer_interrupts
128361 +17.0% 150197 ± 3% interrupts.CPU122.LOC:Local_timer_interrupts
128342 +15.9% 148757 ± 5% interrupts.CPU123.LOC:Local_timer_interrupts
128345 +16.4% 149380 ± 4% interrupts.CPU124.LOC:Local_timer_interrupts
128345 +16.4% 149419 ± 4% interrupts.CPU125.LOC:Local_timer_interrupts
100.75 ± 21% -70.0% 30.25 ± 39% interrupts.CPU125.RES:Rescheduling_interrupts
128366 +15.8% 148692 ± 5% interrupts.CPU126.LOC:Local_timer_interrupts
128345 +17.3% 150598 ± 2% interrupts.CPU127.LOC:Local_timer_interrupts
128367 +16.6% 149700 ± 3% interrupts.CPU129.LOC:Local_timer_interrupts
34.25 ± 5% +797.1% 307.25 ±148% interrupts.CPU13.64:PCI-MSI.1572877-edge.eth0-TxRx-13
128399 +16.8% 149910 ± 3% interrupts.CPU130.LOC:Local_timer_interrupts
128393 +16.2% 149203 ± 4% interrupts.CPU131.LOC:Local_timer_interrupts
128380 +16.4% 149444 ± 4% interrupts.CPU132.LOC:Local_timer_interrupts
128376 +16.3% 149240 ± 4% interrupts.CPU133.LOC:Local_timer_interrupts
128385 +15.8% 148611 ± 5% interrupts.CPU134.LOC:Local_timer_interrupts
128421 +15.6% 148516 ± 5% interrupts.CPU135.LOC:Local_timer_interrupts
128337 +16.5% 149464 ± 3% interrupts.CPU136.LOC:Local_timer_interrupts
128715 +14.6% 147563 ± 6% interrupts.CPU138.LOC:Local_timer_interrupts
128362 +16.3% 149293 ± 4% interrupts.CPU139.LOC:Local_timer_interrupts
128370 +16.2% 149105 ± 4% interrupts.CPU14.LOC:Local_timer_interrupts
128343 +16.6% 149686 ± 3% interrupts.CPU140.LOC:Local_timer_interrupts
128343 +16.5% 149558 ± 4% interrupts.CPU141.LOC:Local_timer_interrupts
128337 +16.0% 148913 ± 4% interrupts.CPU142.LOC:Local_timer_interrupts
128347 +16.5% 149493 ± 4% interrupts.CPU143.LOC:Local_timer_interrupts
128380 +15.9% 148809 ± 4% interrupts.CPU144.LOC:Local_timer_interrupts
128353 +16.8% 149916 ± 3% interrupts.CPU145.LOC:Local_timer_interrupts
128355 +17.6% 150970 ± 2% interrupts.CPU146.LOC:Local_timer_interrupts
128356 +17.8% 151261 ± 2% interrupts.CPU147.LOC:Local_timer_interrupts
128352 +17.5% 150782 ± 2% interrupts.CPU148.LOC:Local_timer_interrupts
128354 +17.6% 150994 ± 2% interrupts.CPU149.LOC:Local_timer_interrupts
128351 +17.6% 150929 ± 2% interrupts.CPU150.LOC:Local_timer_interrupts
16.25 ± 12% +227.7% 53.25 ± 70% interrupts.CPU150.RES:Rescheduling_interrupts
128347 +17.5% 150792 ± 2% interrupts.CPU151.LOC:Local_timer_interrupts
14.00 ± 10% +339.3% 61.50 ± 69% interrupts.CPU151.RES:Rescheduling_interrupts
128357 +17.6% 150892 ± 2% interrupts.CPU152.LOC:Local_timer_interrupts
21.00 ± 37% +178.6% 58.50 ± 65% interrupts.CPU152.RES:Rescheduling_interrupts
2.00 ±173% +7.8e+06% 156028 ±100% interrupts.CPU153.233:PCI-MSI.69206027-edge.nvme0q11
128336 +17.5% 150841 ± 2% interrupts.CPU153.LOC:Local_timer_interrupts
22.75 ± 61% +342.9% 100.75 ± 65% interrupts.CPU153.RES:Rescheduling_interrupts
128355 +17.6% 150985 ± 2% interrupts.CPU154.LOC:Local_timer_interrupts
16.00 ± 7% +659.4% 121.50 ± 66% interrupts.CPU154.RES:Rescheduling_interrupts
128162 +17.7% 150796 ± 2% interrupts.CPU155.LOC:Local_timer_interrupts
28.00 ± 91% +411.6% 143.25 ± 74% interrupts.CPU155.RES:Rescheduling_interrupts
128381 +17.6% 150955 ± 2% interrupts.CPU156.LOC:Local_timer_interrupts
128341 +17.3% 150546 ± 2% interrupts.CPU157.LOC:Local_timer_interrupts
128343 +17.3% 150524 ± 2% interrupts.CPU158.LOC:Local_timer_interrupts
128343 +16.7% 149822 ± 3% interrupts.CPU159.LOC:Local_timer_interrupts
128330 +15.9% 148791 ± 4% interrupts.CPU160.LOC:Local_timer_interrupts
128328 +17.3% 150592 ± 2% interrupts.CPU161.LOC:Local_timer_interrupts
128329 +17.5% 150732 ± 2% interrupts.CPU162.LOC:Local_timer_interrupts
128416 +16.7% 149900 ± 3% interrupts.CPU163.LOC:Local_timer_interrupts
128357 +17.6% 150888 ± 2% interrupts.CPU164.LOC:Local_timer_interrupts
128333 +17.5% 150836 ± 2% interrupts.CPU165.LOC:Local_timer_interrupts
128893 +16.5% 150160 ± 3% interrupts.CPU166.LOC:Local_timer_interrupts
128327 +17.7% 151011 ± 2% interrupts.CPU167.LOC:Local_timer_interrupts
128351 +15.9% 148784 ± 4% interrupts.CPU168.LOC:Local_timer_interrupts
128407 +14.8% 147362 ± 6% interrupts.CPU169.LOC:Local_timer_interrupts
184.50 ± 61% -81.2% 34.75 ±105% interrupts.CPU169.TLB:TLB_shootdowns
128363 +14.9% 147459 ± 6% interrupts.CPU17.LOC:Local_timer_interrupts
128389 +14.4% 146909 ± 7% interrupts.CPU170.LOC:Local_timer_interrupts
128396 +15.4% 148212 ± 5% interrupts.CPU171.LOC:Local_timer_interrupts
128354 +17.1% 150354 ± 3% interrupts.CPU172.LOC:Local_timer_interrupts
128356 +17.0% 150126 ± 3% interrupts.CPU173.LOC:Local_timer_interrupts
128342 +14.5% 146903 ± 7% interrupts.CPU175.LOC:Local_timer_interrupts
128329 +15.0% 147546 ± 6% interrupts.CPU176.LOC:Local_timer_interrupts
128364 +16.9% 150105 ± 3% interrupts.CPU177.LOC:Local_timer_interrupts
128329 +15.6% 148403 ± 5% interrupts.CPU178.LOC:Local_timer_interrupts
128344 +14.8% 147378 ± 6% interrupts.CPU179.LOC:Local_timer_interrupts
128395 +15.0% 147622 ± 6% interrupts.CPU18.LOC:Local_timer_interrupts
128317 +16.5% 149453 ± 4% interrupts.CPU180.LOC:Local_timer_interrupts
128331 +16.2% 149089 ± 4% interrupts.CPU181.LOC:Local_timer_interrupts
128201 +16.0% 148775 ± 4% interrupts.CPU183.LOC:Local_timer_interrupts
128401 +16.5% 149592 ± 3% interrupts.CPU184.LOC:Local_timer_interrupts
128342 +15.3% 147937 ± 5% interrupts.CPU185.LOC:Local_timer_interrupts
128327 +16.5% 149455 ± 4% interrupts.CPU186.LOC:Local_timer_interrupts
128328 +15.5% 148280 ± 5% interrupts.CPU187.LOC:Local_timer_interrupts
128812 +16.3% 149765 ± 3% interrupts.CPU188.LOC:Local_timer_interrupts
128390 +15.1% 147841 ± 5% interrupts.CPU189.LOC:Local_timer_interrupts
128419 +15.5% 148352 ± 5% interrupts.CPU191.LOC:Local_timer_interrupts
128368 +14.5% 147034 ± 7% interrupts.CPU2.LOC:Local_timer_interrupts
128384 +15.7% 148531 ± 5% interrupts.CPU22.LOC:Local_timer_interrupts
128333 +14.9% 147514 ± 6% interrupts.CPU23.LOC:Local_timer_interrupts
31.50 +81.0% 57.00 ± 57% interrupts.CPU24.75:PCI-MSI.1572888-edge.eth0-TxRx-24
128421 +15.0% 147738 ± 6% interrupts.CPU24.LOC:Local_timer_interrupts
128381 +16.2% 149205 ± 4% interrupts.CPU25.LOC:Local_timer_interrupts
128386 +17.0% 150158 ± 3% interrupts.CPU26.LOC:Local_timer_interrupts
128374 +15.9% 148753 ± 5% interrupts.CPU27.LOC:Local_timer_interrupts
128393 +16.4% 149441 ± 4% interrupts.CPU28.LOC:Local_timer_interrupts
128394 +16.4% 149453 ± 4% interrupts.CPU29.LOC:Local_timer_interrupts
128349 +15.2% 147836 ± 6% interrupts.CPU3.LOC:Local_timer_interrupts
128394 +15.8% 148677 ± 5% interrupts.CPU30.LOC:Local_timer_interrupts
128396 +16.8% 149958 ± 3% interrupts.CPU31.LOC:Local_timer_interrupts
128841 +16.2% 149668 ± 3% interrupts.CPU33.LOC:Local_timer_interrupts
128345 +16.7% 149761 ± 3% interrupts.CPU34.LOC:Local_timer_interrupts
128364 +16.1% 149066 ± 4% interrupts.CPU35.LOC:Local_timer_interrupts
128323 +16.5% 149453 ± 4% interrupts.CPU36.LOC:Local_timer_interrupts
128684 +16.0% 149316 ± 4% interrupts.CPU37.LOC:Local_timer_interrupts
128450 +15.3% 148046 ± 5% interrupts.CPU38.LOC:Local_timer_interrupts
128597 +15.3% 148258 ± 5% interrupts.CPU39.LOC:Local_timer_interrupts
128451 +16.6% 149755 ± 3% interrupts.CPU40.LOC:Local_timer_interrupts
128351 +14.9% 147457 ± 6% interrupts.CPU42.LOC:Local_timer_interrupts
128386 +16.3% 149358 ± 4% interrupts.CPU43.LOC:Local_timer_interrupts
128384 +16.6% 149738 ± 3% interrupts.CPU44.LOC:Local_timer_interrupts
128379 +16.5% 149508 ± 4% interrupts.CPU45.LOC:Local_timer_interrupts
128363 +16.0% 148894 ± 4% interrupts.CPU46.LOC:Local_timer_interrupts
16.00 ± 22% +446.9% 87.50 ± 54% interrupts.CPU46.RES:Rescheduling_interrupts
31.50 +92.1% 60.50 ± 67% interrupts.CPU47.98:PCI-MSI.1572911-edge.eth0-TxRx-47
128351 +16.6% 149638 ± 4% interrupts.CPU47.LOC:Local_timer_interrupts
18.00 ± 44% +250.0% 63.00 ± 52% interrupts.CPU47.RES:Rescheduling_interrupts
128356 +15.9% 148823 ± 4% interrupts.CPU48.LOC:Local_timer_interrupts
128366 +16.8% 149931 ± 3% interrupts.CPU49.LOC:Local_timer_interrupts
24.50 ± 77% +455.1% 136.00 ± 72% interrupts.CPU5.RES:Rescheduling_interrupts
128546 +17.4% 150944 ± 2% interrupts.CPU50.LOC:Local_timer_interrupts
128550 +18.0% 151661 interrupts.CPU51.LOC:Local_timer_interrupts
128377 +17.4% 150768 ± 2% interrupts.CPU52.LOC:Local_timer_interrupts
128360 +17.6% 150959 ± 2% interrupts.CPU53.LOC:Local_timer_interrupts
128784 +17.2% 150924 ± 2% interrupts.CPU54.LOC:Local_timer_interrupts
16.75 ± 11% +353.7% 76.00 ± 69% interrupts.CPU54.RES:Rescheduling_interrupts
128352 +17.6% 150887 ± 2% interrupts.CPU55.LOC:Local_timer_interrupts
16.00 ± 22% +345.3% 71.25 ± 78% interrupts.CPU55.RES:Rescheduling_interrupts
128349 +17.6% 150925 ± 2% interrupts.CPU56.LOC:Local_timer_interrupts
15.25 ± 12% +355.7% 69.50 ± 42% interrupts.CPU56.RES:Rescheduling_interrupts
31.75 +118.1% 69.25 ± 65% interrupts.CPU57.108:PCI-MSI.1572921-edge.eth0-TxRx-57
128639 +17.3% 150885 ± 2% interrupts.CPU57.LOC:Local_timer_interrupts
128621 +17.4% 150962 ± 2% interrupts.CPU58.LOC:Local_timer_interrupts
16.75 ± 19% +362.7% 77.50 ± 24% interrupts.CPU58.RES:Rescheduling_interrupts
128312 +17.5% 150783 ± 2% interrupts.CPU59.LOC:Local_timer_interrupts
128351 +17.6% 150943 ± 2% interrupts.CPU60.LOC:Local_timer_interrupts
128372 +17.3% 150622 ± 2% interrupts.CPU61.LOC:Local_timer_interrupts
128350 +17.3% 150581 ± 2% interrupts.CPU62.LOC:Local_timer_interrupts
128692 +17.2% 150797 ± 4% interrupts.CPU63.LOC:Local_timer_interrupts
26.25 ± 66% +237.1% 88.50 ± 64% interrupts.CPU63.RES:Rescheduling_interrupts
128342 +16.0% 148843 ± 4% interrupts.CPU64.LOC:Local_timer_interrupts
128634 +17.5% 151193 ± 2% interrupts.CPU65.LOC:Local_timer_interrupts
128403 +17.5% 150824 ± 2% interrupts.CPU66.LOC:Local_timer_interrupts
15.00 ± 14% +460.0% 84.00 ± 50% interrupts.CPU66.RES:Rescheduling_interrupts
128391 +16.7% 149882 ± 3% interrupts.CPU67.LOC:Local_timer_interrupts
128301 +17.6% 150939 ± 2% interrupts.CPU68.LOC:Local_timer_interrupts
128343 +17.6% 150869 ± 2% interrupts.CPU69.LOC:Local_timer_interrupts
22.50 ± 66% +164.4% 59.50 ± 69% interrupts.CPU69.RES:Rescheduling_interrupts
128311 +14.9% 147423 ± 6% interrupts.CPU7.LOC:Local_timer_interrupts
128348 +17.0% 150218 ± 3% interrupts.CPU70.LOC:Local_timer_interrupts
128372 +17.5% 150891 ± 2% interrupts.CPU71.LOC:Local_timer_interrupts
128331 +16.2% 149151 ± 4% interrupts.CPU72.LOC:Local_timer_interrupts
134.50 ±107% -94.2% 7.75 ± 45% interrupts.CPU72.TLB:TLB_shootdowns
128644 +14.6% 147478 ± 6% interrupts.CPU73.LOC:Local_timer_interrupts
134.75 ±106% -99.3% 1.00 ±122% interrupts.CPU73.TLB:TLB_shootdowns
144.50 ± 96% -98.4% 2.25 ±110% interrupts.CPU74.TLB:TLB_shootdowns
128367 +15.4% 148194 ± 5% interrupts.CPU75.LOC:Local_timer_interrupts
145.50 ± 95% -93.8% 9.00 ± 86% interrupts.CPU75.TLB:TLB_shootdowns
128326 +17.2% 150448 ± 3% interrupts.CPU76.LOC:Local_timer_interrupts
128518 +16.9% 150214 ± 3% interrupts.CPU77.LOC:Local_timer_interrupts
163.00 ± 68% -72.5% 44.75 ± 59% interrupts.CPU78.TLB:TLB_shootdowns
128325 +14.5% 146943 ± 7% interrupts.CPU79.LOC:Local_timer_interrupts
128338 +15.0% 147569 ± 6% interrupts.CPU80.LOC:Local_timer_interrupts
182.50 ± 64% -74.7% 46.25 ± 57% interrupts.CPU80.TLB:TLB_shootdowns
128329 +16.9% 150020 ± 3% interrupts.CPU81.LOC:Local_timer_interrupts
128325 +15.7% 148446 ± 5% interrupts.CPU82.LOC:Local_timer_interrupts
14.25 ± 20% +321.1% 60.00 ±112% interrupts.CPU82.RES:Rescheduling_interrupts
128326 +15.0% 147539 ± 6% interrupts.CPU83.LOC:Local_timer_interrupts
128288 +16.5% 149477 ± 4% interrupts.CPU84.LOC:Local_timer_interrupts
128318 +16.3% 149250 ± 4% interrupts.CPU85.LOC:Local_timer_interrupts
128331 +16.0% 148818 ± 4% interrupts.CPU87.LOC:Local_timer_interrupts
128368 +16.7% 149776 ± 3% interrupts.CPU88.LOC:Local_timer_interrupts
128339 +15.3% 147957 ± 5% interrupts.CPU89.LOC:Local_timer_interrupts
154.50 ± 85% -78.2% 33.75 ± 95% interrupts.CPU89.TLB:TLB_shootdowns
128381 +16.3% 149325 ± 4% interrupts.CPU9.LOC:Local_timer_interrupts
128319 +16.5% 149505 ± 4% interrupts.CPU90.LOC:Local_timer_interrupts
128337 +15.7% 148429 ± 5% interrupts.CPU91.LOC:Local_timer_interrupts
128357 +16.7% 149773 ± 3% interrupts.CPU92.LOC:Local_timer_interrupts
128335 +15.3% 148000 ± 5% interrupts.CPU93.LOC:Local_timer_interrupts
128340 +15.5% 148276 ± 5% interrupts.CPU95.LOC:Local_timer_interrupts
128373 +14.5% 146984 ± 7% interrupts.CPU96.LOC:Local_timer_interrupts
128412 +16.5% 149567 ± 4% interrupts.CPU97.LOC:Local_timer_interrupts
128358 +14.5% 146911 ± 7% interrupts.CPU98.LOC:Local_timer_interrupts
128369 +15.2% 147823 ± 6% interrupts.CPU99.LOC:Local_timer_interrupts
24650613 +15.7% 28525718 ± 5% interrupts.LOC:Local_timer_interrupts
7862 ± 2% +59.6% 12551 ± 28% interrupts.RES:Rescheduling_interrupts
34585 +18.6% 41032 ± 4% softirqs.CPU0.RCU
18735 +26.8% 23764 ± 8% softirqs.CPU0.SCHED
33683 ± 3% +16.1% 39099 ± 7% softirqs.CPU0.TIMER
34894 ± 2% +17.0% 40830 softirqs.CPU1.RCU
35427 ± 3% +10.5% 39133 ± 2% softirqs.CPU10.RCU
9739 ± 4% -11.7% 8596 ± 8% softirqs.CPU10.SCHED
33353 +14.0% 38008 softirqs.CPU100.RCU
29815 ± 2% +20.9% 36042 ± 9% softirqs.CPU100.TIMER
33280 +25.9% 41905 ± 15% softirqs.CPU101.RCU
32709 +19.5% 39098 ± 4% softirqs.CPU102.RCU
32625 +16.9% 38136 ± 4% softirqs.CPU103.RCU
30632 ± 4% +18.6% 36319 ± 8% softirqs.CPU103.TIMER
32725 +16.0% 37957 softirqs.CPU104.RCU
30734 ± 3% +17.6% 36136 ± 8% softirqs.CPU104.TIMER
33442 ± 2% +14.6% 38321 ± 3% softirqs.CPU105.RCU
30813 ± 4% +14.6% 35302 ± 6% softirqs.CPU105.TIMER
32639 +16.6% 38054 ± 2% softirqs.CPU106.RCU
33686 ± 4% +18.9% 40057 ± 9% softirqs.CPU107.RCU
33798 ± 2% +12.8% 38108 softirqs.CPU108.RCU
34144 ± 3% +13.7% 38833 softirqs.CPU109.RCU
33284 ± 8% +17.1% 38971 ± 14% softirqs.CPU11.TIMER
33216 +13.7% 37780 ± 2% softirqs.CPU110.RCU
31042 ± 6% +13.9% 35353 ± 6% softirqs.CPU110.TIMER
33225 ± 3% +17.5% 39053 ± 2% softirqs.CPU111.RCU
33849 +12.5% 38084 ± 2% softirqs.CPU112.RCU
34077 ± 5% +11.8% 38093 ± 2% softirqs.CPU114.RCU
33901 ± 3% +10.5% 37461 softirqs.CPU115.RCU
33275 +13.3% 37695 softirqs.CPU116.RCU
30612 ± 5% +15.7% 35404 ± 6% softirqs.CPU116.TIMER
33376 +12.7% 37599 softirqs.CPU117.RCU
30787 ± 4% +15.7% 35611 ± 9% softirqs.CPU117.TIMER
32936 +13.7% 37448 softirqs.CPU118.RCU
33075 +16.0% 38361 ± 4% softirqs.CPU119.RCU
33703 ± 2% +18.0% 39754 ± 4% softirqs.CPU12.RCU
32529 ± 3% +14.2% 37160 ± 8% softirqs.CPU12.TIMER
33538 +13.1% 37917 softirqs.CPU120.RCU
33563 ± 2% +14.3% 38377 ± 2% softirqs.CPU122.RCU
33079 +29.2% 42731 ± 11% softirqs.CPU124.RCU
34025 ± 3% +13.5% 38629 ± 2% softirqs.CPU125.RCU
33151 ± 2% +15.7% 38341 softirqs.CPU126.RCU
32951 +19.7% 39430 ± 2% softirqs.CPU127.RCU
33478 ± 4% +15.5% 38670 ± 2% softirqs.CPU128.RCU
33476 ± 3% +16.0% 38830 ± 2% softirqs.CPU129.RCU
33721 ± 2% +15.1% 38814 ± 2% softirqs.CPU13.RCU
32281 ± 3% +15.2% 37184 ± 8% softirqs.CPU13.TIMER
32637 ± 2% +15.7% 37755 ± 2% softirqs.CPU130.RCU
32807 +17.6% 38595 ± 2% softirqs.CPU131.RCU
31629 ± 6% +11.0% 35097 ± 4% softirqs.CPU131.TIMER
33159 ± 5% +15.6% 38320 ± 3% softirqs.CPU132.RCU
33044 ± 4% +14.7% 37901 softirqs.CPU134.RCU
32400 +25.8% 40753 ± 10% softirqs.CPU135.RCU
32566 +14.8% 37379 softirqs.CPU136.RCU
32130 ± 2% +19.7% 38453 ± 4% softirqs.CPU137.RCU
32938 ± 2% +14.3% 37661 ± 2% softirqs.CPU138.RCU
32554 +16.2% 37834 ± 2% softirqs.CPU139.RCU
33792 ± 2% +16.6% 39390 softirqs.CPU14.RCU
32375 ± 5% +11.7% 36177 ± 6% softirqs.CPU14.TIMER
32463 +19.8% 38876 ± 3% softirqs.CPU140.RCU
32374 +15.4% 37368 ± 2% softirqs.CPU141.RCU
31981 ± 2% +17.1% 37463 softirqs.CPU142.RCU
32245 +18.4% 38187 ± 5% softirqs.CPU143.RCU
32707 ± 4% +14.8% 37545 ± 2% softirqs.CPU144.RCU
30647 ± 7% +11.6% 34195 ± 6% softirqs.CPU144.TIMER
32309 +19.4% 38576 ± 2% softirqs.CPU145.RCU
30281 ± 6% +16.3% 35203 ± 6% softirqs.CPU145.TIMER
32346 ± 2% +19.6% 38693 ± 4% softirqs.CPU146.RCU
31150 ± 5% +16.6% 36310 ± 8% softirqs.CPU146.TIMER
32289 ± 2% +18.4% 38218 ± 3% softirqs.CPU147.RCU
30829 ± 7% +14.0% 35145 ± 6% softirqs.CPU147.TIMER
32319 +16.6% 37673 ± 2% softirqs.CPU148.RCU
30373 ± 10% +15.4% 35057 ± 6% softirqs.CPU148.TIMER
32452 +15.9% 37608 softirqs.CPU149.RCU
29766 ± 7% +20.9% 35976 ± 7% softirqs.CPU149.TIMER
35249 ± 4% +10.5% 38934 softirqs.CPU15.RCU
32379 +14.8% 37174 softirqs.CPU150.RCU
29970 ± 7% +15.4% 34580 ± 5% softirqs.CPU150.TIMER
32626 +10.8% 36158 ± 4% softirqs.CPU151.RCU
30167 ± 7% +14.4% 34522 ± 6% softirqs.CPU151.TIMER
32287 +15.3% 37231 softirqs.CPU152.RCU
29973 ± 6% +14.5% 34311 ± 6% softirqs.CPU152.TIMER
32465 +15.2% 37390 ± 3% softirqs.CPU153.RCU
32237 +15.2% 37150 softirqs.CPU154.RCU
29739 ± 8% +17.1% 34828 ± 6% softirqs.CPU154.TIMER
32523 +16.5% 37892 ± 3% softirqs.CPU155.RCU
30135 ± 6% +15.3% 34746 ± 6% softirqs.CPU155.TIMER
32645 +16.2% 37937 ± 4% softirqs.CPU156.RCU
30470 ± 7% +13.9% 34691 ± 6% softirqs.CPU156.TIMER
32398 ± 2% +15.8% 37531 ± 3% softirqs.CPU157.RCU
29815 ± 7% +16.9% 34864 ± 6% softirqs.CPU157.TIMER
32136 +14.0% 36631 ± 3% softirqs.CPU158.RCU
30104 ± 9% +17.1% 35255 ± 5% softirqs.CPU158.TIMER
32254 +17.4% 37881 ± 4% softirqs.CPU159.RCU
30043 ± 6% +16.6% 35041 ± 7% softirqs.CPU159.TIMER
33752 +15.3% 38912 ± 2% softirqs.CPU16.RCU
32409 +16.8% 37856 softirqs.CPU160.RCU
30520 ± 7% +13.9% 34755 ± 6% softirqs.CPU160.TIMER
32246 +16.8% 37670 ± 3% softirqs.CPU161.RCU
29976 ± 7% +16.2% 34836 ± 6% softirqs.CPU161.TIMER
32356 +14.4% 37030 ± 3% softirqs.CPU162.RCU
29842 ± 8% +17.1% 34949 ± 8% softirqs.CPU162.TIMER
32279 +16.1% 37481 ± 2% softirqs.CPU163.RCU
32420 +15.1% 37323 softirqs.CPU164.RCU
30463 ± 8% +13.7% 34645 ± 6% softirqs.CPU164.TIMER
32258 +16.0% 37433 ± 3% softirqs.CPU165.RCU
30073 ± 6% +12.9% 33958 ± 6% softirqs.CPU165.TIMER
32168 +17.2% 37707 ± 2% softirqs.CPU166.RCU
32851 ± 2% +14.8% 37702 softirqs.CPU167.RCU
29976 ± 5% +14.9% 34446 ± 5% softirqs.CPU167.TIMER
32181 +15.5% 37173 softirqs.CPU168.RCU
32095 +15.6% 37099 softirqs.CPU169.RCU
30465 ± 7% +12.8% 34372 ± 5% softirqs.CPU169.TIMER
33963 +17.7% 39979 softirqs.CPU17.RCU
32244 ± 3% +11.5% 35946 ± 5% softirqs.CPU17.TIMER
32403 +14.7% 37158 softirqs.CPU170.RCU
32550 +16.2% 37824 ± 2% softirqs.CPU171.RCU
32618 +13.5% 37016 ± 2% softirqs.CPU172.RCU
32142 +15.4% 37099 ± 2% softirqs.CPU173.RCU
33505 ± 6% +11.3% 37294 ± 2% softirqs.CPU174.RCU
32332 +22.4% 39567 ± 7% softirqs.CPU175.RCU
30527 ± 7% +16.9% 35673 ± 6% softirqs.CPU175.TIMER
32160 +15.8% 37242 ± 2% softirqs.CPU176.RCU
30544 ± 7% +10.3% 33682 ± 5% softirqs.CPU176.TIMER
32334 +13.7% 36749 softirqs.CPU177.RCU
32170 +14.9% 36972 ± 2% softirqs.CPU178.RCU
30672 ± 6% +11.9% 34312 ± 6% softirqs.CPU178.TIMER
32136 +14.9% 36933 softirqs.CPU179.RCU
34311 ± 3% +12.5% 38601 softirqs.CPU18.RCU
31992 +15.8% 37054 ± 3% softirqs.CPU180.RCU
32121 +15.9% 37236 ± 2% softirqs.CPU181.RCU
30606 ± 7% +11.3% 34054 ± 5% softirqs.CPU181.TIMER
31643 ± 2% +17.1% 37064 softirqs.CPU182.RCU
32981 ± 5% +11.9% 36902 ± 2% softirqs.CPU183.RCU
31994 +14.1% 36516 softirqs.CPU184.RCU
31634 +16.7% 36904 softirqs.CPU185.RCU
32098 +15.4% 37036 softirqs.CPU186.RCU
31769 +16.6% 37048 softirqs.CPU187.RCU
32705 ± 3% +12.1% 36647 ± 2% softirqs.CPU188.RCU
31754 +16.4% 36974 ± 2% softirqs.CPU189.RCU
34033 +18.2% 40221 ± 2% softirqs.CPU19.RCU
33030 ± 2% +12.5% 37160 ± 7% softirqs.CPU19.TIMER
32064 ± 2% +13.9% 36535 ± 3% softirqs.CPU190.RCU
32045 +17.3% 37576 softirqs.CPU191.RCU
35215 ± 6% +14.6% 40339 ± 2% softirqs.CPU2.RCU
33585 +17.4% 39429 softirqs.CPU20.RCU
33328 +16.9% 38956 ± 2% softirqs.CPU21.RCU
33990 +15.4% 39225 ± 3% softirqs.CPU22.RCU
33451 +18.9% 39761 ± 2% softirqs.CPU23.RCU
31835 ± 3% +17.0% 37247 ± 11% softirqs.CPU23.TIMER
32980 +19.5% 39417 ± 2% softirqs.CPU25.RCU
33251 +17.3% 39019 ± 3% softirqs.CPU26.RCU
33548 +16.8% 39198 softirqs.CPU27.RCU
34308 ± 2% +15.4% 39580 ± 2% softirqs.CPU28.RCU
33528 +18.1% 39601 softirqs.CPU29.RCU
33729 +20.7% 40723 softirqs.CPU3.RCU
32908 ± 3% +17.5% 38659 ± 13% softirqs.CPU3.TIMER
33439 +29.8% 43419 ± 13% softirqs.CPU30.RCU
34440 ± 3% +13.7% 39162 ± 3% softirqs.CPU31.RCU
33497 +15.8% 38781 softirqs.CPU32.RCU
33966 +15.6% 39276 ± 2% softirqs.CPU33.RCU
33181 +25.4% 41625 ± 7% softirqs.CPU34.RCU
33241 +19.2% 39631 ± 3% softirqs.CPU35.RCU
34119 +23.7% 42213 ± 11% softirqs.CPU37.RCU
33433 +16.9% 39072 ± 2% softirqs.CPU38.RCU
32750 +19.4% 39110 ± 2% softirqs.CPU39.RCU
34476 ± 2% +16.4% 40130 softirqs.CPU4.RCU
31499 +20.5% 37951 ± 8% softirqs.CPU4.TIMER
33021 ± 3% +18.3% 39054 softirqs.CPU40.RCU
32900 ± 2% +18.3% 38922 softirqs.CPU41.RCU
32829 +19.2% 39146 ± 3% softirqs.CPU42.RCU
33370 +16.8% 38976 ± 2% softirqs.CPU44.RCU
33122 ± 2% +18.2% 39140 ± 2% softirqs.CPU45.RCU
34188 ± 3% +14.2% 39046 ± 3% softirqs.CPU46.RCU
34547 ± 2% +13.4% 39184 ± 2% softirqs.CPU47.RCU
32740 +16.8% 38227 ± 2% softirqs.CPU48.RCU
34122 ± 5% +12.6% 38416 ± 2% softirqs.CPU49.RCU
34080 +20.6% 41108 ± 4% softirqs.CPU5.RCU
35160 ± 11% +21.3% 42666 ± 13% softirqs.CPU5.TIMER
33941 +14.0% 38697 ± 2% softirqs.CPU50.RCU
33587 +16.5% 39128 softirqs.CPU51.RCU
32221 ± 5% +11.6% 35944 ± 6% softirqs.CPU51.TIMER
33469 +16.2% 38892 ± 2% softirqs.CPU52.RCU
33618 ± 2% +15.6% 38876 ± 3% softirqs.CPU53.RCU
31383 ± 5% +15.7% 36311 ± 9% softirqs.CPU53.TIMER
33411 +17.7% 39318 softirqs.CPU54.RCU
31353 ± 5% +13.2% 35486 ± 6% softirqs.CPU54.TIMER
33561 +15.7% 38835 ± 2% softirqs.CPU55.RCU
31449 ± 6% +13.4% 35664 ± 7% softirqs.CPU55.TIMER
33416 +16.4% 38891 ± 3% softirqs.CPU56.RCU
31445 ± 4% +12.1% 35235 ± 6% softirqs.CPU56.TIMER
33129 +17.3% 38861 ± 3% softirqs.CPU58.RCU
31108 ± 6% +14.1% 35480 ± 8% softirqs.CPU58.TIMER
32752 +17.5% 38490 ± 2% softirqs.CPU59.RCU
31169 ± 5% +12.2% 34986 ± 6% softirqs.CPU59.TIMER
34754 ± 4% +16.5% 40494 ± 7% softirqs.CPU6.RCU
33211 ± 6% +15.2% 38251 ± 3% softirqs.CPU6.TIMER
33270 +24.9% 41539 ± 6% softirqs.CPU60.RCU
31569 ± 6% +21.9% 38492 ± 5% softirqs.CPU60.TIMER
32989 +20.9% 39889 ± 3% softirqs.CPU61.RCU
31121 ± 5% +15.9% 36066 ± 7% softirqs.CPU61.TIMER
33195 ± 2% +18.9% 39482 softirqs.CPU62.RCU
31337 ± 7% +14.9% 35991 ± 8% softirqs.CPU62.TIMER
33021 +17.8% 38898 softirqs.CPU63.RCU
31234 ± 5% +13.9% 35567 ± 8% softirqs.CPU63.TIMER
32825 +17.6% 38598 softirqs.CPU64.RCU
31704 ± 6% +12.9% 35792 ± 10% softirqs.CPU64.TIMER
33240 +18.9% 39508 softirqs.CPU65.RCU
31475 ± 5% +12.9% 35526 ± 9% softirqs.CPU65.TIMER
33190 +20.8% 40106 ± 2% softirqs.CPU66.RCU
8443 +23.9% 10460 ± 4% softirqs.CPU66.SCHED
31182 ± 7% +14.7% 35751 ± 8% softirqs.CPU66.TIMER
32969 +16.8% 38498 softirqs.CPU67.RCU
33177 +17.0% 38810 softirqs.CPU68.RCU
32799 +19.4% 39160 softirqs.CPU69.RCU
31264 ± 5% +14.9% 35937 ± 8% softirqs.CPU69.TIMER
34352 +15.1% 39536 ± 2% softirqs.CPU7.RCU
32372 ± 3% +14.0% 36918 ± 8% softirqs.CPU7.TIMER
34202 ± 5% +14.1% 39029 softirqs.CPU70.RCU
33334 ± 2% +16.1% 38699 ± 2% softirqs.CPU71.RCU
33710 +19.0% 40129 ± 4% softirqs.CPU72.RCU
33730 ± 2% +16.2% 39208 ± 2% softirqs.CPU73.RCU
31947 ± 5% +12.6% 35970 ± 8% softirqs.CPU73.TIMER
33347 +17.4% 39134 ± 4% softirqs.CPU74.RCU
31666 ± 6% +11.6% 35343 ± 4% softirqs.CPU74.TIMER
33119 +17.0% 38735 ± 3% softirqs.CPU75.RCU
33034 +18.0% 38972 ± 3% softirqs.CPU76.RCU
33209 +16.8% 38791 ± 2% softirqs.CPU77.RCU
33699 ± 5% +14.2% 38497 softirqs.CPU79.RCU
35226 ± 4% +14.0% 40145 ± 3% softirqs.CPU8.RCU
32834 ± 2% +17.2% 38477 ± 2% softirqs.CPU80.RCU
32216 +18.8% 38272 ± 3% softirqs.CPU81.RCU
32402 +18.0% 38242 ± 2% softirqs.CPU82.RCU
31305 ± 6% +10.9% 34731 ± 7% softirqs.CPU82.TIMER
32612 +17.9% 38440 ± 2% softirqs.CPU83.RCU
31518 ± 6% +12.8% 35541 ± 8% softirqs.CPU83.TIMER
32748 +16.7% 38226 ± 2% softirqs.CPU84.RCU
32645 +17.4% 38321 ± 2% softirqs.CPU85.RCU
31595 ± 5% +11.8% 35339 ± 7% softirqs.CPU85.TIMER
32665 +17.2% 38277 ± 3% softirqs.CPU86.RCU
31558 ± 7% +13.2% 35720 ± 8% softirqs.CPU86.TIMER
32257 +17.2% 37808 ± 2% softirqs.CPU87.RCU
32385 +18.4% 38335 ± 3% softirqs.CPU88.RCU
32527 +16.2% 37786 ± 2% softirqs.CPU89.RCU
34344 ± 3% +15.4% 39639 softirqs.CPU9.RCU
32369 ± 2% +11.8% 36174 ± 6% softirqs.CPU9.TIMER
32811 +17.8% 38662 ± 2% softirqs.CPU90.RCU
32532 +18.3% 38498 softirqs.CPU91.RCU
32965 ± 2% +15.3% 38002 softirqs.CPU92.RCU
32434 +22.1% 39591 ± 7% softirqs.CPU93.RCU
32546 +37.7% 44801 ± 19% softirqs.CPU94.RCU
31420 ± 8% +37.8% 43298 ± 31% softirqs.CPU94.TIMER
33220 +14.6% 38084 softirqs.CPU95.RCU
33531 ± 2% +12.8% 37823 ± 3% softirqs.CPU96.RCU
33545 +14.3% 38337 softirqs.CPU97.RCU
32966 +14.7% 37811 ± 2% softirqs.CPU98.RCU
33429 +15.9% 38750 ± 4% softirqs.CPU99.RCU
6367566 +16.4% 7409345 softirqs.RCU
6082875 ± 4% +12.4% 6839301 ± 6% softirqs.TIMER
***************************************************************************************************
lkp-ivb-d02: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/16/debian-x86_64-20191114.cgz/lkp-ivb-d02/malloc2/will-it-scale/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 50% 2:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:rebalance_domains
%stddev %change %stddev
\ | \
3690543 -53.4% 1719663 will-it-scale.per_process_ops
59048698 -53.4% 27514625 will-it-scale.workload
20.79 ± 4% +14.9% 23.90 ± 3% boot-time.boot
115892 ± 2% -8.8% 105652 ± 4% meminfo.DirectMap4k
14913 ± 3% +14.0% 16994 softirqs.SCHED
1955 ± 2% -12.8% 1704 ± 2% slabinfo.filp.num_objs
992.00 ± 4% -7.9% 914.00 ± 6% slabinfo.kmalloc-512.num_objs
7533 ± 2% -7.3% 6983 vmstat.system.cs
11027 -3.6% 10634 vmstat.system.in
65202 -4.5% 62286 proc-vmstat.nr_active_anon
64136 -4.2% 61459 proc-vmstat.nr_anon_pages
4090 -5.6% 3861 proc-vmstat.nr_shmem
65178 -4.5% 62264 proc-vmstat.nr_zone_active_anon
856.75 ± 10% -40.3% 511.25 proc-vmstat.pgactivate
366730 -1.2% 362179 proc-vmstat.pgalloc_normal
351608 -2.1% 344374 proc-vmstat.pgfree
9641 ± 23% -67.8% 3105 interrupts.CPU0.NMI:Non-maskable_interrupts
9641 ± 23% -67.8% 3105 interrupts.CPU0.PMI:Performance_monitoring_interrupts
6642 ± 3% -52.8% 3137 interrupts.CPU1.NMI:Non-maskable_interrupts
6642 ± 3% -52.8% 3137 interrupts.CPU1.PMI:Performance_monitoring_interrupts
8051 ± 34% -61.1% 3133 ± 2% interrupts.CPU2.NMI:Non-maskable_interrupts
8051 ± 34% -61.1% 3133 ± 2% interrupts.CPU2.PMI:Performance_monitoring_interrupts
6442 -51.4% 3128 interrupts.CPU3.NMI:Non-maskable_interrupts
6442 -51.4% 3128 interrupts.CPU3.PMI:Performance_monitoring_interrupts
30777 ± 15% -59.4% 12505 interrupts.NMI:Non-maskable_interrupts
30777 ± 15% -59.4% 12505 interrupts.PMI:Performance_monitoring_interrupts
326.55 ± 3% -12.3% 286.33 ± 3% sched_debug.cfs_rq:/.load_avg.avg
449.04 -16.4% 375.50 ± 10% sched_debug.cfs_rq:/.load_avg.max
94.96 ± 11% -28.9% 67.52 ± 22% sched_debug.cfs_rq:/.load_avg.stddev
7.35 ± 8% +95.8% 14.40 ± 7% sched_debug.cfs_rq:/.nr_spread_over.avg
21.79 ± 25% +69.8% 37.00 ± 7% sched_debug.cfs_rq:/.nr_spread_over.max
8.69 ± 37% +72.2% 14.97 ± 7% sched_debug.cfs_rq:/.nr_spread_over.stddev
0.00 ± 21% +28.5% 0.00 ± 12% sched_debug.cpu.next_balance.stddev
451321 ± 2% -8.0% 415116 sched_debug.cpu.nr_switches.avg
1591992 ± 2% -21.1% 1256038 ± 15% sched_debug.cpu.nr_switches.max
658789 ± 2% -23.6% 503350 ± 17% sched_debug.cpu.nr_switches.stddev
440664 ± 2% -8.3% 403980 sched_debug.cpu.sched_count.avg
1579963 ± 2% -21.3% 1244093 ± 15% sched_debug.cpu.sched_count.max
657859 ± 2% -23.6% 502322 ± 18% sched_debug.cpu.sched_count.stddev
2015 ± 2% -12.8% 1757 ± 8% sched_debug.cpu.sched_goidle.avg
207749 ± 2% -9.0% 189052 sched_debug.cpu.ttwu_count.avg
781543 ± 2% -21.6% 612453 ± 15% sched_debug.cpu.ttwu_count.max
331321 ± 2% -23.6% 253093 ± 18% sched_debug.cpu.ttwu_count.stddev
205962 ± 2% -9.2% 187022 sched_debug.cpu.ttwu_local.avg
779755 ± 2% -21.7% 610374 ± 15% sched_debug.cpu.ttwu_local.max
331320 ± 2% -23.6% 253084 ± 18% sched_debug.cpu.ttwu_local.stddev
0.05 ± 3% +137.2% 0.12 perf-stat.i.MPKI
4.412e+09 -52.6% 2.09e+09 perf-stat.i.branch-instructions
0.08 ± 2% +0.1 0.19 ± 4% perf-stat.i.branch-miss-rate%
2868917 ± 3% +30.3% 3737973 ± 5% perf-stat.i.branch-misses
14.41 +2.5 16.94 ± 3% perf-stat.i.cache-miss-rate%
150515 ± 3% +24.2% 186901 ± 5% perf-stat.i.cache-misses
882639 ± 3% +14.1% 1007246 ± 2% perf-stat.i.cache-references
7594 ± 2% -7.4% 7029 perf-stat.i.context-switches
0.71 +1.6% 0.72 perf-stat.i.cpi
1.308e+10 -51.8% 6.311e+09 perf-stat.i.cpu-cycles
164133 ± 4% -62.3% 61839 ± 4% perf-stat.i.cycles-between-cache-misses
0.01 ± 5% +0.0 0.02 perf-stat.i.dTLB-load-miss-rate%
3.901e+09 -52.6% 1.851e+09 perf-stat.i.dTLB-loads
0.00 ± 2% +0.0 0.01 ± 14% perf-stat.i.dTLB-store-miss-rate%
2.585e+09 -52.8% 1.22e+09 perf-stat.i.dTLB-stores
118190 -7.2% 109655 perf-stat.i.iTLB-load-misses
1.849e+10 -52.5% 8.782e+09 perf-stat.i.instructions
430278 -53.9% 198290 perf-stat.i.instructions-per-iTLB-miss
1.41 -1.6% 1.39 perf-stat.i.ipc
0.05 ± 3% +140.3% 0.11 ± 2% perf-stat.overall.MPKI
0.07 ± 4% +0.1 0.18 ± 5% perf-stat.overall.branch-miss-rate%
17.06 ± 2% +1.5 18.55 ± 3% perf-stat.overall.cache-miss-rate%
0.71 +1.6% 0.72 perf-stat.overall.cpi
87002 ± 3% -61.1% 33845 ± 5% perf-stat.overall.cycles-between-cache-misses
0.01 ± 4% +0.0 0.02 perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 2% +0.0 0.01 ± 15% perf-stat.overall.dTLB-store-miss-rate%
156501 -48.8% 80123 perf-stat.overall.instructions-per-iTLB-miss
1.41 -1.6% 1.39 perf-stat.overall.ipc
94374 +2.0% 96228 perf-stat.overall.path-length
4.398e+09 -52.6% 2.083e+09 perf-stat.ps.branch-instructions
2860015 ± 3% +30.3% 3726736 ± 5% perf-stat.ps.branch-misses
150037 ± 3% +24.2% 186360 ± 5% perf-stat.ps.cache-misses
879772 ± 3% +14.1% 1004104 ± 2% perf-stat.ps.cache-references
7569 ± 2% -7.5% 7005 perf-stat.ps.context-switches
1.304e+10 -51.8% 6.29e+09 perf-stat.ps.cpu-cycles
3.889e+09 -52.6% 1.845e+09 perf-stat.ps.dTLB-loads
2.577e+09 -52.8% 1.216e+09 perf-stat.ps.dTLB-stores
117801 -7.2% 109283 perf-stat.ps.iTLB-load-misses
1.843e+10 -52.5% 8.753e+09 perf-stat.ps.instructions
5.573e+12 -52.5% 2.648e+12 perf-stat.total.instructions
74.64 -3.8 70.80 perf-profile.calltrace.cycles-pp.malloc
0.00 +0.5 0.54 ± 5% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.malloc
0.00 +0.7 0.67 ± 18% perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode
0.00 +0.8 0.75 ± 17% perf-profile.calltrace.cycles-pp.lf.vt_console_print.console_unlock.vprintk_emit.printk
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.printk.irq_work_run_list.irq_work_run
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.irq_work_run_list.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.vt_console_print.console_unlock.vprintk_emit.printk.irq_work_run_list
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.vprintk_emit.printk.irq_work_run_list.irq_work_run.smp_irq_work_interrupt
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
0.00 +0.8 0.76 ± 16% perf-profile.calltrace.cycles-pp.printk.irq_work_run_list.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
0.00 +0.8 0.77 ± 17% perf-profile.calltrace.cycles-pp.irq_work_interrupt
0.00 +0.8 0.77 ± 17% perf-profile.calltrace.cycles-pp.smp_irq_work_interrupt.irq_work_interrupt
0.00 +0.9 0.92 ± 24% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.00 +1.0 1.01 ± 5% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
0.00 +1.0 1.01 ± 5% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.00 +1.1 1.05 ± 53% perf-profile.calltrace.cycles-pp.drm_fb_helper_cfb_imageblit.bit_putcs.fbcon_putcs.fbcon_redraw.fbcon_scroll
0.00 +1.1 1.05 ± 53% perf-profile.calltrace.cycles-pp.cfb_imageblit.drm_fb_helper_cfb_imageblit.bit_putcs.fbcon_putcs.fbcon_redraw
0.00 +1.1 1.10 ± 53% perf-profile.calltrace.cycles-pp.bit_putcs.fbcon_putcs.fbcon_redraw.fbcon_scroll.con_scroll
0.00 +1.1 1.11 ± 52% perf-profile.calltrace.cycles-pp.fbcon_putcs.fbcon_redraw.fbcon_scroll.con_scroll.lf
0.00 +1.1 1.12 ± 8% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +1.1 1.13 ± 52% perf-profile.calltrace.cycles-pp.con_scroll.lf.vt_console_print.console_unlock.vprintk_emit
0.00 +1.1 1.13 ± 52% perf-profile.calltrace.cycles-pp.fbcon_scroll.con_scroll.lf.vt_console_print.console_unlock
0.00 +1.1 1.13 ± 52% perf-profile.calltrace.cycles-pp.fbcon_redraw.fbcon_scroll.con_scroll.lf.vt_console_print
0.18 ±173% +1.4 1.55 ± 11% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.55 ± 64% +1.6 2.17 ± 9% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.68 ± 63% +1.9 2.59 ± 7% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt
0.74 ± 62% +2.1 2.87 ± 7% perf-profile.calltrace.cycles-pp.apic_timer_interrupt
77.30 -4.3 73.01 perf-profile.children.cycles-pp.malloc
19.81 -1.2 18.64 ± 4% perf-profile.children.cycles-pp.free
0.06 ± 9% +0.1 0.11 ± 26% perf-profile.children.cycles-pp.filemap_map_pages
0.06 ± 26% +0.1 0.12 ± 43% perf-profile.children.cycles-pp.__x64_sys_clone
0.06 ± 26% +0.1 0.12 ± 43% perf-profile.children.cycles-pp._do_fork
0.03 ±100% +0.1 0.09 ± 20% perf-profile.children.cycles-pp.set_next_entity
0.08 ± 26% +0.1 0.17 ± 27% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.04 ±107% +0.1 0.14 ± 29% perf-profile.children.cycles-pp.flush_old_exec
0.01 ±173% +0.1 0.12 ± 35% perf-profile.children.cycles-pp.__calc_delta
0.00 +0.1 0.10 ± 42% perf-profile.children.cycles-pp.reweight_entity
0.14 ± 25% +0.1 0.25 ± 24% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.14 ± 25% +0.1 0.25 ± 24% perf-profile.children.cycles-pp.do_group_exit
0.14 ± 25% +0.1 0.25 ± 24% perf-profile.children.cycles-pp.do_exit
0.03 ±100% +0.1 0.15 ± 36% perf-profile.children.cycles-pp.rcu_core
0.03 ±100% +0.1 0.17 ± 19% perf-profile.children.cycles-pp.pipe_read
0.15 ± 34% +0.2 0.31 ± 7% perf-profile.children.cycles-pp.exit_mmap
0.00 +0.2 0.15 ± 48% perf-profile.children.cycles-pp.vm_mmap_pgoff
0.04 ± 60% +0.2 0.20 ± 18% perf-profile.children.cycles-pp.new_sync_read
0.11 ± 58% +0.2 0.27 ± 30% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.15 ± 34% +0.2 0.32 ± 11% perf-profile.children.cycles-pp.mmput
0.20 ± 9% +0.2 0.37 ± 15% perf-profile.children.cycles-pp.do_page_fault
0.16 ± 18% +0.2 0.32 ± 18% perf-profile.children.cycles-pp.handle_mm_fault
0.13 ± 24% +0.2 0.31 ± 24% perf-profile.children.cycles-pp.handle_pte_fault
0.04 ±107% +0.2 0.21 ± 49% perf-profile.children.cycles-pp.__update_load_avg_se
0.11 ± 30% +0.2 0.30 ± 17% perf-profile.children.cycles-pp.search_binary_handler
0.11 ± 30% +0.2 0.30 ± 17% perf-profile.children.cycles-pp.load_elf_binary
0.03 ±102% +0.2 0.21 ± 16% perf-profile.children.cycles-pp.update_curr
0.14 ± 26% +0.2 0.32 ± 18% perf-profile.children.cycles-pp.__handle_mm_fault
0.21 ± 12% +0.2 0.41 ± 9% perf-profile.children.cycles-pp.page_fault
0.09 ± 20% +0.2 0.29 ± 28% perf-profile.children.cycles-pp.lapic_next_deadline
0.12 ± 19% +0.2 0.32 ± 36% perf-profile.children.cycles-pp.native_write_msr
0.12 ± 18% +0.2 0.33 ± 34% perf-profile.children.cycles-pp.ksys_read
0.14 ± 23% +0.2 0.35 ± 32% perf-profile.children.cycles-pp.read
0.12 ± 18% +0.2 0.35 ± 33% perf-profile.children.cycles-pp.vfs_read
0.12 ± 28% +0.2 0.35 ± 22% perf-profile.children.cycles-pp.clockevents_program_event
0.04 ±101% +0.2 0.28 ± 12% perf-profile.children.cycles-pp.pick_next_task_fair
0.10 ± 36% +0.2 0.34 ± 39% perf-profile.children.cycles-pp.update_load_avg
0.10 ± 35% +0.3 0.35 ± 20% perf-profile.children.cycles-pp.interrupt_entry
0.16 ± 17% +0.3 0.44 ± 22% perf-profile.children.cycles-pp.execve
0.16 ± 17% +0.3 0.44 ± 22% perf-profile.children.cycles-pp.__x64_sys_execve
0.16 ± 17% +0.3 0.44 ± 22% perf-profile.children.cycles-pp.__do_execve_file
0.10 ± 65% +0.3 0.40 ± 16% perf-profile.children.cycles-pp.__softirqentry_text_start
0.12 ± 64% +0.3 0.43 ± 19% perf-profile.children.cycles-pp.irq_exit
0.18 ± 42% +0.5 0.65 ± 34% perf-profile.children.cycles-pp.task_tick_fair
0.12 ± 75% +0.5 0.62 ± 20% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.22 ± 45% +0.5 0.73 ± 27% perf-profile.children.cycles-pp.scheduler_tick
0.16 ± 26% +0.5 0.69 ±103% perf-profile.children.cycles-pp.write
0.16 ± 46% +0.6 0.74 ± 24% perf-profile.children.cycles-pp.schedule
0.15 ± 51% +0.6 0.75 ± 25% perf-profile.children.cycles-pp.__sched_text_start
0.29 ± 51% +0.6 0.91 ± 18% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.18 ± 14% +0.7 0.91 ± 14% perf-profile.children.cycles-pp.irq_work_run
0.18 ± 14% +0.7 0.91 ± 14% perf-profile.children.cycles-pp.printk
0.18 ± 14% +0.7 0.91 ± 15% perf-profile.children.cycles-pp.irq_work_interrupt
0.18 ± 14% +0.7 0.91 ± 15% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.35 ± 26% +0.8 1.19 ± 7% perf-profile.children.cycles-pp.tick_sched_handle
0.35 ± 26% +0.8 1.19 ± 7% perf-profile.children.cycles-pp.update_process_times
0.39 ± 44% +0.9 1.24 ± 22% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.41 ± 23% +0.9 1.35 ± 11% perf-profile.children.cycles-pp.tick_sched_timer
0.24 ± 23% +1.0 1.22 ± 19% perf-profile.children.cycles-pp.irq_work_run_list
0.18 ± 14% +1.2 1.34 ± 43% perf-profile.children.cycles-pp.vprintk_emit
0.21 ± 16% +1.2 1.40 ± 40% perf-profile.children.cycles-pp.drm_fb_helper_cfb_imageblit
0.21 ± 16% +1.2 1.40 ± 40% perf-profile.children.cycles-pp.cfb_imageblit
0.23 ± 14% +1.3 1.50 ± 40% perf-profile.children.cycles-pp.bit_putcs
0.64 ± 26% +1.3 1.92 ± 10% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.23 ± 16% +1.3 1.52 ± 39% perf-profile.children.cycles-pp.fbcon_putcs
0.24 ± 19% +1.3 1.55 ± 40% perf-profile.children.cycles-pp.fbcon_redraw
0.24 ± 20% +1.3 1.56 ± 40% perf-profile.children.cycles-pp.lf
0.24 ± 20% +1.3 1.56 ± 40% perf-profile.children.cycles-pp.con_scroll
0.24 ± 20% +1.3 1.56 ± 40% perf-profile.children.cycles-pp.fbcon_scroll
0.24 ± 20% +1.3 1.57 ± 39% perf-profile.children.cycles-pp.vt_console_print
0.99 ± 8% +1.4 2.36 ± 27% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.98 ± 7% +1.4 2.36 ± 27% perf-profile.children.cycles-pp.do_syscall_64
0.24 ± 23% +1.4 1.63 ± 40% perf-profile.children.cycles-pp.console_unlock
0.91 ± 21% +1.8 2.68 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt
1.08 ± 23% +2.1 3.21 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
1.18 ± 24% +2.4 3.56 ± 6% perf-profile.children.cycles-pp.apic_timer_interrupt
73.53 -4.7 68.82 perf-profile.self.cycles-pp.malloc
15.91 ± 2% -0.9 15.05 ± 4% perf-profile.self.cycles-pp.free
0.01 ±173% +0.1 0.11 ± 26% perf-profile.self.cycles-pp.__calc_delta
0.02 ±173% +0.1 0.14 ± 42% perf-profile.self.cycles-pp.unmap_page_range
0.12 ± 19% +0.2 0.32 ± 36% perf-profile.self.cycles-pp.native_write_msr
0.10 ± 40% +0.2 0.34 ± 33% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.10 ± 35% +0.3 0.35 ± 20% perf-profile.self.cycles-pp.interrupt_entry
0.21 ± 16% +1.2 1.40 ± 40% perf-profile.self.cycles-pp.cfb_imageblit
***************************************************************************************************
lkp-bdw-ep6: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/16/debian-x86_64-20191114.cgz/lkp-bdw-ep6/pthread_mutex1/will-it-scale/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:__do_softirq
:4 25% 1:4 dmesg.RIP:__usb_hcd_giveback_urb
:4 25% 1:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:rebalance_domains
:4 25% 1:4 dmesg.RIP:tick_nohz_idle_exit
%stddev %change %stddev
\ | \
2.505e+08 -57.9% 1.055e+08 will-it-scale.per_process_ops
4.008e+09 -57.9% 1.689e+09 will-it-scale.workload
31547 ± 5% -12.9% 27481 meminfo.Shmem
0.03 ± 4% +0.0 0.06 mpstat.cpu.all.sys%
14785 ± 18% -17.9% 12143 ± 17% numa-meminfo.node0.Mapped
713810 ± 2% +8.2% 772630 ± 7% numa-vmstat.node1.numa_hit
1410 +6.8% 1506 vmstat.system.cs
428161 ±127% -89.3% 45998 ± 2% cpuidle.POLL.time
59373 ± 53% -82.2% 10569 ± 5% cpuidle.POLL.usage
70394 -2.1% 68899 proc-vmstat.nr_active_anon
67334 -0.8% 66815 proc-vmstat.nr_anon_pages
7887 ± 5% -12.9% 6866 proc-vmstat.nr_shmem
70394 -2.1% 68899 proc-vmstat.nr_zone_active_anon
4138 ± 15% -35.2% 2681 ± 3% proc-vmstat.pgactivate
28675 ± 40% +66.5% 47730 ± 3% softirqs.CPU0.SCHED
77182 ± 5% +11.3% 85908 ± 4% softirqs.CPU14.RCU
155252 ± 11% -22.8% 119871 ± 22% softirqs.CPU22.TIMER
23136 ± 48% -78.4% 5002 ± 16% softirqs.CPU44.SCHED
115092 ± 6% +7.6% 123849 ± 4% softirqs.CPU45.RCU
145244 ± 20% -25.6% 108094 ± 29% softirqs.CPU54.TIMER
3.615e+10 -57.5% 1.535e+10 perf-stat.i.branch-instructions
0.04 ± 30% +0.1 0.09 ± 23% perf-stat.i.branch-miss-rate%
1384 +6.6% 1476 perf-stat.i.context-switches
4.814e+10 ± 2% -53.8% 2.224e+10 ± 4% perf-stat.i.cpu-cycles
2.831e+10 -57.7% 1.198e+10 perf-stat.i.dTLB-loads
1.22e+10 -56.8% 5.27e+09 perf-stat.i.dTLB-stores
7.282e+10 -57.1% 3.126e+10 perf-stat.i.instructions
0.03 ± 33% +0.0 0.08 ± 27% perf-stat.overall.branch-miss-rate%
191503 ± 31% -57.5% 81299 ± 49% perf-stat.overall.cycles-between-cache-misses
5463 +2.0% 5571 perf-stat.overall.path-length
3.603e+10 -57.5% 1.53e+10 perf-stat.ps.branch-instructions
1379 +6.6% 1471 perf-stat.ps.context-switches
4.798e+10 ± 2% -53.8% 2.216e+10 ± 4% perf-stat.ps.cpu-cycles
2.822e+10 -57.7% 1.194e+10 perf-stat.ps.dTLB-loads
1.215e+10 -56.8% 5.253e+09 perf-stat.ps.dTLB-stores
7.257e+10 -57.1% 3.115e+10 perf-stat.ps.instructions
2.19e+13 -57.0% 9.407e+12 perf-stat.total.instructions
47232 ± 8% +29.0% 60937 ± 4% sched_debug.cfs_rq:/.exec_clock.avg
7.97 ± 16% +268.2% 29.34 ± 36% sched_debug.cfs_rq:/.exec_clock.min
797768 ± 8% +30.8% 1043808 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg
8594 ± 14% +36.3% 11717 ± 19% sched_debug.cfs_rq:/.min_vruntime.min
0.28 ± 27% +58.9% 0.44 ± 17% sched_debug.cfs_rq:/.nr_spread_over.stddev
23.87 ± 2% +16.0% 27.69 ± 11% sched_debug.cfs_rq:/.runnable_load_avg.stddev
-85357 -1249.7% 981342 ± 9% sched_debug.cfs_rq:/.spread0.avg
1493225 ± 52% +65.4% 2469981 ± 3% sched_debug.cfs_rq:/.spread0.max
2.21 ± 12% +91.5% 4.23 ± 7% sched_debug.cpu.clock.stddev
2.21 ± 12% +91.5% 4.23 ± 7% sched_debug.cpu.clock_task.stddev
5104 ± 7% +20.8% 6165 ± 5% sched_debug.cpu.nr_switches.stddev
4617 ± 8% +22.4% 5653 ± 6% sched_debug.cpu.sched_count.stddev
1029 ± 7% +15.4% 1188 sched_debug.cpu.sched_goidle.avg
2318 ± 7% +22.4% 2838 ± 6% sched_debug.cpu.sched_goidle.stddev
1028 ± 7% +15.0% 1183 sched_debug.cpu.ttwu_count.avg
2242 ± 13% +19.7% 2685 ± 10% sched_debug.cpu.ttwu_count.stddev
6631 ± 42% +101.3% 13349 ± 8% sched_debug.cpu.ttwu_local.max
960.52 ± 24% +66.7% 1601 ± 9% sched_debug.cpu.ttwu_local.stddev
0.36 ±100% +0.5 0.91 ± 11% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.94 ±101% +2.8 3.75 ± 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.94 ±101% +2.8 3.75 ± 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
0.94 ±101% +2.8 3.75 ± 5% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
0.93 ±101% +2.8 3.75 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.93 ±101% +2.8 3.75 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
17.82 ± 27% -4.5 13.32 ± 3% perf-profile.children.cycles-pp.pthread_mutex_lock
8.70 ± 27% -2.3 6.44 ± 2% perf-profile.children.cycles-pp.pthread_mutex_lock@plt
8.75 ± 28% -2.2 6.52 ± 4% perf-profile.children.cycles-pp.pthread_mutex_unlock@plt
0.05 ± 60% +0.0 0.08 ± 13% perf-profile.children.cycles-pp.note_gp_changes
0.10 ± 11% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.console_unlock
0.10 ± 12% +0.0 0.14 ± 10% perf-profile.children.cycles-pp.irq_work_run_list
0.06 ± 60% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.interrupt_entry
0.11 ± 21% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.read_tsc
0.09 ± 26% +0.1 0.15 ± 15% perf-profile.children.cycles-pp.native_irq_return_iret
0.20 ± 21% +0.1 0.29 ± 30% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.18 ± 33% +0.1 0.28 ± 13% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.28 ± 28% +0.1 0.42 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.32 ± 23% +0.2 0.51 ± 6% perf-profile.children.cycles-pp.rcu_core
0.64 ± 25% +0.3 0.93 ± 13% perf-profile.children.cycles-pp.__softirqentry_text_start
0.78 ± 21% +0.4 1.20 ± 8% perf-profile.children.cycles-pp.irq_exit
0.94 ±101% +2.8 3.75 ± 5% perf-profile.children.cycles-pp.start_kernel
9.09 ± 27% -2.3 6.82 ± 4% perf-profile.self.cycles-pp.pthread_mutex_lock
8.58 ± 27% -2.3 6.31 ± 3% perf-profile.self.cycles-pp.pthread_mutex_lock@plt
8.67 ± 28% -2.2 6.43 ± 4% perf-profile.self.cycles-pp.pthread_mutex_unlock@plt
0.03 ±100% +0.0 0.07 ± 17% perf-profile.self.cycles-pp._raw_spin_lock
0.06 ± 63% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.interrupt_entry
0.11 ± 20% +0.0 0.16 ± 11% perf-profile.self.cycles-pp.read_tsc
0.09 ± 26% +0.1 0.15 ± 15% perf-profile.self.cycles-pp.native_irq_return_iret
0.18 ± 33% +0.1 0.28 ± 13% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
300.75 ± 54% +75.6% 528.25 ± 23% interrupts.37:IR-PCI-MSI.1572868-edge.eth0-TxRx-3
464.50 ± 33% -57.5% 197.50 ± 19% interrupts.40:IR-PCI-MSI.1572871-edge.eth0-TxRx-6
412.50 ± 7% -14.2% 354.00 interrupts.9:IR-IO-APIC.9-fasteoi.acpi
412.50 ± 7% -14.2% 354.00 interrupts.CPU1.9:IR-IO-APIC.9-fasteoi.acpi
4557 ± 26% -37.1% 2865 interrupts.CPU10.NMI:Non-maskable_interrupts
4557 ± 26% -37.1% 2865 interrupts.CPU10.PMI:Performance_monitoring_interrupts
4336 ± 33% -42.4% 2499 ± 24% interrupts.CPU15.NMI:Non-maskable_interrupts
4336 ± 33% -42.4% 2499 ± 24% interrupts.CPU15.PMI:Performance_monitoring_interrupts
300.75 ± 54% +75.6% 528.25 ± 23% interrupts.CPU16.37:IR-PCI-MSI.1572868-edge.eth0-TxRx-3
464.50 ± 33% -57.5% 197.50 ± 19% interrupts.CPU19.40:IR-PCI-MSI.1572871-edge.eth0-TxRx-6
4285 ± 33% -33.4% 2856 interrupts.CPU2.NMI:Non-maskable_interrupts
4285 ± 33% -33.4% 2856 interrupts.CPU2.PMI:Performance_monitoring_interrupts
12.75 ± 50% +294.1% 50.25 ± 83% interrupts.CPU27.RES:Rescheduling_interrupts
7890 -57.4% 3358 interrupts.CPU45.NMI:Non-maskable_interrupts
7890 -57.4% 3358 interrupts.CPU45.PMI:Performance_monitoring_interrupts
7890 -57.4% 3357 interrupts.CPU46.NMI:Non-maskable_interrupts
7890 -57.4% 3357 interrupts.CPU46.PMI:Performance_monitoring_interrupts
6903 ± 24% -51.3% 3358 interrupts.CPU47.NMI:Non-maskable_interrupts
6903 ± 24% -51.3% 3358 interrupts.CPU47.PMI:Performance_monitoring_interrupts
6904 ± 24% -51.3% 3360 interrupts.CPU48.NMI:Non-maskable_interrupts
6904 ± 24% -51.3% 3360 interrupts.CPU48.PMI:Performance_monitoring_interrupts
5917 ± 33% -43.2% 3358 interrupts.CPU49.NMI:Non-maskable_interrupts
5917 ± 33% -43.2% 3358 interrupts.CPU49.PMI:Performance_monitoring_interrupts
4287 ± 33% -33.4% 2856 interrupts.CPU5.NMI:Non-maskable_interrupts
4287 ± 33% -33.4% 2856 interrupts.CPU5.PMI:Performance_monitoring_interrupts
4930 ± 34% -34.4% 3233 ± 6% interrupts.CPU50.NMI:Non-maskable_interrupts
4930 ± 34% -34.4% 3233 ± 6% interrupts.CPU50.PMI:Performance_monitoring_interrupts
4940 ± 34% -34.3% 3245 ± 5% interrupts.CPU52.NMI:Non-maskable_interrupts
4940 ± 34% -34.3% 3245 ± 5% interrupts.CPU52.PMI:Performance_monitoring_interrupts
5907 ± 33% -43.2% 3357 interrupts.CPU53.NMI:Non-maskable_interrupts
5907 ± 33% -43.2% 3357 interrupts.CPU53.PMI:Performance_monitoring_interrupts
5913 ± 33% -43.2% 3357 interrupts.CPU55.NMI:Non-maskable_interrupts
5913 ± 33% -43.2% 3357 interrupts.CPU55.PMI:Performance_monitoring_interrupts
6905 ± 24% -51.3% 3361 interrupts.CPU56.NMI:Non-maskable_interrupts
6905 ± 24% -51.3% 3361 interrupts.CPU56.PMI:Performance_monitoring_interrupts
6904 ± 24% -57.5% 2937 ± 24% interrupts.CPU57.NMI:Non-maskable_interrupts
6904 ± 24% -57.5% 2937 ± 24% interrupts.CPU57.PMI:Performance_monitoring_interrupts
6904 ± 24% -57.5% 2937 ± 24% interrupts.CPU58.NMI:Non-maskable_interrupts
6904 ± 24% -57.5% 2937 ± 24% interrupts.CPU58.PMI:Performance_monitoring_interrupts
6858 ± 24% -57.2% 2937 ± 24% interrupts.CPU59.NMI:Non-maskable_interrupts
6858 ± 24% -57.2% 2937 ± 24% interrupts.CPU59.PMI:Performance_monitoring_interrupts
175277 ± 13% -40.2% 104738 ± 2% interrupts.NMI:Non-maskable_interrupts
175277 ± 13% -40.2% 104738 ± 2% interrupts.PMI:Performance_monitoring_interrupts
***************************************************************************************************
lkp-ivb-d02: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/thread/16/debian-x86_64-20191114.cgz/lkp-ivb-d02/pipe1/will-it-scale/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 75% 3:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:find_busiest_group
%stddev %change %stddev
\ | \
127138 -53.5% 59094 will-it-scale.per_thread_ops
1099984 -16.2% 922278 ± 2% will-it-scale.time.involuntary_context_switches
391.00 -3.5% 377.25 will-it-scale.time.percent_of_cpu_this_job_got
791.53 -3.9% 761.03 will-it-scale.time.system_time
387.84 -2.8% 376.84 ± 2% will-it-scale.time.user_time
2034223 -53.5% 945514 will-it-scale.workload
21.92 ± 3% +10.7% 24.26 ± 5% boot-time.boot
80.50 ± 42% -88.8% 9.00 ± 26% cpuidle.POLL.usage
17343 -8.6% 15858 meminfo.Shmem
139.50 +68.1% 234.50 ± 22% slabinfo.fsnotify_mark_connector.active_objs
46750 ± 6% +13.7% 53160 ± 3% softirqs.CPU2.RCU
194293 ± 6% +11.6% 216921 ± 4% softirqs.RCU
15629 ± 3% +12.7% 17621 softirqs.SCHED
65.50 -3.8% 63.00 vmstat.cpu.sy
33.00 +7.6% 35.50 ± 2% vmstat.cpu.us
7308 -4.7% 6968 vmstat.system.cs
10952 -4.1% 10502 vmstat.system.in
65863 -4.9% 62633 proc-vmstat.nr_active_anon
64543 -4.4% 61687 proc-vmstat.nr_anon_pages
4336 -8.6% 3965 proc-vmstat.nr_shmem
65838 -4.9% 62614 proc-vmstat.nr_zone_active_anon
1233 ± 10% -44.0% 690.25 ± 11% proc-vmstat.pgactivate
351470 -1.9% 344919 proc-vmstat.pgfree
10854 ± 13% -71.6% 3083 interrupts.CPU0.NMI:Non-maskable_interrupts
10854 ± 13% -71.6% 3083 interrupts.CPU0.PMI:Performance_monitoring_interrupts
7952 ± 33% -61.3% 3075 interrupts.CPU2.NMI:Non-maskable_interrupts
7952 ± 33% -61.3% 3075 interrupts.CPU2.PMI:Performance_monitoring_interrupts
7999 ± 34% -51.8% 3857 ± 34% interrupts.CPU3.NMI:Non-maskable_interrupts
7999 ± 34% -51.8% 3857 ± 34% interrupts.CPU3.PMI:Performance_monitoring_interrupts
33765 ± 11% -56.6% 14652 ± 17% interrupts.NMI:Non-maskable_interrupts
33765 ± 11% -56.6% 14652 ± 17% interrupts.PMI:Performance_monitoring_interrupts
10614 ± 11% +14.7% 12169 ± 5% interrupts.RES:Rescheduling_interrupts
5992 ± 32% +90.7% 11431 ± 26% sched_debug.cfs_rq:/.min_vruntime.stddev
7.66 ± 5% +103.5% 15.58 ± 12% sched_debug.cfs_rq:/.nr_spread_over.avg
22.46 ± 10% +60.7% 36.08 ± 17% sched_debug.cfs_rq:/.nr_spread_over.max
1237 ±365% -1083.4% -12166 sched_debug.cfs_rq:/.spread0.avg
-7514 +237.4% -25357 sched_debug.cfs_rq:/.spread0.min
5990 ± 32% +91.1% 11445 ± 26% sched_debug.cfs_rq:/.spread0.stddev
31.19 ± 30% +88.5% 58.80 ± 24% sched_debug.cfs_rq:/.util_avg.stddev
3.16 ± 10% +88.7% 5.96 ± 16% sched_debug.cpu.clock.stddev
3.16 ± 10% +88.7% 5.96 ± 16% sched_debug.cpu.clock_task.stddev
2065 ± 2% -19.8% 1656 ± 8% sched_debug.cpu.sched_goidle.avg
1.46 ±173% +1800.0% 27.71 ± 73% sched_debug.cpu.sched_goidle.min
0.19 ± 9% +113.6% 0.40 perf-stat.i.MPKI
1.207e+09 -50.5% 5.976e+08 perf-stat.i.branch-instructions
1.58 +0.3 1.93 perf-stat.i.branch-miss-rate%
19250623 -39.4% 11672275 perf-stat.i.branch-misses
12.39 ± 4% +2.7 15.10 perf-stat.i.cache-miss-rate%
144627 ± 2% +29.9% 187812 perf-stat.i.cache-misses
1080010 ± 2% +12.8% 1218216 perf-stat.i.cache-references
7371 -4.7% 7022 perf-stat.i.context-switches
2.14 -2.0% 2.10 perf-stat.i.cpi
1.307e+10 -51.7% 6.31e+09 perf-stat.i.cpu-cycles
37.68 ± 8% +8.9% 41.02 ± 7% perf-stat.i.cpu-migrations
156713 ± 2% -62.9% 58110 ± 11% perf-stat.i.cycles-between-cache-misses
38767199 ± 12% -54.5% 17640059 ± 14% perf-stat.i.dTLB-load-misses
1.856e+09 -51.6% 8.987e+08 perf-stat.i.dTLB-loads
9750289 ± 3% -55.6% 4330192 ± 4% perf-stat.i.dTLB-store-misses
1.354e+09 -52.3% 6.46e+08 perf-stat.i.dTLB-stores
1949136 ± 9% -47.8% 1016639 ± 16% perf-stat.i.iTLB-load-misses
5860 ± 14% +81.5% 10639 ± 14% perf-stat.i.iTLB-loads
6.112e+09 -50.7% 3.015e+09 perf-stat.i.instructions
0.47 +2.0% 0.48 perf-stat.i.ipc
0.18 ± 2% +128.9% 0.40 perf-stat.overall.MPKI
1.59 +0.4 1.95 perf-stat.overall.branch-miss-rate%
13.40 ± 3% +2.0 15.43 perf-stat.overall.cache-miss-rate%
2.14 -2.1% 2.09 perf-stat.overall.cpi
90397 ± 2% -62.9% 33558 perf-stat.overall.cycles-between-cache-misses
0.47 +2.2% 0.48 perf-stat.overall.ipc
906994 +6.0% 961269 perf-stat.overall.path-length
1.203e+09 -50.5% 5.957e+08 perf-stat.ps.branch-instructions
19187059 -39.4% 11636390 perf-stat.ps.branch-misses
144150 ± 2% +30.0% 187452 perf-stat.ps.cache-misses
1076446 ± 2% +12.9% 1215149 perf-stat.ps.cache-references
7346 -4.8% 6995 perf-stat.ps.context-switches
1.302e+10 -51.7% 6.289e+09 perf-stat.ps.cpu-cycles
37.55 ± 8% +8.8% 40.87 ± 7% perf-stat.ps.cpu-migrations
38639130 ± 12% -54.5% 17580860 ± 14% perf-stat.ps.dTLB-load-misses
1.849e+09 -51.6% 8.957e+08 perf-stat.ps.dTLB-loads
9718082 ± 3% -55.6% 4315591 ± 4% perf-stat.ps.dTLB-store-misses
1.35e+09 -52.3% 6.438e+08 perf-stat.ps.dTLB-stores
1942698 ± 9% -47.8% 1013144 ± 16% perf-stat.ps.iTLB-load-misses
5841 ± 14% +81.7% 10612 ± 14% perf-stat.ps.iTLB-loads
6.092e+09 -50.7% 3.006e+09 perf-stat.ps.instructions
1.845e+12 -50.7% 9.089e+11 perf-stat.total.instructions
50.03 -1.1 48.94 perf-profile.calltrace.cycles-pp.__GI___libc_read
34.45 -0.8 33.67 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
35.23 -0.7 34.49 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read
0.55 ± 4% -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.__sb_start_write.pipe_write.new_sync_write.vfs_write.ksys_write
0.86 ± 22% -0.2 0.67 ± 18% perf-profile.calltrace.cycles-pp.fsnotify.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
50.15 -1.1 49.10 perf-profile.children.cycles-pp.__GI___libc_read
0.07 ± 24% +0.0 0.12 ± 21% perf-profile.children.cycles-pp.do_page_fault
0.07 ± 21% +0.0 0.12 ± 19% perf-profile.children.cycles-pp.handle_mm_fault
0.01 ±173% +0.1 0.06 ± 26% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +0.1 0.05 perf-profile.children.cycles-pp.do_sys_open
0.00 +0.1 0.05 perf-profile.children.cycles-pp.do_sys_openat2
0.05 ± 60% +0.1 0.10 ± 17% perf-profile.children.cycles-pp.handle_pte_fault
0.01 ±173% +0.1 0.07 ± 31% perf-profile.children.cycles-pp.native_write_msr
0.01 ±173% +0.1 0.07 ± 21% perf-profile.children.cycles-pp.search_binary_handler
0.01 ±173% +0.1 0.07 ± 21% perf-profile.children.cycles-pp.load_elf_binary
0.08 ± 19% +0.1 0.14 ± 16% perf-profile.children.cycles-pp.page_fault
0.06 ± 60% +0.1 0.12 ± 19% perf-profile.children.cycles-pp.__handle_mm_fault
0.12 ± 26% +0.1 0.18 ± 15% perf-profile.children.cycles-pp.__vfs_read
0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.activate_task
0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.enqueue_task_fair
0.01 ±173% +0.1 0.08 ± 10% perf-profile.children.cycles-pp.try_to_wake_up
0.03 ±100% +0.1 0.10 ± 25% perf-profile.children.cycles-pp.execve
0.03 ±100% +0.1 0.10 ± 25% perf-profile.children.cycles-pp.__x64_sys_execve
0.03 ±100% +0.1 0.10 ± 25% perf-profile.children.cycles-pp.__do_execve_file
0.03 ±100% +0.1 0.11 ± 12% perf-profile.children.cycles-pp.read
0.04 ± 57% +0.1 0.12 ± 17% perf-profile.children.cycles-pp.__sched_text_start
0.03 ±100% +0.1 0.11 ± 28% perf-profile.children.cycles-pp.__softirqentry_text_start
0.03 ±100% +0.1 0.11 ± 35% perf-profile.children.cycles-pp.irq_exit
0.02 ±173% +0.1 0.11 ± 20% perf-profile.children.cycles-pp.write
0.01 ±173% +0.1 0.10 ± 45% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.schedule
0.84 ± 3% +0.1 0.96 ± 4% perf-profile.children.cycles-pp.fput_many
0.05 ± 59% +0.1 0.20 ± 43% perf-profile.children.cycles-pp.task_tick_fair
0.06 ± 60% +0.1 0.21 ± 10% perf-profile.children.cycles-pp.cfb_imageblit
0.06 ± 60% +0.2 0.21 ± 12% perf-profile.children.cycles-pp.drm_fb_helper_cfb_imageblit
0.08 ± 26% +0.2 0.24 ± 6% perf-profile.children.cycles-pp.console_unlock
0.08 ± 24% +0.2 0.24 ± 5% perf-profile.children.cycles-pp.fbcon_redraw
0.07 ± 60% +0.2 0.23 ± 42% perf-profile.children.cycles-pp.scheduler_tick
0.08 ± 26% +0.2 0.25 ± 7% perf-profile.children.cycles-pp.irq_work_run_list
0.08 ± 24% +0.2 0.24 ± 6% perf-profile.children.cycles-pp.vt_console_print
0.08 ± 24% +0.2 0.24 ± 6% perf-profile.children.cycles-pp.lf
0.08 ± 24% +0.2 0.24 ± 6% perf-profile.children.cycles-pp.con_scroll
0.08 ± 24% +0.2 0.24 ± 6% perf-profile.children.cycles-pp.fbcon_scroll
0.06 ± 14% +0.2 0.23 ± 7% perf-profile.children.cycles-pp.irq_work_interrupt
0.06 ± 14% +0.2 0.23 ± 7% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.06 ± 14% +0.2 0.23 ± 7% perf-profile.children.cycles-pp.irq_work_run
0.06 ± 14% +0.2 0.23 ± 7% perf-profile.children.cycles-pp.printk
0.06 ± 14% +0.2 0.23 ± 7% perf-profile.children.cycles-pp.vprintk_emit
0.07 ± 60% +0.2 0.24 ± 10% perf-profile.children.cycles-pp.fbcon_putcs
0.06 ± 58% +0.2 0.23 ± 8% perf-profile.children.cycles-pp.bit_putcs
0.13 ± 22% +0.2 0.31 ± 31% perf-profile.children.cycles-pp.update_process_times
0.13 ± 24% +0.2 0.32 ± 32% perf-profile.children.cycles-pp.tick_sched_handle
0.15 ± 26% +0.2 0.36 ± 29% perf-profile.children.cycles-pp.tick_sched_timer
0.21 ± 18% +0.3 0.48 ± 25% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.29 ± 18% +0.3 0.62 ± 23% perf-profile.children.cycles-pp.hrtimer_interrupt
0.34 ± 18% +0.4 0.76 ± 25% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.39 ± 17% +0.4 0.83 ± 24% perf-profile.children.cycles-pp.apic_timer_interrupt
1.67 ± 7% -0.2 1.45 ± 8% perf-profile.self.cycles-pp.__fsnotify_parent
0.01 ±173% +0.1 0.07 ± 31% perf-profile.self.cycles-pp.native_write_msr
0.10 ± 29% +0.1 0.16 ± 14% perf-profile.self.cycles-pp.__vfs_read
0.82 ± 3% +0.1 0.93 ± 4% perf-profile.self.cycles-pp.fput_many
0.06 ± 60% +0.1 0.21 ± 10% perf-profile.self.cycles-pp.cfb_imageblit
***************************************************************************************************
lkp-bdw-de1: 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_threads/rootfs/tbox_group/test/test_memory_size/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/development/50%/debian-x86_64-20191114.cgz/lkp-bdw-de1/MMAP/50%/lmbench3/0x7000019
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 75% 3:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:find_busiest_group
2:4 16% 2:4 perf-profile.calltrace.cycles-pp.sync_regs.error_entry
11:4 72% 14:4 perf-profile.calltrace.cycles-pp.error_entry
0:4 1% 0:4 perf-profile.children.cycles-pp.error_exit
12:4 78% 15:4 perf-profile.children.cycles-pp.error_entry
9:4 63% 12:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
59796 -36.3% 38109 ± 5% lmbench3.MMAP.read.bandwidth.MB/sec
34823 -53.4% 16211 ± 2% lmbench3.MMAP.read_open2close.bandwidth.MB/sec
9.874e+08 ± 9% -69.3% 3.027e+08 lmbench3.time.minor_page_faults
2771 ± 8% -11.2% 2461 lmbench3.time.system_time
5509144 ± 7% -67.8% 1775030 ± 4% lmbench3.time.voluntary_context_switches
0.00 ±125% +0.0 0.00 ± 54% mpstat.cpu.all.iowait%
12325 ± 23% -56.2% 5404 ± 3% vmstat.system.cs
172684 ± 8% +20.6% 208196 ± 4% meminfo.Mapped
30615 ± 3% -19.1% 24758 meminfo.Shmem
39.60 ± 10% +24.2% 49.18 ± 11% boot-time.boot
21.16 ± 17% +18.3% 25.04 ± 22% boot-time.dhcp
576.19 ± 10% +21.1% 697.49 ± 11% boot-time.idle
3634135 ± 11% +276.1% 13669368 ± 3% cpuidle.C1.time
902893 ± 9% +70.4% 1538961 ± 4% cpuidle.C1.usage
5.698e+09 ± 56% -46.4% 3.053e+09 ± 18% cpuidle.C1E.time
13219284 ± 7% -68.1% 4210732 ± 4% cpuidle.POLL.time
5423686 ± 7% -88.0% 651438 ± 4% cpuidle.POLL.usage
42733 ± 10% +23.0% 52572 ± 4% proc-vmstat.nr_mapped
7653 ± 3% -19.1% 6189 proc-vmstat.nr_shmem
12908 -2.7% 12561 proc-vmstat.nr_slab_unreclaimable
58993011 ± 9% -60.9% 23090737 proc-vmstat.numa_hit
58993011 ± 9% -60.9% 23090737 proc-vmstat.numa_local
2582 ± 27% -46.4% 1383 ± 5% proc-vmstat.pgactivate
70058749 ± 8% -53.9% 32317690 proc-vmstat.pgalloc_normal
1.652e+09 ± 9% -69.5% 5.031e+08 proc-vmstat.pgfault
70019497 ± 8% -54.0% 32182265 proc-vmstat.pgfree
839.50 ± 13% -19.6% 675.25 ± 4% slabinfo.Acpi-Parse.active_objs
839.50 ± 13% -19.6% 675.25 ± 4% slabinfo.Acpi-Parse.num_objs
1550 ± 3% -9.3% 1406 ± 4% slabinfo.cred_jar.active_objs
1550 ± 3% -9.3% 1406 ± 4% slabinfo.cred_jar.num_objs
10240 ± 11% -30.3% 7141 slabinfo.filp.active_objs
343.50 ± 9% -31.4% 235.50 ± 2% slabinfo.filp.active_slabs
11007 ± 9% -31.4% 7551 slabinfo.filp.num_objs
343.50 ± 9% -31.4% 235.50 ± 2% slabinfo.filp.num_slabs
176.00 ± 27% +54.5% 272.00 ± 5% slabinfo.kmalloc-rcl-128.active_objs
176.00 ± 27% +54.5% 272.00 ± 5% slabinfo.kmalloc-rcl-128.num_objs
913.50 ± 8% +23.0% 1123 ± 4% slabinfo.kmalloc-rcl-96.active_objs
913.50 ± 8% +23.0% 1123 ± 4% slabinfo.kmalloc-rcl-96.num_objs
2559 ± 16% -38.8% 1565 ± 38% interrupts.34:IR-PCI-MSI.2621441-edge.eth0-TxRx-0
5158 ± 10% -40.9% 3046 ± 12% interrupts.CPU0.RES:Rescheduling_interrupts
4410 ± 14% -35.4% 2850 ± 21% interrupts.CPU1.RES:Rescheduling_interrupts
5504 ± 23% -62.0% 2091 ± 3% interrupts.CPU10.NMI:Non-maskable_interrupts
5504 ± 23% -62.0% 2091 ± 3% interrupts.CPU10.PMI:Performance_monitoring_interrupts
881.25 ± 58% +165.9% 2343 ± 39% interrupts.CPU11.TLB:TLB_shootdowns
4947 ± 6% -13.7% 4271 ± 7% interrupts.CPU14.RES:Rescheduling_interrupts
5151 ± 13% -23.5% 3939 ± 7% interrupts.CPU15.RES:Rescheduling_interrupts
4386 ± 18% -37.7% 2730 ± 10% interrupts.CPU2.RES:Rescheduling_interrupts
4661 ± 11% -43.4% 2636 ± 19% interrupts.CPU3.RES:Rescheduling_interrupts
4812 ± 20% -50.4% 2387 ± 8% interrupts.CPU4.RES:Rescheduling_interrupts
4870 ± 18% -45.3% 2662 ± 22% interrupts.CPU5.RES:Rescheduling_interrupts
3833 ± 13% -23.5% 2933 ± 11% interrupts.CPU6.RES:Rescheduling_interrupts
2559 ± 16% -38.8% 1565 ± 38% interrupts.CPU8.34:IR-PCI-MSI.2621441-edge.eth0-TxRx-0
124.00 ± 3% +17.1% 145.25 ± 7% interrupts.CPU9.CAL:Function_call_interrupts
70339 ± 7% -22.9% 54227 ± 4% interrupts.RES:Rescheduling_interrupts
134057 ± 41% -45.1% 73618 ± 3% softirqs.CPU0.SCHED
135884 ± 40% -43.5% 76725 ± 15% softirqs.CPU1.SCHED
411979 ± 30% -29.0% 292317 softirqs.CPU1.TIMER
125329 ± 40% -37.5% 78295 ± 5% softirqs.CPU10.SCHED
122051 ± 48% -43.5% 68923 ± 6% softirqs.CPU11.SCHED
445933 ± 43% -36.5% 283341 ± 2% softirqs.CPU11.TIMER
131655 ± 41% -46.6% 70340 ± 10% softirqs.CPU12.SCHED
123508 ± 46% -43.7% 69575 ± 3% softirqs.CPU13.SCHED
118137 ± 33% -40.6% 70141 ± 7% softirqs.CPU14.SCHED
121362 ± 49% -40.4% 72283 ± 5% softirqs.CPU15.SCHED
128887 ± 46% -47.0% 68259 ± 7% softirqs.CPU2.SCHED
132599 ± 42% -38.7% 81270 ± 6% softirqs.CPU3.SCHED
122011 ± 48% -37.8% 75843 ± 10% softirqs.CPU4.SCHED
133060 ± 45% -44.3% 74126 ± 3% softirqs.CPU5.SCHED
125294 ± 43% -36.8% 79130 ± 4% softirqs.CPU6.SCHED
133132 ± 44% -44.0% 74489 ± 5% softirqs.CPU7.SCHED
2008609 ± 42% -40.9% 1186473 softirqs.SCHED
194419 ± 6% -10.6% 173824 ± 3% sched_debug.cfs_rq:/.exec_clock.avg
93.69 ± 18% -20.5% 74.48 ± 10% sched_debug.cfs_rq:/.load_avg.stddev
0.65 ± 8% +193.0% 1.91 ± 3% sched_debug.cpu.clock.stddev
0.65 ± 8% +193.2% 1.91 ± 3% sched_debug.cpu.clock_task.stddev
0.00 ± 2% +24.7% 0.00 ± 20% sched_debug.cpu.next_balance.stddev
531879 ± 4% -57.9% 224113 ± 3% sched_debug.cpu.nr_switches.avg
705887 ± 4% -53.5% 328229 ± 3% sched_debug.cpu.nr_switches.max
361512 ± 11% -64.7% 127482 ± 11% sched_debug.cpu.nr_switches.min
105347 ± 24% -38.8% 64436 ± 13% sched_debug.cpu.nr_switches.stddev
527125 ± 4% -58.5% 218856 ± 3% sched_debug.cpu.sched_count.avg
700713 ± 4% -53.8% 323889 ± 2% sched_debug.cpu.sched_count.max
358284 ± 12% -65.7% 122786 ± 10% sched_debug.cpu.sched_count.min
105218 ± 24% -39.0% 64228 ± 14% sched_debug.cpu.sched_count.stddev
262228 ± 4% -58.8% 108039 ± 3% sched_debug.cpu.sched_goidle.avg
349142 ± 4% -54.0% 160597 ± 2% sched_debug.cpu.sched_goidle.max
177904 ± 12% -66.4% 59745 ± 10% sched_debug.cpu.sched_goidle.min
52610 ± 24% -38.8% 32185 ± 14% sched_debug.cpu.sched_goidle.stddev
264288 ± 4% -58.6% 109405 ± 3% sched_debug.cpu.ttwu_count.avg
347196 ± 3% -53.4% 161753 ± 4% sched_debug.cpu.ttwu_count.max
189839 ± 11% -67.9% 60917 ± 10% sched_debug.cpu.ttwu_count.min
48965 ± 25% -36.7% 30988 ± 14% sched_debug.cpu.ttwu_count.stddev
54.70 -10.8% 48.80 perf-stat.i.MPKI
1.512e+09 ± 21% -59.4% 6.14e+08 perf-stat.i.branch-instructions
11536320 ± 17% -46.3% 6194760 perf-stat.i.branch-misses
6.136e+08 ± 21% -56.2% 2.687e+08 perf-stat.i.cache-misses
6.136e+08 ± 21% -56.2% 2.687e+08 perf-stat.i.cache-references
12357 ± 23% -56.4% 5383 ± 3% perf-stat.i.context-switches
1.58 ± 13% -26.7% 1.16 perf-stat.i.cpi
1.734e+10 ± 20% -64.7% 6.122e+09 perf-stat.i.cpu-cycles
21.44 ± 4% +6.7% 22.87 perf-stat.i.cpu-migrations
1154 ± 22% -60.3% 458.09 perf-stat.i.cycles-between-cache-misses
7118274 ± 21% -59.5% 2880366 perf-stat.i.dTLB-load-misses
8.658e+09 ± 21% -59.1% 3.545e+09 perf-stat.i.dTLB-loads
0.28 -0.0 0.26 perf-stat.i.dTLB-store-miss-rate%
4937319 ± 20% -63.8% 1787428 perf-stat.i.dTLB-store-misses
1.041e+09 ± 20% -60.3% 4.138e+08 perf-stat.i.dTLB-stores
49.61 ± 2% -5.1 44.49 perf-stat.i.iTLB-load-miss-rate%
3035551 ± 20% -63.2% 1116287 perf-stat.i.iTLB-load-misses
2880611 ± 20% -57.0% 1239559 perf-stat.i.iTLB-loads
1.379e+10 ± 20% -59.1% 5.643e+09 perf-stat.i.instructions
140716 ± 23% -59.8% 56595 ± 13% perf-stat.i.instructions-per-iTLB-miss
0.79 ± 2% +17.2% 0.92 perf-stat.i.ipc
1006871 ± 21% -63.6% 366463 perf-stat.i.minor-faults
1006871 ± 21% -63.6% 366463 perf-stat.i.page-faults
44.44 +7.1% 47.60 perf-stat.overall.MPKI
0.77 ± 5% +0.2 1.01 perf-stat.overall.branch-miss-rate%
1.26 -13.9% 1.08 perf-stat.overall.cpi
28.36 -19.6% 22.79 perf-stat.overall.cycles-between-cache-misses
0.47 -0.0 0.43 perf-stat.overall.dTLB-store-miss-rate%
51.35 -4.0 47.38 perf-stat.overall.iTLB-load-miss-rate%
4531 +11.5% 5054 perf-stat.overall.instructions-per-iTLB-miss
0.79 +16.1% 0.92 perf-stat.overall.ipc
1.51e+09 ± 21% -59.4% 6.134e+08 perf-stat.ps.branch-instructions
11535806 ± 17% -46.4% 6188412 perf-stat.ps.branch-misses
6.128e+08 ± 21% -56.2% 2.683e+08 perf-stat.ps.cache-misses
6.128e+08 ± 21% -56.2% 2.683e+08 perf-stat.ps.cache-references
12339 ± 23% -56.2% 5405 ± 3% perf-stat.ps.context-switches
1.732e+10 ± 20% -64.7% 6.115e+09 perf-stat.ps.cpu-cycles
21.42 ± 4% +6.7% 22.86 perf-stat.ps.cpu-migrations
7109912 ± 21% -59.5% 2876638 perf-stat.ps.dTLB-load-misses
8.646e+09 ± 21% -59.1% 3.54e+09 perf-stat.ps.dTLB-loads
4931362 ± 20% -63.8% 1785501 perf-stat.ps.dTLB-store-misses
1.04e+09 ± 20% -60.3% 4.134e+08 perf-stat.ps.dTLB-stores
3031899 ± 20% -63.2% 1115046 perf-stat.ps.iTLB-load-misses
2876515 ± 20% -56.9% 1238672 perf-stat.ps.iTLB-loads
1.377e+10 ± 20% -59.1% 5.636e+09 perf-stat.ps.instructions
1005643 ± 21% -63.6% 366083 perf-stat.ps.minor-faults
1005643 ± 21% -63.6% 366083 perf-stat.ps.page-faults
1.358e+13 ± 10% -65.6% 4.675e+12 perf-stat.total.instructions
4.89 ± 29% -2.7 2.15 ± 66% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
4.89 ± 29% -2.7 2.15 ± 66% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
4.89 ± 29% -2.7 2.15 ± 66% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
4.81 ± 32% -2.7 2.15 ± 66% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
4.80 ± 33% -2.7 2.15 ± 66% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
0.00 +0.6 0.60 ± 10% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.4 1.39 ± 9% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
0.00 +1.4 1.39 ± 9% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
0.00 +1.4 1.42 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.munmap
0.00 +1.4 1.42 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.munmap
0.00 +1.4 1.45 ± 9% perf-profile.calltrace.cycles-pp.munmap
4.89 ± 29% -2.7 2.15 ± 66% perf-profile.children.cycles-pp.start_kernel
0.01 ±173% +0.1 0.07 ± 10% perf-profile.children.cycles-pp.sys_imageblit
0.01 ±173% +0.1 0.07 ± 10% perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit
0.01 ±173% +0.1 0.08 ± 38% perf-profile.children.cycles-pp.clear_page_erms
0.01 ±173% +0.1 0.08 ± 13% perf-profile.children.cycles-pp.fbcon_redraw
0.01 ±173% +0.1 0.08 ± 13% perf-profile.children.cycles-pp.con_scroll
0.01 ±173% +0.1 0.08 ± 13% perf-profile.children.cycles-pp.fbcon_scroll
0.01 ±173% +0.1 0.08 ± 13% perf-profile.children.cycles-pp.lf
0.02 ±173% +0.1 0.09 ± 20% perf-profile.children.cycles-pp.unlink_file_vma
0.04 ±100% +0.1 0.11 ± 15% perf-profile.children.cycles-pp.native_flush_tlb
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.vma_interval_tree_insert
0.01 ±173% +0.1 0.09 ± 9% perf-profile.children.cycles-pp.vt_console_print
0.01 ±173% +0.1 0.08 ± 10% perf-profile.children.cycles-pp.fbcon_putcs
0.01 ±173% +0.1 0.08 ± 10% perf-profile.children.cycles-pp.bit_putcs
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.security_mmap_file
0.00 +0.1 0.07 ± 19% perf-profile.children.cycles-pp.get_unmapped_area
0.01 ±173% +0.1 0.09 ± 35% perf-profile.children.cycles-pp.prep_new_page
0.02 ±173% +0.1 0.10 ± 21% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.08 ± 34% perf-profile.children.cycles-pp.enqueue_entity
0.07 ± 31% +0.1 0.15 ± 13% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.1 0.09 ± 37% perf-profile.children.cycles-pp.enqueue_task_fair
0.00 +0.1 0.09 ± 37% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.free_unref_page_list
0.00 +0.1 0.09 ± 40% perf-profile.children.cycles-pp.activate_task
0.03 ±173% +0.1 0.12 ± 17% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.05 ± 70% +0.1 0.14 ± 21% perf-profile.children.cycles-pp.free_pgtables
0.06 ± 59% +0.1 0.16 ± 22% perf-profile.children.cycles-pp.get_page_from_freelist
0.02 ±173% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.up_write
0.00 +0.1 0.10 ± 24% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.05 ± 62% +0.1 0.16 ± 14% perf-profile.children.cycles-pp.perf_event_mmap
0.16 ± 59% +0.1 0.28 ± 10% perf-profile.children.cycles-pp.free_pages_and_swap_cache
0.07 ± 58% +0.1 0.20 ± 26% perf-profile.children.cycles-pp.pte_alloc_one
0.08 ± 58% +0.1 0.21 ± 22% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.01 ±173% +0.1 0.15 ± 34% perf-profile.children.cycles-pp.__wake_up_common
0.02 ±173% +0.1 0.15 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.01 ±173% +0.1 0.15 ± 16% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.00 +0.1 0.14 ± 35% perf-profile.children.cycles-pp.autoremove_wake_function
0.00 +0.1 0.15 ± 32% perf-profile.children.cycles-pp.try_to_wake_up
0.07 ± 62% +0.2 0.23 ± 13% perf-profile.children.cycles-pp.vma_link
0.01 ±173% +0.2 0.20 ± 28% perf-profile.children.cycles-pp.wake_up_page_bit
0.00 +0.2 0.19 ± 11% perf-profile.children.cycles-pp.mmap64
0.13 ± 59% +0.3 0.40 ± 26% perf-profile.children.cycles-pp.tlb_finish_mmu
0.14 ± 62% +0.3 0.48 ± 13% perf-profile.children.cycles-pp.mmap_region
0.17 ± 60% +0.4 0.58 ± 11% perf-profile.children.cycles-pp.do_mmap
0.19 ± 61% +0.5 0.67 ± 10% perf-profile.children.cycles-pp.vm_mmap_pgoff
0.20 ± 61% +0.5 0.73 ± 7% perf-profile.children.cycles-pp.ksys_mmap_pgoff
0.81 ± 60% +0.6 1.40 ± 14% perf-profile.children.cycles-pp.tlb_flush_mmu
0.00 +1.5 1.45 ± 9% perf-profile.children.cycles-pp.munmap
4.49 ± 52% +3.1 7.63 ± 20% perf-profile.children.cycles-pp.do_syscall_64
4.49 ± 52% +3.2 7.64 ± 20% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.01 ±173% +0.1 0.07 ± 10% perf-profile.self.cycles-pp.sys_imageblit
0.01 ±173% +0.1 0.08 ± 38% perf-profile.self.cycles-pp.clear_page_erms
0.04 ±100% +0.1 0.11 ± 15% perf-profile.self.cycles-pp.native_flush_tlb
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.07 ± 64% +0.1 0.16 ± 24% perf-profile.self.cycles-pp.find_vma
0.02 ±173% +0.1 0.11 ± 21% perf-profile.self.cycles-pp.up_write
0.00 +0.1 0.10 ± 24% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.15 ± 59% +0.1 0.25 ± 11% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.02 ±173% +0.1 0.15 ± 9% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.01 ±173% +0.1 0.15 ± 16% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.10 ± 7% +0.2 0.34 ± 12% perf-profile.self.cycles-pp.do_syscall_64
***************************************************************************************************
lkp-bdw-ep6: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/thread/16/debian-x86_64-20191114.cgz/lkp-bdw-ep6/signal1/will-it-scale/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:__bitmap_and
:4 25% 1:4 dmesg.RIP:__do_softirq
:4 25% 1:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 25% 1:4 dmesg.RIP:acpi_ns_check_argument_count
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:idle_cpu
%stddev %change %stddev
\ | \
47711 ± 2% -58.4% 19844 will-it-scale.per_thread_ops
763394 ± 2% -58.4% 317519 will-it-scale.workload
34375 -18.3% 28086 ± 3% meminfo.Shmem
1396 +5.2% 1468 vmstat.system.cs
3825 ± 6% +16.0% 4437 ± 7% slabinfo.kmalloc-rcl-64.active_objs
3825 ± 6% +16.0% 4437 ± 7% slabinfo.kmalloc-rcl-64.num_objs
45.64 ± 6% +13.0% 51.57 ± 6% boot-time.boot
29.57 ± 10% +13.1% 33.45 ± 9% boot-time.dhcp
3550 ± 6% +13.1% 4016 ± 7% boot-time.idle
0.86 ± 11% +13.6% 0.98 ± 10% boot-time.smp_boot
1.623e+08 ± 75% -89.9% 16446802 ±160% cpuidle.C1.time
3143747 ± 46% -84.7% 480305 ±147% cpuidle.C1.usage
491507 ± 77% -90.4% 47421 ± 16% cpuidle.POLL.time
74327 ± 37% -86.0% 10418 ± 16% cpuidle.POLL.usage
1.95 ± 7% +21.8% 2.37 ± 9% sched_debug.cfs_rq:/.nr_spread_over.max
0.34 ± 17% +28.7% 0.44 ± 6% sched_debug.cfs_rq:/.nr_spread_over.stddev
2.06 ± 13% +95.8% 4.03 ± 2% sched_debug.cpu.clock.stddev
2.06 ± 13% +95.8% 4.03 ± 2% sched_debug.cpu.clock_task.stddev
40521 ± 29% -55.8% 17928 ± 72% numa-vmstat.node0.nr_anon_pages
276.75 ± 62% +718.2% 2264 ± 18% numa-vmstat.node0.nr_inactive_anon
593.25 ± 39% +330.1% 2551 ± 11% numa-vmstat.node0.nr_shmem
276.75 ± 62% +718.2% 2264 ± 18% numa-vmstat.node0.nr_zone_inactive_anon
4190 ± 4% -48.7% 2149 ± 18% numa-vmstat.node1.nr_inactive_anon
8014 ± 2% -44.2% 4471 ± 4% numa-vmstat.node1.nr_shmem
4190 ± 4% -48.7% 2149 ± 18% numa-vmstat.node1.nr_zone_inactive_anon
71940 -3.2% 69667 proc-vmstat.nr_active_anon
68165 -1.1% 67445 proc-vmstat.nr_anon_pages
4467 -1.2% 4414 proc-vmstat.nr_inactive_anon
8594 -18.3% 7017 ± 3% proc-vmstat.nr_shmem
71940 -3.2% 69667 proc-vmstat.nr_zone_active_anon
4467 -1.2% 4414 proc-vmstat.nr_zone_inactive_anon
5238 ± 3% -44.2% 2925 ± 11% proc-vmstat.pgactivate
162117 ± 29% -55.8% 71716 ± 72% numa-meminfo.node0.AnonPages
1276 ± 47% +619.7% 9183 ± 17% numa-meminfo.node0.Inactive
1108 ± 62% +717.5% 9059 ± 18% numa-meminfo.node0.Inactive(anon)
2374 ± 39% +329.9% 10207 ± 11% numa-meminfo.node0.Shmem
59639 ± 55% +133.9% 139472 ± 25% numa-meminfo.node1.AnonHugePages
16936 ± 3% -47.9% 8820 ± 17% numa-meminfo.node1.Inactive
16763 ± 4% -48.7% 8598 ± 18% numa-meminfo.node1.Inactive(anon)
32004 ± 2% -44.2% 17860 ± 4% numa-meminfo.node1.Shmem
22493 ± 53% +85.1% 41635 ± 8% softirqs.CPU1.SCHED
42680 -19.6% 34297 ± 19% softirqs.CPU16.SCHED
159963 ± 2% -26.1% 118198 ± 22% softirqs.CPU16.TIMER
42567 -9.1% 38707 ± 6% softirqs.CPU17.SCHED
161430 ± 2% -27.1% 117758 ± 22% softirqs.CPU17.TIMER
160939 ± 2% -26.6% 118078 ± 23% softirqs.CPU18.TIMER
42706 -8.9% 38901 ± 7% softirqs.CPU19.SCHED
160507 ± 2% -26.4% 118152 ± 22% softirqs.CPU19.TIMER
43221 ± 3% -21.6% 33872 ± 17% softirqs.CPU20.SCHED
160921 ± 2% -26.8% 117724 ± 23% softirqs.CPU20.TIMER
42774 -11.2% 37999 ± 5% softirqs.CPU21.SCHED
160484 ± 2% -26.5% 117982 ± 22% softirqs.CPU21.TIMER
141094 ± 16% -24.0% 107201 ± 9% softirqs.CPU27.TIMER
42202 ± 6% -37.5% 26377 ± 45% softirqs.CPU3.SCHED
138383 ± 18% -23.8% 105459 ± 10% softirqs.CPU30.TIMER
137520 ± 19% -24.8% 103399 ± 10% softirqs.CPU31.TIMER
145639 ± 13% -21.4% 114410 ± 8% softirqs.CPU38.TIMER
25505 ± 49% -79.9% 5121 ± 2% softirqs.CPU45.SCHED
84530 ± 4% +14.3% 96657 ± 7% softirqs.CPU47.RCU
12628 ± 52% -40.1% 7564 ± 55% softirqs.CPU57.SCHED
159912 ± 3% -26.7% 117282 ± 23% softirqs.CPU60.TIMER
159928 ± 2% -26.6% 117311 ± 23% softirqs.CPU62.TIMER
42825 -9.8% 38633 ± 6% softirqs.CPU63.SCHED
160854 ± 3% -27.0% 117487 ± 23% softirqs.CPU63.TIMER
159851 ± 2% -26.6% 117322 ± 23% softirqs.CPU64.TIMER
109692 ± 5% -18.3% 89589 ± 10% softirqs.CPU65.RCU
137028 ± 19% -25.6% 101960 ± 11% softirqs.CPU73.TIMER
137335 ± 19% -23.6% 104924 ± 9% softirqs.CPU74.TIMER
136142 ± 20% -23.3% 104416 ± 12% softirqs.CPU75.TIMER
3.037e+09 -53.8% 1.403e+09 perf-stat.i.branch-instructions
0.88 ± 3% +0.4 1.24 ± 17% perf-stat.i.branch-miss-rate%
26824742 ± 4% -33.2% 17913990 ± 16% perf-stat.i.branch-misses
0.11 ± 10% +0.3 0.41 ± 41% perf-stat.i.cache-miss-rate%
167168 ± 8% +77.5% 296716 ± 23% perf-stat.i.cache-misses
1.546e+08 ± 4% -48.7% 79313595 ± 18% perf-stat.i.cache-references
1366 +5.0% 1435 perf-stat.i.context-switches
4.927e+10 -54.7% 2.231e+10 ± 4% perf-stat.i.cpu-cycles
357788 ± 9% -68.2% 113911 ± 40% perf-stat.i.cycles-between-cache-misses
7000456 -52.6% 3316794 ± 20% perf-stat.i.dTLB-load-misses
3.551e+09 -53.7% 1.644e+09 perf-stat.i.dTLB-loads
0.39 -0.0 0.34 perf-stat.i.dTLB-store-miss-rate%
5077831 -56.1% 2227001 ± 10% perf-stat.i.dTLB-store-misses
1.295e+09 ± 2% -49.8% 6.496e+08 ± 12% perf-stat.i.dTLB-stores
90.35 -16.1 74.21 ± 9% perf-stat.i.iTLB-load-miss-rate%
9008271 ± 5% -57.6% 3823025 ± 5% perf-stat.i.iTLB-load-misses
1.309e+10 -53.4% 6.105e+09 perf-stat.i.instructions
1476 ± 4% +10.1% 1625 ± 6% perf-stat.i.instructions-per-iTLB-miss
4304 ± 8% +49.6% 6440 ± 26% perf-stat.i.node-loads
0.88 ± 3% +0.4 1.28 ± 17% perf-stat.overall.branch-miss-rate%
0.11 ± 11% +0.3 0.40 ± 39% perf-stat.overall.cache-miss-rate%
296735 ± 7% -72.9% 80540 ± 28% perf-stat.overall.cycles-between-cache-misses
0.39 -0.0 0.34 perf-stat.overall.dTLB-store-miss-rate%
90.45 -16.1 74.35 ± 9% perf-stat.overall.iTLB-load-miss-rate%
1457 ± 4% +9.9% 1602 ± 6% perf-stat.overall.instructions-per-iTLB-miss
5168695 +12.0% 5791187 ± 3% perf-stat.overall.path-length
3.027e+09 -53.8% 1.398e+09 perf-stat.ps.branch-instructions
26726787 ± 4% -33.2% 17858622 ± 16% perf-stat.ps.branch-misses
166554 ± 8% +77.6% 295791 ± 23% perf-stat.ps.cache-misses
1.541e+08 ± 4% -48.7% 79046152 ± 18% perf-stat.ps.cache-references
1362 +5.1% 1431 perf-stat.ps.context-switches
4.91e+10 -54.7% 2.224e+10 ± 4% perf-stat.ps.cpu-cycles
6976948 -52.6% 3305572 ± 20% perf-stat.ps.dTLB-load-misses
3.539e+09 -53.7% 1.639e+09 perf-stat.ps.dTLB-loads
5060797 -56.1% 2219476 ± 10% perf-stat.ps.dTLB-store-misses
1.291e+09 ± 2% -49.8% 6.474e+08 ± 12% perf-stat.ps.dTLB-stores
8978095 ± 5% -57.6% 3810130 ± 5% perf-stat.ps.iTLB-load-misses
1.305e+10 -53.4% 6.085e+09 perf-stat.ps.instructions
4287 ± 8% +49.9% 6425 ± 26% perf-stat.ps.node-loads
3.944e+12 -53.4% 1.838e+12 perf-stat.total.instructions
4385 ± 47% -42.9% 2502 ± 24% interrupts.CPU0.NMI:Non-maskable_interrupts
4385 ± 47% -42.9% 2502 ± 24% interrupts.CPU0.PMI:Performance_monitoring_interrupts
705.25 ± 28% -45.0% 388.00 interrupts.CPU1.CAL:Function_call_interrupts
336.00 ± 78% -94.3% 19.25 ± 28% interrupts.CPU1.RES:Rescheduling_interrupts
321.75 ± 61% -99.8% 0.50 ±173% interrupts.CPU1.TLB:TLB_shootdowns
207.75 ± 33% -33.6% 138.00 ± 32% interrupts.CPU24.NMI:Non-maskable_interrupts
207.75 ± 33% -33.6% 138.00 ± 32% interrupts.CPU24.PMI:Performance_monitoring_interrupts
383232 ± 33% +39.0% 532699 ± 23% interrupts.CPU29.LOC:Local_timer_interrupts
382392 ± 33% +39.2% 532244 ± 23% interrupts.CPU37.LOC:Local_timer_interrupts
265.25 ± 9% -35.7% 170.50 ± 35% interrupts.CPU40.NMI:Non-maskable_interrupts
265.25 ± 9% -35.7% 170.50 ± 35% interrupts.CPU40.PMI:Performance_monitoring_interrupts
265.00 ± 9% -40.0% 159.00 ± 41% interrupts.CPU41.NMI:Non-maskable_interrupts
265.00 ± 9% -40.0% 159.00 ± 41% interrupts.CPU41.PMI:Performance_monitoring_interrupts
688.75 ± 25% +43.6% 989.25 ± 3% interrupts.CPU45.CAL:Function_call_interrupts
329.00 ± 58% +86.0% 612.00 ± 3% interrupts.CPU45.TLB:TLB_shootdowns
5913 ± 33% -50.4% 2934 ± 24% interrupts.CPU46.NMI:Non-maskable_interrupts
5913 ± 33% -50.4% 2934 ± 24% interrupts.CPU46.PMI:Performance_monitoring_interrupts
5913 ± 33% -52.5% 2810 ± 24% interrupts.CPU47.NMI:Non-maskable_interrupts
5913 ± 33% -52.5% 2810 ± 24% interrupts.CPU47.PMI:Performance_monitoring_interrupts
650.75 ± 2% -26.4% 479.25 ± 28% interrupts.CPU47.TLB:TLB_shootdowns
5914 ± 33% -50.4% 2935 ± 24% interrupts.CPU48.NMI:Non-maskable_interrupts
5914 ± 33% -50.4% 2935 ± 24% interrupts.CPU48.PMI:Performance_monitoring_interrupts
6900 ± 24% -63.5% 2515 ± 33% interrupts.CPU49.NMI:Non-maskable_interrupts
6900 ± 24% -63.5% 2515 ± 33% interrupts.CPU49.PMI:Performance_monitoring_interrupts
6901 ± 24% -63.6% 2515 ± 33% interrupts.CPU50.NMI:Non-maskable_interrupts
6901 ± 24% -63.6% 2515 ± 33% interrupts.CPU50.PMI:Performance_monitoring_interrupts
7889 -69.6% 2396 ± 30% interrupts.CPU52.NMI:Non-maskable_interrupts
7889 -69.6% 2396 ± 30% interrupts.CPU52.PMI:Performance_monitoring_interrupts
7887 -73.4% 2095 ± 34% interrupts.CPU53.NMI:Non-maskable_interrupts
7887 -73.4% 2095 ± 34% interrupts.CPU53.PMI:Performance_monitoring_interrupts
7888 -68.1% 2515 ± 33% interrupts.CPU54.NMI:Non-maskable_interrupts
7888 -68.1% 2515 ± 33% interrupts.CPU54.PMI:Performance_monitoring_interrupts
7888 -62.8% 2937 ± 24% interrupts.CPU55.NMI:Non-maskable_interrupts
7888 -62.8% 2937 ± 24% interrupts.CPU55.PMI:Performance_monitoring_interrupts
7887 -62.6% 2953 ± 24% interrupts.CPU56.NMI:Non-maskable_interrupts
7887 -62.6% 2953 ± 24% interrupts.CPU56.PMI:Performance_monitoring_interrupts
6899 ± 24% -51.4% 3355 interrupts.CPU59.NMI:Non-maskable_interrupts
6899 ± 24% -51.4% 3355 interrupts.CPU59.PMI:Performance_monitoring_interrupts
177.75 ± 7% -40.2% 106.25 ± 37% interrupts.CPU62.NMI:Non-maskable_interrupts
177.75 ± 7% -40.2% 106.25 ± 37% interrupts.CPU62.PMI:Performance_monitoring_interrupts
175.50 ± 7% -40.9% 103.75 ± 33% interrupts.CPU63.NMI:Non-maskable_interrupts
175.50 ± 7% -40.9% 103.75 ± 33% interrupts.CPU63.PMI:Performance_monitoring_interrupts
182.25 ± 9% -32.1% 123.75 ± 45% interrupts.CPU64.NMI:Non-maskable_interrupts
182.25 ± 9% -32.1% 123.75 ± 45% interrupts.CPU64.PMI:Performance_monitoring_interrupts
262.00 ± 10% -49.4% 132.50 ± 25% interrupts.CPU66.NMI:Non-maskable_interrupts
262.00 ± 10% -49.4% 132.50 ± 25% interrupts.CPU66.PMI:Performance_monitoring_interrupts
289.00 ± 13% -44.6% 160.00 ± 13% interrupts.CPU67.NMI:Non-maskable_interrupts
289.00 ± 13% -44.6% 160.00 ± 13% interrupts.CPU67.PMI:Performance_monitoring_interrupts
261.50 ± 6% -48.4% 135.00 ± 30% interrupts.CPU68.NMI:Non-maskable_interrupts
261.50 ± 6% -48.4% 135.00 ± 30% interrupts.CPU68.PMI:Performance_monitoring_interrupts
253.00 ± 6% -45.1% 139.00 ± 24% interrupts.CPU69.NMI:Non-maskable_interrupts
253.00 ± 6% -45.1% 139.00 ± 24% interrupts.CPU69.PMI:Performance_monitoring_interrupts
5359 ± 46% -60.0% 2142 ± 33% interrupts.CPU7.NMI:Non-maskable_interrupts
5359 ± 46% -60.0% 2142 ± 33% interrupts.CPU7.PMI:Performance_monitoring_interrupts
260.75 ± 7% -50.1% 130.00 ± 28% interrupts.CPU70.NMI:Non-maskable_interrupts
260.75 ± 7% -50.1% 130.00 ± 28% interrupts.CPU70.PMI:Performance_monitoring_interrupts
259.50 ± 7% -50.7% 128.00 ± 31% interrupts.CPU71.NMI:Non-maskable_interrupts
259.50 ± 7% -50.7% 128.00 ± 31% interrupts.CPU71.PMI:Performance_monitoring_interrupts
383322 ± 33% +39.0% 532707 ± 23% interrupts.CPU73.LOC:Local_timer_interrupts
266.25 ± 7% -49.7% 134.00 ± 54% interrupts.CPU73.NMI:Non-maskable_interrupts
266.25 ± 7% -49.7% 134.00 ± 54% interrupts.CPU73.PMI:Performance_monitoring_interrupts
6.25 ±154% +1e+06% 64704 ±121% interrupts.CPU78.RES:Rescheduling_interrupts
261.50 ± 8% -38.1% 161.75 ± 40% interrupts.CPU79.NMI:Non-maskable_interrupts
261.50 ± 8% -38.1% 161.75 ± 40% interrupts.CPU79.PMI:Performance_monitoring_interrupts
263.25 ± 8% -59.5% 106.50 ± 16% interrupts.CPU80.NMI:Non-maskable_interrupts
263.25 ± 8% -59.5% 106.50 ± 16% interrupts.CPU80.PMI:Performance_monitoring_interrupts
382307 ± 33% +39.3% 532463 ± 23% interrupts.CPU81.LOC:Local_timer_interrupts
274.25 ± 9% -40.8% 162.25 ± 42% interrupts.CPU81.NMI:Non-maskable_interrupts
274.25 ± 9% -40.8% 162.25 ± 42% interrupts.CPU81.PMI:Performance_monitoring_interrupts
267.00 ± 9% -39.2% 162.25 ± 41% interrupts.CPU82.NMI:Non-maskable_interrupts
267.00 ± 9% -39.2% 162.25 ± 41% interrupts.CPU82.PMI:Performance_monitoring_interrupts
264.50 ± 7% -40.4% 157.75 ± 40% interrupts.CPU85.NMI:Non-maskable_interrupts
264.50 ± 7% -40.4% 157.75 ± 40% interrupts.CPU85.PMI:Performance_monitoring_interrupts
167706 ± 4% -45.3% 91742 ± 12% interrupts.NMI:Non-maskable_interrupts
167706 ± 4% -45.3% 91742 ± 12% interrupts.PMI:Performance_monitoring_interrupts
223207 ± 8% -25.5% 166211 ± 34% interrupts.RES:Rescheduling_interrupts
46.58 ± 6% -13.7 32.86 ± 6% perf-profile.calltrace.cycles-pp.raise
43.73 ± 6% -12.8 30.95 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.raise
43.58 ± 6% -12.7 30.84 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
18.90 ± 6% -5.5 13.41 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
18.53 ± 6% -5.4 13.17 ± 6% perf-profile.calltrace.cycles-pp.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
18.49 ± 6% -5.4 13.13 ± 6% perf-profile.calltrace.cycles-pp.__set_current_blocked.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.74 ± 6% -5.2 12.56 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__set_current_blocked.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64
17.27 ± 6% -5.0 12.23 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__set_current_blocked.sigprocmask.__x64_sys_rt_sigprocmask
10.11 ± 6% -3.0 7.14 ± 7% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
10.10 ± 6% -3.0 7.13 ± 7% perf-profile.calltrace.cycles-pp.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
10.29 ± 6% -2.9 7.39 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
10.29 ± 6% -2.9 7.38 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.45 ± 5% -2.8 6.62 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__restore_rt
9.47 ± 5% -2.8 6.64 ± 6% perf-profile.calltrace.cycles-pp.__restore_rt
9.95 ± 6% -2.8 7.12 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
9.43 ± 5% -2.8 6.61 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__restore_rt
9.42 ± 5% -2.8 6.60 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe.__restore_rt
9.91 ± 6% -2.8 7.10 ± 6% perf-profile.calltrace.cycles-pp.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
9.79 ± 6% -2.8 7.02 ± 6% perf-profile.calltrace.cycles-pp.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.39 ± 6% -2.8 6.63 ± 7% perf-profile.calltrace.cycles-pp.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.18 ± 5% -2.8 6.42 ± 6% perf-profile.calltrace.cycles-pp.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe.__restore_rt
9.49 ± 6% -2.7 6.82 ± 6% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.48 ± 6% -2.7 6.81 ± 6% perf-profile.calltrace.cycles-pp.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.81 ± 5% -2.7 6.14 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.39 ± 6% -2.7 6.73 ± 6% perf-profile.calltrace.cycles-pp.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64
8.90 ± 6% -2.6 6.26 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64
8.74 ± 6% -2.6 6.13 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.get_signal.do_signal.exit_to_usermode_loop
9.26 ± 6% -2.6 6.66 ± 6% perf-profile.calltrace.cycles-pp.signal_setup_done.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.24 ± 6% -2.6 6.64 ± 6% perf-profile.calltrace.cycles-pp.__set_current_blocked.signal_setup_done.do_signal.exit_to_usermode_loop.do_syscall_64
8.57 ± 5% -2.6 5.97 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64
8.89 ± 6% -2.6 6.34 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__set_current_blocked.signal_setup_done.do_signal.exit_to_usermode_loop
8.84 ± 6% -2.5 6.30 ± 6% perf-profile.calltrace.cycles-pp.__lock_task_sighand.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill
8.84 ± 6% -2.5 6.29 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__lock_task_sighand.do_send_sig_info.do_send_specific.do_tkill
8.66 ± 6% -2.5 6.18 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__set_current_blocked.signal_setup_done.do_signal
8.59 ± 6% -2.5 6.13 ± 6% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__lock_task_sighand.do_send_sig_info.do_send_specific
1.50 ± 6% -0.5 1.00 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.raise
1.24 ± 7% -0.4 0.82 ± 7% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.raise
0.83 ± 6% +0.4 1.28 ± 11% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.17 ±173% +0.6 0.75 ± 13% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +0.7 0.72 ± 24% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.45 ± 8% +0.9 2.32 ± 3% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
1.56 ± 9% +1.0 2.52 ± 4% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
30.69 ± 10% +17.4 48.13 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
30.79 ± 10% +17.5 48.31 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
31.44 ± 10% +17.9 49.32 ± 7% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
31.45 ± 10% +17.9 49.33 ± 7% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
31.45 ± 10% +17.9 49.33 ± 7% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
29.94 ± 13% +18.3 48.27 ± 6% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
32.33 ± 13% +19.8 52.10 ± 6% perf-profile.calltrace.cycles-pp.secondary_startup_64
63.53 ± 6% -18.5 45.04 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
63.37 ± 6% -18.4 44.92 ± 6% perf-profile.children.cycles-pp.do_syscall_64
51.85 ± 6% -15.1 36.77 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
46.79 ± 6% -13.8 33.00 ± 6% perf-profile.children.cycles-pp.raise
44.37 ± 6% -13.0 31.34 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irq
36.94 ± 6% -10.7 26.23 ± 6% perf-profile.children.cycles-pp.__set_current_blocked
19.60 ± 6% -5.6 13.96 ± 6% perf-profile.children.cycles-pp.exit_to_usermode_loop
19.59 ± 6% -5.6 13.96 ± 6% perf-profile.children.cycles-pp.do_signal
18.90 ± 6% -5.5 13.41 ± 6% perf-profile.children.cycles-pp.__x64_sys_rt_sigprocmask
18.53 ± 6% -5.4 13.17 ± 6% perf-profile.children.cycles-pp.sigprocmask
9.99 ± 5% -3.0 7.01 ± 6% perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn
9.52 ± 5% -2.8 6.67 ± 6% perf-profile.children.cycles-pp.__restore_rt
9.95 ± 6% -2.8 7.12 ± 6% perf-profile.children.cycles-pp.__x64_sys_tgkill
9.92 ± 6% -2.8 7.10 ± 6% perf-profile.children.cycles-pp.do_tkill
9.79 ± 6% -2.8 7.02 ± 6% perf-profile.children.cycles-pp.do_send_specific
9.39 ± 6% -2.8 6.64 ± 7% perf-profile.children.cycles-pp.get_signal
9.39 ± 6% -2.7 6.73 ± 6% perf-profile.children.cycles-pp.do_send_sig_info
9.26 ± 6% -2.6 6.66 ± 6% perf-profile.children.cycles-pp.signal_setup_done
8.84 ± 6% -2.5 6.30 ± 6% perf-profile.children.cycles-pp.__lock_task_sighand
8.91 ± 6% -2.4 6.53 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.82 ± 6% -0.6 1.20 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64
1.43 ± 6% -0.5 0.95 ± 7% perf-profile.children.cycles-pp.syscall_return_via_sysret
1.25 ± 7% -0.4 0.86 ± 3% perf-profile.children.cycles-pp.__set_task_blocked
1.25 ± 6% -0.4 0.87 ± 4% perf-profile.children.cycles-pp.recalc_sigpending
0.46 ± 5% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
0.42 ± 6% -0.1 0.31 ± 3% perf-profile.children.cycles-pp.__fpu__restore_sig
0.44 ± 8% -0.1 0.33 ± 7% perf-profile.children.cycles-pp.__send_signal
0.38 ± 5% -0.1 0.28 ± 9% perf-profile.children.cycles-pp.dequeue_signal
0.34 ± 6% -0.1 0.24 ± 9% perf-profile.children.cycles-pp.__dequeue_signal
0.32 ± 6% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.recalc_sigpending_tsk
0.25 ± 6% -0.1 0.16 ± 7% perf-profile.children.cycles-pp._copy_from_user
0.27 ± 7% -0.1 0.18 ± 4% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.21 ± 7% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.__might_fault
0.29 ± 6% -0.1 0.21 ± 13% perf-profile.children.cycles-pp.__sigqueue_free
0.28 ± 5% -0.1 0.19 ± 13% perf-profile.children.cycles-pp.security_task_kill
0.27 ± 7% -0.1 0.19 ± 12% perf-profile.children.cycles-pp.apparmor_task_kill
0.21 ± 7% -0.1 0.14 ± 15% perf-profile.children.cycles-pp.__task_pid_nr_ns
0.22 ± 5% -0.1 0.15 ± 16% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.19 ± 9% -0.1 0.12 perf-profile.children.cycles-pp.__sigqueue_alloc
0.22 ± 3% -0.1 0.16 ± 11% perf-profile.children.cycles-pp.fpu__clear
0.11 ± 12% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.restore_altstack
0.07 ± 14% -0.0 0.03 ±100% perf-profile.children.cycles-pp._copy_to_user
0.09 ± 4% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__x64_sys_gettid
0.10 ± 8% -0.0 0.07 ± 13% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.09 ± 11% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.___might_sleep
0.07 ± 15% -0.0 0.05 perf-profile.children.cycles-pp.find_task_by_vpid
0.07 ± 10% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.10 ± 7% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.irq_work_run_list
0.08 ± 6% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.load_balance
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.irq_work_interrupt
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.irq_work_run
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.printk
0.07 ± 7% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.vprintk_emit
0.10 ± 7% +0.0 0.14 ± 7% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.10 ± 10% +0.0 0.15 ± 14% perf-profile.children.cycles-pp.rebalance_domains
0.06 ± 17% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.lapic_next_deadline
0.01 ±173% +0.1 0.06 ± 13% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.01 ±173% +0.1 0.06 ± 17% perf-profile.children.cycles-pp.find_busiest_group
0.13 ± 5% +0.1 0.18 ± 8% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp._raw_spin_lock
0.07 ± 19% +0.1 0.13 ± 19% perf-profile.children.cycles-pp.read_tsc
0.01 ±173% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.sched_clock_cpu
0.04 ±102% +0.1 0.10 ± 14% perf-profile.children.cycles-pp._find_next_bit
0.01 ±173% +0.1 0.08 ± 23% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.sched_clock
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.native_sched_clock
0.09 ± 35% +0.1 0.16 ± 14% perf-profile.children.cycles-pp.__next_timer_interrupt
0.08 ± 14% +0.1 0.15 ± 10% perf-profile.children.cycles-pp.native_write_msr
0.13 ± 28% +0.1 0.23 ± 15% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.18 ± 22% +0.1 0.33 ± 14% perf-profile.children.cycles-pp.tick_nohz_next_event
0.45 ± 7% +0.2 0.62 ± 23% perf-profile.children.cycles-pp.tick_sched_timer
0.10 ± 8% +0.2 0.27 ± 46% perf-profile.children.cycles-pp.rcu_core
0.22 ± 24% +0.2 0.41 ± 13% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.16 ± 17% +0.2 0.40 ± 47% perf-profile.children.cycles-pp.ktime_get
0.36 ± 6% +0.3 0.63 ± 24% perf-profile.children.cycles-pp.__softirqentry_text_start
0.46 ± 26% +0.3 0.75 ± 13% perf-profile.children.cycles-pp.menu_select
0.43 ± 6% +0.4 0.79 ± 23% perf-profile.children.cycles-pp.irq_exit
1.05 ± 4% +0.5 1.57 ± 7% perf-profile.children.cycles-pp.hrtimer_interrupt
1.72 ± 6% +1.0 2.70 ± 3% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
1.86 ± 7% +1.1 2.95 ± 4% perf-profile.children.cycles-pp.apic_timer_interrupt
31.45 ± 10% +17.9 49.33 ± 7% perf-profile.children.cycles-pp.start_secondary
29.94 ± 13% +18.3 48.27 ± 6% perf-profile.children.cycles-pp.intel_idle
31.67 ± 12% +19.4 51.08 ± 6% perf-profile.children.cycles-pp.cpuidle_enter_state
31.67 ± 12% +19.4 51.08 ± 6% perf-profile.children.cycles-pp.cpuidle_enter
32.33 ± 13% +19.8 52.10 ± 6% perf-profile.children.cycles-pp.secondary_startup_64
32.33 ± 13% +19.8 52.10 ± 6% perf-profile.children.cycles-pp.cpu_startup_entry
32.33 ± 13% +19.8 52.11 ± 6% perf-profile.children.cycles-pp.do_idle
51.85 ± 6% -15.1 36.77 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
4.62 ± 6% -1.5 3.17 ± 7% perf-profile.self.cycles-pp.do_syscall_64
1.57 ± 6% -0.5 1.04 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64
1.43 ± 7% -0.5 0.95 ± 7% perf-profile.self.cycles-pp.syscall_return_via_sysret
1.12 ± 8% -0.3 0.81 ± 8% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.93 ± 6% -0.3 0.64 ± 3% perf-profile.self.cycles-pp.recalc_sigpending
0.32 ± 7% -0.1 0.22 ± 4% perf-profile.self.cycles-pp.copy_fpstate_to_sigframe
0.32 ± 6% -0.1 0.22 ± 4% perf-profile.self.cycles-pp.recalc_sigpending_tsk
0.26 ± 7% -0.1 0.17 ± 4% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.27 ± 7% -0.1 0.19 ± 9% perf-profile.self.cycles-pp.raise
0.29 ± 6% -0.1 0.21 ± 13% perf-profile.self.cycles-pp.__sigqueue_free
0.28 ± 8% -0.1 0.20 ± 9% perf-profile.self.cycles-pp.__fpu__restore_sig
0.21 ± 7% -0.1 0.14 ± 15% perf-profile.self.cycles-pp.__task_pid_nr_ns
0.24 ± 5% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.__x64_sys_rt_sigreturn
0.21 ± 4% -0.1 0.15 ± 14% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.17 ± 8% -0.1 0.11 ± 4% perf-profile.self.cycles-pp.__sigqueue_alloc
0.16 ± 12% -0.1 0.11 ± 13% perf-profile.self.cycles-pp.do_signal
0.08 ± 6% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__might_fault
0.13 ± 6% -0.0 0.08 ± 17% perf-profile.self.cycles-pp.apparmor_task_kill
0.23 ± 11% -0.0 0.19 ± 10% perf-profile.self.cycles-pp.__send_signal
0.17 ± 10% -0.0 0.12 ± 11% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.12 ± 8% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__x64_sys_rt_sigprocmask
0.13 ± 5% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.fpu__clear
0.09 ± 11% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.___might_sleep
0.10 ± 5% -0.0 0.07 ± 13% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.01 ±173% +0.0 0.05 ± 9% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp._raw_spin_lock
0.06 ± 13% +0.1 0.12 ± 18% perf-profile.self.cycles-pp.read_tsc
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.native_sched_clock
0.01 ±173% +0.1 0.08 ± 23% perf-profile.self.cycles-pp.native_apic_msr_eoi_write
0.04 ±102% +0.1 0.10 ± 14% perf-profile.self.cycles-pp._find_next_bit
0.08 ± 14% +0.1 0.15 ± 10% perf-profile.self.cycles-pp.native_write_msr
0.18 ± 33% +0.1 0.28 ± 22% perf-profile.self.cycles-pp.menu_select
0.15 ± 22% +0.1 0.26 ± 8% perf-profile.self.cycles-pp.cpuidle_enter_state
29.93 ± 13% +18.3 48.26 ± 6% perf-profile.self.cycles-pp.intel_idle
***************************************************************************************************
lkp-ivb-d04: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-20191114.cgz/300s/lkp-ivb-d04/shared/reaim/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 75% 3:4 dmesg.RIP:cpuidle_enter_state
:4 25% 1:4 dmesg.RIP:load_balance
:4 25% 1:4 dmesg.RIP:rebalance_domains
3:4 -31% 1:4 perf-profile.children.cycles-pp.error_entry
:4 6% 0:4 perf-profile.children.cycles-pp.error_exit
2:4 -17% 1:4 perf-profile.self.cycles-pp.error_entry
:4 3% 0:4 perf-profile.self.cycles-pp.error_exit
%stddev %change %stddev
\ | \
0.37 +143.3% 0.91 reaim.child_systime
2.67 +104.0% 5.45 reaim.child_utime
27775 -51.7% 13403 reaim.jobs_per_min
6943 -51.7% 3350 reaim.jobs_per_min_child
29562 -51.6% 14304 reaim.max_jobs_per_min
0.85 +108.9% 1.77 reaim.parent_time
2.08 ± 2% -16.8% 1.73 ± 2% reaim.std_dev_percent
0.02 ± 2% +82.4% 0.03 ± 2% reaim.std_dev_time
210104 ± 2% +72.2% 361763 reaim.time.involuntary_context_switches
6902175 -24.0% 5246698 reaim.time.minor_page_faults
106.25 +58.1% 168.00 reaim.time.percent_of_cpu_this_job_got
40.40 +84.8% 74.68 reaim.time.system_time
281.47 +54.8% 435.59 reaim.time.user_time
222993 -24.4% 168674 reaim.time.voluntary_context_switches
42000 -24.0% 31900 reaim.workload
30.04 ± 7% +16.6% 35.01 ± 4% boot-time.boot
81.42 ± 7% +13.1% 92.09 ± 5% boot-time.idle
71.02 -17.9 53.14 mpstat.cpu.all.idle%
0.02 ± 18% +0.0 0.02 ± 6% mpstat.cpu.all.soft%
4.90 +2.7 7.64 mpstat.cpu.all.sys%
24.03 +15.2 39.19 mpstat.cpu.all.usr%
2468957 ± 92% -72.2% 686655 ± 19% cpuidle.C1.time
132628 ± 71% -70.9% 38606 ± 24% cpuidle.C1.usage
1100907 ± 31% -36.7% 697198 ± 38% cpuidle.C1E.usage
21384 ± 56% -72.3% 5925 ± 9% cpuidle.POLL.time
10178 ± 5% -91.7% 844.75 ± 14% cpuidle.POLL.usage
70.75 -25.1% 53.00 vmstat.cpu.id
23.50 ± 2% +62.8% 38.25 vmstat.cpu.us
1.00 +100.0% 2.00 vmstat.procs.r
7792 -7.3% 7219 vmstat.system.cs
10621 -1.6% 10448 vmstat.system.in
811.50 ± 4% -23.4% 621.75 ± 6% slabinfo.pid.active_objs
811.50 ± 4% -23.4% 621.75 ± 6% slabinfo.pid.num_objs
614.50 ± 3% -16.5% 513.25 ± 6% slabinfo.signal_cache.active_objs
643.25 ± 2% -16.3% 538.25 ± 7% slabinfo.signal_cache.num_objs
797.00 ± 6% -28.1% 573.00 ± 9% slabinfo.task_delay_info.active_objs
797.00 ± 6% -28.1% 573.00 ± 9% slabinfo.task_delay_info.num_objs
13672 ± 6% -26.9% 9990 ± 3% softirqs.CPU0.NET_RX
36751 -16.6% 30656 ± 4% softirqs.CPU0.SCHED
15253 -18.8% 12381 ± 4% softirqs.CPU1.NET_RX
36663 ± 2% -16.8% 30514 softirqs.CPU1.SCHED
13659 -29.4% 9649 ± 4% softirqs.CPU2.NET_RX
37153 ± 4% -20.7% 29478 ± 3% softirqs.CPU2.SCHED
13524 ± 3% -21.3% 10638 ± 3% softirqs.CPU3.NET_RX
38397 ± 4% -21.0% 30329 ± 4% softirqs.CPU3.SCHED
56110 -24.0% 42659 softirqs.NET_RX
148966 -18.8% 120979 softirqs.SCHED
64646 -1.1% 63909 proc-vmstat.nr_active_anon
63486 -0.9% 62925 proc-vmstat.nr_anon_pages
6324 +1.1% 6392 proc-vmstat.nr_mapped
1072 +1.2% 1085 proc-vmstat.nr_page_table_pages
6202 -1.9% 6084 proc-vmstat.nr_shmem
64646 -1.1% 63911 proc-vmstat.nr_zone_active_anon
6928819 -22.7% 5353998 proc-vmstat.numa_hit
6928819 -22.7% 5353998 proc-vmstat.numa_local
29899 -24.1% 22705 proc-vmstat.pgactivate
6729517 ± 3% -24.4% 5085433 ± 5% proc-vmstat.pgalloc_normal
7304364 -22.7% 5647853 proc-vmstat.pgfault
7127563 -23.0% 5490714 proc-vmstat.pgfree
3803 ± 16% -26.3% 2803 ± 8% interrupts.28:PCI-MSI.2621440-edge.eth0
2471 ± 27% -47.0% 1309 interrupts.CPU0.NMI:Non-maskable_interrupts
2471 ± 27% -47.0% 1309 interrupts.CPU0.PMI:Performance_monitoring_interrupts
6391 ± 8% +32.1% 8442 ± 5% interrupts.CPU0.RES:Rescheduling_interrupts
3803 ± 16% -26.3% 2803 ± 8% interrupts.CPU1.28:PCI-MSI.2621440-edge.eth0
2741 ± 27% -38.6% 1682 ± 29% interrupts.CPU1.NMI:Non-maskable_interrupts
2741 ± 27% -38.6% 1682 ± 29% interrupts.CPU1.PMI:Performance_monitoring_interrupts
6454 ± 9% +55.4% 10028 ± 13% interrupts.CPU1.RES:Rescheduling_interrupts
2561 ± 27% -39.0% 1562 ± 24% interrupts.CPU2.NMI:Non-maskable_interrupts
2561 ± 27% -39.0% 1562 ± 24% interrupts.CPU2.PMI:Performance_monitoring_interrupts
6573 ± 11% +47.2% 9674 ± 5% interrupts.CPU2.RES:Rescheduling_interrupts
6161 ± 2% +61.4% 9943 ± 8% interrupts.CPU3.RES:Rescheduling_interrupts
10041 ± 5% -38.1% 6213 ± 16% interrupts.NMI:Non-maskable_interrupts
10041 ± 5% -38.1% 6213 ± 16% interrupts.PMI:Performance_monitoring_interrupts
25581 ± 3% +48.9% 38088 ± 4% interrupts.RES:Rescheduling_interrupts
82.25 ± 32% -38.3% 50.75 ± 31% interrupts.TLB:TLB_shootdowns
4.269e+08 -22.0% 3.33e+08 perf-stat.i.branch-instructions
1664503 ± 9% -23.1% 1279479 ± 8% perf-stat.i.cache-misses
19051292 -22.7% 14721557 perf-stat.i.cache-references
7870 -7.6% 7274 perf-stat.i.context-switches
1.45 ± 3% -9.7% 1.31 ± 2% perf-stat.i.cpi
4.213e+09 -25.6% 3.136e+09 perf-stat.i.cpu-cycles
175.56 -16.8% 146.10 perf-stat.i.cpu-migrations
1779889 ± 9% -21.3% 1400983 ± 3% perf-stat.i.dTLB-load-misses
7.964e+08 -21.8% 6.225e+08 perf-stat.i.dTLB-loads
351028 ± 2% -22.6% 271606 perf-stat.i.dTLB-store-misses
4.558e+08 ± 2% -22.2% 3.546e+08 perf-stat.i.dTLB-stores
442564 -21.8% 346125 perf-stat.i.iTLB-load-misses
95765 ± 2% -20.3% 76368 ± 2% perf-stat.i.iTLB-loads
3.324e+09 -24.4% 2.514e+09 perf-stat.i.instructions
0.72 ± 2% +8.5% 0.78 ± 2% perf-stat.i.ipc
23876 -23.2% 18334 perf-stat.i.minor-faults
23876 -23.2% 18334 perf-stat.i.page-faults
5.73 +2.2% 5.86 perf-stat.overall.MPKI
1.67 ± 6% +0.4 2.03 ± 3% perf-stat.overall.branch-miss-rate%
1.27 -1.6% 1.25 perf-stat.overall.cpi
4.255e+08 -22.0% 3.319e+08 perf-stat.ps.branch-instructions
1658868 ± 9% -23.1% 1275223 ± 8% perf-stat.ps.cache-misses
18985675 -22.7% 14670825 perf-stat.ps.cache-references
7844 -7.5% 7253 perf-stat.ps.context-switches
4.199e+09 -25.6% 3.126e+09 perf-stat.ps.cpu-cycles
174.96 -16.8% 145.60 perf-stat.ps.cpu-migrations
1773792 ± 9% -21.3% 1396196 ± 3% perf-stat.ps.dTLB-load-misses
7.937e+08 -21.8% 6.204e+08 perf-stat.ps.dTLB-loads
349822 ± 2% -22.6% 270680 perf-stat.ps.dTLB-store-misses
4.543e+08 ± 2% -22.2% 3.534e+08 perf-stat.ps.dTLB-stores
441052 -21.8% 344957 perf-stat.ps.iTLB-load-misses
95442 ± 2% -20.2% 76129 ± 2% perf-stat.ps.iTLB-loads
3.313e+09 -24.4% 2.506e+09 perf-stat.ps.instructions
23793 -23.2% 18271 perf-stat.ps.minor-faults
23793 -23.2% 18271 perf-stat.ps.page-faults
9.988e+11 -23.7% 7.621e+11 perf-stat.total.instructions
45998 +60.9% 74001 sched_debug.cfs_rq:/.exec_clock.avg
47498 +58.8% 75421 sched_debug.cfs_rq:/.exec_clock.max
44646 +62.4% 72516 sched_debug.cfs_rq:/.exec_clock.min
796333 ± 9% -20.8% 630761 sched_debug.cfs_rq:/.load.max
21451 ± 58% +255.5% 76262 ± 11% sched_debug.cfs_rq:/.load.min
324417 ± 8% -29.7% 227954 ± 3% sched_debug.cfs_rq:/.load.stddev
923.62 ± 10% -16.1% 775.25 ± 4% sched_debug.cfs_rq:/.load_avg.max
30.88 ± 82% +156.4% 79.17 ± 17% sched_debug.cfs_rq:/.load_avg.min
377.35 ± 13% -23.9% 287.11 ± 6% sched_debug.cfs_rq:/.load_avg.stddev
189460 +64.2% 311059 sched_debug.cfs_rq:/.min_vruntime.avg
201580 ± 2% +61.4% 325343 sched_debug.cfs_rq:/.min_vruntime.max
179517 +65.3% 296725 sched_debug.cfs_rq:/.min_vruntime.min
0.56 ± 12% +33.3% 0.75 sched_debug.cfs_rq:/.nr_running.avg
0.21 ± 34% +140.0% 0.50 sched_debug.cfs_rq:/.nr_running.min
0.38 ± 8% -35.5% 0.24 ± 3% sched_debug.cfs_rq:/.nr_running.stddev
10.60 ± 21% +123.8% 23.73 ± 5% sched_debug.cfs_rq:/.nr_spread_over.avg
23.08 ± 14% +42.4% 32.88 ± 9% sched_debug.cfs_rq:/.nr_spread_over.max
2.25 ± 87% +583.3% 15.38 ± 10% sched_debug.cfs_rq:/.nr_spread_over.min
708.58 ± 7% -19.9% 567.92 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.max
13.38 ± 80% +371.0% 63.00 ± 15% sched_debug.cfs_rq:/.runnable_load_avg.min
298.60 ± 8% -28.3% 214.23 ± 7% sched_debug.cfs_rq:/.runnable_load_avg.stddev
723964 ± 7% -21.5% 568235 ± 6% sched_debug.cfs_rq:/.runnable_weight.max
14679 ± 86% +363.3% 68009 ± 12% sched_debug.cfs_rq:/.runnable_weight.min
299951 ± 6% -29.5% 211457 ± 7% sched_debug.cfs_rq:/.runnable_weight.stddev
334.42 ± 14% +73.8% 581.19 ± 6% sched_debug.cfs_rq:/.util_avg.avg
642.29 ± 3% +26.0% 809.42 ± 7% sched_debug.cfs_rq:/.util_avg.max
190.79 ± 31% +120.1% 419.96 ± 5% sched_debug.cfs_rq:/.util_avg.min
35.25 ±116% +507.4% 214.10 ± 14% sched_debug.cfs_rq:/.util_est_enqueued.avg
75.00 ± 73% +414.4% 385.83 ± 13% sched_debug.cfs_rq:/.util_est_enqueued.max
0.29 ± 47% +7600.0% 22.46 ±168% sched_debug.cfs_rq:/.util_est_enqueued.min
30.74 ± 69% +378.4% 147.03 ± 20% sched_debug.cfs_rq:/.util_est_enqueued.stddev
0.36 ± 17% +209.4% 1.11 ± 43% sched_debug.cpu.clock.stddev
0.36 ± 17% +209.4% 1.11 ± 43% sched_debug.cpu.clock_task.stddev
4944 ± 32% +58.6% 7841 sched_debug.cpu.curr->pid.avg
1352 ±157% +303.3% 5453 sched_debug.cpu.curr->pid.min
5847 ± 15% -33.4% 3892 sched_debug.cpu.curr->pid.stddev
0.95 ± 16% +29.7% 1.23 ± 6% sched_debug.cpu.nr_running.avg
69299 ± 14% -27.4% 50339 ± 19% sched_debug.cpu.sched_count.stddev
169317 -28.4% 121307 sched_debug.cpu.sched_goidle.avg
209603 ± 2% -31.5% 143623 ± 2% sched_debug.cpu.sched_goidle.max
32708 ± 15% -51.2% 15951 ± 22% sched_debug.cpu.sched_goidle.stddev
8.30 ± 10% -3.1 5.21 ± 7% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.37 ± 13% -2.9 5.43 ± 8% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write._fini
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write._fini
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.new_sync_write.vfs_write
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write._fini
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.devkmsg_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.new_sync_write.vfs_write.ksys_write
6.22 ± 20% -2.8 3.47 ± 17% perf-profile.calltrace.cycles-pp.write._fini
6.22 ± 20% -2.8 3.47 ± 17% perf-profile.calltrace.cycles-pp._fini
5.49 ± 15% -2.5 2.99 ± 30% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.new_sync_write
4.38 ± 13% -2.4 2.02 ± 36% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write
4.26 ± 13% -2.3 1.93 ± 37% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit
0.92 ± 19% -0.5 0.44 ± 58% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.88 ± 24% +0.4 1.25 ± 11% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.44 ± 15% +0.5 1.90 ± 10% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.85 ± 22% +0.6 1.43 ± 21% perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode
0.00 +0.6 0.64 ± 16% perf-profile.calltrace.cycles-pp.alloc_set_pte.filemap_map_pages.handle_pte_fault.__handle_mm_fault.handle_mm_fault
2.87 ± 32% +1.9 4.72 ± 11% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.printk
2.90 ± 32% +1.9 4.76 ± 11% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.printk.irq_work_run_list
0.98 ± 72% +2.2 3.21 ± 12% perf-profile.calltrace.cycles-pp.irq_work_interrupt
0.98 ± 72% +2.2 3.21 ± 12% perf-profile.calltrace.cycles-pp.smp_irq_work_interrupt.irq_work_interrupt
0.98 ± 72% +2.2 3.21 ± 12% perf-profile.calltrace.cycles-pp.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
0.98 ± 72% +2.2 3.21 ± 12% perf-profile.calltrace.cycles-pp.irq_work_run_list.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
3.29 ± 22% +2.7 5.95 ± 15% perf-profile.calltrace.cycles-pp.vprintk_emit.printk.irq_work_run_list.irq_work_run.smp_irq_work_interrupt
3.29 ± 22% +2.7 5.95 ± 15% perf-profile.calltrace.cycles-pp.printk.irq_work_run_list.irq_work_run.smp_irq_work_interrupt.irq_work_interrupt
3.06 ± 34% +2.9 5.95 ± 15% perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.printk.irq_work_run_list.irq_work_run
8.62 ± 10% -3.1 5.54 ± 8% perf-profile.children.cycles-pp.vfs_write
8.69 ± 10% -3.1 5.63 ± 8% perf-profile.children.cycles-pp.ksys_write
8.36 ± 11% -3.0 5.31 ± 7% perf-profile.children.cycles-pp.new_sync_write
9.35 ± 13% -2.9 6.47 ± 10% perf-profile.children.cycles-pp.write
6.62 ± 18% -2.8 3.85 ± 15% perf-profile.children.cycles-pp._fini
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.children.cycles-pp.devkmsg_write
6.22 ± 20% -2.8 3.46 ± 17% perf-profile.children.cycles-pp.devkmsg_emit
1.60 ± 6% -0.4 1.19 ± 10% perf-profile.children.cycles-pp.mmap_region
0.78 ± 51% -0.3 0.48 ± 9% perf-profile.children.cycles-pp.shmem_write_begin
0.31 ± 5% -0.2 0.11 ± 22% perf-profile.children.cycles-pp.run_ksoftirqd
0.54 ± 13% -0.2 0.35 ± 27% perf-profile.children.cycles-pp.rcu_do_batch
0.33 ± 13% -0.2 0.18 ± 36% perf-profile.children.cycles-pp.remove_vma
0.23 ± 20% -0.1 0.08 ± 40% perf-profile.children.cycles-pp.sync_regs
0.32 ± 9% -0.1 0.18 ± 41% perf-profile.children.cycles-pp.smpboot_thread_fn
0.34 ± 10% -0.1 0.22 ± 34% perf-profile.children.cycles-pp.malloc
0.32 ± 12% -0.1 0.21 ± 37% perf-profile.children.cycles-pp.__check_object_size
0.20 ± 30% -0.1 0.11 ± 38% perf-profile.children.cycles-pp.fsnotify
0.16 ± 34% -0.1 0.09 ± 59% perf-profile.children.cycles-pp.prepend_path
0.12 ± 21% -0.1 0.05 ± 62% perf-profile.children.cycles-pp.rcu_cblist_dequeue
0.16 ± 19% -0.1 0.09 ± 38% perf-profile.children.cycles-pp.__pud_alloc
0.14 ± 19% -0.1 0.08 ± 19% perf-profile.children.cycles-pp.__x64_sys_rt_sigaction
0.09 ± 21% -0.1 0.03 ±102% perf-profile.children.cycles-pp.expand_downwards
0.07 ± 41% +0.1 0.13 ± 34% perf-profile.children.cycles-pp.memset_erms
0.12 ± 37% +0.1 0.18 ± 14% perf-profile.children.cycles-pp.security_mmap_addr
0.01 ±173% +0.1 0.07 ± 30% perf-profile.children.cycles-pp.free_unref_page_prepare
0.01 ±173% +0.1 0.07 ± 30% perf-profile.children.cycles-pp.getopt_long
0.07 ± 64% +0.1 0.14 ± 19% perf-profile.children.cycles-pp.__ctype_init
0.01 ±173% +0.1 0.09 ± 35% perf-profile.children.cycles-pp.__note_gp_changes
0.01 ±173% +0.1 0.09 ± 28% perf-profile.children.cycles-pp.select_idle_sibling
0.07 ± 66% +0.1 0.14 ± 30% perf-profile.children.cycles-pp.security_file_open
0.02 ±173% +0.1 0.10 ± 43% perf-profile.children.cycles-pp.note_gp_changes
0.06 ± 64% +0.1 0.14 ± 37% perf-profile.children.cycles-pp.mutex_lock
0.15 ± 2% +0.1 0.23 ± 20% perf-profile.children.cycles-pp.shmem_truncate_range
0.15 ± 2% +0.1 0.23 ± 20% perf-profile.children.cycles-pp.shmem_undo_range
0.00 +0.1 0.09 ± 49% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
0.11 ± 50% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.__ctype_toupper_loc
0.12 ± 27% +0.1 0.24 ± 25% perf-profile.children.cycles-pp.touch_atime
0.11 ± 60% +0.1 0.26 ± 26% perf-profile.children.cycles-pp.call_rcu
0.29 ± 15% +0.1 0.44 ± 17% perf-profile.children.cycles-pp.page_add_file_rmap
0.19 ± 44% +0.2 0.35 ± 32% perf-profile.children.cycles-pp.task_tick_fair
0.56 ± 6% +0.2 0.75 ± 12% perf-profile.children.cycles-pp.schedule
0.80 ± 15% +0.3 1.06 ± 14% perf-profile.children.cycles-pp.alloc_set_pte
1.67 ± 15% +0.5 2.15 ± 12% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.00 ± 16% +0.6 1.59 ± 17% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.93 ± 20% +0.6 1.54 ± 13% perf-profile.children.cycles-pp.exit_to_usermode_loop
4.25 ± 26% +2.1 6.38 ± 13% perf-profile.children.cycles-pp.irq_work_run_list
3.46 ± 22% +2.5 5.96 ± 15% perf-profile.children.cycles-pp.irq_work_interrupt
3.46 ± 22% +2.5 5.96 ± 15% perf-profile.children.cycles-pp.smp_irq_work_interrupt
3.46 ± 22% +2.5 5.96 ± 15% perf-profile.children.cycles-pp.irq_work_run
3.46 ± 22% +2.5 5.96 ± 15% perf-profile.children.cycles-pp.printk
0.41 ± 21% -0.2 0.26 ± 32% perf-profile.self.cycles-pp.kmem_cache_free
0.24 ± 27% -0.2 0.08 ±110% perf-profile.self.cycles-pp.__vma_link_rb
0.21 ± 24% -0.1 0.07 ± 17% perf-profile.self.cycles-pp.sync_regs
0.34 ± 10% -0.1 0.19 ± 59% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.24 ± 30% -0.1 0.13 ± 42% perf-profile.self.cycles-pp.arch_get_unmapped_area_topdown
0.14 ± 40% -0.1 0.04 ±108% perf-profile.self.cycles-pp.cap_vm_enough_memory
0.19 ± 33% -0.1 0.10 ± 30% perf-profile.self.cycles-pp.fsnotify
0.27 ± 12% -0.1 0.19 ± 13% perf-profile.self.cycles-pp.up_write
0.12 ± 21% -0.1 0.05 ± 62% perf-profile.self.cycles-pp.rcu_cblist_dequeue
0.12 ± 18% -0.1 0.06 ± 71% perf-profile.self.cycles-pp.__softirqentry_text_start
0.15 ± 16% -0.1 0.09 ± 21% perf-profile.self.cycles-pp.xas_load
0.11 ± 23% -0.1 0.05 ± 59% perf-profile.self.cycles-pp.__alloc_file
0.01 ±173% +0.1 0.07 ± 17% perf-profile.self.cycles-pp.do_mmap
0.01 ±173% +0.1 0.07 ± 30% perf-profile.self.cycles-pp.free_unref_page_prepare
0.09 ± 25% +0.1 0.15 ± 27% perf-profile.self.cycles-pp.timerqueue_add
0.04 ± 58% +0.1 0.11 ± 54% perf-profile.self.cycles-pp.__fsnotify_parent
0.05 ± 77% +0.1 0.13 ± 34% perf-profile.self.cycles-pp.memset_erms
0.06 ±106% +0.1 0.15 ± 19% perf-profile.self.cycles-pp.lockref_put_or_lock
0.07 ± 22% +0.1 0.17 ± 20% perf-profile.self.cycles-pp.__ctype_toupper_loc
0.05 ± 62% +0.1 0.17 ± 25% perf-profile.self.cycles-pp.bit_putcs
***************************************************************************************************
lkp-bdw-ep6: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/16/debian-x86_64-20191114.cgz/lkp-bdw-ep6/pread2/will-it-scale/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.RIP:__msecs_to_jiffies
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 50% 2:4 dmesg.RIP:find_next_and_bit
:4 25% 1:4 dmesg.RIP:idle_cpu
%stddev %change %stddev
\ | \
47516 -58.3% 19828 will-it-scale.per_process_ops
760272 -58.3% 317258 will-it-scale.workload
32356 -20.9% 25597 meminfo.Shmem
581162 -57.6% 246617 vmstat.system.cs
3906 ± 10% -18.4% 3186 ± 5% slabinfo.eventpoll_pwq.active_objs
3906 ± 10% -18.4% 3186 ± 5% slabinfo.eventpoll_pwq.num_objs
44.30 +18.2% 52.34 ± 6% boot-time.boot
28.05 +19.3% 33.45 ± 9% boot-time.dhcp
3459 +17.2% 4053 ± 6% boot-time.idle
0.21 ± 5% +0.3 0.49 ± 11% mpstat.cpu.all.iowait%
0.04 ± 55% -0.0 0.00 ± 42% mpstat.cpu.all.soft%
0.40 ± 9% +0.1 0.52 ± 6% mpstat.cpu.all.usr%
49949 ± 16% -37.4% 31252 ± 41% numa-vmstat.node1.nr_active_anon
46901 ± 16% -36.0% 30006 ± 43% numa-vmstat.node1.nr_anon_pages
5608 ± 15% -34.0% 3702 ± 24% numa-vmstat.node1.nr_shmem
49949 ± 16% -37.4% 31252 ± 41% numa-vmstat.node1.nr_zone_active_anon
7.102e+08 ± 29% +155.2% 1.813e+09 cpuidle.C1.time
27256121 ± 7% +27.5% 34760814 cpuidle.C1.usage
72244044 ± 20% -48.8% 36979854 ± 7% cpuidle.C1E.usage
3.303e+08 -89.0% 36363726 ± 4% cpuidle.POLL.time
1.016e+08 -94.2% 5891366 ± 5% cpuidle.POLL.usage
199835 ± 16% -37.4% 125098 ± 41% numa-meminfo.node1.Active
199787 ± 16% -37.4% 125025 ± 41% numa-meminfo.node1.Active(anon)
135807 ± 14% -49.2% 68980 ± 59% numa-meminfo.node1.AnonHugePages
187633 ± 16% -36.0% 120058 ± 43% numa-meminfo.node1.AnonPages
1027770 ± 3% -9.1% 934292 ± 3% numa-meminfo.node1.MemUsed
22417 ± 15% -34.0% 14796 ± 24% numa-meminfo.node1.Shmem
70655 -3.3% 68347 proc-vmstat.nr_active_anon
67337 -1.1% 66618 proc-vmstat.nr_anon_pages
4468 -1.4% 4407 proc-vmstat.nr_inactive_anon
8093 -21.0% 6396 proc-vmstat.nr_shmem
70655 -3.3% 68347 proc-vmstat.nr_zone_active_anon
4468 -1.4% 4407 proc-vmstat.nr_zone_inactive_anon
4016 ± 2% -52.8% 1897 ± 3% proc-vmstat.pgactivate
763194 -1.5% 751801 proc-vmstat.pgfree
30.38 ± 9% -19.4% 24.48 ± 7% sched_debug.cfs_rq:/.load_avg.avg
66.85 ± 15% -29.9% 46.86 ± 9% sched_debug.cfs_rq:/.load_avg.stddev
11657 ± 20% +46.4% 17071 ± 17% sched_debug.cfs_rq:/.min_vruntime.min
1.46 ± 4% +54.3% 2.25 ± 22% sched_debug.cfs_rq:/.nr_spread_over.max
255.29 ± 33% -51.8% 123.12 ± 57% sched_debug.cfs_rq:/.removed.load_avg.max
11764 ± 33% -52.1% 5636 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.max
2.31 ± 32% -68.2% 0.73 ± 86% sched_debug.cfs_rq:/.removed.util_avg.avg
108.42 ± 20% -57.5% 46.04 ± 67% sched_debug.cfs_rq:/.removed.util_avg.max
14.41 ± 24% -61.7% 5.52 ± 73% sched_debug.cfs_rq:/.removed.util_avg.stddev
1.95 ± 9% +103.1% 3.96 ± 7% sched_debug.cpu.clock.stddev
1.95 ± 9% +103.1% 3.95 ± 7% sched_debug.cpu.clock_task.stddev
0.00 ± 12% +30.2% 0.00 ± 7% sched_debug.cpu.next_balance.stddev
996142 -57.5% 423123 sched_debug.cpu.nr_switches.avg
4456353 ± 2% -58.8% 1837895 ± 3% sched_debug.cpu.nr_switches.max
1545085 ± 2% -58.2% 645308 ± 3% sched_debug.cpu.nr_switches.stddev
0.07 ± 11% -12.2% 0.06 ± 7% sched_debug.cpu.nr_uninterruptible.avg
994777 -57.6% 421767 sched_debug.cpu.sched_count.avg
4454631 ± 2% -58.8% 1835187 ± 3% sched_debug.cpu.sched_count.max
1545434 ± 2% -58.2% 645403 ± 3% sched_debug.cpu.sched_count.stddev
497129 -57.6% 210604 sched_debug.cpu.sched_goidle.avg
2226464 ± 2% -58.8% 916688 ± 3% sched_debug.cpu.sched_goidle.max
772445 ± 2% -58.3% 322404 ± 3% sched_debug.cpu.sched_goidle.stddev
499374 -57.5% 212027 sched_debug.cpu.ttwu_count.avg
2253283 ± 2% -58.5% 935584 ± 2% sched_debug.cpu.ttwu_count.max
776205 ± 2% -58.2% 324737 ± 3% sched_debug.cpu.ttwu_count.stddev
2.833e+09 -58.7% 1.17e+09 perf-stat.i.branch-instructions
1.34 ± 7% +0.5 1.81 ± 5% perf-stat.i.branch-miss-rate%
38071080 ± 7% -42.7% 21807828 ± 5% perf-stat.i.branch-misses
0.13 ± 42% +0.2 0.34 ± 16% perf-stat.i.cache-miss-rate%
1.708e+08 ± 11% -52.6% 81037761 ± 4% perf-stat.i.cache-references
585466 -57.6% 248186 perf-stat.i.context-switches
3.33e+10 ± 3% -57.8% 1.405e+10 ± 3% perf-stat.i.cpu-cycles
213658 ± 23% -70.6% 62867 ± 15% perf-stat.i.cycles-between-cache-misses
3.214e+09 -57.8% 1.358e+09 perf-stat.i.dTLB-loads
1239865 ± 16% -52.7% 585938 ± 12% perf-stat.i.dTLB-store-misses
1.309e+09 ± 5% -52.7% 6.189e+08 ± 4% perf-stat.i.dTLB-stores
1960515 ± 16% -53.9% 903780 ± 11% perf-stat.i.iTLB-load-misses
4186486 ± 10% -30.8% 2895064 perf-stat.i.iTLB-loads
1.211e+10 -57.6% 5.136e+09 perf-stat.i.instructions
96.22 +1.1 97.36 perf-stat.i.node-load-miss-rate%
63995 ± 12% +40.3% 89787 ± 3% perf-stat.i.node-load-misses
26.57 ± 8% +32.0 58.55 ± 17% perf-stat.i.node-store-miss-rate%
10897 ± 17% +237.4% 36771 ± 19% perf-stat.i.node-store-misses
1.34 ± 7% +0.5 1.86 ± 5% perf-stat.overall.branch-miss-rate%
0.12 ± 41% +0.2 0.33 ± 16% perf-stat.overall.cache-miss-rate%
177582 ± 22% -70.0% 53250 ± 14% perf-stat.overall.cycles-between-cache-misses
93.13 +2.5 95.61 perf-stat.overall.node-load-miss-rate%
27.65 ± 9% +30.2 57.81 ± 17% perf-stat.overall.node-store-miss-rate%
2.824e+09 -58.7% 1.167e+09 perf-stat.ps.branch-instructions
37948277 ± 7% -42.7% 21737958 ± 5% perf-stat.ps.branch-misses
1.702e+08 ± 11% -52.6% 80767304 ± 4% perf-stat.ps.cache-references
583496 -57.6% 247346 perf-stat.ps.context-switches
3.319e+10 ± 3% -57.8% 1.4e+10 ± 3% perf-stat.ps.cpu-cycles
3.204e+09 -57.8% 1.353e+09 perf-stat.ps.dTLB-loads
1235717 ± 16% -52.7% 583994 ± 12% perf-stat.ps.dTLB-store-misses
1.304e+09 ± 5% -52.7% 6.168e+08 ± 4% perf-stat.ps.dTLB-stores
1953938 ± 16% -53.9% 900759 ± 11% perf-stat.ps.iTLB-load-misses
4172435 ± 10% -30.8% 2885326 perf-stat.ps.iTLB-loads
1.207e+10 -57.6% 5.119e+09 perf-stat.ps.instructions
63808 ± 12% +40.3% 89549 ± 3% perf-stat.ps.node-load-misses
10873 ± 17% +237.2% 36660 ± 19% perf-stat.ps.node-store-misses
3.648e+12 -57.7% 1.545e+12 perf-stat.total.instructions
184.25 ± 11% +464.6% 1040 ± 75% interrupts.39:IR-PCI-MSI.1572870-edge.eth0-TxRx-5
3900 ± 7% -62.5% 1462 ± 24% interrupts.CPU0.NMI:Non-maskable_interrupts
3900 ± 7% -62.5% 1462 ± 24% interrupts.CPU0.PMI:Performance_monitoring_interrupts
4668 ± 7% -60.8% 1830 ± 4% interrupts.CPU1.NMI:Non-maskable_interrupts
4668 ± 7% -60.8% 1830 ± 4% interrupts.CPU1.PMI:Performance_monitoring_interrupts
32508 ± 6% -15.2% 27551 ± 2% interrupts.CPU1.RES:Rescheduling_interrupts
4661 ± 3% -75.4% 1148 ± 33% interrupts.CPU10.NMI:Non-maskable_interrupts
4661 ± 3% -75.4% 1148 ± 33% interrupts.CPU10.PMI:Performance_monitoring_interrupts
31432 ± 5% -13.5% 27188 ± 2% interrupts.CPU10.RES:Rescheduling_interrupts
4202 ± 16% -72.3% 1162 ± 31% interrupts.CPU11.NMI:Non-maskable_interrupts
4202 ± 16% -72.3% 1162 ± 31% interrupts.CPU11.PMI:Performance_monitoring_interrupts
4160 ± 3% -68.4% 1316 ± 33% interrupts.CPU12.NMI:Non-maskable_interrupts
4160 ± 3% -68.4% 1316 ± 33% interrupts.CPU12.PMI:Performance_monitoring_interrupts
4514 ± 3% -64.5% 1601 ± 26% interrupts.CPU13.NMI:Non-maskable_interrupts
4514 ± 3% -64.5% 1601 ± 26% interrupts.CPU13.PMI:Performance_monitoring_interrupts
30049 ± 6% -10.0% 27039 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts
4729 ± 5% -71.0% 1373 ± 32% interrupts.CPU14.NMI:Non-maskable_interrupts
4729 ± 5% -71.0% 1373 ± 32% interrupts.CPU14.PMI:Performance_monitoring_interrupts
34066 -19.4% 27473 interrupts.CPU14.RES:Rescheduling_interrupts
4714 ± 6% -65.5% 1626 ± 25% interrupts.CPU15.NMI:Non-maskable_interrupts
4714 ± 6% -65.5% 1626 ± 25% interrupts.CPU15.PMI:Performance_monitoring_interrupts
43.50 ± 70% +1562.1% 723.00 ± 95% interrupts.CPU17.RES:Rescheduling_interrupts
184.25 ± 11% +464.6% 1040 ± 75% interrupts.CPU18.39:IR-PCI-MSI.1572870-edge.eth0-TxRx-5
4624 ± 5% -60.5% 1828 ± 3% interrupts.CPU2.NMI:Non-maskable_interrupts
4624 ± 5% -60.5% 1828 ± 3% interrupts.CPU2.PMI:Performance_monitoring_interrupts
32173 ± 6% -16.2% 26952 ± 2% interrupts.CPU2.RES:Rescheduling_interrupts
4891 ± 5% -62.5% 1836 ± 2% interrupts.CPU3.NMI:Non-maskable_interrupts
4891 ± 5% -62.5% 1836 ± 2% interrupts.CPU3.PMI:Performance_monitoring_interrupts
35431 ± 5% -22.4% 27510 ± 4% interrupts.CPU3.RES:Rescheduling_interrupts
51.50 ±151% +11438.8% 5942 ±169% interrupts.CPU38.RES:Rescheduling_interrupts
4527 ± 8% -59.7% 1825 ± 3% interrupts.CPU4.NMI:Non-maskable_interrupts
4527 ± 8% -59.7% 1825 ± 3% interrupts.CPU4.PMI:Performance_monitoring_interrupts
30981 ± 5% -11.0% 27558 interrupts.CPU4.RES:Rescheduling_interrupts
3074 ± 32% -41.3% 1805 interrupts.CPU44.NMI:Non-maskable_interrupts
3074 ± 32% -41.3% 1805 interrupts.CPU44.PMI:Performance_monitoring_interrupts
2854 ± 21% -43.2% 1622 ± 3% interrupts.CPU45.NMI:Non-maskable_interrupts
2854 ± 21% -43.2% 1622 ± 3% interrupts.CPU45.PMI:Performance_monitoring_interrupts
2494 ± 32% -34.0% 1647 ± 2% interrupts.CPU46.NMI:Non-maskable_interrupts
2494 ± 32% -34.0% 1647 ± 2% interrupts.CPU46.PMI:Performance_monitoring_interrupts
3060 ± 28% -53.5% 1421 ± 26% interrupts.CPU48.NMI:Non-maskable_interrupts
3060 ± 28% -53.5% 1421 ± 26% interrupts.CPU48.PMI:Performance_monitoring_interrupts
3138 ± 36% -56.6% 1363 ± 24% interrupts.CPU49.NMI:Non-maskable_interrupts
3138 ± 36% -56.6% 1363 ± 24% interrupts.CPU49.PMI:Performance_monitoring_interrupts
4428 ± 17% -57.3% 1893 interrupts.CPU5.NMI:Non-maskable_interrupts
4428 ± 17% -57.3% 1893 interrupts.CPU5.PMI:Performance_monitoring_interrupts
3085 ± 27% -47.6% 1617 interrupts.CPU51.NMI:Non-maskable_interrupts
3085 ± 27% -47.6% 1617 interrupts.CPU51.PMI:Performance_monitoring_interrupts
3074 ± 25% -47.9% 1603 ± 4% interrupts.CPU52.NMI:Non-maskable_interrupts
3074 ± 25% -47.9% 1603 ± 4% interrupts.CPU52.PMI:Performance_monitoring_interrupts
12475 ± 9% -24.3% 9441 ± 13% interrupts.CPU52.RES:Rescheduling_interrupts
3642 ± 10% -72.9% 985.75 ± 31% interrupts.CPU53.NMI:Non-maskable_interrupts
3642 ± 10% -72.9% 985.75 ± 31% interrupts.CPU53.PMI:Performance_monitoring_interrupts
3330 ± 5% -69.7% 1009 ± 35% interrupts.CPU54.NMI:Non-maskable_interrupts
3330 ± 5% -69.7% 1009 ± 35% interrupts.CPU54.PMI:Performance_monitoring_interrupts
3791 ± 19% -79.4% 782.25 ± 5% interrupts.CPU55.NMI:Non-maskable_interrupts
3791 ± 19% -79.4% 782.25 ± 5% interrupts.CPU55.PMI:Performance_monitoring_interrupts
3818 ± 3% -72.0% 1070 ± 36% interrupts.CPU56.NMI:Non-maskable_interrupts
3818 ± 3% -72.0% 1070 ± 36% interrupts.CPU56.PMI:Performance_monitoring_interrupts
16271 ± 20% -29.5% 11478 ± 11% interrupts.CPU56.RES:Rescheduling_interrupts
3451 ± 4% -70.4% 1023 ± 36% interrupts.CPU57.NMI:Non-maskable_interrupts
3451 ± 4% -70.4% 1023 ± 36% interrupts.CPU57.PMI:Performance_monitoring_interrupts
3269 ± 9% -62.2% 1234 ± 34% interrupts.CPU58.NMI:Non-maskable_interrupts
3269 ± 9% -62.2% 1234 ± 34% interrupts.CPU58.PMI:Performance_monitoring_interrupts
2873 ± 27% -57.1% 1231 ± 35% interrupts.CPU59.NMI:Non-maskable_interrupts
2873 ± 27% -57.1% 1231 ± 35% interrupts.CPU59.PMI:Performance_monitoring_interrupts
4622 ± 3% -60.6% 1821 ± 4% interrupts.CPU6.NMI:Non-maskable_interrupts
4622 ± 3% -60.6% 1821 ± 4% interrupts.CPU6.PMI:Performance_monitoring_interrupts
33723 ± 4% -18.9% 27349 ± 2% interrupts.CPU6.RES:Rescheduling_interrupts
4503 ± 3% -64.1% 1616 ± 24% interrupts.CPU7.NMI:Non-maskable_interrupts
4503 ± 3% -64.1% 1616 ± 24% interrupts.CPU7.PMI:Performance_monitoring_interrupts
3897 ± 27% -59.0% 1599 ± 24% interrupts.CPU8.NMI:Non-maskable_interrupts
3897 ± 27% -59.0% 1599 ± 24% interrupts.CPU8.PMI:Performance_monitoring_interrupts
30645 ± 4% -9.4% 27769 ± 3% interrupts.CPU8.RES:Rescheduling_interrupts
4350 ± 8% -62.8% 1616 ± 24% interrupts.CPU9.NMI:Non-maskable_interrupts
4350 ± 8% -62.8% 1616 ± 24% interrupts.CPU9.PMI:Performance_monitoring_interrupts
131956 ± 4% -58.7% 54514 ± 3% interrupts.NMI:Non-maskable_interrupts
131956 ± 4% -58.7% 54514 ± 3% interrupts.PMI:Performance_monitoring_interrupts
714824 ± 4% -11.4% 633277 ± 3% interrupts.RES:Rescheduling_interrupts
44129 ± 5% +20.3% 53082 ± 5% softirqs.CPU0.RCU
161701 ± 4% -35.7% 104023 ± 3% softirqs.CPU0.TIMER
43835 ± 3% +18.8% 52074 ± 3% softirqs.CPU1.RCU
157408 ± 8% -32.2% 106722 ± 2% softirqs.CPU1.TIMER
43239 ± 3% +20.6% 52153 ± 4% softirqs.CPU10.RCU
157623 ± 8% -32.4% 106606 ± 2% softirqs.CPU10.TIMER
43200 ± 2% +21.2% 52345 ± 4% softirqs.CPU11.RCU
157353 ± 8% -32.0% 106926 ± 2% softirqs.CPU11.TIMER
43390 ± 2% +23.7% 53686 softirqs.CPU12.RCU
158355 ± 7% -32.3% 107240 ± 2% softirqs.CPU12.TIMER
44002 ± 2% +19.7% 52691 ± 3% softirqs.CPU13.RCU
158735 ± 7% -32.7% 106903 ± 2% softirqs.CPU13.TIMER
42932 ± 3% +21.0% 51955 ± 3% softirqs.CPU14.RCU
157275 ± 7% -32.1% 106713 ± 2% softirqs.CPU14.TIMER
42650 ± 3% +23.8% 52806 ± 3% softirqs.CPU15.RCU
157539 ± 7% -31.9% 107205 ± 3% softirqs.CPU15.TIMER
42682 ± 3% +22.2% 52147 ± 4% softirqs.CPU16.RCU
162790 -40.1% 97521 ± 5% softirqs.CPU16.TIMER
43195 ± 3% +21.4% 52425 ± 4% softirqs.CPU17.RCU
163374 -40.2% 97658 ± 5% softirqs.CPU17.TIMER
42825 ± 3% +22.4% 52436 ± 4% softirqs.CPU18.RCU
163259 -40.5% 97085 ± 5% softirqs.CPU18.TIMER
42723 ± 4% +21.9% 52085 ± 3% softirqs.CPU19.RCU
163199 -40.5% 97043 ± 5% softirqs.CPU19.TIMER
43286 ± 3% +20.9% 52320 ± 3% softirqs.CPU2.RCU
157423 ± 7% -32.1% 106815 ± 2% softirqs.CPU2.TIMER
43480 ± 3% +20.3% 52326 ± 4% softirqs.CPU20.RCU
163538 -40.2% 97736 ± 6% softirqs.CPU20.TIMER
43785 ± 3% +20.0% 52531 ± 4% softirqs.CPU21.RCU
44229 ± 5% +17.8% 52114 ± 4% softirqs.CPU22.RCU
43412 ± 4% +20.6% 52369 ± 4% softirqs.CPU23.RCU
44282 ± 7% +20.3% 53262 ± 6% softirqs.CPU24.RCU
43548 ± 2% +31.9% 57440 ± 7% softirqs.CPU26.RCU
43200 ± 3% +21.0% 52284 ± 4% softirqs.CPU27.RCU
43083 ± 3% +20.6% 51950 ± 4% softirqs.CPU28.RCU
43346 ± 3% +20.2% 52111 ± 4% softirqs.CPU29.RCU
43176 ± 3% +21.2% 52327 ± 4% softirqs.CPU3.RCU
157164 ± 8% -32.3% 106399 ± 2% softirqs.CPU3.TIMER
43585 ± 5% +20.1% 52357 ± 4% softirqs.CPU30.RCU
43719 ± 4% +19.4% 52215 ± 3% softirqs.CPU31.RCU
44414 ± 5% +18.2% 52478 ± 3% softirqs.CPU32.RCU
131897 ± 16% -25.8% 97844 ± 6% softirqs.CPU32.TIMER
44448 ± 5% +18.1% 52484 ± 5% softirqs.CPU33.RCU
42918 +27.2% 54572 ± 4% softirqs.CPU34.RCU
43391 ± 4% +24.4% 53984 ± 9% softirqs.CPU35.RCU
44027 +18.6% 52232 ± 4% softirqs.CPU36.RCU
44153 ± 5% +17.8% 52031 ± 4% softirqs.CPU37.RCU
42768 ± 3% +21.1% 51810 ± 4% softirqs.CPU38.RCU
42923 ± 3% +20.5% 51730 ± 3% softirqs.CPU39.RCU
43636 ± 2% +21.6% 53043 ± 6% softirqs.CPU4.RCU
157659 ± 8% -30.2% 109976 ± 2% softirqs.CPU4.TIMER
42469 ± 3% +21.9% 51764 ± 3% softirqs.CPU40.RCU
42791 ± 3% +20.8% 51694 ± 4% softirqs.CPU41.RCU
43485 ± 4% +20.4% 52375 ± 2% softirqs.CPU42.RCU
43029 ± 2% +21.9% 52464 ± 4% softirqs.CPU43.RCU
31500 ± 30% -44.0% 17635 ± 20% softirqs.CPU43.SCHED
42290 ± 3% +23.6% 52272 ± 4% softirqs.CPU44.RCU
158594 ± 5% -34.3% 104235 ± 3% softirqs.CPU44.TIMER
45530 ± 5% +18.7% 54021 ± 4% softirqs.CPU45.RCU
163284 ± 2% -38.4% 100522 ± 3% softirqs.CPU45.TIMER
44379 ± 2% +19.5% 53012 ± 6% softirqs.CPU46.RCU
162108 ± 2% -38.4% 99925 ± 4% softirqs.CPU46.TIMER
44204 ± 3% +18.7% 52450 ± 4% softirqs.CPU47.RCU
162144 ± 2% -38.7% 99444 ± 4% softirqs.CPU47.TIMER
44903 ± 2% +21.0% 54345 ± 5% softirqs.CPU48.RCU
44780 ± 2% +15.6% 51771 ± 3% softirqs.CPU49.RCU
162631 ± 2% -38.4% 100181 ± 5% softirqs.CPU49.TIMER
43012 ± 3% +26.6% 54472 ± 7% softirqs.CPU5.RCU
44607 ± 3% +17.5% 52402 ± 4% softirqs.CPU50.RCU
162101 ± 2% -38.7% 99441 ± 4% softirqs.CPU50.TIMER
44682 ± 2% +18.9% 53131 ± 3% softirqs.CPU51.RCU
49875 ± 2% -21.1% 39345 ± 22% softirqs.CPU51.SCHED
162062 ± 2% -38.3% 100017 ± 4% softirqs.CPU51.TIMER
44699 +18.3% 52877 ± 4% softirqs.CPU52.RCU
51309 -18.8% 41684 ± 16% softirqs.CPU52.SCHED
162152 ± 3% -38.5% 99708 ± 4% softirqs.CPU52.TIMER
44488 ± 2% +17.6% 52307 ± 4% softirqs.CPU53.RCU
50338 ± 3% -16.4% 42061 ± 15% softirqs.CPU53.SCHED
161963 ± 2% -38.7% 99280 ± 4% softirqs.CPU53.TIMER
43902 ± 2% +21.4% 53297 ± 3% softirqs.CPU54.RCU
161577 ± 2% -37.9% 100401 ± 3% softirqs.CPU54.TIMER
44048 ± 3% +18.8% 52308 ± 4% softirqs.CPU55.RCU
161805 ± 2% -38.7% 99176 ± 4% softirqs.CPU55.TIMER
44051 ± 3% +19.2% 52521 ± 4% softirqs.CPU56.RCU
53419 ± 4% -9.8% 48203 ± 2% softirqs.CPU56.SCHED
160982 ± 3% -37.7% 100317 ± 4% softirqs.CPU56.TIMER
43863 ± 3% +19.4% 52380 ± 3% softirqs.CPU57.RCU
161233 ± 2% -38.1% 99867 ± 3% softirqs.CPU57.TIMER
44561 ± 3% +19.0% 53006 ± 3% softirqs.CPU58.RCU
161767 ± 3% -38.1% 100130 ± 4% softirqs.CPU58.TIMER
44419 ± 4% +21.0% 53761 ± 8% softirqs.CPU59.RCU
50530 ± 3% -7.9% 46520 ± 3% softirqs.CPU59.SCHED
161405 ± 2% -37.2% 101425 ± 4% softirqs.CPU59.TIMER
43821 ± 2% +19.2% 52250 ± 3% softirqs.CPU6.RCU
157996 ± 8% -32.6% 106478 ± 2% softirqs.CPU6.TIMER
43174 ± 4% +20.6% 52047 ± 4% softirqs.CPU60.RCU
42347 ± 3% -15.5% 35762 ± 18% softirqs.CPU60.SCHED
163073 -40.5% 96957 ± 5% softirqs.CPU60.TIMER
42766 ± 3% +21.9% 52126 ± 4% softirqs.CPU61.RCU
162835 -40.5% 96850 ± 6% softirqs.CPU61.TIMER
42574 ± 3% +22.2% 52017 ± 4% softirqs.CPU62.RCU
162880 -40.6% 96682 ± 5% softirqs.CPU62.TIMER
42326 ± 4% +22.4% 51823 ± 4% softirqs.CPU63.RCU
162725 -41.1% 95781 ± 5% softirqs.CPU63.TIMER
42386 ± 3% +24.3% 52687 ± 6% softirqs.CPU64.RCU
162419 -40.0% 97492 ± 5% softirqs.CPU64.TIMER
42664 ± 3% +24.1% 52948 ± 6% softirqs.CPU65.RCU
162604 -39.3% 98719 ± 5% softirqs.CPU65.TIMER
42930 ± 4% +22.4% 52557 ± 5% softirqs.CPU66.RCU
44270 ± 4% +18.0% 52235 ± 5% softirqs.CPU67.RCU
114483 ± 10% -15.6% 96590 ± 5% softirqs.CPU67.TIMER
43515 ± 2% +25.6% 54655 ± 7% softirqs.CPU68.RCU
43366 ± 4% +19.4% 51774 ± 3% softirqs.CPU69.RCU
112432 ± 8% -14.3% 96409 ± 5% softirqs.CPU69.TIMER
43450 ± 2% +24.7% 54161 ± 7% softirqs.CPU7.RCU
157600 ± 8% -31.4% 108046 ± 4% softirqs.CPU7.TIMER
43344 ± 3% +20.6% 52293 ± 4% softirqs.CPU70.RCU
43314 ± 4% +19.9% 51935 ± 4% softirqs.CPU71.RCU
43488 ± 4% +19.8% 52078 ± 4% softirqs.CPU72.RCU
43392 ± 3% +20.9% 52471 ± 4% softirqs.CPU73.RCU
43217 ± 3% +20.5% 52062 ± 4% softirqs.CPU74.RCU
42947 ± 3% +21.5% 52201 ± 4% softirqs.CPU75.RCU
42710 ± 3% +21.2% 51754 ± 3% softirqs.CPU76.RCU
42920 ± 3% +20.8% 51831 ± 3% softirqs.CPU77.RCU
44411 ± 4% +16.3% 51634 ± 4% softirqs.CPU78.RCU
42860 ± 3% +21.3% 52007 ± 3% softirqs.CPU79.RCU
43752 ± 3% +23.7% 54111 ± 4% softirqs.CPU8.RCU
158332 ± 7% -31.5% 108521 ± 3% softirqs.CPU8.TIMER
43727 +18.4% 51771 ± 4% softirqs.CPU80.RCU
42622 ± 2% +22.2% 52098 ± 3% softirqs.CPU81.RCU
43347 ± 3% +18.7% 51452 ± 3% softirqs.CPU82.RCU
43487 ± 3% +18.2% 51421 ± 4% softirqs.CPU83.RCU
42839 ± 2% +20.7% 51717 ± 4% softirqs.CPU84.RCU
42598 ± 3% +21.4% 51721 ± 4% softirqs.CPU85.RCU
42523 ± 3% +23.8% 52631 ± 6% softirqs.CPU86.RCU
43166 ± 2% +18.6% 51178 ± 4% softirqs.CPU87.RCU
43892 ± 2% +18.8% 52158 ± 3% softirqs.CPU9.RCU
158354 ± 7% -32.6% 106771 ± 2% softirqs.CPU9.TIMER
3831450 ± 3% +20.7% 4623682 ± 4% softirqs.RCU
12124176 ± 6% -26.8% 8870348 ± 4% softirqs.TIMER
5.74 -5.7 0.00 perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
49.19 ± 2% -4.4 44.77 ± 2% perf-profile.calltrace.cycles-pp.__libc_pread
48.16 ± 2% -4.3 43.85 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_pread
48.08 ± 2% -4.3 43.78 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_pread
46.68 ± 2% -4.1 42.53 ± 2% perf-profile.calltrace.cycles-pp.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_pread
46.83 ± 2% -4.1 42.68 ± 2% perf-profile.calltrace.cycles-pp.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_pread
46.35 ± 2% -4.1 42.22 ± 2% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
46.30 ± 2% -4.1 42.18 ± 2% perf-profile.calltrace.cycles-pp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64.do_syscall_64
32.56 ± 2% -3.2 29.40 ± 2% perf-profile.calltrace.cycles-pp.wake_up_page_bit.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64
28.11 -3.0 25.09 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.wake_up_page_bit.shmem_file_read_iter.new_sync_read.vfs_read
27.87 -3.0 24.88 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.wake_up_page_bit.shmem_file_read_iter.new_sync_read
12.00 ± 2% -0.9 11.06 ± 3% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64
11.92 ± 2% -0.9 10.99 ± 3% perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read
10.55 ± 3% -0.9 9.69 ± 3% perf-profile.calltrace.cycles-pp.__lock_page.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read
7.53 ± 4% -0.8 6.75 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__lock_page.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter
7.35 ± 4% -0.8 6.58 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__lock_page.find_lock_entry.shmem_getpage_gfp
3.57 ± 3% -0.3 3.28 ± 4% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.wake_up_page_bit.shmem_file_read_iter.new_sync_read
0.59 ± 3% +0.1 0.71 ± 8% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.76 ± 3% +0.2 0.99 ± 9% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.94 ± 4% +0.3 1.21 ± 9% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
1.81 ± 5% +0.5 2.35 ± 7% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +0.6 0.64 ± 6% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +0.7 0.68 ± 16% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
0.00 +0.8 0.82 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.59 ± 59% +0.9 1.46 ± 12% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +1.3 1.25 ± 7% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.95 ± 28% +1.5 2.42 ± 9% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +1.6 1.62 ± 5% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.60 ± 22% +3.0 4.61 ± 7% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
44.98 ± 2% +3.2 48.22 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
1.73 ± 20% +3.3 5.02 ± 7% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
45.11 ± 2% +3.5 48.60 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
48.76 ± 2% +4.1 52.83 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
48.78 ± 2% +4.1 52.86 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
48.78 ± 2% +4.1 52.86 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
50.29 ± 2% +4.2 54.48 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
38.54 ± 2% +5.6 44.12 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
5.91 -5.5 0.43 ± 3% perf-profile.children.cycles-pp.poll_idle
49.26 ± 2% -4.4 44.83 ± 2% perf-profile.children.cycles-pp.__libc_pread
48.26 ± 2% -4.2 44.03 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
48.19 ± 2% -4.2 43.97 ± 2% perf-profile.children.cycles-pp.do_syscall_64
46.83 ± 2% -4.1 42.68 ± 2% perf-profile.children.cycles-pp.ksys_pread64
46.69 ± 2% -4.1 42.56 ± 2% perf-profile.children.cycles-pp.vfs_read
46.35 ± 2% -4.1 42.23 ± 2% perf-profile.children.cycles-pp.new_sync_read
46.30 ± 2% -4.1 42.18 ± 2% perf-profile.children.cycles-pp.shmem_file_read_iter
36.19 ± 2% -3.5 32.70 ± 2% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
32.57 ± 2% -3.2 29.40 ± 2% perf-profile.children.cycles-pp.wake_up_page_bit
29.48 -2.7 26.78 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
12.01 ± 2% -0.9 11.07 ± 3% perf-profile.children.cycles-pp.shmem_getpage_gfp
11.93 ± 2% -0.9 11.00 ± 3% perf-profile.children.cycles-pp.find_lock_entry
10.56 ± 3% -0.9 9.70 ± 3% perf-profile.children.cycles-pp.__lock_page
7.55 ± 4% -0.7 6.80 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irq
3.57 ± 3% -0.3 3.28 ± 4% perf-profile.children.cycles-pp.autoremove_wake_function
0.43 ± 3% -0.1 0.37 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.07 ± 17% -0.0 0.03 ±100% perf-profile.children.cycles-pp.atime_needs_update
0.18 ± 3% -0.0 0.14 ± 12% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.08 ± 19% -0.0 0.04 ± 60% perf-profile.children.cycles-pp.touch_atime
0.20 ± 5% +0.0 0.24 ± 6% perf-profile.children.cycles-pp.update_rq_clock
0.08 ± 13% +0.0 0.13 ± 6% perf-profile.children.cycles-pp.uart_console_write
0.08 ± 10% +0.0 0.13 ± 6% perf-profile.children.cycles-pp.serial8250_console_putchar
0.09 ± 12% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.serial8250_console_write
0.08 ± 10% +0.1 0.13 ± 8% perf-profile.children.cycles-pp.wait_for_xmitr
0.08 ± 13% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.irq_work_interrupt
0.08 ± 13% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.08 ± 13% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.irq_work_run
0.08 ± 13% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.printk
0.08 ± 13% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.vprintk_emit
0.09 ± 8% +0.1 0.15 ± 10% perf-profile.children.cycles-pp.console_unlock
0.07 ± 22% +0.1 0.14 ± 17% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.07 ± 60% +0.1 0.14 ± 19% perf-profile.children.cycles-pp.__remove_hrtimer
0.08 ± 10% +0.1 0.15 ± 7% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.05 ± 62% +0.1 0.12 ± 15% perf-profile.children.cycles-pp.run_timer_softirq
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.rcu_irq_enter
0.23 ± 6% +0.1 0.30 ± 10% perf-profile.children.cycles-pp._find_next_bit
0.09 ± 8% +0.1 0.17 ± 9% perf-profile.children.cycles-pp.irq_work_run_list
0.01 ±173% +0.1 0.09 ± 16% perf-profile.children.cycles-pp.interrupt_entry
0.04 ±113% +0.1 0.12 ± 50% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.calc_global_load_tick
0.41 ± 5% +0.1 0.50 ± 7% perf-profile.children.cycles-pp.__next_timer_interrupt
0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.03 ±100% +0.1 0.12 ± 6% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.00 +0.1 0.10 ± 22% perf-profile.children.cycles-pp._raw_spin_trylock
0.06 ± 61% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.update_blocked_averages
0.06 ± 60% +0.1 0.17 ± 23% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.04 ± 58% +0.1 0.15 ± 8% perf-profile.children.cycles-pp.native_apic_msr_eoi_write
0.06 ± 60% +0.1 0.18 ± 11% perf-profile.children.cycles-pp.run_rebalance_domains
0.03 ±100% +0.1 0.15 ± 17% perf-profile.children.cycles-pp.find_busiest_group
0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.note_gp_changes
0.60 ± 3% +0.1 0.72 ± 7% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.07 ± 61% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.load_balance
0.07 ± 14% +0.1 0.22 ± 8% perf-profile.children.cycles-pp.lapic_next_deadline
0.37 ± 9% +0.1 0.51 ± 11% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.06 ± 16% +0.1 0.21 ± 8% perf-profile.children.cycles-pp.native_irq_return_iret
0.20 ± 4% +0.2 0.36 ± 4% perf-profile.children.cycles-pp.read_tsc
0.20 ± 37% +0.2 0.37 ± 15% perf-profile.children.cycles-pp.irq_enter
0.07 ± 85% +0.2 0.24 ± 7% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.16 ± 26% +0.2 0.35 ± 10% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.16 ± 7% +0.2 0.35 ± 6% perf-profile.children.cycles-pp.native_write_msr
0.11 ± 26% +0.2 0.32 ± 12% perf-profile.children.cycles-pp.rebalance_domains
0.78 ± 2% +0.2 1.00 ± 9% perf-profile.children.cycles-pp.tick_nohz_next_event
0.14 ± 29% +0.2 0.37 ± 11% perf-profile.children.cycles-pp.scheduler_tick
0.96 ± 4% +0.3 1.23 ± 9% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.29 ± 33% +0.4 0.72 ± 15% perf-profile.children.cycles-pp.update_process_times
0.32 ± 34% +0.4 0.77 ± 16% perf-profile.children.cycles-pp.tick_sched_handle
0.42 ± 34% +0.5 0.93 ± 13% perf-profile.children.cycles-pp.tick_sched_timer
0.19 ± 14% +0.5 0.70 ± 5% perf-profile.children.cycles-pp.clockevents_program_event
1.85 ± 5% +0.5 2.38 ± 7% perf-profile.children.cycles-pp.menu_select
0.08 ± 26% +0.5 0.61 ± 18% perf-profile.children.cycles-pp.rcu_core
0.44 ± 11% +0.6 1.01 ± 5% perf-profile.children.cycles-pp.ktime_get
0.76 ± 32% +0.9 1.62 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.35 ± 19% +1.0 1.34 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start
0.47 ± 12% +1.3 1.73 ± 5% perf-profile.children.cycles-pp.irq_exit
1.10 ± 25% +1.6 2.68 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt
1.86 ± 20% +3.2 5.02 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
2.03 ± 18% +3.5 5.49 ± 7% perf-profile.children.cycles-pp.apic_timer_interrupt
46.52 ± 2% +3.6 50.16 ± 2% perf-profile.children.cycles-pp.cpuidle_enter_state
46.53 ± 2% +3.6 50.17 ± 2% perf-profile.children.cycles-pp.cpuidle_enter
48.78 ± 2% +4.1 52.86 perf-profile.children.cycles-pp.start_secondary
50.29 ± 2% +4.2 54.48 ± 2% perf-profile.children.cycles-pp.secondary_startup_64
50.29 ± 2% +4.2 54.48 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
50.30 ± 2% +4.2 54.50 ± 2% perf-profile.children.cycles-pp.do_idle
38.55 ± 2% +5.6 44.12 perf-profile.children.cycles-pp.intel_idle
5.70 -5.3 0.37 ± 3% perf-profile.self.cycles-pp.poll_idle
36.19 ± 2% -3.5 32.70 ± 2% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
1.16 ± 2% -0.1 1.03 ± 5% perf-profile.self.cycles-pp.do_syscall_64
0.38 ± 3% -0.1 0.32 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.18 ± 3% -0.0 0.14 ± 13% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.14 ± 6% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.enqueue_task_fair
0.14 ± 6% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.update_rq_clock
0.25 +0.0 0.28 ± 5% perf-profile.self.cycles-pp.do_idle
0.16 ± 5% +0.0 0.20 ± 9% perf-profile.self.cycles-pp.__next_timer_interrupt
0.07 ± 17% +0.1 0.12 ± 19% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.update_blocked_averages
0.04 ± 60% +0.1 0.10 ± 14% perf-profile.self.cycles-pp.run_timer_softirq
0.07 ± 11% +0.1 0.14 ± 8% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.03 ±100% +0.1 0.09 ± 16% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.scheduler_tick
0.03 ±100% +0.1 0.09 ± 13% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.smp_apic_timer_interrupt
0.23 ± 4% +0.1 0.30 ± 9% perf-profile.self.cycles-pp._find_next_bit
0.01 ±173% +0.1 0.09 ± 13% perf-profile.self.cycles-pp.interrupt_entry
0.00 +0.1 0.07 ± 15% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.note_gp_changes
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.01 ±173% +0.1 0.10 ± 13% perf-profile.self.cycles-pp.find_busiest_group
0.00 +0.1 0.09 ± 26% perf-profile.self.cycles-pp.calc_global_load_tick
0.04 ± 59% +0.1 0.14 ± 23% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.10 ± 23% perf-profile.self.cycles-pp.__softirqentry_text_start
0.00 +0.1 0.10 ± 22% perf-profile.self.cycles-pp._raw_spin_trylock
0.04 ± 58% +0.1 0.14 ± 5% perf-profile.self.cycles-pp.native_apic_msr_eoi_write
0.06 ± 16% +0.1 0.21 ± 8% perf-profile.self.cycles-pp.native_irq_return_iret
0.19 ± 4% +0.2 0.34 ± 4% perf-profile.self.cycles-pp.read_tsc
0.16 ± 7% +0.2 0.35 ± 6% perf-profile.self.cycles-pp.native_write_msr
0.74 ± 7% +0.2 0.98 ± 5% perf-profile.self.cycles-pp.menu_select
0.23 ± 9% +0.3 0.51 ± 10% perf-profile.self.cycles-pp.cpuidle_enter_state
0.26 ± 17% +0.4 0.69 ± 7% perf-profile.self.cycles-pp.ktime_get
38.54 ± 2% +5.6 44.11 perf-profile.self.cycles-pp.intel_idle
***************************************************************************************************
lkp-ivb-d04: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-20191114.cgz/lkp-ivb-d04/pthread_mutex1/will-it-scale/0x21
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.RIP:cpuidle_enter_state
:4 50% 2:4 dmesg.RIP:load_balance
1:4 -25% :4 dmesg.WARNING:at(____ptrval____)for_ip_swapgs_restore_regs_and_return_to_usermode/0x
%stddev %change %stddev
\ | \
2.104e+08 -52.9% 99134408 will-it-scale.per_process_ops
15237207 -52.0% 7319428 will-it-scale.per_thread_ops
0.78 +6.8% 0.83 ± 5% will-it-scale.scalability
3966 ± 6% +10.6% 4386 ± 3% will-it-scale.time.involuntary_context_switches
2226461 -51.0% 1091802 ± 7% will-it-scale.time.voluntary_context_switches
2.096e+09 -52.4% 9.982e+08 will-it-scale.workload
2190 ± 8% -17.4% 1808 ± 3% slabinfo.filp.num_objs
30.11 ± 8% +15.7% 34.84 ± 4% boot-time.boot
81.94 ± 9% +10.9% 90.88 ± 6% boot-time.idle
51203 ± 5% -16.0% 43013 ± 11% softirqs.CPU0.SCHED
27449 ± 7% +19.2% 32729 ± 8% softirqs.CPU1.RCU
36.00 -5.6% 34.00 ± 2% vmstat.cpu.id
51.75 +2.9% 53.25 vmstat.cpu.us
21263 -37.0% 13400 ± 4% vmstat.system.cs
11199 -4.4% 10703 vmstat.system.in
64941 -0.9% 64335 proc-vmstat.nr_active_anon
3422 -1.1% 3385 proc-vmstat.nr_kernel_stack
64952 -0.9% 64345 proc-vmstat.nr_zone_active_anon
68842 -17.5% 56769 proc-vmstat.pgalloc_dma32
320818 +4.2% 334169 proc-vmstat.pgalloc_normal
1054791 ± 34% +315.7% 4384508 ± 4% cpuidle.C1.time
151088 ± 16% +638.1% 1115152 ± 4% cpuidle.C1.usage
66411716 ± 23% -27.2% 48366537 cpuidle.C1E.time
1049491 ± 14% -19.0% 849934 cpuidle.C1E.usage
2178859 -95.8% 91652 ± 22% cpuidle.POLL.time
1806832 -98.3% 31263 ± 56% cpuidle.POLL.usage
24270 ± 6% -76.9% 5600 ± 15% interrupts.CPU0.RES:Rescheduling_interrupts
24938 ± 8% -74.6% 6333 ± 11% interrupts.CPU1.RES:Rescheduling_interrupts
6707 ± 23% -44.0% 3759 ± 33% interrupts.CPU2.NMI:Non-maskable_interrupts
6707 ± 23% -44.0% 3759 ± 33% interrupts.CPU2.PMI:Performance_monitoring_interrupts
21878 ± 5% -75.1% 5455 ± 6% interrupts.CPU2.RES:Rescheduling_interrupts
6762 ± 7% -40.9% 3997 ± 15% interrupts.CPU3.NMI:Non-maskable_interrupts
6762 ± 7% -40.9% 3997 ± 15% interrupts.CPU3.PMI:Performance_monitoring_interrupts
25423 ± 10% -79.2% 5293 ± 13% interrupts.CPU3.RES:Rescheduling_interrupts
24739 ± 18% -36.9% 15618 ± 17% interrupts.NMI:Non-maskable_interrupts
24739 ± 18% -36.9% 15618 ± 17% interrupts.PMI:Performance_monitoring_interrupts
96510 ± 3% -76.5% 22681 ± 7% interrupts.RES:Rescheduling_interrupts
36354 ± 11% +23.6% 44924 ± 16% sched_debug.cfs_rq:/.exec_clock.min
320.56 ± 3% -8.2% 294.19 sched_debug.cfs_rq:/.load_avg.avg
566.12 ± 8% -13.9% 487.33 ± 3% sched_debug.cfs_rq:/.load_avg.max
186.78 ± 10% -22.7% 144.45 ± 8% sched_debug.cfs_rq:/.load_avg.stddev
232654 +12.4% 261512 sched_debug.cfs_rq:/.min_vruntime.avg
132912 ± 7% +26.5% 168078 ± 14% sched_debug.cfs_rq:/.min_vruntime.min
1.69 ± 26% +116.0% 3.65 ± 16% sched_debug.cfs_rq:/.nr_spread_over.avg
5.88 ± 26% +70.2% 10.00 ± 28% sched_debug.cfs_rq:/.nr_spread_over.max
0.12 ±173% +433.3% 0.67 ± 39% sched_debug.cfs_rq:/.nr_spread_over.min
241.93 ± 4% -11.0% 215.36 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.avg
120048 ± 25% -66.6% 40077 ±103% sched_debug.cfs_rq:/.spread0.max
521.71 ± 6% +13.7% 593.17 sched_debug.cfs_rq:/.util_avg.min
0.65 ± 25% +95.2% 1.26 ± 12% sched_debug.cpu.clock.stddev
0.65 ± 25% +95.2% 1.26 ± 12% sched_debug.cpu.clock_task.stddev
607794 -19.4% 489990 ± 2% sched_debug.cpu.nr_switches.avg
1037607 ± 7% -21.4% 815490 ± 10% sched_debug.cpu.nr_switches.max
205920 ± 10% -23.2% 158092 ± 16% sched_debug.cpu.nr_switches.min
314902 ± 13% -23.4% 241089 ± 11% sched_debug.cpu.nr_switches.stddev
595725 -19.9% 477280 ± 2% sched_debug.cpu.sched_count.avg
1023898 ± 8% -21.7% 801724 ± 10% sched_debug.cpu.sched_count.max
195081 ± 12% -24.0% 148353 ± 18% sched_debug.cpu.sched_count.min
313331 ± 13% -23.6% 239325 ± 11% sched_debug.cpu.sched_count.stddev
293215 -20.7% 232421 ± 2% sched_debug.cpu.sched_goidle.avg
503615 ± 8% -22.0% 392723 ± 10% sched_debug.cpu.sched_goidle.max
95451 ± 12% -25.0% 71592 ± 19% sched_debug.cpu.sched_goidle.min
154512 ± 13% -23.9% 117560 ± 12% sched_debug.cpu.sched_goidle.stddev
297672 -19.9% 238580 ± 2% sched_debug.cpu.ttwu_count.avg
507445 ± 7% -21.7% 397386 ± 10% sched_debug.cpu.ttwu_count.max
103665 ± 7% -26.8% 75928 ± 20% sched_debug.cpu.ttwu_count.min
5979 ±115% +285.2% 23028 ± 56% sched_debug.cpu.ttwu_local.min
156086 ± 12% -23.2% 119837 ± 12% sched_debug.cpu.ttwu_local.stddev
2.647e+09 -51.6% 1.282e+09 perf-stat.i.branch-instructions
0.69 ± 2% +0.2 0.84 ± 2% perf-stat.i.branch-miss-rate%
6526139 -19.4% 5261406 perf-stat.i.branch-misses
10117481 ± 2% -46.1% 5456549 ± 2% perf-stat.i.cache-references
21184 -36.5% 13452 ± 4% perf-stat.i.context-switches
8.49e+09 -50.1% 4.239e+09 perf-stat.i.cpu-cycles
24.57 ± 2% +13.8% 27.97 ± 5% perf-stat.i.cpu-migrations
59536 ± 7% -49.1% 30319 ± 7% perf-stat.i.cycles-between-cache-misses
3870291 ± 9% -49.6% 1951431 ± 5% perf-stat.i.dTLB-load-misses
2.168e+09 -51.2% 1.059e+09 perf-stat.i.dTLB-loads
0.38 -0.0 0.38 perf-stat.i.dTLB-store-miss-rate%
2757551 -51.6% 1333439 perf-stat.i.dTLB-store-misses
1.094e+09 -51.0% 5.366e+08 perf-stat.i.dTLB-stores
72.64 -2.2 70.41 perf-stat.i.iTLB-load-miss-rate%
1313363 -44.6% 727435 ± 2% perf-stat.i.iTLB-load-misses
310347 ± 8% -21.6% 243185 ± 8% perf-stat.i.iTLB-loads
6.225e+09 -50.1% 3.103e+09 perf-stat.i.instructions
135864 ± 4% -53.6% 62988 ± 2% perf-stat.i.instructions-per-iTLB-miss
0.78 -2.1% 0.76 perf-stat.i.ipc
1.63 ± 2% +8.2% 1.76 ± 2% perf-stat.overall.MPKI
0.25 +0.2 0.41 perf-stat.overall.branch-miss-rate%
2.80 ± 11% +2.5 5.25 ± 11% perf-stat.overall.cache-miss-rate%
30373 ± 10% -50.7% 14984 ± 11% perf-stat.overall.cycles-between-cache-misses
80.91 -5.9 74.96 ± 2% perf-stat.overall.iTLB-load-miss-rate%
4739 -10.0% 4267 perf-stat.overall.instructions-per-iTLB-miss
903.69 +4.8% 947.23 perf-stat.overall.path-length
2.639e+09 -51.6% 1.277e+09 perf-stat.ps.branch-instructions
6507381 -19.4% 5245105 perf-stat.ps.branch-misses
10084181 ± 2% -46.1% 5438492 ± 2% perf-stat.ps.cache-references
21116 -36.5% 13408 ± 4% perf-stat.ps.context-switches
8.462e+09 -50.1% 4.225e+09 perf-stat.ps.cpu-cycles
24.49 ± 2% +13.8% 27.88 ± 5% perf-stat.ps.cpu-migrations
3857538 ± 9% -49.6% 1944940 ± 5% perf-stat.ps.dTLB-load-misses
2.161e+09 -51.2% 1.055e+09 perf-stat.ps.dTLB-loads
2748462 -51.6% 1328985 perf-stat.ps.dTLB-store-misses
1.091e+09 -51.0% 5.349e+08 perf-stat.ps.dTLB-stores
1309035 -44.6% 725011 ± 2% perf-stat.ps.iTLB-load-misses
309329 ± 8% -21.6% 242382 ± 8% perf-stat.ps.iTLB-loads
6.205e+09 -50.1% 3.093e+09 perf-stat.ps.instructions
1.895e+12 -50.1% 9.455e+11 perf-stat.total.instructions
97.93 -2.3 95.64 perf-profile.calltrace.cycles-pp.secondary_startup_64
1.90 ± 52% -1.3 0.63 ±128% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.printk.irq_work_run_list
1.85 ± 52% -1.2 0.61 ±128% perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock
1.85 ± 52% -1.2 0.61 ±129% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit
1.87 ± 52% -1.2 0.63 ±128% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.printk
0.52 ± 62% +0.7 1.19 ± 29% perf-profile.calltrace.cycles-pp.apic_timer_interrupt
97.90 -2.3 95.58 perf-profile.children.cycles-pp.cpuidle_enter
97.90 -2.3 95.58 perf-profile.children.cycles-pp.cpuidle_enter_state
97.93 -2.3 95.64 perf-profile.children.cycles-pp.secondary_startup_64
97.93 -2.3 95.64 perf-profile.children.cycles-pp.cpu_startup_entry
97.93 -2.3 95.64 perf-profile.children.cycles-pp.do_idle
0.01 ±173% +0.1 0.07 ± 34% perf-profile.children.cycles-pp.update_curr
0.06 ± 65% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.do_sys_open
0.06 ± 65% +0.1 0.12 ± 23% perf-profile.children.cycles-pp.do_sys_openat2
0.01 ±173% +0.1 0.09 ± 24% perf-profile.children.cycles-pp.native_write_msr
0.09 ± 20% +0.1 0.17 ± 17% perf-profile.children.cycles-pp.read
0.07 ± 58% +0.1 0.15 ± 14% perf-profile.children.cycles-pp.ksys_read
0.06 ± 60% +0.1 0.15 ± 16% perf-profile.children.cycles-pp.vfs_read
0.00 +0.1 0.11 ± 13% perf-profile.children.cycles-pp.interrupt_entry
0.10 ± 39% +0.1 0.23 ± 47% perf-profile.children.cycles-pp.handle_pte_fault
0.02 ±173% +0.1 0.15 ± 62% perf-profile.children.cycles-pp.__softirqentry_text_start
0.02 ±173% +0.1 0.17 ± 56% perf-profile.children.cycles-pp.irq_exit
0.15 ± 30% +0.2 0.33 ± 45% perf-profile.children.cycles-pp.fbcon_putcs
0.15 ± 30% +0.2 0.33 ± 45% perf-profile.children.cycles-pp.bit_putcs
0.13 ± 33% +0.2 0.31 ± 50% perf-profile.children.cycles-pp.cfb_imageblit
0.13 ± 33% +0.2 0.31 ± 50% perf-profile.children.cycles-pp.drm_fb_helper_cfb_imageblit
0.18 ± 29% +0.2 0.36 ± 40% perf-profile.children.cycles-pp.vt_console_print
0.17 ± 29% +0.2 0.36 ± 40% perf-profile.children.cycles-pp.lf
0.17 ± 29% +0.2 0.36 ± 40% perf-profile.children.cycles-pp.con_scroll
0.17 ± 29% +0.2 0.36 ± 40% perf-profile.children.cycles-pp.fbcon_scroll
0.17 ± 29% +0.2 0.36 ± 40% perf-profile.children.cycles-pp.fbcon_redraw
0.10 ± 36% +0.3 0.39 ± 67% perf-profile.children.cycles-pp.__handle_mm_fault
0.14 ± 36% +0.3 0.44 ± 58% perf-profile.children.cycles-pp.page_fault
0.10 ± 36% +0.3 0.40 ± 66% perf-profile.children.cycles-pp.handle_mm_fault
0.12 ± 29% +0.3 0.43 ± 58% perf-profile.children.cycles-pp.do_page_fault
0.61 ± 37% +0.5 1.07 ± 14% perf-profile.children.cycles-pp.do_syscall_64
0.61 ± 37% +0.5 1.08 ± 15% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +0.5 0.51 ± 21% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.06 ±101% +0.5 0.60 ± 32% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.12 ± 36% +0.6 0.72 ± 33% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.55 ± 44% +0.6 1.16 ± 34% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.58 ± 43% +0.7 1.26 ± 28% perf-profile.children.cycles-pp.apic_timer_interrupt
0.01 ±173% +0.1 0.08 ± 29% perf-profile.self.cycles-pp.native_write_msr
0.00 +0.1 0.11 ± 13% perf-profile.self.cycles-pp.interrupt_entry
0.13 ± 33% +0.2 0.31 ± 50% perf-profile.self.cycles-pp.cfb_imageblit
***************************************************************************************************
lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/1/debian-x86_64-20191114.cgz/300s/lkp-bdw-ex2/fstime/unixbench/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 100% 4:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 50% 2:4 dmesg.RIP:find_busiest_group
%stddev %change %stddev
\ | \
1445 ± 4% -56.4% 630.12 unixbench.score
2.749e+08 ± 4% -56.4% 1.198e+08 unixbench.workload
0.17 +0.0 0.20 mpstat.cpu.all.usr%
2495 ±136% +150.6% 6253 ± 88% proc-vmstat.numa_hint_faults
12938371 ±169% -99.1% 120518 ± 8% cpuidle.POLL.time
879918 ±150% -97.2% 24704 ± 4% cpuidle.POLL.usage
476955 ± 53% -74.4% 122050 ±147% numa-numastat.node3.local_node
500271 ± 50% -69.4% 153074 ±117% numa-numastat.node3.numa_hit
18344 ± 54% -73.5% 4868 ±117% numa-vmstat.node1.nr_active_anon
18384 ± 54% -75.7% 4476 ±122% numa-vmstat.node1.nr_anon_pages
18344 ± 54% -73.5% 4868 ±117% numa-vmstat.node1.nr_zone_active_anon
7008 ± 92% +402.1% 35190 ± 53% numa-vmstat.node3.nr_anon_pages
453.75 ± 8% -28.3% 325.25 ± 8% slabinfo.buffer_head.active_objs
453.75 ± 8% -28.3% 325.25 ± 8% slabinfo.buffer_head.num_objs
5091 ± 8% +16.6% 5936 ± 5% slabinfo.kmalloc-rcl-64.active_objs
5091 ± 8% +16.6% 5936 ± 5% slabinfo.kmalloc-rcl-64.num_objs
73409 ± 54% -73.5% 19481 ±117% numa-meminfo.node1.Active
73372 ± 54% -73.5% 19474 ±117% numa-meminfo.node1.Active(anon)
73531 ± 54% -75.6% 17905 ±122% numa-meminfo.node1.AnonPages
14527 ±147% +697.6% 115869 ± 58% numa-meminfo.node3.AnonHugePages
28022 ± 92% +402.2% 140720 ± 53% numa-meminfo.node3.AnonPages
14.21 ± 16% +100.8% 28.54 ± 7% sched_debug.cfs_rq:/.exec_clock.min
37067 ± 5% +32.4% 49069 ± 11% sched_debug.cfs_rq:/.min_vruntime.avg
17.55 ± 12% +22.9% 21.57 ± 7% sched_debug.cfs_rq:/.runnable_load_avg.avg
367.53 ± 7% +25.9% 462.58 ± 9% sched_debug.cfs_rq:/.runnable_load_avg.max
73.16 ± 9% +23.1% 90.05 ± 5% sched_debug.cfs_rq:/.runnable_load_avg.stddev
4.60 ± 5% +99.6% 9.18 ± 2% sched_debug.cpu.clock.stddev
4.60 ± 5% +99.6% 9.18 ± 2% sched_debug.cpu.clock_task.stddev
0.00 ± 2% +50.5% 0.00 ± 27% sched_debug.cpu.next_balance.stddev
2059 ± 11% -36.4% 1309 ± 22% sched_debug.cpu.nr_switches.min
2783 ± 6% -20.4% 2215 ± 11% sched_debug.cpu.ttwu_local.max
6.804e+08 ± 2% -22.5% 5.27e+08 ± 2% perf-stat.i.branch-instructions
195.34 -1.6% 192.27 perf-stat.i.cpu-migrations
1.006e+09 ± 4% -22.5% 7.793e+08 ± 2% perf-stat.i.dTLB-loads
3.301e+09 ± 3% -23.2% 2.535e+09 ± 2% perf-stat.i.instructions
0.26 ± 22% -36.0% 0.17 ± 25% perf-stat.i.ipc
37490 ± 9% +32.1% 49541 ± 20% perf-stat.i.node-stores
0.26 ± 24% -35.6% 0.17 ± 25% perf-stat.overall.ipc
5770 ± 3% +76.1% 10159 perf-stat.overall.path-length
6.788e+08 ± 2% -22.5% 5.26e+08 ± 2% perf-stat.ps.branch-instructions
194.95 -1.5% 191.98 perf-stat.ps.cpu-migrations
1.004e+09 ± 4% -22.5% 7.777e+08 ± 2% perf-stat.ps.dTLB-loads
3.293e+09 ± 3% -23.2% 2.53e+09 ± 2% perf-stat.ps.instructions
37424 ± 9% +32.2% 49474 ± 20% perf-stat.ps.node-stores
1.584e+12 ± 3% -23.1% 1.217e+12 ± 2% perf-stat.total.instructions
71256 ± 3% +13.5% 80849 ± 4% softirqs.CPU102.RCU
72774 ± 5% +12.3% 81732 ± 4% softirqs.CPU105.RCU
72835 ± 4% +11.6% 81311 ± 4% softirqs.CPU108.RCU
73527 ± 3% +9.8% 80755 ± 4% softirqs.CPU113.RCU
72325 ± 5% +16.2% 84015 ± 8% softirqs.CPU123.RCU
72159 ± 5% +11.5% 80464 ± 4% softirqs.CPU126.RCU
72621 ± 5% +11.1% 80660 ± 4% softirqs.CPU128.RCU
71614 ± 6% +14.0% 81626 ± 4% softirqs.CPU13.RCU
71902 ± 4% +13.0% 81264 ± 4% softirqs.CPU134.RCU
72274 ± 4% +12.3% 81129 ± 4% softirqs.CPU135.RCU
72700 ± 3% +12.0% 81434 ± 4% softirqs.CPU136.RCU
72390 ± 4% +11.5% 80729 ± 4% softirqs.CPU140.RCU
72409 ± 4% +12.2% 81219 ± 5% softirqs.CPU141.RCU
72835 ± 4% +11.2% 81013 ± 4% softirqs.CPU143.RCU
72743 ± 4% +11.6% 81155 ± 5% softirqs.CPU148.RCU
73655 ± 4% +11.2% 81874 ± 5% softirqs.CPU15.RCU
73231 ± 5% +13.3% 82967 softirqs.CPU156.RCU
72934 ± 5% +10.2% 80364 ± 4% softirqs.CPU161.RCU
72708 ± 4% +10.3% 80211 ± 4% softirqs.CPU162.RCU
72168 ± 4% +11.1% 80211 ± 4% softirqs.CPU163.RCU
72087 ± 4% +11.4% 80276 ± 4% softirqs.CPU164.RCU
72257 ± 4% +11.2% 80333 ± 4% softirqs.CPU167.RCU
71632 ± 4% +12.3% 80441 ± 4% softirqs.CPU168.RCU
72163 ± 4% +12.4% 81099 ± 5% softirqs.CPU169.RCU
72794 ± 4% +12.3% 81777 ± 5% softirqs.CPU17.RCU
71822 ± 4% +12.2% 80589 ± 4% softirqs.CPU171.RCU
69278 ± 9% +16.2% 80490 ± 5% softirqs.CPU174.RCU
71969 ± 4% +11.3% 80130 ± 5% softirqs.CPU175.RCU
72269 ± 4% +10.8% 80077 ± 4% softirqs.CPU181.RCU
73041 ± 3% +10.3% 80532 ± 4% softirqs.CPU184.RCU
72262 ± 4% +14.2% 82530 ± 7% softirqs.CPU186.RCU
72202 ± 3% +10.8% 79999 ± 4% softirqs.CPU188.RCU
73189 ± 3% +9.9% 80417 ± 4% softirqs.CPU189.RCU
72464 ± 4% +15.3% 83515 ± 6% softirqs.CPU24.RCU
73678 ± 7% +10.7% 81565 ± 4% softirqs.CPU31.RCU
73118 ± 4% +11.9% 81812 ± 4% softirqs.CPU32.RCU
73872 ± 5% +12.7% 83260 ± 4% softirqs.CPU4.RCU
73164 ± 4% +12.5% 82332 ± 4% softirqs.CPU40.RCU
73858 ± 4% +10.5% 81603 ± 4% softirqs.CPU42.RCU
73229 ± 4% +11.9% 81978 ± 4% softirqs.CPU44.RCU
73597 ± 5% +13.0% 83155 ± 3% softirqs.CPU47.RCU
73284 ± 4% +12.1% 82124 ± 4% softirqs.CPU48.RCU
73168 ± 3% +12.2% 82108 ± 4% softirqs.CPU6.RCU
72938 ± 4% +11.3% 81164 ± 4% softirqs.CPU68.RCU
73553 ± 4% +13.0% 83098 ± 5% softirqs.CPU7.RCU
72976 ± 4% +11.1% 81057 ± 4% softirqs.CPU71.RCU
73230 ± 4% +12.2% 82174 ± 5% softirqs.CPU72.RCU
73182 ± 4% +16.0% 84872 ± 4% softirqs.CPU74.RCU
72627 ± 4% +11.8% 81180 ± 4% softirqs.CPU75.RCU
72491 ± 4% +15.7% 83893 ± 9% softirqs.CPU76.RCU
72600 ± 4% +12.5% 81707 ± 4% softirqs.CPU77.RCU
72595 ± 4% +15.2% 83616 ± 7% softirqs.CPU78.RCU
72625 ± 4% +11.7% 81128 ± 4% softirqs.CPU83.RCU
73515 ± 4% +11.0% 81610 ± 4% softirqs.CPU85.RCU
73524 ± 3% +11.0% 81621 ± 4% softirqs.CPU91.RCU
72870 ± 4% +11.2% 81049 ± 4% softirqs.CPU92.RCU
38802 ± 33% -33.8% 25684 ± 4% softirqs.CPU95.SCHED
73789 ± 6% +9.7% 80914 ± 4% softirqs.CPU98.RCU
73217 ± 4% +10.5% 80907 ± 4% softirqs.CPU99.RCU
5.46 ± 18% -3.3 2.17 ± 34% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
5.38 ± 18% -3.2 2.13 ± 34% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.78 ± 18% -1.2 0.59 ± 67% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.66 ± 18% -1.1 0.52 ± 64% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.34 ± 19% -0.9 0.47 ± 63% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.26 ± 3% +0.3 1.52 ± 9% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.74 ± 18% +0.3 1.05 ± 20% perf-profile.calltrace.cycles-pp.rcu_sched_clock_irq.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.27 ±100% +0.4 0.62 ± 8% perf-profile.calltrace.cycles-pp.enqueue_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.34 ±106% +0.5 0.84 ± 12% perf-profile.calltrace.cycles-pp.tick_check_oneshot_broadcast_this_cpu.tick_irq_enter.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt
2.78 ± 7% +0.7 3.52 ± 10% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
3.81 ± 4% +0.8 4.58 ± 7% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
3.10 ± 9% +0.8 3.91 ± 9% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
6.77 ± 5% +1.0 7.80 ± 7% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
90.95 +4.5 95.47 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
91.04 +4.6 95.59 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
91.04 +4.6 95.59 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
91.47 +4.6 96.07 perf-profile.calltrace.cycles-pp.secondary_startup_64
78.61 ± 3% +5.7 84.33 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
5.83 ± 17% -3.4 2.44 ± 32% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
5.75 ± 18% -3.4 2.40 ± 32% perf-profile.children.cycles-pp.do_syscall_64
1.82 ± 19% -1.1 0.71 ± 36% perf-profile.children.cycles-pp.ksys_write
1.70 ± 19% -1.1 0.64 ± 32% perf-profile.children.cycles-pp.vfs_write
1.41 ± 20% -0.9 0.54 ± 36% perf-profile.children.cycles-pp.new_sync_write
1.35 ± 20% -0.8 0.51 ± 36% perf-profile.children.cycles-pp.generic_file_write_iter
1.43 ± 18% -0.8 0.61 ± 38% perf-profile.children.cycles-pp.ksys_read
1.29 ± 20% -0.7 0.54 ± 36% perf-profile.children.cycles-pp.vfs_read
1.14 ± 20% -0.7 0.43 ± 36% perf-profile.children.cycles-pp.__generic_file_write_iter
0.92 ± 20% -0.6 0.36 ± 33% perf-profile.children.cycles-pp.generic_perform_write
0.90 ± 19% -0.5 0.36 ± 39% perf-profile.children.cycles-pp.new_sync_read
0.84 ± 19% -0.5 0.33 ± 37% perf-profile.children.cycles-pp.generic_file_read_iter
0.76 ± 16% -0.5 0.31 ± 37% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.74 ± 14% -0.4 0.30 ± 41% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.49 ± 12% -0.3 0.23 ± 17% perf-profile.children.cycles-pp.serial8250_console_write
0.48 ± 12% -0.3 0.22 ± 15% perf-profile.children.cycles-pp.uart_console_write
0.47 ± 11% -0.2 0.22 ± 17% perf-profile.children.cycles-pp.wait_for_xmitr
0.51 ± 12% -0.2 0.26 ± 13% perf-profile.children.cycles-pp.console_unlock
0.46 ± 11% -0.2 0.21 ± 17% perf-profile.children.cycles-pp.serial8250_console_putchar
0.41 ± 27% -0.2 0.17 ± 33% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.55 ± 9% -0.2 0.32 ± 11% perf-profile.children.cycles-pp.irq_work_run_list
0.38 ± 18% -0.2 0.16 ± 39% perf-profile.children.cycles-pp.pagecache_get_page
0.33 ± 21% -0.2 0.11 ± 31% perf-profile.children.cycles-pp.security_file_permission
0.36 ± 27% -0.2 0.15 ± 38% perf-profile.children.cycles-pp.copy_page_to_iter
0.42 ± 5% -0.2 0.22 ± 8% perf-profile.children.cycles-pp.irq_work_run
0.42 ± 5% -0.2 0.22 ± 8% perf-profile.children.cycles-pp.printk
0.42 ± 5% -0.2 0.22 ± 8% perf-profile.children.cycles-pp.vprintk_emit
0.42 ± 5% -0.2 0.23 ± 9% perf-profile.children.cycles-pp.irq_work_interrupt
0.42 ± 5% -0.2 0.23 ± 9% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.35 ± 26% -0.2 0.16 ± 20% perf-profile.children.cycles-pp.io_serial_in
0.26 ± 26% -0.2 0.08 ± 31% perf-profile.children.cycles-pp.common_file_perm
0.26 ± 16% -0.2 0.09 ± 28% perf-profile.children.cycles-pp.simple_write_end
0.28 ± 20% -0.2 0.12 ± 41% perf-profile.children.cycles-pp.find_get_entry
0.25 ± 28% -0.1 0.10 ± 31% perf-profile.children.cycles-pp.copyout
0.24 ± 16% -0.1 0.10 ± 36% perf-profile.children.cycles-pp.simple_write_begin
0.21 ± 19% -0.1 0.09 ± 29% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.20 ± 20% -0.1 0.07 ± 62% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
0.33 ± 7% -0.1 0.21 ± 18% perf-profile.children.cycles-pp.ret_from_fork
0.33 ± 7% -0.1 0.21 ± 18% perf-profile.children.cycles-pp.kthread
0.24 ± 19% -0.1 0.13 ± 26% perf-profile.children.cycles-pp.worker_thread
0.24 ± 18% -0.1 0.13 ± 26% perf-profile.children.cycles-pp.process_one_work
0.23 ± 19% -0.1 0.13 ± 26% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work
0.17 ± 20% -0.1 0.06 ± 64% perf-profile.children.cycles-pp.copyin
0.23 ± 19% -0.1 0.13 ± 28% perf-profile.children.cycles-pp.memcpy_erms
0.14 ± 18% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.xas_load
0.12 ± 30% -0.1 0.04 ±107% perf-profile.children.cycles-pp.___might_sleep
0.12 ± 17% -0.1 0.06 ± 58% perf-profile.children.cycles-pp.delay_tsc
0.10 ± 12% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.14 ± 21% +0.0 0.18 ± 6% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.07 ± 60% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.cpuidle_not_available
0.06 ± 63% +0.1 0.11 ± 3% perf-profile.children.cycles-pp.sched_clock_idle_wakeup_event
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.invoke_rcu_core
0.23 ± 10% +0.1 0.30 ± 8% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.15 ± 31% +0.1 0.21 ± 5% perf-profile.children.cycles-pp.rb_insert_color
0.19 ± 29% +0.1 0.30 ± 14% perf-profile.children.cycles-pp.run_local_timers
0.45 ± 10% +0.1 0.57 ± 9% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.38 ± 26% +0.2 0.56 ± 7% perf-profile.children.cycles-pp.timerqueue_add
1.31 ± 5% +0.3 1.56 ± 10% perf-profile.children.cycles-pp.scheduler_tick
0.57 ± 33% +0.3 0.86 ± 12% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.78 ± 17% +0.3 1.08 ± 20% perf-profile.children.cycles-pp.rcu_sched_clock_irq
2.93 ± 9% +0.7 3.59 ± 10% perf-profile.children.cycles-pp.update_process_times
3.95 ± 7% +0.7 4.64 ± 7% perf-profile.children.cycles-pp.tick_sched_timer
3.23 ± 10% +0.7 3.97 ± 8% perf-profile.children.cycles-pp.tick_sched_handle
6.95 ± 6% +1.0 7.91 ± 7% perf-profile.children.cycles-pp.__hrtimer_run_queues
91.04 +4.6 95.59 perf-profile.children.cycles-pp.start_secondary
91.52 +4.6 96.10 perf-profile.children.cycles-pp.do_idle
91.47 +4.6 96.07 perf-profile.children.cycles-pp.secondary_startup_64
91.47 +4.6 96.07 perf-profile.children.cycles-pp.cpu_startup_entry
2.13 ± 18% -1.3 0.83 ± 30% perf-profile.self.cycles-pp.do_syscall_64
0.75 ± 16% -0.4 0.31 ± 37% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.73 ± 15% -0.4 0.30 ± 41% perf-profile.self.cycles-pp.entry_SYSCALL_64
0.73 ± 33% -0.3 0.41 ± 10% perf-profile.self.cycles-pp.tick_nohz_next_event
0.40 ± 28% -0.2 0.17 ± 31% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.31 ± 8% -0.2 0.15 ± 15% perf-profile.self.cycles-pp.io_serial_in
0.23 ± 19% -0.1 0.11 ± 14% perf-profile.self.cycles-pp.memcpy_erms
0.18 ± 15% -0.1 0.06 ± 60% perf-profile.self.cycles-pp.generic_file_read_iter
0.19 ± 26% -0.1 0.07 ± 30% perf-profile.self.cycles-pp.common_file_perm
0.14 ± 22% -0.1 0.06 ± 63% perf-profile.self.cycles-pp.find_get_entry
0.13 ± 9% -0.1 0.06 ± 74% perf-profile.self.cycles-pp.__fget_light
0.10 ± 28% -0.1 0.03 ±105% perf-profile.self.cycles-pp.___might_sleep
0.12 ± 17% -0.1 0.06 ± 58% perf-profile.self.cycles-pp.delay_tsc
0.12 ± 12% +0.0 0.15 ± 4% perf-profile.self.cycles-pp.irq_exit
0.12 ± 11% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.tick_nohz_tick_stopped
0.21 ± 11% +0.0 0.26 ± 13% perf-profile.self.cycles-pp.update_rq_clock
0.07 ± 62% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.cpuidle_not_available
0.15 ± 29% +0.1 0.20 ± 4% perf-profile.self.cycles-pp.rb_insert_color
0.04 ±100% +0.1 0.10 ± 4% perf-profile.self.cycles-pp.sched_clock_idle_wakeup_event
0.22 ± 16% +0.1 0.29 ± 3% perf-profile.self.cycles-pp.native_apic_mem_write
0.15 ± 34% +0.1 0.22 ± 15% perf-profile.self.cycles-pp.run_local_timers
0.55 ± 6% +0.1 0.64 ± 11% perf-profile.self.cycles-pp.do_idle
0.23 ± 26% +0.1 0.35 ± 11% perf-profile.self.cycles-pp.timerqueue_add
0.57 ± 34% +0.3 0.86 ± 12% perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu
237.75 ± 2% +12.6% 267.75 ± 11% interrupts.75:PCI-MSI.1572888-edge.eth0-TxRx-24
155594 -70.7% 45567 ±139% interrupts.CAL:Function_call_interrupts
418.75 -68.5% 132.00 ±124% interrupts.CPU0.CAL:Function_call_interrupts
808.25 -71.6% 229.25 ±145% interrupts.CPU1.CAL:Function_call_interrupts
809.00 -63.9% 292.00 ±106% interrupts.CPU100.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU101.CAL:Function_call_interrupts
808.50 -71.1% 233.50 ±141% interrupts.CPU102.CAL:Function_call_interrupts
868.25 ± 11% -73.1% 233.50 ±141% interrupts.CPU103.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU104.CAL:Function_call_interrupts
155.00 ± 28% +57.7% 244.50 ± 21% interrupts.CPU104.NMI:Non-maskable_interrupts
155.00 ± 28% +57.7% 244.50 ± 21% interrupts.CPU104.PMI:Performance_monitoring_interrupts
808.50 -71.5% 230.25 ±144% interrupts.CPU105.CAL:Function_call_interrupts
809.50 -70.8% 236.25 ±140% interrupts.CPU106.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU107.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU108.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU109.CAL:Function_call_interrupts
12.00 ± 61% +1785.4% 226.25 ± 76% interrupts.CPU109.RES:Rescheduling_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU11.CAL:Function_call_interrupts
809.00 -71.2% 233.25 ±142% interrupts.CPU110.CAL:Function_call_interrupts
153.00 ± 28% +64.1% 251.00 ± 20% interrupts.CPU110.NMI:Non-maskable_interrupts
153.00 ± 28% +64.1% 251.00 ± 20% interrupts.CPU110.PMI:Performance_monitoring_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU111.CAL:Function_call_interrupts
6.50 ± 59% +1669.2% 115.00 ± 96% interrupts.CPU111.RES:Rescheduling_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU112.CAL:Function_call_interrupts
7.50 ± 65% +986.7% 81.50 ±114% interrupts.CPU112.RES:Rescheduling_interrupts
809.00 -71.2% 232.75 ±142% interrupts.CPU113.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU114.CAL:Function_call_interrupts
154.75 ± 27% +61.6% 250.00 ± 20% interrupts.CPU114.NMI:Non-maskable_interrupts
154.75 ± 27% +61.6% 250.00 ± 20% interrupts.CPU114.PMI:Performance_monitoring_interrupts
808.25 -71.1% 233.75 ±141% interrupts.CPU115.CAL:Function_call_interrupts
138.75 ± 38% +83.8% 255.00 ± 23% interrupts.CPU115.NMI:Non-maskable_interrupts
138.75 ± 38% +83.8% 255.00 ± 23% interrupts.CPU115.PMI:Performance_monitoring_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU116.CAL:Function_call_interrupts
135.75 ± 40% +85.1% 251.25 ± 22% interrupts.CPU116.NMI:Non-maskable_interrupts
135.75 ± 40% +85.1% 251.25 ± 22% interrupts.CPU116.PMI:Performance_monitoring_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU117.CAL:Function_call_interrupts
137.50 ± 40% +313.1% 568.00 ± 90% interrupts.CPU117.NMI:Non-maskable_interrupts
137.50 ± 40% +313.1% 568.00 ± 90% interrupts.CPU117.PMI:Performance_monitoring_interrupts
809.00 -71.1% 234.00 ±141% interrupts.CPU118.CAL:Function_call_interrupts
12.00 ± 63% +333.3% 52.00 ±101% interrupts.CPU118.RES:Rescheduling_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU119.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU12.CAL:Function_call_interrupts
809.00 -71.2% 233.00 ±142% interrupts.CPU120.CAL:Function_call_interrupts
142.25 ± 40% +72.6% 245.50 ± 16% interrupts.CPU120.NMI:Non-maskable_interrupts
142.25 ± 40% +72.6% 245.50 ± 16% interrupts.CPU120.PMI:Performance_monitoring_interrupts
809.00 -71.2% 233.25 ±142% interrupts.CPU121.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU122.CAL:Function_call_interrupts
135.25 ± 41% +77.8% 240.50 ± 18% interrupts.CPU122.NMI:Non-maskable_interrupts
135.25 ± 41% +77.8% 240.50 ± 18% interrupts.CPU122.PMI:Performance_monitoring_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU123.CAL:Function_call_interrupts
133.50 ± 42% +79.2% 239.25 ± 16% interrupts.CPU123.NMI:Non-maskable_interrupts
133.50 ± 42% +79.2% 239.25 ± 16% interrupts.CPU123.PMI:Performance_monitoring_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU124.CAL:Function_call_interrupts
809.50 -71.2% 233.50 ±141% interrupts.CPU125.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU126.CAL:Function_call_interrupts
808.50 -71.1% 233.50 ±141% interrupts.CPU127.CAL:Function_call_interrupts
810.00 -71.1% 233.75 ±141% interrupts.CPU128.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU129.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU13.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU130.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU131.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU133.CAL:Function_call_interrupts
808.50 -71.1% 233.50 ±141% interrupts.CPU134.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU135.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU136.CAL:Function_call_interrupts
811.25 -71.2% 233.50 ±141% interrupts.CPU137.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU138.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU139.CAL:Function_call_interrupts
867.00 ± 11% -73.2% 232.25 ±142% interrupts.CPU14.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU140.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU141.CAL:Function_call_interrupts
809.25 -71.2% 233.00 ±142% interrupts.CPU142.CAL:Function_call_interrupts
809.25 -71.1% 233.50 ±141% interrupts.CPU143.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU144.CAL:Function_call_interrupts
808.50 -71.1% 233.75 ±141% interrupts.CPU145.CAL:Function_call_interrupts
809.25 -70.4% 239.50 ±136% interrupts.CPU146.CAL:Function_call_interrupts
809.00 -70.4% 239.25 ±137% interrupts.CPU147.CAL:Function_call_interrupts
809.25 -70.4% 239.50 ±137% interrupts.CPU148.CAL:Function_call_interrupts
809.25 -70.4% 239.25 ±137% interrupts.CPU149.CAL:Function_call_interrupts
808.00 -71.2% 233.00 ±142% interrupts.CPU15.CAL:Function_call_interrupts
820.75 -70.1% 245.00 ±137% interrupts.CPU155.CAL:Function_call_interrupts
823.75 -70.3% 245.00 ±137% interrupts.CPU156.CAL:Function_call_interrupts
832.25 -70.6% 245.00 ±137% interrupts.CPU157.CAL:Function_call_interrupts
832.00 -70.6% 245.00 ±137% interrupts.CPU158.CAL:Function_call_interrupts
832.75 -70.6% 245.00 ±137% interrupts.CPU159.CAL:Function_call_interrupts
805.00 -71.1% 232.25 ±142% interrupts.CPU16.CAL:Function_call_interrupts
832.25 -70.6% 245.00 ±137% interrupts.CPU160.CAL:Function_call_interrupts
832.50 -70.6% 245.00 ±137% interrupts.CPU161.CAL:Function_call_interrupts
832.75 -70.6% 244.50 ±138% interrupts.CPU162.CAL:Function_call_interrupts
833.50 -70.6% 245.25 ±137% interrupts.CPU163.CAL:Function_call_interrupts
832.50 -70.6% 245.00 ±137% interrupts.CPU164.CAL:Function_call_interrupts
832.50 -70.6% 244.75 ±138% interrupts.CPU165.CAL:Function_call_interrupts
832.25 -70.5% 245.50 ±137% interrupts.CPU166.CAL:Function_call_interrupts
832.25 -70.1% 249.00 ±134% interrupts.CPU167.CAL:Function_call_interrupts
832.50 -69.3% 255.50 ±129% interrupts.CPU168.CAL:Function_call_interrupts
543.50 ± 30% -70.6% 159.75 ±103% interrupts.CPU169.CAL:Function_call_interrupts
810.00 -71.3% 232.75 ±142% interrupts.CPU17.CAL:Function_call_interrupts
832.25 -69.1% 256.75 ±128% interrupts.CPU170.CAL:Function_call_interrupts
832.25 -69.2% 256.50 ±129% interrupts.CPU171.CAL:Function_call_interrupts
832.25 -69.2% 256.50 ±129% interrupts.CPU172.CAL:Function_call_interrupts
832.25 -69.2% 256.50 ±129% interrupts.CPU173.CAL:Function_call_interrupts
832.75 -69.2% 256.50 ±129% interrupts.CPU174.CAL:Function_call_interrupts
832.50 -69.2% 256.50 ±129% interrupts.CPU175.CAL:Function_call_interrupts
224.50 ±111% -92.1% 17.75 ±127% interrupts.CPU175.RES:Rescheduling_interrupts
833.00 -69.2% 256.50 ±129% interrupts.CPU176.CAL:Function_call_interrupts
832.00 -69.2% 256.50 ±129% interrupts.CPU177.CAL:Function_call_interrupts
832.75 -69.2% 256.50 ±129% interrupts.CPU178.CAL:Function_call_interrupts
833.00 -69.2% 256.50 ±129% interrupts.CPU179.CAL:Function_call_interrupts
808.00 -63.9% 291.50 ±106% interrupts.CPU18.CAL:Function_call_interrupts
833.00 -69.2% 256.50 ±129% interrupts.CPU180.CAL:Function_call_interrupts
833.00 -69.2% 256.50 ±129% interrupts.CPU181.CAL:Function_call_interrupts
833.00 -69.2% 256.50 ±129% interrupts.CPU182.CAL:Function_call_interrupts
832.50 -69.2% 256.50 ±129% interrupts.CPU183.CAL:Function_call_interrupts
834.25 -69.3% 256.50 ±129% interrupts.CPU184.CAL:Function_call_interrupts
833.75 -69.2% 256.75 ±128% interrupts.CPU186.CAL:Function_call_interrupts
834.00 -69.2% 256.75 ±129% interrupts.CPU187.CAL:Function_call_interrupts
833.75 -69.2% 257.00 ±129% interrupts.CPU188.CAL:Function_call_interrupts
834.00 -69.1% 257.50 ±129% interrupts.CPU189.CAL:Function_call_interrupts
807.75 -71.2% 232.50 ±142% interrupts.CPU19.CAL:Function_call_interrupts
834.00 -69.1% 257.75 ±128% interrupts.CPU190.CAL:Function_call_interrupts
828.50 -69.4% 253.25 ±130% interrupts.CPU191.CAL:Function_call_interrupts
808.00 -71.6% 229.75 ±144% interrupts.CPU2.CAL:Function_call_interrupts
807.75 -71.2% 232.75 ±142% interrupts.CPU20.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU21.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU22.CAL:Function_call_interrupts
808.00 -71.3% 232.00 ±142% interrupts.CPU23.CAL:Function_call_interrupts
237.75 ± 2% +12.6% 267.75 ± 11% interrupts.CPU24.75:PCI-MSI.1572888-edge.eth0-TxRx-24
808.00 -71.2% 232.50 ±142% interrupts.CPU24.CAL:Function_call_interrupts
808.25 -71.2% 232.50 ±142% interrupts.CPU25.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU26.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU27.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU28.CAL:Function_call_interrupts
808.00 -71.2% 232.50 ±142% interrupts.CPU29.CAL:Function_call_interrupts
2938 ±171% -99.5% 13.75 ± 85% interrupts.CPU29.RES:Rescheduling_interrupts
808.00 -71.2% 232.75 ±142% interrupts.CPU3.CAL:Function_call_interrupts
6192 ±147% -99.3% 43.25 ± 67% interrupts.CPU3.RES:Rescheduling_interrupts
808.00 -71.2% 232.75 ±142% interrupts.CPU30.CAL:Function_call_interrupts
810.00 -71.3% 232.75 ±142% interrupts.CPU31.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU32.CAL:Function_call_interrupts
925.50 ± 12% -74.8% 233.50 ±141% interrupts.CPU33.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU34.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU35.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU36.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU37.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU38.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU39.CAL:Function_call_interrupts
805.00 -71.1% 232.50 ±142% interrupts.CPU4.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU40.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU41.CAL:Function_call_interrupts
807.75 -71.1% 233.50 ±141% interrupts.CPU42.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU43.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU44.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU45.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU46.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU47.CAL:Function_call_interrupts
808.00 -71.2% 232.75 ±142% interrupts.CPU48.CAL:Function_call_interrupts
808.00 -71.1% 233.75 ±141% interrupts.CPU49.CAL:Function_call_interrupts
807.75 -71.2% 232.50 ±142% interrupts.CPU5.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU50.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU51.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU52.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU53.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU54.CAL:Function_call_interrupts
808.25 -71.1% 233.50 ±141% interrupts.CPU55.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU56.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU57.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU58.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU59.CAL:Function_call_interrupts
806.25 -71.2% 232.50 ±142% interrupts.CPU6.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU60.CAL:Function_call_interrupts
808.00 -71.1% 233.75 ±141% interrupts.CPU61.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU62.CAL:Function_call_interrupts
808.00 -71.1% 233.75 ±141% interrupts.CPU63.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU64.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU65.CAL:Function_call_interrupts
807.50 -71.1% 233.25 ±142% interrupts.CPU66.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU67.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU68.CAL:Function_call_interrupts
808.00 -71.1% 233.25 ±142% interrupts.CPU69.CAL:Function_call_interrupts
806.50 -71.2% 232.50 ±142% interrupts.CPU7.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU70.CAL:Function_call_interrupts
808.00 -71.1% 233.50 ±141% interrupts.CPU71.CAL:Function_call_interrupts
808.25 -71.1% 233.50 ±141% interrupts.CPU72.CAL:Function_call_interrupts
808.50 -71.1% 233.50 ±141% interrupts.CPU74.CAL:Function_call_interrupts
808.25 -71.1% 233.50 ±141% interrupts.CPU75.CAL:Function_call_interrupts
808.75 -70.9% 235.50 ±140% interrupts.CPU76.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU77.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU78.CAL:Function_call_interrupts
808.50 -71.1% 233.50 ±141% interrupts.CPU79.CAL:Function_call_interrupts
807.75 -71.2% 232.50 ±142% interrupts.CPU8.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU80.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU81.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU82.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU83.CAL:Function_call_interrupts
809.00 -71.1% 233.75 ±141% interrupts.CPU84.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU85.CAL:Function_call_interrupts
809.00 -70.9% 235.50 ±140% interrupts.CPU86.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU87.CAL:Function_call_interrupts
808.75 -71.1% 233.50 ±141% interrupts.CPU88.CAL:Function_call_interrupts
809.00 -70.9% 235.25 ±140% interrupts.CPU89.CAL:Function_call_interrupts
808.00 -71.0% 234.50 ±140% interrupts.CPU9.CAL:Function_call_interrupts
809.00 -71.1% 234.00 ±141% interrupts.CPU90.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU92.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU93.CAL:Function_call_interrupts
809.00 -71.1% 233.50 ±141% interrupts.CPU94.CAL:Function_call_interrupts
811.00 -71.2% 233.25 ±142% interrupts.CPU95.CAL:Function_call_interrupts
809.25 -71.1% 233.75 ±141% interrupts.CPU96.CAL:Function_call_interrupts
809.00 -71.4% 231.00 ±140% interrupts.CPU97.CAL:Function_call_interrupts
809.00 -71.2% 233.25 ±142% interrupts.CPU98.CAL:Function_call_interrupts
***************************************************************************************************
lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-20191114.cgz/lkp-bdw-ex2/pread3/will-it-scale/0xb000038
commit:
da26170b95 ("ACPI: Convert to new X86 CPU match macros")
06c4d00466 ("cpufreq: Convert to new X86 CPU match macros")
da26170b95feab87 06c4d00466eb374841bc84c39af
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.RIP:_raw_spin_unlock_irqrestore
:4 100% 4:4 dmesg.RIP:cpuidle_enter_state
:4 50% 2:4 dmesg.RIP:find_busiest_group
:4 25% 1:4 dmesg.RIP:idle_cpu
:4 25% 1:4 dmesg.WARNING:at_ip__fsnotify_parent/0x
%stddev %change %stddev
\ | \
873611 ± 2% -56.6% 379265 will-it-scale.per_process_ops
837152 -56.6% 363605 will-it-scale.per_thread_ops
315.75 +2.3% 323.03 will-it-scale.time.elapsed_time
315.75 +2.3% 323.03 will-it-scale.time.elapsed_time.max
19202 +1.9% 19575 will-it-scale.time.involuntary_context_switches
3468 +1.4% 3517 will-it-scale.time.percent_of_cpu_this_job_got
5168 +6.9% 5523 will-it-scale.time.user_time
6.925e+08 -56.3% 3.028e+08 will-it-scale.workload
26.54 +16.3% 30.87 ± 12% boot-time.dhcp
270525 ±142% -96.7% 9017 ± 23% cpuidle.POLL.usage
64251 ± 8% -18.1% 52616 meminfo.Shmem
9631 ± 37% -35.5% 6216 ± 16% numa-meminfo.node0.Mapped
42482 ± 20% -40.7% 25186 ± 11% numa-meminfo.node3.Shmem
2424 ± 36% -35.9% 1554 ± 16% numa-vmstat.node0.nr_mapped
10611 ± 20% -40.8% 6286 ± 12% numa-vmstat.node3.nr_shmem
63853 ±115% +136.8% 151192 ± 94% sched_debug.cfs_rq:/.runnable_weight.max
1307278 ± 8% -35.3% 846161 ± 21% sched_debug.cfs_rq:/.spread0.avg
-2142185 +15.1% -2465630 sched_debug.cfs_rq:/.spread0.min
250.38 ± 5% +12.9% 282.77 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.stddev
114087 ± 31% +175.4% 314198 ± 17% sched_debug.cpu.avg_idle.min
8.23 ± 8% +134.3% 19.27 ± 7% sched_debug.cpu.clock.stddev
8.23 ± 8% +134.3% 19.27 ± 7% sched_debug.cpu.clock_task.stddev
1824 ± 7% -41.4% 1068 ± 13% sched_debug.cpu.nr_switches.min
156.58 ± 3% +14.9% 179.88 ± 7% sched_debug.cpu.nr_uninterruptible.max
8030 ± 4% +11.3% 8940 ± 3% slabinfo.Acpi-State.active_objs
8030 ± 4% +11.3% 8940 ± 3% slabinfo.Acpi-State.num_objs
1086 ± 6% +11.8% 1214 ± 2% slabinfo.kmem_cache_node.active_objs
1455 ± 5% -11.2% 1292 ± 2% slabinfo.skbuff_ext_cache.active_objs
1455 ± 5% -11.2% 1292 ± 2% slabinfo.skbuff_ext_cache.num_objs
664.25 ± 5% +44.9% 962.50 ± 11% slabinfo.skbuff_fclone_cache.active_objs
664.25 ± 5% +44.9% 962.50 ± 11% slabinfo.skbuff_fclone_cache.num_objs
1075 ± 10% -21.5% 844.25 ± 18% slabinfo.task_group.active_objs
1075 ± 10% -21.5% 844.25 ± 18% slabinfo.task_group.num_objs
88339 -3.5% 85206 proc-vmstat.nr_active_anon
99.25 ± 2% -9.8% 89.50 ± 11% proc-vmstat.nr_anon_transparent_hugepages
7680 -1.4% 7574 proc-vmstat.nr_inactive_anon
8852 -1.9% 8686 proc-vmstat.nr_mapped
16055 ± 8% -18.1% 13149 proc-vmstat.nr_shmem
88339 -3.5% 85206 proc-vmstat.nr_zone_active_anon
7680 -1.4% 7574 proc-vmstat.nr_zone_inactive_anon
1309566 +2.5% 1341707 proc-vmstat.numa_hit
1216331 +2.6% 1248497 proc-vmstat.numa_local
267010 ± 4% +20.9% 322935 ± 7% proc-vmstat.numa_pte_updates
12046 ± 16% -32.2% 8164 proc-vmstat.pgactivate
1405309 +1.8% 1430314 proc-vmstat.pgfault
5.30 ± 26% +71.0% 9.06 perf-stat.i.MPKI
1.625e+10 -55.6% 7.211e+09 perf-stat.i.branch-instructions
1.60 ± 6% +0.6 2.18 perf-stat.i.branch-miss-rate%
1.651e+08 -47.4% 86873852 perf-stat.i.branch-misses
2.26 ± 4% +20.4% 2.72 perf-stat.i.cpi
1.81e+11 -51.7% 8.745e+10 perf-stat.i.cpu-cycles
200.87 -2.3% 196.31 perf-stat.i.cpu-migrations
115780 ± 18% -50.4% 57378 ± 10% perf-stat.i.cycles-between-cache-misses
0.19 ± 7% +0.0 0.23 perf-stat.i.dTLB-load-miss-rate%
50659921 -53.8% 23428189 perf-stat.i.dTLB-load-misses
3.197e+10 -56.1% 1.405e+10 perf-stat.i.dTLB-loads
49340777 -55.7% 21880469 perf-stat.i.dTLB-store-misses
2.418e+10 -55.5% 1.077e+10 perf-stat.i.dTLB-stores
89.92 ± 3% -2.9 86.98 perf-stat.i.iTLB-load-miss-rate%
80847212 -55.7% 35813879 perf-stat.i.iTLB-load-misses
4729880 ± 8% -25.0% 3549498 perf-stat.i.iTLB-loads
8.441e+10 -55.6% 3.744e+10 perf-stat.i.instructions
0.48 ± 2% -12.7% 0.41 perf-stat.i.ipc
1.17 ± 7% +104.2% 2.38 ± 10% perf-stat.overall.MPKI
1.01 +0.2 1.20 perf-stat.overall.branch-miss-rate%
2.14 +9.2% 2.34 perf-stat.overall.cpi
0.16 +0.0 0.17 perf-stat.overall.dTLB-load-miss-rate%
94.47 -3.4 91.03 perf-stat.overall.iTLB-load-miss-rate%
0.47 -8.5% 0.43 perf-stat.overall.ipc
38578 +4.9% 40486 perf-stat.overall.path-length
1.626e+10 -55.2% 7.291e+09 perf-stat.ps.branch-instructions
1.651e+08 -47.2% 87150525 perf-stat.ps.branch-misses
1.807e+11 -51.0% 8.848e+10 perf-stat.ps.cpu-cycles
200.31 -2.5% 195.35 perf-stat.ps.cpu-migrations
50687770 -53.4% 23631466 perf-stat.ps.dTLB-load-misses
3.2e+10 -55.6% 1.421e+10 perf-stat.ps.dTLB-loads
49379002 -55.2% 22117282 perf-stat.ps.dTLB-store-misses
2.42e+10 -55.0% 1.088e+10 perf-stat.ps.dTLB-stores
80975693 -55.4% 36144876 perf-stat.ps.iTLB-load-misses
4739796 ± 8% -24.8% 3562875 perf-stat.ps.iTLB-loads
8.447e+10 -55.2% 3.786e+10 perf-stat.ps.instructions
2.672e+13 -54.1% 1.226e+13 perf-stat.total.instructions
103313 ± 5% +8.2% 111756 ± 2% softirqs.CPU1.RCU
116695 ± 2% +14.0% 133013 ± 3% softirqs.CPU103.RCU
8241 ± 9% +18.8% 9792 ± 3% softirqs.CPU104.SCHED
116931 ± 2% +12.5% 131559 softirqs.CPU105.RCU
8671 ± 5% +35.3% 11732 ± 21% softirqs.CPU107.SCHED
124859 ± 7% -12.0% 109855 ± 6% softirqs.CPU11.TIMER
8146 ± 15% +25.6% 10235 ± 9% softirqs.CPU110.SCHED
8051 ± 17% +29.3% 10412 ± 7% softirqs.CPU111.SCHED
12495 ± 17% +36.8% 17089 ± 16% softirqs.CPU117.SCHED
14717 ± 2% +11.7% 16433 ± 6% softirqs.CPU122.SCHED
14948 ± 5% +9.9% 16425 ± 6% softirqs.CPU129.SCHED
110639 +10.5% 122245 softirqs.CPU136.RCU
110864 +11.2% 123292 softirqs.CPU137.RCU
114185 ± 3% +9.4% 124873 softirqs.CPU139.RCU
110850 ± 2% +11.2% 123278 softirqs.CPU142.RCU
110568 ± 4% +10.5% 122143 ± 3% softirqs.CPU144.TIMER
109121 ± 5% +11.8% 122033 ± 4% softirqs.CPU145.TIMER
111912 ± 4% +10.2% 123315 softirqs.CPU146.RCU
108599 ± 5% +11.9% 121550 ± 4% softirqs.CPU146.TIMER
112181 ± 3% +12.3% 126005 softirqs.CPU147.RCU
112234 ± 3% +12.7% 126471 softirqs.CPU148.RCU
109468 ± 4% +11.1% 121657 ± 4% softirqs.CPU148.TIMER
111220 ± 2% +10.3% 122669 softirqs.CPU149.RCU
109018 ± 6% +12.2% 122271 ± 4% softirqs.CPU149.TIMER
109327 ± 5% +12.1% 122520 ± 4% softirqs.CPU151.TIMER
108406 ± 5% +13.4% 122935 ± 4% softirqs.CPU152.TIMER
103893 ± 8% +17.5% 122032 ± 4% softirqs.CPU153.TIMER
108237 ± 5% +12.7% 121936 ± 4% softirqs.CPU154.TIMER
111699 ± 3% +12.1% 125267 ± 2% softirqs.CPU155.RCU
107822 ± 6% +13.2% 122059 ± 4% softirqs.CPU155.TIMER
110230 ± 4% +10.4% 121735 softirqs.CPU156.RCU
110996 ± 9% +18.5% 131541 ± 3% softirqs.CPU156.TIMER
111474 ± 9% +18.3% 131887 ± 3% softirqs.CPU157.TIMER
111808 ± 10% +18.4% 132383 ± 3% softirqs.CPU158.TIMER
112410 ± 9% +19.5% 134371 ± 4% softirqs.CPU159.TIMER
112431 ± 9% +18.2% 132868 ± 3% softirqs.CPU160.TIMER
111938 ± 9% +18.6% 132812 ± 4% softirqs.CPU162.TIMER
112639 ± 8% +19.6% 134695 ± 5% softirqs.CPU163.TIMER
111264 ± 10% +19.3% 132735 ± 4% softirqs.CPU164.TIMER
112895 ± 10% +18.6% 133896 ± 2% softirqs.CPU165.TIMER
112142 ± 9% +19.0% 133462 ± 4% softirqs.CPU166.TIMER
112441 ± 8% +18.5% 133207 ± 4% softirqs.CPU167.TIMER
119231 ± 4% +12.1% 133611 ± 4% softirqs.CPU168.TIMER
110256 ± 3% +14.5% 126229 softirqs.CPU170.RCU
117944 ± 4% +12.7% 132897 ± 4% softirqs.CPU170.TIMER
110796 ± 3% +15.5% 127949 ± 2% softirqs.CPU171.RCU
118324 ± 4% +12.2% 132748 ± 4% softirqs.CPU171.TIMER
111194 ± 3% +14.8% 127611 softirqs.CPU172.RCU
117677 ± 4% +12.5% 132353 ± 4% softirqs.CPU172.TIMER
112702 ± 4% +11.7% 125929 softirqs.CPU173.RCU
117521 ± 4% +13.0% 132777 ± 4% softirqs.CPU173.TIMER
111519 ± 5% +11.5% 124397 softirqs.CPU174.RCU
117624 ± 4% +12.8% 132699 ± 4% softirqs.CPU174.TIMER
117770 ± 4% +12.6% 132555 ± 4% softirqs.CPU175.TIMER
107011 ± 4% +14.6% 122628 softirqs.CPU176.RCU
125052 ± 4% +14.8% 143534 ± 3% softirqs.CPU176.TIMER
124092 ± 4% +16.4% 144483 ± 4% softirqs.CPU177.TIMER
106789 ± 4% +15.9% 123784 softirqs.CPU178.RCU
125402 ± 4% +14.1% 143099 ± 4% softirqs.CPU178.TIMER
108238 ± 4% +16.6% 126156 softirqs.CPU179.RCU
125614 ± 4% +13.6% 142717 ± 4% softirqs.CPU179.TIMER
105149 ± 2% +16.1% 122032 softirqs.CPU180.RCU
126015 ± 4% +13.6% 143152 ± 4% softirqs.CPU180.TIMER
105298 ± 3% +14.8% 120882 softirqs.CPU181.RCU
126284 ± 4% +13.4% 143188 ± 4% softirqs.CPU181.TIMER
126504 ± 4% +13.7% 143880 ± 4% softirqs.CPU182.TIMER
97635 ± 4% +10.2% 107575 ± 2% softirqs.CPU183.RCU
126954 ± 4% +13.2% 143706 ± 3% softirqs.CPU183.TIMER
97029 ± 4% +10.0% 106721 ± 2% softirqs.CPU184.RCU
126597 ± 4% +14.1% 144399 ± 3% softirqs.CPU184.TIMER
126291 ± 4% +14.1% 144041 ± 3% softirqs.CPU185.TIMER
106173 ± 3% +12.6% 119604 softirqs.CPU186.RCU
126032 ± 4% +13.7% 143361 ± 4% softirqs.CPU186.TIMER
101051 ± 2% +10.9% 112061 softirqs.CPU187.RCU
126354 ± 4% +13.3% 143192 ± 3% softirqs.CPU187.TIMER
102818 ± 2% +12.2% 115332 softirqs.CPU188.RCU
127619 ± 3% +12.5% 143581 ± 3% softirqs.CPU188.TIMER
126988 ± 3% +13.1% 143600 ± 3% softirqs.CPU189.TIMER
127844 ± 3% +12.0% 143208 ± 3% softirqs.CPU190.TIMER
105194 ± 4% +8.9% 114593 softirqs.CPU191.RCU
126131 ± 4% +12.6% 141984 ± 3% softirqs.CPU191.TIMER
126023 ± 8% -13.7% 108741 ± 5% softirqs.CPU2.TIMER
104677 +10.9% 116047 softirqs.CPU26.RCU
105355 +12.8% 118890 ± 4% softirqs.CPU29.RCU
103887 ± 2% +11.8% 116158 ± 3% softirqs.CPU37.RCU
100278 +9.9% 110226 softirqs.CPU41.RCU
99651 +11.1% 110705 softirqs.CPU47.RCU
120656 ± 5% +9.0% 131555 ± 5% softirqs.CPU49.TIMER
120260 ± 5% +8.8% 130798 ± 4% softirqs.CPU50.TIMER
121096 ± 5% +7.7% 130459 ± 4% softirqs.CPU51.TIMER
119575 ± 5% +9.4% 130823 ± 4% softirqs.CPU53.TIMER
120678 ± 5% +8.1% 130443 ± 4% softirqs.CPU54.TIMER
100685 +8.5% 109266 ± 2% softirqs.CPU56.RCU
119321 ± 5% +9.6% 130744 ± 4% softirqs.CPU56.TIMER
119688 ± 5% +9.2% 130694 ± 5% softirqs.CPU58.TIMER
118367 ± 5% +10.2% 130390 ± 5% softirqs.CPU59.TIMER
125646 ± 7% -12.5% 109907 ± 6% softirqs.CPU6.TIMER
102136 ± 3% +11.2% 113583 softirqs.CPU60.RCU
120242 ± 7% +14.6% 137784 ± 4% softirqs.CPU60.TIMER
101539 ± 3% +10.3% 111989 softirqs.CPU61.RCU
120829 ± 8% +14.2% 138016 ± 4% softirqs.CPU61.TIMER
121701 ± 7% +13.9% 138600 ± 4% softirqs.CPU62.TIMER
121409 ± 7% +14.2% 138676 ± 4% softirqs.CPU63.TIMER
125328 ± 7% +13.7% 142548 ± 3% softirqs.CPU64.TIMER
123090 ± 10% +15.9% 142685 ± 4% softirqs.CPU65.TIMER
123836 ± 6% +13.8% 140978 ± 4% softirqs.CPU66.TIMER
125334 ± 6% +13.0% 141581 ± 4% softirqs.CPU67.TIMER
123980 ± 7% +14.3% 141747 ± 4% softirqs.CPU68.TIMER
124508 ± 7% +14.3% 142357 ± 4% softirqs.CPU69.TIMER
103525 ± 3% +11.6% 115534 ± 3% softirqs.CPU7.RCU
99522 ± 2% +9.3% 108745 softirqs.CPU70.RCU
125138 ± 7% +13.8% 142351 ± 4% softirqs.CPU70.TIMER
97391 ± 4% +10.6% 107679 softirqs.CPU71.RCU
125595 ± 6% +13.9% 143020 ± 4% softirqs.CPU71.TIMER
98862 +13.3% 111979 softirqs.CPU72.RCU
100573 ± 2% +14.8% 115477 ± 2% softirqs.CPU74.RCU
101877 ± 3% +15.4% 117588 ± 2% softirqs.CPU75.RCU
130688 ± 4% +8.7% 142022 ± 4% softirqs.CPU75.TIMER
101667 ± 2% +17.0% 118990 softirqs.CPU76.RCU
131462 ± 4% +8.4% 142483 ± 4% softirqs.CPU76.TIMER
131276 ± 4% +8.9% 142977 ± 4% softirqs.CPU77.TIMER
100175 ± 2% +13.0% 113199 softirqs.CPU78.RCU
131385 ± 4% +8.8% 142957 ± 4% softirqs.CPU78.TIMER
101826 ± 2% +11.8% 113877 ± 2% softirqs.CPU79.RCU
131559 ± 4% +8.6% 142893 ± 4% softirqs.CPU79.TIMER
97507 ± 4% +16.3% 113402 softirqs.CPU80.RCU
134781 ± 3% +11.6% 150470 ± 4% softirqs.CPU80.TIMER
133591 ± 4% +12.7% 150597 ± 4% softirqs.CPU81.TIMER
98641 ± 3% +14.9% 113360 softirqs.CPU82.RCU
134594 ± 3% +11.5% 150134 ± 4% softirqs.CPU82.TIMER
99247 ± 5% +18.1% 117183 softirqs.CPU83.RCU
135102 ± 4% +12.1% 151482 ± 5% softirqs.CPU83.TIMER
95274 ± 3% +15.0% 109581 softirqs.CPU84.RCU
135875 ± 4% +11.0% 150835 ± 4% softirqs.CPU84.TIMER
95594 ± 4% +12.7% 107706 softirqs.CPU85.RCU
135392 ± 4% +11.2% 150530 ± 4% softirqs.CPU85.TIMER
135627 ± 4% +11.1% 150715 ± 4% softirqs.CPU86.TIMER
137157 ± 4% +10.4% 151396 ± 4% softirqs.CPU87.TIMER
137165 ± 4% +10.5% 151523 ± 4% softirqs.CPU88.TIMER
88932 +8.0% 96045 ± 2% softirqs.CPU89.RCU
94247 ± 4% +15.9% 109213 softirqs.CPU90.RCU
135110 ± 3% +10.9% 149854 ± 3% softirqs.CPU90.TIMER
90759 ± 3% +11.0% 100702 ± 3% softirqs.CPU91.RCU
135137 ± 3% +11.3% 150386 ± 3% softirqs.CPU91.TIMER
92801 +12.3% 104179 softirqs.CPU92.RCU
135193 ± 4% +11.4% 150619 ± 3% softirqs.CPU92.TIMER
136523 ± 3% +10.8% 151310 ± 3% softirqs.CPU93.TIMER
136122 ± 4% +11.1% 151222 ± 3% softirqs.CPU94.TIMER
92008 ± 5% +11.3% 102360 softirqs.CPU95.RCU
136673 ± 4% +10.5% 150992 ± 3% softirqs.CPU95.TIMER
51.52 ± 9% -13.6 37.91 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
50.85 ± 9% -13.4 37.43 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.75 ± 10% -5.4 16.39 ± 6% perf-profile.calltrace.cycles-pp.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
19.97 ± 11% -4.9 15.08 ± 6% perf-profile.calltrace.cycles-pp.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.70 ± 12% -3.7 12.00 ± 9% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
15.06 ± 12% -3.5 11.54 ± 9% perf-profile.calltrace.cycles-pp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64.do_syscall_64
5.70 ± 8% -1.6 4.11 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
5.28 ± 8% -1.5 3.82 ± 3% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
4.08 ± 7% -1.0 3.11 ± 8% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64
3.29 ± 7% -0.7 2.54 ± 10% perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read.vfs_read
2.28 ± 8% -0.6 1.64 ± 3% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.64 ± 8% -0.5 1.16 ± 3% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_read.ksys_pread64.do_syscall_64
1.73 ± 7% -0.4 1.38 ± 15% perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_file_read_iter.new_sync_read
1.33 ± 8% -0.3 0.98 ± 2% perf-profile.calltrace.cycles-pp.__fget_light.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.97 ± 6% -0.3 0.69 ± 4% perf-profile.calltrace.cycles-pp.touch_atime.shmem_file_read_iter.new_sync_read.vfs_read.ksys_pread64
0.87 ± 10% -0.2 0.62 ± 4% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_pread64.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.81 ± 6% -0.2 0.58 ± 3% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.shmem_file_read_iter.new_sync_read.vfs_read
0.65 ± 12% +0.5 1.11 ± 4% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.5 0.54 ± 4% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.14 ±173% +0.7 0.82 ± 3% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +0.7 0.71 ± 5% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.15 ± 12% +0.8 1.97 ± 2% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
1.24 ± 12% +0.9 2.15 ± 2% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
34.25 ± 18% +15.2 49.42 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
34.70 ± 17% +16.3 50.98 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
34.78 ± 17% +16.4 51.14 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
36.14 ± 16% +16.8 52.92 perf-profile.calltrace.cycles-pp.secondary_startup_64
35.31 ± 16% +16.8 52.11 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
35.31 ± 16% +16.8 52.11 ± 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
35.30 ± 16% +16.8 52.10 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
51.57 ± 9% -13.6 37.98 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
50.94 ± 9% -13.4 37.53 ± 2% perf-profile.children.cycles-pp.do_syscall_64
21.78 ± 10% -5.4 16.41 ± 6% perf-profile.children.cycles-pp.ksys_pread64
20.02 ± 11% -4.9 15.12 ± 6% perf-profile.children.cycles-pp.vfs_read
15.73 ± 12% -3.7 12.02 ± 9% perf-profile.children.cycles-pp.new_sync_read
15.16 ± 12% -3.6 11.61 ± 9% perf-profile.children.cycles-pp.shmem_file_read_iter
6.11 ± 8% -1.7 4.41 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret
5.70 ± 8% -1.6 4.11 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64
4.10 ± 7% -1.0 3.13 ± 8% perf-profile.children.cycles-pp.shmem_getpage_gfp
3.37 ± 7% -0.8 2.60 ± 9% perf-profile.children.cycles-pp.find_lock_entry
2.31 ± 8% -0.7 1.66 ± 3% perf-profile.children.cycles-pp.security_file_permission
1.65 ± 8% -0.5 1.17 ± 3% perf-profile.children.cycles-pp.common_file_perm
1.78 ± 7% -0.4 1.41 ± 14% perf-profile.children.cycles-pp.find_get_entry
1.33 ± 8% -0.3 0.98 ± 2% perf-profile.children.cycles-pp.__fget_light
1.00 ± 7% -0.3 0.70 ± 4% perf-profile.children.cycles-pp.touch_atime
0.91 ± 9% -0.3 0.66 ± 4% perf-profile.children.cycles-pp.fsnotify
0.81 ± 6% -0.2 0.58 ± 3% perf-profile.children.cycles-pp.atime_needs_update
0.63 ± 9% -0.2 0.46 ± 3% perf-profile.children.cycles-pp.__x64_sys_pread64
0.52 ± 8% -0.2 0.35 ± 6% perf-profile.children.cycles-pp.current_time
0.59 ± 9% -0.2 0.43 perf-profile.children.cycles-pp.unlock_page
0.60 ± 8% -0.2 0.45 ± 3% perf-profile.children.cycles-pp.__fsnotify_parent
0.54 ± 10% -0.1 0.40 ± 3% perf-profile.children.cycles-pp.___might_sleep
0.44 ± 9% -0.1 0.32 ± 2% perf-profile.children.cycles-pp.__might_sleep
0.40 ± 9% -0.1 0.28 ± 5% perf-profile.children.cycles-pp.mark_page_accessed
0.48 ± 8% -0.1 0.37 ± 4% perf-profile.children.cycles-pp.page_mapping
0.38 ± 10% -0.1 0.27 ± 3% perf-profile.children.cycles-pp.__might_fault
0.29 ± 8% -0.1 0.20 ± 6% perf-profile.children.cycles-pp._cond_resched
0.25 ± 9% -0.1 0.16 ± 5% perf-profile.children.cycles-pp.fpregs_assert_state_consistent
0.19 ± 9% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.rw_verify_area
0.22 ± 9% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.aa_file_perm
0.15 ± 10% -0.1 0.10 ± 8% perf-profile.children.cycles-pp.rcu_all_qs
0.17 ± 7% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.timestamp_truncate
0.07 ± 11% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.__vfs_read
0.09 ± 16% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.apparmor_file_permission
0.07 ± 10% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.PageHuge
0.07 ± 10% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.iov_iter_init
0.06 ± 14% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.native_irq_return_iret
0.07 ± 20% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.native_write_msr
0.06 ± 13% +0.0 0.11 ± 6% perf-profile.children.cycles-pp.read_tsc
0.09 ± 18% +0.0 0.14 ± 8% perf-profile.children.cycles-pp.rebalance_domains
0.06 ± 7% +0.1 0.11 ± 7% perf-profile.children.cycles-pp._find_next_bit
0.06 ± 11% +0.1 0.11 ± 7% perf-profile.children.cycles-pp.lapic_next_deadline
0.05 ± 58% +0.1 0.10 ± 10% perf-profile.children.cycles-pp.load_balance
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp._raw_spin_lock
0.10 ± 26% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.update_blocked_averages
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.sched_clock
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.native_sched_clock
0.01 ±173% +0.1 0.07 ± 10% perf-profile.children.cycles-pp.timerqueue_add
0.00 +0.1 0.06 perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.1 0.06 perf-profile.children.cycles-pp.run_rebalance_domains
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.find_busiest_group
0.01 ±173% +0.1 0.07 ± 11% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.12 ± 30% +0.1 0.18 ± 6% perf-profile.children.cycles-pp.tick_irq_enter
0.18 ± 13% +0.1 0.24 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.interrupt_entry
0.01 ±173% +0.1 0.08 ± 6% perf-profile.children.cycles-pp.timerqueue_del
0.01 ±173% +0.1 0.08 perf-profile.children.cycles-pp.run_timer_softirq
0.01 ±173% +0.1 0.08 ± 8% perf-profile.children.cycles-pp.enqueue_hrtimer
0.09 ± 4% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.__next_timer_interrupt
0.01 ±173% +0.1 0.08 ± 8% perf-profile.children.cycles-pp.sched_clock_cpu
0.01 ±173% +0.1 0.10 ± 5% perf-profile.children.cycles-pp.__remove_hrtimer
0.21 ± 10% +0.1 0.30 ± 11% perf-profile.children.cycles-pp.rcu_core
0.12 ± 3% +0.1 0.21 ± 7% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.14 ± 25% +0.1 0.24 ± 6% perf-profile.children.cycles-pp.irq_enter
0.17 ± 5% +0.1 0.29 ± 3% perf-profile.children.cycles-pp.tick_nohz_next_event
0.16 ± 14% +0.1 0.29 ± 13% perf-profile.children.cycles-pp.scheduler_tick
0.21 ± 3% +0.1 0.35 ± 3% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.41 ± 13% +0.2 0.62 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start
0.36 ± 21% +0.2 0.57 ± 13% perf-profile.children.cycles-pp.update_process_times
0.45 ± 23% +0.2 0.69 ± 12% perf-profile.children.cycles-pp.tick_sched_timer
0.47 ± 12% +0.3 0.72 ± 6% perf-profile.children.cycles-pp.irq_exit
0.37 ± 22% +0.3 0.62 ± 12% perf-profile.children.cycles-pp.tick_sched_handle
0.40 ± 9% +0.3 0.72 ± 5% perf-profile.children.cycles-pp.menu_select
0.66 ± 23% +0.4 1.09 ± 9% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.98 ± 17% +0.5 1.51 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt
1.62 ± 14% +0.9 2.54 ± 6% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
1.73 ± 14% +1.0 2.77 ± 6% perf-profile.children.cycles-pp.apic_timer_interrupt
34.25 ± 18% +15.3 49.51 ± 2% perf-profile.children.cycles-pp.intel_idle
35.63 ± 17% +16.3 51.95 perf-profile.children.cycles-pp.cpuidle_enter_state
35.63 ± 17% +16.3 51.95 perf-profile.children.cycles-pp.cpuidle_enter
36.15 ± 16% +16.8 52.92 perf-profile.children.cycles-pp.do_idle
36.14 ± 16% +16.8 52.92 perf-profile.children.cycles-pp.secondary_startup_64
36.14 ± 16% +16.8 52.92 perf-profile.children.cycles-pp.cpu_startup_entry
35.31 ± 16% +16.8 52.11 ± 2% perf-profile.children.cycles-pp.start_secondary
28.19 ± 10% -7.8 20.37 ± 6% perf-profile.self.cycles-pp.do_syscall_64
6.10 ± 8% -1.7 4.39 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret
5.70 ± 8% -1.6 4.11 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64
1.92 ± 6% -0.5 1.41 ± 3% perf-profile.self.cycles-pp.shmem_file_read_iter
1.41 ± 8% -0.4 0.98 ± 4% perf-profile.self.cycles-pp.common_file_perm
1.31 ± 8% -0.3 0.96 ± 2% perf-profile.self.cycles-pp.__fget_light
0.87 ± 9% -0.3 0.61 ± 4% perf-profile.self.cycles-pp.fsnotify
0.72 ± 9% -0.2 0.52 ± 2% perf-profile.self.cycles-pp.shmem_getpage_gfp
0.63 ± 8% -0.2 0.45 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.64 ± 7% -0.2 0.46 ± 3% perf-profile.self.cycles-pp.copy_page_to_iter
0.63 ± 9% -0.2 0.47 ± 7% perf-profile.self.cycles-pp.find_lock_entry
0.58 ± 9% -0.2 0.43 ± 2% perf-profile.self.cycles-pp.unlock_page
0.54 ± 8% -0.2 0.39 ± 4% perf-profile.self.cycles-pp.__x64_sys_pread64
0.57 ± 8% -0.1 0.42 ± 3% perf-profile.self.cycles-pp.__fsnotify_parent
0.54 ± 10% -0.1 0.39 ± 3% perf-profile.self.cycles-pp.___might_sleep
0.54 ± 9% -0.1 0.40 ± 4% perf-profile.self.cycles-pp.vfs_read
0.47 ± 8% -0.1 0.34 ± 5% perf-profile.self.cycles-pp.new_sync_read
0.43 ± 8% -0.1 0.32 ± 4% perf-profile.self.cycles-pp.ksys_pread64
0.37 ± 9% -0.1 0.26 ± 6% perf-profile.self.cycles-pp.mark_page_accessed
0.45 ± 8% -0.1 0.35 ± 3% perf-profile.self.cycles-pp.page_mapping
0.37 ± 9% -0.1 0.26 ± 3% perf-profile.self.cycles-pp.__might_sleep
0.31 ± 7% -0.1 0.23 ± 3% perf-profile.self.cycles-pp.xas_load
0.25 ± 9% -0.1 0.16 ± 5% perf-profile.self.cycles-pp.fpregs_assert_state_consistent
0.32 ± 9% -0.1 0.23 ± 2% perf-profile.self.cycles-pp.security_file_permission
0.21 ± 13% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.touch_atime
0.19 ± 9% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.rw_verify_area
0.20 ± 7% -0.1 0.14 perf-profile.self.cycles-pp.current_time
0.22 ± 8% -0.1 0.17 ± 4% perf-profile.self.cycles-pp.aa_file_perm
0.14 ± 8% -0.0 0.09 ± 8% perf-profile.self.cycles-pp._cond_resched
0.17 ± 6% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.timestamp_truncate
0.07 ± 11% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.__vfs_read
0.10 ± 11% -0.0 0.07 ± 13% perf-profile.self.cycles-pp.copyout
0.10 ± 7% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__might_fault
0.10 ± 12% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.rcu_all_qs
0.07 ± 10% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.iov_iter_init
0.06 ± 7% +0.0 0.09 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.06 ± 14% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.native_irq_return_iret
0.06 ± 13% +0.0 0.10 ± 8% perf-profile.self.cycles-pp.read_tsc
0.07 ± 20% +0.0 0.12 ± 8% perf-profile.self.cycles-pp.native_write_msr
0.06 ± 7% +0.0 0.11 ± 4% perf-profile.self.cycles-pp._find_next_bit
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.__next_timer_interrupt
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.do_idle
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.interrupt_entry
0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.run_timer_softirq
0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.12 ± 10% +0.1 0.25 ± 2% perf-profile.self.cycles-pp.cpuidle_enter_state
0.15 ± 25% +0.1 0.29 ± 11% perf-profile.self.cycles-pp.menu_select
34.24 ± 18% +15.3 49.50 ± 2% perf-profile.self.cycles-pp.intel_idle
170.25 ± 8% +79.0% 304.75 ± 43% interrupts.57:PCI-MSI.1572870-edge.eth0-TxRx-6
154.75 +11.1% 172.00 ± 4% interrupts.78:PCI-MSI.1572891-edge.eth0-TxRx-27
155.50 +25.1% 194.50 ± 24% interrupts.80:PCI-MSI.1572893-edge.eth0-TxRx-29
154.50 +28.0% 197.75 ± 30% interrupts.89:PCI-MSI.1572902-edge.eth0-TxRx-38
3780 ± 30% -30.6% 2624 ± 27% interrupts.CPU1.NMI:Non-maskable_interrupts
3780 ± 30% -30.6% 2624 ± 27% interrupts.CPU1.PMI:Performance_monitoring_interrupts
6402 ± 24% -60.7% 2514 ± 33% interrupts.CPU100.NMI:Non-maskable_interrupts
6402 ± 24% -60.7% 2514 ± 33% interrupts.CPU100.PMI:Performance_monitoring_interrupts
121.00 ± 2% -73.3% 32.25 ± 9% interrupts.CPU100.RES:Rescheduling_interrupts
5487 ± 33% -54.2% 2515 ± 33% interrupts.CPU101.NMI:Non-maskable_interrupts
5487 ± 33% -54.2% 2515 ± 33% interrupts.CPU101.PMI:Performance_monitoring_interrupts
6402 ± 24% -55.8% 2827 ± 24% interrupts.CPU102.NMI:Non-maskable_interrupts
6402 ± 24% -55.8% 2827 ± 24% interrupts.CPU102.PMI:Performance_monitoring_interrupts
121.75 ± 2% -71.7% 34.50 ± 10% interrupts.CPU102.RES:Rescheduling_interrupts
7316 -54.2% 3353 interrupts.CPU103.NMI:Non-maskable_interrupts
7316 -54.2% 3353 interrupts.CPU103.PMI:Performance_monitoring_interrupts
139.25 ± 23% -75.8% 33.75 ± 7% interrupts.CPU103.RES:Rescheduling_interrupts
7317 -54.2% 3354 interrupts.CPU104.NMI:Non-maskable_interrupts
7317 -54.2% 3354 interrupts.CPU104.PMI:Performance_monitoring_interrupts
118.75 -68.8% 37.00 ± 33% interrupts.CPU104.RES:Rescheduling_interrupts
6401 ± 24% -55.9% 2820 ± 24% interrupts.CPU105.NMI:Non-maskable_interrupts
6401 ± 24% -55.9% 2820 ± 24% interrupts.CPU105.PMI:Performance_monitoring_interrupts
120.00 -72.7% 32.75 ± 3% interrupts.CPU105.RES:Rescheduling_interrupts
5487 ± 33% -47.5% 2878 ± 24% interrupts.CPU106.NMI:Non-maskable_interrupts
5487 ± 33% -47.5% 2878 ± 24% interrupts.CPU106.PMI:Performance_monitoring_interrupts
122.75 ± 2% -70.7% 36.00 ± 13% interrupts.CPU106.RES:Rescheduling_interrupts
6403 ± 24% -56.1% 2810 ± 24% interrupts.CPU107.NMI:Non-maskable_interrupts
6403 ± 24% -56.1% 2810 ± 24% interrupts.CPU107.PMI:Performance_monitoring_interrupts
7320 -55.9% 3229 ± 6% interrupts.CPU108.NMI:Non-maskable_interrupts
7320 -55.9% 3229 ± 6% interrupts.CPU108.PMI:Performance_monitoring_interrupts
122.25 ± 3% -74.4% 31.25 ± 8% interrupts.CPU108.RES:Rescheduling_interrupts
7319 -54.2% 3353 interrupts.CPU109.NMI:Non-maskable_interrupts
7319 -54.2% 3353 interrupts.CPU109.PMI:Performance_monitoring_interrupts
119.50 -73.2% 32.00 ± 4% interrupts.CPU109.RES:Rescheduling_interrupts
6924 ± 9% -57.6% 2934 ± 24% interrupts.CPU110.NMI:Non-maskable_interrupts
6924 ± 9% -57.6% 2934 ± 24% interrupts.CPU110.PMI:Performance_monitoring_interrupts
119.00 -70.4% 35.25 ± 23% interrupts.CPU110.RES:Rescheduling_interrupts
6924 ± 9% -63.7% 2515 ± 33% interrupts.CPU111.NMI:Non-maskable_interrupts
6924 ± 9% -63.7% 2515 ± 33% interrupts.CPU111.PMI:Performance_monitoring_interrupts
121.25 ± 2% -74.4% 31.00 ± 13% interrupts.CPU111.RES:Rescheduling_interrupts
6930 ± 9% -63.7% 2514 ± 33% interrupts.CPU112.NMI:Non-maskable_interrupts
6930 ± 9% -63.7% 2514 ± 33% interrupts.CPU112.PMI:Performance_monitoring_interrupts
121.50 -58.0% 51.00 ± 64% interrupts.CPU112.RES:Rescheduling_interrupts
7318 -59.9% 2934 ± 24% interrupts.CPU113.NMI:Non-maskable_interrupts
7318 -59.9% 2934 ± 24% interrupts.CPU113.PMI:Performance_monitoring_interrupts
124.00 ± 2% -74.8% 31.25 ± 3% interrupts.CPU113.RES:Rescheduling_interrupts
7318 -59.9% 2933 ± 24% interrupts.CPU114.NMI:Non-maskable_interrupts
7318 -59.9% 2933 ± 24% interrupts.CPU114.PMI:Performance_monitoring_interrupts
119.25 -69.4% 36.50 ± 20% interrupts.CPU114.RES:Rescheduling_interrupts
7319 -59.9% 2934 ± 24% interrupts.CPU115.NMI:Non-maskable_interrupts
7319 -59.9% 2934 ± 24% interrupts.CPU115.PMI:Performance_monitoring_interrupts
121.00 -69.8% 36.50 ± 12% interrupts.CPU115.RES:Rescheduling_interrupts
126.25 ± 7% -72.3% 35.00 ± 14% interrupts.CPU116.RES:Rescheduling_interrupts
7317 -65.6% 2514 ± 33% interrupts.CPU117.NMI:Non-maskable_interrupts
7317 -65.6% 2514 ± 33% interrupts.CPU117.PMI:Performance_monitoring_interrupts
4259 ±168% -99.2% 35.50 ± 24% interrupts.CPU119.RES:Rescheduling_interrupts
6404 ± 24% -54.2% 2935 ± 24% interrupts.CPU121.NMI:Non-maskable_interrupts
6404 ± 24% -54.2% 2935 ± 24% interrupts.CPU121.PMI:Performance_monitoring_interrupts
6405 ± 24% -49.6% 3230 ± 6% interrupts.CPU122.NMI:Non-maskable_interrupts
6405 ± 24% -49.6% 3230 ± 6% interrupts.CPU122.PMI:Performance_monitoring_interrupts
116.00 -73.5% 30.75 ± 14% interrupts.CPU122.RES:Rescheduling_interrupts
115.00 ± 3% -75.2% 28.50 interrupts.CPU123.RES:Rescheduling_interrupts
5490 ± 33% -38.9% 3355 interrupts.CPU124.NMI:Non-maskable_interrupts
5490 ± 33% -38.9% 3355 interrupts.CPU124.PMI:Performance_monitoring_interrupts
115.75 ± 4% -74.9% 29.00 ± 10% interrupts.CPU124.RES:Rescheduling_interrupts
5491 ± 33% -41.2% 3230 ± 6% interrupts.CPU125.NMI:Non-maskable_interrupts
5491 ± 33% -41.2% 3230 ± 6% interrupts.CPU125.PMI:Performance_monitoring_interrupts
113.50 -65.9% 38.75 ± 6% interrupts.CPU125.RES:Rescheduling_interrupts
5490 ± 33% -38.9% 3356 interrupts.CPU126.NMI:Non-maskable_interrupts
5490 ± 33% -38.9% 3356 interrupts.CPU126.PMI:Performance_monitoring_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU127.NMI:Non-maskable_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU127.PMI:Performance_monitoring_interrupts
6406 ± 24% -47.7% 3353 interrupts.CPU128.NMI:Non-maskable_interrupts
6406 ± 24% -47.7% 3353 interrupts.CPU128.PMI:Performance_monitoring_interrupts
117.75 ± 3% -69.9% 35.50 ± 15% interrupts.CPU128.RES:Rescheduling_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU129.NMI:Non-maskable_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU129.PMI:Performance_monitoring_interrupts
118.75 -73.9% 31.00 ± 15% interrupts.CPU129.RES:Rescheduling_interrupts
116.75 ± 3% -74.7% 29.50 ± 20% interrupts.CPU130.RES:Rescheduling_interrupts
7322 -54.2% 3354 interrupts.CPU131.NMI:Non-maskable_interrupts
7322 -54.2% 3354 interrupts.CPU131.PMI:Performance_monitoring_interrupts
169.00 ± 54% -77.5% 38.00 ± 36% interrupts.CPU131.RES:Rescheduling_interrupts
6406 ± 24% -47.6% 3357 interrupts.CPU132.NMI:Non-maskable_interrupts
6406 ± 24% -47.6% 3357 interrupts.CPU132.PMI:Performance_monitoring_interrupts
113.50 -61.5% 43.75 ± 67% interrupts.CPU132.RES:Rescheduling_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU133.NMI:Non-maskable_interrupts
6406 ± 24% -47.6% 3354 interrupts.CPU133.PMI:Performance_monitoring_interrupts
149.00 ± 36% -82.6% 26.00 ± 14% interrupts.CPU133.RES:Rescheduling_interrupts
6406 ± 24% -49.4% 3240 ± 6% interrupts.CPU134.NMI:Non-maskable_interrupts
6406 ± 24% -49.4% 3240 ± 6% interrupts.CPU134.PMI:Performance_monitoring_interrupts
116.25 ± 3% -74.0% 30.25 ± 20% interrupts.CPU134.RES:Rescheduling_interrupts
6406 ± 24% -54.2% 2933 ± 24% interrupts.CPU135.NMI:Non-maskable_interrupts
6406 ± 24% -54.2% 2933 ± 24% interrupts.CPU135.PMI:Performance_monitoring_interrupts
189.25 ± 68% -82.6% 33.00 ± 17% interrupts.CPU135.RES:Rescheduling_interrupts
119.25 ± 6% -73.6% 31.50 ± 21% interrupts.CPU136.RES:Rescheduling_interrupts
124.50 ± 18% -82.1% 22.25 ± 24% interrupts.CPU138.RES:Rescheduling_interrupts
130.00 ± 34% +55.2% 201.75 ± 2% interrupts.CPU139.NMI:Non-maskable_interrupts
130.00 ± 34% +55.2% 201.75 ± 2% interrupts.CPU139.PMI:Performance_monitoring_interrupts
105.25 ± 3% -64.1% 37.75 ± 63% interrupts.CPU140.RES:Rescheduling_interrupts
105.00 -67.1% 34.50 ± 33% interrupts.CPU141.RES:Rescheduling_interrupts
106.00 ± 3% -74.3% 27.25 ± 30% interrupts.CPU142.RES:Rescheduling_interrupts
103.75 -66.0% 35.25 ± 61% interrupts.CPU143.RES:Rescheduling_interrupts
108.00 ± 3% -75.0% 27.00 ± 19% interrupts.CPU144.RES:Rescheduling_interrupts
6254 ±146% -99.4% 34.75 ± 26% interrupts.CPU145.RES:Rescheduling_interrupts
145.25 ± 43% -85.7% 20.75 ± 9% interrupts.CPU147.RES:Rescheduling_interrupts
98.75 ± 8% -80.3% 19.50 ± 17% interrupts.CPU149.RES:Rescheduling_interrupts
3969 ± 30% -28.0% 2856 interrupts.CPU15.NMI:Non-maskable_interrupts
3969 ± 30% -28.0% 2856 interrupts.CPU15.PMI:Performance_monitoring_interrupts
239.75 ±102% -90.8% 22.00 ± 21% interrupts.CPU150.RES:Rescheduling_interrupts
180.00 ± 19% +38.3% 249.00 ± 4% interrupts.CPU151.NMI:Non-maskable_interrupts
180.00 ± 19% +38.3% 249.00 ± 4% interrupts.CPU151.PMI:Performance_monitoring_interrupts
103.00 ± 3% -68.9% 32.00 ± 75% interrupts.CPU151.RES:Rescheduling_interrupts
180.50 ± 17% +51.5% 273.50 ± 8% interrupts.CPU152.NMI:Non-maskable_interrupts
180.50 ± 17% +51.5% 273.50 ± 8% interrupts.CPU152.PMI:Performance_monitoring_interrupts
95.75 ± 10% -73.6% 25.25 ± 25% interrupts.CPU152.RES:Rescheduling_interrupts
171.75 ± 18% +46.1% 251.00 ± 4% interrupts.CPU153.NMI:Non-maskable_interrupts
171.75 ± 18% +46.1% 251.00 ± 4% interrupts.CPU153.PMI:Performance_monitoring_interrupts
93.00 ± 12% -75.3% 23.00 ± 27% interrupts.CPU153.RES:Rescheduling_interrupts
90.00 ± 10% -70.8% 26.25 ± 13% interrupts.CPU155.RES:Rescheduling_interrupts
178.50 ± 17% +44.4% 257.75 interrupts.CPU156.NMI:Non-maskable_interrupts
178.50 ± 17% +44.4% 257.75 interrupts.CPU156.PMI:Performance_monitoring_interrupts
91.00 ± 9% -79.9% 18.25 ± 17% interrupts.CPU156.RES:Rescheduling_interrupts
175.25 ± 16% +46.9% 257.50 interrupts.CPU157.NMI:Non-maskable_interrupts
175.25 ± 16% +46.9% 257.50 interrupts.CPU157.PMI:Performance_monitoring_interrupts
175.50 ± 16% +44.9% 254.25 interrupts.CPU158.NMI:Non-maskable_interrupts
175.50 ± 16% +44.9% 254.25 interrupts.CPU158.PMI:Performance_monitoring_interrupts
174.00 ± 18% +51.1% 263.00 ± 3% interrupts.CPU159.NMI:Non-maskable_interrupts
174.00 ± 18% +51.1% 263.00 ± 3% interrupts.CPU159.PMI:Performance_monitoring_interrupts
186.00 ± 24% +41.0% 262.25 interrupts.CPU160.NMI:Non-maskable_interrupts
186.00 ± 24% +41.0% 262.25 interrupts.CPU160.PMI:Performance_monitoring_interrupts
177.50 ± 16% +47.3% 261.50 interrupts.CPU161.NMI:Non-maskable_interrupts
177.50 ± 16% +47.3% 261.50 interrupts.CPU161.PMI:Performance_monitoring_interrupts
172.00 ± 14% +47.7% 254.00 interrupts.CPU162.NMI:Non-maskable_interrupts
172.00 ± 14% +47.7% 254.00 interrupts.CPU162.PMI:Performance_monitoring_interrupts
129.50 ± 73% -82.8% 22.25 ± 59% interrupts.CPU162.RES:Rescheduling_interrupts
28433 ±172% -99.9% 18.50 ± 17% interrupts.CPU165.RES:Rescheduling_interrupts
32332 ± 4% -11.9% 28499 ± 7% interrupts.CPU166.CAL:Function_call_interrupts
1096 ±164% -98.4% 17.25 ± 16% interrupts.CPU166.RES:Rescheduling_interrupts
31585 ± 4% -12.0% 27793 ± 7% interrupts.CPU166.TLB:TLB_shootdowns
32312 ± 4% -17.9% 26538 ± 20% interrupts.CPU168.CAL:Function_call_interrupts
182.00 ± 22% +43.4% 261.00 ± 3% interrupts.CPU168.NMI:Non-maskable_interrupts
182.00 ± 22% +43.4% 261.00 ± 3% interrupts.CPU168.PMI:Performance_monitoring_interrupts
31583 ± 4% -18.2% 25847 ± 20% interrupts.CPU168.TLB:TLB_shootdowns
260.25 ±136% -91.7% 21.50 ± 52% interrupts.CPU169.RES:Rescheduling_interrupts
175.00 ± 20% +47.1% 257.50 interrupts.CPU175.NMI:Non-maskable_interrupts
175.00 ± 20% +47.1% 257.50 interrupts.CPU175.PMI:Performance_monitoring_interrupts
175.00 ± 20% +50.3% 263.00 ± 3% interrupts.CPU176.NMI:Non-maskable_interrupts
175.00 ± 20% +50.3% 263.00 ± 3% interrupts.CPU176.PMI:Performance_monitoring_interrupts
175.00 ± 21% +47.3% 257.75 interrupts.CPU177.NMI:Non-maskable_interrupts
175.00 ± 21% +47.3% 257.75 interrupts.CPU177.PMI:Performance_monitoring_interrupts
179.50 ± 19% +42.5% 255.75 ± 3% interrupts.CPU178.NMI:Non-maskable_interrupts
179.50 ± 19% +42.5% 255.75 ± 3% interrupts.CPU178.PMI:Performance_monitoring_interrupts
157.25 ± 36% +61.8% 254.50 interrupts.CPU180.NMI:Non-maskable_interrupts
157.25 ± 36% +61.8% 254.50 interrupts.CPU180.PMI:Performance_monitoring_interrupts
177.25 ± 20% +43.7% 254.75 interrupts.CPU181.NMI:Non-maskable_interrupts
177.25 ± 20% +43.7% 254.75 interrupts.CPU181.PMI:Performance_monitoring_interrupts
180.50 ± 21% +43.2% 258.50 interrupts.CPU182.NMI:Non-maskable_interrupts
180.50 ± 21% +43.2% 258.50 interrupts.CPU182.PMI:Performance_monitoring_interrupts
175.25 ± 20% +48.5% 260.25 interrupts.CPU183.NMI:Non-maskable_interrupts
175.25 ± 20% +48.5% 260.25 interrupts.CPU183.PMI:Performance_monitoring_interrupts
177.25 ± 20% +51.8% 269.00 ± 4% interrupts.CPU184.NMI:Non-maskable_interrupts
177.25 ± 20% +51.8% 269.00 ± 4% interrupts.CPU184.PMI:Performance_monitoring_interrupts
178.00 ± 19% +46.1% 260.00 ± 2% interrupts.CPU185.NMI:Non-maskable_interrupts
178.00 ± 19% +46.1% 260.00 ± 2% interrupts.CPU185.PMI:Performance_monitoring_interrupts
176.50 ± 20% +44.8% 255.50 interrupts.CPU186.NMI:Non-maskable_interrupts
176.50 ± 20% +44.8% 255.50 interrupts.CPU186.PMI:Performance_monitoring_interrupts
177.75 ± 19% +43.2% 254.50 ± 2% interrupts.CPU187.NMI:Non-maskable_interrupts
177.75 ± 19% +43.2% 254.50 ± 2% interrupts.CPU187.PMI:Performance_monitoring_interrupts
180.25 ± 19% +40.8% 253.75 interrupts.CPU188.NMI:Non-maskable_interrupts
180.25 ± 19% +40.8% 253.75 interrupts.CPU188.PMI:Performance_monitoring_interrupts
177.50 ± 19% +43.4% 254.50 interrupts.CPU189.NMI:Non-maskable_interrupts
177.50 ± 19% +43.4% 254.50 interrupts.CPU189.PMI:Performance_monitoring_interrupts
159.00 ± 37% +60.8% 255.75 interrupts.CPU190.NMI:Non-maskable_interrupts
159.00 ± 37% +60.8% 255.75 interrupts.CPU190.PMI:Performance_monitoring_interrupts
174.00 ± 34% +48.6% 258.50 interrupts.CPU191.NMI:Non-maskable_interrupts
174.00 ± 34% +48.6% 258.50 interrupts.CPU191.PMI:Performance_monitoring_interrupts
4695 ± 40% -39.2% 2856 interrupts.CPU20.NMI:Non-maskable_interrupts
4695 ± 40% -39.2% 2856 interrupts.CPU20.PMI:Performance_monitoring_interrupts
3766 ± 31% -24.2% 2856 interrupts.CPU23.NMI:Non-maskable_interrupts
3766 ± 31% -24.2% 2856 interrupts.CPU23.PMI:Performance_monitoring_interrupts
154.75 +11.1% 172.00 ± 4% interrupts.CPU27.78:PCI-MSI.1572891-edge.eth0-TxRx-27
155.50 +25.1% 194.50 ± 24% interrupts.CPU29.80:PCI-MSI.1572893-edge.eth0-TxRx-29
3765 ± 30% -24.2% 2856 interrupts.CPU34.NMI:Non-maskable_interrupts
3765 ± 30% -24.2% 2856 interrupts.CPU34.PMI:Performance_monitoring_interrupts
154.50 +28.0% 197.75 ± 30% interrupts.CPU38.89:PCI-MSI.1572902-edge.eth0-TxRx-38
98.25 ± 20% -41.5% 57.50 ± 11% interrupts.CPU51.RES:Rescheduling_interrupts
124.00 ± 34% +108.9% 259.00 ± 2% interrupts.CPU52.NMI:Non-maskable_interrupts
124.00 ± 34% +108.9% 259.00 ± 2% interrupts.CPU52.PMI:Performance_monitoring_interrupts
127.50 ± 32% +98.0% 252.50 interrupts.CPU53.NMI:Non-maskable_interrupts
127.50 ± 32% +98.0% 252.50 interrupts.CPU53.PMI:Performance_monitoring_interrupts
12110 +26.5% 15319 ± 20% interrupts.CPU54.CAL:Function_call_interrupts
131.00 ± 33% +111.6% 277.25 ± 15% interrupts.CPU54.NMI:Non-maskable_interrupts
131.00 ± 33% +111.6% 277.25 ± 15% interrupts.CPU54.PMI:Performance_monitoring_interrupts
88.50 ± 35% -34.7% 57.75 ± 18% interrupts.CPU54.RES:Rescheduling_interrupts
128.75 ± 34% +95.1% 251.25 ± 4% interrupts.CPU55.NMI:Non-maskable_interrupts
128.75 ± 34% +95.1% 251.25 ± 4% interrupts.CPU55.PMI:Performance_monitoring_interrupts
131.00 ± 31% +111.8% 277.50 ± 10% interrupts.CPU56.NMI:Non-maskable_interrupts
131.00 ± 31% +111.8% 277.50 ± 10% interrupts.CPU56.PMI:Performance_monitoring_interrupts
125.50 ± 31% +101.0% 252.25 ± 4% interrupts.CPU57.NMI:Non-maskable_interrupts
125.50 ± 31% +101.0% 252.25 ± 4% interrupts.CPU57.PMI:Performance_monitoring_interrupts
170.25 ± 8% +79.0% 304.75 ± 43% interrupts.CPU6.57:PCI-MSI.1572870-edge.eth0-TxRx-6
7715 ±109% -99.8% 19.00 ±173% interrupts.CPU65.TLB:TLB_shootdowns
175.00 ± 17% +45.9% 255.25 interrupts.CPU69.NMI:Non-maskable_interrupts
175.00 ± 17% +45.9% 255.25 interrupts.CPU69.PMI:Performance_monitoring_interrupts
181.25 ± 15% +41.9% 257.25 ± 2% interrupts.CPU70.NMI:Non-maskable_interrupts
181.25 ± 15% +41.9% 257.25 ± 2% interrupts.CPU70.PMI:Performance_monitoring_interrupts
182.25 ± 14% +48.1% 270.00 ± 5% interrupts.CPU71.NMI:Non-maskable_interrupts
182.25 ± 14% +48.1% 270.00 ± 5% interrupts.CPU71.PMI:Performance_monitoring_interrupts
179.00 ± 20% +48.0% 265.00 ± 3% interrupts.CPU72.NMI:Non-maskable_interrupts
179.00 ± 20% +48.0% 265.00 ± 3% interrupts.CPU72.PMI:Performance_monitoring_interrupts
170.25 ± 18% +48.6% 253.00 ± 2% interrupts.CPU73.NMI:Non-maskable_interrupts
170.25 ± 18% +48.6% 253.00 ± 2% interrupts.CPU73.PMI:Performance_monitoring_interrupts
175.00 ± 21% +50.9% 264.00 ± 4% interrupts.CPU74.NMI:Non-maskable_interrupts
175.00 ± 21% +50.9% 264.00 ± 4% interrupts.CPU74.PMI:Performance_monitoring_interrupts
174.50 ± 21% +46.3% 255.25 interrupts.CPU75.NMI:Non-maskable_interrupts
174.50 ± 21% +46.3% 255.25 interrupts.CPU75.PMI:Performance_monitoring_interrupts
30.50 ± 58% +318.9% 127.75 ± 57% interrupts.CPU75.RES:Rescheduling_interrupts
174.50 ± 21% +47.4% 257.25 interrupts.CPU76.NMI:Non-maskable_interrupts
174.50 ± 21% +47.4% 257.25 interrupts.CPU76.PMI:Performance_monitoring_interrupts
175.50 ± 21% +47.6% 259.00 ± 3% interrupts.CPU77.NMI:Non-maskable_interrupts
175.50 ± 21% +47.6% 259.00 ± 3% interrupts.CPU77.PMI:Performance_monitoring_interrupts
177.00 ± 18% +45.6% 257.75 ± 2% interrupts.CPU78.NMI:Non-maskable_interrupts
177.00 ± 18% +45.6% 257.75 ± 2% interrupts.CPU78.PMI:Performance_monitoring_interrupts
171.50 ± 20% +50.0% 257.25 interrupts.CPU79.NMI:Non-maskable_interrupts
171.50 ± 20% +50.0% 257.25 interrupts.CPU79.PMI:Performance_monitoring_interrupts
3020 ± 2% -53.1% 1415 ± 4% interrupts.CPU79.TLB:TLB_shootdowns
170.00 ± 20% +53.8% 261.50 ± 2% interrupts.CPU80.NMI:Non-maskable_interrupts
170.00 ± 20% +53.8% 261.50 ± 2% interrupts.CPU80.PMI:Performance_monitoring_interrupts
170.25 ± 21% +50.7% 256.50 interrupts.CPU81.NMI:Non-maskable_interrupts
170.25 ± 21% +50.7% 256.50 interrupts.CPU81.PMI:Performance_monitoring_interrupts
3339 ± 99% -100.0% 0.00 interrupts.CPU81.TLB:TLB_shootdowns
176.25 ± 20% +47.5% 260.00 interrupts.CPU82.NMI:Non-maskable_interrupts
176.25 ± 20% +47.5% 260.00 interrupts.CPU82.PMI:Performance_monitoring_interrupts
203.00 ± 21% +24.5% 252.75 ± 3% interrupts.CPU83.NMI:Non-maskable_interrupts
203.00 ± 21% +24.5% 252.75 ± 3% interrupts.CPU83.PMI:Performance_monitoring_interrupts
175.50 ± 19% +45.7% 255.75 interrupts.CPU84.NMI:Non-maskable_interrupts
175.50 ± 19% +45.7% 255.75 interrupts.CPU84.PMI:Performance_monitoring_interrupts
175.50 ± 20% +45.4% 255.25 interrupts.CPU85.NMI:Non-maskable_interrupts
175.50 ± 20% +45.4% 255.25 interrupts.CPU85.PMI:Performance_monitoring_interrupts
175.00 ± 21% +49.0% 260.75 interrupts.CPU86.NMI:Non-maskable_interrupts
175.00 ± 21% +49.0% 260.75 interrupts.CPU86.PMI:Performance_monitoring_interrupts
172.25 ± 21% +51.2% 260.50 interrupts.CPU87.NMI:Non-maskable_interrupts
172.25 ± 21% +51.2% 260.50 interrupts.CPU87.PMI:Performance_monitoring_interrupts
175.75 ± 21% +51.9% 267.00 ± 3% interrupts.CPU88.NMI:Non-maskable_interrupts
175.75 ± 21% +51.9% 267.00 ± 3% interrupts.CPU88.PMI:Performance_monitoring_interrupts
176.00 ± 22% +47.6% 259.75 interrupts.CPU89.NMI:Non-maskable_interrupts
176.00 ± 22% +47.6% 259.75 interrupts.CPU89.PMI:Performance_monitoring_interrupts
173.75 ± 21% +47.2% 255.75 interrupts.CPU90.NMI:Non-maskable_interrupts
173.75 ± 21% +47.2% 255.75 interrupts.CPU90.PMI:Performance_monitoring_interrupts
177.50 ± 21% +43.2% 254.25 ± 2% interrupts.CPU91.NMI:Non-maskable_interrupts
177.50 ± 21% +43.2% 254.25 ± 2% interrupts.CPU91.PMI:Performance_monitoring_interrupts
176.25 ± 20% +45.4% 256.25 interrupts.CPU93.NMI:Non-maskable_interrupts
176.25 ± 20% +45.4% 256.25 interrupts.CPU93.PMI:Performance_monitoring_interrupts
177.00 ± 19% +46.0% 258.50 interrupts.CPU94.NMI:Non-maskable_interrupts
177.00 ± 19% +46.0% 258.50 interrupts.CPU94.PMI:Performance_monitoring_interrupts
193.75 ± 17% +34.2% 260.00 interrupts.CPU95.NMI:Non-maskable_interrupts
193.75 ± 17% +34.2% 260.00 interrupts.CPU95.PMI:Performance_monitoring_interrupts
7317 -55.3% 3270 ± 4% interrupts.CPU96.NMI:Non-maskable_interrupts
7317 -55.3% 3270 ± 4% interrupts.CPU96.PMI:Performance_monitoring_interrupts
142.50 ± 20% -72.6% 39.00 ± 6% interrupts.CPU96.RES:Rescheduling_interrupts
7113 ± 4% -65.5% 2451 ± 36% interrupts.CPU97.NMI:Non-maskable_interrupts
7113 ± 4% -65.5% 2451 ± 36% interrupts.CPU97.PMI:Performance_monitoring_interrupts
124.50 ± 2% -59.4% 50.50 ± 56% interrupts.CPU97.RES:Rescheduling_interrupts
6402 ± 24% -61.7% 2451 ± 36% interrupts.CPU98.NMI:Non-maskable_interrupts
6402 ± 24% -61.7% 2451 ± 36% interrupts.CPU98.PMI:Performance_monitoring_interrupts
120.75 ± 2% -73.5% 32.00 ± 4% interrupts.CPU98.RES:Rescheduling_interrupts
6402 ± 24% -60.7% 2513 ± 33% interrupts.CPU99.NMI:Non-maskable_interrupts
6402 ± 24% -60.7% 2513 ± 33% interrupts.CPU99.PMI:Performance_monitoring_interrupts
420164 ± 17% -39.5% 254084 interrupts.NMI:Non-maskable_interrupts
420164 ± 17% -39.5% 254084 interrupts.PMI:Performance_monitoring_interrupts
115628 ± 22% -38.8% 70767 ± 16% interrupts.RES:Rescheduling_interrupts
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 4 months
- 5
- 6