October 2020 - LKP - Ml01.01.Org

[drm/i915] 04ff178484: phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second -30.4% regression

by kernel test robot

Greeting, FYI, we noticed a -30.4% regression of phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second due to commit: commit: 04ff1784840f5f954a656c7e8795c76467e29128 ("[Intel-gfx] [PATCH] drm/i915: Enable WaProgramMgsrForCorrectSliceSpecificMmioReads for Gen9") url: https://github.com/0day-ci/linux/commits/Cooper-Chiou/drm-i915-Enable-WaP... base: git://anongit.freedesktop.org/drm-intel for-linux-next in testcase: phoronix-test-suite on test machine: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory with following parameters: need_x: true test: supertuxkart-1.5.2 option_a: Fullscreen option_b: Ultimate option_c: 1 option_d: Gran Paradiso Island [Approximately 275k triangles; advanced graphics] cpufreq_governor: performance ucode: 0xd6 test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. test-url: http://www.phoronix-test-suite.com/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/need_x/option_a/option_b/option_c/option_d/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/true/Fullscreen/Ultimate/1/Gran Paradiso Island [Approximately 275k triangles; advanced graphics]/debian-x86_64-phoronix/lkp-kbl-nuc1/supertuxkart-1.5.2/phoronix-test-suite/0xd6 commit: 400d4953f1 ("drm/i915/pll: Centralize PLL_ENABLE register lookup") 04ff178484 ("drm/i915: Enable WaProgramMgsrForCorrectSliceSpecificMmioReads for Gen9") 400d4953f1f434d5 04ff1784840f5f954a656c7e879 ---------------- --------------------------- %stddev %change %stddev \ | \ 35.32 -30.4% 24.59 phoronix-test-suite.supertuxkart.1024x768.Fullscreen.Ultimate.1.GranParadisoIsland.frames_per_second 3638 ± 15% -39.2% 2211 ± 4% phoronix-test-suite.time.involuntary_context_switches 32.00 -30.5% 22.25 phoronix-test-suite.time.percent_of_cpu_this_job_got 36 +----------------------------------------------------------------------+ |.+.+..+.+.+.+..+.+.+.+.+..+.+.+.+..+.+.+.+.+..+.+.+.+.+..+ +.+..+.+.| 34 |-+ | | | | | 32 |-+ | | | 30 |-+ | | | 28 |-+ | | | | | 26 |-+ | | O O O O O O O O O O O O O O O O O O O O O O | 24 +----------------------------------------------------------------------+ phoronix-test-suite.time.percent_of_cpu_this_job_got 32 +----------------------------------------------------------------------+ | + +. + + +.+.+. | 30 |-+ | | | | | 28 |-+ | | | 26 |-+ | | | 24 |-+ | | O O | | | 22 |-O O O O O O O O O O O O O O O O O O O | | O | 20 +----------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

1 year, 4 months

3
4
0 / 0

[sched/fair] 3c29e651e1: hackbench.throughput -15.2% regression

by kernel test robot

Greeting, FYI, we noticed a -15.2% regression of hackbench.throughput due to commit: commit: 3c29e651e16dd3b3179cfb2d055ee9538e37515c ("sched/fair: Fall back to sched-idle CPU if idle CPU isn't found") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: hackbench on test machine: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory with following parameters: nr_threads: 100% mode: threads ipc: pipe cpufreq_governor: performance ucode: 0xca test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler. test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc... In addition to that, the commit also has significant impact on the following tests: +------------------+-----------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput -11.3% regression | | test machine | 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 256G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | iterations=18 | | | mode=threads | | | nr_threads=1600% | | | ucode=0x43 | +------------------+-----------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput -10.6% regression | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | mode=process | | | nr_threads=50% | | | ucode=0xb000038 | +------------------+-----------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput -6.8% regression | | test machine | 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | mode=threads | | | nr_threads=100% | | | ucode=0xb8 | +------------------+-----------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/threads/100%/debian-x86_64-20191114.cgz/lkp-cfl-e1/hackbench/0xca commit: 43e9f7f231 ("sched/fair: Start tracking SCHED_IDLE tasks count in cfs_rq") 3c29e651e1 ("sched/fair: Fall back to sched-idle CPU if idle CPU isn't found") 43e9f7f231e40e45 3c29e651e16dd3b3179cfb2d055 ---------------- --------------------------- %stddev %change %stddev \ | \ 69492 ± 3% -15.2% 58899 hackbench.throughput 7.727e+08 ± 7% +38.3% 1.069e+09 ± 2% hackbench.time.involuntary_context_switches 131708 ± 4% -15.4% 111382 hackbench.time.minor_page_faults 684.98 ± 2% -2.5% 667.72 hackbench.time.user_time 1.755e+09 ± 2% +11.2% 1.953e+09 hackbench.time.voluntary_context_switches 4.32e+08 ± 4% -15.6% 3.648e+08 hackbench.workload 186.50 ± 12% -16.6% 155.50 ± 11% interrupts.TLB:TLB_shootdowns 4147892 ± 5% +19.6% 4961643 vmstat.system.cs 0.72 ± 10% -0.1 0.58 ± 17% mpstat.cpu.all.idle% 0.00 ±156% +0.0 0.01 ± 62% mpstat.cpu.all.soft% 1038 ± 9% +18.5% 1230 ± 4% slabinfo.avc_xperms_data.active_objs 1038 ± 9% +18.5% 1230 ± 4% slabinfo.avc_xperms_data.num_objs 40647036 ± 10% -34.6% 26589504 proc-vmstat.numa_hit 40647036 ± 10% -34.6% 26589504 proc-vmstat.numa_local 40724029 ± 10% -34.5% 26661546 proc-vmstat.pgalloc_normal 763906 ± 2% -7.5% 706781 proc-vmstat.pgfault 40701242 ± 10% -34.6% 26637947 proc-vmstat.pgfree 1636058 ± 11% -45.0% 899629 ± 11% turbostat.C1 0.10 ± 7% -0.0 0.07 ± 7% turbostat.C1% 15201 ± 25% +113.3% 32422 ± 8% turbostat.C1E 0.01 ± 57% +0.0 0.03 ± 13% turbostat.C1E% 9093 ± 11% +217.2% 28841 ± 11% turbostat.C3 0.00 ±173% +0.0 0.03 ± 13% turbostat.C3% 16977 ± 2% -92.8% 1222 ± 98% turbostat.C8 0.17 ± 4% -0.2 0.01 ±110% turbostat.C8% 0.13 -100.0% 0.00 turbostat.CPU%c7 9623106 ± 5% -35.1% 6241651 ± 8% cpuidle.C1.time 1636668 ± 11% -45.0% 899926 ± 11% cpuidle.C1.usage 899494 ± 33% +272.6% 3351412 ± 5% cpuidle.C1E.time 15327 ± 25% +112.6% 32592 ± 8% cpuidle.C1E.usage 435674 ± 20% +643.5% 3239351 ± 14% cpuidle.C3.time 9179 ± 11% +215.2% 28933 ± 11% cpuidle.C3.usage 16850924 ± 2% -94.2% 979516 ± 86% cpuidle.C8.time 17150 ± 2% -92.0% 1378 ± 88% cpuidle.C8.usage 6022328 ± 18% -57.1% 2584773 ± 7% cpuidle.POLL.time 5339703 ± 19% -60.1% 2130089 ± 7% cpuidle.POLL.usage 14.06 ± 25% +64.0% 23.07 ± 13% sched_debug.cfs_rq:/.runnable_load_avg.min 25.10 ± 5% -15.8% 21.12 ± 7% sched_debug.cfs_rq:/.runnable_load_avg.stddev 13339 ± 24% +45.7% 19433 ± 7% sched_debug.cfs_rq:/.runnable_weight.min 166.51 ± 24% +48.9% 247.86 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.min 253.56 ± 2% -12.3% 222.30 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.stddev 159602 ± 23% +55.6% 248411 ± 6% sched_debug.cpu.avg_idle.max 51567 ± 24% +49.1% 76905 ± 11% sched_debug.cpu.avg_idle.stddev 11576 ± 5% -9.5% 10478 sched_debug.cpu.curr->pid.avg 9976 ± 8% -16.8% 8305 ± 9% sched_debug.cpu.curr->pid.min 4.81 ± 15% +43.3% 6.89 ± 8% sched_debug.cpu.nr_running.min 6.68 ± 4% -17.0% 5.54 ± 8% sched_debug.cpu.nr_running.stddev 76003928 ± 2% +21.0% 91975904 sched_debug.cpu.nr_switches.avg 78115404 ± 2% +23.4% 96397551 sched_debug.cpu.nr_switches.max 74275755 ± 2% +19.0% 88359903 sched_debug.cpu.nr_switches.min 1043054 ± 15% +83.9% 1917752 ± 10% sched_debug.cpu.nr_switches.stddev -685.26 +64.8% -1129 sched_debug.cpu.nr_uninterruptible.min 15470 ± 9% -31.0% 10674 ± 9% softirqs.CPU0.SCHED 13756 ± 10% -40.8% 8140 ± 4% softirqs.CPU1.SCHED 13645 ± 11% -39.7% 8227 ± 3% softirqs.CPU10.SCHED 14065 ± 12% -38.8% 8609 ± 2% softirqs.CPU11.SCHED 13948 ± 11% -39.9% 8381 ± 6% softirqs.CPU12.SCHED 13823 ± 12% -39.7% 8332 ± 9% softirqs.CPU13.SCHED 73323 +13.4% 83165 ± 11% softirqs.CPU14.RCU 13872 ± 12% -36.5% 8809 ± 7% softirqs.CPU14.SCHED 13726 ± 12% -40.4% 8175 ± 4% softirqs.CPU15.SCHED 13780 ± 11% -34.8% 8987 ± 12% softirqs.CPU2.SCHED 13895 ± 10% -40.5% 8266 ± 6% softirqs.CPU3.SCHED 221879 +13.4% 251589 ± 14% softirqs.CPU3.TIMER 13873 ± 10% -40.4% 8262 ± 6% softirqs.CPU4.SCHED 72625 +12.0% 81355 ± 10% softirqs.CPU5.RCU 13876 ± 13% -41.4% 8137 ± 3% softirqs.CPU5.SCHED 14118 ± 12% -40.8% 8354 ± 3% softirqs.CPU6.SCHED 13503 ± 12% -40.0% 8099 softirqs.CPU7.SCHED 13549 ± 11% -38.2% 8374 ± 8% softirqs.CPU8.SCHED 14273 ± 10% -40.1% 8548 ± 6% softirqs.CPU9.SCHED 223184 ± 11% -38.9% 136383 ± 5% softirqs.SCHED 55.80 +9.9% 61.34 perf-stat.i.MPKI 1.32 +0.1 1.39 perf-stat.i.branch-miss-rate% 1.066e+08 +3.7% 1.105e+08 perf-stat.i.branch-misses 0.15 ± 8% -0.0 0.11 ± 3% perf-stat.i.cache-miss-rate% 2521584 ± 9% -26.5% 1854353 ± 3% perf-stat.i.cache-misses 2.27e+09 +8.0% 2.451e+09 perf-stat.i.cache-references 4162783 ± 4% +19.7% 4981708 perf-stat.i.context-switches 1.52 +2.0% 1.55 perf-stat.i.cpi 227633 ± 14% +75.1% 398694 ± 3% perf-stat.i.cpu-migrations 33931 ± 12% +42.7% 48428 ± 2% perf-stat.i.cycles-between-cache-misses 0.01 -0.0 0.01 ± 4% perf-stat.i.dTLB-load-miss-rate% 1408442 ± 2% -16.4% 1177727 ± 4% perf-stat.i.dTLB-load-misses 1.229e+10 -2.1% 1.203e+10 perf-stat.i.dTLB-loads 0.00 ± 2% -0.0 0.00 ± 4% perf-stat.i.dTLB-store-miss-rate% 35757 ± 2% -16.0% 30032 ± 3% perf-stat.i.dTLB-store-misses 7.449e+09 -2.3% 7.279e+09 perf-stat.i.dTLB-stores 39246970 -5.5% 37079604 perf-stat.i.iTLB-load-misses 76813 ± 8% -26.2% 56724 ± 6% perf-stat.i.iTLB-loads 4.096e+10 -1.9% 4.02e+10 perf-stat.i.instructions 1062 +4.1% 1105 perf-stat.i.instructions-per-iTLB-miss 0.66 -1.9% 0.65 perf-stat.i.ipc 1210 -7.1% 1124 perf-stat.i.minor-faults 105889 ± 10% -24.8% 79596 ± 5% perf-stat.i.node-loads 174508 ± 7% -24.4% 131915 perf-stat.i.node-stores 1210 -7.1% 1124 perf-stat.i.page-faults 55.42 ± 2% +10.0% 60.98 perf-stat.overall.MPKI 1.31 +0.1 1.38 perf-stat.overall.branch-miss-rate% 0.11 ± 11% -0.0 0.08 ± 3% perf-stat.overall.cache-miss-rate% 1.51 +1.9% 1.54 perf-stat.overall.cpi 24740 ± 9% +34.9% 33377 ± 3% perf-stat.overall.cycles-between-cache-misses 0.01 -0.0 0.01 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.00 ± 2% -0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate% 1043 +3.9% 1084 perf-stat.overall.instructions-per-iTLB-miss 0.66 -1.9% 0.65 perf-stat.overall.ipc 57826 ± 3% +15.6% 66874 perf-stat.overall.path-length 1.064e+08 +3.7% 1.104e+08 perf-stat.ps.branch-misses 2517524 ± 9% -26.5% 1851335 ± 3% perf-stat.ps.cache-misses 2.266e+09 +8.0% 2.447e+09 perf-stat.ps.cache-references 4155898 ± 4% +19.7% 4973458 perf-stat.ps.context-switches 227258 ± 14% +75.1% 398041 ± 3% perf-stat.ps.cpu-migrations 1406119 ± 2% -16.4% 1175777 ± 4% perf-stat.ps.dTLB-load-misses 1.227e+10 -2.1% 1.201e+10 perf-stat.ps.dTLB-loads 35699 ± 2% -16.0% 29983 ± 3% perf-stat.ps.dTLB-store-misses 7.437e+09 -2.3% 7.267e+09 perf-stat.ps.dTLB-stores 39182154 -5.5% 37018206 perf-stat.ps.iTLB-load-misses 76695 ± 8% -26.2% 56638 ± 6% perf-stat.ps.iTLB-loads 4.09e+10 -1.9% 4.013e+10 perf-stat.ps.instructions 1208 -7.1% 1122 perf-stat.ps.minor-faults 105716 ± 10% -24.8% 79465 ± 5% perf-stat.ps.node-loads 174234 ± 7% -24.4% 131703 perf-stat.ps.node-stores 1208 -7.1% 1122 perf-stat.ps.page-faults 29.39 ±104% -29.4 0.00 perf-profile.calltrace.cycles-pp.start_thread 15.86 ±105% -15.9 0.00 perf-profile.calltrace.cycles-pp.__GI___libc_write.start_thread 14.88 ±105% -14.9 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 14.75 ±105% -14.8 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 13.53 ±104% -13.5 0.00 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 12.51 ±104% -12.5 0.00 perf-profile.calltrace.cycles-pp.__GI___libc_read.start_thread 12.45 ±105% -12.4 0.00 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 11.21 ±105% -11.2 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 11.08 ±105% -11.1 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 10.47 ±105% -10.5 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 9.73 ±105% -9.7 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 3.09 ± 12% -0.6 2.50 ± 2% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 2.45 ± 14% -0.5 1.95 ± 2% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 1.15 ± 13% -0.2 0.95 ± 4% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 0.99 ± 13% -0.2 0.83 ± 5% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write 0.92 ± 15% +0.2 1.10 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.84 ± 23% +0.3 1.10 ± 2% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.99 ± 19% +0.3 1.26 ± 3% perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.97 ± 23% +0.3 1.26 perf-profile.calltrace.cycles-pp.__enqueue_entity.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.29 ±100% +0.3 0.60 ± 5% perf-profile.calltrace.cycles-pp.reschedule_interrupt.__lock_text_start.__wake_up_common_lock.pipe_write.new_sync_write 0.55 ± 62% +0.3 0.89 ± 7% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.dequeue_task_fair.__schedule.schedule 0.28 ±100% +0.4 0.63 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule.exit_to_usermode_loop 0.33 ±100% +0.4 0.69 ± 2% perf-profile.calltrace.cycles-pp.prepare_to_wait.pipe_wait.pipe_read.new_sync_read.vfs_read 0.29 ±100% +0.4 0.65 ± 4% perf-profile.calltrace.cycles-pp.___perf_sw_event.__schedule.schedule.pipe_wait.pipe_read 1.00 ± 27% +0.4 1.37 ± 2% perf-profile.calltrace.cycles-pp.check_preempt_wakeup.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function 0.57 ± 63% +0.4 0.95 ± 5% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate 1.46 ± 31% +0.4 1.86 ± 2% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.72 ± 60% +0.4 1.14 ± 2% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.29 ±100% +0.4 0.70 ± 6% perf-profile.calltrace.cycles-pp.pick_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.34 ±100% +0.4 0.77 ± 7% perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task 1.26 ± 26% +0.5 1.72 perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common 1.13 ± 26% +0.5 1.59 perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.35 ±100% +0.5 0.83 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 1.28 ± 28% +0.5 1.77 ± 3% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 1.40 ± 26% +0.5 1.89 perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.44 ±100% +0.5 0.95 ± 7% perf-profile.calltrace.cycles-pp.put_prev_entity.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop 2.33 ± 17% +0.5 2.88 ± 2% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read 1.33 ± 28% +0.6 1.89 ± 2% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 1.40 ± 24% +0.6 1.97 ± 4% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 0.83 ± 66% +0.6 1.40 ± 5% perf-profile.calltrace.cycles-pp.native_write_msr 5.01 ± 8% +0.8 5.81 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 1.75 ± 39% +0.9 2.61 ± 6% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 1.33 ± 67% +1.0 2.28 ± 6% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.56 ± 12% +1.2 7.78 perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read 8.96 ± 9% +1.6 10.56 perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 9.23 ± 10% +1.6 10.87 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 9.17 ± 10% +1.6 10.81 perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 3.72 ± 31% +1.7 5.44 ± 6% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.37 ± 8% +1.9 5.32 ± 4% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 4.37 ± 10% +2.3 6.65 ± 5% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 15.27 ± 10% +2.3 17.59 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 15.59 ± 10% +2.4 17.96 perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 3.00 ± 71% +2.6 5.60 ± 6% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.10 ± 71% +2.7 5.77 ± 6% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 18.05 ± 10% +2.7 20.73 perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 28.21 ± 5% +3.7 31.87 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 24.29 ± 8% +4.7 28.98 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 23.38 ± 8% +4.7 28.08 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 23.72 ± 8% +4.7 28.43 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 31.18 ± 41% +12.7 43.86 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 33.44 ± 40% +13.2 46.61 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 64.81 ± 43% +27.5 92.34 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 65.30 ± 43% +27.7 92.99 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 29.39 ±104% -29.4 0.00 perf-profile.children.cycles-pp.start_thread 16.09 ±105% -16.1 0.00 perf-profile.children.cycles-pp.__GI___libc_write 12.73 ±104% -12.7 0.00 perf-profile.children.cycles-pp.__GI___libc_read 5.80 ± 10% -1.2 4.65 ± 3% perf-profile.children.cycles-pp.security_file_permission 4.10 ± 16% -1.0 3.10 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 3.21 ± 9% -0.7 2.55 ± 3% perf-profile.children.cycles-pp.copy_page_to_iter 1.45 ± 32% -0.6 0.83 perf-profile.children.cycles-pp.entry_SYSCALL_64 3.04 ± 8% -0.6 2.44 ± 3% perf-profile.children.cycles-pp.selinux_file_permission 2.56 ± 11% -0.6 1.99 ± 2% perf-profile.children.cycles-pp.copy_page_from_iter 2.80 ± 9% -0.5 2.25 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 3.38 ± 7% -0.5 2.87 ± 2% perf-profile.children.cycles-pp.mutex_lock 1.62 ± 12% -0.4 1.23 ± 3% perf-profile.children.cycles-pp.___might_sleep 1.82 ± 9% -0.4 1.43 ± 4% perf-profile.children.cycles-pp.syscall_return_via_sysret 2.09 ± 12% -0.4 1.72 ± 6% perf-profile.children.cycles-pp.file_has_perm 0.90 ± 20% -0.3 0.57 ± 9% perf-profile.children.cycles-pp.__mutex_lock 1.14 ± 12% -0.3 0.82 ± 3% perf-profile.children.cycles-pp.__inode_security_revalidate 1.26 ± 10% -0.3 0.97 ± 4% perf-profile.children.cycles-pp.copyin 1.70 ± 8% -0.3 1.42 ± 3% perf-profile.children.cycles-pp.copyout 1.25 ± 11% -0.3 0.98 ± 3% perf-profile.children.cycles-pp.fsnotify 1.04 ± 9% -0.3 0.79 ± 3% perf-profile.children.cycles-pp._cond_resched 1.72 ± 7% -0.2 1.48 ± 5% perf-profile.children.cycles-pp.fput_many 1.16 ± 10% -0.2 0.92 ± 4% perf-profile.children.cycles-pp.__might_sleep 1.09 ± 8% -0.2 0.85 ± 3% perf-profile.children.cycles-pp.__fsnotify_parent 0.83 ± 13% -0.2 0.63 ± 3% perf-profile.children.cycles-pp.__might_fault 0.69 ± 11% -0.1 0.56 perf-profile.children.cycles-pp.current_time 0.99 ± 4% -0.1 0.89 ± 4% perf-profile.children.cycles-pp.touch_atime 0.65 ± 6% -0.1 0.55 ± 6% perf-profile.children.cycles-pp.atime_needs_update 0.39 ± 4% -0.1 0.29 perf-profile.children.cycles-pp.rcu_all_qs 0.13 ± 39% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.34 ± 11% -0.1 0.26 ± 9% perf-profile.children.cycles-pp.preempt_schedule_common 0.49 ± 5% -0.1 0.41 ± 2% perf-profile.children.cycles-pp.wake_up_q 0.24 ± 2% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.fpregs_assert_state_consistent 0.30 ± 11% -0.1 0.23 ± 3% perf-profile.children.cycles-pp.inode_has_perm 0.23 ± 8% -0.1 0.18 ± 6% perf-profile.children.cycles-pp.__sb_end_write 0.21 ± 9% -0.1 0.16 ± 9% perf-profile.children.cycles-pp.__x64_sys_read 0.29 ± 8% -0.0 0.24 ± 2% perf-profile.children.cycles-pp.timespec64_trunc 0.21 ± 8% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.__x64_sys_write 0.22 ± 7% -0.0 0.19 ± 2% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.08 ± 16% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.bpf_fd_pass 0.10 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.perf_exclude_event 0.08 ± 24% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.rcu_note_context_switch 0.17 ± 19% +0.1 0.24 ± 8% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.23 ± 19% +0.1 0.32 ± 3% perf-profile.children.cycles-pp.resched_curr 0.61 ± 8% +0.1 0.72 ± 6% perf-profile.children.cycles-pp.sched_clock 0.67 ± 8% +0.1 0.78 ± 6% perf-profile.children.cycles-pp.sched_clock_cpu 0.50 ± 9% +0.1 0.62 ± 3% perf-profile.children.cycles-pp.account_entity_enqueue 0.61 ± 10% +0.2 0.79 perf-profile.children.cycles-pp.account_entity_dequeue 0.43 ± 19% +0.2 0.62 ± 7% perf-profile.children.cycles-pp.clear_buddies 1.42 ± 14% +0.2 1.66 ± 4% perf-profile.children.cycles-pp.native_write_msr 1.17 ± 13% +0.3 1.42 ± 2% perf-profile.children.cycles-pp.check_preempt_wakeup 0.85 ± 23% +0.3 1.12 ± 7% perf-profile.children.cycles-pp.put_prev_entity 0.94 ± 14% +0.3 1.22 ± 5% perf-profile.children.cycles-pp.___perf_sw_event 1.45 ± 11% +0.3 1.73 perf-profile.children.cycles-pp.check_preempt_curr 1.45 ± 12% +0.3 1.76 perf-profile.children.cycles-pp.__enqueue_entity 1.60 ± 10% +0.3 1.91 perf-profile.children.cycles-pp.ttwu_do_wakeup 1.12 ± 9% +0.3 1.43 ± 3% perf-profile.children.cycles-pp.__update_load_avg_se 1.64 ± 8% +0.4 2.00 ± 4% perf-profile.children.cycles-pp.available_idle_cpu 0.96 ± 19% +0.4 1.34 ± 7% perf-profile.children.cycles-pp.pick_next_entity 1.85 ± 16% +0.4 2.28 ± 6% perf-profile.children.cycles-pp.switch_fpu_return 1.90 ± 9% +0.6 2.50 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 3.22 ± 13% +0.6 3.87 perf-profile.children.cycles-pp.update_load_avg 4.03 ± 10% +0.6 4.68 ± 2% perf-profile.children.cycles-pp.update_curr 3.01 ± 14% +0.7 3.72 ± 2% perf-profile.children.cycles-pp.reweight_entity 5.10 ± 8% +0.8 5.87 ± 2% perf-profile.children.cycles-pp.enqueue_entity 4.71 ± 15% +1.1 5.77 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair 6.73 ± 11% +1.1 7.87 perf-profile.children.cycles-pp.dequeue_task_fair 9.07 ± 9% +1.5 10.61 perf-profile.children.cycles-pp.enqueue_task_fair 9.32 ± 9% +1.6 10.89 perf-profile.children.cycles-pp.ttwu_do_activate 91.46 +1.6 93.03 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 9.27 ± 9% +1.6 10.84 perf-profile.children.cycles-pp.activate_task 4.16 ± 26% +1.6 5.78 ± 6% perf-profile.children.cycles-pp.exit_to_usermode_loop 90.79 +1.7 92.47 perf-profile.children.cycles-pp.do_syscall_64 3.48 ± 8% +1.9 5.36 ± 4% perf-profile.children.cycles-pp.select_idle_sibling 4.44 ± 10% +2.2 6.67 ± 5% perf-profile.children.cycles-pp.select_task_rq_fair 18.46 ± 9% +2.3 20.81 perf-profile.children.cycles-pp.pipe_wait 19.93 ± 11% +3.5 23.46 ± 2% perf-profile.children.cycles-pp.__schedule 28.82 ± 5% +3.6 32.45 perf-profile.children.cycles-pp.__wake_up_common_lock 19.89 ± 12% +3.7 23.62 ± 2% perf-profile.children.cycles-pp.schedule 23.96 ± 8% +4.5 28.45 perf-profile.children.cycles-pp.try_to_wake_up 24.53 ± 8% +4.5 29.06 perf-profile.children.cycles-pp.__wake_up_common 23.91 ± 8% +4.6 28.46 perf-profile.children.cycles-pp.autoremove_wake_function 2.76 ± 9% -0.5 2.23 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.46 ± 18% -0.4 1.06 ± 4% perf-profile.self.cycles-pp.pipe_write 1.81 ± 9% -0.4 1.43 ± 4% perf-profile.self.cycles-pp.syscall_return_via_sysret 1.56 ± 12% -0.4 1.19 ± 3% perf-profile.self.cycles-pp.___might_sleep 2.09 ± 7% -0.3 1.81 ± 2% perf-profile.self.cycles-pp.mutex_lock 1.86 ± 8% -0.3 1.59 ± 3% perf-profile.self.cycles-pp.selinux_file_permission 1.21 ± 11% -0.3 0.96 ± 2% perf-profile.self.cycles-pp.fsnotify 1.70 ± 7% -0.2 1.46 ± 5% perf-profile.self.cycles-pp.fput_many 1.04 ± 11% -0.2 0.82 ± 3% perf-profile.self.cycles-pp.__might_sleep 1.01 ± 8% -0.2 0.80 ± 3% perf-profile.self.cycles-pp.__fsnotify_parent 1.04 ± 10% -0.2 0.83 perf-profile.self.cycles-pp.entry_SYSCALL_64 0.67 ± 10% -0.2 0.51 ± 5% perf-profile.self.cycles-pp.new_sync_write 0.64 ± 12% -0.2 0.48 ± 5% perf-profile.self.cycles-pp.vfs_write 1.67 -0.2 1.51 ± 2% perf-profile.self.cycles-pp.pipe_read 0.58 ± 17% -0.1 0.44 ± 7% perf-profile.self.cycles-pp.file_has_perm 0.44 ± 18% -0.1 0.31 ± 7% perf-profile.self.cycles-pp.__mutex_lock 0.49 ± 13% -0.1 0.35 ± 3% perf-profile.self.cycles-pp.copy_page_from_iter 0.64 ± 8% -0.1 0.52 ± 4% perf-profile.self.cycles-pp.copy_page_to_iter 0.67 ± 7% -0.1 0.55 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.30 ± 5% -0.1 0.20 ± 4% perf-profile.self.cycles-pp.ksys_write 0.40 ± 12% -0.1 0.30 ± 7% perf-profile.self.cycles-pp.security_file_permission 0.13 ± 38% -0.1 0.04 ± 59% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.36 ± 11% -0.1 0.28 ± 3% perf-profile.self.cycles-pp.__inode_security_revalidate 0.76 ± 5% -0.1 0.68 ± 5% perf-profile.self.cycles-pp.do_syscall_64 0.21 ± 2% -0.1 0.14 ± 8% perf-profile.self.cycles-pp.fpregs_assert_state_consistent 0.26 ± 12% -0.1 0.20 ± 4% perf-profile.self.cycles-pp.inode_has_perm 0.29 ± 11% -0.1 0.23 ± 6% perf-profile.self.cycles-pp.current_time 0.28 ± 4% -0.1 0.21 ± 2% perf-profile.self.cycles-pp.rcu_all_qs 0.22 ± 7% -0.1 0.17 ± 7% perf-profile.self.cycles-pp.__sb_end_write 0.31 -0.1 0.26 ± 7% perf-profile.self.cycles-pp.ksys_read 0.20 ± 11% -0.0 0.16 ± 9% perf-profile.self.cycles-pp.__x64_sys_read 0.26 ± 8% -0.0 0.22 perf-profile.self.cycles-pp.timespec64_trunc 0.20 ± 5% -0.0 0.16 ± 9% perf-profile.self.cycles-pp.__x64_sys_write 0.24 ± 9% -0.0 0.21 ± 6% perf-profile.self.cycles-pp.__might_fault 0.09 ± 9% -0.0 0.06 perf-profile.self.cycles-pp.copyin 0.14 ± 5% -0.0 0.12 ± 3% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.07 ± 10% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.sched_clock 0.16 ± 5% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.ttwu_do_wakeup 0.20 ± 12% +0.0 0.24 ± 5% perf-profile.self.cycles-pp.__list_add_valid 0.10 ± 26% +0.0 0.14 ± 10% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.15 ± 16% +0.1 0.21 ± 11% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.35 ± 7% +0.1 0.43 ± 4% perf-profile.self.cycles-pp.prepare_to_wait 0.55 ± 2% +0.1 0.63 ± 3% perf-profile.self.cycles-pp.__fget_light 0.22 ± 18% +0.1 0.30 ± 3% perf-profile.self.cycles-pp.resched_curr 0.48 ± 11% +0.1 0.58 ± 3% perf-profile.self.cycles-pp.check_preempt_wakeup 0.39 ± 11% +0.1 0.50 perf-profile.self.cycles-pp.account_entity_enqueue 0.85 ± 7% +0.1 0.97 ± 4% perf-profile.self.cycles-pp.enqueue_entity 0.43 ± 16% +0.1 0.55 ± 7% perf-profile.self.cycles-pp.pick_next_entity 0.86 ± 10% +0.1 0.99 perf-profile.self.cycles-pp.dequeue_task_fair 0.37 ± 21% +0.2 0.55 ± 6% perf-profile.self.cycles-pp.clear_buddies 0.45 ± 14% +0.2 0.65 perf-profile.self.cycles-pp.account_entity_dequeue 1.41 ± 14% +0.2 1.65 ± 4% perf-profile.self.cycles-pp.native_write_msr 0.80 ± 16% +0.3 1.06 ± 4% perf-profile.self.cycles-pp.___perf_sw_event 1.09 ± 9% +0.3 1.39 ± 2% perf-profile.self.cycles-pp.__update_load_avg_se 0.84 ± 16% +0.3 1.14 ± 7% perf-profile.self.cycles-pp.select_task_rq_fair 1.45 ± 12% +0.3 1.75 perf-profile.self.cycles-pp.__enqueue_entity 1.62 ± 8% +0.4 1.99 ± 4% perf-profile.self.cycles-pp.available_idle_cpu 1.83 ± 16% +0.4 2.25 ± 6% perf-profile.self.cycles-pp.switch_fpu_return 2.15 ± 11% +0.5 2.60 ± 5% perf-profile.self.cycles-pp.update_curr 1.88 ± 9% +0.6 2.45 ± 3% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 1.21 ± 9% +0.7 1.92 ± 3% perf-profile.self.cycles-pp._raw_spin_lock 0.80 ± 11% +1.4 2.17 ± 3% perf-profile.self.cycles-pp.select_idle_sibling hackbench.throughput 74000 +-+-----------------------------------------------------------------+ 72000 +-+.+ .+ | |.+ : .+. .+. + | 70000 +-+ : + + +. : | 68000 +-+ + + : | | :: | 66000 +-+ + | 64000 +-+ | 62000 +-+ | | | 60000 +-+ O O OO O O O O O O O OO | 58000 +-+ O O O O O O O O O O O | O O OO O O | 56000 O-+ O O O O O O | 54000 +-O-----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-hsw-ep4: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 256G memory ========================================================================================= compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/18/x86_64-rhel-7.6/threads/1600%/debian-x86_64-2019-11-14.cgz/lkp-hsw-ep4/hackbench/0x43 commit: 43e9f7f231 ("sched/fair: Start tracking SCHED_IDLE tasks count in cfs_rq") 3c29e651e1 ("sched/fair: Fall back to sched-idle CPU if idle CPU isn't found") 43e9f7f231e40e45 3c29e651e16dd3b3179cfb2d055 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 176075 ± 2% -11.3% 156152 hackbench.throughput 891.79 +12.3% 1001 hackbench.time.elapsed_time 891.79 +12.3% 1001 hackbench.time.elapsed_time.max 1.889e+09 ± 9% +33.1% 2.514e+09 ± 3% hackbench.time.involuntary_context_switches 42939 ± 3% +17.0% 50220 hackbench.time.system_time 18978 +3.2% 19592 hackbench.time.user_time 2.558e+09 ± 8% +33.5% 3.415e+09 ± 2% hackbench.time.voluntary_context_switches 43133704 ± 3% +39.2% 60035429 ± 33% cpuidle.C1.time 48661 +17.7% 57274 ± 5% meminfo.Shmem 19043 ± 2% -14.0% 16377 meminfo.max_used_kB 2502 +1.3% 2535 turbostat.Avg_MHz 3.368e+08 ± 5% +30.6% 4.398e+08 turbostat.IRQ 66.25 +4.5% 69.25 vmstat.cpu.sy 29.25 ± 2% -8.5% 26.75 vmstat.cpu.us 5000443 ± 7% +18.6% 5931772 vmstat.system.cs 370173 ± 3% +17.1% 433616 vmstat.system.in 98786923 ± 7% +74.5% 1.724e+08 numa-numastat.node0.local_node 98791606 ± 7% +74.5% 1.724e+08 numa-numastat.node0.numa_hit 4686 ± 99% +297.8% 18642 ± 24% numa-numastat.node0.other_node 1.818e+08 -51.4% 88447082 ± 3% numa-numastat.node1.local_node 1.819e+08 -51.4% 88451833 ± 3% numa-numastat.node1.numa_hit 18694 ± 25% -74.6% 4753 ± 97% numa-numastat.node1.other_node 155316 +1.5% 157632 proc-vmstat.nr_active_anon 99.50 +5.3% 104.75 ± 3% proc-vmstat.nr_dirtied 4440 +4.9% 4656 proc-vmstat.nr_inactive_anon 6283 +1.9% 6399 proc-vmstat.nr_mapped 12248 ± 2% +16.6% 14276 ± 5% proc-vmstat.nr_shmem 98.75 +5.3% 104.00 proc-vmstat.nr_written 155316 +1.5% 157632 proc-vmstat.nr_zone_active_anon 4440 +4.9% 4656 proc-vmstat.nr_zone_inactive_anon 2.807e+08 -7.1% 2.609e+08 proc-vmstat.numa_hit 2.807e+08 -7.1% 2.609e+08 proc-vmstat.numa_local 2.83e+08 -7.0% 2.632e+08 proc-vmstat.pgalloc_normal 3212744 +2.3% 3286078 proc-vmstat.pgfault 2.828e+08 -7.0% 2.631e+08 proc-vmstat.pgfree 39216 ± 35% +153.3% 99342 ± 4% numa-vmstat.node0.nr_active_anon 31864 ± 44% +211.0% 99111 ± 4% numa-vmstat.node0.nr_anon_pages 11183 ± 3% +4212.8% 482321 ± 2% numa-vmstat.node0.nr_kernel_stack 499.50 ± 23% +66.9% 833.75 ± 8% numa-vmstat.node0.nr_page_table_pages 11417 -63.5% 4168 ± 5% numa-vmstat.node0.nr_shmem 15905 ± 4% -12.5% 13919 ± 2% numa-vmstat.node0.nr_slab_reclaimable 17996 ± 3% +587.4% 123708 ± 2% numa-vmstat.node0.nr_slab_unreclaimable 39216 ± 35% +153.3% 99342 ± 4% numa-vmstat.node0.nr_zone_active_anon 52471566 ± 6% +73.3% 90915199 numa-vmstat.node0.numa_hit 52466577 ± 6% +73.2% 90896366 numa-vmstat.node0.numa_local 4990 ± 92% +277.5% 18836 ± 24% numa-vmstat.node0.numa_other 114712 ± 12% -50.1% 57234 ± 7% numa-vmstat.node1.nr_active_anon 114545 ± 12% -58.2% 47874 ± 9% numa-vmstat.node1.nr_anon_pages 462075 -96.6% 15717 ± 67% numa-vmstat.node1.nr_kernel_stack 871.50 ± 13% -37.9% 541.00 ± 13% numa-vmstat.node1.nr_page_table_pages 691.25 ± 22% +1359.2% 10086 ± 8% numa-vmstat.node1.nr_shmem 11357 ± 5% +18.1% 13414 ± 4% numa-vmstat.node1.nr_slab_reclaimable 118594 -85.5% 17243 ± 16% numa-vmstat.node1.nr_slab_unreclaimable 114712 ± 12% -50.1% 57234 ± 7% numa-vmstat.node1.nr_zone_active_anon 93308245 ± 2% -49.7% 46921467 ± 4% numa-vmstat.node1.numa_hit 93128224 ± 2% -49.8% 46755145 ± 4% numa-vmstat.node1.numa_local 157762 ± 35% +154.4% 401333 ± 4% numa-meminfo.node0.Active 157721 ± 35% +154.4% 401249 ± 4% numa-meminfo.node0.Active(anon) 128232 ± 44% +212.2% 400337 ± 4% numa-meminfo.node0.AnonPages 63487 ± 4% -12.0% 55850 ± 2% numa-meminfo.node0.KReclaimable 11691 ± 3% +4087.3% 489553 numa-meminfo.node0.KernelStack 1170596 ± 4% +104.2% 2390602 numa-meminfo.node0.MemUsed 2003 ± 23% +67.3% 3351 ± 8% numa-meminfo.node0.PageTables 63487 ± 4% -12.0% 55850 ± 2% numa-meminfo.node0.SReclaimable 72301 ± 3% +591.9% 500285 numa-meminfo.node0.SUnreclaim 45749 -63.5% 16679 ± 5% numa-meminfo.node0.Shmem 135789 ± 3% +309.6% 556136 numa-meminfo.node0.Slab 460025 ± 11% -50.2% 228882 ± 7% numa-meminfo.node1.Active 459902 ± 11% -50.2% 228802 ± 7% numa-meminfo.node1.Active(anon) 459237 ± 11% -58.3% 191354 ± 9% numa-meminfo.node1.AnonPages 45568 ± 5% +17.8% 53657 ± 4% numa-meminfo.node1.KReclaimable 468955 -96.7% 15461 ± 67% numa-meminfo.node1.KernelStack 2241450 -51.9% 1078199 ± 3% numa-meminfo.node1.MemUsed 3493 ± 13% -38.0% 2167 ± 13% numa-meminfo.node1.PageTables 45568 ± 5% +17.8% 53657 ± 4% numa-meminfo.node1.SReclaimable 479010 -85.6% 68750 ± 16% numa-meminfo.node1.SUnreclaim 2779 ± 23% +1354.1% 40419 ± 8% numa-meminfo.node1.Shmem 524580 -76.7% 122408 ± 8% numa-meminfo.node1.Slab 250988 ± 19% -52.0% 120407 ± 33% sched_debug.cfs_rq:/.MIN_vruntime.avg 1469922 ± 14% -32.1% 998119 ± 33% sched_debug.cfs_rq:/.MIN_vruntime.stddev 20766 ± 9% -25.3% 15519 ± 10% sched_debug.cfs_rq:/.load.avg 43820 ± 19% -40.6% 26044 ± 36% sched_debug.cfs_rq:/.load.stddev 250988 ± 19% -52.0% 120407 ± 33% sched_debug.cfs_rq:/.max_vruntime.avg 1469922 ± 14% -32.1% 998119 ± 33% sched_debug.cfs_rq:/.max_vruntime.stddev 10990567 ± 9% +22.9% 13509735 ± 7% sched_debug.cfs_rq:/.min_vruntime.stddev 102.40 -33.3% 68.27 ± 57% sched_debug.cfs_rq:/.removed.load_avg.max 4711 -33.4% 3136 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.max 19930 ± 10% -25.1% 14917 ± 10% sched_debug.cfs_rq:/.runnable_weight.avg -5713498 -349.0% 14226386 ± 8% sched_debug.cfs_rq:/.spread0.avg 8106715 ± 13% +283.1% 31057182 ± 6% sched_debug.cfs_rq:/.spread0.max -18025645 -99.7% -45393 sched_debug.cfs_rq:/.spread0.min 11027552 ± 9% +21.5% 13398318 ± 7% sched_debug.cfs_rq:/.spread0.stddev 570.46 ± 5% +109.2% 1193 ± 21% sched_debug.cfs_rq:/.util_est_enqueued.avg 2898 ± 11% +90.0% 5507 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.max 563.27 ± 13% +149.3% 1404 ± 18% sched_debug.cfs_rq:/.util_est_enqueued.stddev 155578 ± 22% +84.1% 286457 ± 28% sched_debug.cpu.avg_idle.min 1678 ± 43% +105.9% 3457 ± 31% sched_debug.cpu.clock.stddev 1678 ± 43% +105.9% 3457 ± 31% sched_debug.cpu.clock_task.stddev 50207 -12.3% 44017 ± 7% sched_debug.cpu.curr->pid.avg 82673 -19.5% 66514 ± 5% sched_debug.cpu.curr->pid.max 746.05 ± 11% +554.3% 4881 ± 8% sched_debug.cpu.curr->pid.min 30728 ± 2% -40.8% 18187 ± 10% sched_debug.cpu.curr->pid.stddev 0.00 ± 43% +106.0% 0.00 ± 31% sched_debug.cpu.next_balance.stddev 20.49 ± 6% +149.0% 51.03 ± 23% sched_debug.cpu.nr_running.avg 157.83 ± 9% +77.0% 279.37 ± 8% sched_debug.cpu.nr_running.max 29.95 ± 11% +137.1% 70.99 ± 16% sched_debug.cpu.nr_running.stddev 29803727 ± 9% +29.6% 38623870 ± 3% sched_debug.cpu.nr_switches.avg 51549476 ± 10% +22.5% 63171598 ± 3% sched_debug.cpu.nr_switches.max 12792570 ± 3% +43.5% 18362678 ± 4% sched_debug.cpu.nr_switches.min 2.03 ± 80% +430.9% 10.76 ± 38% sched_debug.cpu.nr_uninterruptible.avg 6.99 ± 4% +48.7% 10.39 ± 5% perf-stat.i.MPKI 7.49 ± 5% -1.2 6.29 ± 5% perf-stat.i.cache-miss-rate% 27202880 ± 2% +46.9% 39966416 ± 2% perf-stat.i.cache-misses 4.662e+08 ± 5% +71.5% 7.998e+08 ± 5% perf-stat.i.cache-references 5989366 ± 4% +12.9% 6760958 ± 5% perf-stat.i.context-switches 197319 ± 12% -19.2% 159504 ± 3% perf-stat.i.cpu-migrations 7415 ± 2% -23.3% 5686 ± 3% perf-stat.i.cycles-between-cache-misses 0.61 ± 35% -0.3 0.35 ± 4% perf-stat.i.dTLB-load-miss-rate% 1.506e+08 ± 38% -44.9% 82967539 ± 5% perf-stat.i.dTLB-load-misses 0.22 ± 4% -0.0 0.20 ± 4% perf-stat.i.dTLB-store-miss-rate% 35974976 ± 5% -13.4% 31146077 ± 6% perf-stat.i.dTLB-store-misses 1.627e+10 -3.7% 1.566e+10 perf-stat.i.dTLB-stores 46665620 ± 3% -14.6% 39838962 ± 5% perf-stat.i.iTLB-load-misses 2191 ± 5% +21.4% 2660 ± 7% perf-stat.i.instructions-per-iTLB-miss 0.47 -2.5% 0.46 perf-stat.i.ipc 6660 ± 8% -19.1% 5391 ± 8% perf-stat.i.minor-faults 62.93 ± 2% +11.1 74.06 perf-stat.i.node-load-miss-rate% 12537290 ± 4% +73.5% 21750457 ± 4% perf-stat.i.node-load-misses 5459308 ± 3% -7.4% 5057404 ± 3% perf-stat.i.node-loads 29.39 ± 2% -4.1 25.29 ± 2% perf-stat.i.node-store-miss-rate% 2863317 +13.6% 3252632 ± 2% perf-stat.i.node-store-misses 6381925 ± 2% +53.5% 9796918 ± 4% perf-stat.i.node-stores 6638 ± 8% -19.4% 5348 ± 8% perf-stat.i.page-faults 4.89 ± 4% +78.4% 8.73 perf-stat.overall.MPKI 1.29 +0.0 1.31 perf-stat.overall.branch-miss-rate% 6.13 ± 4% -1.3 4.85 ± 3% perf-stat.overall.cache-miss-rate% 2.15 +2.0% 2.19 perf-stat.overall.cpi 7187 -27.9% 5182 ± 3% perf-stat.overall.cycles-between-cache-misses 0.63 ± 39% -0.3 0.36 ± 5% perf-stat.overall.dTLB-load-miss-rate% 0.23 ± 5% -0.0 0.21 ± 3% perf-stat.overall.dTLB-store-miss-rate% 75.65 -1.1 74.59 perf-stat.overall.iTLB-load-miss-rate% 1604 ± 3% +15.9% 1859 perf-stat.overall.instructions-per-iTLB-miss 0.47 -2.0% 0.46 perf-stat.overall.ipc 63.14 ± 2% +13.6 76.70 perf-stat.overall.node-load-miss-rate% 30.74 ± 2% -5.1 25.62 ± 2% perf-stat.overall.node-store-miss-rate% 47754 ± 2% +11.7% 53321 perf-stat.overall.path-length 24893507 +40.6% 34993733 ± 2% perf-stat.ps.cache-misses 4.072e+08 ± 5% +77.1% 7.212e+08 perf-stat.ps.cache-references 4968881 ± 7% +19.0% 5911450 perf-stat.ps.context-switches 1.789e+11 +1.3% 1.812e+11 perf-stat.ps.cpu-cycles 1.59e+08 ± 39% -44.1% 88801351 ± 6% perf-stat.ps.dTLB-load-misses 2.502e+10 -2.0% 2.453e+10 perf-stat.ps.dTLB-loads 39138578 ± 5% -12.6% 34190129 ± 3% perf-stat.ps.dTLB-store-misses 1.675e+10 -3.7% 1.613e+10 perf-stat.ps.dTLB-stores 51901139 ± 2% -14.3% 44461197 perf-stat.ps.iTLB-load-misses 16711264 ± 2% -9.3% 15153636 ± 2% perf-stat.ps.iTLB-loads 3573 -9.1% 3247 perf-stat.ps.minor-faults 10427704 ± 3% +73.2% 18055799 ± 3% perf-stat.ps.node-load-misses 6085553 ± 4% -10.0% 5479559 ± 2% perf-stat.ps.node-loads 2566511 +13.4% 2911367 ± 2% perf-stat.ps.node-store-misses 5784179 ± 2% +46.2% 8454210 ± 3% perf-stat.ps.node-stores 3573 -9.1% 3247 perf-stat.ps.page-faults 7.427e+13 ± 2% +11.7% 8.293e+13 perf-stat.total.instructions 127394 ± 5% +19.1% 151665 softirqs.CPU0.RCU 321761 ± 3% +12.8% 363107 ± 3% softirqs.CPU0.TIMER 124526 ± 5% +20.2% 149697 ± 3% softirqs.CPU1.RCU 123768 ± 4% +24.7% 154332 ± 2% softirqs.CPU10.RCU 130315 ± 3% +22.1% 159111 softirqs.CPU11.RCU 126684 ± 4% +26.1% 159755 ± 2% softirqs.CPU12.RCU 124649 ± 9% +27.8% 159298 ± 3% softirqs.CPU13.RCU 124528 ± 4% +23.2% 153372 ± 2% softirqs.CPU14.RCU 326150 ± 2% +9.8% 357991 ± 4% softirqs.CPU14.TIMER 121923 ± 6% +17.4% 143119 softirqs.CPU15.RCU 122114 ± 5% +16.7% 142560 softirqs.CPU16.RCU 121425 ± 6% +14.4% 138861 ± 3% softirqs.CPU17.RCU 330948 ± 2% +22.2% 404570 ± 16% softirqs.CPU17.TIMER 312317 ± 4% +18.2% 369091 ± 2% softirqs.CPU18.TIMER 9626 ± 2% +15.0% 11067 ± 3% softirqs.CPU19.SCHED 322308 ± 3% +21.1% 390454 ± 2% softirqs.CPU19.TIMER 124281 ± 5% +22.8% 152670 ± 2% softirqs.CPU2.RCU 9452 ± 2% +15.6% 10927 ± 3% softirqs.CPU20.SCHED 318575 ± 6% +22.3% 389741 ± 3% softirqs.CPU20.TIMER 9327 ± 3% +16.7% 10886 ± 3% softirqs.CPU21.SCHED 306628 ± 4% +23.3% 377962 ± 3% softirqs.CPU21.TIMER 9424 ± 2% +17.6% 11084 ± 3% softirqs.CPU22.SCHED 302796 ± 4% +24.2% 376126 ± 2% softirqs.CPU22.TIMER 9798 ± 2% +11.4% 10918 ± 4% softirqs.CPU23.SCHED 312009 ± 4% +23.6% 385626 ± 2% softirqs.CPU23.TIMER 9559 ± 3% +13.2% 10822 softirqs.CPU24.SCHED 311772 ± 4% +23.0% 383504 ± 2% softirqs.CPU24.TIMER 9514 ± 4% +13.2% 10766 ± 3% softirqs.CPU25.SCHED 307640 ± 4% +22.4% 376479 ± 2% softirqs.CPU25.TIMER 9573 ± 3% +13.8% 10897 ± 3% softirqs.CPU26.SCHED 314607 ± 9% +21.1% 380918 ± 2% softirqs.CPU26.TIMER 9385 +13.7% 10668 ± 2% softirqs.CPU27.SCHED 301949 ± 4% +25.2% 378140 ± 3% softirqs.CPU27.TIMER 9483 ± 2% +14.7% 10874 ± 2% softirqs.CPU28.SCHED 299462 ± 3% +24.9% 373896 ± 2% softirqs.CPU28.TIMER 9505 ± 3% +13.3% 10769 ± 3% softirqs.CPU29.SCHED 307087 ± 4% +23.8% 380066 ± 3% softirqs.CPU29.TIMER 124992 ± 4% +19.4% 149253 ± 3% softirqs.CPU3.RCU 9630 ± 4% +13.6% 10942 ± 3% softirqs.CPU30.SCHED 306382 ± 4% +25.4% 384355 ± 2% softirqs.CPU30.TIMER 9496 ± 6% +12.6% 10689 ± 2% softirqs.CPU31.SCHED 308689 ± 4% +24.5% 384419 ± 2% softirqs.CPU31.TIMER 9714 +12.6% 10937 ± 4% softirqs.CPU32.SCHED 304137 ± 3% +35.9% 413240 ± 13% softirqs.CPU32.TIMER 9598 ± 2% +13.4% 10882 ± 5% softirqs.CPU33.SCHED 9622 +13.8% 10949 ± 3% softirqs.CPU34.SCHED 305882 ± 4% +27.3% 389315 ± 4% softirqs.CPU34.TIMER 9409 ± 4% +15.3% 10853 ± 4% softirqs.CPU35.SCHED 306215 ± 4% +23.8% 379222 ± 2% softirqs.CPU35.TIMER 321617 ± 4% +12.9% 362966 ± 3% softirqs.CPU36.TIMER 134843 ± 6% +19.4% 161053 ± 2% softirqs.CPU37.RCU 130954 ± 6% +20.4% 157716 softirqs.CPU38.RCU 129884 ± 5% +17.8% 152978 softirqs.CPU39.RCU 124744 ± 4% +20.1% 149790 ± 3% softirqs.CPU4.RCU 130593 ± 5% +17.2% 153092 ± 2% softirqs.CPU40.RCU 134185 ± 5% +19.9% 160871 softirqs.CPU41.RCU 133336 ± 5% +18.1% 157409 softirqs.CPU42.RCU 134486 ± 4% +18.7% 159613 softirqs.CPU43.RCU 129857 ± 6% +18.5% 153887 softirqs.CPU44.RCU 131816 ± 5% +20.0% 158144 softirqs.CPU45.RCU 132691 ± 5% +22.4% 162412 softirqs.CPU46.RCU 138736 ± 3% +18.7% 164668 softirqs.CPU47.RCU 132971 ± 6% +24.2% 165142 softirqs.CPU48.RCU 136142 ± 3% +20.8% 164493 softirqs.CPU49.RCU 125011 ± 4% +23.6% 154462 ± 2% softirqs.CPU5.RCU 133660 ± 4% +19.5% 159753 ± 2% softirqs.CPU50.RCU 140405 ± 4% +19.5% 167772 softirqs.CPU51.RCU 140523 ± 4% +18.5% 166576 softirqs.CPU52.RCU 138849 ± 5% +14.6% 159157 ± 4% softirqs.CPU53.RCU 332171 ± 2% +21.4% 403260 ± 15% softirqs.CPU53.TIMER 133037 ± 4% +14.0% 151688 ± 2% softirqs.CPU54.RCU 9584 +14.3% 10959 ± 2% softirqs.CPU54.SCHED 310603 ± 4% +18.0% 366472 ± 3% softirqs.CPU54.TIMER 9565 ± 2% +13.8% 10889 ± 5% softirqs.CPU55.SCHED 321231 ± 3% +21.3% 389753 ± 2% softirqs.CPU55.TIMER 136633 ± 4% +12.6% 153854 softirqs.CPU56.RCU 9430 ± 2% +15.6% 10898 ± 5% softirqs.CPU56.SCHED 319477 ± 6% +22.1% 390107 ± 2% softirqs.CPU56.TIMER 128672 ± 4% +14.1% 146791 ± 3% softirqs.CPU57.RCU 9493 ± 2% +13.1% 10740 ± 3% softirqs.CPU57.SCHED 305670 ± 4% +23.5% 377597 ± 2% softirqs.CPU57.TIMER 127129 ± 4% +15.6% 146993 ± 2% softirqs.CPU58.RCU 9529 ± 3% +13.6% 10824 ± 4% softirqs.CPU58.SCHED 302317 ± 4% +23.8% 374371 ± 3% softirqs.CPU58.TIMER 9427 ± 2% +14.0% 10743 ± 2% softirqs.CPU59.SCHED 310985 ± 4% +23.5% 384119 ± 3% softirqs.CPU59.TIMER 124937 ± 4% +21.6% 151962 ± 3% softirqs.CPU6.RCU 9435 ± 2% +14.1% 10762 ± 3% softirqs.CPU60.SCHED 311646 ± 4% +22.8% 382731 ± 3% softirqs.CPU60.TIMER 9585 +13.5% 10877 ± 2% softirqs.CPU61.SCHED 306857 ± 4% +22.8% 376944 ± 2% softirqs.CPU61.TIMER 9483 ± 2% +12.5% 10671 ± 5% softirqs.CPU62.SCHED 9620 ± 4% +9.7% 10556 ± 4% softirqs.CPU63.SCHED 301085 ± 3% +24.7% 375397 ± 3% softirqs.CPU63.TIMER 300443 ± 4% +23.7% 371620 ± 2% softirqs.CPU64.TIMER 9667 +11.2% 10751 ± 4% softirqs.CPU65.SCHED 307194 ± 4% +23.4% 379020 ± 3% softirqs.CPU65.TIMER 9493 ± 3% +14.9% 10909 ± 3% softirqs.CPU66.SCHED 306226 ± 4% +25.1% 383140 ± 3% softirqs.CPU66.TIMER 9674 ± 3% +13.8% 11010 ± 3% softirqs.CPU67.SCHED 307870 ± 4% +25.0% 384793 ± 2% softirqs.CPU67.TIMER 9451 ± 2% +14.2% 10792 ± 4% softirqs.CPU68.SCHED 301873 ± 3% +26.1% 380748 softirqs.CPU68.TIMER 9542 +13.8% 10863 ± 3% softirqs.CPU69.SCHED 316206 ± 8% +20.5% 380893 ± 2% softirqs.CPU69.TIMER 128158 ± 4% +20.4% 154294 ± 2% softirqs.CPU7.RCU 9456 ± 3% +13.5% 10734 ± 3% softirqs.CPU70.SCHED 305361 ± 4% +36.4% 416546 ± 15% softirqs.CPU70.TIMER 9520 ± 3% +15.4% 10985 ± 4% softirqs.CPU71.SCHED 305605 ± 4% +24.6% 380653 ± 2% softirqs.CPU71.TIMER 122831 ± 4% +21.6% 149424 ± 2% softirqs.CPU8.RCU 123870 ± 4% +23.0% 152396 ± 2% softirqs.CPU9.RCU 9357957 ± 5% +15.4% 10794953 softirqs.RCU 23209193 ± 3% +15.5% 26806870 ± 3% softirqs.TIMER 4.79 ± 4% -3.1 1.71 ± 16% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.85 ± 4% -2.4 1.41 ± 16% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.39 ± 4% -2.0 1.35 ± 16% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 2.93 ± 5% -1.9 0.99 ± 18% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 3.25 ± 4% -1.9 1.31 ± 10% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write 2.14 ± 4% -1.2 0.91 ± 14% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 2.06 ± 4% -1.2 0.85 ± 13% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 1.52 ± 3% -1.0 0.49 ± 59% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read 1.46 ± 3% -1.0 0.46 ± 59% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.pipe_read.new_sync_read 1.53 ± 8% -0.8 0.68 ± 12% perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read 1.65 ± 4% -0.8 0.81 ± 10% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.45 ± 5% -0.7 0.74 ± 10% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.35 ± 5% -0.7 0.68 ± 10% perf-profile.calltrace.cycles-pp.__fget.__fget_light.__fdget_pos.ksys_write.do_syscall_64 1.28 ± 8% -0.7 0.62 ± 12% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write 1.29 ± 3% -0.6 0.67 ± 9% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 0.64 ± 11% +0.3 0.96 ± 7% perf-profile.calltrace.cycles-pp.__lock_text_start.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 0.00 +0.5 0.55 ± 3% perf-profile.calltrace.cycles-pp.pick_next_entity.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop 0.00 +0.6 0.55 ± 5% perf-profile.calltrace.cycles-pp.pick_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.00 +0.6 0.57 ± 6% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.00 +0.6 0.61 ± 7% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.dequeue_task_fair.__schedule.schedule 0.00 +0.7 0.69 ± 8% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.pipe_wait.pipe_read 0.00 +0.7 0.70 ± 6% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.00 +0.7 0.71 ± 11% perf-profile.calltrace.cycles-pp.__enqueue_entity.put_prev_entity.pick_next_task_fair.__schedule.schedule 0.00 +0.7 0.72 ± 7% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.00 +0.7 0.72 ± 6% perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.dequeue_task_fair.__schedule.schedule.pipe_wait 0.00 +0.8 0.76 ± 10% perf-profile.calltrace.cycles-pp.__enqueue_entity.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.00 +0.8 0.77 ± 2% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.00 +0.8 0.77 ± 5% perf-profile.calltrace.cycles-pp.__switch_to 0.00 +0.8 0.77 ± 6% perf-profile.calltrace.cycles-pp.___perf_sw_event.__schedule.schedule.pipe_wait.pipe_read 0.00 +0.8 0.79 ± 5% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule 0.00 +0.8 0.81 ± 4% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_wait.pipe_read.new_sync_read.vfs_read 0.00 +0.8 0.82 ± 6% perf-profile.calltrace.cycles-pp.update_rq_clock.__schedule.schedule.pipe_wait.pipe_read 0.00 +0.8 0.82 ± 6% perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.00 +0.9 0.90 ± 3% perf-profile.calltrace.cycles-pp.find_next_bit.cpumask_next_wrap.select_idle_sibling.select_task_rq_fair.try_to_wake_up 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.update_rq_clock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.00 +0.9 0.91 ± 6% perf-profile.calltrace.cycles-pp.check_preempt_wakeup.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function 0.00 +0.9 0.92 ± 2% perf-profile.calltrace.cycles-pp.native_write_msr 0.00 +1.1 1.05 ± 5% perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.00 +1.1 1.08 ± 8% perf-profile.calltrace.cycles-pp.put_prev_entity.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop 0.00 +1.1 1.13 ± 5% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.00 +1.2 1.17 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.00 +1.2 1.18 ± 2% perf-profile.calltrace.cycles-pp.__switch_to_asm 0.00 +1.2 1.20 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.pipe_wait.pipe_read 0.00 +1.3 1.30 ± 5% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.00 +1.3 1.34 ± 6% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 0.00 +1.6 1.62 ± 4% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.9 1.88 ± 5% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read 0.00 +1.9 1.93 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.13 ±173% +2.0 2.11 ± 5% perf-profile.calltrace.cycles-pp.cpumask_next_wrap.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 0.00 +2.1 2.06 ± 4% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 0.00 +2.4 2.38 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +2.7 2.65 ± 4% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.35 ±103% +4.3 4.67 ± 4% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.22 ±173% +4.6 4.81 ± 4% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.23 ±173% +4.7 4.97 ± 4% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.72 ± 23% +5.0 5.72 ± 5% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read 0.69 ± 17% +5.6 6.25 ± 4% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 0.74 ± 17% +5.8 6.50 ± 4% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.74 ± 18% +5.8 6.55 ± 5% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 15.99 ± 54% +7.5 23.51 ± 6% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 13.13 +7.7 20.86 ± 3% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.49 +8.7 20.19 ± 3% perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 1.31 ± 27% +8.9 10.21 ± 7% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 1.81 ± 22% +11.2 12.98 ± 5% perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 1.89 ± 22% +11.4 13.28 ± 5% perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 2.18 ± 21% +13.1 15.28 ± 4% perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 2.01 ± 25% +19.1 21.10 ± 7% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 2.38 ± 23% +20.0 22.40 ± 7% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 19.01 ± 3% +23.4 42.38 ± 4% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 21.13 ± 53% +23.8 44.92 ± 5% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 17.85 ± 4% +23.9 41.76 ± 4% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 19.16 ± 53% +24.6 43.74 ± 5% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.79 ± 22% +30.7 34.45 ± 6% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 3.84 ± 23% +30.9 34.69 ± 6% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 4.13 ± 21% +31.0 35.10 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 5.77 ± 14% +31.0 36.76 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 9.20 ± 6% -6.0 3.16 ± 12% perf-profile.children.cycles-pp.syscall_return_via_sysret 8.88 ± 3% -5.8 3.03 ± 12% perf-profile.children.cycles-pp.entry_SYSCALL_64 8.72 ± 4% -5.3 3.39 ± 11% perf-profile.children.cycles-pp.security_file_permission 4.27 ± 3% -2.4 1.89 ± 9% perf-profile.children.cycles-pp.selinux_file_permission 3.15 ± 5% -2.1 1.07 ± 12% perf-profile.children.cycles-pp.file_has_perm 3.48 ± 3% -2.0 1.46 ± 10% perf-profile.children.cycles-pp.copy_page_to_iter 3.80 ± 3% -2.0 1.79 ± 6% perf-profile.children.cycles-pp.mutex_unlock 3.02 ± 5% -1.9 1.11 ± 11% perf-profile.children.cycles-pp.copy_page_from_iter 3.31 ± 4% -1.6 1.75 ± 6% perf-profile.children.cycles-pp.__fdget_pos 2.55 ± 3% -1.5 1.02 ± 10% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 3.17 ± 4% -1.5 1.70 ± 6% perf-profile.children.cycles-pp.__fget_light 2.10 ± 7% -1.4 0.71 ± 12% perf-profile.children.cycles-pp.fsnotify 2.52 ± 6% -1.3 1.23 ± 8% perf-profile.children.cycles-pp.__fget 1.77 ± 6% -1.1 0.66 ± 9% perf-profile.children.cycles-pp.avc_has_perm 1.89 ± 5% -1.1 0.78 ± 10% perf-profile.children.cycles-pp.___might_sleep 1.44 ± 4% -1.0 0.48 ± 12% perf-profile.children.cycles-pp.__inode_security_revalidate 1.33 ± 10% -0.9 0.40 ± 16% perf-profile.children.cycles-pp.current_time 1.56 ± 3% -0.9 0.66 ± 9% perf-profile.children.cycles-pp.copyout 1.56 ± 8% -0.8 0.73 ± 7% perf-profile.children.cycles-pp.touch_atime 1.33 ± 4% -0.8 0.53 ± 10% perf-profile.children.cycles-pp.__might_sleep 1.15 ± 9% -0.8 0.36 ± 12% perf-profile.children.cycles-pp.atime_needs_update 1.17 ± 4% -0.7 0.43 ± 13% perf-profile.children.cycles-pp.copyin 1.23 ± 5% -0.7 0.54 ± 9% perf-profile.children.cycles-pp.__fsnotify_parent 1.32 ± 7% -0.6 0.68 ± 6% perf-profile.children.cycles-pp.file_update_time 1.02 ± 3% -0.6 0.38 ± 12% perf-profile.children.cycles-pp.__might_fault 2.54 ± 2% -0.5 2.03 perf-profile.children.cycles-pp.mutex_lock 0.78 ± 4% -0.4 0.36 ± 10% perf-profile.children.cycles-pp.fput_many 0.53 ± 4% -0.4 0.15 ± 21% perf-profile.children.cycles-pp.inode_has_perm 0.44 ± 12% -0.3 0.11 ± 22% perf-profile.children.cycles-pp.iov_iter_init 0.76 ± 4% -0.3 0.44 ± 8% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.53 ± 3% -0.3 0.21 ± 6% perf-profile.children.cycles-pp.rcu_all_qs 0.41 ± 9% -0.3 0.12 ± 15% perf-profile.children.cycles-pp.timespec64_trunc 0.97 -0.3 0.71 ± 3% perf-profile.children.cycles-pp._cond_resched 0.47 ± 7% -0.3 0.21 ± 11% perf-profile.children.cycles-pp.__x64_sys_read 0.45 ± 7% -0.3 0.20 ± 10% perf-profile.children.cycles-pp.__x64_sys_write 0.37 ± 4% -0.2 0.17 ± 16% perf-profile.children.cycles-pp.generic_pipe_buf_confirm 0.44 ± 12% -0.2 0.24 ± 3% perf-profile.children.cycles-pp.__sb_start_write 0.31 ± 6% -0.2 0.12 ± 13% perf-profile.children.cycles-pp.__sb_end_write 0.36 ± 7% -0.2 0.18 ± 6% perf-profile.children.cycles-pp.rw_verify_area 0.26 ± 14% -0.2 0.09 ± 14% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.29 ± 8% -0.2 0.14 ± 16% perf-profile.children.cycles-pp.fpregs_assert_state_consistent 0.22 ± 39% -0.2 0.06 ± 11% perf-profile.children.cycles-pp.__vfs_read 0.21 ± 19% -0.1 0.11 ± 9% perf-profile.children.cycles-pp.__mutex_unlock_slowpath 0.12 ± 9% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__vfs_write 0.12 ± 17% -0.0 0.08 ± 11% perf-profile.children.cycles-pp.wake_up_q 0.08 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.kill_fasync 0.11 ± 7% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.09 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.01 ±173% +0.1 0.06 ± 6% perf-profile.children.cycles-pp.__mnt_want_write 0.07 ± 25% +0.1 0.12 ± 27% perf-profile.children.cycles-pp.__softirqentry_text_start 0.08 ± 30% +0.1 0.14 ± 26% perf-profile.children.cycles-pp.irq_exit 0.06 ± 6% +0.1 0.12 ± 10% perf-profile.children.cycles-pp.__mark_inode_dirty 0.00 +0.1 0.06 perf-profile.children.cycles-pp.preempt_schedule_common 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.is_cpu_allowed 0.03 ±100% +0.1 0.10 ± 8% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.__x2apic_send_IPI_dest 0.01 ±173% +0.1 0.09 ± 32% perf-profile.children.cycles-pp.migrate_task_rq_fair 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.05 ± 61% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.native_irq_return_iret 0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.08 ± 13% perf-profile.children.cycles-pp.smp_reschedule_interrupt 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.native_load_tls 0.03 ±102% +0.1 0.12 ± 30% perf-profile.children.cycles-pp.set_task_cpu 0.00 +0.1 0.09 ± 11% perf-profile.children.cycles-pp.check_cfs_rq_runtime 0.00 +0.1 0.10 ± 5% perf-profile.children.cycles-pp.rb_next 0.10 ± 10% +0.1 0.20 ± 9% perf-profile.children.cycles-pp.generic_update_time 0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.__x64_sys_exit 0.00 +0.1 0.10 ± 28% perf-profile.children.cycles-pp.do_exit 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.rb_insert_color 0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.__list_add_valid 0.00 +0.1 0.12 ± 7% perf-profile.children.cycles-pp.resched_curr 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.13 ± 10% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.15 ± 4% perf-profile.children.cycles-pp.set_next_buddy 0.00 +0.2 0.16 ± 5% perf-profile.children.cycles-pp.deactivate_task 0.05 ± 9% +0.2 0.22 ± 7% perf-profile.children.cycles-pp.rb_erase 0.06 ± 13% +0.2 0.23 ± 9% perf-profile.children.cycles-pp.finish_wait 0.17 ± 12% +0.2 0.35 ± 2% perf-profile.children.cycles-pp.anon_pipe_buf_release 0.01 ±173% +0.2 0.20 ± 8% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.00 +0.2 0.21 ± 4% perf-profile.children.cycles-pp.cpumask_next 0.07 ± 22% +0.3 0.40 ± 2% perf-profile.children.cycles-pp.prepare_to_wait 0.03 ±100% +0.4 0.39 ± 5% perf-profile.children.cycles-pp.update_min_vruntime 0.03 ±100% +0.4 0.39 ± 12% perf-profile.children.cycles-pp.cpus_share_cache 0.06 ± 14% +0.4 0.43 perf-profile.children.cycles-pp.clear_buddies 0.11 ± 15% +0.4 0.50 ± 3% perf-profile.children.cycles-pp.cpuacct_charge 0.10 ± 26% +0.4 0.49 ± 4% perf-profile.children.cycles-pp.native_sched_clock 0.32 ± 31% +0.4 0.75 ± 14% perf-profile.children.cycles-pp.sched_ttwu_pending 0.11 ± 26% +0.4 0.56 ± 3% perf-profile.children.cycles-pp.sched_clock 0.34 ± 32% +0.5 0.80 ± 15% perf-profile.children.cycles-pp.scheduler_ipi 0.08 ± 12% +0.5 0.56 ± 7% perf-profile.children.cycles-pp.account_entity_enqueue 0.13 ± 26% +0.5 0.62 ± 3% perf-profile.children.cycles-pp.sched_clock_cpu 0.14 ± 26% +0.6 0.77 ± 4% perf-profile.children.cycles-pp.__calc_delta 0.08 ± 16% +0.7 0.76 ± 3% perf-profile.children.cycles-pp.account_entity_dequeue 0.84 ± 5% +0.7 1.54 ± 5% perf-profile.children.cycles-pp.__lock_text_start 1.61 ± 16% +0.7 2.31 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.42 ± 31% +0.7 1.12 ± 13% perf-profile.children.cycles-pp.reschedule_interrupt 0.24 ± 28% +0.9 1.11 perf-profile.children.cycles-pp.native_write_msr 0.14 ± 22% +0.9 1.01 ± 5% perf-profile.children.cycles-pp.check_preempt_wakeup 0.24 ± 32% +0.9 1.12 ± 7% perf-profile.children.cycles-pp.finish_task_switch 0.22 ± 22% +0.9 1.10 ± 3% perf-profile.children.cycles-pp.find_next_bit 0.22 ± 23% +0.9 1.12 ± 3% perf-profile.children.cycles-pp.set_next_entity 0.21 ± 32% +0.9 1.14 ± 3% perf-profile.children.cycles-pp.update_cfs_group 0.16 ± 23% +1.0 1.15 ± 4% perf-profile.children.cycles-pp.check_preempt_curr 0.21 ± 30% +1.0 1.21 ± 2% perf-profile.children.cycles-pp.__switch_to 0.23 ± 21% +1.0 1.24 ± 2% perf-profile.children.cycles-pp.__switch_to_asm 0.16 ± 38% +1.0 1.20 ± 4% perf-profile.children.cycles-pp.___perf_sw_event 0.15 ± 26% +1.0 1.20 ± 3% perf-profile.children.cycles-pp.pick_next_entity 0.15 ± 20% +1.1 1.21 ± 7% perf-profile.children.cycles-pp.put_prev_entity 0.17 ± 22% +1.1 1.23 ± 4% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.19 ± 10% +1.3 1.52 ± 10% perf-profile.children.cycles-pp.__enqueue_entity 0.24 ± 23% +1.3 1.59 ± 6% perf-profile.children.cycles-pp.__update_load_avg_se 0.28 ± 23% +1.4 1.64 ± 3% perf-profile.children.cycles-pp.switch_fpu_return 0.31 ± 29% +1.6 1.88 ± 5% perf-profile.children.cycles-pp.update_rq_clock 0.44 ± 21% +1.8 2.24 ± 4% perf-profile.children.cycles-pp.cpumask_next_wrap 0.33 ± 20% +1.8 2.15 ± 4% perf-profile.children.cycles-pp.dequeue_entity 23.28 ± 2% +2.0 25.27 ± 2% perf-profile.children.cycles-pp.ksys_read 0.46 ± 25% +2.1 2.57 ± 5% perf-profile.children.cycles-pp.update_load_avg 0.20 ± 21% +2.1 2.34 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.91 ± 29% +2.2 3.12 ± 11% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.38 ± 23% +2.4 2.80 ± 4% perf-profile.children.cycles-pp.reweight_entity 0.52 ± 18% +2.4 2.96 ± 3% perf-profile.children.cycles-pp.enqueue_entity 0.49 ± 23% +2.6 3.10 ± 4% perf-profile.children.cycles-pp.update_curr 20.92 ± 2% +3.2 24.12 ± 2% perf-profile.children.cycles-pp.vfs_read 0.21 ± 23% +3.4 3.65 ± 7% perf-profile.children.cycles-pp._raw_spin_lock 0.76 ± 24% +3.9 4.67 ± 3% perf-profile.children.cycles-pp.pick_next_task_fair 0.66 ± 34% +4.4 5.06 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.81 ± 22% +5.0 5.83 ± 4% perf-profile.children.cycles-pp.dequeue_task_fair 1.01 ± 21% +5.8 6.86 ± 4% perf-profile.children.cycles-pp.enqueue_task_fair 1.06 ± 21% +6.0 7.10 ± 4% perf-profile.children.cycles-pp.activate_task 1.07 ± 21% +6.1 7.15 ± 4% perf-profile.children.cycles-pp.ttwu_do_activate 13.19 +7.8 20.94 ± 3% perf-profile.children.cycles-pp.new_sync_read 11.61 +8.7 20.29 ± 3% perf-profile.children.cycles-pp.pipe_read 1.45 ± 25% +8.9 10.35 ± 7% perf-profile.children.cycles-pp.available_idle_cpu 78.85 ± 2% +9.8 88.66 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 77.90 ± 2% +10.1 88.00 perf-profile.children.cycles-pp.do_syscall_64 2.42 ± 21% +12.9 15.36 ± 4% perf-profile.children.cycles-pp.pipe_wait 2.71 ± 26% +15.4 18.12 ± 4% perf-profile.children.cycles-pp.__schedule 2.76 ± 25% +15.6 18.37 ± 4% perf-profile.children.cycles-pp.schedule 27.59 ± 2% +18.6 46.17 ± 3% perf-profile.children.cycles-pp.ksys_write 2.26 ± 23% +19.0 21.30 ± 7% perf-profile.children.cycles-pp.select_idle_sibling 24.98 ± 2% +19.9 44.88 ± 3% perf-profile.children.cycles-pp.vfs_write 2.48 ± 23% +20.0 22.46 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair 19.06 ± 3% +23.3 42.41 ± 4% perf-profile.children.cycles-pp.new_sync_write 17.98 ± 4% +23.9 41.93 ± 4% perf-profile.children.cycles-pp.pipe_write 4.03 ± 21% +30.6 34.60 ± 6% perf-profile.children.cycles-pp.try_to_wake_up 3.97 ± 22% +30.8 34.74 ± 6% perf-profile.children.cycles-pp.autoremove_wake_function 4.30 ± 20% +30.9 35.19 ± 6% perf-profile.children.cycles-pp.__wake_up_common 6.06 ± 14% +31.2 37.21 ± 5% perf-profile.children.cycles-pp.__wake_up_common_lock 24.41 ± 6% -15.5 8.96 ± 10% perf-profile.self.cycles-pp.do_syscall_64 9.18 ± 6% -6.0 3.14 ± 12% perf-profile.self.cycles-pp.syscall_return_via_sysret 8.63 ± 5% -5.6 3.00 ± 12% perf-profile.self.cycles-pp.entry_SYSCALL_64 3.71 ± 3% -2.0 1.73 ± 6% perf-profile.self.cycles-pp.mutex_unlock 2.47 ± 3% -1.5 0.96 ± 10% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 2.76 ± 3% -1.4 1.35 ± 8% perf-profile.self.cycles-pp.selinux_file_permission 2.02 ± 7% -1.3 0.68 ± 12% perf-profile.self.cycles-pp.fsnotify 2.46 ± 6% -1.3 1.20 ± 8% perf-profile.self.cycles-pp.__fget 1.75 ± 6% -1.1 0.64 ± 10% perf-profile.self.cycles-pp.avc_has_perm 1.83 ± 5% -1.1 0.75 ± 10% perf-profile.self.cycles-pp.___might_sleep 1.75 -1.0 0.77 ± 7% perf-profile.self.cycles-pp.pipe_write 1.20 ± 4% -0.7 0.46 ± 10% perf-profile.self.cycles-pp.__might_sleep 1.29 ± 11% -0.7 0.58 ± 10% perf-profile.self.cycles-pp.new_sync_read 1.63 ± 4% -0.7 0.97 ± 5% perf-profile.self.cycles-pp.pipe_read 1.15 ± 5% -0.7 0.49 ± 8% perf-profile.self.cycles-pp.__fsnotify_parent 0.89 ± 8% -0.6 0.27 ± 15% perf-profile.self.cycles-pp.copy_page_from_iter 0.89 ± 4% -0.6 0.29 ± 14% perf-profile.self.cycles-pp.security_file_permission 0.83 ± 5% -0.6 0.24 ± 21% perf-profile.self.cycles-pp.file_has_perm 0.90 ± 2% -0.5 0.41 ± 6% perf-profile.self.cycles-pp.new_sync_write 0.67 ± 10% -0.5 0.20 ± 15% perf-profile.self.cycles-pp.current_time 0.83 ± 4% -0.4 0.41 ± 10% perf-profile.self.cycles-pp.copy_page_to_iter 0.72 ± 7% -0.4 0.31 ± 9% perf-profile.self.cycles-pp.vfs_write 0.75 ± 4% -0.4 0.35 ± 9% perf-profile.self.cycles-pp.fput_many 1.01 ± 4% -0.3 0.69 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.45 ± 4% -0.3 0.14 ± 19% perf-profile.self.cycles-pp.inode_has_perm 0.54 ± 8% -0.3 0.23 ± 9% perf-profile.self.cycles-pp.file_update_time 0.41 ± 10% -0.3 0.11 ± 20% perf-profile.self.cycles-pp.iov_iter_init 0.49 ± 7% -0.3 0.19 ± 8% perf-profile.self.cycles-pp.atime_needs_update 0.44 ± 7% -0.3 0.15 ± 14% perf-profile.self.cycles-pp.ksys_read 0.44 ± 7% -0.3 0.17 ± 9% perf-profile.self.cycles-pp.__inode_security_revalidate 0.41 ± 2% -0.3 0.15 ± 8% perf-profile.self.cycles-pp.rcu_all_qs 0.43 ± 8% -0.3 0.17 ± 11% perf-profile.self.cycles-pp.ksys_write 0.37 ± 9% -0.3 0.11 ± 17% perf-profile.self.cycles-pp.timespec64_trunc 0.42 ± 14% -0.2 0.18 ± 8% perf-profile.self.cycles-pp.__sb_start_write 0.39 ± 7% -0.2 0.17 ± 11% perf-profile.self.cycles-pp.__x64_sys_write 0.40 ± 8% -0.2 0.17 ± 8% perf-profile.self.cycles-pp.__x64_sys_read 0.41 ± 7% -0.2 0.20 ± 11% perf-profile.self.cycles-pp.__wake_up_common_lock 0.60 ± 4% -0.2 0.39 ± 7% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 1.25 -0.2 1.04 ± 2% perf-profile.self.cycles-pp.mutex_lock 0.30 ± 6% -0.2 0.12 ± 15% perf-profile.self.cycles-pp.__sb_end_write 0.35 ± 5% -0.2 0.18 ± 3% perf-profile.self.cycles-pp.rw_verify_area 0.34 ± 7% -0.2 0.18 ± 8% perf-profile.self.cycles-pp.touch_atime 0.32 ± 4% -0.2 0.15 ± 14% perf-profile.self.cycles-pp.generic_pipe_buf_confirm 0.23 ± 16% -0.2 0.08 ± 11% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.74 ± 3% -0.2 0.59 ± 5% perf-profile.self.cycles-pp.vfs_read 0.60 ± 3% -0.2 0.45 ± 4% perf-profile.self.cycles-pp.__fget_light 0.27 ± 8% -0.1 0.12 ± 15% perf-profile.self.cycles-pp.fpregs_assert_state_consistent 0.18 ± 45% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.__vfs_read 0.18 ± 5% -0.1 0.06 ± 17% perf-profile.self.cycles-pp.__fdget_pos 0.25 ± 5% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.__might_fault 0.07 ± 7% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.kill_fasync 0.01 ±173% +0.1 0.06 ± 17% perf-profile.self.cycles-pp.sched_ttwu_pending 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.scheduler_ipi 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.rcu_note_context_switch 0.01 ±173% +0.1 0.07 ± 12% perf-profile.self.cycles-pp.generic_update_time 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.cpumask_next 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.ttwu_do_activate 0.00 +0.1 0.06 perf-profile.self.cycles-pp.__mnt_want_write 0.06 ± 14% +0.1 0.12 ± 10% perf-profile.self.cycles-pp.__mark_inode_dirty 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.is_cpu_allowed 0.00 +0.1 0.07 ± 13% perf-profile.self.cycles-pp.sched_clock_cpu 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.sched_clock 0.03 ±100% +0.1 0.10 ± 11% perf-profile.self.cycles-pp.native_apic_msr_eoi_write 0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.00 +0.1 0.08 perf-profile.self.cycles-pp.native_load_tls 0.05 ± 60% +0.1 0.13 ± 5% perf-profile.self.cycles-pp.native_irq_return_iret 0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.ttwu_do_wakeup 0.00 +0.1 0.09 ± 11% perf-profile.self.cycles-pp.rb_next 0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.__list_add_valid 0.00 +0.1 0.10 ± 10% perf-profile.self.cycles-pp.rb_insert_color 0.00 +0.1 0.11 ± 9% perf-profile.self.cycles-pp.resched_curr 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.32 ± 7% +0.1 0.45 ± 5% perf-profile.self.cycles-pp.__wake_up_common 0.13 ± 10% +0.1 0.25 ± 5% perf-profile.self.cycles-pp.__list_del_entry_valid 0.00 +0.1 0.13 ± 5% perf-profile.self.cycles-pp.autoremove_wake_function 0.00 +0.1 0.13 ± 8% perf-profile.self.cycles-pp.check_preempt_curr 0.04 ± 58% +0.1 0.18 ± 10% perf-profile.self.cycles-pp.finish_wait 0.00 +0.1 0.14 ± 5% perf-profile.self.cycles-pp.set_next_buddy 0.00 +0.1 0.15 ± 3% perf-profile.self.cycles-pp.put_prev_entity 0.00 +0.2 0.15 ± 5% perf-profile.self.cycles-pp.deactivate_task 0.05 ± 9% +0.2 0.21 ± 5% perf-profile.self.cycles-pp.rb_erase 0.00 +0.2 0.15 ± 10% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.00 +0.2 0.18 ± 6% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.15 ± 7% +0.2 0.34 ± 2% perf-profile.self.cycles-pp.anon_pipe_buf_release 0.03 ±100% +0.2 0.21 ± 8% perf-profile.self.cycles-pp.pipe_wait 0.03 ±102% +0.2 0.24 ± 3% perf-profile.self.cycles-pp.activate_task 0.01 ±173% +0.2 0.23 ± 3% perf-profile.self.cycles-pp.prepare_to_wait 0.03 ±100% +0.2 0.25 ± 4% perf-profile.self.cycles-pp.set_next_entity 0.02 ±173% +0.2 0.26 ± 9% perf-profile.self.cycles-pp.dequeue_entity 0.04 ±100% +0.3 0.29 ± 5% perf-profile.self.cycles-pp.enqueue_entity 0.08 ± 31% +0.3 0.34 ± 2% perf-profile.self.cycles-pp.schedule 0.78 ± 3% +0.3 1.09 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.09 ± 24% +0.3 0.42 ± 7% perf-profile.self.cycles-pp.finish_task_switch 0.03 ±100% +0.3 0.37 ± 6% perf-profile.self.cycles-pp.update_min_vruntime 0.03 ±102% +0.4 0.38 perf-profile.self.cycles-pp.clear_buddies 0.03 ±100% +0.4 0.39 ± 12% perf-profile.self.cycles-pp.cpus_share_cache 0.07 ± 22% +0.4 0.44 ± 7% perf-profile.self.cycles-pp.check_preempt_wakeup 0.09 ± 27% +0.4 0.47 ± 4% perf-profile.self.cycles-pp.native_sched_clock 0.07 ± 26% +0.4 0.45 ± 4% perf-profile.self.cycles-pp.pick_next_entity 0.11 ± 15% +0.4 0.50 ± 3% perf-profile.self.cycles-pp.cpuacct_charge 0.07 ± 14% +0.5 0.53 ± 8% perf-profile.self.cycles-pp.account_entity_enqueue 0.10 ± 21% +0.5 0.56 ± 8% perf-profile.self.cycles-pp.try_to_wake_up 0.10 ± 18% +0.5 0.62 ± 6% perf-profile.self.cycles-pp.dequeue_task_fair 0.14 ± 26% +0.6 0.75 ± 4% perf-profile.self.cycles-pp.__calc_delta 0.06 ± 13% +0.6 0.68 ± 4% perf-profile.self.cycles-pp.account_entity_dequeue 0.15 ± 27% +0.6 0.79 ± 6% perf-profile.self.cycles-pp.enqueue_task_fair 0.17 ± 30% +0.7 0.89 ± 4% perf-profile.self.cycles-pp.update_load_avg 0.15 ± 20% +0.7 0.88 ± 4% perf-profile.self.cycles-pp.reweight_entity 0.15 ± 23% +0.8 0.96 ± 3% perf-profile.self.cycles-pp.pick_next_task_fair 0.24 ± 30% +0.9 1.11 perf-profile.self.cycles-pp.native_write_msr 0.20 ± 23% +0.9 1.07 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair 0.20 ± 22% +0.9 1.07 ± 3% perf-profile.self.cycles-pp.find_next_bit 0.20 ± 31% +0.9 1.11 ± 3% perf-profile.self.cycles-pp.update_cfs_group 0.20 ± 28% +0.9 1.14 ± 2% perf-profile.self.cycles-pp.__switch_to 0.14 ± 37% +1.0 1.13 ± 5% perf-profile.self.cycles-pp.___perf_sw_event 0.21 ± 24% +1.0 1.22 ± 2% perf-profile.self.cycles-pp.__switch_to_asm 0.24 ± 23% +1.1 1.31 ± 5% perf-profile.self.cycles-pp.cpumask_next_wrap 0.23 ± 32% +1.3 1.49 ± 5% perf-profile.self.cycles-pp.update_rq_clock 0.19 ± 28% +1.3 1.45 ± 6% perf-profile.self.cycles-pp.update_curr 0.23 ± 23% +1.3 1.55 ± 6% perf-profile.self.cycles-pp.__update_load_avg_se 0.19 ± 10% +1.3 1.51 ± 10% perf-profile.self.cycles-pp.__enqueue_entity 0.28 ± 22% +1.3 1.63 ± 3% perf-profile.self.cycles-pp.switch_fpu_return 0.11 ± 19% +1.6 1.72 ± 5% perf-profile.self.cycles-pp._raw_spin_lock 0.42 ± 26% +1.7 2.12 ± 2% perf-profile.self.cycles-pp.__schedule 0.19 ± 20% +2.0 2.20 ± 4% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.91 ± 29% +2.2 3.11 ± 12% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.32 ± 19% +7.7 8.05 ± 7% perf-profile.self.cycles-pp.select_idle_sibling 1.44 ± 25% +8.8 10.23 ± 7% perf-profile.self.cycles-pp.available_idle_cpu 439.00 +11.7% 490.50 interrupts.100:IR-PCI-MSI.1572923-edge.eth0-TxRx-59 436.25 +13.1% 493.25 interrupts.101:IR-PCI-MSI.1572924-edge.eth0-TxRx-60 436.25 +12.4% 490.50 interrupts.102:IR-PCI-MSI.1572925-edge.eth0-TxRx-61 436.25 +12.4% 490.50 interrupts.103:IR-PCI-MSI.1572926-edge.eth0-TxRx-62 509.75 ± 3% +545.1% 3288 ±120% interrupts.42:IR-PCI-MSI.1572867-edge.eth0-TxRx-3 474.00 ± 3% +49.7% 709.75 ± 24% interrupts.46:IR-PCI-MSI.1572871-edge.eth0-TxRx-7 588.00 ± 35% +196.0% 1740 ± 50% interrupts.51:IR-PCI-MSI.1572876-edge.eth0-TxRx-12 436.75 ± 2% +12.8% 492.50 interrupts.55:IR-PCI-MSI.1572880-edge.eth0-TxRx-16 438.00 +39.5% 611.00 ± 33% interrupts.57:IR-PCI-MSI.1572882-edge.eth0-TxRx-18 436.25 +13.8% 496.25 interrupts.58:IR-PCI-MSI.1572883-edge.eth0-TxRx-19 436.25 +14.3% 498.50 interrupts.59:IR-PCI-MSI.1572884-edge.eth0-TxRx-20 437.00 +12.2% 490.50 interrupts.60:IR-PCI-MSI.1572885-edge.eth0-TxRx-21 436.25 +12.4% 490.50 interrupts.61:IR-PCI-MSI.1572886-edge.eth0-TxRx-22 436.25 +12.4% 490.50 interrupts.62:IR-PCI-MSI.1572887-edge.eth0-TxRx-23 441.00 +11.8% 493.00 interrupts.63:IR-PCI-MSI.1572888-edge.eth0-TxRx-24 437.25 +13.3% 495.25 interrupts.64:IR-PCI-MSI.1572889-edge.eth0-TxRx-25 436.25 +12.4% 490.50 interrupts.65:IR-PCI-MSI.1572890-edge.eth0-TxRx-26 436.25 +12.4% 490.50 interrupts.68:IR-PCI-MSI.1572893-edge.eth0-TxRx-29 436.25 +12.4% 490.50 interrupts.69:IR-PCI-MSI.1572894-edge.eth0-TxRx-30 436.25 +12.4% 490.50 interrupts.71:IR-PCI-MSI.1572896-edge.eth0-TxRx-32 437.25 ± 2% +12.2% 490.50 interrupts.74:IR-PCI-MSI.1572897-edge.eth0-TxRx-33 436.25 +12.6% 491.25 interrupts.75:IR-PCI-MSI.1572898-edge.eth0-TxRx-34 440.75 +12.4% 495.25 ± 2% interrupts.76:IR-PCI-MSI.1572899-edge.eth0-TxRx-35 436.25 +12.6% 491.00 interrupts.77:IR-PCI-MSI.1572900-edge.eth0-TxRx-36 436.75 +13.1% 493.75 interrupts.78:IR-PCI-MSI.1572901-edge.eth0-TxRx-37 436.25 +12.8% 492.25 interrupts.79:IR-PCI-MSI.1572902-edge.eth0-TxRx-38 436.25 +12.8% 492.25 interrupts.80:IR-PCI-MSI.1572903-edge.eth0-TxRx-39 436.25 +12.4% 490.50 interrupts.81:IR-PCI-MSI.1572904-edge.eth0-TxRx-40 436.25 +12.4% 490.50 interrupts.82:IR-PCI-MSI.1572905-edge.eth0-TxRx-41 436.25 +12.4% 490.50 interrupts.83:IR-PCI-MSI.1572906-edge.eth0-TxRx-42 436.25 +14.6% 499.75 ± 2% interrupts.84:IR-PCI-MSI.1572907-edge.eth0-TxRx-43 436.25 +12.4% 490.50 interrupts.85:IR-PCI-MSI.1572908-edge.eth0-TxRx-44 436.50 +12.4% 490.50 interrupts.86:IR-PCI-MSI.1572909-edge.eth0-TxRx-45 436.25 +12.4% 490.50 interrupts.87:IR-PCI-MSI.1572910-edge.eth0-TxRx-46 436.25 +12.4% 490.50 interrupts.88:IR-PCI-MSI.1572911-edge.eth0-TxRx-47 436.25 +12.6% 491.00 interrupts.89:IR-PCI-MSI.1572912-edge.eth0-TxRx-48 441.25 ± 3% +14.1% 503.25 ± 3% interrupts.90:IR-PCI-MSI.1572913-edge.eth0-TxRx-49 436.25 +12.4% 490.50 interrupts.91:IR-PCI-MSI.1572914-edge.eth0-TxRx-50 436.25 +14.4% 499.25 ± 3% interrupts.92:IR-PCI-MSI.1572915-edge.eth0-TxRx-51 439.25 ± 2% +11.7% 490.50 interrupts.94:IR-PCI-MSI.1572917-edge.eth0-TxRx-53 437.75 +12.1% 490.50 interrupts.95:IR-PCI-MSI.1572918-edge.eth0-TxRx-54 436.50 +12.4% 490.50 interrupts.96:IR-PCI-MSI.1572919-edge.eth0-TxRx-55 436.25 +12.4% 490.50 interrupts.97:IR-PCI-MSI.1572920-edge.eth0-TxRx-56 439.00 ± 2% +11.7% 490.50 interrupts.98:IR-PCI-MSI.1572921-edge.eth0-TxRx-57 442.25 ± 3% +10.9% 490.50 interrupts.99:IR-PCI-MSI.1572922-edge.eth0-TxRx-58 1989 +12.1% 2230 interrupts.9:IR-IO-APIC.9-fasteoi.acpi 6596036 ± 10% -21.1% 5206443 ± 6% interrupts.CAL:Function_call_interrupts 86097 ± 13% -18.4% 70229 ± 7% interrupts.CPU0.CAL:Function_call_interrupts 1785369 +12.4% 2006294 interrupts.CPU0.LOC:Local_timer_interrupts 102823 ± 12% -18.3% 84031 ± 5% interrupts.CPU0.TLB:TLB_shootdowns 388425 ± 12% +27.8% 496548 ± 4% interrupts.CPU0.TRM:Thermal_event_interrupts 1989 +12.1% 2230 interrupts.CPU1.9:IR-IO-APIC.9-fasteoi.acpi 90370 ± 8% -21.4% 70995 ± 6% interrupts.CPU1.CAL:Function_call_interrupts 1784834 +12.4% 2006046 interrupts.CPU1.LOC:Local_timer_interrupts 3088391 ± 15% -20.9% 2441882 ± 7% interrupts.CPU1.RES:Rescheduling_interrupts 105391 ± 8% -18.6% 85793 ± 6% interrupts.CPU1.TLB:TLB_shootdowns 388373 ± 12% +27.9% 496558 ± 4% interrupts.CPU1.TRM:Thermal_event_interrupts 88236 ± 11% -19.5% 71001 ± 7% interrupts.CPU10.CAL:Function_call_interrupts 1785471 +12.3% 2004740 interrupts.CPU10.LOC:Local_timer_interrupts 3040774 ± 4% -21.1% 2398396 ± 8% interrupts.CPU10.RES:Rescheduling_interrupts 104483 ± 10% -18.6% 85025 ± 5% interrupts.CPU10.TLB:TLB_shootdowns 388417 ± 12% +27.8% 496560 ± 4% interrupts.CPU10.TRM:Thermal_event_interrupts 1785039 +12.3% 2005274 interrupts.CPU11.LOC:Local_timer_interrupts 925.75 ±173% +461.3% 5196 ± 58% interrupts.CPU11.NMI:Non-maskable_interrupts 925.75 ±173% +461.3% 5196 ± 58% interrupts.CPU11.PMI:Performance_monitoring_interrupts 3094193 ± 14% -21.5% 2430228 ± 8% interrupts.CPU11.RES:Rescheduling_interrupts 102398 ± 10% -16.1% 85884 ± 5% interrupts.CPU11.TLB:TLB_shootdowns 388413 ± 12% +27.8% 496474 ± 4% interrupts.CPU11.TRM:Thermal_event_interrupts 588.00 ± 35% +196.0% 1740 ± 50% interrupts.CPU12.51:IR-PCI-MSI.1572876-edge.eth0-TxRx-12 87438 ± 9% -18.1% 71580 ± 7% interrupts.CPU12.CAL:Function_call_interrupts 1785376 +12.3% 2005068 interrupts.CPU12.LOC:Local_timer_interrupts 103057 ± 10% -16.4% 86186 ± 6% interrupts.CPU12.TLB:TLB_shootdowns 388416 ± 12% +27.8% 496490 ± 4% interrupts.CPU12.TRM:Thermal_event_interrupts 88735 ± 9% -19.4% 71496 ± 9% interrupts.CPU13.CAL:Function_call_interrupts 1785460 +12.3% 2005445 interrupts.CPU13.LOC:Local_timer_interrupts 104230 ± 9% -17.5% 86038 ± 6% interrupts.CPU13.TLB:TLB_shootdowns 388422 ± 12% +27.8% 496563 ± 4% interrupts.CPU13.TRM:Thermal_event_interrupts 88327 ± 12% -19.0% 71507 ± 7% interrupts.CPU14.CAL:Function_call_interrupts 1785094 +12.3% 2005441 interrupts.CPU14.LOC:Local_timer_interrupts 103317 ± 11% -18.1% 84581 ± 6% interrupts.CPU14.TLB:TLB_shootdowns 388412 ± 12% +27.8% 496564 ± 4% interrupts.CPU14.TRM:Thermal_event_interrupts 86972 ± 10% -17.3% 71898 ± 7% interrupts.CPU15.CAL:Function_call_interrupts 1784668 +12.4% 2005375 interrupts.CPU15.LOC:Local_timer_interrupts 3039799 ± 9% -21.1% 2397505 ± 9% interrupts.CPU15.RES:Rescheduling_interrupts 103367 ± 12% -16.9% 85892 ± 6% interrupts.CPU15.TLB:TLB_shootdowns 388342 ± 12% +27.9% 496559 ± 4% interrupts.CPU15.TRM:Thermal_event_interrupts 436.75 ± 2% +12.8% 492.50 interrupts.CPU16.55:IR-PCI-MSI.1572880-edge.eth0-TxRx-16 1784750 +12.4% 2005330 interrupts.CPU16.LOC:Local_timer_interrupts 55.25 ±171% +7696.8% 4307 ± 64% interrupts.CPU16.NMI:Non-maskable_interrupts 55.25 ±171% +7696.8% 4307 ± 64% interrupts.CPU16.PMI:Performance_monitoring_interrupts 2969996 ± 10% -18.7% 2413141 ± 9% interrupts.CPU16.RES:Rescheduling_interrupts 102367 ± 11% -13.7% 88305 ± 3% interrupts.CPU16.TLB:TLB_shootdowns 388423 ± 12% +27.8% 496563 ± 4% interrupts.CPU16.TRM:Thermal_event_interrupts 1785363 +12.3% 2005849 interrupts.CPU17.LOC:Local_timer_interrupts 388418 ± 12% +27.8% 496560 ± 4% interrupts.CPU17.TRM:Thermal_event_interrupts 438.00 +39.5% 611.00 ± 33% interrupts.CPU18.57:IR-PCI-MSI.1572882-edge.eth0-TxRx-18 88992 ± 12% -22.3% 69145 ± 6% interrupts.CPU18.CAL:Function_call_interrupts 1785398 +12.1% 2001316 interrupts.CPU18.LOC:Local_timer_interrupts 2199105 ± 7% +115.2% 4731679 ± 7% interrupts.CPU18.RES:Rescheduling_interrupts 108465 ± 8% -23.0% 83467 ± 5% interrupts.CPU18.TLB:TLB_shootdowns 329294 ± 3% +15.4% 380131 ± 2% interrupts.CPU18.TRM:Thermal_event_interrupts 436.25 +13.8% 496.25 interrupts.CPU19.58:IR-PCI-MSI.1572883-edge.eth0-TxRx-19 92059 ± 6% -24.2% 69776 ± 5% interrupts.CPU19.CAL:Function_call_interrupts 1784665 +12.2% 2001579 interrupts.CPU19.LOC:Local_timer_interrupts 1284622 ± 7% +225.8% 4185208 ± 4% interrupts.CPU19.RES:Rescheduling_interrupts 108492 ± 7% -23.4% 83059 ± 4% interrupts.CPU19.TLB:TLB_shootdowns 329166 ± 3% +15.5% 380141 ± 2% interrupts.CPU19.TRM:Thermal_event_interrupts 1784512 +12.4% 2005572 interrupts.CPU2.LOC:Local_timer_interrupts 3091132 ± 8% -22.3% 2401342 ± 4% interrupts.CPU2.RES:Rescheduling_interrupts 102562 ± 9% -16.5% 85643 ± 5% interrupts.CPU2.TLB:TLB_shootdowns 388380 ± 12% +27.8% 496544 ± 4% interrupts.CPU2.TRM:Thermal_event_interrupts 436.25 +14.3% 498.50 interrupts.CPU20.59:IR-PCI-MSI.1572884-edge.eth0-TxRx-20 91785 ± 9% -23.9% 69853 ± 4% interrupts.CPU20.CAL:Function_call_interrupts 1785284 +12.1% 2001952 interrupts.CPU20.LOC:Local_timer_interrupts 1281621 ± 12% +203.6% 3890516 ± 7% interrupts.CPU20.RES:Rescheduling_interrupts 106297 ± 9% -19.9% 85180 ± 3% interrupts.CPU20.TLB:TLB_shootdowns 329293 ± 3% +15.4% 380131 ± 2% interrupts.CPU20.TRM:Thermal_event_interrupts 437.00 +12.2% 490.50 interrupts.CPU21.60:IR-PCI-MSI.1572885-edge.eth0-TxRx-21 92635 ± 7% -23.9% 70512 ± 6% interrupts.CPU21.CAL:Function_call_interrupts 1785480 +12.1% 2001723 interrupts.CPU21.LOC:Local_timer_interrupts 1595447 ± 6% +187.8% 4591004 interrupts.CPU21.RES:Rescheduling_interrupts 107575 ± 7% -21.6% 84296 ± 5% interrupts.CPU21.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380086 ± 2% interrupts.CPU21.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU22.61:IR-PCI-MSI.1572886-edge.eth0-TxRx-22 92674 ± 10% -24.4% 70047 ± 6% interrupts.CPU22.CAL:Function_call_interrupts 1784881 +12.1% 2001482 interrupts.CPU22.LOC:Local_timer_interrupts 1605143 ± 6% +179.5% 4486945 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 108749 ± 10% -23.3% 83409 ± 5% interrupts.CPU22.TLB:TLB_shootdowns 329295 ± 3% +15.4% 380136 ± 2% interrupts.CPU22.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU23.62:IR-PCI-MSI.1572887-edge.eth0-TxRx-23 90975 ± 11% -23.6% 69492 ± 5% interrupts.CPU23.CAL:Function_call_interrupts 1785236 +12.1% 2001811 interrupts.CPU23.LOC:Local_timer_interrupts 1600988 ± 2% +180.2% 4486667 ± 5% interrupts.CPU23.RES:Rescheduling_interrupts 106819 ± 10% -22.3% 83007 ± 4% interrupts.CPU23.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380146 ± 2% interrupts.CPU23.TRM:Thermal_event_interrupts 441.00 +11.8% 493.00 interrupts.CPU24.63:IR-PCI-MSI.1572888-edge.eth0-TxRx-24 91919 ± 11% -23.1% 70689 ± 5% interrupts.CPU24.CAL:Function_call_interrupts 1784996 +12.1% 2000922 interrupts.CPU24.LOC:Local_timer_interrupts 1612237 ± 5% +188.4% 4649702 ± 2% interrupts.CPU24.RES:Rescheduling_interrupts 108187 ± 8% -22.5% 83831 ± 3% interrupts.CPU24.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380122 ± 2% interrupts.CPU24.TRM:Thermal_event_interrupts 437.25 +13.3% 495.25 interrupts.CPU25.64:IR-PCI-MSI.1572889-edge.eth0-TxRx-25 88417 ± 12% -20.8% 70029 ± 4% interrupts.CPU25.CAL:Function_call_interrupts 1785404 +12.0% 1999622 interrupts.CPU25.LOC:Local_timer_interrupts 1612074 ± 2% +182.4% 4551699 interrupts.CPU25.RES:Rescheduling_interrupts 105324 ± 10% -20.1% 84201 ± 4% interrupts.CPU25.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380141 ± 2% interrupts.CPU25.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU26.65:IR-PCI-MSI.1572890-edge.eth0-TxRx-26 92632 ± 12% -23.5% 70907 ± 5% interrupts.CPU26.CAL:Function_call_interrupts 1784730 +12.1% 2000264 interrupts.CPU26.LOC:Local_timer_interrupts 1639148 ± 6% +188.0% 4720149 ± 4% interrupts.CPU26.RES:Rescheduling_interrupts 108099 ± 11% -21.6% 84727 ± 4% interrupts.CPU26.TLB:TLB_shootdowns 329271 ± 3% +15.4% 379984 ± 2% interrupts.CPU26.TRM:Thermal_event_interrupts 91312 ± 12% -23.4% 69963 ± 6% interrupts.CPU27.CAL:Function_call_interrupts 1785171 +12.1% 2001743 interrupts.CPU27.LOC:Local_timer_interrupts 1704847 ± 11% +179.4% 4764019 ± 4% interrupts.CPU27.RES:Rescheduling_interrupts 106515 ± 11% -21.6% 83491 ± 5% interrupts.CPU27.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380080 ± 2% interrupts.CPU27.TRM:Thermal_event_interrupts 89178 ± 8% -22.0% 69565 ± 6% interrupts.CPU28.CAL:Function_call_interrupts 1785194 +12.1% 2001836 interrupts.CPU28.LOC:Local_timer_interrupts 1593025 ± 8% +185.7% 4551782 ± 5% interrupts.CPU28.RES:Rescheduling_interrupts 104408 ± 10% -19.2% 84365 ± 6% interrupts.CPU28.TLB:TLB_shootdowns 329294 ± 3% +15.4% 380142 ± 2% interrupts.CPU28.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU29.68:IR-PCI-MSI.1572893-edge.eth0-TxRx-29 90850 ± 12% -21.9% 70993 ± 6% interrupts.CPU29.CAL:Function_call_interrupts 1785398 +12.1% 2000545 interrupts.CPU29.LOC:Local_timer_interrupts 1657508 ± 5% +179.4% 4631109 ± 3% interrupts.CPU29.RES:Rescheduling_interrupts 106383 ± 13% -20.8% 84284 ± 4% interrupts.CPU29.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380133 ± 2% interrupts.CPU29.TRM:Thermal_event_interrupts 509.75 ± 3% +545.1% 3288 ±120% interrupts.CPU3.42:IR-PCI-MSI.1572867-edge.eth0-TxRx-3 87008 ± 11% -19.9% 69730 ± 5% interrupts.CPU3.CAL:Function_call_interrupts 1784446 +12.4% 2005368 interrupts.CPU3.LOC:Local_timer_interrupts 3169674 ± 9% -20.4% 2521963 ± 8% interrupts.CPU3.RES:Rescheduling_interrupts 103703 ± 12% -17.1% 85958 ± 7% interrupts.CPU3.TLB:TLB_shootdowns 388356 ± 12% +27.9% 496551 ± 4% interrupts.CPU3.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU30.69:IR-PCI-MSI.1572894-edge.eth0-TxRx-30 92043 ± 12% -24.2% 69765 ± 5% interrupts.CPU30.CAL:Function_call_interrupts 1785175 +12.1% 2001248 interrupts.CPU30.LOC:Local_timer_interrupts 1637465 ± 6% +191.3% 4769701 ± 3% interrupts.CPU30.RES:Rescheduling_interrupts 106836 ± 11% -22.5% 82810 ± 5% interrupts.CPU30.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380130 ± 2% interrupts.CPU30.TRM:Thermal_event_interrupts 1785301 +12.0% 1999270 interrupts.CPU31.LOC:Local_timer_interrupts 62.75 ±173% +4261.4% 2736 ±113% interrupts.CPU31.NMI:Non-maskable_interrupts 62.75 ±173% +4261.4% 2736 ±113% interrupts.CPU31.PMI:Performance_monitoring_interrupts 1589500 ± 5% +184.1% 4515325 interrupts.CPU31.RES:Rescheduling_interrupts 106576 ± 11% -21.5% 83698 ± 5% interrupts.CPU31.TLB:TLB_shootdowns 329293 ± 3% +15.4% 380131 ± 2% interrupts.CPU31.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU32.71:IR-PCI-MSI.1572896-edge.eth0-TxRx-32 93348 ± 12% -24.4% 70595 ± 8% interrupts.CPU32.CAL:Function_call_interrupts 1785245 +12.1% 2001145 interrupts.CPU32.LOC:Local_timer_interrupts 1626883 ± 6% +176.3% 4494456 ± 5% interrupts.CPU32.RES:Rescheduling_interrupts 107151 ± 12% -21.4% 84236 ± 5% interrupts.CPU32.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380131 ± 2% interrupts.CPU32.TRM:Thermal_event_interrupts 437.25 ± 2% +12.2% 490.50 interrupts.CPU33.74:IR-PCI-MSI.1572897-edge.eth0-TxRx-33 91487 ± 12% -22.7% 70758 ± 3% interrupts.CPU33.CAL:Function_call_interrupts 1785371 +12.0% 1999987 interrupts.CPU33.LOC:Local_timer_interrupts 1578761 ± 6% +201.2% 4754762 ± 6% interrupts.CPU33.RES:Rescheduling_interrupts 106071 ± 12% -21.3% 83430 ± 2% interrupts.CPU33.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380130 ± 2% interrupts.CPU33.TRM:Thermal_event_interrupts 436.25 +12.6% 491.25 interrupts.CPU34.75:IR-PCI-MSI.1572898-edge.eth0-TxRx-34 91116 ± 11% -24.3% 68943 ± 7% interrupts.CPU34.CAL:Function_call_interrupts 1785353 +12.1% 2001525 interrupts.CPU34.LOC:Local_timer_interrupts 1553828 ± 4% +186.0% 4444035 ± 3% interrupts.CPU34.RES:Rescheduling_interrupts 105575 ± 10% -20.7% 83762 ± 4% interrupts.CPU34.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380139 ± 2% interrupts.CPU34.TRM:Thermal_event_interrupts 440.75 +12.4% 495.25 ± 2% interrupts.CPU35.76:IR-PCI-MSI.1572899-edge.eth0-TxRx-35 91396 ± 11% -25.6% 67986 ± 11% interrupts.CPU35.CAL:Function_call_interrupts 1785237 +12.0% 2000288 interrupts.CPU35.LOC:Local_timer_interrupts 1602616 ± 10% +189.7% 4642115 ± 3% interrupts.CPU35.RES:Rescheduling_interrupts 107669 ± 12% -21.3% 84736 ± 4% interrupts.CPU35.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380145 ± 2% interrupts.CPU35.TRM:Thermal_event_interrupts 436.25 +12.6% 491.00 interrupts.CPU36.77:IR-PCI-MSI.1572900-edge.eth0-TxRx-36 93553 ± 8% -19.8% 75044 ± 6% interrupts.CPU36.CAL:Function_call_interrupts 1784636 +12.4% 2005389 interrupts.CPU36.LOC:Local_timer_interrupts 2588984 ± 6% +25.8% 3256348 ± 6% interrupts.CPU36.RES:Rescheduling_interrupts 107053 ± 7% -19.0% 86754 ± 5% interrupts.CPU36.TLB:TLB_shootdowns 388423 ± 12% +27.8% 496560 ± 4% interrupts.CPU36.TRM:Thermal_event_interrupts 436.75 +13.1% 493.75 interrupts.CPU37.78:IR-PCI-MSI.1572901-edge.eth0-TxRx-37 89518 ± 10% -18.9% 72619 ± 5% interrupts.CPU37.CAL:Function_call_interrupts 1784648 +12.4% 2005651 interrupts.CPU37.LOC:Local_timer_interrupts 3112476 ± 10% -20.8% 2464103 ± 5% interrupts.CPU37.RES:Rescheduling_interrupts 102576 ± 10% -14.4% 87794 ± 6% interrupts.CPU37.TLB:TLB_shootdowns 388412 ± 12% +27.8% 496563 ± 4% interrupts.CPU37.TRM:Thermal_event_interrupts 436.25 +12.8% 492.25 interrupts.CPU38.79:IR-PCI-MSI.1572902-edge.eth0-TxRx-38 92566 ± 10% -20.6% 73466 ± 6% interrupts.CPU38.CAL:Function_call_interrupts 1785132 +12.4% 2005883 interrupts.CPU38.LOC:Local_timer_interrupts 3163520 ± 10% -26.0% 2340820 ± 11% interrupts.CPU38.RES:Rescheduling_interrupts 105823 ± 10% -18.0% 86785 ± 4% interrupts.CPU38.TLB:TLB_shootdowns 388401 ± 12% +27.8% 496554 ± 4% interrupts.CPU38.TRM:Thermal_event_interrupts 436.25 +12.8% 492.25 interrupts.CPU39.80:IR-PCI-MSI.1572903-edge.eth0-TxRx-39 93197 ± 11% -21.8% 72854 ± 7% interrupts.CPU39.CAL:Function_call_interrupts 1784624 +12.4% 2005934 interrupts.CPU39.LOC:Local_timer_interrupts 105953 ± 11% -20.8% 83925 ± 6% interrupts.CPU39.TLB:TLB_shootdowns 388418 ± 12% +27.8% 496548 ± 4% interrupts.CPU39.TRM:Thermal_event_interrupts 86883 ± 13% -17.8% 71449 ± 7% interrupts.CPU4.CAL:Function_call_interrupts 1784433 +12.4% 2005462 interrupts.CPU4.LOC:Local_timer_interrupts 3119739 ± 9% -21.1% 2461192 ± 4% interrupts.CPU4.RES:Rescheduling_interrupts 104829 ± 11% -19.1% 84802 ± 5% interrupts.CPU4.TLB:TLB_shootdowns 388417 ± 12% +27.8% 496563 ± 4% interrupts.CPU4.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU40.81:IR-PCI-MSI.1572904-edge.eth0-TxRx-40 91881 ± 12% -21.4% 72188 ± 8% interrupts.CPU40.CAL:Function_call_interrupts 1784831 +12.4% 2005991 interrupts.CPU40.LOC:Local_timer_interrupts 3101288 ± 10% -17.2% 2569221 ± 7% interrupts.CPU40.RES:Rescheduling_interrupts 105884 ± 10% -19.0% 85772 ± 5% interrupts.CPU40.TLB:TLB_shootdowns 388415 ± 12% +27.8% 496564 ± 4% interrupts.CPU40.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU41.82:IR-PCI-MSI.1572905-edge.eth0-TxRx-41 91739 ± 12% -19.9% 73475 ± 7% interrupts.CPU41.CAL:Function_call_interrupts 1785231 +12.3% 2005398 interrupts.CPU41.LOC:Local_timer_interrupts 3223405 ± 11% -27.9% 2325498 ± 5% interrupts.CPU41.RES:Rescheduling_interrupts 104410 ± 11% -18.7% 84846 ± 6% interrupts.CPU41.TLB:TLB_shootdowns 388408 ± 12% +27.8% 496557 ± 4% interrupts.CPU41.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU42.83:IR-PCI-MSI.1572906-edge.eth0-TxRx-42 1785354 +12.4% 2006034 interrupts.CPU42.LOC:Local_timer_interrupts 3068304 ± 9% -22.1% 2390347 ± 6% interrupts.CPU42.RES:Rescheduling_interrupts 107102 ± 9% -20.7% 84890 ± 4% interrupts.CPU42.TLB:TLB_shootdowns 388423 ± 12% +27.8% 496564 ± 4% interrupts.CPU42.TRM:Thermal_event_interrupts 436.25 +14.6% 499.75 ± 2% interrupts.CPU43.84:IR-PCI-MSI.1572907-edge.eth0-TxRx-43 92178 ± 9% -18.3% 75306 ± 7% interrupts.CPU43.CAL:Function_call_interrupts 1784759 +12.4% 2005986 interrupts.CPU43.LOC:Local_timer_interrupts 6434 ± 7% -64.3% 2297 ±106% interrupts.CPU43.NMI:Non-maskable_interrupts 6434 ± 7% -64.3% 2297 ±106% interrupts.CPU43.PMI:Performance_monitoring_interrupts 104773 ± 9% -17.6% 86369 ± 6% interrupts.CPU43.TLB:TLB_shootdowns 388425 ± 12% +27.8% 496556 ± 4% interrupts.CPU43.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU44.85:IR-PCI-MSI.1572908-edge.eth0-TxRx-44 92387 ± 10% -21.9% 72174 ± 9% interrupts.CPU44.CAL:Function_call_interrupts 1784603 +12.4% 2006064 interrupts.CPU44.LOC:Local_timer_interrupts 106179 ± 9% -18.6% 86461 ± 6% interrupts.CPU44.TLB:TLB_shootdowns 388426 ± 12% +27.8% 496562 ± 4% interrupts.CPU44.TRM:Thermal_event_interrupts 436.50 +12.4% 490.50 interrupts.CPU45.86:IR-PCI-MSI.1572909-edge.eth0-TxRx-45 93641 ± 7% -21.9% 73155 ± 6% interrupts.CPU45.CAL:Function_call_interrupts 1784811 +12.4% 2005654 interrupts.CPU45.LOC:Local_timer_interrupts 3093195 ± 11% -15.6% 2609354 ± 4% interrupts.CPU45.RES:Rescheduling_interrupts 106463 ± 7% -19.6% 85593 ± 5% interrupts.CPU45.TLB:TLB_shootdowns 388408 ± 12% +27.8% 496564 ± 4% interrupts.CPU45.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU46.87:IR-PCI-MSI.1572910-edge.eth0-TxRx-46 91739 ± 10% -19.0% 74279 ± 8% interrupts.CPU46.CAL:Function_call_interrupts 1784609 +12.4% 2005522 interrupts.CPU46.LOC:Local_timer_interrupts 2970471 ± 9% -21.0% 2345439 ± 8% interrupts.CPU46.RES:Rescheduling_interrupts 108158 ± 10% -19.8% 86743 ± 4% interrupts.CPU46.TLB:TLB_shootdowns 388368 ± 12% +27.8% 496469 ± 4% interrupts.CPU46.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU47.88:IR-PCI-MSI.1572911-edge.eth0-TxRx-47 92856 ± 9% -20.0% 74327 ± 8% interrupts.CPU47.CAL:Function_call_interrupts 1784835 +12.4% 2005700 interrupts.CPU47.LOC:Local_timer_interrupts 3116242 ± 10% -20.4% 2480398 ± 5% interrupts.CPU47.RES:Rescheduling_interrupts 104927 ± 9% -18.6% 85393 ± 6% interrupts.CPU47.TLB:TLB_shootdowns 388403 ± 12% +27.8% 496554 ± 4% interrupts.CPU47.TRM:Thermal_event_interrupts 436.25 +12.6% 491.00 interrupts.CPU48.89:IR-PCI-MSI.1572912-edge.eth0-TxRx-48 92889 ± 11% -21.5% 72890 ± 8% interrupts.CPU48.CAL:Function_call_interrupts 1784772 +12.4% 2006205 interrupts.CPU48.LOC:Local_timer_interrupts 3175210 ± 12% -19.7% 2548339 ± 13% interrupts.CPU48.RES:Rescheduling_interrupts 105183 ± 11% -18.6% 85618 ± 6% interrupts.CPU48.TLB:TLB_shootdowns 388426 ± 12% +27.8% 496563 ± 4% interrupts.CPU48.TRM:Thermal_event_interrupts 441.25 ± 3% +14.1% 503.25 ± 3% interrupts.CPU49.90:IR-PCI-MSI.1572913-edge.eth0-TxRx-49 90134 ± 10% -18.3% 73603 ± 6% interrupts.CPU49.CAL:Function_call_interrupts 1785145 +12.4% 2005932 interrupts.CPU49.LOC:Local_timer_interrupts 3185609 ± 11% -17.6% 2626502 ± 4% interrupts.CPU49.RES:Rescheduling_interrupts 102737 ± 10% -17.3% 84932 ± 5% interrupts.CPU49.TLB:TLB_shootdowns 388425 ± 12% +27.8% 496560 ± 4% interrupts.CPU49.TRM:Thermal_event_interrupts 92114 ± 9% -23.2% 70721 ± 6% interrupts.CPU5.CAL:Function_call_interrupts 1785135 +12.3% 2005424 interrupts.CPU5.LOC:Local_timer_interrupts 3210646 ± 12% -24.8% 2415935 ± 4% interrupts.CPU5.RES:Rescheduling_interrupts 107349 ± 9% -18.9% 87034 ± 6% interrupts.CPU5.TLB:TLB_shootdowns 388418 ± 12% +27.8% 496564 ± 4% interrupts.CPU5.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU50.91:IR-PCI-MSI.1572914-edge.eth0-TxRx-50 92406 ± 10% -20.2% 73771 ± 8% interrupts.CPU50.CAL:Function_call_interrupts 1785200 +12.4% 2006488 interrupts.CPU50.LOC:Local_timer_interrupts 106635 ± 9% -19.9% 85431 ± 6% interrupts.CPU50.TLB:TLB_shootdowns 388419 ± 12% +27.8% 496564 ± 4% interrupts.CPU50.TRM:Thermal_event_interrupts 436.25 +14.4% 499.25 ± 3% interrupts.CPU51.92:IR-PCI-MSI.1572915-edge.eth0-TxRx-51 91491 ± 9% -20.8% 72473 ± 6% interrupts.CPU51.CAL:Function_call_interrupts 1784683 +12.4% 2005527 interrupts.CPU51.LOC:Local_timer_interrupts 3051494 ± 8% -24.6% 2300032 ± 10% interrupts.CPU51.RES:Rescheduling_interrupts 104954 ± 10% -20.2% 83775 ± 5% interrupts.CPU51.TLB:TLB_shootdowns 388264 ± 12% +27.9% 496462 ± 4% interrupts.CPU51.TRM:Thermal_event_interrupts 92938 ± 11% -19.7% 74594 ± 7% interrupts.CPU52.CAL:Function_call_interrupts 1785451 +12.4% 2006171 interrupts.CPU52.LOC:Local_timer_interrupts 3025681 ± 11% -17.1% 2506800 ± 10% interrupts.CPU52.RES:Rescheduling_interrupts 107100 ± 11% -19.6% 86156 ± 6% interrupts.CPU52.TLB:TLB_shootdowns 388422 ± 12% +27.8% 496563 ± 4% interrupts.CPU52.TRM:Thermal_event_interrupts 439.25 ± 2% +11.7% 490.50 interrupts.CPU53.94:IR-PCI-MSI.1572917-edge.eth0-TxRx-53 93000 ± 12% -20.9% 73549 ± 7% interrupts.CPU53.CAL:Function_call_interrupts 1785290 +12.3% 2005441 interrupts.CPU53.LOC:Local_timer_interrupts 3212623 ± 7% -18.2% 2629478 ± 10% interrupts.CPU53.RES:Rescheduling_interrupts 107303 ± 11% -17.5% 88567 ± 10% interrupts.CPU53.TLB:TLB_shootdowns 388411 ± 12% +27.8% 496557 ± 4% interrupts.CPU53.TRM:Thermal_event_interrupts 437.75 +12.1% 490.50 interrupts.CPU54.95:IR-PCI-MSI.1572918-edge.eth0-TxRx-54 1785170 +12.0% 2000090 interrupts.CPU54.LOC:Local_timer_interrupts 5351 ± 26% -64.5% 1900 ± 99% interrupts.CPU54.NMI:Non-maskable_interrupts 5351 ± 26% -64.5% 1900 ± 99% interrupts.CPU54.PMI:Performance_monitoring_interrupts 2066106 ± 9% +92.7% 3982033 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts 108150 ± 12% -21.2% 85173 ± 5% interrupts.CPU54.TLB:TLB_shootdowns 329294 ± 3% +15.4% 380146 ± 2% interrupts.CPU54.TRM:Thermal_event_interrupts 436.50 +12.4% 490.50 interrupts.CPU55.96:IR-PCI-MSI.1572919-edge.eth0-TxRx-55 91164 ± 12% -19.9% 73014 ± 6% interrupts.CPU55.CAL:Function_call_interrupts 1785472 +12.0% 1999115 interrupts.CPU55.LOC:Local_timer_interrupts 1286654 ± 6% +228.2% 4223034 ± 5% interrupts.CPU55.RES:Rescheduling_interrupts 104943 ± 11% -19.5% 84466 ± 5% interrupts.CPU55.TLB:TLB_shootdowns 329292 ± 3% +15.4% 379918 ± 2% interrupts.CPU55.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU56.97:IR-PCI-MSI.1572920-edge.eth0-TxRx-56 96934 ± 13% -23.4% 74215 ± 6% interrupts.CPU56.CAL:Function_call_interrupts 1785010 +12.1% 2000169 interrupts.CPU56.LOC:Local_timer_interrupts 1312758 ± 17% +194.5% 3866522 ± 3% interrupts.CPU56.RES:Rescheduling_interrupts 109307 ± 12% -22.1% 85139 ± 4% interrupts.CPU56.TLB:TLB_shootdowns 329273 ± 3% +15.4% 380131 ± 2% interrupts.CPU56.TRM:Thermal_event_interrupts 439.00 ± 2% +11.7% 490.50 interrupts.CPU57.98:IR-PCI-MSI.1572921-edge.eth0-TxRx-57 94960 ± 11% -22.9% 73246 ± 5% interrupts.CPU57.CAL:Function_call_interrupts 1785297 +12.0% 2000019 interrupts.CPU57.LOC:Local_timer_interrupts 1666475 ± 10% +169.6% 4492937 interrupts.CPU57.RES:Rescheduling_interrupts 107534 ± 10% -22.0% 83871 ± 5% interrupts.CPU57.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380136 ± 2% interrupts.CPU57.TRM:Thermal_event_interrupts 442.25 ± 3% +10.9% 490.50 interrupts.CPU58.99:IR-PCI-MSI.1572922-edge.eth0-TxRx-58 92818 ± 12% -21.4% 72925 ± 5% interrupts.CPU58.CAL:Function_call_interrupts 1785429 +12.0% 1999528 interrupts.CPU58.LOC:Local_timer_interrupts 1606064 ± 5% +176.8% 4446179 ± 6% interrupts.CPU58.RES:Rescheduling_interrupts 103696 ± 11% -19.5% 83458 ± 4% interrupts.CPU58.TLB:TLB_shootdowns 329293 ± 3% +15.4% 380022 ± 2% interrupts.CPU58.TRM:Thermal_event_interrupts 439.00 +11.7% 490.50 interrupts.CPU59.100:IR-PCI-MSI.1572923-edge.eth0-TxRx-59 93876 ± 13% -20.5% 74669 ± 6% interrupts.CPU59.CAL:Function_call_interrupts 1785085 +12.0% 1999992 interrupts.CPU59.LOC:Local_timer_interrupts 1634812 ± 5% +174.5% 4487501 ± 4% interrupts.CPU59.RES:Rescheduling_interrupts 106929 ± 13% -21.0% 84522 ± 5% interrupts.CPU59.TLB:TLB_shootdowns 329291 ± 3% +15.4% 380111 ± 2% interrupts.CPU59.TRM:Thermal_event_interrupts 89930 ± 9% -20.5% 71520 ± 7% interrupts.CPU6.CAL:Function_call_interrupts 1785220 +12.3% 2005468 interrupts.CPU6.LOC:Local_timer_interrupts 106307 ± 7% -19.9% 85162 ± 6% interrupts.CPU6.TLB:TLB_shootdowns 388421 ± 12% +27.8% 496564 ± 4% interrupts.CPU6.TRM:Thermal_event_interrupts 436.25 +13.1% 493.25 interrupts.CPU60.101:IR-PCI-MSI.1572924-edge.eth0-TxRx-60 98595 ± 11% -25.6% 73379 ± 5% interrupts.CPU60.CAL:Function_call_interrupts 1785116 +12.1% 2000324 interrupts.CPU60.LOC:Local_timer_interrupts 1604314 ± 8% +186.8% 4601614 ± 5% interrupts.CPU60.RES:Rescheduling_interrupts 110442 ± 10% -24.0% 83932 ± 5% interrupts.CPU60.TLB:TLB_shootdowns 329256 ± 3% +15.5% 380140 ± 2% interrupts.CPU60.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU61.102:IR-PCI-MSI.1572925-edge.eth0-TxRx-61 93035 ± 11% -21.4% 73124 ± 5% interrupts.CPU61.CAL:Function_call_interrupts 1785176 +12.1% 2000960 interrupts.CPU61.LOC:Local_timer_interrupts 4567 ± 67% -79.2% 952.00 ±171% interrupts.CPU61.NMI:Non-maskable_interrupts 4567 ± 67% -79.2% 952.00 ±171% interrupts.CPU61.PMI:Performance_monitoring_interrupts 1575186 ± 6% +194.9% 4644760 ± 4% interrupts.CPU61.RES:Rescheduling_interrupts 103665 ± 11% -18.7% 84259 ± 5% interrupts.CPU61.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380127 ± 2% interrupts.CPU61.TRM:Thermal_event_interrupts 436.25 +12.4% 490.50 interrupts.CPU62.103:IR-PCI-MSI.1572926-edge.eth0-TxRx-62 95188 ± 10% -21.9% 74376 ± 6% interrupts.CPU62.CAL:Function_call_interrupts 1785028 +12.0% 1999262 interrupts.CPU62.LOC:Local_timer_interrupts 1613834 ± 8% +184.7% 4594499 ± 3% interrupts.CPU62.RES:Rescheduling_interrupts 106856 ± 10% -21.4% 83987 ± 5% interrupts.CPU62.TLB:TLB_shootdowns 329270 ± 3% +15.4% 380120 ± 2% interrupts.CPU62.TRM:Thermal_event_interrupts 94411 ± 11% -21.3% 74269 ± 5% interrupts.CPU63.CAL:Function_call_interrupts 1785322 +12.0% 1999237 interrupts.CPU63.LOC:Local_timer_interrupts 1669218 ± 6% +187.2% 4794684 ± 3% interrupts.CPU63.RES:Rescheduling_interrupts 105402 ± 10% -18.3% 86076 ± 8% interrupts.CPU63.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380141 ± 2% interrupts.CPU63.TRM:Thermal_event_interrupts 96060 ± 11% -22.6% 74364 ± 6% interrupts.CPU64.CAL:Function_call_interrupts 1785304 +12.0% 1999571 interrupts.CPU64.LOC:Local_timer_interrupts 1681501 ± 7% +164.0% 4438647 ± 3% interrupts.CPU64.RES:Rescheduling_interrupts 108534 ± 10% -22.8% 83813 ± 5% interrupts.CPU64.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380142 ± 2% interrupts.CPU64.TRM:Thermal_event_interrupts 94178 ± 9% -22.7% 72758 ± 8% interrupts.CPU65.CAL:Function_call_interrupts 1785338 +12.0% 1999408 interrupts.CPU65.LOC:Local_timer_interrupts 1674108 ± 4% +182.2% 4724262 ± 3% interrupts.CPU65.RES:Rescheduling_interrupts 107519 ± 10% -22.6% 83259 ± 5% interrupts.CPU65.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380128 ± 2% interrupts.CPU65.TRM:Thermal_event_interrupts 95135 ± 8% -22.4% 73795 ± 5% interrupts.CPU66.CAL:Function_call_interrupts 1785413 +12.0% 2000352 interrupts.CPU66.LOC:Local_timer_interrupts 616.75 ±171% +902.4% 6182 ± 28% interrupts.CPU66.NMI:Non-maskable_interrupts 616.75 ±171% +902.4% 6182 ± 28% interrupts.CPU66.PMI:Performance_monitoring_interrupts 1646166 ± 6% +169.3% 4433267 ± 6% interrupts.CPU66.RES:Rescheduling_interrupts 107190 ± 7% -22.5% 83034 ± 4% interrupts.CPU66.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380118 ± 2% interrupts.CPU66.TRM:Thermal_event_interrupts 95627 ± 10% -22.4% 74249 ± 5% interrupts.CPU67.CAL:Function_call_interrupts 1785314 +12.1% 2001128 interrupts.CPU67.LOC:Local_timer_interrupts 1611146 ± 4% +183.8% 4572204 ± 7% interrupts.CPU67.RES:Rescheduling_interrupts 109283 ± 11% -22.5% 84676 ± 4% interrupts.CPU67.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380142 ± 2% interrupts.CPU67.TRM:Thermal_event_interrupts 95479 ± 11% -20.6% 75791 ± 5% interrupts.CPU68.CAL:Function_call_interrupts 1785192 +12.0% 1999411 interrupts.CPU68.LOC:Local_timer_interrupts 1575394 ± 7% +189.9% 4567277 ± 4% interrupts.CPU68.RES:Rescheduling_interrupts 106972 ± 12% -18.6% 87039 ± 5% interrupts.CPU68.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380129 ± 2% interrupts.CPU68.TRM:Thermal_event_interrupts 93067 ± 14% -19.9% 74538 ± 4% interrupts.CPU69.CAL:Function_call_interrupts 1785257 +12.1% 2000636 interrupts.CPU69.LOC:Local_timer_interrupts 1578663 ± 9% +192.9% 4624518 ± 3% interrupts.CPU69.RES:Rescheduling_interrupts 104271 ± 12% -18.5% 84989 ± 2% interrupts.CPU69.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380066 ± 2% interrupts.CPU69.TRM:Thermal_event_interrupts 474.00 ± 3% +49.7% 709.75 ± 24% interrupts.CPU7.46:IR-PCI-MSI.1572871-edge.eth0-TxRx-7 92062 ± 9% -19.7% 73884 ± 5% interrupts.CPU7.CAL:Function_call_interrupts 1784266 +12.4% 2004980 interrupts.CPU7.LOC:Local_timer_interrupts 2505703 ± 11% -19.0% 2029187 ± 5% interrupts.CPU7.RES:Rescheduling_interrupts 107698 ± 8% -18.4% 87903 ± 6% interrupts.CPU7.TLB:TLB_shootdowns 388281 ± 12% +27.8% 496347 ± 4% interrupts.CPU7.TRM:Thermal_event_interrupts 92337 ± 12% -17.5% 76148 ± 2% interrupts.CPU70.CAL:Function_call_interrupts 1785161 +12.0% 1999757 interrupts.CPU70.LOC:Local_timer_interrupts 1562360 ± 4% +170.8% 4231208 ± 9% interrupts.CPU70.RES:Rescheduling_interrupts 103862 ± 10% -18.8% 84371 ± 3% interrupts.CPU70.TLB:TLB_shootdowns 329296 ± 3% +15.4% 380141 ± 2% interrupts.CPU70.TRM:Thermal_event_interrupts 95829 ± 12% -21.2% 75509 ± 5% interrupts.CPU71.CAL:Function_call_interrupts 1784894 +12.1% 2001287 interrupts.CPU71.LOC:Local_timer_interrupts 1533567 ± 7% +196.9% 4553440 interrupts.CPU71.RES:Rescheduling_interrupts 105883 ± 11% -20.4% 84248 ± 6% interrupts.CPU71.TLB:TLB_shootdowns 329247 ± 3% +15.5% 380146 ± 2% interrupts.CPU71.TRM:Thermal_event_interrupts 88372 ± 11% -20.3% 70389 ± 7% interrupts.CPU8.CAL:Function_call_interrupts 1784452 +12.4% 2005305 interrupts.CPU8.LOC:Local_timer_interrupts 103992 ± 10% -17.4% 85887 ± 5% interrupts.CPU8.TLB:TLB_shootdowns 388422 ± 12% +27.8% 496557 ± 4% interrupts.CPU8.TRM:Thermal_event_interrupts 89290 ± 10% -19.1% 72221 ± 6% interrupts.CPU9.CAL:Function_call_interrupts 1784716 +12.4% 2005710 interrupts.CPU9.LOC:Local_timer_interrupts 104340 ± 10% -16.0% 87647 ± 3% interrupts.CPU9.TLB:TLB_shootdowns 388408 ± 12% +27.8% 496557 ± 4% interrupts.CPU9.TRM:Thermal_event_interrupts 1.285e+08 +12.2% 1.442e+08 interrupts.LOC:Local_timer_interrupts 144.00 +50.0% 216.00 interrupts.MCP:Machine_check_polls 1.677e+08 ± 8% +50.4% 2.522e+08 ± 2% interrupts.RES:Rescheduling_interrupts 7624145 ± 10% -19.7% 6125835 ± 5% interrupts.TLB:TLB_shootdowns 25836833 ± 8% +22.2% 31559779 ± 2% interrupts.TRM:Thermal_event_interrupts *************************************************************************************************** lkp-bdw-ep6: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/process/50%/debian-x86_64-2019-11-14.cgz/lkp-bdw-ep6/hackbench/0xb000038 commit: 43e9f7f231 ("sched/fair: Start tracking SCHED_IDLE tasks count in cfs_rq") 3c29e651e1 ("sched/fair: Fall back to sched-idle CPU if idle CPU isn't found") 43e9f7f231e40e45 3c29e651e16dd3b3179cfb2d055 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 134091 -10.6% 119937 hackbench.throughput 3.352e+09 ± 2% +16.1% 3.892e+09 ± 5% hackbench.time.involuntary_context_switches 535571 ± 2% +10.6% 592420 ± 4% numa-meminfo.node0.FilePages 12614 ± 18% -12.2% 11078 ± 18% numa-meminfo.node1.Mapped 3472 ± 6% +18.0% 4096 slabinfo.skbuff_head_cache.active_objs 3568 ± 6% +15.7% 4128 slabinfo.skbuff_head_cache.num_objs 730128 ± 5% -52.2% 349073 ± 25% turbostat.C3 14.77 +5.9% 15.64 turbostat.RAMWatt 24613783 ± 5% -32.6% 16595193 ± 23% numa-numastat.node0.local_node 24632941 ± 5% -32.6% 16605181 ± 23% numa-numastat.node0.numa_hit 25827961 -29.9% 18097150 ± 19% numa-numastat.node1.local_node 25836948 -29.9% 18115676 ± 19% numa-numastat.node1.numa_hit 50467170 ± 2% -31.2% 34733456 ± 10% proc-vmstat.numa_hit 50439016 ± 2% -31.2% 34704933 ± 10% proc-vmstat.numa_local 50622650 ± 2% -31.1% 34896854 ± 10% proc-vmstat.pgalloc_normal 50548381 ± 2% -31.1% 34834391 ± 10% proc-vmstat.pgfree 79.00 +2.2% 80.75 vmstat.cpu.sy 19.00 -7.9% 17.50 ± 2% vmstat.cpu.us 13450755 +4.6% 14066265 vmstat.system.cs 1122772 -12.1% 986681 vmstat.system.in 133891 ± 2% +10.6% 148112 ± 4% numa-vmstat.node0.nr_file_pages 12301995 ± 4% -30.2% 8590153 ± 22% numa-vmstat.node0.numa_hit 12282910 ± 4% -30.1% 8580139 ± 22% numa-vmstat.node0.numa_local 12964354 ± 5% -31.2% 8914408 ± 18% numa-vmstat.node1.numa_hit 12806275 ± 5% -31.7% 8746928 ± 19% numa-vmstat.node1.numa_local 33816695 ± 10% +17.8% 39824104 ± 7% cpuidle.C1.time 21015951 ± 3% +19.6% 25127666 ± 7% cpuidle.C1E.time 730991 ± 5% -52.1% 350128 ± 25% cpuidle.C3.usage 1.497e+08 ± 28% +41.6% 2.119e+08 ± 15% cpuidle.C6.time 6771631 ± 4% -45.2% 3713804 ± 15% cpuidle.POLL.time 5209842 ± 4% -44.1% 2913245 ± 15% cpuidle.POLL.usage 26965506 +5.5% 28444381 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg 28257967 +6.6% 30126596 ± 4% sched_debug.cfs_rq:/.min_vruntime.max 582203 ± 9% +37.0% 797353 ± 8% sched_debug.cfs_rq:/.min_vruntime.stddev 4.65 ± 8% -10.7% 4.16 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.stddev 4620 ± 6% -10.7% 4125 ± 4% sched_debug.cfs_rq:/.runnable_weight.stddev 582831 ± 9% +36.6% 796226 ± 7% sched_debug.cfs_rq:/.spread0.stddev 154.73 ± 2% -14.7% 132.00 ± 3% sched_debug.cfs_rq:/.util_avg.stddev 120.93 ± 25% +43.5% 173.50 ± 19% sched_debug.cfs_rq:/.util_est_enqueued.min 184.93 ± 2% -11.0% 164.54 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.stddev 182135 ± 18% +57.1% 286098 ± 6% sched_debug.cpu.avg_idle.avg 185926 ± 19% +49.0% 276991 ± 9% sched_debug.cpu.avg_idle.stddev 3.32 ± 4% -10.8% 2.96 ± 3% sched_debug.cpu.nr_running.stddev 46710201 +9.0% 50934866 ± 5% sched_debug.cpu.nr_switches.avg 50053735 +16.9% 58491253 ± 7% sched_debug.cpu.nr_switches.max 43751407 +6.7% 46698664 ± 4% sched_debug.cpu.nr_switches.min 1344975 ± 10% +78.9% 2406504 ± 16% sched_debug.cpu.nr_switches.stddev 1.63 ± 3% -32.8% 1.09 ± 11% sched_debug.cpu.nr_uninterruptible.avg 1017 ± 27% -59.5% 411.75 ± 16% interrupts.40:IR-PCI-MSI.1572871-edge.eth0-TxRx-6 6547829 -14.4% 5603910 ± 5% interrupts.CPU16.RES:Rescheduling_interrupts 1017 ± 27% -59.5% 411.75 ± 16% interrupts.CPU19.40:IR-PCI-MSI.1572871-edge.eth0-TxRx-6 6801598 -14.7% 5801847 ± 5% interrupts.CPU19.RES:Rescheduling_interrupts 6609756 -13.7% 5703084 ± 8% interrupts.CPU20.RES:Rescheduling_interrupts 6446878 ± 2% -11.8% 5689145 ± 7% interrupts.CPU21.RES:Rescheduling_interrupts 6634825 -9.4% 6008203 ± 6% interrupts.CPU24.RES:Rescheduling_interrupts 6801182 -9.8% 6137528 ± 3% interrupts.CPU25.RES:Rescheduling_interrupts 6687252 -12.9% 5821967 ± 6% interrupts.CPU28.RES:Rescheduling_interrupts 6583387 -10.9% 5868659 ± 6% interrupts.CPU29.RES:Rescheduling_interrupts 6585631 -16.6% 5490726 ± 9% interrupts.CPU37.RES:Rescheduling_interrupts 6759973 -13.2% 5867800 ± 7% interrupts.CPU57.RES:Rescheduling_interrupts 6459616 ± 2% -10.5% 5783047 ± 6% interrupts.CPU58.RES:Rescheduling_interrupts 6580818 ± 2% -16.9% 5468945 ± 3% interrupts.CPU60.RES:Rescheduling_interrupts 6723178 ± 2% -12.4% 5887778 ± 3% interrupts.CPU63.RES:Rescheduling_interrupts 6480129 -16.2% 5427168 ± 7% interrupts.CPU64.RES:Rescheduling_interrupts 6439558 ± 2% -11.6% 5691160 ± 5% interrupts.CPU65.RES:Rescheduling_interrupts 6662822 -12.0% 5866390 ± 7% interrupts.CPU68.RES:Rescheduling_interrupts 6602178 -12.0% 5809760 ± 7% interrupts.CPU7.RES:Rescheduling_interrupts 6616172 -14.1% 5685889 ± 7% interrupts.CPU73.RES:Rescheduling_interrupts 6591477 -13.8% 5682655 ± 8% interrupts.CPU81.RES:Rescheduling_interrupts 13.97 +15.8% 16.18 perf-stat.i.MPKI 1.70 -0.1 1.65 perf-stat.i.branch-miss-rate% 3.607e+08 -1.6% 3.549e+08 perf-stat.i.branch-misses 1.22 ± 6% +0.8 2.01 ± 18% perf-stat.i.cache-miss-rate% 17650711 ± 6% +98.0% 34953649 ± 18% perf-stat.i.cache-misses 1.496e+09 +17.3% 1.755e+09 perf-stat.i.cache-references 13503062 +4.6% 14122231 perf-stat.i.context-switches 2946654 ± 2% +18.5% 3491269 ± 3% perf-stat.i.cpu-migrations 29365 ± 8% -30.6% 20387 ± 31% perf-stat.i.cycles-between-cache-misses 0.35 ± 2% +0.0 0.36 ± 2% perf-stat.i.dTLB-store-miss-rate% 2.048e+10 -2.1% 2.006e+10 perf-stat.i.dTLB-stores 55.17 -1.4 53.74 perf-stat.i.iTLB-load-miss-rate% 1.019e+08 +5.5% 1.074e+08 perf-stat.i.iTLB-loads 3068 -3.0% 2975 perf-stat.i.minor-faults 9195204 ± 6% +113.0% 19589023 ± 18% perf-stat.i.node-load-misses 28132 ± 6% +125.3% 63396 ± 13% perf-stat.i.node-loads 58.92 -9.8 49.16 ± 4% perf-stat.i.node-store-miss-rate% 3588196 ± 6% +60.5% 5760265 ± 19% perf-stat.i.node-store-misses 2415953 ± 5% +145.2% 5924042 ± 18% perf-stat.i.node-stores 3068 -3.0% 2975 perf-stat.i.page-faults 13.96 +16.0% 16.19 perf-stat.overall.MPKI 1.70 -0.1 1.65 perf-stat.overall.branch-miss-rate% 1.18 ± 6% +0.8 1.99 ± 18% perf-stat.overall.cache-miss-rate% 13823 ± 6% -47.8% 7221 ± 20% perf-stat.overall.cycles-between-cache-misses 0.35 ± 2% +0.0 0.36 ± 2% perf-stat.overall.dTLB-store-miss-rate% 55.11 -1.4 53.70 perf-stat.overall.iTLB-load-miss-rate% 59.75 -10.5 49.23 perf-stat.overall.node-store-miss-rate% 78192 +13.0% 88370 perf-stat.overall.path-length 3.601e+08 -1.6% 3.543e+08 perf-stat.ps.branch-misses 17622620 ± 6% +98.0% 34899005 ± 18% perf-stat.ps.cache-misses 1.494e+09 +17.3% 1.752e+09 perf-stat.ps.cache-references 13480657 +4.6% 14099389 perf-stat.ps.context-switches 2941749 ± 2% +18.5% 3485631 ± 3% perf-stat.ps.cpu-migrations 2.045e+10 -2.1% 2.003e+10 perf-stat.ps.dTLB-stores 1.017e+08 +5.5% 1.072e+08 perf-stat.ps.iTLB-loads 3064 -3.0% 2972 perf-stat.ps.minor-faults 9180406 ± 6% +113.0% 19558101 ± 18% perf-stat.ps.node-load-misses 28101 ± 6% +125.3% 63314 ± 13% perf-stat.ps.node-loads 3582467 ± 6% +60.5% 5751138 ± 19% perf-stat.ps.node-store-misses 2412086 ± 5% +145.2% 5914636 ± 18% perf-stat.ps.node-stores 3064 -3.0% 2972 perf-stat.ps.page-faults 223485 +9.1% 243918 ± 5% softirqs.CPU0.TIMER 11887 ± 11% -18.2% 9723 ± 6% softirqs.CPU1.SCHED 215411 +9.2% 235267 ± 6% softirqs.CPU1.TIMER 11293 ± 3% -14.3% 9678 ± 10% softirqs.CPU10.SCHED 213916 +9.8% 234908 ± 5% softirqs.CPU10.TIMER 212758 +7.7% 229141 ± 5% softirqs.CPU11.TIMER 11098 ± 2% -15.9% 9337 ± 10% softirqs.CPU12.SCHED 213397 +9.0% 232706 ± 6% softirqs.CPU12.TIMER 212419 +8.3% 230115 ± 6% softirqs.CPU13.TIMER 10777 ± 4% -12.5% 9426 ± 6% softirqs.CPU14.SCHED 11241 ± 3% -11.5% 9950 ± 6% softirqs.CPU15.SCHED 214604 +10.0% 236116 ± 8% softirqs.CPU15.TIMER 11147 -14.9% 9482 ± 8% softirqs.CPU16.SCHED 216343 +8.4% 234558 ± 6% softirqs.CPU16.TIMER 214680 +7.0% 229748 ± 6% softirqs.CPU17.TIMER 212791 +8.6% 230988 ± 6% softirqs.CPU19.TIMER 11211 ± 4% -10.4% 10047 ± 6% softirqs.CPU2.SCHED 219918 +9.8% 241513 ± 6% softirqs.CPU2.TIMER 10825 ± 4% -14.3% 9273 ± 7% softirqs.CPU20.SCHED 215209 +8.8% 234149 ± 6% softirqs.CPU20.TIMER 10869 ± 4% -11.4% 9626 ± 4% softirqs.CPU21.SCHED 216225 +8.7% 235105 ± 5% softirqs.CPU21.TIMER 13013 ± 7% -14.0% 11192 ± 3% softirqs.CPU22.SCHED 220406 +8.9% 239975 ± 4% softirqs.CPU22.TIMER 11925 -14.9% 10145 ± 3% softirqs.CPU23.SCHED 220231 +7.6% 237056 ± 5% softirqs.CPU23.TIMER 11140 ± 2% -11.5% 9861 ± 7% softirqs.CPU24.SCHED 216091 +8.9% 235338 ± 5% softirqs.CPU24.TIMER 11438 ± 3% -16.3% 9578 ± 2% softirqs.CPU25.SCHED 214880 +9.4% 235143 ± 5% softirqs.CPU25.TIMER 214888 +8.8% 233874 ± 5% softirqs.CPU26.TIMER 11410 ± 2% -13.7% 9844 ± 10% softirqs.CPU27.SCHED 215012 +8.7% 233790 ± 4% softirqs.CPU27.TIMER 220618 ± 2% +7.8% 237788 ± 5% softirqs.CPU28.TIMER 11096 ± 5% -14.3% 9513 ± 6% softirqs.CPU29.SCHED 217194 +8.2% 235108 ± 5% softirqs.CPU29.TIMER 11445 ± 2% -16.7% 9536 ± 10% softirqs.CPU3.SCHED 214692 +9.1% 234221 ± 5% softirqs.CPU3.TIMER 11127 ± 5% -10.5% 9954 ± 6% softirqs.CPU30.SCHED 214861 +8.2% 232532 ± 5% softirqs.CPU30.TIMER 217582 +7.8% 234493 ± 4% softirqs.CPU31.TIMER 214606 +8.8% 233473 ± 4% softirqs.CPU32.TIMER 11299 ± 2% -11.7% 9975 ± 6% softirqs.CPU33.SCHED 11503 ± 2% -16.0% 9658 ± 10% softirqs.CPU34.SCHED 213233 +10.9% 236580 ± 6% softirqs.CPU34.TIMER 11162 ± 2% -11.6% 9863 ± 7% softirqs.CPU35.SCHED 11241 -13.9% 9678 ± 6% softirqs.CPU36.SCHED 215681 +9.2% 235446 ± 4% softirqs.CPU36.TIMER 11358 -15.2% 9632 ± 6% softirqs.CPU37.SCHED 219691 ± 2% +18.5% 260407 ± 13% softirqs.CPU37.TIMER 11570 ± 2% -13.1% 10049 ± 6% softirqs.CPU38.SCHED 215559 +8.2% 233189 ± 4% softirqs.CPU38.TIMER 11295 ± 4% -13.1% 9819 ± 10% softirqs.CPU39.SCHED 215781 ± 2% +7.6% 232108 ± 5% softirqs.CPU39.TIMER 11506 ± 7% -13.0% 10006 ± 6% softirqs.CPU4.SCHED 214973 +8.9% 234140 ± 6% softirqs.CPU4.TIMER 11304 ± 2% -13.7% 9759 ± 10% softirqs.CPU40.SCHED 213827 +10.1% 235341 ± 4% softirqs.CPU40.TIMER 11462 ± 4% -13.5% 9913 ± 8% softirqs.CPU41.SCHED 215879 ± 2% +7.2% 231499 ± 5% softirqs.CPU41.TIMER 11418 ± 3% -14.0% 9819 ± 8% softirqs.CPU43.SCHED 214864 +8.3% 232698 ± 4% softirqs.CPU43.TIMER 10706 ± 5% -13.9% 9223 ± 11% softirqs.CPU44.SCHED 217386 +9.4% 237916 ± 5% softirqs.CPU44.TIMER 215191 +9.7% 236017 ± 5% softirqs.CPU45.TIMER 214214 +9.9% 235466 ± 6% softirqs.CPU46.TIMER 214471 +9.9% 235675 ± 5% softirqs.CPU47.TIMER 11251 ± 2% -13.0% 9785 ± 8% softirqs.CPU48.SCHED 212500 +9.9% 233451 ± 6% softirqs.CPU48.TIMER 213609 +9.9% 234657 ± 5% softirqs.CPU49.TIMER 216836 +8.5% 235225 ± 5% softirqs.CPU5.TIMER 215854 +9.0% 235383 ± 5% softirqs.CPU50.TIMER 11468 -14.4% 9820 ± 9% softirqs.CPU51.SCHED 215402 +8.8% 234360 ± 5% softirqs.CPU51.TIMER 214152 +8.8% 233038 ± 5% softirqs.CPU52.TIMER 212843 +8.4% 230716 ± 5% softirqs.CPU53.TIMER 11373 ± 2% -14.9% 9679 ± 7% softirqs.CPU54.SCHED 214008 +9.5% 234380 ± 5% softirqs.CPU54.TIMER 212619 +7.5% 228539 ± 5% softirqs.CPU55.TIMER 11136 ± 3% -16.4% 9312 ± 10% softirqs.CPU56.SCHED 213404 +9.0% 232542 ± 6% softirqs.CPU56.TIMER 11171 ± 4% -11.9% 9837 ± 7% softirqs.CPU57.SCHED 212283 +8.6% 230474 ± 6% softirqs.CPU57.TIMER 11137 ± 4% -14.0% 9578 ± 6% softirqs.CPU58.SCHED 11226 ± 4% -17.2% 9289 ± 4% softirqs.CPU59.SCHED 214193 +23.1% 263668 ± 22% softirqs.CPU59.TIMER 217195 +8.2% 234975 ± 5% softirqs.CPU6.TIMER 11051 ± 4% -14.4% 9460 ± 9% softirqs.CPU60.SCHED 217131 +7.9% 234363 ± 5% softirqs.CPU60.TIMER 11206 ± 3% -12.6% 9793 ± 9% softirqs.CPU61.SCHED 211791 +9.2% 231302 ± 5% softirqs.CPU61.TIMER 214956 ± 2% +8.8% 233770 ± 5% softirqs.CPU62.TIMER 11180 ± 3% -14.8% 9526 ± 8% softirqs.CPU63.SCHED 213413 +8.7% 232008 ± 5% softirqs.CPU63.TIMER 215674 +8.1% 233086 ± 6% softirqs.CPU64.TIMER 11032 ± 3% -15.7% 9302 ± 7% softirqs.CPU65.SCHED 215870 +9.0% 235386 ± 5% softirqs.CPU65.TIMER 11403 ± 3% -14.2% 9786 ± 6% softirqs.CPU66.SCHED 215968 +9.4% 236175 ± 5% softirqs.CPU66.TIMER 11098 ± 3% -7.4% 10281 ± 4% softirqs.CPU67.SCHED 217846 +8.3% 236023 ± 4% softirqs.CPU67.TIMER 11094 -12.2% 9740 ± 7% softirqs.CPU68.SCHED 215512 +9.4% 235796 ± 5% softirqs.CPU68.TIMER 11321 ± 3% -14.1% 9724 ± 3% softirqs.CPU69.SCHED 213564 +9.0% 232867 ± 5% softirqs.CPU69.TIMER 218822 +8.8% 238080 ± 6% softirqs.CPU7.TIMER 11507 ± 2% -12.9% 10026 ± 4% softirqs.CPU70.SCHED 213928 +9.4% 233986 ± 4% softirqs.CPU70.TIMER 213528 +8.5% 231730 ± 4% softirqs.CPU71.TIMER 11262 ± 2% -11.1% 10013 ± 5% softirqs.CPU72.SCHED 11145 ± 3% -14.5% 9533 ± 8% softirqs.CPU73.SCHED 216467 +9.2% 236409 ± 5% softirqs.CPU73.TIMER 11447 ± 4% -13.2% 9935 ± 4% softirqs.CPU74.SCHED 212578 +9.1% 232022 ± 5% softirqs.CPU74.TIMER 215256 +7.8% 232072 ± 5% softirqs.CPU75.TIMER 11324 ± 4% -11.8% 9985 ± 3% softirqs.CPU76.SCHED 214170 +8.6% 232516 ± 5% softirqs.CPU76.TIMER 11646 ± 5% -15.7% 9824 ± 7% softirqs.CPU77.SCHED 213706 +8.0% 230880 ± 5% softirqs.CPU77.TIMER 11397 ± 6% -13.9% 9810 ± 10% softirqs.CPU78.SCHED 11179 ± 3% -11.5% 9894 ± 5% softirqs.CPU79.SCHED 213215 +8.4% 231081 ± 5% softirqs.CPU79.TIMER 11165 ± 4% -16.2% 9352 ± 9% softirqs.CPU8.SCHED 216508 ± 2% +7.9% 233692 ± 6% softirqs.CPU8.TIMER 11203 ± 2% -13.9% 9643 ± 4% softirqs.CPU80.SCHED 216446 +8.3% 234469 ± 5% softirqs.CPU80.TIMER 11151 ± 2% -12.8% 9726 ± 6% softirqs.CPU81.SCHED 11373 ± 3% -13.0% 9891 ± 6% softirqs.CPU82.SCHED 213597 +8.9% 232608 ± 5% softirqs.CPU82.TIMER 214308 +7.9% 231148 ± 5% softirqs.CPU83.TIMER 214384 +20.9% 259149 ± 15% softirqs.CPU84.TIMER 11458 -13.7% 9887 ± 7% softirqs.CPU86.SCHED 215459 +8.2% 233058 ± 5% softirqs.CPU86.TIMER 11303 ± 4% -12.4% 9904 ± 8% softirqs.CPU87.SCHED 214185 +7.9% 231116 ± 5% softirqs.CPU87.TIMER 11030 ± 2% -13.0% 9593 ± 8% softirqs.CPU9.SCHED 213229 +8.7% 231788 ± 6% softirqs.CPU9.TIMER 995635 -12.9% 867688 ± 5% softirqs.SCHED 19052052 +8.6% 20690944 ± 5% softirqs.TIMER 31.32 -1.6 29.74 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 30.24 -1.5 28.76 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 26.06 -0.9 25.17 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.35 ± 5% -0.9 1.48 ± 12% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common 25.36 -0.8 24.54 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 2.75 ± 4% -0.7 2.08 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 4.24 ± 2% -0.6 3.60 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 3.84 ± 2% -0.6 3.23 ± 2% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 7.83 -0.5 7.30 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 1.68 ± 6% -0.5 1.17 ± 10% perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 8.02 -0.5 7.53 ± 2% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 8.08 -0.5 7.60 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 1.63 ± 4% -0.4 1.19 ± 6% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write 1.71 ± 6% -0.4 1.28 ± 8% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_wait 2.60 -0.4 2.19 ± 4% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.03 ± 2% -0.4 1.64 ± 4% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.47 -0.4 3.08 ± 4% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 1.95 ± 2% -0.3 1.61 ± 3% perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 2.67 -0.3 2.35 ± 3% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 0.56 -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.22 ± 4% -0.3 0.94 ± 2% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write 1.25 ± 2% -0.3 1.00 ± 5% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 2.64 -0.2 2.41 ± 2% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 1.53 -0.2 1.34 ± 7% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.59 ± 4% -0.2 0.40 ± 57% perf-profile.calltrace.cycles-pp.__enqueue_entity.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 1.34 -0.2 1.16 ± 6% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 1.07 ± 2% -0.2 0.90 ± 4% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write 1.05 -0.2 0.88 ± 6% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule 1.56 ± 2% -0.2 1.38 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.pipe_read.new_sync_read 1.17 ± 4% -0.2 1.01 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 0.98 ± 2% -0.2 0.82 ± 4% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.66 ± 2% -0.2 1.50 ± 5% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read 0.73 ± 3% -0.2 0.57 ± 2% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.96 ± 2% -0.1 0.82 ± 3% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write 0.89 ± 2% -0.1 0.77 ± 3% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.66 ± 6% -0.1 0.54 ± 2% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64 2.42 -0.1 2.32 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.pipe_wait.pipe_read 0.89 ± 4% -0.1 0.79 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write 0.74 ± 2% -0.1 0.66 ± 3% perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.84 -0.1 0.79 ± 3% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.56 -0.0 0.54 ± 2% perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.77 ± 2% +0.1 0.82 perf-profile.calltrace.cycles-pp.check_preempt_wakeup.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function 0.90 ± 3% +0.1 0.97 ± 2% perf-profile.calltrace.cycles-pp.native_write_msr 0.69 ± 3% +0.1 0.77 ± 3% perf-profile.calltrace.cycles-pp.update_rq_clock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.80 ± 4% +0.1 0.89 ± 2% perf-profile.calltrace.cycles-pp.___perf_sw_event.__schedule.schedule.pipe_wait.pipe_read 1.10 +0.1 1.20 perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.73 ± 3% +0.1 0.83 ± 2% perf-profile.calltrace.cycles-pp.__switch_to 1.05 +0.1 1.16 perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 0.63 ± 4% +0.1 0.75 ± 2% perf-profile.calltrace.cycles-pp.put_prev_entity.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop 0.99 ± 5% +0.1 1.12 ± 5% perf-profile.calltrace.cycles-pp.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 1.07 ± 3% +0.1 1.21 ± 2% perf-profile.calltrace.cycles-pp.__switch_to_asm 0.64 ± 6% +0.2 0.80 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.pipe_wait.pipe_read 1.41 ± 3% +0.2 1.59 ± 2% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.77 ± 5% +0.2 1.00 ± 5% perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop 1.73 ± 3% +0.3 2.06 ± 3% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.14 ±173% +0.5 0.63 ± 5% perf-profile.calltrace.cycles-pp.update_rq_clock.__schedule.schedule.pipe_wait.pipe_read 0.13 ±173% +0.5 0.64 ± 5% perf-profile.calltrace.cycles-pp.migrate_task_rq_fair.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common 1.85 ± 5% +0.5 2.38 ± 3% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.00 +0.6 0.59 ± 4% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_wait.pipe_read.new_sync_read.vfs_read 0.00 +0.6 0.60 ± 5% perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.dequeue_task_fair.__schedule.schedule.pipe_wait 0.00 +0.7 0.67 ± 5% perf-profile.calltrace.cycles-pp.__update_load_avg_cfs_rq.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.15 ±173% +1.0 1.14 ± 12% perf-profile.calltrace.cycles-pp.cpumask_next_wrap.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 87.66 +1.1 88.78 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 86.87 +1.1 88.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.59 ± 4% +1.4 6.96 ± 3% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.72 ± 4% +1.4 7.12 ± 3% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.87 ± 4% +1.4 7.28 ± 3% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.70 ± 30% +3.3 4.98 ± 13% perf-profile.calltrace.cycles-pp.available_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function 35.54 +3.3 38.87 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 34.28 +3.5 37.82 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 31.12 +4.1 35.22 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 30.49 +4.1 34.63 ± 2% perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 22.54 ± 2% +6.0 28.53 ± 3% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 20.58 ± 2% +6.2 26.76 ± 3% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 19.97 ± 2% +6.2 26.16 ± 3% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 19.73 ± 3% +6.2 25.92 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 3.39 ± 20% +7.0 10.39 ± 12% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 4.89 ± 15% +7.1 11.98 ± 10% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 31.34 -1.6 29.75 perf-profile.children.cycles-pp.ksys_read 30.28 -1.5 28.79 perf-profile.children.cycles-pp.vfs_read 4.14 ± 5% -1.3 2.85 ± 7% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 3.51 ± 6% -1.0 2.54 ± 8% perf-profile.children.cycles-pp.update_cfs_group 26.10 -0.9 25.20 perf-profile.children.cycles-pp.new_sync_read 25.42 -0.8 24.59 perf-profile.children.cycles-pp.pipe_read 4.67 -0.8 3.86 ± 4% perf-profile.children.cycles-pp.security_file_permission 4.33 ± 2% -0.7 3.65 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret 4.24 ± 2% -0.6 3.60 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64 2.18 ± 4% -0.5 1.64 ± 6% perf-profile.children.cycles-pp.mutex_unlock 7.92 -0.5 7.40 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair 8.10 -0.5 7.61 ± 3% perf-profile.children.cycles-pp.activate_task 8.16 -0.5 7.67 ± 3% perf-profile.children.cycles-pp.ttwu_do_activate 4.12 ± 4% -0.5 3.64 ± 5% perf-profile.children.cycles-pp._raw_spin_lock 2.83 -0.4 2.38 ± 6% perf-profile.children.cycles-pp.selinux_file_permission 3.53 -0.4 3.13 ± 4% perf-profile.children.cycles-pp.enqueue_entity 1.99 ± 2% -0.4 1.64 ± 3% perf-profile.children.cycles-pp.copy_page_from_iter 3.34 -0.4 2.99 ± 4% perf-profile.children.cycles-pp.update_load_avg 2.70 -0.3 2.39 ± 3% perf-profile.children.cycles-pp.copy_page_to_iter 2.66 -0.3 2.35 ± 3% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.93 ± 3% -0.3 0.64 ± 7% perf-profile.children.cycles-pp.__mutex_unlock_slowpath 1.41 ± 4% -0.3 1.13 perf-profile.children.cycles-pp.file_has_perm 2.75 -0.3 2.49 ± 2% perf-profile.children.cycles-pp.dequeue_entity 2.29 ± 2% -0.3 2.04 perf-profile.children.cycles-pp.mutex_lock 0.85 ± 3% -0.2 0.61 ± 4% perf-profile.children.cycles-pp.__inode_security_revalidate 0.59 ± 3% -0.2 0.39 ± 6% perf-profile.children.cycles-pp.__mutex_lock 1.79 ± 2% -0.2 1.59 ± 4% perf-profile.children.cycles-pp.__fdget_pos 1.70 ± 2% -0.2 1.52 ± 3% perf-profile.children.cycles-pp.__fget_light 0.93 ± 3% -0.2 0.75 perf-profile.children.cycles-pp.avc_has_perm 1.09 ± 2% -0.2 0.92 ± 4% perf-profile.children.cycles-pp.copyin 2.33 ± 2% -0.2 2.16 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.96 ± 2% -0.2 0.81 ± 2% perf-profile.children.cycles-pp.___might_sleep 1.67 ± 2% -0.2 1.52 ± 5% perf-profile.children.cycles-pp.copyout 0.83 ± 4% -0.1 0.68 ± 2% perf-profile.children.cycles-pp._cond_resched 0.33 ± 5% -0.1 0.19 ± 10% perf-profile.children.cycles-pp.preempt_schedule_common 0.42 ± 2% -0.1 0.28 ± 8% perf-profile.children.cycles-pp.wake_up_q 0.70 ± 3% -0.1 0.59 ± 3% perf-profile.children.cycles-pp.__might_sleep 0.65 ± 5% -0.1 0.54 ± 7% perf-profile.children.cycles-pp.__fsnotify_parent 0.52 ± 2% -0.1 0.43 perf-profile.children.cycles-pp.__might_fault 0.53 ± 5% -0.1 0.45 perf-profile.children.cycles-pp.current_time 0.84 ± 3% -0.1 0.77 perf-profile.children.cycles-pp.fsnotify 0.16 ± 7% -0.1 0.09 ± 13% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.15 ± 8% -0.1 0.08 ± 15% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.22 ± 3% -0.1 0.16 ± 7% perf-profile.children.cycles-pp.wake_q_add 0.49 -0.1 0.44 perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.26 ± 4% -0.1 0.21 ± 2% perf-profile.children.cycles-pp.rcu_all_qs 0.08 ± 14% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__vfs_read 0.25 ± 4% -0.0 0.20 ± 5% perf-profile.children.cycles-pp.finish_wait 0.38 -0.0 0.34 ± 2% perf-profile.children.cycles-pp.__x64_sys_read 0.43 ± 3% -0.0 0.39 ± 2% perf-profile.children.cycles-pp.prepare_to_wait 0.14 ± 20% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.task_tick_fair 0.16 ± 19% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.scheduler_tick 0.10 ± 8% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.18 ± 8% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.inode_has_perm 0.21 ± 2% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.deactivate_task 0.20 ± 2% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.generic_pipe_buf_confirm 0.13 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.__sb_end_write 0.14 ± 9% -0.0 0.12 perf-profile.children.cycles-pp.timespec64_trunc 0.14 ± 3% -0.0 0.11 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret 0.11 ± 4% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.smp_reschedule_interrupt 0.17 ± 4% -0.0 0.15 perf-profile.children.cycles-pp.iov_iter_init 0.11 ± 4% -0.0 0.09 ± 10% perf-profile.children.cycles-pp.native_apic_msr_eoi_write 0.09 ± 4% -0.0 0.07 perf-profile.children.cycles-pp.__x2apic_send_IPI_dest 0.15 -0.0 0.13 ± 3% perf-profile.children.cycles-pp.rb_insert_color 0.18 ± 2% -0.0 0.17 ± 2% perf-profile.children.cycles-pp.set_next_buddy 0.08 ± 5% -0.0 0.07 perf-profile.children.cycles-pp.interrupt_entry 0.23 ± 2% +0.0 0.24 perf-profile.children.cycles-pp.cpumask_next 0.67 +0.0 0.69 perf-profile.children.cycles-pp.__calc_delta 0.15 ± 3% +0.0 0.18 ± 6% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.17 ± 6% +0.1 0.23 ± 3% perf-profile.children.cycles-pp.remove_entity_load_avg 0.14 ± 6% +0.1 0.19 ± 7% perf-profile.children.cycles-pp.attach_entity_load_avg 0.80 ± 3% +0.1 0.86 perf-profile.children.cycles-pp.check_preempt_wakeup 0.37 ± 3% +0.1 0.45 ± 4% perf-profile.children.cycles-pp.account_entity_enqueue 0.79 ± 4% +0.1 0.88 ± 5% perf-profile.children.cycles-pp.finish_task_switch 0.80 ± 2% +0.1 0.89 ± 2% perf-profile.children.cycles-pp.put_prev_entity 0.54 ± 2% +0.1 0.65 perf-profile.children.cycles-pp.account_entity_dequeue 1.01 ± 5% +0.1 1.13 ± 5% perf-profile.children.cycles-pp.set_task_cpu 0.49 ± 7% +0.2 0.65 ± 5% perf-profile.children.cycles-pp.migrate_task_rq_fair 1.23 ± 4% +0.2 1.40 ± 2% perf-profile.children.cycles-pp.__switch_to_asm 1.15 ± 2% +0.2 1.33 ± 2% perf-profile.children.cycles-pp.__switch_to 1.42 ± 3% +0.2 1.59 ± 2% perf-profile.children.cycles-pp.switch_fpu_return 0.76 ± 3% +0.2 0.96 ± 3% perf-profile.children.cycles-pp.pick_next_entity 2.21 +0.2 2.42 perf-profile.children.cycles-pp.reweight_entity 2.20 ± 2% +0.2 2.43 perf-profile.children.cycles-pp.load_new_mm_cr3 1.24 ± 5% +0.2 1.48 ± 4% perf-profile.children.cycles-pp.update_rq_clock 1.43 ± 5% +0.3 1.73 ± 2% perf-profile.children.cycles-pp.___perf_sw_event 0.38 ± 15% +0.3 0.68 ± 9% perf-profile.children.cycles-pp.find_next_bit 3.96 +0.3 4.28 perf-profile.children.cycles-pp.pick_next_task_fair 4.43 ± 2% +0.4 4.82 perf-profile.children.cycles-pp.switch_mm_irqs_off 1.11 +0.7 1.83 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.46 ± 26% +0.7 1.20 ± 12% perf-profile.children.cycles-pp.cpumask_next_wrap 87.76 +1.1 88.86 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 86.98 +1.1 88.10 perf-profile.children.cycles-pp.do_syscall_64 21.71 +1.3 23.02 perf-profile.children.cycles-pp.__schedule 5.98 ± 4% +1.4 7.34 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop 21.59 +1.4 22.99 perf-profile.children.cycles-pp.schedule 1.73 ± 29% +3.3 5.03 ± 13% perf-profile.children.cycles-pp.available_idle_cpu 35.55 +3.3 38.88 perf-profile.children.cycles-pp.ksys_write 34.31 +3.5 37.84 perf-profile.children.cycles-pp.vfs_write 31.14 +4.1 35.23 ± 2% perf-profile.children.cycles-pp.new_sync_write 30.56 +4.2 34.74 ± 2% perf-profile.children.cycles-pp.pipe_write 22.96 ± 2% +6.0 28.93 ± 3% perf-profile.children.cycles-pp.__wake_up_common_lock 20.11 ± 2% +6.1 26.19 ± 3% perf-profile.children.cycles-pp.try_to_wake_up 20.66 ± 2% +6.2 26.82 ± 3% perf-profile.children.cycles-pp.__wake_up_common 20.01 ± 2% +6.2 26.19 ± 3% perf-profile.children.cycles-pp.autoremove_wake_function 3.46 ± 20% +7.0 10.48 ± 12% perf-profile.children.cycles-pp.select_idle_sibling 4.92 ± 15% +7.1 12.01 ± 10% perf-profile.children.cycles-pp.select_task_rq_fair 11.85 ± 3% -2.1 9.72 ± 2% perf-profile.self.cycles-pp.do_syscall_64 4.13 ± 5% -1.3 2.85 ± 8% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 3.49 ± 6% -1.0 2.52 ± 9% perf-profile.self.cycles-pp.update_cfs_group 4.33 ± 2% -0.7 3.64 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret 4.24 ± 2% -0.6 3.60 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64 2.12 ± 4% -0.5 1.59 ± 6% perf-profile.self.cycles-pp.mutex_unlock 2.61 -0.3 2.31 ± 3% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.60 ± 2% -0.3 1.30 ± 5% perf-profile.self.cycles-pp.update_load_avg 1.48 ± 3% -0.2 1.25 ± 2% perf-profile.self.cycles-pp.mutex_lock 1.95 -0.2 1.75 ± 7% perf-profile.self.cycles-pp.selinux_file_permission 1.06 ± 5% -0.2 0.86 ± 5% perf-profile.self.cycles-pp.pipe_write 1.46 ± 2% -0.2 1.28 ± 3% perf-profile.self.cycles-pp.pipe_read 1.65 ± 2% -0.2 1.49 ± 4% perf-profile.self.cycles-pp.__fget_light 0.91 ± 3% -0.2 0.74 perf-profile.self.cycles-pp.avc_has_perm 0.94 ± 2% -0.2 0.79 ± 2% perf-profile.self.cycles-pp.___might_sleep 1.84 -0.1 1.72 ± 2% perf-profile.self.cycles-pp.update_curr 1.05 -0.1 0.93 perf-profile.self.cycles-pp.enqueue_task_fair 0.63 ± 3% -0.1 0.52 ± 2% perf-profile.self.cycles-pp.__might_sleep 0.60 ± 6% -0.1 0.51 ± 7% perf-profile.self.cycles-pp.__fsnotify_parent 0.29 ± 3% -0.1 0.19 ± 5% perf-profile.self.cycles-pp.__mutex_lock 0.38 ± 4% -0.1 0.29 ± 4% perf-profile.self.cycles-pp.vfs_write 0.51 -0.1 0.43 ± 4% perf-profile.self.cycles-pp.copy_page_to_iter 0.49 -0.1 0.41 ± 2% perf-profile.self.cycles-pp.new_sync_write 0.35 ± 4% -0.1 0.28 ± 2% perf-profile.self.cycles-pp.copy_page_from_iter 0.81 ± 3% -0.1 0.75 perf-profile.self.cycles-pp.fsnotify 0.26 -0.1 0.19 ± 3% perf-profile.self.cycles-pp.__inode_security_revalidate 0.20 ± 4% -0.1 0.13 ± 6% perf-profile.self.cycles-pp.__mutex_unlock_slowpath 0.29 ± 5% -0.1 0.23 ± 3% perf-profile.self.cycles-pp.file_has_perm 0.22 -0.1 0.16 ± 8% perf-profile.self.cycles-pp.wake_q_add 0.57 ± 2% -0.1 0.52 perf-profile.self.cycles-pp.new_sync_read 0.34 ± 2% -0.1 0.29 ± 3% perf-profile.self.cycles-pp.dequeue_entity 0.26 ± 3% -0.1 0.21 ± 3% perf-profile.self.cycles-pp.ksys_read 0.28 ± 2% -0.0 0.23 perf-profile.self.cycles-pp.security_file_permission 0.22 ± 3% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.finish_wait 0.25 -0.0 0.21 ± 4% perf-profile.self.cycles-pp.ksys_write 0.88 -0.0 0.83 perf-profile.self.cycles-pp.__lock_text_start 0.66 -0.0 0.61 perf-profile.self.cycles-pp.vfs_read 1.37 -0.0 1.32 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.29 ± 4% -0.0 0.25 perf-profile.self.cycles-pp.current_time 0.20 ± 3% -0.0 0.16 ± 4% perf-profile.self.cycles-pp.rcu_all_qs 0.10 ± 8% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.42 -0.0 0.39 ± 2% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.34 -0.0 0.31 ± 2% perf-profile.self.cycles-pp.__x64_sys_read 0.09 ± 5% -0.0 0.05 ± 9% perf-profile.self.cycles-pp.wake_up_q 0.15 ± 8% -0.0 0.12 ± 4% perf-profile.self.cycles-pp.inode_has_perm 0.14 ± 5% -0.0 0.11 ± 9% perf-profile.self.cycles-pp.rb_next 0.20 ± 2% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.deactivate_task 0.11 ± 4% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__fdget_pos 0.24 ± 2% -0.0 0.22 ± 3% perf-profile.self.cycles-pp.prepare_to_wait 0.14 ± 3% -0.0 0.11 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 0.13 ± 7% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.timespec64_trunc 0.06 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.copyout 0.11 ± 4% -0.0 0.09 ± 10% perf-profile.self.cycles-pp.native_apic_msr_eoi_write 0.17 ± 4% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.generic_pipe_buf_confirm 0.18 ± 2% -0.0 0.16 ± 4% perf-profile.self.cycles-pp.__might_fault 0.17 ± 2% -0.0 0.16 ± 2% perf-profile.self.cycles-pp.set_next_buddy 0.15 ± 2% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.rb_insert_color 0.12 ± 3% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.__sb_end_write 0.10 ± 8% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.06 -0.0 0.05 perf-profile.self.cycles-pp.kill_fasync 0.14 ± 3% +0.0 0.16 ± 5% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.66 +0.0 0.68 perf-profile.self.cycles-pp.__calc_delta 0.16 ± 5% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.native_load_tls 0.14 ± 3% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.67 +0.0 0.70 perf-profile.self.cycles-pp.dequeue_task_fair 0.23 ± 3% +0.0 0.27 ± 3% perf-profile.self.cycles-pp._cond_resched 0.17 ± 4% +0.0 0.21 ± 6% perf-profile.self.cycles-pp.activate_task 0.35 ± 3% +0.0 0.40 perf-profile.self.cycles-pp.pick_next_entity 1.20 +0.1 1.25 perf-profile.self.cycles-pp.select_task_rq_fair 0.13 ± 6% +0.1 0.18 ± 6% perf-profile.self.cycles-pp.attach_entity_load_avg 0.87 ± 3% +0.1 0.96 ± 3% perf-profile.self.cycles-pp.pick_next_task_fair 0.27 ± 6% +0.1 0.36 ± 7% perf-profile.self.cycles-pp.migrate_task_rq_fair 0.32 ± 2% +0.1 0.41 ± 4% perf-profile.self.cycles-pp.account_entity_enqueue 0.42 +0.1 0.56 ± 2% perf-profile.self.cycles-pp.account_entity_dequeue 2.24 ± 3% +0.1 2.39 ± 2% perf-profile.self.cycles-pp.switch_mm_irqs_off 1.09 ± 2% +0.2 1.26 ± 2% perf-profile.self.cycles-pp.__switch_to 1.20 ± 4% +0.2 1.37 ± 2% perf-profile.self.cycles-pp.__switch_to_asm 1.40 ± 3% +0.2 1.58 ± 2% perf-profile.self.cycles-pp.switch_fpu_return 0.89 ± 6% +0.2 1.10 ± 5% perf-profile.self.cycles-pp.update_rq_clock 2.19 ± 2% +0.2 2.42 perf-profile.self.cycles-pp.load_new_mm_cr3 1.33 ± 4% +0.3 1.60 ± 3% perf-profile.self.cycles-pp.___perf_sw_event 0.34 ± 14% +0.3 0.66 ± 9% perf-profile.self.cycles-pp.find_next_bit 0.28 ± 23% +0.4 0.72 ± 12% perf-profile.self.cycles-pp.cpumask_next_wrap 0.89 +0.7 1.58 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 1.04 +0.7 1.76 ± 4% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.65 ± 12% +3.0 3.61 ± 13% perf-profile.self.cycles-pp.select_idle_sibling 1.71 ± 29% +3.3 4.97 ± 13% perf-profile.self.cycles-pp.available_idle_cpu *************************************************************************************************** lkp-cfl-e1: 16 threads Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/threads/100%/debian-x86_64-2018-04-03.cgz/lkp-cfl-e1/hackbench/0xb8 commit: 43e9f7f231 ("sched/fair: Start tracking SCHED_IDLE tasks count in cfs_rq") 3c29e651e1 ("sched/fair: Fall back to sched-idle CPU if idle CPU isn't found") 43e9f7f231e40e45 3c29e651e16dd3b3179cfb2d055 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:2 -50% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x 1:2 -50% :4 dmesg.WARNING:stack_recursion %stddev %change %stddev \ | \ 49845 -6.8% 46466 hackbench.throughput 8.776e+08 +13.0% 9.915e+08 hackbench.time.involuntary_context_switches 93623 -6.3% 87707 hackbench.time.minor_page_faults 740.08 -1.4% 729.54 hackbench.time.user_time 1.569e+09 +3.5% 1.623e+09 hackbench.time.voluntary_context_switches 3.072e+08 -6.2% 2.88e+08 hackbench.workload 21.45 -1.7% 21.09 boot-time.boot 1747212 ± 3% -31.0% 1205072 ± 14% cpuidle.POLL.time 1289000 ± 4% -36.6% 817407 ± 13% cpuidle.POLL.usage 4038486 +6.3% 4293331 vmstat.system.cs 394711 -10.2% 354353 ± 2% vmstat.system.in 10059 -15.4% 8506 ± 5% softirqs.CPU0.SCHED 309881 -27.3% 225159 ± 4% softirqs.CPU2.TIMER 220105 +20.8% 265807 ± 16% softirqs.CPU6.TIMER 120937 ± 3% -17.6% 99667 ± 2% softirqs.SCHED 18883 -8.9% 17200 ± 3% slabinfo.kmalloc-32.active_objs 18883 -8.9% 17200 ± 3% slabinfo.kmalloc-32.num_objs 8573 ± 2% -7.6% 7924 slabinfo.lsm_file_cache.active_objs 8573 ± 2% -7.6% 7924 slabinfo.lsm_file_cache.num_objs 5280 -8.8% 4814 slabinfo.task_delay_info.active_objs 5280 -8.8% 4814 slabinfo.task_delay_info.num_objs 65295 -1.9% 64034 proc-vmstat.nr_active_anon 60605 -1.5% 59671 proc-vmstat.nr_anon_pages 12935 -0.9% 12820 proc-vmstat.nr_slab_unreclaimable 65295 -1.9% 64034 proc-vmstat.nr_zone_active_anon 24774010 -16.6% 20673098 proc-vmstat.numa_hit 24774010 -16.6% 20673098 proc-vmstat.numa_local 24839243 -16.5% 20735391 proc-vmstat.pgalloc_normal 673024 -2.4% 657142 proc-vmstat.pgfault 24822112 -16.5% 20717243 proc-vmstat.pgfree 247.95 ± 14% -19.1% 200.59 ± 4% sched_debug.cfs_rq:/.load_avg.max 43.55 ± 3% -19.9% 34.86 ± 6% sched_debug.cfs_rq:/.load_avg.min 55.51 ± 6% -13.2% 48.19 ± 7% sched_debug.cfs_rq:/.load_avg.stddev 20116 ± 8% -12.8% 17531 ± 5% sched_debug.cfs_rq:/.runnable_weight.min 1288 +7.5% 1384 ± 3% sched_debug.cfs_rq:/.util_avg.max 54763 ± 9% +130.8% 126390 ± 25% sched_debug.cpu.avg_idle.avg 301502 ± 18% +84.9% 557406 ± 14% sched_debug.cpu.avg_idle.max 82233 ± 22% +122.7% 183153 ± 17% sched_debug.cpu.avg_idle.stddev 0.00 ± 12% -12.0% 0.00 ± 8% sched_debug.cpu.next_balance.stddev 16.92 ± 4% -7.5% 15.66 ± 3% sched_debug.cpu.nr_running.avg 2.92 ± 10% -20.9% 2.31 ± 16% sched_debug.cpu.nr_uninterruptible.avg 2977 ± 50% -73.0% 803.75 ± 43% interrupts.133:IR-PCI-MSI.2097154-edge.eth1-TxRx-1 546.00 ± 23% +119.5% 1198 ± 16% interrupts.135:IR-PCI-MSI.2097156-edge.eth1-TxRx-3 13831842 -11.5% 12245495 ± 2% interrupts.CPU0.RES:Rescheduling_interrupts 45259 ± 5% +68.9% 76440 ± 15% interrupts.CPU0.TRM:Thermal_event_interrupts 2977 ± 50% -73.0% 803.75 ± 43% interrupts.CPU1.133:IR-PCI-MSI.2097154-edge.eth1-TxRx-1 45283 ± 5% +68.9% 76474 ± 15% interrupts.CPU1.TRM:Thermal_event_interrupts 13947887 -11.0% 12413074 interrupts.CPU10.RES:Rescheduling_interrupts 45275 ± 5% +68.9% 76468 ± 15% interrupts.CPU10.TRM:Thermal_event_interrupts 45286 ± 5% +68.9% 76468 ± 15% interrupts.CPU11.TRM:Thermal_event_interrupts 13579741 -11.8% 11974820 ± 5% interrupts.CPU12.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76471 ± 15% interrupts.CPU12.TRM:Thermal_event_interrupts 13668073 -11.3% 12119346 interrupts.CPU13.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76474 ± 15% interrupts.CPU13.TRM:Thermal_event_interrupts 13578574 -7.8% 12518854 interrupts.CPU14.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76467 ± 15% interrupts.CPU14.TRM:Thermal_event_interrupts 13689117 -10.1% 12310290 ± 2% interrupts.CPU15.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76473 ± 15% interrupts.CPU15.TRM:Thermal_event_interrupts 13924470 -10.5% 12461613 interrupts.CPU2.RES:Rescheduling_interrupts 45264 ± 5% +68.9% 76467 ± 15% interrupts.CPU2.TRM:Thermal_event_interrupts 546.00 ± 23% +119.5% 1198 ± 16% interrupts.CPU3.135:IR-PCI-MSI.2097156-edge.eth1-TxRx-3 13951884 -10.5% 12480739 interrupts.CPU3.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76469 ± 15% interrupts.CPU3.TRM:Thermal_event_interrupts 45285 ± 5% +68.9% 76471 ± 15% interrupts.CPU4.TRM:Thermal_event_interrupts 14030690 -10.7% 12530992 ± 3% interrupts.CPU5.RES:Rescheduling_interrupts 45286 ± 5% +68.9% 76471 ± 15% interrupts.CPU5.TRM:Thermal_event_interrupts 45285 ± 5% +68.9% 76474 ± 15% interrupts.CPU6.TRM:Thermal_event_interrupts 45285 ± 5% +68.9% 76472 ± 15% interrupts.CPU7.TRM:Thermal_event_interrupts 13319036 -10.2% 11966842 ± 2% interrupts.CPU8.RES:Rescheduling_interrupts 45280 ± 5% +68.7% 76405 ± 15% interrupts.CPU8.TRM:Thermal_event_interrupts 13401328 -11.8% 11816711 ± 3% interrupts.CPU9.RES:Rescheduling_interrupts 45279 ± 5% +68.9% 76467 ± 15% interrupts.CPU9.TRM:Thermal_event_interrupts 2.19e+08 -9.8% 1.974e+08 ± 2% interrupts.RES:Rescheduling_interrupts 724498 ± 5% +68.9% 1223435 ± 15% interrupts.TRM:Thermal_event_interrupts 53.44 +4.2% 55.68 perf-stat.i.MPKI 0.12 -0.0 0.10 ± 4% perf-stat.i.cache-miss-rate% 1764490 -13.1% 1533362 ± 3% perf-stat.i.cache-misses 1.767e+09 +3.6% 1.832e+09 perf-stat.i.cache-references 4055785 +6.2% 4306694 perf-stat.i.context-switches 336154 +21.5% 408363 perf-stat.i.cpu-migrations 34528 ± 5% +10.3% 38089 ± 3% perf-stat.i.cycles-between-cache-misses 0.01 ± 6% -0.0 0.01 ± 6% perf-stat.i.dTLB-load-miss-rate% 899577 ± 6% -15.2% 762553 ± 5% perf-stat.i.dTLB-load-misses 0.00 ± 7% -0.0 0.00 ± 4% perf-stat.i.dTLB-store-miss-rate% 22816 ± 7% -13.2% 19813 ± 4% perf-stat.i.dTLB-store-misses 6.044e+09 -1.2% 5.969e+09 perf-stat.i.dTLB-stores 31331199 -3.4% 30272777 perf-stat.i.iTLB-load-misses 1061 +3.1% 1094 perf-stat.i.instructions-per-iTLB-miss 1077 -2.9% 1046 perf-stat.i.minor-faults 73018 -10.9% 65028 ± 2% perf-stat.i.node-loads 122632 ± 2% -9.3% 111181 ± 4% perf-stat.i.node-stores 1077 -2.9% 1046 perf-stat.i.page-faults 53.29 +4.2% 55.53 perf-stat.overall.MPKI 0.10 -0.0 0.08 ± 3% perf-stat.overall.cache-miss-rate% 25264 +15.3% 29120 ± 3% perf-stat.overall.cycles-between-cache-misses 0.01 ± 6% -0.0 0.01 ± 6% perf-stat.overall.dTLB-load-miss-rate% 0.00 ± 7% -0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate% 1058 +2.9% 1089 perf-stat.overall.instructions-per-iTLB-miss 65158 +6.6% 69487 perf-stat.overall.path-length 1761814 -13.1% 1530883 ± 3% perf-stat.ps.cache-misses 1.765e+09 +3.7% 1.829e+09 perf-stat.ps.cache-references 4048770 +6.2% 4299578 perf-stat.ps.context-switches 335565 +21.5% 407697 perf-stat.ps.cpu-migrations 898100 ± 6% -15.2% 761293 ± 5% perf-stat.ps.dTLB-load-misses 22777 ± 7% -13.2% 19781 ± 4% perf-stat.ps.dTLB-store-misses 6.034e+09 -1.2% 5.96e+09 perf-stat.ps.dTLB-stores 31277565 -3.4% 30222833 perf-stat.ps.iTLB-load-misses 1075 -2.9% 1044 perf-stat.ps.minor-faults 72896 -10.9% 64922 ± 2% perf-stat.ps.node-loads 122424 ± 2% -9.3% 111005 ± 4% perf-stat.ps.node-stores 1075 -2.9% 1044 perf-stat.ps.page-faults 39.37 ±100% -36.4 2.98 ±173% perf-profile.calltrace.cycles-pp.start_thread 21.68 ±100% -20.0 1.64 ±173% perf-profile.calltrace.cycles-pp.__GI___libc_write.start_thread 20.14 ±100% -18.6 1.52 ±173% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 20.00 ±100% -18.5 1.51 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 18.05 ±100% -16.7 1.39 ±173% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread 16.75 ±100% -15.5 1.22 ±173% perf-profile.calltrace.cycles-pp.__GI___libc_read.start_thread 16.70 ±100% -15.4 1.26 ±173% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 14.98 ±100% -13.9 1.09 ±173% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 14.82 ±100% -13.7 1.08 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 13.95 ±100% -12.9 1.03 ±173% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread 12.97 ±100% -12.0 0.95 ±173% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 3.69 ± 6% -1.1 2.58 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common 4.25 ± 6% -1.0 3.29 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 1.54 ± 10% -0.5 1.05 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 1.07 ± 16% -0.5 0.60 ± 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write 1.14 ± 2% -0.3 0.80 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule.pipe_wait 0.55 ± 4% -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.new_sync_read.vfs_read.ksys_read 1.90 ± 9% -0.2 1.67 ± 7% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.71 ± 7% -0.2 1.48 ± 7% perf-profile.calltrace.cycles-pp.__fget.__fget_light.__fdget_pos.ksys_write.do_syscall_64 0.68 ± 19% +0.2 0.86 perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.67 ± 16% +0.2 0.88 ± 4% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_wait 0.29 ±100% +0.4 0.64 ± 4% perf-profile.calltrace.cycles-pp.___perf_sw_event.__schedule.schedule.pipe_wait.pipe_read 0.31 ±100% +0.4 0.67 ± 4% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_wait.pipe_read.new_sync_read.vfs_read 0.32 ±100% +0.4 0.68 ± 2% perf-profile.calltrace.cycles-pp.pick_next_entity.pick_next_task_fair.__schedule.schedule.pipe_wait 0.29 ±100% +0.4 0.68 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 0.35 ±100% +0.4 0.78 perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.dequeue_task_fair.__schedule.schedule 1.23 ± 19% +0.4 1.68 ± 2% perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 1.29 ± 18% +0.5 1.76 ± 5% perf-profile.calltrace.cycles-pp.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.update_load_avg.set_next_entity.pick_next_task_fair.__schedule.schedule 0.00 +0.6 0.59 ± 7% perf-profile.calltrace.cycles-pp.__enqueue_entity.put_prev_entity.pick_next_task_fair.__schedule.schedule 8.82 +0.6 9.46 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 0.47 ±100% +0.7 1.14 ± 6% perf-profile.calltrace.cycles-pp.put_prev_entity.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop 2.21 ± 10% +0.7 2.88 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.exit_to_usermode_loop.do_syscall_64 9.10 +0.7 9.79 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 9.04 +0.7 9.74 ± 2% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.71 ±100% +0.9 1.61 ± 3% perf-profile.calltrace.cycles-pp.__switch_to 0.68 ± 99% +0.9 1.60 ± 3% perf-profile.calltrace.cycles-pp.native_write_msr 0.86 ±100% +0.9 1.79 ± 2% perf-profile.calltrace.cycles-pp.__switch_to_asm 6.54 +1.0 7.53 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_wait.pipe_read 26.96 +1.0 27.95 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 1.42 ± 63% +1.0 2.47 ± 3% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.54 ± 8% +1.2 5.79 ± 4% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 14.99 +1.3 16.27 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_wait.pipe_read.new_sync_read 15.35 +1.3 16.66 perf-profile.calltrace.cycles-pp.schedule.pipe_wait.pipe_read.new_sync_read.vfs_read 27.37 +1.3 28.70 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write 17.81 +1.6 19.38 perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 3.95 ± 11% +1.8 5.70 ± 6% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common 23.38 +2.0 25.33 ± 2% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write 24.30 +2.0 26.27 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write 23.73 +2.0 25.71 ± 2% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write 5.24 ± 10% +2.0 7.25 ± 6% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 3.23 ± 57% +2.7 5.98 ± 4% perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.34 ± 57% +2.8 6.18 ± 4% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 39.37 ±100% -36.4 2.98 ±173% perf-profile.children.cycles-pp.start_thread 21.68 ±100% -20.0 1.67 ±173% perf-profile.children.cycles-pp.__GI___libc_write 16.99 ±100% -15.7 1.24 ±173% perf-profile.children.cycles-pp.__GI___libc_read 6.84 ± 10% -2.1 4.71 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 45.35 -1.0 44.33 perf-profile.children.cycles-pp.ksys_write 6.70 ± 5% -1.0 5.70 ± 2% perf-profile.children.cycles-pp._raw_spin_lock 5.90 ± 4% -0.6 5.34 ± 6% perf-profile.children.cycles-pp.security_file_permission 3.35 ± 9% -0.6 2.80 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 42.14 -0.5 41.63 perf-profile.children.cycles-pp.vfs_write 3.41 -0.4 3.01 perf-profile.children.cycles-pp.__fdget_pos 3.30 -0.4 2.91 perf-profile.children.cycles-pp.__fget_light 2.71 ± 2% -0.4 2.32 perf-profile.children.cycles-pp.__fget 3.23 -0.3 2.93 ± 3% perf-profile.children.cycles-pp.mutex_lock 2.76 -0.3 2.47 ± 5% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 2.21 ± 3% -0.3 1.93 ± 10% perf-profile.children.cycles-pp.file_has_perm 3.14 -0.2 2.90 ± 4% perf-profile.children.cycles-pp.copy_page_to_iter 3.03 ± 5% -0.2 2.79 ± 5% perf-profile.children.cycles-pp.selinux_file_permission 2.10 ± 5% -0.2 1.86 ± 2% perf-profile.children.cycles-pp.mutex_unlock 1.50 ± 5% -0.2 1.27 ± 2% perf-profile.children.cycles-pp.fput_many 0.68 ± 17% -0.2 0.48 ± 4% perf-profile.children.cycles-pp.__mutex_lock 1.66 ± 2% -0.2 1.47 ± 4% perf-profile.children.cycles-pp.copyout 1.73 -0.2 1.57 ± 2% perf-profile.children.cycles-pp.update_rq_clock 1.30 -0.1 1.17 ± 6% perf-profile.children.cycles-pp.copyin 0.27 ± 11% -0.1 0.15 ± 9% perf-profile.children.cycles-pp.preempt_schedule_common 1.25 ± 3% -0.1 1.15 ± 3% perf-profile.children.cycles-pp.fsnotify 0.79 -0.1 0.69 ± 7% perf-profile.children.cycles-pp.reschedule_interrupt 0.91 -0.1 0.82 ± 5% perf-profile.children.cycles-pp._cond_resched 0.80 ± 2% -0.1 0.71 ± 3% perf-profile.children.cycles-pp.file_update_time 0.29 ± 10% -0.1 0.24 ± 5% perf-profile.children.cycles-pp.rb_insert_color 0.26 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.native_irq_return_iret 0.07 ± 14% -0.0 0.03 ±100% perf-profile.children.cycles-pp.scheduler_ipi 0.22 ± 6% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.__x64_sys_read 0.25 ± 4% -0.0 0.21 ± 2% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.27 -0.0 0.23 ± 9% perf-profile.children.cycles-pp.timespec64_trunc 0.23 ± 2% -0.0 0.20 ± 5% perf-profile.children.cycles-pp.smp_reschedule_interrupt 0.22 -0.0 0.20 ± 5% perf-profile.children.cycles-pp.__x64_sys_write 0.24 -0.0 0.22 ± 3% perf-profile.children.cycles-pp.__list_add_valid 0.14 -0.0 0.12 ± 10% perf-profile.children.cycles-pp.kill_fasync 0.11 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.perf_exclude_event 0.10 +0.0 0.12 ± 8% perf-profile.children.cycles-pp.is_cpu_allowed 0.09 ± 11% +0.0 0.12 ± 7% perf-profile.children.cycles-pp.rcu_note_context_switch 0.07 +0.0 0.10 ± 10% perf-profile.children.cycles-pp.pkg_thermal_notify 0.17 ± 3% +0.0 0.20 ± 9% perf-profile.children.cycles-pp.deactivate_task 0.16 +0.0 0.21 ± 10% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.08 ± 6% +0.0 0.12 ± 10% perf-profile.children.cycles-pp.intel_thermal_interrupt 0.08 ± 6% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.smp_thermal_interrupt 0.08 +0.1 0.13 ± 9% perf-profile.children.cycles-pp.thermal_interrupt 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.default_wake_function 0.19 ± 5% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.wakeup_preempt_entity 0.19 ± 5% +0.1 0.27 ± 4% perf-profile.children.cycles-pp.finish_wait 0.89 ± 8% +0.1 0.98 perf-profile.children.cycles-pp.__calc_delta 0.63 ± 4% +0.1 0.74 ± 4% perf-profile.children.cycles-pp.native_sched_clock 0.33 ± 4% +0.1 0.44 ± 5% perf-profile.children.cycles-pp.set_next_buddy 1.23 ± 3% +0.1 1.34 ± 3% perf-profile.children.cycles-pp.check_preempt_wakeup 0.69 ± 4% +0.1 0.81 ± 3% perf-profile.children.cycles-pp.sched_clock 1.52 ± 3% +0.1 1.65 ± 2% perf-profile.children.cycles-pp.set_next_entity 0.73 ± 4% +0.1 0.88 ± 3% perf-profile.children.cycles-pp.sched_clock_cpu 0.57 ± 4% +0.2 0.74 ± 4% perf-profile.children.cycles-pp.account_entity_dequeue 1.21 ± 4% +0.2 1.39 ± 2% perf-profile.children.cycles-pp.__update_load_avg_se 1.99 ± 3% +0.2 2.20 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 1.64 ± 6% +0.2 1.85 perf-profile.children.cycles-pp.__switch_to_asm 1.60 ± 4% +0.2 1.85 ± 3% perf-profile.children.cycles-pp.update_cfs_group 3.91 +0.2 4.15 perf-profile.children.cycles-pp.update_curr 1.04 ± 5% +0.3 1.30 ± 4% perf-profile.children.cycles-pp.___perf_sw_event 1.05 ± 9% +0.3 1.33 ± 2% perf-profile.children.cycles-pp.pick_next_entity 1.57 ± 3% +0.3 1.89 perf-profile.children.cycles-pp.native_write_msr 1.01 ± 9% +0.3 1.33 ± 5% perf-profile.children.cycles-pp.put_prev_entity 2.17 ± 7% +0.3 2.51 ± 2% perf-profile.children.cycles-pp.switch_fpu_return 1.93 ± 7% +0.4 2.36 perf-profile.children.cycles-pp.__switch_to 2.99 ± 4% +0.6 3.57 ± 2% perf-profile.children.cycles-pp.reweight_entity 8.89 +0.6 9.50 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair 9.16 +0.7 9.82 perf-profile.children.cycles-pp.ttwu_do_activate 9.09 +0.7 9.76 ± 2% perf-profile.children.cycles-pp.activate_task 5.18 ± 6% +0.9 6.04 ± 2% perf-profile.children.cycles-pp.pick_next_task_fair 6.71 +0.9 7.63 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 28.01 +1.4 29.36 ± 2% perf-profile.children.cycles-pp.__wake_up_common_lock 4.91 ± 7% +1.4 6.28 ± 4% perf-profile.children.cycles-pp.exit_to_usermode_loop 18.19 +1.4 19.56 perf-profile.children.cycles-pp.pipe_wait 4.03 ± 11% +1.7 5.75 ± 6% perf-profile.children.cycles-pp.select_idle_sibling 23.86 ± 2% +1.8 25.71 ± 2% perf-profile.children.cycles-pp.try_to_wake_up 24.44 +1.9 26.36 ± 2% perf-profile.children.cycles-pp.__wake_up_common 23.84 +1.9 25.77 ± 2% perf-profile.children.cycles-pp.autoremove_wake_function 5.29 ± 10% +2.0 7.29 ± 6% perf-profile.children.cycles-pp.select_task_rq_fair 20.27 ± 2% +2.3 22.53 ± 2% perf-profile.children.cycles-pp.__schedule 20.36 ± 2% +2.5 22.82 ± 2% perf-profile.children.cycles-pp.schedule 6.82 ± 10% -2.1 4.69 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 2.67 ± 2% -0.4 2.29 perf-profile.self.cycles-pp.__fget 2.72 -0.3 2.44 ± 5% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.22 -0.2 0.98 ± 2% perf-profile.self.cycles-pp.update_rq_clock 1.36 ± 3% -0.2 1.13 ± 6% perf-profile.self.cycles-pp.pipe_write 1.48 ± 5% -0.2 1.24 ± 3% perf-profile.self.cycles-pp.fput_many 2.04 ± 5% -0.2 1.81 ± 2% perf-profile.self.cycles-pp.mutex_unlock 1.96 -0.2 1.73 ± 2% perf-profile.self.cycles-pp.mutex_lock 0.66 ± 12% -0.1 0.53 ± 10% perf-profile.self.cycles-pp.file_has_perm 0.38 ± 10% -0.1 0.28 ± 9% perf-profile.self.cycles-pp.ksys_read 0.34 ± 7% -0.1 0.25 ± 7% perf-profile.self.cycles-pp.__mutex_lock 1.21 ± 3% -0.1 1.11 ± 2% perf-profile.self.cycles-pp.fsnotify 1.00 -0.1 0.94 ± 5% perf-profile.self.cycles-pp.__might_sleep 0.60 ± 4% -0.1 0.55 ± 8% perf-profile.self.cycles-pp.vfs_write 0.29 ± 10% -0.1 0.23 ± 3% perf-profile.self.cycles-pp.rb_insert_color 0.32 ± 6% -0.0 0.28 ± 6% perf-profile.self.cycles-pp.ksys_write 0.26 -0.0 0.21 ± 2% perf-profile.self.cycles-pp.native_irq_return_iret 0.07 ± 14% -0.0 0.03 ±100% perf-profile.self.cycles-pp.scheduler_ipi 0.36 ± 5% -0.0 0.32 ± 8% perf-profile.self.cycles-pp.__sb_start_write 0.29 -0.0 0.24 ± 4% perf-profile.self.cycles-pp.check_preempt_curr 0.22 ± 6% -0.0 0.17 ± 6% perf-profile.self.cycles-pp.__x64_sys_read 0.25 -0.0 0.21 ± 8% perf-profile.self.cycles-pp.timespec64_trunc 0.22 ± 4% -0.0 0.19 ± 11% perf-profile.self.cycles-pp.wake_q_add 0.21 ± 2% -0.0 0.18 ± 6% perf-profile.self.cycles-pp.__x64_sys_write 0.21 ± 2% -0.0 0.20 perf-profile.self.cycles-pp.__list_add_valid 0.11 ± 4% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.kill_fasync 0.06 ± 9% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.rcu_note_context_switch 0.15 +0.0 0.18 ± 6% perf-profile.self.cycles-pp.autoremove_wake_function 0.16 +0.0 0.19 ± 9% perf-profile.self.cycles-pp.deactivate_task 0.26 +0.0 0.29 ± 5% perf-profile.self.cycles-pp.rcu_all_qs 0.33 ± 3% +0.0 0.37 ± 4% perf-profile.self.cycles-pp.set_next_entity 0.18 ± 5% +0.0 0.22 ± 6% perf-profile.self.cycles-pp.wakeup_preempt_entity 0.03 ±100% +0.0 0.07 perf-profile.self.cycles-pp.check_cfs_rq_runtime 0.16 ± 6% +0.0 0.20 ± 6% perf-profile.self.cycles-pp.exit_to_usermode_loop 0.16 +0.0 0.20 ± 12% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.20 ± 2% +0.1 0.25 ± 2% perf-profile.self.cycles-pp.activate_task 0.41 ± 6% +0.1 0.46 perf-profile.self.cycles-pp.schedule 1.96 +0.1 2.02 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.15 ± 6% +0.1 0.22 perf-profile.self.cycles-pp.finish_wait 0.41 ± 4% +0.1 0.48 ± 6% perf-profile.self.cycles-pp.account_entity_enqueue 0.61 ± 4% +0.1 0.71 ± 3% perf-profile.self.cycles-pp.native_sched_clock 0.83 ± 2% +0.1 0.93 perf-profile.self.cycles-pp.dequeue_task_fair 0.29 ± 3% +0.1 0.40 ± 5% perf-profile.self.cycles-pp.set_next_buddy 1.02 +0.1 1.15 ± 7% perf-profile.self.cycles-pp.enqueue_task_fair 0.46 ± 12% +0.2 0.61 ± 3% perf-profile.self.cycles-pp.pick_next_entity 1.17 ± 4% +0.2 1.35 ± 2% perf-profile.self.cycles-pp.__update_load_avg_se 0.42 ± 8% +0.2 0.61 ± 5% perf-profile.self.cycles-pp.account_entity_dequeue 1.64 ± 6% +0.2 1.85 perf-profile.self.cycles-pp.__switch_to_asm 1.23 ± 4% +0.2 1.46 ± 3% perf-profile.self.cycles-pp.reweight_entity 1.07 ± 5% +0.2 1.31 ± 4% perf-profile.self.cycles-pp.select_task_rq_fair 0.90 ± 5% +0.2 1.14 ± 5% perf-profile.self.cycles-pp.___perf_sw_event 1.57 ± 4% +0.2 1.82 ± 2% perf-profile.self.cycles-pp.update_cfs_group 1.17 ± 3% +0.3 1.42 ± 7% perf-profile.self.cycles-pp.update_load_avg 1.56 ± 4% +0.3 1.88 perf-profile.self.cycles-pp.native_write_msr 2.16 ± 7% +0.3 2.50 ± 2% perf-profile.self.cycles-pp.switch_fpu_return 1.84 ± 8% +0.4 2.25 ± 2% perf-profile.self.cycles-pp.__switch_to 1.22 +0.5 1.73 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 0.92 ± 11% +1.3 2.27 ± 6% perf-profile.self.cycles-pp.select_idle_sibling Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

1 year, 7 months

4
6
0 / 0

[mm] e6e88712e4: stress-ng.tmpfs.ops_per_sec -69.7% regression

by kernel test robot

Greeting, FYI, we noticed a -100.0% regression of stress-ng.tmpfs.ops_per_sec due to commit: commit: e6e88712e43b7942df451508aafc2f083266f56b ("mm: optimise madvise WILLNEED") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: stress-ng on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory with following parameters: nr_threads: 100% disk: 1HDD testtime: 100s class: memory cpufreq_governor: performance ucode: 0x5002f01 If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode: memory/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp3/stress-ng/100s/0x400002c commit: f5df8635c5a3c912919c91be64aa198554b0f9ed e6e88712e43b7942df451508aafc2f083266f56b f5df8635c5a3c912 e6e88712e43b7942df451508aaf ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 423:5 51243% 2986:5 dmesg.timestamp:last :5 40% 2:5 last_state.exit_fail :5 40% 2:5 last_state.is_incomplete_run :5 0% :5 last_state.running :5 40% 2:5 last_state.soft_timeout :5 40% 2:5 last_state.test.stress-ng.exit_code.143 3:5 40% 5:5 kmsg.EDAC_skx:Can't_find_size_for_NVDIMM_ADR=#/SMBIOS= 1:5 -20% :5 kmsg.ioatdma#:#:#:Errors 1:5 -20% :5 kmsg.ioatdma#:#:#:ioat_timer_event:Channel_halted(#) 69:5 836% 111:5 kmsg.timestamp:EDAC_skx:Can't_find_size_for_NVDIMM_ADR=#/SMBIOS= 23:5 -473% :5 kmsg.timestamp:ioatdma#:#:#:Errors 23:5 -472% :5 kmsg.timestamp:ioatdma#:#:#:ioat_timer_event:Channel_halted(#) 423:5 69754% 3911:5 kmsg.timestamp:last 5:5 -40% 3:5 stderr.Aborted 5:5 -40% 3:5 stderr.Events_disabled 5:5 -40% 3:5 stderr.Events_enabled 5:5 -40% 3:5 stderr.[perf_record:Woken_up#times_to_write_data] 5:5 -40% 3:5 stderr.has_stderr 1:5 0% 1:5 stderr.ls:cannot_access'%perf_data':No_such_file_or_directory 1:5 -20% :5 stderr.malloc():corrupted_top_size 4:5 -20% 3:5 stderr.malloc():invalid_size(unsorted) 0:5 0% 0:5 perf-profile.children.cycles-pp.error_entry :5 3% 0:5 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 108.08 -1.0% 107.00 stress-ng.time.elapsed_time 108.08 -1.0% 107.00 stress-ng.time.elapsed_time.max 26521 ± 20% +76.4% 46780 ± 3% stress-ng.time.involuntary_context_switches 3248307 ± 20% +54.5% 5019072 ± 19% stress-ng.time.major_page_faults 675875 -0.1% 675470 stress-ng.time.maximum_resident_set_size 92279190 ± 12% -47.3% 48660512 stress-ng.time.minor_page_faults 4096 +0.0% 4096 stress-ng.time.page_size 3951 ± 8% +88.7% 7453 ± 2% stress-ng.time.percent_of_cpu_this_job_got 3370 ± 9% +117.9% 7343 stress-ng.time.system_time 900.24 ± 7% -29.7% 632.56 ± 2% stress-ng.time.user_time 1343 -16.1% 1127 ± 2% stress-ng.time.voluntary_context_switches 1198 ± 4% -69.7% 362.67 stress-ng.tmpfs.ops 11.62 ± 4% -69.7% 3.52 stress-ng.tmpfs.ops_per_sec 138.01 -1.0% 136.69 uptime.boot 2795 ± 2% -1.2% 2760 uptime.idle 27.54 ± 2% -0.2% 27.48 ± 2% boot-time.boot 20.59 -0.4% 20.50 boot-time.dhcp 2209 ± 2% +0.1% 2212 ± 2% boot-time.idle 0.95 ± 11% -9.6% 0.86 boot-time.smp_boot 6.15 ± 2% +1.6% 6.25 ± 9% iostat.cpu.idle 0.01 ± 59% -15.0% 0.01 ±100% iostat.cpu.iowait 74.40 +15.8% 86.14 iostat.cpu.system 19.44 ± 5% -60.9% 7.61 iostat.cpu.user 4.53 ± 3% +0.1 4.58 ± 12% mpstat.cpu.all.idle% 0.00 ± 80% -0.0 0.00 ±141% mpstat.cpu.all.iowait% 0.22 ± 3% +0.4 0.65 ± 4% mpstat.cpu.all.irq% 0.01 ± 10% +0.0 0.02 ± 15% mpstat.cpu.all.soft% 75.45 +11.6 87.00 mpstat.cpu.all.sys% 19.79 ± 5% -12.0 7.74 mpstat.cpu.all.usr% 1884655 ±137% -80.5% 367657 ± 16% cpuidle.C1.time 5320 ±146% -77.2% 1211 ± 8% cpuidle.C1.usage 3346442 ± 25% -38.8% 2047933 ± 18% cpuidle.C1E.time 8085 ± 26% -40.9% 4775 ± 15% cpuidle.C1E.usage 4.879e+08 ± 4% -2.7% 4.747e+08 ± 5% cpuidle.C6.time 184919 ± 13% -24.0% 140448 ± 18% cpuidle.C6.usage 782.80 ± 70% -70.6% 230.33 ± 38% cpuidle.POLL.time 207.60 ±120% -78.3% 45.00 ± 35% cpuidle.POLL.usage 0.00 -100.0% 0.00 numa-numastat.node0.interleave_hit 8845248 -7.2% 8207045 numa-numastat.node0.local_node 8872518 -7.2% 8235955 numa-numastat.node0.numa_hit 27274 ± 39% +6.0% 28909 ± 70% numa-numastat.node0.other_node 0.00 -100.0% 0.00 numa-numastat.node1.interleave_hit 8857958 +0.3% 8880677 numa-numastat.node1.local_node 8874087 +0.2% 8895138 numa-numastat.node1.numa_hit 16133 ± 66% -10.3% 14467 ±141% numa-numastat.node1.other_node 108.08 -1.0% 107.00 time.elapsed_time 108.08 -1.0% 107.00 time.elapsed_time.max 26521 ± 20% +76.4% 46780 ± 3% time.involuntary_context_switches 3248307 ± 20% +54.5% 5019072 ± 19% time.major_page_faults 675875 -0.1% 675470 time.maximum_resident_set_size 92279190 ± 12% -47.3% 48660512 time.minor_page_faults 4096 +0.0% 4096 time.page_size 3951 ± 8% +88.7% 7453 ± 2% time.percent_of_cpu_this_job_got 3370 ± 9% +117.9% 7343 time.system_time 900.24 ± 7% -29.7% 632.56 ± 2% time.user_time 1343 -16.1% 1127 ± 2% time.voluntary_context_switches 6.00 -5.6% 5.67 ± 8% vmstat.cpu.id 73.80 +16.1% 85.67 vmstat.cpu.sy 19.20 ± 6% -63.5% 7.00 vmstat.cpu.us 0.00 -100.0% 0.00 vmstat.cpu.wa 0.40 ±200% -100.0% 0.00 vmstat.io.bi 2.60 ±200% -100.0% 0.00 vmstat.io.bo 4.40 ± 18% -9.1% 4.00 vmstat.memory.buff 61205822 -0.0% 61180200 vmstat.memory.cache 68665018 -0.4% 68399944 vmstat.memory.free 0.00 -100.0% 0.00 vmstat.procs.b 90.00 +0.4% 90.33 vmstat.procs.r 1577 ± 6% -19.5% 1269 vmstat.system.cs 155950 +4.9% 163607 vmstat.system.in 31436258 +22.8% 38613269 meminfo.Active 31436086 +22.8% 38613201 meminfo.Active(anon) 170.60 ±107% -60.3% 67.67 ± 33% meminfo.Active(file) 128020 ± 4% +2.5% 131201 ± 3% meminfo.AnonHugePages 540756 ± 11% -10.6% 483387 ± 7% meminfo.AnonPages 4.40 ± 18% -9.1% 4.00 meminfo.Buffers 61444796 +0.0% 61468357 meminfo.Cached 194552 +0.0% 194552 meminfo.CmaFree 204800 +0.0% 204800 meminfo.CmaTotal 65845924 +0.0% 65845928 meminfo.CommitLimit 69965026 -0.1% 69896024 meminfo.Committed_AS 6.465e+08 -0.1% 6.459e+08 meminfo.DirectMap1G 17274148 ± 7% -11.0% 15370246 ± 6% meminfo.DirectMap2M 677172 ± 5% +6.2% 719273 ± 2% meminfo.DirectMap4k 64.80 ± 9% -2.8% 63.00 meminfo.Dirty 2048 +0.0% 2048 meminfo.Hugepagesize 7211066 ± 4% +132.7% 16783208 ± 6% meminfo.Inactive 7210669 ± 4% +132.8% 16782845 ± 6% meminfo.Inactive(anon) 396.00 ± 14% -8.4% 362.67 meminfo.Inactive(file) 224508 -0.6% 223245 meminfo.KReclaimable 21529 ± 5% -5.2% 20401 ± 3% meminfo.KernelStack 29107501 -47.5% 15281310 meminfo.Mapped 67689626 -0.5% 67372180 meminfo.MemAvailable 68195737 -0.5% 67878993 meminfo.MemFree 1.317e+08 +0.0% 1.317e+08 meminfo.MemTotal 63496115 +0.5% 63812865 meminfo.Memused 22381531 -75.0% 5600796 ± 6% meminfo.Mlocked 111504 ± 3% +6.3% 118584 ± 2% meminfo.PageTables 54026 +0.2% 54144 meminfo.Percpu 224508 -0.6% 223245 meminfo.SReclaimable 532214 +66.6% 886463 meminfo.SUnreclaim 60492516 +0.0% 60516229 meminfo.Shmem 756723 +46.6% 1109709 meminfo.Slab 23332949 -71.9% 6552476 ± 5% meminfo.Unevictable 3.436e+10 +0.0% 3.436e+10 meminfo.VmallocTotal 158453 ± 4% -5.2% 150267 meminfo.VmallocUsed 0.40 ±200% -100.0% 0.00 meminfo.Writeback 640913 +1.9% 653134 meminfo.max_used_kB 15828901 ± 3% +18.5% 18751296 ± 2% numa-meminfo.node0.Active 15828849 ± 3% +18.5% 18751235 ± 2% numa-meminfo.node0.Active(anon) 50.20 ± 43% +21.5% 61.00 ± 32% numa-meminfo.node0.Active(file) 89342 ± 38% -20.1% 71395 ± 10% numa-meminfo.node0.AnonHugePages 299668 ± 23% -26.8% 219240 ± 10% numa-meminfo.node0.AnonPages 24.60 ±109% -10.6% 22.00 ±135% numa-meminfo.node0.Dirty 30889346 -3.8% 29724751 numa-meminfo.node0.FilePages 3683538 ± 4% +116.6% 7980276 ± 4% numa-meminfo.node0.Inactive 3683361 ± 4% +116.7% 7980053 ± 4% numa-meminfo.node0.Inactive(anon) 176.60 ± 56% +25.9% 222.33 ± 44% numa-meminfo.node0.Inactive(file) 113695 ± 3% -6.2% 106650 ± 7% numa-meminfo.node0.KReclaimable 10287 ± 10% -3.7% 9908 ± 5% numa-meminfo.node0.KernelStack 14627069 -50.7% 7217504 ± 2% numa-meminfo.node0.Mapped 33718745 +3.2% 34799393 numa-meminfo.node0.MemFree 65676039 +0.0% 65676044 numa-meminfo.node0.MemTotal 31957292 -3.4% 30876649 numa-meminfo.node0.MemUsed 11196527 -75.7% 2725929 ± 7% numa-meminfo.node0.Mlocked 52778 ± 5% +11.3% 58763 ± 4% numa-meminfo.node0.PageTables 113695 ± 3% -6.2% 106650 ± 7% numa-meminfo.node0.SReclaimable 275746 ± 2% +63.0% 449434 ± 2% numa-meminfo.node0.SUnreclaim 30411486 -3.9% 29239402 numa-meminfo.node0.Shmem 389441 +42.8% 556084 ± 3% numa-meminfo.node0.Slab 11674021 -72.5% 3210988 ± 6% numa-meminfo.node0.Unevictable 0.00 -100.0% 0.00 numa-meminfo.node0.Writeback 15637726 ± 2% +25.7% 19663292 ± 3% numa-meminfo.node1.Active 15637606 ± 2% +25.7% 19663285 ± 3% numa-meminfo.node1.Active(anon) 119.40 ±165% -94.7% 6.33 ±141% numa-meminfo.node1.Active(file) 38463 ± 89% +56.1% 60028 ± 15% numa-meminfo.node1.AnonHugePages 241882 ± 37% +9.2% 264113 ± 16% numa-meminfo.node1.AnonPages 39.80 ± 74% +3.9% 41.33 ± 70% numa-meminfo.node1.Dirty 30632669 +2.7% 31455689 numa-meminfo.node1.FilePages 3559463 ± 6% +145.7% 8746082 ± 14% numa-meminfo.node1.Inactive 3559243 ± 6% +145.7% 8745941 ± 14% numa-meminfo.node1.Inactive(anon) 219.00 ± 67% -36.1% 140.00 ± 70% numa-meminfo.node1.Inactive(file) 111003 ± 3% +4.7% 116206 ± 6% numa-meminfo.node1.KReclaimable 11250 ± 10% -6.8% 10489 ± 7% numa-meminfo.node1.KernelStack 14533234 -45.2% 7961730 numa-meminfo.node1.Mapped 34398511 -3.0% 33370337 numa-meminfo.node1.MemFree 66015814 +0.0% 66015816 numa-meminfo.node1.MemTotal 31617302 +3.3% 32645477 numa-meminfo.node1.MemUsed 11200859 ± 3% -74.6% 2842334 ± 5% numa-meminfo.node1.Mlocked 58771 ± 7% +2.0% 59920 ± 7% numa-meminfo.node1.PageTables 111003 ± 3% +4.7% 116206 ± 6% numa-meminfo.node1.SReclaimable 256870 ± 3% +69.3% 434794 ± 2% numa-meminfo.node1.SUnreclaim 30158245 +2.8% 30988908 numa-meminfo.node1.Shmem 367874 ± 2% +49.8% 551001 ± 3% numa-meminfo.node1.Slab 11674780 ± 3% -71.7% 3308958 ± 5% numa-meminfo.node1.Unevictable 0.00 -100.0% 0.00 numa-meminfo.node1.Writeback 0.00 -100.0% 0.00 proc-vmstat.compact_isolated 7857318 +22.1% 9591743 proc-vmstat.nr_active_anon 42.00 ±109% -60.3% 16.67 ± 32% proc-vmstat.nr_active_file 135135 ± 11% -10.7% 120681 ± 7% proc-vmstat.nr_anon_pages 62.00 ± 4% +2.7% 63.67 ± 2% proc-vmstat.nr_anon_transparent_hugepages 130.40 ±108% -54.0% 60.00 proc-vmstat.nr_dirtied 15.80 ± 10% -5.1% 15.00 proc-vmstat.nr_dirty 1687530 -0.0% 1687077 proc-vmstat.nr_dirty_background_threshold 3379188 -0.0% 3378279 proc-vmstat.nr_dirty_threshold 15355708 -0.4% 15287398 proc-vmstat.nr_file_pages 48638 +0.0% 48638 proc-vmstat.nr_free_cma 17054619 -0.0% 17050200 proc-vmstat.nr_free_pages 1801446 ± 4% +132.2% 4183033 ± 6% proc-vmstat.nr_inactive_anon 98.60 ± 14% -8.4% 90.33 proc-vmstat.nr_inactive_file 1.60 ± 93% -16.7% 1.33 ± 93% proc-vmstat.nr_isolated_anon 21527 ± 5% -5.3% 20390 ± 3% proc-vmstat.nr_kernel_stack 7271413 -47.7% 3802076 proc-vmstat.nr_mapped 5592797 -75.1% 1394593 ± 6% proc-vmstat.nr_mlock 27791 ± 3% +6.4% 29565 proc-vmstat.nr_page_table_pages 15117636 -0.5% 15049364 proc-vmstat.nr_shmem 56092 -0.7% 55693 proc-vmstat.nr_slab_reclaimable 132917 +66.4% 221176 proc-vmstat.nr_slab_unreclaimable 5830654 -72.0% 1632513 ± 5% proc-vmstat.nr_unevictable 0.00 -100.0% 0.00 proc-vmstat.nr_writeback 131.20 ±111% -55.8% 58.00 proc-vmstat.nr_written 7857318 +22.1% 9591743 proc-vmstat.nr_zone_active_anon 42.00 ±109% -60.3% 16.67 ± 32% proc-vmstat.nr_zone_active_file 1801446 ± 4% +132.2% 4183033 ± 6% proc-vmstat.nr_zone_inactive_anon 98.60 ± 14% -8.4% 90.33 proc-vmstat.nr_zone_inactive_file 5830654 -72.0% 1632514 ± 5% proc-vmstat.nr_zone_unevictable 15.80 ± 10% -5.1% 15.00 proc-vmstat.nr_zone_write_pending 39731 ± 10% -11.9% 34987 ± 27% proc-vmstat.numa_hint_faults 19700 ± 21% -16.7% 16403 ± 25% proc-vmstat.numa_hint_faults_local 17783159 -3.4% 17169908 proc-vmstat.numa_hit 49.00 ± 67% -32.0% 33.33 ± 35% proc-vmstat.numa_huge_pte_updates 0.00 -100.0% 0.00 proc-vmstat.numa_interleave 17739740 -3.5% 17126412 proc-vmstat.numa_local 43418 +0.2% 43496 proc-vmstat.numa_other 12833 ± 52% +5.3% 13507 ± 57% proc-vmstat.numa_pages_migrated 84737 ± 25% -17.3% 70054 ± 26% proc-vmstat.numa_pte_updates 76644797 ± 2% -61.7% 29321914 ± 3% proc-vmstat.pgactivate 0.00 -100.0% 0.00 proc-vmstat.pgalloc_dma 0.00 -100.0% 0.00 proc-vmstat.pgalloc_dma32 18033237 -3.1% 17472724 proc-vmstat.pgalloc_normal 2.22e+08 ± 5% -67.1% 72960039 proc-vmstat.pgfault 15578043 ± 12% +11.1% 17305293 proc-vmstat.pgfree 0.00 -100.0% 0.00 proc-vmstat.pgmigrate_fail 12833 ± 52% +5.3% 13507 ± 57% proc-vmstat.pgmigrate_success 54.40 ±200% -100.0% 0.00 proc-vmstat.pgpgin 292.80 ±200% -100.0% 0.00 proc-vmstat.pgpgout 25419 -0.1% 25390 proc-vmstat.pgreuse 75.20 ± 19% +10.8% 83.33 ± 2% proc-vmstat.thp_collapse_alloc 0.00 -100.0% 0.00 proc-vmstat.thp_deferred_split_page 12.20 ± 3% +1.1% 12.33 ± 3% proc-vmstat.thp_fault_alloc 0.40 ±122% -100.0% 0.00 proc-vmstat.thp_split_pmd 0.40 ±122% -100.0% 0.00 proc-vmstat.thp_zero_page_alloc 0.00 -100.0% 0.00 proc-vmstat.unevictable_pgs_cleared 68994933 ± 2% -70.0% 20699812 ± 5% proc-vmstat.unevictable_pgs_culled 68995131 ± 2% -70.0% 20699799 ± 5% proc-vmstat.unevictable_pgs_mlocked 68930376 ± 2% -70.0% 20699799 ± 5% proc-vmstat.unevictable_pgs_munlocked 68930350 ± 2% -70.0% 20699796 ± 5% proc-vmstat.unevictable_pgs_rescued 0.00 -100.0% 0.00 proc-vmstat.unevictable_pgs_stranded 3953745 ± 3% +18.6% 4688080 ± 2% numa-vmstat.node0.nr_active_anon 12.00 ± 45% +25.0% 15.00 ± 32% numa-vmstat.node0.nr_active_file 74811 ± 23% -26.7% 54818 ± 10% numa-vmstat.node0.nr_anon_pages 43.40 ± 39% -20.1% 34.67 ± 10% numa-vmstat.node0.nr_anon_transparent_hugepages 23.80 ± 89% -18.8% 19.33 ±130% numa-vmstat.node0.nr_dirtied 5.80 ±115% -8.0% 5.33 ±141% numa-vmstat.node0.nr_dirty 7712748 -3.6% 7433505 numa-vmstat.node0.nr_file_pages 8439381 +3.1% 8697737 numa-vmstat.node0.nr_free_pages 918878 ± 4% +117.3% 1997170 ± 5% numa-vmstat.node0.nr_inactive_anon 43.80 ± 56% +25.6% 55.00 ± 45% numa-vmstat.node0.nr_inactive_file 0.60 ±133% -100.0% 0.00 numa-vmstat.node0.nr_isolated_anon 10288 ± 10% -3.6% 9914 ± 5% numa-vmstat.node0.nr_kernel_stack 3649858 -50.6% 1804283 ± 2% numa-vmstat.node0.nr_mapped 2794854 ± 2% -75.6% 681416 ± 8% numa-vmstat.node0.nr_mlock 13160 ± 5% +11.4% 14659 ± 3% numa-vmstat.node0.nr_page_table_pages 7593283 -3.7% 7312167 numa-vmstat.node0.nr_shmem 28406 ± 3% -6.2% 26640 ± 7% numa-vmstat.node0.nr_slab_reclaimable 68914 ± 2% +62.7% 112147 ± 2% numa-vmstat.node0.nr_slab_unreclaimable 2914224 -72.5% 802680 ± 6% numa-vmstat.node0.nr_unevictable 0.00 -100.0% 0.00 numa-vmstat.node0.nr_writeback 17.60 ± 84% -22.3% 13.67 ±131% numa-vmstat.node0.nr_written 3953751 ± 3% +18.6% 4688076 ± 2% numa-vmstat.node0.nr_zone_active_anon 12.00 ± 45% +25.0% 15.00 ± 32% numa-vmstat.node0.nr_zone_active_file 918874 ± 4% +117.3% 1997165 ± 5% numa-vmstat.node0.nr_zone_inactive_anon 43.80 ± 56% +25.6% 55.00 ± 45% numa-vmstat.node0.nr_zone_inactive_file 2914222 -72.5% 802680 ± 6% numa-vmstat.node0.nr_zone_unevictable 5.80 ±115% -8.0% 5.33 ±141% numa-vmstat.node0.nr_zone_write_pending 8839477 -5.7% 8338471 numa-vmstat.node0.numa_hit 133233 -0.2% 132979 numa-vmstat.node0.numa_interleave 8808766 -6.6% 8228382 numa-vmstat.node0.numa_local 30715 ± 34% +258.4% 110094 ± 43% numa-vmstat.node0.numa_other 3905459 ± 2% +25.7% 4908210 ± 4% numa-vmstat.node1.nr_active_anon 29.40 ±167% -95.5% 1.33 ±141% numa-vmstat.node1.nr_active_file 60260 ± 37% +9.5% 65963 ± 16% numa-vmstat.node1.nr_anon_pages 18.40 ± 90% +55.8% 28.67 ± 15% numa-vmstat.node1.nr_anon_transparent_hugepages 84.80 ±134% -57.9% 35.67 ± 70% numa-vmstat.node1.nr_dirtied 9.80 ± 74% +5.4% 10.33 ± 70% numa-vmstat.node1.nr_dirty 7647606 +2.7% 7857218 numa-vmstat.node1.nr_file_pages 48638 +0.0% 48638 numa-vmstat.node1.nr_free_cma 8610467 -3.0% 8349486 numa-vmstat.node1.nr_free_pages 885382 ± 6% +146.9% 2185669 ± 13% numa-vmstat.node1.nr_inactive_anon 54.60 ± 67% -36.5% 34.67 ± 70% numa-vmstat.node1.nr_inactive_file 0.20 ±200% +566.7% 1.33 ± 93% numa-vmstat.node1.nr_isolated_anon 11243 ± 10% -6.7% 10492 ± 7% numa-vmstat.node1.nr_kernel_stack 3625916 ± 2% -45.1% 1992150 numa-vmstat.node1.nr_mapped 2797793 ± 3% -74.5% 712259 ± 6% numa-vmstat.node1.nr_mlock 14674 ± 7% +2.1% 14987 ± 7% numa-vmstat.node1.nr_page_table_pages 7529001 +2.8% 7740522 numa-vmstat.node1.nr_shmem 27707 ± 3% +4.7% 29012 ± 7% numa-vmstat.node1.nr_slab_reclaimable 64142 ± 3% +69.3% 108600 ± 3% numa-vmstat.node1.nr_slab_unreclaimable 2916280 ± 3% -71.6% 828916 ± 5% numa-vmstat.node1.nr_unevictable 0.00 -100.0% 0.00 numa-vmstat.node1.nr_writeback 74.60 ±146% -66.0% 25.33 ± 70% numa-vmstat.node1.nr_written 3905452 ± 2% +25.7% 4908206 ± 4% numa-vmstat.node1.nr_zone_active_anon 29.40 ±167% -95.5% 1.33 ±141% numa-vmstat.node1.nr_zone_active_file 885383 ± 6% +146.9% 2185666 ± 13% numa-vmstat.node1.nr_zone_inactive_anon 54.60 ± 67% -36.5% 34.67 ± 70% numa-vmstat.node1.nr_zone_inactive_file 2916278 ± 3% -71.6% 828916 ± 5% numa-vmstat.node1.nr_zone_unevictable 9.80 ± 74% +2.0% 10.00 ± 71% numa-vmstat.node1.nr_zone_write_pending 8722862 +2.1% 8902016 numa-vmstat.node1.numa_hit 132992 +0.2% 133258 numa-vmstat.node1.numa_interleave 8570505 +3.0% 8829040 numa-vmstat.node1.numa_local 152360 ± 7% -52.1% 72980 ± 65% numa-vmstat.node1.numa_other 30.21 ±199% +65423.6% 19792 ±141% sched_debug.cfs_rq:/.MIN_vruntime.avg 2839 ±199% +33533.7% 955010 ±140% sched_debug.cfs_rq:/.MIN_vruntime.max 0.00 +0.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.min 291.30 ±200% +46532.9% 135843 ±140% sched_debug.cfs_rq:/.MIN_vruntime.stddev 28461 -0.5% 28325 sched_debug.cfs_rq:/.exec_clock.avg 29902 -0.8% 29650 sched_debug.cfs_rq:/.exec_clock.max 27325 -5.8% 25738 sched_debug.cfs_rq:/.exec_clock.min 248.42 ± 21% +37.2% 340.72 ± 4% sched_debug.cfs_rq:/.exec_clock.stddev 12605 ± 23% +53.9% 19396 ± 30% sched_debug.cfs_rq:/.load.avg 571429 ± 48% +44.6% 826542 ± 39% sched_debug.cfs_rq:/.load.max 5363 -1.6% 5277 sched_debug.cfs_rq:/.load.min 58046 ± 48% +62.5% 94341 ± 42% sched_debug.cfs_rq:/.load.stddev 26.42 ± 25% -17.8% 21.71 ± 24% sched_debug.cfs_rq:/.load_avg.avg 640.10 ± 48% -24.0% 486.50 ± 21% sched_debug.cfs_rq:/.load_avg.max 4.90 ± 4% +2.0% 5.00 sched_debug.cfs_rq:/.load_avg.min 87.17 ± 36% -26.0% 64.51 ± 34% sched_debug.cfs_rq:/.load_avg.stddev 30.21 ±199% +65423.6% 19792 ±141% sched_debug.cfs_rq:/.max_vruntime.avg 2839 ±199% +33533.7% 955010 ±140% sched_debug.cfs_rq:/.max_vruntime.max 0.00 +0.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.min 291.30 ±200% +46532.9% 135843 ±140% sched_debug.cfs_rq:/.max_vruntime.stddev 2903124 -0.8% 2881055 sched_debug.cfs_rq:/.min_vruntime.avg 2940930 -0.6% 2924526 sched_debug.cfs_rq:/.min_vruntime.max 2759231 ± 2% -5.6% 2605100 sched_debug.cfs_rq:/.min_vruntime.min 32148 ± 19% +50.4% 48341 ± 2% sched_debug.cfs_rq:/.min_vruntime.stddev 0.55 +4.5% 0.58 ± 4% sched_debug.cfs_rq:/.nr_running.avg 1.10 ± 18% +21.2% 1.33 ± 17% sched_debug.cfs_rq:/.nr_running.max 0.50 +0.0% 0.50 sched_debug.cfs_rq:/.nr_running.min 0.15 ± 7% +30.9% 0.20 ± 26% sched_debug.cfs_rq:/.nr_running.stddev 2.34 ± 17% +1142.8% 29.11 ± 11% sched_debug.cfs_rq:/.nr_spread_over.avg 56.20 ± 52% +743.4% 474.00 ± 31% sched_debug.cfs_rq:/.nr_spread_over.max 0.00 +3.2e+102% 3.17 ± 19% sched_debug.cfs_rq:/.nr_spread_over.min 7.55 ± 32% +809.9% 68.66 ± 23% sched_debug.cfs_rq:/.nr_spread_over.stddev 4.09 ±143% -56.0% 1.80 ±141% sched_debug.cfs_rq:/.removed.load_avg.avg 202.30 ±122% -15.6% 170.67 ±141% sched_debug.cfs_rq:/.removed.load_avg.max 27.21 ±128% -36.0% 17.42 ±141% sched_debug.cfs_rq:/.removed.load_avg.stddev 1.37 ±126% -31.7% 0.94 ±141% sched_debug.cfs_rq:/.removed.runnable_avg.avg 84.00 ±128% +6.0% 89.00 ±141% sched_debug.cfs_rq:/.removed.runnable_avg.max 10.08 ±122% -9.9% 9.08 ±141% sched_debug.cfs_rq:/.removed.runnable_avg.stddev 1.37 ±126% -31.7% 0.94 ±141% sched_debug.cfs_rq:/.removed.util_avg.avg 84.00 ±128% +6.0% 89.00 ±141% sched_debug.cfs_rq:/.removed.util_avg.max 10.08 ±122% -9.9% 9.08 ±141% sched_debug.cfs_rq:/.removed.util_avg.stddev 645.49 ± 3% -0.2% 644.45 ± 4% sched_debug.cfs_rq:/.runnable_avg.avg 1167 ± 5% +11.3% 1299 ± 12% sched_debug.cfs_rq:/.runnable_avg.max 466.90 ± 17% +9.3% 510.50 sched_debug.cfs_rq:/.runnable_avg.min 158.78 ± 7% +6.9% 169.72 ± 14% sched_debug.cfs_rq:/.runnable_avg.stddev 103207 ± 23% +10.6% 114183 ± 87% sched_debug.cfs_rq:/.spread0.avg 141212 ± 16% +10.8% 156503 ± 62% sched_debug.cfs_rq:/.spread0.max -40257 +304.7% -162912 sched_debug.cfs_rq:/.spread0.min 32026 ± 19% +50.6% 48217 ± 2% sched_debug.cfs_rq:/.spread0.stddev 642.25 ± 3% -0.4% 639.71 ± 4% sched_debug.cfs_rq:/.util_avg.avg 1024 +15.0% 1177 ± 10% sched_debug.cfs_rq:/.util_avg.max 421.20 ± 30% +15.1% 484.67 ± 3% sched_debug.cfs_rq:/.util_avg.min 150.86 ± 4% +4.4% 157.44 ± 13% sched_debug.cfs_rq:/.util_avg.stddev 347.03 ± 9% -66.6% 116.03 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.avg 1039 ± 2% -1.2% 1026 sched_debug.cfs_rq:/.util_est_enqueued.max 0.50 +0.0% 0.50 sched_debug.cfs_rq:/.util_est_enqueued.min 319.62 ± 4% -17.5% 263.67 sched_debug.cfs_rq:/.util_est_enqueued.stddev 1809157 ± 27% -11.0% 1610896 ± 33% sched_debug.cpu.avg_idle.avg 7946220 ± 54% -43.9% 4457187 ± 46% sched_debug.cpu.avg_idle.max 329579 ± 38% -25.7% 244834 ± 47% sched_debug.cpu.avg_idle.min 1115761 ± 44% -32.3% 754920 ± 54% sched_debug.cpu.avg_idle.stddev 59017 -0.5% 58751 sched_debug.cpu.clock.avg 59030 -0.4% 58768 sched_debug.cpu.clock.max 59007 -0.5% 58734 sched_debug.cpu.clock.min 7.41 ± 29% +55.1% 11.49 ± 13% sched_debug.cpu.clock.stddev 58776 -0.7% 58377 sched_debug.cpu.clock_task.avg 58933 -0.7% 58548 sched_debug.cpu.clock_task.max 53421 -0.9% 52926 sched_debug.cpu.clock_task.min 637.28 ± 3% +2.8% 655.18 ± 6% sched_debug.cpu.clock_task.stddev 1537 +1.6% 1562 ± 2% sched_debug.cpu.curr->pid.avg 3292 ± 8% -3.1% 3189 ± 10% sched_debug.cpu.curr->pid.max 1324 ± 5% +0.2% 1326 ± 5% sched_debug.cpu.curr->pid.min 395.47 ± 7% +8.2% 427.88 ± 10% sched_debug.cpu.curr->pid.stddev 976324 ± 31% -16.9% 811504 ± 33% sched_debug.cpu.max_idle_balance_cost.avg 3211116 ± 47% -12.6% 2806818 ± 73% sched_debug.cpu.max_idle_balance_cost.max 500000 +0.0% 500000 sched_debug.cpu.max_idle_balance_cost.min 453858 ± 49% -31.1% 312847 ± 70% sched_debug.cpu.max_idle_balance_cost.stddev 4294 -0.0% 4294 sched_debug.cpu.next_balance.avg 4294 -0.0% 4294 sched_debug.cpu.next_balance.max 4294 -0.0% 4294 sched_debug.cpu.next_balance.min 0.00 ± 16% +33.0% 0.00 ± 39% sched_debug.cpu.next_balance.stddev 0.56 +4.4% 0.59 ± 5% sched_debug.cpu.nr_running.avg 1.60 ± 12% +4.2% 1.67 ± 14% sched_debug.cpu.nr_running.max 0.50 +0.0% 0.50 sched_debug.cpu.nr_running.min 0.22 ± 7% +15.6% 0.25 ± 19% sched_debug.cpu.nr_running.stddev 2009 ± 4% +3.1% 2072 ± 2% sched_debug.cpu.nr_switches.avg 11032 ± 14% -25.7% 8200 ± 12% sched_debug.cpu.nr_switches.max 720.60 ± 9% +1.4% 730.50 ± 13% sched_debug.cpu.nr_switches.min 1541 ± 11% -9.1% 1400 ± 3% sched_debug.cpu.nr_switches.stddev 0.02 ± 35% -11.8% 0.02 ± 27% sched_debug.cpu.nr_uninterruptible.avg 31.30 ± 23% +1.7% 31.83 ± 8% sched_debug.cpu.nr_uninterruptible.max -14.00 +50.0% -21.00 sched_debug.cpu.nr_uninterruptible.min 7.09 ± 9% +10.9% 7.87 ± 9% sched_debug.cpu.nr_uninterruptible.stddev 641.59 ± 10% -15.8% 540.26 ± 5% sched_debug.cpu.sched_count.avg 4502 ± 28% -0.5% 4479 sched_debug.cpu.sched_count.max 200.40 ± 35% -35.5% 129.33 ± 4% sched_debug.cpu.sched_count.min 617.03 ± 20% +13.6% 700.98 ± 4% sched_debug.cpu.sched_count.stddev 67.06 ± 28% -24.9% 50.36 ± 8% sched_debug.cpu.sched_goidle.avg 1491 ± 24% -12.9% 1299 ± 19% sched_debug.cpu.sched_goidle.max 4.30 ± 85% -38.0% 2.67 ± 38% sched_debug.cpu.sched_goidle.min 180.00 ± 16% -8.8% 164.19 ± 15% sched_debug.cpu.sched_goidle.stddev 285.21 ± 14% -23.4% 218.37 ± 5% sched_debug.cpu.ttwu_count.avg 2022 ± 39% +9.9% 2221 ± 20% sched_debug.cpu.ttwu_count.max 57.00 ± 8% -24.9% 42.83 ± 4% sched_debug.cpu.ttwu_count.min 297.42 ± 30% +10.5% 328.53 ± 9% sched_debug.cpu.ttwu_count.stddev 163.51 ± 6% -5.0% 155.34 ± 2% sched_debug.cpu.ttwu_local.avg 903.60 ± 68% +65.7% 1496 ± 8% sched_debug.cpu.ttwu_local.max 46.60 ± 6% -20.2% 37.17 sched_debug.cpu.ttwu_local.min 127.35 ± 45% +91.4% 243.79 ± 7% sched_debug.cpu.ttwu_local.stddev 59006 -0.5% 58734 sched_debug.cpu_clk 996147 +0.0% 996147 sched_debug.dl_rq:.dl_bw->bw.avg 996147 +0.0% 996147 sched_debug.dl_rq:.dl_bw->bw.max 996147 +0.0% 996147 sched_debug.dl_rq:.dl_bw->bw.min 4.295e+09 -0.0% 4.295e+09 sched_debug.jiffies 58510 -0.5% 58239 sched_debug.ktime 950.00 +0.0% 950.00 sched_debug.rt_rq:/.rt_runtime.avg 950.00 +0.0% 950.00 sched_debug.rt_rq:/.rt_runtime.max 950.00 +0.0% 950.00 sched_debug.rt_rq:/.rt_runtime.min 59366 -0.6% 59028 sched_debug.sched_clk 1.00 +0.0% 1.00 sched_debug.sched_clock_stable() 4139835 +0.0% 4139835 sched_debug.sysctl_sched.sysctl_sched_features 24.00 +0.0% 24.00 sched_debug.sysctl_sched.sysctl_sched_latency 3.00 +0.0% 3.00 sched_debug.sysctl_sched.sysctl_sched_min_granularity 1.00 +0.0% 1.00 sched_debug.sysctl_sched.sysctl_sched_tunable_scaling 4.00 +0.0% 4.00 sched_debug.sysctl_sched.sysctl_sched_wakeup_granularity 0.00 -100.0% 0.00 latency_stats.avg.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.avg.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.avg.cgroup_kn_lock_live.cgroup_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.00 -100.0% 0.00 latency_stats.avg.pipe_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.percpu_rwsem_wait.__percpu_down_read.cgroup_can_fork.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.wb_wait_for_completion.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.wait_on_page_bit.__filemap_fdatawait_range.filemap_fdatawait_keep_errors.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.put_and_wait_on_page_locked.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.avg.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_setattr.nfs_setattr.notify_change.vfs_utimes.do_utimes.__x64_sys_utimensat.do_syscall_64 0.00 -100.0% 0.00 latency_stats.avg.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs_file_flush.filp_close.do_dup2.__x64_sys_dup2.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.may_open.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.path_openat 0.00 -100.0% 0.00 latency_stats.avg.cgroup_kn_lock_live.__cgroup1_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.__vm_munmap.elf_map.load_elf_interp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.copy_user_generic_unrolled._copy_from_user.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 79.40 ±200% -100.0% 0.00 latency_stats.avg.kernfs_iop_permission.inode_permission.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.60 ± 97% -100.0% 0.00 latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 4843 ±122% -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 16.60 ±200% -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.80 ±123% -100.0% 0.00 latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 154.80 ±120% -100.0% 0.00 latency_stats.avg.resolve_symbol.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ±200% -100.0% 0.00 latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe 321.00 ±122% -100.0% 0.00 latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe 25.00 ±200% -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 54.80 ±200% -100.0% 0.00 latency_stats.avg.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 171.20 ±200% -100.0% 0.00 latency_stats.avg.rmap_walk_anon.remove_migration_ptes.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 4831 ±121% -97.6% 116.00 ±134% latency_stats.avg.do_exit.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 2179 ±185% -95.2% 103.67 ±141% latency_stats.avg.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 1163 ±100% -87.5% 145.33 ± 2% latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx 1034 ±187% -81.6% 190.00 ±134% latency_stats.avg.finished_loading.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 844.20 ± 90% -68.5% 266.33 ± 44% latency_stats.avg.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe 140.40 ±128% -61.8% 53.67 ±141% latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup 175267 ± 81% -52.5% 83199 ±141% latency_stats.avg.blk_execute_rq.__scsi_execute.ioctl_internal_command.scsi_set_medium_removal.cdrom_release.[cdrom].sr_block_release.[sr_mod].__blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode 205883 ± 55% -35.0% 133812 ± 88% latency_stats.avg.max 496.40 ± 24% -34.5% 325.00 ± 6% latency_stats.avg.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe 82676 ± 69% -29.4% 58389 ± 76% latency_stats.avg.mm_access.proc_mem_open.proc_maps_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 2373 ± 5% -13.2% 2059 ± 4% latency_stats.avg.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2251 ± 11% -9.0% 2048 ± 6% latency_stats.avg.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 212.20 ± 14% -6.7% 198.00 ± 15% latency_stats.avg.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 540.60 ± 14% -2.3% 528.00 ± 2% latency_stats.avg.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 59.60 ± 12% +14.1% 68.00 ± 10% latency_stats.avg.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 392.20 ± 47% +17.9% 462.33 ± 95% latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk 551.00 ± 82% +44.2% 794.67 ± 26% latency_stats.avg.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe 721.80 ±147% +77.3% 1280 ±141% latency_stats.avg.blk_execute_rq.sg_io.scsi_cmd_ioctl.cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 2269 ±200% +81.3% 4114 ±141% latency_stats.avg.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 743.80 ± 75% +84.5% 1372 ± 14% latency_stats.avg.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 40213 ±198% +89.7% 76285 ±141% latency_stats.avg.do_init_module.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 207.20 ±149% +112.2% 439.67 ±141% latency_stats.avg.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk 975.40 ± 50% +122.1% 2166 ± 67% latency_stats.avg.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 843.00 ± 70% +151.1% 2116 ± 47% latency_stats.avg.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 78.20 ± 27% +397.4% 389.00 ±141% latency_stats.avg.do_coredump.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 16588 ±187% +426.3% 87301 ±139% latency_stats.avg.m_start.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.00 ±108% +812.5% 219.00 ± 78% latency_stats.avg.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% +1.2e+05% 240.33 ±140% latency_stats.avg.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.3e+101% 0.33 ±141% latency_stats.avg.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +4.8e+103% 48.00 ± 72% latency_stats.avg.devtmpfs_submit_req.devtmpfs_create_node.device_add.devm_create_dev_dax.__dax_pmem_probe.[dax_pmem_core].dax_pmem_compat_probe.[dax_pmem_compat].nvdimm_bus_probe.[libnvdimm].really_probe.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev 0.00 +1.8e+105% 1781 ±141% latency_stats.avg.blk_execute_rq.__scsi_execute.sr_do_ioctl.[sr_mod].sr_packet.[sr_mod].cdrom_get_media_event.[cdrom].sr_drive_status.[sr_mod].cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64 0.00 +1.9e+105% 1940 ±141% latency_stats.avg.blk_execute_rq.__scsi_execute.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open.path_openat 0.00 +9.7e+106% 96869 ±141% latency_stats.avg.blk_execute_rq.__scsi_execute.scsi_test_unit_ready.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open 0.00 -100.0% 0.00 latency_stats.hits.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.hits.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.hits.cgroup_kn_lock_live.cgroup_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.00 -100.0% 0.00 latency_stats.hits.pipe_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.percpu_rwsem_wait.__percpu_down_read.cgroup_can_fork.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.wb_wait_for_completion.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.wait_on_page_bit.__filemap_fdatawait_range.filemap_fdatawait_keep_errors.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.put_and_wait_on_page_locked.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.hits.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_setattr.nfs_setattr.notify_change.vfs_utimes.do_utimes.__x64_sys_utimensat.do_syscall_64 0.00 -100.0% 0.00 latency_stats.hits.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs_file_flush.filp_close.do_dup2.__x64_sys_dup2.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.may_open.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.path_openat 0.00 -100.0% 0.00 latency_stats.hits.cgroup_kn_lock_live.__cgroup1_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.__vm_munmap.elf_map.load_elf_interp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.copy_user_generic_unrolled._copy_from_user.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% -100.0% 0.00 latency_stats.hits.kernfs_iop_permission.inode_permission.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ± 93% -100.0% 0.00 latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±122% -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±122% -100.0% 0.00 latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ± 93% -100.0% 0.00 latency_stats.hits.resolve_symbol.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ±200% -100.0% 0.00 latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ±122% -100.0% 0.00 latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±200% -100.0% 0.00 latency_stats.hits.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% -100.0% 0.00 latency_stats.hits.rmap_walk_anon.remove_migration_ptes.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 27.20 ±127% -93.9% 1.67 ± 28% latency_stats.hits.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe 115.60 ± 66% -92.2% 9.00 ± 72% latency_stats.hits.finished_loading.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.20 ± 75% -91.8% 1.00 ±141% latency_stats.hits.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.00 -66.7% 0.33 ±141% latency_stats.hits.do_coredump.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 1133 ± 2% -50.2% 564.67 ± 4% latency_stats.hits.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 51.60 ± 63% -49.0% 26.33 ± 24% latency_stats.hits.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe 499.60 ± 36% -46.0% 269.67 ± 30% latency_stats.hits.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.20 ±200% -44.4% 0.67 ± 70% latency_stats.hits.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.60 ± 81% -44.4% 0.33 ±141% latency_stats.hits.blk_execute_rq.__scsi_execute.ioctl_internal_command.scsi_set_medium_removal.cdrom_release.[cdrom].sr_block_release.[sr_mod].__blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode 16557 ± 11% -42.7% 9493 ± 3% latency_stats.hits.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 16557 ± 11% -42.7% 9493 ± 3% latency_stats.hits.max 19.60 ± 74% -35.4% 12.67 ± 40% latency_stats.hits.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 201.00 ± 2% -32.7% 135.33 ± 2% latency_stats.hits.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±122% -16.7% 0.33 ±141% latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup 0.40 ±122% -16.7% 0.33 ±141% latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk 0.80 ± 50% -16.7% 0.67 ± 70% latency_stats.hits.mm_access.proc_mem_open.proc_maps_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±122% -16.7% 0.33 ±141% latency_stats.hits.do_init_module.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.00 +0.0% 1.00 latency_stats.hits.do_exit.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 1.00 +0.0% 1.00 latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx 1.00 +0.0% 1.00 latency_stats.hits.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.60 ± 5% +0.8% 8.67 ± 5% latency_stats.hits.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk 0.80 ± 50% +25.0% 1.00 latency_stats.hits.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.20 ± 81% +38.9% 1.67 ±141% latency_stats.hits.blk_execute_rq.sg_io.scsi_cmd_ioctl.cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.00 ± 70% +50.0% 3.00 ± 47% latency_stats.hits.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.20 ±200% +66.7% 0.33 ±141% latency_stats.hits.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 22.60 ± 90% +100.6% 45.33 ± 52% latency_stats.hits.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 22.60 ± 81% +103.5% 46.00 ± 49% latency_stats.hits.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.60 ±133% +233.3% 2.00 ± 40% latency_stats.hits.m_start.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.3e+101% 0.33 ±141% latency_stats.hits.blk_execute_rq.__scsi_execute.sr_do_ioctl.[sr_mod].sr_packet.[sr_mod].cdrom_get_media_event.[cdrom].sr_drive_status.[sr_mod].cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64 0.00 +3.3e+101% 0.33 ±141% latency_stats.hits.blk_execute_rq.__scsi_execute.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open.path_openat 0.00 +3.3e+101% 0.33 ±141% latency_stats.hits.blk_execute_rq.__scsi_execute.scsi_test_unit_ready.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open 0.00 +3.3e+101% 0.33 ±141% latency_stats.hits.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +6.7e+101% 0.67 ± 70% latency_stats.hits.devtmpfs_submit_req.devtmpfs_create_node.device_add.devm_create_dev_dax.__dax_pmem_probe.[dax_pmem_core].dax_pmem_compat_probe.[dax_pmem_compat].nvdimm_bus_probe.[libnvdimm].really_probe.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev 0.00 -100.0% 0.00 latency_stats.max.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.max.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.max.cgroup_kn_lock_live.cgroup_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.00 -100.0% 0.00 latency_stats.max.pipe_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.percpu_rwsem_wait.__percpu_down_read.cgroup_can_fork.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.wb_wait_for_completion.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.wait_on_page_bit.__filemap_fdatawait_range.filemap_fdatawait_keep_errors.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.put_and_wait_on_page_locked.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.max.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_setattr.nfs_setattr.notify_change.vfs_utimes.do_utimes.__x64_sys_utimensat.do_syscall_64 0.00 -100.0% 0.00 latency_stats.max.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs_file_flush.filp_close.do_dup2.__x64_sys_dup2.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.may_open.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.path_openat 0.00 -100.0% 0.00 latency_stats.max.cgroup_kn_lock_live.__cgroup1_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.__vm_munmap.elf_map.load_elf_interp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.copy_user_generic_unrolled._copy_from_user.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 79.40 ±200% -100.0% 0.00 latency_stats.max.kernfs_iop_permission.inode_permission.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.80 ± 95% -100.0% 0.00 latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 4843 ±122% -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 16.60 ±200% -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.80 ±123% -100.0% 0.00 latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 227.20 ±129% -100.0% 0.00 latency_stats.max.resolve_symbol.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.40 ±200% -100.0% 0.00 latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe 615.60 ±122% -100.0% 0.00 latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe 25.00 ±200% -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 75.80 ±200% -100.0% 0.00 latency_stats.max.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 171.20 ±200% -100.0% 0.00 latency_stats.max.rmap_walk_anon.remove_migration_ptes.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 4831 ±121% -97.6% 116.00 ±134% latency_stats.max.do_exit.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 4210 ±182% -94.5% 233.00 ±141% latency_stats.max.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 1163 ±100% -87.5% 145.33 ± 2% latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx 6357 ±147% -85.5% 924.00 ±136% latency_stats.max.finished_loading.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 140.40 ±128% -61.8% 53.67 ±141% latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup 175267 ± 81% -52.5% 83199 ±141% latency_stats.max.blk_execute_rq.__scsi_execute.ioctl_internal_command.scsi_set_medium_removal.cdrom_release.[cdrom].sr_block_release.[sr_mod].__blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode 205883 ± 55% -34.5% 134756 ± 87% latency_stats.max.max 82676 ± 69% -29.4% 58389 ± 76% latency_stats.max.mm_access.proc_mem_open.proc_maps_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 212.20 ± 14% -6.7% 198.00 ± 15% latency_stats.max.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 4915 -1.2% 4856 ± 2% latency_stats.max.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 4807 ± 2% -0.2% 4796 latency_stats.max.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 4806 ± 3% +2.8% 4943 latency_stats.max.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe 3021 ± 30% +9.4% 3305 ± 27% latency_stats.max.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe 2567 ± 62% +12.7% 2892 ± 36% latency_stats.max.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe 3939 ± 27% +15.2% 4539 ± 12% latency_stats.max.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 4186 ± 14% +16.3% 4870 ± 2% latency_stats.max.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 3327 ± 26% +19.4% 3971 ± 14% latency_stats.max.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 1259 ±163% +53.8% 1937 ±141% latency_stats.max.blk_execute_rq.sg_io.scsi_cmd_ioctl.cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 1946 ± 76% +56.3% 3043 ±129% latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk 1985 ± 91% +68.8% 3350 ± 5% latency_stats.max.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2269 ±200% +81.3% 4114 ±141% latency_stats.max.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 40213 ±198% +89.7% 76285 ±141% latency_stats.max.do_init_module.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 207.20 ±149% +112.2% 439.67 ±141% latency_stats.max.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk 975.40 ± 50% +122.1% 2166 ± 67% latency_stats.max.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 151.60 ±125% +142.5% 367.67 ± 96% latency_stats.max.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe 78.20 ± 27% +397.4% 389.00 ±141% latency_stats.max.do_coredump.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 16850 ±183% +423.6% 88237 ±137% latency_stats.max.m_start.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.40 ±200% +59983.3% 240.33 ±140% latency_stats.max.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.3e+101% 0.33 ±141% latency_stats.max.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +4.8e+103% 48.00 ± 72% latency_stats.max.devtmpfs_submit_req.devtmpfs_create_node.device_add.devm_create_dev_dax.__dax_pmem_probe.[dax_pmem_core].dax_pmem_compat_probe.[dax_pmem_compat].nvdimm_bus_probe.[libnvdimm].really_probe.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev 0.00 +1.8e+105% 1781 ±141% latency_stats.max.blk_execute_rq.__scsi_execute.sr_do_ioctl.[sr_mod].sr_packet.[sr_mod].cdrom_get_media_event.[cdrom].sr_drive_status.[sr_mod].cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64 0.00 +1.9e+105% 1940 ±141% latency_stats.max.blk_execute_rq.__scsi_execute.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open.path_openat 0.00 +9.7e+106% 96869 ±141% latency_stats.max.blk_execute_rq.__scsi_execute.scsi_test_unit_ready.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open 0.00 -100.0% 0.00 latency_stats.sum.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.sum.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.sum.cgroup_kn_lock_live.cgroup_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.page_lock_anon_vma_read.rmap_walk_anon.try_to_unmap.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.anon_vma_clone.anon_vma_fork.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.unlink_file_vma.free_pgtables.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.00 -100.0% 0.00 latency_stats.sum.pipe_release.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.percpu_rwsem_wait.__percpu_down_read.cgroup_can_fork.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.wb_wait_for_completion.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.wait_on_page_bit.__filemap_fdatawait_range.filemap_fdatawait_keep_errors.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.sync_inodes_sb.iterate_supers.ksys_sync.__do_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.put_and_wait_on_page_locked.do_swap_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.sum.stop_one_cpu.__set_cpus_allowed_ptr.sched_setaffinity.__x64_sys_sched_setaffinity.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.stop_one_cpu.sched_exec.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_get_acl.get_acl.posix_acl_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_do_create.nfs3_proc_create.nfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_setattr.nfs_setattr.notify_change.vfs_utimes.do_utimes.__x64_sys_utimensat.do_syscall_64 0.00 -100.0% 0.00 latency_stats.sum.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs_file_flush.filp_close.do_dup2.__x64_sys_dup2.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.may_open.path_openat.do_filp_open 0.00 -100.0% 0.00 latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_lookup_verify_inode.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.path_openat 0.00 -100.0% 0.00 latency_stats.sum.cgroup_kn_lock_live.__cgroup1_procs_write.cgroup_file_write.kernfs_fop_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.stop_two_cpus.migrate_swap.task_numa_migrate.task_numa_fault.do_huge_pmd_numa_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.__vm_munmap.elf_map.load_elf_interp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.copy_user_generic_unrolled._copy_from_user.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 79.40 ±200% -100.0% 0.00 latency_stats.sum.kernfs_iop_permission.inode_permission.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.60 ± 98% -100.0% 0.00 latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 4843 ±122% -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 16.60 ±200% -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.80 ±123% -100.0% 0.00 latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe 228.20 ±129% -100.0% 0.00 latency_stats.sum.resolve_symbol.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.20 ±200% -100.0% 0.00 latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe 642.20 ±122% -100.0% 0.00 latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_ppoll.do_syscall_64.entry_SYSCALL_64_after_hwframe 25.00 ±200% -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 109.80 ±200% -100.0% 0.00 latency_stats.sum.rwsem_down_write_slowpath.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 171.20 ±200% -100.0% 0.00 latency_stats.sum.rmap_walk_anon.remove_migration_ptes.migrate_pages.migrate_misplaced_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 58893 ±193% -99.5% 311.33 ±141% latency_stats.sum.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 192025 ±190% -98.8% 2303 ±132% latency_stats.sum.finished_loading.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 4831 ±121% -97.6% 116.00 ±134% latency_stats.sum.do_exit.do_group_exit.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 67961 ±114% -88.8% 7587 ± 65% latency_stats.sum.poll_schedule_timeout.do_select.core_sys_select.kern_select.__x64_sys_select.do_syscall_64.entry_SYSCALL_64_after_hwframe 1163 ±100% -87.5% 145.33 ± 2% latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup.__lookup_slow.walk_component.path_lookupat.filename_lookup.vfs_statx 140.40 ±128% -61.8% 53.67 ±141% latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_access.nfs_do_access.nfs_permission.inode_permission.link_path_walk.path_lookupat.filename_lookup 99229 ± 22% -55.6% 44099 ± 8% latency_stats.sum.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64.entry_SYSCALL_64_after_hwframe 175267 ± 81% -52.5% 83199 ±141% latency_stats.sum.blk_execute_rq.__scsi_execute.ioctl_internal_command.scsi_set_medium_removal.cdrom_release.[cdrom].sr_block_release.[sr_mod].__blkdev_put.blkdev_close.__fput.task_work_run.exit_to_user_mode_prepare.syscall_exit_to_user_mode 615300 ± 16% -51.5% 298615 ± 6% latency_stats.sum.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 760.80 ± 91% -42.6% 437.00 ± 79% latency_stats.sum.futex_wait_queue_me.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe 987092 ± 6% -34.4% 647610 ± 10% latency_stats.sum.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 987092 ± 6% -34.4% 647610 ± 10% latency_stats.sum.max 82676 ± 69% -29.4% 58389 ± 76% latency_stats.sum.mm_access.proc_mem_open.proc_maps_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 212.20 ± 14% -6.7% 198.00 ± 15% latency_stats.sum.wait_woken.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 194779 ± 11% +1.8% 198252 ± 14% latency_stats.sum.ep_poll.do_epoll_wait.__x64_sys_epoll_wait.do_syscall_64.entry_SYSCALL_64_after_hwframe 3347 ± 45% +22.9% 4115 ± 97% latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_getattr.__nfs_revalidate_inode.nfs_access_get_cached.nfs_do_access.nfs_permission.inode_permission.link_path_walk 10592 ± 76% +55.2% 16437 ± 25% latency_stats.sum.poll_schedule_timeout.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 53629 ± 82% +80.1% 96602 ± 51% latency_stats.sum.devkmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2269 ±200% +81.3% 4114 ±141% latency_stats.sum.msleep.cpuinfo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 50787 ± 89% +89.0% 95979 ± 54% latency_stats.sum.do_syslog.kmsg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 40213 ±198% +89.7% 76285 ±141% latency_stats.sum.do_init_module.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 2518 ± 95% +96.5% 4948 ± 24% latency_stats.sum.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 207.20 ±149% +112.2% 439.67 ±141% latency_stats.sum.rpc_wait_bit_killable.__rpc_execute.rpc_run_task.rpc_call_sync.nfs3_rpc_wrapper.nfs3_proc_lookup.nfs_lookup_revalidate_dentry.nfs_do_lookup_revalidate.__nfs_lookup_revalidate.lookup_fast.walk_component.link_path_walk 975.40 ± 50% +122.1% 2166 ± 67% latency_stats.sum.wait_for_partner.fifo_open.do_dentry_open.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 1444 ±147% +343.2% 6400 ±141% latency_stats.sum.blk_execute_rq.sg_io.scsi_cmd_ioctl.cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 78.20 ± 27% +397.4% 389.00 ±141% latency_stats.sum.do_coredump.get_signal.arch_do_signal.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 17462 ±176% +901.8% 174939 ±139% latency_stats.sum.m_start.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.20 ±200% +10824.2% 240.33 ±140% latency_stats.sum.d_alloc_parallel.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +3.3e+101% 0.33 ±141% latency_stats.sum.d_alloc_parallel.__lookup_slow.walk_component.path_lookupat.filename_lookup.user_statfs.__do_sys_statfs.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +4.8e+103% 48.00 ± 72% latency_stats.sum.devtmpfs_submit_req.devtmpfs_create_node.device_add.devm_create_dev_dax.__dax_pmem_probe.[dax_pmem_core].dax_pmem_compat_probe.[dax_pmem_compat].nvdimm_bus_probe.[libnvdimm].really_probe.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev 0.00 +1.8e+105% 1781 ±141% latency_stats.sum.blk_execute_rq.__scsi_execute.sr_do_ioctl.[sr_mod].sr_packet.[sr_mod].cdrom_get_media_event.[cdrom].sr_drive_status.[sr_mod].cdrom_ioctl.[cdrom].sr_block_ioctl.[sr_mod].blkdev_ioctl.block_ioctl.__x64_sys_ioctl.do_syscall_64 0.00 +1.9e+105% 1940 ±141% latency_stats.sum.blk_execute_rq.__scsi_execute.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open.path_openat 0.00 +9.7e+106% 96869 ±141% latency_stats.sum.blk_execute_rq.__scsi_execute.scsi_test_unit_ready.sr_check_events.[sr_mod].cdrom_check_events.[cdrom].sr_block_check_events.[sr_mod].disk_check_events.bdev_check_media_change.sr_block_open.[sr_mod].__blkdev_get.blkdev_get.do_dentry_open 199651 +0.2% 200132 slabinfo.Acpi-Operand.active_objs 3564 +0.2% 3573 slabinfo.Acpi-Operand.active_slabs 199651 +0.2% 200132 slabinfo.Acpi-Operand.num_objs 3564 +0.2% 3573 slabinfo.Acpi-Operand.num_slabs 2216 ± 8% +6.1% 2351 ± 7% slabinfo.Acpi-Parse.active_objs 29.60 ± 7% +7.0% 31.67 ± 5% slabinfo.Acpi-Parse.active_slabs 2216 ± 8% +6.1% 2351 ± 7% slabinfo.Acpi-Parse.num_objs 29.60 ± 7% +7.0% 31.67 ± 5% slabinfo.Acpi-Parse.num_slabs 4978 +0.3% 4995 slabinfo.Acpi-State.active_objs 97.00 +0.3% 97.33 slabinfo.Acpi-State.active_slabs 4978 +0.3% 4995 slabinfo.Acpi-State.num_objs 97.00 +0.3% 97.33 slabinfo.Acpi-State.num_slabs 2108 ± 4% -0.9% 2089 ± 2% slabinfo.PING.active_objs 65.20 ± 4% -0.3% 65.00 ± 2% slabinfo.PING.active_slabs 2108 ± 4% -0.9% 2089 ± 2% slabinfo.PING.num_objs 65.20 ± 4% -0.3% 65.00 ± 2% slabinfo.PING.num_slabs 192.00 +0.0% 192.00 slabinfo.RAW.active_objs 6.00 +0.0% 6.00 slabinfo.RAW.active_slabs 192.00 +0.0% 192.00 slabinfo.RAW.num_objs 6.00 +0.0% 6.00 slabinfo.RAW.num_slabs 109.20 ± 9% +3.2% 112.67 ± 10% slabinfo.RAWv6.active_objs 4.20 ± 9% +3.2% 4.33 ± 10% slabinfo.RAWv6.active_slabs 109.20 ± 9% +3.2% 112.67 ± 10% slabinfo.RAWv6.num_objs 4.20 ± 9% +3.2% 4.33 ± 10% slabinfo.RAWv6.num_slabs 86.80 ± 6% +2.2% 88.67 ± 7% slabinfo.TCP.active_objs 6.20 ± 6% +2.2% 6.33 ± 7% slabinfo.TCP.active_slabs 86.80 ± 6% +2.2% 88.67 ± 7% slabinfo.TCP.num_objs 6.20 ± 6% +2.2% 6.33 ± 7% slabinfo.TCP.num_slabs 52.00 -8.3% 47.67 ± 12% slabinfo.TCPv6.active_objs 4.00 -8.3% 3.67 ± 12% slabinfo.TCPv6.active_slabs 52.00 -8.3% 47.67 ± 12% slabinfo.TCPv6.num_objs 4.00 -8.3% 3.67 ± 12% slabinfo.TCPv6.num_slabs 164.00 ± 8% -7.9% 151.00 ± 12% slabinfo.UDPv6.active_objs 6.60 ± 7% -9.1% 6.00 ± 13% slabinfo.UDPv6.active_slabs 164.00 ± 8% -7.9% 151.00 ± 12% slabinfo.UDPv6.num_objs 6.60 ± 7% -9.1% 6.00 ± 13% slabinfo.UDPv6.num_slabs 30935 -2.3% 30211 ± 2% slabinfo.anon_vma.active_objs 672.20 -2.2% 657.33 ± 2% slabinfo.anon_vma.active_slabs 30941 -2.2% 30260 ± 2% slabinfo.anon_vma.num_objs 672.20 -2.2% 657.33 ± 2% slabinfo.anon_vma.num_slabs 69942 -2.2% 68395 slabinfo.anon_vma_chain.active_objs 1093 -2.0% 1071 slabinfo.anon_vma_chain.active_slabs 69980 -2.0% 68572 slabinfo.anon_vma_chain.num_objs 1093 -2.0% 1071 slabinfo.anon_vma_chain.num_slabs 631.80 ± 13% +2.9% 650.00 ± 5% slabinfo.bdev_cache.active_objs 16.20 ± 13% +2.9% 16.67 ± 5% slabinfo.bdev_cache.active_slabs 631.80 ± 13% +2.9% 650.00 ± 5% slabinfo.bdev_cache.num_objs 16.20 ± 13% +2.9% 16.67 ± 5% slabinfo.bdev_cache.num_slabs 223.00 ± 17% -17.9% 183.00 ± 3% slabinfo.biovec-128.active_objs 13.40 ± 19% -20.4% 10.67 ± 4% slabinfo.biovec-128.active_slabs 223.00 ± 17% -17.9% 183.00 ± 3% slabinfo.biovec-128.num_objs 13.40 ± 19% -20.4% 10.67 ± 4% slabinfo.biovec-128.num_slabs 358.40 ± 19% -7.7% 330.67 ± 9% slabinfo.biovec-64.active_objs 11.20 ± 19% -7.7% 10.33 ± 9% slabinfo.biovec-64.active_slabs 358.40 ± 19% -7.7% 330.67 ± 9% slabinfo.biovec-64.num_objs 11.20 ± 19% -7.7% 10.33 ± 9% slabinfo.biovec-64.num_slabs 152.20 ± 9% -1.9% 149.33 ± 6% slabinfo.biovec-max.active_objs 19.00 ± 8% -1.8% 18.67 ± 6% slabinfo.biovec-max.active_slabs 152.20 ± 9% -1.9% 149.33 ± 6% slabinfo.biovec-max.num_objs 19.00 ± 8% -1.8% 18.67 ± 6% slabinfo.biovec-max.num_slabs 549.40 ± 12% -7.7% 507.00 ± 6% slabinfo.blkdev_ioc.active_objs 14.00 ± 11% -7.1% 13.00 ± 6% slabinfo.blkdev_ioc.active_slabs 549.40 ± 12% -7.7% 507.00 ± 6% slabinfo.blkdev_ioc.num_objs 14.00 ± 11% -7.1% 13.00 ± 6% slabinfo.blkdev_ioc.num_slabs 20.80 ±200% -100.0% 0.00 slabinfo.btrfs_delayed_node.active_objs 0.40 ±200% -100.0% 0.00 slabinfo.btrfs_delayed_node.active_slabs 20.80 ±200% -100.0% 0.00 slabinfo.btrfs_delayed_node.num_objs 0.40 ±200% -100.0% 0.00 slabinfo.btrfs_delayed_node.num_slabs 138.40 ± 48% -19.1% 112.00 slabinfo.btrfs_inode.active_objs 4.80 ± 44% -16.7% 4.00 slabinfo.btrfs_inode.active_slabs 138.40 ± 48% -19.1% 112.00 slabinfo.btrfs_inode.num_objs 4.80 ± 44% -16.7% 4.00 slabinfo.btrfs_inode.num_slabs 17.40 ±200% -100.0% 0.00 slabinfo.btrfs_ordered_extent.active_objs 0.40 ±200% -100.0% 0.00 slabinfo.btrfs_ordered_extent.active_slabs 17.40 ±200% -100.0% 0.00 slabinfo.btrfs_ordered_extent.num_objs 0.40 ±200% -100.0% 0.00 slabinfo.btrfs_ordered_extent.num_slabs 565.00 ± 12% -12.6% 494.00 ± 3% slabinfo.buffer_head.active_objs 14.40 ± 11% -12.0% 12.67 ± 3% slabinfo.buffer_head.active_slabs 565.00 ± 12% -12.6% 494.00 ± 3% slabinfo.buffer_head.num_objs 14.40 ± 11% -12.0% 12.67 ± 3% slabinfo.buffer_head.num_slabs 5631 -1.0% 5577 slabinfo.cred_jar.active_objs 133.40 -0.8% 132.33 slabinfo.cred_jar.active_slabs 5631 -1.0% 5577 slabinfo.cred_jar.num_objs 133.40 -0.8% 132.33 slabinfo.cred_jar.num_slabs 126.00 -0.5% 125.33 slabinfo.dax_cache.active_objs 3.00 -22.2% 2.33 ± 20% slabinfo.dax_cache.active_slabs 126.00 -0.5% 125.33 slabinfo.dax_cache.num_objs 3.00 -22.2% 2.33 ± 20% slabinfo.dax_cache.num_slabs 117579 ± 2% +0.3% 117936 slabinfo.dentry.active_objs 2830 ± 2% +0.1% 2833 slabinfo.dentry.active_slabs 118902 ± 2% +0.1% 119026 slabinfo.dentry.num_objs 2830 ± 2% +0.1% 2833 slabinfo.dentry.num_slabs 32.00 +0.0% 32.00 slabinfo.dma-kmalloc-512.active_objs 1.00 +0.0% 1.00 slabinfo.dma-kmalloc-512.active_slabs 32.00 +0.0% 32.00 slabinfo.dma-kmalloc-512.num_objs 1.00 +0.0% 1.00 slabinfo.dma-kmalloc-512.num_slabs 30.00 +0.0% 30.00 slabinfo.dmaengine-unmap-128.active_objs 1.00 +0.0% 1.00 slabinfo.dmaengine-unmap-128.active_slabs 30.00 +0.0% 30.00 slabinfo.dmaengine-unmap-128.num_objs 1.00 +0.0% 1.00 slabinfo.dmaengine-unmap-128.num_slabs 1676 ± 10% +9.7% 1839 ± 17% slabinfo.dmaengine-unmap-16.active_objs 39.60 ± 10% +10.3% 43.67 ± 16% slabinfo.dmaengine-unmap-16.active_slabs 1676 ± 10% +9.7% 1839 ± 17% slabinfo.dmaengine-unmap-16.num_objs 39.60 ± 10% +10.3% 43.67 ± 16% slabinfo.dmaengine-unmap-16.num_slabs 15.00 +0.0% 15.00 slabinfo.dmaengine-unmap-256.active_objs 1.00 +0.0% 1.00 slabinfo.dmaengine-unmap-256.active_slabs 15.00 +0.0% 15.00 slabinfo.dmaengine-unmap-256.num_objs 1.00 +0.0% 1.00 slabinfo.dmaengine-unmap-256.num_slabs 4550 ± 8% +3.5% 4707 ± 2% slabinfo.eventpoll_pwq.active_objs 81.20 ± 8% +3.4% 84.00 ± 2% slabinfo.eventpoll_pwq.active_slabs 4550 ± 8% +3.5% 4707 ± 2% slabinfo.eventpoll_pwq.num_objs 81.20 ± 8% +3.4% 84.00 ± 2% slabinfo.eventpoll_pwq.num_slabs 1115 ± 14% +8.2% 1207 ± 11% slabinfo.file_lock_cache.active_objs 29.60 ± 14% +8.1% 32.00 ± 13% slabinfo.file_lock_cache.active_slabs 1115 ± 14% +8.2% 1207 ± 11% slabinfo.file_lock_cache.num_objs 29.60 ± 14% +8.1% 32.00 ± 13% slabinfo.file_lock_cache.num_slabs 4698 +1.6% 4772 slabinfo.files_cache.active_objs 101.60 +1.7% 103.33 slabinfo.files_cache.active_slabs 4698 +1.6% 4772 slabinfo.files_cache.num_objs 101.60 +1.7% 103.33 slabinfo.files_cache.num_slabs 28716 ± 3% +5.0% 30138 slabinfo.filp.active_objs 926.20 ± 4% +3.9% 962.67 slabinfo.filp.active_slabs 29652 ± 4% +3.9% 30817 slabinfo.filp.num_objs 926.20 ± 4% +3.9% 962.67 slabinfo.filp.num_slabs 3120 ± 15% -7.0% 2901 ± 5% slabinfo.fsnotify_mark_connector.active_objs 24.20 ± 15% -6.3% 22.67 ± 5% slabinfo.fsnotify_mark_connector.active_slabs 3120 ± 15% -7.0% 2901 ± 5% slabinfo.fsnotify_mark_connector.num_objs 24.20 ± 15% -6.3% 22.67 ± 5% slabinfo.fsnotify_mark_connector.num_slabs 31892 +0.9% 32178 slabinfo.ftrace_event_field.active_objs 375.20 +0.7% 378.00 slabinfo.ftrace_event_field.active_slabs 31892 +0.9% 32178 slabinfo.ftrace_event_field.num_objs 375.20 +0.7% 378.00 slabinfo.ftrace_event_field.num_slabs 104.00 +0.0% 104.00 slabinfo.hugetlbfs_inode_cache.active_objs 2.00 +0.0% 2.00 slabinfo.hugetlbfs_inode_cache.active_slabs 104.00 +0.0% 104.00 slabinfo.hugetlbfs_inode_cache.num_objs 2.00 +0.0% 2.00 slabinfo.hugetlbfs_inode_cache.num_slabs 66863 -0.4% 66623 slabinfo.inode_cache.active_objs 1242 -0.3% 1238 slabinfo.inode_cache.active_slabs 67098 -0.3% 66875 slabinfo.inode_cache.num_objs 1242 -0.3% 1238 slabinfo.inode_cache.num_slabs 87083 -0.2% 86908 slabinfo.kernfs_node_cache.active_objs 2720 -0.2% 2715 slabinfo.kernfs_node_cache.active_slabs 87083 -0.2% 86908 slabinfo.kernfs_node_cache.num_objs 2720 -0.2% 2715 slabinfo.kernfs_node_cache.num_slabs 2743 ± 17% +22.3% 3354 slabinfo.khugepaged_mm_slot.active_objs 75.60 ± 17% +22.6% 92.67 slabinfo.khugepaged_mm_slot.active_slabs 2743 ± 17% +22.3% 3354 slabinfo.khugepaged_mm_slot.num_objs 75.60 ± 17% +22.6% 92.67 slabinfo.khugepaged_mm_slot.num_slabs 4956 -0.3% 4940 ± 2% slabinfo.kmalloc-128.active_objs 156.80 ± 2% -0.5% 156.00 slabinfo.kmalloc-128.active_slabs 5019 ± 2% -0.3% 5002 slabinfo.kmalloc-128.num_objs 156.80 ± 2% -0.5% 156.00 slabinfo.kmalloc-128.num_slabs 35368 +0.5% 35535 slabinfo.kmalloc-16.active_objs 139.00 +1.4% 141.00 slabinfo.kmalloc-16.active_slabs 35632 +1.3% 36096 slabinfo.kmalloc-16.num_objs 139.00 +1.4% 141.00 slabinfo.kmalloc-16.num_slabs 6036 -0.2% 6026 slabinfo.kmalloc-192.active_objs 146.80 -0.3% 146.33 slabinfo.kmalloc-192.active_slabs 6165 -0.1% 6159 slabinfo.kmalloc-192.num_objs 146.80 -0.3% 146.33 slabinfo.kmalloc-192.num_slabs 6378 ± 2% +4.8% 6687 slabinfo.kmalloc-1k.active_objs 202.00 ± 2% +4.0% 210.00 slabinfo.kmalloc-1k.active_slabs 6464 ± 2% +4.1% 6730 slabinfo.kmalloc-1k.num_objs 202.00 ± 2% +4.0% 210.00 slabinfo.kmalloc-1k.num_slabs 8765 ± 4% -0.9% 8687 ± 3% slabinfo.kmalloc-256.active_objs 276.40 ± 4% -1.6% 272.00 ± 3% slabinfo.kmalloc-256.active_slabs 8864 ± 4% -1.7% 8718 ± 3% slabinfo.kmalloc-256.num_objs 276.40 ± 4% -1.6% 272.00 ± 3% slabinfo.kmalloc-256.num_slabs 6091 ± 4% -1.4% 6004 ± 2% slabinfo.kmalloc-2k.active_objs 386.80 ± 4% -1.2% 382.33 ± 2% slabinfo.kmalloc-2k.active_slabs 6198 ± 4% -1.2% 6125 ± 2% slabinfo.kmalloc-2k.num_objs 386.80 ± 4% -1.2% 382.33 ± 2% slabinfo.kmalloc-2k.num_slabs 90267 ± 2% +0.2% 90479 slabinfo.kmalloc-32.active_objs 705.20 ± 2% +0.4% 708.00 slabinfo.kmalloc-32.active_slabs 90374 ± 2% +0.4% 90705 slabinfo.kmalloc-32.num_objs 705.20 ± 2% +0.4% 708.00 slabinfo.kmalloc-32.num_slabs 2132 ± 4% -4.2% 2043 slabinfo.kmalloc-4k.active_objs 273.40 ± 4% -5.0% 259.67 slabinfo.kmalloc-4k.active_slabs 2189 ± 4% -4.9% 2081 slabinfo.kmalloc-4k.num_objs 273.40 ± 4% -5.0% 259.67 slabinfo.kmalloc-4k.num_slabs 60206 +66.6% 100322 slabinfo.kmalloc-512.active_objs 2210 ± 2% +66.3% 3676 ± 3% slabinfo.kmalloc-512.active_slabs 70766 ± 2% +66.3% 117666 ± 3% slabinfo.kmalloc-512.num_objs 2210 ± 2% +66.3% 3676 ± 3% slabinfo.kmalloc-512.num_slabs 53775 +0.8% 54179 slabinfo.kmalloc-64.active_objs 840.60 +0.8% 847.00 slabinfo.kmalloc-64.active_slabs 53835 +0.8% 54247 slabinfo.kmalloc-64.num_objs 840.60 +0.8% 847.00 slabinfo.kmalloc-64.num_slabs 54761 +1.2% 55439 slabinfo.kmalloc-8.active_objs 109.00 +0.9% 110.00 slabinfo.kmalloc-8.active_slabs 55808 +0.9% 56320 slabinfo.kmalloc-8.num_objs 109.00 +0.9% 110.00 slabinfo.kmalloc-8.num_slabs 898.40 +0.5% 902.67 slabinfo.kmalloc-8k.active_objs 229.80 +0.4% 230.67 slabinfo.kmalloc-8k.active_slabs 920.80 +0.4% 924.67 slabinfo.kmalloc-8k.num_objs 229.80 +0.4% 230.67 slabinfo.kmalloc-8k.num_slabs 7901 ± 3% -2.6% 7691 slabinfo.kmalloc-96.active_objs 188.80 ± 4% -2.0% 185.00 slabinfo.kmalloc-96.active_slabs 7957 ± 3% -2.4% 7770 slabinfo.kmalloc-96.num_objs 188.80 ± 4% -2.0% 185.00 slabinfo.kmalloc-96.num_slabs 1107 ± 21% -26.8% 810.67 ± 12% slabinfo.kmalloc-rcl-128.active_objs 34.60 ± 21% -26.8% 25.33 ± 12% slabinfo.kmalloc-rcl-128.active_slabs 1107 ± 21% -26.8% 810.67 ± 12% slabinfo.kmalloc-rcl-128.num_objs 34.60 ± 21% -26.8% 25.33 ± 12% slabinfo.kmalloc-rcl-128.num_slabs 302.40 ± 13% -25.9% 224.00 ± 17% slabinfo.kmalloc-rcl-192.active_objs 7.20 ± 13% -25.9% 5.33 ± 17% slabinfo.kmalloc-rcl-192.active_slabs 302.40 ± 13% -25.9% 224.00 ± 17% slabinfo.kmalloc-rcl-192.num_objs 7.20 ± 13% -25.9% 5.33 ± 17% slabinfo.kmalloc-rcl-192.num_slabs 166.40 ± 18% -23.1% 128.00 ± 20% slabinfo.kmalloc-rcl-256.active_objs 5.20 ± 18% -23.1% 4.00 ± 20% slabinfo.kmalloc-rcl-256.active_slabs 166.40 ± 18% -23.1% 128.00 ± 20% slabinfo.kmalloc-rcl-256.num_objs 5.20 ± 18% -23.1% 4.00 ± 20% slabinfo.kmalloc-rcl-256.num_slabs 2136 ± 6% +1.7% 2173 slabinfo.kmalloc-rcl-512.active_objs 66.40 ± 7% +1.9% 67.67 slabinfo.kmalloc-rcl-512.active_slabs 2136 ± 6% +1.7% 2173 slabinfo.kmalloc-rcl-512.num_objs 66.40 ± 7% +1.9% 67.67 slabinfo.kmalloc-rcl-512.num_slabs 6517 ± 4% -5.4% 6163 ± 4% slabinfo.kmalloc-rcl-64.active_objs 101.40 ± 4% -5.3% 96.00 ± 4% slabinfo.kmalloc-rcl-64.active_slabs 6519 ± 4% -5.5% 6164 ± 4% slabinfo.kmalloc-rcl-64.num_objs 101.40 ± 4% -5.3% 96.00 ± 4% slabinfo.kmalloc-rcl-64.num_slabs 3120 ± 11% -16.5% 2604 ± 5% slabinfo.kmalloc-rcl-96.active_objs 74.20 ± 12% -16.4% 62.00 ± 5% slabinfo.kmalloc-rcl-96.active_slabs 3120 ± 11% -16.5% 2604 ± 5% slabinfo.kmalloc-rcl-96.num_objs 74.20 ± 12% -16.4% 62.00 ± 5% slabinfo.kmalloc-rcl-96.num_slabs 377.60 ± 6% +7.3% 405.33 ± 19% slabinfo.kmem_cache.active_objs 11.80 ± 6% +7.3% 12.67 ± 19% slabinfo.kmem_cache.active_slabs 377.60 ± 6% +7.3% 405.33 ± 19% slabinfo.kmem_cache.num_objs 11.80 ± 6% +7.3% 12.67 ± 19% slabinfo.kmem_cache.num_slabs 773.20 ± 6% +15.5% 892.67 ± 17% slabinfo.kmem_cache_node.active_objs 12.80 ± 5% +14.6% 14.67 ± 17% slabinfo.kmem_cache_node.active_slabs 819.20 ± 5% +14.6% 938.67 ± 17% slabinfo.kmem_cache_node.num_objs 12.80 ± 5% +14.6% 14.67 ± 17% slabinfo.kmem_cache_node.num_slabs 17532 -0.2% 17496 slabinfo.lsm_file_cache.active_objs 102.20 -0.2% 102.00 slabinfo.lsm_file_cache.active_slabs 17532 -0.2% 17496 slabinfo.lsm_file_cache.num_objs 102.20 -0.2% 102.00 slabinfo.lsm_file_cache.num_slabs 3205 -0.6% 3185 slabinfo.mm_struct.active_objs 106.00 -0.6% 105.33 slabinfo.mm_struct.active_slabs 3205 -0.6% 3185 slabinfo.mm_struct.num_objs 106.00 -0.6% 105.33 slabinfo.mm_struct.num_slabs 950.40 ± 14% +0.2% 952.00 ± 11% slabinfo.mnt_cache.active_objs 18.60 ± 14% +0.4% 18.67 ± 11% slabinfo.mnt_cache.active_slabs 950.40 ± 14% +0.2% 952.00 ± 11% slabinfo.mnt_cache.num_objs 18.60 ± 14% +0.4% 18.67 ± 11% slabinfo.mnt_cache.num_slabs 34.00 +0.0% 34.00 slabinfo.mqueue_inode_cache.active_objs 1.00 +0.0% 1.00 slabinfo.mqueue_inode_cache.active_slabs 34.00 +0.0% 34.00 slabinfo.mqueue_inode_cache.num_objs 1.00 +0.0% 1.00 slabinfo.mqueue_inode_cache.num_slabs 769.80 -0.0% 769.67 slabinfo.names_cache.active_objs 96.20 -0.2% 96.00 slabinfo.names_cache.active_slabs 769.80 -0.0% 769.67 slabinfo.names_cache.num_objs 96.20 -0.2% 96.00 slabinfo.names_cache.num_slabs 120.00 +0.0% 120.00 slabinfo.nfs_inode_cache.active_objs 4.00 +0.0% 4.00 slabinfo.nfs_inode_cache.active_slabs 120.00 +0.0% 120.00 slabinfo.nfs_inode_cache.num_objs 4.00 +0.0% 4.00 slabinfo.nfs_inode_cache.num_slabs 73.00 ± 13% +2.7% 75.00 ± 13% slabinfo.nfs_read_data.active_objs 1.60 ± 30% +4.2% 1.67 ± 28% slabinfo.nfs_read_data.active_slabs 73.00 ± 13% +2.7% 75.00 ± 13% slabinfo.nfs_read_data.num_objs 1.60 ± 30% +4.2% 1.67 ± 28% slabinfo.nfs_read_data.num_slabs 352.80 ± 26% -18.0% 289.33 ± 20% slabinfo.numa_policy.active_objs 5.60 ± 24% -16.7% 4.67 ± 20% slabinfo.numa_policy.active_slabs 352.80 ± 26% -18.0% 289.33 ± 20% slabinfo.numa_policy.num_objs 5.60 ± 24% -16.7% 4.67 ± 20% slabinfo.numa_policy.num_slabs 9425 +1.8% 9595 slabinfo.pde_opener.active_objs 92.00 +1.4% 93.33 slabinfo.pde_opener.active_slabs 9425 +1.8% 9595 slabinfo.pde_opener.num_objs 92.00 +1.4% 93.33 slabinfo.pde_opener.num_slabs 4537 -1.7% 4459 slabinfo.pid.active_objs 141.20 -1.8% 138.67 slabinfo.pid.active_slabs 4537 -1.7% 4459 slabinfo.pid.num_objs 141.20 -1.8% 138.67 slabinfo.pid.num_slabs 105.80 ± 70% -47.1% 56.00 slabinfo.pid_namespace.active_objs 1.80 ± 64% -44.4% 1.00 slabinfo.pid_namespace.active_slabs 105.80 ± 70% -47.1% 56.00 slabinfo.pid_namespace.num_objs 1.80 ± 64% -44.4% 1.00 slabinfo.pid_namespace.num_slabs 1652 ± 4% +3.4% 1709 ± 6% slabinfo.pool_workqueue.active_objs 51.00 ± 4% +3.3% 52.67 ± 7% slabinfo.pool_workqueue.active_slabs 1652 ± 4% +3.4% 1709 ± 6% slabinfo.pool_workqueue.num_objs 51.00 ± 4% +3.3% 52.67 ± 7% slabinfo.pool_workqueue.num_slabs 3864 -0.7% 3836 slabinfo.proc_dir_entry.active_objs 92.00 -0.7% 91.33 slabinfo.proc_dir_entry.active_slabs 3864 -0.7% 3836 slabinfo.proc_dir_entry.num_objs 92.00 -0.7% 91.33 slabinfo.proc_dir_entry.num_slabs 15443 ± 5% -9.7% 13950 slabinfo.proc_inode_cache.active_objs 329.00 ± 6% -8.3% 301.67 ± 2% slabinfo.proc_inode_cache.active_slabs 15813 ± 6% -8.3% 14501 ± 2% slabinfo.proc_inode_cache.num_objs 329.00 ± 6% -8.3% 301.67 ± 2% slabinfo.proc_inode_cache.num_slabs 255149 -0.4% 254216 slabinfo.radix_tree_node.active_objs 4558 -0.4% 4541 slabinfo.radix_tree_node.active_slabs 255287 -0.4% 254355 slabinfo.radix_tree_node.num_objs 4558 -0.4% 4541 slabinfo.radix_tree_node.num_slabs 134.40 ± 5% +3.2% 138.67 ± 5% slabinfo.request_queue.active_objs 8.40 ± 5% +3.2% 8.67 ± 5% slabinfo.request_queue.active_slabs 134.40 ± 5% +3.2% 138.67 ± 5% slabinfo.request_queue.num_objs 8.40 ± 5% +3.2% 8.67 ± 5% slabinfo.request_queue.num_slabs 91.80 ± 22% +11.1% 102.00 slabinfo.rpc_inode_cache.active_objs 1.80 ± 22% +11.1% 2.00 slabinfo.rpc_inode_cache.active_slabs 91.80 ± 22% +11.1% 102.00 slabinfo.rpc_inode_cache.num_objs 1.80 ± 22% +11.1% 2.00 slabinfo.rpc_inode_cache.num_slabs 928.00 +0.0% 928.00 slabinfo.scsi_sense_cache.active_objs 29.00 +0.0% 29.00 slabinfo.scsi_sense_cache.active_slabs 928.00 +0.0% 928.00 slabinfo.scsi_sense_cache.num_objs 29.00 +0.0% 29.00 slabinfo.scsi_sense_cache.num_slabs 3264 +0.0% 3264 slabinfo.seq_file.active_objs 96.00 +0.0% 96.00 slabinfo.seq_file.active_slabs 3264 +0.0% 3264 slabinfo.seq_file.num_objs 96.00 +0.0% 96.00 slabinfo.seq_file.num_slabs 5449 ± 2% +0.7% 5486 ± 2% slabinfo.shmem_inode_cache.active_objs 117.80 ± 2% +0.5% 118.33 ± 2% slabinfo.shmem_inode_cache.active_slabs 5449 ± 2% +0.7% 5486 ± 2% slabinfo.shmem_inode_cache.num_objs 117.80 ± 2% +0.5% 118.33 ± 2% slabinfo.shmem_inode_cache.num_slabs 2552 ± 3% -2.1% 2498 ± 2% slabinfo.sighand_cache.active_objs 172.20 ± 2% -1.9% 169.00 ± 2% slabinfo.sighand_cache.active_slabs 2588 ± 2% -1.8% 2541 ± 2% slabinfo.sighand_cache.num_objs 172.20 ± 2% -1.9% 169.00 ± 2% slabinfo.sighand_cache.num_slabs 3887 ± 2% -0.3% 3877 slabinfo.signal_cache.active_objs 140.60 ± 2% -0.7% 139.67 slabinfo.signal_cache.active_slabs 3948 ± 2% -0.6% 3926 slabinfo.signal_cache.num_objs 140.60 ± 2% -0.7% 139.67 slabinfo.signal_cache.num_slabs 581.60 ± 14% -3.4% 562.00 ± 10% slabinfo.skbuff_fclone_cache.active_objs 17.60 ± 16% -3.4% 17.00 ± 12% slabinfo.skbuff_fclone_cache.active_slabs 581.60 ± 14% -3.4% 562.00 ± 10% slabinfo.skbuff_fclone_cache.num_objs 17.60 ± 16% -3.4% 17.00 ± 12% slabinfo.skbuff_fclone_cache.num_slabs 4339 ± 10% +5.7% 4585 ± 10% slabinfo.skbuff_head_cache.active_objs 135.60 ± 10% +6.2% 144.00 ± 10% slabinfo.skbuff_head_cache.active_slabs 4345 ± 10% +6.2% 4617 ± 10% slabinfo.skbuff_head_cache.num_objs 135.60 ± 10% +6.2% 144.00 ± 10% slabinfo.skbuff_head_cache.num_slabs 3405 ± 3% -1.3% 3359 slabinfo.sock_inode_cache.active_objs 86.60 ± 2% -1.1% 85.67 slabinfo.sock_inode_cache.active_slabs 3405 ± 3% -1.3% 3359 slabinfo.sock_inode_cache.num_objs 86.60 ± 2% -1.1% 85.67 slabinfo.sock_inode_cache.num_slabs 6129 +0.7% 6169 slabinfo.task_delay_info.active_objs 119.80 +0.7% 120.67 slabinfo.task_delay_info.active_slabs 6129 +0.7% 6169 slabinfo.task_delay_info.num_objs 119.80 +0.7% 120.67 slabinfo.task_delay_info.num_slabs 1296 ± 10% +1.7% 1318 ± 3% slabinfo.task_group.active_objs 27.60 ± 10% +3.9% 28.67 ± 3% slabinfo.task_group.active_slabs 1296 ± 10% +1.7% 1318 ± 3% slabinfo.task_group.num_objs 27.60 ± 10% +3.9% 28.67 ± 3% slabinfo.task_group.num_slabs 1593 ± 4% -3.5% 1538 ± 2% slabinfo.task_struct.active_objs 1599 ± 4% -3.4% 1544 ± 2% slabinfo.task_struct.active_slabs 1599 ± 4% -3.4% 1544 ± 2% slabinfo.task_struct.num_objs 1599 ± 4% -3.4% 1544 ± 2% slabinfo.task_struct.num_slabs 105.80 -2.0% 103.67 slabinfo.taskstats.active_objs 2.00 +0.0% 2.00 slabinfo.taskstats.active_slabs 105.80 -2.0% 103.67 slabinfo.taskstats.num_objs 2.00 +0.0% 2.00 slabinfo.taskstats.num_slabs 2633 ± 2% -3.3% 2545 ± 3% slabinfo.trace_event_file.active_objs 57.20 ± 2% -3.3% 55.33 ± 3% slabinfo.trace_event_file.active_slabs 2633 ± 2% -3.3% 2545 ± 3% slabinfo.trace_event_file.num_objs 57.20 ± 2% -3.3% 55.33 ± 3% slabinfo.trace_event_file.num_slabs 105.60 ± 23% -6.2% 99.00 ± 27% slabinfo.tw_sock_TCP.active_objs 3.20 ± 23% -6.3% 3.00 ± 27% slabinfo.tw_sock_TCP.active_slabs 105.60 ± 23% -6.2% 99.00 ± 27% slabinfo.tw_sock_TCP.num_objs 3.20 ± 23% -6.3% 3.00 ± 27% slabinfo.tw_sock_TCP.num_slabs 1345825 +75.7% 2364088 slabinfo.vm_area_struct.active_objs 40117 +103.2% 81517 slabinfo.vm_area_struct.active_slabs 1604716 +103.2% 3260692 slabinfo.vm_area_struct.num_objs 40117 +103.2% 81517 slabinfo.vm_area_struct.num_slabs 9416 ± 2% +1.7% 9574 ± 2% slabinfo.vmap_area.active_objs 147.00 ± 2% +1.6% 149.33 ± 2% slabinfo.vmap_area.active_slabs 9437 ± 2% +1.6% 9584 ± 2% slabinfo.vmap_area.num_objs 147.00 ± 2% +1.6% 149.33 ± 2% slabinfo.vmap_area.num_slabs 80.60 ± 29% -1.2% 79.67 ± 14% slabinfo.xfrm_state.active_objs 1.40 ± 34% -4.8% 1.33 ± 35% slabinfo.xfrm_state.active_slabs 80.60 ± 29% -1.2% 79.67 ± 14% slabinfo.xfrm_state.num_objs 1.40 ± 34% -4.8% 1.33 ± 35% slabinfo.xfrm_state.num_slabs 784.80 ± 2% -0.1% 784.33 softirqs.BLOCK 8.80 ± 84% +21.2% 10.67 ±104% softirqs.CPU0.BLOCK 1.00 +0.0% 1.00 softirqs.CPU0.HI 110.40 ± 41% -25.1% 82.67 ± 58% softirqs.CPU0.NET_RX 4.00 ± 47% -75.0% 1.00 ± 81% softirqs.CPU0.NET_TX 6886 ± 2% -51.0% 3373 ± 3% softirqs.CPU0.RCU 4936 ± 10% +1.1% 4992 ± 9% softirqs.CPU0.SCHED 113.20 -0.2% 113.00 softirqs.CPU0.TASKLET 1962 ± 22% -46.8% 1044 ± 32% softirqs.CPU0.TIMER 4.40 ±177% +248.5% 15.33 ± 91% softirqs.CPU1.BLOCK 47.40 ± 22% +2619.4% 1289 ± 99% softirqs.CPU1.NET_RX 1.00 ± 63% +500.0% 6.00 softirqs.CPU1.NET_TX 2997 ± 7% +68.3% 5046 ± 32% softirqs.CPU1.RCU 4038 ± 15% +8.5% 4382 ± 5% softirqs.CPU1.SCHED 0.00 +1.7e+102% 1.67 ± 74% softirqs.CPU1.TASKLET 205.40 ± 41% +369.5% 964.33 ± 63% softirqs.CPU1.TIMER 7.20 ± 88% -100.0% 0.00 softirqs.CPU10.BLOCK 1936 ± 7% +36.6% 2645 softirqs.CPU10.RCU 3043 ± 11% -8.4% 2787 ± 8% softirqs.CPU10.SCHED 170.00 ± 34% -63.3% 62.33 ± 14% softirqs.CPU10.TIMER 7.20 ±186% +62.0% 11.67 ± 74% softirqs.CPU11.BLOCK 1.00 +0.0% 1.00 softirqs.CPU11.HI 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU11.NET_RX 1972 ± 7% +34.2% 2648 ± 2% softirqs.CPU11.RCU 2998 ± 7% -7.8% 2764 ± 3% softirqs.CPU11.SCHED 54.00 +0.0% 54.00 softirqs.CPU11.TASKLET 333.40 ± 62% -81.5% 61.67 softirqs.CPU11.TIMER 2.00 ±154% -66.7% 0.67 ±141% softirqs.CPU12.BLOCK 0.00 +6.7e+101% 0.67 ±141% softirqs.CPU12.NET_RX 2196 ± 22% +21.0% 2658 softirqs.CPU12.RCU 2828 ± 7% +4.0% 2942 ± 12% softirqs.CPU12.SCHED 193.40 ± 69% -65.9% 66.00 ± 11% softirqs.CPU12.TIMER 8.00 ±154% +8.3% 8.67 ±110% softirqs.CPU13.BLOCK 2077 ± 8% +31.0% 2720 ± 6% softirqs.CPU13.RCU 3100 ± 13% -4.9% 2947 ± 4% softirqs.CPU13.SCHED 178.00 ± 27% +58.1% 281.33 ± 25% softirqs.CPU13.TIMER 3.20 ±170% -89.6% 0.33 ±141% softirqs.CPU14.BLOCK 1970 ± 5% +63.8% 3227 ± 19% softirqs.CPU14.RCU 3065 ± 8% -4.7% 2922 ± 3% softirqs.CPU14.SCHED 253.40 ± 34% -50.5% 125.33 ± 29% softirqs.CPU14.TIMER 0.00 +6.7e+101% 0.67 ±141% softirqs.CPU15.BLOCK 2.00 +0.0% 2.00 softirqs.CPU15.NET_RX 2007 ± 8% +38.1% 2773 ± 4% softirqs.CPU15.RCU 2821 ± 12% +15.3% 3254 ± 10% softirqs.CPU15.SCHED 2.00 +0.0% 2.00 softirqs.CPU15.TASKLET 351.00 ± 45% -19.5% 282.67 ± 91% softirqs.CPU15.TIMER 6.60 ±177% +233.3% 22.00 ± 94% softirqs.CPU16.BLOCK 2.00 +0.0% 2.00 softirqs.CPU16.NET_RX 2043 ± 14% +31.6% 2689 ± 4% softirqs.CPU16.RCU 3162 ± 7% -7.8% 2917 ± 8% softirqs.CPU16.SCHED 1.60 ± 50% -58.3% 0.67 ±141% softirqs.CPU16.TASKLET 384.00 ±115% +62.8% 625.00 ±114% softirqs.CPU16.TIMER 21.00 ±100% -77.8% 4.67 ±141% softirqs.CPU17.BLOCK 2.00 +0.0% 2.00 softirqs.CPU17.NET_RX 2012 ± 9% +26.7% 2550 ± 5% softirqs.CPU17.RCU 3035 ± 4% -13.7% 2620 ± 6% softirqs.CPU17.SCHED 12.00 ±183% -83.3% 2.00 softirqs.CPU17.TASKLET 152.40 ± 56% +316.9% 635.33 ±123% softirqs.CPU17.TIMER 1.80 ±123% +214.8% 5.67 ±141% softirqs.CPU18.BLOCK 2.00 +0.0% 2.00 softirqs.CPU18.NET_RX 1936 ± 8% +43.1% 2771 ± 6% softirqs.CPU18.RCU 2916 ± 4% -2.4% 2847 ± 6% softirqs.CPU18.SCHED 1.60 ± 50% +25.0% 2.00 softirqs.CPU18.TASKLET 208.60 ± 45% -58.1% 87.33 ± 36% softirqs.CPU18.TIMER 0.60 ±133% +2177.8% 13.67 ±141% softirqs.CPU19.BLOCK 2.00 +0.0% 2.00 softirqs.CPU19.NET_RX 1925 ± 6% +42.4% 2742 softirqs.CPU19.RCU 2641 ± 18% +6.4% 2810 ± 4% softirqs.CPU19.SCHED 2.00 -33.3% 1.33 ± 70% softirqs.CPU19.TASKLET 191.80 ± 36% -30.7% 133.00 ± 34% softirqs.CPU19.TIMER 4.40 ±200% -84.8% 0.67 ±141% softirqs.CPU2.BLOCK 2611 ± 3% +35.0% 3526 ± 9% softirqs.CPU2.RCU 3550 ± 11% -12.7% 3099 ± 6% softirqs.CPU2.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU2.TASKLET 431.60 ± 77% -47.9% 225.00 ± 20% softirqs.CPU2.TIMER 2.00 +0.0% 2.00 softirqs.CPU20.NET_RX 0.00 -100.0% 0.00 softirqs.CPU20.NET_TX 1932 ± 8% +44.5% 2792 ± 2% softirqs.CPU20.RCU 2811 ± 8% -1.4% 2772 ± 4% softirqs.CPU20.SCHED 2.00 +0.0% 2.00 softirqs.CPU20.TASKLET 217.40 ± 54% -51.5% 105.33 ± 20% softirqs.CPU20.TIMER 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU21.BLOCK 2.20 ± 18% -9.1% 2.00 softirqs.CPU21.NET_RX 1926 ± 6% +36.4% 2628 ± 3% softirqs.CPU21.RCU 2679 ± 7% +4.9% 2809 softirqs.CPU21.SCHED 2.00 +0.0% 2.00 softirqs.CPU21.TASKLET 259.80 ± 40% -28.5% 185.67 ± 56% softirqs.CPU21.TIMER 6.40 ±200% -100.0% 0.00 softirqs.CPU22.BLOCK 2.00 +0.0% 2.00 softirqs.CPU22.NET_RX 2088 ± 20% +50.8% 3149 ± 26% softirqs.CPU22.RCU 3141 ± 10% -10.1% 2825 ± 19% softirqs.CPU22.SCHED 1.60 ± 50% +25.0% 2.00 softirqs.CPU22.TASKLET 381.20 ± 92% +33.9% 510.33 ±124% softirqs.CPU22.TIMER 2.40 ±200% +2538.9% 63.33 ±141% softirqs.CPU23.BLOCK 0.00 -100.0% 0.00 softirqs.CPU23.NET_TX 1933 ± 12% +39.7% 2700 ± 6% softirqs.CPU23.RCU 2848 ± 7% -2.0% 2792 ± 8% softirqs.CPU23.SCHED 2.00 -33.3% 1.33 ± 70% softirqs.CPU23.TASKLET 343.00 ± 58% -40.0% 205.67 ± 80% softirqs.CPU23.TIMER 20.60 ±116% +5.2% 21.67 ±134% softirqs.CPU24.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU24.NET_RX 2688 ± 3% +31.0% 3521 ± 6% softirqs.CPU24.RCU 2939 ± 9% -11.5% 2601 ± 15% softirqs.CPU24.SCHED 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU24.TASKLET 203.00 ± 31% +140.4% 488.00 ±119% softirqs.CPU24.TIMER 6.40 ±177% -100.0% 0.00 softirqs.CPU25.BLOCK 0.00 -100.0% 0.00 softirqs.CPU25.NET_TX 2737 ± 8% +13.9% 3119 ± 2% softirqs.CPU25.RCU 3319 ± 12% -17.1% 2750 ± 7% softirqs.CPU25.SCHED 0.00 -100.0% 0.00 softirqs.CPU25.TASKLET 273.40 ± 46% -62.1% 103.67 ± 35% softirqs.CPU25.TIMER 4.00 ±114% +408.3% 20.33 ±127% softirqs.CPU26.BLOCK 1.00 ±200% -100.0% 0.00 softirqs.CPU26.NET_TX 2317 ± 5% +30.1% 3014 ± 2% softirqs.CPU26.RCU 3248 ± 16% -4.7% 3095 ± 12% softirqs.CPU26.SCHED 0.00 -100.0% 0.00 softirqs.CPU26.TASKLET 403.00 ±125% -21.2% 317.67 ± 97% softirqs.CPU26.TIMER 12.40 ±200% -11.3% 11.00 ±128% softirqs.CPU27.BLOCK 2191 ± 6% +25.8% 2756 ± 3% softirqs.CPU27.RCU 2933 ± 6% -7.3% 2719 ± 7% softirqs.CPU27.SCHED 1.60 ± 30% +25.0% 2.00 softirqs.CPU27.TASKLET 360.20 ± 43% +62.5% 585.33 ± 93% softirqs.CPU27.TIMER 0.00 +4.3e+103% 42.67 ±141% softirqs.CPU28.BLOCK 2005 ± 3% +38.8% 2783 ± 2% softirqs.CPU28.RCU 3058 ± 5% -11.0% 2720 ± 2% softirqs.CPU28.SCHED 6.20 ±143% -67.7% 2.00 softirqs.CPU28.TASKLET 305.40 ± 60% -62.3% 115.00 ± 37% softirqs.CPU28.TIMER 5.80 ±200% +256.3% 20.67 ±141% softirqs.CPU29.BLOCK 0.00 +1.3e+102% 1.33 ±141% softirqs.CPU29.NET_TX 2118 ± 18% +31.3% 2782 ± 12% softirqs.CPU29.RCU 2837 ± 8% +6.4% 3019 ± 13% softirqs.CPU29.SCHED 9.40 ±127% -78.7% 2.00 softirqs.CPU29.TASKLET 199.20 ± 43% +380.8% 957.67 ± 56% softirqs.CPU29.TIMER 2.40 ±200% +11.1% 2.67 ±141% softirqs.CPU3.BLOCK 0.80 ±200% -100.0% 0.00 softirqs.CPU3.NET_TX 2413 ± 7% +33.8% 3229 ± 5% softirqs.CPU3.RCU 3226 ± 18% -6.5% 3018 ± 2% softirqs.CPU3.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU3.TASKLET 422.40 ±111% +3.6% 437.67 ±112% softirqs.CPU3.TIMER 0.00 -100.0% 0.00 softirqs.CPU30.BLOCK 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU30.NET_TX 1920 ± 8% +61.7% 3104 ± 14% softirqs.CPU30.RCU 2959 ± 8% -3.3% 2860 ± 4% softirqs.CPU30.SCHED 1.60 ± 30% +25.0% 2.00 softirqs.CPU30.TASKLET 220.20 ± 59% -33.1% 147.33 ± 69% softirqs.CPU30.TIMER 9.00 ±194% -81.5% 1.67 ±141% softirqs.CPU31.BLOCK 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU31.NET_RX 1966 ± 6% +39.7% 2747 ± 5% softirqs.CPU31.RCU 3207 ± 9% -9.2% 2911 ± 7% softirqs.CPU31.SCHED 1.80 ± 22% -7.4% 1.67 ± 28% softirqs.CPU31.TASKLET 240.60 ± 35% -25.3% 179.67 ± 46% softirqs.CPU31.TIMER 27.40 ±198% -61.1% 10.67 ±141% softirqs.CPU32.BLOCK 0.00 -100.0% 0.00 softirqs.CPU32.NET_RX 1947 ± 10% +37.3% 2674 ± 13% softirqs.CPU32.RCU 3235 ± 9% -17.0% 2685 ± 6% softirqs.CPU32.SCHED 1.80 ± 22% +103.7% 3.67 ± 46% softirqs.CPU32.TASKLET 154.00 ± 31% -19.5% 124.00 ± 23% softirqs.CPU32.TIMER 12.40 ±200% -100.0% 0.00 softirqs.CPU33.BLOCK 1840 ± 5% +29.6% 2386 ± 4% softirqs.CPU33.RCU 2970 ± 11% -4.2% 2846 ± 5% softirqs.CPU33.SCHED 1.80 ± 22% +11.1% 2.00 softirqs.CPU33.TASKLET 231.60 ± 45% +32.3% 306.33 ±107% softirqs.CPU33.TIMER 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU34.BLOCK 1854 ± 10% +34.2% 2488 softirqs.CPU34.RCU 2674 ± 4% +10.1% 2946 ± 11% softirqs.CPU34.SCHED 2.00 +0.0% 2.00 softirqs.CPU34.TASKLET 177.80 ± 37% +22.2% 217.33 ± 22% softirqs.CPU34.TIMER 21.00 ±145% +73.0% 36.33 ± 67% softirqs.CPU35.BLOCK 1991 ± 10% +24.0% 2468 ± 6% softirqs.CPU35.RCU 3255 ± 8% -14.1% 2795 ± 11% softirqs.CPU35.SCHED 0.00 +3e+102% 3.00 ±141% softirqs.CPU35.TASKLET 220.40 ± 54% -57.5% 93.67 ± 47% softirqs.CPU35.TIMER 13.60 ±178% -95.1% 0.67 ±141% softirqs.CPU36.BLOCK 1841 ± 9% +31.7% 2425 ± 5% softirqs.CPU36.RCU 3068 ± 6% -8.5% 2809 ± 8% softirqs.CPU36.SCHED 151.40 ± 40% +118.4% 330.67 ± 87% softirqs.CPU36.TIMER 14.00 ±172% -100.0% 0.00 softirqs.CPU37.BLOCK 1864 ± 9% +23.2% 2297 softirqs.CPU37.RCU 2907 ± 6% -1.9% 2852 ± 6% softirqs.CPU37.SCHED 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU37.TASKLET 228.00 ± 27% -43.1% 129.67 ± 53% softirqs.CPU37.TIMER 1.80 ±150% +992.6% 19.67 ±141% softirqs.CPU38.BLOCK 0.00 -100.0% 0.00 softirqs.CPU38.NET_TX 1803 ± 4% +34.9% 2433 ± 11% softirqs.CPU38.RCU 3001 ± 10% +3.3% 3100 ± 8% softirqs.CPU38.SCHED 189.00 ± 67% -66.8% 62.67 softirqs.CPU38.TIMER 25.60 ±140% -100.0% 0.00 softirqs.CPU39.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU39.NET_RX 1794 ± 7% +35.5% 2431 ± 3% softirqs.CPU39.RCU 3072 ± 6% -7.9% 2830 ± 7% softirqs.CPU39.SCHED 7.20 ±125% -100.0% 0.00 softirqs.CPU39.TASKLET 159.60 ± 35% -48.0% 83.00 ± 26% softirqs.CPU39.TIMER 0.00 +8.7e+102% 8.67 ±141% softirqs.CPU4.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU4.NET_RX 2273 ± 13% +36.7% 3107 softirqs.CPU4.RCU 3131 ± 3% +1.1% 3166 ± 10% softirqs.CPU4.SCHED 253.20 ± 58% +8.0% 273.33 ± 36% softirqs.CPU4.TIMER 6.20 ±176% -67.7% 2.00 ±141% softirqs.CPU40.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU40.NET_RX 1860 ± 2% +28.4% 2389 ± 7% softirqs.CPU40.RCU 3268 ± 12% -13.1% 2841 ± 7% softirqs.CPU40.SCHED 0.00 +6.7e+101% 0.67 ±141% softirqs.CPU40.TASKLET 249.00 ± 28% -46.6% 133.00 ± 48% softirqs.CPU40.TIMER 5.80 ±175% -82.8% 1.00 ± 81% softirqs.CPU41.BLOCK 1919 ± 6% +43.6% 2756 ± 8% softirqs.CPU41.RCU 3147 ± 7% -4.0% 3023 ± 3% softirqs.CPU41.SCHED 295.40 ± 36% -38.4% 182.00 ± 58% softirqs.CPU41.TIMER 0.20 ±200% +11400.0% 23.00 ±141% softirqs.CPU42.BLOCK 2008 ± 4% +78.3% 3580 ± 47% softirqs.CPU42.RCU 3071 ± 14% -10.0% 2763 ± 5% softirqs.CPU42.SCHED 297.00 ± 30% +56.5% 464.67 ±120% softirqs.CPU42.TIMER 13.20 ±184% -100.0% 0.00 softirqs.CPU43.BLOCK 2040 ± 15% +25.7% 2564 ± 11% softirqs.CPU43.RCU 3052 ± 5% +5.5% 3219 ± 11% softirqs.CPU43.SCHED 0.00 -100.0% 0.00 softirqs.CPU43.TASKLET 244.80 ± 36% +94.3% 475.67 ± 71% softirqs.CPU43.TIMER 12.40 ±200% -46.2% 6.67 ±141% softirqs.CPU44.BLOCK 1874 ± 16% +23.8% 2319 ± 9% softirqs.CPU44.RCU 2901 ± 5% -3.1% 2811 ± 3% softirqs.CPU44.SCHED 267.20 ± 52% +84.8% 493.67 ± 94% softirqs.CPU44.TIMER 38.60 ±196% -56.0% 17.00 ± 71% softirqs.CPU45.BLOCK 1791 ± 3% +28.8% 2307 ± 3% softirqs.CPU45.RCU 3169 ± 4% -11.0% 2820 ± 3% softirqs.CPU45.SCHED 0.00 -100.0% 0.00 softirqs.CPU45.TASKLET 189.80 ± 57% -64.2% 68.00 ± 14% softirqs.CPU45.TIMER 6.40 ±200% +124.0% 14.33 ±141% softirqs.CPU46.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU46.NET_RX 1904 ± 9% +23.7% 2355 softirqs.CPU46.RCU 3032 ± 5% -6.1% 2846 ± 8% softirqs.CPU46.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU46.TASKLET 167.60 ± 35% -10.9% 149.33 ± 10% softirqs.CPU46.TIMER 14.00 ± 94% +40.5% 19.67 ± 60% softirqs.CPU47.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU47.NET_RX 2091 ± 16% +11.2% 2325 ± 5% softirqs.CPU47.RCU 2418 ± 11% +16.3% 2812 ± 11% softirqs.CPU47.SCHED 223.60 ± 20% +441.4% 1210 ± 53% softirqs.CPU47.TIMER 200.00 ± 27% -36.8% 126.33 ± 84% softirqs.CPU48.BLOCK 2.00 +0.0% 2.00 softirqs.CPU48.NET_RX 0.40 ±122% -100.0% 0.00 softirqs.CPU48.NET_TX 2589 ± 5% -2.5% 2525 softirqs.CPU48.RCU 2756 ± 13% -0.6% 2739 ± 12% softirqs.CPU48.SCHED 0.20 ±200% +233.3% 0.67 ±141% softirqs.CPU48.TASKLET 174.60 ± 43% -18.1% 143.00 ± 25% softirqs.CPU48.TIMER 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU49.BLOCK 2.00 +0.0% 2.00 softirqs.CPU49.NET_RX 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU49.NET_TX 2523 ± 13% +5.7% 2666 softirqs.CPU49.RCU 2975 ± 13% -10.7% 2656 ± 3% softirqs.CPU49.SCHED 0.00 +6.7e+102% 6.67 ±141% softirqs.CPU49.TASKLET 222.00 ± 42% -51.1% 108.67 ± 25% softirqs.CPU49.TIMER 0.00 +4e+102% 4.00 ±141% softirqs.CPU5.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU5.NET_RX 2125 ± 7% +39.4% 2962 softirqs.CPU5.RCU 3090 ± 4% -6.0% 2904 ± 4% softirqs.CPU5.SCHED 192.20 ± 48% -48.8% 98.33 ± 47% softirqs.CPU5.TIMER 5.20 ±123% -23.1% 4.00 ±141% softirqs.CPU50.BLOCK 2.00 +0.0% 2.00 softirqs.CPU50.NET_RX 2040 ± 15% +64.5% 3355 ± 17% softirqs.CPU50.RCU 3347 ± 18% -6.4% 3132 ± 9% softirqs.CPU50.SCHED 655.80 ± 81% -76.0% 157.67 ± 58% softirqs.CPU50.TIMER 2.00 +0.0% 2.00 softirqs.CPU51.NET_RX 0.20 ±200% -100.0% 0.00 softirqs.CPU51.NET_TX 2047 ± 6% +38.9% 2842 ± 6% softirqs.CPU51.RCU 3110 ± 7% -4.0% 2987 ± 5% softirqs.CPU51.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU51.TASKLET 211.20 ± 40% -12.2% 185.33 ± 83% softirqs.CPU51.TIMER 2.60 ±200% -100.0% 0.00 softirqs.CPU52.BLOCK 2.00 +0.0% 2.00 softirqs.CPU52.NET_RX 1919 ± 10% +43.9% 2762 ± 15% softirqs.CPU52.RCU 2986 ± 8% +9.9% 3282 ± 22% softirqs.CPU52.SCHED 354.40 ± 68% +31.5% 466.00 ±114% softirqs.CPU52.TIMER 0.00 +4.7e+102% 4.67 ±141% softirqs.CPU53.BLOCK 2.00 +0.0% 2.00 softirqs.CPU53.NET_RX 2139 ± 20% +18.9% 2544 softirqs.CPU53.RCU 3264 ± 12% -9.9% 2942 ± 11% softirqs.CPU53.SCHED 350.80 ±123% -72.0% 98.33 ± 46% softirqs.CPU53.TIMER 2.20 ± 18% -9.1% 2.00 softirqs.CPU54.NET_RX 0.00 -100.0% 0.00 softirqs.CPU54.NET_TX 1920 ± 13% +44.9% 2783 ± 13% softirqs.CPU54.RCU 2970 ± 6% -4.8% 2828 ± 4% softirqs.CPU54.SCHED 145.80 ± 25% -16.8% 121.33 ± 35% softirqs.CPU54.TIMER 2.40 ±200% -100.0% 0.00 softirqs.CPU55.BLOCK 2.20 ± 18% -9.1% 2.00 softirqs.CPU55.NET_RX 1727 ± 5% +55.4% 2683 ± 11% softirqs.CPU55.RCU 2990 ± 8% -1.4% 2948 ± 9% softirqs.CPU55.SCHED 3.00 ±200% -88.9% 0.33 ±141% softirqs.CPU55.TASKLET 182.60 ± 44% -25.3% 136.33 ± 19% softirqs.CPU55.TIMER 4.00 ±200% -100.0% 0.00 softirqs.CPU56.BLOCK 0.60 ±200% -100.0% 0.00 softirqs.CPU56.NET_TX 1653 ± 2% +51.7% 2509 ± 3% softirqs.CPU56.RCU 3105 ± 10% -4.7% 2961 ± 11% softirqs.CPU56.SCHED 1.20 ±200% -100.0% 0.00 softirqs.CPU56.TASKLET 406.00 ±135% -67.2% 133.00 ± 65% softirqs.CPU56.TIMER 4.00 ±126% +50.0% 6.00 ±141% softirqs.CPU57.BLOCK 2.00 +0.0% 2.00 softirqs.CPU57.NET_RX 0.20 ±200% -100.0% 0.00 softirqs.CPU57.NET_TX 1907 ± 9% +27.4% 2429 softirqs.CPU57.RCU 3110 ± 14% -4.8% 2962 ± 9% softirqs.CPU57.SCHED 195.80 ± 27% +315.4% 813.33 ± 66% softirqs.CPU57.TIMER 4.80 ±200% -44.4% 2.67 ± 93% softirqs.CPU58.BLOCK 2.00 +0.0% 2.00 softirqs.CPU58.NET_RX 2147 ± 25% +15.5% 2479 ± 6% softirqs.CPU58.RCU 3032 ± 7% -0.1% 3029 ± 8% softirqs.CPU58.SCHED 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU58.TASKLET 168.80 ± 46% +9.6% 185.00 ± 78% softirqs.CPU58.TIMER 3.20 ±122% -68.8% 1.00 ±141% softirqs.CPU59.BLOCK 2.00 +0.0% 2.00 softirqs.CPU59.NET_RX 1792 ± 13% +36.2% 2441 ± 2% softirqs.CPU59.RCU 3260 ± 12% -6.0% 3066 ± 5% softirqs.CPU59.SCHED 174.40 ± 40% -58.9% 71.67 ± 5% softirqs.CPU59.TIMER 0.00 -100.0% 0.00 softirqs.CPU6.BLOCK 0.00 -100.0% 0.00 softirqs.CPU6.NET_RX 2032 ± 5% +61.6% 3285 ± 11% softirqs.CPU6.RCU 3021 ± 15% -8.7% 2757 ± 6% softirqs.CPU6.SCHED 200.20 ± 42% +1.2% 202.67 ± 53% softirqs.CPU6.TIMER 10.80 ±115% -25.9% 8.00 ±106% softirqs.CPU60.BLOCK 2.00 +0.0% 2.00 softirqs.CPU60.NET_RX 1699 ± 4% +42.9% 2428 ± 5% softirqs.CPU60.RCU 3005 ± 8% -5.6% 2835 ± 10% softirqs.CPU60.SCHED 244.80 ± 57% +7.7% 263.67 ± 61% softirqs.CPU60.TIMER 2.80 ±200% -4.8% 2.67 ±141% softirqs.CPU61.BLOCK 2.20 ± 18% -9.1% 2.00 softirqs.CPU61.NET_RX 1950 ± 27% +20.5% 2351 ± 4% softirqs.CPU61.RCU 2924 ± 12% -5.4% 2765 ± 9% softirqs.CPU61.SCHED 137.00 ± 44% +36.3% 186.67 ± 57% softirqs.CPU61.TIMER 8.40 ±122% -44.4% 4.67 ±141% softirqs.CPU62.BLOCK 2.00 +0.0% 2.00 softirqs.CPU62.NET_RX 1741 ± 10% +45.0% 2525 ± 11% softirqs.CPU62.RCU 3140 ± 9% -10.6% 2808 ± 7% softirqs.CPU62.SCHED 223.60 ± 45% -73.2% 60.00 ± 10% softirqs.CPU62.TIMER 2.40 ±200% +11.1% 2.67 ± 93% softirqs.CPU63.BLOCK 2.00 +0.0% 2.00 softirqs.CPU63.NET_RX 1675 ± 8% +36.1% 2279 ± 9% softirqs.CPU63.RCU 2856 ± 10% +3.7% 2963 ± 6% softirqs.CPU63.SCHED 210.40 ± 16% +0.6% 211.67 ± 36% softirqs.CPU63.TIMER 1.20 ±200% -44.4% 0.67 ±141% softirqs.CPU64.BLOCK 2.20 ± 18% -9.1% 2.00 softirqs.CPU64.NET_RX 1805 ± 4% +31.3% 2371 ± 2% softirqs.CPU64.RCU 3093 ± 11% -10.2% 2776 ± 9% softirqs.CPU64.SCHED 215.00 ± 32% +49.6% 321.67 ± 96% softirqs.CPU64.TIMER 0.00 -100.0% 0.00 softirqs.CPU65.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU65.NET_RX 11.40 ± 4% -3.5% 11.00 softirqs.CPU65.NET_TX 1753 ± 3% +47.7% 2590 ± 5% softirqs.CPU65.RCU 3098 ± 3% -9.8% 2793 ± 9% softirqs.CPU65.SCHED 0.00 -100.0% 0.00 softirqs.CPU65.TASKLET 183.60 ± 25% -30.6% 127.33 ± 55% softirqs.CPU65.TIMER 2.40 ±200% +52.8% 3.67 ±141% softirqs.CPU66.BLOCK 626.40 ±155% -88.6% 71.67 ± 7% softirqs.CPU66.NET_RX 2.20 ± 34% +6.1% 2.33 ± 53% softirqs.CPU66.NET_TX 1796 ± 11% +26.2% 2267 softirqs.CPU66.RCU 3364 ± 11% -12.6% 2940 ± 5% softirqs.CPU66.SCHED 373.20 ± 70% +24.5% 464.67 ±122% softirqs.CPU66.TIMER 888.80 ±176% -91.4% 76.67 ± 43% softirqs.CPU67.NET_RX 3.20 ± 75% -37.5% 2.00 ± 40% softirqs.CPU67.NET_TX 1714 ± 5% +40.1% 2403 ± 3% softirqs.CPU67.RCU 3384 ± 15% -13.5% 2929 ± 8% softirqs.CPU67.SCHED 0.60 ±133% -44.4% 0.33 ±141% softirqs.CPU67.TASKLET 250.80 ± 31% -60.7% 98.67 ± 22% softirqs.CPU67.TIMER 0.40 ±122% -100.0% 0.00 softirqs.CPU68.BLOCK 1869 ±189% -92.4% 142.67 ± 94% softirqs.CPU68.NET_RX 4.00 ± 57% -75.0% 1.00 ± 81% softirqs.CPU68.NET_TX 1894 ± 17% +33.3% 2525 ± 5% softirqs.CPU68.RCU 3332 ± 18% -12.4% 2919 ± 6% softirqs.CPU68.SCHED 0.40 ±122% -100.0% 0.00 softirqs.CPU68.TASKLET 301.20 ± 33% -57.6% 127.67 ± 26% softirqs.CPU68.TIMER 253.80 ±119% -46.3% 136.33 ± 39% softirqs.CPU69.NET_RX 1.40 ± 34% +66.7% 2.33 ± 72% softirqs.CPU69.NET_TX 1771 ± 8% +42.2% 2519 ± 3% softirqs.CPU69.RCU 2996 ± 4% -4.4% 2865 ± 13% softirqs.CPU69.SCHED 0.20 ±200% +66.7% 0.33 ±141% softirqs.CPU69.TASKLET 244.40 ± 85% -65.5% 84.33 ± 25% softirqs.CPU69.TIMER 0.00 -100.0% 0.00 softirqs.CPU7.NET_RX 0.20 ±200% -100.0% 0.00 softirqs.CPU7.NET_TX 2008 ± 5% +41.3% 2837 softirqs.CPU7.RCU 3187 ± 11% -8.5% 2915 ± 7% softirqs.CPU7.SCHED 158.00 ± 34% -26.6% 116.00 ± 37% softirqs.CPU7.TIMER 9.20 ±127% -96.4% 0.33 ±141% softirqs.CPU70.BLOCK 288.00 ±153% +22.5% 352.67 ±108% softirqs.CPU70.NET_RX 2.40 ± 72% -2.8% 2.33 ± 20% softirqs.CPU70.NET_TX 1653 ± 5% +49.9% 2478 ± 7% softirqs.CPU70.RCU 3002 ± 8% -3.7% 2890 ± 6% softirqs.CPU70.SCHED 165.20 ± 41% +79.6% 296.67 ± 66% softirqs.CPU70.TIMER 4.00 ±200% +0.0% 4.00 ±141% softirqs.CPU71.BLOCK 220.40 ±104% +338.1% 965.67 ± 98% softirqs.CPU71.NET_RX 1.80 ± 22% -25.9% 1.33 ± 35% softirqs.CPU71.NET_TX 1855 ± 7% +38.4% 2567 ± 6% softirqs.CPU71.RCU 3131 ± 8% -4.9% 2978 ± 17% softirqs.CPU71.SCHED 0.20 ±200% +66.7% 0.33 ±141% softirqs.CPU71.TASKLET 230.80 ± 60% -34.9% 150.33 ± 40% softirqs.CPU71.TIMER 0.40 ±200% +2900.0% 12.00 ±118% softirqs.CPU72.BLOCK 2357 ± 2% +17.0% 2759 ± 5% softirqs.CPU72.RCU 2871 ± 4% -7.3% 2662 ± 4% softirqs.CPU72.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU72.TASKLET 224.40 ± 40% -65.2% 78.00 ± 16% softirqs.CPU72.TIMER 33.00 ± 92% -100.0% 0.00 softirqs.CPU73.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU73.NET_RX 2368 ± 11% +7.6% 2549 ± 5% softirqs.CPU73.RCU 3173 ± 15% -25.7% 2357 ± 12% softirqs.CPU73.SCHED 573.40 ± 90% -41.9% 333.00 ±105% softirqs.CPU73.TIMER 13.20 ±178% +124.7% 29.67 ±141% softirqs.CPU74.BLOCK 0.20 ±200% +66.7% 0.33 ±141% softirqs.CPU74.NET_RX 1894 ± 9% +28.9% 2441 ± 6% softirqs.CPU74.RCU 3186 ± 7% -12.2% 2796 ± 9% softirqs.CPU74.SCHED 0.00 -100.0% 0.00 softirqs.CPU74.TASKLET 476.80 ± 36% -73.4% 127.00 ± 71% softirqs.CPU74.TIMER 0.80 ±145% -100.0% 0.00 softirqs.CPU75.BLOCK 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU75.NET_RX 1743 ± 8% +32.8% 2315 ± 6% softirqs.CPU75.RCU 3105 ± 8% -12.9% 2704 ± 10% softirqs.CPU75.SCHED 235.80 ± 82% -49.4% 119.33 ± 34% softirqs.CPU75.TIMER 0.20 ±200% +11733.3% 23.67 ±135% softirqs.CPU76.BLOCK 0.00 -100.0% 0.00 softirqs.CPU76.NET_TX 1642 ± 7% +38.9% 2281 softirqs.CPU76.RCU 3063 ± 6% -0.9% 3037 ± 6% softirqs.CPU76.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU76.TASKLET 268.00 ± 41% -58.2% 112.00 ± 64% softirqs.CPU76.TIMER 5.80 ±200% +256.3% 20.67 ±141% softirqs.CPU77.BLOCK 0.00 +1.7e+102% 1.67 ±141% softirqs.CPU77.NET_TX 1683 ± 14% +43.9% 2423 ± 13% softirqs.CPU77.RCU 3018 ± 5% +0.7% 3038 ± 16% softirqs.CPU77.SCHED 262.00 ± 21% +159.7% 680.33 ± 83% softirqs.CPU77.TIMER 8.20 ±135% +13.8% 9.33 ±126% softirqs.CPU78.BLOCK 1682 ± 3% +38.6% 2331 ± 5% softirqs.CPU78.RCU 3179 ± 6% -12.7% 2774 ± 4% softirqs.CPU78.SCHED 199.20 ± 18% -7.1% 185.00 ± 78% softirqs.CPU78.TIMER 0.00 +6.7e+101% 0.67 ±141% softirqs.CPU79.NET_RX 1916 ± 13% +76.9% 3390 ± 49% softirqs.CPU79.RCU 3214 ± 5% -12.1% 2826 ± 6% softirqs.CPU79.SCHED 412.20 ± 61% +15.2% 475.00 ± 90% softirqs.CPU79.TIMER 2.80 ±200% -100.0% 0.00 softirqs.CPU8.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU8.NET_TX 2195 ± 17% +28.2% 2814 ± 2% softirqs.CPU8.RCU 2970 ± 12% -1.5% 2926 ± 8% softirqs.CPU8.SCHED 231.00 ± 79% -54.3% 105.67 ± 58% softirqs.CPU8.TIMER 1.80 ±101% -63.0% 0.67 ±141% softirqs.CPU80.BLOCK 1758 ± 8% +38.3% 2432 ± 8% softirqs.CPU80.RCU 2985 ± 5% +0.9% 3013 ± 7% softirqs.CPU80.SCHED 0.20 ±200% +66.7% 0.33 ±141% softirqs.CPU80.TASKLET 141.00 ± 45% -15.4% 119.33 ± 35% softirqs.CPU80.TIMER 15.00 ±186% -100.0% 0.00 softirqs.CPU81.BLOCK 1613 ± 11% +27.7% 2061 ± 4% softirqs.CPU81.RCU 3086 ± 10% -8.8% 2814 ± 2% softirqs.CPU81.SCHED 0.40 ±200% -100.0% 0.00 softirqs.CPU81.TASKLET 183.80 ± 19% +41.1% 259.33 ± 46% softirqs.CPU81.TIMER 27.60 ±131% -100.0% 0.00 softirqs.CPU82.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU82.NET_RX 1709 ± 11% +24.7% 2131 ± 3% softirqs.CPU82.RCU 3088 ± 17% -9.0% 2811 ± 4% softirqs.CPU82.SCHED 0.00 -100.0% 0.00 softirqs.CPU82.TASKLET 280.00 ± 54% -35.2% 181.33 ± 94% softirqs.CPU82.TIMER 23.60 ±200% -100.0% 0.00 softirqs.CPU83.BLOCK 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU83.NET_RX 1630 ± 7% +30.6% 2129 ± 2% softirqs.CPU83.RCU 3095 ± 12% -1.7% 3042 ± 2% softirqs.CPU83.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU83.TASKLET 271.60 ± 17% -52.7% 128.33 ± 39% softirqs.CPU83.TIMER 7.20 ±173% +29.6% 9.33 ±141% softirqs.CPU84.BLOCK 1656 ± 6% +34.5% 2228 softirqs.CPU84.RCU 3178 ± 11% -2.0% 3114 ± 3% softirqs.CPU84.SCHED 338.80 ± 58% -60.1% 135.33 ± 51% softirqs.CPU84.TIMER 6.80 ±185% +61.8% 11.00 ±141% softirqs.CPU85.BLOCK 1670 ± 6% +24.5% 2080 ± 2% softirqs.CPU85.RCU 3047 ± 7% -2.4% 2976 softirqs.CPU85.SCHED 233.00 ± 48% -73.1% 62.67 ± 10% softirqs.CPU85.TIMER 1544 ± 9% +30.1% 2009 softirqs.CPU86.RCU 2992 ± 9% -8.6% 2735 ± 2% softirqs.CPU86.SCHED 175.80 ± 20% +155.2% 448.67 ± 71% softirqs.CPU86.TIMER 0.40 ±200% -100.0% 0.00 softirqs.CPU87.BLOCK 0.20 ±200% -100.0% 0.00 softirqs.CPU87.NET_RX 1542 ± 8% +57.1% 2423 ± 6% softirqs.CPU87.RCU 2941 ± 7% -5.5% 2780 ± 10% softirqs.CPU87.SCHED 111.80 ± 28% +36.3% 152.33 ± 44% softirqs.CPU87.TIMER 0.20 ±200% -100.0% 0.00 softirqs.CPU88.NET_RX 0.00 -100.0% 0.00 softirqs.CPU88.NET_TX 1601 ± 12% +38.6% 2220 ± 6% softirqs.CPU88.RCU 3040 ± 5% -7.1% 2825 ± 7% softirqs.CPU88.SCHED 200.20 ± 28% -52.0% 96.00 ± 44% softirqs.CPU88.TIMER 0.00 +6.7e+101% 0.67 ±141% softirqs.CPU89.BLOCK 1707 ± 17% +35.8% 2317 ± 18% softirqs.CPU89.RCU 3045 ± 6% -6.8% 2837 ± 2% softirqs.CPU89.SCHED 0.20 ±200% -100.0% 0.00 softirqs.CPU89.TASKLET 297.00 ± 88% -53.9% 137.00 ± 81% softirqs.CPU89.TIMER 2.80 ±200% -76.2% 0.67 ±141% softirqs.CPU9.BLOCK 2193 ± 11% +26.7% 2778 ± 3% softirqs.CPU9.RCU 3206 ± 12% -15.5% 2708 ± 8% softirqs.CPU9.SCHED 198.20 ± 54% -49.0% 101.00 ± 31% softirqs.CPU9.TIMER 0.20 ±200% +11066.7% 22.33 ±125% softirqs.CPU90.BLOCK 0.00 +3.3e+101% 0.33 ±141% softirqs.CPU90.NET_RX 0.00 -100.0% 0.00 softirqs.CPU90.NET_TX 1480 ± 4% +41.7% 2097 ± 3% softirqs.CPU90.RCU 2937 ± 6% +6.5% 3128 ± 6% softirqs.CPU90.SCHED 262.20 ± 76% -15.2% 222.33 ± 68% softirqs.CPU90.TIMER 0.00 +8.7e+102% 8.67 ±141% softirqs.CPU91.BLOCK 0.00 -100.0% 0.00 softirqs.CPU91.NET_RX 1690 ± 10% +21.8% 2058 softirqs.CPU91.RCU 3135 ± 5% -7.1% 2912 ± 5% softirqs.CPU91.SCHED 0.00 +1.7e+102% 1.67 ±141% softirqs.CPU91.TASKLET 187.40 ± 40% +94.2% 364.00 ±104% softirqs.CPU91.TIMER 0.00 -100.0% 0.00 softirqs.CPU92.NET_TX 1622 ± 7% +27.6% 2069 ± 6% softirqs.CPU92.RCU 3153 ± 4% -9.8% 2845 ± 4% softirqs.CPU92.SCHED 0.00 +6.3e+102% 6.33 ±141% softirqs.CPU92.TASKLET 221.60 ± 48% +42.6% 316.00 ± 99% softirqs.CPU92.TIMER 0.80 ±122% -100.0% 0.00 softirqs.CPU93.BLOCK 1557 ± 6% +32.2% 2058 ± 2% softirqs.CPU93.RCU 3096 -12.8% 2700 ± 5% softirqs.CPU93.SCHED 0.00 -100.0% 0.00 softirqs.CPU93.TASKLET 162.40 ± 22% -63.3% 59.67 ± 14% softirqs.CPU93.TIMER 8.40 ±188% -96.0% 0.33 ±141% softirqs.CPU94.BLOCK 1528 ± 8% +32.8% 2029 ± 3% softirqs.CPU94.RCU 3050 ± 8% -6.5% 2851 ± 7% softirqs.CPU94.SCHED 242.80 ± 39% -37.0% 153.00 ± 36% softirqs.CPU94.TIMER 0.40 ±200% +5066.7% 20.67 ±141% softirqs.CPU95.BLOCK 2161 ± 24% +25.3% 2707 ± 8% softirqs.CPU95.RCU 3117 ± 13% -9.3% 2825 ± 2% softirqs.CPU95.SCHED 0.00 -100.0% 0.00 softirqs.CPU95.TASKLET 229.40 ± 28% -5.0% 218.00 ± 70% softirqs.CPU95.TIMER 2.00 +0.0% 2.00 softirqs.HI 4358 ± 73% -27.2% 3170 ± 66% softirqs.NET_RX 36.60 ± 6% -4.4% 35.00 ± 4% softirqs.NET_TX 191572 ± 4% +31.8% 252582 softirqs.RCU 296266 -5.5% 280002 softirqs.SCHED 235.60 ± 7% -5.3% 223.00 softirqs.TASKLET 25759 -4.7% 24556 softirqs.TIMER 0.00 -100.0% 0.00 interrupts.0:IO-APIC.2-edge.timer 0.00 -100.0% 0.00 interrupts.31:PCI-MSI.48791552-edge.PCIe.PME,pciehp 0.00 -100.0% 0.00 interrupts.32:PCI-MSI.48807936-edge.PCIe.PME,pciehp 0.00 -100.0% 0.00 interrupts.342:PCI-MSI.327680-edge.xhci_hcd 0.00 -100.0% 0.00 interrupts.344:PCI-MSI.65536-edge.ioat-msix 0.00 +1.8e+103% 17.67 ±141% interrupts.345:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.345:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.345:PCI-MSI.69206016-edge.nvme1q0 0.00 +2.3e+103% 23.33 ±141% interrupts.346:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.346:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.346:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.346:PCI-MSI.69206016-edge.nvme1q0 35.00 ± 81% -100.0% 0.00 interrupts.347:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.347:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.347:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.347:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.348:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.348:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.348:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.348:PCI-MSI.71680-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.349:PCI-MSI.73728-edge.ioat-msix 10.80 ±200% +63.6% 17.67 ±141% interrupts.350:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.350:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.350:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.350:PCI-MSI.75776-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.351:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.351:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.351:PCI-MSI.71680-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.352:PCI-MSI.73728-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.352:PCI-MSI.77824-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.353:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.353:PCI-MSI.75776-edge.ioat-msix 12.20 ±200% -100.0% 0.00 interrupts.354:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.354:PCI-MSI.77824-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.355:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.355:PCI-MSI.79872-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.356:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.356:PCI-MSI.79872-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.357:PCI-MSI.67174400-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.358:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.358:PCI-MSI.67174400-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.359:PCI-MSI.67176448-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.360:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.360:PCI-MSI.67176448-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.360:PCI-MSI.67178496-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.361:PCI-MSI.67178496-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.361:PCI-MSI.67180544-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.362:PCI-MSI.67180544-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.362:PCI-MSI.67182592-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.363:PCI-MSI.67182592-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.363:PCI-MSI.67184640-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.364:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.364:PCI-MSI.67184640-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.364:PCI-MSI.67186688-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.365:PCI-MSI.67186688-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.365:PCI-MSI.67188736-edge.ioat-msix 2.00 ±200% -100.0% 0.00 interrupts.366:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.366:PCI-MSI.67188736-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.367:PCI-MSI.68681729-edge.nvme0q1 0.00 -100.0% 0.00 interrupts.367:PCI-MSI.69206017-edge.nvme1q1 0.00 -100.0% 0.00 interrupts.371:PCI-MSI.69206021-edge.nvme1q5 0.00 -100.0% 0.00 interrupts.372:PCI-MSI.69206022-edge.nvme1q6 0.00 -100.0% 0.00 interrupts.373:PCI-MSI.68681735-edge.nvme0q7 0.00 -100.0% 0.00 interrupts.374:PCI-MSI.69206024-edge.nvme1q8 0.00 -100.0% 0.00 interrupts.375:PCI-MSI.69206025-edge.nvme1q9 0.00 -100.0% 0.00 interrupts.376:PCI-MSI.68681733-edge.nvme0q5 0.00 -100.0% 0.00 interrupts.376:PCI-MSI.68681738-edge.nvme0q10 0.00 -100.0% 0.00 interrupts.378:PCI-MSI.68681740-edge.nvme0q12 0.00 -100.0% 0.00 interrupts.378:PCI-MSI.69206028-edge.nvme1q12 0.00 -100.0% 0.00 interrupts.379:PCI-MSI.69206029-edge.nvme1q13 0.00 -100.0% 0.00 interrupts.381:PCI-MSI.69206031-edge.nvme1q15 0.00 -100.0% 0.00 interrupts.384:PCI-MSI.68681746-edge.nvme0q18 0.00 -100.0% 0.00 interrupts.385:PCI-MSI.69206035-edge.nvme1q19 0.00 -100.0% 0.00 interrupts.387:PCI-MSI.69206027-edge.nvme1q11 0.00 -100.0% 0.00 interrupts.389:PCI-MSI.69206028-edge.nvme1q12 0.00 -100.0% 0.00 interrupts.390:PCI-MSI.69206040-edge.nvme1q24 0.00 -100.0% 0.00 interrupts.391:PCI-MSI.69206041-edge.nvme1q25 0.00 -100.0% 0.00 interrupts.392:PCI-MSI.69206042-edge.nvme1q26 0.00 -100.0% 0.00 interrupts.398:PCI-MSI.68681729-edge.nvme0q1 0.00 -100.0% 0.00 interrupts.398:PCI-MSI.69206017-edge.nvme1q1 0.00 -100.0% 0.00 interrupts.399:PCI-MSI.68681730-edge.nvme0q2 0.00 -100.0% 0.00 interrupts.399:PCI-MSI.69206018-edge.nvme1q2 0.00 -100.0% 0.00 interrupts.3:IO-APIC.3-edge 0.00 -100.0% 0.00 interrupts.401:PCI-MSI.68681732-edge.nvme0q4 0.00 -100.0% 0.00 interrupts.403:PCI-MSI.68681734-edge.nvme0q6 0.00 -100.0% 0.00 interrupts.404:PCI-MSI.68681735-edge.nvme0q7 0.00 -100.0% 0.00 interrupts.405:PCI-MSI.68681736-edge.nvme0q8 0.00 -100.0% 0.00 interrupts.406:PCI-MSI.68681737-edge.nvme0q9 0.00 -100.0% 0.00 interrupts.407:PCI-MSI.69206026-edge.nvme1q10 0.00 -100.0% 0.00 interrupts.409:PCI-MSI.69206028-edge.nvme1q12 0.00 -100.0% 0.00 interrupts.411:PCI-MSI.68681742-edge.nvme0q14 0.00 -100.0% 0.00 interrupts.412:PCI-MSI.68681751-edge.nvme0q23 0.00 -100.0% 0.00 interrupts.413:PCI-MSI.68681744-edge.nvme0q16 0.00 -100.0% 0.00 interrupts.414:PCI-MSI.68681745-edge.nvme0q17 0.00 -100.0% 0.00 interrupts.415:PCI-MSI.69206034-edge.nvme1q18 0.00 -100.0% 0.00 interrupts.418:PCI-MSI.68681749-edge.nvme0q21 0.00 -100.0% 0.00 interrupts.41:PCI-MSI.112721920-edge.PCIe.PME,pciehp 0.00 -100.0% 0.00 interrupts.42:PCI-MSI.112738304-edge.PCIe.PME,pciehp 0.00 -100.0% 0.00 interrupts.45:PCI-MSI.12582913-edge 0.00 -100.0% 0.00 interrupts.46:PCI-MSI.12582914-edge 0.00 -100.0% 0.00 interrupts.47:PCI-MSI.12582915-edge 0.00 -100.0% 0.00 interrupts.48:PCI-MSI.12582916-edge 0.00 -100.0% 0.00 interrupts.49:PCI-MSI.12582917-edge 0.00 -100.0% 0.00 interrupts.4:IO-APIC.4-edge.ttyS0 0.00 -100.0% 0.00 interrupts.50:PCI-MSI.12582918-edge 0.00 -100.0% 0.00 interrupts.51:PCI-MSI.12582919-edge 0.00 -100.0% 0.00 interrupts.52:PCI-MSI.12582920-edge 0.00 -100.0% 0.00 interrupts.55:PCI-MSI.12584961-edge 0.00 -100.0% 0.00 interrupts.56:PCI-MSI.12584962-edge 0.00 -100.0% 0.00 interrupts.57:PCI-MSI.12584963-edge 0.00 -100.0% 0.00 interrupts.58:PCI-MSI.12584964-edge 0.00 -100.0% 0.00 interrupts.59:PCI-MSI.12584965-edge 0.00 -100.0% 0.00 interrupts.60:PCI-MSI.12584966-edge 0.00 -100.0% 0.00 interrupts.61:PCI-MSI.12584967-edge 0.00 -100.0% 0.00 interrupts.62:PCI-MSI.12584968-edge 0.00 -100.0% 0.00 interrupts.65:PCI-MSI.12587009-edge 0.00 -100.0% 0.00 interrupts.66:PCI-MSI.12587010-edge 0.00 -100.0% 0.00 interrupts.67:PCI-MSI.12587011-edge 0.00 -100.0% 0.00 interrupts.68:PCI-MSI.12587012-edge 0.00 -100.0% 0.00 interrupts.69:PCI-MSI.12587013-edge 0.00 -100.0% 0.00 interrupts.70:PCI-MSI.12587014-edge 0.00 -100.0% 0.00 interrupts.71:PCI-MSI.12587015-edge 0.00 -100.0% 0.00 interrupts.72:PCI-MSI.12587016-edge 0.00 -100.0% 0.00 interrupts.74:PCI-MSI.12589056-edge.eth3 1189 ±161% -91.2% 104.33 ± 10% interrupts.75:PCI-MSI.12589057-edge.eth3-TxRx-0 1628 ±187% -94.1% 96.33 ± 24% interrupts.76:PCI-MSI.12589058-edge.eth3-TxRx-1 3389 ±194% -93.4% 223.00 ± 95% interrupts.77:PCI-MSI.12589059-edge.eth3-TxRx-2 432.80 ±120% -74.7% 109.67 ± 18% interrupts.78:PCI-MSI.12589060-edge.eth3-TxRx-3 502.60 ±167% +21.2% 609.00 ±120% interrupts.79:PCI-MSI.12589061-edge.eth3-TxRx-4 241.60 ± 72% +662.3% 1841 ±100% interrupts.80:PCI-MSI.12589062-edge.eth3-TxRx-5 125.20 ± 40% +12.9% 141.33 ± 63% interrupts.81:PCI-MSI.12589063-edge.eth3-TxRx-6 67.00 ± 12% +3288.6% 2270 ±112% interrupts.82:PCI-MSI.12589064-edge.eth3-TxRx-7 0.00 -100.0% 0.00 interrupts.8:IO-APIC.8-edge.rtc0 117914 ± 41% -49.0% 60118 ± 42% interrupts.CAL:Function_call_interrupts 0.00 -100.0% 0.00 interrupts.CPU0.0:IO-APIC.2-edge.timer 125.20 ± 40% +12.9% 141.33 ± 63% interrupts.CPU0.81:PCI-MSI.12589063-edge.eth3-TxRx-6 1743 ± 16% -25.7% 1295 ± 16% interrupts.CPU0.CAL:Function_call_interrupts 45.20 ± 69% -20.4% 36.00 ± 21% interrupts.CPU0.IWI:IRQ_work_interrupts 107476 -1.3% 106067 interrupts.CPU0.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU0.MCP:Machine_check_polls 35344 ± 7% +18.3% 41811 interrupts.CPU0.NMI:Non-maskable_interrupts 35344 ± 7% +18.3% 41811 interrupts.CPU0.PMI:Performance_monitoring_interrupts 87.80 ± 35% -10.0% 79.00 ± 19% interrupts.CPU0.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.CPU0.RTR:APIC_ICR_read_retries 82.80 ±190% -84.3% 13.00 ± 53% interrupts.CPU0.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU1.413:PCI-MSI.68681744-edge.nvme0q16 67.00 ± 12% +3288.6% 2270 ±112% interrupts.CPU1.82:PCI-MSI.12589064-edge.eth3-TxRx-7 2076 ± 58% -33.9% 1373 ± 40% interrupts.CPU1.CAL:Function_call_interrupts 45.00 ± 71% -38.5% 27.67 ± 17% interrupts.CPU1.IWI:IRQ_work_interrupts 107466 -1.9% 105397 interrupts.CPU1.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU1.MCP:Machine_check_polls 35451 ± 7% +15.4% 40916 interrupts.CPU1.NMI:Non-maskable_interrupts 35451 ± 7% +15.4% 40916 interrupts.CPU1.PMI:Performance_monitoring_interrupts 94.00 ± 32% +54.3% 145.00 ± 37% interrupts.CPU1.RES:Rescheduling_interrupts 0.20 ±200% +5900.0% 12.00 ±141% interrupts.CPU1.TLB:TLB_shootdowns 1229 ± 44% -52.1% 589.00 ± 49% interrupts.CPU10.CAL:Function_call_interrupts 64.40 ± 40% -61.7% 24.67 ± 30% interrupts.CPU10.IWI:IRQ_work_interrupts 104889 -0.5% 104324 interrupts.CPU10.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU10.MCP:Machine_check_polls 36270 ± 6% +9.8% 39825 ± 4% interrupts.CPU10.NMI:Non-maskable_interrupts 36270 ± 6% +9.8% 39825 ± 4% interrupts.CPU10.PMI:Performance_monitoring_interrupts 70.80 ± 40% -60.9% 27.67 ± 43% interrupts.CPU10.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.CPU10.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU11.342:PCI-MSI.327680-edge.xhci_hcd 0.00 -100.0% 0.00 interrupts.CPU11.418:PCI-MSI.68681749-edge.nvme0q21 1527 ± 64% -63.6% 555.67 ± 47% interrupts.CPU11.CAL:Function_call_interrupts 39.00 ± 43% -34.2% 25.67 ± 23% interrupts.CPU11.IWI:IRQ_work_interrupts 107139 -2.8% 104093 interrupts.CPU11.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU11.MCP:Machine_check_polls 34802 ± 5% +18.8% 41346 interrupts.CPU11.NMI:Non-maskable_interrupts 34802 ± 5% +18.8% 41346 interrupts.CPU11.PMI:Performance_monitoring_interrupts 79.20 ± 83% -40.7% 47.00 ± 49% interrupts.CPU11.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU11.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU12.8:IO-APIC.8-edge.rtc0 1199 ± 43% -54.4% 546.67 ± 47% interrupts.CPU12.CAL:Function_call_interrupts 38.20 ± 53% -38.9% 23.33 ± 8% interrupts.CPU12.IWI:IRQ_work_interrupts 105614 -1.0% 104543 interrupts.CPU12.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU12.MCP:Machine_check_polls 34818 ± 7% +19.5% 41623 interrupts.CPU12.NMI:Non-maskable_interrupts 34818 ± 7% +19.5% 41623 interrupts.CPU12.PMI:Performance_monitoring_interrupts 104.60 ± 45% -73.6% 27.67 ± 25% interrupts.CPU12.RES:Rescheduling_interrupts 0.40 ±200% +566.7% 2.67 ±141% interrupts.CPU12.TLB:TLB_shootdowns 1302 ± 22% -53.2% 609.33 ± 50% interrupts.CPU13.CAL:Function_call_interrupts 51.20 ± 51% -35.5% 33.00 ± 26% interrupts.CPU13.IWI:IRQ_work_interrupts 106875 -2.0% 104695 interrupts.CPU13.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU13.MCP:Machine_check_polls 34490 ± 6% +20.3% 41488 interrupts.CPU13.NMI:Non-maskable_interrupts 34490 ± 6% +20.3% 41488 interrupts.CPU13.PMI:Performance_monitoring_interrupts 78.40 ± 88% -49.4% 39.67 ± 45% interrupts.CPU13.RES:Rescheduling_interrupts 0.00 +6e+102% 6.00 ± 75% interrupts.CPU13.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU14.4:IO-APIC.4-edge.ttyS0 1167 ± 44% -52.9% 550.00 ± 47% interrupts.CPU14.CAL:Function_call_interrupts 54.40 ± 52% -42.4% 31.33 ± 33% interrupts.CPU14.IWI:IRQ_work_interrupts 106164 -2.2% 103815 interrupts.CPU14.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU14.MCP:Machine_check_polls 36638 ± 4% +12.8% 41325 interrupts.CPU14.NMI:Non-maskable_interrupts 36638 ± 4% +12.8% 41325 interrupts.CPU14.PMI:Performance_monitoring_interrupts 83.20 ± 37% -73.2% 22.33 ± 33% interrupts.CPU14.RES:Rescheduling_interrupts 0.60 ±200% -100.0% 0.00 interrupts.CPU14.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU15.344:PCI-MSI.65536-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU15.45:PCI-MSI.12582913-edge 1177 ± 39% -46.9% 624.67 ± 39% interrupts.CPU15.CAL:Function_call_interrupts 36.40 ± 42% -14.8% 31.00 ± 28% interrupts.CPU15.IWI:IRQ_work_interrupts 106322 -1.7% 104472 interrupts.CPU15.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU15.MCP:Machine_check_polls 35907 ± 6% +14.1% 40987 interrupts.CPU15.NMI:Non-maskable_interrupts 35907 ± 6% +14.1% 40987 interrupts.CPU15.PMI:Performance_monitoring_interrupts 156.00 ±116% -65.6% 53.67 ± 36% interrupts.CPU15.RES:Rescheduling_interrupts 0.00 +3.7e+102% 3.67 ±122% interrupts.CPU15.TLB:TLB_shootdowns 0.00 +1.8e+103% 17.67 ±141% interrupts.CPU16.345:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 +2.3e+103% 23.33 ±141% interrupts.CPU16.346:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU16.346:PCI-MSI.67584-edge.ioat-msix 10.80 ±200% -100.0% 0.00 interrupts.CPU16.347:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU16.348:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU16.46:PCI-MSI.12582914-edge 1154 ± 43% -50.1% 576.33 ± 48% interrupts.CPU16.CAL:Function_call_interrupts 52.60 ± 29% -41.7% 30.67 ± 20% interrupts.CPU16.IWI:IRQ_work_interrupts 106527 -2.4% 103960 interrupts.CPU16.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU16.MCP:Machine_check_polls 34764 ± 4% +18.5% 41185 interrupts.CPU16.NMI:Non-maskable_interrupts 34764 ± 4% +18.5% 41185 interrupts.CPU16.PMI:Performance_monitoring_interrupts 49.00 ± 57% +13.6% 55.67 ± 76% interrupts.CPU16.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU16.TLB:TLB_shootdowns 24.20 ±122% -100.0% 0.00 interrupts.CPU17.347:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU17.347:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU17.347:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU17.349:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU17.349:PCI-MSI.67584-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU17.47:PCI-MSI.12582915-edge 1182 ± 44% -48.9% 604.67 ± 42% interrupts.CPU17.CAL:Function_call_interrupts 39.60 ± 51% -31.0% 27.33 ± 32% interrupts.CPU17.IWI:IRQ_work_interrupts 106106 -2.2% 103754 interrupts.CPU17.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU17.MCP:Machine_check_polls 36370 ± 6% +13.2% 41168 interrupts.CPU17.NMI:Non-maskable_interrupts 36370 ± 6% +13.2% 41168 interrupts.CPU17.PMI:Performance_monitoring_interrupts 58.60 ± 44% +7.5% 63.00 ± 64% interrupts.CPU17.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.CPU17.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU18.348:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU18.348:PCI-MSI.71680-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU18.349:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU18.349:PCI-MSI.69632-edge.ioat-msix 10.80 ±200% -100.0% 0.00 interrupts.CPU18.350:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU18.350:PCI-MSI.69632-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU18.48:PCI-MSI.12582916-edge 1151 ± 43% -54.6% 522.67 ± 45% interrupts.CPU18.CAL:Function_call_interrupts 30.60 ± 54% -7.4% 28.33 ± 23% interrupts.CPU18.IWI:IRQ_work_interrupts 106264 -1.1% 105122 interrupts.CPU18.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU18.MCP:Machine_check_polls 37200 ± 6% +10.8% 41199 interrupts.CPU18.NMI:Non-maskable_interrupts 37200 ± 6% +10.8% 41199 interrupts.CPU18.PMI:Performance_monitoring_interrupts 69.80 ± 55% -44.1% 39.00 ± 56% interrupts.CPU18.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.CPU18.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU19.349:PCI-MSI.73728-edge.ioat-msix 0.00 +1.8e+103% 17.67 ±141% interrupts.CPU19.350:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU19.351:PCI-MSI.71680-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU19.49:PCI-MSI.12582917-edge 1144 ± 44% -50.8% 563.00 ± 47% interrupts.CPU19.CAL:Function_call_interrupts 39.60 ± 54% -19.2% 32.00 ± 26% interrupts.CPU19.IWI:IRQ_work_interrupts 105742 -1.7% 103955 interrupts.CPU19.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU19.MCP:Machine_check_polls 36162 ± 5% +13.9% 41201 interrupts.CPU19.NMI:Non-maskable_interrupts 36162 ± 5% +13.9% 41201 interrupts.CPU19.PMI:Performance_monitoring_interrupts 51.00 ± 43% -37.3% 32.00 ± 27% interrupts.CPU19.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU19.TLB:TLB_shootdowns 1594 ± 33% -49.0% 814.00 ± 8% interrupts.CPU2.CAL:Function_call_interrupts 58.40 ± 43% -48.6% 30.00 ± 37% interrupts.CPU2.IWI:IRQ_work_interrupts 105913 -0.9% 105004 interrupts.CPU2.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU2.MCP:Machine_check_polls 35248 ± 7% +14.0% 40194 ± 5% interrupts.CPU2.NMI:Non-maskable_interrupts 35248 ± 7% +14.0% 40194 ± 5% interrupts.CPU2.PMI:Performance_monitoring_interrupts 113.80 ± 36% -7.1% 105.67 ± 18% interrupts.CPU2.RES:Rescheduling_interrupts 1.60 ±200% +1150.0% 20.00 ± 74% interrupts.CPU2.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU20.350:PCI-MSI.75776-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU20.352:PCI-MSI.73728-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU20.50:PCI-MSI.12582918-edge 1213 ± 43% -54.0% 558.67 ± 46% interrupts.CPU20.CAL:Function_call_interrupts 20.40 ± 5% +47.1% 30.00 ± 7% interrupts.CPU20.IWI:IRQ_work_interrupts 104307 +0.4% 104744 interrupts.CPU20.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU20.MCP:Machine_check_polls 33299 ± 2% +24.7% 41519 interrupts.CPU20.NMI:Non-maskable_interrupts 33299 ± 2% +24.7% 41519 interrupts.CPU20.PMI:Performance_monitoring_interrupts 61.60 ± 32% -67.0% 20.33 ± 48% interrupts.CPU20.RES:Rescheduling_interrupts 0.00 +1e+102% 1.00 ±141% interrupts.CPU20.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU21.352:PCI-MSI.77824-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU21.353:PCI-MSI.75776-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU21.51:PCI-MSI.12582919-edge 1362 ± 53% -57.0% 586.00 ± 46% interrupts.CPU21.CAL:Function_call_interrupts 30.60 ± 51% -7.4% 28.33 ± 34% interrupts.CPU21.IWI:IRQ_work_interrupts 105105 ± 2% -0.6% 104492 interrupts.CPU21.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU21.MCP:Machine_check_polls 36342 ± 6% +12.8% 40986 interrupts.CPU21.NMI:Non-maskable_interrupts 36342 ± 6% +12.8% 40986 interrupts.CPU21.PMI:Performance_monitoring_interrupts 71.00 ± 43% -28.2% 51.00 ± 50% interrupts.CPU21.RES:Rescheduling_interrupts 0.60 ±133% -100.0% 0.00 interrupts.CPU21.TLB:TLB_shootdowns 12.20 ±200% -100.0% 0.00 interrupts.CPU22.354:PCI-MSI.288768-edge.ahci[0000:00:11.5] 0.00 -100.0% 0.00 interrupts.CPU22.354:PCI-MSI.77824-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU22.52:PCI-MSI.12582920-edge 1130 ± 43% -51.1% 552.33 ± 46% interrupts.CPU22.CAL:Function_call_interrupts 22.60 ± 6% +74.0% 39.33 ± 13% interrupts.CPU22.IWI:IRQ_work_interrupts 105349 -2.0% 103276 interrupts.CPU22.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU22.MCP:Machine_check_polls 35790 ± 9% +15.2% 41230 interrupts.CPU22.NMI:Non-maskable_interrupts 35790 ± 9% +15.2% 41230 interrupts.CPU22.PMI:Performance_monitoring_interrupts 53.60 ± 40% -50.2% 26.67 ± 46% interrupts.CPU22.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU22.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU23.355:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.CPU23.355:PCI-MSI.79872-edge.ioat-msix 1141 ± 43% -57.2% 488.33 ± 46% interrupts.CPU23.CAL:Function_call_interrupts 46.00 ± 67% -32.6% 31.00 ± 22% interrupts.CPU23.IWI:IRQ_work_interrupts 105776 ± 2% -1.1% 104605 interrupts.CPU23.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU23.MCP:Machine_check_polls 36878 ± 5% +11.9% 41277 interrupts.CPU23.NMI:Non-maskable_interrupts 36878 ± 5% +11.9% 41277 interrupts.CPU23.PMI:Performance_monitoring_interrupts 63.60 ± 37% -45.5% 34.67 ± 22% interrupts.CPU23.RES:Rescheduling_interrupts 0.00 +2.7e+102% 2.67 ±141% interrupts.CPU23.TLB:TLB_shootdowns 1292 ± 36% -48.3% 668.33 ± 34% interrupts.CPU24.CAL:Function_call_interrupts 42.80 ± 39% -23.7% 32.67 ± 25% interrupts.CPU24.IWI:IRQ_work_interrupts 107035 -1.9% 105051 interrupts.CPU24.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU24.MCP:Machine_check_polls 36772 ± 7% +11.0% 40806 interrupts.CPU24.NMI:Non-maskable_interrupts 36772 ± 7% +11.0% 40806 interrupts.CPU24.PMI:Performance_monitoring_interrupts 508.00 ±123% -83.1% 85.67 ± 31% interrupts.CPU24.RES:Rescheduling_interrupts 0.20 ±200% +4900.0% 10.00 ± 58% interrupts.CPU24.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU25.41:PCI-MSI.112721920-edge.PCIe.PME,pciehp 1320 ± 21% -48.8% 676.33 ± 39% interrupts.CPU25.CAL:Function_call_interrupts 38.00 ± 50% -7.9% 35.00 ± 23% interrupts.CPU25.IWI:IRQ_work_interrupts 105956 -2.2% 103678 interrupts.CPU25.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU25.MCP:Machine_check_polls 35852 ± 5% +14.2% 40946 ± 2% interrupts.CPU25.NMI:Non-maskable_interrupts 35852 ± 5% +14.2% 40946 ± 2% interrupts.CPU25.PMI:Performance_monitoring_interrupts 94.20 ± 34% -2.0% 92.33 ± 13% interrupts.CPU25.RES:Rescheduling_interrupts 0.20 ±200% +3733.3% 7.67 ±105% interrupts.CPU25.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU26.42:PCI-MSI.112738304-edge.PCIe.PME,pciehp 1712 ± 53% -33.8% 1134 ± 16% interrupts.CPU26.CAL:Function_call_interrupts 44.60 ± 42% -32.0% 30.33 ± 28% interrupts.CPU26.IWI:IRQ_work_interrupts 104913 ± 2% -0.5% 104337 interrupts.CPU26.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU26.MCP:Machine_check_polls 35996 ± 8% +13.4% 40804 ± 2% interrupts.CPU26.NMI:Non-maskable_interrupts 35996 ± 8% +13.4% 40804 ± 2% interrupts.CPU26.PMI:Performance_monitoring_interrupts 323.60 ±138% -1.4% 319.00 ± 84% interrupts.CPU26.RES:Rescheduling_interrupts 0.20 ±200% +66.7% 0.33 ±141% interrupts.CPU26.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU27.357:PCI-MSI.67174400-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU27.358:PCI-MSI.67174400-edge.ioat-msix 1275 ± 44% -40.4% 759.67 ± 44% interrupts.CPU27.CAL:Function_call_interrupts 37.80 ± 85% -38.3% 23.33 ± 17% interrupts.CPU27.IWI:IRQ_work_interrupts 104939 ± 2% -1.8% 103032 interrupts.CPU27.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU27.MCP:Machine_check_polls 36940 ± 7% +10.5% 40803 interrupts.CPU27.NMI:Non-maskable_interrupts 36940 ± 7% +10.5% 40803 interrupts.CPU27.PMI:Performance_monitoring_interrupts 73.20 ± 42% +59.4% 116.67 ± 28% interrupts.CPU27.RES:Rescheduling_interrupts 0.00 +6.7e+101% 0.67 ±141% interrupts.CPU27.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU28.359:PCI-MSI.67176448-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU28.360:PCI-MSI.67176448-edge.ioat-msix 1391 ± 49% -56.6% 603.67 ± 43% interrupts.CPU28.CAL:Function_call_interrupts 30.40 ± 49% +22.8% 37.33 ± 13% interrupts.CPU28.IWI:IRQ_work_interrupts 105431 -1.7% 103629 interrupts.CPU28.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU28.MCP:Machine_check_polls 38038 ± 8% +5.4% 40078 ± 2% interrupts.CPU28.NMI:Non-maskable_interrupts 38038 ± 8% +5.4% 40078 ± 2% interrupts.CPU28.PMI:Performance_monitoring_interrupts 194.80 ±101% -72.6% 53.33 ± 23% interrupts.CPU28.RES:Rescheduling_interrupts 66.40 ±200% -100.0% 0.00 interrupts.CPU28.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU29.360:PCI-MSI.67178496-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU29.361:PCI-MSI.67178496-edge.ioat-msix 1191 ± 43% -43.2% 676.33 ± 46% interrupts.CPU29.CAL:Function_call_interrupts 69.60 ± 22% -42.5% 40.00 ± 12% interrupts.CPU29.IWI:IRQ_work_interrupts 106254 -2.5% 103547 interrupts.CPU29.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU29.MCP:Machine_check_polls 36910 ± 5% +11.8% 41267 interrupts.CPU29.NMI:Non-maskable_interrupts 36910 ± 5% +11.8% 41267 interrupts.CPU29.PMI:Performance_monitoring_interrupts 49.80 ± 26% +41.9% 70.67 ± 20% interrupts.CPU29.RES:Rescheduling_interrupts 0.40 ±122% +1650.0% 7.00 ±141% interrupts.CPU29.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU3.414:PCI-MSI.68681745-edge.nvme0q17 1717 ± 63% -44.3% 955.67 ± 42% interrupts.CPU3.CAL:Function_call_interrupts 53.60 ± 30% -40.9% 31.67 ± 24% interrupts.CPU3.IWI:IRQ_work_interrupts 105699 -0.9% 104797 interrupts.CPU3.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU3.MCP:Machine_check_polls 35746 ± 6% +15.9% 41429 interrupts.CPU3.NMI:Non-maskable_interrupts 35746 ± 6% +15.9% 41429 interrupts.CPU3.PMI:Performance_monitoring_interrupts 86.00 ± 22% -5.4% 81.33 ± 30% interrupts.CPU3.RES:Rescheduling_interrupts 0.00 +6.7e+102% 6.67 ± 93% interrupts.CPU3.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU30.361:PCI-MSI.67180544-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU30.362:PCI-MSI.67180544-edge.ioat-msix 1215 ± 44% -50.6% 600.00 ± 39% interrupts.CPU30.CAL:Function_call_interrupts 45.60 ± 68% -10.1% 41.00 ± 12% interrupts.CPU30.IWI:IRQ_work_interrupts 105188 -0.6% 104548 interrupts.CPU30.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU30.MCP:Machine_check_polls 35956 ± 5% +13.9% 40943 interrupts.CPU30.NMI:Non-maskable_interrupts 35956 ± 5% +13.9% 40943 interrupts.CPU30.PMI:Performance_monitoring_interrupts 71.20 ± 95% -37.7% 44.33 ± 37% interrupts.CPU30.RES:Rescheduling_interrupts 0.00 +1.6e+103% 16.00 ±141% interrupts.CPU30.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU31.362:PCI-MSI.67182592-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU31.363:PCI-MSI.67182592-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU31.401:PCI-MSI.68681732-edge.nvme0q4 1170 ± 40% -49.7% 589.33 ± 41% interrupts.CPU31.CAL:Function_call_interrupts 54.40 ± 28% -34.4% 35.67 ± 37% interrupts.CPU31.IWI:IRQ_work_interrupts 105350 ± 2% -0.6% 104674 interrupts.CPU31.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU31.MCP:Machine_check_polls 36695 ± 3% +6.1% 38944 ± 8% interrupts.CPU31.NMI:Non-maskable_interrupts 36695 ± 3% +6.1% 38944 ± 8% interrupts.CPU31.PMI:Performance_monitoring_interrupts 44.00 ± 38% +34.8% 59.33 ± 30% interrupts.CPU31.RES:Rescheduling_interrupts 44.40 ±198% -88.0% 5.33 ±141% interrupts.CPU31.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU32.363:PCI-MSI.67184640-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU32.364:PCI-MSI.67184640-edge.ioat-msix 1480 ± 60% -56.7% 641.67 ± 41% interrupts.CPU32.CAL:Function_call_interrupts 48.60 ± 68% -41.7% 28.33 ± 27% interrupts.CPU32.IWI:IRQ_work_interrupts 105223 -0.6% 104608 interrupts.CPU32.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU32.MCP:Machine_check_polls 36046 ± 6% +13.0% 40735 interrupts.CPU32.NMI:Non-maskable_interrupts 36046 ± 6% +13.0% 40735 interrupts.CPU32.PMI:Performance_monitoring_interrupts 43.80 ± 40% +113.9% 93.67 ± 78% interrupts.CPU32.RES:Rescheduling_interrupts 17.60 ±200% -29.9% 12.33 ± 53% interrupts.CPU32.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU33.364:PCI-MSI.67186688-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU33.365:PCI-MSI.67186688-edge.ioat-msix 1179 ± 38% -47.2% 623.00 ± 45% interrupts.CPU33.CAL:Function_call_interrupts 45.20 ± 68% -35.8% 29.00 ± 39% interrupts.CPU33.IWI:IRQ_work_interrupts 105800 -1.2% 104555 interrupts.CPU33.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU33.MCP:Machine_check_polls 35765 ± 7% +13.9% 40749 interrupts.CPU33.NMI:Non-maskable_interrupts 35765 ± 7% +13.9% 40749 interrupts.CPU33.PMI:Performance_monitoring_interrupts 96.80 ± 73% -5.3% 91.67 ± 65% interrupts.CPU33.RES:Rescheduling_interrupts 1.40 ±139% +328.6% 6.00 ± 98% interrupts.CPU33.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU34.365:PCI-MSI.67188736-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU34.366:PCI-MSI.67188736-edge.ioat-msix 1253 ± 34% -53.8% 579.00 ± 44% interrupts.CPU34.CAL:Function_call_interrupts 40.60 ± 68% -17.9% 33.33 ± 23% interrupts.CPU34.IWI:IRQ_work_interrupts 104952 -0.3% 104594 interrupts.CPU34.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU34.MCP:Machine_check_polls 37133 ± 6% +9.6% 40704 interrupts.CPU34.NMI:Non-maskable_interrupts 37133 ± 6% +9.6% 40704 interrupts.CPU34.PMI:Performance_monitoring_interrupts 95.80 ± 55% -56.9% 41.33 ± 18% interrupts.CPU34.RES:Rescheduling_interrupts 0.00 +1e+103% 10.00 ±114% interrupts.CPU34.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU35.403:PCI-MSI.68681734-edge.nvme0q6 1161 ± 41% -51.7% 561.00 ± 48% interrupts.CPU35.CAL:Function_call_interrupts 46.80 ± 43% -38.0% 29.00 ± 34% interrupts.CPU35.IWI:IRQ_work_interrupts 106085 -2.3% 103668 interrupts.CPU35.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU35.MCP:Machine_check_polls 35361 ± 6% +15.7% 40921 interrupts.CPU35.NMI:Non-maskable_interrupts 35361 ± 6% +15.7% 40921 interrupts.CPU35.PMI:Performance_monitoring_interrupts 60.80 ± 33% -75.9% 14.67 ± 25% interrupts.CPU35.RES:Rescheduling_interrupts 0.40 ±200% +1816.7% 7.67 ± 81% interrupts.CPU35.TLB:TLB_shootdowns 1148 ± 43% -47.3% 605.67 ± 49% interrupts.CPU36.CAL:Function_call_interrupts 30.40 ± 53% +4.2% 31.67 ± 23% interrupts.CPU36.IWI:IRQ_work_interrupts 104917 -1.4% 103480 interrupts.CPU36.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU36.MCP:Machine_check_polls 36278 ± 9% +11.8% 40572 interrupts.CPU36.NMI:Non-maskable_interrupts 36278 ± 9% +11.8% 40572 interrupts.CPU36.PMI:Performance_monitoring_interrupts 78.60 ± 44% -64.0% 28.33 ± 15% interrupts.CPU36.RES:Rescheduling_interrupts 0.00 +1.3e+103% 12.67 ± 87% interrupts.CPU36.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU37.404:PCI-MSI.68681735-edge.nvme0q7 1157 ± 43% -48.2% 599.00 ± 36% interrupts.CPU37.CAL:Function_call_interrupts 38.20 ± 48% -12.7% 33.33 ± 27% interrupts.CPU37.IWI:IRQ_work_interrupts 105480 -1.8% 103560 interrupts.CPU37.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU37.MCP:Machine_check_polls 35362 ± 5% +15.0% 40668 interrupts.CPU37.NMI:Non-maskable_interrupts 35362 ± 5% +15.0% 40668 interrupts.CPU37.PMI:Performance_monitoring_interrupts 40.20 ± 44% -44.4% 22.33 ± 25% interrupts.CPU37.RES:Rescheduling_interrupts 0.40 ±200% -16.7% 0.33 ±141% interrupts.CPU37.TLB:TLB_shootdowns 1166 ± 43% -51.2% 569.67 ± 48% interrupts.CPU38.CAL:Function_call_interrupts 34.60 ± 78% -34.5% 22.67 ± 7% interrupts.CPU38.IWI:IRQ_work_interrupts 105830 -1.8% 103888 interrupts.CPU38.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU38.MCP:Machine_check_polls 35914 ± 7% +12.9% 40541 interrupts.CPU38.NMI:Non-maskable_interrupts 35914 ± 7% +12.9% 40541 interrupts.CPU38.PMI:Performance_monitoring_interrupts 78.00 ± 64% -76.9% 18.00 ± 12% interrupts.CPU38.RES:Rescheduling_interrupts 1.80 ±173% -81.5% 0.33 ±141% interrupts.CPU38.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU39.405:PCI-MSI.68681736-edge.nvme0q8 1206 ± 44% -52.4% 575.00 ± 46% interrupts.CPU39.CAL:Function_call_interrupts 30.00 ± 53% +2.2% 30.67 ± 27% interrupts.CPU39.IWI:IRQ_work_interrupts 106171 -1.8% 104234 interrupts.CPU39.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU39.MCP:Machine_check_polls 35164 ± 5% +15.5% 40616 interrupts.CPU39.NMI:Non-maskable_interrupts 35164 ± 5% +15.5% 40616 interrupts.CPU39.PMI:Performance_monitoring_interrupts 58.60 ± 73% -53.9% 27.00 ± 19% interrupts.CPU39.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU39.TLB:TLB_shootdowns 1258 ± 39% -46.0% 680.33 ± 28% interrupts.CPU4.CAL:Function_call_interrupts 49.80 ± 49% -59.8% 20.00 ± 8% interrupts.CPU4.IWI:IRQ_work_interrupts 105754 -1.0% 104715 interrupts.CPU4.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU4.MCP:Machine_check_polls 38485 ± 4% +1.8% 39159 ± 3% interrupts.CPU4.NMI:Non-maskable_interrupts 38485 ± 4% +1.8% 39159 ± 3% interrupts.CPU4.PMI:Performance_monitoring_interrupts 106.00 ± 36% +33.3% 141.33 ± 48% interrupts.CPU4.RES:Rescheduling_interrupts 0.00 +6.7e+101% 0.67 ±141% interrupts.CPU4.TLB:TLB_shootdowns 1184 ± 43% -51.2% 578.33 ± 47% interrupts.CPU40.CAL:Function_call_interrupts 31.20 ± 46% -12.4% 27.33 ± 22% interrupts.CPU40.IWI:IRQ_work_interrupts 106382 -1.9% 104310 interrupts.CPU40.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU40.MCP:Machine_check_polls 38001 ± 3% +7.3% 40775 interrupts.CPU40.NMI:Non-maskable_interrupts 38001 ± 3% +7.3% 40775 interrupts.CPU40.PMI:Performance_monitoring_interrupts 61.20 ± 54% -40.1% 36.67 ± 14% interrupts.CPU40.RES:Rescheduling_interrupts 0.00 +7.3e+102% 7.33 ±131% interrupts.CPU40.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU41.406:PCI-MSI.68681737-edge.nvme0q9 1178 ± 41% -51.0% 577.33 ± 49% interrupts.CPU41.CAL:Function_call_interrupts 46.40 ± 39% -44.0% 26.00 ± 11% interrupts.CPU41.IWI:IRQ_work_interrupts 105918 -0.6% 105239 interrupts.CPU41.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU41.MCP:Machine_check_polls 37378 +8.8% 40674 interrupts.CPU41.NMI:Non-maskable_interrupts 37378 +8.8% 40674 interrupts.CPU41.PMI:Performance_monitoring_interrupts 56.60 ± 42% -48.2% 29.33 ± 30% interrupts.CPU41.RES:Rescheduling_interrupts 0.00 +5.3e+102% 5.33 ±141% interrupts.CPU41.TLB:TLB_shootdowns 1209 ± 37% -51.3% 589.67 ± 44% interrupts.CPU42.CAL:Function_call_interrupts 38.80 ± 59% -33.8% 25.67 ± 25% interrupts.CPU42.IWI:IRQ_work_interrupts 106931 -2.9% 103872 interrupts.CPU42.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU42.MCP:Machine_check_polls 34186 ± 7% +18.6% 40549 interrupts.CPU42.NMI:Non-maskable_interrupts 34186 ± 7% +18.6% 40549 interrupts.CPU42.PMI:Performance_monitoring_interrupts 104.60 ± 29% -53.2% 49.00 ± 58% interrupts.CPU42.RES:Rescheduling_interrupts 0.00 +2.7e+102% 2.67 ±141% interrupts.CPU42.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU43.407:PCI-MSI.69206026-edge.nvme1q10 1146 ± 41% -50.9% 563.00 ± 47% interrupts.CPU43.CAL:Function_call_interrupts 60.40 ± 58% -39.3% 36.67 ± 26% interrupts.CPU43.IWI:IRQ_work_interrupts 105946 -2.1% 103720 interrupts.CPU43.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU43.MCP:Machine_check_polls 37198 ± 4% +9.7% 40800 interrupts.CPU43.NMI:Non-maskable_interrupts 37198 ± 4% +9.7% 40800 interrupts.CPU43.PMI:Performance_monitoring_interrupts 80.80 ± 42% -60.0% 32.33 ± 16% interrupts.CPU43.RES:Rescheduling_interrupts 0.60 ±133% +1177.8% 7.67 ± 70% interrupts.CPU43.TLB:TLB_shootdowns 1139 ± 42% -46.6% 608.33 ± 45% interrupts.CPU44.CAL:Function_call_interrupts 34.60 ± 68% +7.9% 37.33 ± 27% interrupts.CPU44.IWI:IRQ_work_interrupts 105117 -1.5% 103556 interrupts.CPU44.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU44.MCP:Machine_check_polls 36248 ± 8% +13.5% 41148 interrupts.CPU44.NMI:Non-maskable_interrupts 36248 ± 8% +13.5% 41148 interrupts.CPU44.PMI:Performance_monitoring_interrupts 83.40 ± 90% -27.3% 60.67 ± 26% interrupts.CPU44.RES:Rescheduling_interrupts 1.60 ±170% -37.5% 1.00 ±141% interrupts.CPU44.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU45.387:PCI-MSI.69206027-edge.nvme1q11 1167 ± 41% -49.2% 593.00 ± 51% interrupts.CPU45.CAL:Function_call_interrupts 59.80 ± 29% -61.5% 23.00 ± 3% interrupts.CPU45.IWI:IRQ_work_interrupts 106680 -3.1% 103357 interrupts.CPU45.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU45.MCP:Machine_check_polls 36324 ± 7% +10.3% 40065 interrupts.CPU45.NMI:Non-maskable_interrupts 36324 ± 7% +10.3% 40065 interrupts.CPU45.PMI:Performance_monitoring_interrupts 133.60 ± 80% -57.1% 57.33 ± 46% interrupts.CPU45.RES:Rescheduling_interrupts 1.60 ±170% -79.2% 0.33 ±141% interrupts.CPU45.TLB:TLB_shootdowns 1176 ± 42% -42.9% 671.67 ± 31% interrupts.CPU46.CAL:Function_call_interrupts 45.80 ± 68% -18.5% 37.33 ± 27% interrupts.CPU46.IWI:IRQ_work_interrupts 104406 -0.7% 103655 interrupts.CPU46.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU46.MCP:Machine_check_polls 36585 ± 10% +13.4% 41474 interrupts.CPU46.NMI:Non-maskable_interrupts 36585 ± 10% +13.4% 41474 interrupts.CPU46.PMI:Performance_monitoring_interrupts 74.00 ± 38% +1.4% 75.00 ± 87% interrupts.CPU46.RES:Rescheduling_interrupts 0.00 +2.3e+103% 22.67 ± 12% interrupts.CPU46.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU47.389:PCI-MSI.69206028-edge.nvme1q12 0.00 -100.0% 0.00 interrupts.CPU47.409:PCI-MSI.69206028-edge.nvme1q12 1415 ± 53% -57.3% 604.00 ± 43% interrupts.CPU47.CAL:Function_call_interrupts 55.00 ± 53% -57.6% 23.33 ± 7% interrupts.CPU47.IWI:IRQ_work_interrupts 105299 -1.1% 104095 interrupts.CPU47.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU47.MCP:Machine_check_polls 37302 ± 10% +9.1% 40692 interrupts.CPU47.NMI:Non-maskable_interrupts 37302 ± 10% +9.1% 40692 interrupts.CPU47.PMI:Performance_monitoring_interrupts 87.00 ± 58% -15.7% 73.33 ± 46% interrupts.CPU47.RES:Rescheduling_interrupts 2.20 ±200% +218.2% 7.00 ± 34% interrupts.CPU47.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU48.356:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.CPU48.356:PCI-MSI.79872-edge.ioat-msix 0.00 -100.0% 0.00 interrupts.CPU48.358:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.CPU48.360:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.CPU48.364:PCI-MSI.376832-edge.ahci[0000:00:17.0] 2.00 ±200% -100.0% 0.00 interrupts.CPU48.366:PCI-MSI.376832-edge.ahci[0000:00:17.0] 0.00 -100.0% 0.00 interrupts.CPU48.55:PCI-MSI.12584961-edge 1280 ± 37% -55.3% 573.00 ± 47% interrupts.CPU48.CAL:Function_call_interrupts 58.00 ± 58% -42.0% 33.67 ± 30% interrupts.CPU48.IWI:IRQ_work_interrupts 106107 -1.5% 104468 interrupts.CPU48.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU48.MCP:Machine_check_polls 35915 ± 8% +14.9% 41254 interrupts.CPU48.NMI:Non-maskable_interrupts 35915 ± 8% +14.9% 41254 interrupts.CPU48.PMI:Performance_monitoring_interrupts 59.60 ± 43% -16.7% 49.67 ± 39% interrupts.CPU48.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU48.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU49.345:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU49.345:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU49.346:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU49.348:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU49.349:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU49.350:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU49.351:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU49.351:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU49.3:IO-APIC.3-edge 0.00 -100.0% 0.00 interrupts.CPU49.56:PCI-MSI.12584962-edge 1304 ± 38% -49.3% 661.67 ± 41% interrupts.CPU49.CAL:Function_call_interrupts 46.20 ± 67% -38.7% 28.33 ± 34% interrupts.CPU49.IWI:IRQ_work_interrupts 104634 -0.2% 104379 interrupts.CPU49.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU49.MCP:Machine_check_polls 36454 ± 8% +13.7% 41435 ± 2% interrupts.CPU49.NMI:Non-maskable_interrupts 36454 ± 8% +13.7% 41435 ± 2% interrupts.CPU49.PMI:Performance_monitoring_interrupts 94.40 ± 9% -8.5% 86.33 ± 23% interrupts.CPU49.RES:Rescheduling_interrupts 1.60 ±170% +1191.7% 20.67 ±141% interrupts.CPU49.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU5.31:PCI-MSI.48791552-edge.PCIe.PME,pciehp 0.00 -100.0% 0.00 interrupts.CPU5.415:PCI-MSI.69206034-edge.nvme1q18 1202 ± 44% -41.0% 709.67 ± 38% interrupts.CPU5.CAL:Function_call_interrupts 73.80 ± 22% -63.4% 27.00 ± 29% interrupts.CPU5.IWI:IRQ_work_interrupts 106142 -1.9% 104111 interrupts.CPU5.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU5.MCP:Machine_check_polls 36562 ± 3% +8.9% 39809 ± 4% interrupts.CPU5.NMI:Non-maskable_interrupts 36562 ± 3% +8.9% 39809 ± 4% interrupts.CPU5.PMI:Performance_monitoring_interrupts 58.40 ± 35% +120.3% 128.67 ± 40% interrupts.CPU5.RES:Rescheduling_interrupts 0.00 +8.7e+102% 8.67 ±141% interrupts.CPU5.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU50.345:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU50.346:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU50.347:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU50.348:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU50.349:PCI-MSI.68681728-edge.nvme0q0 0.00 -100.0% 0.00 interrupts.CPU50.350:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU50.353:PCI-MSI.69206016-edge.nvme1q0 0.00 -100.0% 0.00 interrupts.CPU50.57:PCI-MSI.12584963-edge 1194 ± 41% -45.9% 646.67 ± 42% interrupts.CPU50.CAL:Function_call_interrupts 45.80 ± 40% -35.2% 29.67 ± 32% interrupts.CPU50.IWI:IRQ_work_interrupts 105279 -0.9% 104357 interrupts.CPU50.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU50.MCP:Machine_check_polls 37528 ± 2% +9.9% 41248 interrupts.CPU50.NMI:Non-maskable_interrupts 37528 ± 2% +9.9% 41248 interrupts.CPU50.PMI:Performance_monitoring_interrupts 93.00 ± 73% -15.1% 79.00 ± 12% interrupts.CPU50.RES:Rescheduling_interrupts 0.20 ±200% +66.7% 0.33 ±141% interrupts.CPU50.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU51.58:PCI-MSI.12584964-edge 1176 ± 42% -45.6% 640.67 ± 50% interrupts.CPU51.CAL:Function_call_interrupts 60.20 ± 40% -56.8% 26.00 ± 17% interrupts.CPU51.IWI:IRQ_work_interrupts 106157 -2.0% 104034 interrupts.CPU51.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU51.MCP:Machine_check_polls 36877 ± 6% +10.3% 40679 interrupts.CPU51.NMI:Non-maskable_interrupts 36877 ± 6% +10.3% 40679 interrupts.CPU51.PMI:Performance_monitoring_interrupts 62.40 ± 41% -18.3% 51.00 ± 40% interrupts.CPU51.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU51.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU52.384:PCI-MSI.68681746-edge.nvme0q18 0.00 -100.0% 0.00 interrupts.CPU52.59:PCI-MSI.12584965-edge 1136 ± 44% -48.9% 580.33 ± 43% interrupts.CPU52.CAL:Function_call_interrupts 50.20 ± 67% -28.3% 36.00 ± 27% interrupts.CPU52.IWI:IRQ_work_interrupts 105211 -0.3% 104883 interrupts.CPU52.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU52.MCP:Machine_check_polls 37420 ± 10% +10.0% 41179 interrupts.CPU52.NMI:Non-maskable_interrupts 37420 ± 10% +10.0% 41179 interrupts.CPU52.PMI:Performance_monitoring_interrupts 87.60 ± 67% -46.0% 47.33 ± 36% interrupts.CPU52.RES:Rescheduling_interrupts 205.00 ±199% -99.8% 0.33 ±141% interrupts.CPU52.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU53.60:PCI-MSI.12584966-edge 1166 ± 44% -49.9% 584.33 ± 46% interrupts.CPU53.CAL:Function_call_interrupts 22.60 ± 9% -4.1% 21.67 ± 2% interrupts.CPU53.IWI:IRQ_work_interrupts 106072 -0.5% 105555 interrupts.CPU53.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU53.MCP:Machine_check_polls 35894 ± 7% +14.6% 41127 interrupts.CPU53.NMI:Non-maskable_interrupts 35894 ± 7% +14.6% 41127 interrupts.CPU53.PMI:Performance_monitoring_interrupts 65.40 ± 69% +5.5% 69.00 ± 19% interrupts.CPU53.RES:Rescheduling_interrupts 0.20 ±200% +66.7% 0.33 ±141% interrupts.CPU53.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU54.385:PCI-MSI.69206035-edge.nvme1q19 0.00 -100.0% 0.00 interrupts.CPU54.61:PCI-MSI.12584967-edge 1145 ± 42% -48.0% 595.00 ± 48% interrupts.CPU54.CAL:Function_call_interrupts 49.80 ± 51% -33.7% 33.00 ± 29% interrupts.CPU54.IWI:IRQ_work_interrupts 104362 +0.2% 104559 interrupts.CPU54.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU54.MCP:Machine_check_polls 36865 ± 4% +11.9% 41254 interrupts.CPU54.NMI:Non-maskable_interrupts 36865 ± 4% +11.9% 41254 interrupts.CPU54.PMI:Performance_monitoring_interrupts 50.00 ± 33% +11.3% 55.67 ± 34% interrupts.CPU54.RES:Rescheduling_interrupts 3.40 ±185% -100.0% 0.00 interrupts.CPU54.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU55.62:PCI-MSI.12584968-edge 1137 ± 42% -51.3% 554.00 ± 47% interrupts.CPU55.CAL:Function_call_interrupts 45.80 ± 63% -41.0% 27.00 ± 28% interrupts.CPU55.IWI:IRQ_work_interrupts 105488 -0.5% 105005 interrupts.CPU55.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU55.MCP:Machine_check_polls 34680 ± 7% +18.1% 40941 interrupts.CPU55.NMI:Non-maskable_interrupts 34680 ± 7% +18.1% 40941 interrupts.CPU55.PMI:Performance_monitoring_interrupts 56.60 ± 39% -2.8% 55.00 ± 73% interrupts.CPU55.RES:Rescheduling_interrupts 33.80 ±194% -99.0% 0.33 ±141% interrupts.CPU55.TLB:TLB_shootdowns 1155 ± 44% -50.9% 567.67 ± 48% interrupts.CPU56.CAL:Function_call_interrupts 30.40 ± 52% +10.7% 33.67 ± 26% interrupts.CPU56.IWI:IRQ_work_interrupts 106025 ± 2% -1.3% 104695 interrupts.CPU56.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU56.MCP:Machine_check_polls 35806 ± 6% +14.8% 41111 interrupts.CPU56.NMI:Non-maskable_interrupts 35806 ± 6% +14.8% 41111 interrupts.CPU56.PMI:Performance_monitoring_interrupts 60.60 ± 38% -13.6% 52.33 ± 50% interrupts.CPU56.RES:Rescheduling_interrupts 0.40 ±122% -100.0% 0.00 interrupts.CPU56.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU57.65:PCI-MSI.12587009-edge 1217 ± 45% -49.9% 610.33 ± 42% interrupts.CPU57.CAL:Function_call_interrupts 53.20 ± 54% -49.2% 27.00 ± 21% interrupts.CPU57.IWI:IRQ_work_interrupts 105073 +0.1% 105170 interrupts.CPU57.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU57.MCP:Machine_check_polls 36927 ± 6% +11.0% 40972 interrupts.CPU57.NMI:Non-maskable_interrupts 36927 ± 6% +11.0% 40972 interrupts.CPU57.PMI:Performance_monitoring_interrupts 67.40 ± 32% +28.1% 86.33 ± 29% interrupts.CPU57.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.CPU57.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU58.66:PCI-MSI.12587010-edge 1163 ± 43% -51.6% 562.33 ± 48% interrupts.CPU58.CAL:Function_call_interrupts 43.60 ± 48% -38.1% 27.00 ± 19% interrupts.CPU58.IWI:IRQ_work_interrupts 107719 -2.7% 104802 interrupts.CPU58.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU58.MCP:Machine_check_polls 37449 ± 7% +8.8% 40746 interrupts.CPU58.NMI:Non-maskable_interrupts 37449 ± 7% +8.8% 40746 interrupts.CPU58.PMI:Performance_monitoring_interrupts 72.00 ± 72% -56.9% 31.00 ± 44% interrupts.CPU58.RES:Rescheduling_interrupts 0.40 ±122% -100.0% 0.00 interrupts.CPU58.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU59.67:PCI-MSI.12587011-edge 1149 ± 44% -50.2% 572.33 ± 43% interrupts.CPU59.CAL:Function_call_interrupts 60.60 ± 37% -60.4% 24.00 ± 12% interrupts.CPU59.IWI:IRQ_work_interrupts 104343 +0.7% 105107 interrupts.CPU59.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU59.MCP:Machine_check_polls 35970 ± 4% +14.3% 41123 interrupts.CPU59.NMI:Non-maskable_interrupts 35970 ± 4% +14.3% 41123 interrupts.CPU59.PMI:Performance_monitoring_interrupts 49.00 ± 70% +57.8% 77.33 ± 78% interrupts.CPU59.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU59.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU6.32:PCI-MSI.48807936-edge.PCIe.PME,pciehp 1160 ± 43% -48.9% 593.00 ± 47% interrupts.CPU6.CAL:Function_call_interrupts 63.80 ± 32% -62.9% 23.67 ± 13% interrupts.CPU6.IWI:IRQ_work_interrupts 106868 -1.4% 105362 interrupts.CPU6.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU6.MCP:Machine_check_polls 37563 ± 2% +9.0% 40946 interrupts.CPU6.NMI:Non-maskable_interrupts 37563 ± 2% +9.0% 40946 interrupts.CPU6.PMI:Performance_monitoring_interrupts 55.20 ± 37% -38.4% 34.00 ± 12% interrupts.CPU6.RES:Rescheduling_interrupts 0.40 ±122% +483.3% 2.33 ±141% interrupts.CPU6.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU60.68:PCI-MSI.12587012-edge 1179 ± 44% -53.6% 547.33 ± 47% interrupts.CPU60.CAL:Function_call_interrupts 37.80 ± 52% -25.0% 28.33 ± 31% interrupts.CPU60.IWI:IRQ_work_interrupts 106971 -2.0% 104804 interrupts.CPU60.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU60.MCP:Machine_check_polls 35528 ± 7% +15.7% 41121 interrupts.CPU60.NMI:Non-maskable_interrupts 35528 ± 7% +15.7% 41121 interrupts.CPU60.PMI:Performance_monitoring_interrupts 113.60 ± 66% -63.0% 42.00 ± 79% interrupts.CPU60.RES:Rescheduling_interrupts 0.60 ±133% -100.0% 0.00 interrupts.CPU60.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU61.69:PCI-MSI.12587013-edge 1188 ± 43% -52.7% 562.33 ± 47% interrupts.CPU61.CAL:Function_call_interrupts 46.80 ± 68% -53.0% 22.00 ± 12% interrupts.CPU61.IWI:IRQ_work_interrupts 105340 ± 2% -0.5% 104852 interrupts.CPU61.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU61.MCP:Machine_check_polls 37616 ± 2% +1.3% 38087 ± 9% interrupts.CPU61.NMI:Non-maskable_interrupts 37616 ± 2% +1.3% 38087 ± 9% interrupts.CPU61.PMI:Performance_monitoring_interrupts 62.60 ± 61% -67.0% 20.67 ± 18% interrupts.CPU61.RES:Rescheduling_interrupts 0.20 ±200% -100.0% 0.00 interrupts.CPU61.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU62.412:PCI-MSI.68681751-edge.nvme0q23 0.00 -100.0% 0.00 interrupts.CPU62.70:PCI-MSI.12587014-edge 1148 ± 43% -51.9% 552.67 ± 47% interrupts.CPU62.CAL:Function_call_interrupts 49.40 ± 62% -58.2% 20.67 ± 6% interrupts.CPU62.IWI:IRQ_work_interrupts 106207 -0.6% 105550 interrupts.CPU62.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU62.MCP:Machine_check_polls 36231 ± 7% +10.7% 40102 ± 3% interrupts.CPU62.NMI:Non-maskable_interrupts 36231 ± 7% +10.7% 40102 ± 3% interrupts.CPU62.PMI:Performance_monitoring_interrupts 77.60 ± 46% -57.9% 32.67 ± 35% interrupts.CPU62.RES:Rescheduling_interrupts 1.00 ±154% -33.3% 0.67 ±141% interrupts.CPU62.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU63.71:PCI-MSI.12587015-edge 1152 ± 42% -51.3% 560.67 ± 46% interrupts.CPU63.CAL:Function_call_interrupts 33.00 ± 43% -16.2% 27.67 ± 31% interrupts.CPU63.IWI:IRQ_work_interrupts 106674 -1.5% 105114 interrupts.CPU63.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU63.MCP:Machine_check_polls 36221 ± 5% +13.2% 41009 interrupts.CPU63.NMI:Non-maskable_interrupts 36221 ± 5% +13.2% 41009 interrupts.CPU63.PMI:Performance_monitoring_interrupts 72.60 ± 98% -16.0% 61.00 ± 22% interrupts.CPU63.RES:Rescheduling_interrupts 0.40 ±200% -100.0% 0.00 interrupts.CPU63.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU64.390:PCI-MSI.69206040-edge.nvme1q24 0.00 -100.0% 0.00 interrupts.CPU64.72:PCI-MSI.12587016-edge 1289 ± 49% -57.2% 552.33 ± 48% interrupts.CPU64.CAL:Function_call_interrupts 53.40 ± 53% -61.3% 20.67 ± 2% interrupts.CPU64.IWI:IRQ_work_interrupts 106599 -1.3% 105265 interrupts.CPU64.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU64.MCP:Machine_check_polls 37543 ± 3% +7.8% 40471 ± 2% interrupts.CPU64.NMI:Non-maskable_interrupts 37543 ± 3% +7.8% 40471 ± 2% interrupts.CPU64.PMI:Performance_monitoring_interrupts 42.80 ± 58% -26.8% 31.33 ± 62% interrupts.CPU64.RES:Rescheduling_interrupts 0.80 ± 93% -100.0% 0.00 interrupts.CPU64.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU65.74:PCI-MSI.12589056-edge.eth3 1150 ± 43% -52.1% 551.00 ± 47% interrupts.CPU65.CAL:Function_call_interrupts 45.40 ± 67% -55.9% 20.00 ± 4% interrupts.CPU65.IWI:IRQ_work_interrupts 105239 -0.0% 105223 interrupts.CPU65.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU65.MCP:Machine_check_polls 35937 ± 5% +11.7% 40147 ± 2% interrupts.CPU65.NMI:Non-maskable_interrupts 35937 ± 5% +11.7% 40147 ± 2% interrupts.CPU65.PMI:Performance_monitoring_interrupts 48.80 ± 33% -44.0% 27.33 ± 45% interrupts.CPU65.RES:Rescheduling_interrupts 0.20 ±200% +1233.3% 2.67 ±141% interrupts.CPU65.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU66.391:PCI-MSI.69206041-edge.nvme1q25 1189 ±161% -91.2% 104.33 ± 10% interrupts.CPU66.75:PCI-MSI.12589057-edge.eth3-TxRx-0 1151 ± 42% -50.3% 572.00 ± 46% interrupts.CPU66.CAL:Function_call_interrupts 59.00 ± 60% -50.8% 29.00 ± 36% interrupts.CPU66.IWI:IRQ_work_interrupts 106152 -0.5% 105648 interrupts.CPU66.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU66.MCP:Machine_check_polls 38444 ± 10% +8.2% 41610 ± 2% interrupts.CPU66.NMI:Non-maskable_interrupts 38444 ± 10% +8.2% 41610 ± 2% interrupts.CPU66.PMI:Performance_monitoring_interrupts 62.80 ± 27% -30.5% 43.67 ± 54% interrupts.CPU66.RES:Rescheduling_interrupts 0.40 ±200% +66.7% 0.67 ±141% interrupts.CPU66.TLB:TLB_shootdowns 1628 ±187% -94.1% 96.33 ± 24% interrupts.CPU67.76:PCI-MSI.12589058-edge.eth3-TxRx-1 1176 ± 43% -52.4% 560.33 ± 47% interrupts.CPU67.CAL:Function_call_interrupts 32.40 ± 46% -35.2% 21.00 interrupts.CPU67.IWI:IRQ_work_interrupts 106022 -0.3% 105733 interrupts.CPU67.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU67.MCP:Machine_check_polls 35901 ± 5% +14.3% 41043 interrupts.CPU67.NMI:Non-maskable_interrupts 35901 ± 5% +14.3% 41043 interrupts.CPU67.PMI:Performance_monitoring_interrupts 57.80 ± 49% -29.1% 41.00 ± 50% interrupts.CPU67.RES:Rescheduling_interrupts 568.60 ±199% -100.0% 0.00 interrupts.CPU67.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU68.392:PCI-MSI.69206042-edge.nvme1q26 3389 ±194% -93.4% 223.00 ± 95% interrupts.CPU68.77:PCI-MSI.12589059-edge.eth3-TxRx-2 1172 ± 43% -53.0% 550.33 ± 47% interrupts.CPU68.CAL:Function_call_interrupts 60.60 ± 42% -70.8% 17.67 ± 2% interrupts.CPU68.IWI:IRQ_work_interrupts 107459 -2.8% 104481 interrupts.CPU68.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU68.MCP:Machine_check_polls 35334 ± 5% +5.6% 37302 interrupts.CPU68.NMI:Non-maskable_interrupts 35334 ± 5% +5.6% 37302 interrupts.CPU68.PMI:Performance_monitoring_interrupts 65.20 ± 54% -52.5% 31.00 ± 54% interrupts.CPU68.RES:Rescheduling_interrupts 0.80 ± 93% -100.0% 0.00 interrupts.CPU68.TLB:TLB_shootdowns 432.80 ±120% -74.7% 109.67 ± 18% interrupts.CPU69.78:PCI-MSI.12589060-edge.eth3-TxRx-3 1159 ± 43% -53.1% 543.67 ± 47% interrupts.CPU69.CAL:Function_call_interrupts 24.20 ± 3% +21.2% 29.33 ± 29% interrupts.CPU69.IWI:IRQ_work_interrupts 106381 -1.6% 104721 interrupts.CPU69.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU69.MCP:Machine_check_polls 38373 +6.5% 40885 interrupts.CPU69.NMI:Non-maskable_interrupts 38373 +6.5% 40885 interrupts.CPU69.PMI:Performance_monitoring_interrupts 59.20 ± 74% -41.4% 34.67 ± 56% interrupts.CPU69.RES:Rescheduling_interrupts 0.40 ±122% -100.0% 0.00 interrupts.CPU69.TLB:TLB_shootdowns 1157 ± 42% -45.4% 632.00 ± 50% interrupts.CPU7.CAL:Function_call_interrupts 48.40 ± 61% -55.2% 21.67 ± 2% interrupts.CPU7.IWI:IRQ_work_interrupts 105610 ± 2% -0.9% 104711 interrupts.CPU7.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU7.MCP:Machine_check_polls 36345 ± 4% +13.3% 41174 interrupts.CPU7.NMI:Non-maskable_interrupts 36345 ± 4% +13.3% 41174 interrupts.CPU7.PMI:Performance_monitoring_interrupts 70.80 ± 74% -15.7% 59.67 ± 41% interrupts.CPU7.RES:Rescheduling_interrupts 0.20 ±200% +1233.3% 2.67 ±141% interrupts.CPU7.TLB:TLB_shootdowns 502.60 ±167% +21.2% 609.00 ±120% interrupts.CPU70.79:PCI-MSI.12589061-edge.eth3-TxRx-4 1142 ± 43% -51.8% 550.67 ± 46% interrupts.CPU70.CAL:Function_call_interrupts 46.20 ± 67% -56.0% 20.33 ± 8% interrupts.CPU70.IWI:IRQ_work_interrupts 105503 ± 2% -0.5% 105005 interrupts.CPU70.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU70.MCP:Machine_check_polls 37743 ± 4% +5.7% 39879 ± 4% interrupts.CPU70.NMI:Non-maskable_interrupts 37743 ± 4% +5.7% 39879 ± 4% interrupts.CPU70.PMI:Performance_monitoring_interrupts 48.80 ± 45% -18.0% 40.00 ± 72% interrupts.CPU70.RES:Rescheduling_interrupts 0.60 ±133% -44.4% 0.33 ±141% interrupts.CPU70.TLB:TLB_shootdowns 241.60 ± 72% +662.3% 1841 ±100% interrupts.CPU71.80:PCI-MSI.12589062-edge.eth3-TxRx-5 1174 ± 41% -52.7% 555.33 ± 46% interrupts.CPU71.CAL:Function_call_interrupts 48.00 ± 61% -34.7% 31.33 ± 27% interrupts.CPU71.IWI:IRQ_work_interrupts 105211 -0.3% 104865 interrupts.CPU71.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU71.MCP:Machine_check_polls 36912 ± 6% +11.3% 41085 interrupts.CPU71.NMI:Non-maskable_interrupts 36912 ± 6% +11.3% 41085 interrupts.CPU71.PMI:Performance_monitoring_interrupts 43.60 ± 65% -36.5% 27.67 ± 44% interrupts.CPU71.RES:Rescheduling_interrupts 0.80 ± 93% -58.3% 0.33 ±141% interrupts.CPU71.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU72.398:PCI-MSI.68681729-edge.nvme0q1 0.00 -100.0% 0.00 interrupts.CPU72.398:PCI-MSI.69206017-edge.nvme1q1 1281 ± 34% -54.2% 586.33 ± 44% interrupts.CPU72.CAL:Function_call_interrupts 38.00 ± 49% -37.7% 23.67 ± 15% interrupts.CPU72.IWI:IRQ_work_interrupts 104488 -0.4% 104077 interrupts.CPU72.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU72.MCP:Machine_check_polls 36746 ± 7% +11.6% 41024 interrupts.CPU72.NMI:Non-maskable_interrupts 36746 ± 7% +11.6% 41024 interrupts.CPU72.PMI:Performance_monitoring_interrupts 228.40 ±102% -82.8% 39.33 ± 30% interrupts.CPU72.RES:Rescheduling_interrupts 0.80 ±122% -100.0% 0.00 interrupts.CPU72.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU73.367:PCI-MSI.68681729-edge.nvme0q1 0.00 -100.0% 0.00 interrupts.CPU73.367:PCI-MSI.69206017-edge.nvme1q1 1294 ± 37% -51.4% 629.00 ± 42% interrupts.CPU73.CAL:Function_call_interrupts 29.80 ± 40% +4.0% 31.00 ± 35% interrupts.CPU73.IWI:IRQ_work_interrupts 106119 ± 2% -1.7% 104362 interrupts.CPU73.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU73.MCP:Machine_check_polls 38003 ± 5% +7.7% 40939 interrupts.CPU73.NMI:Non-maskable_interrupts 38003 ± 5% +7.7% 40939 interrupts.CPU73.PMI:Performance_monitoring_interrupts 75.40 ± 29% -3.6% 72.67 ± 28% interrupts.CPU73.RES:Rescheduling_interrupts 0.60 ±133% -100.0% 0.00 interrupts.CPU73.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU74.399:PCI-MSI.68681730-edge.nvme0q2 0.00 -100.0% 0.00 interrupts.CPU74.399:PCI-MSI.69206018-edge.nvme1q2 1228 ± 42% -48.3% 635.33 ± 40% interrupts.CPU74.CAL:Function_call_interrupts 61.00 ± 54% -53.6% 28.33 ± 34% interrupts.CPU74.IWI:IRQ_work_interrupts 106208 -2.4% 103690 interrupts.CPU74.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU74.MCP:Machine_check_polls 38616 ± 3% +5.6% 40768 interrupts.CPU74.NMI:Non-maskable_interrupts 38616 ± 3% +5.6% 40768 interrupts.CPU74.PMI:Performance_monitoring_interrupts 111.60 ± 73% -51.6% 54.00 ± 50% interrupts.CPU74.RES:Rescheduling_interrupts 86.80 ±198% -99.6% 0.33 ±141% interrupts.CPU74.TLB:TLB_shootdowns 1168 ± 41% -46.2% 629.00 ± 41% interrupts.CPU75.CAL:Function_call_interrupts 53.40 ± 47% -42.6% 30.67 ± 22% interrupts.CPU75.IWI:IRQ_work_interrupts 106626 -1.9% 104620 interrupts.CPU75.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU75.MCP:Machine_check_polls 38362 ± 2% +7.0% 41048 interrupts.CPU75.NMI:Non-maskable_interrupts 38362 ± 2% +7.0% 41048 interrupts.CPU75.PMI:Performance_monitoring_interrupts 68.60 ± 41% -23.7% 52.33 ± 36% interrupts.CPU75.RES:Rescheduling_interrupts 0.60 ±133% -100.0% 0.00 interrupts.CPU75.TLB:TLB_shootdowns 1129 ± 43% -44.0% 633.00 ± 31% interrupts.CPU76.CAL:Function_call_interrupts 37.60 ± 51% -7.8% 34.67 ± 29% interrupts.CPU76.IWI:IRQ_work_interrupts 106500 -2.2% 104158 interrupts.CPU76.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU76.MCP:Machine_check_polls 34992 ± 9% +16.9% 40889 interrupts.CPU76.NMI:Non-maskable_interrupts 34992 ± 9% +16.9% 40889 interrupts.CPU76.PMI:Performance_monitoring_interrupts 45.20 ± 38% -24.0% 34.33 ± 9% interrupts.CPU76.RES:Rescheduling_interrupts 0.80 ± 93% -58.3% 0.33 ±141% interrupts.CPU76.TLB:TLB_shootdowns 1146 ± 42% -44.8% 633.00 ± 46% interrupts.CPU77.CAL:Function_call_interrupts 49.40 ± 31% -56.1% 21.67 ± 2% interrupts.CPU77.IWI:IRQ_work_interrupts 106334 -1.7% 104531 interrupts.CPU77.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU77.MCP:Machine_check_polls 37297 ± 2% +7.7% 40176 interrupts.CPU77.NMI:Non-maskable_interrupts 37297 ± 2% +7.7% 40176 interrupts.CPU77.PMI:Performance_monitoring_interrupts 33.00 ± 33% +37.4% 45.33 ± 55% interrupts.CPU77.RES:Rescheduling_interrupts 0.80 ± 50% -100.0% 0.00 interrupts.CPU77.TLB:TLB_shootdowns 1140 ± 43% -49.4% 577.33 ± 45% interrupts.CPU78.CAL:Function_call_interrupts 23.40 ± 6% +55.3% 36.33 ± 24% interrupts.CPU78.IWI:IRQ_work_interrupts 106173 -2.4% 103635 interrupts.CPU78.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU78.MCP:Machine_check_polls 36301 ± 6% +12.8% 40936 interrupts.CPU78.NMI:Non-maskable_interrupts 36301 ± 6% +12.8% 40936 interrupts.CPU78.PMI:Performance_monitoring_interrupts 42.80 ± 33% -11.2% 38.00 ± 57% interrupts.CPU78.RES:Rescheduling_interrupts 0.80 ± 93% -100.0% 0.00 interrupts.CPU78.TLB:TLB_shootdowns 1163 ± 43% -51.3% 567.00 ± 46% interrupts.CPU79.CAL:Function_call_interrupts 45.20 ± 43% -45.4% 24.67 ± 11% interrupts.CPU79.IWI:IRQ_work_interrupts 105861 -1.4% 104332 interrupts.CPU79.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU79.MCP:Machine_check_polls 35532 ± 4% +17.1% 41611 ± 3% interrupts.CPU79.NMI:Non-maskable_interrupts 35532 ± 4% +17.1% 41611 ± 3% interrupts.CPU79.PMI:Performance_monitoring_interrupts 62.40 ± 66% -43.4% 35.33 ± 22% interrupts.CPU79.RES:Rescheduling_interrupts 1.00 ± 63% -66.7% 0.33 ±141% interrupts.CPU79.TLB:TLB_shootdowns 1145 ± 43% -17.6% 943.33 ± 76% interrupts.CPU8.CAL:Function_call_interrupts 44.80 ± 43% -52.4% 21.33 ± 9% interrupts.CPU8.IWI:IRQ_work_interrupts 106298 -1.6% 104562 interrupts.CPU8.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU8.MCP:Machine_check_polls 36034 ± 3% +11.6% 40213 interrupts.CPU8.NMI:Non-maskable_interrupts 36034 ± 3% +11.6% 40213 interrupts.CPU8.PMI:Performance_monitoring_interrupts 45.20 ± 50% -15.2% 38.33 ± 71% interrupts.CPU8.RES:Rescheduling_interrupts 0.60 ±200% +177.8% 1.67 ±141% interrupts.CPU8.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU80.371:PCI-MSI.69206021-edge.nvme1q5 0.00 -100.0% 0.00 interrupts.CPU80.376:PCI-MSI.68681733-edge.nvme0q5 1149 ± 43% -47.1% 607.67 ± 34% interrupts.CPU80.CAL:Function_call_interrupts 21.80 ± 7% +69.7% 37.00 ± 17% interrupts.CPU80.IWI:IRQ_work_interrupts 106798 -2.3% 104393 interrupts.CPU80.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU80.MCP:Machine_check_polls 35077 ± 6% +18.0% 41383 interrupts.CPU80.NMI:Non-maskable_interrupts 35077 ± 6% +18.0% 41383 interrupts.CPU80.PMI:Performance_monitoring_interrupts 77.80 ±104% -69.6% 23.67 ± 53% interrupts.CPU80.RES:Rescheduling_interrupts 5.40 ±163% -93.8% 0.33 ±141% interrupts.CPU80.TLB:TLB_shootdowns 1140 ± 43% -46.9% 605.00 ± 33% interrupts.CPU81.CAL:Function_call_interrupts 39.20 ± 80% +8.0% 42.33 ± 6% interrupts.CPU81.IWI:IRQ_work_interrupts 105037 -1.9% 103020 interrupts.CPU81.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU81.MCP:Machine_check_polls 37562 ± 8% +11.1% 41714 ± 2% interrupts.CPU81.NMI:Non-maskable_interrupts 37562 ± 8% +11.1% 41714 ± 2% interrupts.CPU81.PMI:Performance_monitoring_interrupts 43.60 ± 61% -40.4% 26.00 ± 21% interrupts.CPU81.RES:Rescheduling_interrupts 7.80 ±181% -95.7% 0.33 ±141% interrupts.CPU81.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU82.372:PCI-MSI.69206022-edge.nvme1q6 1162 ± 42% -45.8% 630.00 ± 52% interrupts.CPU82.CAL:Function_call_interrupts 47.20 ± 64% -39.3% 28.67 ± 35% interrupts.CPU82.IWI:IRQ_work_interrupts 106938 -2.3% 104486 interrupts.CPU82.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU82.MCP:Machine_check_polls 37757 ± 6% +9.0% 41157 ± 3% interrupts.CPU82.NMI:Non-maskable_interrupts 37757 ± 6% +9.0% 41157 ± 3% interrupts.CPU82.PMI:Performance_monitoring_interrupts 55.80 ± 82% -34.3% 36.67 ± 49% interrupts.CPU82.RES:Rescheduling_interrupts 1.80 ± 41% -81.5% 0.33 ±141% interrupts.CPU82.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU83.379:PCI-MSI.69206029-edge.nvme1q13 1182 ± 44% -47.4% 622.00 ± 42% interrupts.CPU83.CAL:Function_call_interrupts 37.80 ± 52% -1.2% 37.33 ± 27% interrupts.CPU83.IWI:IRQ_work_interrupts 105482 -0.7% 104697 interrupts.CPU83.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU83.MCP:Machine_check_polls 34286 ± 4% +20.7% 41384 interrupts.CPU83.NMI:Non-maskable_interrupts 34286 ± 4% +20.7% 41384 interrupts.CPU83.PMI:Performance_monitoring_interrupts 47.60 ± 69% -24.4% 36.00 ± 45% interrupts.CPU83.RES:Rescheduling_interrupts 3.60 ±147% -7.4% 3.33 ± 86% interrupts.CPU83.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU84.373:PCI-MSI.68681735-edge.nvme0q7 1185 ± 41% -53.1% 556.00 ± 48% interrupts.CPU84.CAL:Function_call_interrupts 45.00 ± 68% -34.8% 29.33 ± 33% interrupts.CPU84.IWI:IRQ_work_interrupts 106133 -1.3% 104799 interrupts.CPU84.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU84.MCP:Machine_check_polls 35125 ± 7% +17.1% 41123 interrupts.CPU84.NMI:Non-maskable_interrupts 35125 ± 7% +17.1% 41123 interrupts.CPU84.PMI:Performance_monitoring_interrupts 49.80 ± 56% -66.5% 16.67 ± 37% interrupts.CPU84.RES:Rescheduling_interrupts 0.60 ±133% +66.7% 1.00 ±141% interrupts.CPU84.TLB:TLB_shootdowns 1150 ± 44% -47.8% 600.33 ± 50% interrupts.CPU85.CAL:Function_call_interrupts 38.60 ± 79% -46.5% 20.67 ± 2% interrupts.CPU85.IWI:IRQ_work_interrupts 106438 -2.0% 104319 interrupts.CPU85.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU85.MCP:Machine_check_polls 37591 ± 6% +9.0% 40969 interrupts.CPU85.NMI:Non-maskable_interrupts 37591 ± 6% +9.0% 40969 interrupts.CPU85.PMI:Performance_monitoring_interrupts 45.60 ± 34% +33.8% 61.00 ± 30% interrupts.CPU85.RES:Rescheduling_interrupts 1.00 ± 63% +33.3% 1.33 ± 93% interrupts.CPU85.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU86.374:PCI-MSI.69206024-edge.nvme1q8 1184 ± 43% -45.9% 641.00 ± 51% interrupts.CPU86.CAL:Function_call_interrupts 23.40 ± 8% +56.7% 36.67 ± 26% interrupts.CPU86.IWI:IRQ_work_interrupts 104643 -1.6% 103010 interrupts.CPU86.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU86.MCP:Machine_check_polls 36619 ± 7% +12.2% 41099 interrupts.CPU86.NMI:Non-maskable_interrupts 36619 ± 7% +12.2% 41099 interrupts.CPU86.PMI:Performance_monitoring_interrupts 96.20 ± 69% -55.0% 43.33 ± 38% interrupts.CPU86.RES:Rescheduling_interrupts 0.80 ± 93% -58.3% 0.33 ±141% interrupts.CPU86.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU87.411:PCI-MSI.68681742-edge.nvme0q14 1161 ± 43% -45.8% 629.67 ± 51% interrupts.CPU87.CAL:Function_call_interrupts 38.40 ± 79% -45.3% 21.00 ± 3% interrupts.CPU87.IWI:IRQ_work_interrupts 105294 -0.4% 104894 interrupts.CPU87.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU87.MCP:Machine_check_polls 36854 ± 8% +11.0% 40894 ± 2% interrupts.CPU87.NMI:Non-maskable_interrupts 36854 ± 8% +11.0% 40894 ± 2% interrupts.CPU87.PMI:Performance_monitoring_interrupts 93.60 ± 62% -76.9% 21.67 ± 30% interrupts.CPU87.RES:Rescheduling_interrupts 13.60 ±192% -85.3% 2.00 ±108% interrupts.CPU87.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU88.375:PCI-MSI.69206025-edge.nvme1q9 1178 ± 43% -51.6% 569.67 ± 48% interrupts.CPU88.CAL:Function_call_interrupts 56.80 ± 56% -41.9% 33.00 ± 13% interrupts.CPU88.IWI:IRQ_work_interrupts 105543 -1.2% 104283 interrupts.CPU88.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU88.MCP:Machine_check_polls 36893 ± 6% +11.8% 41248 interrupts.CPU88.NMI:Non-maskable_interrupts 36893 ± 6% +11.8% 41248 interrupts.CPU88.PMI:Performance_monitoring_interrupts 68.60 ± 66% -44.1% 38.33 ± 19% interrupts.CPU88.RES:Rescheduling_interrupts 0.80 ± 93% +25.0% 1.00 interrupts.CPU88.TLB:TLB_shootdowns 1228 ± 35% -54.7% 557.00 ± 47% interrupts.CPU89.CAL:Function_call_interrupts 38.20 ± 53% -9.2% 34.67 ± 23% interrupts.CPU89.IWI:IRQ_work_interrupts 105435 -2.6% 102696 interrupts.CPU89.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU89.MCP:Machine_check_polls 36102 ± 10% +15.0% 41527 ± 2% interrupts.CPU89.NMI:Non-maskable_interrupts 36102 ± 10% +15.0% 41527 ± 2% interrupts.CPU89.PMI:Performance_monitoring_interrupts 92.80 ± 48% -70.9% 27.00 ± 42% interrupts.CPU89.RES:Rescheduling_interrupts 129.40 ±198% -99.2% 1.00 interrupts.CPU89.TLB:TLB_shootdowns 1172 ± 41% -42.2% 677.67 ± 35% interrupts.CPU9.CAL:Function_call_interrupts 68.00 ± 42% -57.8% 28.67 ± 40% interrupts.CPU9.IWI:IRQ_work_interrupts 106676 -2.3% 104256 interrupts.CPU9.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU9.MCP:Machine_check_polls 38201 ± 2% +6.9% 40850 ± 2% interrupts.CPU9.NMI:Non-maskable_interrupts 38201 ± 2% +6.9% 40850 ± 2% interrupts.CPU9.PMI:Performance_monitoring_interrupts 73.00 ± 32% -0.5% 72.67 ± 43% interrupts.CPU9.RES:Rescheduling_interrupts 0.20 ±200% +1900.0% 4.00 ±141% interrupts.CPU9.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU90.376:PCI-MSI.68681738-edge.nvme0q10 1178 ± 44% -52.5% 559.33 ± 49% interrupts.CPU90.CAL:Function_call_interrupts 30.20 ± 53% +1.5% 30.67 ± 30% interrupts.CPU90.IWI:IRQ_work_interrupts 103590 +0.1% 103729 interrupts.CPU90.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU90.MCP:Machine_check_polls 36362 ± 8% +13.2% 41148 interrupts.CPU90.NMI:Non-maskable_interrupts 36362 ± 8% +13.2% 41148 interrupts.CPU90.PMI:Performance_monitoring_interrupts 51.40 ± 51% -48.8% 26.33 ± 51% interrupts.CPU90.RES:Rescheduling_interrupts 1.40 ±106% -28.6% 1.00 interrupts.CPU90.TLB:TLB_shootdowns 1124 ± 43% -46.9% 597.67 ± 50% interrupts.CPU91.CAL:Function_call_interrupts 38.00 ± 51% +0.0% 38.00 ± 22% interrupts.CPU91.IWI:IRQ_work_interrupts 106425 ± 2% -1.8% 104491 interrupts.CPU91.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU91.MCP:Machine_check_polls 36002 ± 5% +15.3% 41517 ± 2% interrupts.CPU91.NMI:Non-maskable_interrupts 36002 ± 5% +15.3% 41517 ± 2% interrupts.CPU91.PMI:Performance_monitoring_interrupts 77.80 ± 59% -33.6% 51.67 ± 43% interrupts.CPU91.RES:Rescheduling_interrupts 0.40 ±122% +1650.0% 7.00 ±112% interrupts.CPU91.TLB:TLB_shootdowns 1166 ± 41% -48.7% 598.00 ± 39% interrupts.CPU92.CAL:Function_call_interrupts 31.00 ± 50% +4.3% 32.33 ± 27% interrupts.CPU92.IWI:IRQ_work_interrupts 105500 -1.5% 103918 interrupts.CPU92.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU92.MCP:Machine_check_polls 37063 ± 8% +12.1% 41532 ± 3% interrupts.CPU92.NMI:Non-maskable_interrupts 37063 ± 8% +12.1% 41532 ± 3% interrupts.CPU92.PMI:Performance_monitoring_interrupts 61.60 ± 35% -48.1% 32.00 ± 73% interrupts.CPU92.RES:Rescheduling_interrupts 1.00 ±109% +33.3% 1.33 ± 35% interrupts.CPU92.TLB:TLB_shootdowns 1178 ± 44% -51.8% 568.00 ± 46% interrupts.CPU93.CAL:Function_call_interrupts 70.80 ± 40% -68.9% 22.00 ± 7% interrupts.CPU93.IWI:IRQ_work_interrupts 104633 -0.5% 104066 interrupts.CPU93.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU93.MCP:Machine_check_polls 38032 ± 2% +7.7% 40967 ± 2% interrupts.CPU93.NMI:Non-maskable_interrupts 38032 ± 2% +7.7% 40967 ± 2% interrupts.CPU93.PMI:Performance_monitoring_interrupts 82.60 ± 62% -65.7% 28.33 ± 11% interrupts.CPU93.RES:Rescheduling_interrupts 1.00 -66.7% 0.33 ±141% interrupts.CPU93.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU94.378:PCI-MSI.68681740-edge.nvme0q12 0.00 -100.0% 0.00 interrupts.CPU94.378:PCI-MSI.69206028-edge.nvme1q12 1170 ± 43% -47.3% 617.33 ± 45% interrupts.CPU94.CAL:Function_call_interrupts 29.40 ± 55% +14.5% 33.67 ± 25% interrupts.CPU94.IWI:IRQ_work_interrupts 105992 -2.5% 103340 interrupts.CPU94.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU94.MCP:Machine_check_polls 34659 ± 5% +19.5% 41429 ± 2% interrupts.CPU94.NMI:Non-maskable_interrupts 34659 ± 5% +19.5% 41429 ± 2% interrupts.CPU94.PMI:Performance_monitoring_interrupts 69.80 ± 54% -65.1% 24.33 ± 10% interrupts.CPU94.RES:Rescheduling_interrupts 1.20 ± 62% -44.4% 0.67 ± 70% interrupts.CPU94.TLB:TLB_shootdowns 0.00 -100.0% 0.00 interrupts.CPU95.381:PCI-MSI.69206031-edge.nvme1q15 1255 ± 38% -51.1% 613.33 ± 40% interrupts.CPU95.CAL:Function_call_interrupts 35.80 ± 38% +0.6% 36.00 ± 27% interrupts.CPU95.IWI:IRQ_work_interrupts 106774 -2.7% 103921 interrupts.CPU95.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.CPU95.MCP:Machine_check_polls 42106 ± 9% -1.4% 41536 interrupts.CPU95.NMI:Non-maskable_interrupts 42106 ± 9% -1.4% 41536 interrupts.CPU95.PMI:Performance_monitoring_interrupts 181.80 ± 39% -60.0% 72.67 ± 16% interrupts.CPU95.RES:Rescheduling_interrupts 7.40 ± 13% -23.4% 5.67 ± 29% interrupts.CPU95.TLB:TLB_shootdowns 4228 ± 4% -33.5% 2813 ± 2% interrupts.IWI:IRQ_work_interrupts 10161513 -1.4% 10021491 interrupts.LOC:Local_timer_interrupts 0.00 -100.0% 0.00 interrupts.MCP:Machine_check_polls 3501659 +12.0% 3922994 interrupts.NMI:Non-maskable_interrupts 3501659 +12.0% 3922994 interrupts.PMI:Performance_monitoring_interrupts 7870 ± 19% -34.8% 5128 ± 9% interrupts.RES:Rescheduling_interrupts 0.00 -100.0% 0.00 interrupts.RTR:APIC_ICR_read_retries 1317 ±130% -77.8% 292.67 ± 12% interrupts.TLB:TLB_shootdowns 43.97 ± 12% -43.8 0.20 ±141% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 43.89 ± 12% -43.7 0.20 ±141% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 42.03 ± 14% -42.0 0.00 perf-profile.calltrace.cycles-pp.__mm_populate.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 41.95 ± 14% -42.0 0.00 perf-profile.calltrace.cycles-pp.populate_vma_page_range.__mm_populate.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 41.95 ± 14% -42.0 0.00 perf-profile.calltrace.cycles-pp.__get_user_pages.populate_vma_page_range.__mm_populate.vm_mmap_pgoff.ksys_mmap_pgoff 41.60 ± 14% -41.6 0.00 perf-profile.calltrace.cycles-pp.follow_page_pte.__get_user_pages.populate_vma_page_range.__mm_populate.vm_mmap_pgoff 49.03 ± 7% -40.1 8.92 ± 13% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 49.00 ± 7% -40.1 8.89 ± 14% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 48.85 ± 7% -40.0 8.81 ± 14% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe 27.05 ± 9% -25.3 1.71 ± 44% perf-profile.calltrace.cycles-pp.__munlock_pagevec.munlock_vma_pages_range.__do_munmap.__vm_munmap.__x64_sys_munmap 27.29 ± 9% -25.3 1.98 ± 39% perf-profile.calltrace.cycles-pp.munlock_vma_pages_range.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 23.70 ± 16% -23.7 0.00 perf-profile.calltrace.cycles-pp.lru_add_drain.follow_page_pte.__get_user_pages.populate_vma_page_range.__mm_populate 17.65 ± 11% -17.6 0.00 perf-profile.calltrace.cycles-pp.lru_add_drain_cpu.lru_add_drain.follow_page_pte.__get_user_pages.populate_vma_page_range 17.64 ± 11% -17.6 0.00 perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.follow_page_pte.__get_user_pages 17.56 ± 11% -17.6 0.00 perf-profile.calltrace.cycles-pp.mlock_vma_page.follow_page_pte.__get_user_pages.populate_vma_page_range.__mm_populate 17.53 ± 11% -17.5 0.00 perf-profile.calltrace.cycles-pp.isolate_lru_page.mlock_vma_page.follow_page_pte.__get_user_pages.populate_vma_page_range 17.26 ± 11% -17.3 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.isolate_lru_page.mlock_vma_page.follow_page_pte.__get_user_pages 17.18 ± 11% -17.2 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.isolate_lru_page.mlock_vma_page.follow_page_pte 17.12 ± 11% -17.1 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain.follow_page_pte 17.02 ± 11% -17.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain_cpu.lru_add_drain 17.27 ± 6% -13.6 3.65 ± 15% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 16.45 ± 6% -13.4 3.09 ± 18% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap 16.21 ± 5% -13.3 2.87 ± 20% perf-profile.calltrace.cycles-pp.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region.__do_munmap 16.36 ± 5% -13.3 3.04 ± 19% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap 13.84 ± 3% -13.0 0.87 ± 78% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain.free_pages_and_swap_cache.tlb_flush_mmu 13.75 ± 3% -13.0 0.80 ± 79% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain.free_pages_and_swap_cache 13.58 ± 9% -12.9 0.70 ± 80% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__munlock_pagevec.munlock_vma_pages_range.__do_munmap.__vm_munmap 14.59 ± 4% -12.9 1.72 ± 34% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region 13.19 ± 9% -12.8 0.35 ±141% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.__munlock_pagevec.munlock_vma_pages_range.__do_munmap 14.46 ± 4% -12.8 1.65 ± 36% perf-profile.calltrace.cycles-pp.free_pages_and_swap_cache.tlb_flush_mmu.zap_pte_range.unmap_page_range.unmap_vmas 14.42 ± 4% -12.8 1.63 ± 37% perf-profile.calltrace.cycles-pp.lru_add_drain.free_pages_and_swap_cache.tlb_flush_mmu.zap_pte_range.unmap_page_range 13.13 ± 9% -12.8 0.34 ±141% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.__munlock_pagevec.munlock_vma_pages_range 13.14 ± 8% -12.8 0.36 ±141% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__munlock_pagevec.munlock_vma_pages_range.__do_munmap.__vm_munmap 14.39 ± 3% -12.8 1.61 ± 37% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.lru_add_drain.free_pages_and_swap_cache.tlb_flush_mmu.zap_pte_range 13.06 ± 8% -12.7 0.33 ±141% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.__munlock_pagevec.munlock_vma_pages_range.__do_munmap 6.06 ± 33% -6.1 0.00 perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.lru_add_drain.follow_page_pte.__get_user_pages.populate_vma_page_range 5.85 ± 33% -5.8 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain.follow_page_pte.__get_user_pages 5.82 ± 33% -5.8 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.lru_add_drain.follow_page_pte 1.69 ± 32% -1.7 0.00 perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.60 ± 32% -1.6 0.00 perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 0.93 ± 33% -0.9 0.00 perf-profile.calltrace.cycles-pp.asm_exc_page_fault 0.92 ±125% -0.9 0.00 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe 0.75 ± 24% -0.8 0.00 perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault 0.73 ± 24% -0.7 0.00 perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 1.29 ± 25% -0.6 0.74 ± 6% perf-profile.calltrace.cycles-pp.remove_vma.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 1.22 ± 25% -0.5 0.70 ± 5% perf-profile.calltrace.cycles-pp.kmem_cache_free.remove_vma.__do_munmap.__vm_munmap.__x64_sys_munmap 1.65 ± 20% -0.5 1.17 ± 5% perf-profile.calltrace.cycles-pp.__split_vma.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.45 ± 85% -0.5 0.00 perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap 1.89 ± 20% -0.4 1.44 ± 6% perf-profile.calltrace.cycles-pp.__split_vma.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 0.43 ± 84% -0.4 0.00 perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.35 ± 82% -0.3 0.00 perf-profile.calltrace.cycles-pp.vm_area_dup.__split_vma.__do_munmap.__vm_munmap.__x64_sys_munmap 0.30 ±122% -0.3 0.00 perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.unmap_region.__do_munmap.__vm_munmap 0.27 ±122% -0.3 0.00 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.23 ±122% -0.2 0.00 perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 1.16 ± 20% -0.2 0.93 ± 5% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.do_madvise.__x64_sys_madvise.do_syscall_64 0.21 ±122% -0.2 0.00 perf-profile.calltrace.cycles-pp.find_vma.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64 0.21 ±122% -0.2 0.00 perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.zap_pte_range.unmap_page_range.unmap_vmas.unmap_region 1.27 ± 20% -0.2 1.09 ± 6% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.__do_munmap.__vm_munmap.__x64_sys_munmap 0.12 ±200% -0.1 0.00 perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 0.10 ±200% -0.1 0.00 perf-profile.calltrace.cycles-pp.vm_area_dup.__split_vma.do_madvise.__x64_sys_madvise.do_syscall_64 0.10 ±200% -0.1 0.00 perf-profile.calltrace.cycles-pp.vma_interval_tree_remove.unlink_file_vma.free_pgtables.unmap_region.__do_munmap 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.syscall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.syscall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe.syscall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_init_module.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_one_initcall.do_init_module.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.driver_register.do_one_initcall.do_init_module.load_module.__do_sys_finit_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.bus_add_driver.driver_register.do_one_initcall.do_init_module.load_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.bus_for_each_dev.bus_add_driver.driver_register.do_one_initcall.do_init_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__driver_attach.bus_for_each_dev.bus_add_driver.driver_register.do_one_initcall 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.device_driver_attach.__driver_attach.bus_for_each_dev.bus_add_driver.driver_register 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev.bus_add_driver 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.really_probe.driver_probe_device.device_driver_attach.__driver_attach.bus_for_each_dev 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.nvdimm_bus_probe.really_probe.driver_probe_device.device_driver_attach.__driver_attach 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.dax_pmem_compat_probe.nvdimm_bus_probe.really_probe.driver_probe_device.device_driver_attach 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.dev_dax_probe.dax_pmem_compat_probe.nvdimm_bus_probe.really_probe.driver_probe_device 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.devm_memremap_pages.dev_dax_probe.dax_pmem_compat_probe.nvdimm_bus_probe.really_probe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.memremap_pages.devm_memremap_pages.dev_dax_probe.dax_pmem_compat_probe.nvdimm_bus_probe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.pagemap_range.memremap_pages.devm_memremap_pages.dev_dax_probe.dax_pmem_compat_probe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.memmap_init_zone_device.pagemap_range.memremap_pages.devm_memremap_pages.dev_dax_probe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.generic_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write.ksys_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write.vfs_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.drm_fb_helper_dirty_work.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.memcpy_erms.drm_fb_helper_dirty_work.process_one_work.worker_thread.kthread 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.finished_loading.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__mutex_lock.finished_loading.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.__generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.finished_loading.load_module.__do_sys_finit_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.shmem_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.prepare_to_wait_event.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.load_module.__do_sys_finit_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.khugepaged.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.khugepaged_scan_mm_slot.khugepaged.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.khugepaged_scan_pmd.khugepaged_scan_mm_slot.khugepaged.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.collapse_huge_page.khugepaged_scan_pmd.khugepaged_scan_mm_slot.khugepaged.kthread 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.iov_iter_fault_in_readable.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.new_sync_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__get_user_nocheck_1.iov_iter_fault_in_readable.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.unlock_page.shmem_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.copy_page.collapse_huge_page.khugepaged_scan_pmd.khugepaged_scan_mm_slot.khugepaged 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__libc_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.asm_exc_page_fault.__get_user_nocheck_1.iov_iter_fault_in_readable.generic_perform_write.__generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__libc_start_main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.main.__libc_start_main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.cmd_record.run_builtin.main.__libc_start_main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.__get_user_nocheck_1.iov_iter_fault_in_readable.generic_perform_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.__get_user_nocheck_1.iov_iter_fault_in_readable 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common.__x64_sys_execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.find_lock_entry.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.change_page_attr_set_clr.set_memory_ro.module_enable_ro.load_module.__do_sys_finit_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.module_enable_ro.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.set_memory_ro.module_enable_ro.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.record__mmap_read_evlist.cmd_record.run_builtin.main.__libc_start_main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.read 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.perf_mmap__push.record__mmap_read_evlist.cmd_record.run_builtin.main 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.load_module.__do_sys_finit_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.finish_wait.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.__get_user_nocheck_1 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.perf_mmap__read_head.perf_mmap__push.record__mmap_read_evlist.cmd_record.run_builtin 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.update_load_avg.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.copy_process._do_fork.__do_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.task_work_run.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.task_numa_work.task_work_run.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__pthread_enable_asynccancel 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.devkmsg_emit.devkmsg_write.cold.new_sync_write.vfs_write.ksys_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.up_write.generic_file_write_iter.new_sync_write.vfs_write.ksys_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rcu_gp_kthread.kthread.ret_from_fork 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.change_protection.change_prot_numa.task_numa_work.task_work_run.exit_to_user_mode_prepare 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.change_prot_numa.task_numa_work.task_work_run.exit_to_user_mode_prepare.irqentry_exit_to_user_mode 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.on_each_cpu.cpa_flush.change_page_attr_set_clr.set_memory_ro.module_enable_ro 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu.cpa_flush.change_page_attr_set_clr.set_memory_ro 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.cpa_flush.change_page_attr_set_clr.set_memory_ro.module_enable_ro.load_module 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.secondary_startup_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__fget_files.__fget_light.__fdget_pos.ksys_write.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.hrtimer_active.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__pthread_disable_asynccancel 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.mutex_unlock.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__init_single_page.memmap_init_zone_device.pagemap_range.memremap_pages.devm_memremap_pages 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.find_get_entry.find_lock_entry.shmem_getpage_gfp.shmem_write_begin.generic_perform_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold.new_sync_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve.do_execveat_common 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.run_timer_softirq.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.shmem_add_to_page_cache.shmem_getpage_gfp.shmem_write_begin.generic_perform_write.__generic_file_write_iter 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.call_timer_fn.run_timer_softirq.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit.devkmsg_write.cold 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit.devkmsg_emit 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.vprintk_emit 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.io_serial_in.wait_for_xmitr.serial8250_console_putchar.uart_console_write.serial8250_console_write 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__mutex_lock.load_module.__do_sys_finit_module.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.dup_mm.copy_process._do_fork.__do_sys_clone.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.load_module.__do_sys_finit_module.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.mmput.begin_new_exec.load_elf_binary.exec_binprm.bprm_execve 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.begin_new_exec.load_elf_binary.exec_binprm 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.dup_mmap.dup_mm.copy_process._do_fork.__do_sys_clone 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.filemap_map_pages.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.update_curr.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.memcpy_erms.drm_fb_helper_dirty_work.process_one_work.worker_thread 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.pmdp_huge_clear_flush.collapse_huge_page.khugepaged_scan_pmd.khugepaged_scan_mm_slot 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.pmdp_huge_clear_flush.collapse_huge_page.khugepaged_scan_pmd.khugepaged_scan_mm_slot.khugepaged 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.flush_tlb_mm_range.pmdp_huge_clear_flush.collapse_huge_page.khugepaged_scan_pmd 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.wait4 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.setlocale 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.seq_read.proc_reg_read.vfs_read.ksys_read.do_syscall_64 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.seq_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.copy_page.wp_page_copy.__handle_mm_fault.handle_mm_fault.do_user_addr_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu.__change_page_attr_set_clr.__change_page_attr_set_clr.change_page_attr_set_clr 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.on_each_cpu.__change_page_attr_set_clr.__change_page_attr_set_clr.change_page_attr_set_clr.set_memory_ro 0.00 +0.0 0.00 perf-profile.calltrace.cycles-pp.__change_page_attr_set_clr.__change_page_attr_set_clr.change_page_attr_set_clr.set_memory_ro.module_enable_ro 0.55 ± 53% +0.1 0.63 ± 7% perf-profile.calltrace.cycles-pp.vma_interval_tree_insert.__vma_adjust.__split_vma.__do_munmap.__vm_munmap 0.42 ± 82% +0.2 0.63 ± 8% perf-profile.calltrace.cycles-pp.vma_interval_tree_insert.__vma_adjust.__split_vma.do_madvise.__x64_sys_madvise 1.36 ± 24% +0.3 1.68 ± 9% perf-profile.calltrace.cycles-pp.find_vma_prev.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.34 ± 24% +0.3 1.67 ± 9% perf-profile.calltrace.cycles-pp.find_vma.find_vma_prev.do_madvise.__x64_sys_madvise.do_syscall_64 0.00 +0.3 0.35 ± 70% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.do_madvise 0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.do_madvise.__x64_sys_madvise 0.00 +0.6 0.58 ± 2% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.do_madvise.__x64_sys_madvise.do_syscall_64 0.00 +0.6 0.62 ± 3% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 97.91 +1.7 99.63 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 96.78 +2.4 99.22 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +9.1 9.05 perf-profile.calltrace.cycles-pp.xas_find.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.64 ± 22% +85.5 89.18 perf-profile.calltrace.cycles-pp.do_madvise.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.67 ± 22% +86.1 89.78 perf-profile.calltrace.cycles-pp.__x64_sys_madvise.do_syscall_64.entry_SYSCALL_64_after_hwframe 80.11 ± 5% -78.0 2.12 ± 54% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 51.71 ± 5% -49.2 2.49 ± 39% perf-profile.children.cycles-pp.pagevec_lru_move_fn 50.07 ± 6% -48.4 1.62 ± 51% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 43.97 ± 12% -43.5 0.48 ± 25% perf-profile.children.cycles-pp.ksys_mmap_pgoff 43.89 ± 12% -43.4 0.47 ± 25% perf-profile.children.cycles-pp.vm_mmap_pgoff 42.03 ± 14% -41.9 0.08 ± 20% perf-profile.children.cycles-pp.__mm_populate 41.95 ± 14% -41.9 0.07 ± 20% perf-profile.children.cycles-pp.populate_vma_page_range 41.95 ± 14% -41.9 0.07 ± 20% perf-profile.children.cycles-pp.__get_user_pages 41.77 ± 14% -41.6 0.20 ± 11% perf-profile.children.cycles-pp.follow_page_pte 49.04 ± 7% -40.1 8.92 ± 13% perf-profile.children.cycles-pp.__x64_sys_munmap 49.00 ± 7% -40.1 8.90 ± 13% perf-profile.children.cycles-pp.__vm_munmap 48.87 ± 7% -40.0 8.82 ± 14% perf-profile.children.cycles-pp.__do_munmap 38.17 ± 9% -36.5 1.66 ± 36% perf-profile.children.cycles-pp.lru_add_drain 30.43 ± 5% -29.8 0.62 ± 54% perf-profile.children.cycles-pp._raw_spin_lock_irq 27.06 ± 9% -25.3 1.72 ± 43% perf-profile.children.cycles-pp.__munlock_pagevec 27.29 ± 9% -25.3 1.98 ± 39% perf-profile.children.cycles-pp.munlock_vma_pages_range 17.70 ± 11% -17.7 0.00 perf-profile.children.cycles-pp.lru_add_drain_cpu 17.57 ± 11% -17.6 0.00 perf-profile.children.cycles-pp.isolate_lru_page 17.56 ± 11% -17.6 0.00 perf-profile.children.cycles-pp.mlock_vma_page 17.28 ± 6% -13.6 3.66 ± 15% perf-profile.children.cycles-pp.unmap_region 16.45 ± 6% -13.4 3.10 ± 18% perf-profile.children.cycles-pp.unmap_vmas 16.22 ± 5% -13.3 2.87 ± 20% perf-profile.children.cycles-pp.zap_pte_range 16.37 ± 5% -13.3 3.04 ± 19% perf-profile.children.cycles-pp.unmap_page_range 14.62 ± 4% -12.9 1.75 ± 34% perf-profile.children.cycles-pp.tlb_flush_mmu 14.46 ± 4% -12.8 1.65 ± 36% perf-profile.children.cycles-pp.free_pages_and_swap_cache 1.69 ± 32% -1.3 0.37 ± 27% perf-profile.children.cycles-pp.do_mmap 1.60 ± 32% -1.3 0.35 ± 26% perf-profile.children.cycles-pp.mmap_region 3.54 ± 20% -0.9 2.61 ± 6% perf-profile.children.cycles-pp.__split_vma 0.94 ± 33% -0.9 0.02 ±141% perf-profile.children.cycles-pp.asm_exc_page_fault 0.88 ± 20% -0.8 0.07 ± 25% perf-profile.children.cycles-pp.handle_mm_fault 0.76 ± 24% -0.7 0.02 ±141% perf-profile.children.cycles-pp.exc_page_fault 0.77 ± 20% -0.7 0.05 ± 72% perf-profile.children.cycles-pp.__handle_mm_fault 0.74 ± 24% -0.7 0.02 ±141% perf-profile.children.cycles-pp.do_user_addr_fault 1.06 ± 99% -0.7 0.38 ± 6% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.68 ± 19% -0.7 0.02 ±141% perf-profile.children.cycles-pp.do_fault 1.30 ± 25% -0.5 0.75 ± 6% perf-profile.children.cycles-pp.remove_vma 0.93 ± 26% -0.5 0.39 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 1.23 ± 25% -0.5 0.70 ± 5% perf-profile.children.cycles-pp.kmem_cache_free 0.92 ± 21% -0.4 0.48 ± 4% perf-profile.children.cycles-pp.vm_area_dup 2.43 ± 20% -0.4 2.03 ± 6% perf-profile.children.cycles-pp.__vma_adjust 0.48 ± 6% -0.3 0.15 ± 19% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.39 ± 30% -0.3 0.08 ± 30% perf-profile.children.cycles-pp.vma_link 0.62 ± 9% -0.3 0.33 ± 9% perf-profile.children.cycles-pp.release_pages 0.26 ± 19% -0.3 0.00 perf-profile.children.cycles-pp.alloc_set_pte 0.30 ± 37% -0.2 0.06 ± 19% perf-profile.children.cycles-pp.vm_area_alloc 0.36 ± 19% -0.2 0.14 ± 9% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.22 ± 23% -0.2 0.00 perf-profile.children.cycles-pp.native_irq_return_iret 0.25 ± 31% -0.2 0.04 ± 76% perf-profile.children.cycles-pp.perf_event_mmap 0.21 ± 15% -0.2 0.00 perf-profile.children.cycles-pp.filemap_map_pages 0.20 ±102% -0.2 0.00 perf-profile.children.cycles-pp.irqentry_exit_to_user_mode 0.65 ± 27% -0.2 0.45 ± 6% perf-profile.children.cycles-pp.free_pgtables 0.20 ± 21% -0.2 0.00 perf-profile.children.cycles-pp.find_get_entry 0.19 ± 24% -0.2 0.00 perf-profile.children.cycles-pp.__do_fault 0.18 ± 19% -0.2 0.00 perf-profile.children.cycles-pp.shmem_getpage_gfp 0.18 ± 18% -0.2 0.00 perf-profile.children.cycles-pp.page_add_file_rmap 0.42 ± 21% -0.2 0.25 ± 5% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.18 ± 22% -0.2 0.00 perf-profile.children.cycles-pp.shmem_fault 0.17 ± 24% -0.2 0.00 perf-profile.children.cycles-pp.finish_fault 0.57 ± 27% -0.2 0.40 ± 7% perf-profile.children.cycles-pp.unlink_file_vma 0.30 ± 24% -0.2 0.14 ± 8% perf-profile.children.cycles-pp.refill_obj_stock 0.34 ± 29% -0.2 0.18 ± 2% perf-profile.children.cycles-pp.__vma_link_rb 0.17 ± 3% -0.2 0.02 ±141% perf-profile.children.cycles-pp.mem_cgroup_page_lruvec 0.15 ± 26% -0.2 0.00 perf-profile.children.cycles-pp.sync_regs 0.15 ± 2% -0.1 0.00 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.24 ± 21% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.13 ± 25% -0.1 0.00 perf-profile.children.cycles-pp.find_lock_entry 0.13 ± 12% -0.1 0.00 perf-profile.children.cycles-pp.__mod_node_page_state 0.55 ± 26% -0.1 0.42 ± 5% perf-profile.children.cycles-pp.vma_interval_tree_remove 0.31 ± 21% -0.1 0.17 ± 5% perf-profile.children.cycles-pp.flush_tlb_func_common 0.24 ± 4% -0.1 0.11 ± 22% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.14 ± 20% -0.1 0.02 ±141% perf-profile.children.cycles-pp.xas_load 0.16 ± 11% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.__mod_lruvec_state 0.27 ± 21% -0.1 0.15 ± 5% perf-profile.children.cycles-pp.native_flush_tlb_one_user 0.19 ± 19% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.__rb_insert_augmented 0.12 ± 3% -0.1 0.00 perf-profile.children.cycles-pp.lru_cache_add 0.20 ± 23% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.___might_sleep 0.18 ± 20% -0.1 0.07 perf-profile.children.cycles-pp.__mod_memcg_state 0.21 ± 27% -0.1 0.11 ± 8% perf-profile.children.cycles-pp.drain_obj_stock 0.11 ± 4% -0.1 0.00 perf-profile.children.cycles-pp.putback_lru_page 0.18 ± 21% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.down_write_killable 0.17 ± 32% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 0.21 ± 23% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.page_remove_rmap 1.39 ± 21% -0.1 1.29 ± 7% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.20 ± 26% -0.1 0.11 ± 8% perf-profile.children.cycles-pp.page_counter_uncharge 0.09 ± 32% -0.1 0.00 perf-profile.children.cycles-pp.d_path 0.39 ± 11% -0.1 0.30 ± 14% perf-profile.children.cycles-pp.mark_page_accessed 0.20 ± 24% -0.1 0.11 ± 8% perf-profile.children.cycles-pp.page_counter_cancel 0.09 ± 25% -0.1 0.00 perf-profile.children.cycles-pp.security_mmap_file 0.14 ± 22% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.obj_cgroup_charge 0.14 ± 20% -0.1 0.05 perf-profile.children.cycles-pp.__entry_text_start 0.09 ± 20% -0.1 0.00 perf-profile.children.cycles-pp.__might_sleep 0.13 ± 22% -0.1 0.05 perf-profile.children.cycles-pp.up_write 0.08 ± 22% -0.1 0.00 perf-profile.children.cycles-pp.fault_dirty_shared_page 0.09 ± 19% -0.1 0.02 ±141% perf-profile.children.cycles-pp._cond_resched 0.19 ± 29% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.__rb_erase_color 0.19 ± 33% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.__slab_alloc 0.07 ± 23% -0.1 0.00 perf-profile.children.cycles-pp.syscall_enter_from_user_mode 0.07 ± 5% -0.1 0.00 perf-profile.children.cycles-pp.__libc_write 0.09 ± 11% -0.1 0.02 ±141% perf-profile.children.cycles-pp.ksys_write 0.09 ± 11% -0.1 0.02 ±141% perf-profile.children.cycles-pp.vfs_write 0.07 ± 24% -0.1 0.00 perf-profile.children.cycles-pp.tlb_finish_mmu 0.07 ± 18% -0.1 0.00 perf-profile.children.cycles-pp.__slab_free 0.07 ± 20% -0.1 0.00 perf-profile.children.cycles-pp.vma_interval_tree_augment_rotate 0.14 ± 23% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.__memcg_kmem_uncharge 0.08 ± 12% -0.1 0.02 ±141% perf-profile.children.cycles-pp.new_sync_write 0.06 ± 7% -0.1 0.00 perf-profile.children.cycles-pp.generic_file_write_iter 0.06 ± 7% -0.1 0.00 perf-profile.children.cycles-pp.__generic_file_write_iter 0.18 ± 4% -0.1 0.12 ± 18% perf-profile.children.cycles-pp.__list_add_valid 0.06 ± 18% -0.1 0.00 perf-profile.children.cycles-pp.cpumask_any_but 0.06 ± 6% -0.1 0.00 perf-profile.children.cycles-pp.generic_perform_write 0.12 ± 21% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.down_write 0.11 ± 22% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.vmacache_find 0.06 ± 51% -0.1 0.00 perf-profile.children.cycles-pp.ret_from_fork 0.06 ± 51% -0.1 0.00 perf-profile.children.cycles-pp.kthread 0.17 ± 36% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.___slab_alloc 0.11 ± 28% -0.0 0.06 ± 16% perf-profile.children.cycles-pp.vma_merge 0.05 ± 53% -0.0 0.00 perf-profile.children.cycles-pp.page_mapping 0.28 ± 7% -0.0 0.24 ± 14% perf-profile.children.cycles-pp.workingset_age_nonresident 0.11 ± 15% -0.0 0.06 perf-profile.children.cycles-pp.free_unref_page_list 0.30 ± 7% -0.0 0.26 ± 15% perf-profile.children.cycles-pp.workingset_activation 0.04 ± 51% -0.0 0.00 perf-profile.children.cycles-pp.follow_page_mask 0.04 ± 87% -0.0 0.00 perf-profile.children.cycles-pp.prepend_path 0.44 ± 6% -0.0 0.40 ± 19% perf-profile.children.cycles-pp.__activate_page 0.04 ± 85% -0.0 0.00 perf-profile.children.cycles-pp.perf_iterate_sb 0.04 ± 83% -0.0 0.00 perf-profile.children.cycles-pp.userfaultfd_unmap_prep 0.04 ± 82% -0.0 0.00 perf-profile.children.cycles-pp.syscall 0.04 ± 82% -0.0 0.00 perf-profile.children.cycles-pp.__do_sys_finit_module 0.04 ± 82% -0.0 0.00 perf-profile.children.cycles-pp.load_module 0.04 ± 83% -0.0 0.00 perf-profile.children.cycles-pp.vma_gap_callbacks_rotate 0.04 ± 83% -0.0 0.00 perf-profile.children.cycles-pp.__memcg_kmem_charge 0.03 ± 82% -0.0 0.00 perf-profile.children.cycles-pp.up_read 0.03 ± 82% -0.0 0.00 perf-profile.children.cycles-pp.tlb_gather_mmu 0.03 ±123% -0.0 0.00 perf-profile.children.cycles-pp.get_unmapped_area 0.13 ± 20% -0.0 0.10 ± 16% perf-profile.children.cycles-pp.__list_del_entry_valid 0.13 ± 13% -0.0 0.11 ± 12% perf-profile.children.cycles-pp.__munlock_isolate_lru_page 0.02 ±125% -0.0 0.00 perf-profile.children.cycles-pp.memcpy_erms 0.02 ±125% -0.0 0.00 perf-profile.children.cycles-pp.common_file_perm 0.02 ±122% -0.0 0.00 perf-profile.children.cycles-pp.rcu_all_qs 0.02 ±122% -0.0 0.00 perf-profile.children.cycles-pp.page_counter_try_charge 0.02 ±122% -0.0 0.00 perf-profile.children.cycles-pp.__count_memcg_events 0.02 ±122% -0.0 0.00 perf-profile.children.cycles-pp.downgrade_write 0.02 ±123% -0.0 0.00 perf-profile.children.cycles-pp.fput_many 0.02 ±123% -0.0 0.00 perf-profile.children.cycles-pp.put_cpu_partial 0.02 ±123% -0.0 0.00 perf-profile.children.cycles-pp.set_page_dirty 0.02 ±122% -0.0 0.00 perf-profile.children.cycles-pp.__set_page_dirty_no_writeback 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.vprintk_emit 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.console_unlock 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.prepend_name 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.__fget_files 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.unlock_page 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.activate_page 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.serial8250_console_write 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.uart_console_write 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp._find_next_bit 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.khugepaged 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.khugepaged_scan_mm_slot 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.khugepaged_scan_pmd 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.collapse_huge_page 0.01 ±200% -0.0 0.00 perf-profile.children.cycles-pp.__remove_shared_vm_struct 0.08 ± 13% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.try_grab_page 0.08 ± 24% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.vmacache_update 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_init_module 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_one_initcall 0.00 +0.0 0.00 perf-profile.children.cycles-pp.driver_register 0.00 +0.0 0.00 perf-profile.children.cycles-pp.bus_add_driver 0.00 +0.0 0.00 perf-profile.children.cycles-pp.bus_for_each_dev 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__driver_attach 0.00 +0.0 0.00 perf-profile.children.cycles-pp.device_driver_attach 0.00 +0.0 0.00 perf-profile.children.cycles-pp.driver_probe_device 0.00 +0.0 0.00 perf-profile.children.cycles-pp.really_probe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.nvdimm_bus_probe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dax_pmem_compat_probe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dev_dax_probe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.devm_memremap_pages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.memremap_pages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pagemap_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.memmap_init_zone_device 0.00 +0.0 0.00 perf-profile.children.cycles-pp.worker_thread 0.00 +0.0 0.00 perf-profile.children.cycles-pp.process_one_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.drm_fb_helper_dirty_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__mutex_lock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.00 +0.0 0.00 perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copyin 0.00 +0.0 0.00 perf-profile.children.cycles-pp.osq_lock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.finished_loading 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shmem_write_end 0.00 +0.0 0.00 perf-profile.children.cycles-pp.prepare_to_wait_event 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shmem_write_begin 0.00 +0.0 0.00 perf-profile.children.cycles-pp.iov_iter_fault_in_readable 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__get_user_nocheck_1 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irq_exit_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_execve 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_execveat_common 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__softirqentry_text_start 0.00 +0.0 0.00 perf-profile.children.cycles-pp.execve 0.00 +0.0 0.00 perf-profile.children.cycles-pp.on_each_cpu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.smp_call_function_many_cond 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_softirq_own_stack 0.00 +0.0 0.00 perf-profile.children.cycles-pp.bprm_execve 0.00 +0.0 0.00 perf-profile.children.cycles-pp.change_page_attr_set_clr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__libc_fork 0.00 +0.0 0.00 perf-profile.children.cycles-pp.exec_binprm 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__libc_start_main 0.00 +0.0 0.00 perf-profile.children.cycles-pp.main 0.00 +0.0 0.00 perf-profile.children.cycles-pp.run_builtin 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cmd_record 0.00 +0.0 0.00 perf-profile.children.cycles-pp.load_elf_binary 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.00 +0.0 0.00 perf-profile.children.cycles-pp.write 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sched_text_start 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__fdget_pos 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cpa_flush 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__do_sys_clone 0.00 +0.0 0.00 perf-profile.children.cycles-pp._do_fork 0.00 +0.0 0.00 perf-profile.children.cycles-pp.try_to_wake_up 0.00 +0.0 0.00 perf-profile.children.cycles-pp.module_enable_ro 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_memory_ro 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ksys_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vfs_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.record__mmap_read_evlist 0.00 +0.0 0.00 perf-profile.children.cycles-pp.schedule 0.00 +0.0 0.00 perf-profile.children.cycles-pp.read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mmput 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_filp_open 0.00 +0.0 0.00 perf-profile.children.cycles-pp.path_openat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_mmap__push 0.00 +0.0 0.00 perf-profile.children.cycles-pp.finish_wait 0.00 +0.0 0.00 perf-profile.children.cycles-pp.exit_mmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_sys_open 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_sys_openat2 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_mmap__read_head 0.00 +0.0 0.00 perf-profile.children.cycles-pp.select_task_rq_fair 0.00 +0.0 0.00 perf-profile.children.cycles-pp._vm_unmap_aliases 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_process 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_exit_group 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_group_exit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_exit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.seq_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__purge_vmap_area_lazy 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pthread_enable_asynccancel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.devkmsg_write.cold 0.00 +0.0 0.00 perf-profile.children.cycles-pp.devkmsg_emit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__init_single_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wp_page_copy 0.00 +0.0 0.00 perf-profile.children.cycles-pp.change_protection 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__fget_light 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_gp_kthread 0.00 +0.0 0.00 perf-profile.children.cycles-pp.get_page_from_freelist 0.00 +0.0 0.00 perf-profile.children.cycles-pp.load_balance 0.00 +0.0 0.00 perf-profile.children.cycles-pp.change_prot_numa 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mutex_unlock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.secondary_startup_64 0.00 +0.0 0.00 perf-profile.children.cycles-pp.start_secondary 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cpu_startup_entry 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_idle 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.0 0.00 perf-profile.children.cycles-pp.hrtimer_active 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pthread_disable_asynccancel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cpuidle_enter 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cpuidle_enter_state 0.00 +0.0 0.00 perf-profile.children.cycles-pp.intel_idle 0.00 +0.0 0.00 perf-profile.children.cycles-pp.begin_new_exec 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mutex_lock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.run_timer_softirq 0.00 +0.0 0.00 perf-profile.children.cycles-pp.io_serial_in 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shmem_add_to_page_cache 0.00 +0.0 0.00 perf-profile.children.cycles-pp.call_timer_fn 0.00 +0.0 0.00 perf-profile.children.cycles-pp.walk_component 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wait_for_xmitr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.clear_page_erms 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dup_mm 0.00 +0.0 0.00 perf-profile.children.cycles-pp.link_path_walk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_core 0.00 +0.0 0.00 perf-profile.children.cycles-pp.serial8250_console_putchar 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__vunmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.change_p4d_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_pfnblock_flags_mask 0.00 +0.0 0.00 perf-profile.children.cycles-pp.find_busiest_group 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_mmap_fault 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dup_mmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_memory_x 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_sd_lb_stats 0.00 +0.0 0.00 perf-profile.children.cycles-pp.select_idle_sibling 0.00 +0.0 0.00 perf-profile.children.cycles-pp.prep_new_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.proc_reg_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.enqueue_task_fair 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_anonymous_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__update_load_avg_se 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ttwu_do_activate 0.00 +0.0 0.00 perf-profile.children.cycles-pp.setlocale 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__wake_up_common_lock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.find_idlest_group 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +0.0 0.00 perf-profile.children.cycles-pp.alloc_pages_vma 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__wake_up_common 0.00 +0.0 0.00 perf-profile.children.cycles-pp.enqueue_entity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.flush_tlb_kernel_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.autoremove_wake_function 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_do_batch 0.00 +0.0 0.00 perf-profile.children.cycles-pp.schedule_timeout 0.00 +0.0 0.00 perf-profile.children.cycles-pp.force_qs_rnp 0.00 +0.0 0.00 perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_huge_pmd_numa_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.migrate_misplaced_transhuge_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.down_read_trylock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.migrate_page_copy 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irqtime_account_irq 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irq_work_run_list 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__open64_nocancel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pipe_write 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__lookup_slow 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mem_cgroup_charge 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irq_work_single 0.00 +0.0 0.00 perf-profile.children.cycles-pp.newidle_balance 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rmqueue 0.00 +0.0 0.00 perf-profile.children.cycles-pp.new_sync_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sched_exec 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_cfs_group 0.00 +0.0 0.00 perf-profile.children.cycles-pp.free_module 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mutex_spin_on_owner 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wake_up_new_task 0.00 +0.0 0.00 perf-profile.children.cycles-pp.run_local_timers 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shmem_alloc_and_acct_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.asm_sysvec_irq_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sysvec_irq_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sysvec_irq_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.arch_scale_freq_tick 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__account_scheduler_latency 0.00 +0.0 0.00 perf-profile.children.cycles-pp.diskstats_show 0.00 +0.0 0.00 perf-profile.children.cycles-pp.smpboot_thread_fn 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_page_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.filename_lookup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.available_idle_cpu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.path_lookupat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irq_work_run 0.00 +0.0 0.00 perf-profile.children.cycles-pp.printk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.unlink_anon_vmas 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wait4 0.00 +0.0 0.00 perf-profile.children.cycles-pp.alloc_empty_file 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__alloc_file 0.00 +0.0 0.00 perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_irq_load_avg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sched_setaffinity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.lookup_fast 0.00 +0.0 0.00 perf-profile.children.cycles-pp.step_into 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__clear_user 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shmem_alloc_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.d_alloc_parallel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sched_clock_cpu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.get_arg_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__get_user_pages_remote 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dput 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sysfs_kf_seq_show 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sum_zone_numa_state 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_blocked_averages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__do_sys_wait4 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_mprotect 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_mprotect_pkey 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dev_attr_show 0.00 +0.0 0.00 perf-profile.children.cycles-pp.run_rebalance_domains 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kernel_wait4 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_wait 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_mmap_to_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__get_free_pages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vmstat_start 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sum_vm_events 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pte_alloc_one 0.00 +0.0 0.00 perf-profile.children.cycles-pp.account_user_time 0.00 +0.0 0.00 perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__switch_to 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mprotect_fixup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.evlist__disable 0.00 +0.0 0.00 perf-profile.children.cycles-pp.elf_map 0.00 +0.0 0.00 perf-profile.children.cycles-pp.finish_task_switch 0.00 +0.0 0.00 perf-profile.children.cycles-pp.stack_trace_save_tsk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sched_clock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_open_execat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.release_pte_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.open64 0.00 +0.0 0.00 perf-profile.children.cycles-pp._dl_addr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__memcg_kmem_charge_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.read_tsc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.try_charge 0.00 +0.0 0.00 perf-profile.children.cycles-pp.blocking_notifier_call_chain 0.00 +0.0 0.00 perf-profile.children.cycles-pp.trace_module_notify 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rmqueue_bulk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.00 +0.0 0.00 perf-profile.children.cycles-pp.delay_tsc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_nohz_stats 0.00 +0.0 0.00 perf-profile.children.cycles-pp.switch_mm_irqs_off 0.00 +0.0 0.00 perf-profile.children.cycles-pp.load_elf_interp 0.00 +0.0 0.00 perf-profile.children.cycles-pp.d_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_dentry_open 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pipe_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.native_sched_clock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.show_stat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__do_sys_newstat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vfs_statx 0.00 +0.0 0.00 perf-profile.children.cycles-pp.calc_global_load_tick 0.00 +0.0 0.00 perf-profile.children.cycles-pp.asm_common_interrupt 0.00 +0.0 0.00 perf-profile.children.cycles-pp.reweight_entity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_strings 0.00 +0.0 0.00 perf-profile.children.cycles-pp.common_interrupt 0.00 +0.0 0.00 perf-profile.children.cycles-pp.run_ksoftirqd 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_pte_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.0 0.00 perf-profile.children.cycles-pp.llist_add_batch 0.00 +0.0 0.00 perf-profile.children.cycles-pp.part_stat_read_all 0.00 +0.0 0.00 perf-profile.children.cycles-pp.check_preempt_curr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wait_task_zombie 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ttwu_do_wakeup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__mmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.anon_vma_fork 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_string_kernel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pte_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irq_enter_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.unlazy_walk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.switch_fpu_return 0.00 +0.0 0.00 perf-profile.children.cycles-pp.check_preempt_wakeup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__fput 0.00 +0.0 0.00 perf-profile.children.cycles-pp.arch_stack_walk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__legitimize_path 0.00 +0.0 0.00 perf-profile.children.cycles-pp.alloc_bprm 0.00 +0.0 0.00 perf-profile.children.cycles-pp.release_task 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vmstat_update 0.00 +0.0 0.00 perf-profile.children.cycles-pp.refresh_cpu_vm_stats 0.00 +0.0 0.00 perf-profile.children.cycles-pp.generic_file_buffered_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pmd_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__close 0.00 +0.0 0.00 perf-profile.children.cycles-pp.blk_mq_queue_tag_busy_iter 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mm_init 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_faccessat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.blk_mq_in_flight 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sysvec_call_function_single 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__vmalloc_node_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.malloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__dentry_kill 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_sched_setaffinity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vt_console_print 0.00 +0.0 0.00 perf-profile.children.cycles-pp.lf 0.00 +0.0 0.00 perf-profile.children.cycles-pp.con_scroll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.fbcon_scroll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.node_read_numastat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__queue_work 0.00 +0.0 0.00 perf-profile.children.cycles-pp.fbcon_redraw 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pud_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sysvec_call_function_single 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sched_ttwu_pending 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_sys_poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.node_read_vmstat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.schedule_tail 0.00 +0.0 0.00 perf-profile.children.cycles-pp.setup_arg_pages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.xas_find_conflict 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__accumulate_pelt_segments 0.00 +0.0 0.00 perf-profile.children.cycles-pp.anon_vma_clone 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__put_user_nocheck_4 0.00 +0.0 0.00 perf-profile.children.cycles-pp.dequeue_entity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.call_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pgd_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.fbcon_putcs 0.00 +0.0 0.00 perf-profile.children.cycles-pp.bit_putcs 0.00 +0.0 0.00 perf-profile.children.cycles-pp.cpuacct_charge 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_segcblist_enqueue 0.00 +0.0 0.00 perf-profile.children.cycles-pp.free_pcppages_bulk 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__legitimize_mnt 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__d_lookup_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.d_add 0.00 +0.0 0.00 perf-profile.children.cycles-pp.net_rx_action 0.00 +0.0 0.00 perf-profile.children.cycles-pp.touch_atime 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_readlink 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_readlinkat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.simple_lookup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.swake_up_locked 0.00 +0.0 0.00 perf-profile.children.cycles-pp.get_mem_cgroup_from_mm 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__xstat64 0.00 +0.0 0.00 perf-profile.children.cycles-pp.resched_curr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.tick_sched_do_timer 0.00 +0.0 0.00 perf-profile.children.cycles-pp.irqtime_account_process_tick 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_cblist_dequeue 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sys_imageblit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__kernel_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__d_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.security_file_permission 0.00 +0.0 0.00 perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.igb_poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shift_arg_pages 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__close_nocancel 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__fsnotify_parent 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__remove_hrtimer 0.00 +0.0 0.00 perf-profile.children.cycles-pp.unwind_next_frame 0.00 +0.0 0.00 perf-profile.children.cycles-pp.file_update_time 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_close 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mod_sysfs_setup 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pick_link 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__send_signal 0.00 +0.0 0.00 perf-profile.children.cycles-pp.arch_do_signal 0.00 +0.0 0.00 perf-profile.children.cycles-pp.arch_dup_task_struct 0.00 +0.0 0.00 perf-profile.children.cycles-pp.open_exec 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rcu_implicit_dynticks_qs 0.00 +0.0 0.00 perf-profile.children.cycles-pp.trigger_load_balance 0.00 +0.0 0.00 perf-profile.children.cycles-pp.lockref_put_or_lock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__cgroup_account_cputime_field 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__mmdrop 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ep_poll_callback 0.00 +0.0 0.00 perf-profile.children.cycles-pp.napi_complete_done 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_notify_parent 0.00 +0.0 0.00 perf-profile.children.cycles-pp.create_elf_tables 0.00 +0.0 0.00 perf-profile.children.cycles-pp.swake_up_one 0.00 +0.0 0.00 perf-profile.children.cycles-pp.anon_vma_interval_tree_remove 0.00 +0.0 0.00 perf-profile.children.cycles-pp.strnlen_user 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kstat_irqs 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_wp_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.inode_permission 0.00 +0.0 0.00 perf-profile.children.cycles-pp.allocate_slab 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__kmalloc_node 0.00 +0.0 0.00 perf-profile.children.cycles-pp.getname_flags 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_pageblock_migratetype 0.00 +0.0 0.00 perf-profile.children.cycles-pp.handle_edge_irq 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kstat_irqs_usr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__switch_to_asm 0.00 +0.0 0.00 perf-profile.children.cycles-pp.record__pushfn 0.00 +0.0 0.00 perf-profile.children.cycles-pp.put_task_stack 0.00 +0.0 0.00 perf-profile.children.cycles-pp.put_prev_entity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.current_time 0.00 +0.0 0.00 perf-profile.children.cycles-pp._copy_to_user 0.00 +0.0 0.00 perf-profile.children.cycles-pp.security_bprm_creds_for_exec 0.00 +0.0 0.00 perf-profile.children.cycles-pp._IO_setvbuf 0.00 +0.0 0.00 perf-profile.children.cycles-pp.asm_sysvec_call_function 0.00 +0.0 0.00 perf-profile.children.cycles-pp.gro_normal_list 0.00 +0.0 0.00 perf-profile.children.cycles-pp.netif_receive_skb_list_internal 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__netif_receive_skb_list_core 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ip_list_rcv 0.00 +0.0 0.00 perf-profile.children.cycles-pp.signal_wake_up_state 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sock_sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wake_up_q 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rwsem_down_read_slowpath 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pmdp_huge_clear_flush 0.00 +0.0 0.00 perf-profile.children.cycles-pp.on_each_cpu_cond_mask 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__change_page_attr_set_clr 0.00 +0.0 0.00 perf-profile.children.cycles-pp.smp_call_function_single 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pgd_free 0.00 +0.0 0.00 perf-profile.children.cycles-pp.schedule_idle 0.00 +0.0 0.00 perf-profile.children.cycles-pp.resolve_symbol 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_next_entity 0.00 +0.0 0.00 perf-profile.children.cycles-pp.flush_smp_call_function_queue 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sysvec_call_function 0.00 +0.0 0.00 perf-profile.children.cycles-pp.timekeeping_advance 0.00 +0.0 0.00 perf-profile.children.cycles-pp.note_gp_changes 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sysvec_call_function 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vsnprintf 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_task_dead 0.00 +0.0 0.00 perf-profile.children.cycles-pp.devkmsg_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.purge_fragmented_blocks_allcpus 0.00 +0.0 0.00 perf-profile.children.cycles-pp.prepare_creds 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sys_sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__acct_update_integrals 0.00 +0.0 0.00 perf-profile.children.cycles-pp.___sys_sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.____sys_sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kobject_uevent_env 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mem_cgroup_uncharge_list 0.00 +0.0 0.00 perf-profile.children.cycles-pp.lockref_get_not_dead 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__alloc_fd 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__anon_vma_prepare 0.00 +0.0 0.00 perf-profile.children.cycles-pp.security_file_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.xas_create_range 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__calc_delta 0.00 +0.0 0.00 perf-profile.children.cycles-pp.apparmor_file_alloc_security 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__check_object_size 0.00 +0.0 0.00 perf-profile.children.cycles-pp.xas_create 0.00 +0.0 0.00 perf-profile.children.cycles-pp.uncharge_batch 0.00 +0.0 0.00 perf-profile.children.cycles-pp.preempt_schedule_common 0.00 +0.0 0.00 perf-profile.children.cycles-pp.epoll_wait 0.00 +0.0 0.00 perf-profile.children.cycles-pp.file_free_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__d_lookup_done 0.00 +0.0 0.00 perf-profile.children.cycles-pp.strncpy_from_user 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_ioctl 0.00 +0.0 0.00 perf-profile.children.cycles-pp.queue_work_on 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__memcg_kmem_uncharge_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.set_memory_nx 0.00 +0.0 0.00 perf-profile.children.cycles-pp.osq_unlock 0.00 +0.0 0.00 perf-profile.children.cycles-pp.update_min_vruntime 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kfree 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__kmalloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__setup_rt_frame 0.00 +0.0 0.00 perf-profile.children.cycles-pp.proc_invalidate_siblings_dcache 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__close_fd 0.00 +0.0 0.00 perf-profile.children.cycles-pp.netlink_sendmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__free_pages_ok 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_epoll_wait 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_epoll_wait 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ep_poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.netlink_broadcast_filtered 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__munmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ioctl 0.00 +0.0 0.00 perf-profile.children.cycles-pp.down_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_event_task_tick 0.00 +0.0 0.00 perf-profile.children.cycles-pp.strcmp 0.00 +0.0 0.00 perf-profile.children.cycles-pp.put_cred_rcu 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pick_file 0.00 +0.0 0.00 perf-profile.children.cycles-pp.security_task_getsecid 0.00 +0.0 0.00 perf-profile.children.cycles-pp.enqueue_hrtimer 0.00 +0.0 0.00 perf-profile.children.cycles-pp.generic_update_time 0.00 +0.0 0.00 perf-profile.children.cycles-pp.find_symbol 0.00 +0.0 0.00 perf-profile.children.cycles-pp.each_symbol_section 0.00 +0.0 0.00 perf-profile.children.cycles-pp.find_exported_symbol_in_section 0.00 +0.0 0.00 perf-profile.children.cycles-pp.bsearch 0.00 +0.0 0.00 perf-profile.children.cycles-pp.mod_sysfs_teardown 0.00 +0.0 0.00 perf-profile.children.cycles-pp._exit 0.00 +0.0 0.00 perf-profile.children.cycles-pp.recvmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.account_process_tick 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__mark_inode_dirty 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vfprintf 0.00 +0.0 0.00 perf-profile.children.cycles-pp.timerqueue_add 0.00 +0.0 0.00 perf-profile.children.cycles-pp.timerqueue_del 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__put_anon_vma 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__put_task_struct 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sock_def_readable 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__sys_recvmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.___sys_recvmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.____sys_recvmsg 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__x64_sys_pipe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__do_pipe_flags 0.00 +0.0 0.00 perf-profile.children.cycles-pp.complete 0.00 +0.0 0.00 perf-profile.children.cycles-pp.d_invalidate 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_pipe2 0.00 +0.0 0.00 perf-profile.children.cycles-pp.fifo_open 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kernfs_remove_by_name_ns 0.00 +0.0 0.00 perf-profile.children.cycles-pp.ptep_clear_flush 0.00 +0.0 0.00 perf-profile.children.cycles-pp.shrink_dcache_parent 0.00 +0.0 0.00 perf-profile.children.cycles-pp.xas_alloc 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__pipe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__hrtimer_get_next_event 0.00 +0.0 0.00 perf-profile.children.cycles-pp.path_init 0.00 +0.0 0.00 perf-profile.children.cycles-pp.apparmor_task_getsecid 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_poll 0.00 +0.0 0.00 perf-profile.children.cycles-pp.create_pipe_files 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wait_for_completion 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__libc_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kmsg_read 0.00 +0.0 0.00 perf-profile.children.cycles-pp.do_syslog 0.00 +0.0 0.00 perf-profile.children.cycles-pp.it_real_fn 0.00 +0.0 0.00 perf-profile.children.cycles-pp.kill_pid_info 0.00 +0.0 0.00 perf-profile.children.cycles-pp.sysfs_remove_group 0.00 +0.0 0.00 perf-profile.children.cycles-pp.access 0.00 +0.0 0.00 perf-profile.children.cycles-pp.memset_erms 0.00 +0.0 0.00 perf-profile.children.cycles-pp.rb_erase 0.00 +0.0 0.00 perf-profile.children.cycles-pp.vma_policy_mof 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_fpstate_to_sigframe 0.00 +0.0 0.00 perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.00 +0.0 0.00 perf-profile.children.cycles-pp.copy_page_to_iter 0.00 +0.0 0.00 perf-profile.children.cycles-pp.page_get_link 0.00 +0.0 0.00 perf-profile.children.cycles-pp.queue_delayed_work_on 0.00 +0.0 0.00 perf-profile.children.cycles-pp.security_file_open 0.00 +0.0 0.00 perf-profile.children.cycles-pp.perf_ioctl 0.00 +0.0 0.00 perf-profile.children.cycles-pp.wait_for_partner 0.00 +0.0 0.00 perf-profile.children.cycles-pp.__do_sys_newfstat 0.00 +0.0 0.00 perf-profile.children.cycles-pp.pagecache_get_page 0.00 +0.0 0.00 perf-profile.children.cycles-pp.remove_files 0.00 +0.0 0.00 perf-profile.children.cycles-pp.netlink_broadcast 0.05 ± 88% +0.0 0.07 ± 14% perf-profile.children.cycles-pp.get_partial_node 0.26 ± 25% +0.0 0.29 ± 7% perf-profile.children.cycles-pp.__vma_rb_erase 0.20 ± 15% +0.0 0.24 ± 9% perf-profile.children.cycles-pp.follow_page 0.02 ±123% +0.0 0.06 ± 19% perf-profile.children.cycles-pp.clockevents_program_event 0.00 +0.1 0.05 perf-profile.children.cycles-pp.update_curr 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.follow_pmd_mask 0.01 ±200% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.ktime_get 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.update_load_avg 0.29 ± 21% +0.1 0.37 ± 5% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 0.23 ± 23% +0.1 0.32 perf-profile.children.cycles-pp._raw_spin_lock 0.21 ± 22% +0.1 0.31 ± 5% perf-profile.children.cycles-pp.vma_migratable 0.25 ± 22% +0.1 0.35 ± 6% perf-profile.children.cycles-pp.task_work_run 0.25 ± 20% +0.1 0.35 ± 6% perf-profile.children.cycles-pp.task_numa_work 0.08 ± 13% +0.1 0.20 ± 2% perf-profile.children.cycles-pp.task_tick_fair 0.10 ± 11% +0.2 0.29 ± 3% perf-profile.children.cycles-pp.scheduler_tick 1.86 ± 24% +0.2 2.09 ± 7% perf-profile.children.cycles-pp.find_vma 0.14 ± 13% +0.3 0.44 ± 2% perf-profile.children.cycles-pp.update_process_times 0.14 ± 13% +0.3 0.44 ± 2% perf-profile.children.cycles-pp.tick_sched_handle 1.36 ± 24% +0.3 1.68 ± 9% perf-profile.children.cycles-pp.find_vma_prev 0.15 ± 13% +0.3 0.48 ± 2% perf-profile.children.cycles-pp.tick_sched_timer 0.16 ± 12% +0.4 0.54 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.23 ± 16% +0.5 0.69 ± 2% perf-profile.children.cycles-pp.hrtimer_interrupt 0.24 ± 16% +0.5 0.70 ± 3% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 0.35 ± 18% +0.5 0.83 ± 2% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 0.26 ± 14% +0.5 0.77 ± 2% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 0.19 ± 10% +0.5 0.70 ± 2% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack 98.08 +1.6 99.73 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 96.94 +2.4 99.32 perf-profile.children.cycles-pp.do_syscall_64 0.00 +8.6 8.60 perf-profile.children.cycles-pp.xas_find 3.68 ± 22% +86.1 89.79 perf-profile.children.cycles-pp.__x64_sys_madvise 3.66 ± 22% +86.1 89.78 perf-profile.children.cycles-pp.do_madvise 80.11 ± 5% -78.0 2.12 ± 53% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.83 ±123% -0.8 0.00 perf-profile.self.cycles-pp.syscall_exit_to_user_mode 0.57 ± 33% -0.4 0.14 ± 29% perf-profile.self.cycles-pp.mmap_region 0.81 ± 25% -0.3 0.49 ± 5% perf-profile.self.cycles-pp.kmem_cache_free 0.55 ± 23% -0.3 0.28 ± 11% perf-profile.self.cycles-pp.zap_pte_range 0.35 ± 23% -0.2 0.12 ± 4% perf-profile.self.cycles-pp.kmem_cache_alloc 0.48 ± 8% -0.2 0.26 ± 11% perf-profile.self.cycles-pp.release_pages 0.22 ± 23% -0.2 0.00 perf-profile.self.cycles-pp.native_irq_return_iret 0.17 ± 5% -0.2 0.00 perf-profile.self.cycles-pp.mem_cgroup_page_lruvec 0.34 ± 29% -0.2 0.18 ± 2% perf-profile.self.cycles-pp.__vma_link_rb 0.48 ± 20% -0.2 0.33 ± 4% perf-profile.self.cycles-pp.__vma_adjust 0.15 ± 24% -0.1 0.00 perf-profile.self.cycles-pp.sync_regs 0.24 ± 21% -0.1 0.10 ± 4% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.14 ±129% -0.1 0.00 perf-profile.self.cycles-pp.irqentry_exit_to_user_mode 0.20 ± 4% -0.1 0.06 ± 19% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.54 ± 26% -0.1 0.41 ± 6% perf-profile.self.cycles-pp.vma_interval_tree_remove 0.26 ± 4% -0.1 0.13 ± 24% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.24 ± 4% -0.1 0.11 ± 22% perf-profile.self.cycles-pp.mem_cgroup_update_lru_size 0.13 ± 9% -0.1 0.00 perf-profile.self.cycles-pp.__mod_node_page_state 0.13 ± 20% -0.1 0.00 perf-profile.self.cycles-pp.xas_load 0.27 ± 17% -0.1 0.14 ± 6% perf-profile.self.cycles-pp.vm_area_dup 0.27 ± 21% -0.1 0.15 ± 5% perf-profile.self.cycles-pp.native_flush_tlb_one_user 0.18 ± 22% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.11 ± 13% -0.1 0.00 perf-profile.self.cycles-pp.follow_page_pte 0.18 ± 18% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.__mod_memcg_state 0.19 ± 22% -0.1 0.09 ± 5% perf-profile.self.cycles-pp.___might_sleep 0.17 ± 20% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.__rb_insert_augmented 1.39 ± 21% -0.1 1.28 ± 7% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.16 ± 6% -0.1 0.06 ± 23% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.16 ± 33% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.09 ± 21% -0.1 0.00 perf-profile.self.cycles-pp.__handle_mm_fault 0.09 ± 4% -0.1 0.00 perf-profile.self.cycles-pp.lru_cache_add 0.09 ± 7% -0.1 0.00 perf-profile.self.cycles-pp.isolate_lru_page 0.14 ± 20% -0.1 0.05 perf-profile.self.cycles-pp.__entry_text_start 0.19 ± 26% -0.1 0.10 ± 8% perf-profile.self.cycles-pp.page_counter_cancel 0.09 ± 18% -0.1 0.00 perf-profile.self.cycles-pp.refill_obj_stock 0.08 ± 20% -0.1 0.00 perf-profile.self.cycles-pp.down_write_killable 0.13 ± 22% -0.1 0.05 perf-profile.self.cycles-pp.up_write 0.08 ± 33% -0.1 0.00 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.08 ± 22% -0.1 0.00 perf-profile.self.cycles-pp.page_remove_rmap 0.08 ± 13% -0.1 0.00 perf-profile.self.cycles-pp.filemap_map_pages 0.08 ± 20% -0.1 0.00 perf-profile.self.cycles-pp.__might_sleep 0.17 ± 21% -0.1 0.10 ± 9% perf-profile.self.cycles-pp.__split_vma 0.07 ± 18% -0.1 0.00 perf-profile.self.cycles-pp.handle_mm_fault 0.07 ± 18% -0.1 0.00 perf-profile.self.cycles-pp.page_add_file_rmap 0.07 ± 23% -0.1 0.00 perf-profile.self.cycles-pp.find_get_entry 0.07 ± 24% -0.1 0.00 perf-profile.self.cycles-pp.syscall_enter_from_user_mode 0.07 ± 18% -0.1 0.00 perf-profile.self.cycles-pp.__slab_free 0.10 ± 29% -0.1 0.03 ± 70% perf-profile.self.cycles-pp.___slab_alloc 0.10 ± 23% -0.1 0.03 ± 70% perf-profile.self.cycles-pp.vmacache_find 0.18 ± 4% -0.1 0.12 ± 18% perf-profile.self.cycles-pp.__list_add_valid 0.06 ± 18% -0.1 0.00 perf-profile.self.cycles-pp.vma_interval_tree_augment_rotate 0.06 ± 14% -0.1 0.00 perf-profile.self.cycles-pp.obj_cgroup_charge 0.16 ± 27% -0.1 0.10 ± 8% perf-profile.self.cycles-pp.__rb_erase_color 0.16 ± 17% -0.1 0.10 ± 19% perf-profile.self.cycles-pp.__munlock_pagevec 0.05 ± 53% -0.1 0.00 perf-profile.self.cycles-pp.mark_page_accessed 0.28 ± 7% -0.1 0.23 ± 13% perf-profile.self.cycles-pp.workingset_age_nonresident 0.11 ± 15% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.free_unref_page_list 0.05 ± 52% -0.0 0.00 perf-profile.self.cycles-pp.page_mapping 0.10 ± 28% -0.0 0.06 ± 16% perf-profile.self.cycles-pp.vma_merge 0.04 ± 51% -0.0 0.00 perf-profile.self.cycles-pp.lru_add_drain_cpu 0.04 ± 83% -0.0 0.00 perf-profile.self.cycles-pp.down_write 0.04 ± 82% -0.0 0.00 perf-profile.self.cycles-pp.flush_tlb_mm_range 0.04 ± 50% -0.0 0.00 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.04 ± 83% -0.0 0.00 perf-profile.self.cycles-pp.userfaultfd_unmap_prep 0.23 ± 24% -0.0 0.19 ± 4% perf-profile.self.cycles-pp.__do_munmap 0.03 ± 82% -0.0 0.00 perf-profile.self.cycles-pp.up_read 0.03 ± 82% -0.0 0.00 perf-profile.self.cycles-pp.tlb_gather_mmu 0.03 ± 81% -0.0 0.00 perf-profile.self.cycles-pp.follow_page_mask 0.03 ±123% -0.0 0.00 perf-profile.self.cycles-pp.vma_gap_callbacks_rotate 0.13 ± 20% -0.0 0.10 ± 16% perf-profile.self.cycles-pp.__list_del_entry_valid 0.02 ±125% -0.0 0.00 perf-profile.self.cycles-pp.perf_iterate_sb 0.02 ±125% -0.0 0.00 perf-profile.self.cycles-pp.memcpy_erms 0.02 ±122% -0.0 0.00 perf-profile.self.cycles-pp.downgrade_write 0.02 ±123% -0.0 0.00 perf-profile.self.cycles-pp._cond_resched 0.02 ±123% -0.0 0.00 perf-profile.self.cycles-pp.fput_many 0.02 ±123% -0.0 0.00 perf-profile.self.cycles-pp.page_counter_try_charge 0.02 ±123% -0.0 0.00 perf-profile.self.cycles-pp.__count_memcg_events 0.02 ±122% -0.0 0.00 perf-profile.self.cycles-pp.alloc_set_pte 0.02 ±122% -0.0 0.00 perf-profile.self.cycles-pp.__set_page_dirty_no_writeback 0.15 ± 9% -0.0 0.13 ± 16% perf-profile.self.cycles-pp.__activate_page 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.common_file_perm 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.do_mmap 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.asm_exc_page_fault 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.do_user_addr_fault 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.exit_to_user_mode_prepare 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.perf_event_mmap 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.prepend_name 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.__fget_files 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.unlock_page 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.flush_tlb_func_common 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.tlb_finish_mmu 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp._find_next_bit 0.01 ±200% -0.0 0.00 perf-profile.self.cycles-pp.__remove_shared_vm_struct 0.08 ± 28% -0.0 0.07 perf-profile.self.cycles-pp.vmacache_update 0.08 ± 13% -0.0 0.07 ± 11% perf-profile.self.cycles-pp.try_grab_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.memmap_init_zone_device 0.00 +0.0 0.00 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.00 +0.0 0.00 perf-profile.self.cycles-pp.osq_lock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.shmem_write_end 0.00 +0.0 0.00 perf-profile.self.cycles-pp.copy_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.smp_call_function_many_cond 0.00 +0.0 0.00 perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.00 +0.0 0.00 perf-profile.self.cycles-pp.perf_mmap__read_head 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__pthread_enable_asynccancel 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__get_user_nocheck_1 0.00 +0.0 0.00 perf-profile.self.cycles-pp.mutex_unlock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.hrtimer_active 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__pthread_disable_asynccancel 0.00 +0.0 0.00 perf-profile.self.cycles-pp.intel_idle 0.00 +0.0 0.00 perf-profile.self.cycles-pp.mutex_lock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.io_serial_in 0.00 +0.0 0.00 perf-profile.self.cycles-pp.find_lock_entry 0.00 +0.0 0.00 perf-profile.self.cycles-pp.clear_page_erms 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__init_single_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.set_pfnblock_flags_mask 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_curr 0.00 +0.0 0.00 perf-profile.self.cycles-pp.vprintk_emit 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__update_load_avg_se 0.00 +0.0 0.00 perf-profile.self.cycles-pp.find_idlest_group 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_load_avg 0.00 +0.0 0.00 perf-profile.self.cycles-pp.lapic_next_deadline 0.00 +0.0 0.00 perf-profile.self.cycles-pp.perf_mmap_fault 0.00 +0.0 0.00 perf-profile.self.cycles-pp.down_read_trylock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.change_p4d_range 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_sd_lb_stats 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.0 0.00 perf-profile.self.cycles-pp.task_tick_fair 0.00 +0.0 0.00 perf-profile.self.cycles-pp.change_protection 0.00 +0.0 0.00 perf-profile.self.cycles-pp.tick_sched_timer 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_cfs_group 0.00 +0.0 0.00 perf-profile.self.cycles-pp.mutex_spin_on_owner 0.00 +0.0 0.00 perf-profile.self.cycles-pp.arch_scale_freq_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.available_idle_cpu 0.00 +0.0 0.00 perf-profile.self.cycles-pp.run_local_timers 0.00 +0.0 0.00 perf-profile.self.cycles-pp.select_idle_sibling 0.00 +0.0 0.00 perf-profile.self.cycles-pp._raw_spin_trylock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__sched_text_start 0.00 +0.0 0.00 perf-profile.self.cycles-pp.shmem_add_to_page_cache 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_irq_load_avg 0.00 +0.0 0.00 perf-profile.self.cycles-pp.sum_zone_numa_state 0.00 +0.0 0.00 perf-profile.self.cycles-pp.perf_mmap_to_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.sum_vm_events 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__switch_to 0.00 +0.0 0.00 perf-profile.self.cycles-pp._dl_addr 0.00 +0.0 0.00 perf-profile.self.cycles-pp.irqtime_account_irq 0.00 +0.0 0.00 perf-profile.self.cycles-pp.read_tsc 0.00 +0.0 0.00 perf-profile.self.cycles-pp.trace_module_notify 0.00 +0.0 0.00 perf-profile.self.cycles-pp.delay_tsc 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_nohz_stats 0.00 +0.0 0.00 perf-profile.self.cycles-pp.native_sched_clock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__alloc_file 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rmqueue_bulk 0.00 +0.0 0.00 perf-profile.self.cycles-pp.switch_mm_irqs_off 0.00 +0.0 0.00 perf-profile.self.cycles-pp.calc_global_load_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.llist_add_batch 0.00 +0.0 0.00 perf-profile.self.cycles-pp.part_stat_read_all 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__do_fault 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_blocked_averages 0.00 +0.0 0.00 perf-profile.self.cycles-pp.hrtimer_interrupt 0.00 +0.0 0.00 perf-profile.self.cycles-pp.load_balance 0.00 +0.0 0.00 perf-profile.self.cycles-pp.reweight_entity 0.00 +0.0 0.00 perf-profile.self.cycles-pp.switch_fpu_return 0.00 +0.0 0.00 perf-profile.self.cycles-pp.blk_mq_queue_tag_busy_iter 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_rq_clock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.account_user_time 0.00 +0.0 0.00 perf-profile.self.cycles-pp.try_charge 0.00 +0.0 0.00 perf-profile.self.cycles-pp.xas_find_conflict 0.00 +0.0 0.00 perf-profile.self.cycles-pp.cpuacct_charge 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rcu_segcblist_enqueue 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__legitimize_mnt 0.00 +0.0 0.00 perf-profile.self.cycles-pp.collapse_huge_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.record__mmap_read_evlist 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__d_lookup_rcu 0.00 +0.0 0.00 perf-profile.self.cycles-pp.get_mem_cgroup_from_mm 0.00 +0.0 0.00 perf-profile.self.cycles-pp.resched_curr 0.00 +0.0 0.00 perf-profile.self.cycles-pp.irqtime_account_process_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rcu_cblist_dequeue 0.00 +0.0 0.00 perf-profile.self.cycles-pp.sys_imageblit 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__fsnotify_parent 0.00 +0.0 0.00 perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__hrtimer_run_queues 0.00 +0.0 0.00 perf-profile.self.cycles-pp.scheduler_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.khugepaged_scan_pmd 0.00 +0.0 0.00 perf-profile.self.cycles-pp.enqueue_entity 0.00 +0.0 0.00 perf-profile.self.cycles-pp.refresh_cpu_vm_stats 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__accumulate_pelt_segments 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rcu_implicit_dynticks_qs 0.00 +0.0 0.00 perf-profile.self.cycles-pp.trigger_load_balance 0.00 +0.0 0.00 perf-profile.self.cycles-pp.anon_vma_interval_tree_remove 0.00 +0.0 0.00 perf-profile.self.cycles-pp.strnlen_user 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.00 +0.0 0.00 perf-profile.self.cycles-pp.kstat_irqs 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__switch_to_asm 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.00 +0.0 0.00 perf-profile.self.cycles-pp.smp_call_function_single 0.00 +0.0 0.00 perf-profile.self.cycles-pp._vm_unmap_aliases 0.00 +0.0 0.00 perf-profile.self.cycles-pp.prep_new_page 0.00 +0.0 0.00 perf-profile.self.cycles-pp.purge_fragmented_blocks_allcpus 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__acct_update_integrals 0.00 +0.0 0.00 perf-profile.self.cycles-pp.lockref_get_not_dead 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.00 +0.0 0.00 perf-profile.self.cycles-pp.do_dentry_open 0.00 +0.0 0.00 perf-profile.self.cycles-pp.copy_pte_range 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__calc_delta 0.00 +0.0 0.00 perf-profile.self.cycles-pp.apparmor_file_alloc_security 0.00 +0.0 0.00 perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.0 0.00 perf-profile.self.cycles-pp.file_free_rcu 0.00 +0.0 0.00 perf-profile.self.cycles-pp.osq_unlock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.update_min_vruntime 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.00 +0.0 0.00 perf-profile.self.cycles-pp.stack_trace_save_tsk 0.00 +0.0 0.00 perf-profile.self.cycles-pp.timekeeping_advance 0.00 +0.0 0.00 perf-profile.self.cycles-pp.down_read 0.00 +0.0 0.00 perf-profile.self.cycles-pp.perf_event_task_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.strcmp 0.00 +0.0 0.00 perf-profile.self.cycles-pp.account_process_tick 0.00 +0.0 0.00 perf-profile.self.cycles-pp.get_page_from_freelist 0.00 +0.0 0.00 perf-profile.self.cycles-pp.rebalance_domains 0.00 +0.0 0.00 perf-profile.self.cycles-pp.task_numa_work 0.00 +0.0 0.00 perf-profile.self.cycles-pp.pick_next_task_fair 0.00 +0.0 0.00 perf-profile.self.cycles-pp.sched_clock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.flush_smp_call_function_queue 0.00 +0.0 0.00 perf-profile.self.cycles-pp.prepare_creds 0.00 +0.0 0.00 perf-profile.self.cycles-pp.lockref_put_or_lock 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__mark_inode_dirty 0.00 +0.0 0.00 perf-profile.self.cycles-pp.vfprintf 0.00 +0.0 0.00 perf-profile.self.cycles-pp.__hrtimer_get_next_event 0.00 +0.0 0.00 perf-profile.self.cycles-pp.memset_erms 0.26 ± 25% +0.0 0.28 ± 7% perf-profile.self.cycles-pp.__vma_rb_erase 0.11 ± 20% +0.0 0.15 ± 8% perf-profile.self.cycles-pp.unmap_page_range 0.19 ± 21% +0.1 0.24 perf-profile.self.cycles-pp._raw_spin_lock 0.01 ±200% +0.1 0.07 ± 14% perf-profile.self.cycles-pp.ktime_get 0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.follow_pmd_mask 0.21 ± 23% +0.1 0.30 ± 6% perf-profile.self.cycles-pp.vma_migratable 1.67 ± 23% +0.3 1.95 ± 8% perf-profile.self.cycles-pp.find_vma 0.00 +7.9 7.95 perf-profile.self.cycles-pp.xas_find 0.30 ± 23% +77.8 78.12 perf-profile.self.cycles-pp.do_madvise Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

1 year, 7 months

6
8
0 / 0

Re: [perf metricgroup] fcc9c5243c: perf-sanity-tests.Parse_and_process_metrics.fail

by Ian Rogers

On Tue, Oct 20, 2020 at 1:56 AM kajoljain <kjain(a)linux.ibm.com> wrote: > > > > On 10/19/20 9:50 PM, Ian Rogers wrote: > > On Mon, Oct 19, 2020 at 2:51 AM John Garry <john.garry(a)huawei.com> wrote: > >> > >> On 19/10/2020 00:30, Ian Rogers wrote: > >>> On Sun, Oct 18, 2020 at 1:51 AM kernel test robot <rong.a.chen(a)intel.com> wrote: > >>>> > >>>> Greeting, > >>>> > >>>> FYI, we noticed the following commit (built with gcc-9): > >>>> > >>>> commit: fcc9c5243c478f104014daf4d23db86098d2aef0 ("perf metricgroup: Hack a fix for aliases when covering multiple PMUs") > >>>> url: https://github.com/0day-ci/linux/commits/John-Garry/perf-pmu-events-Suppo... > >>>> > >>>> > >>>> in testcase: perf-sanity-tests > >>>> version: perf-x86_64-c85fb28b6f99-1_20201008 > >>>> with following parameters: > >>>> > >>>> perf_compiler: gcc > >>>> ucode: 0xdc > >>>> > >>>> > >>>> > >>>> on test machine: 4 threads Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz with 32G memory > >>>> > >>>> caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): > >>> > >>> I believe this is a Skylake and there is a known bug in the Skylake > >>> metric DRAM_Parallel_Reads as described here: > >>> https://lore.kernel.org/lkml/CAP-5=fXejVaQa9qfW66cY77qB962+jbe8tT5bsLoOOc... > >>> Fixing the bug needs more knowledge than what is available in manuals. > >>> Hopefully Intel can take a look. > >>> > >>> Thanks, > >>> Ian > >> > >> So this named patch ("perf metricgroup: Hack a fix for aliases...") is > >> breaking test #67 on my machine also, which is a broadwell. > > > > Thanks for taking a look John. If you want help you can send the > > output of "perf test 67 -vvv" to me. It is possible Broadwell has > > similar glitches in the json to Skylake. I tested the original test on > > server parts as I can access them as cloud machines. > > > >> I will have a look, but I was hoping that Ian would have a proper fix > >> for this on top of ("perf metricgroup: Fix uncore metric expressions"), > >> which now looks to be merged. > > > > I still have these changes to look at in my inbox but I'm assuming > > they're good :-) Sorry for not getting to them, but it's good they are > > merged. > > Hi Ian, > Checked in upstream kernel with your fix patch, in powerpc also test case 67 is passing. > But I am getting issue in test 10 for powerpc > > [command]# ./perf test 10 > 10: PMU events : > 10.1: PMU event table sanity : Ok > 10.2: PMU event map aliases : Ok > 10.3: Parsing of PMU event table metrics : Skip (some metrics failed) > 10.4: Parsing of PMU event table metrics with fake PMUs : FAILED! > > Was debugging it, issue is with commit e1c92a7fbbc5 perf tests: Add another metric parsing test. > > So, there we are passing different runtime parameter value in "expr__find_other and expr__parse" > in function `metric_parse_fake`. I believe we need to send same value. > I will send fix patch for the same. > > Thanks, > Kajol Jain Thanks, the fake support was done by Jiri. I do try to test on Power 8. The awesome thing, aside from the testing nit fixes, is that the metrics will actually work once the test is passing :-). They may of course report junk. Thanks, Ian > > > > Thanks, > > Ian > > > >> Thanks! > >> > >>> > >>>> > >>>> > >>>> If you fix the issue, kindly add following tag > >>>> Reported-by: kernel test robot <rong.a.chen(a)intel.com> > >>>> > >>>> > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 67 > >>>> 67: Parse and process metrics : FAILED! > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 68 > >>>> 68: x86 rdpmc : Ok > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 69 > >>>> 69: Convert perf time to TSC : Ok > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 70 > >>>> 70: DWARF unwind : Ok > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 71 > >>>> 71: x86 instruction decoder - new instructions : Ok > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 72 > >>>> 72: Intel PT packet decoder : Ok > >>>> 2020-10-16 19:31:52 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 73 > >>>> 73: x86 bp modify : Ok > >>>> 2020-10-16 19:31:53 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 74 > >>>> 74: probe libc's inet_pton & backtrace it with ping : Ok > >>>> 2020-10-16 19:31:54 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-fcc9c5243c478f104014daf4d23db86098d2aef0/tools/perf/perf test 75 > >>>> 75: Zstd perf.data compression/decompression : Ok > >>>> > >>>> > >>>> > >>>> To reproduce: > >>>> > >>>> git clone https://github.com/intel/lkp-tests.git > >>>> cd lkp-tests > >>>> bin/lkp install job.yaml # job file is attached in this email > >>>> bin/lkp run job.yaml > >>>> > >>>> > >>>> > >>>> Thanks, > >>>> Rong Chen > >>>> > >>> . > >>> > >>

1 year, 7 months

2
3
0 / 0

[btrfs] c75e839414: aim7.jobs-per-min -9.1% regression

by kernel test robot

Greeting, FYI, we noticed a -9.1% regression of aim7.jobs-per-min due to commit: commit: c75e839414d3610e6487ae3145199c500d55f7f7 ("btrfs: kill the subvol_srcu") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: aim7 on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory with following parameters: disk: 4BRD_12G md: RAID0 fs: btrfs test: disk_wrt load: 1500 cpufreq_governor: performance ucode: 0x500002c test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode: gcc-7/performance/4BRD_12G/btrfs/x86_64-rhel-7.6/1500/RAID0/debian-x86_64-20191114.cgz/lkp-csl-2ap2/disk_wrt/aim7/0x500002c commit: efc3453494 ("btrfs: make btrfs_cleanup_fs_roots use the radix tree lock") c75e839414 ("btrfs: kill the subvol_srcu") efc3453494af7818 c75e839414d3610e6487ae31451 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 3:9 -33% :8 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x %stddev %change %stddev \ | \ 29509 ± 2% -9.1% 26837 ± 2% aim7.jobs-per-min 305.28 ± 2% +10.0% 335.72 ± 2% aim7.time.elapsed_time 305.28 ± 2% +10.0% 335.72 ± 2% aim7.time.elapsed_time.max 4883135 ± 10% +37.9% 6735464 ± 7% aim7.time.involuntary_context_switches 56288 ± 2% +10.5% 62202 ± 2% aim7.time.system_time 2344783 +6.5% 2497364 ± 2% aim7.time.voluntary_context_switches 62337721 ± 2% +9.8% 68456490 ± 2% turbostat.IRQ 431.56 ± 6% +22.3% 527.88 ± 4% vmstat.procs.r 27340 ± 2% +11.2% 30397 ± 2% vmstat.system.cs 226804 ± 6% +21.7% 276057 ± 4% meminfo.Active(file) 221309 ± 6% +22.3% 270668 ± 4% meminfo.Dirty 720.89 ±111% +49.3% 1076 ± 73% meminfo.Mlocked 14278 ± 2% -8.3% 13094 ± 2% meminfo.max_used_kB 57228 ± 6% +22.7% 70195 ± 5% numa-meminfo.node0.Active(file) 55433 ± 6% +21.6% 67431 ± 4% numa-meminfo.node0.Dirty 56152 ± 6% +21.4% 68180 ± 5% numa-meminfo.node1.Active(file) 55001 ± 6% +22.5% 67397 ± 4% numa-meminfo.node1.Dirty 56373 ± 6% +21.7% 68594 ± 4% numa-meminfo.node2.Active(file) 55222 ± 7% +22.6% 67726 ± 4% numa-meminfo.node2.Dirty 56671 ± 6% +20.5% 68317 ± 3% numa-meminfo.node3.Active(file) 55285 ± 6% +21.8% 67355 ± 4% numa-meminfo.node3.Dirty 56694 ± 6% +21.7% 69019 ± 4% proc-vmstat.nr_active_file 55342 ± 6% +22.3% 67662 ± 4% proc-vmstat.nr_dirty 402316 +2.1% 410951 proc-vmstat.nr_file_pages 180.22 ±111% +49.4% 269.25 ± 73% proc-vmstat.nr_mlock 56694 ± 6% +21.7% 69019 ± 4% proc-vmstat.nr_zone_active_file 54680 ± 6% +22.8% 67168 ± 4% proc-vmstat.nr_zone_write_pending 3144381 ± 2% +6.1% 3335275 proc-vmstat.pgactivate 1387558 ± 2% +7.9% 1496754 ± 2% proc-vmstat.pgfault 983.33 ± 4% +5.4% 1036 proc-vmstat.unevictable_pgs_culled 14331 ± 6% +22.6% 17566 ± 5% numa-vmstat.node0.nr_active_file 13884 ± 6% +21.6% 16884 ± 4% numa-vmstat.node0.nr_dirty 14330 ± 6% +22.6% 17566 ± 5% numa-vmstat.node0.nr_zone_active_file 13714 ± 6% +22.2% 16755 ± 4% numa-vmstat.node0.nr_zone_write_pending 14047 ± 6% +21.3% 17043 ± 4% numa-vmstat.node1.nr_active_file 13763 ± 6% +22.3% 16838 ± 4% numa-vmstat.node1.nr_dirty 14047 ± 6% +21.3% 17043 ± 4% numa-vmstat.node1.nr_zone_active_file 13599 ± 6% +23.0% 16726 ± 4% numa-vmstat.node1.nr_zone_write_pending 14074 ± 5% +21.7% 17130 ± 4% numa-vmstat.node2.nr_active_file 13786 ± 6% +22.6% 16906 ± 4% numa-vmstat.node2.nr_dirty 14074 ± 5% +21.7% 17130 ± 4% numa-vmstat.node2.nr_zone_active_file 13617 ± 7% +23.3% 16789 ± 4% numa-vmstat.node2.nr_zone_write_pending 14151 ± 6% +20.7% 17074 ± 3% numa-vmstat.node3.nr_active_file 13790 ± 6% +22.1% 16832 ± 4% numa-vmstat.node3.nr_dirty 14152 ± 6% +20.7% 17074 ± 3% numa-vmstat.node3.nr_zone_active_file 13627 ± 6% +22.5% 16696 ± 4% numa-vmstat.node3.nr_zone_write_pending 828631 ± 16% +49.9% 1241934 ± 8% sched_debug.cfs_rq:/.min_vruntime.stddev 1.33 ± 30% +96.9% 2.61 ± 14% sched_debug.cfs_rq:/.nr_spread_over.avg 831152 ± 16% +49.7% 1244586 ± 8% sched_debug.cfs_rq:/.spread0.stddev 1.92 ± 14% +28.4% 2.47 ± 8% sched_debug.cpu.nr_running.avg 5.00 ± 9% +29.7% 6.48 ± 9% sched_debug.cpu.nr_running.max 0.90 ± 9% +16.0% 1.05 ± 3% sched_debug.cpu.nr_running.stddev 21790 ± 11% +16.7% 25440 ± 2% sched_debug.cpu.nr_switches.avg 19761 ± 11% +17.9% 23289 ± 2% sched_debug.cpu.nr_switches.min 20403 ± 12% +18.1% 24101 ± 2% sched_debug.cpu.sched_count.avg 27825 ± 10% +15.8% 32227 ± 4% sched_debug.cpu.sched_count.max 18995 ± 13% +18.3% 22463 ± 2% sched_debug.cpu.sched_count.min 1143 ± 11% +15.6% 1322 ± 4% sched_debug.cpu.sched_count.stddev 1404 ± 7% -31.0% 969.66 ± 11% sched_debug.cpu.sched_goidle.avg 1186 ± 8% -36.0% 759.25 ± 14% sched_debug.cpu.sched_goidle.min 16821 ± 14% +20.6% 20284 ± 6% sched_debug.cpu.ttwu_count.max 2790 ± 11% +21.7% 3395 ± 7% sched_debug.cpu.ttwu_count.stddev 398.19 ± 16% +28.3% 510.73 ± 10% sched_debug.cpu.ttwu_local.stddev 43238516 ± 5% +19.0% 51459028 ± 4% perf-stat.i.cache-misses 83870573 ± 4% +13.8% 95436555 ± 4% perf-stat.i.cache-references 27181 ± 2% +11.1% 30198 ± 2% perf-stat.i.context-switches 3008 ± 2% -7.1% 2794 perf-stat.i.cpu-migrations 12612 ± 5% -15.6% 10641 ± 3% perf-stat.i.cycles-between-cache-misses 1.1e+09 ± 2% -7.3% 1.019e+09 ± 2% perf-stat.i.dTLB-stores 10684629 ± 2% +10.8% 11842781 ± 2% perf-stat.i.node-load-misses 641429 ± 2% +24.4% 798190 ± 2% perf-stat.i.node-loads 5915955 ± 2% -6.3% 5543368 ± 2% perf-stat.i.node-store-misses 380971 -6.7% 355629 ± 2% perf-stat.i.node-stores 1.66 ± 4% +14.4% 1.90 ± 3% perf-stat.overall.MPKI 13064 ± 5% -15.8% 10999 ± 4% perf-stat.overall.cycles-between-cache-misses 43484558 ± 5% +19.2% 51837476 ± 4% perf-stat.ps.cache-misses 83278267 ± 4% +14.4% 95253129 ± 3% perf-stat.ps.cache-references 27414 ± 2% +11.2% 30486 ± 2% perf-stat.ps.context-switches 3028 ± 2% -7.0% 2817 perf-stat.ps.cpu-migrations 1.104e+09 ± 2% -7.3% 1.023e+09 ± 2% perf-stat.ps.dTLB-stores 4394 -1.8% 4315 perf-stat.ps.minor-faults 10766873 ± 2% +11.0% 11947268 ± 2% perf-stat.ps.node-load-misses 645940 ± 2% +24.7% 805392 ± 2% perf-stat.ps.node-loads 5965618 ± 2% -6.2% 5595562 ± 2% perf-stat.ps.node-store-misses 383092 -6.5% 358124 ± 2% perf-stat.ps.node-stores 4395 -1.8% 4315 perf-stat.ps.page-faults 1.538e+13 ± 2% +10.0% 1.692e+13 ± 2% perf-stat.total.instructions 27.39 -0.1 27.28 perf-profile.calltrace.cycles-pp.btrfs_dirty_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 35.13 +0.1 35.23 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write 35.23 +0.1 35.34 perf-profile.calltrace.cycles-pp._raw_spin_lock.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter 35.48 +0.1 35.60 perf-profile.calltrace.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 35.08 +0.1 35.22 perf-profile.calltrace.cycles-pp._raw_spin_lock.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter 34.97 +0.1 35.12 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write 35.57 +0.1 35.72 perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 35.10 +0.2 35.26 perf-profile.calltrace.cycles-pp.btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 35.11 +0.2 35.27 perf-profile.calltrace.cycles-pp.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 98.71 +0.2 98.88 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.69 +0.2 98.87 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.74 +0.2 98.91 perf-profile.calltrace.cycles-pp.write 98.71 +0.2 98.89 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 98.68 +0.2 98.86 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.64 +0.2 98.82 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 98.63 +0.2 98.81 perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 98.58 +0.2 98.77 perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write 27.39 -0.1 27.28 perf-profile.children.cycles-pp.btrfs_dirty_pages 0.56 ± 5% -0.1 0.46 ± 9% perf-profile.children.cycles-pp.btrfs_get_extent 0.51 ± 5% -0.1 0.41 ± 9% perf-profile.children.cycles-pp.btrfs_lookup_file_extent 0.52 ± 5% -0.1 0.43 ± 9% perf-profile.children.cycles-pp.btrfs_search_slot 0.44 ± 6% -0.1 0.35 ± 11% perf-profile.children.cycles-pp.btrfs_read_lock_root_node 0.43 ± 6% -0.1 0.34 ± 11% perf-profile.children.cycles-pp.btrfs_tree_read_lock 0.19 ± 15% -0.1 0.11 ± 27% perf-profile.children.cycles-pp.start_secondary 0.19 ± 16% -0.1 0.10 ± 27% perf-profile.children.cycles-pp.cpuidle_enter 0.19 ± 16% -0.1 0.10 ± 27% perf-profile.children.cycles-pp.cpuidle_enter_state 0.41 ± 7% -0.1 0.33 ± 8% perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.46 ± 7% -0.1 0.38 ± 8% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 0.19 ± 15% -0.1 0.11 ± 25% perf-profile.children.cycles-pp.secondary_startup_64 0.19 ± 15% -0.1 0.11 ± 25% perf-profile.children.cycles-pp.cpu_startup_entry 0.19 ± 15% -0.1 0.11 ± 25% perf-profile.children.cycles-pp.do_idle 0.18 ± 15% -0.1 0.10 ± 24% perf-profile.children.cycles-pp.intel_idle 0.29 ± 9% -0.1 0.22 ± 11% perf-profile.children.cycles-pp.osq_lock 0.19 ± 6% -0.0 0.15 ± 16% perf-profile.children.cycles-pp.finish_wait 0.39 ± 5% -0.0 0.35 ± 6% perf-profile.children.cycles-pp.do_unlinkat 0.39 ± 6% -0.0 0.35 ± 7% perf-profile.children.cycles-pp.unlink 0.26 ± 5% -0.0 0.22 ± 6% perf-profile.children.cycles-pp.do_sys_open 0.26 ± 5% -0.0 0.22 ± 6% perf-profile.children.cycles-pp.do_sys_openat2 0.26 ± 4% -0.0 0.22 ± 6% perf-profile.children.cycles-pp.do_filp_open 0.26 ± 4% -0.0 0.22 ± 6% perf-profile.children.cycles-pp.path_openat 0.26 ± 4% -0.0 0.22 ± 6% perf-profile.children.cycles-pp.creat 0.00 +0.0 0.05 perf-profile.children.cycles-pp.btrfs_calculate_inode_block_rsv_size 99.65 +0.1 99.73 perf-profile.children.cycles-pp.do_syscall_64 99.66 +0.1 99.74 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 35.62 +0.1 35.74 perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes 35.57 +0.1 35.72 perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata 97.55 +0.2 97.72 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 98.74 +0.2 98.92 perf-profile.children.cycles-pp.write 98.70 +0.2 98.88 perf-profile.children.cycles-pp.ksys_write 98.69 +0.2 98.87 perf-profile.children.cycles-pp.vfs_write 98.65 +0.2 98.83 perf-profile.children.cycles-pp.new_sync_write 98.63 +0.2 98.81 perf-profile.children.cycles-pp.btrfs_file_write_iter 98.59 +0.2 98.78 perf-profile.children.cycles-pp.btrfs_buffered_write 97.60 +0.2 97.79 perf-profile.children.cycles-pp._raw_spin_lock 0.18 ± 15% -0.1 0.10 ± 24% perf-profile.self.cycles-pp.intel_idle 0.28 ± 9% -0.1 0.21 ± 12% perf-profile.self.cycles-pp.osq_lock 0.45 ± 2% -0.0 0.41 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 135788 ± 2% +13.1% 153639 ± 3% softirqs.CPU0.RCU 115547 ± 3% +8.0% 124768 ± 4% softirqs.CPU0.TIMER 135243 ± 3% +14.0% 154188 ± 2% softirqs.CPU1.RCU 136056 ± 3% +12.4% 152960 ± 3% softirqs.CPU10.RCU 134253 ± 3% +14.2% 153260 ± 3% softirqs.CPU100.RCU 134668 ± 4% +13.7% 153157 ± 2% softirqs.CPU101.RCU 109995 ± 3% +7.9% 118637 ± 3% softirqs.CPU101.TIMER 134989 ± 4% +13.9% 153700 ± 2% softirqs.CPU102.RCU 109876 ± 3% +8.9% 119608 ± 2% softirqs.CPU102.TIMER 134868 ± 4% +13.8% 153427 ± 3% softirqs.CPU103.RCU 109933 ± 3% +8.2% 118946 ± 3% softirqs.CPU103.TIMER 134454 ± 3% +14.0% 153285 ± 3% softirqs.CPU104.RCU 109731 ± 2% +8.4% 118965 ± 3% softirqs.CPU104.TIMER 134878 ± 3% +13.6% 153283 ± 3% softirqs.CPU105.RCU 134096 ± 3% +14.1% 153022 ± 3% softirqs.CPU106.RCU 109821 ± 2% +8.2% 118845 ± 3% softirqs.CPU106.TIMER 133905 ± 3% +15.0% 154004 ± 3% softirqs.CPU107.RCU 134117 ± 3% +14.3% 153232 ± 3% softirqs.CPU108.RCU 109545 ± 2% +8.8% 119182 ± 3% softirqs.CPU108.TIMER 134574 ± 3% +13.8% 153202 ± 3% softirqs.CPU109.RCU 109804 ± 3% +8.2% 118760 ± 3% softirqs.CPU109.TIMER 135106 ± 3% +14.8% 155124 ± 3% softirqs.CPU11.RCU 111746 ± 4% +7.8% 120460 ± 3% softirqs.CPU11.TIMER 134482 ± 4% +14.3% 153687 ± 3% softirqs.CPU110.RCU 110314 ± 3% +8.1% 119241 ± 3% softirqs.CPU110.TIMER 134464 ± 3% +14.3% 153634 ± 3% softirqs.CPU111.RCU 110626 ± 3% +8.3% 119815 ± 3% softirqs.CPU111.TIMER 134895 ± 3% +14.4% 154257 ± 3% softirqs.CPU112.RCU 110040 ± 3% +14.6% 126058 ± 16% softirqs.CPU112.TIMER 134644 ± 3% +13.6% 152993 ± 3% softirqs.CPU113.RCU 109693 ± 3% +8.1% 118569 ± 3% softirqs.CPU113.TIMER 134313 ± 3% +13.9% 152993 ± 3% softirqs.CPU114.RCU 109711 ± 3% +8.6% 119143 ± 3% softirqs.CPU114.TIMER 134559 ± 3% +13.8% 153115 ± 3% softirqs.CPU115.RCU 110226 ± 3% +8.2% 119221 ± 3% softirqs.CPU115.TIMER 134087 ± 3% +14.2% 153077 ± 3% softirqs.CPU116.RCU 110225 ± 3% +9.0% 120184 ± 3% softirqs.CPU116.TIMER 134271 ± 3% +14.1% 153220 ± 3% softirqs.CPU117.RCU 109179 ± 2% +8.3% 118274 ± 3% softirqs.CPU117.TIMER 134281 ± 3% +14.1% 153230 ± 3% softirqs.CPU118.RCU 134415 ± 3% +14.0% 153215 ± 3% softirqs.CPU119.RCU 109514 ± 2% +8.3% 118643 ± 3% softirqs.CPU119.TIMER 135560 ± 3% +13.5% 153874 ± 3% softirqs.CPU12.RCU 110316 ± 2% +8.5% 119734 ± 3% softirqs.CPU12.TIMER 134177 ± 3% +14.6% 153815 ± 3% softirqs.CPU120.RCU 134367 ± 3% +15.0% 154493 ± 3% softirqs.CPU121.RCU 133972 ± 3% +14.3% 153173 ± 3% softirqs.CPU122.RCU 134801 ± 4% +13.6% 153136 ± 3% softirqs.CPU123.RCU 134709 ± 3% +13.9% 153440 ± 3% softirqs.CPU124.RCU 135185 ± 3% +13.1% 152925 ± 3% softirqs.CPU125.RCU 134977 ± 3% +13.8% 153608 ± 3% softirqs.CPU126.RCU 133862 ± 4% +14.7% 153558 ± 3% softirqs.CPU127.RCU 134554 ± 3% +13.9% 153237 ± 3% softirqs.CPU128.RCU 134254 ± 3% +14.1% 153130 ± 3% softirqs.CPU129.RCU 135133 ± 3% +14.0% 154103 ± 3% softirqs.CPU13.RCU 110389 ± 2% +8.1% 119382 ± 3% softirqs.CPU13.TIMER 134319 ± 3% +13.8% 152909 ± 3% softirqs.CPU130.RCU 133590 ± 3% +14.5% 152925 ± 3% softirqs.CPU131.RCU 134416 ± 4% +14.0% 153223 ± 3% softirqs.CPU132.RCU 133931 ± 3% +14.5% 153359 ± 3% softirqs.CPU133.RCU 134031 ± 3% +14.5% 153527 ± 3% softirqs.CPU134.RCU 133851 ± 4% +14.3% 153052 ± 3% softirqs.CPU135.RCU 134235 ± 4% +13.9% 152959 ± 3% softirqs.CPU136.RCU 134003 ± 3% +14.2% 153037 ± 3% softirqs.CPU137.RCU 133453 ± 3% +14.4% 152625 ± 3% softirqs.CPU138.RCU 133514 ± 3% +14.8% 153289 ± 3% softirqs.CPU139.RCU 134952 ± 3% +13.6% 153372 ± 3% softirqs.CPU14.RCU 134045 ± 3% +13.7% 152361 ± 3% softirqs.CPU140.RCU 133662 ± 3% +14.1% 152528 ± 3% softirqs.CPU141.RCU 133643 ± 3% +14.7% 153283 ± 2% softirqs.CPU142.RCU 133313 ± 3% +15.0% 153254 ± 3% softirqs.CPU143.RCU 133585 ± 3% +14.4% 152837 ± 3% softirqs.CPU144.RCU 108590 ± 3% +12.7% 122339 ± 5% softirqs.CPU144.TIMER 133471 ± 3% +14.5% 152883 ± 3% softirqs.CPU145.RCU 108095 ± 3% +14.5% 123726 ± 6% softirqs.CPU145.TIMER 133588 ± 3% +15.4% 154173 ± 3% softirqs.CPU146.RCU 108268 ± 3% +19.8% 129684 ± 16% softirqs.CPU146.TIMER 134060 ± 3% +14.3% 153270 ± 3% softirqs.CPU147.RCU 108731 ± 3% +13.0% 122902 ± 5% softirqs.CPU147.TIMER 133778 ± 3% +14.1% 152681 ± 3% softirqs.CPU148.RCU 108208 ± 3% +12.6% 121875 ± 5% softirqs.CPU148.TIMER 133514 ± 3% +14.2% 152460 ± 3% softirqs.CPU149.RCU 108054 ± 3% +15.6% 124938 ± 9% softirqs.CPU149.TIMER 134677 ± 3% +14.5% 154138 ± 2% softirqs.CPU15.RCU 133245 ± 3% +14.4% 152373 ± 3% softirqs.CPU150.RCU 107788 ± 3% +13.1% 121957 ± 5% softirqs.CPU150.TIMER 133747 ± 3% +14.0% 152473 ± 3% softirqs.CPU151.RCU 108258 ± 4% +12.4% 121662 ± 5% softirqs.CPU151.TIMER 133819 ± 3% +14.1% 152726 ± 3% softirqs.CPU152.RCU 108163 ± 3% +12.7% 121940 ± 5% softirqs.CPU152.TIMER 134057 ± 3% +14.0% 152844 ± 3% softirqs.CPU153.RCU 107680 ± 3% +13.1% 121787 ± 5% softirqs.CPU153.TIMER 133660 ± 3% +14.2% 152675 ± 3% softirqs.CPU154.RCU 107911 ± 3% +15.4% 124485 ± 9% softirqs.CPU154.TIMER 133349 ± 3% +14.6% 152811 ± 3% softirqs.CPU155.RCU 107513 ± 3% +15.1% 123737 ± 6% softirqs.CPU155.TIMER 133901 ± 3% +14.0% 152615 ± 3% softirqs.CPU156.RCU 107853 ± 3% +13.0% 121904 ± 5% softirqs.CPU156.TIMER 133621 ± 3% +14.2% 152615 ± 3% softirqs.CPU157.RCU 108040 ± 3% +12.6% 121684 ± 5% softirqs.CPU157.TIMER 133891 ± 3% +14.2% 152862 ± 3% softirqs.CPU158.RCU 108534 ± 3% +12.7% 122300 ± 5% softirqs.CPU158.TIMER 133925 ± 3% +14.5% 153347 ± 3% softirqs.CPU159.RCU 108099 ± 3% +12.9% 122015 ± 5% softirqs.CPU159.TIMER 134893 ± 3% +14.5% 154389 ± 3% softirqs.CPU16.RCU 134169 ± 3% +13.9% 152812 ± 3% softirqs.CPU160.RCU 108300 ± 3% +12.9% 122318 ± 5% softirqs.CPU160.TIMER 133818 ± 3% +15.1% 154048 ± 4% softirqs.CPU161.RCU 107919 ± 3% +13.6% 122606 ± 6% softirqs.CPU161.TIMER 133867 ± 3% +14.2% 152856 ± 3% softirqs.CPU162.RCU 107991 ± 3% +13.2% 122209 ± 5% softirqs.CPU162.TIMER 133579 ± 3% +14.3% 152654 ± 3% softirqs.CPU163.RCU 108317 ± 3% +12.9% 122271 ± 5% softirqs.CPU163.TIMER 133914 ± 3% +14.4% 153158 ± 3% softirqs.CPU164.RCU 133684 ± 3% +14.4% 152895 ± 3% softirqs.CPU165.RCU 107435 ± 3% +12.5% 120877 ± 5% softirqs.CPU165.TIMER 133983 ± 3% +13.9% 152582 ± 3% softirqs.CPU166.RCU 107432 ± 3% +13.2% 121641 ± 5% softirqs.CPU166.TIMER 133947 ± 3% +13.6% 152137 ± 3% softirqs.CPU167.RCU 134005 ± 3% +14.5% 153385 ± 4% softirqs.CPU168.RCU 115752 ± 4% +12.0% 129634 ± 4% softirqs.CPU168.TIMER 133557 ± 3% +15.2% 153865 ± 4% softirqs.CPU169.RCU 115884 ± 3% +11.7% 129481 ± 4% softirqs.CPU169.TIMER 135348 ± 3% +13.8% 153977 ± 3% softirqs.CPU17.RCU 110589 ± 3% +7.9% 119298 ± 3% softirqs.CPU17.TIMER 134463 ± 3% +14.0% 153229 ± 3% softirqs.CPU170.RCU 133740 ± 3% +14.1% 152630 ± 3% softirqs.CPU171.RCU 116524 ± 4% +10.9% 129237 ± 3% softirqs.CPU171.TIMER 133716 ± 3% +13.8% 152196 ± 3% softirqs.CPU172.RCU 116393 ± 4% +10.9% 129087 ± 4% softirqs.CPU172.TIMER 133564 ± 3% +13.9% 152165 ± 3% softirqs.CPU173.RCU 116237 ± 3% +11.4% 129460 ± 3% softirqs.CPU173.TIMER 133411 ± 3% +14.5% 152764 ± 3% softirqs.CPU174.RCU 116018 ± 3% +11.2% 129006 ± 4% softirqs.CPU174.TIMER 133147 ± 3% +15.0% 153104 ± 2% softirqs.CPU175.RCU 116052 ± 4% +11.7% 129664 ± 3% softirqs.CPU175.TIMER 133989 ± 3% +13.8% 152504 ± 3% softirqs.CPU176.RCU 116071 ± 4% +10.9% 128756 ± 3% softirqs.CPU176.TIMER 133902 ± 3% +14.1% 152811 ± 3% softirqs.CPU177.RCU 115994 ± 3% +11.1% 128849 ± 4% softirqs.CPU177.TIMER 133679 ± 3% +14.4% 152887 ± 3% softirqs.CPU178.RCU 115942 ± 4% +13.4% 131439 ± 5% softirqs.CPU178.TIMER 133985 ± 3% +14.0% 152762 ± 3% softirqs.CPU179.RCU 116347 ± 4% +11.2% 129422 ± 4% softirqs.CPU179.TIMER 134982 ± 3% +14.0% 153838 ± 3% softirqs.CPU18.RCU 110310 ± 3% +8.6% 119851 ± 3% softirqs.CPU18.TIMER 133236 ± 3% +14.7% 152870 ± 3% softirqs.CPU180.RCU 115901 ± 4% +11.3% 129054 ± 4% softirqs.CPU180.TIMER 133615 ± 3% +14.4% 152876 ± 3% softirqs.CPU181.RCU 115505 ± 4% +11.3% 128560 ± 3% softirqs.CPU181.TIMER 133171 ± 3% +14.7% 152810 ± 3% softirqs.CPU182.RCU 115955 ± 4% +11.0% 128687 ± 3% softirqs.CPU182.TIMER 133413 ± 3% +14.4% 152671 ± 3% softirqs.CPU183.RCU 116313 ± 4% +11.0% 129140 ± 3% softirqs.CPU183.TIMER 133598 ± 3% +14.8% 153388 ± 3% softirqs.CPU184.RCU 115462 ± 3% +13.0% 130430 ± 6% softirqs.CPU184.TIMER 133884 ± 3% +13.9% 152525 ± 3% softirqs.CPU185.RCU 115598 ± 4% +11.1% 128397 ± 4% softirqs.CPU185.TIMER 133262 ± 3% +14.5% 152646 ± 3% softirqs.CPU186.RCU 115745 ± 3% +11.1% 128612 ± 4% softirqs.CPU186.TIMER 133430 ± 3% +14.5% 152767 ± 3% softirqs.CPU187.RCU 115769 ± 4% +11.0% 128464 ± 3% softirqs.CPU187.TIMER 133259 ± 3% +14.8% 153036 ± 3% softirqs.CPU188.RCU 116108 ± 4% +11.3% 129232 ± 3% softirqs.CPU188.TIMER 133609 ± 3% +14.1% 152436 ± 3% softirqs.CPU189.RCU 115984 ± 4% +11.0% 128710 ± 3% softirqs.CPU189.TIMER 135090 ± 3% +13.9% 153802 ± 3% softirqs.CPU19.RCU 110865 ± 2% +8.2% 119936 ± 3% softirqs.CPU19.TIMER 133685 ± 3% +14.2% 152631 ± 3% softirqs.CPU190.RCU 115642 ± 3% +11.2% 128581 ± 4% softirqs.CPU190.TIMER 131031 ± 3% +14.6% 150126 ± 3% softirqs.CPU191.RCU 114275 ± 4% +11.4% 127249 ± 4% softirqs.CPU191.TIMER 134928 ± 3% +14.3% 154165 ± 3% softirqs.CPU2.RCU 135126 ± 3% +14.0% 154083 ± 3% softirqs.CPU20.RCU 111013 ± 3% +8.6% 120549 ± 3% softirqs.CPU20.TIMER 134663 ± 3% +14.5% 154251 ± 3% softirqs.CPU21.RCU 109671 ± 2% +8.2% 118708 ± 3% softirqs.CPU21.TIMER 135047 ± 3% +13.9% 153766 ± 3% softirqs.CPU22.RCU 134437 ± 3% +14.2% 153492 ± 3% softirqs.CPU23.RCU 109675 ± 2% +8.3% 118824 ± 3% softirqs.CPU23.TIMER 136114 ± 3% +13.3% 154277 ± 3% softirqs.CPU24.RCU 134825 ± 3% +14.2% 154007 ± 3% softirqs.CPU25.RCU 139234 ± 4% +13.8% 158515 ± 3% softirqs.CPU26.RCU 135056 ± 3% +14.1% 154062 ± 3% softirqs.CPU27.RCU 135307 ± 3% +13.7% 153897 ± 3% softirqs.CPU28.RCU 134686 ± 3% +14.7% 154497 ± 3% softirqs.CPU29.RCU 134688 ± 3% +14.4% 154115 ± 2% softirqs.CPU3.RCU 134642 ± 3% +14.5% 154226 ± 3% softirqs.CPU30.RCU 134773 ± 3% +14.2% 153887 ± 3% softirqs.CPU31.RCU 134523 ± 3% +14.3% 153733 ± 3% softirqs.CPU32.RCU 134488 ± 3% +14.4% 153801 ± 3% softirqs.CPU33.RCU 134483 ± 3% +14.1% 153380 ± 3% softirqs.CPU34.RCU 134886 ± 3% +13.6% 153180 ± 3% softirqs.CPU35.RCU 135021 ± 3% +13.6% 153340 ± 3% softirqs.CPU36.RCU 134064 ± 3% +15.1% 154277 ± 3% softirqs.CPU37.RCU 134166 ± 3% +14.8% 153967 ± 3% softirqs.CPU38.RCU 134488 ± 3% +14.4% 153871 ± 3% softirqs.CPU39.RCU 135294 ± 2% +14.6% 155025 ± 3% softirqs.CPU4.RCU 134598 ± 4% +14.3% 153848 ± 3% softirqs.CPU40.RCU 134255 ± 3% +14.8% 154099 ± 3% softirqs.CPU41.RCU 134334 ± 3% +14.3% 153491 ± 3% softirqs.CPU42.RCU 134201 ± 3% +14.5% 153654 ± 3% softirqs.CPU43.RCU 134260 ± 3% +14.2% 153359 ± 3% softirqs.CPU44.RCU 134005 ± 3% +14.4% 153367 ± 3% softirqs.CPU45.RCU 134236 ± 3% +14.3% 153419 ± 3% softirqs.CPU46.RCU 134552 ± 3% +13.8% 153056 ± 3% softirqs.CPU47.RCU 134623 ± 3% +14.4% 154028 ± 3% softirqs.CPU48.RCU 134348 ± 3% +14.7% 154080 ± 3% softirqs.CPU49.RCU 109020 ± 3% +18.6% 129279 ± 14% softirqs.CPU49.TIMER 134334 ± 3% +15.0% 154455 ± 3% softirqs.CPU5.RCU 110260 ± 2% +8.8% 119951 ± 4% softirqs.CPU5.TIMER 134377 ± 3% +13.8% 152954 ± 3% softirqs.CPU50.RCU 109169 ± 3% +15.0% 125548 ± 9% softirqs.CPU50.TIMER 134780 ± 3% +14.2% 153967 ± 3% softirqs.CPU51.RCU 109951 ± 3% +12.5% 123641 ± 5% softirqs.CPU51.TIMER 133929 ± 3% +15.0% 154012 ± 3% softirqs.CPU52.RCU 108665 ± 3% +12.8% 122613 ± 5% softirqs.CPU52.TIMER 133761 ± 3% +14.9% 153675 ± 3% softirqs.CPU53.RCU 108606 ± 3% +19.6% 129861 ± 16% softirqs.CPU53.TIMER 134369 ± 3% +14.1% 153255 ± 3% softirqs.CPU54.RCU 108917 ± 3% +12.5% 122585 ± 5% softirqs.CPU54.TIMER 133810 ± 3% +14.6% 153282 ± 3% softirqs.CPU55.RCU 108875 ± 3% +12.5% 122468 ± 5% softirqs.CPU55.TIMER 134038 ± 3% +14.3% 153248 ± 3% softirqs.CPU56.RCU 108569 ± 3% +12.8% 122502 ± 5% softirqs.CPU56.TIMER 133993 ± 4% +14.5% 153426 ± 3% softirqs.CPU57.RCU 108465 ± 3% +12.8% 122399 ± 5% softirqs.CPU57.TIMER 134049 ± 3% +14.7% 153708 ± 3% softirqs.CPU58.RCU 108634 ± 4% +18.8% 129107 ± 16% softirqs.CPU58.TIMER 134025 ± 3% +14.9% 154015 ± 3% softirqs.CPU59.RCU 108501 ± 3% +18.6% 128721 ± 13% softirqs.CPU59.TIMER 135247 ± 3% +14.5% 154804 ± 3% softirqs.CPU6.RCU 133745 ± 4% +14.7% 153452 ± 3% softirqs.CPU60.RCU 108526 ± 3% +13.0% 122688 ± 5% softirqs.CPU60.TIMER 133931 ± 3% +14.6% 153549 ± 3% softirqs.CPU61.RCU 108764 ± 3% +12.9% 122787 ± 5% softirqs.CPU61.TIMER 134682 ± 3% +13.8% 153266 ± 3% softirqs.CPU62.RCU 109188 ± 3% +12.5% 122806 ± 5% softirqs.CPU62.TIMER 134190 ± 3% +14.6% 153761 ± 2% softirqs.CPU63.RCU 108489 ± 3% +12.8% 122426 ± 5% softirqs.CPU63.TIMER 134280 ± 3% +14.3% 153538 ± 3% softirqs.CPU64.RCU 108493 ± 3% +13.3% 122953 ± 5% softirqs.CPU64.TIMER 134074 ± 3% +14.7% 153765 ± 3% softirqs.CPU65.RCU 108331 ± 3% +13.0% 122440 ± 5% softirqs.CPU65.TIMER 134424 ± 4% +14.3% 153692 ± 3% softirqs.CPU66.RCU 108874 ± 3% +12.5% 122490 ± 5% softirqs.CPU66.TIMER 133801 ± 3% +14.9% 153746 ± 3% softirqs.CPU67.RCU 108903 ± 3% +13.2% 123240 ± 5% softirqs.CPU67.TIMER 134085 ± 3% +14.4% 153371 ± 3% softirqs.CPU68.RCU 109310 ± 3% +12.3% 122810 ± 5% softirqs.CPU68.TIMER 134091 ± 3% +14.5% 153515 ± 3% softirqs.CPU69.RCU 108193 ± 3% +12.5% 121716 ± 5% softirqs.CPU69.TIMER 134883 ± 3% +13.6% 153181 ± 3% softirqs.CPU7.RCU 134392 ± 3% +14.8% 154240 ± 3% softirqs.CPU70.RCU 108056 ± 3% +13.4% 122578 ± 5% softirqs.CPU70.TIMER 133901 ± 3% +14.2% 152873 ± 3% softirqs.CPU71.RCU 134273 ± 3% +14.4% 153630 ± 3% softirqs.CPU72.RCU 116189 ± 3% +11.5% 129495 ± 3% softirqs.CPU72.TIMER 134231 ± 3% +14.5% 153682 ± 3% softirqs.CPU73.RCU 116348 ± 3% +11.3% 129453 ± 3% softirqs.CPU73.TIMER 134235 ± 3% +14.1% 153158 ± 3% softirqs.CPU74.RCU 133896 ± 3% +14.6% 153477 ± 3% softirqs.CPU75.RCU 116933 ± 4% +11.2% 129980 ± 3% softirqs.CPU75.TIMER 134014 ± 3% +14.3% 153198 ± 3% softirqs.CPU76.RCU 116889 ± 3% +11.0% 129768 ± 3% softirqs.CPU76.TIMER 134608 ± 3% +13.7% 152994 ± 3% softirqs.CPU77.RCU 117342 ± 3% +11.0% 130274 ± 3% softirqs.CPU77.TIMER 134551 ± 3% +13.9% 153253 ± 3% softirqs.CPU78.RCU 117229 ± 4% +10.5% 129549 ± 4% softirqs.CPU78.TIMER 134118 ± 3% +14.3% 153325 ± 3% softirqs.CPU79.RCU 116982 ± 3% +11.0% 129802 ± 3% softirqs.CPU79.TIMER 135303 ± 3% +13.9% 154129 ± 3% softirqs.CPU8.RCU 134699 ± 3% +13.6% 153047 ± 3% softirqs.CPU80.RCU 117058 ± 4% +10.6% 129470 ± 3% softirqs.CPU80.TIMER 134088 ± 3% +15.6% 155063 ± 3% softirqs.CPU81.RCU 116539 ± 4% +12.3% 130886 ± 5% softirqs.CPU81.TIMER 133989 ± 3% +14.6% 153526 ± 3% softirqs.CPU82.RCU 116614 ± 4% +16.8% 136238 ± 12% softirqs.CPU82.TIMER 133966 ± 3% +14.3% 153142 ± 3% softirqs.CPU83.RCU 117140 ± 3% +11.2% 130205 ± 4% softirqs.CPU83.TIMER 133561 ± 3% +15.0% 153661 ± 3% softirqs.CPU84.RCU 116648 ± 4% +11.3% 129844 ± 4% softirqs.CPU84.TIMER 134217 ± 3% +14.2% 153330 ± 3% softirqs.CPU85.RCU 116247 ± 4% +11.3% 129336 ± 3% softirqs.CPU85.TIMER 133956 ± 3% +14.5% 153338 ± 3% softirqs.CPU86.RCU 116654 ± 4% +11.1% 129560 ± 3% softirqs.CPU86.TIMER 133834 ± 3% +15.1% 154049 ± 2% softirqs.CPU87.RCU 116898 ± 4% +12.0% 130912 ± 3% softirqs.CPU87.TIMER 133951 ± 3% +15.1% 154211 ± 3% softirqs.CPU88.RCU 116139 ± 3% +16.0% 134676 ± 13% softirqs.CPU88.TIMER 134288 ± 3% +14.3% 153433 ± 2% softirqs.CPU89.RCU 116227 ± 3% +11.0% 129064 ± 3% softirqs.CPU89.TIMER 135289 ± 3% +13.6% 153744 ± 3% softirqs.CPU9.RCU 133598 ± 3% +14.5% 153019 ± 3% softirqs.CPU90.RCU 116395 ± 3% +10.9% 129084 ± 4% softirqs.CPU90.TIMER 133854 ± 4% +14.9% 153799 ± 3% softirqs.CPU91.RCU 116562 ± 4% +11.1% 129452 ± 3% softirqs.CPU91.TIMER 134107 ± 3% +14.1% 152958 ± 3% softirqs.CPU92.RCU 117107 ± 4% +10.6% 129559 ± 3% softirqs.CPU92.TIMER 133800 ± 3% +14.7% 153465 ± 3% softirqs.CPU93.RCU 116415 ± 3% +11.5% 129823 ± 4% softirqs.CPU93.TIMER 134092 ± 3% +14.0% 152835 ± 3% softirqs.CPU94.RCU 116063 ± 3% +11.4% 129252 ± 4% softirqs.CPU94.TIMER 134284 ± 3% +14.1% 153230 ± 4% softirqs.CPU95.RCU 117908 ± 3% +11.0% 130904 ± 4% softirqs.CPU95.TIMER 134264 ± 3% +14.3% 153455 ± 3% softirqs.CPU96.RCU 109819 ± 3% +8.6% 119258 ± 3% softirqs.CPU96.TIMER 135000 ± 3% +13.7% 153529 ± 3% softirqs.CPU97.RCU 134163 ± 3% +14.2% 153253 ± 3% softirqs.CPU98.RCU 109990 ± 3% +8.1% 118896 ± 3% softirqs.CPU98.TIMER 134966 ± 3% +13.5% 153245 ± 3% softirqs.CPU99.RCU 25776297 ± 3% +14.3% 29452390 ± 3% softirqs.RCU 21445010 ± 3% +9.5% 23488096 ± 3% softirqs.TIMER 614.00 ± 2% +9.9% 674.50 ± 2% interrupts.9:IO-APIC.9-fasteoi.acpi 611854 ± 2% +10.1% 673945 ± 2% interrupts.CPU0.LOC:Local_timer_interrupts 614.00 ± 2% +9.9% 674.50 ± 2% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 611835 ± 2% +10.1% 673883 ± 2% interrupts.CPU1.LOC:Local_timer_interrupts 611859 ± 2% +10.2% 673975 ± 2% interrupts.CPU10.LOC:Local_timer_interrupts 7508 ± 5% +15.5% 8675 ± 4% interrupts.CPU10.RES:Rescheduling_interrupts 611802 ± 2% +10.2% 673904 ± 2% interrupts.CPU100.LOC:Local_timer_interrupts 7323 ± 5% +16.1% 8503 ± 3% interrupts.CPU100.RES:Rescheduling_interrupts 611804 ± 2% +10.2% 673917 ± 2% interrupts.CPU101.LOC:Local_timer_interrupts 7342 ± 3% +13.8% 8352 ± 3% interrupts.CPU101.RES:Rescheduling_interrupts 611780 ± 2% +10.2% 673877 ± 2% interrupts.CPU102.LOC:Local_timer_interrupts 7506 ± 5% +12.2% 8424 ± 4% interrupts.CPU102.RES:Rescheduling_interrupts 611734 ± 2% +10.2% 673851 ± 2% interrupts.CPU103.LOC:Local_timer_interrupts 7436 ± 3% +15.8% 8607 ± 4% interrupts.CPU103.RES:Rescheduling_interrupts 611800 ± 2% +10.2% 673908 ± 2% interrupts.CPU104.LOC:Local_timer_interrupts 7519 ± 5% +13.1% 8502 ± 2% interrupts.CPU104.RES:Rescheduling_interrupts 611790 ± 2% +10.1% 673864 ± 2% interrupts.CPU105.LOC:Local_timer_interrupts 7346 ± 5% +16.4% 8553 ± 2% interrupts.CPU105.RES:Rescheduling_interrupts 611801 ± 2% +10.1% 673859 ± 2% interrupts.CPU106.LOC:Local_timer_interrupts 7352 ± 5% +16.5% 8567 ± 2% interrupts.CPU106.RES:Rescheduling_interrupts 611797 ± 2% +10.1% 673890 ± 2% interrupts.CPU107.LOC:Local_timer_interrupts 7238 ± 6% +15.3% 8344 ± 4% interrupts.CPU107.RES:Rescheduling_interrupts 611778 ± 2% +10.2% 673882 ± 2% interrupts.CPU108.LOC:Local_timer_interrupts 7310 ± 5% +16.3% 8503 ± 5% interrupts.CPU108.RES:Rescheduling_interrupts 611788 ± 2% +10.1% 673881 ± 2% interrupts.CPU109.LOC:Local_timer_interrupts 7324 ± 6% +13.4% 8307 interrupts.CPU109.RES:Rescheduling_interrupts 611827 ± 2% +10.2% 673960 ± 2% interrupts.CPU11.LOC:Local_timer_interrupts 7598 ± 6% +12.6% 8557 ± 5% interrupts.CPU11.RES:Rescheduling_interrupts 611796 ± 2% +10.1% 673865 ± 2% interrupts.CPU110.LOC:Local_timer_interrupts 7326 ± 4% +16.2% 8513 ± 4% interrupts.CPU110.RES:Rescheduling_interrupts 611804 ± 2% +10.1% 673890 ± 2% interrupts.CPU111.LOC:Local_timer_interrupts 7312 ± 3% +14.4% 8365 ± 3% interrupts.CPU111.RES:Rescheduling_interrupts 611801 ± 2% +10.1% 673890 ± 2% interrupts.CPU112.LOC:Local_timer_interrupts 7277 ± 2% +14.6% 8337 ± 5% interrupts.CPU112.RES:Rescheduling_interrupts 611789 ± 2% +10.2% 673896 ± 2% interrupts.CPU113.LOC:Local_timer_interrupts 7346 ± 4% +15.2% 8461 ± 4% interrupts.CPU113.RES:Rescheduling_interrupts 611759 ± 2% +10.2% 673861 ± 2% interrupts.CPU114.LOC:Local_timer_interrupts 7290 ± 4% +17.9% 8594 ± 4% interrupts.CPU114.RES:Rescheduling_interrupts 611783 ± 2% +10.2% 673883 ± 2% interrupts.CPU115.LOC:Local_timer_interrupts 7470 ± 4% +13.6% 8489 ± 5% interrupts.CPU115.RES:Rescheduling_interrupts 611807 ± 2% +10.2% 673925 ± 2% interrupts.CPU116.LOC:Local_timer_interrupts 7336 ± 4% +15.3% 8455 ± 2% interrupts.CPU116.RES:Rescheduling_interrupts 611778 ± 2% +10.2% 673890 ± 2% interrupts.CPU117.LOC:Local_timer_interrupts 7326 ± 5% +15.9% 8493 ± 3% interrupts.CPU117.RES:Rescheduling_interrupts 611782 ± 2% +10.1% 673849 ± 2% interrupts.CPU118.LOC:Local_timer_interrupts 7239 ± 4% +18.4% 8574 ± 5% interrupts.CPU118.RES:Rescheduling_interrupts 611778 ± 2% +10.2% 673881 ± 2% interrupts.CPU119.LOC:Local_timer_interrupts 7327 ± 4% +13.7% 8335 ± 6% interrupts.CPU119.RES:Rescheduling_interrupts 611853 ± 2% +10.1% 673944 ± 2% interrupts.CPU12.LOC:Local_timer_interrupts 7516 ± 4% +17.0% 8798 ± 6% interrupts.CPU12.RES:Rescheduling_interrupts 611417 ± 2% +10.2% 673606 ± 2% interrupts.CPU120.LOC:Local_timer_interrupts 7392 ± 4% +14.2% 8444 ± 5% interrupts.CPU120.RES:Rescheduling_interrupts 611457 ± 2% +10.2% 673608 ± 2% interrupts.CPU121.LOC:Local_timer_interrupts 7376 ± 3% +15.6% 8525 ± 4% interrupts.CPU121.RES:Rescheduling_interrupts 611426 ± 2% +10.2% 673610 ± 2% interrupts.CPU122.LOC:Local_timer_interrupts 7466 ± 5% +11.7% 8336 ± 4% interrupts.CPU122.RES:Rescheduling_interrupts 611384 ± 2% +10.2% 673577 ± 2% interrupts.CPU123.LOC:Local_timer_interrupts 7240 ± 5% +18.2% 8559 ± 3% interrupts.CPU123.RES:Rescheduling_interrupts 611388 ± 2% +10.2% 673597 ± 2% interrupts.CPU124.LOC:Local_timer_interrupts 7245 ± 5% +18.0% 8548 ± 5% interrupts.CPU124.RES:Rescheduling_interrupts 611391 ± 2% +10.2% 673567 ± 2% interrupts.CPU125.LOC:Local_timer_interrupts 7318 ± 3% +15.3% 8436 ± 5% interrupts.CPU125.RES:Rescheduling_interrupts 611421 ± 2% +10.2% 673570 ± 2% interrupts.CPU126.LOC:Local_timer_interrupts 7258 ± 5% +16.4% 8448 ± 4% interrupts.CPU126.RES:Rescheduling_interrupts 611468 ± 2% +10.2% 673614 ± 2% interrupts.CPU127.LOC:Local_timer_interrupts 7276 ± 5% +16.9% 8508 ± 5% interrupts.CPU127.RES:Rescheduling_interrupts 611422 ± 2% +10.2% 673591 ± 2% interrupts.CPU128.LOC:Local_timer_interrupts 7278 ± 4% +17.0% 8518 ± 3% interrupts.CPU128.RES:Rescheduling_interrupts 611407 ± 2% +10.2% 673562 ± 2% interrupts.CPU129.LOC:Local_timer_interrupts 7284 ± 3% +17.0% 8519 ± 5% interrupts.CPU129.RES:Rescheduling_interrupts 611825 ± 2% +10.1% 673920 ± 2% interrupts.CPU13.LOC:Local_timer_interrupts 7550 ± 4% +16.2% 8771 ± 3% interrupts.CPU13.RES:Rescheduling_interrupts 611428 ± 2% +10.2% 673571 ± 2% interrupts.CPU130.LOC:Local_timer_interrupts 7337 ± 5% +16.4% 8541 ± 5% interrupts.CPU130.RES:Rescheduling_interrupts 611406 ± 2% +10.2% 673582 ± 2% interrupts.CPU131.LOC:Local_timer_interrupts 7205 ± 5% +17.1% 8440 ± 6% interrupts.CPU131.RES:Rescheduling_interrupts 611449 ± 2% +10.2% 673586 ± 2% interrupts.CPU132.LOC:Local_timer_interrupts 7431 ± 4% +12.7% 8372 ± 3% interrupts.CPU132.RES:Rescheduling_interrupts 611464 ± 2% +10.2% 673588 ± 2% interrupts.CPU133.LOC:Local_timer_interrupts 7289 ± 4% +15.9% 8446 ± 3% interrupts.CPU133.RES:Rescheduling_interrupts 611437 ± 2% +10.2% 673583 ± 2% interrupts.CPU134.LOC:Local_timer_interrupts 7321 ± 4% +17.7% 8616 ± 4% interrupts.CPU134.RES:Rescheduling_interrupts 611401 ± 2% +10.2% 673595 ± 2% interrupts.CPU135.LOC:Local_timer_interrupts 7300 ± 4% +15.7% 8446 ± 4% interrupts.CPU135.RES:Rescheduling_interrupts 611462 ± 2% +10.2% 673602 ± 2% interrupts.CPU136.LOC:Local_timer_interrupts 7389 ± 4% +13.9% 8417 ± 5% interrupts.CPU136.RES:Rescheduling_interrupts 611424 ± 2% +10.2% 673588 ± 2% interrupts.CPU137.LOC:Local_timer_interrupts 7126 ± 4% +20.0% 8550 ± 5% interrupts.CPU137.RES:Rescheduling_interrupts 611383 ± 2% +10.2% 673556 ± 2% interrupts.CPU138.LOC:Local_timer_interrupts 7297 ± 5% +16.1% 8475 ± 5% interrupts.CPU138.RES:Rescheduling_interrupts 611422 ± 2% +10.2% 673603 ± 2% interrupts.CPU139.LOC:Local_timer_interrupts 7160 ± 4% +17.6% 8423 ± 4% interrupts.CPU139.RES:Rescheduling_interrupts 611815 ± 2% +10.1% 673901 ± 2% interrupts.CPU14.LOC:Local_timer_interrupts 7576 ± 5% +16.3% 8810 ± 3% interrupts.CPU14.RES:Rescheduling_interrupts 611388 ± 2% +10.2% 673577 ± 2% interrupts.CPU140.LOC:Local_timer_interrupts 7342 ± 6% +12.9% 8293 ± 4% interrupts.CPU140.RES:Rescheduling_interrupts 611394 ± 2% +10.2% 673596 ± 2% interrupts.CPU141.LOC:Local_timer_interrupts 7257 ± 4% +16.1% 8423 ± 5% interrupts.CPU141.RES:Rescheduling_interrupts 611411 ± 2% +10.2% 673590 ± 2% interrupts.CPU142.LOC:Local_timer_interrupts 7300 ± 6% +16.1% 8475 ± 3% interrupts.CPU142.RES:Rescheduling_interrupts 611396 ± 2% +10.2% 673622 ± 2% interrupts.CPU143.LOC:Local_timer_interrupts 7399 ± 5% +14.0% 8435 ± 4% interrupts.CPU143.RES:Rescheduling_interrupts 610929 ± 2% +10.3% 673686 ± 2% interrupts.CPU144.LOC:Local_timer_interrupts 7281 ± 5% +13.4% 8257 ± 5% interrupts.CPU144.RES:Rescheduling_interrupts 610918 ± 2% +10.3% 673755 ± 2% interrupts.CPU145.LOC:Local_timer_interrupts 7343 ± 5% +14.5% 8408 ± 4% interrupts.CPU145.RES:Rescheduling_interrupts 610910 ± 2% +10.3% 673705 ± 2% interrupts.CPU146.LOC:Local_timer_interrupts 7524 ± 4% +13.6% 8550 ± 6% interrupts.CPU146.RES:Rescheduling_interrupts 610858 ± 2% +10.3% 673769 ± 2% interrupts.CPU147.LOC:Local_timer_interrupts 7433 ± 4% +10.8% 8237 ± 3% interrupts.CPU147.RES:Rescheduling_interrupts 610872 ± 2% +10.3% 673727 ± 2% interrupts.CPU148.LOC:Local_timer_interrupts 7354 ± 3% +13.1% 8320 ± 4% interrupts.CPU148.RES:Rescheduling_interrupts 610909 ± 2% +10.3% 673750 ± 2% interrupts.CPU149.LOC:Local_timer_interrupts 7365 ± 3% +16.5% 8582 ± 3% interrupts.CPU149.RES:Rescheduling_interrupts 611818 ± 2% +10.2% 673937 ± 2% interrupts.CPU15.LOC:Local_timer_interrupts 7632 ± 4% +12.5% 8587 ± 4% interrupts.CPU15.RES:Rescheduling_interrupts 610898 ± 2% +10.3% 673770 ± 2% interrupts.CPU150.LOC:Local_timer_interrupts 7369 ± 4% +12.4% 8282 ± 3% interrupts.CPU150.RES:Rescheduling_interrupts 610887 ± 2% +10.3% 673754 ± 2% interrupts.CPU151.LOC:Local_timer_interrupts 7322 ± 4% +15.3% 8445 ± 3% interrupts.CPU151.RES:Rescheduling_interrupts 610849 ± 2% +10.3% 673762 ± 2% interrupts.CPU152.LOC:Local_timer_interrupts 7305 ± 4% +15.5% 8439 ± 5% interrupts.CPU152.RES:Rescheduling_interrupts 610909 ± 2% +10.3% 673759 ± 2% interrupts.CPU153.LOC:Local_timer_interrupts 7363 ± 6% +14.5% 8432 ± 2% interrupts.CPU153.RES:Rescheduling_interrupts 610878 ± 2% +10.3% 673730 ± 2% interrupts.CPU154.LOC:Local_timer_interrupts 7373 ± 4% +14.1% 8414 ± 4% interrupts.CPU154.RES:Rescheduling_interrupts 610891 ± 2% +10.3% 673720 ± 2% interrupts.CPU155.LOC:Local_timer_interrupts 7385 ± 5% +11.8% 8260 ± 4% interrupts.CPU155.RES:Rescheduling_interrupts 610909 ± 2% +10.3% 673753 ± 2% interrupts.CPU156.LOC:Local_timer_interrupts 7377 ± 5% +14.0% 8410 ± 5% interrupts.CPU156.RES:Rescheduling_interrupts 610886 ± 2% +10.3% 673754 ± 2% interrupts.CPU157.LOC:Local_timer_interrupts 7399 ± 5% +13.1% 8370 ± 4% interrupts.CPU157.RES:Rescheduling_interrupts 610854 ± 2% +10.3% 673699 ± 2% interrupts.CPU158.LOC:Local_timer_interrupts 7489 ± 4% +10.5% 8278 ± 2% interrupts.CPU158.RES:Rescheduling_interrupts 610921 ± 2% +10.3% 673726 ± 2% interrupts.CPU159.LOC:Local_timer_interrupts 7281 ± 5% +15.4% 8402 ± 4% interrupts.CPU159.RES:Rescheduling_interrupts 611836 ± 2% +10.1% 673889 ± 2% interrupts.CPU16.LOC:Local_timer_interrupts 7548 ± 4% +15.6% 8723 ± 5% interrupts.CPU16.RES:Rescheduling_interrupts 610870 ± 2% +10.3% 673742 ± 2% interrupts.CPU160.LOC:Local_timer_interrupts 610856 ± 2% +10.3% 673722 ± 2% interrupts.CPU161.LOC:Local_timer_interrupts 7472 ± 5% +13.4% 8475 ± 5% interrupts.CPU161.RES:Rescheduling_interrupts 610891 ± 2% +10.3% 673708 ± 2% interrupts.CPU162.LOC:Local_timer_interrupts 7177 ± 5% +14.8% 8239 ± 5% interrupts.CPU162.RES:Rescheduling_interrupts 610864 ± 2% +10.3% 673696 ± 2% interrupts.CPU163.LOC:Local_timer_interrupts 7337 ± 5% +12.7% 8266 ± 4% interrupts.CPU163.RES:Rescheduling_interrupts 610858 ± 2% +10.3% 673724 ± 2% interrupts.CPU164.LOC:Local_timer_interrupts 7269 ± 5% +15.2% 8376 ± 4% interrupts.CPU164.RES:Rescheduling_interrupts 610861 ± 2% +10.3% 673711 ± 2% interrupts.CPU165.LOC:Local_timer_interrupts 7431 ± 4% +9.4% 8131 ± 4% interrupts.CPU165.RES:Rescheduling_interrupts 610867 ± 2% +10.3% 673684 ± 2% interrupts.CPU166.LOC:Local_timer_interrupts 7339 ± 2% +14.1% 8374 ± 4% interrupts.CPU166.RES:Rescheduling_interrupts 610913 ± 2% +10.3% 673730 ± 2% interrupts.CPU167.LOC:Local_timer_interrupts 7174 ± 3% +17.5% 8427 ± 4% interrupts.CPU167.RES:Rescheduling_interrupts 611289 ± 2% +10.2% 673888 ± 2% interrupts.CPU168.LOC:Local_timer_interrupts 7311 ± 5% +14.7% 8382 ± 3% interrupts.CPU168.RES:Rescheduling_interrupts 611333 ± 2% +10.2% 673887 ± 2% interrupts.CPU169.LOC:Local_timer_interrupts 7232 ± 2% +17.8% 8517 ± 5% interrupts.CPU169.RES:Rescheduling_interrupts 611838 ± 2% +10.1% 673879 ± 2% interrupts.CPU17.LOC:Local_timer_interrupts 7539 ± 2% +17.7% 8873 ± 10% interrupts.CPU17.RES:Rescheduling_interrupts 611349 ± 2% +10.2% 673889 ± 2% interrupts.CPU170.LOC:Local_timer_interrupts 7374 ± 2% +14.2% 8424 ± 5% interrupts.CPU170.RES:Rescheduling_interrupts 611297 ± 2% +10.2% 673873 ± 2% interrupts.CPU171.LOC:Local_timer_interrupts 7438 ± 4% +13.9% 8471 ± 5% interrupts.CPU171.RES:Rescheduling_interrupts 611304 ± 2% +10.2% 673845 ± 2% interrupts.CPU172.LOC:Local_timer_interrupts 7317 ± 3% +16.6% 8529 ± 5% interrupts.CPU172.RES:Rescheduling_interrupts 611297 ± 2% +10.2% 673887 ± 2% interrupts.CPU173.LOC:Local_timer_interrupts 611309 ± 2% +10.2% 673858 ± 2% interrupts.CPU174.LOC:Local_timer_interrupts 7369 ± 5% +15.8% 8531 ± 5% interrupts.CPU174.RES:Rescheduling_interrupts 611311 ± 2% +10.2% 673872 ± 2% interrupts.CPU175.LOC:Local_timer_interrupts 7352 ± 4% +15.1% 8465 ± 4% interrupts.CPU175.RES:Rescheduling_interrupts 611309 ± 2% +10.2% 673886 ± 2% interrupts.CPU176.LOC:Local_timer_interrupts 7395 ± 2% +14.0% 8434 ± 5% interrupts.CPU176.RES:Rescheduling_interrupts 611322 ± 2% +10.2% 673868 ± 2% interrupts.CPU177.LOC:Local_timer_interrupts 611248 ± 2% +10.2% 673805 ± 2% interrupts.CPU178.LOC:Local_timer_interrupts 7355 ± 5% +14.1% 8393 ± 4% interrupts.CPU178.RES:Rescheduling_interrupts 611319 ± 2% +10.2% 673906 ± 2% interrupts.CPU179.LOC:Local_timer_interrupts 7269 ± 4% +15.2% 8374 ± 6% interrupts.CPU179.RES:Rescheduling_interrupts 611799 ± 2% +10.1% 673864 ± 2% interrupts.CPU18.LOC:Local_timer_interrupts 7585 ± 4% +14.5% 8683 ± 4% interrupts.CPU18.RES:Rescheduling_interrupts 611330 ± 2% +10.2% 673869 ± 2% interrupts.CPU180.LOC:Local_timer_interrupts 7404 ± 4% +14.0% 8442 ± 5% interrupts.CPU180.RES:Rescheduling_interrupts 611324 ± 2% +10.2% 673889 ± 2% interrupts.CPU181.LOC:Local_timer_interrupts 7435 ± 2% +13.0% 8399 ± 3% interrupts.CPU181.RES:Rescheduling_interrupts 611322 ± 2% +10.2% 673874 ± 2% interrupts.CPU182.LOC:Local_timer_interrupts 7250 ± 4% +14.6% 8305 ± 4% interrupts.CPU182.RES:Rescheduling_interrupts 611307 ± 2% +10.2% 673852 ± 2% interrupts.CPU183.LOC:Local_timer_interrupts 7320 ± 4% +13.2% 8290 ± 5% interrupts.CPU183.RES:Rescheduling_interrupts 611329 ± 2% +10.2% 673877 ± 2% interrupts.CPU184.LOC:Local_timer_interrupts 7377 ± 4% +12.5% 8299 ± 5% interrupts.CPU184.RES:Rescheduling_interrupts 611312 ± 2% +10.2% 673866 ± 2% interrupts.CPU185.LOC:Local_timer_interrupts 7333 ± 4% +13.9% 8351 ± 5% interrupts.CPU185.RES:Rescheduling_interrupts 611290 ± 2% +10.2% 673868 ± 2% interrupts.CPU186.LOC:Local_timer_interrupts 7426 ± 4% +14.1% 8471 ± 3% interrupts.CPU186.RES:Rescheduling_interrupts 611304 ± 2% +10.2% 673853 ± 2% interrupts.CPU187.LOC:Local_timer_interrupts 7380 ± 3% +12.5% 8304 ± 5% interrupts.CPU187.RES:Rescheduling_interrupts 611307 ± 2% +10.2% 673881 ± 2% interrupts.CPU188.LOC:Local_timer_interrupts 7277 ± 5% +16.3% 8467 ± 6% interrupts.CPU188.RES:Rescheduling_interrupts 611299 ± 2% +10.2% 673879 ± 2% interrupts.CPU189.LOC:Local_timer_interrupts 7436 ± 3% +14.5% 8514 ± 6% interrupts.CPU189.RES:Rescheduling_interrupts 611761 ± 2% +10.2% 673928 ± 2% interrupts.CPU19.LOC:Local_timer_interrupts 7515 ± 6% +12.7% 8467 ± 4% interrupts.CPU19.RES:Rescheduling_interrupts 611321 ± 2% +10.2% 673856 ± 2% interrupts.CPU190.LOC:Local_timer_interrupts 7188 ± 3% +16.4% 8366 ± 5% interrupts.CPU190.RES:Rescheduling_interrupts 611544 ± 2% +10.2% 674120 ± 2% interrupts.CPU191.LOC:Local_timer_interrupts 7207 ± 3% +15.3% 8312 ± 3% interrupts.CPU191.RES:Rescheduling_interrupts 611805 ± 2% +10.2% 673920 ± 2% interrupts.CPU2.LOC:Local_timer_interrupts 611781 ± 2% +10.2% 673897 ± 2% interrupts.CPU20.LOC:Local_timer_interrupts 7531 ± 5% +16.4% 8768 ± 3% interrupts.CPU20.RES:Rescheduling_interrupts 611715 ± 2% +10.2% 673897 ± 2% interrupts.CPU21.LOC:Local_timer_interrupts 7467 ± 3% +14.9% 8577 ± 4% interrupts.CPU21.RES:Rescheduling_interrupts 611834 ± 2% +10.1% 673900 ± 2% interrupts.CPU22.LOC:Local_timer_interrupts 7427 ± 6% +17.9% 8754 ± 4% interrupts.CPU22.RES:Rescheduling_interrupts 611788 ± 2% +10.1% 673869 ± 2% interrupts.CPU23.LOC:Local_timer_interrupts 7592 ± 4% +12.2% 8518 ± 4% interrupts.CPU23.RES:Rescheduling_interrupts 611426 ± 2% +10.2% 673619 ± 2% interrupts.CPU24.LOC:Local_timer_interrupts 7457 ± 4% +14.7% 8551 ± 3% interrupts.CPU24.RES:Rescheduling_interrupts 611439 ± 2% +10.2% 673636 ± 2% interrupts.CPU25.LOC:Local_timer_interrupts 611402 ± 2% +10.2% 673620 ± 2% interrupts.CPU26.LOC:Local_timer_interrupts 7463 ± 3% +18.4% 8838 ± 7% interrupts.CPU26.RES:Rescheduling_interrupts 611413 ± 2% +10.2% 673615 ± 2% interrupts.CPU27.LOC:Local_timer_interrupts 7412 ± 4% +16.1% 8607 ± 4% interrupts.CPU27.RES:Rescheduling_interrupts 611409 ± 2% +10.2% 673625 ± 2% interrupts.CPU28.LOC:Local_timer_interrupts 7478 ± 5% +15.6% 8648 ± 3% interrupts.CPU28.RES:Rescheduling_interrupts 611415 ± 2% +10.2% 673620 ± 2% interrupts.CPU29.LOC:Local_timer_interrupts 7431 ± 2% +15.5% 8585 ± 2% interrupts.CPU29.RES:Rescheduling_interrupts 611807 ± 2% +10.1% 673896 ± 2% interrupts.CPU3.LOC:Local_timer_interrupts 7659 ± 5% +20.9% 9264 ± 10% interrupts.CPU3.RES:Rescheduling_interrupts 611433 ± 2% +10.2% 673520 ± 2% interrupts.CPU30.LOC:Local_timer_interrupts 7432 ± 3% +16.5% 8659 ± 4% interrupts.CPU30.RES:Rescheduling_interrupts 611450 ± 2% +10.2% 673604 ± 2% interrupts.CPU31.LOC:Local_timer_interrupts 7490 ± 4% +14.6% 8585 ± 5% interrupts.CPU31.RES:Rescheduling_interrupts 611444 ± 2% +10.2% 673588 ± 2% interrupts.CPU32.LOC:Local_timer_interrupts 7393 ± 4% +19.0% 8799 ± 3% interrupts.CPU32.RES:Rescheduling_interrupts 611407 ± 2% +10.2% 673606 ± 2% interrupts.CPU33.LOC:Local_timer_interrupts 7398 ± 4% +16.8% 8644 ± 4% interrupts.CPU33.RES:Rescheduling_interrupts 611452 ± 2% +10.2% 673609 ± 2% interrupts.CPU34.LOC:Local_timer_interrupts 7414 ± 5% +18.8% 8806 ± 4% interrupts.CPU34.RES:Rescheduling_interrupts 611433 ± 2% +10.2% 673588 ± 2% interrupts.CPU35.LOC:Local_timer_interrupts 7486 ± 5% +18.6% 8878 ± 3% interrupts.CPU35.RES:Rescheduling_interrupts 611450 ± 2% +10.2% 673603 ± 2% interrupts.CPU36.LOC:Local_timer_interrupts 7503 ± 3% +15.0% 8627 ± 3% interrupts.CPU36.RES:Rescheduling_interrupts 611465 ± 2% +10.2% 673611 ± 2% interrupts.CPU37.LOC:Local_timer_interrupts 7416 ± 3% +17.6% 8719 ± 2% interrupts.CPU37.RES:Rescheduling_interrupts 611445 ± 2% +10.2% 673575 ± 2% interrupts.CPU38.LOC:Local_timer_interrupts 7477 ± 5% +14.2% 8540 ± 3% interrupts.CPU38.RES:Rescheduling_interrupts 611420 ± 2% +10.2% 673600 ± 2% interrupts.CPU39.LOC:Local_timer_interrupts 7562 ± 5% +14.0% 8620 ± 4% interrupts.CPU39.RES:Rescheduling_interrupts 611823 ± 2% +10.2% 673949 ± 2% interrupts.CPU4.LOC:Local_timer_interrupts 7579 ± 4% +14.9% 8708 ± 3% interrupts.CPU4.RES:Rescheduling_interrupts 611390 ± 2% +10.2% 673618 ± 2% interrupts.CPU40.LOC:Local_timer_interrupts 7444 ± 4% +15.9% 8626 ± 3% interrupts.CPU40.RES:Rescheduling_interrupts 611429 ± 2% +10.2% 673612 ± 2% interrupts.CPU41.LOC:Local_timer_interrupts 7464 ± 5% +15.3% 8605 ± 2% interrupts.CPU41.RES:Rescheduling_interrupts 611418 ± 2% +10.2% 673597 ± 2% interrupts.CPU42.LOC:Local_timer_interrupts 7394 ± 4% +18.6% 8772 ± 5% interrupts.CPU42.RES:Rescheduling_interrupts 611364 ± 2% +10.2% 673601 ± 2% interrupts.CPU43.LOC:Local_timer_interrupts 7483 ± 5% +15.3% 8630 ± 3% interrupts.CPU43.RES:Rescheduling_interrupts 611421 ± 2% +10.2% 673593 ± 2% interrupts.CPU44.LOC:Local_timer_interrupts 7463 ± 2% +16.0% 8656 ± 4% interrupts.CPU44.RES:Rescheduling_interrupts 611423 ± 2% +10.2% 673593 ± 2% interrupts.CPU45.LOC:Local_timer_interrupts 7455 ± 4% +14.8% 8558 ± 3% interrupts.CPU45.RES:Rescheduling_interrupts 611333 ± 2% +10.2% 673616 ± 2% interrupts.CPU46.LOC:Local_timer_interrupts 7406 ± 3% +17.4% 8696 ± 3% interrupts.CPU46.RES:Rescheduling_interrupts 611421 ± 2% +10.2% 673605 ± 2% interrupts.CPU47.LOC:Local_timer_interrupts 7482 ± 5% +15.7% 8660 ± 2% interrupts.CPU47.RES:Rescheduling_interrupts 610910 ± 2% +10.3% 673737 ± 2% interrupts.CPU48.LOC:Local_timer_interrupts 7521 ± 6% +15.1% 8655 ± 4% interrupts.CPU48.RES:Rescheduling_interrupts 610921 ± 2% +10.3% 673770 ± 2% interrupts.CPU49.LOC:Local_timer_interrupts 7594 ± 5% +12.7% 8558 ± 3% interrupts.CPU49.RES:Rescheduling_interrupts 611796 ± 2% +10.1% 673831 ± 2% interrupts.CPU5.LOC:Local_timer_interrupts 610930 ± 2% +10.3% 673671 ± 2% interrupts.CPU50.LOC:Local_timer_interrupts 7504 ± 2% +17.6% 8824 ± 4% interrupts.CPU50.RES:Rescheduling_interrupts 610882 ± 2% +10.3% 673738 ± 2% interrupts.CPU51.LOC:Local_timer_interrupts 610884 ± 2% +10.3% 673731 ± 2% interrupts.CPU52.LOC:Local_timer_interrupts 7436 ± 4% +18.1% 8783 ± 3% interrupts.CPU52.RES:Rescheduling_interrupts 610885 ± 2% +10.3% 673774 ± 2% interrupts.CPU53.LOC:Local_timer_interrupts 7544 ± 4% +15.3% 8700 ± 4% interrupts.CPU53.RES:Rescheduling_interrupts 610902 ± 2% +10.3% 673763 ± 2% interrupts.CPU54.LOC:Local_timer_interrupts 7534 ± 4% +15.6% 8709 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts 610927 ± 2% +10.3% 673739 ± 2% interrupts.CPU55.LOC:Local_timer_interrupts 610883 ± 2% +10.3% 673719 ± 2% interrupts.CPU56.LOC:Local_timer_interrupts 610921 ± 2% +10.3% 673689 ± 2% interrupts.CPU57.LOC:Local_timer_interrupts 7473 ± 5% +14.8% 8577 ± 4% interrupts.CPU57.RES:Rescheduling_interrupts 610893 ± 2% +10.3% 673781 ± 2% interrupts.CPU58.LOC:Local_timer_interrupts 7407 ± 5% +16.6% 8635 ± 3% interrupts.CPU58.RES:Rescheduling_interrupts 610898 ± 2% +10.3% 673763 ± 2% interrupts.CPU59.LOC:Local_timer_interrupts 7642 ± 5% +13.1% 8643 ± 3% interrupts.CPU59.RES:Rescheduling_interrupts 611823 ± 2% +10.1% 673914 ± 2% interrupts.CPU6.LOC:Local_timer_interrupts 7542 ± 3% +17.3% 8845 ± 3% interrupts.CPU6.RES:Rescheduling_interrupts 610869 ± 2% +10.3% 673784 ± 2% interrupts.CPU60.LOC:Local_timer_interrupts 7535 ± 4% +14.8% 8647 ± 5% interrupts.CPU60.RES:Rescheduling_interrupts 610906 ± 2% +10.3% 673701 ± 2% interrupts.CPU61.LOC:Local_timer_interrupts 7631 ± 4% +13.5% 8660 ± 4% interrupts.CPU61.RES:Rescheduling_interrupts 610863 ± 2% +10.3% 673705 ± 2% interrupts.CPU62.LOC:Local_timer_interrupts 7634 ± 4% +11.8% 8532 ± 4% interrupts.CPU62.RES:Rescheduling_interrupts 610920 ± 2% +10.3% 673730 ± 2% interrupts.CPU63.LOC:Local_timer_interrupts 7549 ± 5% +14.8% 8663 ± 5% interrupts.CPU63.RES:Rescheduling_interrupts 610884 ± 2% +10.3% 673727 ± 2% interrupts.CPU64.LOC:Local_timer_interrupts 7644 ± 3% +13.4% 8672 ± 3% interrupts.CPU64.RES:Rescheduling_interrupts 610853 ± 2% +10.3% 673708 ± 2% interrupts.CPU65.LOC:Local_timer_interrupts 7555 ± 5% +14.8% 8672 ± 3% interrupts.CPU65.RES:Rescheduling_interrupts 610950 ± 2% +10.3% 673804 ± 2% interrupts.CPU66.LOC:Local_timer_interrupts 7457 ± 5% +16.8% 8710 ± 4% interrupts.CPU66.RES:Rescheduling_interrupts 610888 ± 2% +10.3% 673735 ± 2% interrupts.CPU67.LOC:Local_timer_interrupts 7550 ± 4% +11.5% 8415 ± 5% interrupts.CPU67.RES:Rescheduling_interrupts 610891 ± 2% +10.3% 673727 ± 2% interrupts.CPU68.LOC:Local_timer_interrupts 7612 ± 4% +12.1% 8534 ± 3% interrupts.CPU68.RES:Rescheduling_interrupts 610901 ± 2% +10.3% 673659 ± 2% interrupts.CPU69.LOC:Local_timer_interrupts 7493 ± 4% +14.8% 8601 ± 4% interrupts.CPU69.RES:Rescheduling_interrupts 611808 ± 2% +10.1% 673844 ± 2% interrupts.CPU7.LOC:Local_timer_interrupts 7673 ± 5% +15.0% 8821 ± 4% interrupts.CPU7.RES:Rescheduling_interrupts 610906 ± 2% +10.3% 673733 ± 2% interrupts.CPU70.LOC:Local_timer_interrupts 7412 ± 3% +16.9% 8664 ± 4% interrupts.CPU70.RES:Rescheduling_interrupts 610871 ± 2% +10.3% 673671 ± 2% interrupts.CPU71.LOC:Local_timer_interrupts 7519 ± 4% +13.8% 8557 ± 5% interrupts.CPU71.RES:Rescheduling_interrupts 611325 ± 2% +10.2% 673906 ± 2% interrupts.CPU72.LOC:Local_timer_interrupts 7720 ± 4% +9.6% 8459 ± 4% interrupts.CPU72.RES:Rescheduling_interrupts 611328 ± 2% +10.2% 673908 ± 2% interrupts.CPU73.LOC:Local_timer_interrupts 7535 ± 4% +14.6% 8634 ± 4% interrupts.CPU73.RES:Rescheduling_interrupts 611311 ± 2% +10.2% 673883 ± 2% interrupts.CPU74.LOC:Local_timer_interrupts 7526 ± 5% +14.7% 8635 ± 6% interrupts.CPU74.RES:Rescheduling_interrupts 611315 ± 2% +10.2% 673868 ± 2% interrupts.CPU75.LOC:Local_timer_interrupts 7712 ± 5% +9.8% 8469 ± 4% interrupts.CPU75.RES:Rescheduling_interrupts 611304 ± 2% +10.2% 673860 ± 2% interrupts.CPU76.LOC:Local_timer_interrupts 7476 ± 5% +14.2% 8537 ± 5% interrupts.CPU76.RES:Rescheduling_interrupts 611322 ± 2% +10.2% 673834 ± 2% interrupts.CPU77.LOC:Local_timer_interrupts 7670 ± 3% +12.5% 8630 ± 5% interrupts.CPU77.RES:Rescheduling_interrupts 611326 ± 2% +10.2% 673851 ± 2% interrupts.CPU78.LOC:Local_timer_interrupts 7417 ± 3% +15.6% 8578 ± 4% interrupts.CPU78.RES:Rescheduling_interrupts 611328 ± 2% +10.2% 673820 ± 2% interrupts.CPU79.LOC:Local_timer_interrupts 7545 ± 4% +13.9% 8590 ± 4% interrupts.CPU79.RES:Rescheduling_interrupts 611842 ± 2% +10.1% 673928 ± 2% interrupts.CPU8.LOC:Local_timer_interrupts 7673 ± 3% +14.9% 8818 ± 4% interrupts.CPU8.RES:Rescheduling_interrupts 611366 ± 2% +10.2% 673868 ± 2% interrupts.CPU80.LOC:Local_timer_interrupts 7513 ± 3% +16.1% 8723 ± 5% interrupts.CPU80.RES:Rescheduling_interrupts 611322 ± 2% +10.2% 673860 ± 2% interrupts.CPU81.LOC:Local_timer_interrupts 611299 ± 2% +10.2% 673868 ± 2% interrupts.CPU82.LOC:Local_timer_interrupts 7523 ± 4% +13.8% 8562 ± 4% interrupts.CPU82.RES:Rescheduling_interrupts 611320 ± 2% +10.2% 673727 ± 2% interrupts.CPU83.LOC:Local_timer_interrupts 7518 ± 5% +12.4% 8454 ± 5% interrupts.CPU83.RES:Rescheduling_interrupts 611326 ± 2% +10.2% 673899 ± 2% interrupts.CPU84.LOC:Local_timer_interrupts 7452 ± 6% +12.3% 8365 ± 5% interrupts.CPU84.RES:Rescheduling_interrupts 611329 ± 2% +10.2% 673885 ± 2% interrupts.CPU85.LOC:Local_timer_interrupts 7399 ± 5% +11.1% 8218 ± 5% interrupts.CPU85.RES:Rescheduling_interrupts 611278 ± 2% +10.2% 673875 ± 2% interrupts.CPU86.LOC:Local_timer_interrupts 7376 ± 4% +16.3% 8581 ± 3% interrupts.CPU86.RES:Rescheduling_interrupts 611313 ± 2% +10.2% 673874 ± 2% interrupts.CPU87.LOC:Local_timer_interrupts 7544 ± 4% +12.8% 8508 ± 4% interrupts.CPU87.RES:Rescheduling_interrupts 611351 ± 2% +10.2% 673928 ± 2% interrupts.CPU88.LOC:Local_timer_interrupts 7418 ± 6% +13.3% 8406 ± 4% interrupts.CPU88.RES:Rescheduling_interrupts 611324 ± 2% +10.2% 673795 ± 2% interrupts.CPU89.LOC:Local_timer_interrupts 7426 ± 4% +13.6% 8439 ± 5% interrupts.CPU89.RES:Rescheduling_interrupts 611832 ± 2% +10.2% 673968 ± 2% interrupts.CPU9.LOC:Local_timer_interrupts 7538 ± 3% +15.6% 8715 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts 611298 ± 2% +10.2% 673878 ± 2% interrupts.CPU90.LOC:Local_timer_interrupts 7421 ± 3% +12.7% 8363 ± 4% interrupts.CPU90.RES:Rescheduling_interrupts 611305 ± 2% +10.2% 673874 ± 2% interrupts.CPU91.LOC:Local_timer_interrupts 7377 ± 5% +15.6% 8528 ± 5% interrupts.CPU91.RES:Rescheduling_interrupts 611288 ± 2% +10.2% 673876 ± 2% interrupts.CPU92.LOC:Local_timer_interrupts 7349 ± 4% +12.0% 8234 ± 4% interrupts.CPU92.RES:Rescheduling_interrupts 611329 ± 2% +10.2% 673857 ± 2% interrupts.CPU93.LOC:Local_timer_interrupts 7438 ± 3% +14.7% 8530 ± 4% interrupts.CPU93.RES:Rescheduling_interrupts 611276 ± 2% +10.2% 673866 ± 2% interrupts.CPU94.LOC:Local_timer_interrupts 7363 ± 4% +12.7% 8300 ± 5% interrupts.CPU94.RES:Rescheduling_interrupts 611381 ± 2% +10.2% 673922 ± 2% interrupts.CPU95.LOC:Local_timer_interrupts 10549 ± 3% +14.9% 12117 ± 4% interrupts.CPU95.RES:Rescheduling_interrupts 611824 ± 2% +10.1% 673847 ± 2% interrupts.CPU96.LOC:Local_timer_interrupts 7416 ± 3% +12.9% 8375 ± 5% interrupts.CPU96.RES:Rescheduling_interrupts 611751 ± 2% +10.2% 673870 ± 2% interrupts.CPU97.LOC:Local_timer_interrupts 7437 ± 4% +14.0% 8477 ± 4% interrupts.CPU97.RES:Rescheduling_interrupts 611787 ± 2% +10.1% 673877 ± 2% interrupts.CPU98.LOC:Local_timer_interrupts 7555 ± 4% +13.0% 8534 ± 3% interrupts.CPU98.RES:Rescheduling_interrupts 611783 ± 2% +10.1% 673872 ± 2% interrupts.CPU99.LOC:Local_timer_interrupts 7452 ± 3% +12.8% 8404 ± 5% interrupts.CPU99.RES:Rescheduling_interrupts 1.174e+08 ± 2% +10.2% 1.294e+08 ± 2% interrupts.LOC:Local_timer_interrupts 1433875 ± 3% +14.6% 1643307 ± 3% interrupts.RES:Rescheduling_interrupts aim7.jobs-per-min 30500 +-------------------------------------------------------------------+ | ..+.... .| 30000 |-+ ...... ... ... | 29500 |................ ...... .. ... | | +.. ... .. | 29000 |-+ ... ... | 28500 |-+ . ... | | +. | 28000 |-+ O O | 27500 |-+ | | | 27000 |-+ | 26500 |-+ | | O | 26000 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

1 year, 7 months

2
3
0 / 0

Re: [selftest/bpf] 472547778d: WARNING:at_kernel/bpf/verifier.c:#resolve_pseudo_ldimm64

by Hao Luo

Sure, let me take a look at it. On Thu, Oct 29, 2020 at 1:43 PM Andrii Nakryiko <andrii.nakryiko(a)gmail.com> wrote: > > Hao, > > This seems to be coming from resolve_pseudo_ldimm64(), could you > please take a look? Thanks! > > -- Andrii > > On Thu, Oct 29, 2020 at 5:58 AM kernel test robot <lkp(a)intel.com> wrote: > > > > Greeting, > > > > FYI, we noticed the following commit (built with gcc-9): > > > > commit: 472547778de24e2764ab325268dd5b77e6923939 ("selftest/bpf: Fix profiler test using CO-RE relocation for enums") > > https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master > > > > > > in testcase: kernel-selftests > > version: kernel-selftests-x86_64-b5a583fb-1_20201015 > > with following parameters: > > > > group: kselftests-bpf > > ucode: 0xd6 > > > > test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel. > > test-url: https://www.kernel.org/doc/Documentation/kselftest.txt > > > > > > on test machine: 4 threads Intel(R) Core(TM) i7-7567U CPU @ 3.50GHz with 32G memory > > > > caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): > > > > > > +------------------------------------------+------------+------------+ > > | | 435ccfa894 | 472547778d | > > +------------------------------------------+------------+------------+ > > | boot_successes | 10 | 0 | > > | boot_failures | 0 | 10 | > > | BUG:using__this_cpu_read()in_preemptible | 0 | 10 | > > +------------------------------------------+------------+------------+ > > > > > > If you fix the issue, kindly add following tag > > Reported-by: kernel test robot <lkp(a)intel.com> > > > > > > kern :warn : [ 325.530080] WARNING: CPU: 3 PID: 20214 at kernel/bpf/verifier.c:9718 resolve_pseudo_ldimm64+0x6b8/0x8e0 > > kern :warn : [ 325.530812] Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver netconsole snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio btrfs blake2b_generic xor zstd_compress raid6_pq libcrc32c intel_rapl_msr intel_rapl_common sd_mod t10_pi sg i915 btusb wmi_bmof intel_wmi_thunderbolt x86_pkg_temp_thermal intel_powerclamp snd_soc_skl snd_soc_sst_ipc snd_soc_sst_dsp snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi snd_soc_core snd_compress coretemp crct10dif_pclmul snd_hda_intel crc32_pclmul btrtl crc32c_intel btbcm ghash_clmulni_intel btintel snd_intel_dspcfg snd_hda_codec snd_hda_core iwlwifi aesni_intel crypto_simd ahci snd_hwdep bluetooth snd_pcm libahci cryptd cfg80211 snd_timer glue_helper ir_rc6_decoder pcspkr ecdh_generic libata mei_me snd ecc rc_rc6_mce mei soundcore i2c_i801 rfkill i2c_smbus wmi ipmi_devintf ite_cir ipmi_msghandler rc_core acpi_pad video intel_pmc_core ip_tables > > user :notice: [ 325.533201] # #3/p valid map access into an array with a constant OK > > kern :warn : [ 325.537207] CPU: 3 PID: 20214 Comm: test_verifier Not tainted 5.9.0-13427-g472547778de2 #1 > > > > kern :warn : [ 325.538572] Hardware name: Intel Corporation NUC7i7BNH/NUC7i7BNB, BIOS BNKBL357.86A.0067.2018.0814.1500 08/14/2018 > > kern :warn : [ 325.539414] RIP: 0010:resolve_pseudo_ldimm64+0x6b8/0x8e0 > > kern :warn : [ 325.539835] Code: ff ff c7 44 24 28 ea ff ff ff e9 49 fc ff ff 48 c7 c7 58 a8 5e 82 89 0c 24 48 89 54 24 08 c6 05 21 71 ff 01 01 e8 46 38 aa 00 <0f> 0b 8b 0c 24 48 8b 54 24 08 e9 5d fd ff ff 48 c7 c6 d8 a7 5e 82 > > kern :warn : [ 325.541298] RSP: 0018:ffffc90003b0fc50 EFLAGS: 00010282 > > kern :warn : [ 325.541732] RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000000000 > > kern :warn : [ 325.542274] RDX: 0000000000000001 RSI: ffffffff811d234f RDI: ffffffff811d234f > > kern :warn : [ 325.542847] RBP: ffffc90003b0fcb8 R08: 0000000000000001 R09: 0000000000000001 > > kern :warn : [ 325.543389] R10: 0000000000000001 R11: 0000000000000001 R12: ffff888100c3a000 > > user :notice: [ 325.543850] # #4/u valid map access into an array with a register OK > > kern :warn : [ 325.543996] R13: ffff8882c025dc00 R14: 0000000000000025 R15: ffffc9000108d058 > > > > kern :warn : [ 325.545045] FS: 00007fd26e745740(0000) GS:ffff88887ed80000(0000) knlGS:0000000000000000 > > kern :warn : [ 325.545893] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > > kern :warn : [ 325.546334] CR2: 000055a9904a3e30 CR3: 00000002c0730002 CR4: 00000000003706e0 > > kern :warn : [ 325.546900] Call Trace: > > kern :warn : [ 325.547114] bpf_check+0x907/0x17c0 > > kern :warn : [ 325.547396] ? find_held_lock+0x2b/0x80 > > kern :warn : [ 325.547781] bpf_prog_load+0x48c/0x8c0 > > kern :warn : [ 325.548133] ? find_held_lock+0x2b/0x80 > > kern :warn : [ 325.548450] __do_sys_bpf+0x93e/0x1a60 > > kern :warn : [ 325.548791] do_syscall_64+0x33/0x40 > > kern :warn : [ 325.549076] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > > kern :warn : [ 325.549468] RIP: 0033:0x7fd26e83df59 > > kern :warn : [ 325.549771] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 07 6f 0c 00 f7 d8 64 89 01 48 > > kern :warn : [ 325.551230] RSP: 002b:00007ffc55a5fc08 EFLAGS: 00000246 ORIG_RAX: 0000000000000141 > > user :notice: [ 325.551650] # #4/p valid map access into an array with a register OK > > kern :warn : [ 325.551853] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd26e83df59 > > > > kern :warn : [ 325.552308] RDX: 0000000000000078 RSI: 00007ffc55a5fc30 RDI: 0000000000000005 > > kern :warn : [ 325.552309] RBP: 00007ffc55a5fc30 R08: 0000000000000004 R09: 0000000000000000 > > kern :warn : [ 325.552310] R10: 0000000000000025 R11: 0000000000000246 R12: 0000000000000005 > > kern :warn : [ 325.552311] R13: 0000000000000000 R14: 00007ffc55a5fda0 R15: 00007ffc55a5fda0 > > kern :warn : [ 325.552325] CPU: 3 PID: 20214 Comm: test_verifier Not tainted 5.9.0-13427-g472547778de2 #1 > > user :notice: [ 325.554366] # #5/u valid map access into an array with a variable OK > > kern :warn : [ 325.554456] Hardware name: Intel Corporation NUC7i7BNH/NUC7i7BNB, BIOS BNKBL357.86A.0067.2018.0814.1500 08/14/2018 > > kern :warn : [ 325.554457] Call Trace: > > kern :warn : [ 325.554461] dump_stack+0x8d/0xb5 > > kern :warn : [ 325.554464] ? resolve_pseudo_ldimm64+0x6b8/0x8e0 > > > > kern :warn : [ 325.555551] __warn.cold+0x24/0x4b > > kern :warn : [ 325.555554] ? resolve_pseudo_ldimm64+0x6b8/0x8e0 > > kern :warn : [ 325.555558] report_bug+0xd1/0x100 > > user :notice: [ 325.557680] # #5/p valid map access into an array with a variable OK > > kern :warn : [ 325.557869] ? tick_nohz_tick_stopped+0x12/0x40 > > kern :warn : [ 325.557873] handle_bug+0x3a/0xa0 > > kern :warn : [ 325.557876] exc_invalid_op+0x14/0x80 > > > > kern :warn : [ 325.558465] asm_exc_invalid_op+0x12/0x20 > > kern :warn : [ 325.560172] RIP: 0010:resolve_pseudo_ldimm64+0x6b8/0x8e0 > > user :notice: [ 325.560516] # #6/u valid map access into an array with a signed variable OK > > kern :warn : [ 325.560553] Code: ff ff c7 44 24 28 ea ff ff ff e9 49 fc ff ff 48 c7 c7 58 a8 5e 82 89 0c 24 48 89 54 24 08 c6 05 21 71 ff 01 01 e8 46 38 aa 00 <0f> 0b 8b 0c 24 48 8b 54 24 08 e9 5d fd ff ff 48 c7 c6 d8 a7 5e 82 > > kern :warn : [ 325.560554] RSP: 0018:ffffc90003b0fc50 EFLAGS: 00010282 > > > > > > kern :warn : [ 325.562354] RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000000000 > > kern :warn : [ 325.562355] RDX: 0000000000000001 RSI: ffffffff811d234f RDI: ffffffff811d234f > > kern :warn : [ 325.562356] RBP: ffffc90003b0fcb8 R08: 0000000000000001 R09: 0000000000000001 > > kern :warn : [ 325.562357] R10: 0000000000000001 R11: 0000000000000001 R12: ffff888100c3a000 > > kern :warn : [ 325.562358] R13: ffff8882c025dc00 R14: 0000000000000025 R15: ffffc9000108d058 > > kern :warn : [ 325.562369] ? wake_up_klogd+0x4f/0x80 > > kern :warn : [ 325.562371] ? wake_up_klogd+0x4f/0x80 > > kern :warn : [ 325.562391] bpf_check+0x907/0x17c0 > > user :notice: [ 325.564634] # #6/p valid map access into an array with a signed variable OK > > kern :warn : [ 325.565045] ? find_held_lock+0x2b/0x80 > > kern :warn : [ 325.565057] bpf_prog_load+0x48c/0x8c0 > > > > kern :warn : [ 325.565875] ? find_held_lock+0x2b/0x80 > > kern :warn : [ 325.565889] __do_sys_bpf+0x93e/0x1a60 > > kern :warn : [ 325.565911] do_syscall_64+0x33/0x40 > > user :notice: [ 325.567592] # #7/u invalid map access into an array with a constant OK > > kern :warn : [ 325.567640] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > > > > kern :warn : [ 325.568193] RIP: 0033:0x7fd26e83df59 > > kern :warn : [ 325.569659] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 07 6f 0c 00 f7 d8 64 89 01 48 > > user :notice: [ 325.569825] # #7/p invalid map access into an array with a constant OK > > kern :warn : [ 325.570965] RSP: 002b:00007ffc55a5fc08 EFLAGS: 00000246 ORIG_RAX: 0000000000000141 > > kern :warn : [ 325.570967] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fd26e83df59 > > kern :warn : [ 325.570968] RDX: 0000000000000078 RSI: 00007ffc55a5fc30 RDI: 0000000000000005 > > kern :warn : [ 325.570969] RBP: 00007ffc55a5fc30 R08: 0000000000000004 R09: 0000000000000000 > > kern :warn : [ 325.570970] R10: 0000000000000025 R11: 0000000000000246 R12: 0000000000000005 > > kern :warn : [ 325.570972] R13: 0000000000000000 R14: 00007ffc55a5fda0 R15: 00007ffc55a5fda0 > > > > kern :warn : [ 325.573227] irq event stamp: 93003 > > kern :warn : [ 325.575115] hardirqs last enabled at (93103): [<ffffffff811d30b3>] console_unlock+0x4d3/0x5c0 > > user :notice: [ 325.575571] # #8/u invalid map access into an array with a register OK > > > > kern :warn : [ 325.575873] hardirqs last disabled at (93130): [<ffffffff81ddfa21>] __schedule+0x6e1/0xaa0 > > kern :warn : [ 325.577041] softirqs last enabled at (93170): [<ffffffff8200034e>] __do_softirq+0x34e/0x49c > > kern :warn : [ 325.577666] softirqs last disabled at (93187): [<ffffffff81e010f2>] asm_call_irq_on_stack+0x12/0x20 > > kern :warn : [ 325.578385] ---[ end trace 54e7a2ba0948b528 ]--- > > > > > > To reproduce: > > > > git clone https://github.com/intel/lkp-tests.git > > cd lkp-tests > > bin/lkp install job.yaml # job file is attached in this email > > bin/lkp run job.yaml > > > > > > > > Thanks, > > lkp > >

1 year, 7 months

1
1
0 / 0

[sched] 0a361f5e67: BUG:assuming_atomic_context_at_include/linux/filter.h

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: 0a361f5e6796503d574de4eb613ba730008fc439 ("sched: Make migrate_disable/enable() independent of RT") https://git.kernel.org/cgit/linux/kernel/git/tglx/devel.git highmem in testcase: trinity version: trinity-i386-4d2343bd-1_20200320 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-------------------------------------------------------+------------+------------+ | | 6608fec763 | 0a361f5e67 | +-------------------------------------------------------+------------+------------+ | boot_successes | 16 | 4 | | boot_failures | 0 | 6 | | BUG:assuming_atomic_context_at_include/linux/filter.h | 0 | 6 | +-------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 36.404341] BUG: assuming atomic context at include/linux/filter.h:597 [ 36.406042] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: (journald) [ 36.407820] no locks held by (journald)/229. [ 36.409004] CPU: 0 PID: 229 Comm: (journald) Not tainted 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 36.411102] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 36.413226] Call Trace: [ 36.414916] dump_stack+0x1b/0x1d [ 36.415945] __cant_sleep.cold+0x63/0x74 [ 36.417078] __seccomp_filter+0x64/0x400 [ 36.422800] ? find_held_lock+0x24/0x80 [ 36.423901] __secure_computing+0x30/0x80 [ 36.425027] syscall_trace_enter+0x52/0x1a0 [ 36.426236] syscall_enter_from_user_mode+0x97/0xc0 [ 36.427527] do_int80_syscall_32+0xe/0x40 [ 36.428629] entry_INT80_32+0x124/0x124 [ 36.429753] EIP: 0xb7f9ba02 [ 36.430608] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 36.435236] EAX: ffffffda EBX: 00000001 ECX: 00000000 EDX: 01724228 [ 36.436841] ESI: b7d3f3e7 EDI: b7f96440 EBP: b7d3fb79 ESP: bfa98288 [ 36.440340] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000246 Starting Create Static Device Nodes in /dev... Starting Load Kernel Modules... [ OK ] Mounted RPC Pipe File System. [ OK ] Started Remount Root and Kernel File Systems. Starting udev Coldplug all Devices... Starting Load/Save Random Seed... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Load Kernel Modules. Mounting Configuration File System... Starting Apply Kernel Variables... Mounting FUSE Control File System... Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Preprocess NFS configuration... [ OK ] Mounted Configuration File System. [ OK ] Mounted FUSE Control File System. [ OK ] Started Load/Save Random Seed. [ OK ] Started Apply Kernel Variables. [ OK ] Started Preprocess NFS configuration. [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target NFS client services. Starting Raise network interfaces... [ OK ] Started Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. [ OK ] Started Journal Service. Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started Create Volatile Files and Directories. Starting Network Time Synchronization... Starting Update UTMP about System Boot/Shutdown... Starting RPC bind portmap service... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC bind portmap service. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Network Time Synchronization. [ OK ] Reached target System Time Synchronized. [ 37.546472] BUG: assuming atomic context at include/linux/filter.h:597 [ 37.548206] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 37.550022] no locks held by systemd-journal/229. [ 37.551335] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 37.553930] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 37.556094] Call Trace: [ 37.556881] dump_stack+0x1b/0x1d [ 37.557851] __cant_sleep.cold+0x63/0x74 [ 37.558981] __seccomp_filter+0x64/0x400 [ 37.560079] ? ep_scan_ready_list+0x21f/0x230 [ 37.561324] ? do_epoll_wait+0x234/0x580 [ 37.562458] __secure_computing+0x30/0x80 [ 37.563586] syscall_trace_enter+0x52/0x1a0 [ 37.564875] syscall_enter_from_user_mode+0x97/0xc0 [ 37.566190] do_int80_syscall_32+0xe/0x40 [ 37.567320] entry_INT80_32+0x124/0x124 [ 37.568403] EIP: 0xb7f2da02 [ 37.569281] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 37.573769] EAX: ffffffda EBX: 00000000 ECX: bfa24584 EDX: 00000007 [ 37.575400] ESI: bfa24584 EDI: b7cad000 EBP: bfa24788 ESP: bfa24544 [ 37.577024] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000292 [ 37.717687] _warn_unseeded_randomness: 412 callbacks suppressed [ 37.717699] random: get_random_u32 called from bucket_table_alloc+0x70/0x160 with crng_init=1 [ 37.727260] random: get_random_u32 called from allocate_slab+0x152/0x670 with crng_init=1 [ 37.846992] random: get_random_bytes called from flow_hash_from_keys+0x88/0x160 with crng_init=1 [ 38.546430] BUG: assuming atomic context at include/linux/filter.h:597 [ 38.548197] in_atomic(): 0, irqs_disabled(): 0, pid: 244, name: systemd-udevd [ 38.550022] no locks held by systemd-udevd/244. [ 38.551269] CPU: 0 PID: 244 Comm: systemd-udevd Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 38.553777] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 38.555970] Call Trace: [ 38.556733] dump_stack+0x1b/0x1d [ 38.557680] __cant_sleep.cold+0x63/0x74 [ 38.558700] __seccomp_filter+0x64/0x400 [ 38.559738] ? trace_hardirqs_on+0x1e/0xc0 [ 38.560737] __secure_computing+0x30/0x80 [ 38.561678] syscall_trace_enter+0x52/0x1a0 [ 38.562791] syscall_enter_from_user_mode+0x97/0xc0 [ 38.564027] do_int80_syscall_32+0xe/0x40 [ 38.565104] entry_INT80_32+0x124/0x124 [ 38.566140] EIP: 0xb7f13a02 [ 38.566991] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 38.571096] EAX: ffffffda EBX: 004fbbe0 ECX: bfc71300 EDX: 00000007 [ 38.572433] ESI: 000000f4 EDI: 006001e0 EBP: 00000007 ESP: bfc712b8 [ 38.573867] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000286 [ 39.279882] _warn_unseeded_randomness: 18 callbacks suppressed [ 39.279891] random: get_random_u32 called from bucket_table_alloc+0x70/0x160 with crng_init=1 [ 39.291604] random: get_random_u32 called from allocate_slab+0x152/0x670 with crng_init=1 [ 39.433500] random: get_random_u32 called from bucket_table_alloc+0x70/0x160 with crng_init=1 [ 39.546415] BUG: assuming atomic context at include/linux/filter.h:597 [ 39.548027] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 39.549773] no locks held by systemd-journal/229. [ 39.550935] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 39.553283] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 39.554943] Call Trace: [ 39.555694] dump_stack+0x1b/0x1d [ 39.556545] __cant_sleep.cold+0x63/0x74 [ 39.557389] __seccomp_filter+0x64/0x400 [ 39.557943] ? ep_scan_ready_list+0x21f/0x230 [ 39.558586] ? do_epoll_wait+0x234/0x580 [ 39.559167] __secure_computing+0x30/0x80 [ 39.559745] syscall_trace_enter+0x52/0x1a0 [ 39.560406] syscall_enter_from_user_mode+0x97/0xc0 [ 39.561589] do_int80_syscall_32+0xe/0x40 [ 39.562617] entry_INT80_32+0x124/0x124 [ 39.563588] EIP: 0xb7f2da02 [ 39.564355] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 39.568444] EAX: ffffffda EBX: 00000000 ECX: bfa24584 EDX: 00000007 [ 39.569796] ESI: bfa24584 EDI: b7cad000 EBP: bfa24788 ESP: bfa24544 [ 39.571369] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000292 [ 40.285162] _warn_unseeded_randomness: 36 callbacks suppressed [ 40.285174] random: get_random_u32 called from allocate_slab+0x152/0x670 with crng_init=1 [ 40.332838] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 40.332847] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting /etc/rc.local Compatibility... [ OK ] Started Regular background program processing daemon. [ 40.546431] BUG: assuming atomic context at include/linux/filter.h:597 [ 40.548133] in_atomic(): 0, irqs_disabled(): 0, pid: 244, name: systemd-udevd [ 40.549954] no locks held by systemd-udevd/244. [ 40.551244] CPU: 0 PID: 244 Comm: systemd-udevd Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 40.553769] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 40.555984] Call Trace: [ 40.556760] dump_stack+0x1b/0x1d [ 40.557720] __cant_sleep.cold+0x63/0x74 [ 40.558830] __seccomp_filter+0x64/0x400 [ 40.559931] ? trace_hardirqs_on+0x1e/0xc0 [ 40.561064] __secure_computing+0x30/0x80 [ 40.562170] syscall_trace_enter+0x52/0x1a0 [ 40.563503] syscall_enter_from_user_mode+0x97/0xc0 [ 40.564796] do_int80_syscall_32+0xe/0x40 [ 40.565909] entry_INT80_32+0x124/0x124 [ 40.566989] EIP: 0xb7f13a02 [ 40.567827] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 40.572364] EAX: ffffffda EBX: 004fbbe0 ECX: bfc71300 EDX: 00000007 [ 40.573966] ESI: 000000f4 EDI: 006001e0 EBP: 00000007 ESP: bfc712b8 [ 40.575575] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000286 Starting Login Service... [ OK ] Started Daily Cleanup of Temporary Directories. Starting OpenBSD Secure Shell server... Starting LKP bootstrap... Starting System Logging Service... Starting LSB: Execute the kexec -e command to reboot system... [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Reached target Timers. [ 40.536089] rc.local[342]: PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/lkp/lkp/src/bin Starting Permit User Sessions... Starting LSB: Start and stop bmc-watchdog... [ OK ] Started D-Bus System Message Bus. [ 40.626126] rc.local[342]: /lkp/lkp/src/bin/lkp-setup-rootfs: 78: /lkp/lkp/src/bin/lkp-setup-rootfs: cannot create /sys/devices/system/cpu/microcode/reload: Directory nonexistent [ OK ] Started System Logging Service. [ OK ] Started /etc/rc.local Compatibility. [ OK ] Started Permit User Sessions. [ OK ] Started LSB: Execute the kexec -e command to reboot system. [ OK ] Started LSB: Start and stop bmc-watchdog. [ OK ] Started OpenBSD Secure Shell server. [ OK ] Started Login Service. Starting LSB: Load kernel image with kexec... [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ 41.294185] _warn_unseeded_randomness: 423 callbacks suppressed [ 41.294194] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 41.294202] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 41.294208] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 LKP: HOSTNAME vm-snb-i386-12, MAC 52:54:00:12:34:56, kernel 5.10.0-rc1-00064-g0a361f5e6796 1, serial console /dev/ttyS0 [ OK ] Started LSB: Load kernel image with kexec. [ 41.546865] BUG: assuming atomic context at include/linux/filter.h:597 [ 41.548607] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 41.550570] no locks held by systemd-journal/229. [ 41.551838] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 41.554414] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 41.556569] Call Trace: [ 41.557329] dump_stack+0x1b/0x1d [ 41.558295] __cant_sleep.cold+0x63/0x74 [ 41.559368] __seccomp_filter+0x64/0x400 [ 41.560484] ? ep_scan_ready_list+0x21f/0x230 [ 41.561578] ? do_epoll_wait+0x234/0x580 [ 41.562688] __secure_computing+0x30/0x80 [ 41.563771] syscall_trace_enter+0x52/0x1a0 [ 41.565040] syscall_enter_from_user_mode+0x97/0xc0 [ 41.566338] do_int80_syscall_32+0xe/0x40 [ 41.567465] entry_INT80_32+0x124/0x124 [ 41.568523] EIP: 0xb7f2da02 [ 41.569390] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 41.573888] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 41.575521] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 41.577099] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 42.307001] _warn_unseeded_randomness: 119 callbacks suppressed [ 42.307009] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 42.307017] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 42.307021] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 42.794410] BUG: assuming atomic context at include/linux/filter.h:597 [ 42.798996] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 42.800476] no locks held by systemd-journal/229. [ 42.801485] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 42.806892] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 42.808637] Call Trace: [ 42.809236] dump_stack+0x1b/0x1d [ 42.809958] __cant_sleep.cold+0x63/0x74 [ 42.810823] __seccomp_filter+0x64/0x400 [ 42.811651] ? ep_scan_ready_list+0x21f/0x230 [ 42.812625] ? do_epoll_wait+0x234/0x580 [ 42.813600] __secure_computing+0x30/0x80 [ 42.814584] syscall_trace_enter+0x52/0x1a0 [ 42.815684] syscall_enter_from_user_mode+0x97/0xc0 [ 42.816808] do_int80_syscall_32+0xe/0x40 [ 42.817968] entry_INT80_32+0x124/0x124 [ 42.818925] EIP: 0xb7f2da02 [ 42.819678] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 42.823649] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 42.825072] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 42.826479] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 43.538963] _warn_unseeded_randomness: 158 callbacks suppressed [ 43.538972] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 43.538982] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 43.538987] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 44.047140] BUG: assuming atomic context at include/linux/filter.h:597 [ 44.048976] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 44.051061] no locks held by systemd-journal/229. [ 44.052422] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 44.055135] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 44.057480] Call Trace: [ 44.058304] dump_stack+0x1b/0x1d [ 44.059342] __cant_sleep.cold+0x63/0x74 [ 44.060485] __seccomp_filter+0x64/0x400 [ 44.061663] ? ep_scan_ready_list+0x21f/0x230 [ 44.062956] ? do_epoll_wait+0x234/0x580 [ 44.064194] __secure_computing+0x30/0x80 [ 44.065150] syscall_trace_enter+0x52/0x1a0 [ 44.066423] syscall_enter_from_user_mode+0x97/0xc0 [ 44.068070] do_int80_syscall_32+0xe/0x40 [ 44.069486] entry_INT80_32+0x124/0x124 [ 44.070869] EIP: 0xb7f2da02 [ 44.071914] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 44.077739] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 44.079796] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 44.081872] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 44.802249] _warn_unseeded_randomness: 345 callbacks suppressed [ 44.802257] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 44.802266] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 44.802270] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 45.046697] BUG: assuming atomic context at include/linux/filter.h:597 [ 45.048324] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 45.050262] no locks held by systemd-journal/229. [ 45.051568] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 45.054058] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 45.056202] Call Trace: [ 45.056986] dump_stack+0x1b/0x1d [ 45.057933] __cant_sleep.cold+0x63/0x74 [ 45.059084] __seccomp_filter+0x64/0x400 [ 45.060278] ? ep_scan_ready_list+0x21f/0x230 [ 45.061377] ? do_epoll_wait+0x234/0x580 [ 45.062396] __secure_computing+0x30/0x80 [ 45.063381] syscall_trace_enter+0x52/0x1a0 [ 45.064581] syscall_enter_from_user_mode+0x97/0xc0 [ 45.065918] do_int80_syscall_32+0xe/0x40 [ 45.067064] entry_INT80_32+0x124/0x124 [ 45.068122] EIP: 0xb7f2da02 [ 45.068964] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 45.073463] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 45.075075] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 45.076635] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 46.046427] BUG: assuming atomic context at include/linux/filter.h:597 [ 46.048170] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 46.050121] no locks held by systemd-journal/229. [ 46.051404] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 46.053948] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 46.056119] Call Trace: [ 46.056905] dump_stack+0x1b/0x1d [ 46.057860] __cant_sleep.cold+0x63/0x74 [ 46.058985] __seccomp_filter+0x64/0x400 [ 46.060100] ? ep_scan_ready_list+0x21f/0x230 [ 46.061165] ? do_epoll_wait+0x234/0x580 [ 46.062264] __secure_computing+0x30/0x80 [ 46.063388] syscall_trace_enter+0x52/0x1a0 [ 46.064663] syscall_enter_from_user_mode+0x97/0xc0 [ 46.065959] do_int80_syscall_32+0xe/0x40 [ 46.067023] entry_INT80_32+0x124/0x124 [ 46.068090] EIP: 0xb7f2da02 [ 46.068922] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 46.073464] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 46.075068] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 46.076510] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 46.279189] _warn_unseeded_randomness: 116 callbacks suppressed [ 46.279198] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 46.279206] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 46.279210] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 47.339307] _warn_unseeded_randomness: 30 callbacks suppressed [ 47.339316] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 47.339324] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 47.339328] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 47.355423] BUG: assuming atomic context at include/linux/filter.h:597 [ 47.356977] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 47.358606] no locks held by systemd-journal/229. [ 47.359712] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 47.361943] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 47.363835] Call Trace: [ 47.364489] dump_stack+0x1b/0x1d [ 47.365353] __cant_sleep.cold+0x63/0x74 [ 47.366313] __seccomp_filter+0x64/0x400 [ 47.367322] ? ep_scan_ready_list+0x21f/0x230 [ 47.368341] ? do_epoll_wait+0x234/0x580 [ 47.369419] __secure_computing+0x30/0x80 [ 47.370492] syscall_trace_enter+0x52/0x1a0 [ 47.371739] syscall_enter_from_user_mode+0x97/0xc0 [ 47.372978] do_int80_syscall_32+0xe/0x40 [ 47.374015] entry_INT80_32+0x124/0x124 [ 47.375004] EIP: 0xb7f2da02 [ 47.375822] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 47.380073] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 47.381630] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 47.383198] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 48.438911] _warn_unseeded_randomness: 16 callbacks suppressed [ 48.438917] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 48.438922] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 48.438925] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 48.453937] BUG: assuming atomic context at include/linux/filter.h:597 [ 48.455310] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 48.457091] no locks held by systemd-journal/229. [ 48.457956] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 48.459276] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 48.460861] Call Trace: [ 48.461561] dump_stack+0x1b/0x1d [ 48.462484] __cant_sleep.cold+0x63/0x74 [ 48.463466] __seccomp_filter+0x64/0x400 [ 48.464106] ? ep_scan_ready_list+0x21f/0x230 [ 48.464822] ? do_epoll_wait+0x234/0x580 [ 48.465817] __secure_computing+0x30/0x80 [ 48.466841] syscall_trace_enter+0x52/0x1a0 [ 48.467933] syscall_enter_from_user_mode+0x97/0xc0 [ 48.469086] do_int80_syscall_32+0xe/0x40 [ 48.470084] entry_INT80_32+0x124/0x124 [ 48.471015] EIP: 0xb7f2da02 [ 48.471785] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 48.475825] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 48.477228] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 48.478660] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 49.539128] _warn_unseeded_randomness: 16 callbacks suppressed [ 49.539136] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 49.539144] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 49.539148] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 49.557564] BUG: assuming atomic context at include/linux/filter.h:597 [ 49.559079] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 49.560787] no locks held by systemd-journal/229. [ 49.561907] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 49.564138] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 49.566069] Call Trace: [ 49.566796] dump_stack+0x1b/0x1d [ 49.567631] __cant_sleep.cold+0x63/0x74 [ 49.568596] __seccomp_filter+0x64/0x400 [ 49.569583] ? ep_scan_ready_list+0x21f/0x230 [ 49.570654] ? do_epoll_wait+0x234/0x580 [ 49.571620] __secure_computing+0x30/0x80 [ 49.573527] syscall_trace_enter+0x52/0x1a0 [ 49.574685] syscall_enter_from_user_mode+0x97/0xc0 [ 49.575840] do_int80_syscall_32+0xe/0x40 [ 49.576848] entry_INT80_32+0x124/0x124 [ 49.577788] EIP: 0xb7f2da02 [ 49.578564] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 49.582595] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 49.584019] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 49.585445] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 50.638945] _warn_unseeded_randomness: 16 callbacks suppressed [ 50.638951] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 50.638956] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 50.638959] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 50.653357] BUG: assuming atomic context at include/linux/filter.h:597 [ 50.654920] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 50.656623] no locks held by systemd-journal/229. [ 50.657788] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 50.659144] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 50.660770] Call Trace: [ 50.661485] dump_stack+0x1b/0x1d [ 50.662446] __cant_sleep.cold+0x63/0x74 [ 50.663489] __seccomp_filter+0x64/0x400 [ 50.664540] ? ep_scan_ready_list+0x21f/0x230 [ 50.665696] ? do_epoll_wait+0x234/0x580 [ 50.666775] __secure_computing+0x30/0x80 [ 50.667879] syscall_trace_enter+0x52/0x1a0 [ 50.669146] syscall_enter_from_user_mode+0x97/0xc0 [ 50.670430] do_int80_syscall_32+0xe/0x40 [ 50.671412] entry_INT80_32+0x124/0x124 [ 50.672290] EIP: 0xb7f2da02 [ 50.672936] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 50.676838] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 50.678261] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 50.679741] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 51.716937] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.724154] BUG: assuming atomic context at include/linux/filter.h:597 [ 51.725891] in_atomic(): 0, irqs_disabled(): 0, pid: 229, name: systemd-journal [ 51.727845] no locks held by systemd-journal/229. [ 51.729088] CPU: 0 PID: 229 Comm: systemd-journal Tainted: G W 5.10.0-rc1-00064-g0a361f5e6796 #1 [ 51.731626] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 51.733810] Call Trace: [ 51.734624] dump_stack+0x1b/0x1d [ 51.735512] __cant_sleep.cold+0x63/0x74 [ 51.736619] __seccomp_filter+0x64/0x400 [ 51.737720] ? ep_scan_ready_list+0x21f/0x230 [ 51.738938] ? do_epoll_wait+0x234/0x580 [ 51.740018] __secure_computing+0x30/0x80 [ 51.741073] syscall_trace_enter+0x52/0x1a0 [ 51.742410] syscall_enter_from_user_mode+0x97/0xc0 [ 51.743697] do_int80_syscall_32+0xe/0x40 [ 51.744840] entry_INT80_32+0x124/0x124 [ 51.745896] EIP: 0xb7f2da02 [ 51.746706] Code: 95 01 00 05 25 36 02 00 83 ec 14 8d 80 e8 99 ff ff 50 6a 02 e8 1f ff 00 00 c7 04 24 7f 00 00 00 e8 7e 87 01 00 66 90 90 cd 80 <c3> 8d b6 00 00 00 00 8d bc 27 00 00 00 00 8b 1c 24 c3 8d b6 00 00 [ 51.751280] EAX: ffffffda EBX: 00000000 ECX: bfa24544 EDX: 00000007 [ 51.752828] ESI: bfa24544 EDI: b7cad000 EBP: bfa24788 ESP: bfa24504 [ 51.754485] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000296 [ 51.781469] _warn_unseeded_randomness: 16 callbacks suppressed [ 51.781476] random: get_random_u32 called from arch_pick_mmap_layout+0x54/0x140 with crng_init=1 [ 51.781485] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1 [ 51.781489] random: get_random_u32 called from arch_align_stack+0x2d/0x40 with crng_init=1 [ 51.807372] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.809857] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.830558] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.832954] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.847546] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.849998] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.875435] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.877761] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.890770] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.892964] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.906499] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.909225] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.930676] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.933078] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.952799] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.966824] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 51.969117] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.002522] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.004976] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.018668] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.021386] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.038432] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.040584] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.060357] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.074601] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.076815] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.086482] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.088755] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.106431] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.108798] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.126562] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.128862] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.142535] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.145101] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.162482] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.164845] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.183537] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.186139] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.202718] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.205404] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.222537] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.225485] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.242681] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.245163] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.262464] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.264808] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.282573] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.285033] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.298495] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.300866] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.318465] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.320768] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.334577] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.336888] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.354438] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.356752] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.370543] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.373022] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.390765] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.393300] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.410525] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.412879] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.430846] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.433491] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.450542] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.453104] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.466521] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.468865] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.486505] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.488996] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.506895] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.509243] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.526516] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.529014] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.542430] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 [ 52.544750] Lockdown: trinity-main: unsafe use of perf is restricted; see man kernel_lockdown.7 To reproduce: # build kernel cd linux cp config-5.10.0-rc1-00064-g0a361f5e6796 .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

1 year, 8 months

3
3
0 / 0

[rcu] 44bad5b3cc: dmesg.INFO:rcu_preempt_detected_stalls_on_CPUs/tasks

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: 44bad5b3cca2d452d17ef82841b20b42a2cf11a0 ("rcu: Do full report for .need_qs for strict GPs") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: trinity version: trinity-i386-4d2343bd-1_20200320 with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +--------------------------------------------------+------------+------------+ | | f19920e412 | 44bad5b3cc | +--------------------------------------------------+------------+------------+ | boot_successes | 23 | 16 | | boot_failures | 21 | 48 | | BUG:kernel_hang_in_test_stage | 21 | 47 | | INFO:rcu_preempt_self-detected_stall_on_CPU | 4 | | | EIP:_raw_spin_unlock_irq | 5 | 25 | | EIP:___might_sleep | 1 | | | EIP:preempt_schedule_common | 4 | 2 | | EIP:preempt_schedule_notrace | 4 | | | EIP:__put_user_4 | 1 | | | EIP:schedule | 9 | 40 | | INFO:rcu_preempt_detected_stalls_on_CPUs/tasks | 8 | 40 | | WARNING:at_net/sched/sch_generic.c:#dev_watchdog | 2 | 1 | | EIP:dev_watchdog | 2 | 1 | +--------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 311.442723] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [ 311.445504] (detected by 1, t=100002 jiffies, g=83721, q=12) [ 311.446491] rcu: All QSes seen, last rcu_preempt kthread activity 100002 (10023--89979), jiffies_till_next_fqs=3, root ->qsmask 0x0 [ 311.448502] rcu: rcu_preempt kthread starved for 100002 jiffies! g83721 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1 [ 311.450260] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. [ 311.451793] rcu: RCU grace-period kthread stack dump: [ 311.452650] task:rcu_preempt state:R running task stack: 0 pid: 10 ppid: 2 flags:0x00004008 [ 311.454190] Call Trace: [ 311.454569] sched_show_task+0x125/0x137 [ 311.455208] rcu_check_gp_kthread_starvation+0xe4/0xf6 [ 311.456058] rcu_sched_clock_irq+0x7c3/0x89a [ 311.456793] ? account_system_time+0x68/0x71 [ 311.457543] update_process_times+0x24/0x4f [ 311.458273] tick_sched_handle+0x55/0x63 [ 311.458959] tick_sched_timer+0x3b/0x79 [ 311.459634] ? tick_sched_do_timer+0x44/0x44 [ 311.460353] __hrtimer_run_queues+0x13a/0x1fe [ 311.461130] ? tick_sched_do_timer+0x44/0x44 [ 311.461861] hrtimer_interrupt+0xb0/0x1bc [ 311.462575] ? sysvec_call_function_single+0x2c/0x2c [ 311.463423] __sysvec_apic_timer_interrupt+0xc3/0x13b [ 311.464306] sysvec_apic_timer_interrupt+0x1b/0x2e [ 311.465097] handle_exception+0x143/0x143 [ 311.465747] EIP: _raw_spin_unlock_irq+0x25/0x2f [ 311.466519] Code: 9e ff 5b 5d c3 66 66 66 66 90 55 89 e5 53 89 c3 83 c0 10 8b 55 04 e8 e5 80 a2 ff 89 d8 e8 1e b4 a2 ff fb 64 ff 0d f4 06 c8 41 <75> 05 e8 fe 77 98 ff 5b 5d c3 66 66 66 66 90 55 89 e5 56 89 d6 53 [ 311.469547] EAX: 00000001 EBX: f57777c0 ECX: 00000000 EDX: f4eab840 [ 311.470573] ESI: 00000000 EDI: f4eab840 EBP: f4eb5df8 ESP: f4eb5df4 [ 311.471709] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00000202 [ 311.472930] ? sysvec_call_function_single+0x2c/0x2c [ 311.473771] ? _raw_spin_unlock_irq+0x25/0x2f [ 311.474512] finish_task_switch+0x151/0x1dd [ 311.475244] ? finish_task_switch+0x129/0x1dd [ 311.476000] __schedule+0x4a2/0x4df [ 311.476630] ? sysvec_call_function_single+0x2c/0x2c [ 311.477479] preempt_schedule_irq+0x45/0x56 [ 311.478204] irqentry_exit_cond_resched+0x37/0x3a [ 311.479018] irqentry_exit+0x33/0x42 [ 311.479649] sysvec_apic_timer_interrupt+0x2a/0x2e [ 311.480520] handle_exception+0x143/0x143 [ 311.481187] EIP: schedule+0x8c/0xb2 [ 311.481752] Code: 39 d1 74 0a ba 01 00 00 00 e8 e7 de c8 ff 64 8b 35 fc 06 c8 41 64 ff 05 f4 06 c8 41 31 c0 e8 9c fa ff ff 64 ff 0d f4 06 c8 41 <8b> 06 a8 08 75 e5 8b 43 14 a9 20 00 00 20 74 12 a8 20 89 d8 74 07 [ 311.484809] EAX: 00000000 EBX: f4eab840 ECX: 00000000 EDX: f4eab840 [ 311.485882] ESI: f4eab840 EDI: 00000003 EBP: f4eb5ef8 ESP: f4eb5ef0 [ 311.486967] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00000246 [ 311.488134] ? sysvec_call_function_single+0x2c/0x2c [ 311.489016] ? schedule+0x8c/0xb2 [ 311.489606] schedule_timeout+0x88/0xbf [ 311.490291] ? __next_timer_interrupt+0xb7/0xb7 [ 311.491084] rcu_gp_kthread+0x545/0x8fa [ 311.491761] ? call_rcu+0x189/0x189 [ 311.492381] kthread+0x101/0x106 [ 311.492923] ? call_rcu+0x189/0x189 [ 311.493522] ? kthread_queue_delayed_work+0x55/0x55 [ 311.494374] ret_from_fork+0x1c/0x30 To reproduce: # build kernel cd linux cp config-5.9.0-rc1-00006-g44bad5b3cca2d .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

1 year, 8 months

3
2
0 / 0

[drm/vkms] ea40d7857d: WARNING:at_drivers/gpu/drm/vkms/vkms_crtc.c:#vkms_vblank_simulate

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-9): commit: ea40d7857d5250e5400f38c69ef9e17321e9c4a2 ("drm/vkms: fbdev emulation support") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: boot on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-------------------------------------------------------------------+------------+------------+ | | 23fae9cf97 | ea40d7857d | +-------------------------------------------------------------------+------------+------------+ | boot_successes | 56 | 40 | | boot_failures | 0 | 20 | | WARNING:at_drivers/gpu/drm/vkms/vkms_crtc.c:#vkms_vblank_simulate | 0 | 20 | | EIP:vkms_vblank_simulate | 0 | 20 | | EIP:e1000_raise_ee_clk | 0 | 1 | | EIP:e1000_lower_ee_clk | 0 | 1 | | EIP:___might_sleep | 0 | 14 | | EIP:lock_acquire | 0 | 4 | | EIP:default_idle | 0 | 13 | | EIP:generic_exec_single | 0 | 4 | | EIP:stutter_wait | 0 | 3 | | EIP:delay_tsc | 0 | 9 | | EIP:_raw_spin_unlock_irqrestore | 0 | 5 | | EIP:torture_random | 0 | 1 | | EIP:console_unlock | 0 | 6 | | EIP:_raw_spin_unlock_irq | 0 | 3 | | EIP:_raw_spin_unlock | 0 | 1 | | EIP:kthread_should_stop | 0 | 1 | | EIP:__do_softirq | 0 | 3 | | INFO:rcu_preempt_self-detected_stall_on_CPU | 0 | 1 | | EIP:exit_to_user_mode_prepare | 0 | 1 | | EIP:acpi_ut_update_object_reference | 0 | 1 | | EIP:queued_spin_lock_slowpath | 0 | 1 | | EIP:check_preemption_disabled | 0 | 1 | | EIP:preempt_schedule_irq | 0 | 1 | | EIP:from_kuid_munged | 0 | 1 | | EIP:lock_release | 0 | 1 | | WARNING:at_net/sched/sch_generic.c:#dev_watchdog | 0 | 1 | | EIP:dev_watchdog | 0 | 1 | +-------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 71.976352] WARNING: CPU: 0 PID: 0 at drivers/gpu/drm/vkms/vkms_crtc.c:21 vkms_vblank_simulate+0x130/0x140 [ 71.978893] Modules linked in: uvesafb aesni_intel floppy processor evdev input_leds psmouse pcspkr [ 71.981347] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.9.0-rc5-01227-gea40d7857d525 #1 [ 72.006908] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014 [ 72.009579] EIP: vkms_vblank_simulate+0x130/0x140 [ 72.010999] Code: 00 00 ff b7 4c 01 00 00 68 04 e2 54 c5 6a 02 89 55 ec 89 4d f0 e8 d0 d8 fe ff 8b 55 ec 8b 4d f0 83 c4 18 eb 80 8d 74 26 00 90 <0f> 0b e9 02 ff ff ff 8d b4 26 00 00 00 00 66 90 55 89 e5 57 56 53 [ 72.015911] EAX: 00000003 EBX: f65df328 ECX: f65df328 EDX: 00000000 [ 72.018281] ESI: 00fe4c00 EDI: 00000000 EBP: c5637e24 ESP: c5637e10 [ 72.020737] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00210006 [ 72.023286] CR0: 80050033 CR2: 020cf844 CR3: 0581c000 CR4: 000406d0 [ 72.025641] Call Trace: [ 72.027494] __hrtimer_run_queues+0xb5/0x1a0 [ 72.029556] ? vkms_disable_vblank+0x10/0x10 [ 72.031643] hrtimer_interrupt+0x115/0x260 [ 72.033615] ? sysvec_call_function_single+0x30/0x30 [ 72.035676] __sysvec_apic_timer_interrupt+0x5a/0xa0 [ 72.037664] sysvec_apic_timer_interrupt+0x1a/0x30 [ 72.039653] handle_exception+0x165/0x165 [ 72.041492] EIP: default_idle+0xe/0x10 [ 72.043412] Code: 66 90 0f ae 38 0f ae f0 66 66 90 eb bc 8d b4 26 00 00 00 00 fb eb d9 8d 74 26 00 90 e9 07 00 00 00 0f 00 2d 1a 20 dc c4 fb f4 <c3> cc 55 89 e5 56 53 89 c3 e8 04 86 ff ff 89 c2 a1 7c b9 82 c5 03 [ 72.052922] EAX: 0001026e EBX: 00000000 ECX: 00000000 EDX: c55a67ed [ 72.055250] ESI: 00000000 EDI: 00000000 EBP: c5637f2c ESP: c5637f28 [ 72.057416] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00200212 [ 72.059739] ? sysvec_call_function_single+0x30/0x30 [ 72.061810] ? sysvec_call_function_single+0x30/0x30 [ 72.063965] ? default_idle+0xe/0x10 [ 72.065876] ? arch_cpu_idle+0x9/0x10 [ 72.067870] default_idle_call+0x23/0x40 [ 72.069827] do_idle+0x165/0x170 [ 72.071743] cpu_startup_entry+0x1d/0x20 [ 72.073707] rest_init+0xf8/0xfd [ 72.075527] arch_call_rest_init+0x8/0xb [ 72.077422] start_kernel+0x5f9/0x607 [ 72.079414] ? early_idt_handler_common+0x50/0x50 [ 72.081446] i386_start_kernel+0x43/0x45 [ 72.083396] startup_32_smp+0x164/0x170 [ 72.085234] ---[ end trace 9b827069a4cfe883 ]--- To reproduce: # build kernel cd linux cp config-5.9.0-rc5-01227-gea40d7857d525 .config make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

1 year, 8 months

1
0
0 / 0

[fs] 2b2f891180: stress-ng.sendfile.ops_per_sec 32.0% improvement

by kernel test robot

Greeting, FYI, we noticed a 32.0% improvement of stress-ng.sendfile.ops_per_sec due to commit: commit: 2b2f89118025e62137e4d1514866069b24d810a4 ("[PATCH v2 2/2] fs: generic_file_buffered_read() now uses find_get_pages_contig") url: https://github.com/0day-ci/linux/commits/Kent-Overstreet/generic_file_buf... base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git 986b9eacb25910865b50e5f298aa8e2df7642f1b in testcase: stress-ng on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory with following parameters: nr_threads: 100% disk: 1HDD testtime: 30s class: pipe cpufreq_governor: performance ucode: 0x5002f01 Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode: pipe/gcc-9/performance/1HDD/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp5/stress-ng/30s/0x5002f01 commit: aa5222a7e8 ("fs: Break generic_file_buffered_read up into multiple functions") 2b2f891180 ("fs: generic_file_buffered_read() now uses find_get_pages_contig") aa5222a7e8f6ab9e 2b2f89118025e62137e4d151486 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:missing_R10_value_at__fsnotify_parent/0x %stddev %change %stddev \ | \ 1.38e+08 ± 8% -21.4% 1.084e+08 ± 18% stress-ng.pipe.ops 4598964 ± 8% -21.4% 3614448 ± 18% stress-ng.pipe.ops_per_sec 14543902 +32.0% 19194451 stress-ng.sendfile.ops 484783 +32.0% 639800 stress-ng.sendfile.ops_per_sec 9893 -20.7% 7844 stress-ng.time.maximum_resident_set_size 259655 ± 3% +11.0% 288128 ± 5% cpuidle.POLL.time 214144 -3.0% 207721 ± 2% vmstat.system.in 16311 ± 22% -17.2% 13502 ± 23% numa-meminfo.node0.KernelStack 37461 ± 42% -42.0% 21717 ± 60% numa-meminfo.node0.PageTables 147305 ± 16% -17.5% 121457 ± 18% numa-meminfo.node0.SUnreclaim 2102 ± 5% -9.5% 1901 ± 4% slabinfo.PING.active_objs 2102 ± 5% -9.5% 1901 ± 4% slabinfo.PING.num_objs 3295 ± 4% -6.9% 3069 ± 5% slabinfo.sock_inode_cache.active_objs 3295 ± 4% -6.9% 3069 ± 5% slabinfo.sock_inode_cache.num_objs 2.303e+10 -4.0% 2.21e+10 ± 2% perf-stat.i.branch-instructions 209728 -4.5% 200298 ± 2% perf-stat.i.cpu-migrations 2110607 -8.5% 1932169 ± 2% perf-stat.i.node-loads 0.48 +0.0 0.52 perf-stat.overall.branch-miss-rate% 2.261e+10 -3.8% 2.174e+10 ± 3% perf-stat.ps.branch-instructions 2109192 -8.2% 1936642 ± 2% perf-stat.ps.node-loads 24778 ± 2% -5.4% 23434 ± 2% proc-vmstat.nr_active_anon 76250 +6.2% 81012 ± 9% proc-vmstat.nr_anon_pages 80059 +6.0% 84835 ± 8% proc-vmstat.nr_inactive_anon 28762 ± 2% -4.6% 27434 ± 2% proc-vmstat.nr_shmem 24778 ± 2% -5.4% 23434 ± 2% proc-vmstat.nr_zone_active_anon 80059 +6.0% 84835 ± 8% proc-vmstat.nr_zone_inactive_anon 5269 +38.8% 7313 ± 16% sched_debug.cfs_rq:/.load.min 274.69 +1285.1% 3804 ±142% sched_debug.cfs_rq:/.load_avg.max 46.74 ± 4% +1059.0% 541.77 ±144% sched_debug.cfs_rq:/.load_avg.stddev 3.97 ± 26% -45.5% 2.16 ± 57% sched_debug.cfs_rq:/.removed.load_avg.avg 31.04 ± 11% -35.7% 19.95 ± 57% sched_debug.cfs_rq:/.removed.load_avg.stddev 1850 ± 3% -9.8% 1669 ± 2% sched_debug.cfs_rq:/.runnable_avg.max -65895 -277.0% 116623 ±123% sched_debug.cfs_rq:/.spread0.avg 1253 ± 2% -11.9% 1105 ± 2% sched_debug.cfs_rq:/.util_avg.max 120.28 ± 11% -20.8% 95.27 ± 12% sched_debug.cfs_rq:/.util_avg.stddev 90.38 ± 52% +87.0% 169.00 ± 14% sched_debug.cfs_rq:/.util_est_enqueued.min 91.18 -0.8 90.33 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 93.72 -0.5 93.22 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 0.71 ± 17% +0.2 0.91 ± 13% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 1.08 ± 15% +0.3 1.36 ± 13% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 91.28 -0.8 90.44 perf-profile.children.cycles-pp.do_syscall_64 93.81 -0.5 93.32 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.06 ± 20% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.__x64_sys_write 0.06 ± 22% +0.0 0.08 ± 15% perf-profile.children.cycles-pp.prepare_to_wait_event 0.04 ± 63% +0.0 0.07 ± 20% perf-profile.children.cycles-pp.clockevents_program_event 0.02 ±173% +0.1 0.07 ± 22% perf-profile.children.cycles-pp.ktime_get 0.18 ± 14% +0.1 0.28 ± 17% perf-profile.children.cycles-pp.finish_task_switch 0.53 ± 10% +0.2 0.71 ± 14% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack 1.97 ± 9% +0.2 2.20 ± 4% perf-profile.children.cycles-pp.mutex_lock 1.45 ± 18% +0.3 1.77 ± 13% perf-profile.children.cycles-pp.common_file_perm 2.08 ± 16% +0.5 2.53 ± 13% perf-profile.children.cycles-pp.security_file_permission 0.11 ± 22% +0.0 0.16 ± 17% perf-profile.self.cycles-pp.copyin 0.03 ±100% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.__x64_sys_write 0.19 ± 19% +0.0 0.24 ± 14% perf-profile.self.cycles-pp.ksys_write 0.36 ± 11% +0.1 0.46 ± 15% perf-profile.self.cycles-pp.security_file_permission 0.63 ± 17% +0.2 0.78 ± 12% perf-profile.self.cycles-pp.syscall_exit_to_user_mode 1.16 ± 18% +0.3 1.44 ± 13% perf-profile.self.cycles-pp.common_file_perm 0.00 +1.8e+104% 183.75 ±132% interrupts.93:PCI-MSI.31981626-edge.i40e-eth0-TxRx-57 7738 ± 2% -37.7% 4819 ± 34% interrupts.CPU21.NMI:Non-maskable_interrupts 7738 ± 2% -37.7% 4819 ± 34% interrupts.CPU21.PMI:Performance_monitoring_interrupts 7735 ± 2% -37.5% 4834 ± 36% interrupts.CPU23.NMI:Non-maskable_interrupts 7735 ± 2% -37.5% 4834 ± 36% interrupts.CPU23.PMI:Performance_monitoring_interrupts 4378 ± 23% +335.6% 19072 ± 95% interrupts.CPU42.CAL:Function_call_interrupts 6507 ± 21% +33.6% 8696 ± 22% interrupts.CPU45.CAL:Function_call_interrupts 17585 ± 34% -53.7% 8147 ± 80% interrupts.CPU51.CAL:Function_call_interrupts 30252 ± 76% -75.5% 7413 ± 67% interrupts.CPU53.CAL:Function_call_interrupts 22394 ± 68% -72.6% 6125 ± 67% interrupts.CPU55.CAL:Function_call_interrupts 21262 ± 42% -70.6% 6255 ± 70% interrupts.CPU56.CAL:Function_call_interrupts 9201 ± 83% +111.2% 19434 ± 64% interrupts.CPU56.RES:Rescheduling_interrupts 20517 ± 57% -58.0% 8627 ± 69% interrupts.CPU58.CAL:Function_call_interrupts 30292 ± 79% -69.4% 9282 ±103% interrupts.CPU59.CAL:Function_call_interrupts 20349 ± 56% -60.6% 8013 ± 91% interrupts.CPU6.CAL:Function_call_interrupts 21097 ± 55% -63.7% 7660 ± 96% interrupts.CPU61.CAL:Function_call_interrupts 11855 ± 80% +132.5% 27562 ± 65% interrupts.CPU63.RES:Rescheduling_interrupts 12953 ± 23% -52.3% 6181 ± 75% interrupts.CPU66.CAL:Function_call_interrupts 19018 ± 38% -65.0% 6660 ±102% interrupts.CPU67.CAL:Function_call_interrupts 26718 ± 70% -66.5% 8941 ± 54% interrupts.CPU7.CAL:Function_call_interrupts 12561 ± 98% +114.0% 26876 ± 72% interrupts.CPU7.RES:Rescheduling_interrupts 10208 ± 83% +113.2% 21760 ± 60% interrupts.CPU8.RES:Rescheduling_interrupts 5057 ± 16% +235.1% 16946 ±105% interrupts.CPU87.CAL:Function_call_interrupts 9429 ± 66% +62.9% 15363 ± 43% interrupts.CPU9.RES:Rescheduling_interrupts stress-ng.sendfile.ops 2e+07 +-----------------------------------------------------------------+ |O OOO O O | 1.9e+07 |-O OO OOOOOOOOOO | | O OO | 1.8e+07 |-+O | | O | 1.7e+07 |-+ | | | 1.6e+07 |-+ | | ++ | 1.5e+07 |-+ + ++++ +++++++ +++++++ +++ ++++++++ +++++ +: + + | |++++++++++ :: : ++ + :+ :: :: + + + + ++++++++++| 1.4e+07 |-+ + + + + + + + | | | 1.3e+07 +-----------------------------------------------------------------+ stress-ng.sendfile.ops_per_sec 660000 +------------------------------------------------------------------+ 640000 |O+ OOO OOOOOO | | O OO OOOOOO O | 620000 |-+ O OO | 600000 |-+O | | O | 580000 |-+ | 560000 |-+ | 540000 |-+ | | | 520000 |-+ ++ | 500000 |-+ + + +++ ++ +++++++ + + +++ ++ +++++++ + :++ | |++++++ +++++ +:+ :: + + +::+:+ :: + + +:: :+++ ++++ | 480000 |-+ + + :: + :+ :: + :+ + + +| 460000 +------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

1 year, 8 months

1
0
0 / 0

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP October 2020