June 2022 - LKP - Ml01.01.Org

[io_uring] 584b0180f0: phoronix-test-suite.fio.SequentialWrite.IO_uring.Yes.Yes.1MB.DefaultTestDirectory.mb_s -10.2% regression

by kernel test robot

Greeting, FYI, we noticed a -10.2% regression of phoronix-test-suite.fio.SequentialWrite.IO_uring.Yes.Yes.1MB.DefaultTestDirectory.mb_s due to commit: commit: 584b0180f0f4d67d7145950fe68c625f06c88b10 ("io_uring: move read/write file prep state into actual opcode handler") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: phoronix-test-suite on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory with following parameters: test: fio-1.14.1 option_a: Sequential Write option_b: IO_uring option_c: Yes option_d: Yes option_e: 1MB option_f: Default Test Directory cpufreq_governor: performance ucode: 0x500320a test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. test-url: http://www.phoronix-test-suite.com/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= compiler/cpufreq_governor/kconfig/option_a/option_b/option_c/option_d/option_e/option_f/rootfs/tbox_group/test/testcase/ucode: gcc-11/performance/x86_64-rhel-8.3/Sequential Write/IO_uring/Yes/Yes/1MB/Default Test Directory/debian-x86_64-phoronix/lkp-csl-2sp7/fio-1.14.1/phoronix-test-suite/0x500320a commit: a3e4bc23d5 ("io_uring: defer splice/tee file validity check until command issue") 584b0180f0 ("io_uring: move read/write file prep state into actual opcode handler") a3e4bc23d5470b2b 584b0180f0f4d67d7145950fe68 ---------------- --------------------------- %stddev %change %stddev \ | \ 1081 -10.2% 971.00 phoronix-test-suite.fio.SequentialWrite.IO_uring.Yes.Yes.1MB.DefaultTestDirectory.iops 1084 -10.2% 974.67 phoronix-test-suite.fio.SequentialWrite.IO_uring.Yes.Yes.1MB.DefaultTestDirectory.mb_s 118.42 +132.0% 274.70 ± 55% phoronix-test-suite.time.elapsed_time 118.42 +132.0% 274.70 ± 55% phoronix-test-suite.time.elapsed_time.max 1317 ± 19% +921.5% 13458 ± 53% phoronix-test-suite.time.involuntary_context_switches 185595 +23.8% 229715 ± 17% phoronix-test-suite.time.minor_page_faults 68.33 +2031.5% 1456 ± 3% phoronix-test-suite.time.percent_of_cpu_this_job_got 58.62 +6771.2% 4028 ± 58% phoronix-test-suite.time.system_time 244.97 +10.1% 269.72 pmeter.Average_Active_Power 1655992 ± 78% +1356.2% 24114501 ± 50% numa-numastat.node1.local_node 1662758 ± 78% +1374.2% 24512157 ± 50% numa-numastat.node1.numa_hit 958669 +10.8% 1062574 ± 7% meminfo.Active 843569 +12.0% 945049 ± 8% meminfo.Active(anon) 61229 ± 3% -60.2% 24352 ± 21% meminfo.Writeback 96.73 -14.0 82.71 mpstat.cpu.all.idle% 1.75 ± 15% -0.3 1.43 ± 16% mpstat.cpu.all.irq% 0.80 +14.4 15.19 ± 3% mpstat.cpu.all.sys% 0.33 -0.0 0.28 ± 11% mpstat.cpu.all.usr% 258678 ± 7% -37.0% 162850 ± 17% numa-meminfo.node0.Dirty 56023 ± 12% -85.5% 8096 ± 50% numa-meminfo.node0.Writeback 2978 ± 44% +350.6% 13421 ± 82% numa-meminfo.node1.Active(anon) 1.83 ± 73% +8.1e+06% 148245 ± 22% numa-meminfo.node1.Dirty 96.33 -14.4% 82.50 vmstat.cpu.id 746.67 ± 2% -40.8% 441.83 ± 53% vmstat.io.bi 1.00 +1350.0% 14.50 ± 15% vmstat.procs.r 187622 ± 3% +2.6% 192531 vmstat.system.in 79.33 ± 9% +490.3% 468.33 ± 3% turbostat.Avg_MHz 4.77 ± 15% +13.3 18.11 ± 5% turbostat.Busy% 1688 ± 7% +53.6% 2593 ± 2% turbostat.Bzy_MHz 13881106 ± 34% +181.8% 39121066 ± 64% turbostat.C1E 22867090 ± 3% +134.6% 53644530 ± 54% turbostat.IRQ 49.00 +5.4% 51.67 ± 2% turbostat.PkgTmp 120.78 +16.5% 140.68 turbostat.PkgWatt 64647 ± 7% -36.9% 40763 ± 17% numa-vmstat.node0.nr_dirty 13891 ± 12% -85.1% 2064 ± 50% numa-vmstat.node0.nr_writeback 78537 ± 6% -45.5% 42771 ± 17% numa-vmstat.node0.nr_zone_write_pending 744.50 ± 44% +350.7% 3355 ± 82% numa-vmstat.node1.nr_active_anon 6.00 ± 52% +3.6e+08% 21761586 ± 53% numa-vmstat.node1.nr_dirtied 0.00 +3.7e+106% 37065 ± 22% numa-vmstat.node1.nr_dirty 5.50 ± 48% +3.9e+08% 21697670 ± 53% numa-vmstat.node1.nr_written 744.50 ± 44% +350.7% 3355 ± 82% numa-vmstat.node1.nr_zone_active_anon 0.00 +4e+106% 40201 ± 22% numa-vmstat.node1.nr_zone_write_pending 1662586 ± 78% +1374.3% 24512265 ± 50% numa-vmstat.node1.numa_hit 1655820 ± 78% +1356.4% 24114609 ± 50% numa-vmstat.node1.numa_local 17009 ± 36% +3730.9% 651618 ± 64% sched_debug.cfs_rq:/.min_vruntime.avg 33445 ± 30% +2211.0% 772918 ± 59% sched_debug.cfs_rq:/.min_vruntime.max 11326 ± 45% +4758.2% 550285 ± 70% sched_debug.cfs_rq:/.min_vruntime.min 3907 ± 21% +2044.3% 83779 ± 38% sched_debug.cfs_rq:/.min_vruntime.stddev 91.33 ± 33% +55.1% 141.65 ± 37% sched_debug.cfs_rq:/.runnable_avg.avg 7037 ± 70% +823.4% 64981 ± 67% sched_debug.cfs_rq:/.spread0.max -15244 +934.3% -157672 sched_debug.cfs_rq:/.spread0.min 3930 ± 21% +2031.5% 83782 ± 38% sched_debug.cfs_rq:/.spread0.stddev 90.43 ± 34% +53.1% 138.43 ± 37% sched_debug.cfs_rq:/.util_avg.avg 135.84 ± 21% +529.3% 854.87 ± 67% sched_debug.cpu.curr->pid.avg 1000 ± 10% +376.5% 4767 ± 59% sched_debug.cpu.nr_switches.min 210892 +12.0% 236262 ± 8% proc-vmstat.nr_active_anon 18617 +7.7% 20053 proc-vmstat.nr_kernel_stack 53538 +3.3% 55319 proc-vmstat.nr_slab_unreclaimable 15260 ± 4% -60.1% 6094 ± 21% proc-vmstat.nr_writeback 210892 +12.0% 236262 ± 8% proc-vmstat.nr_zone_active_anon 9868 ± 31% +227.2% 32291 ± 60% proc-vmstat.numa_hint_faults 9609 ± 28% +156.6% 24657 ± 62% proc-vmstat.numa_hint_faults_local 416.00 ± 8% +259.4% 1495 ± 54% proc-vmstat.numa_huge_pte_updates 259.00 ±156% +40441.1% 105001 ± 46% proc-vmstat.numa_pages_migrated 230799 ± 7% +252.9% 814389 ± 53% proc-vmstat.numa_pte_updates 292996 +7.3% 314293 proc-vmstat.pgactivate 867707 +73.7% 1507465 ± 39% proc-vmstat.pgfault 259.00 ±156% +40441.1% 105001 ± 46% proc-vmstat.pgmigrate_success 311.33 ± 7% +2155.2% 7021 ± 65% proc-vmstat.pgrotated 30.29 ± 42% -73.8% 7.93 ±110% perf-stat.i.MPKI 7.08e+08 +283.6% 2.716e+09 perf-stat.i.branch-instructions 2.91 ± 44% -1.9 1.04 ± 83% perf-stat.i.branch-miss-rate% 34699379 -10.6% 31027580 ± 3% perf-stat.i.cache-misses 6.802e+09 ± 10% +554.9% 4.455e+10 ± 3% perf-stat.i.cpu-cycles 33.73 ± 25% +1103.3% 405.85 ± 5% perf-stat.i.cpu-migrations 1102 ± 33% +132.4% 2562 ± 22% perf-stat.i.cycles-between-cache-misses 0.22 ± 50% -0.2 0.07 ±137% perf-stat.i.dTLB-load-miss-rate% 9.67e+08 ± 4% +270.6% 3.584e+09 ± 2% perf-stat.i.dTLB-loads 4.994e+08 ± 2% -6.6% 4.664e+08 ± 2% perf-stat.i.dTLB-stores 3.503e+09 +284.6% 1.347e+10 perf-stat.i.instructions 3126 ± 5% +327.7% 13371 ± 7% perf-stat.i.instructions-per-iTLB-miss 0.52 ± 9% -38.4% 0.32 ± 8% perf-stat.i.ipc 70851 ± 10% +554.6% 463814 ± 3% perf-stat.i.metric.GHz 23543856 +202.1% 71118618 perf-stat.i.metric.M/sec 24.45 ± 5% +17.6 42.05 ± 5% perf-stat.i.node-load-miss-rate% 154141 ± 4% +1027.3% 1737599 ± 11% perf-stat.i.node-load-misses 6780078 -41.7% 3950788 ± 5% perf-stat.i.node-loads 19.06 ± 16% +32.5 51.53 ± 7% perf-stat.i.node-store-miss-rate% 54242 ± 17% +4415.1% 2449115 ± 15% perf-stat.i.node-store-misses 5188725 -41.8% 3018300 ± 12% perf-stat.i.node-stores 20.79 ± 28% -81.7% 3.80 ± 31% perf-stat.overall.MPKI 2.06 ± 28% -1.8 0.31 ± 39% perf-stat.overall.branch-miss-rate% 1.94 ± 10% +70.2% 3.31 ± 2% perf-stat.overall.cpi 195.90 ± 8% +632.9% 1435 perf-stat.overall.cycles-between-cache-misses 0.10 ± 48% -0.1 0.01 ±116% perf-stat.overall.dTLB-load-miss-rate% 3154 ± 6% +306.3% 12813 ± 8% perf-stat.overall.instructions-per-iTLB-miss 0.52 ± 11% -41.9% 0.30 ± 2% perf-stat.overall.ipc 2.23 ± 4% +28.3 30.55 ± 10% perf-stat.overall.node-load-miss-rate% 1.04 ± 17% +43.8 44.81 ± 15% perf-stat.overall.node-store-miss-rate% 7.02e+08 +284.8% 2.702e+09 perf-stat.ps.branch-instructions 34381260 -10.2% 30861100 ± 3% perf-stat.ps.cache-misses 6.746e+09 ± 10% +556.9% 4.431e+10 ± 3% perf-stat.ps.cpu-cycles 33.43 ± 25% +1107.4% 403.66 ± 5% perf-stat.ps.cpu-migrations 9.587e+08 ± 4% +271.8% 3.565e+09 ± 2% perf-stat.ps.dTLB-loads 4.951e+08 ± 2% -6.3% 4.64e+08 ± 2% perf-stat.ps.dTLB-stores 3.473e+09 +285.9% 1.34e+10 perf-stat.ps.instructions 152903 ± 4% +1030.3% 1728344 ± 11% perf-stat.ps.node-load-misses 6717519 -41.5% 3929544 ± 5% perf-stat.ps.node-loads 53840 ± 17% +4424.7% 2436140 ± 15% perf-stat.ps.node-store-misses 5140848 -41.6% 3001971 ± 12% perf-stat.ps.node-stores 4.129e+11 +801.9% 3.724e+12 ± 56% perf-stat.total.instructions 61.17 ± 3% -49.8 11.37 ± 16% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 60.62 ± 3% -49.4 11.26 ± 16% perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify 60.58 ± 3% -49.3 11.26 ± 16% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 59.76 ± 3% -48.6 11.19 ± 16% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 55.62 ± 2% -44.8 10.84 ± 17% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 55.13 ± 3% -44.4 10.73 ± 17% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry 41.00 ± 4% -31.5 9.54 ± 20% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 40.57 ± 3% -31.0 9.53 ± 20% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 13.53 ± 4% -12.4 1.10 ± 9% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 14.04 ± 21% -12.1 1.96 ± 4% perf-profile.calltrace.cycles-pp.generic_perform_write.ext4_buffered_write_iter.io_write.io_issue_sqe.io_wq_submit_work 13.80 ± 10% -12.1 1.73 ± 9% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 10.98 ± 5% -10.0 0.98 ± 9% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 11.01 ± 9% -9.6 1.41 ± 11% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 10.97 ± 9% -9.6 1.40 ± 11% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 10.78 ± 9% -9.4 1.38 ± 11% perf-profile.calltrace.cycles-pp.loop_process_work.process_one_work.worker_thread.kthread.ret_from_fork 10.60 ± 10% -9.2 1.35 ± 11% perf-profile.calltrace.cycles-pp.lo_write_simple.loop_process_work.process_one_work.worker_thread.kthread 10.32 ± 9% -9.0 1.31 ± 12% perf-profile.calltrace.cycles-pp.do_iter_write.lo_write_simple.loop_process_work.process_one_work.worker_thread 10.00 ± 9% -8.7 1.28 ± 12% perf-profile.calltrace.cycles-pp.do_iter_readv_writev.do_iter_write.lo_write_simple.loop_process_work.process_one_work 9.93 ± 9% -8.7 1.28 ± 12% perf-profile.calltrace.cycles-pp.generic_file_write_iter.do_iter_readv_writev.do_iter_write.lo_write_simple.loop_process_work 9.59 ± 9% -8.4 1.24 ± 13% perf-profile.calltrace.cycles-pp.__generic_file_write_iter.generic_file_write_iter.do_iter_readv_writev.do_iter_write.lo_write_simple 9.41 ± 9% -8.2 1.22 ± 13% perf-profile.calltrace.cycles-pp.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.do_iter_readv_writev.do_iter_write 9.02 ± 8% -8.1 0.95 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 9.02 ± 8% -8.1 0.95 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.calltrace.cycles-pp.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.calltrace.cycles-pp.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.calltrace.cycles-pp.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.16 ± 9% -7.1 1.07 ± 14% perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.do_iter_readv_writev 7.36 ± 6% -6.7 0.62 ± 9% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 7.17 ± 7% -6.6 0.62 ± 9% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 5.18 ± 21% -4.5 0.72 ± 6% perf-profile.calltrace.cycles-pp.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.io_write.io_issue_sqe 5.08 ± 21% -4.4 0.70 ± 5% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter.io_write 5.05 ± 21% -4.4 0.70 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter_atomic.generic_perform_write.ext4_buffered_write_iter 4.69 ± 8% -4.3 0.36 ± 70% perf-profile.calltrace.cycles-pp.invalidate_mapping_pagevec.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64 5.02 ± 21% -4.3 0.75 ± 4% perf-profile.calltrace.cycles-pp.ext4_da_write_begin.generic_perform_write.ext4_buffered_write_iter.io_write.io_issue_sqe 0.00 +0.6 0.61 ± 2% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_slowpath.ext4_buffered_write_iter.io_write.io_issue_sqe 0.00 +2.0 2.03 ± 2% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.ext4_buffered_write_iter.io_write 28.19 ± 7% +59.2 87.44 ± 2% perf-profile.calltrace.cycles-pp.ret_from_fork 14.40 ± 21% +71.3 85.71 ± 2% perf-profile.calltrace.cycles-pp.io_wqe_worker.ret_from_fork 14.25 ± 21% +71.4 85.64 ± 2% perf-profile.calltrace.cycles-pp.io_worker_handle_work.io_wqe_worker.ret_from_fork 14.23 ± 21% +71.4 85.63 ± 2% perf-profile.calltrace.cycles-pp.io_issue_sqe.io_wq_submit_work.io_worker_handle_work.io_wqe_worker.ret_from_fork 14.23 ± 21% +71.4 85.64 ± 2% perf-profile.calltrace.cycles-pp.io_wq_submit_work.io_worker_handle_work.io_wqe_worker.ret_from_fork 14.22 ± 21% +71.4 85.63 ± 2% perf-profile.calltrace.cycles-pp.io_write.io_issue_sqe.io_wq_submit_work.io_worker_handle_work.io_wqe_worker 14.10 ± 21% +71.5 85.62 ± 2% perf-profile.calltrace.cycles-pp.ext4_buffered_write_iter.io_write.io_issue_sqe.io_wq_submit_work.io_worker_handle_work 0.00 +80.9 80.92 ± 2% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.ext4_buffered_write_iter.io_write 0.00 +83.0 82.99 ± 2% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.ext4_buffered_write_iter.io_write.io_issue_sqe 0.00 +83.6 83.63 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.ext4_buffered_write_iter.io_write.io_issue_sqe.io_wq_submit_work 61.17 ± 3% -49.8 11.37 ± 16% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 61.17 ± 3% -49.8 11.37 ± 16% perf-profile.children.cycles-pp.cpu_startup_entry 61.17 ± 3% -49.8 11.37 ± 16% perf-profile.children.cycles-pp.do_idle 60.34 ± 3% -49.0 11.30 ± 16% perf-profile.children.cycles-pp.cpuidle_idle_call 56.14 ± 3% -45.2 10.95 ± 17% perf-profile.children.cycles-pp.cpuidle_enter 56.08 ± 3% -45.1 10.94 ± 17% perf-profile.children.cycles-pp.cpuidle_enter_state 41.25 ± 4% -31.6 9.64 ± 20% perf-profile.children.cycles-pp.intel_idle 41.16 ± 4% -31.5 9.64 ± 20% perf-profile.children.cycles-pp.mwait_idle_with_hints 23.64 ± 10% -20.4 3.22 ± 5% perf-profile.children.cycles-pp.generic_perform_write 13.80 ± 10% -12.1 1.73 ± 9% perf-profile.children.cycles-pp.kthread 13.48 ± 8% -11.8 1.72 ± 9% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 13.41 ± 5% -11.6 1.80 ± 9% perf-profile.children.cycles-pp.copy_page_from_iter_atomic 11.71 ± 6% -10.2 1.55 ± 9% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 11.01 ± 9% -9.6 1.41 ± 11% perf-profile.children.cycles-pp.worker_thread 10.97 ± 9% -9.6 1.40 ± 11% perf-profile.children.cycles-pp.process_one_work 10.78 ± 9% -9.4 1.38 ± 11% perf-profile.children.cycles-pp.loop_process_work 10.61 ± 10% -9.3 1.35 ± 12% perf-profile.children.cycles-pp.lo_write_simple 10.19 ± 7% -9.1 1.12 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 10.18 ± 7% -9.1 1.12 ± 5% perf-profile.children.cycles-pp.do_syscall_64 10.32 ± 9% -9.0 1.32 ± 12% perf-profile.children.cycles-pp.do_iter_write 10.08 ± 9% -8.8 1.32 ± 12% perf-profile.children.cycles-pp.generic_file_write_iter 10.00 ± 9% -8.7 1.28 ± 12% perf-profile.children.cycles-pp.do_iter_readv_writev 9.75 ± 9% -8.5 1.28 ± 13% perf-profile.children.cycles-pp.__generic_file_write_iter 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.children.cycles-pp.__x64_sys_fadvise64 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.children.cycles-pp.ksys_fadvise64_64 8.21 ± 8% -7.3 0.88 ± 7% perf-profile.children.cycles-pp.generic_fadvise 7.93 ± 6% -6.8 1.16 ± 10% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 7.76 ± 7% -6.6 1.15 ± 10% perf-profile.children.cycles-pp.hrtimer_interrupt 5.14 ± 21% -4.4 0.72 ± 5% perf-profile.children.cycles-pp.copyin 5.13 ± 21% -4.4 0.72 ± 5% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 5.02 ± 21% -4.3 0.75 ± 4% perf-profile.children.cycles-pp.ext4_da_write_begin 4.70 ± 8% -4.2 0.52 ± 9% perf-profile.children.cycles-pp.invalidate_mapping_pagevec 4.60 ± 10% -3.8 0.80 ± 15% perf-profile.children.cycles-pp.__hrtimer_run_queues 3.98 ± 9% -3.5 0.44 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start 3.54 ± 13% -3.2 0.30 ± 13% perf-profile.children.cycles-pp.menu_select 3.71 ± 15% -3.2 0.54 ± 3% perf-profile.children.cycles-pp.pagecache_get_page 3.51 ± 9% -3.2 0.36 ± 10% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 3.51 ± 9% -3.2 0.36 ± 10% perf-profile.children.cycles-pp.filemap_fdatawrite_wbc 3.51 ± 9% -3.1 0.37 ± 6% perf-profile.children.cycles-pp.do_writepages 3.51 ± 9% -3.1 0.37 ± 6% perf-profile.children.cycles-pp.ext4_writepages 3.50 ± 9% -3.1 0.37 ± 6% perf-profile.children.cycles-pp.mpage_prepare_extent_to_map 3.67 ± 16% -3.1 0.54 ± 3% perf-profile.children.cycles-pp.__filemap_get_folio 2.87 ± 10% -2.6 0.29 ± 11% perf-profile.children.cycles-pp.mpage_process_page_bufs 3.08 ± 11% -2.4 0.66 ± 15% perf-profile.children.cycles-pp.tick_sched_timer 2.71 ± 52% -2.4 0.30 ± 23% perf-profile.children.cycles-pp.ktime_get 2.70 ± 10% -2.4 0.30 ± 5% perf-profile.children.cycles-pp.smpboot_thread_fn 2.66 ± 21% -2.3 0.33 ± 3% perf-profile.children.cycles-pp.generic_write_end 2.61 ± 11% -2.3 0.29 ± 6% perf-profile.children.cycles-pp.run_ksoftirqd 2.57 ± 11% -2.3 0.28 ± 7% perf-profile.children.cycles-pp.blk_complete_reqs 2.56 ± 11% -2.3 0.28 ± 7% perf-profile.children.cycles-pp.blk_mq_end_request 2.56 ± 11% -2.3 0.28 ± 7% perf-profile.children.cycles-pp.blk_update_request 2.54 ± 11% -2.3 0.28 ± 7% perf-profile.children.cycles-pp.ext4_end_bio 2.54 ± 11% -2.3 0.28 ± 7% perf-profile.children.cycles-pp.ext4_finish_bio 2.45 ± 9% -2.2 0.24 ± 9% perf-profile.children.cycles-pp.mpage_submit_page 2.48 ± 21% -2.2 0.30 ± 2% perf-profile.children.cycles-pp.__block_commit_write 2.40 ± 15% -1.8 0.58 ± 14% perf-profile.children.cycles-pp.tick_sched_handle 2.06 ± 34% -1.8 0.24 ± 15% perf-profile.children.cycles-pp.clockevents_program_event 2.26 ± 13% -1.7 0.57 ± 13% perf-profile.children.cycles-pp.update_process_times 1.80 ± 9% -1.6 0.17 ± 8% perf-profile.children.cycles-pp.ext4_bio_write_page 1.78 ± 11% -1.6 0.18 ± 7% perf-profile.children.cycles-pp.folio_end_writeback 1.86 ± 21% -1.6 0.28 ± 6% perf-profile.children.cycles-pp.filemap_add_folio 1.78 ± 14% -1.6 0.20 ± 13% perf-profile.children.cycles-pp.__irq_exit_rcu 1.80 ± 22% -1.5 0.26 ± 6% perf-profile.children.cycles-pp.ext4_block_write_begin 1.69 ± 12% -1.5 0.20 ± 17% perf-profile.children.cycles-pp.mapping_evict_folio 1.63 ± 22% -1.5 0.14 ± 12% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 1.68 ± 12% -1.5 0.20 ± 17% perf-profile.children.cycles-pp.filemap_release_folio 1.55 ± 10% -1.4 0.16 ± 7% perf-profile.children.cycles-pp.__folio_end_writeback 1.50 ± 6% -1.3 0.15 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.41 ± 11% -1.3 0.14 ± 8% perf-profile.children.cycles-pp.remove_mapping 1.38 ± 11% -1.2 0.14 ± 7% perf-profile.children.cycles-pp.__remove_mapping 1.28 ± 14% -1.1 0.14 ± 10% perf-profile.children.cycles-pp.release_pages 1.24 ± 27% -1.1 0.11 ± 17% perf-profile.children.cycles-pp.tick_nohz_next_event 1.26 ± 21% -1.1 0.19 ± 5% perf-profile.children.cycles-pp.__filemap_add_folio 1.26 ± 9% -1.1 0.19 ± 4% perf-profile.children.cycles-pp.__schedule 1.19 ± 14% -1.1 0.13 ± 13% perf-profile.children.cycles-pp.__pagevec_release 1.15 ± 15% -1.0 0.13 ± 25% perf-profile.children.cycles-pp.try_to_free_buffers 1.11 ± 16% -1.0 0.10 ± 15% perf-profile.children.cycles-pp.__folio_start_writeback 1.17 ± 24% -1.0 0.18 ± 8% perf-profile.children.cycles-pp.create_empty_buffers 1.35 ± 8% -1.0 0.40 ± 13% perf-profile.children.cycles-pp.perf_tp_event 1.42 ± 13% -0.9 0.47 ± 13% perf-profile.children.cycles-pp.scheduler_tick 1.05 ± 7% -0.9 0.12 ± 12% perf-profile.children.cycles-pp.__mod_lruvec_page_state 1.31 ± 8% -0.9 0.38 ± 13% perf-profile.children.cycles-pp.perf_event_output_forward 1.31 ± 8% -0.9 0.39 ± 13% perf-profile.children.cycles-pp.__perf_event_overflow 1.06 ± 6% -0.9 0.14 ± 9% perf-profile.children.cycles-pp.xas_load 1.17 ± 8% -0.8 0.34 ± 14% perf-profile.children.cycles-pp.perf_prepare_sample 0.96 ± 22% -0.8 0.14 ± 6% perf-profile.children.cycles-pp.mark_buffer_dirty 0.94 ± 21% -0.8 0.15 ± 6% perf-profile.children.cycles-pp.folio_alloc 1.12 ± 8% -0.8 0.32 ± 15% perf-profile.children.cycles-pp.perf_callchain 1.11 ± 8% -0.8 0.32 ± 15% perf-profile.children.cycles-pp.get_perf_callchain 0.92 ± 19% -0.8 0.15 ± 5% perf-profile.children.cycles-pp.__alloc_pages 0.90 ± 18% -0.8 0.14 ± 9% perf-profile.children.cycles-pp.fault_in_iov_iter_readable 0.86 ± 10% -0.8 0.09 ± 11% perf-profile.children.cycles-pp._raw_spin_lock 0.89 ± 27% -0.7 0.14 ± 7% perf-profile.children.cycles-pp.alloc_page_buffers 0.80 ± 10% -0.7 0.07 ± 15% perf-profile.children.cycles-pp.irq_work_run_list 0.81 ± 17% -0.7 0.07 ± 21% perf-profile.children.cycles-pp.irq_enter_rcu 0.86 ± 18% -0.7 0.13 ± 9% perf-profile.children.cycles-pp.fault_in_readable 0.88 ± 8% -0.7 0.16 ± 4% perf-profile.children.cycles-pp.schedule 0.84 ± 29% -0.7 0.14 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.asm_sysvec_irq_work 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.sysvec_irq_work 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.__sysvec_irq_work 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.irq_work_single 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.irq_work_run 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp._printk 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.vprintk_emit 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.console_unlock 0.78 ± 9% -0.7 0.07 ± 16% perf-profile.children.cycles-pp.call_console_drivers 0.77 ± 19% -0.7 0.06 ± 47% perf-profile.children.cycles-pp.tick_irq_enter 0.84 ± 29% -0.7 0.14 ± 9% perf-profile.children.cycles-pp.alloc_buffer_head 0.80 ± 16% -0.7 0.10 ± 10% perf-profile.children.cycles-pp.shmem_write_begin 0.78 ± 24% -0.7 0.09 ± 30% perf-profile.children.cycles-pp.kmem_cache_free 0.75 ± 10% -0.7 0.06 ± 11% perf-profile.children.cycles-pp.serial8250_console_write 0.75 ± 10% -0.7 0.06 ± 11% perf-profile.children.cycles-pp.uart_console_write 0.77 ± 14% -0.7 0.09 ± 8% perf-profile.children.cycles-pp.lapic_next_deadline 0.76 ± 9% -0.7 0.08 ± 12% perf-profile.children.cycles-pp.__filemap_remove_folio 0.76 ± 17% -0.7 0.10 ± 10% perf-profile.children.cycles-pp.shmem_getpage_gfp 0.72 ± 55% -0.7 0.06 ± 47% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.72 ± 9% -0.7 0.06 ± 11% perf-profile.children.cycles-pp.wait_for_xmitr 0.72 ± 10% -0.7 0.06 ± 11% perf-profile.children.cycles-pp.serial8250_console_putchar 0.73 ± 23% -0.6 0.08 ± 29% perf-profile.children.cycles-pp.free_buffer_head 0.70 ± 19% -0.6 0.06 ± 19% perf-profile.children.cycles-pp.rebalance_domains 0.69 ± 14% -0.6 0.06 ± 17% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.73 ± 21% -0.6 0.12 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist 0.71 ± 8% -0.6 0.09 ± 5% perf-profile.children.cycles-pp.native_irq_return_iret 0.64 ± 21% -0.6 0.06 ± 14% perf-profile.children.cycles-pp.free_unref_page_list 0.67 ± 23% -0.6 0.10 ± 10% perf-profile.children.cycles-pp.__folio_mark_dirty 0.59 ± 8% -0.6 0.02 ± 99% perf-profile.children.cycles-pp.io_serial_in 0.62 ± 15% -0.6 0.06 ± 11% perf-profile.children.cycles-pp.folio_clear_dirty_for_io 0.62 ± 14% -0.6 0.06 ± 11% perf-profile.children.cycles-pp.sched_clock_cpu 0.60 ± 20% -0.5 0.09 ± 7% perf-profile.children.cycles-pp.folio_add_lru 0.54 ± 16% -0.5 0.06 ± 9% perf-profile.children.cycles-pp.native_sched_clock 0.50 ± 7% -0.5 0.04 ± 71% perf-profile.children.cycles-pp.read_tsc 0.50 ± 10% -0.4 0.06 ± 6% perf-profile.children.cycles-pp.__might_resched 0.55 ± 38% -0.4 0.11 ± 25% perf-profile.children.cycles-pp.start_kernel 0.50 ± 17% -0.4 0.07 ± 10% perf-profile.children.cycles-pp.xas_store 0.49 ± 11% -0.4 0.06 ± 11% perf-profile.children.cycles-pp.__mod_lruvec_state 0.51 ± 19% -0.4 0.08 ± 8% perf-profile.children.cycles-pp.__pagevec_lru_add 0.54 ± 18% -0.4 0.11 ± 11% perf-profile.children.cycles-pp.load_balance 0.47 ± 49% -0.4 0.05 ± 46% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.50 ± 21% -0.4 0.08 ± 5% perf-profile.children.cycles-pp.rmqueue 0.46 ± 14% -0.4 0.04 ± 44% perf-profile.children.cycles-pp.irqtime_account_irq 0.47 ± 22% -0.4 0.06 ± 7% perf-profile.children.cycles-pp.ext4_da_get_block_prep 0.43 ± 34% -0.4 0.03 ±102% perf-profile.children.cycles-pp.memcg_slab_free_hook 0.46 ± 8% -0.4 0.06 ± 17% perf-profile.children.cycles-pp.jbd2_journal_try_to_free_buffers 0.47 ± 12% -0.4 0.08 ± 13% perf-profile.children.cycles-pp.perf_callchain_user 0.44 ± 7% -0.4 0.06 ± 8% perf-profile.children.cycles-pp.ksys_read 0.62 ± 7% -0.4 0.24 ± 18% perf-profile.children.cycles-pp.perf_callchain_kernel 0.44 ± 7% -0.4 0.06 ± 8% perf-profile.children.cycles-pp.vfs_read 0.43 ± 8% -0.4 0.06 ± 13% perf-profile.children.cycles-pp.jbd2_journal_grab_journal_head 0.39 ± 7% -0.4 0.03 ±100% perf-profile.children.cycles-pp.free_pcppages_bulk 0.38 ± 8% -0.4 0.02 ± 99% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.40 ± 13% -0.4 0.05 ± 7% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 0.43 ± 9% -0.3 0.08 ± 8% perf-profile.children.cycles-pp.try_to_wake_up 0.38 ± 10% -0.3 0.04 ± 44% perf-profile.children.cycles-pp.__mod_node_page_state 0.41 ± 13% -0.3 0.07 ± 15% perf-profile.children.cycles-pp.__get_user_nocheck_8 0.40 ± 20% -0.3 0.08 ± 11% perf-profile.children.cycles-pp.find_busiest_group 0.65 ± 9% -0.3 0.33 ± 17% perf-profile.children.cycles-pp.update_curr 0.51 ± 7% -0.3 0.19 ± 17% perf-profile.children.cycles-pp.unwind_next_frame 0.38 ± 21% -0.3 0.06 ± 9% perf-profile.children.cycles-pp.__mem_cgroup_charge 0.37 ± 20% -0.3 0.06 ± 9% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.63 ± 9% -0.3 0.32 ± 17% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 0.38 ± 17% -0.3 0.08 ± 12% perf-profile.children.cycles-pp.update_sd_lb_stats 0.38 ± 6% -0.3 0.08 ± 8% perf-profile.children.cycles-pp.__libc_start_main 0.32 ± 12% -0.3 0.02 ± 99% perf-profile.children.cycles-pp.read 0.32 ± 21% -0.3 0.04 ± 45% perf-profile.children.cycles-pp.rmqueue_bulk 0.31 ± 42% -0.3 0.04 ± 71% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 0.26 ± 25% -0.2 0.02 ± 99% perf-profile.children.cycles-pp.folio_account_dirtied 0.29 ± 20% -0.2 0.07 ± 14% perf-profile.children.cycles-pp.update_sg_lb_stats 0.27 ± 7% -0.2 0.08 ± 7% perf-profile.children.cycles-pp.asm_exc_page_fault 0.24 ± 10% -0.2 0.08 ± 22% perf-profile.children.cycles-pp.__unwind_start 0.18 ± 16% -0.2 0.03 ±100% perf-profile.children.cycles-pp.__orc_find 0.16 ± 16% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.ksys_write 0.16 ± 16% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.vfs_write 0.16 ± 16% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.new_sync_write 0.15 ± 17% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.__libc_write 0.17 ± 18% -0.1 0.07 ± 6% perf-profile.children.cycles-pp.schedule_timeout 0.15 ± 24% -0.1 0.09 ± 13% perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +2.6 2.64 ± 2% perf-profile.children.cycles-pp.rwsem_spin_on_owner 28.20 ± 7% +59.2 87.44 ± 2% perf-profile.children.cycles-pp.ret_from_fork 14.40 ± 21% +71.3 85.71 ± 2% perf-profile.children.cycles-pp.io_wqe_worker 14.25 ± 21% +71.4 85.64 ± 2% perf-profile.children.cycles-pp.io_worker_handle_work 14.23 ± 21% +71.4 85.63 ± 2% perf-profile.children.cycles-pp.io_issue_sqe 14.23 ± 21% +71.4 85.64 ± 2% perf-profile.children.cycles-pp.io_wq_submit_work 14.22 ± 21% +71.4 85.63 ± 2% perf-profile.children.cycles-pp.io_write 14.10 ± 21% +71.5 85.62 ± 2% perf-profile.children.cycles-pp.ext4_buffered_write_iter 0.00 +80.9 80.95 ± 2% perf-profile.children.cycles-pp.osq_lock 0.00 +83.0 83.00 ± 2% perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.00 +83.6 83.63 ± 2% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 40.90 ± 3% -31.3 9.63 ± 20% perf-profile.self.cycles-pp.mwait_idle_with_hints 8.22 ± 9% -7.1 1.08 ± 14% perf-profile.self.cycles-pp.copy_page_from_iter_atomic 5.02 ± 20% -4.3 0.71 ± 5% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 2.31 ± 61% -2.0 0.26 ± 25% perf-profile.self.cycles-pp.ktime_get 1.89 ± 12% -1.7 0.17 ± 8% perf-profile.self.cycles-pp.cpuidle_enter_state 1.64 ± 15% -1.5 0.14 ± 20% perf-profile.self.cycles-pp.menu_select 1.42 ± 20% -1.3 0.15 ± 7% perf-profile.self.cycles-pp.__block_commit_write 1.26 ± 7% -1.1 0.14 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.86 ± 5% -0.7 0.12 ± 13% perf-profile.self.cycles-pp.xas_load 0.83 ± 17% -0.7 0.12 ± 10% perf-profile.self.cycles-pp.fault_in_readable 0.77 ± 14% -0.7 0.09 ± 8% perf-profile.self.cycles-pp.lapic_next_deadline 0.69 ± 9% -0.6 0.08 ± 16% perf-profile.self.cycles-pp._raw_spin_lock 0.70 ± 8% -0.6 0.09 ± 5% perf-profile.self.cycles-pp.native_irq_return_iret 0.59 ± 8% -0.6 0.02 ± 99% perf-profile.self.cycles-pp.io_serial_in 0.50 ± 6% -0.5 0.03 ±100% perf-profile.self.cycles-pp.read_tsc 0.51 ± 16% -0.5 0.06 ± 9% perf-profile.self.cycles-pp.native_sched_clock 0.46 ± 10% -0.4 0.06 ± 8% perf-profile.self.cycles-pp.__might_resched 0.43 ± 11% -0.4 0.03 ± 70% perf-profile.self.cycles-pp.ext4_bio_write_page 0.42 ± 8% -0.4 0.05 ± 8% perf-profile.self.cycles-pp.jbd2_journal_grab_journal_head 0.38 ± 11% -0.3 0.03 ± 70% perf-profile.self.cycles-pp.__mod_node_page_state 0.36 ± 15% -0.3 0.02 ± 99% perf-profile.self.cycles-pp.release_pages 0.37 ± 62% -0.3 0.05 ± 45% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.21 ± 19% -0.2 0.06 ± 8% perf-profile.self.cycles-pp.update_sg_lb_stats 0.18 ± 16% -0.2 0.03 ±100% perf-profile.self.cycles-pp.__orc_find 0.19 ± 8% -0.1 0.08 ± 15% perf-profile.self.cycles-pp.unwind_next_frame 0.00 +2.6 2.62 ± 2% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.00 +80.4 80.42 ± 2% perf-profile.self.cycles-pp.osq_lock Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 weeks, 4 days

4
18
0 / 0

[net] 4890b686f4: netperf.Throughput_Mbps -69.4% regression

by kernel test robot

Greeting, FYI, we noticed a -69.4% regression of netperf.Throughput_Mbps due to commit: commit: 4890b686f4088c90432149bd6de567e621266fa2 ("net: keep sk->sk_forward_alloc as small as possible") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: netperf on test machine: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory with following parameters: ip: ipv4 runtime: 300s nr_threads: 25% cluster: cs-localhost send_size: 10K test: SCTP_STREAM_MANY cpufreq_governor: performance ucode: 0x7002402 test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance. test-url: http://www.netperf.org/netperf/ In addition to that, the commit also has significant impact on the following tests: +------------------+----------------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps -73.7% regression | | test machine | 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=50% | | | runtime=300s | | | send_size=10K | | | test=SCTP_STREAM_MANY | | | ucode=0x7002402 | +------------------+----------------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode: cs-localhost/gcc-11/performance/ipv4/x86_64-rhel-8.3/25%/debian-11.1-x86_64-20220510.cgz/300s/10K/lkp-cpl-4sp1/SCTP_STREAM_MANY/netperf/0x7002402 commit: 7c80b038d2 ("net: fix sk_wmem_schedule() and sk_rmem_schedule() errors") 4890b686f4 ("net: keep sk->sk_forward_alloc as small as possible") 7c80b038d23e1f4c 4890b686f4088c90432149bd6de ---------------- --------------------------- %stddev %change %stddev \ | \ 15855 -69.4% 4854 netperf.Throughput_Mbps 570788 -69.4% 174773 netperf.Throughput_total_Mbps 30543 -59.1% 12480 ± 3% netperf.time.involuntary_context_switches 16661 ± 2% -20.1% 13317 ± 2% netperf.time.minor_page_faults 2076 -58.1% 869.17 ± 2% netperf.time.percent_of_cpu_this_job_got 6118 -57.8% 2583 ± 2% netperf.time.system_time 143.71 ± 6% -72.3% 39.77 netperf.time.user_time 87371 ± 8% +81.1% 158253 netperf.time.voluntary_context_switches 2.09e+09 -69.4% 6.4e+08 netperf.workload 36264 +18.2% 42849 uptime.idle 3.058e+10 +22.0% 3.731e+10 cpuidle..time 6.536e+08 -60.7% 2.566e+08 cpuidle..usage 127819 ± 79% -82.3% 22609 ± 65% numa-meminfo.node3.Inactive 127764 ± 79% -82.4% 22440 ± 66% numa-meminfo.node3.Inactive(anon) 71.38 +14.7 86.09 mpstat.cpu.all.idle% 4.84 -2.1 2.78 ± 2% mpstat.cpu.all.soft% 22.32 -12.1 10.25 ± 2% mpstat.cpu.all.sys% 0.78 ± 3% -0.5 0.25 mpstat.cpu.all.usr% 71.00 +20.9% 85.83 vmstat.cpu.id 4121749 -23.6% 3150424 vmstat.memory.cache 43.00 ± 2% -55.0% 19.33 ± 2% vmstat.procs.r 3921783 -69.4% 1200263 vmstat.system.cs 292198 -1.3% 288478 vmstat.system.in 6.908e+08 ± 3% -70.1% 2.064e+08 ± 9% numa-numastat.node0.local_node 6.907e+08 ± 3% -70.1% 2.065e+08 ± 9% numa-numastat.node0.numa_hit 6.517e+08 ± 2% -65.5% 2.246e+08 ± 10% numa-numastat.node1.local_node 6.519e+08 ± 2% -65.5% 2.247e+08 ± 10% numa-numastat.node1.numa_hit 6.81e+08 ± 3% -72.1% 1.902e+08 ± 8% numa-numastat.node2.local_node 6.811e+08 ± 3% -72.0% 1.905e+08 ± 8% numa-numastat.node2.numa_hit 6.819e+08 ± 3% -69.9% 2.05e+08 ± 6% numa-numastat.node3.local_node 6.823e+08 ± 3% -69.9% 2.051e+08 ± 6% numa-numastat.node3.numa_hit 6.907e+08 ± 3% -70.1% 2.065e+08 ± 9% numa-vmstat.node0.numa_hit 6.908e+08 ± 3% -70.1% 2.064e+08 ± 9% numa-vmstat.node0.numa_local 6.519e+08 ± 2% -65.5% 2.247e+08 ± 10% numa-vmstat.node1.numa_hit 6.517e+08 ± 2% -65.5% 2.246e+08 ± 10% numa-vmstat.node1.numa_local 6.811e+08 ± 3% -72.0% 1.905e+08 ± 8% numa-vmstat.node2.numa_hit 6.81e+08 ± 3% -72.1% 1.902e+08 ± 8% numa-vmstat.node2.numa_local 31948 ± 79% -82.4% 5622 ± 66% numa-vmstat.node3.nr_inactive_anon 31948 ± 79% -82.4% 5622 ± 66% numa-vmstat.node3.nr_zone_inactive_anon 6.823e+08 ± 3% -69.9% 2.051e+08 ± 6% numa-vmstat.node3.numa_hit 6.819e+08 ± 3% -69.9% 2.05e+08 ± 6% numa-vmstat.node3.numa_local 1216292 ± 5% -70.1% 363637 ± 4% meminfo.Active 1215873 ± 5% -70.1% 363097 ± 4% meminfo.Active(anon) 3994598 -24.3% 3022264 meminfo.Cached 1878317 ± 4% -53.7% 870428 meminfo.Committed_AS 431272 ± 8% -28.0% 310461 meminfo.Inactive 428860 ± 9% -28.4% 306912 meminfo.Inactive(anon) 668273 ± 5% -71.3% 192010 ± 4% meminfo.Mapped 5793516 -17.1% 4802753 meminfo.Memused 8320 ± 2% -12.1% 7309 ± 2% meminfo.PageTables 1341918 ± 6% -72.5% 368590 ± 4% meminfo.Shmem 9796929 -25.1% 7337138 meminfo.max_used_kB 1029 -51.6% 498.17 ± 2% turbostat.Avg_MHz 31.32 -16.2 15.17 ± 2% turbostat.Busy% 5.953e+08 -69.1% 1.837e+08 ± 2% turbostat.C1 9.22 -5.2 4.04 ± 4% turbostat.C1% 68.58 +23.5% 84.67 turbostat.CPU%c1 57.67 -16.8% 48.00 ± 3% turbostat.CoreTmp 0.23 ± 2% -31.4% 0.16 turbostat.IPC 18.59 ± 30% -18.6 0.00 turbostat.PKG_% 4524200 ± 6% -81.5% 835280 turbostat.POLL 0.10 ± 3% -0.1 0.02 ± 17% turbostat.POLL% 57.33 -16.6% 47.83 ± 4% turbostat.PkgTmp 561.39 -25.9% 416.03 turbostat.PkgWatt 7.75 +6.8% 8.27 turbostat.RAMWatt 303881 ± 5% -70.2% 90609 ± 4% proc-vmstat.nr_active_anon 998594 -24.4% 755404 proc-vmstat.nr_file_pages 107254 ± 9% -28.4% 76741 proc-vmstat.nr_inactive_anon 167104 ± 5% -71.0% 48414 ± 4% proc-vmstat.nr_mapped 2081 ± 2% -12.1% 1828 ± 2% proc-vmstat.nr_page_table_pages 335422 ± 6% -72.6% 91983 ± 4% proc-vmstat.nr_shmem 32561 -1.7% 31994 proc-vmstat.nr_slab_reclaimable 303881 ± 5% -70.2% 90609 ± 4% proc-vmstat.nr_zone_active_anon 107254 ± 9% -28.4% 76741 proc-vmstat.nr_zone_inactive_anon 267554 ± 15% -25.4% 199518 ± 10% proc-vmstat.numa_hint_faults 82267 ± 20% -27.2% 59929 ± 13% proc-vmstat.numa_hint_faults_local 2.706e+09 -69.5% 8.266e+08 proc-vmstat.numa_hit 2.705e+09 -69.5% 8.262e+08 proc-vmstat.numa_local 489361 ± 9% -19.4% 394229 ± 6% proc-vmstat.numa_pte_updates 510140 ± 18% -75.3% 125829 ± 2% proc-vmstat.pgactivate 7.17e+09 -69.4% 2.197e+09 proc-vmstat.pgalloc_normal 1636476 ± 2% -11.5% 1448944 proc-vmstat.pgfault 7.17e+09 -69.4% 2.197e+09 proc-vmstat.pgfree 30967 ± 41% -88.7% 3488 ± 30% sched_debug.cfs_rq:/.MIN_vruntime.avg 1604384 ± 22% -83.6% 262510 ± 14% sched_debug.cfs_rq:/.MIN_vruntime.max 201146 ± 30% -86.1% 28034 ± 18% sched_debug.cfs_rq:/.MIN_vruntime.stddev 0.29 ± 8% -43.5% 0.16 ± 9% sched_debug.cfs_rq:/.h_nr_running.avg 0.42 ± 3% -15.1% 0.36 ± 3% sched_debug.cfs_rq:/.h_nr_running.stddev 30967 ± 41% -88.7% 3488 ± 30% sched_debug.cfs_rq:/.max_vruntime.avg 1604384 ± 22% -83.6% 262510 ± 14% sched_debug.cfs_rq:/.max_vruntime.max 201146 ± 30% -86.1% 28034 ± 18% sched_debug.cfs_rq:/.max_vruntime.stddev 1526268 ± 11% -80.6% 295647 ± 10% sched_debug.cfs_rq:/.min_vruntime.avg 2336190 ± 12% -79.4% 482042 ± 7% sched_debug.cfs_rq:/.min_vruntime.max 859659 ± 11% -85.8% 121714 ± 18% sched_debug.cfs_rq:/.min_vruntime.min 343902 ± 15% -78.7% 73263 ± 6% sched_debug.cfs_rq:/.min_vruntime.stddev 0.29 ± 8% -43.6% 0.16 ± 9% sched_debug.cfs_rq:/.nr_running.avg 0.42 ± 3% -15.1% 0.36 ± 3% sched_debug.cfs_rq:/.nr_running.stddev 312.39 ± 7% -46.1% 168.29 ± 5% sched_debug.cfs_rq:/.runnable_avg.avg 355.85 ± 2% -27.3% 258.86 ± 3% sched_debug.cfs_rq:/.runnable_avg.stddev 984535 ± 22% -82.1% 176253 ± 31% sched_debug.cfs_rq:/.spread0.max -491914 -62.6% -184050 sched_debug.cfs_rq:/.spread0.min 343876 ± 15% -78.7% 73261 ± 6% sched_debug.cfs_rq:/.spread0.stddev 312.25 ± 7% -46.1% 168.23 ± 5% sched_debug.cfs_rq:/.util_avg.avg 355.80 ± 2% -27.3% 258.80 ± 3% sched_debug.cfs_rq:/.util_avg.stddev 213.78 ± 8% -62.3% 80.50 ± 11% sched_debug.cfs_rq:/.util_est_enqueued.avg 331.99 ± 3% -37.4% 207.79 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.stddev 630039 +19.0% 749877 ± 3% sched_debug.cpu.avg_idle.avg 4262 +45.9% 6219 ± 3% sched_debug.cpu.avg_idle.min 2345 ± 14% -35.1% 1522 ± 6% sched_debug.cpu.clock_task.stddev 1496 ± 5% -47.9% 779.72 ± 7% sched_debug.cpu.curr->pid.avg 2528 ± 3% -19.7% 2031 ± 3% sched_debug.cpu.curr->pid.stddev 0.00 ± 10% -23.0% 0.00 ± 4% sched_debug.cpu.next_balance.stddev 0.25 ± 6% -48.0% 0.13 ± 8% sched_debug.cpu.nr_running.avg 0.41 ± 2% -19.9% 0.33 ± 3% sched_debug.cpu.nr_running.stddev 3859540 ± 10% -70.7% 1132195 ± 10% sched_debug.cpu.nr_switches.avg 7113795 ± 11% -64.8% 2504199 ± 10% sched_debug.cpu.nr_switches.max 1618475 ± 15% -86.1% 224980 ± 30% sched_debug.cpu.nr_switches.min 1045624 ± 9% -57.2% 447501 ± 9% sched_debug.cpu.nr_switches.stddev 2.446e+10 -66.9% 8.087e+09 perf-stat.i.branch-instructions 2.356e+08 ± 2% -65.6% 80979566 ± 3% perf-stat.i.branch-misses 0.74 ± 8% +5.7 6.47 perf-stat.i.cache-miss-rate% 16166727 ± 10% +236.6% 54420281 ± 2% perf-stat.i.cache-misses 2.609e+09 -67.5% 8.493e+08 ± 2% perf-stat.i.cache-references 3956687 -69.4% 1211999 perf-stat.i.context-switches 1.23 +44.9% 1.79 perf-stat.i.cpi 1.51e+11 -52.3% 7.199e+10 ± 2% perf-stat.i.cpu-cycles 363.75 -38.7% 223.06 perf-stat.i.cpu-migrations 10558 ± 10% -87.4% 1326 perf-stat.i.cycles-between-cache-misses 652403 ±109% -72.7% 178258 ± 8% perf-stat.i.dTLB-load-misses 3.497e+10 -66.9% 1.158e+10 perf-stat.i.dTLB-loads 0.00 ± 3% +0.0 0.00 ± 11% perf-stat.i.dTLB-store-miss-rate% 119514 ± 5% -51.8% 57642 ± 9% perf-stat.i.dTLB-store-misses 2.067e+10 -66.9% 6.833e+09 perf-stat.i.dTLB-stores 74.98 +0.8 75.82 perf-stat.i.iTLB-load-miss-rate% 1.648e+08 ± 3% -67.2% 54063746 ± 4% perf-stat.i.iTLB-load-misses 54768215 -68.8% 17107737 perf-stat.i.iTLB-loads 1.223e+11 -66.9% 4.052e+10 perf-stat.i.instructions 0.81 -30.7% 0.56 perf-stat.i.ipc 1.05 -52.3% 0.50 ± 2% perf-stat.i.metric.GHz 453.64 -46.1% 244.53 perf-stat.i.metric.K/sec 574.31 -66.9% 189.94 perf-stat.i.metric.M/sec 4984 ± 2% -12.4% 4368 perf-stat.i.minor-faults 4306378 ± 13% +145.4% 10568372 ± 2% perf-stat.i.node-load-misses 267971 ± 20% +205.5% 818656 ± 4% perf-stat.i.node-loads 93.32 +4.7 98.02 perf-stat.i.node-store-miss-rate% 1642200 ± 14% +217.5% 5214268 ± 2% perf-stat.i.node-store-misses 198883 ± 16% -39.3% 120629 ± 9% perf-stat.i.node-stores 4985 ± 2% -12.4% 4369 perf-stat.i.page-faults 21.33 -1.7% 20.96 perf-stat.overall.MPKI 0.62 ± 10% +5.8 6.41 perf-stat.overall.cache-miss-rate% 1.23 +44.0% 1.78 perf-stat.overall.cpi 9426 ± 9% -86.0% 1323 perf-stat.overall.cycles-between-cache-misses 0.00 ± 4% +0.0 0.00 ± 9% perf-stat.overall.dTLB-store-miss-rate% 75.04 +0.9 75.95 perf-stat.overall.iTLB-load-miss-rate% 0.81 -30.5% 0.56 perf-stat.overall.ipc 89.11 +8.6 97.73 perf-stat.overall.node-store-miss-rate% 17633 +8.3% 19103 perf-stat.overall.path-length 2.438e+10 -66.9% 8.061e+09 perf-stat.ps.branch-instructions 2.348e+08 ± 2% -65.6% 80709139 ± 3% perf-stat.ps.branch-misses 16118295 ± 10% +236.5% 54240216 ± 2% perf-stat.ps.cache-misses 2.6e+09 -67.4% 8.464e+08 ± 2% perf-stat.ps.cache-references 3943074 -69.4% 1207953 perf-stat.ps.context-switches 1.505e+11 -52.3% 7.175e+10 ± 2% perf-stat.ps.cpu-cycles 362.72 -38.7% 222.48 perf-stat.ps.cpu-migrations 650701 ±109% -72.7% 177916 ± 8% perf-stat.ps.dTLB-load-misses 3.485e+10 -66.9% 1.155e+10 perf-stat.ps.dTLB-loads 119179 ± 5% -51.8% 57464 ± 9% perf-stat.ps.dTLB-store-misses 2.06e+10 -66.9% 6.81e+09 perf-stat.ps.dTLB-stores 1.642e+08 ± 3% -67.2% 53885104 ± 4% perf-stat.ps.iTLB-load-misses 54583301 -68.8% 17050690 perf-stat.ps.iTLB-loads 1.219e+11 -66.9% 4.039e+10 perf-stat.ps.instructions 4965 ± 2% -12.3% 4352 perf-stat.ps.minor-faults 4293134 ± 13% +145.4% 10534117 ± 2% perf-stat.ps.node-load-misses 267097 ± 20% +205.5% 816047 ± 4% perf-stat.ps.node-loads 1637287 ± 13% +217.4% 5197315 ± 2% perf-stat.ps.node-store-misses 198487 ± 15% -39.3% 120430 ± 9% perf-stat.ps.node-stores 4966 ± 2% -12.3% 4353 perf-stat.ps.page-faults 3.686e+13 -66.8% 1.223e+13 perf-stat.total.instructions 9.05 ± 7% -3.4 5.70 ± 6% perf-profile.calltrace.cycles-pp.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 8.94 ± 7% -3.2 5.69 ± 5% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 8.61 ± 7% -3.2 5.44 ± 6% perf-profile.calltrace.cycles-pp.memcpy_erms.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 5.69 ± 4% -3.0 2.68 ± 7% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle_irq.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 5.85 ± 4% -3.0 2.90 ± 8% perf-profile.calltrace.cycles-pp.intel_idle_irq.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 21.32 ± 6% -2.9 18.43 ± 5% perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 13.45 ± 7% -2.5 10.92 ± 5% perf-profile.calltrace.cycles-pp.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 7.02 ± 7% -2.5 4.51 ± 6% perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 6.53 ± 6% -2.5 4.06 ± 6% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 6.51 ± 6% -2.5 4.05 ± 6% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 5.68 ± 6% -2.1 3.54 ± 6% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg 5.52 ± 6% -2.1 3.45 ± 6% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg 5.48 ± 6% -2.1 3.42 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 11.97 ± 7% -2.0 9.98 ± 5% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc 9.16 ± 7% -1.8 7.37 ± 5% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg 10.42 ± 7% -1.4 9.00 ± 5% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 1.58 ± 6% -1.2 0.35 ± 70% perf-profile.calltrace.cycles-pp.__alloc_pages.kmalloc_large_node.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb 3.49 ± 6% -1.2 2.30 ± 7% perf-profile.calltrace.cycles-pp.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 3.15 ± 6% -1.1 2.06 ± 6% perf-profile.calltrace.cycles-pp._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg 2.86 ± 7% -1.1 1.79 ± 7% perf-profile.calltrace.cycles-pp.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 3.16 ± 7% -1.1 2.11 ± 5% perf-profile.calltrace.cycles-pp.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm 3.00 ± 6% -1.0 1.96 ± 6% perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc 2.97 ± 6% -1.0 1.93 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user 3.26 ± 7% -1.0 2.22 ± 5% perf-profile.calltrace.cycles-pp.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 2.89 ± 7% -1.0 1.87 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter 2.68 ± 6% -0.9 1.74 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data 2.40 ± 7% -0.9 1.46 ± 6% perf-profile.calltrace.cycles-pp._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg 2.49 ± 7% -0.9 1.62 ± 5% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event 2.46 ± 6% -0.9 1.60 ± 5% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready 1.86 ± 6% -0.8 1.10 ± 6% perf-profile.calltrace.cycles-pp.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.81 ± 7% -0.8 1.06 ± 5% perf-profile.calltrace.cycles-pp.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc 1.76 ± 9% -0.7 1.01 ± 6% perf-profile.calltrace.cycles-pp.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 1.82 ± 6% -0.7 1.08 ± 6% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 1.50 ± 6% -0.7 0.76 ± 5% perf-profile.calltrace.cycles-pp.skb_release_data.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.79 ± 6% -0.7 1.06 ± 6% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg 1.61 ± 6% -0.6 1.01 ± 6% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 0.86 ± 7% -0.6 0.26 ±100% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 1.56 ± 6% -0.6 0.98 ± 6% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary 1.56 ± 8% -0.6 0.99 ± 6% perf-profile.calltrace.cycles-pp.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 1.25 ± 7% -0.6 0.68 ± 5% perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user 1.22 ± 7% -0.6 0.66 ± 5% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty 1.19 ± 7% -0.5 0.64 ± 5% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb._sctp_make_chunk 0.90 ± 7% -0.5 0.39 ± 70% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter 0.94 ± 7% -0.5 0.46 ± 45% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram 0.74 ± 6% -0.5 0.27 ±100% perf-profile.calltrace.cycles-pp.sctp_endpoint_lookup_assoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 0.98 ± 8% -0.4 0.57 ± 7% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.05 ± 8% -0.4 0.66 ± 7% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 1.10 ± 7% -0.4 0.72 ± 6% perf-profile.calltrace.cycles-pp.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.46 ± 45% +0.4 0.83 ± 27% perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary 0.00 +0.8 0.84 ± 24% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 0.00 +0.8 0.84 ± 24% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +0.9 0.85 ± 6% perf-profile.calltrace.cycles-pp.page_counter_uncharge.drain_stock.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state 0.00 +0.9 0.87 ± 6% perf-profile.calltrace.cycles-pp.drain_stock.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason 0.00 +1.0 0.98 ± 7% perf-profile.calltrace.cycles-pp.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason.sctp_recvmsg 0.00 +1.2 1.24 ± 5% perf-profile.calltrace.cycles-pp.page_counter_uncharge.drain_stock.refill_stock.__sk_mem_reduce_allocated.sctp_wfree 0.00 +1.3 1.26 ± 5% perf-profile.calltrace.cycles-pp.drain_stock.refill_stock.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state 0.00 +1.3 1.27 ± 19% perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg 0.00 +1.3 1.29 ± 26% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 1.60 ± 10% +1.3 2.92 ± 5% perf-profile.calltrace.cycles-pp.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 0.00 +1.4 1.35 ± 5% perf-profile.calltrace.cycles-pp.refill_stock.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state.consume_skb 0.00 +1.4 1.42 ± 25% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 0.00 +1.6 1.63 ± 5% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data 0.00 +1.7 1.66 ± 19% perf-profile.calltrace.cycles-pp.page_counter_try_charge.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule 10.96 ± 7% +1.7 12.67 ± 5% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 0.00 +1.7 1.72 ± 5% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter 0.00 +1.7 1.73 ± 5% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm 10.84 ± 7% +1.8 12.59 ± 5% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 10.63 ± 7% +1.8 12.42 ± 5% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush 10.58 ± 7% +1.8 12.40 ± 5% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit 10.53 ± 7% +1.8 12.36 ± 5% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit 10.36 ± 7% +1.9 12.25 ± 5% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2 10.26 ± 7% +1.9 12.18 ± 5% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip 10.23 ± 7% +1.9 12.17 ± 5% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq 10.07 ± 7% +2.0 12.08 ± 5% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start 0.00 +2.0 2.02 ± 6% perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc 9.84 ± 7% +2.1 11.95 ± 5% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action 9.82 ± 7% +2.1 11.94 ± 5% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll 9.74 ± 7% +2.1 11.88 ± 5% perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog 3.38 ± 7% +2.1 5.53 ± 5% perf-profile.calltrace.cycles-pp.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 0.00 +2.4 2.38 ± 6% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg 0.00 +2.5 2.54 ± 6% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 0.00 +2.5 2.55 ± 6% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 8.08 ± 7% +2.7 10.74 ± 5% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 7.63 ± 7% +2.8 10.44 ± 5% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 15.25 ± 6% +2.9 18.11 ± 6% perf-profile.calltrace.cycles-pp.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64 15.15 ± 7% +2.9 18.03 ± 5% perf-profile.calltrace.cycles-pp.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 15.20 ± 6% +2.9 18.09 ± 6% perf-profile.calltrace.cycles-pp.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg 15.02 ± 7% +2.9 17.94 ± 6% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 14.96 ± 7% +2.9 17.90 ± 6% perf-profile.calltrace.cycles-pp.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg 11.70 ± 7% +3.0 14.67 ± 6% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock 0.84 ± 10% +3.1 3.94 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 0.96 ± 9% +3.1 4.06 ± 6% perf-profile.calltrace.cycles-pp.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 0.64 ± 11% +3.2 3.82 ± 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg 0.00 +3.9 3.90 ± 5% perf-profile.calltrace.cycles-pp.sctp_eat_data.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 0.00 +4.0 3.98 ± 5% perf-profile.calltrace.cycles-pp.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu 2.90 ± 7% +4.2 7.09 ± 6% perf-profile.calltrace.cycles-pp.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv 1.87 ± 7% +4.5 6.40 ± 6% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 1.43 ± 7% +4.6 6.01 ± 6% perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm 1.78 ± 6% +4.6 6.42 ± 6% perf-profile.calltrace.cycles-pp.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 0.00 +5.1 5.10 ± 5% perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put 0.17 ±141% +5.3 5.42 ± 6% perf-profile.calltrace.cycles-pp.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter 0.00 +5.3 5.35 ± 6% perf-profile.calltrace.cycles-pp.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack 0.00 +5.5 5.51 ± 6% perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason.sctp_recvmsg.inet_recvmsg 0.00 +5.7 5.65 ± 6% perf-profile.calltrace.cycles-pp.skb_release_head_state.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 9.38 ± 6% -3.5 5.93 ± 6% perf-profile.children.cycles-pp.sctp_packet_pack 24.70 ± 6% -3.4 21.34 ± 6% perf-profile.children.cycles-pp.sctp_outq_flush 8.83 ± 6% -3.2 5.60 ± 6% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 8.77 ± 6% -3.2 5.58 ± 6% perf-profile.children.cycles-pp.memcpy_erms 5.88 ± 4% -3.0 2.92 ± 8% perf-profile.children.cycles-pp.intel_idle_irq 21.34 ± 6% -2.8 18.58 ± 6% perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc 7.06 ± 6% -2.5 4.54 ± 7% perf-profile.children.cycles-pp.sctp_datamsg_from_user 13.52 ± 6% -2.5 11.00 ± 6% perf-profile.children.cycles-pp.sctp_primitive_SEND 6.53 ± 6% -2.5 4.06 ± 6% perf-profile.children.cycles-pp.skb_copy_datagram_iter 6.51 ± 6% -2.5 4.05 ± 6% perf-profile.children.cycles-pp.__skb_datagram_iter 5.68 ± 6% -2.1 3.54 ± 6% perf-profile.children.cycles-pp._copy_to_iter 5.52 ± 6% -2.1 3.45 ± 6% perf-profile.children.cycles-pp.copyout 3.33 ± 6% -1.4 1.92 ± 6% perf-profile.children.cycles-pp.__alloc_skb 3.38 ± 6% -1.3 2.07 ± 6% perf-profile.children.cycles-pp.__schedule 3.51 ± 6% -1.2 2.31 ± 7% perf-profile.children.cycles-pp.sctp_user_addto_chunk 2.67 ± 6% -1.2 1.47 ± 6% perf-profile.children.cycles-pp.skb_release_data 2.43 ± 6% -1.1 1.32 ± 6% perf-profile.children.cycles-pp.kmalloc_reserve 3.17 ± 6% -1.1 2.08 ± 7% perf-profile.children.cycles-pp._copy_from_iter 2.38 ± 6% -1.1 1.29 ± 6% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 2.88 ± 7% -1.1 1.80 ± 7% perf-profile.children.cycles-pp.sctp_make_datafrag_empty 3.18 ± 6% -1.1 2.12 ± 6% perf-profile.children.cycles-pp.sctp_data_ready 3.02 ± 6% -1.0 1.98 ± 7% perf-profile.children.cycles-pp.copyin 3.28 ± 6% -1.0 2.25 ± 6% perf-profile.children.cycles-pp.sctp_ulpq_tail_event 2.26 ± 6% -1.0 1.22 ± 5% perf-profile.children.cycles-pp.kmalloc_large_node 2.62 ± 6% -1.0 1.60 ± 7% perf-profile.children.cycles-pp._sctp_make_chunk 2.90 ± 6% -1.0 1.89 ± 6% perf-profile.children.cycles-pp.__wake_up_common_lock 2.69 ± 6% -0.9 1.75 ± 6% perf-profile.children.cycles-pp.__wake_up_common 1.97 ± 6% -0.9 1.04 ± 6% perf-profile.children.cycles-pp.__alloc_pages 2.50 ± 6% -0.9 1.64 ± 6% perf-profile.children.cycles-pp.autoremove_wake_function 2.48 ± 6% -0.9 1.63 ± 6% perf-profile.children.cycles-pp.try_to_wake_up 1.67 ± 5% -0.8 0.86 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist 2.26 ± 7% -0.8 1.48 ± 7% perf-profile.children.cycles-pp.sctp_outq_flush_data 1.86 ± 6% -0.8 1.10 ± 6% perf-profile.children.cycles-pp.schedule_timeout 1.76 ± 8% -0.7 1.02 ± 6% perf-profile.children.cycles-pp.sctp_ulpevent_free 2.08 ± 5% -0.7 1.33 ± 8% perf-profile.children.cycles-pp.kmem_cache_free 1.84 ± 6% -0.7 1.10 ± 6% perf-profile.children.cycles-pp.schedule 1.62 ± 6% -0.6 1.02 ± 6% perf-profile.children.cycles-pp.schedule_idle 1.20 ± 6% -0.6 0.62 ± 7% perf-profile.children.cycles-pp.free_unref_page 1.49 ± 5% -0.5 0.95 ± 6% perf-profile.children.cycles-pp._copy_from_user 1.03 ± 6% -0.5 0.54 ± 5% perf-profile.children.cycles-pp.rmqueue 1.06 ± 6% -0.5 0.58 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.18 ± 5% -0.4 0.74 ± 6% perf-profile.children.cycles-pp.__check_object_size 1.22 ± 4% -0.4 0.79 ± 8% perf-profile.children.cycles-pp.__rhashtable_lookup 0.97 ± 6% -0.4 0.57 ± 7% perf-profile.children.cycles-pp.__slab_free 0.94 ± 7% -0.4 0.54 ± 7% perf-profile.children.cycles-pp.dequeue_task_fair 1.18 ± 6% -0.4 0.78 ± 7% perf-profile.children.cycles-pp.ttwu_do_activate 0.82 ± 6% -0.4 0.43 ± 7% perf-profile.children.cycles-pp._raw_spin_lock 1.11 ± 6% -0.4 0.73 ± 7% perf-profile.children.cycles-pp.sendmsg_copy_msghdr 1.14 ± 6% -0.4 0.76 ± 7% perf-profile.children.cycles-pp.enqueue_task_fair 0.87 ± 7% -0.4 0.50 ± 7% perf-profile.children.cycles-pp.dequeue_entity 0.92 ± 11% -0.4 0.56 ± 6% perf-profile.children.cycles-pp.sctp_outq_select_transport 1.00 ± 5% -0.4 0.65 ± 6% perf-profile.children.cycles-pp.__copy_msghdr_from_user 0.82 ± 12% -0.3 0.49 ± 6% perf-profile.children.cycles-pp.sctp_packet_config 0.84 ± 6% -0.3 0.54 ± 8% perf-profile.children.cycles-pp.import_iovec 0.84 ± 6% -0.3 0.55 ± 7% perf-profile.children.cycles-pp.pick_next_task_fair 0.80 ± 4% -0.3 0.51 ± 9% perf-profile.children.cycles-pp.kfree 0.50 ± 6% -0.3 0.20 ± 7% perf-profile.children.cycles-pp.free_pcppages_bulk 0.80 ± 6% -0.3 0.51 ± 8% perf-profile.children.cycles-pp.__import_iovec 0.83 ± 6% -0.3 0.54 ± 7% perf-profile.children.cycles-pp.enqueue_entity 0.79 ± 7% -0.3 0.51 ± 7% perf-profile.children.cycles-pp.kmem_cache_alloc 0.70 ± 6% -0.3 0.42 ± 8% perf-profile.children.cycles-pp.update_load_avg 0.78 ± 7% -0.3 0.50 ± 10% perf-profile.children.cycles-pp.sctp_hash_cmp 0.73 ± 5% -0.3 0.47 ± 6% perf-profile.children.cycles-pp.__sctp_rcv_lookup 0.69 ± 6% -0.3 0.44 ± 6% perf-profile.children.cycles-pp.check_heap_object 0.47 ± 6% -0.3 0.22 ± 8% perf-profile.children.cycles-pp.__free_pages_ok 0.70 ± 4% -0.2 0.46 ± 6% perf-profile.children.cycles-pp.sctp_addrs_lookup_transport 0.68 ± 6% -0.2 0.43 ± 8% perf-profile.children.cycles-pp.iovec_from_user 0.71 ± 6% -0.2 0.47 ± 8% perf-profile.children.cycles-pp.sctp_chunkify 0.66 ± 5% -0.2 0.42 ± 8% perf-profile.children.cycles-pp.__might_resched 0.60 ± 5% -0.2 0.36 ± 4% perf-profile.children.cycles-pp.set_next_entity 0.74 ± 6% -0.2 0.51 ± 8% perf-profile.children.cycles-pp.sctp_endpoint_lookup_assoc 0.72 ± 6% -0.2 0.50 ± 9% perf-profile.children.cycles-pp.sctp_epaddr_lookup_transport 0.54 ± 6% -0.2 0.32 ± 10% perf-profile.children.cycles-pp.__dev_queue_xmit 0.44 ± 7% -0.2 0.23 ± 6% perf-profile.children.cycles-pp.sctp_inq_pop 0.61 ± 6% -0.2 0.40 ± 7% perf-profile.children.cycles-pp.copy_user_short_string 0.62 ± 13% -0.2 0.42 ± 5% perf-profile.children.cycles-pp.__skb_clone 0.52 ± 5% -0.2 0.32 ± 7% perf-profile.children.cycles-pp.__might_fault 0.46 ± 5% -0.2 0.27 ± 7% perf-profile.children.cycles-pp.simple_copy_to_iter 0.51 ± 7% -0.2 0.33 ± 4% perf-profile.children.cycles-pp.__entry_text_start 0.36 ± 7% -0.2 0.19 ± 8% perf-profile.children.cycles-pp.update_curr 0.56 ± 6% -0.2 0.38 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.37 ± 7% -0.2 0.21 ± 5% perf-profile.children.cycles-pp.__mod_node_page_state 0.32 ± 7% -0.2 0.17 ± 8% perf-profile.children.cycles-pp.__zone_watermark_ok 0.42 ± 10% -0.2 0.27 ± 6% perf-profile.children.cycles-pp.select_task_rq 0.46 ± 17% -0.2 0.31 ± 5% perf-profile.children.cycles-pp.__copy_skb_header 0.46 ± 7% -0.1 0.31 ± 10% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk 0.46 ± 7% -0.1 0.32 ± 4% perf-profile.children.cycles-pp.update_rq_clock 0.43 ± 5% -0.1 0.29 ± 10% perf-profile.children.cycles-pp.sctp_addto_chunk 0.41 ± 7% -0.1 0.27 ± 10% perf-profile.children.cycles-pp.sctp_packet_append_chunk 0.34 ± 6% -0.1 0.20 ± 9% perf-profile.children.cycles-pp.dev_hard_start_xmit 0.46 ± 8% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.40 ± 5% -0.1 0.27 ± 5% perf-profile.children.cycles-pp.sockfd_lookup_light 0.38 ± 6% -0.1 0.25 ± 6% perf-profile.children.cycles-pp.sctp_chunk_free 0.24 ± 14% -0.1 0.10 ± 11% perf-profile.children.cycles-pp.sctp_assoc_rwnd_increase 0.35 ± 6% -0.1 0.21 ± 6% perf-profile.children.cycles-pp.__list_add_valid 0.36 ± 7% -0.1 0.22 ± 10% perf-profile.children.cycles-pp.sctp_gen_sack 0.36 ± 5% -0.1 0.23 ± 9% perf-profile.children.cycles-pp.memset_erms 0.35 ± 8% -0.1 0.22 ± 10% perf-profile.children.cycles-pp.memcg_slab_free_hook 0.32 ± 6% -0.1 0.19 ± 9% perf-profile.children.cycles-pp.loopback_xmit 0.36 ± 5% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.sock_kmalloc 0.36 ± 4% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.__might_sleep 0.33 ± 8% -0.1 0.21 ± 7% perf-profile.children.cycles-pp.__virt_addr_valid 0.28 ± 8% -0.1 0.15 ± 8% perf-profile.children.cycles-pp.free_unref_page_commit 0.34 ± 4% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.free_pcp_prepare 0.33 ± 7% -0.1 0.20 ± 11% perf-profile.children.cycles-pp.sctp_make_sack 0.30 ± 13% -0.1 0.18 ± 9% perf-profile.children.cycles-pp.sctp_v4_xmit 0.34 ± 5% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.__fdget 0.35 ± 6% -0.1 0.23 ± 7% perf-profile.children.cycles-pp.move_addr_to_kernel 0.25 ± 5% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.__free_one_page 0.40 ± 9% -0.1 0.29 ± 6% perf-profile.children.cycles-pp.aa_sk_perm 0.24 ± 6% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.prepare_task_switch 0.32 ± 7% -0.1 0.21 ± 6% perf-profile.children.cycles-pp.sctp_check_transmitted 0.30 ± 6% -0.1 0.19 ± 7% perf-profile.children.cycles-pp.sctp_association_put 0.36 ± 7% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.sock_recvmsg 0.26 ± 12% -0.1 0.16 ± 15% perf-profile.children.cycles-pp.ipv4_dst_check 0.22 ± 9% -0.1 0.11 ± 46% perf-profile.children.cycles-pp.accept_connections 0.31 ± 11% -0.1 0.20 ± 9% perf-profile.children.cycles-pp.select_task_rq_fair 0.22 ± 17% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.dst_release 0.23 ± 6% -0.1 0.12 ± 7% perf-profile.children.cycles-pp.rmqueue_bulk 0.22 ± 6% -0.1 0.11 ± 12% perf-profile.children.cycles-pp.sock_wfree 0.28 ± 6% -0.1 0.18 ± 5% perf-profile.children.cycles-pp.send_sctp_stream_1toMany 0.32 ± 7% -0.1 0.23 ± 9% perf-profile.children.cycles-pp.security_socket_recvmsg 0.30 ± 7% -0.1 0.20 ± 9% perf-profile.children.cycles-pp.skb_set_owner_w 0.28 ± 7% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack 0.27 ± 4% -0.1 0.17 ± 9% perf-profile.children.cycles-pp.sock_kfree_s 0.27 ± 10% -0.1 0.18 ± 11% perf-profile.children.cycles-pp.sctp_transport_hold 0.24 ± 6% -0.1 0.15 ± 5% perf-profile.children.cycles-pp.__switch_to 0.24 ± 7% -0.1 0.15 ± 6% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.21 ± 10% -0.1 0.12 ± 9% perf-profile.children.cycles-pp.recv_sctp_stream_1toMany 0.23 ± 7% -0.1 0.14 ± 7% perf-profile.children.cycles-pp.prepare_to_wait_exclusive 0.22 ± 9% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.accept_connection 0.22 ± 9% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.spawn_child 0.22 ± 9% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.process_requests 0.23 ± 3% -0.1 0.14 ± 7% perf-profile.children.cycles-pp.__kmalloc 0.20 ± 9% -0.1 0.12 ± 10% perf-profile.children.cycles-pp.skb_clone 0.31 ± 10% -0.1 0.22 ± 13% perf-profile.children.cycles-pp.sctp_sched_fcfs_dequeue 0.29 ± 12% -0.1 0.21 ± 5% perf-profile.children.cycles-pp.sctp_transport_put 0.22 ± 8% -0.1 0.14 ± 7% perf-profile.children.cycles-pp.select_idle_sibling 0.22 ± 8% -0.1 0.14 ± 5% perf-profile.children.cycles-pp.__switch_to_asm 0.25 ± 10% -0.1 0.17 ± 11% perf-profile.children.cycles-pp.__sctp_packet_append_chunk 0.23 ± 5% -0.1 0.15 ± 10% perf-profile.children.cycles-pp.__cond_resched 0.20 ± 6% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.available_idle_cpu 0.19 ± 9% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.poll_idle 0.20 ± 6% -0.1 0.13 ± 9% perf-profile.children.cycles-pp.reweight_entity 0.20 ± 7% -0.1 0.13 ± 8% perf-profile.children.cycles-pp.sctp_make_control 0.25 ± 9% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.20 ± 6% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.__free_pages 0.26 ± 8% -0.1 0.19 ± 9% perf-profile.children.cycles-pp.security_socket_sendmsg 0.19 ± 8% -0.1 0.12 ± 13% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.17 ± 9% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.__mod_timer 0.16 ± 5% -0.1 0.09 ± 7% perf-profile.children.cycles-pp.___perf_sw_event 0.21 ± 6% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.sctp_datamsg_put 0.21 ± 7% -0.1 0.14 ± 7% perf-profile.children.cycles-pp.sctp_association_hold 0.18 ± 10% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.sctp_outq_flush_ctrl 0.16 ± 8% -0.1 0.09 ± 14% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.20 ± 4% -0.1 0.13 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc_trace 0.19 ± 5% -0.1 0.13 ± 8% perf-profile.children.cycles-pp.__update_load_avg_se 0.16 ± 5% -0.1 0.10 ± 9% perf-profile.children.cycles-pp.del_timer 0.14 ± 11% -0.1 0.08 ± 4% perf-profile.children.cycles-pp.check_new_pages 0.23 ± 7% -0.1 0.17 ± 10% perf-profile.children.cycles-pp.sctp_sched_dequeue_common 0.10 ± 5% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.finish_task_switch 0.18 ± 7% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.sctp_outq_tail 0.12 ± 4% -0.1 0.06 ± 13% perf-profile.children.cycles-pp.check_stack_object 0.13 ± 8% -0.1 0.08 ± 8% perf-profile.children.cycles-pp.__put_user_nocheck_4 0.16 ± 4% -0.1 0.10 ± 13% perf-profile.children.cycles-pp.__genradix_ptr 0.17 ± 6% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.nr_iowait_cpu 0.16 ± 8% -0.1 0.11 ± 13% perf-profile.children.cycles-pp.sctp_sendmsg_parse 0.13 ± 7% -0.1 0.08 ± 12% perf-profile.children.cycles-pp.lock_timer_base 0.08 ± 12% -0.0 0.02 ± 99% perf-profile.children.cycles-pp.ip_local_out 0.14 ± 7% -0.0 0.09 ± 11% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 0.14 ± 9% -0.0 0.09 ± 7% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.14 ± 9% -0.0 0.09 ± 10% perf-profile.children.cycles-pp.sctp_datamsg_destroy 0.12 ± 20% -0.0 0.07 ± 21% perf-profile.children.cycles-pp.sctp_hash_key 0.11 ± 20% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.ip_rcv 0.11 ± 8% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.sctp_sock_rfree 0.24 ± 7% -0.0 0.19 ± 6% perf-profile.children.cycles-pp.sched_clock_cpu 0.12 ± 6% -0.0 0.08 ± 11% perf-profile.children.cycles-pp.__netif_rx 0.16 ± 8% -0.0 0.11 ± 10% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.31 ± 6% -0.0 0.27 ± 5% perf-profile.children.cycles-pp.sctp_ulpevent_receive_data 0.13 ± 7% -0.0 0.09 ± 5% perf-profile.children.cycles-pp.pick_next_entity 0.12 ± 6% -0.0 0.08 ± 7% perf-profile.children.cycles-pp.__check_heap_object 0.12 ± 8% -0.0 0.08 ± 12% perf-profile.children.cycles-pp.netif_rx_internal 0.08 ± 10% -0.0 0.03 ± 70% perf-profile.children.cycles-pp.__wrgsbase_inactive 0.22 ± 8% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.read_tsc 0.14 ± 8% -0.0 0.10 ± 9% perf-profile.children.cycles-pp.check_preempt_curr 0.10 ± 9% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.rcu_all_qs 0.10 ± 10% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.validate_xmit_skb 0.14 ± 8% -0.0 0.10 ± 9% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.11 ± 6% -0.0 0.07 ± 9% perf-profile.children.cycles-pp.enqueue_to_backlog 0.09 ± 5% -0.0 0.05 ± 45% perf-profile.children.cycles-pp.__netif_receive_skb_core 0.12 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__put_user_nocheck_8 0.12 ± 6% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.sctp_chunk_abandoned 0.12 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.skb_put 0.20 ± 7% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.native_sched_clock 0.09 ± 5% -0.0 0.05 ± 46% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.11 ± 9% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.sctp_inet_skb_msgname 0.10 ± 8% -0.0 0.06 perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.09 ± 7% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.os_xsave 0.12 ± 9% -0.0 0.09 ± 8% perf-profile.children.cycles-pp.resched_curr 0.09 ± 10% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.sctp_ulpevent_init 0.14 ± 10% -0.0 0.11 ± 5% perf-profile.children.cycles-pp.update_cfs_group 0.09 ± 10% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.sctp_ulpq_order 0.08 ± 11% -0.0 0.05 ± 44% perf-profile.children.cycles-pp.perf_tp_event 0.07 ± 5% -0.0 0.04 ± 45% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.10 ± 8% -0.0 0.07 ± 9% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 0.07 ± 10% -0.0 0.04 ± 45% perf-profile.children.cycles-pp.__cgroup_account_cputime 0.08 ± 6% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.sctp_tsnmap_check 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.update_sd_lb_stats 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.find_busiest_group 0.01 ±223% +0.1 0.09 ± 26% perf-profile.children.cycles-pp.load_balance 0.05 ± 46% +0.1 0.13 ± 4% perf-profile.children.cycles-pp.sctp_get_af_specific 0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.native_irq_return_iret 0.00 +0.1 0.09 ± 39% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.09 ± 31% perf-profile.children.cycles-pp.calc_global_load_tick 0.00 +0.1 0.10 ± 37% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.00 +0.1 0.10 ± 31% perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.1 0.10 ± 25% perf-profile.children.cycles-pp.arch_scale_freq_tick 0.03 ±100% +0.1 0.15 ± 35% perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.1 0.14 ± 21% perf-profile.children.cycles-pp.cgroup_rstat_updated 0.17 ± 15% +0.1 0.32 ± 19% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.2 0.16 ± 32% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.24 ± 11% +0.2 0.42 ± 20% perf-profile.children.cycles-pp.update_process_times 0.24 ± 11% +0.2 0.43 ± 20% perf-profile.children.cycles-pp.tick_sched_handle 0.09 ± 11% +0.2 0.29 ± 28% perf-profile.children.cycles-pp.__irq_exit_rcu 0.53 ± 7% +0.2 0.74 ± 16% perf-profile.children.cycles-pp.ktime_get 0.20 ± 10% +0.2 0.42 ± 21% perf-profile.children.cycles-pp.clockevents_program_event 0.06 ± 13% +0.3 0.31 ± 53% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.00 +0.3 0.26 ± 12% perf-profile.children.cycles-pp.propagate_protected_usage 0.28 ± 8% +0.3 0.54 ± 19% perf-profile.children.cycles-pp.tick_sched_timer 0.55 ± 7% +0.3 0.84 ± 26% perf-profile.children.cycles-pp.menu_select 0.29 ± 7% +0.3 0.58 ± 39% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.20 ± 8% +0.3 0.50 ± 44% perf-profile.children.cycles-pp.tick_nohz_next_event 0.32 ± 6% +0.3 0.66 ± 17% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.00 +0.5 0.52 ± 6% perf-profile.children.cycles-pp.mem_cgroup_uncharge_skmem 0.56 ± 7% +0.6 1.16 ± 17% perf-profile.children.cycles-pp.hrtimer_interrupt 0.56 ± 7% +0.6 1.17 ± 17% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 0.00 +1.0 0.96 ± 4% perf-profile.children.cycles-pp.__mod_memcg_state 0.72 ± 6% +1.0 1.69 ± 20% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 0.91 ± 6% +1.1 2.05 ± 16% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 1.62 ± 9% +1.3 2.96 ± 5% perf-profile.children.cycles-pp.sctp_ulpevent_make_rcvmsg 10.76 ± 7% +1.8 12.59 ± 6% perf-profile.children.cycles-pp.__local_bh_enable_ip 10.64 ± 7% +1.9 12.51 ± 6% perf-profile.children.cycles-pp.do_softirq 10.41 ± 7% +2.0 12.37 ± 6% perf-profile.children.cycles-pp.net_rx_action 10.31 ± 7% +2.0 12.30 ± 6% perf-profile.children.cycles-pp.__napi_poll 10.29 ± 7% +2.0 12.30 ± 6% perf-profile.children.cycles-pp.process_backlog 10.66 ± 7% +2.1 12.73 ± 5% perf-profile.children.cycles-pp.__softirqentry_text_start 10.12 ± 7% +2.1 12.20 ± 6% perf-profile.children.cycles-pp.__netif_receive_skb_one_core 0.00 +2.1 2.10 ± 6% perf-profile.children.cycles-pp.page_counter_uncharge 3.40 ± 7% +2.1 5.54 ± 5% perf-profile.children.cycles-pp.sctp_skb_recv_datagram 0.00 +2.1 2.14 ± 5% perf-profile.children.cycles-pp.drain_stock 9.89 ± 7% +2.2 12.07 ± 6% perf-profile.children.cycles-pp.ip_local_deliver_finish 9.87 ± 7% +2.2 12.06 ± 6% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 0.00 +2.2 2.20 ± 5% perf-profile.children.cycles-pp.page_counter_try_charge 9.80 ± 7% +2.2 12.00 ± 6% perf-profile.children.cycles-pp.sctp_rcv 0.00 +2.4 2.36 ± 6% perf-profile.children.cycles-pp.refill_stock 15.40 ± 6% +2.8 18.21 ± 6% perf-profile.children.cycles-pp.sctp_recvmsg 1.10 ± 8% +2.8 3.94 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 15.25 ± 6% +2.9 18.12 ± 6% perf-profile.children.cycles-pp.inet_recvmsg 15.36 ± 6% +2.9 18.28 ± 6% perf-profile.children.cycles-pp.release_sock 1.36 ± 7% +3.0 4.35 ± 6% perf-profile.children.cycles-pp.lock_sock_nested 1.25 ± 8% +3.0 4.24 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_bh 15.10 ± 6% +3.0 18.11 ± 6% perf-profile.children.cycles-pp.__release_sock 15.04 ± 6% +3.0 18.07 ± 6% perf-profile.children.cycles-pp.sctp_backlog_rcv 0.62 ± 6% +3.4 4.02 ± 6% perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2 0.00 +3.4 3.41 ± 6% perf-profile.children.cycles-pp.try_charge_memcg 0.49 ± 6% +3.4 3.94 ± 6% perf-profile.children.cycles-pp.sctp_eat_data 19.74 ± 6% +3.7 23.44 ± 6% perf-profile.children.cycles-pp.sctp_assoc_bh_rcv 3.40 ± 7% +3.9 7.34 ± 6% perf-profile.children.cycles-pp.sctp_chunk_put 0.00 +4.0 4.04 ± 6% perf-profile.children.cycles-pp.mem_cgroup_charge_skmem 2.92 ± 6% +4.2 7.16 ± 6% perf-profile.children.cycles-pp.sctp_outq_sack 0.00 +4.3 4.29 ± 6% perf-profile.children.cycles-pp.__sk_mem_raise_allocated 0.00 +4.3 4.32 ± 6% perf-profile.children.cycles-pp.__sk_mem_schedule 1.99 ± 6% +4.4 6.40 ± 6% perf-profile.children.cycles-pp.consume_skb 1.78 ± 6% +4.6 6.42 ± 6% perf-profile.children.cycles-pp.kfree_skb_reason 0.37 ± 8% +5.0 5.40 ± 6% perf-profile.children.cycles-pp.sctp_wfree 0.87 ± 9% +10.3 11.20 ± 6% perf-profile.children.cycles-pp.skb_release_head_state 0.00 +10.7 10.66 ± 6% perf-profile.children.cycles-pp.__sk_mem_reduce_allocated 8.78 ± 6% -3.2 5.58 ± 6% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 8.70 ± 6% -3.2 5.54 ± 6% perf-profile.self.cycles-pp.memcpy_erms 0.96 ± 6% -0.4 0.57 ± 7% perf-profile.self.cycles-pp.__slab_free 0.83 ± 7% -0.3 0.54 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.70 ± 9% -0.3 0.41 ± 5% perf-profile.self.cycles-pp.sctp_chunk_put 0.83 ± 4% -0.2 0.59 ± 8% perf-profile.self.cycles-pp.kmem_cache_free 0.60 ± 6% -0.2 0.36 ± 8% perf-profile.self.cycles-pp.sctp_recvmsg 0.64 ± 5% -0.2 0.41 ± 7% perf-profile.self.cycles-pp.__might_resched 0.57 ± 6% -0.2 0.36 ± 8% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.38 ± 7% -0.2 0.16 ± 9% perf-profile.self.cycles-pp.sctp_sendmsg_to_asoc 0.62 ± 6% -0.2 0.40 ± 6% perf-profile.self.cycles-pp._raw_spin_lock 0.59 ± 7% -0.2 0.39 ± 5% perf-profile.self.cycles-pp.__schedule 0.58 ± 6% -0.2 0.39 ± 7% perf-profile.self.cycles-pp.copy_user_short_string 0.50 ± 12% -0.2 0.31 ± 8% perf-profile.self.cycles-pp.sctp_packet_config 0.40 ± 8% -0.2 0.23 ± 9% perf-profile.self.cycles-pp.sctp_packet_pack 0.33 ± 8% -0.2 0.16 ± 6% perf-profile.self.cycles-pp.rmqueue 0.45 ± 3% -0.2 0.29 ± 11% perf-profile.self.cycles-pp.kfree 0.45 ± 8% -0.2 0.29 ± 8% perf-profile.self.cycles-pp.sctp_datamsg_from_user 0.32 ± 5% -0.2 0.16 ± 9% perf-profile.self.cycles-pp.get_page_from_freelist 0.37 ± 7% -0.2 0.21 ± 5% perf-profile.self.cycles-pp.__mod_node_page_state 0.52 ± 7% -0.2 0.36 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid 0.32 ± 6% -0.2 0.16 ± 8% perf-profile.self.cycles-pp.__zone_watermark_ok 0.41 ± 7% -0.2 0.26 ± 8% perf-profile.self.cycles-pp.kmem_cache_alloc 0.46 ± 17% -0.1 0.31 ± 4% perf-profile.self.cycles-pp.__copy_skb_header 0.35 ± 7% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.update_load_avg 0.39 ± 5% -0.1 0.25 ± 9% perf-profile.self.cycles-pp.sctp_outq_flush_data 0.37 ± 7% -0.1 0.23 ± 5% perf-profile.self.cycles-pp.update_rq_clock 0.37 ± 6% -0.1 0.24 ± 7% perf-profile.self.cycles-pp.__skb_datagram_iter 0.23 ± 13% -0.1 0.10 ± 12% perf-profile.self.cycles-pp.sctp_assoc_rwnd_increase 0.38 ± 6% -0.1 0.25 ± 10% perf-profile.self.cycles-pp.sctp_sendmsg 0.35 ± 5% -0.1 0.22 ± 9% perf-profile.self.cycles-pp.memset_erms 0.37 ± 5% -0.1 0.24 ± 5% perf-profile.self.cycles-pp.set_next_entity 0.37 ± 6% -0.1 0.24 ± 6% perf-profile.self.cycles-pp.skb_release_data 0.36 ± 13% -0.1 0.23 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.35 ± 5% -0.1 0.22 ± 7% perf-profile.self.cycles-pp.check_heap_object 0.31 ± 6% -0.1 0.18 ± 14% perf-profile.self.cycles-pp.__rhashtable_lookup 0.34 ± 7% -0.1 0.22 ± 10% perf-profile.self.cycles-pp.memcg_slab_free_hook 0.34 ± 5% -0.1 0.22 ± 6% perf-profile.self.cycles-pp.free_pcp_prepare 0.32 ± 8% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__virt_addr_valid 0.25 ± 7% -0.1 0.13 ± 10% perf-profile.self.cycles-pp.free_unref_page_commit 0.39 ± 6% -0.1 0.28 ± 9% perf-profile.self.cycles-pp.enqueue_entity 0.32 ± 6% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.__list_add_valid 0.30 ± 13% -0.1 0.18 ± 11% perf-profile.self.cycles-pp.sctp_v4_xmit 0.32 ± 7% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__alloc_skb 0.33 ± 5% -0.1 0.22 ± 7% perf-profile.self.cycles-pp.__fdget 0.30 ± 6% -0.1 0.19 ± 7% perf-profile.self.cycles-pp.sctp_association_put 0.31 ± 5% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__might_sleep 0.21 ± 18% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.dst_release 0.26 ± 13% -0.1 0.15 ± 13% perf-profile.self.cycles-pp.ipv4_dst_check 0.31 ± 6% -0.1 0.21 ± 7% perf-profile.self.cycles-pp.sctp_skb_recv_datagram 0.26 ± 9% -0.1 0.16 ± 13% perf-profile.self.cycles-pp.sctp_cmd_interpreter 0.21 ± 6% -0.1 0.11 ± 12% perf-profile.self.cycles-pp.sock_wfree 0.23 ± 7% -0.1 0.13 ± 6% perf-profile.self.cycles-pp.__alloc_pages 0.31 ± 6% -0.1 0.21 ± 9% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.24 ± 5% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.__check_object_size 0.17 ± 7% -0.1 0.07 ± 12% perf-profile.self.cycles-pp.update_curr 0.18 ± 36% -0.1 0.08 ± 20% perf-profile.self.cycles-pp.sctp_cmp_addr_exact 0.31 ± 6% -0.1 0.22 ± 9% perf-profile.self.cycles-pp.enqueue_task_fair 0.27 ± 5% -0.1 0.18 ± 7% perf-profile.self.cycles-pp.send_sctp_stream_1toMany 0.27 ± 8% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack 0.29 ± 6% -0.1 0.20 ± 8% perf-profile.self.cycles-pp.skb_set_owner_w 0.26 ± 10% -0.1 0.17 ± 11% perf-profile.self.cycles-pp.sctp_transport_hold 0.21 ± 10% -0.1 0.12 ± 8% perf-profile.self.cycles-pp.recv_sctp_stream_1toMany 0.24 ± 7% -0.1 0.15 ± 6% perf-profile.self.cycles-pp.__switch_to 0.25 ± 12% -0.1 0.17 ± 12% perf-profile.self.cycles-pp.sctp_rcv 0.24 ± 4% -0.1 0.16 ± 4% perf-profile.self.cycles-pp.__entry_text_start 0.28 ± 12% -0.1 0.20 ± 4% perf-profile.self.cycles-pp.sctp_transport_put 0.20 ± 5% -0.1 0.11 ± 6% perf-profile.self.cycles-pp.__wake_up_common 0.22 ± 6% -0.1 0.14 ± 5% perf-profile.self.cycles-pp.__switch_to_asm 0.22 ± 5% -0.1 0.14 ± 9% perf-profile.self.cycles-pp.consume_skb 0.21 ± 7% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.recvmsg 0.20 ± 6% -0.1 0.13 ± 9% perf-profile.self.cycles-pp.reweight_entity 0.21 ± 6% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.sctp_datamsg_put 0.20 ± 4% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.available_idle_cpu 0.20 ± 6% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.__free_pages 0.10 ± 16% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.sctp_ulpq_tail_data 0.16 ± 9% -0.1 0.09 ± 14% perf-profile.self.cycles-pp.____sys_recvmsg 0.28 ± 9% -0.1 0.21 ± 7% perf-profile.self.cycles-pp.aa_sk_perm 0.18 ± 8% -0.1 0.11 ± 13% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.10 ± 9% -0.1 0.03 ±100% perf-profile.self.cycles-pp.process_backlog 0.20 ± 7% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.sctp_association_hold 0.20 ± 7% -0.1 0.13 ± 9% perf-profile.self.cycles-pp.sctp_hash_cmp 0.22 ± 8% -0.1 0.16 ± 4% perf-profile.self.cycles-pp.sctp_wfree 0.18 ± 7% -0.1 0.11 ± 6% perf-profile.self.cycles-pp._copy_from_user 0.17 ± 8% -0.1 0.10 ± 6% perf-profile.self.cycles-pp.poll_idle 0.16 ± 8% -0.1 0.09 ± 14% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.19 ± 6% -0.1 0.13 ± 10% perf-profile.self.cycles-pp.__update_load_avg_se 0.14 ± 7% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.___perf_sw_event 0.16 ± 8% -0.1 0.10 ± 10% perf-profile.self.cycles-pp.try_to_wake_up 0.16 ± 5% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.sctp_packet_append_chunk 0.20 ± 8% -0.1 0.14 ± 5% perf-profile.self.cycles-pp.sendmsg 0.14 ± 12% -0.1 0.08 ± 4% perf-profile.self.cycles-pp.check_new_pages 0.17 ± 11% -0.1 0.11 ± 15% perf-profile.self.cycles-pp.sctp_outq_flush 0.17 ± 8% -0.1 0.11 ± 9% perf-profile.self.cycles-pp.sctp_assoc_bh_rcv 0.17 ± 6% -0.1 0.11 ± 5% perf-profile.self.cycles-pp.nr_iowait_cpu 0.17 ± 7% -0.1 0.12 ± 9% perf-profile.self.cycles-pp.sctp_packet_transmit 0.12 ± 9% -0.1 0.06 ± 14% perf-profile.self.cycles-pp.dequeue_entity 0.15 ± 8% -0.1 0.10 ± 13% perf-profile.self.cycles-pp.____sys_sendmsg 0.15 ± 14% -0.1 0.10 ± 8% perf-profile.self.cycles-pp.sctp_ulpevent_free 0.18 ± 9% -0.1 0.12 ± 10% perf-profile.self.cycles-pp.sctp_do_sm 0.14 ± 4% -0.1 0.09 ± 10% perf-profile.self.cycles-pp.__genradix_ptr 0.13 ± 10% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.__put_user_nocheck_4 0.15 ± 7% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.__copy_msghdr_from_user 0.13 ± 10% -0.1 0.08 ± 12% perf-profile.self.cycles-pp.__import_iovec 0.16 ± 4% -0.0 0.11 ± 11% perf-profile.self.cycles-pp.__skb_clone 0.16 ± 8% -0.0 0.11 ± 13% perf-profile.self.cycles-pp.sctp_sendmsg_parse 0.13 ± 6% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.do_syscall_64 0.17 ± 6% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.do_idle 0.12 ± 17% -0.0 0.07 ± 18% perf-profile.self.cycles-pp.sctp_hash_key 0.14 ± 9% -0.0 0.09 ± 9% perf-profile.self.cycles-pp.sctp_check_transmitted 0.13 ± 5% -0.0 0.08 ± 7% perf-profile.self.cycles-pp.sock_kmalloc 0.11 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.sctp_sock_rfree 0.11 ± 6% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.12 ± 9% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.___sys_recvmsg 0.14 ± 8% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.07 ± 10% -0.0 0.03 ±100% perf-profile.self.cycles-pp._sctp_make_chunk 0.22 ± 8% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.read_tsc 0.12 ± 5% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__put_user_nocheck_8 0.13 ± 8% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.sctp_inq_pop 0.12 ± 6% -0.0 0.08 ± 7% perf-profile.self.cycles-pp.__check_heap_object 0.12 ± 4% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__kmalloc 0.08 ± 8% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.__mod_lruvec_page_state 0.12 ± 8% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.12 ± 7% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.sctp_sf_eat_data_6_2 0.12 ± 6% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.__free_pages_ok 0.11 ± 8% -0.0 0.07 ± 7% perf-profile.self.cycles-pp._copy_to_iter 0.11 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.__ip_queue_xmit 0.08 ± 10% -0.0 0.03 ± 70% perf-profile.self.cycles-pp.__wrgsbase_inactive 0.13 ± 8% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.pick_next_entity 0.11 ± 8% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.select_task_rq 0.11 ± 7% -0.0 0.07 ± 8% perf-profile.self.cycles-pp.sctp_inet_skb_msgname 0.10 ± 9% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.sctp_outq_sack 0.08 ± 5% -0.0 0.05 ± 45% perf-profile.self.cycles-pp.__netif_receive_skb_core 0.20 ± 8% -0.0 0.16 ± 5% perf-profile.self.cycles-pp.native_sched_clock 0.12 ± 9% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook 0.10 ± 7% -0.0 0.06 ± 14% perf-profile.self.cycles-pp.__cond_resched 0.12 ± 4% -0.0 0.08 ± 12% perf-profile.self.cycles-pp.kmem_cache_alloc_trace 0.10 ± 5% -0.0 0.06 ± 15% perf-profile.self.cycles-pp.check_stack_object 0.12 ± 6% -0.0 0.08 ± 7% perf-profile.self.cycles-pp.sctp_outq_tail 0.12 ± 8% -0.0 0.08 ± 12% perf-profile.self.cycles-pp.sctp_chunk_abandoned 0.10 ± 4% -0.0 0.06 ± 14% perf-profile.self.cycles-pp.iovec_from_user 0.09 ± 7% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.os_xsave 0.13 ± 7% -0.0 0.09 ± 11% perf-profile.self.cycles-pp.sctp_sched_dequeue_common 0.07 ± 11% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.move_addr_to_kernel 0.09 ± 10% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.sctp_ulpevent_init 0.08 ± 10% -0.0 0.05 ± 45% perf-profile.self.cycles-pp.free_unref_page 0.10 ± 5% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.__might_fault 0.11 ± 12% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.__sctp_packet_append_chunk 0.07 ± 11% -0.0 0.03 ± 70% perf-profile.self.cycles-pp.sockfd_lookup_light 0.11 ± 7% -0.0 0.08 ± 9% perf-profile.self.cycles-pp.cpuidle_idle_call 0.12 ± 7% -0.0 0.09 ± 10% perf-profile.self.cycles-pp.ip_finish_output2 0.12 ± 8% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.resched_curr 0.10 ± 5% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.skb_put 0.09 ± 7% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.sctp_outq_select_transport 0.08 ± 6% -0.0 0.04 ± 45% perf-profile.self.cycles-pp.__sys_recvmsg 0.08 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.sock_kfree_s 0.10 ± 5% -0.0 0.07 ± 14% perf-profile.self.cycles-pp.net_rx_action 0.09 ± 8% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.sctp_chunkify 0.10 ± 9% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 0.14 ± 10% -0.0 0.11 ± 5% perf-profile.self.cycles-pp.update_cfs_group 0.09 ± 8% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.security_socket_recvmsg 0.08 ± 9% -0.0 0.05 perf-profile.self.cycles-pp.rcu_all_qs 0.07 ± 9% -0.0 0.04 ± 45% perf-profile.self.cycles-pp.sctp_tsnmap_check 0.08 ± 11% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.sctp_addto_chunk 0.08 ± 10% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.kmalloc_large_node 0.10 ± 8% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.lock_sock_nested 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.mem_cgroup_uncharge_skmem 0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.lapic_next_deadline 0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.native_irq_return_iret 0.04 ± 71% +0.1 0.12 ± 7% perf-profile.self.cycles-pp.sctp_get_af_specific 0.00 +0.1 0.09 ± 41% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.09 ± 31% perf-profile.self.cycles-pp.calc_global_load_tick 0.00 +0.1 0.10 ± 31% perf-profile.self.cycles-pp._raw_spin_trylock 0.01 ±223% +0.1 0.10 ± 50% perf-profile.self.cycles-pp.tick_nohz_next_event 0.11 ± 9% +0.1 0.21 ± 10% perf-profile.self.cycles-pp.cpuidle_enter_state 0.00 +0.1 0.10 ± 25% perf-profile.self.cycles-pp.arch_scale_freq_tick 0.00 +0.1 0.13 ± 19% perf-profile.self.cycles-pp.cgroup_rstat_updated 0.00 +0.1 0.14 ± 10% perf-profile.self.cycles-pp.mem_cgroup_charge_skmem 0.00 +0.2 0.21 ± 8% perf-profile.self.cycles-pp.refill_stock 0.00 +0.2 0.25 ± 9% perf-profile.self.cycles-pp.__sk_mem_raise_allocated 0.31 ± 8% +0.3 0.56 ± 23% perf-profile.self.cycles-pp.ktime_get 0.06 ± 13% +0.3 0.31 ± 53% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.00 +0.3 0.26 ± 11% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +0.8 0.82 ± 3% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +1.2 1.19 ± 7% perf-profile.self.cycles-pp.try_charge_memcg 0.00 +2.0 1.96 ± 6% perf-profile.self.cycles-pp.page_counter_uncharge 0.00 +2.1 2.07 ± 5% perf-profile.self.cycles-pp.page_counter_try_charge 1.09 ± 8% +2.8 3.92 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.29 ± 6% +3.5 3.81 ± 6% perf-profile.self.cycles-pp.sctp_eat_data 0.00 +7.8 7.76 ± 6% perf-profile.self.cycles-pp.__sk_mem_reduce_allocated *************************************************************************************************** lkp-cpl-4sp1: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode: cs-localhost/gcc-11/performance/ipv4/x86_64-rhel-8.3/50%/debian-11.1-x86_64-20220510.cgz/300s/10K/lkp-cpl-4sp1/SCTP_STREAM_MANY/netperf/0x7002402 commit: 7c80b038d2 ("net: fix sk_wmem_schedule() and sk_rmem_schedule() errors") 4890b686f4 ("net: keep sk->sk_forward_alloc as small as possible") 7c80b038d23e1f4c 4890b686f4088c90432149bd6de ---------------- --------------------------- %stddev %change %stddev \ | \ 9985 -73.7% 2624 netperf.Throughput_Mbps 718950 -73.7% 188942 netperf.Throughput_total_Mbps 68186 -71.8% 19239 ± 2% netperf.time.involuntary_context_switches 29139 ± 2% -16.8% 24247 netperf.time.minor_page_faults 3137 -68.1% 1000 netperf.time.percent_of_cpu_this_job_got 9264 -67.8% 2979 netperf.time.system_time 199.50 -77.7% 44.44 ± 2% netperf.time.user_time 316769 ± 2% +21.5% 384840 netperf.time.voluntary_context_switches 2.633e+09 -73.7% 6.919e+08 netperf.workload 29358 +42.4% 41821 uptime.idle 2.381e+10 +52.8% 3.639e+10 cpuidle..time 7.884e+08 -65.8% 2.694e+08 cpuidle..usage 56.10 +27.9 83.96 mpstat.cpu.all.idle% 0.80 -0.2 0.61 ± 5% mpstat.cpu.all.irq% 7.50 -4.2 3.29 mpstat.cpu.all.soft% 34.45 -22.6 11.86 mpstat.cpu.all.sys% 1.14 -0.9 0.27 mpstat.cpu.all.usr% 55.83 +49.3% 83.33 vmstat.cpu.id 5727924 ± 3% -43.6% 3229130 vmstat.memory.cache 64.67 ± 2% -65.2% 22.50 ± 2% vmstat.procs.r 4915230 -73.6% 1295498 vmstat.system.cs 298596 -3.1% 289395 vmstat.system.in 92833 ±101% -63.0% 34380 ± 35% numa-meminfo.node1.Inactive 92773 ±101% -62.9% 34380 ± 35% numa-meminfo.node1.Inactive(anon) 1468231 ± 19% -74.4% 376377 ± 16% numa-meminfo.node3.Active 1468231 ± 19% -74.4% 376377 ± 16% numa-meminfo.node3.Active(anon) 925228 ± 17% -95.4% 42887 ± 27% numa-meminfo.node3.Inactive 925228 ± 17% -95.4% 42887 ± 27% numa-meminfo.node3.Inactive(anon) 1162413 ± 17% -85.6% 167082 ± 21% numa-meminfo.node3.Mapped 2348690 ± 14% -83.8% 380889 ± 16% numa-meminfo.node3.Shmem 8.422e+08 -72.9% 2.286e+08 ± 5% numa-numastat.node0.local_node 8.425e+08 -72.8% 2.288e+08 ± 5% numa-numastat.node0.numa_hit 8.344e+08 -73.3% 2.226e+08 ± 5% numa-numastat.node1.local_node 8.341e+08 -73.3% 2.227e+08 ± 5% numa-numastat.node1.numa_hit 8.584e+08 -74.8% 2.163e+08 ± 10% numa-numastat.node2.local_node 8.583e+08 -74.8% 2.164e+08 ± 10% numa-numastat.node2.numa_hit 8.684e+08 -74.1% 2.251e+08 ± 6% numa-numastat.node3.local_node 8.681e+08 -74.1% 2.252e+08 ± 6% numa-numastat.node3.numa_hit 1860369 ± 5% -76.2% 442423 ± 3% meminfo.Active 1860257 ± 5% -76.2% 442314 ± 3% meminfo.Active(anon) 5599254 ± 3% -44.7% 3099170 meminfo.Cached 3542743 ± 6% -71.5% 1010644 meminfo.Committed_AS 1423628 ± 11% -76.4% 336110 meminfo.Inactive 1423448 ± 11% -76.4% 335928 meminfo.Inactive(anon) 1453354 ± 6% -83.5% 240203 ± 3% meminfo.Mapped 7494321 ± 2% -34.5% 4912267 meminfo.Memused 12458 -18.9% 10104 meminfo.PageTables 2948963 ± 7% -84.8% 449291 ± 3% meminfo.Shmem 11063817 -30.5% 7685444 meminfo.max_used_kB 8.425e+08 -72.8% 2.288e+08 ± 5% numa-vmstat.node0.numa_hit 8.422e+08 -72.9% 2.286e+08 ± 5% numa-vmstat.node0.numa_local 23213 ±101% -63.0% 8583 ± 35% numa-vmstat.node1.nr_inactive_anon 23213 ±101% -63.0% 8583 ± 35% numa-vmstat.node1.nr_zone_inactive_anon 8.341e+08 -73.3% 2.227e+08 ± 5% numa-vmstat.node1.numa_hit 8.344e+08 -73.3% 2.226e+08 ± 5% numa-vmstat.node1.numa_local 8.583e+08 -74.8% 2.164e+08 ± 10% numa-vmstat.node2.numa_hit 8.584e+08 -74.8% 2.163e+08 ± 10% numa-vmstat.node2.numa_local 366556 ± 19% -74.2% 94616 ± 16% numa-vmstat.node3.nr_active_anon 231387 ± 17% -95.4% 10658 ± 27% numa-vmstat.node3.nr_inactive_anon 291532 ± 17% -86.8% 38558 ± 21% numa-vmstat.node3.nr_mapped 586771 ± 14% -83.7% 95702 ± 16% numa-vmstat.node3.nr_shmem 366556 ± 19% -74.2% 94616 ± 16% numa-vmstat.node3.nr_zone_active_anon 231387 ± 17% -95.4% 10658 ± 27% numa-vmstat.node3.nr_zone_inactive_anon 8.681e+08 -74.1% 2.252e+08 ± 6% numa-vmstat.node3.numa_hit 8.684e+08 -74.1% 2.251e+08 ± 6% numa-vmstat.node3.numa_local 1495 -61.8% 571.00 turbostat.Avg_MHz 47.16 -29.8 17.36 turbostat.Busy% 3178 +3.7% 3295 turbostat.Bzy_MHz 7.464e+08 -73.4% 1.985e+08 turbostat.C1 13.74 -8.9 4.80 ± 2% turbostat.C1% 34154266 ± 14% +97.4% 67405025 turbostat.C1E 36.80 ± 21% +37.1 73.90 ± 3% turbostat.C1E% 52.81 +56.4% 82.60 turbostat.CPU%c1 58.83 ± 2% -20.1% 47.00 ± 2% turbostat.CoreTmp 0.20 -25.6% 0.15 turbostat.IPC 128.56 ± 3% -128.6 0.00 turbostat.PKG_% 5447540 ± 3% -83.7% 887322 turbostat.POLL 0.13 -0.1 0.03 turbostat.POLL% 58.83 ± 2% -19.8% 47.17 ± 2% turbostat.PkgTmp 591.77 -28.1% 425.61 turbostat.PkgWatt 8.17 +3.5% 8.46 turbostat.RAMWatt 465173 ± 5% -76.3% 110436 ± 3% proc-vmstat.nr_active_anon 83691 -1.7% 82260 proc-vmstat.nr_anon_pages 3086038 +2.1% 3150528 proc-vmstat.nr_dirty_background_threshold 6179622 +2.1% 6308761 proc-vmstat.nr_dirty_threshold 1399831 ± 3% -44.7% 774653 proc-vmstat.nr_file_pages 31038779 +2.1% 31684629 proc-vmstat.nr_free_pages 355768 ± 11% -76.4% 83981 proc-vmstat.nr_inactive_anon 363110 ± 6% -83.4% 60381 ± 3% proc-vmstat.nr_mapped 3114 -18.9% 2526 proc-vmstat.nr_page_table_pages 737257 ± 7% -84.8% 112182 ± 3% proc-vmstat.nr_shmem 33546 -3.9% 32233 proc-vmstat.nr_slab_reclaimable 465173 ± 5% -76.3% 110436 ± 3% proc-vmstat.nr_zone_active_anon 355768 ± 11% -76.4% 83981 proc-vmstat.nr_zone_inactive_anon 125868 ± 15% -29.5% 88747 ± 12% proc-vmstat.numa_hint_faults_local 3.403e+09 -73.8% 8.93e+08 proc-vmstat.numa_hit 3.403e+09 -73.8% 8.927e+08 proc-vmstat.numa_local 1698265 ± 8% -91.3% 146940 ± 2% proc-vmstat.pgactivate 9.031e+09 -73.7% 2.375e+09 proc-vmstat.pgalloc_normal 1809374 ± 2% -11.5% 1601059 ± 2% proc-vmstat.pgfault 9.031e+09 -73.7% 2.375e+09 proc-vmstat.pgfree 40961 +1.3% 41503 proc-vmstat.pgreuse 121388 ± 29% -96.2% 4632 ± 47% sched_debug.cfs_rq:/.MIN_vruntime.avg 3776647 ± 10% -91.9% 305894 ± 40% sched_debug.cfs_rq:/.MIN_vruntime.max 623786 ± 18% -94.3% 35468 ± 44% sched_debug.cfs_rq:/.MIN_vruntime.stddev 0.40 ± 7% -58.4% 0.17 ± 7% sched_debug.cfs_rq:/.h_nr_running.avg 0.45 -19.1% 0.37 ± 3% sched_debug.cfs_rq:/.h_nr_running.stddev 121388 ± 29% -96.2% 4632 ± 47% sched_debug.cfs_rq:/.max_vruntime.avg 3776647 ± 10% -91.9% 305894 ± 40% sched_debug.cfs_rq:/.max_vruntime.max 623786 ± 18% -94.3% 35468 ± 44% sched_debug.cfs_rq:/.max_vruntime.stddev 3455794 ± 6% -89.2% 374393 ± 9% sched_debug.cfs_rq:/.min_vruntime.avg 4153720 ± 7% -88.1% 494762 ± 7% sched_debug.cfs_rq:/.min_vruntime.max 2710531 ± 7% -91.1% 240412 ± 10% sched_debug.cfs_rq:/.min_vruntime.min 368488 ± 8% -85.9% 51911 ± 13% sched_debug.cfs_rq:/.min_vruntime.stddev 0.40 ± 7% -58.4% 0.17 ± 7% sched_debug.cfs_rq:/.nr_running.avg 0.45 -19.2% 0.37 ± 3% sched_debug.cfs_rq:/.nr_running.stddev 386.20 ± 3% -56.3% 168.94 sched_debug.cfs_rq:/.runnable_avg.avg 1215 ± 8% -18.7% 987.82 ± 4% sched_debug.cfs_rq:/.runnable_avg.max 340.61 -31.1% 234.69 ± 2% sched_debug.cfs_rq:/.runnable_avg.stddev 429174 ± 24% -103.8% -16476 sched_debug.cfs_rq:/.spread0.avg 1127012 ± 15% -90.8% 103881 ± 28% sched_debug.cfs_rq:/.spread0.max -315952 -52.4% -150458 sched_debug.cfs_rq:/.spread0.min 368407 ± 8% -85.9% 51908 ± 13% sched_debug.cfs_rq:/.spread0.stddev 385.96 ± 3% -56.3% 168.81 sched_debug.cfs_rq:/.util_avg.avg 1215 ± 8% -18.7% 987.79 ± 4% sched_debug.cfs_rq:/.util_avg.max 340.53 -31.1% 234.60 ± 2% sched_debug.cfs_rq:/.util_avg.stddev 274.31 ± 7% -74.9% 68.97 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg 981.12 -10.6% 877.51 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.max 337.06 -47.8% 176.03 ± 3% sched_debug.cfs_rq:/.util_est_enqueued.stddev 457832 ± 5% +41.2% 646422 ± 5% sched_debug.cpu.avg_idle.avg 1762 ± 7% -42.8% 1009 ± 7% sched_debug.cpu.clock_task.stddev 2358 ± 5% -61.0% 920.92 ± 2% sched_debug.cpu.curr->pid.avg 2793 -22.1% 2176 ± 2% sched_debug.cpu.curr->pid.stddev 557670 ± 6% +8.4% 604409 ± 7% sched_debug.cpu.max_idle_balance_cost.max 0.00 ± 2% -27.5% 0.00 ± 5% sched_debug.cpu.next_balance.stddev 0.39 ± 5% -61.1% 0.15 ± 3% sched_debug.cpu.nr_running.avg 0.45 -22.2% 0.35 sched_debug.cpu.nr_running.stddev 5005510 ± 7% -75.6% 1221805 ± 10% sched_debug.cpu.nr_switches.avg 6928957 ± 8% -70.7% 2030568 ± 9% sched_debug.cpu.nr_switches.max 3447354 ± 12% -84.3% 541402 ± 17% sched_debug.cpu.nr_switches.min 629520 ± 7% -55.8% 278525 ± 6% sched_debug.cpu.nr_switches.stddev 3.074e+10 -71.6% 8.745e+09 perf-stat.i.branch-instructions 2.971e+08 ± 2% -70.3% 88205513 ± 4% perf-stat.i.branch-misses 1.05 ± 3% +5.6 6.66 perf-stat.i.cache-miss-rate% 30824055 ± 3% +98.8% 61267408 perf-stat.i.cache-misses 3.297e+09 -71.8% 9.296e+08 perf-stat.i.cache-references 4957450 -73.6% 1308421 perf-stat.i.context-switches 1.43 +33.1% 1.90 perf-stat.i.cpi 2.196e+11 -62.4% 8.259e+10 perf-stat.i.cpu-cycles 929.67 -64.3% 331.55 perf-stat.i.cpu-migrations 7494 ± 4% -82.0% 1351 perf-stat.i.cycles-between-cache-misses 0.01 ± 26% -0.0 0.00 perf-stat.i.dTLB-load-miss-rate% 2694006 ± 27% -90.1% 265691 perf-stat.i.dTLB-load-misses 4.398e+10 -71.5% 1.252e+10 perf-stat.i.dTLB-loads 0.00 ± 7% -0.0 0.00 ± 5% perf-stat.i.dTLB-store-miss-rate% 967059 ± 8% -84.3% 151835 ± 6% perf-stat.i.dTLB-store-misses 2.599e+10 -71.6% 7.377e+09 perf-stat.i.dTLB-stores 63.87 +10.9 74.76 perf-stat.i.iTLB-load-miss-rate% 1.972e+08 -70.5% 58088811 ± 5% perf-stat.i.iTLB-load-misses 1.126e+08 -82.7% 19440392 perf-stat.i.iTLB-loads 1.538e+11 -71.5% 4.38e+10 perf-stat.i.instructions 0.71 -24.8% 0.53 perf-stat.i.ipc 1.53 -62.4% 0.57 perf-stat.i.metric.GHz 909.37 -69.9% 273.61 perf-stat.i.metric.K/sec 722.30 -71.6% 205.33 perf-stat.i.metric.M/sec 5562 ± 3% -12.4% 4874 ± 2% perf-stat.i.minor-faults 8844727 ± 5% +30.4% 11534796 perf-stat.i.node-load-misses 623949 ± 11% +54.9% 966213 ± 2% perf-stat.i.node-loads 91.43 +5.4 96.84 perf-stat.i.node-store-miss-rate% 3461624 ± 2% +66.0% 5746681 perf-stat.i.node-store-misses 410920 ± 7% -49.7% 206502 ± 3% perf-stat.i.node-stores 5563 ± 3% -12.4% 4876 ± 2% perf-stat.i.page-faults 21.44 -1.0% 21.22 perf-stat.overall.MPKI 0.93 ± 4% +5.7 6.59 perf-stat.overall.cache-miss-rate% 1.43 +32.0% 1.89 perf-stat.overall.cpi 7136 ± 4% -81.1% 1348 perf-stat.overall.cycles-between-cache-misses 0.01 ± 27% -0.0 0.00 perf-stat.overall.dTLB-load-miss-rate% 0.00 ± 7% -0.0 0.00 ± 5% perf-stat.overall.dTLB-store-miss-rate% 63.66 +11.2 74.89 perf-stat.overall.iTLB-load-miss-rate% 0.70 -24.3% 0.53 perf-stat.overall.ipc 89.40 +7.1 96.53 perf-stat.overall.node-store-miss-rate% 17593 +8.6% 19108 perf-stat.overall.path-length 3.063e+10 -71.5% 8.716e+09 perf-stat.ps.branch-instructions 2.961e+08 ± 2% -70.3% 87907848 ± 4% perf-stat.ps.branch-misses 30717141 ± 3% +98.8% 61062871 perf-stat.ps.cache-misses 3.286e+09 -71.8% 9.265e+08 perf-stat.ps.cache-references 4940513 -73.6% 1304046 perf-stat.ps.context-switches 2.189e+11 -62.4% 8.231e+10 perf-stat.ps.cpu-cycles 926.60 -64.3% 330.61 perf-stat.ps.cpu-migrations 2684405 ± 27% -90.1% 264976 perf-stat.ps.dTLB-load-misses 4.383e+10 -71.5% 1.248e+10 perf-stat.ps.dTLB-loads 963689 ± 8% -84.3% 151363 ± 6% perf-stat.ps.dTLB-store-misses 2.591e+10 -71.6% 7.352e+09 perf-stat.ps.dTLB-stores 1.965e+08 -70.5% 57894987 ± 5% perf-stat.ps.iTLB-load-misses 1.122e+08 -82.7% 19375491 perf-stat.ps.iTLB-loads 1.532e+11 -71.5% 4.366e+10 perf-stat.ps.instructions 5536 ± 3% -12.3% 4857 ± 2% perf-stat.ps.minor-faults 8813664 ± 5% +30.4% 11496729 perf-stat.ps.node-load-misses 622201 ± 11% +54.8% 963024 ± 2% perf-stat.ps.node-loads 3450020 ± 2% +66.0% 5727738 perf-stat.ps.node-store-misses 409584 ± 8% -49.7% 206027 ± 3% perf-stat.ps.node-stores 5537 ± 3% -12.3% 4858 ± 2% perf-stat.ps.page-faults 4.632e+13 -71.5% 1.322e+13 perf-stat.total.instructions 9.54 ± 4% -6.1 3.40 ± 5% perf-profile.calltrace.cycles-pp.intel_idle_irq.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 9.17 ± 5% -6.1 3.05 ± 6% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle_irq.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 8.84 ± 4% -3.2 5.62 ± 4% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 8.63 ± 4% -3.1 5.53 ± 4% perf-profile.calltrace.cycles-pp.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 8.18 ± 4% -2.9 5.29 ± 4% perf-profile.calltrace.cycles-pp.memcpy_erms.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 6.49 ± 4% -2.5 3.99 ± 4% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 6.47 ± 3% -2.5 3.98 ± 4% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 21.33 ± 3% -2.5 18.86 ± 4% perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 13.50 ± 3% -2.5 11.04 ± 4% perf-profile.calltrace.cycles-pp.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 6.89 ± 3% -2.4 4.50 ± 4% perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 5.63 ± 3% -2.1 3.49 ± 4% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg 5.46 ± 3% -2.1 3.40 ± 4% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg 5.42 ± 3% -2.0 3.38 ± 4% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 11.96 ± 3% -1.9 10.08 ± 4% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc 9.08 ± 4% -1.6 7.48 ± 4% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg 1.76 ± 4% -1.3 0.43 ± 44% perf-profile.calltrace.cycles-pp.__alloc_pages.kmalloc_large_node.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb 10.30 ± 4% -1.2 9.11 ± 4% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 3.42 ± 3% -1.1 2.30 ± 4% perf-profile.calltrace.cycles-pp.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 2.85 ± 3% -1.1 1.78 ± 4% perf-profile.calltrace.cycles-pp.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 1.79 ± 4% -1.0 0.75 ± 4% perf-profile.calltrace.cycles-pp.skb_release_data.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 3.08 ± 4% -1.0 2.07 ± 4% perf-profile.calltrace.cycles-pp.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm 3.08 ± 3% -1.0 2.08 ± 4% perf-profile.calltrace.cycles-pp._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg 3.20 ± 4% -1.0 2.20 ± 4% perf-profile.calltrace.cycles-pp.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 2.82 ± 4% -1.0 1.84 ± 4% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data.sctp_cmd_interpreter 2.94 ± 3% -1.0 1.97 ± 4% perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user.sctp_sendmsg_to_asoc 2.42 ± 3% -1.0 1.46 ± 4% perf-profile.calltrace.cycles-pp._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg 2.90 ± 3% -0.9 1.95 ± 4% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter.sctp_user_addto_chunk.sctp_datamsg_from_user 11.68 ± 3% -0.9 10.75 ± 4% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 2.63 ± 4% -0.9 1.70 ± 4% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event.sctp_ulpq_tail_data 2.46 ± 4% -0.9 1.59 ± 4% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready.sctp_ulpq_tail_event 2.44 ± 4% -0.9 1.58 ± 4% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sctp_data_ready 11.49 ± 3% -0.8 10.64 ± 4% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv 1.82 ± 3% -0.8 1.02 ± 4% perf-profile.calltrace.cycles-pp.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 1.86 ± 4% -0.8 1.08 ± 4% perf-profile.calltrace.cycles-pp.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc 1.88 ± 3% -0.8 1.10 ± 5% perf-profile.calltrace.cycles-pp.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.84 ± 3% -0.8 1.09 ± 5% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 1.81 ± 3% -0.7 1.07 ± 5% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg 1.68 ± 4% -0.7 0.98 ± 6% perf-profile.calltrace.cycles-pp.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 1.65 ± 4% -0.7 0.99 ± 3% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 1.61 ± 4% -0.6 0.96 ± 3% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary 1.30 ± 3% -0.6 0.69 ± 3% perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user 1.27 ± 3% -0.6 0.67 ± 3% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb._sctp_make_chunk.sctp_make_datafrag_empty 1.24 ± 3% -0.6 0.65 ± 3% perf-profile.calltrace.cycles-pp.kmalloc_large_node.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb._sctp_make_chunk 0.97 ± 3% -0.5 0.46 ± 44% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram 1.02 ± 3% -0.5 0.57 ± 3% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.10 ± 4% -0.4 0.67 ± 5% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 0.92 ± 3% -0.4 0.56 ± 6% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter 1.04 ± 4% -0.3 0.71 ± 4% perf-profile.calltrace.cycles-pp.sendmsg_copy_msghdr.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.17 ±141% +0.5 0.70 ± 15% perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary 0.00 +0.9 0.91 ± 5% perf-profile.calltrace.cycles-pp.page_counter_uncharge.drain_stock.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state 0.00 +0.9 0.93 ± 5% perf-profile.calltrace.cycles-pp.drain_stock.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason 0.00 +1.0 0.95 ± 15% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 0.00 +1.0 1.03 ± 5% perf-profile.calltrace.cycles-pp.refill_stock.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason.sctp_recvmsg 0.00 +1.0 1.04 ± 14% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 11.57 ± 3% +1.3 12.82 ± 4% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg 0.00 +1.3 1.33 ± 4% perf-profile.calltrace.cycles-pp.page_counter_uncharge.drain_stock.refill_stock.__sk_mem_reduce_allocated.sctp_wfree 0.00 +1.4 1.36 ± 4% perf-profile.calltrace.cycles-pp.drain_stock.refill_stock.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state 1.67 ± 3% +1.4 3.04 ± 4% perf-profile.calltrace.cycles-pp.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 11.39 ± 3% +1.4 12.77 ± 4% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock 0.00 +1.4 1.45 ± 4% perf-profile.calltrace.cycles-pp.refill_stock.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state.consume_skb 0.00 +1.5 1.46 ± 5% perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg 0.00 +1.7 1.74 ± 4% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data 0.00 +1.8 1.83 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter 0.00 +1.8 1.84 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.sctp_ulpevent_make_rcvmsg.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm 0.00 +2.0 1.97 ± 5% perf-profile.calltrace.cycles-pp.page_counter_try_charge.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule 18.94 ± 3% +2.1 21.02 ± 4% perf-profile.calltrace.cycles-pp.recvmsg 0.00 +2.1 2.14 ± 4% perf-profile.calltrace.cycles-pp.try_charge_memcg.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc 10.88 ± 4% +2.2 13.11 ± 4% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 10.74 ± 4% +2.3 13.04 ± 4% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 18.22 ± 3% +2.3 20.55 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.recvmsg 10.51 ± 4% +2.4 12.88 ± 4% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush 10.47 ± 4% +2.4 12.84 ± 4% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit 18.08 ± 3% +2.4 20.46 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 10.42 ± 4% +2.4 12.81 ± 4% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit 10.25 ± 4% +2.4 12.70 ± 4% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2 17.84 ± 3% +2.5 20.32 ± 4% perf-profile.calltrace.cycles-pp.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 10.15 ± 4% +2.5 12.64 ± 4% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip 10.13 ± 4% +2.5 12.63 ± 4% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq 0.00 +2.5 2.50 ± 4% perf-profile.calltrace.cycles-pp.mem_cgroup_charge_skmem.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg 3.59 ± 3% +2.5 6.11 ± 5% perf-profile.calltrace.cycles-pp.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 9.97 ± 4% +2.6 12.54 ± 4% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start 17.56 ± 3% +2.6 20.14 ± 4% perf-profile.calltrace.cycles-pp.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 0.00 +2.7 2.66 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_raise_allocated.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 0.00 +2.7 2.68 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_schedule.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 9.70 ± 4% +2.7 12.40 ± 4% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action 9.68 ± 4% +2.7 12.39 ± 4% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll 9.61 ± 4% +2.7 12.33 ± 4% perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog 16.65 ± 3% +2.9 19.58 ± 4% perf-profile.calltrace.cycles-pp.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.06 ± 4% +3.1 11.19 ± 4% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 15.88 ± 3% +3.2 19.12 ± 4% perf-profile.calltrace.cycles-pp.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64 15.83 ± 3% +3.3 19.09 ± 4% perf-profile.calltrace.cycles-pp.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg 7.62 ± 3% +3.3 10.90 ± 4% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 1.14 ± 3% +3.5 4.62 ± 5% perf-profile.calltrace.cycles-pp.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 1.02 ± 3% +3.5 4.51 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 0.83 ± 4% +3.6 4.38 ± 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg 15.16 ± 3% +3.6 18.74 ± 5% perf-profile.calltrace.cycles-pp.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 15.04 ± 3% +3.6 18.66 ± 5% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 11.66 ± 3% +3.6 15.29 ± 5% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock 14.98 ± 3% +3.6 18.62 ± 5% perf-profile.calltrace.cycles-pp.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg 0.00 +4.2 4.24 ± 4% perf-profile.calltrace.cycles-pp.sctp_eat_data.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 0.00 +4.3 4.33 ± 4% perf-profile.calltrace.cycles-pp.sctp_sf_eat_data_6_2.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu 2.88 ± 3% +4.7 7.54 ± 4% perf-profile.calltrace.cycles-pp.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv 23.81 ± 12% +4.8 28.57 ± 11% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 23.81 ± 12% +4.8 28.58 ± 11% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 2.11 ± 4% +4.8 6.89 ± 4% perf-profile.calltrace.cycles-pp.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 1.84 ± 3% +5.0 6.86 ± 4% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 1.42 ± 3% +5.0 6.47 ± 4% perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm 0.00 +5.5 5.53 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put 0.00 +5.8 5.80 ± 4% perf-profile.calltrace.cycles-pp.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack 0.00 +5.9 5.87 ± 4% perf-profile.calltrace.cycles-pp.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter 0.00 +6.0 5.99 ± 4% perf-profile.calltrace.cycles-pp.__sk_mem_reduce_allocated.skb_release_head_state.kfree_skb_reason.sctp_recvmsg.inet_recvmsg 0.00 +6.1 6.13 ± 4% perf-profile.calltrace.cycles-pp.skb_release_head_state.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 9.61 ± 5% -6.2 3.42 ± 5% perf-profile.children.cycles-pp.intel_idle_irq 9.16 ± 3% -3.3 5.87 ± 5% perf-profile.children.cycles-pp.sctp_packet_pack 8.74 ± 3% -3.1 5.61 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 25.01 ± 3% -3.0 21.98 ± 4% perf-profile.children.cycles-pp.sctp_outq_flush 8.52 ± 3% -3.0 5.50 ± 5% perf-profile.children.cycles-pp.memcpy_erms 6.49 ± 3% -2.5 3.99 ± 4% perf-profile.children.cycles-pp.skb_copy_datagram_iter 6.47 ± 3% -2.5 3.98 ± 4% perf-profile.children.cycles-pp.__skb_datagram_iter 7.07 ± 3% -2.5 4.60 ± 4% perf-profile.children.cycles-pp.sctp_datamsg_from_user 21.61 ± 3% -2.4 19.19 ± 4% perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc 13.72 ± 3% -2.4 11.31 ± 5% perf-profile.children.cycles-pp.sctp_primitive_SEND 5.63 ± 3% -2.1 3.50 ± 4% perf-profile.children.cycles-pp._copy_to_iter 5.46 ± 3% -2.1 3.40 ± 4% perf-profile.children.cycles-pp.copyout 22.37 ± 3% -2.0 20.39 ± 4% perf-profile.children.cycles-pp.sctp_packet_transmit 3.59 ± 3% -1.6 1.96 ± 4% perf-profile.children.cycles-pp.__alloc_skb 2.98 ± 3% -1.5 1.49 ± 5% perf-profile.children.cycles-pp.skb_release_data 3.46 ± 4% -1.4 2.06 ± 4% perf-profile.children.cycles-pp.__schedule 2.66 ± 3% -1.3 1.35 ± 4% perf-profile.children.cycles-pp.kmalloc_reserve 2.62 ± 3% -1.3 1.32 ± 4% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 2.50 ± 3% -1.3 1.24 ± 4% perf-profile.children.cycles-pp.kmalloc_large_node 3.51 ± 3% -1.2 2.36 ± 4% perf-profile.children.cycles-pp.sctp_user_addto_chunk 2.20 ± 3% -1.1 1.07 ± 4% perf-profile.children.cycles-pp.__alloc_pages 2.93 ± 3% -1.1 1.82 ± 5% perf-profile.children.cycles-pp.sctp_make_datafrag_empty 2.70 ± 3% -1.1 1.62 ± 4% perf-profile.children.cycles-pp._sctp_make_chunk 3.17 ± 3% -1.0 2.12 ± 5% perf-profile.children.cycles-pp.sctp_data_ready 3.16 ± 3% -1.0 2.13 ± 4% perf-profile.children.cycles-pp._copy_from_iter 3.28 ± 3% -1.0 2.26 ± 5% perf-profile.children.cycles-pp.sctp_ulpq_tail_event 2.90 ± 3% -1.0 1.88 ± 5% perf-profile.children.cycles-pp.__wake_up_common_lock 1.89 ± 4% -1.0 0.88 ± 4% perf-profile.children.cycles-pp.get_page_from_freelist 3.02 ± 3% -1.0 2.02 ± 4% perf-profile.children.cycles-pp.copyin 2.47 ± 3% -1.0 1.49 ± 7% perf-profile.children.cycles-pp.sctp_outq_flush_data 2.70 ± 3% -0.9 1.75 ± 5% perf-profile.children.cycles-pp.__wake_up_common 2.53 ± 3% -0.9 1.64 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function 2.51 ± 3% -0.9 1.63 ± 4% perf-profile.children.cycles-pp.try_to_wake_up 1.83 ± 3% -0.8 1.02 ± 4% perf-profile.children.cycles-pp.sctp_ulpevent_free 2.10 ± 3% -0.8 1.32 ± 6% perf-profile.children.cycles-pp.kmem_cache_free 1.89 ± 3% -0.8 1.12 ± 5% perf-profile.children.cycles-pp.schedule_timeout 1.39 ± 4% -0.8 0.63 ± 5% perf-profile.children.cycles-pp.free_unref_page 1.86 ± 3% -0.7 1.11 ± 4% perf-profile.children.cycles-pp.schedule 1.25 ± 4% -0.7 0.56 ± 5% perf-profile.children.cycles-pp.rmqueue 1.28 ± 4% -0.7 0.60 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.66 ± 4% -0.7 1.00 ± 4% perf-profile.children.cycles-pp.schedule_idle 0.98 ± 4% -0.6 0.43 ± 3% perf-profile.children.cycles-pp._raw_spin_lock 1.08 ± 4% -0.5 0.54 ± 4% perf-profile.children.cycles-pp.sctp_outq_select_transport 1.45 ± 4% -0.5 0.94 ± 4% perf-profile.children.cycles-pp._copy_from_user 0.98 ± 4% -0.5 0.48 ± 5% perf-profile.children.cycles-pp.sctp_packet_config 1.25 ± 12% -0.5 0.78 ± 5% perf-profile.children.cycles-pp.__rhashtable_lookup 1.21 ± 3% -0.5 0.73 ± 4% perf-profile.children.cycles-pp.__check_object_size 0.98 ± 3% -0.4 0.53 ± 7% perf-profile.children.cycles-pp.dequeue_task_fair 0.64 ± 5% -0.4 0.20 ± 5% perf-profile.children.cycles-pp.free_pcppages_bulk 1.18 ± 4% -0.4 0.78 ± 5% perf-profile.children.cycles-pp.ttwu_do_activate 0.62 ± 4% -0.4 0.22 ± 4% perf-profile.children.cycles-pp.__free_pages_ok 0.90 ± 3% -0.4 0.50 ± 6% perf-profile.children.cycles-pp.dequeue_entity 1.14 ± 3% -0.4 0.75 ± 4% perf-profile.children.cycles-pp.enqueue_task_fair 0.95 ± 4% -0.4 0.57 ± 6% perf-profile.children.cycles-pp.__slab_free 0.76 ± 3% -0.3 0.42 ± 3% perf-profile.children.cycles-pp.__skb_clone 1.07 ± 4% -0.3 0.73 ± 5% perf-profile.children.cycles-pp.sendmsg_copy_msghdr 0.76 ± 3% -0.3 0.42 ± 5% perf-profile.children.cycles-pp.update_load_avg 0.98 ± 4% -0.3 0.65 ± 3% perf-profile.children.cycles-pp.__copy_msghdr_from_user 0.81 ± 14% -0.3 0.49 ± 6% perf-profile.children.cycles-pp.sctp_hash_cmp 0.88 ± 4% -0.3 0.56 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair 0.84 ± 3% -0.3 0.54 ± 5% perf-profile.children.cycles-pp.enqueue_entity 0.82 ± 3% -0.3 0.53 ± 5% perf-profile.children.cycles-pp.import_iovec 0.81 ± 2% -0.3 0.52 ± 6% perf-profile.children.cycles-pp.kfree 0.59 ± 3% -0.3 0.30 ± 4% perf-profile.children.cycles-pp.__copy_skb_header 0.78 ± 3% -0.3 0.51 ± 6% perf-profile.children.cycles-pp.__import_iovec 0.62 ± 5% -0.3 0.35 ± 5% perf-profile.children.cycles-pp.set_next_entity 0.76 ± 12% -0.3 0.50 ± 5% perf-profile.children.cycles-pp.sctp_endpoint_lookup_assoc 0.69 ± 4% -0.3 0.43 ± 5% perf-profile.children.cycles-pp.check_heap_object 0.77 ± 3% -0.3 0.52 ± 5% perf-profile.children.cycles-pp.kmem_cache_alloc 0.74 ± 12% -0.3 0.49 ± 5% perf-profile.children.cycles-pp.sctp_epaddr_lookup_transport 0.72 ± 10% -0.2 0.48 ± 6% perf-profile.children.cycles-pp.__sctp_rcv_lookup 0.66 ± 4% -0.2 0.42 ± 5% perf-profile.children.cycles-pp.__might_resched 0.70 ± 10% -0.2 0.46 ± 7% perf-profile.children.cycles-pp.sctp_addrs_lookup_transport 0.65 ± 2% -0.2 0.42 ± 5% perf-profile.children.cycles-pp.iovec_from_user 0.50 ± 4% -0.2 0.26 ± 4% perf-profile.children.cycles-pp.simple_copy_to_iter 0.46 ± 3% -0.2 0.23 ± 8% perf-profile.children.cycles-pp.sctp_inq_pop 0.41 ± 3% -0.2 0.19 ± 6% perf-profile.children.cycles-pp.update_curr 0.69 ± 3% -0.2 0.47 ± 5% perf-profile.children.cycles-pp.sctp_chunkify 0.55 ± 3% -0.2 0.34 ± 4% perf-profile.children.cycles-pp.__dev_queue_xmit 0.53 ± 4% -0.2 0.33 ± 6% perf-profile.children.cycles-pp.__might_fault 0.58 ± 4% -0.2 0.39 ± 5% perf-profile.children.cycles-pp.copy_user_short_string 0.46 ± 9% -0.2 0.28 ± 12% perf-profile.children.cycles-pp.select_task_rq 0.33 ± 4% -0.2 0.16 ± 7% perf-profile.children.cycles-pp.free_unref_page_commit 0.28 ± 5% -0.2 0.11 ± 9% perf-profile.children.cycles-pp.dst_release 0.32 ± 7% -0.2 0.15 ± 7% perf-profile.children.cycles-pp.ipv4_dst_check 0.38 ± 3% -0.2 0.22 ± 8% perf-profile.children.cycles-pp.__mod_node_page_state 0.44 ± 8% -0.2 0.28 ± 13% perf-profile.children.cycles-pp.sctp_packet_append_chunk 0.49 ± 6% -0.2 0.33 ± 11% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk 0.54 ± 4% -0.2 0.39 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.34 ± 4% -0.2 0.19 ± 8% perf-profile.children.cycles-pp.sctp_v4_xmit 0.42 ± 3% -0.2 0.27 ± 10% perf-profile.children.cycles-pp.sockfd_lookup_light 0.32 ± 4% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.__zone_watermark_ok 0.47 ± 3% -0.1 0.32 ± 5% perf-profile.children.cycles-pp.__entry_text_start 0.28 ± 2% -0.1 0.13 ± 5% perf-profile.children.cycles-pp.__free_one_page 0.28 ± 5% -0.1 0.13 ± 4% perf-profile.children.cycles-pp.prepare_task_switch 0.43 ± 5% -0.1 0.29 ± 9% perf-profile.children.cycles-pp.sctp_addto_chunk 0.37 ± 4% -0.1 0.23 ± 6% perf-profile.children.cycles-pp.sctp_gen_sack 0.41 ± 4% -0.1 0.27 ± 8% perf-profile.children.cycles-pp.aa_sk_perm 0.35 ± 3% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.__list_add_valid 0.34 ± 4% -0.1 0.20 ± 6% perf-profile.children.cycles-pp.sctp_make_sack 0.44 ± 4% -0.1 0.30 ± 6% perf-profile.children.cycles-pp.update_rq_clock 0.37 ± 4% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.sock_recvmsg 0.34 ± 4% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.sctp_check_transmitted 0.35 ± 3% -0.1 0.22 ± 6% perf-profile.children.cycles-pp.memcg_slab_free_hook 0.36 ± 4% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.__fdget 0.34 ± 10% -0.1 0.22 ± 15% perf-profile.children.cycles-pp.select_task_rq_fair 0.44 ± 4% -0.1 0.32 ± 7% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.34 ± 5% -0.1 0.21 ± 7% perf-profile.children.cycles-pp.__virt_addr_valid 0.34 ± 3% -0.1 0.22 ± 5% perf-profile.children.cycles-pp.dev_hard_start_xmit 0.28 ± 14% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.sctp_transport_hold 0.35 ± 2% -0.1 0.23 ± 7% perf-profile.children.cycles-pp.__might_sleep 0.38 ± 4% -0.1 0.26 ± 4% perf-profile.children.cycles-pp.sctp_chunk_free 0.31 ± 5% -0.1 0.20 ± 5% perf-profile.children.cycles-pp.loopback_xmit 0.33 ± 4% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.free_pcp_prepare 0.33 ± 5% -0.1 0.22 ± 7% perf-profile.children.cycles-pp.security_socket_recvmsg 0.35 ± 2% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.sock_kmalloc 0.30 ± 2% -0.1 0.20 ± 8% perf-profile.children.cycles-pp.sctp_association_put 0.22 ± 7% -0.1 0.12 ± 6% perf-profile.children.cycles-pp.sctp_assoc_rwnd_increase 0.34 ± 4% -0.1 0.23 ± 2% perf-profile.children.cycles-pp.move_addr_to_kernel 0.28 ± 4% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.sock_kfree_s 0.23 ± 5% -0.1 0.13 ± 7% perf-profile.children.cycles-pp.rmqueue_bulk 0.31 ± 9% -0.1 0.21 ± 8% perf-profile.children.cycles-pp.sctp_transport_put 0.33 ± 6% -0.1 0.23 ± 12% perf-profile.children.cycles-pp.sctp_sched_fcfs_dequeue 0.28 ± 8% -0.1 0.18 ± 20% perf-profile.children.cycles-pp.__sctp_packet_append_chunk 0.34 ± 4% -0.1 0.24 ± 8% perf-profile.children.cycles-pp.memset_erms 0.19 ± 4% -0.1 0.10 ± 5% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.29 ± 4% -0.1 0.19 ± 7% perf-profile.children.cycles-pp.skb_set_owner_w 0.27 ± 4% -0.1 0.18 ± 5% perf-profile.children.cycles-pp.security_socket_sendmsg 0.24 ± 4% -0.1 0.14 ± 6% perf-profile.children.cycles-pp.__switch_to 0.26 ± 4% -0.1 0.17 ± 9% perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack 0.27 ± 2% -0.1 0.18 ± 5% perf-profile.children.cycles-pp.send_sctp_stream_1toMany 0.23 ± 4% -0.1 0.14 ± 5% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.20 ± 4% -0.1 0.11 ± 8% perf-profile.children.cycles-pp.sctp_outq_flush_ctrl 0.24 ± 7% -0.1 0.15 ± 14% perf-profile.children.cycles-pp.select_idle_sibling 0.26 ± 4% -0.1 0.17 ± 11% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.22 ± 5% -0.1 0.14 ± 5% perf-profile.children.cycles-pp.__switch_to_asm 0.21 -0.1 0.13 ± 8% perf-profile.children.cycles-pp.accept_connection 0.21 -0.1 0.13 ± 8% perf-profile.children.cycles-pp.spawn_child 0.21 -0.1 0.13 ± 8% perf-profile.children.cycles-pp.process_requests 0.14 ± 5% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.check_stack_object 0.20 ± 3% -0.1 0.12 ± 9% perf-profile.children.cycles-pp.sock_wfree 0.22 ± 4% -0.1 0.14 ± 3% perf-profile.children.cycles-pp.prepare_to_wait_exclusive 0.24 ± 5% -0.1 0.17 ± 9% perf-profile.children.cycles-pp.sctp_sched_dequeue_common 0.22 ± 3% -0.1 0.15 ± 2% perf-profile.children.cycles-pp.__kmalloc 0.21 ± 3% -0.1 0.13 ± 8% perf-profile.children.cycles-pp.sctp_make_control 0.20 ± 2% -0.1 0.12 ± 9% perf-profile.children.cycles-pp.recv_sctp_stream_1toMany 0.17 ± 6% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.___perf_sw_event 0.14 ± 5% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.sctp_sock_rfree 0.20 ± 4% -0.1 0.13 ± 7% perf-profile.children.cycles-pp.skb_clone 0.19 ± 30% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.sctp_cmp_addr_exact 0.17 ± 4% -0.1 0.10 ± 8% perf-profile.children.cycles-pp.__mod_timer 0.20 ± 4% -0.1 0.13 ± 6% perf-profile.children.cycles-pp.available_idle_cpu 0.23 ± 7% -0.1 0.16 ± 3% perf-profile.children.cycles-pp.__cond_resched 0.21 ± 6% -0.1 0.14 ± 10% perf-profile.children.cycles-pp.sctp_datamsg_put 0.16 ± 4% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.check_new_pages 0.14 ± 6% -0.1 0.08 ± 12% perf-profile.children.cycles-pp.sctp_inet_skb_msgname 0.14 ± 6% -0.1 0.08 ± 9% perf-profile.children.cycles-pp.ip_rcv 0.18 ± 3% -0.1 0.11 ± 9% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.18 ± 4% -0.1 0.12 ± 9% perf-profile.children.cycles-pp.poll_idle 0.20 ± 6% -0.1 0.14 ± 6% perf-profile.children.cycles-pp.kmem_cache_alloc_trace 0.19 -0.1 0.13 ± 8% perf-profile.children.cycles-pp.sctp_outq_tail 0.18 ± 3% -0.1 0.12 ± 7% perf-profile.children.cycles-pp.reweight_entity 0.20 ± 4% -0.1 0.13 ± 11% perf-profile.children.cycles-pp.update_cfs_group 0.16 ± 5% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.del_timer 0.16 ± 5% -0.1 0.10 ± 3% perf-profile.children.cycles-pp.sctp_sendmsg_parse 0.16 ± 5% -0.1 0.10 ± 9% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.18 ± 2% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.__free_pages 0.17 ± 4% -0.1 0.11 ± 5% perf-profile.children.cycles-pp.nr_iowait_cpu 0.14 ± 2% -0.1 0.09 ± 10% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.11 ± 6% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__build_skb_around 0.19 ± 3% -0.1 0.14 ± 8% perf-profile.children.cycles-pp.__update_load_avg_se 0.16 ± 5% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.13 ± 6% -0.1 0.08 ± 13% perf-profile.children.cycles-pp.task_tick_fair 0.21 ± 3% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.sctp_association_hold 0.15 ± 6% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.check_preempt_curr 0.07 ± 6% -0.0 0.02 ± 99% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.10 ± 5% -0.0 0.05 ± 7% perf-profile.children.cycles-pp.finish_task_switch 0.14 ± 6% -0.0 0.10 ± 6% perf-profile.children.cycles-pp.__genradix_ptr 0.12 ± 4% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.sctp_chunk_abandoned 0.07 ± 5% -0.0 0.02 ± 99% perf-profile.children.cycles-pp.ip_local_out 0.22 ± 6% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.sched_clock_cpu 0.14 ± 5% -0.0 0.09 ± 6% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 0.12 ± 6% -0.0 0.08 ± 7% perf-profile.children.cycles-pp.__netif_rx 0.20 ± 5% -0.0 0.16 ± 8% perf-profile.children.cycles-pp.read_tsc 0.12 ± 6% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.lock_timer_base 0.19 ± 5% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.native_sched_clock 0.13 ± 5% -0.0 0.09 ± 5% perf-profile.children.cycles-pp.pick_next_entity 0.12 ± 5% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.netif_rx_internal 0.12 ± 7% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__put_user_nocheck_4 0.12 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.skb_put 0.11 ± 4% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.__put_user_nocheck_8 0.12 ± 3% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.resched_curr 0.11 ± 8% -0.0 0.07 ± 25% perf-profile.children.cycles-pp.sctp_chunk_assign_ssn 0.13 ± 4% -0.0 0.09 ± 6% perf-profile.children.cycles-pp.sctp_datamsg_destroy 0.07 ± 7% -0.0 0.03 ±100% perf-profile.children.cycles-pp.ip_rcv_core 0.11 ± 3% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.enqueue_to_backlog 0.10 ± 5% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.sctp_transport_reset_t3_rtx 0.09 ± 6% -0.0 0.05 ± 7% perf-profile.children.cycles-pp.__netif_receive_skb_core 0.10 ± 5% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.validate_xmit_skb 0.11 ± 6% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 0.06 ± 6% -0.0 0.02 ± 99% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 0.10 ± 8% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.sctp_ulpq_order 0.09 ± 6% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.os_xsave 0.12 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__check_heap_object 0.10 ± 5% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.rcu_all_qs 0.08 ± 5% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.08 ± 5% -0.0 0.06 ± 8% perf-profile.children.cycles-pp.perf_tp_event 0.08 -0.0 0.06 ± 9% perf-profile.children.cycles-pp.__mod_lruvec_page_state 0.31 ± 3% -0.0 0.28 ± 4% perf-profile.children.cycles-pp.sctp_ulpevent_receive_data 0.10 ± 10% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.rcu_idle_exit 0.08 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.sctp_tsnmap_check 0.08 ± 5% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.sctp_ulpevent_init 0.07 ± 8% -0.0 0.05 perf-profile.children.cycles-pp.__wrgsbase_inactive 0.10 ± 5% +0.0 0.13 ± 10% perf-profile.children.cycles-pp.sctp_sockaddr_af 0.00 +0.1 0.05 perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.19 ± 3% +0.1 0.24 ± 11% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.1 0.07 ± 32% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.update_blocked_averages 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.run_rebalance_domains 0.24 ± 3% +0.1 0.32 ± 9% perf-profile.children.cycles-pp.update_process_times 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.update_sg_lb_stats 0.24 ± 4% +0.1 0.32 ± 9% perf-profile.children.cycles-pp.tick_sched_handle 0.00 +0.1 0.08 ± 41% perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.update_sd_lb_stats 0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.find_busiest_group 0.04 ± 71% +0.1 0.14 ± 3% perf-profile.children.cycles-pp.sctp_get_af_specific 0.01 ±223% +0.1 0.11 ± 18% perf-profile.children.cycles-pp.load_balance 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.02 ±141% +0.1 0.14 ± 46% perf-profile.children.cycles-pp.rebalance_domains 0.45 ± 5% +0.1 0.58 ± 10% perf-profile.children.cycles-pp.ktime_get 0.00 +0.1 0.14 ± 17% perf-profile.children.cycles-pp.cgroup_rstat_updated 0.26 ± 4% +0.1 0.41 ± 12% perf-profile.children.cycles-pp.tick_sched_timer 0.15 ± 10% +0.2 0.32 ± 16% perf-profile.children.cycles-pp.clockevents_program_event 0.30 ± 4% +0.2 0.50 ± 10% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.25 ± 4% +0.2 0.45 ± 20% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.00 +0.2 0.20 ± 16% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.50 ± 2% +0.2 0.71 ± 15% perf-profile.children.cycles-pp.menu_select 0.16 ± 5% +0.2 0.38 ± 22% perf-profile.children.cycles-pp.tick_nohz_next_event 0.08 ± 8% +0.2 0.30 ± 23% perf-profile.children.cycles-pp.__irq_exit_rcu 0.00 +0.3 0.33 ± 12% perf-profile.children.cycles-pp.propagate_protected_usage 0.48 ± 5% +0.4 0.89 ± 11% perf-profile.children.cycles-pp.hrtimer_interrupt 0.48 ± 6% +0.4 0.90 ± 10% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 0.00 +0.6 0.55 ± 3% perf-profile.children.cycles-pp.mem_cgroup_uncharge_skmem 0.61 ± 5% +0.7 1.35 ± 11% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 1.00 ± 2% +0.8 1.82 ± 10% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 0.00 +1.0 1.03 ± 4% perf-profile.children.cycles-pp.__mod_memcg_state 1.73 ± 2% +1.4 3.14 ± 4% perf-profile.children.cycles-pp.sctp_ulpevent_make_rcvmsg 19.09 ± 3% +2.0 21.11 ± 4% perf-profile.children.cycles-pp.recvmsg 11.51 ± 3% +2.2 13.66 ± 4% perf-profile.children.cycles-pp.__ip_queue_xmit 11.26 ± 3% +2.3 13.53 ± 4% perf-profile.children.cycles-pp.ip_finish_output2 0.00 +2.3 2.27 ± 5% perf-profile.children.cycles-pp.page_counter_uncharge 0.00 +2.3 2.32 ± 4% perf-profile.children.cycles-pp.drain_stock 0.00 +2.4 2.40 ± 5% perf-profile.children.cycles-pp.page_counter_try_charge 10.87 ± 3% +2.4 13.28 ± 4% perf-profile.children.cycles-pp.__local_bh_enable_ip 10.76 ± 3% +2.4 13.20 ± 4% perf-profile.children.cycles-pp.do_softirq 17.84 ± 3% +2.5 20.32 ± 4% perf-profile.children.cycles-pp.__sys_recvmsg 3.60 ± 3% +2.5 6.12 ± 5% perf-profile.children.cycles-pp.sctp_skb_recv_datagram 10.53 ± 3% +2.5 13.07 ± 4% perf-profile.children.cycles-pp.net_rx_action 0.00 +2.5 2.54 ± 4% perf-profile.children.cycles-pp.refill_stock 10.43 ± 3% +2.6 13.01 ± 4% perf-profile.children.cycles-pp.__napi_poll 17.57 ± 3% +2.6 20.15 ± 4% perf-profile.children.cycles-pp.___sys_recvmsg 10.41 ± 3% +2.6 12.99 ± 4% perf-profile.children.cycles-pp.process_backlog 10.77 ± 3% +2.7 13.43 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start 10.24 ± 3% +2.7 12.90 ± 4% perf-profile.children.cycles-pp.__netif_receive_skb_one_core 9.97 ± 3% +2.8 12.76 ± 4% perf-profile.children.cycles-pp.ip_local_deliver_finish 9.95 ± 3% +2.8 12.74 ± 4% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 9.89 ± 3% +2.8 12.69 ± 4% perf-profile.children.cycles-pp.sctp_rcv 1.71 ± 4% +2.9 4.57 ± 4% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 16.66 ± 3% +2.9 19.59 ± 4% perf-profile.children.cycles-pp.____sys_recvmsg 16.01 ± 3% +3.2 19.21 ± 4% perf-profile.children.cycles-pp.sctp_recvmsg 15.89 ± 3% +3.2 19.12 ± 4% perf-profile.children.cycles-pp.inet_recvmsg 1.49 ± 3% +3.4 4.86 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_bh 1.59 ± 3% +3.4 4.96 ± 4% perf-profile.children.cycles-pp.lock_sock_nested 15.60 ± 3% +3.6 19.22 ± 4% perf-profile.children.cycles-pp.release_sock 0.00 +3.7 3.69 ± 4% perf-profile.children.cycles-pp.try_charge_memcg 15.33 ± 3% +3.7 19.04 ± 4% perf-profile.children.cycles-pp.__release_sock 15.27 ± 3% +3.7 19.00 ± 4% perf-profile.children.cycles-pp.sctp_backlog_rcv 0.62 ± 5% +3.8 4.45 ± 4% perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2 0.48 ± 5% +3.9 4.36 ± 5% perf-profile.children.cycles-pp.sctp_eat_data 0.00 +4.4 4.36 ± 4% perf-profile.children.cycles-pp.mem_cgroup_charge_skmem 3.46 ± 3% +4.4 7.91 ± 4% perf-profile.children.cycles-pp.sctp_chunk_put 20.07 ± 3% +4.6 24.66 ± 4% perf-profile.children.cycles-pp.sctp_assoc_bh_rcv 0.00 +4.6 4.60 ± 4% perf-profile.children.cycles-pp.__sk_mem_raise_allocated 0.00 +4.6 4.63 ± 4% perf-profile.children.cycles-pp.__sk_mem_schedule 24.02 ± 12% +4.7 28.76 ± 11% perf-profile.children.cycles-pp.intel_idle 2.97 ± 3% +4.8 7.75 ± 4% perf-profile.children.cycles-pp.sctp_outq_sack 2.11 ± 4% +4.8 6.90 ± 4% perf-profile.children.cycles-pp.kfree_skb_reason 2.04 ± 3% +4.9 6.98 ± 4% perf-profile.children.cycles-pp.consume_skb 0.37 ± 3% +5.6 5.94 ± 4% perf-profile.children.cycles-pp.sctp_wfree 0.95 ± 3% +11.3 12.23 ± 4% perf-profile.children.cycles-pp.skb_release_head_state 0.00 +11.7 11.67 ± 4% perf-profile.children.cycles-pp.__sk_mem_reduce_allocated 8.68 ± 3% -3.1 5.58 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 8.45 ± 3% -3.0 5.46 ± 5% perf-profile.self.cycles-pp.memcpy_erms 0.94 ± 4% -0.4 0.57 ± 6% perf-profile.self.cycles-pp.__slab_free 0.71 ± 3% -0.3 0.42 ± 2% perf-profile.self.cycles-pp.sctp_chunk_put 0.58 ± 3% -0.3 0.30 ± 3% perf-profile.self.cycles-pp.__copy_skb_header 0.87 ± 3% -0.3 0.59 ± 6% perf-profile.self.cycles-pp.kmem_cache_free 0.58 ± 5% -0.3 0.30 ± 6% perf-profile.self.cycles-pp.sctp_packet_config 0.82 ± 3% -0.3 0.55 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.65 ± 4% -0.2 0.41 ± 5% perf-profile.self.cycles-pp.__might_resched 0.41 ± 4% -0.2 0.17 ± 8% perf-profile.self.cycles-pp.rmqueue 0.63 ± 4% -0.2 0.40 ± 3% perf-profile.self.cycles-pp._raw_spin_lock 0.59 ± 4% -0.2 0.36 ± 7% perf-profile.self.cycles-pp.sctp_recvmsg 0.39 ± 4% -0.2 0.18 ± 5% perf-profile.self.cycles-pp.sctp_sendmsg_to_asoc 0.58 ± 3% -0.2 0.36 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.43 ± 4% -0.2 0.24 ± 9% perf-profile.self.cycles-pp.sctp_packet_pack 0.39 ± 4% -0.2 0.20 ± 2% perf-profile.self.cycles-pp.update_load_avg 0.56 ± 4% -0.2 0.38 ± 5% perf-profile.self.cycles-pp.copy_user_short_string 0.27 ± 5% -0.2 0.10 ± 7% perf-profile.self.cycles-pp.dst_release 0.32 ± 3% -0.2 0.16 ± 7% perf-profile.self.cycles-pp.get_page_from_freelist 0.31 ± 7% -0.2 0.15 ± 6% perf-profile.self.cycles-pp.ipv4_dst_check 0.30 ± 4% -0.2 0.14 ± 7% perf-profile.self.cycles-pp.free_unref_page_commit 0.38 ± 3% -0.2 0.22 ± 8% perf-profile.self.cycles-pp.__mod_node_page_state 0.54 ± 3% -0.2 0.38 ± 5% perf-profile.self.cycles-pp.__schedule 0.47 ± 2% -0.2 0.31 ± 5% perf-profile.self.cycles-pp.kfree 0.34 ± 4% -0.2 0.18 ± 7% perf-profile.self.cycles-pp.sctp_v4_xmit 0.23 ± 4% -0.2 0.07 ± 10% perf-profile.self.cycles-pp.update_curr 0.32 ± 12% -0.2 0.17 ± 9% perf-profile.self.cycles-pp.__rhashtable_lookup 0.51 ± 4% -0.2 0.36 ± 6% perf-profile.self.cycles-pp.__list_del_entry_valid 0.32 ± 3% -0.2 0.17 ± 4% perf-profile.self.cycles-pp.__zone_watermark_ok 0.42 ± 3% -0.1 0.27 ± 5% perf-profile.self.cycles-pp.kmem_cache_alloc 0.40 ± 5% -0.1 0.26 ± 7% perf-profile.self.cycles-pp.sctp_outq_flush_data 0.28 ± 4% -0.1 0.15 ± 6% perf-profile.self.cycles-pp.__check_object_size 0.35 ± 4% -0.1 0.22 ± 9% perf-profile.self.cycles-pp.__fdget 0.42 ± 4% -0.1 0.29 ± 6% perf-profile.self.cycles-pp.sctp_datamsg_from_user 0.36 ± 5% -0.1 0.24 ± 5% perf-profile.self.cycles-pp.set_next_entity 0.34 ± 3% -0.1 0.21 ± 3% perf-profile.self.cycles-pp.check_heap_object 0.34 ± 3% -0.1 0.22 ± 7% perf-profile.self.cycles-pp.memcg_slab_free_hook 0.32 ± 2% -0.1 0.20 ± 5% perf-profile.self.cycles-pp.__list_add_valid 0.32 ± 5% -0.1 0.20 ± 8% perf-profile.self.cycles-pp.__virt_addr_valid 0.34 ± 5% -0.1 0.22 ± 4% perf-profile.self.cycles-pp.__skb_datagram_iter 0.34 ± 4% -0.1 0.22 ± 7% perf-profile.self.cycles-pp.update_rq_clock 0.37 ± 5% -0.1 0.25 ± 4% perf-profile.self.cycles-pp.sctp_sendmsg 0.27 ± 13% -0.1 0.16 ± 6% perf-profile.self.cycles-pp.sctp_transport_hold 0.35 ± 3% -0.1 0.24 ± 6% perf-profile.self.cycles-pp.skb_release_data 0.32 ± 4% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__alloc_skb 0.22 ± 7% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.sctp_assoc_rwnd_increase 0.33 ± 5% -0.1 0.22 ± 4% perf-profile.self.cycles-pp.free_pcp_prepare 0.31 ± 4% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.enqueue_task_fair 0.36 ± 3% -0.1 0.26 ± 3% perf-profile.self.cycles-pp.enqueue_entity 0.30 -0.1 0.20 ± 8% perf-profile.self.cycles-pp.sctp_association_put 0.24 ± 4% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.__alloc_pages 0.30 ± 9% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.sctp_transport_put 0.31 ± 3% -0.1 0.21 ± 6% perf-profile.self.cycles-pp.sctp_skb_recv_datagram 0.30 ± 4% -0.1 0.20 ± 8% perf-profile.self.cycles-pp.aa_sk_perm 0.33 ± 4% -0.1 0.23 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.30 ± 3% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.__might_sleep 0.18 ± 4% -0.1 0.09 ± 10% perf-profile.self.cycles-pp.____sys_recvmsg 0.19 ± 5% -0.1 0.09 ± 11% perf-profile.self.cycles-pp.sctp_ulpevent_free 0.32 ± 3% -0.1 0.23 ± 8% perf-profile.self.cycles-pp.memset_erms 0.30 ± 6% -0.1 0.21 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.28 ± 3% -0.1 0.19 ± 6% perf-profile.self.cycles-pp.skb_set_owner_w 0.23 ± 6% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.__switch_to 0.18 ± 4% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.26 ± 4% -0.1 0.17 ± 7% perf-profile.self.cycles-pp.sctp_cmd_interpreter 0.25 ± 4% -0.1 0.17 ± 7% perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack 0.26 -0.1 0.18 ± 5% perf-profile.self.cycles-pp.send_sctp_stream_1toMany 0.17 ± 32% -0.1 0.09 ± 6% perf-profile.self.cycles-pp.sctp_cmp_addr_exact 0.22 ± 5% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.__switch_to_asm 0.20 ± 2% -0.1 0.12 ± 10% perf-profile.self.cycles-pp.recv_sctp_stream_1toMany 0.19 ± 3% -0.1 0.11 ± 9% perf-profile.self.cycles-pp.sock_wfree 0.10 ± 5% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.process_backlog 0.10 ± 6% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.__free_one_page 0.20 ± 4% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.recvmsg 0.22 ± 3% -0.1 0.14 ± 7% perf-profile.self.cycles-pp.consume_skb 0.18 ± 3% -0.1 0.11 ± 10% perf-profile.self.cycles-pp._copy_from_user 0.15 ± 7% -0.1 0.08 ± 4% perf-profile.self.cycles-pp.___perf_sw_event 0.15 ± 4% -0.1 0.08 ± 5% perf-profile.self.cycles-pp.check_new_pages 0.20 ± 5% -0.1 0.13 ± 6% perf-profile.self.cycles-pp.available_idle_cpu 0.22 ± 3% -0.1 0.15 ± 5% perf-profile.self.cycles-pp.__entry_text_start 0.18 ± 2% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.sctp_assoc_bh_rcv 0.13 ± 7% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.sctp_sock_rfree 0.17 ± 4% -0.1 0.11 ± 10% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.13 ± 5% -0.1 0.07 ± 13% perf-profile.self.cycles-pp.__free_pages_ok 0.20 ± 5% -0.1 0.14 ± 9% perf-profile.self.cycles-pp.sctp_datamsg_put 0.19 ± 3% -0.1 0.12 ± 12% perf-profile.self.cycles-pp.sendmsg 0.18 ± 4% -0.1 0.12 ± 7% perf-profile.self.cycles-pp.reweight_entity 0.14 ± 7% -0.1 0.07 ± 10% perf-profile.self.cycles-pp.sctp_inet_skb_msgname 0.23 ± 3% -0.1 0.17 ± 9% perf-profile.self.cycles-pp.sctp_wfree 0.19 ± 3% -0.1 0.13 ± 11% perf-profile.self.cycles-pp.update_cfs_group 0.17 ± 4% -0.1 0.11 ± 3% perf-profile.self.cycles-pp.nr_iowait_cpu 0.17 ± 7% -0.1 0.11 ± 9% perf-profile.self.cycles-pp.sctp_packet_transmit 0.08 ± 18% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.sctp_ulpq_tail_data 0.17 ± 7% -0.1 0.11 ± 9% perf-profile.self.cycles-pp.sctp_packet_append_chunk 0.19 ± 4% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.sctp_do_sm 0.18 ± 2% -0.1 0.12 ± 4% perf-profile.self.cycles-pp.__free_pages 0.17 ± 5% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.__wake_up_common 0.16 ± 6% -0.1 0.10 ± 3% perf-profile.self.cycles-pp.sctp_sendmsg_parse 0.15 ± 6% -0.1 0.09 ± 13% perf-profile.self.cycles-pp.try_to_wake_up 0.10 ± 3% -0.1 0.04 ± 45% perf-profile.self.cycles-pp.__build_skb_around 0.15 ± 6% -0.1 0.09 ± 11% perf-profile.self.cycles-pp.sctp_check_transmitted 0.08 ± 14% -0.1 0.03 ±101% perf-profile.self.cycles-pp.select_task_rq_fair 0.12 ± 6% -0.1 0.06 ± 14% perf-profile.self.cycles-pp.dequeue_entity 0.19 ± 4% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.sctp_hash_cmp 0.14 ± 4% -0.1 0.09 ± 10% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.16 ± 4% -0.1 0.10 ± 7% perf-profile.self.cycles-pp.poll_idle 0.22 ± 8% -0.1 0.17 ± 10% perf-profile.self.cycles-pp.sctp_rcv 0.11 ± 4% -0.1 0.06 ± 11% perf-profile.self.cycles-pp.__ip_queue_xmit 0.12 ± 10% -0.1 0.08 ± 24% perf-profile.self.cycles-pp.__sctp_packet_append_chunk 0.13 ± 2% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.sctp_inq_pop 0.18 ± 3% -0.0 0.13 ± 11% perf-profile.self.cycles-pp.__update_load_avg_se 0.14 ± 5% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.do_syscall_64 0.11 ± 6% -0.0 0.06 ± 11% perf-profile.self.cycles-pp._copy_to_iter 0.09 ± 11% -0.0 0.04 ± 76% perf-profile.self.cycles-pp.sctp_chunk_assign_ssn 0.14 ± 3% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.____sys_sendmsg 0.12 ± 4% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.___sys_recvmsg 0.20 ± 2% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.sctp_association_hold 0.17 ± 3% -0.0 0.12 ± 7% perf-profile.self.cycles-pp.__skb_clone 0.14 ± 3% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.__copy_msghdr_from_user 0.13 ± 5% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.sctp_sf_eat_data_6_2 0.13 ± 2% -0.0 0.09 ± 13% perf-profile.self.cycles-pp.sctp_outq_tail 0.20 ± 4% -0.0 0.16 ± 9% perf-profile.self.cycles-pp.read_tsc 0.13 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.__import_iovec 0.13 ± 6% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.__genradix_ptr 0.11 ± 8% -0.0 0.07 ± 14% perf-profile.self.cycles-pp.select_task_rq 0.12 ± 3% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.resched_curr 0.13 ± 5% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.pick_next_entity 0.12 ± 6% -0.0 0.08 ± 12% perf-profile.self.cycles-pp.__put_user_nocheck_4 0.12 ± 6% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.sctp_chunk_abandoned 0.10 ± 7% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 0.07 ± 7% -0.0 0.02 ± 99% perf-profile.self.cycles-pp.ip_rcv_core 0.13 ± 7% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.sctp_sched_dequeue_common 0.13 ± 7% -0.0 0.09 ± 6% perf-profile.self.cycles-pp.ip_finish_output2 0.12 ± 6% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook 0.08 ± 6% -0.0 0.04 ± 71% perf-profile.self.cycles-pp._sctp_make_chunk 0.10 ± 4% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.net_rx_action 0.10 ± 5% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.sctp_addto_chunk 0.09 ± 6% -0.0 0.05 ± 7% perf-profile.self.cycles-pp.__netif_receive_skb_core 0.12 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.__kmalloc 0.11 ± 5% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.__put_user_nocheck_8 0.18 ± 6% -0.0 0.15 ± 7% perf-profile.self.cycles-pp.native_sched_clock 0.09 ± 5% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.check_stack_object 0.07 -0.0 0.03 ± 70% perf-profile.self.cycles-pp.__mod_lruvec_page_state 0.16 ± 4% -0.0 0.12 ± 10% perf-profile.self.cycles-pp.sctp_outq_flush 0.10 ± 3% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.skb_put 0.06 ± 6% -0.0 0.02 ± 99% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 0.10 ± 4% -0.0 0.07 ± 15% perf-profile.self.cycles-pp.__might_fault 0.12 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.kmem_cache_alloc_trace 0.07 ± 8% -0.0 0.04 ± 71% perf-profile.self.cycles-pp.sockfd_lookup_light 0.10 ± 7% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.__cond_resched 0.09 ± 6% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.os_xsave 0.09 ± 6% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.free_unref_page 0.09 ± 7% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.security_socket_recvmsg 0.11 ± 4% -0.0 0.08 ± 7% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.12 ± 4% -0.0 0.09 ± 12% perf-profile.self.cycles-pp.sock_kmalloc 0.09 ± 6% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.sctp_user_addto_chunk 0.07 ± 6% -0.0 0.04 ± 44% perf-profile.self.cycles-pp.rcu_all_qs 0.10 ± 5% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.sctp_outq_sack 0.09 ± 4% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.sctp_outq_select_transport 0.10 ± 3% -0.0 0.07 ± 9% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.08 ± 5% -0.0 0.05 ± 46% perf-profile.self.cycles-pp.sctp_ulpevent_init 0.12 ± 4% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__check_heap_object 0.07 ± 11% -0.0 0.04 ± 44% perf-profile.self.cycles-pp.loopback_xmit 0.14 ± 2% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.do_idle 0.11 ± 4% -0.0 0.08 ± 12% perf-profile.self.cycles-pp.cpuidle_idle_call 0.09 -0.0 0.06 ± 11% perf-profile.self.cycles-pp._copy_from_iter 0.08 ± 5% -0.0 0.06 ± 13% perf-profile.self.cycles-pp.kmalloc_large_node 0.08 ± 5% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.sctp_chunkify 0.09 ± 4% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.iovec_from_user 0.14 ± 4% -0.0 0.12 ± 11% perf-profile.self.cycles-pp.sctp_ulpevent_make_rcvmsg 0.07 ± 6% -0.0 0.05 ± 7% perf-profile.self.cycles-pp.sctp_tsnmap_check 0.08 ± 6% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.sock_kfree_s 0.08 ± 5% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.skb_release_head_state 0.07 ± 8% -0.0 0.05 perf-profile.self.cycles-pp.__wrgsbase_inactive 0.09 ± 8% -0.0 0.07 ± 13% perf-profile.self.cycles-pp.__softirqentry_text_start 0.07 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__sys_recvmsg 0.18 ± 4% +0.0 0.22 ± 12% perf-profile.self.cycles-pp.menu_select 0.00 +0.1 0.06 ± 19% perf-profile.self.cycles-pp.update_sg_lb_stats 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.lapic_next_deadline 0.00 +0.1 0.07 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret 0.09 ± 4% +0.1 0.16 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state 0.00 +0.1 0.08 ± 41% perf-profile.self.cycles-pp._raw_spin_trylock 0.00 +0.1 0.09 ± 54% perf-profile.self.cycles-pp.tick_nohz_next_event 0.01 ±223% +0.1 0.13 ± 5% perf-profile.self.cycles-pp.sctp_get_af_specific 0.00 +0.1 0.13 ± 6% perf-profile.self.cycles-pp.mem_cgroup_charge_skmem 0.00 +0.1 0.14 ± 19% perf-profile.self.cycles-pp.cgroup_rstat_updated 0.25 ± 6% +0.2 0.43 ± 14% perf-profile.self.cycles-pp.ktime_get 0.00 +0.2 0.20 ± 16% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.00 +0.2 0.22 ± 6% perf-profile.self.cycles-pp.refill_stock 0.00 +0.3 0.25 ± 9% perf-profile.self.cycles-pp.__sk_mem_raise_allocated 0.00 +0.3 0.32 ± 12% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +0.9 0.89 ± 4% perf-profile.self.cycles-pp.__mod_memcg_state 0.00 +1.3 1.27 ± 5% perf-profile.self.cycles-pp.try_charge_memcg 0.00 +2.1 2.10 ± 5% perf-profile.self.cycles-pp.page_counter_uncharge 0.00 +2.2 2.23 ± 5% perf-profile.self.cycles-pp.page_counter_try_charge 1.70 ± 4% +2.8 4.54 ± 4% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.29 ± 5% +4.0 4.24 ± 5% perf-profile.self.cycles-pp.sctp_eat_data 0.00 +8.6 8.55 ± 4% perf-profile.self.cycles-pp.__sk_mem_reduce_allocated Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 1 week

7
32
0 / 0

[KVM] 9fc222967a: kvm-unit-tests.msr.fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 9fc222967a39d6be96dabb942cc94e4f07ca049c ("KVM: x86: Give host userspace full control of MSR_IA32_MISC_ENABLES") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: kvm-unit-tests version: kvm-unit-tests-x86_64-8719e83-1_20220518 with following parameters: ucode: 0x28 on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-4790 v3 @ 3.60GHz with 6G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> 2022-06-29 05:36:04 ./run_tests.sh ... [32mPASS[0m memory (7 tests) [31mFAIL[0m msr <------ [32mPASS[0m pmu (142 tests) ... To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 2 weeks

1
0
0 / 0

[can] 39bbbe2356: BUG:sleeping_function_called_from_invalid_context_at_mm/page_alloc.c

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 39bbbe2356a2a13ec26a8765d8a4e6dfe7ce33e9 ("[PATCH v4 05/12] can: slcan: use CAN network device driver API") url: https://github.com/intel-lab-lkp/linux/commits/Dario-Binacchi/can-slcan-e... patch link: https://lore.kernel.org/lkml/20220614122821.3646071-6-dario.binacchi@amar... in testcase: ltp version: ltp-x86_64-14c1f76-1_20220625 with following parameters: test: pty ucode: 0x21 test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features. test-url: http://linux-test-project.github.io/ on test machine: 4 threads 1 sockets Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 164.290583][ T3878] BUG: sleeping function called from invalid context at mm/page_alloc.c:5203 [ 164.290589][ T3878] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 3878, name: pty03 [ 164.290592][ T3878] preempt_count: 1, expected: 0 [ 164.290595][ T3878] CPU: 1 PID: 3878 Comm: pty03 Tainted: G S 5.19.0-rc2-00005-g39bbbe2356a2 #1 [ 164.290600][ T3878] Hardware name: Hewlett-Packard p6-1451cx/2ADA, BIOS 8.15 02/05/2013 [ 164.290602][ T3878] Call Trace: [ 164.290604][ T3878] <TASK> [ 164.290606][ T3878] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 1)) [ 164.290615][ T3878] __might_resched.cold (kernel/sched/core.c:9792) [ 164.290621][ T3878] prepare_alloc_pages+0x330/0x500 [ 164.290628][ T3878] ? tty_set_ldisc (drivers/tty/tty_ldisc.c:555) [ 164.290634][ T3878] __alloc_pages (mm/page_alloc.c:5415) [ 164.290637][ T3878] ? __alloc_pages_slowpath+0x15c0/0x15c0 [ 164.290641][ T3878] ? tty_set_ldisc (drivers/tty/tty_ldisc.c:555) [ 164.290645][ T3878] ? kasan_save_stack (mm/kasan/common.c:40) [ 164.290650][ T3878] ? kasan_set_track (mm/kasan/common.c:45) [ 164.290654][ T3878] ? __kasan_slab_free (mm/kasan/common.c:368 mm/kasan/common.c:328 mm/kasan/common.c:374) [ 164.290658][ T3878] ? entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:115) [ 164.290663][ T3878] ? do_syscall_64 (arch/x86/entry/common.c:50 arch/x86/entry/common.c:80) [ 164.290668][ T3878] ? entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:115) [ 164.290672][ T3878] kmalloc_large_node (mm/slub.c:4432) [ 164.290677][ T3878] __kmalloc_node (include/asm-generic/getorder.h:41 mm/slub.c:4450) [ 164.290681][ T3878] kvmalloc_node (mm/util.c:619) [ 164.290687][ T3878] alloc_netdev_mqs (net/core/dev.c:10577) [ 164.290694][ T3878] ? can_get_state_str (drivers/net/can/dev/dev.c:222) can_dev [ 164.290704][ T3878] ? _raw_spin_lock (arch/x86/include/asm/atomic.h:202 include/linux/atomic/atomic-instrumented.h:543 include/asm-generic/qspinlock.h:111 include/linux/spinlock.h:185 include/linux/spinlock_api_smp.h:134 kernel/locking/spinlock.c:154) [ 164.290708][ T3878] alloc_candev_mqs (drivers/net/can/dev/dev.c:262) can_dev [ 164.290717][ T3878] slcan_open (drivers/net/can/slcan.c:531 drivers/net/can/slcan.c:584) slcan [ 164.290723][ T3878] tty_ldisc_open (drivers/tty/tty_ldisc.c:433) [ 164.290728][ T3878] tty_set_ldisc (drivers/tty/tty_ldisc.c:558) [ 164.290733][ T3878] tty_ioctl (drivers/tty/tty_io.c:2714) [ 164.290736][ T3878] ? do_sys_openat2 (fs/open.c:1288) [ 164.290740][ T3878] ? tty_release (drivers/tty/tty_io.c:2655) [ 164.290744][ T3878] ? do_sys_openat2 (fs/open.c:1288) [ 164.290747][ T3878] ? build_open_flags (fs/open.c:1264) [ 164.290751][ T3878] ? __ia32_sys_stat (fs/stat.c:396) [ 164.290755][ T3878] ? userns_owner (kernel/user_namespace.c:371) [ 164.290760][ T3878] ? __fget_files (arch/x86/include/asm/atomic64_64.h:22 include/linux/atomic/atomic-arch-fallback.h:2363 include/linux/atomic/atomic-arch-fallback.h:2388 include/linux/atomic/atomic-arch-fallback.h:2404 include/linux/atomic/atomic-long.h:497 include/linux/atomic/atomic-instrumented.h:1854 fs/file.c:882 fs/file.c:913) [ 164.290764][ T3878] __x64_sys_ioctl (fs/ioctl.c:52 fs/ioctl.c:870 fs/ioctl.c:856 fs/ioctl.c:856) [ 164.290768][ T3878] do_syscall_64 (arch/x86/entry/common.c:50 arch/x86/entry/common.c:80) [ 164.290773][ T3878] entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:115) [ 164.290777][ T3878] RIP: 0033:0x7f86f3323cc7 [ 164.290781][ T3878] Code: 00 00 00 48 8b 05 c9 91 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 91 0c 00 f7 d8 64 89 01 48 All code ======== 0: 00 00 add %al,(%rax) 2: 00 48 8b add %cl,-0x75(%rax) 5: 05 c9 91 0c 00 add $0xc91c9,%eax a: 64 c7 00 26 00 00 00 movl $0x26,%fs:(%rax) 11: 48 c7 c0 ff ff ff ff mov $0xffffffffffffffff,%rax 18: c3 retq 19: 66 2e 0f 1f 84 00 00 nopw %cs:0x0(%rax,%rax,1) 20: 00 00 00 23: b8 10 00 00 00 mov $0x10,%eax 28: 0f 05 syscall 2a:* 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax <-- trapping instruction 30: 73 01 jae 0x33 32: c3 retq 33: 48 8b 0d 99 91 0c 00 mov 0xc9199(%rip),%rcx # 0xc91d3 3a: f7 d8 neg %eax 3c: 64 89 01 mov %eax,%fs:(%rcx) 3f: 48 rex.W Code starting with the faulting instruction =========================================== 0: 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax 6: 73 01 jae 0x9 8: c3 retq 9: 48 8b 0d 99 91 0c 00 mov 0xc9199(%rip),%rcx # 0xc91a9 10: f7 d8 neg %eax 12: 64 89 01 mov %eax,%fs:(%rcx) 15: 48 rex.W [ 164.290784][ T3878] RSP: 002b:00007fff6a8fb8b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [ 164.290789][ T3878] RAX: ffffffffffffffda RBX: 00007f86f322c6c0 RCX: 00007f86f3323cc7 [ 164.290792][ T3878] RDX: 000055911985c700 RSI: 0000000000005423 RDI: 000000000000000d [ 164.290795][ T3878] RBP: 000055911985c700 R08: 0000000000000000 R09: cccccccccccccccd [ 164.290797][ T3878] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000000000d [ 164.290799][ T3878] R13: 0000000000000006 R14: 000055911985c6a0 R15: 0000000000000004 [ 164.290803][ T3878] </TASK> [ 164.738226][ T3878] BUG: scheduling while atomic: pty03/3878/0x00000002 [ 164.738233][ T3878] Modules linked in: slcan can_dev n_hdlc netconsole btrfs blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi crc64_rocksoft_generic crc64_rocksoft crc64 sg i915 intel_rapl_msr intel_gtt intel_rapl_common drm_buddy x86_pkg_temp_thermal drm_display_helper intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul crc32c_intel ahci ttm ghash_clmulni_intel rapl libahci intel_cstate ipmi_devintf drm_kms_helper intel_uncore ipmi_msghandler usb_storage mei_me syscopyarea sysfillrect libata sysimgblt mei fb_sys_fops video drm fuse ip_tables [ 164.738298][ T3878] CPU: 3 PID: 3878 Comm: pty03 Tainted: G S W 5.19.0-rc2-00005-g39bbbe2356a2 #1 [ 164.738302][ T3878] Hardware name: Hewlett-Packard p6-1451cx/2ADA, BIOS 8.15 02/05/2013 [ 164.738305][ T3878] Call Trace: [ 164.738307][ T3878] <TASK> [ 164.738309][ T3878] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 1)) [ 164.738318][ T3878] __schedule_bug.cold (kernel/sched/core.c:5661) [ 164.738323][ T3878] schedule_debug (arch/x86/include/asm/preempt.h:35 kernel/sched/core.c:5688) [ 164.738329][ T3878] __schedule (arch/x86/include/asm/jump_label.h:27 include/linux/jump_label.h:207 kernel/sched/features.h:40 kernel/sched/core.c:6324) [ 164.738335][ T3878] ? node_tag_clear (arch/x86/include/asm/bitops.h:94 include/asm-generic/bitops/instrumented-non-atomic.h:43 lib/radix-tree.c:107 lib/radix-tree.c:1000) [ 164.738340][ T3878] ? io_schedule_timeout (kernel/sched/core.c:6310) [ 164.738344][ T3878] ? idr_alloc_u32 (lib/idr.c:55) [ 164.738349][ T3878] ? _raw_spin_lock_irq (arch/x86/include/asm/atomic.h:202 include/linux/atomic/atomic-instrumented.h:543 include/asm-generic/qspinlock.h:111 include/linux/spinlock.h:185 include/linux/spinlock_api_smp.h:120 kernel/locking/spinlock.c:170) [ 164.738353][ T3878] schedule (include/linux/instrumented.h:71 (discriminator 1) include/asm-generic/bitops/instrumented-non-atomic.h:134 (discriminator 1) include/linux/thread_info.h:118 (discriminator 1) include/linux/sched.h:2196 (discriminator 1) kernel/sched/core.c:6502 (discriminator 1)) [ 164.738358][ T3878] rwsem_down_write_slowpath (arch/x86/include/asm/current.h:15 kernel/locking/rwsem.c:1174) [ 164.738362][ T3878] ? __down_timeout (kernel/locking/rwsem.c:1099) [ 164.738365][ T3878] ? _raw_write_lock_irq (kernel/locking/spinlock.c:153) [ 164.738370][ T3878] ? idr_get_free (lib/radix-tree.c:1533) [ 164.738373][ T3878] ? kernfs_dir_fop_release (fs/kernfs/dir.c:584) [ 164.738379][ T3878] down_write (kernel/locking/rwsem.c:1544) [ 164.738383][ T3878] ? down_write_killable (kernel/locking/rwsem.c:1540) [ 164.738386][ T3878] ? idr_alloc (lib/idr.c:118) [ 164.738389][ T3878] ? _raw_spin_lock (arch/x86/include/asm/atomic.h:202 include/linux/atomic/atomic-instrumented.h:543 include/asm-generic/qspinlock.h:111 include/linux/spinlock.h:185 include/linux/spinlock_api_smp.h:134 kernel/locking/spinlock.c:154) [ 164.738393][ T3878] ? __fprop_add_percpu_max (lib/idr.c:35) [ 164.738397][ T3878] kernfs_add_one (include/linux/kernfs.h:332 fs/kernfs/dir.c:737) [ 164.738402][ T3878] ? kernfs_new_node (fs/kernfs/dir.c:659) [ 164.738406][ T3878] ? device_remove_bin_file (drivers/base/core.c:2089) [ 164.738411][ T3878] __kernfs_create_file (fs/kernfs/file.c:1016) [ 164.738415][ T3878] sysfs_add_file_mode_ns (fs/sysfs/file.c:301) [ 164.738419][ T3878] ? projid_m_show (kernel/user_namespace.c:308) [ 164.738423][ T3878] ? _raw_write_lock_irq (kernel/locking/spinlock.c:153) [ 164.738427][ T3878] create_files (fs/sysfs/group.c:66 (discriminator 3)) [ 164.738431][ T3878] ? make_kgid (kernel/user_namespace.c:475) [ 164.738434][ T3878] internal_create_group (fs/sysfs/group.c:148) [ 164.738438][ T3878] ? down_write (arch/x86/include/asm/atomic64_64.h:34 include/linux/atomic/atomic-long.h:41 include/linux/atomic/atomic-instrumented.h:1280 kernel/locking/rwsem.c:139 kernel/locking/rwsem.c:256 kernel/locking/rwsem.c:1286 kernel/locking/rwsem.c:1296 kernel/locking/rwsem.c:1543) [ 164.738441][ T3878] ? create_files (fs/sysfs/group.c:109) [ 164.738444][ T3878] ? __cond_resched (kernel/sched/core.c:8217) [ 164.738448][ T3878] ? down_write (arch/x86/include/asm/atomic64_64.h:34 include/linux/atomic/atomic-long.h:41 include/linux/atomic/atomic-instrumented.h:1280 kernel/locking/rwsem.c:139 kernel/locking/rwsem.c:256 kernel/locking/rwsem.c:1286 kernel/locking/rwsem.c:1296 kernel/locking/rwsem.c:1543) [ 164.738452][ T3878] internal_create_groups+0x7c/0x140 [ 164.738456][ T3878] device_add_attrs (drivers/base/core.c:2621) [ 164.738460][ T3878] ? klist_children_put (drivers/base/core.c:2614) [ 164.738464][ T3878] ? kernfs_create_link (fs/kernfs/symlink.c:48) [ 164.738467][ T3878] ? kernfs_put (arch/x86/include/asm/atomic.h:123 (discriminator 1) include/linux/atomic/atomic-instrumented.h:576 (discriminator 1) fs/kernfs/dir.c:521 (discriminator 1)) [ 164.738471][ T3878] device_add (drivers/base/core.c:3368) [ 164.738476][ T3878] ? device_initialize (drivers/base/core.c:3200) [ 164.738479][ T3878] ? __fw_devlink_link_to_suppliers (drivers/base/core.c:3299) [ 164.738484][ T3878] ? __hrtimer_init (kernel/time/hrtimer.c:1559) [ 164.738488][ T3878] netdev_register_kobject (net/core/net-sysfs.c:2014) [ 164.738493][ T3878] register_netdevice (net/core/dev.c:10047) [ 164.738498][ T3878] ? __cond_resched (kernel/sched/core.c:8217) [ 164.738502][ T3878] ? netdev_change_features (net/core/dev.c:9942) [ 164.738507][ T3878] register_netdev (net/core/dev.c:10171) [ 164.738511][ T3878] register_candev (drivers/net/can/dev/dev.c:460) can_dev [ 164.738522][ T3878] ? can_set_termination (drivers/net/can/dev/dev.c:460) can_dev [ 164.738529][ T3878] ? _raw_spin_lock (arch/x86/include/asm/atomic.h:202 include/linux/atomic/atomic-instrumented.h:543 include/asm-generic/qspinlock.h:111 include/linux/spinlock.h:185 include/linux/spinlock_api_smp.h:134 kernel/locking/spinlock.c:154) [ 164.738533][ T3878] ? alloc_candev_mqs (drivers/net/can/dev/dev.c:284) can_dev [ 164.738541][ T3878] slcan_open (drivers/net/can/slcan.c:598) slcan [ 164.738547][ T3878] tty_ldisc_open (drivers/tty/tty_ldisc.c:433) [ 164.738552][ T3878] tty_set_ldisc (drivers/tty/tty_ldisc.c:558) [ 164.738557][ T3878] tty_ioctl (drivers/tty/tty_io.c:2714) [ 164.738561][ T3878] ? tty_release (drivers/tty/tty_io.c:2655) [ 164.738565][ T3878] ? __switch_to (arch/x86/kernel/process.h:38 arch/x86/kernel/process_64.c:627) [ 164.738569][ T3878] ? __schedule (kernel/sched/core.c:6310) [ 164.738574][ T3878] ? io_schedule_timeout (kernel/sched/core.c:6310) [ 164.738578][ T3878] ? __fget_files (arch/x86/include/asm/atomic64_64.h:22 include/linux/atomic/atomic-arch-fallback.h:2363 include/linux/atomic/atomic-arch-fallback.h:2388 include/linux/atomic/atomic-arch-fallback.h:2404 include/linux/atomic/atomic-long.h:497 include/linux/atomic/atomic-instrumented.h:1854 fs/file.c:882 fs/file.c:913) [ 164.738583][ T3878] __x64_sys_ioctl (fs/ioctl.c:52 fs/ioctl.c:870 fs/ioctl.c:856 fs/ioctl.c:856) [ 164.738587][ T3878] do_syscall_64 (arch/x86/entry/common.c:50 arch/x86/entry/common.c:80) [ 164.738591][ T3878] entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:115) [ 164.738596][ T3878] RIP: 0033:0x7f86f3323cc7 [ 164.738599][ T3878] Code: 00 00 00 48 8b 05 c9 91 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 91 0c 00 f7 d8 64 89 01 48 All code ======== 0: 00 00 add %al,(%rax) 2: 00 48 8b add %cl,-0x75(%rax) 5: 05 c9 91 0c 00 add $0xc91c9,%eax a: 64 c7 00 26 00 00 00 movl $0x26,%fs:(%rax) 11: 48 c7 c0 ff ff ff ff mov $0xffffffffffffffff,%rax 18: c3 retq 19: 66 2e 0f 1f 84 00 00 nopw %cs:0x0(%rax,%rax,1) 20: 00 00 00 23: b8 10 00 00 00 mov $0x10,%eax 28: 0f 05 syscall 2a:* 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax <-- trapping instruction 30: 73 01 jae 0x33 32: c3 retq 33: 48 8b 0d 99 91 0c 00 mov 0xc9199(%rip),%rcx # 0xc91d3 3a: f7 d8 neg %eax 3c: 64 89 01 mov %eax,%fs:(%rcx) 3f: 48 rex.W Code starting with the faulting instruction =========================================== 0: 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax 6: 73 01 jae 0x9 8: c3 retq 9: 48 8b 0d 99 91 0c 00 mov 0xc9199(%rip),%rcx # 0xc91a9 10: f7 d8 neg %eax 12: 64 89 01 mov %eax,%fs:(%rcx) 15: 48 rex.W [ 164.738603][ T3878] RSP: 002b:00007fff6a8fb8b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [ 164.738608][ T3878] RAX: ffffffffffffffda RBX: 00007f86f322c6c0 RCX: 00007f86f3323cc7 [ 164.738611][ T3878] RDX: 000055911985c700 RSI: 0000000000005423 RDI: 000000000000000d [ 164.738613][ T3878] RBP: 000055911985c700 R08: 0000000000000000 R09: cccccccccccccccd [ 164.738616][ T3878] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000000000d [ 164.738618][ T3878] R13: 0000000000000006 R14: 000055911985c6a0 R15: 0000000000000004 [ 164.738621][ T3878] </TASK> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 2 weeks

1
0
0 / 0

[bitops] 001bea109d: BUG:KASAN:wild-memory-access_in_dmar_parse_one_rhsa

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 001bea109daf51941db554c798c1c7de3e98b243 ("bitops: unify non-atomic bitops prototypes across architectures") https://github.com/alobakin/linux bitops in testcase: nvml version: nvml-x86_64-3de7d358f-1_20211217 with following parameters: test: pmem group: pmemobjcli nr_pmem: 1 fs: ext4 mount_option: dax bp_memmap: 32G!4G ucode: 0x700001c on test machine: 16 threads 1 sockets Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 3.971080][ T0] BUG: KASAN: wild-memory-access in dmar_parse_one_rhsa (arch/x86/include/asm/bitops.h:214 arch/x86/include/asm/bitops.h:226 include/asm-generic/bitops/instrumented-non-atomic.h:142 include/linux/nodemask.h:415 drivers/iommu/intel/dmar.c:497) [ 3.978906][ T0] Read of size 8 at addr 1fffffff853197d8 by task swapper/0/0 [ 3.986212][ T0] [ 3.988406][ T0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.19.0-rc3-00030-g001bea109daf #1 [ 3.997097][ T0] Hardware name: Supermicro SYS-5018D-FN4T/X10SDV-8C-TLN4F, BIOS 1.1 03/02/2016 [ 4.005965][ T0] Call Trace: [ 4.009109][ T0] <TASK> [ 4.011910][ T0] ? dmar_parse_one_rhsa (arch/x86/include/asm/bitops.h:214 arch/x86/include/asm/bitops.h:226 include/asm-generic/bitops/instrumented-non-atomic.h:142 include/linux/nodemask.h:415 drivers/iommu/intel/dmar.c:497) [ 4.017045][ T0] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 1)) [ 4.021408][ T0] kasan_report (mm/kasan/report.c:162 mm/kasan/report.c:493) [ 4.025680][ T0] ? dmar_parse_one_rhsa (arch/x86/include/asm/bitops.h:214 arch/x86/include/asm/bitops.h:226 include/asm-generic/bitops/instrumented-non-atomic.h:142 include/linux/nodemask.h:415 drivers/iommu/intel/dmar.c:497) [ 4.030818][ T0] kasan_check_range (mm/kasan/generic.c:190) [ 4.035525][ T0] dmar_parse_one_rhsa (arch/x86/include/asm/bitops.h:214 arch/x86/include/asm/bitops.h:226 include/asm-generic/bitops/instrumented-non-atomic.h:142 include/linux/nodemask.h:415 drivers/iommu/intel/dmar.c:497) [ 4.040492][ T0] dmar_walk_remapping_entries (drivers/iommu/intel/dmar.c:609) [ 4.046149][ T0] parse_dmar_table (drivers/iommu/intel/dmar.c:671) [ 4.050855][ T0] ? dmar_table_detect (drivers/iommu/intel/dmar.c:633) [ 4.055647][ T0] ? dmar_free_dev_scope (drivers/iommu/intel/dmar.c:408) [ 4.060787][ T0] ? init_dmars (drivers/iommu/intel/iommu.c:3359) [ 4.065148][ T0] ? iommu_resume (drivers/iommu/intel/iommu.c:3419) [ 4.069680][ T0] ? dmar_walk_dsm_resource+0x300/0x300 [ 4.075685][ T0] ? dmar_acpi_insert_dev_scope (drivers/iommu/intel/dmar.c:466) [ 4.081431][ T0] ? dmar_check_one_atsr (drivers/iommu/intel/iommu.c:3521) [ 4.086571][ T0] dmar_table_init (drivers/iommu/intel/dmar.c:846) [ 4.091018][ T0] intel_prepare_irq_remapping (drivers/iommu/intel/irq_remapping.c:742) [ 4.096591][ T0] irq_remapping_prepare (drivers/iommu/irq_remapping.c:102) [ 4.101558][ T0] enable_IR_x2apic (arch/x86/kernel/apic/apic.c:1928) [ 4.106177][ T0] default_setup_apic_routing (arch/x86/kernel/apic/probe_64.c:25 (discriminator 1)) [ 4.111661][ T0] apic_intr_mode_init (arch/x86/kernel/apic/apic.c:1446) [ 4.116541][ T0] x86_late_time_init (arch/x86/kernel/time.c:101) [ 4.121247][ T0] start_kernel (init/main.c:1101) [ 4.125606][ T0] secondary_startup_64_no_verify (arch/x86/kernel/head_64.S:358) [ 4.131353][ T0] </TASK> [ 4.134243][ T0] ================================================================== [ 4.142161][ T0] Disabling lock debugging due to kernel taint [ 4.148174][ T0] DMAR-IR: IOAPIC id 8 under DRHD base 0xfbffc000 IOMMU 0 [ 4.155230][ T0] DMAR-IR: IOAPIC id 9 under DRHD base 0xfbffc000 IOMMU 0 [ 4.162287][ T0] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 4.168386][ T0] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 4.168388][ T0] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 4.184851][ T0] DMAR-IR: IRQ remapping was enabled on dmar0 but we are not in kdump mode [ 4.193386][ T0] DMAR-IR: Enabled IRQ remapping in xapic mode [ 4.199389][ T0] x2apic: IRQ remapping doesn't support X2APIC mode [ 4.205839][ T0] Switched APIC routing to physical flat. [ 4.211420][ T0] masked ExtINT on CPU#0 [ 4.215858][ T0] ENABLING IO-APIC IRQs [ 4.219887][ T0] init IO_APIC IRQs [ 4.223554][ T0] apic 8 pin 0 not connected [ 4.228102][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.242262][ T0] IOAPIC[0]: Preconfigured routing entry (8-1 -> IRQ 1 Level:0 ActiveLow:0) [ 4.250797][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:30 Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.264961][ T0] IOAPIC[0]: Preconfigured routing entry (8-2 -> IRQ 0 Level:0 ActiveLow:0) [ 4.273501][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.287663][ T0] IOAPIC[0]: Preconfigured routing entry (8-3 -> IRQ 3 Level:0 ActiveLow:0) [ 4.296195][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.310354][ T0] IOAPIC[0]: Preconfigured routing entry (8-4 -> IRQ 4 Level:0 ActiveLow:0) [ 4.318885][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.333042][ T0] IOAPIC[0]: Preconfigured routing entry (8-5 -> IRQ 5 Level:0 ActiveLow:0) [ 4.341583][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.355742][ T0] IOAPIC[0]: Preconfigured routing entry (8-6 -> IRQ 6 Level:0 ActiveLow:0) [ 4.364273][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.378431][ T0] IOAPIC[0]: Preconfigured routing entry (8-7 -> IRQ 7 Level:0 ActiveLow:0) [ 4.386964][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.401120][ T0] IOAPIC[0]: Preconfigured routing entry (8-8 -> IRQ 8 Level:0 ActiveLow:0) [ 4.409653][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.423810][ T0] IOAPIC[0]: Preconfigured routing entry (8-9 -> IRQ 9 Level:1 ActiveLow:0) [ 4.432347][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.446509][ T0] IOAPIC[0]: Preconfigured routing entry (8-10 -> IRQ 10 Level:0 ActiveLow:0) [ 4.455217][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.469371][ T0] IOAPIC[0]: Preconfigured routing entry (8-11 -> IRQ 11 Level:0 ActiveLow:0) [ 4.478077][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.492236][ T0] IOAPIC[0]: Preconfigured routing entry (8-12 -> IRQ 12 Level:0 ActiveLow:0) [ 4.500941][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.515097][ T0] IOAPIC[0]: Preconfigured routing entry (8-13 -> IRQ 13 Level:0 ActiveLow:0) [ 4.523807][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.537961][ T0] IOAPIC[0]: Preconfigured routing entry (8-14 -> IRQ 14 Level:0 ActiveLow:0) [ 4.546671][ T0] IOAPIC[8]: Set IRTE entry (P:1 FPD:0 Dst_Mode:0 Redir_hint:1 Trig_Mode:0 Dlvry_Mode:0 Avail:0 Vector:EF Dest:00000000 SID:F0FF SQ:0 SVT:1) [ 4.560824][ T0] IOAPIC[0]: Preconfigured routing entry (8-15 -> IRQ 15 Level:0 ActiveLow:0) [ 4.569519][ T0] apic 8 pin 16 not connected [ 4.574133][ T0] apic 8 pin 17 not connected [ 4.578743][ T0] apic 8 pin 18 not connected [ 4.583356][ T0] apic 8 pin 19 not connected [ 4.587975][ T0] apic 8 pin 20 not connected [ 4.592593][ T0] apic 8 pin 21 not connected [ 4.597203][ T0] apic 8 pin 22 not connected [ 4.601816][ T0] apic 8 pin 23 not connected [ 4.606434][ T0] apic 9 pin 0 not connected [ 4.610958][ T0] apic 9 pin 1 not connected [ 4.615483][ T0] apic 9 pin 2 not connected [ 4.620015][ T0] apic 9 pin 3 not connected [ 4.624539][ T0] apic 9 pin 4 not connected [ 4.629064][ T0] apic 9 pin 5 not connected [ 4.633596][ T0] apic 9 pin 6 not connected [ 4.638121][ T0] apic 9 pin 7 not connected [ 4.642653][ T0] apic 9 pin 8 not connected [ 4.647185][ T0] apic 9 pin 9 not connected [ 4.651710][ T0] apic 9 pin 10 not connected [ 4.656322][ T0] apic 9 pin 11 not connected [ 4.660940][ T0] apic 9 pin 12 not connected [ 4.665552][ T0] apic 9 pin 13 not connected [ 4.670172][ T0] apic 9 pin 14 not connected [ 4.674789][ T0] apic 9 pin 15 not connected To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 2 weeks

1
0
0 / 0

[filemap] 91fd26c76b: phoronix-test-suite.fio.SequentialRead.LinuxAIO.Yes.No.4KB.DefaultTestDirectory.mb_s -8.9% regression

by kernel test robot

Greeting, FYI, we noticed a -8.9% regression of phoronix-test-suite.fio.SequentialRead.LinuxAIO.Yes.No.4KB.DefaultTestDirectory.mb_s due to commit: commit: 91fd26c76b86231276b6d7ac71d02d6fde78e297 ("[PATCH 1/3] filemap: Correct the conditions for marking a folio as accessed") url: https://github.com/intel-lab-lkp/linux/commits/Matthew-Wilcox-Oracle/Fixe... base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git 4b35035bcf80ddb47c0112c4fbd84a63a2836a18 patch link: https://lore.kernel.org/linux-mm/20220619151143.1054746-2-willy@infradead... in testcase: phoronix-test-suite on test machine: 96 threads 2 sockets Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory with following parameters: test: fio-1.14.1 option_a: Sequential Read option_b: Linux AIO option_c: Yes option_d: No option_e: 4KB option_f: Default Test Directory cpufreq_governor: performance ucode: 0x500320a test-description: The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available that provides an extensible framework for which new tests can be easily added. test-url: http://www.phoronix-test-suite.com/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= compiler/cpufreq_governor/kconfig/option_a/option_b/option_c/option_d/option_e/option_f/rootfs/tbox_group/test/testcase/ucode: gcc-11/performance/x86_64-rhel-8.3/Sequential Read/Linux AIO/Yes/No/4KB/Default Test Directory/debian-x86_64-phoronix/lkp-csl-2sp7/fio-1.14.1/phoronix-test-suite/0x500320a commit: 4b35035bcf ("Merge tag 'nfs-for-5.19-2' of git://git.linux-nfs.org/projects/anna/linux-nfs") 91fd26c76b ("filemap: Correct the conditions for marking a folio as accessed") 4b35035bcf80ddb4 91fd26c76b86231276b6d7ac71d ---------------- --------------------------- %stddev %change %stddev \ | \ 477611 -8.9% 435055 phoronix-test-suite.fio.SequentialRead.LinuxAIO.Yes.No.4KB.DefaultTestDirectory.iops 1865 -8.9% 1699 phoronix-test-suite.fio.SequentialRead.LinuxAIO.Yes.No.4KB.DefaultTestDirectory.mb_s 2.871e+08 -8.8% 2.619e+08 phoronix-test-suite.time.file_system_inputs 925561 +45.0% 1342367 ± 4% numa-meminfo.node0.Active 89584 ± 15% +466.8% 507739 ± 11% numa-meminfo.node0.Active(file) 22395 ± 15% +464.5% 126419 ± 11% numa-vmstat.node0.nr_active_file 22395 ± 15% +464.5% 126422 ± 11% numa-vmstat.node0.nr_zone_active_file 1168858 -8.9% 1064851 vmstat.io.bi 20386 -7.7% 18809 vmstat.system.cs 950958 +43.6% 1365179 ± 3% meminfo.Active 112156 +369.8% 526961 ± 7% meminfo.Active(file) 2764971 -14.5% 2364011 meminfo.Inactive 1502049 -26.2% 1108866 meminfo.Inactive(file) 31273678 -7.0% 29071736 perf-stat.i.cache-misses 20797 -7.8% 19169 perf-stat.i.context-switches 6002418 -8.5% 5491342 perf-stat.i.node-loads 6357381 -7.6% 5874070 perf-stat.i.node-stores 239.46 ± 9% +14.4% 273.86 ± 5% perf-stat.overall.cycles-between-cache-misses 30990966 -7.1% 28805139 perf-stat.ps.cache-misses 20608 -7.8% 18993 perf-stat.ps.context-switches 5947870 -8.5% 5440625 perf-stat.ps.node-loads 6299557 -7.6% 5819731 perf-stat.ps.node-stores 28038 +370.1% 131814 ± 7% proc-vmstat.nr_active_file 98818 -1.6% 97280 proc-vmstat.nr_anon_pages 375391 -26.2% 277223 proc-vmstat.nr_inactive_file 28038 +370.1% 131814 ± 7% proc-vmstat.nr_zone_active_file 375391 -26.2% 277223 proc-vmstat.nr_zone_inactive_file 511.83 ± 14% +79.3% 917.83 ± 63% proc-vmstat.numa_hint_faults_local 40090769 -7.8% 36977817 proc-vmstat.numa_hit 39810116 -7.7% 36751505 proc-vmstat.numa_local 316086 +10350.9% 33034013 proc-vmstat.pgactivate 39795174 -7.9% 36645119 proc-vmstat.pgalloc_normal 39417989 -8.0% 36280723 proc-vmstat.pgfree 1.436e+08 -8.8% 1.31e+08 proc-vmstat.pgpgin 18.38 ± 10% -2.5 15.86 ± 2% perf-profile.calltrace.cycles-pp.ret_from_fork 18.38 ± 10% -2.5 15.86 ± 2% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 17.11 ± 10% -2.5 14.62 ± 2% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 15.09 ± 10% -2.4 12.67 ± 2% perf-profile.calltrace.cycles-pp.loop_process_work.process_one_work.worker_thread.kthread.ret_from_fork 15.28 ± 10% -2.4 12.88 ± 2% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 14.03 ± 9% -2.3 11.71 ± 3% perf-profile.calltrace.cycles-pp.do_iter_read.loop_process_work.process_one_work.worker_thread.kthread 13.60 ± 9% -2.2 11.36 ± 2% perf-profile.calltrace.cycles-pp.do_iter_readv_writev.do_iter_read.loop_process_work.process_one_work.worker_thread 13.51 ± 9% -2.2 11.28 ± 2% perf-profile.calltrace.cycles-pp.shmem_file_read_iter.do_iter_readv_writev.do_iter_read.loop_process_work.process_one_work 11.84 ± 9% -1.9 9.90 ± 3% perf-profile.calltrace.cycles-pp.copy_page_to_iter.shmem_file_read_iter.do_iter_readv_writev.do_iter_read.loop_process_work 11.76 ± 9% -1.9 9.83 ± 3% perf-profile.calltrace.cycles-pp._copy_to_iter.copy_page_to_iter.shmem_file_read_iter.do_iter_readv_writev.do_iter_read 0.00 +0.6 0.62 ± 4% perf-profile.calltrace.cycles-pp.__folio_activate.pagevec_lru_move_fn.folio_mark_accessed.filemap_read.aio_read 0.00 +0.7 0.71 ± 6% perf-profile.calltrace.cycles-pp.workingset_activation.folio_mark_accessed.filemap_read.aio_read.io_submit_one 0.00 +1.1 1.14 ± 5% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.folio_mark_accessed.filemap_read.aio_read.io_submit_one 11.35 ± 8% +1.5 12.80 ± 2% perf-profile.calltrace.cycles-pp.filemap_read.aio_read.io_submit_one.__x64_sys_io_submit.do_syscall_64 0.26 ±100% +2.3 2.54 ± 6% perf-profile.calltrace.cycles-pp.folio_mark_accessed.filemap_read.aio_read.io_submit_one.__x64_sys_io_submit 51.18 ± 2% +2.3 53.50 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry 56.89 ± 2% +2.4 59.30 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 56.38 ± 2% +2.4 58.79 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 56.40 ± 2% +2.4 58.82 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 56.40 ± 2% +2.4 58.82 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify 55.10 ± 3% +2.5 57.56 perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify 18.39 ± 10% -2.5 15.86 ± 2% perf-profile.children.cycles-pp.ret_from_fork 18.38 ± 10% -2.5 15.86 ± 2% perf-profile.children.cycles-pp.kthread 17.11 ± 10% -2.5 14.62 ± 2% perf-profile.children.cycles-pp.worker_thread 15.11 ± 10% -2.4 12.69 ± 2% perf-profile.children.cycles-pp.loop_process_work 15.28 ± 10% -2.4 12.88 ± 2% perf-profile.children.cycles-pp.process_one_work 14.04 ± 9% -2.3 11.72 ± 2% perf-profile.children.cycles-pp.do_iter_read 13.61 ± 9% -2.2 11.36 ± 2% perf-profile.children.cycles-pp.do_iter_readv_writev 13.52 ± 9% -2.2 11.28 ± 2% perf-profile.children.cycles-pp.shmem_file_read_iter 15.62 ± 5% -2.2 13.40 ± 2% perf-profile.children.cycles-pp.copy_page_to_iter 11.78 ± 9% -1.9 9.84 ± 3% perf-profile.children.cycles-pp._copy_to_iter 1.07 ± 10% -0.2 0.92 ± 4% perf-profile.children.cycles-pp.shmem_getpage_gfp 0.53 ± 5% -0.1 0.39 ± 11% perf-profile.children.cycles-pp.security_file_permission 0.46 ± 5% -0.1 0.32 ± 13% perf-profile.children.cycles-pp.apparmor_file_permission 0.32 ± 6% -0.1 0.25 ± 9% perf-profile.children.cycles-pp.touch_atime 0.26 ± 6% -0.1 0.20 ± 11% perf-profile.children.cycles-pp.atime_needs_update 0.50 -0.1 0.45 ± 5% perf-profile.children.cycles-pp.free_pcppages_bulk 0.38 ± 6% -0.0 0.33 ± 2% perf-profile.children.cycles-pp.ksys_read 0.42 ± 5% -0.0 0.38 ± 5% perf-profile.children.cycles-pp.read_tsc 0.37 ± 6% -0.0 0.33 perf-profile.children.cycles-pp.vfs_read 0.24 ± 9% -0.0 0.21 ± 2% perf-profile.children.cycles-pp.seq_read_iter 0.13 ± 6% -0.0 0.10 ± 14% perf-profile.children.cycles-pp.current_time 0.12 ± 5% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.__libc_read 0.02 ±141% +0.1 0.08 ± 22% perf-profile.children.cycles-pp.mem_cgroup_update_lru_size 0.02 ±142% +0.1 0.08 ± 9% perf-profile.children.cycles-pp.folio_lruvec_lock_irqsave 0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.__count_memcg_events 0.17 ± 12% +0.1 0.26 ± 7% perf-profile.children.cycles-pp.__mod_node_page_state 0.25 ± 13% +0.1 0.37 ± 8% perf-profile.children.cycles-pp.__mod_lruvec_state 2.61 ± 5% +0.3 2.86 ± 4% perf-profile.children.cycles-pp.tick_sched_timer 2.04 ± 6% +0.3 2.32 ± 7% perf-profile.children.cycles-pp.update_process_times 0.00 +0.5 0.46 ± 11% perf-profile.children.cycles-pp.workingset_age_nonresident 0.00 +0.6 0.64 ± 4% perf-profile.children.cycles-pp.__folio_activate 0.00 +0.7 0.72 ± 7% perf-profile.children.cycles-pp.workingset_activation 0.00 +1.1 1.14 ± 5% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.51 ± 9% +2.1 2.59 ± 6% perf-profile.children.cycles-pp.folio_mark_accessed 56.89 ± 2% +2.4 59.29 perf-profile.children.cycles-pp.do_idle 56.89 ± 2% +2.4 59.30 perf-profile.children.cycles-pp.secondary_startup_64_no_verify 56.89 ± 2% +2.4 59.30 perf-profile.children.cycles-pp.cpu_startup_entry 56.40 ± 2% +2.4 58.82 perf-profile.children.cycles-pp.start_secondary 55.60 ± 2% +2.5 58.06 perf-profile.children.cycles-pp.cpuidle_idle_call 11.69 ± 9% -1.9 9.78 ± 3% perf-profile.self.cycles-pp._copy_to_iter 0.37 ± 6% -0.1 0.24 ± 15% perf-profile.self.cycles-pp.apparmor_file_permission 0.13 ± 12% -0.0 0.10 ± 14% perf-profile.self.cycles-pp.atime_needs_update 0.08 ± 17% +0.0 0.11 ± 6% perf-profile.self.cycles-pp.__mod_lruvec_state 0.18 ± 12% +0.1 0.26 ± 12% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 0.16 ± 14% +0.1 0.25 ± 8% perf-profile.self.cycles-pp.__mod_node_page_state 0.49 ± 9% +0.2 0.71 ± 9% perf-profile.self.cycles-pp.folio_mark_accessed 0.00 +0.2 0.25 ± 5% perf-profile.self.cycles-pp.workingset_activation 0.00 +0.3 0.30 ± 9% perf-profile.self.cycles-pp.pagevec_lru_move_fn 0.00 +0.3 0.34 ± 9% perf-profile.self.cycles-pp.__folio_activate 0.00 +0.5 0.46 ± 11% perf-profile.self.cycles-pp.workingset_age_nonresident Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 2 weeks

1
0
0 / 0

[VFS] 46a2afd9f6: ltp.rename10.fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 46a2afd9f68f24a42f38f3a8afebafe7e494e9d8 ("[PATCH 06/12] VFS: support concurrent renames.") url: https://github.com/intel-lab-lkp/linux/commits/NeilBrown/Allow-concurrent... base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git b13baccc3850ca8b8cccbf8ed9912dbaa0fdf7f3 patch link: https://lore.kernel.org/linux-nfs/165516230199.21248.18142980966152036732... in testcase: ltp version: ltp-x86_64-14c1f76-1_20220618 with following parameters: disk: 1HDD fs: ext4 test: syscalls-02 ucode: 0xec test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features. test-url: http://linux-test-project.github.io/ on test machine: 4 threads Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz with 32G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> <<<test_start>>> tag=rename10 stime=1655898309 cmdline="rename10" contacts="" analysis=exit <<<test_output>>> rename10 1 TFAIL : rename10.c:123: call succeeded unexpectedly rename10 2 TPASS : expected failure - errno = 2 : No such file or directory <<<execution_status>>> initiation_status="ok" duration=0 termination_type=exited termination_id=1 corefile=no cutime=0 cstime=1 <<<test_end>>> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 2 weeks

1
0
0 / 0

[block] d85c85c4da: blktests.scsi/004.fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: d85c85c4da6a7795261519c895665c45e6dea954 ("block: untangle request_queue refcounting from sysfs") git://git.infradead.org/users/hch/block.git block-sysfs-cleanups in testcase: blktests version: blktests-x86_64-19ccca4-1_20220621 with following parameters: disk: 1HDD test: scsi-group-02 ucode: 0x700001c on test machine: 16 threads 1 sockets Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): actually we also noticed blktests.scsi/005.fail upon this commit but can pass on parent: ceedefac0670e104 d85c85c4da6a7795261519c8956 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :6 100% 6:6 blktests.scsi/004.fail :6 100% 6:6 blktests.scsi/005.fail If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> 2022-06-22 05:19:27 sed "s:^:scsi/:" /lkp/benchmarks/blktests/tests/scsi-group-02 2022-06-22 05:19:27 ./check scsi/004 scsi/005 scsi/004 (ensure repeated TASK SET FULL results in EIO on timing out command) scsi/004 (ensure repeated TASK SET FULL results in EIO on timing out command) [failed] --- tests/scsi/004.out 2022-06-21 17:26:34.000000000 +0000 +++ /lkp/benchmarks/blktests/results/nodev/scsi/004.out.bad 2022-06-22 05:19:28.159296904 +0000 @@ -1,3 +1,5 @@ Running scsi/004 -Input/output error +ls: cannot access '/sys/class/scsi_device/6:*/device/block': No such file or directory +tests/scsi/004: line 30: /sys/block//device/timeout: No such file or directory +tests/scsi/004: line 37: /sys/block//device/queue_depth: No such file or directory Test complete scsi/005 (test SCSI device blacklisting) scsi/005 (test SCSI device blacklisting) [failed] --- tests/scsi/005.out 2022-06-21 17:26:34.000000000 +0000 +++ /lkp/benchmarks/blktests/results/nodev/scsi/005.out.bad 2022-06-22 05:19:30.564296820 +0000 @@ -1,10 +1,42 @@ Running scsi/005 - -AAAAAAAA BBBBBBBBBBBBBBBB -HITACHI OPEN-V REPORTLUN2 TRY_VPD_PAGES - Scanner NOLUN -Inateck -Promise STEX SPARSELUN ... (Run 'diff -u tests/scsi/005.out /lkp/benchmarks/blktests/results/nodev/scsi/005.out.bad' to see the entire diff) To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 3 weeks

1
0
0 / 0

53889cbba5: unixbench.score 4.9% improvement

by kernel test robot

Greeting, FYI, we noticed a 4.9% improvement of unixbench.score due to commit: commit: 53889cbba547c1c2d5986a9cd5c24f7c74cb60c6 ("switch new_sync_{read,write}() to ITER_UBUF") https://git.kernel.org/cgit/linux/kernel/git/viro/vfs.git work.iov_iter in testcase: unixbench on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory with following parameters: runtime: 300s nr_task: 1 test: pipe cpufreq_governor: performance ucode: 0xd000331 test-description: UnixBench is the original BYTE UNIX benchmark suite aims to test performance of Unix-like system. test-url: https://github.com/kdlucas/byte-unixbench In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------------------------------------------+ | testcase: change | unixbench: unixbench.score 5.1% improvement | | test machine | 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory | | test parameters | cpufreq_governor=performance | | | nr_task=30% | | | runtime=300s | | | test=pipe | | | ucode=0xd000331 | +------------------+---------------------------------------------------------------------------------+ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-11/performance/x86_64-rhel-8.3/1/debian-11.1-x86_64-20220510.cgz/300s/lkp-icl-2sp2/pipe/unixbench/0xd000331 commit: 6696361cc3 ("new iov_iter flavour - ITER_UBUF") 53889cbba5 ("switch new_sync_{read,write}() to ITER_UBUF") 6696361cc3d8045e 53889cbba547c1c2d5986a9cd5c ---------------- --------------------------- %stddev %change %stddev \ | \ 1708 +4.9% 1791 unixbench.score 8.287e+08 +4.9% 8.694e+08 unixbench.workload 720.67 ± 4% -14.1% 619.17 ± 13% numa-vmstat.node0.nr_page_table_pages 4246 ± 11% +33.9% 5684 ± 11% numa-vmstat.node1.nr_slab_reclaimable 5390 ± 28% +61.5% 8705 ± 11% sched_debug.cfs_rq:/.min_vruntime.min 143.52 ± 8% +14.3% 164.07 ± 6% sched_debug.cpu.clock_task.stddev 2884 ± 5% -14.1% 2478 ± 13% numa-meminfo.node0.PageTables 16986 ± 11% +33.9% 22737 ± 11% numa-meminfo.node1.KReclaimable 680093 +24.8% 848544 ± 14% numa-meminfo.node1.MemUsed 16986 ± 11% +33.9% 22737 ± 11% numa-meminfo.node1.SReclaimable 102557 ± 4% +14.7% 117640 ± 5% numa-meminfo.node1.Slab 3873762 ± 4% +5.8% 4099788 ± 6% perf-stat.i.cache-references 0.00 +0.0 0.00 ± 5% perf-stat.i.dTLB-load-miss-rate% 13216 +38.9% 18360 ± 7% perf-stat.i.dTLB-load-misses 1.405e+09 +1.2% 1.422e+09 perf-stat.i.dTLB-loads 0.82 ± 4% +6.4% 0.88 ± 6% perf-stat.overall.MPKI 0.00 +0.0 0.00 ± 8% perf-stat.overall.dTLB-load-miss-rate% 2213 -5.1% 2099 perf-stat.overall.path-length 3864227 ± 4% +5.8% 4089229 ± 6% perf-stat.ps.cache-references 13184 +38.9% 18314 ± 7% perf-stat.ps.dTLB-load-misses 1.401e+09 +1.2% 1.419e+09 perf-stat.ps.dTLB-loads 7.69 ± 19% -7.7 0.00 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.12 ± 19% -7.1 0.00 perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 6.82 ± 20% -6.8 0.00 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.25 ± 20% -6.3 0.00 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 0.30 ±100% +0.3 0.64 ± 11% perf-profile.calltrace.cycles-pp.cpu_startup_entry.rest_init.arch_call_rest_init.start_kernel.secondary_startup_64_no_verify 0.30 ±100% +0.3 0.64 ± 11% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.rest_init.arch_call_rest_init.start_kernel 0.30 ±100% +0.3 0.64 ± 11% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify 0.30 ±100% +0.3 0.64 ± 11% perf-profile.calltrace.cycles-pp.arch_call_rest_init.start_kernel.secondary_startup_64_no_verify 0.30 ±100% +0.3 0.64 ± 11% perf-profile.calltrace.cycles-pp.rest_init.arch_call_rest_init.start_kernel.secondary_startup_64_no_verify 0.00 +0.7 0.72 ± 16% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.vfs_read.ksys_read 0.00 +0.8 0.76 ± 12% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.vfs_write.ksys_write 0.00 +0.8 0.84 ± 16% perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +0.9 0.88 ± 14% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +0.9 0.92 ± 10% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +1.4 1.43 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +1.5 1.46 ± 14% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter.pipe_write.vfs_write 0.00 +1.7 1.69 ± 13% perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.pipe_write.vfs_write.ksys_write 0.00 +1.8 1.84 ± 15% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read 0.00 +2.4 2.36 ± 14% perf-profile.calltrace.cycles-pp._copy_from_iter.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +2.5 2.46 ± 14% perf-profile.calltrace.cycles-pp._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read.ksys_read 0.00 +2.8 2.77 ± 14% perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +6.4 6.44 ± 14% perf-profile.calltrace.cycles-pp.pipe_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +7.6 7.64 ± 11% perf-profile.calltrace.cycles-pp.pipe_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.76 ± 19% -7.8 0.00 perf-profile.children.cycles-pp.new_sync_write 6.88 ± 20% -6.9 0.00 perf-profile.children.cycles-pp.new_sync_read 0.51 ± 19% +0.1 0.64 ± 11% perf-profile.children.cycles-pp.start_kernel 0.51 ± 19% +0.1 0.64 ± 11% perf-profile.children.cycles-pp.arch_call_rest_init 0.51 ± 19% +0.1 0.64 ± 11% perf-profile.children.cycles-pp.rest_init 4.25 ± 10% +0.6 4.88 ± 5% perf-profile.children.cycles-pp.menu_select 0.56 ± 24% -0.2 0.36 ± 19% perf-profile.self.cycles-pp._copy_to_iter 0.56 ± 19% -0.2 0.39 ± 21% perf-profile.self.cycles-pp._copy_from_iter 0.14 ± 22% -0.0 0.10 ± 20% perf-profile.self.cycles-pp.__might_fault 0.45 ± 12% +0.2 0.68 ± 12% perf-profile.self.cycles-pp.vfs_write 0.46 ± 21% +0.3 0.73 ± 13% perf-profile.self.cycles-pp.vfs_read *************************************************************************************************** lkp-icl-2sp2: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-11/performance/x86_64-rhel-8.3/30%/debian-11.1-x86_64-20220510.cgz/300s/lkp-icl-2sp2/pipe/unixbench/0xd000331 commit: 6696361cc3 ("new iov_iter flavour - ITER_UBUF") 53889cbba5 ("switch new_sync_{read,write}() to ITER_UBUF") 6696361cc3d8045e 53889cbba547c1c2d5986a9cd5c ---------------- --------------------------- %stddev %change %stddev \ | \ 64561 +5.1% 67831 unixbench.score 9713 -1.2% 9599 unixbench.time.system_time 1602 +7.1% 1716 unixbench.time.user_time 3.138e+10 +5.0% 3.295e+10 unixbench.workload 9897912 +46.8% 14527340 ± 2% perf-stat.i.branch-misses 0.00 ± 3% +0.0 0.00 perf-stat.i.dTLB-load-miss-rate% 150639 ± 2% +113.2% 321130 ± 2% perf-stat.i.dTLB-load-misses 4.203e+10 +1.4% 4.262e+10 perf-stat.i.dTLB-loads 2.57e+10 -1.3% 2.537e+10 perf-stat.i.dTLB-stores 1.365e+11 -1.4% 1.346e+11 perf-stat.i.instructions 1.51 -1.8% 1.48 perf-stat.i.ipc 0.04 +0.0 0.06 ± 2% perf-stat.overall.branch-miss-rate% 0.57 +1.4% 0.58 perf-stat.overall.cpi 0.00 ± 2% +0.0 0.00 ± 2% perf-stat.overall.dTLB-load-miss-rate% 1.74 -1.4% 1.72 perf-stat.overall.ipc 1702 -6.1% 1599 perf-stat.overall.path-length 9878244 +46.8% 14503803 ± 2% perf-stat.ps.branch-misses 150480 ± 2% +113.2% 320812 ± 2% perf-stat.ps.dTLB-load-misses 4.199e+10 +1.4% 4.259e+10 perf-stat.ps.dTLB-loads 2.567e+10 -1.3% 2.535e+10 perf-stat.ps.dTLB-stores 1.363e+11 -1.3% 1.345e+11 perf-stat.ps.instructions 5.343e+13 -1.4% 5.27e+13 perf-stat.total.instructions 29.42 -29.4 0.00 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 27.18 -27.2 0.00 perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 25.43 -25.4 0.00 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 23.37 -23.4 0.00 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64 10.83 -10.8 0.00 perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read 9.93 -9.9 0.00 perf-profile.calltrace.cycles-pp._copy_to_iter.copy_page_to_iter.pipe_read.new_sync_read.vfs_read 9.23 -9.2 0.00 perf-profile.calltrace.cycles-pp._copy_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write 7.18 -7.2 0.00 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.copy_page_to_iter.pipe_read.new_sync_read 6.32 -6.3 0.00 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.pipe_write.new_sync_write.vfs_write 5.04 -5.0 0.00 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter.pipe_write.new_sync_write 30.12 -1.0 29.10 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 33.16 -0.8 32.33 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 35.35 -0.6 34.71 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 6.43 -0.6 5.80 perf-profile.calltrace.cycles-pp.__entry_text_start.read 36.68 -0.6 36.08 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 33.59 -0.5 33.14 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 36.77 -0.4 36.38 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 47.98 -0.4 47.62 perf-profile.calltrace.cycles-pp.read 39.08 -0.3 38.82 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 5.86 -0.2 5.67 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.copy_page_to_iter.pipe_read 0.56 +0.0 0.59 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write 0.57 +0.0 0.60 perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.63 +0.0 0.66 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_safe_stack.read 0.56 ± 2% +0.0 0.60 ± 2% perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 0.85 +0.1 0.90 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.53 ± 2% +0.1 0.58 ± 2% perf-profile.calltrace.cycles-pp.__might_resched.__might_fault._copy_to_iter.copy_page_to_iter.pipe_read 0.95 +0.1 1.01 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 1.59 ± 2% +0.1 1.66 perf-profile.calltrace.cycles-pp.apparmor_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 2.01 +0.1 2.08 perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.15 +0.1 2.24 perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 1.71 +0.1 1.82 ± 2% perf-profile.calltrace.cycles-pp.main 2.11 +0.1 2.23 perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 6.04 +0.4 6.44 perf-profile.calltrace.cycles-pp.__entry_text_start.write 0.00 +0.5 0.53 ± 3% perf-profile.calltrace.cycles-pp.__might_resched.__might_fault._copy_from_iter.pipe_write.vfs_write 0.00 +0.6 0.60 perf-profile.calltrace.cycles-pp.__might_resched.mutex_lock.pipe_write.vfs_write.ksys_write 0.00 +0.6 0.62 ± 2% perf-profile.calltrace.cycles-pp.__might_resched.mutex_lock.pipe_read.vfs_read.ksys_read 0.00 +0.6 0.64 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_safe_stack.write 51.10 +0.7 51.84 perf-profile.calltrace.cycles-pp.write 0.00 +0.9 0.94 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.vfs_write.ksys_write 0.00 +1.1 1.06 perf-profile.calltrace.cycles-pp.__might_fault._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read 0.00 +1.1 1.08 ± 2% perf-profile.calltrace.cycles-pp.__might_fault._copy_from_iter.pipe_write.vfs_write.ksys_write 0.00 +1.2 1.19 ± 2% perf-profile.calltrace.cycles-pp.current_time.atime_needs_update.touch_atime.pipe_read.vfs_read 0.00 +1.3 1.28 ± 2% perf-profile.calltrace.cycles-pp.current_time.file_update_time.pipe_write.vfs_write.ksys_write 0.00 +1.6 1.58 perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +1.7 1.72 perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +1.7 1.74 perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +1.8 1.84 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +2.2 2.20 perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +2.5 2.52 perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.vfs_read.ksys_read 0.00 +2.8 2.75 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.vfs_write.ksys_write 0.00 +3.0 3.01 perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +3.4 3.37 perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +3.4 3.38 perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +5.1 5.06 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +5.3 5.29 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter.pipe_write.vfs_write 0.00 +6.4 6.37 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read 0.00 +6.8 6.75 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter.pipe_write.vfs_write.ksys_write 0.00 +8.5 8.50 perf-profile.calltrace.cycles-pp._copy_from_iter.pipe_write.vfs_write.ksys_write.do_syscall_64 0.00 +8.6 8.56 perf-profile.calltrace.cycles-pp._copy_to_iter.copy_page_to_iter.pipe_read.vfs_read.ksys_read 0.00 +9.7 9.70 perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.vfs_read.ksys_read.do_syscall_64 0.00 +23.0 22.98 perf-profile.calltrace.cycles-pp.pipe_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +27.4 27.37 perf-profile.calltrace.cycles-pp.pipe_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 29.66 -29.7 0.00 perf-profile.children.cycles-pp.new_sync_write 25.68 -25.7 0.00 perf-profile.children.cycles-pp.new_sync_read 10.11 -1.2 8.87 perf-profile.children.cycles-pp._copy_to_iter 11.02 -1.1 9.88 perf-profile.children.cycles-pp.copy_page_to_iter 30.36 -1.0 29.34 perf-profile.children.cycles-pp.vfs_read 75.43 -0.9 74.54 perf-profile.children.cycles-pp.do_syscall_64 33.38 -0.8 32.58 perf-profile.children.cycles-pp.ksys_read 77.32 -0.8 76.55 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 9.46 -0.7 8.78 perf-profile.children.cycles-pp._copy_from_iter 47.87 -0.5 47.33 perf-profile.children.cycles-pp.read 33.91 -0.5 33.39 perf-profile.children.cycles-pp.vfs_write 37.02 -0.4 36.63 perf-profile.children.cycles-pp.ksys_write 24.13 -0.3 23.79 perf-profile.children.cycles-pp.pipe_read 2.73 -0.3 2.45 perf-profile.children.cycles-pp.__might_fault 6.71 -0.2 6.49 perf-profile.children.cycles-pp.copyout 2.81 -0.1 2.66 perf-profile.children.cycles-pp.__might_resched 0.37 ± 4% -0.1 0.30 ± 3% perf-profile.children.cycles-pp.anon_pipe_buf_release 0.63 -0.0 0.60 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.78 ± 2% +0.0 0.81 perf-profile.children.cycles-pp.rw_verify_area 0.63 +0.0 0.66 perf-profile.children.cycles-pp.rcu_all_qs 0.54 ± 3% +0.0 0.58 perf-profile.children.cycles-pp.fsnotify_perm 1.61 +0.1 1.67 perf-profile.children.cycles-pp.aa_file_perm 0.45 ± 2% +0.1 0.50 ± 2% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 1.29 ± 2% +0.1 1.35 perf-profile.children.cycles-pp.syscall_return_via_sysret 1.26 +0.1 1.32 perf-profile.children.cycles-pp.__cond_resched 1.30 +0.1 1.38 perf-profile.children.cycles-pp.syscall_enter_from_user_mode 2.36 +0.1 2.44 perf-profile.children.cycles-pp.file_update_time 2.77 +0.1 2.87 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 2.26 +0.1 2.38 perf-profile.children.cycles-pp.syscall_exit_to_user_mode 2.64 +0.1 2.76 perf-profile.children.cycles-pp.current_time 2.52 +0.2 2.68 perf-profile.children.cycles-pp.atime_needs_update 0.83 +0.2 1.00 ± 2% perf-profile.children.cycles-pp.__wake_up_common 3.07 +0.2 3.25 perf-profile.children.cycles-pp.touch_atime 1.10 +0.2 1.30 perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 4.42 +0.2 4.64 perf-profile.children.cycles-pp.__fdget_pos 5.18 +0.3 5.45 perf-profile.children.cycles-pp.__wake_up_common_lock 5.92 +0.3 6.26 perf-profile.children.cycles-pp.copyin 6.90 +0.4 7.25 perf-profile.children.cycles-pp.mutex_lock 6.24 +0.5 6.69 perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack 2.98 +0.5 3.47 perf-profile.children.cycles-pp.mutex_unlock 2.10 -0.8 1.26 perf-profile.self.cycles-pp._copy_to_iter 2.14 -0.7 1.43 ± 2% perf-profile.self.cycles-pp._copy_from_iter 2.99 -0.3 2.68 perf-profile.self.cycles-pp.write 2.49 -0.2 2.34 perf-profile.self.cycles-pp.__might_resched 0.47 ± 2% -0.1 0.42 ± 5% perf-profile.self.cycles-pp.__might_fault 0.27 ± 5% -0.0 0.22 ± 5% perf-profile.self.cycles-pp.anon_pipe_buf_release 0.37 ± 3% -0.0 0.35 ± 2% perf-profile.self.cycles-pp.copy_page_from_iter 0.31 ± 2% +0.0 0.33 perf-profile.self.cycles-pp.rcu_all_qs 0.62 ± 2% +0.0 0.65 perf-profile.self.cycles-pp.rw_verify_area 0.46 +0.0 0.49 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.79 +0.0 0.82 perf-profile.self.cycles-pp.__cond_resched 0.62 ± 2% +0.0 0.66 perf-profile.self.cycles-pp.touch_atime 0.95 ± 2% +0.0 0.99 perf-profile.self.cycles-pp.ksys_write 0.29 ± 3% +0.1 0.35 ± 3% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 1.29 ± 2% +0.1 1.35 perf-profile.self.cycles-pp.syscall_return_via_sysret 1.68 +0.1 1.74 perf-profile.self.cycles-pp.current_time 1.10 +0.1 1.16 perf-profile.self.cycles-pp.syscall_enter_from_user_mode 1.42 +0.1 1.48 perf-profile.self.cycles-pp.aa_file_perm 1.56 +0.1 1.64 perf-profile.self.cycles-pp.do_syscall_64 1.55 +0.1 1.62 perf-profile.self.cycles-pp.__might_sleep 1.14 +0.1 1.24 perf-profile.self.cycles-pp.atime_needs_update 0.87 +0.1 0.96 perf-profile.self.cycles-pp.syscall_exit_to_user_mode 2.68 +0.1 2.78 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.90 +0.1 1.00 perf-profile.self.cycles-pp.ksys_read 2.04 +0.1 2.17 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.75 ± 2% +0.1 0.88 ± 2% perf-profile.self.cycles-pp.__wake_up_common 1.68 ± 2% +0.1 1.82 ± 2% perf-profile.self.cycles-pp.main 3.59 +0.2 3.76 perf-profile.self.cycles-pp.mutex_lock 1.10 +0.2 1.30 perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 4.25 +0.2 4.46 perf-profile.self.cycles-pp.__fdget_pos 1.78 +0.2 2.02 perf-profile.self.cycles-pp.__entry_text_start 3.01 +0.4 3.42 perf-profile.self.cycles-pp.pipe_read 6.08 +0.4 6.53 perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack 2.82 +0.5 3.30 perf-profile.self.cycles-pp.mutex_unlock 1.80 +0.7 2.50 perf-profile.self.cycles-pp.vfs_write 1.74 +0.7 2.48 perf-profile.self.cycles-pp.vfs_read Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 3 weeks

1
0
0 / 0

[cpuidle,intel_idle] 32d4fd5751: WARNING:at_kernel/rcu/tree.c:#rcu_eqs_exit

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 32d4fd5751eadbe1823a37eb38df85ec5c8e6207 ("cpuidle,intel_idle: Fix CPUIDLE_FLAG_IRQ_ENABLE") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: kernel-selftests version: kernel-selftests-x86_64-cef46213-1_20220609 with following parameters: group: resctrl ucode: 0x500320a test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel. test-url: https://www.kernel.org/doc/Documentation/kselftest.txt on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 29.104402][ T0] WARNING: CPU: 0 PID: 0 at kernel/rcu/tree.c:864 rcu_eqs_exit+0x4b/0xc0 [ 29.104417][ T0] [ 29.104418][ T0] ============================= [ 29.104419][ T0] WARNING: suspicious RCU usage [ 29.104421][ T0] 5.19.0-rc1-00001-g32d4fd5751ea #1 Not tainted [ 29.104424][ T0] ----------------------------- [ 29.104425][ T0] include/trace/events/lock.h:24 suspicious rcu_dereference_check() usage! [ 29.104428][ T0] [ 29.104428][ T0] other info that might help us debug this: [ 29.104428][ T0] [ 29.104430][ T0] [ 29.104430][ T0] rcu_scheduler_active = 2, debug_locks = 1 [ 29.104432][ T0] RCU used illegally from extended quiescent state! [ 29.104433][ T0] no locks held by swapper/0/0. [ 29.104435][ T0] [ 29.104435][ T0] stack backtrace: [ 29.104436][ T0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.19.0-rc1-00001-g32d4fd5751ea #1 [ 29.104439][ T0] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0012.070720200218 07/07/2020 [ 29.104441][ T0] Call Trace: [ 29.104443][ T0] <TASK> [ 29.104449][ T0] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 4)) [ 29.104457][ T0] lock_acquire.cold (include/trace/events/lock.h:24 kernel/locking/lockdep.c:5636) [ 29.104465][ T0] ? rcu_read_unlock (include/linux/rcupdate.h:724 (discriminator 5)) [ 29.104480][ T0] ? check_prev_add (kernel/locking/lockdep.c:3785) [ 29.104483][ T0] ? console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.104490][ T0] _raw_spin_lock_irqsave (include/linux/spinlock_api_smp.h:111 kernel/locking/spinlock.c:162) [ 29.104495][ T0] ? down_trylock (kernel/locking/semaphore.c:140) [ 29.104499][ T0] down_trylock (kernel/locking/semaphore.c:140) [ 29.104501][ T0] ? console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.104505][ T0] __down_trylock_console_sem (kernel/printk/printk.c:273) [ 29.104509][ T0] console_trylock (kernel/printk/printk.c:2728) [ 29.104512][ T0] console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.104517][ T0] vprintk_emit (kernel/printk/printk.c:2400) [ 29.104520][ T0] ? __irq_work_queue_local (kernel/irq_work.c:101 (discriminator 1)) [ 29.104528][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104533][ T0] _printk (kernel/printk/printk.c:2417) [ 29.104537][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.104540][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104545][ T0] ? _printk (kernel/printk/printk.c:2417) [ 29.104548][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.104557][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104561][ T0] __warn (kernel/panic.c:616) [ 29.104569][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104574][ T0] report_bug (lib/bug.c:200) [ 29.104585][ T0] handle_bug (arch/x86/kernel/traps.c:316) [ 29.104588][ T0] exc_invalid_op (arch/x86/kernel/traps.c:336 (discriminator 1)) [ 29.104592][ T0] asm_exc_invalid_op (arch/x86/include/asm/idtentry.h:568) [ 29.104596][ T0] RIP: rcu_eqs_exit+0x4b/0xc0 [ 29.104600][ T0] Code: 1d 32 68 43 7c 48 8b 83 40 01 00 00 48 85 c0 74 1d 48 83 c0 01 48 89 83 40 01 00 00 5b 5d c3 65 8b 05 75 ca 43 7c 85 c0 74 cc <0f> 0b eb c8 e8 6c ff ff ff 48 8d ab 50 01 00 00 be 04 00 00 00 48 All code ======== 0: 1d 32 68 43 7c sbb $0x7c436832,%eax 5: 48 8b 83 40 01 00 00 mov 0x140(%rbx),%rax c: 48 85 c0 test %rax,%rax f: 74 1d je 0x2e 11: 48 83 c0 01 add $0x1,%rax 15: 48 89 83 40 01 00 00 mov %rax,0x140(%rbx) 1c: 5b pop %rbx 1d: 5d pop %rbp 1e: c3 retq 1f: 65 8b 05 75 ca 43 7c mov %gs:0x7c43ca75(%rip),%eax # 0x7c43ca9b 26: 85 c0 test %eax,%eax 28: 74 cc je 0xfffffffffffffff6 2a:* 0f 0b ud2 <-- trapping instruction 2c: eb c8 jmp 0xfffffffffffffff6 2e: e8 6c ff ff ff callq 0xffffffffffffff9f 33: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 3a: be 04 00 00 00 mov $0x4,%esi 3f: 48 rex.W Code starting with the faulting instruction =========================================== 0: 0f 0b ud2 2: eb c8 jmp 0xffffffffffffffcc 4: e8 6c ff ff ff callq 0xffffffffffffff75 9: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 10: be 04 00 00 00 mov $0x4,%esi 15: 48 rex.W [ 29.104603][ T0] RSP: 0000:ffffffff85207da0 EFLAGS: 00010002 [ 29.104607][ T0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff825face9 [ 29.104609][ T0] RDX: 1ffffffff0b823e0 RSI: 0000000000000008 RDI: ffffffff852387c0 [ 29.104611][ T0] RBP: ffffffff85c11e40 R08: 0000000000000000 R09: ffffffff852387c7 [ 29.104612][ T0] R10: fffffbfff0a470f8 R11: 0000000000000001 R12: 0000000000000001 [ 29.104614][ T0] R13: ffffe8ec26c031ec R14: ffffffff85c11ec0 R15: ffffe8ec26c031e8 [ 29.104623][ T0] ? mwait_idle_with_hints (include/linux/instrumented.h:71 include/asm-generic/bitops/instrumented-non-atomic.h:134 include/linux/thread_info.h:118 include/linux/sched/idle.h:88 arch/x86/include/asm/mwait.h:120) [ 29.104635][ T0] cpuidle_enter_state (drivers/cpuidle/cpuidle.c:239) [ 29.104648][ T0] cpuidle_enter (drivers/cpuidle/cpuidle.c:353) [ 29.104653][ T0] cpuidle_idle_call (kernel/sched/idle.c:155 kernel/sched/idle.c:236) [ 29.104659][ T0] ? arch_cpu_idle_exit+0xc0/0xc0 [ 29.104664][ T0] ? lockdep_hardirqs_on_prepare (kernel/locking/lockdep.c:4526) [ 29.104667][ T0] ? tick_nohz_idle_enter (arch/x86/include/asm/irqflags.h:45 (discriminator 3) arch/x86/include/asm/irqflags.h:80 (discriminator 3) kernel/time/tick-sched.c:1163 (discriminator 3)) [ 29.104671][ T0] ? trace_hardirqs_on (kernel/trace/trace_preemptirq.c:50 (discriminator 22)) [ 29.104676][ T0] ? tsc_verify_tsc_adjust (arch/x86/kernel/tsc_sync.c:58) [ 29.104685][ T0] do_idle (kernel/sched/idle.c:303) [ 29.104690][ T0] cpu_startup_entry (kernel/sched/idle.c:399 (discriminator 1)) [ 29.104694][ T0] rest_init (include/linux/rcupdate.h:696 init/main.c:697) [ 29.104698][ T0] arch_call_rest_init+0xf/0x15 [ 29.104704][ T0] start_kernel (init/main.c:1139) [ 29.104709][ T0] secondary_startup_64_no_verify (arch/x86/kernel/head_64.S:358) [ 29.104728][ T0] </TASK> [ 29.104730][ T0] [ 29.104731][ T0] ============================= [ 29.104732][ T0] WARNING: suspicious RCU usage [ 29.104732][ T0] 5.19.0-rc1-00001-g32d4fd5751ea #1 Not tainted [ 29.104734][ T0] ----------------------------- [ 29.104734][ T0] include/trace/events/lock.h:69 suspicious rcu_dereference_check() usage! [ 29.104736][ T0] [ 29.104736][ T0] other info that might help us debug this: [ 29.104736][ T0] [ 29.104737][ T0] [ 29.104737][ T0] rcu_scheduler_active = 2, debug_locks = 1 [ 29.104738][ T0] RCU used illegally from extended quiescent state! [ 29.104739][ T0] 1 lock held by swapper/0/0: [ 29.104740][ T0] #0: ffffffff85778a98 ((console_sem).lock){....}-{2:2}, at: down_trylock (kernel/locking/semaphore.c:140) [ 29.104748][ T0] [ 29.104748][ T0] stack backtrace: [ 29.104749][ T0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.19.0-rc1-00001-g32d4fd5751ea #1 [ 29.104751][ T0] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0012.070720200218 07/07/2020 [ 29.104752][ T0] Call Trace: [ 29.104753][ T0] <TASK> [ 29.104756][ T0] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 4)) [ 29.104760][ T0] ? down_trylock (kernel/locking/semaphore.c:145) [ 29.104761][ T0] lock_release.cold (include/trace/events/lock.h:69 kernel/locking/lockdep.c:5676) [ 29.104766][ T0] _raw_spin_unlock_irqrestore (include/linux/spinlock_api_smp.h:150 kernel/locking/spinlock.c:194) [ 29.104770][ T0] down_trylock (kernel/locking/semaphore.c:145) [ 29.104772][ T0] ? console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.104775][ T0] __down_trylock_console_sem (kernel/printk/printk.c:273) [ 29.104779][ T0] console_trylock (kernel/printk/printk.c:2728) [ 29.104782][ T0] console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.104787][ T0] vprintk_emit (kernel/printk/printk.c:2400) [ 29.104790][ T0] ? __irq_work_queue_local (kernel/irq_work.c:101 (discriminator 1)) [ 29.104796][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104800][ T0] _printk (kernel/printk/printk.c:2417) [ 29.104804][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.104806][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104811][ T0] ? _printk (kernel/printk/printk.c:2417) [ 29.104815][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.104825][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104829][ T0] __warn (kernel/panic.c:616) [ 29.104833][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.104838][ T0] report_bug (lib/bug.c:200) [ 29.104847][ T0] handle_bug (arch/x86/kernel/traps.c:316) [ 29.104850][ T0] exc_invalid_op (arch/x86/kernel/traps.c:336 (discriminator 1)) [ 29.104854][ T0] asm_exc_invalid_op (arch/x86/include/asm/idtentry.h:568) [ 29.104856][ T0] RIP: rcu_eqs_exit+0x4b/0xc0 [ 29.104859][ T0] Code: 1d 32 68 43 7c 48 8b 83 40 01 00 00 48 85 c0 74 1d 48 83 c0 01 48 89 83 40 01 00 00 5b 5d c3 65 8b 05 75 ca 43 7c 85 c0 74 cc <0f> 0b eb c8 e8 6c ff ff ff 48 8d ab 50 01 00 00 be 04 00 00 00 48 All code ======== 0: 1d 32 68 43 7c sbb $0x7c436832,%eax 5: 48 8b 83 40 01 00 00 mov 0x140(%rbx),%rax c: 48 85 c0 test %rax,%rax f: 74 1d je 0x2e 11: 48 83 c0 01 add $0x1,%rax 15: 48 89 83 40 01 00 00 mov %rax,0x140(%rbx) 1c: 5b pop %rbx 1d: 5d pop %rbp 1e: c3 retq 1f: 65 8b 05 75 ca 43 7c mov %gs:0x7c43ca75(%rip),%eax # 0x7c43ca9b 26: 85 c0 test %eax,%eax 28: 74 cc je 0xfffffffffffffff6 2a:* 0f 0b ud2 <-- trapping instruction 2c: eb c8 jmp 0xfffffffffffffff6 2e: e8 6c ff ff ff callq 0xffffffffffffff9f 33: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 3a: be 04 00 00 00 mov $0x4,%esi 3f: 48 rex.W Code starting with the faulting instruction =========================================== 0: 0f 0b ud2 2: eb c8 jmp 0xffffffffffffffcc 4: e8 6c ff ff ff callq 0xffffffffffffff75 9: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 10: be 04 00 00 00 mov $0x4,%esi 15: 48 rex.W [ 29.104861][ T0] RSP: 0000:ffffffff85207da0 EFLAGS: 00010002 [ 29.104863][ T0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff825face9 [ 29.104865][ T0] RDX: 1ffffffff0b823e0 RSI: 0000000000000008 RDI: ffffffff852387c0 [ 29.104866][ T0] RBP: ffffffff85c11e40 R08: 0000000000000000 R09: ffffffff852387c7 [ 29.104867][ T0] R10: fffffbfff0a470f8 R11: 0000000000000001 R12: 0000000000000001 [ 29.104868][ T0] R13: ffffe8ec26c031ec R14: ffffffff85c11ec0 R15: ffffe8ec26c031e8 [ 29.104878][ T0] ? mwait_idle_with_hints (include/linux/instrumented.h:71 include/asm-generic/bitops/instrumented-non-atomic.h:134 include/linux/thread_info.h:118 include/linux/sched/idle.h:88 arch/x86/include/asm/mwait.h:120) [ 29.104888][ T0] cpuidle_enter_state (drivers/cpuidle/cpuidle.c:239) [ 29.104897][ T0] cpuidle_enter (drivers/cpuidle/cpuidle.c:353) [ 29.104903][ T0] cpuidle_idle_call (kernel/sched/idle.c:155 kernel/sched/idle.c:236) [ 29.104907][ T0] ? arch_cpu_idle_exit+0xc0/0xc0 [ 29.104912][ T0] ? lockdep_hardirqs_on_prepare (kernel/locking/lockdep.c:4526) [ 29.104915][ T0] ? tick_nohz_idle_enter (arch/x86/include/asm/irqflags.h:45 (discriminator 3) arch/x86/include/asm/irqflags.h:80 (discriminator 3) kernel/time/tick-sched.c:1163 (discriminator 3)) [ 29.104917][ T0] ? trace_hardirqs_on (kernel/trace/trace_preemptirq.c:50 (discriminator 22)) [ 29.104919][ T0] ? tsc_verify_tsc_adjust (arch/x86/kernel/tsc_sync.c:58) [ 29.104926][ T0] do_idle (kernel/sched/idle.c:303) [ 29.104931][ T0] cpu_startup_entry (kernel/sched/idle.c:399 (discriminator 1)) [ 29.104935][ T0] rest_init (include/linux/rcupdate.h:696 init/main.c:697) [ 29.104939][ T0] arch_call_rest_init+0xf/0x15 [ 29.104941][ T0] start_kernel (init/main.c:1139) [ 29.104947][ T0] secondary_startup_64_no_verify (arch/x86/kernel/head_64.S:358) [ 29.104964][ T0] </TASK> [ 29.105350][ T0] [ 29.105350][ T0] ============================= [ 29.105350][ T0] WARNING: suspicious RCU usage [ 29.105350][ T0] 5.19.0-rc1-00001-g32d4fd5751ea #1 Not tainted [ 29.105350][ T0] ----------------------------- [ 29.105350][ T0] include/linux/rcupdate.h:696 rcu_read_lock() used illegally while idle! [ 29.105350][ T0] [ 29.105350][ T0] other info that might help us debug this: [ 29.105350][ T0] [ 29.105350][ T0] [ 29.105350][ T0] rcu_scheduler_active = 2, debug_locks = 1 [ 29.105350][ T0] RCU used illegally from extended quiescent state! [ 29.105350][ T0] 4 locks held by swapper/0/0: [ 29.105350][ T0] #0: ffffffff85778a20 (console_lock){+.+.}-{0:0}, at: console_trylock_spinning (kernel/printk/printk.c:2000) [ 29.105350][ T0] #1: ffffffff853f8380 (console_owner){....}-{0:0}, at: __console_emit_next_record (kernel/printk/printk.c:2909 (discriminator 3)) [ 29.105350][ T0] #2: ffffffff85ca5098 (printing_lock){+.+.}-{2:2}, at: vt_console_print (drivers/tty/vt/vt.c:3090) [ 29.105350][ T0] #3: ffffffff85789b40 (rcu_read_lock){....}-{1:2}, at: atomic_notifier_call_chain (kernel/notifier.c:221) [ 29.105350][ T0] [ 29.105350][ T0] stack backtrace: [ 29.105350][ T0] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.19.0-rc1-00001-g32d4fd5751ea #1 [ 29.105350][ T0] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0012.070720200218 07/07/2020 [ 29.105350][ T0] Call Trace: [ 29.105350][ T0] <TASK> [ 29.105350][ T0] dump_stack_lvl (lib/dump_stack.c:107 (discriminator 4)) [ 29.105350][ T0] atomic_notifier_call_chain (include/linux/rcupdate.h:696 kernel/notifier.c:224) [ 29.105350][ T0] vt_console_print (drivers/tty/vt/vt.c:3137) [ 29.105350][ T0] ? __lock_acquire (kernel/locking/lockdep.c:4973) [ 29.105350][ T0] ? lf (drivers/tty/vt/vt.c:3079) [ 29.105350][ T0] ? rwlock_bug+0xc0/0xc0 [ 29.105350][ T0] ? __console_emit_next_record (kernel/printk/printk.c:1938 (discriminator 3) kernel/printk/printk.c:2910 (discriminator 3)) [ 29.105350][ T0] __console_emit_next_record (kernel/printk/printk.c:2075 kernel/printk/printk.c:2916) [ 29.105350][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.105350][ T0] ? devkmsg_read (kernel/printk/printk.c:2856) [ 29.105350][ T0] ? __lock_acquire (kernel/locking/lockdep.c:5053) [ 29.105350][ T0] ? lock_acquire (kernel/locking/lockdep.c:466 kernel/locking/lockdep.c:5667 kernel/locking/lockdep.c:5630) [ 29.105350][ T0] console_flush_all (kernel/printk/printk.c:2950 kernel/printk/printk.c:3007) [ 29.105350][ T0] console_unlock (kernel/printk/printk.c:3074) [ 29.105350][ T0] ? wake_up_klogd (kernel/printk/printk.c:3046) [ 29.105350][ T0] ? kmsg_dump_register (kernel/printk/printk.c:4043) [ 29.105350][ T0] ? __down_trylock_console_sem (kernel/printk/printk.c:279) [ 29.105350][ T0] vprintk_emit (kernel/printk/printk.c:2401) [ 29.105350][ T0] ? __irq_work_queue_local (kernel/irq_work.c:101 (discriminator 1)) [ 29.105350][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.105350][ T0] _printk (kernel/printk/printk.c:2417) [ 29.105350][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.105350][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.105350][ T0] ? _printk (kernel/printk/printk.c:2417) [ 29.105350][ T0] ? record_print_text.cold (kernel/printk/printk.c:2417) [ 29.105350][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.105350][ T0] __warn (kernel/panic.c:616) [ 29.105350][ T0] ? rcu_eqs_exit+0x4b/0xc0 [ 29.105350][ T0] report_bug (lib/bug.c:200) [ 29.105350][ T0] handle_bug (arch/x86/kernel/traps.c:316) [ 29.105350][ T0] exc_invalid_op (arch/x86/kernel/traps.c:336 (discriminator 1)) [ 29.105350][ T0] asm_exc_invalid_op (arch/x86/include/asm/idtentry.h:568) [ 29.105350][ T0] RIP: rcu_eqs_exit+0x4b/0xc0 [ 29.105350][ T0] Code: 1d 32 68 43 7c 48 8b 83 40 01 00 00 48 85 c0 74 1d 48 83 c0 01 48 89 83 40 01 00 00 5b 5d c3 65 8b 05 75 ca 43 7c 85 c0 74 cc <0f> 0b eb c8 e8 6c ff ff ff 48 8d ab 50 01 00 00 be 04 00 00 00 48 All code ======== 0: 1d 32 68 43 7c sbb $0x7c436832,%eax 5: 48 8b 83 40 01 00 00 mov 0x140(%rbx),%rax c: 48 85 c0 test %rax,%rax f: 74 1d je 0x2e 11: 48 83 c0 01 add $0x1,%rax 15: 48 89 83 40 01 00 00 mov %rax,0x140(%rbx) 1c: 5b pop %rbx 1d: 5d pop %rbp 1e: c3 retq 1f: 65 8b 05 75 ca 43 7c mov %gs:0x7c43ca75(%rip),%eax # 0x7c43ca9b 26: 85 c0 test %eax,%eax 28: 74 cc je 0xfffffffffffffff6 2a:* 0f 0b ud2 <-- trapping instruction 2c: eb c8 jmp 0xfffffffffffffff6 2e: e8 6c ff ff ff callq 0xffffffffffffff9f 33: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 3a: be 04 00 00 00 mov $0x4,%esi 3f: 48 rex.W Code starting with the faulting instruction =========================================== 0: 0f 0b ud2 2: eb c8 jmp 0xffffffffffffffcc 4: e8 6c ff ff ff callq 0xffffffffffffff75 9: 48 8d ab 50 01 00 00 lea 0x150(%rbx),%rbp 10: be 04 00 00 00 mov $0x4,%esi 15: 48 rex.W [ 29.105350][ T0] RSP: 0000:ffffffff85207da0 EFLAGS: 00010002 [ 29.105350][ T0] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff825face9 [ 29.105350][ T0] RDX: 1ffffffff0b823e0 RSI: 0000000000000008 RDI: ffffffff852387c0 [ 29.105350][ T0] RBP: ffffffff85c11e40 R08: 0000000000000000 R09: ffffffff852387c7 [ 29.105350][ T0] R10: fffffbfff0a470f8 R11: 0000000000000001 R12: 0000000000000001 [ 29.105350][ T0] R13: ffffe8ec26c031ec R14: ffffffff85c11ec0 R15: ffffe8ec26c031e8 [ 29.105350][ T0] ? mwait_idle_with_hints (include/linux/instrumented.h:71 include/asm-generic/bitops/instrumented-non-atomic.h:134 include/linux/thread_info.h:118 include/linux/sched/idle.h:88 arch/x86/include/asm/mwait.h:120) [ 29.105350][ T0] cpuidle_enter_state (drivers/cpuidle/cpuidle.c:239) [ 29.105350][ T0] cpuidle_enter (drivers/cpuidle/cpuidle.c:353) [ 29.105350][ T0] cpuidle_idle_call (kernel/sched/idle.c:155 kernel/sched/idle.c:236) [ 29.105350][ T0] ? arch_cpu_idle_exit+0xc0/0xc0 [ 29.105350][ T0] ? lockdep_hardirqs_on_prepare (kernel/locking/lockdep.c:4526) [ 29.105350][ T0] ? tick_nohz_idle_enter (arch/x86/include/asm/irqflags.h:45 (discriminator 3) arch/x86/include/asm/irqflags.h:80 (discriminator 3) kernel/time/tick-sched.c:1163 (discriminator 3)) [ 29.105350][ T0] ? trace_hardirqs_on (kernel/trace/trace_preemptirq.c:50 (discriminator 22)) [ 29.105350][ T0] ? tsc_verify_tsc_adjust (arch/x86/kernel/tsc_sync.c:58) [ 29.105350][ T0] do_idle (kernel/sched/idle.c:303) [ 29.105350][ T0] cpu_startup_entry (kernel/sched/idle.c:399 (discriminator 1)) [ 29.105350][ T0] rest_init (include/linux/rcupdate.h:696 init/main.c:697) [ 29.105350][ T0] arch_call_rest_init+0xf/0x15 [ 29.105350][ T0] start_kernel (init/main.c:1139) [ 29.105350][ T0] secondary_startup_64_no_verify (arch/x86/kernel/head_64.S:358) [ 29.105350][ T0] </TASK> [ 29.105350][ T0] [ 29.105350][ T0] ============================= To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

1 month, 3 weeks

2
1
0 / 0

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP June 2022