FYI, we noticed the below changes on https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master commit 192132b9a034d87566294be0fba5f8f75c2cf16b ("net: Add support for VRFs to inetpeer cache") ========================================================================================= tbox_group/testcase/rootfs/kconfig/compiler/cpufreq_governor/runtime/nr_threads/cluster/test: lkp-sbx04/netperf/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/performance/300s/200%/cs-localhost/TCP_CRR commit: 5345c2e12d41f815c1009c9dee72f3d5fcfd4282 192132b9a034d87566294be0fba5f8f75c2cf16b 5345c2e12d41f815 192132b9a034d87566294be0fb ---------------- -------------------------- %stddev %change %stddev \ | \ 2841 ± 2% -17.5% 2344 ± 1% netperf.Throughput_tps 1.095e+08 ± 2% -17.3% 90493497 ± 1% netperf.time.involuntary_context_switches 1.093e+08 ± 2% -17.5% 90186076 ± 1% netperf.time.minor_page_faults 4612 ± 0% +9.8% 5062 ± 1% netperf.time.percent_of_cpu_this_job_got 13149 ± 0% +11.7% 14686 ± 1% netperf.time.system_time 943.49 ± 3% -17.1% 781.88 ± 1% netperf.time.user_time 1.091e+08 ± 2% -17.5% 90055371 ± 1% netperf.time.voluntary_context_switches 4.367e+08 ± 2% -17.5% 3.604e+08 ± 1% softirqs.NET_RX 320.02 ± 0% -2.2% 312.95 ± 0% turbostat.CorWatt 375.96 ± 0% -1.9% 368.88 ± 0% turbostat.PkgWatt 1428128 ± 2% -17.3% 1180769 ± 1% vmstat.system.cs 68804 ± 0% +1.2% 69635 ± 0% vmstat.system.in 23930 ±148% -97.8% 522.50 ± 21% numa-meminfo.node0.Shmem 1358 ±141% +301.8% 5457 ± 19% numa-meminfo.node2.AnonHugePages 118910 ± 3% +40.5% 167013 ± 25% numa-meminfo.node2.FilePages 2519 ±143% +279.0% 9548 ± 9% numa-meminfo.node2.Inactive(anon) 2604 ±140% +1850.5% 50791 ± 82% numa-meminfo.node2.Shmem 1.095e+08 ± 2% -17.3% 90493497 ± 1% time.involuntary_context_switches 1.093e+08 ± 2% -17.5% 90186076 ± 1% time.minor_page_faults 4612 ± 0% +9.8% 5062 ± 1% time.percent_of_cpu_this_job_got 13149 ± 0% +11.7% 14686 ± 1% time.system_time 943.49 ± 3% -17.1% 781.88 ± 1% time.user_time 1.091e+08 ± 2% -17.5% 90055371 ± 1% time.voluntary_context_switches 0.00 ± -1% +Inf% 12974495 ±167% latency_stats.avg.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath 1.092e+08 ± 2% -17.5% 90102386 ± 1% latency_stats.hits.inet_csk_accept.inet_accept.SYSC_accept4.SyS_accept.entry_SYSCALL_64_fastpath 2.183e+08 ± 2% -17.5% 1.801e+08 ± 1% latency_stats.hits.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.SyS_recvfrom.entry_SYSCALL_64_fastpath 0.00 ± -1% +Inf% 13170498 ±164% latency_stats.max.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath 13924 ± 43% +112.0% 29515 ± 95% latency_stats.sum.call_rwsem_down_write_failed.unlink_file_vma.free_pgtables.unmap_region.do_munmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.SyS_mmap_pgoff.SyS_mmap.entry_SYSCALL_64_fastpath 1.794e+10 ± 2% +16.6% 2.092e+10 ± 2% latency_stats.sum.inet_csk_accept.inet_accept.SYSC_accept4.SyS_accept.entry_SYSCALL_64_fastpath 0.00 ± -1% +Inf% 13298537 ±162% latency_stats.sum.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath 1.281e+10 ± 0% -5.8% 1.207e+10 ± 0% latency_stats.sum.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.SyS_recvfrom.entry_SYSCALL_64_fastpath 1.126e+08 ± 2% -17.4% 93008884 ± 1% proc-vmstat.numa_hit 1.126e+08 ± 2% -17.4% 93008682 ± 1% proc-vmstat.numa_local 3937 ± 4% -11.5% 3483 ± 7% proc-vmstat.numa_pages_migrated 6363343 ± 2% -18.4% 5191906 ± 2% proc-vmstat.pgalloc_dma32 1.077e+08 ± 2% -17.2% 89162443 ± 1% proc-vmstat.pgalloc_normal 1.101e+08 ± 2% -17.3% 91044527 ± 1% proc-vmstat.pgfault 1.14e+08 ± 2% -17.3% 94305253 ± 1% proc-vmstat.pgfree 3937 ± 4% -11.5% 3483 ± 7% proc-vmstat.pgmigrate_success 28042466 ± 2% -17.5% 23130696 ± 2% numa-numastat.node0.local_node 28042466 ± 2% -17.5% 23130763 ± 2% numa-numastat.node0.numa_hit 0.00 ± 40% +Inf% 67.50 ± 8% numa-numastat.node0.other_node 28130811 ± 3% -15.6% 23732122 ± 1% numa-numastat.node1.local_node 28130861 ± 3% -15.6% 23732168 ± 1% numa-numastat.node1.numa_hit 28109208 ± 2% -18.4% 22948672 ± 2% numa-numastat.node2.local_node 28109647 ± 2% -18.4% 22948710 ± 2% numa-numastat.node2.numa_hit 28283999 ± 2% -18.0% 23200094 ± 1% numa-numastat.node3.local_node 28284539 ± 2% -18.0% 23200610 ± 1% numa-numastat.node3.numa_hit 89720 ± 2% -10.5% 80327 ± 1% slabinfo.Acpi-State.active_objs 1766 ± 2% -10.4% 1581 ± 1% slabinfo.Acpi-State.active_slabs 90097 ± 2% -10.4% 80684 ± 1% slabinfo.Acpi-State.num_objs 1766 ± 2% -10.4% 1581 ± 1% slabinfo.Acpi-State.num_slabs 1165 ± 4% +23.6% 1440 ± 9% slabinfo.blkdev_requests.active_objs 1165 ± 4% +23.6% 1440 ± 9% slabinfo.blkdev_requests.num_objs 45272 ± 5% -27.6% 32776 ± 3% slabinfo.kmalloc-256.active_objs 792.50 ± 5% -29.8% 556.50 ± 4% slabinfo.kmalloc-256.active_slabs 50753 ± 5% -29.7% 35654 ± 4% slabinfo.kmalloc-256.num_objs 792.50 ± 5% -29.8% 556.50 ± 4% slabinfo.kmalloc-256.num_slabs 78268 ± 3% -11.2% 69534 ± 1% slabinfo.kmalloc-64.active_objs 1289 ± 2% -13.1% 1120 ± 1% slabinfo.kmalloc-64.active_slabs 82539 ± 2% -13.1% 71749 ± 1% slabinfo.kmalloc-64.num_objs 1289 ± 2% -13.1% 1120 ± 1% slabinfo.kmalloc-64.num_slabs 152.50 ± 37% -72.0% 42.67 ± 85% numa-vmstat.node0.nr_dirtied 5982 ±148% -97.8% 130.00 ± 21% numa-vmstat.node0.nr_shmem 148.75 ± 37% -71.5% 42.33 ± 86% numa-vmstat.node0.nr_written 14143937 ± 2% -17.2% 11706912 ± 2% numa-vmstat.node0.numa_hit 14109627 ± 2% -17.3% 11671407 ± 2% numa-vmstat.node0.numa_local 32.00 ±119% +244.5% 110.25 ± 75% numa-vmstat.node1.nr_dirtied 30.67 ±121% +252.2% 108.00 ± 75% numa-vmstat.node1.nr_written 14248863 ± 3% -15.3% 12069600 ± 1% numa-vmstat.node1.numa_hit 14238070 ± 3% -15.3% 12059120 ± 1% numa-vmstat.node1.numa_local 29727 ± 3% +40.5% 41752 ± 25% numa-vmstat.node2.nr_file_pages 629.25 ±144% +279.3% 2386 ± 9% numa-vmstat.node2.nr_inactive_anon 650.50 ±140% +1851.9% 12697 ± 82% numa-vmstat.node2.nr_shmem 14166575 ± 2% -18.0% 11610237 ± 2% numa-vmstat.node2.numa_hit 14124116 ± 2% -18.1% 11569737 ± 2% numa-vmstat.node2.numa_local 14255093 ± 2% -17.7% 11737181 ± 1% numa-vmstat.node3.numa_hit 14214429 ± 2% -17.7% 11695545 ± 1% numa-vmstat.node3.numa_local 4.22 ± 7% -27.1% 3.07 ± 6% perf-profile.cpu-cycles.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath 2.12 ± 3% -24.3% 1.60 ± 4% perf-profile.cpu-cycles.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath 25.95 ± 1% +21.2% 31.45 ± 3% perf-profile.cpu-cycles.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath 10.69 ± 2% -20.7% 8.48 ± 2% perf-profile.cpu-cycles.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath 23.42 ± 6% -37.4% 14.65 ± 9% perf-profile.cpu-cycles.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath 15.88 ± 4% +67.7% 26.64 ± 5% perf-profile.cpu-cycles.____fput.task_work_run.do_notify_resume.int_signal 21.77 ± 12% -47.6% 11.40 ± 15% perf-profile.cpu-cycles.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task.activate_task 3.14 ± 14% -23.2% 2.41 ± 4% perf-profile.cpu-cycles.__dentry_kill.dput.__fput.____fput.task_work_run 2.52 ± 6% -59.8% 1.01 ± 36% perf-profile.cpu-cycles.__destroy_inode.destroy_inode.evict.iput.__dentry_kill 3.01 ± 2% -31.9% 2.05 ± 3% perf-profile.cpu-cycles.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output.ip_output 12.36 ± 6% +12.4% 13.89 ± 1% perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip._raw_spin_unlock_bh 29.10 ± 4% -13.3% 25.23 ± 2% perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2 2.16 ± 16% -43.8% 1.21 ± 3% perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.tcp_prequeue_process 15.70 ± 4% +68.6% 26.47 ± 4% perf-profile.cpu-cycles.__fput.____fput.task_work_run.do_notify_resume.int_signal 0.67 ± 17% +69.9% 1.14 ± 5% perf-profile.cpu-cycles.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 25.34 ± 1% +22.3% 30.99 ± 3% perf-profile.cpu-cycles.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath 3.18 ± 2% -20.8% 2.52 ± 3% perf-profile.cpu-cycles.__kernel_text_address.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency 12.44 ± 6% +12.0% 13.94 ± 1% perf-profile.cpu-cycles.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock.__inet_stream_connect.inet_stream_connect 29.46 ± 4% -13.3% 25.54 ± 2% perf-profile.cpu-cycles.__local_bh_enable_ip.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk 2.40 ± 15% -47.1% 1.27 ± 4% perf-profile.cpu-cycles.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg 1.49 ± 3% -15.6% 1.26 ± 1% perf-profile.cpu-cycles.__schedule.schedule.schedule_timeout.sk_wait_data.tcp_recvmsg 1.49 ± 4% -12.4% 1.31 ± 1% perf-profile.cpu-cycles.__sock_create.sys_socket.entry_SYSCALL_64_fastpath 21.55 ± 7% -38.8% 13.18 ± 10% perf-profile.cpu-cycles.__tcp_push_pending_frames.tcp_push.tcp_sendmsg.inet_sendmsg.sock_sendmsg 7.71 ± 3% +56.6% 12.09 ± 4% perf-profile.cpu-cycles.__tcp_push_pending_frames.tcp_send_fin.tcp_close.inet_release.sock_release 2.66 ± 2% -21.8% 2.08 ± 6% perf-profile.cpu-cycles.__vfs_read.vfs_read.sys_read.entry_SYSCALL_64_fastpath 8.51 ± 10% -44.9% 4.70 ± 13% perf-profile.cpu-cycles.__wake_up_common.__wake_up_sync_key.sock_def_readable.tcp_child_process.tcp_v4_do_rcv 16.79 ± 10% -43.8% 9.44 ± 12% perf-profile.cpu-cycles.__wake_up_common.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish 8.60 ± 11% -44.8% 4.75 ± 12% perf-profile.cpu-cycles.__wake_up_sync_key.sock_def_readable.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv 16.96 ± 10% -43.6% 9.56 ± 12% perf-profile.cpu-cycles.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver 0.82 ± 24% -42.1% 0.47 ± 6% perf-profile.cpu-cycles._raw_spin_lock.inode_doinit_with_dentry.selinux_d_instantiate.security_d_instantiate.d_instantiate 1.74 ± 20% -52.2% 0.83 ± 6% perf-profile.cpu-cycles._raw_spin_lock.selinux_inode_free_security.security_inode_free.__destroy_inode.destroy_inode 0.00 ± -1% +Inf% 6.25 ± 17% perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process 0.00 ± -1% +Inf% 5.69 ± 12% perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process 0.00 ± -1% +Inf% 8.21 ± 12% perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv 0.00 ± -1% +Inf% 5.65 ± 13% perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_time_wait.tcp_fin 14.89 ± 19% -60.2% 5.92 ± 26% perf-profile.cpu-cycles._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task 12.46 ± 6% +11.8% 13.92 ± 1% perf-profile.cpu-cycles._raw_spin_unlock_bh.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect 23.55 ± 11% -45.6% 12.82 ± 13% perf-profile.cpu-cycles.activate_task.ttwu_do_activate.try_to_wake_up.default_wake_function.autoremove_wake_function 8.49 ± 11% -45.0% 4.67 ± 13% perf-profile.cpu-cycles.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.sock_def_readable.tcp_child_process 16.75 ± 10% -43.9% 9.40 ± 12% perf-profile.cpu-cycles.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv 1.82 ± 1% -23.9% 1.39 ± 1% perf-profile.cpu-cycles.copy_page_to_iter.generic_file_read_iter.__vfs_read.vfs_read.sys_read 1.29 ± 7% -42.3% 0.75 ± 26% perf-profile.cpu-cycles.d_instantiate.sock_alloc_file.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath 8.47 ± 11% -44.9% 4.67 ± 12% perf-profile.cpu-cycles.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.sock_def_readable 16.71 ± 10% -44.0% 9.36 ± 12% perf-profile.cpu-cycles.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.tcp_prequeue 1.12 ± 5% -28.6% 0.80 ± 11% perf-profile.cpu-cycles.dequeue_task.deactivate_task.__schedule.schedule.schedule_timeout 2.62 ± 5% -45.4% 1.43 ± 25% perf-profile.cpu-cycles.destroy_inode.evict.iput.__dentry_kill.dput 1.44 ± 3% -16.1% 1.21 ± 2% perf-profile.cpu-cycles.dev_hard_start_xmit.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output 3.15 ± 3% -30.5% 2.18 ± 4% perf-profile.cpu-cycles.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk 2.07 ± 7% -32.2% 1.40 ± 3% perf-profile.cpu-cycles.do_filp_open.do_sys_open.sys_open.entry_SYSCALL_64_fastpath 1.65 ± 3% -17.7% 1.36 ± 2% perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath 2.42 ± 2% -25.6% 1.80 ± 5% perf-profile.cpu-cycles.do_munmap.vm_munmap.sys_munmap.entry_SYSCALL_64_fastpath 16.19 ± 4% +65.9% 26.85 ± 4% perf-profile.cpu-cycles.do_notify_resume.int_signal 12.40 ± 6% +12.3% 13.92 ± 1% perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock.__inet_stream_connect 29.32 ± 4% -13.3% 25.43 ± 2% perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip.ip_finish_output2.ip_finish_output.ip_output 2.36 ± 15% -47.0% 1.25 ± 3% perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg 12.38 ± 6% +12.4% 13.91 ± 1% perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock 29.23 ± 4% -13.3% 25.34 ± 2% perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_finish_output 2.27 ± 16% -45.7% 1.23 ± 3% perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg 2.44 ± 2% -30.5% 1.70 ± 6% perf-profile.cpu-cycles.do_sys_open.sys_open.entry_SYSCALL_64_fastpath 3.60 ± 15% -31.8% 2.46 ± 1% perf-profile.cpu-cycles.dput.__fput.____fput.task_work_run.do_notify_resume 5.97 ± 3% -24.1% 4.53 ± 4% perf-profile.cpu-cycles.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 22.90 ± 12% -46.4% 12.28 ± 14% perf-profile.cpu-cycles.enqueue_entity.enqueue_task_fair.enqueue_task.activate_task.ttwu_do_activate 23.53 ± 11% -45.6% 12.80 ± 13% perf-profile.cpu-cycles.enqueue_task.activate_task.ttwu_do_activate.try_to_wake_up.default_wake_function 23.30 ± 11% -46.0% 12.59 ± 13% perf-profile.cpu-cycles.enqueue_task_fair.enqueue_task.activate_task.ttwu_do_activate.try_to_wake_up 81.30 ± 1% -12.6% 71.09 ± 1% perf-profile.cpu-cycles.entry_SYSCALL_64_fastpath 2.79 ± 9% -26.7% 2.05 ± 13% perf-profile.cpu-cycles.evict.iput.__dentry_kill.dput.__fput 2.63 ± 1% -24.7% 1.98 ± 5% perf-profile.cpu-cycles.generic_file_read_iter.__vfs_read.vfs_read.sys_read.entry_SYSCALL_64_fastpath 1.25 ± 1% -11.6% 1.10 ± 6% perf-profile.cpu-cycles.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.copy_page_to_iter 1.61 ± 4% -17.0% 1.34 ± 2% perf-profile.cpu-cycles.inet_accept.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath 1.08 ± 4% -27.3% 0.79 ± 5% perf-profile.cpu-cycles.inet_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath 1.42 ± 4% -9.7% 1.28 ± 1% perf-profile.cpu-cycles.inet_csk_accept.inet_accept.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath 10.13 ± 2% -20.2% 8.09 ± 3% perf-profile.cpu-cycles.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath 10.96 ± 2% +112.9% 23.33 ± 6% perf-profile.cpu-cycles.inet_release.sock_release.sock_close.__fput.____fput 23.08 ± 6% -37.9% 14.34 ± 9% perf-profile.cpu-cycles.inet_sendmsg.sock_sendmsg.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath 25.43 ± 1% +22.3% 31.09 ± 3% perf-profile.cpu-cycles.inet_stream_connect.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath 1.18 ± 13% -70.0% 0.35 ± 45% perf-profile.cpu-cycles.inode_doinit_with_dentry.selinux_d_instantiate.security_d_instantiate.d_instantiate.sock_alloc_file 16.22 ± 4% +65.8% 26.88 ± 4% perf-profile.cpu-cycles.int_signal 32.31 ± 4% -13.9% 27.82 ± 2% perf-profile.cpu-cycles.ip_finish_output.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb 32.07 ± 3% -13.9% 27.61 ± 2% perf-profile.cpu-cycles.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk.ip_queue_xmit 5.52 ± 2% -19.1% 4.46 ± 2% perf-profile.cpu-cycles.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_connect.tcp_v4_connect 26.33 ± 5% -12.7% 22.97 ± 2% perf-profile.cpu-cycles.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames 5.46 ± 2% -19.2% 4.41 ± 2% perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_connect 1.52 ± 11% -28.4% 1.09 ± 4% perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_send_ack 26.05 ± 5% -12.6% 22.77 ± 2% perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit 6.14 ± 2% -19.2% 4.96 ± 2% perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect 1.29 ± 10% -17.7% 1.06 ± 2% perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established 20.46 ± 7% -40.0% 12.29 ± 10% perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_push 6.16 ± 3% +76.8% 10.88 ± 5% perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin 2.96 ± 13% -23.7% 2.25 ± 7% perf-profile.cpu-cycles.iput.__dentry_kill.dput.__fput.____fput 1.23 ± 5% -25.3% 0.92 ± 9% perf-profile.cpu-cycles.is_module_text_address.__kernel_text_address.print_context_stack.dump_trace.save_stack_trace_tsk 1.18 ± 3% -23.6% 0.90 ± 4% perf-profile.cpu-cycles.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2 1.40 ± 23% -79.7% 0.28 ± 17% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock.selinux_inode_free_security.security_inode_free.__destroy_inode 0.00 ± -1% +Inf% 6.06 ± 17% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect 0.00 ± -1% +Inf% 5.52 ± 12% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process 0.00 ± -1% +Inf% 7.96 ± 12% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process 0.00 ± -1% +Inf% 5.49 ± 14% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_time_wait 14.34 ± 20% -61.6% 5.50 ± 28% perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 1.91 ± 7% -29.3% 1.35 ± 3% perf-profile.cpu-cycles.path_openat.do_filp_open.do_sys_open.sys_open.entry_SYSCALL_64_fastpath 5.42 ± 4% -24.0% 4.12 ± 2% perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity 15.36 ± 4% +49.3% 22.93 ± 5% perf-profile.cpu-cycles.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect 1.47 ± 4% +572.7% 9.86 ± 9% perf-profile.cpu-cycles.release_sock.tcp_close.inet_release.sock_release.sock_close 5.99 ± 3% -23.9% 4.56 ± 4% perf-profile.cpu-cycles.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task 0.94 ± 3% -21.5% 0.74 ± 3% perf-profile.cpu-cycles.schedule.schedule_timeout.inet_csk_accept.inet_accept.SYSC_accept4 1.55 ± 4% -17.0% 1.28 ± 1% perf-profile.cpu-cycles.schedule.schedule_timeout.sk_wait_data.tcp_recvmsg.inet_recvmsg 0.96 ± 3% -22.1% 0.75 ± 3% perf-profile.cpu-cycles.schedule_timeout.inet_csk_accept.inet_accept.SYSC_accept4.sys_accept 1.58 ± 3% -18.3% 1.29 ± 1% perf-profile.cpu-cycles.schedule_timeout.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg 1.25 ± 7% -57.6% 0.53 ± 40% perf-profile.cpu-cycles.security_d_instantiate.d_instantiate.sock_alloc_file.SYSC_accept4.sys_accept 2.41 ± 9% -73.2% 0.65 ± 47% perf-profile.cpu-cycles.security_inode_free.__destroy_inode.destroy_inode.evict.iput 1.01 ± 8% -36.1% 0.64 ± 6% perf-profile.cpu-cycles.security_sock_rcv_skb.sk_filter.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver 1.21 ± 2% -20.3% 0.96 ± 1% perf-profile.cpu-cycles.security_socket_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath 1.24 ± 8% -58.7% 0.51 ± 42% perf-profile.cpu-cycles.selinux_d_instantiate.security_d_instantiate.d_instantiate.sock_alloc_file.SYSC_accept4 2.38 ± 9% -74.9% 0.60 ± 47% perf-profile.cpu-cycles.selinux_inode_free_security.security_inode_free.__destroy_inode.destroy_inode.evict 1.19 ± 3% -23.6% 0.91 ± 2% perf-profile.cpu-cycles.selinux_socket_bind.security_socket_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath 1.14 ± 4% -19.7% 0.92 ± 3% perf-profile.cpu-cycles.sk_filter.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish 2.45 ± 2% -12.9% 2.14 ± 5% perf-profile.cpu-cycles.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom 1.48 ± 11% -18.1% 1.21 ± 3% perf-profile.cpu-cycles.sock_alloc_file.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath 11.04 ± 2% +112.7% 23.48 ± 6% perf-profile.cpu-cycles.sock_close.__fput.____fput.task_work_run.do_notify_resume 8.65 ± 10% -44.5% 4.80 ± 12% perf-profile.cpu-cycles.sock_def_readable.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish 10.42 ± 2% -20.3% 8.30 ± 3% perf-profile.cpu-cycles.sock_recvmsg.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath 11.02 ± 2% +113.0% 23.48 ± 6% perf-profile.cpu-cycles.sock_release.sock_close.__fput.____fput.task_work_run 23.26 ± 6% -37.7% 14.49 ± 9% perf-profile.cpu-cycles.sock_sendmsg.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath 4.31 ± 7% -26.6% 3.17 ± 6% perf-profile.cpu-cycles.sys_accept.entry_SYSCALL_64_fastpath 2.16 ± 3% -25.0% 1.62 ± 4% perf-profile.cpu-cycles.sys_bind.entry_SYSCALL_64_fastpath 26.02 ± 1% +21.0% 31.48 ± 3% perf-profile.cpu-cycles.sys_connect.entry_SYSCALL_64_fastpath 2.09 ± 4% -27.8% 1.51 ± 3% perf-profile.cpu-cycles.sys_mmap.entry_SYSCALL_64_fastpath 2.07 ± 4% -27.4% 1.50 ± 3% perf-profile.cpu-cycles.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath 2.53 ± 2% -21.6% 1.98 ± 5% perf-profile.cpu-cycles.sys_munmap.entry_SYSCALL_64_fastpath 2.49 ± 3% -28.9% 1.77 ± 7% perf-profile.cpu-cycles.sys_open.entry_SYSCALL_64_fastpath 2.96 ± 3% -20.2% 2.37 ± 2% perf-profile.cpu-cycles.sys_read.entry_SYSCALL_64_fastpath 10.74 ± 2% -20.7% 8.52 ± 2% perf-profile.cpu-cycles.sys_recvfrom.entry_SYSCALL_64_fastpath 23.48 ± 6% -37.4% 14.69 ± 9% perf-profile.cpu-cycles.sys_sendto.entry_SYSCALL_64_fastpath 2.43 ± 2% -23.8% 1.85 ± 6% perf-profile.cpu-cycles.sys_socket.entry_SYSCALL_64_fastpath 16.06 ± 4% +66.8% 26.79 ± 5% perf-profile.cpu-cycles.task_work_run.do_notify_resume.int_signal 1.94 ± 5% -24.0% 1.48 ± 2% perf-profile.cpu-cycles.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver 9.42 ± 9% +21.5% 11.45 ± 1% perf-profile.cpu-cycles.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver 10.82 ± 2% +114.2% 23.18 ± 6% perf-profile.cpu-cycles.tcp_close.inet_release.sock_release.sock_close.__fput 2.44 ± 2% -24.6% 1.84 ± 4% perf-profile.cpu-cycles.tcp_conn_request.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv 7.43 ± 2% -19.2% 6.00 ± 2% perf-profile.cpu-cycles.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.SYSC_connect 1.16 ± 6% -35.6% 0.74 ± 8% perf-profile.cpu-cycles.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv 2.52 ± 4% +215.6% 7.96 ± 9% perf-profile.cpu-cycles.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish 1.14 ± 7% -26.3% 0.84 ± 3% perf-profile.cpu-cycles.tcp_done.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process 2.41 ± 3% +224.9% 7.82 ± 9% perf-profile.cpu-cycles.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv 1.10 ± 2% +565.6% 7.30 ± 15% perf-profile.cpu-cycles.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.__inet_stream_connect 0.11 ± 19% +5669.6% 6.63 ± 17% perf-profile.cpu-cycles.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv 0.10 ± 15% +5890.0% 5.99 ± 11% perf-profile.cpu-cycles.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv 0.10 ± 15% +8738.5% 8.62 ± 11% perf-profile.cpu-cycles.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock 0.11 ± 18% +5345.5% 5.99 ± 12% perf-profile.cpu-cycles.tcp_get_metrics.tcp_update_metrics.tcp_time_wait.tcp_fin.tcp_data_queue 0.03 ± 35% +25137.5% 6.73 ± 16% perf-profile.cpu-cycles.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock 0.02 ± 53% +25935.7% 6.08 ± 11% perf-profile.cpu-cycles.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv 17.50 ± 9% -43.1% 9.95 ± 12% perf-profile.cpu-cycles.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish 7.24 ± 3% -19.9% 5.80 ± 3% perf-profile.cpu-cycles.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom 21.65 ± 7% -39.0% 13.21 ± 10% perf-profile.cpu-cycles.tcp_push.tcp_sendmsg.inet_sendmsg.sock_sendmsg.SYSC_sendto 3.75 ± 3% -30.0% 2.62 ± 2% perf-profile.cpu-cycles.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg 0.49 ± 8% +1221.9% 6.48 ± 10% perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish 2.71 ± 2% +226.3% 8.84 ± 12% perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.__inet_stream_connect.inet_stream_connect 1.37 ± 4% +610.4% 9.75 ± 9% perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.tcp_close.inet_release 6.49 ± 3% +71.7% 11.15 ± 5% perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver 10.02 ± 3% -20.1% 8.01 ± 3% perf-profile.cpu-cycles.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.sys_recvfrom 2.40 ± 1% -14.1% 2.06 ± 3% perf-profile.cpu-cycles.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process 8.41 ± 2% +47.8% 12.42 ± 4% perf-profile.cpu-cycles.tcp_send_fin.tcp_close.inet_release.sock_release.sock_close 22.87 ± 6% -38.2% 14.14 ± 9% perf-profile.cpu-cycles.tcp_sendmsg.inet_sendmsg.sock_sendmsg.SYSC_sendto.sys_sendto 1.43 ± 3% +400.0% 7.14 ± 10% perf-profile.cpu-cycles.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv 6.51 ± 2% -19.0% 5.27 ± 2% perf-profile.cpu-cycles.tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect 1.71 ± 4% -19.6% 1.37 ± 2% perf-profile.cpu-cycles.tcp_transmit_skb.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established.tcp_v4_do_rcv 20.86 ± 7% -39.4% 12.65 ± 10% perf-profile.cpu-cycles.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_push.tcp_sendmsg 6.46 ± 2% +72.5% 11.13 ± 5% perf-profile.cpu-cycles.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin.tcp_close 0.06 ± 48% +14437.5% 8.72 ± 11% perf-profile.cpu-cycles.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.tcp_close 0.07 ± 57% +8066.7% 6.12 ± 12% perf-profile.cpu-cycles.tcp_update_metrics.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process 2.53 ± 1% -22.5% 1.96 ± 3% perf-profile.cpu-cycles.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish 8.76 ± 2% -19.5% 7.05 ± 2% perf-profile.cpu-cycles.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect 2.81 ± 2% +216.7% 8.91 ± 12% perf-profile.cpu-cycles.tcp_v4_do_rcv.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect 1.40 ± 4% +602.0% 9.79 ± 9% perf-profile.cpu-cycles.tcp_v4_do_rcv.release_sock.tcp_close.inet_release.sock_release 3.92 ± 2% -64.3% 1.40 ± 18% perf-profile.cpu-cycles.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg 19.08 ± 3% +31.2% 25.04 ± 2% perf-profile.cpu-cycles.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish 1.24 ± 1% -13.7% 1.07 ± 5% perf-profile.cpu-cycles.tcp_v4_send_synack.tcp_conn_request.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv 1.48 ± 2% -11.1% 1.32 ± 1% perf-profile.cpu-cycles.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish 21.47 ± 7% -39.0% 13.11 ± 9% perf-profile.cpu-cycles.tcp_write_xmit.__tcp_push_pending_frames.tcp_push.tcp_sendmsg.inet_sendmsg 7.65 ± 2% +57.3% 12.04 ± 5% perf-profile.cpu-cycles.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin.tcp_close.inet_release 0.43 ± 20% +135.6% 1.03 ± 7% perf-profile.cpu-cycles.tick_sched_handle.isra.17.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt 0.51 ± 18% +107.4% 1.06 ± 7% perf-profile.cpu-cycles.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt 25.09 ± 10% -44.3% 13.97 ± 12% perf-profile.cpu-cycles.try_to_wake_up.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key 23.97 ± 11% -45.4% 13.10 ± 13% perf-profile.cpu-cycles.ttwu_do_activate.constprop.83.try_to_wake_up.default_wake_function.autoremove_wake_function.__wake_up_common 0.39 ± 24% +153.9% 0.98 ± 8% perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 2.88 ± 3% -19.8% 2.31 ± 4% perf-profile.cpu-cycles.vfs_read.sys_read.entry_SYSCALL_64_fastpath 2.01 ± 4% -26.9% 1.47 ± 2% perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath 2.50 ± 2% -24.4% 1.89 ± 5% perf-profile.cpu-cycles.vm_munmap.sys_munmap.entry_SYSCALL_64_fastpath 175.75 ± 26% -67.3% 57.50 ± 62% sched_debug.cfs_rq[0]:/.blocked_load_avg 195.75 ± 24% -61.9% 74.50 ± 45% sched_debug.cfs_rq[0]:/.tg_load_contrib 1267483 ± 58% +241.8% 4331730 ± 32% sched_debug.cfs_rq[10]:/.MIN_vruntime 106.50 ± 67% +167.1% 284.50 ± 43% sched_debug.cfs_rq[10]:/.blocked_load_avg 20.25 ± 21% +95.1% 39.50 ± 9% sched_debug.cfs_rq[10]:/.load 1267483 ± 58% +241.8% 4331730 ± 32% sched_debug.cfs_rq[10]:/.max_vruntime 7064228 ± 4% +24.8% 8816370 ± 6% sched_debug.cfs_rq[10]:/.min_vruntime 124.00 ± 57% +150.2% 310.25 ± 39% sched_debug.cfs_rq[10]:/.tg_load_contrib 7354915 ± 10% +30.2% 9574721 ± 15% sched_debug.cfs_rq[11]:/.min_vruntime 562.00 ± 14% +29.7% 729.00 ± 9% sched_debug.cfs_rq[11]:/.utilization_load_avg 328.50 ± 84% -74.7% 83.00 ±120% sched_debug.cfs_rq[17]:/.blocked_load_avg 348.75 ± 79% -70.8% 102.00 ± 94% sched_debug.cfs_rq[17]:/.tg_load_contrib 550.25 ± 7% +17.9% 648.50 ± 9% sched_debug.cfs_rq[20]:/.utilization_load_avg 3859894 ± 33% -84.1% 613604 ±133% sched_debug.cfs_rq[21]:/.MIN_vruntime 3859894 ± 33% -84.1% 613604 ±133% sched_debug.cfs_rq[21]:/.max_vruntime 3393438 ± 42% -100.0% 0.00 ± 0% sched_debug.cfs_rq[23]:/.MIN_vruntime 3393438 ± 42% -100.0% 0.00 ± 0% sched_debug.cfs_rq[23]:/.max_vruntime 6969709 ± 6% +9.1% 7603127 ± 4% sched_debug.cfs_rq[23]:/.min_vruntime 20.25 ± 18% -38.3% 12.50 ± 4% sched_debug.cfs_rq[23]:/.runnable_load_avg 21.50 ± 19% +445.3% 117.25 ± 68% sched_debug.cfs_rq[27]:/.load 16.50 ± 10% +31.8% 21.75 ± 5% sched_debug.cfs_rq[27]:/.runnable_load_avg 784.00 ± 91% -87.7% 96.75 ± 92% sched_debug.cfs_rq[28]:/.blocked_load_avg 800.25 ± 89% -85.6% 115.25 ± 75% sched_debug.cfs_rq[28]:/.tg_load_contrib 6864371 ± 11% +28.0% 8788136 ± 10% sched_debug.cfs_rq[2]:/.min_vruntime -160064 ±-318% -624.8% 839954 ± 61% sched_debug.cfs_rq[2]:/.spread0 91.50 ± 28% -62.0% 34.75 ± 78% sched_debug.cfs_rq[30]:/.nr_spread_over 488.75 ± 18% +29.1% 631.00 ± 10% sched_debug.cfs_rq[30]:/.utilization_load_avg 84.00 ± 36% -54.2% 38.50 ± 60% sched_debug.cfs_rq[31]:/.nr_spread_over 6916568 ± 11% +13.9% 7879054 ± 6% sched_debug.cfs_rq[32]:/.min_vruntime 116.50 ±125% -82.6% 20.25 ± 42% sched_debug.cfs_rq[34]:/.load 6871979 ± 12% +28.6% 8834078 ± 11% sched_debug.cfs_rq[34]:/.min_vruntime 23.25 ± 11% -37.6% 14.50 ± 24% sched_debug.cfs_rq[34]:/.runnable_load_avg -153189 ±-326% -677.7% 885021 ± 64% sched_debug.cfs_rq[34]:/.spread0 7.75 ± 27% +377.4% 37.00 ± 57% sched_debug.cfs_rq[35]:/.blocked_load_avg 6977299 ± 10% +21.0% 8439329 ± 15% sched_debug.cfs_rq[35]:/.min_vruntime 6848733 ± 11% +22.6% 8396951 ± 10% sched_debug.cfs_rq[37]:/.min_vruntime -176509 ±-214% -353.7% 447796 ±108% sched_debug.cfs_rq[37]:/.spread0 6783146 ± 8% +25.7% 8525859 ± 14% sched_debug.cfs_rq[38]:/.min_vruntime 511.50 ± 9% +37.9% 705.25 ± 3% sched_debug.cfs_rq[38]:/.utilization_load_avg 6750617 ± 4% +24.5% 8403331 ± 11% sched_debug.cfs_rq[39]:/.min_vruntime 6957525 ± 8% +20.8% 8406635 ± 15% sched_debug.cfs_rq[3]:/.min_vruntime 7280418 ± 2% +22.5% 8920591 ± 14% sched_debug.cfs_rq[40]:/.min_vruntime 7111998 ± 5% +25.1% 8894040 ± 7% sched_debug.cfs_rq[42]:/.min_vruntime 7354642 ± 10% +30.2% 9579368 ± 15% sched_debug.cfs_rq[43]:/.min_vruntime 48.50 ±103% +123.7% 108.50 ± 60% sched_debug.cfs_rq[43]:/.nr_spread_over 7446762 ± 7% +21.6% 9051878 ± 17% sched_debug.cfs_rq[44]:/.min_vruntime 435.50 ± 22% +43.4% 624.50 ± 12% sched_debug.cfs_rq[46]:/.utilization_load_avg 489.00 ± 7% +34.3% 656.50 ± 8% sched_debug.cfs_rq[48]:/.utilization_load_avg 21.75 ± 51% +55.2% 33.75 ± 14% sched_debug.cfs_rq[49]:/.nr_spread_over 282.00 ± 81% -83.5% 46.50 ±117% sched_debug.cfs_rq[4]:/.blocked_load_avg 302.25 ± 75% -79.2% 62.75 ± 88% sched_debug.cfs_rq[4]:/.tg_load_contrib 568.50 ± 19% +24.7% 709.00 ± 1% sched_debug.cfs_rq[4]:/.utilization_load_avg 47.75 ± 69% +703.1% 383.50 ± 78% sched_debug.cfs_rq[50]:/.blocked_load_avg 62.75 ± 52% +541.4% 402.50 ± 75% sched_debug.cfs_rq[50]:/.tg_load_contrib 516.00 ± 13% +34.1% 691.75 ± 12% sched_debug.cfs_rq[50]:/.utilization_load_avg 6918551 ± 5% +9.8% 7594242 ± 5% sched_debug.cfs_rq[55]:/.min_vruntime 70.00 ± 45% -49.6% 35.25 ± 67% sched_debug.cfs_rq[58]:/.nr_spread_over 518.25 ± 22% +33.3% 691.00 ± 6% sched_debug.cfs_rq[58]:/.utilization_load_avg 482.00 ± 15% +30.7% 630.00 ± 5% sched_debug.cfs_rq[59]:/.utilization_load_avg 6893442 ± 10% +22.3% 8433961 ± 9% sched_debug.cfs_rq[5]:/.min_vruntime 561.50 ± 5% +18.1% 663.00 ± 9% sched_debug.cfs_rq[5]:/.utilization_load_avg 2118027 ± 62% -82.9% 361211 ±109% sched_debug.cfs_rq[61]:/.MIN_vruntime 2118027 ± 62% -82.9% 361211 ±109% sched_debug.cfs_rq[61]:/.max_vruntime 3804794 ± 35% -60.4% 1508156 ± 71% sched_debug.cfs_rq[62]:/.MIN_vruntime 3804794 ± 35% -60.4% 1508156 ± 71% sched_debug.cfs_rq[62]:/.max_vruntime 3234850 ± 51% -64.2% 1157307 ±145% sched_debug.cfs_rq[6]:/.MIN_vruntime 3234850 ± 51% -64.2% 1157307 ±145% sched_debug.cfs_rq[6]:/.max_vruntime 6791201 ± 8% +26.7% 8601638 ± 15% sched_debug.cfs_rq[6]:/.min_vruntime 6657096 ± 4% +26.2% 8398917 ± 11% sched_debug.cfs_rq[7]:/.min_vruntime 558.75 ± 11% +29.8% 725.00 ± 11% sched_debug.cfs_rq[7]:/.utilization_load_avg 7286102 ± 1% +23.1% 8965833 ± 15% sched_debug.cfs_rq[8]:/.min_vruntime 3383122 ± 2% -17.9% 2775877 ± 1% sched_debug.cpu#0.nr_switches 3392389 ± 2% -17.9% 2785232 ± 1% sched_debug.cpu#0.sched_count 3380345 ± 2% -19.0% 2737980 ± 1% sched_debug.cpu#0.ttwu_count 3364390 ± 2% -18.8% 2733371 ± 1% sched_debug.cpu#0.ttwu_local 34.25 ± 59% -56.9% 14.75 ± 12% sched_debug.cpu#1.cpu_load[0] 28.50 ± 42% -48.2% 14.75 ± 10% sched_debug.cpu#1.cpu_load[1] 26.75 ± 36% -43.9% 15.00 ± 12% sched_debug.cpu#1.cpu_load[2] 25.25 ± 34% -40.6% 15.00 ± 9% sched_debug.cpu#1.cpu_load[3] 22.50 ± 34% -44.4% 12.50 ± 8% sched_debug.cpu#1.cpu_load[4] 3369428 ± 2% -16.2% 2824862 ± 1% sched_debug.cpu#1.nr_switches 3371094 ± 2% -16.1% 2827260 ± 1% sched_debug.cpu#1.sched_count 3389319 ± 2% -17.1% 2810445 ± 1% sched_debug.cpu#1.ttwu_count 3353366 ± 2% -16.3% 2807598 ± 1% sched_debug.cpu#1.ttwu_local 3335017 ± 2% -15.4% 2820801 ± 1% sched_debug.cpu#10.nr_switches 3335956 ± 2% -15.4% 2821090 ± 1% sched_debug.cpu#10.sched_count 3336430 ± 2% -15.9% 2806740 ± 1% sched_debug.cpu#10.ttwu_count 3318441 ± 2% -15.5% 2804699 ± 1% sched_debug.cpu#10.ttwu_local 3370289 ± 3% -16.3% 2821155 ± 2% sched_debug.cpu#11.nr_switches 3371290 ± 3% -16.3% 2821629 ± 2% sched_debug.cpu#11.sched_count 3361232 ± 3% -15.8% 2829002 ± 2% sched_debug.cpu#11.ttwu_count 3358106 ± 3% -16.4% 2807327 ± 2% sched_debug.cpu#11.ttwu_local 16.50 ± 13% -25.8% 12.25 ± 15% sched_debug.cpu#12.cpu_load[4] 3398141 ± 3% -17.9% 2791418 ± 2% sched_debug.cpu#12.nr_switches 3400097 ± 3% -17.9% 2793004 ± 2% sched_debug.cpu#12.sched_count 1646 ± 32% +66.4% 2739 ± 24% sched_debug.cpu#12.sched_goidle 3395185 ± 3% -17.7% 2792849 ± 3% sched_debug.cpu#12.ttwu_count 3392814 ± 3% -18.5% 2766292 ± 2% sched_debug.cpu#12.ttwu_local 3384418 ± 4% -16.9% 2813855 ± 1% sched_debug.cpu#13.nr_switches 3385991 ± 4% -16.8% 2817516 ± 1% sched_debug.cpu#13.sched_count 3385348 ± 3% -17.2% 2804182 ± 2% sched_debug.cpu#13.ttwu_count 3369621 ± 4% -16.9% 2800765 ± 2% sched_debug.cpu#13.ttwu_local 3377257 ± 3% -16.1% 2833788 ± 2% sched_debug.cpu#14.nr_switches 3379864 ± 3% -16.1% 2836414 ± 2% sched_debug.cpu#14.sched_count 3360760 ± 3% -15.9% 2826049 ± 2% sched_debug.cpu#14.ttwu_count 3357666 ± 3% -15.9% 2823748 ± 2% sched_debug.cpu#14.ttwu_local 3380508 ± 3% -16.2% 2833752 ± 1% sched_debug.cpu#15.nr_switches 3381560 ± 3% -16.2% 2834059 ± 1% sched_debug.cpu#15.sched_count 3381759 ± 3% -16.1% 2838452 ± 2% sched_debug.cpu#15.ttwu_count 3368631 ± 3% -16.4% 2814682 ± 1% sched_debug.cpu#15.ttwu_local 3389967 ± 2% -17.6% 2791917 ± 1% sched_debug.cpu#16.nr_switches 3392333 ± 2% -17.6% 2794492 ± 1% sched_debug.cpu#16.sched_count 3395971 ± 2% -18.1% 2780908 ± 1% sched_debug.cpu#16.ttwu_count 3380594 ± 2% -18.0% 2770502 ± 1% sched_debug.cpu#16.ttwu_local 3379066 ± 2% -17.0% 2804619 ± 2% sched_debug.cpu#17.nr_switches 3379518 ± 2% -17.0% 2806250 ± 2% sched_debug.cpu#17.sched_count 3369568 ± 3% -17.2% 2790359 ± 2% sched_debug.cpu#17.ttwu_count 3366929 ± 3% -17.2% 2788295 ± 2% sched_debug.cpu#17.ttwu_local 3364431 ± 2% -17.1% 2787730 ± 1% sched_debug.cpu#18.nr_switches 3364899 ± 2% -17.1% 2788705 ± 1% sched_debug.cpu#18.sched_count 3358511 ± 2% -17.3% 2776889 ± 1% sched_debug.cpu#18.ttwu_count 3348289 ± 2% -17.6% 2759313 ± 1% sched_debug.cpu#18.ttwu_local 16.75 ± 10% -17.9% 13.75 ± 12% sched_debug.cpu#19.cpu_load[4] 3389035 ± 2% -17.5% 2794874 ± 1% sched_debug.cpu#19.nr_switches 3390379 ± 2% -17.4% 2800760 ± 1% sched_debug.cpu#19.sched_count 3382434 ± 2% -17.7% 2785348 ± 1% sched_debug.cpu#19.ttwu_count 3379051 ± 2% -17.7% 2781538 ± 1% sched_debug.cpu#19.ttwu_local 23.00 ± 21% -38.0% 14.25 ± 7% sched_debug.cpu#2.cpu_load[3] 3360803 ± 2% -16.7% 2800049 ± 1% sched_debug.cpu#2.nr_switches 3361823 ± 2% -16.5% 2805748 ± 1% sched_debug.cpu#2.sched_count 3343040 ± 2% -16.6% 2789182 ± 1% sched_debug.cpu#2.ttwu_count 3338401 ± 2% -16.5% 2787168 ± 1% sched_debug.cpu#2.ttwu_local 3341149 ± 2% -16.8% 2779014 ± 2% sched_debug.cpu#20.nr_switches 3341677 ± 2% -16.8% 2780361 ± 2% sched_debug.cpu#20.sched_count 3317813 ± 1% -16.5% 2771814 ± 2% sched_debug.cpu#20.ttwu_count 3313754 ± 1% -16.9% 2752947 ± 3% sched_debug.cpu#20.ttwu_local 3393487 ± 2% -17.6% 2795372 ± 1% sched_debug.cpu#21.nr_switches 3400093 ± 2% -17.7% 2796868 ± 1% sched_debug.cpu#21.sched_count 3378310 ± 2% -17.5% 2787801 ± 2% sched_debug.cpu#21.ttwu_count 3376315 ± 2% -17.7% 2780178 ± 2% sched_debug.cpu#21.ttwu_local 16.75 ± 2% -14.9% 14.25 ± 7% sched_debug.cpu#22.cpu_load[4] 3387714 ± 2% -17.2% 2803908 ± 2% sched_debug.cpu#22.nr_switches 3388108 ± 2% -17.2% 2805212 ± 2% sched_debug.cpu#22.sched_count 3384725 ± 2% -17.5% 2792197 ± 2% sched_debug.cpu#22.ttwu_count 3382935 ± 2% -17.6% 2788179 ± 2% sched_debug.cpu#22.ttwu_local 21.25 ± 13% -24.7% 16.00 ± 13% sched_debug.cpu#23.cpu_load[3] 18.00 ± 13% -23.6% 13.75 ± 9% sched_debug.cpu#23.cpu_load[4] 3401316 ± 2% -17.5% 2805389 ± 2% sched_debug.cpu#23.nr_switches 3405993 ± 2% -17.6% 2807165 ± 2% sched_debug.cpu#23.sched_count 3390254 ± 2% -17.0% 2814478 ± 1% sched_debug.cpu#23.ttwu_count 3386402 ± 2% -17.5% 2794862 ± 2% sched_debug.cpu#23.ttwu_local 3426699 ± 2% -18.1% 2807177 ± 2% sched_debug.cpu#24.nr_switches 3427534 ± 2% -18.1% 2807540 ± 2% sched_debug.cpu#24.sched_count 3419707 ± 2% -17.2% 2830470 ± 2% sched_debug.cpu#24.ttwu_count 3417657 ± 2% -18.3% 2793422 ± 2% sched_debug.cpu#24.ttwu_local 17.75 ± 7% -15.5% 15.00 ± 4% sched_debug.cpu#25.cpu_load[3] 15.50 ± 9% -16.1% 13.00 ± 5% sched_debug.cpu#25.cpu_load[4] 3390931 ± 3% -16.7% 2825710 ± 2% sched_debug.cpu#25.nr_switches 3394428 ± 3% -16.7% 2826362 ± 2% sched_debug.cpu#25.sched_count 3386135 ± 3% -17.1% 2806667 ± 2% sched_debug.cpu#25.ttwu_count 3374191 ± 3% -17.0% 2800759 ± 2% sched_debug.cpu#25.ttwu_local 3382304 ± 3% -16.8% 2815129 ± 1% sched_debug.cpu#26.nr_switches 3382617 ± 3% -16.8% 2815612 ± 1% sched_debug.cpu#26.sched_count 3391284 ± 2% -17.4% 2800669 ± 2% sched_debug.cpu#26.ttwu_count 3368626 ± 3% -17.0% 2797457 ± 1% sched_debug.cpu#26.ttwu_local 21.75 ± 13% +448.3% 119.25 ±114% sched_debug.cpu#27.load 3377532 ± 2% -17.0% 2802024 ± 1% sched_debug.cpu#27.nr_switches 3377791 ± 2% -17.0% 2803686 ± 1% sched_debug.cpu#27.sched_count 913.75 ± 15% +96.1% 1792 ± 34% sched_debug.cpu#27.sched_goidle 3378183 ± 3% -17.9% 2772945 ± 1% sched_debug.cpu#27.ttwu_count 3361335 ± 3% -17.6% 2769863 ± 1% sched_debug.cpu#27.ttwu_local 126632 ± 46% +52.9% 193604 ± 4% sched_debug.cpu#28.avg_idle 3391259 ± 3% -17.1% 2813047 ± 1% sched_debug.cpu#28.nr_switches 3391775 ± 3% -17.0% 2815887 ± 1% sched_debug.cpu#28.sched_count 3379019 ± 3% -16.9% 2808674 ± 1% sched_debug.cpu#28.ttwu_count 3377041 ± 3% -16.9% 2806132 ± 1% sched_debug.cpu#28.ttwu_local 3374213 ± 3% -16.6% 2812863 ± 1% sched_debug.cpu#29.nr_switches 3374449 ± 3% -16.6% 2815602 ± 1% sched_debug.cpu#29.sched_count 1120 ± 28% +92.2% 2153 ± 33% sched_debug.cpu#29.sched_goidle 3368967 ± 3% -17.4% 2783822 ± 0% sched_debug.cpu#29.ttwu_count 3360964 ± 3% -17.4% 2777215 ± 0% sched_debug.cpu#29.ttwu_local 3380214 ± 2% -17.8% 2777895 ± 1% sched_debug.cpu#3.nr_switches 3380943 ± 2% -17.8% 2779026 ± 1% sched_debug.cpu#3.sched_count 3371958 ± 2% -17.7% 2773613 ± 1% sched_debug.cpu#3.ttwu_count 3368641 ± 2% -17.8% 2770455 ± 1% sched_debug.cpu#3.ttwu_local 3399413 ± 2% -17.2% 2813130 ± 1% sched_debug.cpu#30.nr_switches 3399925 ± 2% -17.3% 2813415 ± 1% sched_debug.cpu#30.sched_count 3388030 ± 2% -17.2% 2805998 ± 1% sched_debug.cpu#30.ttwu_count 3384874 ± 2% -17.2% 2803761 ± 1% sched_debug.cpu#30.ttwu_local 3424347 ± 2% -17.9% 2809733 ± 1% sched_debug.cpu#31.nr_switches 3424975 ± 2% -18.0% 2809973 ± 1% sched_debug.cpu#31.sched_count 3413707 ± 2% -17.9% 2802556 ± 1% sched_debug.cpu#31.ttwu_count 3411722 ± 2% -17.9% 2800372 ± 1% sched_debug.cpu#31.ttwu_local 161244 ± 31% +141.0% 388617 ± 75% sched_debug.cpu#32.avg_idle 3340294 ± 4% -16.8% 2779491 ± 1% sched_debug.cpu#32.nr_switches 3340509 ± 4% -16.8% 2779888 ± 1% sched_debug.cpu#32.sched_count 3336888 ± 3% -16.4% 2788296 ± 2% sched_debug.cpu#32.ttwu_count 3327022 ± 4% -17.1% 2756567 ± 1% sched_debug.cpu#32.ttwu_local 3369761 ± 2% -18.2% 2756152 ± 2% sched_debug.cpu#33.nr_switches 3370085 ± 2% -18.2% 2757175 ± 2% sched_debug.cpu#33.sched_count 3353138 ± 2% -17.9% 2754433 ± 1% sched_debug.cpu#33.ttwu_count 3350768 ± 2% -18.5% 2731749 ± 2% sched_debug.cpu#33.ttwu_local 3353463 ± 2% -17.1% 2778380 ± 1% sched_debug.cpu#34.nr_switches 3353783 ± 2% -17.1% 2778950 ± 1% sched_debug.cpu#34.sched_count 3338913 ± 2% -17.1% 2769303 ± 1% sched_debug.cpu#34.ttwu_count 3336154 ± 2% -17.0% 2767598 ± 1% sched_debug.cpu#34.ttwu_local 19.75 ± 6% -13.9% 17.00 ± 7% sched_debug.cpu#35.cpu_load[1] 19.75 ± 4% -17.7% 16.25 ± 6% sched_debug.cpu#35.cpu_load[2] 19.75 ± 4% -17.7% 16.25 ± 5% sched_debug.cpu#35.cpu_load[3] 17.25 ± 11% -20.3% 13.75 ± 10% sched_debug.cpu#35.cpu_load[4] 3357618 ± 2% -17.1% 2784568 ± 1% sched_debug.cpu#35.nr_switches 3357860 ± 2% -17.0% 2785577 ± 1% sched_debug.cpu#35.sched_count 3350978 ± 2% -17.1% 2779124 ± 1% sched_debug.cpu#35.ttwu_count 3348950 ± 2% -17.1% 2775164 ± 1% sched_debug.cpu#35.ttwu_local 33.50 ± 8% -29.9% 23.50 ± 24% sched_debug.cpu#36.load 2.00 ± 0% -50.0% 1.00 ± 0% sched_debug.cpu#36.nr_running 3378181 ± 2% -17.8% 2776642 ± 2% sched_debug.cpu#36.nr_switches 3378466 ± 2% -17.8% 2777079 ± 2% sched_debug.cpu#36.sched_count 3374695 ± 2% -17.8% 2774072 ± 2% sched_debug.cpu#36.ttwu_count 3370536 ± 2% -18.0% 2763776 ± 2% sched_debug.cpu#36.ttwu_local 17.50 ± 13% -22.9% 13.50 ± 12% sched_debug.cpu#37.cpu_load[1] 3340460 ± 3% -16.8% 2779658 ± 2% sched_debug.cpu#37.nr_switches 3340683 ± 3% -16.8% 2779914 ± 2% sched_debug.cpu#37.sched_count 3341001 ± 2% -17.4% 2760062 ± 3% sched_debug.cpu#37.ttwu_count 3324668 ± 3% -17.1% 2756964 ± 2% sched_debug.cpu#37.ttwu_local 18.75 ± 7% -21.3% 14.75 ± 12% sched_debug.cpu#38.cpu_load[3] 17.50 ± 12% -27.1% 12.75 ± 3% sched_debug.cpu#38.cpu_load[4] 3401218 ± 2% -18.2% 2782005 ± 1% sched_debug.cpu#38.nr_switches 3401410 ± 2% -18.2% 2782445 ± 1% sched_debug.cpu#38.sched_count 3400794 ± 2% -18.1% 2784512 ± 2% sched_debug.cpu#38.ttwu_count 3399813 ± 2% -18.6% 2768586 ± 1% sched_debug.cpu#38.ttwu_local 17.50 ± 11% -22.9% 13.50 ± 15% sched_debug.cpu#39.cpu_load[4] 3392132 ± 2% -17.0% 2815024 ± 2% sched_debug.cpu#39.nr_switches 3392712 ± 2% -17.0% 2815476 ± 2% sched_debug.cpu#39.sched_count 3389117 ± 2% -16.9% 2816247 ± 1% sched_debug.cpu#39.ttwu_count 3387435 ± 2% -17.3% 2802276 ± 2% sched_debug.cpu#39.ttwu_local 165738 ± 10% +22.5% 203085 ± 10% sched_debug.cpu#4.avg_idle 20.00 ± 15% -26.2% 14.75 ± 5% sched_debug.cpu#4.cpu_load[2] 20.00 ± 15% -27.5% 14.50 ± 5% sched_debug.cpu#4.cpu_load[3] 17.75 ± 21% -29.6% 12.50 ± 6% sched_debug.cpu#4.cpu_load[4] 3373163 ± 2% -17.8% 2772508 ± 2% sched_debug.cpu#4.nr_switches 3373753 ± 2% -17.8% 2773251 ± 2% sched_debug.cpu#4.sched_count 3362050 ± 2% -17.9% 2761172 ± 2% sched_debug.cpu#4.ttwu_count 3356987 ± 2% -17.9% 2755498 ± 2% sched_debug.cpu#4.ttwu_local 18.25 ± 9% -17.8% 15.00 ± 0% sched_debug.cpu#40.cpu_load[3] 15.75 ± 12% -22.2% 12.25 ± 3% sched_debug.cpu#40.cpu_load[4] 3387417 ± 3% -16.6% 2826272 ± 1% sched_debug.cpu#40.nr_switches 3388123 ± 3% -16.6% 2826849 ± 1% sched_debug.cpu#40.sched_count 3379250 ± 3% -16.0% 2837310 ± 2% sched_debug.cpu#40.ttwu_count 3375881 ± 3% -16.5% 2817881 ± 1% sched_debug.cpu#40.ttwu_local 3339240 ± 2% -16.2% 2796813 ± 0% sched_debug.cpu#41.nr_switches 4.75 ± 40% -100.0% 0.00 ± 2% sched_debug.cpu#41.nr_uninterruptible 3339755 ± 2% -16.2% 2797077 ± 0% sched_debug.cpu#41.sched_count 3340575 ± 2% -17.0% 2773377 ± 0% sched_debug.cpu#41.ttwu_count 3320958 ± 2% -16.5% 2771410 ± 0% sched_debug.cpu#41.ttwu_local 3383562 ± 2% -16.9% 2811241 ± 1% sched_debug.cpu#42.nr_switches 3383989 ± 2% -16.9% 2811641 ± 1% sched_debug.cpu#42.sched_count 3375932 ± 2% -16.9% 2803836 ± 1% sched_debug.cpu#42.ttwu_count 3373666 ± 2% -16.9% 2801995 ± 1% sched_debug.cpu#42.ttwu_local 1465 ± 2% +19.7% 1753 ± 12% sched_debug.cpu#43.curr->pid 3369174 ± 3% -16.5% 2814479 ± 2% sched_debug.cpu#43.nr_switches 3369600 ± 3% -16.5% 2815000 ± 2% sched_debug.cpu#43.sched_count 3381844 ± 3% -16.8% 2813877 ± 2% sched_debug.cpu#43.ttwu_count 3363319 ± 3% -16.6% 2805345 ± 2% sched_debug.cpu#43.ttwu_local 3373569 ± 3% -16.8% 2805446 ± 2% sched_debug.cpu#44.nr_switches 3374319 ± 3% -16.8% 2806109 ± 2% sched_debug.cpu#44.sched_count 3366509 ± 3% -16.6% 2808499 ± 2% sched_debug.cpu#44.ttwu_count 3364864 ± 3% -17.1% 2788871 ± 2% sched_debug.cpu#44.ttwu_local 19.00 ± 13% -25.0% 14.25 ± 12% sched_debug.cpu#45.cpu_load[0] 3386942 ± 3% -16.9% 2816202 ± 2% sched_debug.cpu#45.nr_switches 3387927 ± 3% -16.8% 2817175 ± 2% sched_debug.cpu#45.sched_count 3379784 ± 4% -17.1% 2802342 ± 2% sched_debug.cpu#45.ttwu_count 3374320 ± 4% -17.0% 2799191 ± 2% sched_debug.cpu#45.ttwu_local 17.50 ± 6% -18.6% 14.25 ± 13% sched_debug.cpu#46.cpu_load[1] 14.50 ± 7% -19.0% 11.75 ± 12% sched_debug.cpu#46.cpu_load[4] 3362941 ± 3% -15.9% 2828995 ± 2% sched_debug.cpu#46.nr_switches 3363152 ± 3% -15.9% 2829614 ± 2% sched_debug.cpu#46.sched_count 3365155 ± 3% -16.0% 2825366 ± 2% sched_debug.cpu#46.ttwu_count 3352628 ± 3% -15.8% 2823128 ± 2% sched_debug.cpu#46.ttwu_local 182936 ± 1% +8.1% 197759 ± 4% sched_debug.cpu#47.avg_idle 3411346 ± 3% -17.3% 2820818 ± 1% sched_debug.cpu#47.nr_switches 3412191 ± 3% -17.3% 2821388 ± 1% sched_debug.cpu#47.sched_count 3405411 ± 3% -17.2% 2819712 ± 1% sched_debug.cpu#47.ttwu_count 3403059 ± 3% -17.3% 2815610 ± 1% sched_debug.cpu#47.ttwu_local 3384910 ± 2% -17.8% 2782329 ± 2% sched_debug.cpu#48.nr_switches 3385314 ± 2% -17.8% 2782524 ± 2% sched_debug.cpu#48.sched_count 3372909 ± 2% -17.2% 2792501 ± 2% sched_debug.cpu#48.ttwu_count 3371515 ± 2% -18.1% 2760527 ± 3% sched_debug.cpu#48.ttwu_local 20.00 ± 10% -25.0% 15.00 ± 16% sched_debug.cpu#49.cpu_load[3] 19.75 ± 16% -32.9% 13.25 ± 16% sched_debug.cpu#49.cpu_load[4] 3361041 ± 1% -16.7% 2799376 ± 1% sched_debug.cpu#49.nr_switches 3361389 ± 2% -16.7% 2799954 ± 1% sched_debug.cpu#49.sched_count 803.25 ± 66% +81.8% 1460 ± 12% sched_debug.cpu#49.sched_goidle 3381487 ± 2% -17.5% 2790957 ± 2% sched_debug.cpu#49.ttwu_count 3353421 ± 1% -16.8% 2788906 ± 2% sched_debug.cpu#49.ttwu_local 15.75 ± 9% +50.8% 23.75 ± 35% sched_debug.cpu#5.cpu_load[0] 3391672 ± 2% -17.9% 2785157 ± 2% sched_debug.cpu#5.nr_switches 3391868 ± 2% -17.9% 2786330 ± 2% sched_debug.cpu#5.sched_count 3383157 ± 2% -18.0% 2774308 ± 2% sched_debug.cpu#5.ttwu_count 3378359 ± 2% -18.0% 2771534 ± 2% sched_debug.cpu#5.ttwu_local 3378831 ± 2% -18.2% 2764907 ± 1% sched_debug.cpu#50.nr_switches 3379167 ± 2% -18.2% 2765068 ± 1% sched_debug.cpu#50.sched_count 3381931 ± 2% -18.4% 2759976 ± 2% sched_debug.cpu#50.ttwu_count 3372100 ± 2% -19.0% 2732913 ± 2% sched_debug.cpu#50.ttwu_local 3391742 ± 2% -17.8% 2787873 ± 2% sched_debug.cpu#51.nr_switches 3393991 ± 3% -17.9% 2788131 ± 2% sched_debug.cpu#51.sched_count 3388915 ± 2% -18.0% 2779415 ± 2% sched_debug.cpu#51.ttwu_count 3386448 ± 2% -18.0% 2776396 ± 2% sched_debug.cpu#51.ttwu_local 3353919 ± 2% -17.8% 2755852 ± 2% sched_debug.cpu#52.nr_switches 3354723 ± 2% -17.8% 2756388 ± 2% sched_debug.cpu#52.sched_count 3341951 ± 2% -18.3% 2731052 ± 3% sched_debug.cpu#52.ttwu_count 3337845 ± 2% -18.5% 2720797 ± 3% sched_debug.cpu#52.ttwu_local 3373578 ± 3% -17.1% 2796911 ± 2% sched_debug.cpu#53.nr_switches 3375925 ± 3% -17.1% 2797166 ± 2% sched_debug.cpu#53.sched_count 3383459 ± 2% -17.5% 2790891 ± 2% sched_debug.cpu#53.ttwu_count 3366616 ± 3% -17.3% 2784981 ± 2% sched_debug.cpu#53.ttwu_local 3390257 ± 3% -17.9% 2782148 ± 2% sched_debug.cpu#54.nr_switches 3391465 ± 3% -18.0% 2782549 ± 2% sched_debug.cpu#54.sched_count 3386304 ± 3% -16.9% 2812809 ± 1% sched_debug.cpu#54.ttwu_count 3384612 ± 3% -18.3% 2766815 ± 3% sched_debug.cpu#54.ttwu_local 22.25 ± 17% -23.6% 17.00 ± 7% sched_debug.cpu#55.cpu_load[1] 21.00 ± 16% -21.4% 16.50 ± 3% sched_debug.cpu#55.cpu_load[2] 19.75 ± 13% -20.3% 15.75 ± 5% sched_debug.cpu#55.cpu_load[3] 3374233 ± 1% -16.8% 2807090 ± 1% sched_debug.cpu#55.nr_switches 3374808 ± 1% -16.8% 2807431 ± 1% sched_debug.cpu#55.sched_count 3366364 ± 1% -17.2% 2786327 ± 1% sched_debug.cpu#55.ttwu_count 3362765 ± 1% -17.3% 2780406 ± 1% sched_debug.cpu#55.ttwu_local 3411822 ± 2% -17.6% 2811122 ± 2% sched_debug.cpu#56.nr_switches 3412183 ± 2% -17.6% 2811594 ± 2% sched_debug.cpu#56.sched_count 3407786 ± 2% -17.6% 2809656 ± 2% sched_debug.cpu#56.ttwu_count 3406197 ± 2% -17.7% 2804844 ± 2% sched_debug.cpu#56.ttwu_local 3397172 ± 3% -17.2% 2811744 ± 2% sched_debug.cpu#57.nr_switches 3397605 ± 3% -17.2% 2812005 ± 2% sched_debug.cpu#57.sched_count 3384695 ± 3% -16.6% 2822416 ± 2% sched_debug.cpu#57.ttwu_count 3382809 ± 3% -17.3% 2798177 ± 2% sched_debug.cpu#57.ttwu_local 188353 ± 1% +77.7% 334775 ± 61% sched_debug.cpu#58.avg_idle 3368337 ± 3% -16.7% 2805233 ± 2% sched_debug.cpu#58.nr_switches 3368535 ± 3% -16.7% 2805585 ± 2% sched_debug.cpu#58.sched_count 3360154 ± 4% -16.7% 2799389 ± 2% sched_debug.cpu#58.ttwu_count 3350965 ± 4% -16.5% 2796475 ± 1% sched_debug.cpu#58.ttwu_local 3386769 ± 3% -17.8% 2784174 ± 1% sched_debug.cpu#59.nr_switches 3387003 ± 3% -17.8% 2784602 ± 1% sched_debug.cpu#59.sched_count 3374107 ± 3% -17.4% 2786119 ± 1% sched_debug.cpu#59.ttwu_count 3371740 ± 3% -17.9% 2767788 ± 1% sched_debug.cpu#59.ttwu_local 3404679 ± 2% -17.7% 2803402 ± 2% sched_debug.cpu#6.nr_switches 3404946 ± 2% -17.6% 2804520 ± 2% sched_debug.cpu#6.sched_count 3396778 ± 2% -17.7% 2794779 ± 2% sched_debug.cpu#6.ttwu_count 3395316 ± 2% -17.8% 2789570 ± 2% sched_debug.cpu#6.ttwu_local 20.50 ± 8% -24.4% 15.50 ± 5% sched_debug.cpu#60.cpu_load[0] 3378881 ± 3% -17.1% 2799854 ± 1% sched_debug.cpu#60.nr_switches 3379401 ± 3% -17.1% 2800303 ± 1% sched_debug.cpu#60.sched_count 3370998 ± 3% -17.4% 2784997 ± 2% sched_debug.cpu#60.ttwu_count 3369479 ± 3% -17.4% 2783285 ± 2% sched_debug.cpu#60.ttwu_local 3389402 ± 2% -18.2% 2771097 ± 1% sched_debug.cpu#61.nr_switches 2.75 ±104% -72.7% 0.75 ±110% sched_debug.cpu#61.nr_uninterruptible 3389770 ± 2% -18.2% 2771881 ± 1% sched_debug.cpu#61.sched_count 448.25 ± 43% +362.6% 2073 ± 18% sched_debug.cpu#61.sched_goidle 3382036 ± 2% -18.4% 2761058 ± 3% sched_debug.cpu#61.ttwu_count 3374996 ± 2% -18.8% 2738991 ± 2% sched_debug.cpu#61.ttwu_local 3401719 ± 2% -17.5% 2806660 ± 1% sched_debug.cpu#62.nr_switches 3401992 ± 2% -17.5% 2807250 ± 1% sched_debug.cpu#62.sched_count 3409442 ± 3% -17.8% 2801102 ± 1% sched_debug.cpu#62.ttwu_count 3396668 ± 2% -17.6% 2799344 ± 1% sched_debug.cpu#62.ttwu_local 188622 ± 1% +82.6% 344360 ± 61% sched_debug.cpu#63.avg_idle 3403259 ± 1% -17.7% 2800949 ± 2% sched_debug.cpu#63.nr_switches 3403635 ± 1% -17.7% 2801160 ± 2% sched_debug.cpu#63.sched_count 1502 ± 36% -60.9% 587.25 ± 38% sched_debug.cpu#63.sched_goidle 3407423 ± 1% -18.1% 2792346 ± 2% sched_debug.cpu#63.ttwu_count 3394668 ± 1% -17.8% 2791028 ± 2% sched_debug.cpu#63.ttwu_local 3395141 ± 2% -17.1% 2815960 ± 1% sched_debug.cpu#7.nr_switches 3395368 ± 2% -17.0% 2817099 ± 1% sched_debug.cpu#7.sched_count 3390104 ± 2% -16.8% 2819988 ± 1% sched_debug.cpu#7.ttwu_count 3388220 ± 2% -17.2% 2806057 ± 2% sched_debug.cpu#7.ttwu_local 20.75 ± 26% -32.5% 14.00 ± 8% sched_debug.cpu#8.cpu_load[3] 19.00 ± 21% -35.5% 12.25 ± 12% sched_debug.cpu#8.cpu_load[4] 3412535 ± 3% -16.9% 2834133 ± 2% sched_debug.cpu#8.nr_switches 3414440 ± 3% -17.0% 2834516 ± 2% sched_debug.cpu#8.sched_count 3400639 ± 3% -16.8% 2828023 ± 2% sched_debug.cpu#8.ttwu_count 3397501 ± 3% -16.9% 2822112 ± 1% sched_debug.cpu#8.ttwu_local 21.75 ± 30% -32.2% 14.75 ± 10% sched_debug.cpu#9.cpu_load[1] 20.50 ± 22% -26.8% 15.00 ± 12% sched_debug.cpu#9.cpu_load[2] 3361173 ± 2% -15.8% 2828970 ± 2% sched_debug.cpu#9.nr_switches 3363065 ± 2% -15.9% 2829633 ± 2% sched_debug.cpu#9.sched_count 3352680 ± 3% -15.8% 2822914 ± 1% sched_debug.cpu#9.ttwu_count 3339358 ± 2% -15.6% 2819319 ± 2% sched_debug.cpu#9.ttwu_local lkp-sbx04: Sandy Bridge-EX Memory: 64G perf-profile.cpu-cycles.sys_connect.entry_SYSCALL_64_fastpath 33 ++---------------------------------------------------------------------+ | O O | 32 ++ O | 31 ++ O | | O O | 30 O+ O O O O O | | O O O O O O O | 29 ++ O O O O | | | 28 ++ | 27 ++ *. .*.* | | *.*.*. + *. .* + .* 26 ++ * *.*.*.*.*. .*. .*.. .*.*. .*.* *.*. .*.*.*. .* | * *.*.* * * * * * | 25 ++---------------------------------------------------------------------+ perf-profile.cpu-cycles.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath 33 ++---------------------------------------------------------------------+ | O | 32 ++ O O | 31 ++ O | | O O | 30 O+ O O O O O | | O O O O O O | 29 ++ O O O O O | | | 28 ++ | 27 ++ *. .*. | | *.*.*. + *. * *. .* 26 ++ * *.*.*.*.*. * *.. .*.*. .*. + *.*. .*.*.* * | * *. + + + * * * * + + | 25 ++------------------------*-*---*----------------------------------*---+ perf-profile.cpu-cycles.sock_release.sock_close.__fput.____fput.task_work_run 26 ++-----------------------------------------O---------------------------+ | | 24 ++ O O O | 22 ++ O | | O O | 20 ++ O | | | 18 ++ | | O | 16 O+O O O O | 14 ++ O O O O O O O O O | | | 12 ++ .*. | *. .*.*. .*.*.*.*.*.* *.*.*.*.*..*.*.*.*.*.*.*. .*.*.*.*.*.*.*.*.| 10 ++*-*-----*----------------------------------------*-*-----------------* perf-profile.cpu-cycles.inet_release.sock_release.sock_close.__fput.____fput 26 ++---------------------------------------------------------------------+ | O | 24 ++ O O | 22 ++ O O | | O O | 20 ++ O | | | 18 ++ | | O | 16 O+O O O O | 14 ++ O O O O O O O O O | | | 12 ++ | *. .*.*. .*.*.*.*.*.*.*.*.*.*.*.*..*.*.*.*.*.*.*. .*.*.*.*.*.*.*.*.| 10 ++*-*-----*----------------------------------------*-*-----------------* perf-profile.cpu-cycles.tcp_close.inet_release.sock_release.sock_close.__fput 26 ++---------------------------------------------------------------------+ | O | 24 ++ O O O | 22 ++ O | | O O O | 20 ++ | 18 ++ | | | 16 O+O O O | 14 ++ O O O O O O O O O O O | | | 12 *+ .*.*.*. .*. | 10 ++*.*.*.*.*.*.*.*.*.*.* * *..*.*.*.*.*.*.*. .*.*.*.*.*.*.*.*.*.* | * | 8 ++---------------------------------------------------------------------+ netperf.time.system_time 15000 ++------------------------------------------------------------------+ 14800 ++ O O | | O O | 14600 ++ O | 14400 ++ O O | | O | 14200 ++ | 14000 ++ | 13800 O+O O O O | | O O O OO O O O | 13600 ++ O O | 13400 ++ | | | 13200 *+*.*.*.*.*.*.*.**.*.*.*.*.*.*.*.*.*.*.*.*.*.*.*.*.**.*.*.*.*.*.*.*.* 13000 ++------------------------------------------------------------------+ netperf.time.percent_of_cpu_this_job_got 5200 ++-------------------------------------------------------------------+ | O | 5100 ++ O | | O O O | 5000 ++ O O | | O | 4900 ++ | | O | 4800 O+O O O O O O O | | O O O O O O | 4700 ++ | *. .*. .*. | 4600 ++*.*.*.*.*.*.*.*.*.*.*.* *.*.*.**.*.*.* *.*.*.*.*.*.*.*.*.*.*.*.* | | 4500 ++-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample To reproduce: git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Ying Huang