January 2019 - LKP - Ml01.01.Org

Re: [LKP] [rcu] kernel BUG at include/linux/pagemap.h:149!

by Frederic Weisbecker

On Fri, Sep 11, 2015 at 10:19:47AM +0800, Boqun Feng wrote: > Subject: [PATCH 01/27] rcu: Don't disable preemption for Tiny and Tree RCU > readers > > Because preempt_disable() maps to barrier() for non-debug builds, > it forces the compiler to spill and reload registers. Because Tree > RCU and Tiny RCU now only appear in CONFIG_PREEMPT=n builds, these > barrier() instances generate needless extra code for each instance of > rcu_read_lock() and rcu_read_unlock(). This extra code slows down Tree > RCU and bloats Tiny RCU. > > This commit therefore removes the preempt_disable() and preempt_enable() > from the non-preemptible implementations of __rcu_read_lock() and > __rcu_read_unlock(), respectively. > > For debug purposes, preempt_disable() and preempt_enable() are still > kept if CONFIG_PREEMPT_COUNT=y, which makes the detection of sleeping > inside atomic sections still work in non-preemptible kernels. > > Signed-off-by: Boqun Feng <boqun.feng(a)gmail.com> > Signed-off-by: Paul E. McKenney <paulmck(a)linux.vnet.ibm.com> > --- > include/linux/rcupdate.h | 6 ++++-- > include/linux/rcutiny.h | 1 + > kernel/rcu/tree.c | 9 +++++++++ > 3 files changed, 14 insertions(+), 2 deletions(-) > > diff --git a/include/linux/rcupdate.h b/include/linux/rcupdate.h > index d63bb77..6c3cece 100644 > --- a/include/linux/rcupdate.h > +++ b/include/linux/rcupdate.h > @@ -297,12 +297,14 @@ void synchronize_rcu(void); > > static inline void __rcu_read_lock(void) > { > - preempt_disable(); > + if (IS_ENABLED(CONFIG_PREEMPT_COUNT)) > + preempt_disable(); preempt_disable() is a no-op when !CONFIG_PREEMPT_COUNT, right? Or rather it's a barrier(), which is anyway implied by rcu_read_lock(). So perhaps we can get rid of the IS_ENABLED() check?

2 years, 7 months

4
4
0 / 0

[mm] ac5b2c1891: vm-scalability.throughput -61.3% regression

by kernel test robot

Greeting, FYI, we noticed a -61.3% regression of vm-scalability.throughput due to commit: commit: ac5b2c18911ffe95c08d69273917f90212cf5659 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: vm-scalability on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory with following parameters: runtime: 300 thp_enabled: always thp_defrag: always nr_task: 32 nr_ssd: 1 test: swap-w-seq ucode: 0x3d cpufreq_governor: performance test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us. test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode: gcc-7/performance/x86_64-rhel-7.2/1/32/debian-x86_64-2018-04-03.cgz/300/lkp-hsw-ep4/swap-w-seq/vm-scalability/always/always/0x3d commit: 94e297c50b ("include/linux/notifier.h: SRCU: fix ctags") ac5b2c1891 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings") 94e297c50b529f5d ac5b2c18911ffe95c08d692739 ---------------- -------------------------- %stddev %change %stddev \ | \ 0.57 ± 35% +258.8% 2.05 ± 4% vm-scalability.free_time 146022 ± 14% -40.5% 86833 ± 2% vm-scalability.median 29.29 ± 40% -89.6% 3.06 ± 26% vm-scalability.stddev 7454656 ± 9% -61.3% 2885836 ± 3% vm-scalability.throughput 189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time 189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time.max 8768 ± 3% +11.6% 9781 ± 5% vm-scalability.time.involuntary_context_switches 20320196 ± 2% -33.4% 13531732 ± 3% vm-scalability.time.maximum_resident_set_size 425945 ± 9% +17.4% 499908 ± 4% vm-scalability.time.minor_page_faults 253.79 ± 6% +62.0% 411.07 ± 4% vm-scalability.time.system_time 322.52 +8.0% 348.18 vm-scalability.time.user_time 246150 ± 12% +50.3% 370019 ± 4% vm-scalability.time.voluntary_context_switches 7746519 ± 11% +49.0% 11538799 ± 4% cpuidle.C6.usage 192240 ± 10% +44.3% 277460 ± 8% interrupts.CAL:Function_call_interrupts 22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.MIN_vruntime.avg 22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.max_vruntime.avg 29.36 ± 13% +10.8% 32.52 ± 14% boot-time.boot 24.28 ± 16% +12.4% 27.30 ± 16% boot-time.dhcp 1597 ± 15% +10.2% 1760 ± 15% boot-time.idle 68.25 -9.8 58.48 ± 2% mpstat.cpu.idle% 27.12 ± 5% +10.3 37.42 ± 3% mpstat.cpu.iowait% 2.48 ± 11% -0.8 1.73 ± 2% mpstat.cpu.usr% 3422396 ± 14% +46.6% 5018492 ± 7% softirqs.RCU 1776561 ± 10% +52.4% 2707785 ± 2% softirqs.SCHED 5685772 ± 7% +54.3% 8774055 ± 3% softirqs.TIMER 7742519 ± 11% +49.0% 11534924 ± 4% turbostat.C6 29922317 ± 10% +55.0% 46366941 turbostat.IRQ 9.49 ± 64% -83.0% 1.62 ± 54% turbostat.Pkg%pc2 36878790 ± 27% -84.9% 5570259 ± 47% vmstat.memory.free 1.117e+08 ± 15% +73.5% 1.939e+08 ± 10% vmstat.memory.swpd 25.25 ± 4% +34.7% 34.00 vmstat.procs.b 513725 ± 7% +47.9% 759561 ± 12% numa-numastat.node0.local_node 35753 ±160% +264.7% 130386 ± 39% numa-numastat.node0.numa_foreign 519403 ± 6% +48.7% 772182 ± 12% numa-numastat.node0.numa_hit 35753 ±160% +264.7% 130386 ± 39% numa-numastat.node1.numa_miss 44315 ±138% +198.5% 132279 ± 40% numa-numastat.node1.other_node 32798032 ± 46% +80.6% 59228165 ± 2% numa-meminfo.node0.Active 32798009 ± 46% +80.6% 59228160 ± 2% numa-meminfo.node0.Active(anon) 33430762 ± 46% +80.8% 60429537 ± 2% numa-meminfo.node0.AnonHugePages 33572119 ± 46% +80.2% 60512777 ± 2% numa-meminfo.node0.AnonPages 1310559 ± 64% +86.4% 2442244 ± 2% numa-meminfo.node0.Inactive 1309969 ± 64% +86.4% 2442208 ± 2% numa-meminfo.node0.Inactive(anon) 30385359 ± 53% -90.7% 2821023 ± 44% numa-meminfo.node0.MemFree 35505047 ± 45% +77.6% 63055165 ± 2% numa-meminfo.node0.MemUsed 166560 ± 42% +130.2% 383345 ± 6% numa-meminfo.node0.PageTables 23702 ±105% -89.0% 2617 ± 44% numa-meminfo.node0.Shmem 1212 ± 65% +402.8% 6093 ± 57% numa-meminfo.node1.Shmem 8354144 ± 44% +77.1% 14798964 ± 2% numa-vmstat.node0.nr_active_anon 8552787 ± 44% +76.8% 15122222 ± 2% numa-vmstat.node0.nr_anon_pages 16648 ± 44% +77.1% 29492 ± 2% numa-vmstat.node0.nr_anon_transparent_hugepages 7436650 ± 53% -90.4% 712936 ± 44% numa-vmstat.node0.nr_free_pages 332106 ± 63% +83.8% 610268 ± 2% numa-vmstat.node0.nr_inactive_anon 41929 ± 41% +130.6% 96703 ± 6% numa-vmstat.node0.nr_page_table_pages 5900 ±106% -89.0% 650.75 ± 45% numa-vmstat.node0.nr_shmem 43336 ± 92% +151.2% 108840 ± 7% numa-vmstat.node0.nr_vmscan_write 43110 ± 92% +150.8% 108110 ± 7% numa-vmstat.node0.nr_written 8354142 ± 44% +77.1% 14798956 ± 2% numa-vmstat.node0.nr_zone_active_anon 332105 ± 63% +83.8% 610269 ± 2% numa-vmstat.node0.nr_zone_inactive_anon 321.50 ± 66% +384.9% 1559 ± 59% numa-vmstat.node1.nr_shmem 88815743 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active 88815702 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active(anon) 90446011 ± 11% +34.0% 1.212e+08 ± 2% meminfo.AnonHugePages 90613587 ± 11% +34.0% 1.214e+08 ± 2% meminfo.AnonPages 5.15e+08 ± 3% +22.2% 6.293e+08 ± 2% meminfo.Committed_AS 187419 ± 10% -19.6% 150730 ± 7% meminfo.DirectMap4k 3620693 ± 18% +35.3% 4897093 ± 2% meminfo.Inactive 3620054 ± 18% +35.3% 4896961 ± 2% meminfo.Inactive(anon) 36144979 ± 28% -87.0% 4715681 ± 57% meminfo.MemAvailable 36723121 ± 27% -85.9% 5179468 ± 52% meminfo.MemFree 395801 ± 2% +56.9% 620816 ± 4% meminfo.PageTables 178672 +15.1% 205668 ± 2% meminfo.SUnreclaim 249496 +12.6% 280897 meminfo.Slab 1751813 ± 2% +34.7% 2360437 ± 3% meminfo.SwapCached 6.716e+08 -12.4% 5.88e+08 ± 2% meminfo.SwapFree 3926 ± 17% +72.9% 6788 ± 13% meminfo.Writeback 1076 ± 3% +42.9% 1538 ± 4% slabinfo.biovec-max.active_objs 275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.active_slabs 1104 ± 2% +41.0% 1557 ± 4% slabinfo.biovec-max.num_objs 275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.num_slabs 588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.active_objs 588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.num_objs 13852 ± 3% +37.5% 19050 ± 3% slabinfo.kmalloc-4k.active_objs 1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.active_slabs 14217 ± 3% +37.7% 19577 ± 3% slabinfo.kmalloc-4k.num_objs 1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.num_slabs 158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.active_objs 158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.num_objs 17762 ± 4% +44.3% 25638 ± 4% slabinfo.pool_workqueue.active_objs 563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.active_slabs 18048 ± 3% +43.5% 25906 ± 4% slabinfo.pool_workqueue.num_objs 563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.num_slabs 34631 ± 3% +21.0% 41905 ± 2% slabinfo.radix_tree_node.active_objs 624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.active_slabs 34998 ± 3% +20.7% 42228 ± 2% slabinfo.radix_tree_node.num_objs 624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.num_slabs 9.727e+11 ± 8% +50.4% 1.463e+12 ± 12% perf-stat.branch-instructions 1.11 ± 12% +1.2 2.31 ± 8% perf-stat.branch-miss-rate% 1.078e+10 ± 13% +214.9% 3.395e+10 ± 17% perf-stat.branch-misses 3.17 ± 11% -1.5 1.65 ± 9% perf-stat.cache-miss-rate% 8.206e+08 ± 7% +49.4% 1.226e+09 ± 11% perf-stat.cache-misses 2.624e+10 ± 14% +187.0% 7.532e+10 ± 17% perf-stat.cache-references 1174249 ± 9% +52.3% 1788442 ± 3% perf-stat.context-switches 2.921e+12 ± 8% +71.1% 4.998e+12 ± 9% perf-stat.cpu-cycles 1437 ± 14% +85.1% 2661 ± 20% perf-stat.cpu-migrations 7.586e+08 ± 21% +134.7% 1.78e+09 ± 30% perf-stat.dTLB-load-misses 7.943e+11 ± 11% +84.3% 1.464e+12 ± 14% perf-stat.dTLB-loads 93963731 ± 22% +40.9% 1.324e+08 ± 10% perf-stat.dTLB-store-misses 3.394e+11 ± 6% +60.5% 5.449e+11 ± 10% perf-stat.dTLB-stores 1.531e+08 ± 22% +44.0% 2.204e+08 ± 11% perf-stat.iTLB-load-misses 1.688e+08 ± 23% +71.1% 2.888e+08 ± 12% perf-stat.iTLB-loads 3.267e+12 ± 7% +58.5% 5.177e+12 ± 13% perf-stat.instructions 3988 ± 43% +123.9% 8930 ± 22% perf-stat.major-faults 901474 ± 5% +34.2% 1209877 ± 2% perf-stat.minor-faults 31.24 ± 10% +21.7 52.91 ± 2% perf-stat.node-load-miss-rate% 1.135e+08 ± 16% +187.6% 3.264e+08 ± 13% perf-stat.node-load-misses 6.27 ± 17% +26.9 33.19 ± 4% perf-stat.node-store-miss-rate% 27354489 ± 15% +601.2% 1.918e+08 ± 13% perf-stat.node-store-misses 905482 ± 5% +34.6% 1218833 ± 2% perf-stat.page-faults 4254 ± 7% +58.5% 6741 ± 13% perf-stat.path-length 6364 ± 25% +84.1% 11715 ± 14% proc-vmstat.allocstall_movable 46439 ± 12% +100.4% 93049 ± 21% proc-vmstat.compact_migrate_scanned 22425696 ± 10% +29.0% 28932634 ± 6% proc-vmstat.nr_active_anon 22875703 ± 11% +29.2% 29560082 ± 6% proc-vmstat.nr_anon_pages 44620 ± 11% +29.2% 57643 ± 6% proc-vmstat.nr_anon_transparent_hugepages 879436 ± 28% -77.3% 199768 ± 98% proc-vmstat.nr_dirty_background_threshold 1761029 ± 28% -77.3% 400034 ± 98% proc-vmstat.nr_dirty_threshold 715724 +17.6% 841386 ± 3% proc-vmstat.nr_file_pages 8960545 ± 28% -76.4% 2111248 ± 93% proc-vmstat.nr_free_pages 904330 ± 18% +31.2% 1186458 ± 7% proc-vmstat.nr_inactive_anon 11137 ± 2% +27.1% 14154 ± 9% proc-vmstat.nr_isolated_anon 12566 +3.5% 13012 proc-vmstat.nr_kernel_stack 97491 ± 2% +52.6% 148790 ± 10% proc-vmstat.nr_page_table_pages 17674 +6.2% 18763 ± 2% proc-vmstat.nr_slab_reclaimable 44820 +13.0% 50645 ± 2% proc-vmstat.nr_slab_unreclaimable 135763 ± 9% +68.4% 228600 ± 6% proc-vmstat.nr_vmscan_write 1017 ± 10% +54.7% 1573 ± 14% proc-vmstat.nr_writeback 220023 ± 5% +73.5% 381732 ± 6% proc-vmstat.nr_written 22425696 ± 10% +29.0% 28932635 ± 6% proc-vmstat.nr_zone_active_anon 904330 ± 18% +31.2% 1186457 ± 7% proc-vmstat.nr_zone_inactive_anon 1018 ± 10% +55.3% 1581 ± 13% proc-vmstat.nr_zone_write_pending 145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_foreign 671.50 ± 96% +479.4% 3890 ± 71% proc-vmstat.numa_hint_faults 1122389 ± 9% +17.2% 1315380 ± 4% proc-vmstat.numa_hit 214722 ± 5% +21.6% 261076 ± 3% proc-vmstat.numa_huge_pte_updates 1108142 ± 9% +17.4% 1300857 ± 4% proc-vmstat.numa_local 145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_miss 159615 ± 44% +57.6% 251573 ± 16% proc-vmstat.numa_other 185.50 ± 81% +8278.6% 15542 ± 40% proc-vmstat.numa_pages_migrated 1.1e+08 ± 5% +21.6% 1.337e+08 ± 3% proc-vmstat.numa_pte_updates 688332 ±106% +177.9% 1913062 ± 3% proc-vmstat.pgalloc_dma32 72593045 ± 10% +51.1% 1.097e+08 ± 3% proc-vmstat.pgdeactivate 919059 ± 4% +35.1% 1241472 ± 2% proc-vmstat.pgfault 3716 ± 45% +120.3% 8186 ± 25% proc-vmstat.pgmajfault 7.25 ± 26% +4.2e+05% 30239 ± 25% proc-vmstat.pgmigrate_fail 5340 ±106% +264.0% 19438 ± 33% proc-vmstat.pgmigrate_success 2.837e+08 ± 10% +51.7% 4.303e+08 ± 3% proc-vmstat.pgpgout 211428 ± 6% +74.1% 368188 ± 4% proc-vmstat.pgrefill 219051 ± 5% +73.7% 380419 ± 5% proc-vmstat.pgrotated 559397 ± 8% +43.0% 800110 ± 11% proc-vmstat.pgscan_direct 32894 ± 59% +158.3% 84981 ± 23% proc-vmstat.pgscan_kswapd 207042 ± 8% +71.5% 355174 ± 5% proc-vmstat.pgsteal_direct 14745 ± 65% +104.3% 30121 ± 18% proc-vmstat.pgsteal_kswapd 70934968 ± 10% +51.7% 1.076e+08 ± 3% proc-vmstat.pswpout 5852284 ± 12% +145.8% 14382881 ± 5% proc-vmstat.slabs_scanned 13453 ± 24% +204.9% 41023 ± 8% proc-vmstat.thp_split_page_failed 138385 ± 10% +51.6% 209783 ± 3% proc-vmstat.thp_split_pmd 138385 ± 10% +51.6% 209782 ± 3% proc-vmstat.thp_swpout 4.61 ± 24% -1.2 3.37 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle 2.90 ± 18% -0.7 2.19 ± 8% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 1.86 ± 32% -0.6 1.22 ± 7% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 1.60 ± 31% -0.5 1.08 ± 10% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt 2.98 ± 8% -0.5 2.48 ± 10% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.46 ± 32% -0.5 0.96 ± 9% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 0.74 ± 27% -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 1.03 ± 52% -0.4 0.63 ± 15% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 1.17 ± 19% -0.3 0.87 ± 11% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.80 ± 17% +0.4 1.22 ± 7% perf-profile.calltrace.cycles-pp.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request 0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage 0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio 0.52 ± 60% +0.5 1.03 ± 6% perf-profile.calltrace.cycles-pp.dma_pool_alloc.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request 1.64 ± 16% +0.6 2.21 ± 15% perf-profile.calltrace.cycles-pp.find_next_bit.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done 0.51 ± 64% +0.8 1.31 ± 17% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start 0.80 ± 25% +0.9 1.67 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request 0.82 ± 24% +0.9 1.71 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request 0.82 ± 25% +0.9 1.73 ± 19% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio 0.87 ± 25% +1.0 1.87 ± 14% perf-profile.calltrace.cycles-pp.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage 2.05 ± 15% +1.4 3.48 ± 7% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.__swap_writepage.pageout.shrink_page_list 2.09 ± 15% +1.4 3.53 ± 7% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg 2.05 ± 15% +1.4 3.49 ± 7% perf-profile.calltrace.cycles-pp.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage.pageout 2.06 ± 15% +1.4 3.50 ± 7% perf-profile.calltrace.cycles-pp.submit_bio.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list 2.10 ± 15% +1.4 3.54 ± 6% perf-profile.calltrace.cycles-pp.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node 3.31 ± 12% +1.5 4.83 ± 5% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages 3.33 ± 12% +1.5 4.86 ± 5% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages 3.40 ± 12% +1.6 4.97 ± 6% perf-profile.calltrace.cycles-pp.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath 3.57 ± 12% +1.6 5.19 ± 7% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.__do_page_fault 3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask 3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page 3.49 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault 3.51 ± 12% +1.7 5.17 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault 3.34 ± 14% +2.2 5.57 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_check_inflight.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats 9.14 ± 17% +5.5 14.66 ± 22% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done 12.10 ± 17% +6.8 18.89 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request 13.88 ± 15% +7.1 21.01 ± 20% perf-profile.calltrace.cycles-pp.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle 13.87 ± 15% +7.1 21.00 ± 20% perf-profile.calltrace.cycles-pp.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state 13.97 ± 15% +7.1 21.10 ± 20% perf-profile.calltrace.cycles-pp.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 13.94 ± 15% +7.1 21.07 ± 20% perf-profile.calltrace.cycles-pp.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry 12.50 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu 12.70 ± 17% +7.2 19.86 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu 12.48 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq 12.46 ± 17% +7.2 19.63 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request 14.78 ± 18% +8.1 22.83 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event 14.87 ± 18% +8.1 22.95 ± 21% perf-profile.calltrace.cycles-pp.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq 14.89 ± 18% +8.1 22.98 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ 14.90 ± 18% +8.1 22.99 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr 14.88 ± 18% +8.1 22.97 ± 21% perf-profile.calltrace.cycles-pp.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq 4.79 ± 22% -1.3 3.52 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt 3.04 ± 16% -0.7 2.30 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues 1.98 ± 29% -0.7 1.29 ± 7% perf-profile.children.cycles-pp.tick_sched_timer 1.70 ± 27% -0.6 1.14 ± 9% perf-profile.children.cycles-pp.tick_sched_handle 1.57 ± 29% -0.5 1.03 ± 10% perf-profile.children.cycles-pp.update_process_times 3.02 ± 8% -0.5 2.52 ± 10% perf-profile.children.cycles-pp.menu_select 1.19 ± 19% -0.3 0.89 ± 10% perf-profile.children.cycles-pp.tick_nohz_next_event 0.81 ± 25% -0.2 0.56 ± 11% perf-profile.children.cycles-pp.scheduler_tick 0.42 ± 19% -0.1 0.30 ± 14% perf-profile.children.cycles-pp._raw_spin_lock 0.27 ± 13% -0.1 0.21 ± 15% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.11 ± 35% -0.0 0.07 ± 19% perf-profile.children.cycles-pp.run_local_timers 0.10 ± 15% -0.0 0.07 ± 28% perf-profile.children.cycles-pp.cpu_load_update 0.14 ± 9% -0.0 0.11 ± 15% perf-profile.children.cycles-pp.perf_event_task_tick 0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_flush_plug_list 0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_mq_flush_plug_list 0.06 ± 26% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.read 0.07 ± 17% +0.0 0.11 ± 36% perf-profile.children.cycles-pp.deferred_split_scan 0.15 ± 14% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.blk_mq_sched_dispatch_requests 0.15 ± 16% +0.1 0.21 ± 15% perf-profile.children.cycles-pp.blk_mq_dispatch_rq_list 0.15 ± 14% +0.1 0.22 ± 14% perf-profile.children.cycles-pp.__blk_mq_run_hw_queue 0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.shrink_slab 0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.do_shrink_slab 0.72 ± 19% +0.3 1.00 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.44 ± 18% +0.3 0.74 ± 14% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.86 ± 18% +0.4 1.30 ± 9% perf-profile.children.cycles-pp.blk_mq_try_issue_directly 0.88 ± 18% +0.5 1.34 ± 9% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly 0.82 ± 19% +0.5 1.30 ± 9% perf-profile.children.cycles-pp.dma_pool_alloc 1.02 ± 15% +0.5 1.55 ± 9% perf-profile.children.cycles-pp.nvme_queue_rq 1.07 ± 15% +0.7 1.76 ± 21% perf-profile.children.cycles-pp.__indirect_thunk_start 2.42 ± 16% +0.7 3.16 ± 13% perf-profile.children.cycles-pp.find_next_bit 0.95 ± 26% +1.1 2.00 ± 15% perf-profile.children.cycles-pp.blk_account_io_start 2.19 ± 17% +1.5 3.72 ± 8% perf-profile.children.cycles-pp.blk_mq_make_request 2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.submit_bio 2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.generic_make_request 2.21 ± 17% +1.5 3.76 ± 8% perf-profile.children.cycles-pp.__swap_writepage 2.23 ± 17% +1.5 3.77 ± 7% perf-profile.children.cycles-pp.pageout 3.60 ± 13% +1.6 5.22 ± 7% perf-profile.children.cycles-pp.__alloc_pages_nodemask 3.51 ± 15% +1.6 5.15 ± 6% perf-profile.children.cycles-pp.shrink_page_list 3.48 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.do_try_to_free_pages 3.53 ± 14% +1.6 5.17 ± 6% perf-profile.children.cycles-pp.shrink_inactive_list 3.49 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.try_to_free_pages 3.51 ± 12% +1.7 5.19 ± 6% perf-profile.children.cycles-pp.__alloc_pages_slowpath 3.61 ± 14% +1.7 5.30 ± 6% perf-profile.children.cycles-pp.shrink_node_memcg 3.69 ± 15% +1.8 5.45 ± 7% perf-profile.children.cycles-pp.shrink_node 4.10 ± 17% +2.4 6.47 ± 18% perf-profile.children.cycles-pp.blk_mq_check_inflight 10.64 ± 16% +6.8 17.39 ± 17% perf-profile.children.cycles-pp.bt_iter 13.17 ± 16% +7.4 20.59 ± 18% perf-profile.children.cycles-pp.blk_account_io_done 13.39 ± 16% +7.4 20.81 ± 19% perf-profile.children.cycles-pp.blk_mq_end_request 15.67 ± 17% +8.2 23.84 ± 20% perf-profile.children.cycles-pp.handle_irq 15.66 ± 17% +8.2 23.83 ± 20% perf-profile.children.cycles-pp.handle_edge_irq 15.57 ± 17% +8.2 23.73 ± 20% perf-profile.children.cycles-pp.nvme_irq 15.60 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event 15.58 ± 17% +8.2 23.75 ± 20% perf-profile.children.cycles-pp.__handle_irq_event_percpu 15.59 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event_percpu 15.75 ± 17% +8.2 23.93 ± 20% perf-profile.children.cycles-pp.ret_from_intr 15.73 ± 17% +8.2 23.91 ± 20% perf-profile.children.cycles-pp.do_IRQ 15.54 ± 17% +8.2 23.73 ± 19% perf-profile.children.cycles-pp.blk_mq_complete_request 14.07 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.part_round_stats 14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_queue_tag_busy_iter 14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_in_flight 0.38 ± 20% -0.1 0.28 ± 16% perf-profile.self.cycles-pp._raw_spin_lock 0.10 ± 13% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.idle_cpu 0.12 ± 14% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.10 ± 15% -0.0 0.07 ± 28% perf-profile.self.cycles-pp.cpu_load_update 0.14 ± 9% -0.0 0.11 ± 15% perf-profile.self.cycles-pp.perf_event_task_tick 0.62 ± 16% +0.3 0.89 ± 12% perf-profile.self.cycles-pp.dma_pool_alloc 0.44 ± 18% +0.3 0.74 ± 14% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.81 ± 16% +0.5 1.32 ± 25% perf-profile.self.cycles-pp.__indirect_thunk_start 2.07 ± 16% +0.6 2.69 ± 12% perf-profile.self.cycles-pp.find_next_bit 1.77 ± 16% +1.1 2.91 ± 15% perf-profile.self.cycles-pp.blk_mq_queue_tag_busy_iter 3.82 ± 16% +2.2 6.00 ± 18% perf-profile.self.cycles-pp.blk_mq_check_inflight 6.43 ± 15% +4.1 10.56 ± 16% perf-profile.self.cycles-pp.bt_iter vm-scalability.time.system_time 600 +-+-------------------------------------------------------------------+ | | 500 +-O OO | O O OO | | O O O O O O | 400 +-+ O O O O | | | 300 +-+ .+.++. .+ .+ .+ .+.+ +.+ .++.+.++ .++.+.++. | | ++ + :.+ + + + : +.+ : +.+ + .++.+ +.+ .| 200 +-+ + + : : : : + + | |: : : : : | |: :: : : | 100 +-+ :: :: | | : : | 0 +-+-------------------------------------------------------------------+ vm-scalability.time.maximum_resident_set_size 2.5e+07 +-+---------------------------------------------------------------+ | | | ++.++.++.+. +. +. + +.++.+ +.++.+ .+.++. .++. .++.+ .+ | 2e+07 +-+ + .+ + +.+: : : : + ++ + + +.| | : + : : : : | | : : : : : | 1.5e+07 O-+O OO: : : : | |: O O O O : : : : | 1e+07 +-+ O O O O OO O : : : : | |:O O :: :: | |: :: :: | 5e+06 +-+ : : | | : : | | : : | 0 +-+---------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 9 months

8
75
0 / 0

[page cache] eb797a8ee0: vm-scalability.throughput -16.5% regression

by kernel test robot

Greeting, FYI, we noticed a -16.5% regression of vm-scalability.throughput due to commit: commit: eb797a8ee0ab4cd03df556980ce7bf167cadaa50 ("page cache: Rearrange address_space") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: vm-scalability on test machine: 80 threads Skylake with 64G memory with following parameters: runtime: 300s test: small-allocs cpufreq_governor: performance test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us. test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/ In addition to that, the commit also has significant impact on the following tests: +------------------+----------------------------------------------------------------------+ | testcase: change | unixbench: unixbench.score 20.9% improvement | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory | | test parameters | cpufreq_governor=performance | | | nr_task=100% | | | runtime=300s | | | test=shell8 | | | ucode=0xb00002e | +------------------+----------------------------------------------------------------------+ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase: gcc-7/performance/x86_64-rhel-7.2/debian-x86_64-2018-04-03.cgz/300s/lkp-skl-2sp2/small-allocs/vm-scalability commit: f32f004cdd ("ida: Convert to XArray") eb797a8ee0 ("page cache: Rearrange address_space") f32f004cddf86d63 eb797a8ee0ab4cd03df556980c ---------------- -------------------------- fail:runs %reproduction fail:runs | | | 3:4 -13% 3:4 perf-profile.calltrace.cycles-pp.error_entry 3:4 -12% 3:4 perf-profile.children.cycles-pp.error_entry 1:4 -6% 1:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 235891 -16.5% 197085 vm-scalability.median 18881481 -16.5% 15769081 vm-scalability.throughput 316.19 +14.4% 361.58 vm-scalability.time.elapsed_time 316.19 +14.4% 361.58 vm-scalability.time.elapsed_time.max 22924 +15.9% 26576 vm-scalability.time.system_time 3254041 ± 9% +36.4% 4437311 ± 3% vm-scalability.time.voluntary_context_switches 277831 ± 3% +9.5% 304359 interrupts.CAL:Function_call_interrupts 102367 ± 2% +10.1% 112694 ± 2% meminfo.Shmem 6.67 ± 5% -0.9 5.76 ± 2% mpstat.cpu.usr% 0.49 -5.0% 0.46 pmeter.Average_Active_Power 38678749 -12.1% 34005251 pmeter.performance_per_watt 2621420 ± 38% +59.2% 4173292 ± 3% turbostat.C1 62964314 ± 10% +18.7% 74735975 turbostat.IRQ 20821 ± 10% +20.6% 25103 ± 2% vmstat.system.cs 192700 ± 8% +5.9% 204006 vmstat.system.in 76742 +3.7% 79550 proc-vmstat.nr_active_anon 25578 ± 2% +10.1% 28154 ± 2% proc-vmstat.nr_shmem 76742 +3.7% 79550 proc-vmstat.nr_zone_active_anon 34211075 ± 14% +28.7% 44023085 ± 3% cpuidle.C1.time 2628057 ± 37% +59.1% 4179955 ± 3% cpuidle.C1.usage 200488 ± 20% +75.5% 351836 ± 13% cpuidle.POLL.time 57706 ± 49% +93.1% 111419 ± 18% cpuidle.POLL.usage 2.08 ± 14% +20.7% 2.51 ± 4% sched_debug.cfs_rq:/.nr_spread_over.avg 50.05 ± 36% -38.0% 31.04 ± 24% sched_debug.cpu.cpu_load[1].max 0.25 ± 14% +17.4% 0.29 ± 7% sched_debug.cpu.nr_running.stddev 42905 ± 12% +26.2% 54143 ± 3% sched_debug.cpu.nr_switches.avg 19996 ± 17% +43.0% 28586 ± 7% sched_debug.cpu.nr_switches.min 43774 ± 12% +26.5% 55370 ± 3% sched_debug.cpu.sched_count.avg 20285 ± 17% +43.1% 29024 ± 8% sched_debug.cpu.sched_count.min 19949 ± 12% +28.0% 25530 ± 3% sched_debug.cpu.sched_goidle.avg 9260 ± 16% +44.9% 13422 ± 8% sched_debug.cpu.sched_goidle.min 23108 ± 12% +26.0% 29110 ± 3% sched_debug.cpu.ttwu_count.avg 25905 ± 11% +25.8% 32593 ± 2% sched_debug.cpu.ttwu_count.max 21683 ± 12% +26.0% 27323 ± 3% sched_debug.cpu.ttwu_count.min 73.74 -3.6 70.12 perf-stat.cache-miss-rate% 2.83e+10 ± 2% +5.5% 2.985e+10 perf-stat.cache-misses 3.838e+10 +10.9% 4.257e+10 perf-stat.cache-references 6787110 ± 9% +35.5% 9197959 ± 3% perf-stat.context-switches 3.17 +11.1% 3.52 perf-stat.cpi 7.609e+13 +14.5% 8.715e+13 perf-stat.cpu-cycles 21380 +11.1% 23753 perf-stat.cpu-migrations 0.08 -0.0 0.07 perf-stat.dTLB-load-miss-rate% 6.634e+12 +3.8% 6.888e+12 perf-stat.dTLB-loads 0.13 -0.0 0.12 perf-stat.dTLB-store-miss-rate% 1.135e+09 -5.6% 1.071e+09 perf-stat.dTLB-store-misses 2.184e+09 -2.3% 2.135e+09 perf-stat.iTLB-load-misses 2.404e+13 +3.1% 2.479e+13 perf-stat.instructions 11006 +5.5% 11614 perf-stat.instructions-per-iTLB-miss 0.32 -10.0% 0.28 perf-stat.ipc 2.898e+09 +15.2% 3.337e+09 ± 2% perf-stat.node-load-misses 7.235e+08 +19.1% 8.615e+08 ± 4% perf-stat.node-store-misses 4975 +5.3% 5236 perf-stat.path-length 1.10 -0.1 0.97 ± 2% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link 0.68 ± 2% -0.1 0.59 perf-profile.calltrace.cycles-pp.vma_interval_tree_insert.vma_link.mmap_region.do_mmap.vm_mmap_pgoff 0.59 ± 3% -0.0 0.55 ± 2% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode 1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_numa_work.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.64 ± 2% +0.4 2.00 perf-profile.calltrace.cycles-pp.page_fault 1.57 ± 2% +0.4 1.93 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault 1.59 ± 2% +0.4 1.96 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault 0.65 +0.5 1.19 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 0.00 +1.0 1.03 ± 4% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 1.10 -0.1 0.97 ± 2% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.68 ± 2% -0.1 0.59 perf-profile.children.cycles-pp.vma_interval_tree_insert 0.62 ± 2% -0.1 0.55 ± 2% perf-profile.children.cycles-pp.native_irq_return_iret 0.47 -0.1 0.41 perf-profile.children.cycles-pp.sync_regs 0.32 ± 4% -0.1 0.27 ± 3% perf-profile.children.cycles-pp.get_unmapped_area 0.26 ± 3% -0.1 0.21 ± 3% perf-profile.children.cycles-pp.__perf_sw_event 0.21 ± 4% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.find_vma 0.27 ± 3% -0.0 0.22 ± 3% perf-profile.children.cycles-pp.unmapped_area_topdown 0.11 ± 42% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.29 ± 2% -0.0 0.24 ± 3% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.19 ± 4% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.___perf_sw_event 0.13 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.vma_policy_mof 0.59 ± 3% -0.0 0.56 ± 2% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.16 ± 2% -0.0 0.13 perf-profile.children.cycles-pp.__rb_insert_augmented 0.19 ± 2% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.perf_event_mmap 0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.vmacache_find 0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__fget 0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.d_path 0.09 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.__vma_link_rb 0.01 ±173% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.osq_unlock 1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop 1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_work_run 1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_numa_work 1.66 ± 2% +0.4 2.01 perf-profile.children.cycles-pp.page_fault 1.59 ± 2% +0.4 1.96 perf-profile.children.cycles-pp.do_page_fault 1.58 ± 2% +0.4 1.95 perf-profile.children.cycles-pp.__do_page_fault 0.66 +0.5 1.20 ± 4% perf-profile.children.cycles-pp.handle_mm_fault 0.47 +0.6 1.04 ± 4% perf-profile.children.cycles-pp.__handle_mm_fault 1.09 -0.1 0.96 ± 2% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.67 ± 2% -0.1 0.59 ± 2% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.62 ± 2% -0.1 0.55 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 0.46 -0.1 0.40 perf-profile.self.cycles-pp.sync_regs 0.43 -0.1 0.37 ± 2% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.30 ± 5% -0.1 0.25 ± 3% perf-profile.self.cycles-pp.__do_page_fault 0.11 ± 42% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.27 ± 3% -0.0 0.22 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown 0.17 ± 3% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.___perf_sw_event 0.14 ± 8% -0.0 0.11 perf-profile.self.cycles-pp.mmap_region 0.18 ± 2% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.handle_mm_fault 0.15 -0.0 0.12 ± 4% perf-profile.self.cycles-pp.__rb_insert_augmented 0.12 ± 4% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.find_vma 0.08 ± 5% -0.0 0.06 perf-profile.self.cycles-pp.vma_policy_mof 0.08 ± 8% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.vmacache_find 0.08 ± 10% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__fget 0.07 ± 6% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__perf_sw_event 0.06 -0.0 0.05 perf-profile.self.cycles-pp.d_path 0.08 ± 5% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.down_write 0.11 ± 4% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.up_write 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.__vma_link_rb 0.18 ± 9% +0.1 0.28 ± 6% perf-profile.self.cycles-pp.rwsem_down_write_failed 0.01 ±173% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.osq_unlock 1.05 ± 4% +0.2 1.26 ± 2% perf-profile.self.cycles-pp.task_numa_work 0.35 ± 2% +0.6 0.95 ± 5% perf-profile.self.cycles-pp.__handle_mm_fault vm-scalability.time.system_time 30000 +-+-----------------------------------------------------------------+ | O O | 25000 O-O O O O O O O O O O O O O O O O O O O O O | |.+..+.+..+.+..+.+.+..+.+..+.+..+.+ .+..+.+.+..+.+..+.+..+.| | : + + | 20000 +-+ : : : | | : :: : | 15000 +-+ : : : : | | : : : : | 10000 +-+ : : : : | | : : : : | | : : : : | 5000 +-+ :: :: | | : : | 0 +-+-----------------------------------------------------------------+ vm-scalability.time.elapsed_time 400 +-+-------------------------------------------------------------------+ O O O O O O O O O O O O O O O O O O O O O O O O | 350 +-+ | 300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.| | : : : | 250 +-+ : :: : | | : : : : | 200 +-+ : : : : | | : : : : | 150 +-+ : : : : | 100 +-+ : : : : | | : : : : | 50 +-+ :: :: | | : : | 0 +-+-------------------------------------------------------------------+ vm-scalability.time.elapsed_time.max 400 +-+-------------------------------------------------------------------+ O O O O O O O O O O O O O O O O O O O O O O O O | 350 +-+ | 300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.| | : : : | 250 +-+ : :: : | | : : : : | 200 +-+ : : : : | | : : : : | 150 +-+ : : : : | 100 +-+ : : : : | | : : : : | 50 +-+ :: :: | | : : | 0 +-+-------------------------------------------------------------------+ vm-scalability.throughput 2e+07 +-+---------------------------------------------------------------+ 1.8e+07 +-+..+.+.+..+.+..+.+.+..+.+.+..+.+ + +..+.+..+.+.+..+.+.+..+.| | : : : | 1.6e+07 O-O O O O O O O O O O O O O O O O O O O O O O O | 1.4e+07 +-+ : :: : | | : : : : | 1.2e+07 +-+ : : : : | 1e+07 +-+ : : : : | 8e+06 +-+ : : : : | | : : : : | 6e+06 +-+ : : : : | 4e+06 +-+ :: : | | : : | 2e+06 +-+ : : | 0 +-+---------------------------------------------------------------+ vm-scalability.median 250000 +-+----------------------------------------------------------------+ |.+..+.+..+.+.+..+.+..+.+.+..+ + + +.+..+.+..+.+.+..+.+..+.| | : : : | 200000 O-O O O O O O O O O O O O O O O O O O O O O O O | | : :: : | | : : : : | 150000 +-+ : : : : | | : : : : | 100000 +-+ : : : : | | : : : : | | : : : : | 50000 +-+ : :: | | : : | | : : | 0 +-+----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-bdw-ep3b: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.2/100%/debian-x86_64-2018-04-03.cgz/300s/lkp-bdw-ep3b/shell8/unixbench/0xb00002e commit: f32f004cdd ("ida: Convert to XArray") eb797a8ee0 ("page cache: Rearrange address_space") f32f004cddf86d63 eb797a8ee0ab4cd03df556980c ---------------- -------------------------- fail:runs %reproduction fail:runs | | | :4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x :4 25% 1:4 dmesg.WARNING:at_ip__slab_free/0x :4 25% 1:4 dmesg.WARNING:at_ip_filename_lookup/0x 1:4 -25% :4 dmesg.WARNING:at_ip_fsnotify/0x 1:4 -25% :4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x 1:4 9% 2:4 perf-profile.children.cycles-pp.error_entry 1:4 7% 1:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 39940 +20.9% 48288 unixbench.score 641.38 +1.0% 647.51 unixbench.time.elapsed_time 641.38 +1.0% 647.51 unixbench.time.elapsed_time.max 24220392 +29.1% 31263367 ± 2% unixbench.time.involuntary_context_switches 1.836e+09 +20.8% 2.217e+09 unixbench.time.minor_page_faults 7052 +2.1% 7200 unixbench.time.percent_of_cpu_this_job_got 36337 -2.7% 35347 unixbench.time.system_time 8893 +26.8% 11279 ± 2% unixbench.time.user_time 85632909 +4.3% 89281018 unixbench.time.voluntary_context_switches 15301176 +21.7% 18622462 unixbench.workload 42884872 +19.0% 51033794 softirqs.RCU 43387938 ± 6% -12.9% 37797790 ± 2% cpuidle.C1.usage 1155156 ± 4% -24.0% 878414 ± 4% cpuidle.POLL.usage 152008 ± 9% +15.2% 175048 ± 7% meminfo.DirectMap4k 255196 +13.6% 289806 meminfo.Shmem 100.25 +26.7% 127.00 ± 2% vmstat.procs.r 337268 +3.6% 349315 vmstat.system.cs 19.30 -1.7 17.59 mpstat.cpu.idle% 0.01 ± 30% +0.0 0.02 ± 35% mpstat.cpu.iowait% 15.54 +3.6 19.11 mpstat.cpu.usr% 7.086e+08 +20.8% 8.56e+08 ± 2% numa-numastat.node0.local_node 7.086e+08 +20.8% 8.561e+08 ± 2% numa-numastat.node0.numa_hit 7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.local_node 7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.numa_hit 2274 +2.1% 2322 turbostat.Avg_MHz 43383925 ± 6% -12.9% 37793914 ± 2% turbostat.C1 14.41 ± 2% -17.4% 11.90 ± 7% turbostat.CPU%c1 243.24 +2.2% 248.48 turbostat.PkgWatt 14.16 +8.1% 15.30 turbostat.RAMWatt 6807 ± 4% +48.1% 10084 ± 5% slabinfo.files_cache.active_objs 6807 ± 4% +48.2% 10090 ± 5% slabinfo.files_cache.num_objs 3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.active_objs 3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.num_objs 17134 ± 4% +13.8% 19493 ± 2% slabinfo.proc_inode_cache.active_objs 17134 ± 4% +14.0% 19524 ± 2% slabinfo.proc_inode_cache.num_objs 3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.active_objs 3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.num_objs 1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.active_objs 1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.num_objs 713963 ± 14% -20.9% 564405 ± 4% numa-meminfo.node0.FilePages 20539 ± 9% -19.7% 16496 ± 15% numa-meminfo.node0.Mapped 1281514 ± 9% -10.6% 1145886 ± 4% numa-meminfo.node0.MemUsed 683.75 ± 11% +54.1% 1053 ± 12% numa-meminfo.node0.Mlocked 48239 ± 4% -19.8% 38686 ± 17% numa-meminfo.node0.SReclaimable 669804 ± 15% +27.8% 856173 ± 3% numa-meminfo.node1.FilePages 4719 ± 56% +227.5% 15456 ± 43% numa-meminfo.node1.Inactive 4644 ± 57% +232.0% 15419 ± 43% numa-meminfo.node1.Inactive(anon) 14609 ± 12% +47.2% 21499 ± 11% numa-meminfo.node1.Mapped 40126 ± 6% +29.6% 52000 ± 12% numa-meminfo.node1.SReclaimable 119605 ± 96% +131.3% 276593 ± 3% numa-meminfo.node1.Shmem 130207 +18.0% 153583 ± 5% numa-meminfo.node1.Slab 547652 ± 4% +5.4% 577200 ± 4% numa-meminfo.node1.Unevictable 178549 ± 14% -21.0% 141123 ± 4% numa-vmstat.node0.nr_file_pages 5179 ± 9% -20.3% 4130 ± 16% numa-vmstat.node0.nr_mapped 170.50 ± 12% +54.5% 263.50 ± 13% numa-vmstat.node0.nr_mlock 12061 ± 4% -19.8% 9670 ± 17% numa-vmstat.node0.nr_slab_reclaimable 3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_hit 3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_local 167459 ± 15% +27.9% 214111 ± 3% numa-vmstat.node1.nr_file_pages 1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_inactive_anon 3673 ± 11% +49.4% 5488 ± 13% numa-vmstat.node1.nr_mapped 29911 ± 96% +131.3% 69188 ± 3% numa-vmstat.node1.nr_shmem 10036 ± 6% +29.5% 13000 ± 12% numa-vmstat.node1.nr_slab_reclaimable 22541 +12.7% 25401 ± 3% numa-vmstat.node1.nr_slab_unreclaimable 136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_unevictable 1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_zone_inactive_anon 136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_zone_unevictable 3.525e+08 +22.0% 4.301e+08 ± 2% numa-vmstat.node1.numa_hit 3.523e+08 +22.0% 4.299e+08 ± 2% numa-vmstat.node1.numa_local 149893 +6.3% 159383 proc-vmstat.nr_active_anon 345938 +2.7% 355212 proc-vmstat.nr_file_pages 6075 +9.3% 6643 proc-vmstat.nr_inactive_anon 30490 +2.2% 31159 proc-vmstat.nr_kernel_stack 8870 +8.1% 9585 proc-vmstat.nr_mapped 9254 +2.3% 9471 proc-vmstat.nr_page_table_pages 63803 +13.6% 72460 proc-vmstat.nr_shmem 22097 +2.6% 22671 proc-vmstat.nr_slab_reclaimable 47965 +6.9% 51274 proc-vmstat.nr_slab_unreclaimable 149893 +6.3% 159383 proc-vmstat.nr_zone_active_anon 6075 +9.3% 6643 proc-vmstat.nr_zone_inactive_anon 1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_hit 1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_local 47447 +10.8% 52569 proc-vmstat.pgactivate 1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgalloc_normal 1.846e+09 +20.7% 2.228e+09 proc-vmstat.pgfault 1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgfree 63795 +20.6% 76962 proc-vmstat.thp_deferred_split_page 63790 +20.6% 76940 proc-vmstat.thp_fault_alloc 26894638 +20.9% 32515246 proc-vmstat.unevictable_pgs_culled 1.556e+13 +4.9% 1.632e+13 perf-stat.branch-instructions 1.54 +0.2 1.75 perf-stat.branch-miss-rate% 2.399e+11 +19.4% 2.863e+11 perf-stat.branch-misses 1.034e+11 +17.1% 1.21e+11 ± 2% perf-stat.cache-misses 9.784e+11 +18.6% 1.161e+12 perf-stat.cache-references 2.18e+08 +4.6% 2.281e+08 perf-stat.context-switches 1.60 -1.0% 1.59 perf-stat.cpi 1.281e+14 +3.2% 1.322e+14 perf-stat.cpu-cycles 46095973 +22.0% 56220581 perf-stat.cpu-migrations 0.19 +0.0 0.23 ± 2% perf-stat.dTLB-load-miss-rate% 4.148e+10 +23.3% 5.113e+10 ± 2% perf-stat.dTLB-load-misses 2.213e+13 +2.1% 2.261e+13 perf-stat.dTLB-loads 5.537e+09 +22.2% 6.767e+09 ± 2% perf-stat.dTLB-store-misses 8.001e+12 +20.3% 9.625e+12 perf-stat.dTLB-stores 2.034e+10 +20.1% 2.443e+10 perf-stat.iTLB-load-misses 1.3e+10 +17.1% 1.522e+10 perf-stat.iTLB-loads 7.991e+13 +4.3% 8.332e+13 perf-stat.instructions 3929 -13.2% 3411 perf-stat.instructions-per-iTLB-miss 1.81e+09 +20.7% 2.184e+09 perf-stat.minor-faults 91.68 -2.3 89.39 perf-stat.node-load-miss-rate% 3.395e+10 +14.5% 3.889e+10 perf-stat.node-load-misses 3.083e+09 +49.7% 4.616e+09 ± 3% perf-stat.node-loads 1.018e+10 +20.2% 1.224e+10 ± 2% perf-stat.node-store-misses 8.896e+09 +21.3% 1.079e+10 ± 2% perf-stat.node-stores 1.81e+09 +20.7% 2.184e+09 perf-stat.page-faults 5222880 -14.3% 4475405 perf-stat.path-length 1942 ± 7% +37.3% 2665 ± 18% sched_debug.cfs_rq:/.exec_clock.stddev 47.72 ± 7% +18.8% 56.67 ± 2% sched_debug.cfs_rq:/.load_avg.avg 4.95 ± 9% +44.0% 7.14 ± 7% sched_debug.cfs_rq:/.load_avg.min 265960 ± 8% +36.3% 362493 ± 15% sched_debug.cfs_rq:/.min_vruntime.stddev 0.33 ± 6% -11.5% 0.29 ± 5% sched_debug.cfs_rq:/.nr_running.stddev 2.77 ± 7% +88.4% 5.23 ± 3% sched_debug.cfs_rq:/.nr_spread_over.avg 7.18 ± 5% +79.1% 12.86 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max 0.27 ± 52% +358.3% 1.25 ± 25% sched_debug.cfs_rq:/.nr_spread_over.min 1.57 ± 2% +40.9% 2.21 ± 2% sched_debug.cfs_rq:/.nr_spread_over.stddev 27.36 ± 5% +13.2% 30.98 ± 6% sched_debug.cfs_rq:/.removed.load_avg.avg 1263 ± 5% +14.1% 1442 ± 6% sched_debug.cfs_rq:/.removed.runnable_sum.avg 265962 ± 8% +36.3% 362499 ± 15% sched_debug.cfs_rq:/.spread0.stddev 8169 ± 28% +64.2% 13411 ± 21% sched_debug.cpu.avg_idle.min 298.80 ± 11% +57.4% 470.43 ± 28% sched_debug.cpu.cpu_load[0].max 7.46 ± 5% +34.4% 10.03 ± 12% sched_debug.cpu.cpu_load[1].avg 212.55 ± 15% +52.5% 324.14 ± 17% sched_debug.cpu.cpu_load[1].max 25.69 ± 9% +52.4% 39.15 ± 19% sched_debug.cpu.cpu_load[1].stddev 7.18 ± 3% +32.7% 9.53 ± 5% sched_debug.cpu.cpu_load[2].avg 151.27 ± 16% +51.9% 229.80 ± 11% sched_debug.cpu.cpu_load[2].max 19.45 ± 11% +50.2% 29.22 ± 10% sched_debug.cpu.cpu_load[2].stddev 6.92 ± 2% +29.5% 8.96 ± 4% sched_debug.cpu.cpu_load[3].avg 106.45 ± 23% +52.6% 162.50 ± 15% sched_debug.cpu.cpu_load[3].max 14.94 ± 15% +48.0% 22.10 ± 10% sched_debug.cpu.cpu_load[3].stddev 6.45 ± 2% +25.9% 8.12 ± 6% sched_debug.cpu.cpu_load[4].avg 79.82 ± 34% +56.2% 124.64 ± 25% sched_debug.cpu.cpu_load[4].max 11.70 ± 23% +47.3% 17.23 ± 17% sched_debug.cpu.cpu_load[4].stddev 422565 ± 24% +22.7% 518276 ± 15% sched_debug.cpu.load.max 0.00 ± 3% +23.4% 0.00 ± 14% sched_debug.cpu.next_balance.stddev 1.14 ± 5% +31.4% 1.50 ± 7% sched_debug.cpu.nr_running.avg 3.16 ± 2% +38.1% 4.36 ± 9% sched_debug.cpu.nr_running.max 0.71 ± 2% +33.7% 0.95 ± 7% sched_debug.cpu.nr_running.stddev 39284 ± 7% +47.6% 57979 ± 20% sched_debug.cpu.nr_switches.stddev 1658 ± 12% +73.9% 2884 ± 11% sched_debug.cpu.nr_uninterruptible.max -1902 +212.1% -5938 sched_debug.cpu.nr_uninterruptible.min 716.66 ± 9% +107.5% 1487 ± 30% sched_debug.cpu.nr_uninterruptible.stddev 43221 ± 7% +46.5% 63340 ± 18% sched_debug.cpu.sched_count.stddev 351785 ± 3% -14.1% 302212 sched_debug.cpu.sched_goidle.min 21765 ± 7% +51.5% 32969 ± 24% sched_debug.cpu.sched_goidle.stddev 148360 +23.9% 183753 ± 2% sched_debug.cpu.ttwu_local.avg 152765 +24.4% 190065 ± 2% sched_debug.cpu.ttwu_local.max 2051 ± 10% +87.1% 3838 ± 32% sched_debug.cpu.ttwu_local.stddev 0.00 ± 25% +2.1e+05% 0.56 ± 46% sched_debug.rt_rq:/.rt_time.avg 0.02 ± 25% +2.1e+05% 49.46 ± 46% sched_debug.rt_rq:/.rt_time.max 0.00 ± 25% +2.1e+05% 5.24 ± 46% sched_debug.rt_rq:/.rt_time.stddev 20.84 ± 2% -4.4 16.42 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma 21.69 ± 2% -4.4 17.32 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables 17.27 ± 2% -3.4 13.86 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.exit_mmap 17.44 -3.4 14.05 ± 3% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.exit_mmap.mmput 36.96 -3.1 33.88 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 36.94 -3.1 33.87 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.69 -2.2 10.53 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.71 -2.2 10.55 ± 2% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 13.36 -2.0 11.41 perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64 8.96 ± 2% -1.9 7.03 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma 8.63 ± 2% -1.9 6.71 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust 13.61 -1.9 11.71 perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.11 -1.8 6.36 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process 8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.copy_process._do_fork.do_syscall_64 8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process._do_fork 8.50 -1.7 6.76 ± 2% perf-profile.calltrace.cycles-pp.down_write.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.70 ± 2% -1.7 7.01 ± 3% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.flush_old_exec 9.06 -1.6 7.47 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.do_exit 9.36 ± 2% -1.6 7.77 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.flush_old_exec.load_elf_binary 9.71 -1.5 8.21 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.do_exit.do_group_exit 6.71 ± 2% -1.5 5.26 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.mprotect_fixup 6.77 ± 2% -1.4 5.32 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey 9.54 -1.3 8.23 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 10.17 -1.3 8.86 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64 9.31 -1.3 8.01 ± 4% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 10.04 -1.3 8.74 ± 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 7.63 ± 2% -1.3 6.33 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect 10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 7.34 -1.3 6.05 ± 2% perf-profile.calltrace.cycles-pp.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 7.71 ± 2% -1.3 6.43 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64 10.84 -1.2 9.62 perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 8.01 ± 2% -1.2 6.80 ± 2% perf-profile.calltrace.cycles-pp.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.09 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 8.10 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.17 -1.2 9.99 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork 11.16 -1.2 9.99 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 11.15 -1.2 9.98 perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork 11.80 -1.1 10.73 perf-profile.calltrace.cycles-pp.__libc_fork 4.28 -1.1 3.21 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link 4.44 ± 2% -1.0 3.47 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.unmap_region 4.45 -1.0 3.49 ± 2% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.unmap_region.do_munmap 11.18 -1.0 10.22 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler 4.48 -1.0 3.52 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.unmap_region.do_munmap.mmap_region 11.19 -1.0 10.23 perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file 4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.vma_link.mmap_region.do_mmap 4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link.mmap_region 4.67 -0.9 3.73 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.do_munmap.mmap_region.do_mmap 4.45 -0.9 3.51 ± 9% perf-profile.calltrace.cycles-pp.down_write.vma_link.mmap_region.do_mmap.vm_mmap_pgoff 11.30 -0.9 10.38 perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve 4.85 -0.9 3.98 ± 2% perf-profile.calltrace.cycles-pp.unmap_region.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff 5.40 -0.8 4.57 ± 2% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff 2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.do_munmap.mmap_region 2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.do_munmap 2.42 -0.4 1.98 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.do_munmap.mmap_region.do_mmap 2.43 -0.4 1.99 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff 13.17 -0.3 12.82 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group 13.17 -0.3 12.83 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 2.69 ± 2% -0.1 2.56 perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault 0.56 +0.2 0.72 ± 2% perf-profile.calltrace.cycles-pp._IO_default_xsputn 0.63 +0.2 0.78 ± 3% perf-profile.calltrace.cycles-pp.copy_strings.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.75 +0.2 0.92 ± 2% perf-profile.calltrace.cycles-pp.wp_page_copy.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault 0.82 +0.2 1.01 ± 2% perf-profile.calltrace.cycles-pp.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault 0.94 ± 2% +0.2 1.16 perf-profile.calltrace.cycles-pp._dl_addr 0.64 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.ret_from_fork 0.63 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 0.67 ± 2% +0.2 0.91 ± 4% perf-profile.calltrace.cycles-pp.page_remove_rmap.unmap_page_range.unmap_vmas.exit_mmap.mmput 0.87 +0.2 1.12 ± 2% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.88 +0.2 1.13 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale 0.70 ± 2% +0.3 0.96 ± 3% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec 1.10 +0.3 1.37 ± 2% perf-profile.calltrace.cycles-pp.__strcoll_l 0.70 ± 2% +0.3 0.97 ± 3% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec.load_elf_binary 1.04 +0.3 1.32 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale 0.89 +0.3 1.17 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.flush_old_exec 0.95 +0.3 1.25 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.flush_old_exec.load_elf_binary 1.15 +0.3 1.46 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale 4.73 +0.3 5.04 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 1.15 +0.3 1.46 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.setlocale 1.07 +0.3 1.39 perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 1.09 ± 2% +0.3 1.42 perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 1.11 ± 2% +0.3 1.45 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mmap64 1.11 +0.3 1.44 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64 0.26 ±100% +0.3 0.60 perf-profile.calltrace.cycles-pp.copy_page_range.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.85 +0.3 5.19 perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 0.39 ± 57% +0.4 0.74 ± 3% perf-profile.calltrace.cycles-pp.wait4 1.20 +0.4 1.56 perf-profile.calltrace.cycles-pp.mmap64 13.89 +0.4 14.25 perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64 13.91 +0.4 14.28 perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.78 ± 2% +0.4 2.19 perf-profile.calltrace.cycles-pp.vfprintf.__vsnprintf_chk 0.55 ± 3% +0.4 0.99 ± 3% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary 0.60 ± 4% +0.5 1.06 ± 3% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler 0.66 ± 3% +0.5 1.12 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler.__do_execve_file 5.43 +0.5 5.91 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault 5.45 +0.5 5.92 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault 0.00 +0.5 0.51 perf-profile.calltrace.cycles-pp.page_fault.setlocale 0.00 +0.5 0.51 ± 3% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 5.58 +0.5 6.09 perf-profile.calltrace.cycles-pp.page_fault 0.00 +0.5 0.52 ± 4% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork 0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 1.37 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit 1.38 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit 0.00 +0.5 0.53 ± 3% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 1.73 ± 2% +0.5 2.26 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit 0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 2.69 +0.5 3.24 perf-profile.calltrace.cycles-pp.__vsnprintf_chk 1.80 ± 2% +0.6 2.35 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit 0.00 +0.6 0.56 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 0.00 +0.6 0.56 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 2.46 +0.6 3.03 ± 2% perf-profile.calltrace.cycles-pp.setlocale 0.00 +0.6 0.58 ± 3% perf-profile.calltrace.cycles-pp.write 0.00 +0.6 0.58 ± 2% perf-profile.calltrace.cycles-pp.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait4 0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.6 0.61 ± 3% perf-profile.calltrace.cycles-pp.read 0.00 +0.6 0.61 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.62 ± 5% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 0.00 +0.6 0.63 ± 4% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4 1.63 ± 2% +0.7 2.31 ± 5% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap 0.00 +0.7 0.74 ± 3% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.elf_map 0.12 ±173% +0.8 0.91 ± 3% perf-profile.calltrace.cycles-pp.do_munmap.vm_munmap.elf_map.load_elf_binary.search_binary_handler 2.05 ± 2% +0.8 2.84 ± 4% perf-profile.calltrace.cycles-pp.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput 0.13 ±173% +0.8 0.92 ± 4% perf-profile.calltrace.cycles-pp.vm_munmap.elf_map.load_elf_binary.search_binary_handler.__do_execve_file 15.67 +0.8 16.48 perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 15.71 +0.8 16.53 perf-profile.calltrace.cycles-pp.execve 1.16 ± 3% +0.9 2.05 ± 3% perf-profile.calltrace.cycles-pp.elf_map.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve 42.48 -8.6 33.85 ± 3% perf-profile.children.cycles-pp.osq_lock 44.24 -8.5 35.76 ± 2% perf-profile.children.cycles-pp.rwsem_down_write_failed 44.25 -8.5 35.78 ± 2% perf-profile.children.cycles-pp.call_rwsem_down_write_failed 44.77 -8.4 36.37 ± 2% perf-profile.children.cycles-pp.down_write 22.58 -4.1 18.50 ± 2% perf-profile.children.cycles-pp.unlink_file_vma 24.10 -3.9 20.25 ± 2% perf-profile.children.cycles-pp.free_pgtables 13.81 -1.8 11.97 perf-profile.children.cycles-pp.ksys_mmap_pgoff 69.44 -1.8 67.68 perf-profile.children.cycles-pp.do_syscall_64 69.50 -1.8 67.74 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 10.31 ± 2% -1.5 8.80 ± 2% perf-profile.children.cycles-pp.__vma_adjust 13.93 -1.5 12.43 perf-profile.children.cycles-pp.mmap_region 10.40 -1.5 8.90 ± 2% perf-profile.children.cycles-pp.__split_vma 14.23 -1.4 12.80 perf-profile.children.cycles-pp.do_mmap 14.44 -1.4 13.06 perf-profile.children.cycles-pp.vm_mmap_pgoff 9.67 -1.3 8.35 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state 24.58 -1.3 23.26 perf-profile.children.cycles-pp.mmput 24.55 -1.3 23.24 perf-profile.children.cycles-pp.exit_mmap 9.44 -1.3 8.12 ± 4% perf-profile.children.cycles-pp.intel_idle 10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.secondary_startup_64 10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry 10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.do_idle 10.04 -1.3 8.75 ± 3% perf-profile.children.cycles-pp.start_secondary 11.07 -1.2 9.82 perf-profile.children.cycles-pp.copy_process 8.02 ± 2% -1.2 6.80 ± 2% perf-profile.children.cycles-pp.mprotect_fixup 11.38 -1.2 10.18 perf-profile.children.cycles-pp._do_fork 8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.do_mprotect_pkey 8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.__x64_sys_mprotect 11.84 -1.1 10.77 perf-profile.children.cycles-pp.__libc_fork 11.51 -0.9 10.57 perf-profile.children.cycles-pp.flush_old_exec 8.20 -0.8 7.44 perf-profile.children.cycles-pp.do_munmap 5.36 -0.6 4.79 perf-profile.children.cycles-pp.unmap_region 5.70 ± 2% -0.5 5.21 perf-profile.children.cycles-pp.filemap_map_pages 5.81 -0.4 5.39 perf-profile.children.cycles-pp.vma_link 0.29 ± 3% -0.1 0.15 perf-profile.children.cycles-pp.radix_tree_next_chunk 0.39 ± 3% -0.0 0.36 perf-profile.children.cycles-pp.time 0.16 ± 4% -0.0 0.13 perf-profile.children.cycles-pp.find_busiest_group 0.30 -0.0 0.29 perf-profile.children.cycles-pp.load_balance 0.23 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.__strcasecmp 0.17 -0.0 0.15 ± 3% perf-profile.children.cycles-pp.fopen 0.05 +0.0 0.06 perf-profile.children.cycles-pp.__put_task_struct 0.05 +0.0 0.06 perf-profile.children.cycles-pp.vm_brk_flags 0.05 +0.0 0.06 perf-profile.children.cycles-pp.__perf_event__output_id_sample 0.05 +0.0 0.06 perf-profile.children.cycles-pp.security_mmap_addr 0.05 +0.0 0.06 perf-profile.children.cycles-pp.selinux_file_open 0.06 +0.0 0.07 perf-profile.children.cycles-pp.__switch_to 0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__x64_sys_pipe 0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.do_pipe2 0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.unmap_single_vma 0.07 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__errno_location 0.05 +0.0 0.06 ± 6% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate 0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.perf_event_task_output 0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.load_elf_phdrs 0.17 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending 0.06 ± 6% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.cpumask_next 0.06 +0.0 0.07 ± 5% perf-profile.children.cycles-pp.kfree 0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.do_signal 0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.memcpy 0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.__pipe 0.08 +0.0 0.10 ± 5% perf-profile.children.cycles-pp.vfs_getattr 0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.security_inode_getattr 0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.avc_has_perm 0.07 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.fsnotify 0.07 +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__tsearch 0.07 ± 7% +0.0 0.08 perf-profile.children.cycles-pp.memchr 0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.file_has_perm 0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__alloc_fd 0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.free_unref_page_commit 0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.up_read 0.29 +0.0 0.30 ± 2% perf-profile.children.cycles-pp.save_stack_trace_tsk 0.13 ± 3% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.pipe_wait 0.06 +0.0 0.08 ± 6% perf-profile.children.cycles-pp.__put_anon_vma 0.06 ± 11% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.wake_up_page_bit 0.05 ± 9% +0.0 0.07 perf-profile.children.cycles-pp.dup_fd 0.19 ± 2% +0.0 0.21 perf-profile.children.cycles-pp.dequeue_entity 0.10 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.move_queued_task 0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.__list_add_valid 0.08 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.find_next_bit 0.07 ± 5% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.arch_dup_task_struct 0.11 +0.0 0.13 ± 3% perf-profile.children.cycles-pp.find_get_entry 0.07 ± 10% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.cp_new_stat 0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.load_new_mm_cr3 0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.set_next_entity 0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__install_special_mapping 0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp._IO_setb 0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.trailing_symlink 0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.setup_new_exec 0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.perf_event_task 0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__legitimize_mnt 0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.vma_gap_callbacks_rotate 0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.security_file_free 0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.down_write_killable 0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.available_idle_cpu 0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp._vm_normal_page 0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.expand_downwards 0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp._copy_to_user 0.06 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__unlock_page_memcg 0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.security_file_alloc 0.17 ± 2% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.osq_unlock 0.10 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.finish_fault 0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.may_open 0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.perf_output_copy 0.10 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.selinux_mmap_file 0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.try_charge 0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.___slab_alloc 0.08 ± 6% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__pthread_once_slow 0.07 +0.0 0.09 perf-profile.children.cycles-pp.move_page_tables 0.07 +0.0 0.09 perf-profile.children.cycles-pp.touch_atime 0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.queue_work_on 0.09 ± 7% +0.0 0.11 perf-profile.children.cycles-pp.filp_close 0.08 ± 8% +0.0 0.10 perf-profile.children.cycles-pp.selinux_vm_enough_memory 0.09 ± 4% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.sync_regs 0.08 +0.0 0.10 perf-profile.children.cycles-pp.__inode_security_revalidate 0.07 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.prepend_name 0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.complete_walk 0.06 +0.0 0.08 ± 8% perf-profile.children.cycles-pp.unlock_page_memcg 0.06 ± 11% +0.0 0.08 perf-profile.children.cycles-pp.cred_has_capability 0.06 +0.0 0.08 perf-profile.children.cycles-pp.security_file_open 0.06 +0.0 0.08 perf-profile.children.cycles-pp.__queue_work 0.05 ± 8% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.copyin 0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_stage2 0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.simple_write_begin 0.06 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.security_file_permission 0.14 ± 5% +0.0 0.16 ± 2% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.13 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__anon_vma_prepare 0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.migration_cpu_stop 0.09 ± 7% +0.0 0.11 ± 3% perf-profile.children.cycles-pp._IO_file_close 0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.__call_rcu 0.07 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc_trace 0.11 ± 4% +0.0 0.13 perf-profile.children.cycles-pp.do_brk_flags 0.10 ± 8% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.prepare_creds 0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.put_task_stack 0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__slab_alloc 0.09 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__x64_sys_brk 0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.map_vdso 0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.get_zeroed_page 0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.anon_vma_interval_tree_remove 0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__libc_sigaction 0.11 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.cpu_stopper_thread 0.10 ± 5% +0.0 0.12 ± 5% perf-profile.children.cycles-pp.prepare_binprm 0.09 +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__d_alloc 0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.simple_lookup 0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.vm_area_alloc 0.04 ± 57% +0.0 0.06 ± 6% perf-profile.children.cycles-pp.alloc_pid 0.11 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.brk 0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.memset_erms 0.11 ± 3% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.__get_user_8 0.09 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.evict 0.15 ± 3% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.avc_has_perm_noaudit 0.13 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.sched_move_task 0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.__dentry_kill 0.10 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.unmapped_area_topdown 0.10 ± 4% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.__snprintf_chk 0.09 ± 4% +0.0 0.11 ± 7% perf-profile.children.cycles-pp.select_idle_sibling 0.08 ± 5% +0.0 0.11 ± 8% perf-profile.children.cycles-pp.lockref_get_not_dead 0.07 +0.0 0.10 ± 4% perf-profile.children.cycles-pp.d_add 0.04 ± 57% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.do_huge_pmd_anonymous_page 0.11 +0.0 0.14 ± 3% perf-profile.children.cycles-pp.fput 0.11 ± 6% +0.0 0.14 ± 3% perf-profile.children.cycles-pp._exit 0.12 ± 6% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.security_vm_enough_memory_mm 0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.free_pgd_range 0.11 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.vm_area_dup 0.10 ± 7% +0.0 0.13 perf-profile.children.cycles-pp.vma_interval_tree_augment_rotate 0.10 ± 5% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.rcu_all_qs 0.09 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.munmap 0.08 ± 6% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__mmdrop 0.07 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.truncate_inode_pages_range 0.04 ± 57% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.grab_cache_page_write_begin 0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__lru_cache_add 0.11 ± 4% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.prepend_path 0.14 ± 3% +0.0 0.17 ± 6% perf-profile.children.cycles-pp.security_mmap_file 0.14 ± 3% +0.0 0.17 ± 7% perf-profile.children.cycles-pp.mem_cgroup_try_charge 0.12 ± 3% +0.0 0.15 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.13 +0.0 0.16 ± 2% perf-profile.children.cycles-pp.lockref_put_or_lock 0.14 ± 6% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.kernel_read 0.12 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.__put_user_4 0.09 +0.0 0.12 ± 8% perf-profile.children.cycles-pp.file_free_rcu 0.11 ± 4% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.__x64_sys_close 0.20 ± 3% +0.0 0.23 ± 2% perf-profile.children.cycles-pp.update_load_avg 0.16 +0.0 0.20 ± 5% perf-profile.children.cycles-pp.vfs_statx_fd 0.17 ± 3% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_path 0.15 ± 3% +0.0 0.19 ± 3% perf-profile.children.cycles-pp.stop_one_cpu 0.16 +0.0 0.20 ± 2% perf-profile.children.cycles-pp.anon_vma_clone 0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.getenv 0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp._init 0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.__pud_alloc 0.12 ± 4% +0.0 0.16 ± 4% perf-profile.children.cycles-pp.__getrlimit 0.09 +0.0 0.12 ± 4% perf-profile.children.cycles-pp.wake_q_add 0.30 ± 2% +0.0 0.34 ± 3% perf-profile.children.cycles-pp.strchrnul 0.18 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.open_exec 0.14 +0.0 0.18 ± 2% perf-profile.children.cycles-pp.shift_arg_pages 0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.preempt_schedule_common 0.19 ± 4% +0.0 0.23 perf-profile.children.cycles-pp.getname_flags 0.17 ± 4% +0.0 0.21 ± 2% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.14 ± 3% +0.0 0.18 ± 5% perf-profile.children.cycles-pp.__might_fault 0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.perf_event_mmap_output 0.13 ± 6% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.dentry_kill 0.13 ± 5% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.13 ± 3% +0.0 0.17 ± 3% perf-profile.children.cycles-pp.do_unlinkat 0.11 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.inode_permission 0.14 ± 5% +0.0 0.18 perf-profile.children.cycles-pp.free_pcppages_bulk 0.08 +0.0 0.12 ± 11% perf-profile.children.cycles-pp.rcu_cblist_dequeue 0.23 ± 2% +0.0 0.27 ± 4% perf-profile.children.cycles-pp.ptep_clear_flush 0.18 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.change_protection_range 0.16 ± 2% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.memcpy_erms 0.15 ± 3% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.pagecache_get_page 0.14 ± 3% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.legitimize_path 0.39 ± 2% +0.0 0.43 ± 3% perf-profile.children.cycles-pp.malloc 0.54 +0.0 0.58 perf-profile.children.cycles-pp.ttwu_do_activate 0.25 ± 3% +0.0 0.29 perf-profile.children.cycles-pp.dequeue_task_fair 0.19 ± 2% +0.0 0.23 ± 3% perf-profile.children.cycles-pp._copy_from_user 0.18 ± 2% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.vmacache_find 0.18 ± 2% +0.0 0.22 perf-profile.children.cycles-pp.open64 0.14 ± 3% +0.0 0.18 perf-profile.children.cycles-pp.lock_page_memcg 0.01 ±173% +0.0 0.05 ± 9% perf-profile.children.cycles-pp.__follow_mount_rcu 0.21 ± 6% +0.0 0.26 ± 3% perf-profile.children.cycles-pp._IO_file_xsputn 0.17 ± 3% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.signal_wake_up_state 0.14 ± 3% +0.0 0.18 ± 3% perf-profile.children.cycles-pp.count 0.13 ± 3% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.unlinkat 0.11 ± 7% +0.0 0.15 ± 9% perf-profile.children.cycles-pp.__get_vm_area_node 0.09 ± 4% +0.0 0.14 ± 13% perf-profile.children.cycles-pp.alloc_vmap_area 0.20 ± 2% +0.0 0.24 ± 3% perf-profile.children.cycles-pp.__vma_link_rb 0.17 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.schedule_tail 0.14 ± 3% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__rb_erase_color 0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.insert_vm_struct 0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.put_prev_entity 0.19 ± 2% +0.0 0.24 ± 2% perf-profile.children.cycles-pp.copy_strings_kernel 0.19 ± 2% +0.0 0.24 ± 5% perf-profile.children.cycles-pp.setup_arg_pages 0.17 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.__pmd_alloc 0.15 ± 3% +0.0 0.19 ± 5% perf-profile.children.cycles-pp.unlazy_walk 0.14 ± 5% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__get_free_pages 0.01 ±173% +0.0 0.06 perf-profile.children.cycles-pp.__free_pages_ok 0.15 +0.0 0.20 ± 4% perf-profile.children.cycles-pp.mark_page_accessed 0.15 ± 2% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_alloc 0.57 +0.0 0.61 perf-profile.children.cycles-pp.enqueue_entity 0.23 +0.0 0.28 ± 4% perf-profile.children.cycles-pp.__do_sys_newfstat 0.16 ± 5% +0.0 0.21 ± 6% perf-profile.children.cycles-pp.__generic_file_write_iter 0.15 ± 7% +0.0 0.20 ± 5% perf-profile.children.cycles-pp.generic_perform_write 0.00 +0.1 0.05 perf-profile.children.cycles-pp.vma_merge 0.00 +0.1 0.05 perf-profile.children.cycles-pp.free_one_page 0.00 +0.1 0.05 perf-profile.children.cycles-pp.rcu_segcblist_enqueue 0.00 +0.1 0.05 perf-profile.children.cycles-pp.__fget_light 0.17 ± 7% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.generic_file_write_iter 0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.anon_vma_fork 0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay 0.19 +0.1 0.24 ± 3% perf-profile.children.cycles-pp.finish_task_switch 0.18 ± 2% +0.1 0.24 ± 3% perf-profile.children.cycles-pp.__send_signal 0.18 ± 2% +0.1 0.23 ± 2% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__pagevec_release 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__perf_event_header__init_id 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.check_preempt_curr 0.21 ± 2% +0.1 0.27 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function 0.21 ± 3% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.generic_file_read_iter 0.30 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.wake_up_new_task 0.25 +0.1 0.30 perf-profile.children.cycles-pp.get_unmapped_area 0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.get_user_arg_ptr 0.17 ± 2% +0.1 0.22 ± 3% perf-profile.children.cycles-pp.pgd_alloc 0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.page_add_new_anon_rmap 0.21 ± 2% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__might_sleep 0.31 +0.1 0.36 perf-profile.children.cycles-pp.native_flush_tlb_one_user 0.26 ± 3% +0.1 0.31 ± 2% perf-profile.children.cycles-pp.do_open_execat 0.20 ± 4% +0.1 0.25 ± 7% perf-profile.children.cycles-pp.__vmalloc_node_range 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__mod_node_page_state 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert 0.22 +0.1 0.28 ± 4% perf-profile.children.cycles-pp.__wake_up_common_lock 0.22 ± 3% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.do_notify_parent 0.28 ± 2% +0.1 0.34 ± 5% perf-profile.children.cycles-pp.__rb_insert_augmented 0.23 ± 2% +0.1 0.29 perf-profile.children.cycles-pp.strlen 0.19 ± 2% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.copyout 0.19 ± 4% +0.1 0.25 ± 3% perf-profile.children.cycles-pp.mm_init 0.64 +0.1 0.70 perf-profile.children.cycles-pp.enqueue_task_fair 0.29 ± 2% +0.1 0.35 ± 3% perf-profile.children.cycles-pp.___perf_sw_event 0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.terminate_walk 0.26 ± 3% +0.1 0.33 perf-profile.children.cycles-pp.free_unref_page_list 0.23 +0.1 0.30 ± 5% perf-profile.children.cycles-pp.__wake_up_common 0.32 +0.1 0.38 perf-profile.children.cycles-pp.__perf_sw_event 0.28 ± 2% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.get_user_pages_remote 0.25 ± 2% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.pipe_write 0.22 ± 3% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.copy_page_to_iter 0.23 ± 2% +0.1 0.29 ± 2% perf-profile.children.cycles-pp._IO_file_open 0.32 ± 3% +0.1 0.38 ± 2% perf-profile.children.cycles-pp._fini 0.28 +0.1 0.34 ± 4% perf-profile.children.cycles-pp.__get_user_pages 0.34 ± 2% +0.1 0.41 perf-profile.children.cycles-pp.unlock_page 0.30 ± 2% +0.1 0.36 ± 4% perf-profile.children.cycles-pp.__pte_alloc 0.32 +0.1 0.39 perf-profile.children.cycles-pp.vma_interval_tree_remove 0.29 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.pipe_read 0.23 +0.1 0.30 ± 2% perf-profile.children.cycles-pp.do_dentry_open 0.10 ± 5% +0.1 0.16 ± 10% perf-profile.children.cycles-pp.run_ksoftirqd 0.22 ± 3% +0.1 0.29 ± 3% perf-profile.children.cycles-pp.d_alloc_parallel 0.39 +0.1 0.46 ± 3% perf-profile.children.cycles-pp.__fxstat64 0.34 +0.1 0.41 perf-profile.children.cycles-pp.flush_tlb_func_common 0.27 ± 3% +0.1 0.34 ± 3% perf-profile.children.cycles-pp.__d_lookup_rcu 0.34 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._IO_padn 0.16 ± 2% +0.1 0.23 ± 3% perf-profile.children.cycles-pp.release_task 0.24 +0.1 0.31 ± 3% perf-profile.children.cycles-pp.__lookup_slow 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.do_prlimit 0.32 +0.1 0.40 ± 2% perf-profile.children.cycles-pp.selinux_inode_permission 0.39 ± 2% +0.1 0.46 ± 2% perf-profile.children.cycles-pp.find_vma 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.__x64_sys_getrlimit 0.59 +0.1 0.67 ± 2% perf-profile.children.cycles-pp.schedule 0.28 +0.1 0.36 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid 0.35 ± 2% +0.1 0.42 ± 2% perf-profile.children.cycles-pp.security_inode_permission 0.32 ± 3% +0.1 0.40 ± 3% perf-profile.children.cycles-pp.__do_sys_newstat 0.27 ± 3% +0.1 0.35 ± 2% perf-profile.children.cycles-pp.lookup_slow 0.33 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._cond_resched 0.32 +0.1 0.40 ± 3% perf-profile.children.cycles-pp.remove_vma 0.30 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.perf_iterate_sb 0.13 ± 5% +0.1 0.21 ± 14% perf-profile.children.cycles-pp.find_vmap_area 0.33 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.vfs_statx 0.39 ± 2% +0.1 0.47 ± 2% perf-profile.children.cycles-pp._IO_fwrite 0.29 ± 2% +0.1 0.38 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.18 ± 8% +0.1 0.27 ± 12% perf-profile.children.cycles-pp.__vunmap 0.43 +0.1 0.52 ± 2% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.37 ± 3% +0.1 0.46 ± 4% perf-profile.children.cycles-pp.___might_sleep 0.40 ± 3% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.__slab_free 0.29 +0.1 0.38 ± 2% perf-profile.children.cycles-pp.create_elf_tables 0.18 ± 7% +0.1 0.27 ± 10% perf-profile.children.cycles-pp.free_work 0.37 ± 2% +0.1 0.46 perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.18 ± 4% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.wait_consider_task 0.39 ± 2% +0.1 0.48 ± 3% perf-profile.children.cycles-pp.__xstat64 0.39 +0.1 0.48 ± 2% perf-profile.children.cycles-pp.pte_alloc_one 0.29 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.__alloc_file 0.40 ± 2% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.unlink_anon_vmas 0.32 ± 2% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.alloc_empty_file 0.44 +0.1 0.54 perf-profile.children.cycles-pp.page_add_file_rmap 0.41 ± 2% +0.1 0.51 ± 2% perf-profile.children.cycles-pp.sched_exec 0.39 +0.1 0.48 perf-profile.children.cycles-pp.copy_page 0.31 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.52 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret 0.20 ± 6% +0.1 0.30 ± 9% perf-profile.children.cycles-pp.process_one_work 0.36 ± 2% +0.1 0.47 ± 3% perf-profile.children.cycles-pp.__fput 0.51 +0.1 0.62 ± 2% perf-profile.children.cycles-pp.copy_page_range 0.40 ± 2% +0.1 0.50 ± 3% perf-profile.children.cycles-pp.__clear_user 0.36 ± 2% +0.1 0.47 perf-profile.children.cycles-pp.__x64_sys_munmap 0.35 +0.1 0.46 perf-profile.children.cycles-pp.strnlen_user 0.23 ± 5% +0.1 0.34 ± 9% perf-profile.children.cycles-pp.worker_thread 0.48 ± 2% +0.1 0.59 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.40 ± 2% +0.1 0.51 ± 3% perf-profile.children.cycles-pp.dput 0.44 +0.1 0.55 ± 4% perf-profile.children.cycles-pp.lookup_fast 1.14 +0.1 1.25 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start 0.42 ± 2% +0.1 0.54 ± 2% perf-profile.children.cycles-pp.free_pages_and_swap_cache 1.08 ± 2% +0.1 1.20 ± 2% perf-profile.children.cycles-pp.__sched_text_start 0.51 +0.1 0.63 ± 2% perf-profile.children.cycles-pp.ksys_read 0.40 +0.1 0.52 ± 4% perf-profile.children.cycles-pp.smpboot_thread_fn 0.46 +0.1 0.58 ± 3% perf-profile.children.cycles-pp.write 0.49 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.read 0.42 ± 2% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.__vfs_write 0.44 +0.1 0.57 ± 2% perf-profile.children.cycles-pp.task_work_run 0.99 ± 2% +0.1 1.12 ± 4% perf-profile.children.cycles-pp.rcu_process_callbacks 0.55 ± 2% +0.1 0.67 ± 2% perf-profile.children.cycles-pp.kmem_cache_free 0.54 +0.1 0.66 ± 3% perf-profile.children.cycles-pp.__vfs_read 0.62 +0.1 0.75 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair 0.46 +0.1 0.59 ± 4% perf-profile.children.cycles-pp.vfs_write 0.45 ± 2% +0.1 0.58 ± 2% perf-profile.children.cycles-pp.do_faccessat 0.47 +0.1 0.60 ± 3% perf-profile.children.cycles-pp.ksys_write 0.15 ± 6% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.queued_write_lock_slowpath 0.14 ± 8% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.51 ± 3% +0.1 0.65 perf-profile.children.cycles-pp.kmem_cache_alloc 0.58 +0.1 0.72 ± 2% perf-profile.children.cycles-pp.__entry_SYSCALL_64_trampoline 0.62 +0.1 0.77 perf-profile.children.cycles-pp.vfs_read 0.63 +0.2 0.78 ± 2% perf-profile.children.cycles-pp.perf_event_mmap 0.62 +0.2 0.77 ± 2% perf-profile.children.cycles-pp.alloc_pages_vma 0.35 ± 4% +0.2 0.51 ± 4% perf-profile.children.cycles-pp.lru_add_drain 0.35 ± 3% +0.2 0.52 ± 5% perf-profile.children.cycles-pp.lru_add_drain_cpu 0.60 ± 2% +0.2 0.78 ± 2% perf-profile.children.cycles-pp.path_lookupat 0.62 ± 2% +0.2 0.80 ± 2% perf-profile.children.cycles-pp.filename_lookup 0.43 ± 2% +0.2 0.61 ± 3% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.64 +0.2 0.83 ± 3% perf-profile.children.cycles-pp.walk_component 0.75 ± 2% +0.2 0.95 ± 2% perf-profile.children.cycles-pp._IO_default_xsputn 0.86 +0.2 1.07 ± 3% perf-profile.children.cycles-pp.clear_page_erms 0.84 +0.2 1.04 ± 3% perf-profile.children.cycles-pp.copy_strings 0.41 ± 4% +0.2 0.62 ± 5% perf-profile.children.cycles-pp.do_wait 0.43 ± 5% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.__do_sys_wait4 0.42 ± 4% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.kernel_wait4 0.95 ± 2% +0.2 1.16 perf-profile.children.cycles-pp._dl_addr 0.95 +0.2 1.17 ± 2% perf-profile.children.cycles-pp.wp_page_copy 0.80 +0.2 1.02 ± 2% perf-profile.children.cycles-pp.link_path_walk 0.93 +0.2 1.16 perf-profile.children.cycles-pp.vma_interval_tree_insert 0.95 +0.2 1.18 perf-profile.children.cycles-pp.alloc_set_pte 0.51 ± 3% +0.2 0.74 ± 3% perf-profile.children.cycles-pp.wait4 0.63 ± 2% +0.2 0.87 ± 4% perf-profile.children.cycles-pp.kthread 1.04 +0.2 1.27 ± 2% perf-profile.children.cycles-pp.do_wp_page 1.29 +0.2 1.54 ± 3% perf-profile.children.cycles-pp.wake_up_q 2.06 +0.3 2.33 ± 2% perf-profile.children.cycles-pp.up_write 9.02 +0.3 9.29 perf-profile.children.cycles-pp.handle_mm_fault 1.53 +0.3 1.79 ± 2% perf-profile.children.cycles-pp.rwsem_wake 0.81 +0.3 1.08 ± 3% perf-profile.children.cycles-pp.ret_from_fork 1.53 +0.3 1.81 ± 2% perf-profile.children.cycles-pp.call_rwsem_wake 1.10 +0.3 1.38 ± 2% perf-profile.children.cycles-pp.__strcoll_l 0.81 ± 2% +0.3 1.08 ± 4% perf-profile.children.cycles-pp._raw_spin_lock 0.93 +0.3 1.23 perf-profile.children.cycles-pp.rwsem_spin_on_owner 1.24 +0.3 1.54 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist 1.35 +0.3 1.69 ± 3% perf-profile.children.cycles-pp.__alloc_pages_nodemask 1.68 +0.4 2.04 ± 3% perf-profile.children.cycles-pp.try_to_wake_up 1.22 +0.4 1.58 perf-profile.children.cycles-pp.mmap64 14.16 +0.4 14.53 perf-profile.children.cycles-pp.load_elf_binary 1.05 ± 2% +0.4 1.42 ± 4% perf-profile.children.cycles-pp.page_remove_rmap 14.19 +0.4 14.56 perf-profile.children.cycles-pp.search_binary_handler 2.09 ± 2% +0.4 2.52 perf-profile.children.cycles-pp.vfprintf 9.80 +0.5 10.26 perf-profile.children.cycles-pp.__do_page_fault 9.82 +0.5 10.29 perf-profile.children.cycles-pp.do_page_fault 1.27 ± 2% +0.5 1.79 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.96 +0.5 2.49 ± 2% perf-profile.children.cycles-pp.path_openat 2.01 +0.5 2.54 perf-profile.children.cycles-pp.do_sys_open 1.98 +0.5 2.52 ± 2% perf-profile.children.cycles-pp.do_filp_open 0.86 ± 2% +0.5 1.40 ± 2% perf-profile.children.cycles-pp.vm_munmap 10.22 +0.6 10.78 perf-profile.children.cycles-pp.page_fault 2.73 +0.6 3.29 perf-profile.children.cycles-pp.__vsnprintf_chk 2.76 +0.6 3.39 ± 2% perf-profile.children.cycles-pp.setlocale 1.77 ± 2% +0.7 2.50 ± 4% perf-profile.children.cycles-pp.release_pages 1.47 +0.8 2.27 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 2.12 ± 2% +0.8 2.93 ± 4% perf-profile.children.cycles-pp.tlb_flush_mmu_free 15.71 +0.8 16.53 perf-profile.children.cycles-pp.execve 16.01 +0.8 16.84 perf-profile.children.cycles-pp.__do_execve_file 16.02 +0.8 16.86 perf-profile.children.cycles-pp.__x64_sys_execve 2.24 ± 2% +0.8 3.09 ± 4% perf-profile.children.cycles-pp.arch_tlb_finish_mmu 2.25 ± 2% +0.8 3.10 ± 4% perf-profile.children.cycles-pp.tlb_finish_mmu 2.77 +0.9 3.62 ± 3% perf-profile.children.cycles-pp.unmap_page_range 2.89 +0.9 3.77 ± 3% perf-profile.children.cycles-pp.unmap_vmas 1.18 ± 3% +0.9 2.09 ± 2% perf-profile.children.cycles-pp.elf_map 41.69 -8.5 33.23 ± 3% perf-profile.self.cycles-pp.osq_lock 9.44 -1.3 8.12 ± 4% perf-profile.self.cycles-pp.intel_idle 4.14 ± 2% -0.6 3.53 perf-profile.self.cycles-pp.filemap_map_pages 0.54 ± 2% -0.2 0.37 perf-profile.self.cycles-pp.rwsem_down_write_failed 0.28 ± 3% -0.1 0.15 ± 2% perf-profile.self.cycles-pp.radix_tree_next_chunk 0.13 ± 6% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.find_busiest_group 0.05 +0.0 0.06 perf-profile.self.cycles-pp.anon_vma_fork 0.05 +0.0 0.06 perf-profile.self.cycles-pp.__call_rcu 0.05 +0.0 0.06 perf-profile.self.cycles-pp.__unlock_page_memcg 0.06 +0.0 0.07 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.06 +0.0 0.07 perf-profile.self.cycles-pp.do_wp_page 0.06 +0.0 0.07 perf-profile.self.cycles-pp.kfree 0.06 +0.0 0.07 perf-profile.self.cycles-pp.__switch_to 0.07 ± 5% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.find_next_bit 0.07 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__tsearch 0.05 ± 8% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.path_openat 0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.d_alloc_parallel 0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.unlock_page_memcg 0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.up_read 0.06 +0.0 0.07 ± 5% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.06 ± 6% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.__perf_sw_event 0.06 ± 7% +0.0 0.07 perf-profile.self.cycles-pp.strncpy_from_user 0.09 ± 4% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.update_load_avg 0.07 +0.0 0.09 ± 5% perf-profile.self.cycles-pp.find_get_entry 0.05 +0.0 0.07 ± 7% perf-profile.self.cycles-pp.__d_alloc 0.05 ± 9% +0.0 0.07 perf-profile.self.cycles-pp.create_elf_tables 0.17 ± 3% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.osq_unlock 0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.07 ± 5% +0.0 0.09 perf-profile.self.cycles-pp.getenv 0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp._vm_normal_page 0.11 ± 7% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.__sched_text_start 0.09 ± 4% +0.0 0.11 ± 6% perf-profile.self.cycles-pp._cond_resched 0.09 ± 4% +0.0 0.11 perf-profile.self.cycles-pp.__list_add_valid 0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.perf_iterate_sb 0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__vma_adjust 0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.sync_regs 0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.load_new_mm_cr3 0.06 ± 6% +0.0 0.08 perf-profile.self.cycles-pp._IO_setb 0.05 +0.0 0.07 ± 6% perf-profile.self.cycles-pp.__legitimize_mnt 0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__libc_fork 0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.change_protection_range 0.06 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memchr 0.08 ± 6% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.anon_vma_interval_tree_remove 0.07 ± 12% +0.0 0.09 ± 9% perf-profile.self.cycles-pp.try_charge 0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.inode_permission 0.07 +0.0 0.09 perf-profile.self.cycles-pp.avc_has_perm 0.08 +0.0 0.10 ± 7% perf-profile.self.cycles-pp.free_pgd_range 0.07 ± 7% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.prepend_name 0.05 ± 8% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_stage2 0.08 ± 10% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.available_idle_cpu 0.10 ± 8% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.unlink_anon_vmas 0.10 ± 7% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.memset_erms 0.07 ± 5% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.rcu_all_qs 0.08 ± 6% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.lockref_get_not_dead 0.06 ± 9% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memcpy 0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.fput 0.12 ± 6% +0.0 0.15 ± 4% perf-profile.self.cycles-pp.do_syscall_64 0.07 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__snprintf_chk 0.04 ± 57% +0.0 0.06 ± 6% perf-profile.self.cycles-pp.vm_area_dup 0.11 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.__get_user_8 0.08 ± 5% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.file_free_rcu 0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__vma_link_rb 0.13 ± 5% +0.0 0.16 ± 5% perf-profile.self.cycles-pp.copy_page_range 0.11 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.perf_event_mmap 0.18 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.find_vma 0.14 +0.0 0.17 ± 2% perf-profile.self.cycles-pp.copy_process 0.10 ± 4% +0.0 0.13 perf-profile.self.cycles-pp.link_path_walk 0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__fput 0.08 ± 8% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.free_pcppages_bulk 0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.do_mmap 0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc_trace 0.10 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.vma_interval_tree_augment_rotate 0.15 ± 2% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.vma_compute_subtree_gap 0.14 ± 3% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.avc_has_perm_noaudit 0.12 +0.0 0.15 ± 2% perf-profile.self.cycles-pp.lock_page_memcg 0.11 ± 4% +0.0 0.15 ± 2% perf-profile.self.cycles-pp._init 0.10 ± 5% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown 0.11 +0.0 0.14 ± 3% perf-profile.self.cycles-pp.lockref_put_or_lock 0.03 ±100% +0.0 0.06 perf-profile.self.cycles-pp.unmap_vmas 0.18 +0.0 0.21 ± 4% perf-profile.self.cycles-pp.handle_mm_fault 0.09 +0.0 0.12 ± 4% perf-profile.self.cycles-pp.wake_q_add 0.15 ± 5% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.kmem_cache_free 0.08 ± 5% +0.0 0.12 ± 5% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.18 ± 3% +0.0 0.22 ± 3% perf-profile.self.cycles-pp._IO_file_xsputn 0.17 ± 2% +0.0 0.21 ± 3% perf-profile.self.cycles-pp.strchrnul 0.16 ± 5% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.memcpy_erms 0.12 ± 3% +0.0 0.16 ± 4% perf-profile.self.cycles-pp.__rb_erase_color 0.12 ± 7% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.17 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.vmacache_find 0.08 +0.0 0.12 ± 11% perf-profile.self.cycles-pp.rcu_cblist_dequeue 0.16 +0.0 0.20 perf-profile.self.cycles-pp.mmap_region 0.14 +0.0 0.18 ± 2% perf-profile.self.cycles-pp.mark_page_accessed 0.07 ± 6% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.queued_read_lock_slowpath 0.21 ± 2% +0.0 0.26 ± 4% perf-profile.self.cycles-pp.get_page_from_freelist 0.17 ± 2% +0.0 0.22 perf-profile.self.cycles-pp.malloc 0.16 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.strlen 0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.down_read_trylock 0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.__errno_location 0.17 ± 2% +0.0 0.22 ± 3% perf-profile.self.cycles-pp.selinux_inode_permission 0.26 +0.0 0.30 ± 5% perf-profile.self.cycles-pp.__rb_insert_augmented 0.18 ± 2% +0.0 0.23 ± 5% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.1 0.05 perf-profile.self.cycles-pp.load_elf_binary 0.00 +0.1 0.05 perf-profile.self.cycles-pp.page_fault 0.00 +0.1 0.05 perf-profile.self.cycles-pp.pagevec_lru_move_fn 0.00 +0.1 0.05 perf-profile.self.cycles-pp.flush_tlb_mm_range 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__inode_security_revalidate 0.00 +0.1 0.05 perf-profile.self.cycles-pp.dup_fd 0.00 +0.1 0.05 perf-profile.self.cycles-pp.acct_collect 0.00 +0.1 0.05 perf-profile.self.cycles-pp.vma_merge 0.00 +0.1 0.05 perf-profile.self.cycles-pp.rcu_segcblist_enqueue 0.24 ± 2% +0.1 0.30 ± 2% perf-profile.self.cycles-pp.___perf_sw_event 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.mem_cgroup_throttle_swaprate 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert 0.44 ± 2% +0.1 0.49 ± 4% perf-profile.self.cycles-pp.down_write 0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__might_fault 0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__mod_node_page_state 0.22 +0.1 0.28 ± 3% perf-profile.self.cycles-pp.__vsnprintf_chk 0.15 ± 2% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.__alloc_file 0.30 +0.1 0.36 perf-profile.self.cycles-pp.native_flush_tlb_one_user 0.18 ± 4% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.__do_page_fault 0.31 ± 2% +0.1 0.37 perf-profile.self.cycles-pp._IO_padn 0.33 ± 3% +0.1 0.40 perf-profile.self.cycles-pp.unlock_page 0.21 ± 3% +0.1 0.28 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.20 ± 2% +0.1 0.27 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.36 +0.1 0.43 ± 2% perf-profile.self.cycles-pp.page_add_file_rmap 0.31 +0.1 0.38 perf-profile.self.cycles-pp.vma_interval_tree_remove 0.27 ± 3% +0.1 0.34 ± 3% perf-profile.self.cycles-pp.__d_lookup_rcu 0.28 +0.1 0.35 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid 0.41 +0.1 0.49 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair 0.34 +0.1 0.42 perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.35 ± 3% +0.1 0.43 ± 3% perf-profile.self.cycles-pp.___might_sleep 0.29 ± 3% +0.1 0.38 perf-profile.self.cycles-pp.kmem_cache_alloc 0.36 ± 3% +0.1 0.45 perf-profile.self.cycles-pp._IO_fwrite 0.44 +0.1 0.53 perf-profile.self.cycles-pp.__handle_mm_fault 0.39 ± 3% +0.1 0.48 ± 2% perf-profile.self.cycles-pp.__slab_free 0.32 ± 2% +0.1 0.41 perf-profile.self.cycles-pp.alloc_set_pte 0.38 +0.1 0.47 perf-profile.self.cycles-pp.copy_page 0.52 +0.1 0.62 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 0.34 ± 2% +0.1 0.45 ± 2% perf-profile.self.cycles-pp.strnlen_user 0.41 ± 2% +0.1 0.52 ± 2% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.47 ± 2% +0.1 0.59 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.51 +0.1 0.64 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 0.53 +0.1 0.66 perf-profile.self.cycles-pp.__entry_SYSCALL_64_trampoline 0.65 ± 2% +0.2 0.82 perf-profile.self.cycles-pp._IO_default_xsputn 0.84 +0.2 1.05 ± 3% perf-profile.self.cycles-pp.clear_page_erms 0.91 ± 2% +0.2 1.13 perf-profile.self.cycles-pp._dl_addr 0.91 +0.2 1.14 perf-profile.self.cycles-pp.vma_interval_tree_insert 1.08 +0.3 1.35 ± 2% perf-profile.self.cycles-pp.__strcoll_l 0.91 +0.3 1.20 perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.92 ± 2% +0.3 1.26 ± 4% perf-profile.self.cycles-pp.page_remove_rmap 1.33 +0.4 1.72 ± 2% perf-profile.self.cycles-pp.unmap_page_range 1.75 ± 2% +0.4 2.18 perf-profile.self.cycles-pp.vfprintf 1.23 ± 2% +0.5 1.73 ± 5% perf-profile.self.cycles-pp.release_pages 1.47 +0.8 2.26 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 10 months

5
9
0 / 0

c438cfd46e ("blk-mq: fix changelog"): BUG: unable to handle kernel NULL pointer dereference at 00000000

by kernel test robot

Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core.git debugfs_cleanup commit c438cfd46e37a6dd9e370219a6f0d397cc3c1a36 Author: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> AuthorDate: Fri Jan 4 14:06:22 2019 +0100 Commit: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> CommitDate: Thu Jan 31 14:18:25 2019 +0100 blk-mq: fix changelog ddd7d0ff2d wireless: fix changelog c438cfd46e blk-mq: fix changelog 31b092d47f lib: WIP, break up +------------------------------------------+------------+------------+------------+ | | ddd7d0ff2d | c438cfd46e | 31b092d47f | +------------------------------------------+------------+------------+------------+ | boot_successes | 37 | 0 | 0 | | boot_failures | 0 | 26 | 26 | | BUG:unable_to_handle_kernel | 0 | 26 | 26 | | Oops:#[##] | 0 | 26 | 26 | | EIP:debugfs_create_files | 0 | 26 | 26 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 26 | 26 | +------------------------------------------+------------+------------+------------+ [ 7.740649] igt_debug 0x0000000000000a00-0x0000000000000e00: 1024: used [ 7.741350] igt_debug 0x0000000000000e00-0x0000000000001000: 512: free [ 7.742149] igt_debug total: 4096, used 2048 free 2048 [ 42.726577] [drm] Initialized vgem 1.0.0 20120112 for vgem on minor 0 [ 42.728241] Floppy drive(s): fd0 is 2.88M AMI BIOS [ 42.729334] BUG: unable to handle kernel NULL pointer dereference at 00000000 [ 42.729735] #PF error: [normal kernel read fault] [ 42.729735] *pde = 00000000 [ 42.729735] Oops: 0000 [#1] [ 42.729735] CPU: 0 PID: 1 Comm: swapper Not tainted 5.0.0-rc2-00115-gc438cfd #113 [ 42.729735] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 42.729735] EIP: debugfs_create_files+0x6b/0xa0 [ 42.729735] Code: 00 00 00 00 0f 97 c0 31 c9 89 c7 0f b6 d0 b8 68 ab 7b 82 e8 57 6d be ff 89 f8 84 c0 75 38 8b 46 30 8b 7d f0 89 b8 fc 01 00 00 <8b> 03 85 c0 74 26 8d b4 26 00 00 00 00 0f b7 53 04 89 1c 24 89 f1 [ 42.729735] EAX: 9efb5000 EBX: 00000000 ECX: 00000000 EDX: 00000000 [ 42.729735] ESI: 9efb3840 EDI: 9d6cf800 EBP: 80243e3c ESP: 80243e24 [ 42.729735] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00210246 [ 42.729735] CR0: 80050033 CR2: 00000000 CR3: 02924000 CR4: 001406d0 [ 42.729735] Call Trace: [ 42.729735] blk_mq_debugfs_register_sched_hctx+0x34/0x40 [ 42.729735] blk_mq_debugfs_register+0xb1/0xc0 [ 42.729735] blk_register_queue+0x108/0x230 [ 42.729735] __device_add_disk+0x44f/0x640 [ 42.729735] device_add_disk+0x17/0x20 [ 42.729735] loop_add+0x217/0x2c0 [ 42.729735] loop_init+0xf9/0x11a [ 42.729735] ? floppy_async_init+0xd4c/0xd4c [ 42.729735] do_one_initcall+0xdd/0x25d [ 42.729735] kernel_init_freeable+0x25a/0x2d7 [ 42.729735] ? rest_init+0x140/0x140 [ 42.729735] kernel_init+0x10/0x100 [ 42.729735] ? schedule_tail_wrapper+0x9/0x10 [ 42.729735] ret_from_fork+0x19/0x30 [ 42.729735] CR2: 0000000000000000 [ 42.729735] _warn_unseeded_randomness: 35 callbacks suppressed [ 42.729735] random: get_random_bytes called from init_oops_id+0x3f/0x50 with crng_init=1 [ 42.729735] ---[ end trace 25be250042fb0fd4 ]--- [ 42.729735] EIP: debugfs_create_files+0x6b/0xa0 # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start 0e9ac1e5b38fa1032c8809b7f375c5f20aa8c2be f17b5f06cb92ef2250513a1e154c47b78df07d40 -- git bisect good f095dea55a4ac7fdb83f505523ad417274e54192 # 01:00 G 10 0 0 0 Merge 'ulf.hansson-mmc/next' into devel-catchup-201901312352 git bisect good f1ac64a048ea54cd0bfa9d1d455056c135e3e597 # 01:08 G 11 0 0 0 Merge 'alaahl/for-linust' into devel-catchup-201901312352 git bisect bad 4f28883ea4af13b4d15f7ae2f7efb5fa81cc4f84 # 01:14 B 0 9 34 11 Merge 'driver-core/debugfs_cleanup' into devel-catchup-201901312352 git bisect good 52c070b7c8809576d3065d4b6a4cf1154d7acde2 # 01:33 G 10 0 0 0 cw1200: no need to check return value of debugfs_create functions git bisect good 3000a51bc760ad362eeab65de07a92c47b2353eb # 01:43 G 10 0 0 0 f2fs: no need to check return value of debugfs_create functions git bisect good 50b82e5dd6c2fad0af36a80baff41b37c18e091b # 02:00 G 11 0 0 0 xen-netback: fix changelog git bisect bad 6a37bbef02b8607940a432c864e3f635293cb1e3 # 02:04 B 0 2 16 0 pstore: fix changelog git bisect good c3cbe3160fcb8ea6dc6a6d2939af4f2bf05c11a2 # 02:29 G 11 0 0 0 sunrpc: fix changelog git bisect good ddd7d0ff2d7b4f80e2c4b54718f66c5601fd25c1 # 02:35 G 11 0 0 0 wireless: fix changelog git bisect bad c438cfd46e37a6dd9e370219a6f0d397cc3c1a36 # 02:39 B 0 1 15 0 blk-mq: fix changelog # first bad commit: [c438cfd46e37a6dd9e370219a6f0d397cc3c1a36] blk-mq: fix changelog git bisect good ddd7d0ff2d7b4f80e2c4b54718f66c5601fd25c1 # 02:48 G 30 0 0 0 wireless: fix changelog # extra tests with debug options git bisect bad c438cfd46e37a6dd9e370219a6f0d397cc3c1a36 # 02:53 B 0 2 16 0 blk-mq: fix changelog # extra tests on HEAD of linux-devel/devel-catchup-201901312352 git bisect bad 0e9ac1e5b38fa1032c8809b7f375c5f20aa8c2be # 02:58 B 0 17 34 0 0day head guard for 'devel-catchup-201901312352' # extra tests on tree/branch driver-core/debugfs_cleanup git bisect bad 31b092d47f0a16ce1ece9593a387a883d64acab8 # 03:03 B 0 1 15 0 lib: WIP, break up # extra tests with first bad commit reverted git bisect good 29828fbf7aa1702254ce9767e2943ac944784316 # 03:28 G 10 0 0 0 Revert "blk-mq: fix changelog" --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/pipermail/lkp Intel Corporation

2 years, 11 months

1
0
0 / 0

[mm] 9bc8039e71: will-it-scale.per_thread_ops -64.1% regression

by kernel test robot

Greeting, FYI, we noticed a -64.1% regression of will-it-scale.per_thread_ops due to commit: commit: 9bc8039e715da3b53dbac89525323a9f2f69b7b5 ("mm: brk: downgrade mmap_sem to read when shrinking") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: will-it-scale on test machine: 8 threads Ivy Bridge with 16G memory with following parameters: nr_task: 100% mode: thread test: brk1 ucode: 0x20 cpufreq_governor: performance test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two. test-url: https://github.com/antonblanchard/will-it-scale Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.2/thread/100%/debian-x86_64-2018-04-03.cgz/lkp-ivb-d01/brk1/will-it-scale/0x20 commit: 85a06835f6 ("mm: mremap: downgrade mmap_sem to read when shrinking") 9bc8039e71 ("mm: brk: downgrade mmap_sem to read when shrinking") 85a06835f6f1ba79 9bc8039e715da3b53dbac89525 ---------------- -------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 kmsg.a0f723>]usb_hcd_irq :4 25% 1:4 kmsg.b6a4a7>]usb_hcd_irq 1:4 -25% :4 kmsg.cae42e>]usb_hcd_irq :4 25% 1:4 kmsg.fb#f87>]usb_hcd_irq :4 25% 1:4 kmsg.fd#>]usb_hcd_irq %stddev %change %stddev \ | \ 196250 ± 8% -64.1% 70494 will-it-scale.per_thread_ops 127330 ± 19% -98.0% 2525 ± 24% will-it-scale.time.involuntary_context_switches 727.50 ± 2% -77.0% 167.25 will-it-scale.time.percent_of_cpu_this_job_got 2141 ± 2% -77.6% 479.12 will-it-scale.time.system_time 50.48 ± 7% -48.5% 25.98 will-it-scale.time.user_time 34925294 ± 18% +270.3% 1.293e+08 ± 4% will-it-scale.time.voluntary_context_switches 1570007 ± 8% -64.1% 563958 will-it-scale.workload 6435 ± 2% -6.4% 6024 proc-vmstat.nr_shmem 1298 ± 16% -44.5% 721.00 ± 18% proc-vmstat.pgactivate 2341 +16.4% 2724 slabinfo.kmalloc-96.active_objs 2341 +16.4% 2724 slabinfo.kmalloc-96.num_objs 6346 ±150% -87.8% 776.25 ± 9% softirqs.NET_RX 160107 ± 8% +151.9% 403273 softirqs.SCHED 1097999 -13.0% 955526 softirqs.TIMER 5.50 ± 9% -81.8% 1.00 vmstat.procs.r 230700 ± 19% +269.9% 853292 ± 4% vmstat.system.cs 26706 ± 3% +15.7% 30910 ± 5% vmstat.system.in 11.24 ± 23% +72.2 83.39 mpstat.cpu.idle% 0.00 ±131% +0.0 0.04 ± 99% mpstat.cpu.iowait% 86.32 ± 2% -70.8 15.54 mpstat.cpu.sys% 2.44 ± 7% -1.4 1.04 ± 8% mpstat.cpu.usr% 20610709 ± 15% +2376.0% 5.103e+08 ± 34% cpuidle.C1.time 3233399 ± 8% +241.5% 11042785 ± 25% cpuidle.C1.usage 36172040 ± 6% +931.3% 3.73e+08 ± 15% cpuidle.C1E.time 783605 ± 4% +548.7% 5083041 ± 18% cpuidle.C1E.usage 28753819 ± 39% +1054.5% 3.319e+08 ± 49% cpuidle.C3.time 283912 ± 25% +688.4% 2238225 ± 34% cpuidle.C3.usage 1.507e+08 ± 47% +292.3% 5.913e+08 ± 28% cpuidle.C6.time 339861 ± 37% +549.7% 2208222 ± 24% cpuidle.C6.usage 2709719 ± 5% +824.2% 25043444 cpuidle.POLL.time 28602864 ± 18% +173.7% 78276116 ± 10% cpuidle.POLL.usage 3338 ± 2% -71.8% 941.75 turbostat.Avg_MHz 90.40 ± 2% -65.1 25.31 turbostat.Busy% 3233316 ± 8% +241.5% 11042588 ± 25% turbostat.C1 0.83 ± 16% +20.2 21.02 ± 35% turbostat.C1% 783559 ± 4% +548.7% 5082972 ± 18% turbostat.C1E 1.46 ± 7% +13.9 15.34 ± 15% turbostat.C1E% 283898 ± 25% +688.4% 2238202 ± 34% turbostat.C3 1.17 ± 39% +12.5 13.66 ± 49% turbostat.C3% 339857 ± 37% +549.7% 2208205 ± 24% turbostat.C6 6.05 ± 46% +18.2 24.30 ± 28% turbostat.C6% 6.12 ± 18% +755.7% 52.39 ± 9% turbostat.CPU%c1 2.18 ±105% +735.9% 18.18 ± 45% turbostat.CPU%c3 1.30 ±117% +216.3% 4.12 ± 92% turbostat.CPU%c6 38.31 -37.2% 24.06 turbostat.CorWatt 8285923 ± 2% +13.9% 9436075 ± 6% turbostat.IRQ 43.17 -33.4% 28.77 turbostat.PkgWatt 8.92e+11 -67.9% 2.862e+11 ± 31% perf-stat.branch-instructions 0.55 ± 4% +1.0 1.53 ± 5% perf-stat.branch-miss-rate% 0.19 ± 22% +0.7 0.89 ± 69% perf-stat.cache-miss-rate% 2.401e+10 -57.3% 1.025e+10 ± 28% perf-stat.cache-references 71517245 ± 18% +264.5% 2.607e+08 ± 4% perf-stat.context-switches 1.85 -21.9% 1.44 ± 2% perf-stat.cpi 8.223e+12 ± 2% -76.8% 1.904e+12 ± 32% perf-stat.cpu-cycles 0.34 ± 11% +0.3 0.63 ± 9% perf-stat.dTLB-load-miss-rate% 4.563e+09 ± 10% -50.7% 2.252e+09 ± 27% perf-stat.dTLB-load-misses 1.357e+12 -73.2% 3.63e+11 ± 31% perf-stat.dTLB-loads 0.01 ± 28% +0.0 0.02 ± 10% perf-stat.dTLB-store-miss-rate% 20813820 ± 31% +109.2% 43542782 ± 25% perf-stat.dTLB-store-misses 97.04 -13.4 83.65 ± 2% perf-stat.iTLB-load-miss-rate% 5.871e+08 ± 8% -48.9% 3.001e+08 ± 35% perf-stat.iTLB-load-misses 17851698 ± 4% +235.7% 59936365 ± 41% perf-stat.iTLB-loads 4.456e+12 -70.6% 1.311e+12 ± 31% perf-stat.instructions 7651 ± 9% -41.0% 4513 ± 11% perf-stat.instructions-per-iTLB-miss 0.54 +28.2% 0.69 ± 2% perf-stat.ipc 131812 ± 2% -75.7% 31973 sched_debug.cfs_rq:/.exec_clock.avg 133451 ± 2% -67.5% 43371 ± 30% sched_debug.cfs_rq:/.exec_clock.max 130067 ± 4% -83.3% 21767 ± 30% sched_debug.cfs_rq:/.exec_clock.min 1220 ± 87% +592.8% 8456 ± 98% sched_debug.cfs_rq:/.exec_clock.stddev 229519 ± 6% +70.6% 391456 ± 4% sched_debug.cfs_rq:/.load.max 65462 ± 11% +141.1% 157808 ± 4% sched_debug.cfs_rq:/.load.stddev 82.00 ± 3% -83.5% 13.54 ± 30% sched_debug.cfs_rq:/.load_avg.min 985041 ± 4% -90.8% 90737 sched_debug.cfs_rq:/.min_vruntime.avg 1004586 ± 4% -87.2% 128180 ± 21% sched_debug.cfs_rq:/.min_vruntime.max 969836 ± 5% -93.6% 62139 ± 28% sched_debug.cfs_rq:/.min_vruntime.min 0.77 ± 5% -42.6% 0.44 ± 10% sched_debug.cfs_rq:/.nr_running.avg 0.34 ± 12% +39.5% 0.48 sched_debug.cfs_rq:/.nr_running.stddev 1.79 ± 7% -63.1% 0.66 ± 22% sched_debug.cfs_rq:/.nr_spread_over.avg 10.54 ± 20% -68.0% 3.38 ± 26% sched_debug.cfs_rq:/.nr_spread_over.max 3.52 ± 18% -68.3% 1.12 ± 25% sched_debug.cfs_rq:/.nr_spread_over.stddev 96.05 ± 6% -33.5% 63.92 ± 8% sched_debug.cfs_rq:/.runnable_load_avg.avg 237.58 ± 7% +31.3% 311.83 ± 2% sched_debug.cfs_rq:/.runnable_load_avg.max 67.84 ± 9% +55.7% 105.65 sched_debug.cfs_rq:/.runnable_load_avg.stddev 200408 ± 8% +80.6% 361912 ± 6% sched_debug.cfs_rq:/.runnable_weight.max 56555 ± 14% +160.3% 147211 ± 5% sched_debug.cfs_rq:/.runnable_weight.stddev 936.14 ± 2% -55.3% 418.09 ± 6% sched_debug.cfs_rq:/.util_avg.avg 1341 ± 11% -43.2% 762.54 ± 11% sched_debug.cfs_rq:/.util_avg.max 587.25 ± 18% -69.6% 178.75 ± 23% sched_debug.cfs_rq:/.util_avg.min 518.64 ± 11% -90.2% 50.84 ± 29% sched_debug.cfs_rq:/.util_est_enqueued.avg 1018 ± 4% -70.8% 297.75 ± 23% sched_debug.cfs_rq:/.util_est_enqueued.max 386.54 ± 6% -73.6% 102.24 ± 21% sched_debug.cfs_rq:/.util_est_enqueued.stddev 116574 ± 30% +67.2% 194964 ± 30% sched_debug.cpu.avg_idle.avg 93.29 ± 16% -35.1% 60.54 ± 8% sched_debug.cpu.cpu_load[0].avg 221.08 ± 8% +34.3% 296.96 ± 9% sched_debug.cpu.cpu_load[0].max 63.60 ± 9% +57.6% 100.26 ± 9% sched_debug.cpu.cpu_load[0].stddev 95.54 ± 13% -47.7% 49.98 ± 7% sched_debug.cpu.cpu_load[1].avg 41.00 ± 52% -97.7% 0.96 ± 68% sched_debug.cpu.cpu_load[1].min 44.57 ± 16% +38.2% 61.57 ± 8% sched_debug.cpu.cpu_load[1].stddev 98.62 ± 10% -58.2% 41.19 ± 7% sched_debug.cpu.cpu_load[2].avg 169.42 ± 8% -28.1% 121.79 ± 9% sched_debug.cpu.cpu_load[2].max 58.04 ± 35% -94.5% 3.17 ± 47% sched_debug.cpu.cpu_load[2].min 100.91 ± 8% -64.5% 35.80 ± 10% sched_debug.cpu.cpu_load[3].avg 155.21 ± 5% -39.6% 93.79 ± 13% sched_debug.cpu.cpu_load[3].max 70.42 ± 22% -93.3% 4.71 ± 36% sched_debug.cpu.cpu_load[3].min 102.59 ± 6% -68.9% 31.92 ± 17% sched_debug.cpu.cpu_load[4].avg 144.54 ± 5% -44.9% 79.71 ± 28% sched_debug.cpu.cpu_load[4].max 78.79 ± 15% -92.6% 5.83 ± 30% sched_debug.cpu.cpu_load[4].min 1044 ± 5% -33.5% 694.38 ± 4% sched_debug.cpu.curr->pid.avg 835.66 ± 4% +19.0% 994.65 sched_debug.cpu.curr->pid.stddev 228643 ± 6% +71.3% 391578 ± 4% sched_debug.cpu.load.max 64674 ± 11% +143.6% 157538 ± 4% sched_debug.cpu.load.stddev 0.00 ± 5% -48.4% 0.00 ± 46% sched_debug.cpu.next_balance.stddev 1.03 ± 16% -44.9% 0.57 ± 13% sched_debug.cpu.nr_running.avg 6206533 ± 12% +167.7% 16616895 ± 4% sched_debug.cpu.nr_switches.avg 6795551 ± 18% +222.4% 21911344 ± 19% sched_debug.cpu.nr_switches.max 5666982 ± 9% +115.3% 12201219 ± 17% sched_debug.cpu.nr_switches.min 351168 ± 73% +837.8% 3293280 ± 72% sched_debug.cpu.nr_switches.stddev 0.32 ± 21% +109.8% 0.67 ± 8% sched_debug.cpu.nr_uninterruptible.avg 6297340 ± 12% +163.9% 16617675 ± 4% sched_debug.cpu.sched_count.avg 6887997 ± 18% +218.1% 21912464 ± 19% sched_debug.cpu.sched_count.max 5753875 ± 8% +112.1% 12201952 ± 17% sched_debug.cpu.sched_count.min 352908 ± 73% +833.2% 3293323 ± 71% sched_debug.cpu.sched_count.stddev 3067826 ± 12% +170.7% 8305951 ± 4% sched_debug.cpu.sched_goidle.avg 3361061 ± 18% +225.9% 10953485 ± 19% sched_debug.cpu.sched_goidle.max 2798299 ± 9% +117.9% 6098033 ± 17% sched_debug.cpu.sched_goidle.min 175049 ± 72% +840.7% 1646720 ± 72% sched_debug.cpu.sched_goidle.stddev 3232125 ± 11% +159.6% 8389199 ± 4% sched_debug.cpu.ttwu_count.avg 3533980 ± 16% +275.2% 13260800 ± 36% sched_debug.cpu.ttwu_count.max 271212 ±109% +1140.0% 3363044 ± 83% sched_debug.cpu.ttwu_count.stddev 107111 ± 9% +30.6% 139843 ± 17% sched_debug.cpu.ttwu_local.max 85459 ± 6% -29.3% 60381 ± 44% sched_debug.cpu.ttwu_local.min 6551 ± 69% +374.8% 31104 ± 78% sched_debug.cpu.ttwu_local.stddev 82.07 -72.2 9.87 ± 5% perf-profile.calltrace.cycles-pp.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 81.23 -72.0 9.20 ± 5% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 81.17 -72.0 9.18 ± 5% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64 68.76 -68.8 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk 94.12 -54.6 39.55 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 94.54 -54.4 40.16 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 94.69 -54.3 40.35 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 10.16 ± 3% -10.0 0.19 ±173% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk 0.89 ± 10% -0.2 0.67 ± 6% perf-profile.calltrace.cycles-pp.anon_vma_clone.__split_vma.__do_munmap.__x64_sys_brk.do_syscall_64 0.66 ± 6% +0.4 1.03 ± 8% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk 0.74 ± 6% +0.4 1.16 ± 8% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64 1.42 ± 7% +0.4 1.85 ± 6% perf-profile.calltrace.cycles-pp.vma_merge.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.59 ± 11% perf-profile.calltrace.cycles-pp.__task_rq_lock.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake 0.00 +0.6 0.63 ± 13% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry 0.00 +0.7 0.66 ± 18% perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +0.7 0.67 ± 9% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable 0.00 +0.7 0.67 ± 11% perf-profile.calltrace.cycles-pp.unlink_anon_vmas.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk 0.00 +0.7 0.67 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_idle.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable 0.00 +0.7 0.68 ± 12% perf-profile.calltrace.cycles-pp.find_next_bit.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length 0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.67 ± 7% +0.7 1.35 ± 9% perf-profile.calltrace.cycles-pp.perf_event_mmap.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.14 ±173% +0.7 0.87 ± 5% perf-profile.calltrace.cycles-pp.get_unmapped_area.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.8 0.77 ± 8% perf-profile.calltrace.cycles-pp.security_vm_enough_memory_mm.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.8 0.78 ± 11% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64 0.00 +0.9 0.87 ± 17% perf-profile.calltrace.cycles-pp.unwind_next_frame.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity 0.00 +0.9 0.91 ± 8% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule 1.75 ± 10% +0.9 2.66 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.0 0.98 ± 7% perf-profile.calltrace.cycles-pp.__switch_to 0.00 +1.0 0.98 ± 9% perf-profile.calltrace.cycles-pp.__switch_to_asm 0.00 +1.1 1.10 ± 3% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule 0.00 +1.1 1.11 ± 20% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake 0.00 +1.2 1.20 ± 6% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select 0.00 +1.6 1.64 ± 7% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle 0.00 +1.9 1.86 ± 14% perf-profile.calltrace.cycles-pp.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 5.75 ± 4% +1.9 7.64 ± 5% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +1.9 1.91 ± 14% perf-profile.calltrace.cycles-pp.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate 0.00 +2.1 2.09 ± 11% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 3.38 ± 5% +2.1 5.47 ± 4% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.2 2.25 ± 14% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up 0.00 +2.5 2.46 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry 0.00 +2.5 2.46 ± 10% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.00 +3.1 3.06 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.00 +3.5 3.52 ± 4% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable 0.00 +3.8 3.80 ± 8% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.00 +4.1 4.10 ± 3% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable 0.00 +4.7 4.66 ± 11% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary 0.00 +4.8 4.83 ± 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +5.3 5.27 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.91 ± 16% +5.5 6.44 ± 4% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_write 0.95 ± 15% +5.7 6.70 ± 4% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk 1.73 ± 11% +5.8 7.53 ± 4% perf-profile.calltrace.cycles-pp.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +6.2 6.15 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q 1.15 ± 17% +6.2 7.33 ± 4% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64 1.15 ± 17% +6.2 7.36 ± 4% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +6.9 6.93 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_read 0.00 +6.9 6.95 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake 0.00 +7.1 7.15 ± 3% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk 0.00 +7.3 7.33 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake 0.00 +7.8 7.75 ± 3% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64 0.00 +7.8 7.79 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +7.9 7.90 ± 3% perf-profile.calltrace.cycles-pp.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +8.0 8.00 ± 4% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable 0.00 +8.2 8.22 ± 4% perf-profile.calltrace.cycles-pp.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk 0.83 ± 27% +25.9 26.75 ± 11% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 1.09 ± 32% +30.9 31.97 ± 10% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.62 ± 36% +44.4 46.01 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.63 ± 36% +44.5 46.18 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 1.63 ± 36% +44.6 46.21 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 1.73 ± 29% +51.1 52.86 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64 82.10 -72.2 9.91 ± 6% perf-profile.children.cycles-pp.down_write_killable 81.23 -72.0 9.20 ± 5% perf-profile.children.cycles-pp.call_rwsem_down_write_failed_killable 81.20 -72.0 9.18 ± 5% perf-profile.children.cycles-pp.rwsem_down_write_failed_killable 68.78 -68.8 0.01 ±173% perf-profile.children.cycles-pp.osq_lock 94.15 -54.6 39.58 ± 2% perf-profile.children.cycles-pp.__x64_sys_brk 94.59 -54.3 40.28 ± 3% perf-profile.children.cycles-pp.do_syscall_64 94.74 -54.3 40.48 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 10.16 ± 3% -9.8 0.38 ± 61% perf-profile.children.cycles-pp.rwsem_spin_on_owner 1.25 ± 11% -0.5 0.78 ± 5% perf-profile.children.cycles-pp.find_vma 0.89 ± 10% -0.2 0.67 ± 7% perf-profile.children.cycles-pp.anon_vma_clone 0.27 ± 31% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.tlb_gather_mmu 0.07 ± 7% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.cap_mmap_addr 0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.tlb_flush_mmu_free 0.00 +0.1 0.05 perf-profile.children.cycles-pp.irq_work_run_list 0.08 ± 25% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.arch_tlb_finish_mmu 0.01 ±173% +0.1 0.07 ± 12% perf-profile.children.cycles-pp.cap_capable 0.07 ± 12% +0.1 0.13 ± 23% perf-profile.children.cycles-pp.selinux_mmap_addr 0.04 ± 60% +0.1 0.10 ± 27% perf-profile.children.cycles-pp.free_pgd_range 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.strlen 0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.sched_idle_set_state 0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.__list_add_valid 0.03 ±102% +0.1 0.10 ± 14% perf-profile.children.cycles-pp.__vm_enough_memory 0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.1 0.08 ± 30% perf-profile.children.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.__enqueue_entity 0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.perf_exclude_event 0.04 ± 58% +0.1 0.12 ± 31% perf-profile.children.cycles-pp.lru_add_drain_cpu 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.in_sched_functions 0.09 ± 20% +0.1 0.18 ± 26% perf-profile.children.cycles-pp.tick_sched_handle 0.09 ± 21% +0.1 0.17 ± 26% perf-profile.children.cycles-pp.update_process_times 0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.tick_check_broadcast_expired 0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret 0.23 ± 15% +0.1 0.32 ± 13% perf-profile.children.cycles-pp.remove_vma 0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.get_cpu_device 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.vma_adjust_trans_huge 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.hugepage_vma_check 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.put_prev_task_idle 0.10 ± 15% +0.1 0.19 ± 13% perf-profile.children.cycles-pp.__vma_link_rb 0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.userfaultfd_unmap_prep 0.10 ± 19% +0.1 0.20 ± 21% perf-profile.children.cycles-pp.__rb_insert_augmented 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.clear_buddies 0.16 ± 14% +0.1 0.27 ± 22% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.03 ±100% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.khugepaged_enter_vma_merge 0.13 ± 19% +0.1 0.23 ± 13% perf-profile.children.cycles-pp.tlb_finish_mmu 0.00 +0.1 0.10 ± 28% perf-profile.children.cycles-pp.pm_qos_request 0.00 +0.1 0.10 ± 34% perf-profile.children.cycles-pp.stack_access_ok 0.00 +0.1 0.11 ± 37% perf-profile.children.cycles-pp.perf_swevent_event 0.17 ± 27% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.avc_has_perm_noaudit 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.irq_work_needs_cpu 0.00 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.reschedule_interrupt 0.00 +0.1 0.11 ± 19% perf-profile.children.cycles-pp.clockevents_program_event 0.00 +0.1 0.11 ± 42% perf-profile.children.cycles-pp.tick_nohz_tick_stopped 0.10 ± 15% +0.1 0.22 ± 24% perf-profile.children.cycles-pp.tick_sched_timer 0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.can_stop_idle_tick 0.53 ± 4% +0.1 0.66 ± 9% perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.native_load_tls 0.00 +0.1 0.13 ± 33% perf-profile.children.cycles-pp.load_new_mm_cr3 0.07 ± 23% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.cap_vm_enough_memory 0.00 +0.1 0.14 ± 19% perf-profile.children.cycles-pp.__update_idle_core 0.00 +0.1 0.14 ± 15% perf-profile.children.cycles-pp.update_min_vruntime 0.00 +0.1 0.14 ± 26% perf-profile.children.cycles-pp.leave_mm 0.33 ± 6% +0.1 0.47 ± 14% perf-profile.children.cycles-pp.___might_sleep 0.00 +0.2 0.15 ± 24% perf-profile.children.cycles-pp.ttwu_stat 0.09 ± 20% +0.2 0.24 ± 13% perf-profile.children.cycles-pp.perf_event_mmap_output 0.14 ± 9% +0.2 0.30 ± 20% perf-profile.children.cycles-pp.strlcpy 0.01 ±173% +0.2 0.18 ± 31% perf-profile.children.cycles-pp.__softirqentry_text_start 0.00 +0.2 0.17 ± 25% perf-profile.children.cycles-pp.deactivate_task 0.00 +0.2 0.18 ± 12% perf-profile.children.cycles-pp.orc_find 0.00 +0.2 0.18 ± 14% perf-profile.children.cycles-pp.sched_ttwu_pending 0.24 ± 14% +0.2 0.42 ± 7% perf-profile.children.cycles-pp.security_mmap_addr 0.00 +0.2 0.18 ± 11% perf-profile.children.cycles-pp.rcu_eqs_exit 0.00 +0.2 0.19 ± 15% perf-profile.children.cycles-pp.rcu_eqs_enter 0.20 ± 10% +0.2 0.40 ± 14% perf-profile.children.cycles-pp.__might_sleep 0.07 ± 21% +0.2 0.27 ± 18% perf-profile.children.cycles-pp.__vma_rb_erase 0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.rb_next 0.00 +0.2 0.20 ± 20% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.save_stack_address 0.22 ± 19% +0.2 0.43 ± 9% perf-profile.children.cycles-pp.cred_has_capability 0.00 +0.2 0.22 ± 25% perf-profile.children.cycles-pp.__orc_find 0.00 +0.2 0.23 ± 14% perf-profile.children.cycles-pp.kernel_text_address 0.03 ±100% +0.2 0.25 ± 24% perf-profile.children.cycles-pp.irq_exit 0.00 +0.2 0.23 ± 27% perf-profile.children.cycles-pp.__rwsem_mark_wake 0.00 +0.2 0.24 ± 22% perf-profile.children.cycles-pp.nr_iowait_cpu 0.00 +0.2 0.25 ± 12% perf-profile.children.cycles-pp.call_cpuidle 0.24 ± 13% +0.3 0.50 ± 9% perf-profile.children.cycles-pp.perf_iterate_sb 0.38 ± 13% +0.3 0.63 ± 14% perf-profile.children.cycles-pp.vm_area_dup 0.32 ± 7% +0.3 0.57 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc 0.00 +0.3 0.26 ± 8% perf-profile.children.cycles-pp.put_prev_entity 0.16 ± 12% +0.3 0.42 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.00 +0.3 0.27 ± 24% perf-profile.children.cycles-pp.menu_reflect 0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.activate_task 0.00 +0.3 0.27 ± 23% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.account_entity_dequeue 0.00 +0.3 0.28 ± 18% perf-profile.children.cycles-pp.__kernel_text_address 0.00 +0.3 0.28 ± 8% perf-profile.children.cycles-pp.get_iowait_load 0.27 ± 13% +0.3 0.56 ± 12% perf-profile.children.cycles-pp.selinux_vm_enough_memory 0.41 ± 2% +0.3 0.70 ± 9% perf-profile.children.cycles-pp.unlink_anon_vmas 0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.pick_next_entity 0.00 +0.3 0.31 ± 4% perf-profile.children.cycles-pp.rb_erase_cached 0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.account_entity_enqueue 0.00 +0.3 0.33 ± 8% perf-profile.children.cycles-pp.available_idle_cpu 0.00 +0.3 0.34 ± 14% perf-profile.children.cycles-pp.update_ts_time_stats 0.00 +0.3 0.34 ± 12% perf-profile.children.cycles-pp.unwind_get_return_address 0.00 +0.3 0.35 ± 20% perf-profile.children.cycles-pp.rwsem_downgrade_wake 0.45 ± 3% +0.4 0.80 ± 11% perf-profile.children.cycles-pp.free_pgtables 0.00 +0.4 0.37 ± 8% perf-profile.children.cycles-pp.__calc_delta 0.00 +0.4 0.37 ± 24% perf-profile.children.cycles-pp.call_rwsem_downgrade_wake 0.00 +0.4 0.38 ± 8% perf-profile.children.cycles-pp.select_idle_sibling 0.68 ± 6% +0.4 1.06 ± 7% perf-profile.children.cycles-pp.unmap_page_range 0.00 +0.4 0.39 ± 7% perf-profile.children.cycles-pp.put_prev_task_fair 0.22 ± 8% +0.4 0.62 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt 0.00 +0.4 0.41 ± 2% perf-profile.children.cycles-pp.rcu_idle_exit 0.50 ± 11% +0.4 0.91 ± 6% perf-profile.children.cycles-pp.get_unmapped_area 0.00 +0.4 0.42 ± 3% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.36 ± 11% +0.4 0.79 ± 9% perf-profile.children.cycles-pp.security_vm_enough_memory_mm 0.75 ± 6% +0.4 1.19 ± 8% perf-profile.children.cycles-pp.unmap_vmas 1.42 ± 7% +0.4 1.86 ± 5% perf-profile.children.cycles-pp.vma_merge 0.00 +0.5 0.46 ± 15% perf-profile.children.cycles-pp.__unwind_start 0.00 +0.5 0.46 ± 32% perf-profile.children.cycles-pp.resched_curr 0.12 ± 8% +0.5 0.62 ± 12% perf-profile.children.cycles-pp.__indirect_thunk_start 0.01 ±173% +0.5 0.53 ± 14% perf-profile.children.cycles-pp.read_tsc 0.00 +0.5 0.52 ± 23% perf-profile.children.cycles-pp.downgrade_write 0.06 ± 62% +0.5 0.58 ± 12% perf-profile.children.cycles-pp.wake_q_add 0.44 ± 26% +0.6 1.00 ± 25% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.00 +0.6 0.62 ± 13% perf-profile.children.cycles-pp.reweight_entity 0.04 ±106% +0.6 0.67 ± 6% perf-profile.children.cycles-pp.native_write_msr 0.00 +0.6 0.63 ± 13% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.00 +0.6 0.64 ± 6% perf-profile.children.cycles-pp.___perf_sw_event 0.00 +0.7 0.68 ± 7% perf-profile.children.cycles-pp.pick_next_task_idle 0.28 ± 9% +0.7 0.96 ± 10% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.04 ±100% +0.7 0.72 ± 10% perf-profile.children.cycles-pp.__task_rq_lock 0.02 ±173% +0.7 0.71 ± 9% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.00 +0.7 0.70 ± 10% perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.7 0.72 ± 6% perf-profile.children.cycles-pp.__update_load_avg_se 0.68 ± 6% +0.7 1.40 ± 9% perf-profile.children.cycles-pp.perf_event_mmap 0.00 +0.7 0.74 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.29 ± 8% +0.7 1.03 ± 10% perf-profile.children.cycles-pp.apic_timer_interrupt 0.01 ±173% +0.7 0.76 ± 6% perf-profile.children.cycles-pp.finish_task_switch 0.01 ±173% +0.8 0.81 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.03 ±100% +0.8 0.84 ± 11% perf-profile.children.cycles-pp.ktime_get 0.02 ±173% +0.8 0.83 ± 21% perf-profile.children.cycles-pp.check_preempt_curr 0.01 ±173% +0.8 0.83 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.03 ±105% +0.9 0.88 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.02 ±173% +0.9 0.92 ± 20% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.46 ± 26% +0.9 1.36 ± 20% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.75 ± 10% +0.9 2.67 ± 5% perf-profile.children.cycles-pp.unmap_region 0.01 ±173% +0.9 0.95 ± 11% perf-profile.children.cycles-pp.find_next_bit 0.01 ±173% +1.0 0.99 ± 7% perf-profile.children.cycles-pp.update_cfs_group 0.03 ±105% +1.0 1.04 ± 8% perf-profile.children.cycles-pp.__switch_to_asm 0.04 ± 57% +1.0 1.07 ± 10% perf-profile.children.cycles-pp.update_curr 0.03 ±100% +1.2 1.24 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair 0.01 ±173% +1.2 1.23 ± 6% perf-profile.children.cycles-pp.__switch_to 0.28 ± 12% +1.3 1.55 ± 10% perf-profile.children.cycles-pp._raw_spin_lock 0.01 ±173% +1.3 1.34 ± 13% perf-profile.children.cycles-pp.native_sched_clock 0.02 ±173% +1.4 1.37 ± 12% perf-profile.children.cycles-pp.sched_clock 0.00 +1.4 1.36 ± 12% perf-profile.children.cycles-pp.unwind_next_frame 0.04 ± 63% +1.4 1.49 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu 0.03 ±100% +1.5 1.48 ± 10% perf-profile.children.cycles-pp.__next_timer_interrupt 0.08 ± 38% +1.7 1.77 ± 5% perf-profile.children.cycles-pp.set_next_entity 5.79 ± 4% +1.9 7.71 ± 5% perf-profile.children.cycles-pp.__do_munmap 0.00 +2.1 2.09 ± 9% perf-profile.children.cycles-pp.__save_stack_trace 3.38 ± 5% +2.1 5.47 ± 4% perf-profile.children.cycles-pp.do_brk_flags 0.00 +2.1 2.13 ± 9% perf-profile.children.cycles-pp.save_stack_trace_tsk 0.05 ± 61% +2.2 2.22 ± 7% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.01 ±173% +2.5 2.53 ± 8% perf-profile.children.cycles-pp.__account_scheduler_latency 0.11 ± 47% +2.5 2.65 ± 2% perf-profile.children.cycles-pp.update_load_avg 0.06 ± 60% +2.6 2.66 ± 7% perf-profile.children.cycles-pp.tick_nohz_next_event 0.15 ± 42% +3.2 3.33 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair 0.09 ± 31% +3.4 3.51 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.14 ± 35% +3.5 3.62 ± 3% perf-profile.children.cycles-pp.dequeue_entity 0.16 ± 36% +4.0 4.12 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 0.24 ± 44% +4.1 4.30 ± 5% perf-profile.children.cycles-pp.poll_idle 0.24 ± 50% +5.3 5.54 ± 4% perf-profile.children.cycles-pp.schedule_idle 2.34 ± 9% +5.6 7.90 ± 4% perf-profile.children.cycles-pp.up_write 0.19 ± 35% +5.8 5.99 ± 6% perf-profile.children.cycles-pp.menu_select 0.20 ± 33% +6.1 6.30 ± 2% perf-profile.children.cycles-pp.enqueue_entity 0.22 ± 32% +6.7 6.96 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair 0.24 ± 29% +7.1 7.35 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate 0.00 +7.9 7.91 ± 3% perf-profile.children.cycles-pp.up_read 0.32 ± 37% +7.9 8.23 ± 4% perf-profile.children.cycles-pp.schedule 0.91 ± 15% +12.5 13.40 ± 3% perf-profile.children.cycles-pp.try_to_wake_up 0.95 ± 15% +12.9 13.85 ± 3% perf-profile.children.cycles-pp.wake_up_q 0.55 ± 43% +13.0 13.52 ± 4% perf-profile.children.cycles-pp.__sched_text_start 1.15 ± 17% +14.0 15.11 ± 3% perf-profile.children.cycles-pp.rwsem_wake 1.15 ± 17% +14.0 15.15 ± 3% perf-profile.children.cycles-pp.call_rwsem_wake 0.88 ± 20% +29.8 30.72 ± 5% perf-profile.children.cycles-pp.intel_idle 1.16 ± 24% +35.6 36.74 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state 1.63 ± 36% +44.6 46.21 ± 9% perf-profile.children.cycles-pp.start_secondary 1.74 ± 29% +51.1 52.81 ± 2% perf-profile.children.cycles-pp.do_idle 1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.secondary_startup_64 1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry 68.56 -68.5 0.01 ±173% perf-profile.self.cycles-pp.osq_lock 10.12 ± 4% -9.7 0.38 ± 61% perf-profile.self.cycles-pp.rwsem_spin_on_owner 1.41 ± 7% -0.9 0.51 ± 17% perf-profile.self.cycles-pp.rwsem_down_write_failed_killable 1.16 ± 4% -0.6 0.52 ± 12% perf-profile.self.cycles-pp.up_write 1.02 ± 14% -0.5 0.48 ± 9% perf-profile.self.cycles-pp.find_vma 1.16 ± 5% -0.2 0.94 ± 2% perf-profile.self.cycles-pp.__vma_adjust 0.38 ± 10% -0.2 0.20 ± 17% perf-profile.self.cycles-pp.anon_vma_clone 0.26 ± 31% -0.1 0.12 ± 5% perf-profile.self.cycles-pp.tlb_gather_mmu 0.06 ± 15% +0.0 0.09 ± 15% perf-profile.self.cycles-pp.cap_mmap_addr 0.06 +0.0 0.10 ± 8% perf-profile.self.cycles-pp.__split_vma 0.01 ±173% +0.0 0.06 ± 14% perf-profile.self.cycles-pp.remove_vma 0.04 ± 58% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.tlb_finish_mmu 0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.strlen 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.unwind_get_return_address 0.04 ± 60% +0.1 0.10 ± 27% perf-profile.self.cycles-pp.free_pgd_range 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.cap_capable 0.00 +0.1 0.06 ± 34% perf-profile.self.cycles-pp.__list_add_valid 0.04 ± 58% +0.1 0.11 ± 28% perf-profile.self.cycles-pp.lru_add_drain_cpu 0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.kernel_text_address 0.00 +0.1 0.07 ± 34% perf-profile.self.cycles-pp.put_prev_task_idle 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.hugepage_vma_check 0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.rcu_note_context_switch 0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.__save_stack_trace 0.00 +0.1 0.08 ± 16% perf-profile.self.cycles-pp.clear_buddies 0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__enqueue_entity 0.10 ± 31% +0.1 0.17 ± 13% perf-profile.self.cycles-pp.security_mmap_addr 0.04 ± 58% +0.1 0.12 ± 32% perf-profile.self.cycles-pp.selinux_vm_enough_memory 0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.free_pgtables 0.09 ± 13% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.unlink_anon_vmas 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.rb_insert_color_cached 0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.get_cpu_device 0.04 ± 58% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.selinux_mmap_addr 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.vma_adjust_trans_huge 0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.tick_check_broadcast_expired 0.05 ± 8% +0.1 0.14 ± 33% perf-profile.self.cycles-pp.userfaultfd_unmap_complete 0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.__vma_link_rb 0.00 +0.1 0.09 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret 0.00 +0.1 0.09 ± 12% perf-profile.self.cycles-pp.ttwu_do_wakeup 0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.irq_work_needs_cpu 0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.update_ts_time_stats 0.00 +0.1 0.09 ± 32% perf-profile.self.cycles-pp.tick_nohz_tick_stopped 0.00 +0.1 0.09 ± 36% perf-profile.self.cycles-pp.stack_access_ok 0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.userfaultfd_unmap_prep 0.00 +0.1 0.10 ± 11% perf-profile.self.cycles-pp.__unwind_start 0.00 +0.1 0.10 ± 29% perf-profile.self.cycles-pp.pm_qos_request 0.50 ± 4% +0.1 0.60 ± 12% perf-profile.self.cycles-pp.vma_compute_subtree_gap 0.15 ± 12% +0.1 0.25 ± 9% perf-profile.self.cycles-pp.perf_iterate_sb 0.03 ±100% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.rwsem_wake 0.00 +0.1 0.10 ± 23% perf-profile.self.cycles-pp.ttwu_do_activate 0.09 ± 17% +0.1 0.20 ± 22% perf-profile.self.cycles-pp.__rb_insert_augmented 0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.save_stack_address 0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.hrtimer_next_event_without 0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.tick_nohz_idle_exit 0.17 ± 28% +0.1 0.27 ± 9% perf-profile.self.cycles-pp.avc_has_perm_noaudit 0.01 ±173% +0.1 0.12 ± 15% perf-profile.self.cycles-pp.cap_vm_enough_memory 0.00 +0.1 0.11 ± 31% perf-profile.self.cycles-pp.sched_clock_cpu 0.09 ± 19% +0.1 0.20 ± 21% perf-profile.self.cycles-pp.arch_get_unmapped_area_topdown 0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.native_load_tls 0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.can_stop_idle_tick 0.00 +0.1 0.12 ± 15% perf-profile.self.cycles-pp.up_read 0.00 +0.1 0.13 ± 18% perf-profile.self.cycles-pp.__update_idle_core 0.00 +0.1 0.13 ± 33% perf-profile.self.cycles-pp.load_new_mm_cr3 0.00 +0.1 0.13 ± 12% perf-profile.self.cycles-pp.update_min_vruntime 0.32 ± 7% +0.1 0.45 ± 13% perf-profile.self.cycles-pp.___might_sleep 0.03 ±100% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.cred_has_capability 0.11 ± 21% +0.1 0.24 ± 14% perf-profile.self.cycles-pp.get_unmapped_area 0.00 +0.1 0.14 ± 19% perf-profile.self.cycles-pp.put_prev_task_fair 0.00 +0.1 0.14 ± 30% perf-profile.self.cycles-pp.deactivate_task 0.00 +0.1 0.14 ± 46% perf-profile.self.cycles-pp.downgrade_write 0.09 ± 20% +0.1 0.23 ± 16% perf-profile.self.cycles-pp.perf_event_mmap_output 0.00 +0.1 0.15 ± 19% perf-profile.self.cycles-pp.pick_next_task_idle 0.00 +0.1 0.15 ± 13% perf-profile.self.cycles-pp.schedule_idle 0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.ttwu_stat 0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.cpu_startup_entry 0.01 ±173% +0.2 0.17 ± 28% perf-profile.self.cycles-pp.strlcpy 0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.schedule 0.18 ± 8% +0.2 0.34 ± 13% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.2 0.16 ± 26% perf-profile.self.cycles-pp.rb_next 0.24 ± 6% +0.2 0.41 ± 11% perf-profile.self.cycles-pp.kmem_cache_alloc 0.18 ± 27% +0.2 0.35 ± 8% perf-profile.self.cycles-pp.vma_merge 0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.sched_ttwu_pending 0.00 +0.2 0.18 ± 22% perf-profile.self.cycles-pp.rcu_eqs_enter 0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.orc_find 0.00 +0.2 0.18 ± 18% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.rcu_eqs_exit 0.00 +0.2 0.19 ± 18% perf-profile.self.cycles-pp.__list_del_entry_valid 0.01 ±173% +0.2 0.21 ± 20% perf-profile.self.cycles-pp.__vma_rb_erase 0.00 +0.2 0.21 ± 27% perf-profile.self.cycles-pp.get_next_timer_interrupt 0.00 +0.2 0.22 ± 13% perf-profile.self.cycles-pp.rcu_idle_exit 0.00 +0.2 0.22 ± 25% perf-profile.self.cycles-pp.__orc_find 0.00 +0.2 0.22 ± 21% perf-profile.self.cycles-pp.update_rq_clock 0.00 +0.2 0.22 ± 28% perf-profile.self.cycles-pp.menu_reflect 0.00 +0.2 0.23 ± 27% perf-profile.self.cycles-pp.__rwsem_mark_wake 0.00 +0.2 0.23 ± 21% perf-profile.self.cycles-pp.nr_iowait_cpu 0.00 +0.2 0.24 ± 13% perf-profile.self.cycles-pp.account_entity_dequeue 0.00 +0.2 0.24 ± 3% perf-profile.self.cycles-pp.tick_nohz_next_event 0.00 +0.2 0.24 ± 10% perf-profile.self.cycles-pp.call_cpuidle 0.25 ± 5% +0.2 0.49 ± 9% perf-profile.self.cycles-pp.perf_event_mmap 0.00 +0.2 0.25 ± 5% perf-profile.self.cycles-pp.rb_erase_cached 0.00 +0.2 0.25 ± 16% perf-profile.self.cycles-pp.pick_next_entity 0.38 ± 9% +0.2 0.63 ± 7% perf-profile.self.cycles-pp.__x64_sys_brk 0.00 +0.2 0.25 ± 7% perf-profile.self.cycles-pp.put_prev_entity 0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.activate_task 0.00 +0.3 0.28 ± 8% perf-profile.self.cycles-pp.get_iowait_load 0.24 ± 7% +0.3 0.52 ± 13% perf-profile.self.cycles-pp.__do_munmap 0.00 +0.3 0.28 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state 0.00 +0.3 0.29 ± 14% perf-profile.self.cycles-pp.account_entity_enqueue 0.00 +0.3 0.29 ± 7% perf-profile.self.cycles-pp.ktime_get 0.00 +0.3 0.33 ± 12% perf-profile.self.cycles-pp.check_preempt_curr 0.00 +0.3 0.33 ± 7% perf-profile.self.cycles-pp.available_idle_cpu 0.00 +0.3 0.33 ± 8% perf-profile.self.cycles-pp.__account_scheduler_latency 0.00 +0.3 0.35 ± 4% perf-profile.self.cycles-pp.__calc_delta 0.37 ± 5% +0.4 0.73 ± 6% perf-profile.self.cycles-pp.unmap_page_range 0.01 ±173% +0.4 0.45 ± 3% perf-profile.self.cycles-pp.wake_up_q 0.00 +0.4 0.44 ± 15% perf-profile.self.cycles-pp.dequeue_task_fair 0.12 ± 13% +0.4 0.56 ± 12% perf-profile.self.cycles-pp.__indirect_thunk_start 0.00 +0.5 0.46 ± 32% perf-profile.self.cycles-pp.resched_curr 0.00 +0.5 0.48 ± 10% perf-profile.self.cycles-pp.___perf_sw_event 0.01 ±173% +0.5 0.51 ± 14% perf-profile.self.cycles-pp.read_tsc 0.06 ± 62% +0.5 0.58 ± 12% perf-profile.self.cycles-pp.wake_q_add 0.44 ± 26% +0.6 0.99 ± 24% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.02 ±173% +0.6 0.58 ± 13% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.01 ±173% +0.6 0.59 ± 17% perf-profile.self.cycles-pp.update_curr 0.00 +0.6 0.59 ± 17% perf-profile.self.cycles-pp.dequeue_entity 0.04 ±106% +0.6 0.66 ± 6% perf-profile.self.cycles-pp.native_write_msr 0.00 +0.6 0.62 ± 13% perf-profile.self.cycles-pp.reweight_entity 0.00 +0.6 0.65 ± 13% perf-profile.self.cycles-pp.__next_timer_interrupt 0.23 ± 11% +0.7 0.89 ± 13% perf-profile.self.cycles-pp._raw_spin_lock 0.00 +0.7 0.66 ± 10% perf-profile.self.cycles-pp.enqueue_task_fair 0.01 ±173% +0.7 0.69 ± 4% perf-profile.self.cycles-pp.finish_task_switch 0.00 +0.7 0.69 ± 8% perf-profile.self.cycles-pp.__update_load_avg_se 0.02 ±173% +0.8 0.80 ± 2% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.01 ±173% +0.8 0.80 ± 5% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.8 0.78 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.8 0.80 ± 11% perf-profile.self.cycles-pp.unwind_next_frame 0.00 +0.8 0.83 ± 9% perf-profile.self.cycles-pp.find_next_bit 0.07 ± 17% +0.9 0.97 ± 9% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.01 ±173% +0.9 0.96 ± 7% perf-profile.self.cycles-pp.update_cfs_group 0.03 ±105% +1.0 0.98 ± 8% perf-profile.self.cycles-pp.set_next_entity 0.02 ±173% +1.0 1.01 ± 7% perf-profile.self.cycles-pp.pick_next_task_fair 0.03 ±105% +1.0 1.04 ± 8% perf-profile.self.cycles-pp.__switch_to_asm 0.04 ±103% +1.1 1.10 ± 9% perf-profile.self.cycles-pp.update_load_avg 0.01 ±173% +1.2 1.18 ± 7% perf-profile.self.cycles-pp.do_idle 0.01 ±173% +1.2 1.18 ± 5% perf-profile.self.cycles-pp.__switch_to 0.04 ±107% +1.2 1.28 ± 7% perf-profile.self.cycles-pp.enqueue_entity 0.01 ±173% +1.3 1.31 ± 14% perf-profile.self.cycles-pp.native_sched_clock 0.07 ± 28% +1.5 1.60 ± 6% perf-profile.self.cycles-pp.try_to_wake_up 0.08 ± 33% +1.7 1.81 ± 9% perf-profile.self.cycles-pp.menu_select 0.10 ± 43% +2.2 2.32 ± 9% perf-profile.self.cycles-pp.__sched_text_start 0.22 ± 44% +3.8 4.05 ± 6% perf-profile.self.cycles-pp.poll_idle 0.88 ± 20% +29.7 30.58 ± 5% perf-profile.self.cycles-pp.intel_idle will-it-scale.per_thread_ops 220000 +-+----------------------------------------------------------------+ |. + + + +. + + +. :+ + .+. + + | 200000 +-+ +. + + .+ : + +. + + +. .+. + + .+ + + + | 180000 +-+ + + + .+. : + + +. .+ + + + +| | + + + + | 160000 +-+ | | | 140000 +-+ | | | 120000 +-+ | 100000 +-O | | | 80000 O-+ O O O O | | O O O O O O O O O O O O O O O O O O O | 60000 +-+----------------------------------------------------------------+ will-it-scale.workload 1.8e+06 +-+---------------------------------------------------------------+ | .+ + .+ .+ + .+. .+. | 1.6e+06 +-+ + + + .+ +.+ + .+.+ + .+. + :.+ + + + | | +.+ + + +. + +.+ +.+ +. .+ + + + +| 1.4e+06 +-+ + + + + | | | 1.2e+06 +-+ | | | 1e+06 +-+ | | | 800000 +-O | O O O | 600000 +-+ O O O O OO O O O O O O O O O O O O O | | O O | 400000 +-+---------------------------------------------------------------+ will-it-scale.time.user_time 60 +-+--------------------------------------------------------------------+ | | 55 +-+.+ .+ .+ + .+.. .+. | 50 +-+ + .+.. .+ +.+ + .+..+ + .+. : + .+ + + + | | +.+ + + .+. + +.+ +.+ +. : + + + +| 45 +-+ + + +.+ + | | | 40 +-+ | | | 35 +-+ | 30 +-O | O O O O O O O O | 25 +-+ O O O O O O O O O O O O | | O O O O | 20 +-+--------------------------------------------------------------------+ will-it-scale.time.system_time 2400 +-+------------------------------------------------------------------+ 2200 +-+.+.+.+.+. .+.+.+.+.+.+..+.+.+.+.+.+. .+. | | +.+.+.+.+ +.+ +.+.+.+.+.+.+.+.| 2000 +-+ | 1800 +-+ | | | 1600 +-+ | 1400 +-+ | 1200 +-+ | | | 1000 +-+ | 800 +-+ | | | 600 O-O O O O O O O O O O O O O O O O O O O O O O | 400 +-+---------------------------O----O---------------------------------+ will-it-scale.time.percent_of_cpu_this_job_got 800 +-+-------------------------------------------------------------------+ |.+.+.+.+.+.+.+. .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+..+.+.+.+. .+.+.+.| 700 +-+ +. + | | | 600 +-+ | | | 500 +-+ | | | 400 +-+ | | | 300 +-+ | | | 200 O-O O O O O O | | O O O O O O O O O O O O O O O O O O | 100 +-+-------------------------------------------------------------------+ will-it-scale.time.voluntary_context_switches 1.6e+08 +-+---------------------------------------------------------------+ | O O O O O | 1.4e+08 +-O O O O O O O | 1.2e+08 O-+ O O OO O O O O | | O O O O | 1e+08 +-+ | | | 8e+07 +-+ | | | 6e+07 +-+ | 4e+07 +-+ + .| | .+. + :.+. .+.+.+.++.+.+.+.+.+.+.+ | 2e+07 +-+. .+.+.+ + + +.+. .+.+.+.+. .+.+.+ | | + + + | 0 +-+---------------------------------------------------------------+ will-it-scale.time.involuntary_context_switches 200000 +-+----------------------------------------------------------------+ 180000 +-+ + .+ : + + .+ + + .+ | | + : : + + : | 160000 +-+ : : : + + | 140000 +-+ + + +.: +.+. + + .+ + + | | + + : : + +.+ +.+.+ : + + | 120000 +-+ + : : : + :| 100000 +-+ + + :| 80000 +-+ | | | 60000 +-+ | 40000 +-+ | | | 20000 +-+ | 0 O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-OO-O-O-O-O-O-O-------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 11 months

7
9
0 / 0

[drm/bochs] 7a0483ac4f: BUG:unable_to_handle_kernel

by kernel test robot

FYI, we noticed the following commit (built with gcc-6): commit: 7a0483ac4ffca4998945c159b28afdde8353cc84 ("drm/bochs: switch to generic drm fbdev emulation") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: trinity with following parameters: runtime: 300s test-description: Trinity is a linux system call fuzz tester. test-url: http://codemonkey.org.uk/projects/trinity/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 768M caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------+------------+------------+ | | 132a45340a | 7a0483ac4f | +-----------------------------------------------------+------------+------------+ | boot_successes | 48 | 6 | | boot_failures | 0 | 44 | | BUG:unable_to_handle_kernel | 0 | 44 | | Oops:#[##] | 0 | 44 | | RIP:restore_fbdev_mode | 0 | 44 | | WARNING:at_kernel/locking/lockdep.c:#lock_downgrade | 0 | 14 | | RIP:lock_downgrade | 0 | 14 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 44 | +-----------------------------------------------------+------------+------------+ [ 9.996031] BUG: unable to handle kernel NULL pointer dereference at 0000000000000020 [ 9.996169] ------------[ cut here ]------------ [ 9.996991] #PF error: [normal kernel read fault] [ 9.997548] downgrading a read lock [ 9.997571] WARNING: CPU: 0 PID: 479 at kernel/locking/lockdep.c:3553 lock_downgrade+0xd1/0x190 [ 9.998095] PGD 800000001c3f1067 P4D 800000001c3f1067 PUD 1c148067 PMD 0 [ 9.998516] Modules linked in: [ 9.999778] Oops: 0000 [#1] PREEMPT SMP PTI [ 10.000594] CPU: 0 PID: 479 Comm: mkdir Not tainted 5.0.0-rc1-00140-g7a0483a #1 [ 10.000967] CPU: 1 PID: 239 Comm: plymouthd Not tainted 5.0.0-rc1-00140-g7a0483a #1 [ 10.001478] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 10.002351] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 10.003269] RIP: 0010:lock_downgrade+0xd1/0x190 [ 10.004274] RIP: 0010:restore_fbdev_mode+0x1b/0x1e0 [ 10.005272] Code: 8b 54 24 0c 89 93 28 0b 00 00 48 8b 08 48 89 8b 20 0b 00 00 f6 40 32 03 74 1a 48 c7 c7 10 56 53 82 48 89 04 24 e8 8f 60 fa ff <0f> 0b 8b 54 24 0c 48 8b 04 24 0f b6 48 32 4c 89 60 08 44 89 ee 48 [ 10.005824] Code: 41 5c 41 5d 41 5e 41 5f c3 66 0f 1f 44 00 00 41 57 41 56 41 55 41 54 49 89 fc 55 53 48 83 ec 08 e8 2a f8 ba ff 4d 8b 6c 24 40 <49> 8b 55 20 41 8b 45 50 25 00 00 01 00 85 82 78 01 00 00 0f 85 47 [ 10.006415] RSP: 0018:ffffc9000066fe28 EFLAGS: 00010096 [ 10.008634] RSP: 0018:ffffc9000045bdb0 EFLAGS: 00010293 [ 10.010881] RAX: 0000000000000017 RBX: ffff88802cabc000 RCX: 0000000000000001 [ 10.011513] RAX: 0000000000000000 RBX: ffff88801c1e6d40 RCX: 0000000000000000 [ 10.012142] RDX: ffff88802cabc000 RSI: ffffffff81132f29 RDI: 00000000ffffffff [ 10.012999] RDX: ffff88802f834000 RSI: ffffffff815d0886 RDI: ffff88801c1e6d40 [ 10.013855] RBP: ffff88802d830128 R08: 00000002c324869d R09: ffffc9000066fdb8 [ 10.014712] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000001 [ 10.015571] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff811f1db8 [ 10.016430] R10: ffffc9000045bdf0 R11: 0000000000000001 R12: ffff88801c1e6d40 [ 10.017283] R13: 0000000000000003 R14: 0000000000000246 R15: 00007fa7532b9000 [ 10.018145] R13: 0000000000000000 R14: ffff88801c255278 R15: ffffffff815d2680 [ 10.019010] FS: 00007fa7532b47c0(0000) GS:ffff888029600000(0000) knlGS:0000000000000000 [ 10.019885] FS: 00007f8ba8290700(0000) GS:ffff888029a00000(0000) knlGS:0000000000000000 [ 10.020747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 10.021715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 10.022684] CR2: 00007fa7532b8000 CR3: 000000002d86a000 CR4: 00000000000406f0 [ 10.023390] CR2: 0000000000000020 CR3: 000000001c16e000 CR4: 00000000000406e0 [ 10.024078] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 10.024927] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 10.025781] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 10.026632] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 10.027485] Call Trace: [ 10.028342] Call Trace: [ 10.029195] downgrade_write+0x12/0x80 [ 10.029501] ? drm_fb_helper_lastclose+0x20/0x20 [ 10.029820] __do_munmap+0x3d8/0x5c0 [ 10.030273] drm_fb_helper_restore_fbdev_mode_unlocked+0x4a/0xa0 [ 10.030835] __vm_munmap+0x67/0xc0 [ 10.031268] drm_fbdev_client_restore+0x11/0x20 [ 10.031969] __x64_sys_munmap+0x1b/0x20 [ 10.032390] drm_client_dev_restore+0xa8/0xe0 [ 10.032936] do_syscall_64+0xb5/0x200 [ 10.033405] drm_release+0xc0/0x120 [ 10.033933] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 10.034381] ? drm_lastclose+0x100/0x100 [ 10.034806] RIP: 0033:0x7fa752bab897 [ 10.035422] __fput+0x15c/0x250 [ 10.035904] Code: f0 ff ff 73 01 c3 48 8b 0d a6 75 2c 00 31 d2 48 29 c2 64 89 11 48 83 c8 ff eb ea 90 90 90 90 90 90 90 90 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 79 75 2c 00 31 d2 48 29 c2 64 [ 10.036344] task_work_run+0x9d/0xd0 [ 10.036726] RSP: 002b:00007ffc66b50a38 EFLAGS: 00000206 ORIG_RAX: 000000000000000b [ 10.038945] exit_to_usermode_loop+0x7a/0xc0 [ 10.039383] RAX: ffffffffffffffda RBX: 000000000060c010 RCX: 00007fa752bab897 [ 10.040280] do_syscall_64+0x1c9/0x200 [ 10.040804] RDX: 0000000000000000 RSI: 0000000000001000 RDI: 00007fa7532b8000 [ 10.041662] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 10.042113] RBP: 0000000000000000 R08: 0000000000000010 R09: 00000000ffffffff [ 10.042964] RIP: 0033:0x7f8ba7973040 [ 10.043574] R10: 00007ffc66b50840 R11: 0000000000000206 R12: 0000000000000000 [ 10.044426] Code: 40 75 0b 31 c0 48 83 c4 08 e9 0c ff ff ff 48 8d 3d c5 99 09 00 e8 a0 3f 02 00 83 3d 9d 71 2d 00 00 75 10 b8 03 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 9e b1 01 00 48 89 04 24 [ 10.044860] R13: 00007ffc66b50bb8 R14: 00007fa753096d00 R15: 0000000000000000 [ 10.045722] RSP: 002b:00007ffe098cf568 EFLAGS: 00000246 ORIG_RAX: 0000000000000003 [ 10.047994] ---[ end trace 2efaa9fea56af290 ]--- To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

2 years, 11 months

1
0
0 / 0

Test monitoring on custom github repo

by Thomas Garnier

Hi, I am working on KASLR (PIE for x86_64). I previously used Kees (CCed) branches for lkp bot testing but someone told be I could ask you to add a custom github path to monitor all branches on it. I pushed my changes to: https://github.com/thgarnie/linux (kasrl_pie_v2 right now) Can you add it? Anything I need to do? Thanks, -- Thomas

2 years, 12 months

3
4
0 / 0

[/proc/stat] 3047027b34: reaim.jobs_per_min -4.8% regression

by kernel test robot

Greeting, FYI, we noticed a -4.8% regression of reaim.jobs_per_min due to commit: commit: 3047027b34b8c6404b509903058b89836093acc7 ("[PATCH 2/2] /proc/stat: Add sysctl parameter to control irq counts latency") url: https://github.com/0day-ci/linux/commits/Waiman-Long/proc-stat-Reduce-irq... in testcase: reaim on test machine: 56 threads Intel(R) Xeon(R) CPU E5-2695 v3 @ 2.30GHz with 256G memory with following parameters: runtime: 300s nr_task: 5000 test: shared_memory cpufreq_governor: performance ucode: 0x3d test-description: REAIM is an updated and improved version of AIM 7 benchmark. test-url: https://sourceforge.net/projects/re-aim-7/ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.2/5000/debian-x86_64-2018-04-03.cgz/300s/lkp-hsw-ep5/shared_memory/reaim/0x3d commit: 51e8bce392 ("/proc/stat: Extract irqs counting code into show_stat_irqs()") 3047027b34 ("/proc/stat: Add sysctl parameter to control irq counts latency") 51e8bce392dd2cc9 3047027b34b8c6404b50990305 ---------------- -------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 kmsg.igb#:#:#:exceed_max#second %stddev %change %stddev \ | \ 101.96 +7.5% 109.60 reaim.child_systime 33.32 -1.8% 32.73 reaim.child_utime 5534451 -4.8% 5271308 reaim.jobs_per_min 1106 -4.8% 1054 reaim.jobs_per_min_child 5800927 -4.9% 5517884 reaim.max_jobs_per_min 5.42 +5.0% 5.69 reaim.parent_time 1.51 +5.3% 1.59 reaim.std_dev_time 29374932 -2.8% 28558608 reaim.time.minor_page_faults 1681 +1.6% 1708 reaim.time.percent_of_cpu_this_job_got 3841 +4.5% 4012 reaim.time.system_time 1234 -4.4% 1180 reaim.time.user_time 18500000 -2.7% 18000000 reaim.workload 5495296 ± 9% -9.5% 4970496 meminfo.DirectMap2M 5142 ± 18% -43.2% 2920 ± 46% numa-vmstat.node0.nr_shmem 29.00 ± 32% +56.9% 45.50 ± 10% vmstat.procs.r 67175 ± 37% +66.6% 111910 ± 20% numa-meminfo.node0.AnonHugePages 20591 ± 18% -43.2% 11691 ± 46% numa-meminfo.node0.Shmem 64688 ± 6% -36.8% 40906 ± 19% slabinfo.kmalloc-8.active_objs 64691 ± 6% -36.8% 40908 ± 19% slabinfo.kmalloc-8.num_objs 37.36 ± 7% +11.1% 41.53 ± 4% boot-time.boot 29.15 ± 6% +14.3% 33.31 ± 3% boot-time.dhcp 847.73 ± 9% +12.9% 957.09 ± 4% boot-time.idle 202.50 ±100% +101.7% 408.50 proc-vmstat.nr_mlock 8018 ± 9% -12.3% 7034 ± 2% proc-vmstat.nr_shmem 29175944 -2.8% 28369676 proc-vmstat.numa_hit 29170351 -2.8% 28364111 proc-vmstat.numa_local 5439 ± 5% -18.7% 4423 ± 7% proc-vmstat.pgactivate 30220220 -2.8% 29374906 proc-vmstat.pgalloc_normal 30182224 -2.7% 29368266 proc-vmstat.pgfault 30186671 -2.8% 29341792 proc-vmstat.pgfree 69510 ± 12% -34.2% 45759 ± 33% sched_debug.cfs_rq:/.load.avg 30.21 ± 24% -33.6% 20.05 ± 20% sched_debug.cfs_rq:/.runnable_load_avg.avg 66447 ± 12% -37.6% 41460 ± 37% sched_debug.cfs_rq:/.runnable_weight.avg 12.35 ± 4% +88.0% 23.22 ± 15% sched_debug.cpu.clock.stddev 12.35 ± 4% +88.0% 23.22 ± 15% sched_debug.cpu.clock_task.stddev 30.06 ± 12% -26.5% 22.10 ± 13% sched_debug.cpu.cpu_load[0].avg 29.37 ± 9% -22.6% 22.72 ± 13% sched_debug.cpu.cpu_load[1].avg 28.71 ± 6% -21.1% 22.66 ± 16% sched_debug.cpu.cpu_load[2].avg 17985 -12.0% 15823 ± 2% sched_debug.cpu.curr->pid.max 67478 ± 6% -32.5% 45531 ± 24% sched_debug.cpu.load.avg 10369 ± 49% -100.0% 0.00 sched_debug.cpu.load.min 0.21 ± 34% -100.0% 0.00 sched_debug.cpu.nr_running.min 12.98 -16.3% 10.86 ± 11% perf-stat.i.MPKI 5.712e+09 -3.8% 5.492e+09 perf-stat.i.branch-instructions 1.024e+08 -3.7% 98557208 perf-stat.i.branch-misses 8.17 +0.4 8.58 ± 2% perf-stat.i.cache-miss-rate% 7839589 +10.5% 8659798 perf-stat.i.cache-misses 86324420 +3.8% 89595898 ± 2% perf-stat.i.cache-references 1.55 ± 2% -4.0% 1.49 perf-stat.i.cpi 2290 -1.9% 2246 perf-stat.i.cpu-migrations 4667 -10.9% 4160 perf-stat.i.cycles-between-cache-misses 8.749e+09 -3.9% 8.409e+09 perf-stat.i.dTLB-loads 527660 ± 3% -15.0% 448539 ± 5% perf-stat.i.dTLB-store-misses 5.747e+09 -4.3% 5.499e+09 perf-stat.i.dTLB-stores 53047071 -3.5% 51190942 perf-stat.i.iTLB-load-misses 20576112 -13.7% 17759009 ± 2% perf-stat.i.iTLB-loads 3.207e+10 -3.9% 3.083e+10 perf-stat.i.instructions 0.77 -2.3% 0.75 perf-stat.i.ipc 99933 -3.8% 96127 perf-stat.i.minor-faults 4325719 +5.6% 4568226 perf-stat.i.node-load-misses 52.39 -2.0 50.36 perf-stat.i.node-store-miss-rate% 1411700 +20.9% 1706321 perf-stat.i.node-store-misses 883790 +34.1% 1184836 perf-stat.i.node-stores 99933 -3.8% 96127 perf-stat.i.page-faults 2.69 +7.9% 2.91 perf-stat.overall.MPKI 9.08 +0.6 9.67 ± 2% perf-stat.overall.cache-miss-rate% 1.13 +5.0% 1.19 perf-stat.overall.cpi 4633 -8.6% 4233 perf-stat.overall.cycles-between-cache-misses 0.01 ± 2% -0.0 0.01 ± 4% perf-stat.overall.dTLB-store-miss-rate% 72.05 +2.2 74.24 perf-stat.overall.iTLB-load-miss-rate% 0.88 -4.8% 0.84 perf-stat.overall.ipc 78.12 +1.4 79.52 perf-stat.overall.node-load-miss-rate% 61.49 -2.5 59.01 perf-stat.overall.node-store-miss-rate% 5.688e+09 -3.8% 5.471e+09 perf-stat.ps.branch-instructions 1.02e+08 -3.7% 98177745 perf-stat.ps.branch-misses 7807912 +10.5% 8626353 perf-stat.ps.cache-misses 85999504 +3.8% 89266688 ± 2% perf-stat.ps.cache-references 2282 -1.9% 2239 perf-stat.ps.cpu-migrations 8.713e+09 -3.9% 8.376e+09 perf-stat.ps.dTLB-loads 525761 ± 3% -15.0% 446967 ± 5% perf-stat.ps.dTLB-store-misses 5.723e+09 -4.3% 5.478e+09 perf-stat.ps.dTLB-stores 52823322 -3.5% 50990190 perf-stat.ps.iTLB-load-misses 20490261 -13.7% 17689923 ± 2% perf-stat.ps.iTLB-loads 3.193e+10 -3.8% 3.071e+10 perf-stat.ps.instructions 99560 -3.8% 95786 perf-stat.ps.minor-faults 4308031 +5.6% 4550453 perf-stat.ps.node-load-misses 1405805 +20.9% 1699670 perf-stat.ps.node-store-misses 880319 +34.1% 1180378 perf-stat.ps.node-stores 99560 -3.8% 95786 perf-stat.ps.page-faults 9.664e+12 -2.8% 9.397e+12 perf-stat.total.instructions 33.09 ± 7% -25.0 8.10 ± 45% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 32.21 ± 7% -24.3 7.92 ± 45% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 22.36 ± 7% -17.1 5.24 ± 49% perf-profile.calltrace.cycles-pp.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 10.57 ± 5% -8.3 2.31 ± 48% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 9.60 ± 4% -7.6 2.03 ± 49% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 3.68 ± 8% -3.3 0.43 ±102% perf-profile.calltrace.cycles-pp.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.37 ± 9% -2.8 1.60 ± 50% perf-profile.calltrace.cycles-pp.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.30 ± 2% -1.9 0.44 ±102% perf-profile.calltrace.cycles-pp.security_sem_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.10 ± 3% -1.6 3.46 ± 10% perf-profile.calltrace.cycles-pp.ipc_has_perm.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.20 -1.3 1.95 ± 23% perf-profile.calltrace.cycles-pp.avc_has_perm.ipc_has_perm.security_ipc_permission.do_semtimedop.do_syscall_64 2.12 ± 3% -0.4 1.76 ± 4% perf-profile.calltrace.cycles-pp.avc_has_perm.ipc_has_perm.security_sem_semop.do_semtimedop.do_syscall_64 1.03 ± 2% -0.1 0.94 ± 3% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault 1.06 ± 2% -0.1 0.97 ± 3% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault 1.06 ± 2% -0.1 0.98 ± 3% perf-profile.calltrace.cycles-pp.page_fault 0.91 ± 3% -0.1 0.82 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 0.86 ± 3% -0.1 0.78 ± 3% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 0.61 ± 12% +0.2 0.79 ± 12% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry 0.61 ± 10% +0.2 0.79 ± 10% perf-profile.calltrace.cycles-pp.shm_close.remove_vma.__do_munmap.ksys_shmdt.do_syscall_64 0.67 ± 11% +0.2 0.86 ± 10% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary 0.40 ± 57% +0.2 0.62 ± 8% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.do_shmat.__x64_sys_shmat.do_syscall_64 0.40 ± 57% +0.2 0.62 ± 7% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.do_shmat.__x64_sys_shmat 0.43 ± 57% +0.2 0.66 ± 7% perf-profile.calltrace.cycles-pp.down_write.do_shmat.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.41 ± 57% +0.3 0.67 ± 9% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.shm_close.remove_vma.__do_munmap 0.40 ± 57% +0.3 0.66 ± 7% perf-profile.calltrace.cycles-pp.down_write.ipcget.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.41 ± 57% +0.3 0.67 ± 9% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.shm_close.remove_vma 0.44 ± 57% +0.3 0.71 ± 9% perf-profile.calltrace.cycles-pp.down_write.shm_close.remove_vma.__do_munmap.ksys_shmdt 0.26 ±100% +0.4 0.67 ± 8% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 0.28 ±100% +0.4 0.71 ± 7% perf-profile.calltrace.cycles-pp.__might_fault._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.58 ± 10% +0.4 1.03 ± 6% perf-profile.calltrace.cycles-pp.shmctl_down.ksys_shmctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl 0.59 ± 10% +0.5 1.05 ± 6% perf-profile.calltrace.cycles-pp.ksys_shmctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl 0.13 ±173% +0.5 0.62 ± 7% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.ipcget.__x64_sys_shmget.do_syscall_64 0.13 ±173% +0.5 0.62 ± 7% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.ipcget.__x64_sys_shmget 0.12 ±173% +0.5 0.66 ± 8% perf-profile.calltrace.cycles-pp.dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop 0.00 +0.6 0.58 ± 7% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.60 ± 7% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.61 ± 7% perf-profile.calltrace.cycles-pp.wait_consider_task.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64 0.00 +0.6 0.62 ± 4% perf-profile.calltrace.cycles-pp.semctl_down.ksys_semctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl 0.75 ± 8% +0.6 1.38 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_semop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 0.00 +0.6 0.65 ± 9% perf-profile.calltrace.cycles-pp.ipcperms.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 0.00 +0.6 0.65 ± 8% perf-profile.calltrace.cycles-pp.__dentry_kill.dentry_kill.dput.__fput.task_work_run 0.89 ± 11% +0.7 1.57 ± 8% perf-profile.calltrace.cycles-pp.do_shmat.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat 0.90 ± 11% +0.7 1.58 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat 0.90 ± 10% +0.7 1.58 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat 0.00 +0.7 0.68 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait 0.90 ± 11% +0.7 1.59 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmat 0.00 +0.7 0.69 ± 5% perf-profile.calltrace.cycles-pp.wait 0.27 ±100% +0.7 0.99 ± 7% perf-profile.calltrace.cycles-pp.perform_atomic_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 0.95 ± 11% +0.7 1.67 ± 8% perf-profile.calltrace.cycles-pp.shmat 0.00 +0.7 0.73 ± 6% perf-profile.calltrace.cycles-pp.ipcget.ksys_semget.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget 0.00 +0.7 0.74 ± 8% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl 0.72 ± 9% +0.7 1.46 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 0.00 +0.8 0.75 ± 5% perf-profile.calltrace.cycles-pp.ksys_semget.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget 0.00 +0.8 0.76 ± 8% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl 0.89 ± 9% +0.8 1.65 ± 9% perf-profile.calltrace.cycles-pp.__do_munmap.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt 0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget 0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semget 0.90 ± 9% +0.8 1.68 ± 9% perf-profile.calltrace.cycles-pp.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt 0.00 +0.8 0.78 ± 6% perf-profile.calltrace.cycles-pp.ksys_semctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl 0.00 +0.8 0.80 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semctl 0.00 +0.8 0.80 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl 0.00 +0.8 0.85 ± 5% perf-profile.calltrace.cycles-pp.semget 0.97 ± 9% +0.8 1.82 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl 0.97 ± 9% +0.8 1.82 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmctl 0.94 ± 10% +0.9 1.79 ± 6% perf-profile.calltrace.cycles-pp._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 1.04 ± 9% +0.9 1.91 ± 6% perf-profile.calltrace.cycles-pp.ipcget.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget 1.05 ± 9% +0.9 1.92 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget 1.05 ± 9% +0.9 1.93 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmget 1.05 ± 9% +0.9 1.93 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget 1.02 ± 9% +0.9 1.92 ± 7% perf-profile.calltrace.cycles-pp.shmctl 1.00 ± 9% +0.9 1.93 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt 1.00 ± 8% +0.9 1.94 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmdt 1.13 ± 8% +0.9 2.08 ± 6% perf-profile.calltrace.cycles-pp.shmget 0.00 +1.0 0.97 ± 5% perf-profile.calltrace.cycles-pp.semctl 1.03 ± 9% +1.0 1.99 ± 5% perf-profile.calltrace.cycles-pp.do_smart_update.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 1.04 ± 8% +1.0 2.03 ± 9% perf-profile.calltrace.cycles-pp.shmdt 2.61 ± 9% +1.3 3.89 ± 14% perf-profile.calltrace.cycles-pp.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 1.65 ± 13% +2.0 3.65 ± 7% perf-profile.calltrace.cycles-pp.security_sem_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 1.61 ± 6% +5.3 6.89 ± 2% perf-profile.calltrace.cycles-pp.idr_find.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.45 ± 9% +6.2 12.63 ± 6% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.semop 2.92 ± 5% +8.0 10.88 ± 7% perf-profile.calltrace.cycles-pp.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 9.07 ± 8% +8.8 17.85 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.semop 15.56 ± 8% +18.8 34.38 ± 6% perf-profile.calltrace.cycles-pp.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 17.40 ± 8% +20.4 37.82 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop 17.99 ± 8% +21.0 39.00 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semop 33.85 ± 8% +36.1 69.98 ± 6% perf-profile.calltrace.cycles-pp.semop reaim.time.percent_of_cpu_this_job_got 1800 +-+------------------------------------------------------------------+ | O | 1780 +-OO O O O | 1760 O-+ O O OO | | | 1740 +-+ | | | 1720 +-+ O .+. | | O O + + | 1700 +-+ O .+ : | 1680 +-+ .+ .+. .+ .+.+ .+ : +. .+.++.| |.++.+.++ : .++ ++.+ + +.+.++.++ +.+.++.+.+ ++ | 1660 +-+ : + | | + | 1640 +-+------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

3 years

3
2
0 / 0

[PM] 8234f6734c: will-it-scale.per_process_ops -3.6% regression

by kernel test robot

Greeting, FYI, we noticed a -3.6% regression of will-it-scale.per_process_ops due to commit: commit: 8234f6734c5d74ac794e5517437f51c57d65f865 ("PM-runtime: Switch autosuspend over to using hrtimers") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: will-it-scale on test machine: 104 threads Skylake with 192G memory with following parameters: nr_task: 100% mode: process test: poll2 cpufreq_governor: performance test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two. test-url: https://github.com/antonblanchard/will-it-scale Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase: gcc-7/performance/x86_64-rhel-7.2/process/100%/debian-x86_64-2018-04-03.cgz/lkp-skl-fpga01/poll2/will-it-scale commit: v4.20-rc7 8234f6734c ("PM-runtime: Switch autosuspend over to using hrtimers") v4.20-rc7 8234f6734c5d74ac794e551743 ---------------- -------------------------- fail:runs %reproduction fail:runs | | | :2 50% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 240408 -3.6% 231711 will-it-scale.per_process_ops 25002520 -3.6% 24097991 will-it-scale.workload 351914 -1.7% 345882 interrupts.CAL:Function_call_interrupts 1.77 ± 45% -1.1 0.64 mpstat.cpu.idle% 106164 ± 24% -23.2% 81494 ± 28% numa-meminfo.node0.AnonHugePages 326430 ± 8% -11.3% 289513 softirqs.SCHED 1294 -2.0% 1268 vmstat.system.cs 3178 +48.4% 4716 ± 16% slabinfo.eventpoll_pwq.active_objs 3178 +48.4% 4716 ± 16% slabinfo.eventpoll_pwq.num_objs 336.32 -100.0% 0.00 uptime.boot 3192 -100.0% 0.00 uptime.idle 3.456e+08 ± 76% -89.9% 34913819 ± 62% cpuidle.C1E.time 747832 ± 72% -87.5% 93171 ± 45% cpuidle.C1E.usage 16209 ± 26% -38.2% 10021 ± 44% cpuidle.POLL.time 6352 ± 32% -39.5% 3843 ± 48% cpuidle.POLL.usage 885259 ± 2% -13.8% 763434 ± 7% numa-vmstat.node0.numa_hit 865117 ± 2% -13.9% 744992 ± 7% numa-vmstat.node0.numa_local 405085 ± 7% +38.0% 558905 ± 9% numa-vmstat.node1.numa_hit 254056 ± 11% +59.7% 405824 ± 13% numa-vmstat.node1.numa_local 738158 ± 73% -88.5% 85078 ± 47% turbostat.C1E 1.07 ± 76% -1.0 0.11 ± 62% turbostat.C1E% 1.58 ± 49% -65.4% 0.55 ± 6% turbostat.CPU%c1 0.15 ± 13% -35.0% 0.10 ± 38% turbostat.CPU%c6 153.97 ± 16% -54.7 99.31 turbostat.PKG_% 64141 +1.5% 65072 proc-vmstat.nr_anon_pages 19541 -7.0% 18178 ± 8% proc-vmstat.nr_shmem 18296 +1.1% 18506 proc-vmstat.nr_slab_reclaimable 713938 -2.3% 697489 proc-vmstat.numa_hit 693688 -2.4% 677228 proc-vmstat.numa_local 772220 -1.9% 757334 proc-vmstat.pgalloc_normal 798565 -1.8% 784042 proc-vmstat.pgfault 732336 -2.7% 712661 proc-vmstat.pgfree 20.33 ± 4% -7.0% 18.92 sched_debug.cfs_rq:/.runnable_load_avg.max 160603 -44.5% 89108 ± 38% sched_debug.cfs_rq:/.spread0.avg 250694 -29.3% 177358 ± 18% sched_debug.cfs_rq:/.spread0.max 1109 ± 4% -7.0% 1031 sched_debug.cfs_rq:/.util_avg.max 20.33 ± 4% -7.2% 18.88 sched_debug.cpu.cpu_load[0].max -10.00 +35.0% -13.50 sched_debug.cpu.nr_uninterruptible.min 3.56 ± 10% +44.2% 5.14 ± 18% sched_debug.cpu.nr_uninterruptible.stddev 87.10 ± 24% -34.0% 57.44 ± 37% sched_debug.cpu.sched_goidle.avg 239.48 -25.6% 178.07 ± 18% sched_debug.cpu.sched_goidle.stddev 332.67 ± 7% -25.5% 247.83 ± 13% sched_debug.cpu.ttwu_count.min 231.67 ± 8% -15.4% 195.96 ± 12% sched_debug.cpu.ttwu_local.min 95.47 -95.5 0.00 perf-profile.calltrace.cycles-pp.poll 90.26 -90.3 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.poll 90.08 -90.1 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll 89.84 -89.8 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll 88.04 -88.0 0.00 perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll 2.66 -0.1 2.54 perf-profile.calltrace.cycles-pp._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.90 -0.1 1.81 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64 2.56 +0.1 2.64 perf-profile.calltrace.cycles-pp.__fdget.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +2.3 2.29 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret 0.00 +2.3 2.34 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 17.45 +3.8 21.24 perf-profile.calltrace.cycles-pp.__fget_light.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +92.7 92.66 perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +94.5 94.51 perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +94.8 94.75 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +94.9 94.92 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 96.03 -96.0 0.00 perf-profile.children.cycles-pp.poll 90.29 -90.3 0.00 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 90.11 -90.1 0.00 perf-profile.children.cycles-pp.do_syscall_64 89.87 -89.9 0.00 perf-profile.children.cycles-pp.__x64_sys_poll 89.39 -89.4 0.00 perf-profile.children.cycles-pp.do_sys_poll 16.19 -16.2 0.00 perf-profile.children.cycles-pp.__fget_light 68.59 -68.6 0.00 perf-profile.self.cycles-pp.do_sys_poll 14.84 -14.8 0.00 perf-profile.self.cycles-pp.__fget_light 1.759e+13 -100.0% 0.00 perf-stat.branch-instructions 0.28 -0.3 0.00 perf-stat.branch-miss-rate% 4.904e+10 -100.0% 0.00 perf-stat.branch-misses 6.79 ± 3% -6.8 0.00 perf-stat.cache-miss-rate% 1.071e+08 ± 4% -100.0% 0.00 perf-stat.cache-misses 1.578e+09 -100.0% 0.00 perf-stat.cache-references 385311 ± 2% -100.0% 0.00 perf-stat.context-switches 1.04 -100.0% 0.00 perf-stat.cpi 8.643e+13 -100.0% 0.00 perf-stat.cpu-cycles 13787 -100.0% 0.00 perf-stat.cpu-migrations 0.00 ± 4% -0.0 0.00 perf-stat.dTLB-load-miss-rate% 23324811 ± 5% -100.0% 0.00 perf-stat.dTLB-load-misses 1.811e+13 -100.0% 0.00 perf-stat.dTLB-loads 0.00 -0.0 0.00 perf-stat.dTLB-store-miss-rate% 2478029 -100.0% 0.00 perf-stat.dTLB-store-misses 8.775e+12 -100.0% 0.00 perf-stat.dTLB-stores 99.66 -99.7 0.00 perf-stat.iTLB-load-miss-rate% 7.527e+09 -100.0% 0.00 perf-stat.iTLB-load-misses 25540468 ± 39% -100.0% 0.00 perf-stat.iTLB-loads 8.33e+13 -100.0% 0.00 perf-stat.instructions 11066 -100.0% 0.00 perf-stat.instructions-per-iTLB-miss 0.96 -100.0% 0.00 perf-stat.ipc 777357 -100.0% 0.00 perf-stat.minor-faults 81.69 -81.7 0.00 perf-stat.node-load-miss-rate% 20040093 -100.0% 0.00 perf-stat.node-load-misses 4491667 ± 7% -100.0% 0.00 perf-stat.node-loads 75.23 ± 10% -75.2 0.00 perf-stat.node-store-miss-rate% 3418662 ± 30% -100.0% 0.00 perf-stat.node-store-misses 1027183 ± 11% -100.0% 0.00 perf-stat.node-stores 777373 -100.0% 0.00 perf-stat.page-faults 3331644 -100.0% 0.00 perf-stat.path-length will-it-scale.per_process_ops 242000 +-+----------------------------------------------------------------+ | +.+.. .+..+. .+.+..+.+.+. .+.+.. | 240000 +-+ + +.+ +.+..+ +..+ +.| 238000 +-+..+.+. .+. .+..+ | | +. +.+ | 236000 +-+ | | | 234000 +-+ | | O O O O | 232000 +-+ O O O O O O O O O O O O O | 230000 +-+ O O O O O O | | O | 228000 O-+ O O | | O O | 226000 +-+----------------------------------------------------------------+ will-it-scale.workload 2.52e+07 +-+--------------------------------------------------------------+ | +..+. .+..+. .+. .+.+..+. .+..+. | 2.5e+07 +-+ + +.+ +.+.+. + +.+ +.| 2.48e+07 +-+.+..+. .+. .+.+ | | + +..+ | 2.46e+07 +-+ | 2.44e+07 +-+ | | | 2.42e+07 +-+ O O O O O O O O | 2.4e+07 +-+ O O O O O O O O O O | | O O O O O O | 2.38e+07 O-+ O | 2.36e+07 +-O O O | | | 2.34e+07 +-+--------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

3 years

2
3
0 / 0

a8cc099c95 ("ARC: adjust memblock_reserve of kernel memory"): BUG: kernel reboot-without-warning in boot stage

by kernel test robot

Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://github.com/0day-ci/linux/commits/Eugeniy-Paltsev/ARC-adjust-membl... commit a8cc099c956012905a3de91ebe031526a29f5eee Author: Eugeniy Paltsev <Eugeniy.Paltsev(a)synopsys.com> AuthorDate: Wed Dec 19 19:16:16 2018 +0300 Commit: 0day robot <lkp(a)intel.com> CommitDate: Fri Dec 21 16:37:55 2018 +0800 ARC: adjust memblock_reserve of kernel memory In setup_arch_memory we reserve the memory area wherein the kernel is located. Current implementation may reserve more memory than it actually required in case of CONFIG_LINUX_LINK_BASE is not equal to CONFIG_LINUX_RAM_BASE. This happens because we calculate start of the reserved region relatively to the CONFIG_LINUX_RAM_BASE and end of the region relatively to the CONFIG_LINUX_RAM_BASE. For example in case of HSDK board we wasted 256MiB of physical memory: ------------------->8------------------------------ Memory: 770416K/1048576K available (5496K kernel code, 240K rwdata, 1064K rodata, 2200K init, 275K bss, 278160K reserved, 0K cma-reserved) ------------------->8------------------------------ Fix that. Cc: stable(a)vger.kernel.org Signed-off-by: Eugeniy Paltsev <Eugeniy.Paltsev(a)synopsys.com> 4fbd8d194f Linux 4.15-rc1 a8cc099c95 ARC: adjust memblock_reserve of kernel memory +-------------------------------------------------+-----------+------------+ | | v4.15-rc1 | a8cc099c95 | +-------------------------------------------------+-----------+------------+ | boot_successes | 56 | 0 | | boot_failures | 5 | 28 | | End_of_test:RCU_HOTPLUG | 3 | | | Mem-Info | 2 | | | BUG:kernel_reboot-without-warning_in_boot_stage | 0 | 28 | +-------------------------------------------------+-----------+------------+ output_len: 0x00000000016a69a8 kernel_total_size: 0x0000000001948000 Decompressing Linux... Parsing ELF... done. Booting the kernel. BUG: kernel reboot-without-warning in boot stage Linux version 4.15.0-rc1-00001-ga8cc099 #1 Command line: root=/dev/ram0 hung_task_panic=1 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 net.ifnames=0 printk.devkmsg=on panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 drbd.minor_count=8 systemd.log_level=err ignore_loglevel console=tty0 earlyprintk=ttyS0,115200 console=ttyS0,115200 vga=normal rw link=/cephfs/kbuild/run-queue/kvm/x86_64-rhel-7.2-clear/linux-review:Eugeniy-Paltsev:ARC-adjust-memblock_reserve-of-kernel-memory:20181221-163750:a8cc099c956012905a3de91ebe031526a29f5eee/.vmlinuz-a8cc099c956012905a3de91ebe031526a29f5eee-20190117183135-5:yocto-vm-yocto-235 branch=linux-review/Eugeniy-Paltsev/ARC-adjust-memblock_reserve-of-kernel-memory/20181221-163750 BOOT_IMAGE=/pkg/linux/x86_64-rhel-7.2-clear/gcc-7/a8cc099c956012905a3de91ebe031526a29f5eee/vmlinuz-4.15.0-rc1-00001-ga8cc099 drbd.minor_count=8 rcuperf.shutdown=0 # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start a8cc099c956012905a3de91ebe031526a29f5eee 4fbd8d194f06c8a3fd2af1ce560ddb31f7ec8323 -- # first bad commit: [a8cc099c956012905a3de91ebe031526a29f5eee] ARC: adjust memblock_reserve of kernel memory git bisect good 4fbd8d194f06c8a3fd2af1ce560ddb31f7ec8323 # 21:34 G 31 0 3 14 Linux 4.15-rc1 # extra tests on HEAD of linux-review/Eugeniy-Paltsev/ARC-adjust-memblock_reserve-of-kernel-memory/20181221-163750 git bisect bad a8cc099c956012905a3de91ebe031526a29f5eee # 21:35 B 0 28 61 0 ARC: adjust memblock_reserve of kernel memory --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/pipermail/lkp Intel Corporation

3 years

1
0
0 / 0

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP January 2019