Re: [LKP] [rcu] kernel BUG at include/linux/pagemap.h:149!
by Frederic Weisbecker
On Fri, Sep 11, 2015 at 10:19:47AM +0800, Boqun Feng wrote:
> Subject: [PATCH 01/27] rcu: Don't disable preemption for Tiny and Tree RCU
> readers
>
> Because preempt_disable() maps to barrier() for non-debug builds,
> it forces the compiler to spill and reload registers. Because Tree
> RCU and Tiny RCU now only appear in CONFIG_PREEMPT=n builds, these
> barrier() instances generate needless extra code for each instance of
> rcu_read_lock() and rcu_read_unlock(). This extra code slows down Tree
> RCU and bloats Tiny RCU.
>
> This commit therefore removes the preempt_disable() and preempt_enable()
> from the non-preemptible implementations of __rcu_read_lock() and
> __rcu_read_unlock(), respectively.
>
> For debug purposes, preempt_disable() and preempt_enable() are still
> kept if CONFIG_PREEMPT_COUNT=y, which makes the detection of sleeping
> inside atomic sections still work in non-preemptible kernels.
>
> Signed-off-by: Boqun Feng <boqun.feng(a)gmail.com>
> Signed-off-by: Paul E. McKenney <paulmck(a)linux.vnet.ibm.com>
> ---
> include/linux/rcupdate.h | 6 ++++--
> include/linux/rcutiny.h | 1 +
> kernel/rcu/tree.c | 9 +++++++++
> 3 files changed, 14 insertions(+), 2 deletions(-)
>
> diff --git a/include/linux/rcupdate.h b/include/linux/rcupdate.h
> index d63bb77..6c3cece 100644
> --- a/include/linux/rcupdate.h
> +++ b/include/linux/rcupdate.h
> @@ -297,12 +297,14 @@ void synchronize_rcu(void);
>
> static inline void __rcu_read_lock(void)
> {
> - preempt_disable();
> + if (IS_ENABLED(CONFIG_PREEMPT_COUNT))
> + preempt_disable();
preempt_disable() is a no-op when !CONFIG_PREEMPT_COUNT, right?
Or rather it's a barrier(), which is anyway implied by rcu_read_lock().
So perhaps we can get rid of the IS_ENABLED() check?
1 year, 8 months
[mm] ac5b2c1891: vm-scalability.throughput -61.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -61.3% regression of vm-scalability.throughput due to commit:
commit: ac5b2c18911ffe95c08d69273917f90212cf5659 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: vm-scalability
on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 128G memory
with following parameters:
runtime: 300
thp_enabled: always
thp_defrag: always
nr_task: 32
nr_ssd: 1
test: swap-w-seq
ucode: 0x3d
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode:
gcc-7/performance/x86_64-rhel-7.2/1/32/debian-x86_64-2018-04-03.cgz/300/lkp-hsw-ep4/swap-w-seq/vm-scalability/always/always/0x3d
commit:
94e297c50b ("include/linux/notifier.h: SRCU: fix ctags")
ac5b2c1891 ("mm: thp: relax __GFP_THISNODE for MADV_HUGEPAGE mappings")
94e297c50b529f5d ac5b2c18911ffe95c08d692739
---------------- --------------------------
%stddev %change %stddev
\ | \
0.57 ± 35% +258.8% 2.05 ± 4% vm-scalability.free_time
146022 ± 14% -40.5% 86833 ± 2% vm-scalability.median
29.29 ± 40% -89.6% 3.06 ± 26% vm-scalability.stddev
7454656 ± 9% -61.3% 2885836 ± 3% vm-scalability.throughput
189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time
189.21 ± 10% +52.4% 288.34 ± 2% vm-scalability.time.elapsed_time.max
8768 ± 3% +11.6% 9781 ± 5% vm-scalability.time.involuntary_context_switches
20320196 ± 2% -33.4% 13531732 ± 3% vm-scalability.time.maximum_resident_set_size
425945 ± 9% +17.4% 499908 ± 4% vm-scalability.time.minor_page_faults
253.79 ± 6% +62.0% 411.07 ± 4% vm-scalability.time.system_time
322.52 +8.0% 348.18 vm-scalability.time.user_time
246150 ± 12% +50.3% 370019 ± 4% vm-scalability.time.voluntary_context_switches
7746519 ± 11% +49.0% 11538799 ± 4% cpuidle.C6.usage
192240 ± 10% +44.3% 277460 ± 8% interrupts.CAL:Function_call_interrupts
22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.MIN_vruntime.avg
22.45 ± 85% -80.6% 4.36 ±173% sched_debug.cfs_rq:/.max_vruntime.avg
29.36 ± 13% +10.8% 32.52 ± 14% boot-time.boot
24.28 ± 16% +12.4% 27.30 ± 16% boot-time.dhcp
1597 ± 15% +10.2% 1760 ± 15% boot-time.idle
68.25 -9.8 58.48 ± 2% mpstat.cpu.idle%
27.12 ± 5% +10.3 37.42 ± 3% mpstat.cpu.iowait%
2.48 ± 11% -0.8 1.73 ± 2% mpstat.cpu.usr%
3422396 ± 14% +46.6% 5018492 ± 7% softirqs.RCU
1776561 ± 10% +52.4% 2707785 ± 2% softirqs.SCHED
5685772 ± 7% +54.3% 8774055 ± 3% softirqs.TIMER
7742519 ± 11% +49.0% 11534924 ± 4% turbostat.C6
29922317 ± 10% +55.0% 46366941 turbostat.IRQ
9.49 ± 64% -83.0% 1.62 ± 54% turbostat.Pkg%pc2
36878790 ± 27% -84.9% 5570259 ± 47% vmstat.memory.free
1.117e+08 ± 15% +73.5% 1.939e+08 ± 10% vmstat.memory.swpd
25.25 ± 4% +34.7% 34.00 vmstat.procs.b
513725 ± 7% +47.9% 759561 ± 12% numa-numastat.node0.local_node
35753 ±160% +264.7% 130386 ± 39% numa-numastat.node0.numa_foreign
519403 ± 6% +48.7% 772182 ± 12% numa-numastat.node0.numa_hit
35753 ±160% +264.7% 130386 ± 39% numa-numastat.node1.numa_miss
44315 ±138% +198.5% 132279 ± 40% numa-numastat.node1.other_node
32798032 ± 46% +80.6% 59228165 ± 2% numa-meminfo.node0.Active
32798009 ± 46% +80.6% 59228160 ± 2% numa-meminfo.node0.Active(anon)
33430762 ± 46% +80.8% 60429537 ± 2% numa-meminfo.node0.AnonHugePages
33572119 ± 46% +80.2% 60512777 ± 2% numa-meminfo.node0.AnonPages
1310559 ± 64% +86.4% 2442244 ± 2% numa-meminfo.node0.Inactive
1309969 ± 64% +86.4% 2442208 ± 2% numa-meminfo.node0.Inactive(anon)
30385359 ± 53% -90.7% 2821023 ± 44% numa-meminfo.node0.MemFree
35505047 ± 45% +77.6% 63055165 ± 2% numa-meminfo.node0.MemUsed
166560 ± 42% +130.2% 383345 ± 6% numa-meminfo.node0.PageTables
23702 ±105% -89.0% 2617 ± 44% numa-meminfo.node0.Shmem
1212 ± 65% +402.8% 6093 ± 57% numa-meminfo.node1.Shmem
8354144 ± 44% +77.1% 14798964 ± 2% numa-vmstat.node0.nr_active_anon
8552787 ± 44% +76.8% 15122222 ± 2% numa-vmstat.node0.nr_anon_pages
16648 ± 44% +77.1% 29492 ± 2% numa-vmstat.node0.nr_anon_transparent_hugepages
7436650 ± 53% -90.4% 712936 ± 44% numa-vmstat.node0.nr_free_pages
332106 ± 63% +83.8% 610268 ± 2% numa-vmstat.node0.nr_inactive_anon
41929 ± 41% +130.6% 96703 ± 6% numa-vmstat.node0.nr_page_table_pages
5900 ±106% -89.0% 650.75 ± 45% numa-vmstat.node0.nr_shmem
43336 ± 92% +151.2% 108840 ± 7% numa-vmstat.node0.nr_vmscan_write
43110 ± 92% +150.8% 108110 ± 7% numa-vmstat.node0.nr_written
8354142 ± 44% +77.1% 14798956 ± 2% numa-vmstat.node0.nr_zone_active_anon
332105 ± 63% +83.8% 610269 ± 2% numa-vmstat.node0.nr_zone_inactive_anon
321.50 ± 66% +384.9% 1559 ± 59% numa-vmstat.node1.nr_shmem
88815743 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active
88815702 ± 10% +33.8% 1.188e+08 ± 2% meminfo.Active(anon)
90446011 ± 11% +34.0% 1.212e+08 ± 2% meminfo.AnonHugePages
90613587 ± 11% +34.0% 1.214e+08 ± 2% meminfo.AnonPages
5.15e+08 ± 3% +22.2% 6.293e+08 ± 2% meminfo.Committed_AS
187419 ± 10% -19.6% 150730 ± 7% meminfo.DirectMap4k
3620693 ± 18% +35.3% 4897093 ± 2% meminfo.Inactive
3620054 ± 18% +35.3% 4896961 ± 2% meminfo.Inactive(anon)
36144979 ± 28% -87.0% 4715681 ± 57% meminfo.MemAvailable
36723121 ± 27% -85.9% 5179468 ± 52% meminfo.MemFree
395801 ± 2% +56.9% 620816 ± 4% meminfo.PageTables
178672 +15.1% 205668 ± 2% meminfo.SUnreclaim
249496 +12.6% 280897 meminfo.Slab
1751813 ± 2% +34.7% 2360437 ± 3% meminfo.SwapCached
6.716e+08 -12.4% 5.88e+08 ± 2% meminfo.SwapFree
3926 ± 17% +72.9% 6788 ± 13% meminfo.Writeback
1076 ± 3% +42.9% 1538 ± 4% slabinfo.biovec-max.active_objs
275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.active_slabs
1104 ± 2% +41.0% 1557 ± 4% slabinfo.biovec-max.num_objs
275.75 ± 2% +41.1% 389.00 ± 4% slabinfo.biovec-max.num_slabs
588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.active_objs
588.25 ± 7% +17.9% 693.75 ± 7% slabinfo.file_lock_cache.num_objs
13852 ± 3% +37.5% 19050 ± 3% slabinfo.kmalloc-4k.active_objs
1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.active_slabs
14217 ± 3% +37.7% 19577 ± 3% slabinfo.kmalloc-4k.num_objs
1776 ± 3% +37.7% 2446 ± 3% slabinfo.kmalloc-4k.num_slabs
158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.active_objs
158.25 ± 15% +54.0% 243.75 ± 18% slabinfo.nfs_read_data.num_objs
17762 ± 4% +44.3% 25638 ± 4% slabinfo.pool_workqueue.active_objs
563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.active_slabs
18048 ± 3% +43.5% 25906 ± 4% slabinfo.pool_workqueue.num_objs
563.25 ± 3% +43.7% 809.25 ± 4% slabinfo.pool_workqueue.num_slabs
34631 ± 3% +21.0% 41905 ± 2% slabinfo.radix_tree_node.active_objs
624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.active_slabs
34998 ± 3% +20.7% 42228 ± 2% slabinfo.radix_tree_node.num_objs
624.50 ± 3% +20.7% 753.75 ± 2% slabinfo.radix_tree_node.num_slabs
9.727e+11 ± 8% +50.4% 1.463e+12 ± 12% perf-stat.branch-instructions
1.11 ± 12% +1.2 2.31 ± 8% perf-stat.branch-miss-rate%
1.078e+10 ± 13% +214.9% 3.395e+10 ± 17% perf-stat.branch-misses
3.17 ± 11% -1.5 1.65 ± 9% perf-stat.cache-miss-rate%
8.206e+08 ± 7% +49.4% 1.226e+09 ± 11% perf-stat.cache-misses
2.624e+10 ± 14% +187.0% 7.532e+10 ± 17% perf-stat.cache-references
1174249 ± 9% +52.3% 1788442 ± 3% perf-stat.context-switches
2.921e+12 ± 8% +71.1% 4.998e+12 ± 9% perf-stat.cpu-cycles
1437 ± 14% +85.1% 2661 ± 20% perf-stat.cpu-migrations
7.586e+08 ± 21% +134.7% 1.78e+09 ± 30% perf-stat.dTLB-load-misses
7.943e+11 ± 11% +84.3% 1.464e+12 ± 14% perf-stat.dTLB-loads
93963731 ± 22% +40.9% 1.324e+08 ± 10% perf-stat.dTLB-store-misses
3.394e+11 ± 6% +60.5% 5.449e+11 ± 10% perf-stat.dTLB-stores
1.531e+08 ± 22% +44.0% 2.204e+08 ± 11% perf-stat.iTLB-load-misses
1.688e+08 ± 23% +71.1% 2.888e+08 ± 12% perf-stat.iTLB-loads
3.267e+12 ± 7% +58.5% 5.177e+12 ± 13% perf-stat.instructions
3988 ± 43% +123.9% 8930 ± 22% perf-stat.major-faults
901474 ± 5% +34.2% 1209877 ± 2% perf-stat.minor-faults
31.24 ± 10% +21.7 52.91 ± 2% perf-stat.node-load-miss-rate%
1.135e+08 ± 16% +187.6% 3.264e+08 ± 13% perf-stat.node-load-misses
6.27 ± 17% +26.9 33.19 ± 4% perf-stat.node-store-miss-rate%
27354489 ± 15% +601.2% 1.918e+08 ± 13% perf-stat.node-store-misses
905482 ± 5% +34.6% 1218833 ± 2% perf-stat.page-faults
4254 ± 7% +58.5% 6741 ± 13% perf-stat.path-length
6364 ± 25% +84.1% 11715 ± 14% proc-vmstat.allocstall_movable
46439 ± 12% +100.4% 93049 ± 21% proc-vmstat.compact_migrate_scanned
22425696 ± 10% +29.0% 28932634 ± 6% proc-vmstat.nr_active_anon
22875703 ± 11% +29.2% 29560082 ± 6% proc-vmstat.nr_anon_pages
44620 ± 11% +29.2% 57643 ± 6% proc-vmstat.nr_anon_transparent_hugepages
879436 ± 28% -77.3% 199768 ± 98% proc-vmstat.nr_dirty_background_threshold
1761029 ± 28% -77.3% 400034 ± 98% proc-vmstat.nr_dirty_threshold
715724 +17.6% 841386 ± 3% proc-vmstat.nr_file_pages
8960545 ± 28% -76.4% 2111248 ± 93% proc-vmstat.nr_free_pages
904330 ± 18% +31.2% 1186458 ± 7% proc-vmstat.nr_inactive_anon
11137 ± 2% +27.1% 14154 ± 9% proc-vmstat.nr_isolated_anon
12566 +3.5% 13012 proc-vmstat.nr_kernel_stack
97491 ± 2% +52.6% 148790 ± 10% proc-vmstat.nr_page_table_pages
17674 +6.2% 18763 ± 2% proc-vmstat.nr_slab_reclaimable
44820 +13.0% 50645 ± 2% proc-vmstat.nr_slab_unreclaimable
135763 ± 9% +68.4% 228600 ± 6% proc-vmstat.nr_vmscan_write
1017 ± 10% +54.7% 1573 ± 14% proc-vmstat.nr_writeback
220023 ± 5% +73.5% 381732 ± 6% proc-vmstat.nr_written
22425696 ± 10% +29.0% 28932635 ± 6% proc-vmstat.nr_zone_active_anon
904330 ± 18% +31.2% 1186457 ± 7% proc-vmstat.nr_zone_inactive_anon
1018 ± 10% +55.3% 1581 ± 13% proc-vmstat.nr_zone_write_pending
145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_foreign
671.50 ± 96% +479.4% 3890 ± 71% proc-vmstat.numa_hint_faults
1122389 ± 9% +17.2% 1315380 ± 4% proc-vmstat.numa_hit
214722 ± 5% +21.6% 261076 ± 3% proc-vmstat.numa_huge_pte_updates
1108142 ± 9% +17.4% 1300857 ± 4% proc-vmstat.numa_local
145368 ± 48% +63.1% 237050 ± 17% proc-vmstat.numa_miss
159615 ± 44% +57.6% 251573 ± 16% proc-vmstat.numa_other
185.50 ± 81% +8278.6% 15542 ± 40% proc-vmstat.numa_pages_migrated
1.1e+08 ± 5% +21.6% 1.337e+08 ± 3% proc-vmstat.numa_pte_updates
688332 ±106% +177.9% 1913062 ± 3% proc-vmstat.pgalloc_dma32
72593045 ± 10% +51.1% 1.097e+08 ± 3% proc-vmstat.pgdeactivate
919059 ± 4% +35.1% 1241472 ± 2% proc-vmstat.pgfault
3716 ± 45% +120.3% 8186 ± 25% proc-vmstat.pgmajfault
7.25 ± 26% +4.2e+05% 30239 ± 25% proc-vmstat.pgmigrate_fail
5340 ±106% +264.0% 19438 ± 33% proc-vmstat.pgmigrate_success
2.837e+08 ± 10% +51.7% 4.303e+08 ± 3% proc-vmstat.pgpgout
211428 ± 6% +74.1% 368188 ± 4% proc-vmstat.pgrefill
219051 ± 5% +73.7% 380419 ± 5% proc-vmstat.pgrotated
559397 ± 8% +43.0% 800110 ± 11% proc-vmstat.pgscan_direct
32894 ± 59% +158.3% 84981 ± 23% proc-vmstat.pgscan_kswapd
207042 ± 8% +71.5% 355174 ± 5% proc-vmstat.pgsteal_direct
14745 ± 65% +104.3% 30121 ± 18% proc-vmstat.pgsteal_kswapd
70934968 ± 10% +51.7% 1.076e+08 ± 3% proc-vmstat.pswpout
5852284 ± 12% +145.8% 14382881 ± 5% proc-vmstat.slabs_scanned
13453 ± 24% +204.9% 41023 ± 8% proc-vmstat.thp_split_page_failed
138385 ± 10% +51.6% 209783 ± 3% proc-vmstat.thp_split_pmd
138385 ± 10% +51.6% 209782 ± 3% proc-vmstat.thp_swpout
4.61 ± 24% -1.2 3.37 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle
2.90 ± 18% -0.7 2.19 ± 8% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.86 ± 32% -0.6 1.22 ± 7% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.60 ± 31% -0.5 1.08 ± 10% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
2.98 ± 8% -0.5 2.48 ± 10% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.46 ± 32% -0.5 0.96 ± 9% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.74 ± 27% -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
1.03 ± 52% -0.4 0.63 ± 15% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.17 ± 19% -0.3 0.87 ± 11% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.80 ± 17% +0.4 1.22 ± 7% perf-profile.calltrace.cycles-pp.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request
0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage
0.81 ± 16% +0.4 1.23 ± 8% perf-profile.calltrace.cycles-pp.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request.generic_make_request.submit_bio
0.52 ± 60% +0.5 1.03 ± 6% perf-profile.calltrace.cycles-pp.dma_pool_alloc.nvme_queue_rq.__blk_mq_try_issue_directly.blk_mq_try_issue_directly.blk_mq_make_request
1.64 ± 16% +0.6 2.21 ± 15% perf-profile.calltrace.cycles-pp.find_next_bit.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done
0.51 ± 64% +0.8 1.31 ± 17% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start
0.80 ± 25% +0.9 1.67 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request
0.82 ± 24% +0.9 1.71 ± 19% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request
0.82 ± 25% +0.9 1.73 ± 19% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio
0.87 ± 25% +1.0 1.87 ± 14% perf-profile.calltrace.cycles-pp.blk_account_io_start.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage
2.05 ± 15% +1.4 3.48 ± 7% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.__swap_writepage.pageout.shrink_page_list
2.09 ± 15% +1.4 3.53 ± 7% perf-profile.calltrace.cycles-pp.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg
2.05 ± 15% +1.4 3.49 ± 7% perf-profile.calltrace.cycles-pp.blk_mq_make_request.generic_make_request.submit_bio.__swap_writepage.pageout
2.06 ± 15% +1.4 3.50 ± 7% perf-profile.calltrace.cycles-pp.submit_bio.__swap_writepage.pageout.shrink_page_list.shrink_inactive_list
2.10 ± 15% +1.4 3.54 ± 6% perf-profile.calltrace.cycles-pp.pageout.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node
3.31 ± 12% +1.5 4.83 ± 5% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages
3.33 ± 12% +1.5 4.86 ± 5% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages
3.40 ± 12% +1.6 4.97 ± 6% perf-profile.calltrace.cycles-pp.shrink_node_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
3.57 ± 12% +1.6 5.19 ± 7% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page
3.49 ± 12% +1.6 5.13 ± 6% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault
3.51 ± 12% +1.7 5.17 ± 6% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.do_huge_pmd_anonymous_page.__handle_mm_fault.handle_mm_fault
3.34 ± 14% +2.2 5.57 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_check_inflight.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats
9.14 ± 17% +5.5 14.66 ± 22% perf-profile.calltrace.cycles-pp.bt_iter.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done
12.10 ± 17% +6.8 18.89 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_queue_tag_busy_iter.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request
13.88 ± 15% +7.1 21.01 ± 20% perf-profile.calltrace.cycles-pp.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle
13.87 ± 15% +7.1 21.00 ± 20% perf-profile.calltrace.cycles-pp.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr.cpuidle_enter_state
13.97 ± 15% +7.1 21.10 ± 20% perf-profile.calltrace.cycles-pp.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
13.94 ± 15% +7.1 21.07 ± 20% perf-profile.calltrace.cycles-pp.do_IRQ.ret_from_intr.cpuidle_enter_state.do_idle.cpu_startup_entry
12.50 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu
12.70 ± 17% +7.2 19.86 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_end_request.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu
12.48 ± 17% +7.2 19.65 ± 20% perf-profile.calltrace.cycles-pp.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request.nvme_irq
12.46 ± 17% +7.2 19.63 ± 21% perf-profile.calltrace.cycles-pp.blk_mq_in_flight.part_round_stats.blk_account_io_done.blk_mq_end_request.blk_mq_complete_request
14.78 ± 18% +8.1 22.83 ± 20% perf-profile.calltrace.cycles-pp.blk_mq_complete_request.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event
14.87 ± 18% +8.1 22.95 ± 21% perf-profile.calltrace.cycles-pp.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq
14.89 ± 18% +8.1 22.98 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ
14.90 ± 18% +8.1 22.99 ± 21% perf-profile.calltrace.cycles-pp.handle_irq_event.handle_edge_irq.handle_irq.do_IRQ.ret_from_intr
14.88 ± 18% +8.1 22.97 ± 21% perf-profile.calltrace.cycles-pp.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.handle_irq
4.79 ± 22% -1.3 3.52 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt
3.04 ± 16% -0.7 2.30 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues
1.98 ± 29% -0.7 1.29 ± 7% perf-profile.children.cycles-pp.tick_sched_timer
1.70 ± 27% -0.6 1.14 ± 9% perf-profile.children.cycles-pp.tick_sched_handle
1.57 ± 29% -0.5 1.03 ± 10% perf-profile.children.cycles-pp.update_process_times
3.02 ± 8% -0.5 2.52 ± 10% perf-profile.children.cycles-pp.menu_select
1.19 ± 19% -0.3 0.89 ± 10% perf-profile.children.cycles-pp.tick_nohz_next_event
0.81 ± 25% -0.2 0.56 ± 11% perf-profile.children.cycles-pp.scheduler_tick
0.42 ± 19% -0.1 0.30 ± 14% perf-profile.children.cycles-pp._raw_spin_lock
0.27 ± 13% -0.1 0.21 ± 15% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.11 ± 35% -0.0 0.07 ± 19% perf-profile.children.cycles-pp.run_local_timers
0.10 ± 15% -0.0 0.07 ± 28% perf-profile.children.cycles-pp.cpu_load_update
0.14 ± 9% -0.0 0.11 ± 15% perf-profile.children.cycles-pp.perf_event_task_tick
0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_flush_plug_list
0.07 ± 17% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_mq_flush_plug_list
0.06 ± 26% +0.0 0.11 ± 17% perf-profile.children.cycles-pp.read
0.07 ± 17% +0.0 0.11 ± 36% perf-profile.children.cycles-pp.deferred_split_scan
0.15 ± 14% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.blk_mq_sched_dispatch_requests
0.15 ± 16% +0.1 0.21 ± 15% perf-profile.children.cycles-pp.blk_mq_dispatch_rq_list
0.15 ± 14% +0.1 0.22 ± 14% perf-profile.children.cycles-pp.__blk_mq_run_hw_queue
0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.shrink_slab
0.08 ± 23% +0.1 0.14 ± 34% perf-profile.children.cycles-pp.do_shrink_slab
0.72 ± 19% +0.3 1.00 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.44 ± 18% +0.3 0.74 ± 14% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.86 ± 18% +0.4 1.30 ± 9% perf-profile.children.cycles-pp.blk_mq_try_issue_directly
0.88 ± 18% +0.5 1.34 ± 9% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly
0.82 ± 19% +0.5 1.30 ± 9% perf-profile.children.cycles-pp.dma_pool_alloc
1.02 ± 15% +0.5 1.55 ± 9% perf-profile.children.cycles-pp.nvme_queue_rq
1.07 ± 15% +0.7 1.76 ± 21% perf-profile.children.cycles-pp.__indirect_thunk_start
2.42 ± 16% +0.7 3.16 ± 13% perf-profile.children.cycles-pp.find_next_bit
0.95 ± 26% +1.1 2.00 ± 15% perf-profile.children.cycles-pp.blk_account_io_start
2.19 ± 17% +1.5 3.72 ± 8% perf-profile.children.cycles-pp.blk_mq_make_request
2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.submit_bio
2.20 ± 17% +1.5 3.73 ± 8% perf-profile.children.cycles-pp.generic_make_request
2.21 ± 17% +1.5 3.76 ± 8% perf-profile.children.cycles-pp.__swap_writepage
2.23 ± 17% +1.5 3.77 ± 7% perf-profile.children.cycles-pp.pageout
3.60 ± 13% +1.6 5.22 ± 7% perf-profile.children.cycles-pp.__alloc_pages_nodemask
3.51 ± 15% +1.6 5.15 ± 6% perf-profile.children.cycles-pp.shrink_page_list
3.48 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.do_try_to_free_pages
3.53 ± 14% +1.6 5.17 ± 6% perf-profile.children.cycles-pp.shrink_inactive_list
3.49 ± 12% +1.6 5.13 ± 6% perf-profile.children.cycles-pp.try_to_free_pages
3.51 ± 12% +1.7 5.19 ± 6% perf-profile.children.cycles-pp.__alloc_pages_slowpath
3.61 ± 14% +1.7 5.30 ± 6% perf-profile.children.cycles-pp.shrink_node_memcg
3.69 ± 15% +1.8 5.45 ± 7% perf-profile.children.cycles-pp.shrink_node
4.10 ± 17% +2.4 6.47 ± 18% perf-profile.children.cycles-pp.blk_mq_check_inflight
10.64 ± 16% +6.8 17.39 ± 17% perf-profile.children.cycles-pp.bt_iter
13.17 ± 16% +7.4 20.59 ± 18% perf-profile.children.cycles-pp.blk_account_io_done
13.39 ± 16% +7.4 20.81 ± 19% perf-profile.children.cycles-pp.blk_mq_end_request
15.67 ± 17% +8.2 23.84 ± 20% perf-profile.children.cycles-pp.handle_irq
15.66 ± 17% +8.2 23.83 ± 20% perf-profile.children.cycles-pp.handle_edge_irq
15.57 ± 17% +8.2 23.73 ± 20% perf-profile.children.cycles-pp.nvme_irq
15.60 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event
15.58 ± 17% +8.2 23.75 ± 20% perf-profile.children.cycles-pp.__handle_irq_event_percpu
15.59 ± 17% +8.2 23.77 ± 20% perf-profile.children.cycles-pp.handle_irq_event_percpu
15.75 ± 17% +8.2 23.93 ± 20% perf-profile.children.cycles-pp.ret_from_intr
15.73 ± 17% +8.2 23.91 ± 20% perf-profile.children.cycles-pp.do_IRQ
15.54 ± 17% +8.2 23.73 ± 19% perf-profile.children.cycles-pp.blk_mq_complete_request
14.07 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.part_round_stats
14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_queue_tag_busy_iter
14.05 ± 16% +8.4 22.45 ± 16% perf-profile.children.cycles-pp.blk_mq_in_flight
0.38 ± 20% -0.1 0.28 ± 16% perf-profile.self.cycles-pp._raw_spin_lock
0.10 ± 13% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.idle_cpu
0.12 ± 14% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.10 ± 15% -0.0 0.07 ± 28% perf-profile.self.cycles-pp.cpu_load_update
0.14 ± 9% -0.0 0.11 ± 15% perf-profile.self.cycles-pp.perf_event_task_tick
0.62 ± 16% +0.3 0.89 ± 12% perf-profile.self.cycles-pp.dma_pool_alloc
0.44 ± 18% +0.3 0.74 ± 14% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.81 ± 16% +0.5 1.32 ± 25% perf-profile.self.cycles-pp.__indirect_thunk_start
2.07 ± 16% +0.6 2.69 ± 12% perf-profile.self.cycles-pp.find_next_bit
1.77 ± 16% +1.1 2.91 ± 15% perf-profile.self.cycles-pp.blk_mq_queue_tag_busy_iter
3.82 ± 16% +2.2 6.00 ± 18% perf-profile.self.cycles-pp.blk_mq_check_inflight
6.43 ± 15% +4.1 10.56 ± 16% perf-profile.self.cycles-pp.bt_iter
vm-scalability.time.system_time
600 +-+-------------------------------------------------------------------+
| |
500 +-O OO |
O O OO |
| O O O O O O |
400 +-+ O O O O |
| |
300 +-+ .+.++. .+ .+ .+ .+.+ +.+ .++.+.++ .++.+.++. |
| ++ + :.+ + + + : +.+ : +.+ + .++.+ +.+ .|
200 +-+ + + : : : : + + |
|: : : : : |
|: :: : : |
100 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.time.maximum_resident_set_size
2.5e+07 +-+---------------------------------------------------------------+
| |
| ++.++.++.+. +. +. + +.++.+ +.++.+ .+.++. .++. .++.+ .+ |
2e+07 +-+ + .+ + +.+: : : : + ++ + + +.|
| : + : : : : |
| : : : : : |
1.5e+07 O-+O OO: : : : |
|: O O O O : : : : |
1e+07 +-+ O O O O OO O : : : : |
|:O O :: :: |
|: :: :: |
5e+06 +-+ : : |
| : : |
| : : |
0 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 10 months
[page cache] eb797a8ee0: vm-scalability.throughput -16.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -16.5% regression of vm-scalability.throughput due to commit:
commit: eb797a8ee0ab4cd03df556980ce7bf167cadaa50 ("page cache: Rearrange address_space")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: vm-scalability
on test machine: 80 threads Skylake with 64G memory
with following parameters:
runtime: 300s
test: small-allocs
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------------------------------+
| testcase: change | unixbench: unixbench.score 20.9% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | nr_task=100% |
| | runtime=300s |
| | test=shell8 |
| | ucode=0xb00002e |
+------------------+----------------------------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.2/debian-x86_64-2018-04-03.cgz/300s/lkp-skl-2sp2/small-allocs/vm-scalability
commit:
f32f004cdd ("ida: Convert to XArray")
eb797a8ee0 ("page cache: Rearrange address_space")
f32f004cddf86d63 eb797a8ee0ab4cd03df556980c
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
3:4 -13% 3:4 perf-profile.calltrace.cycles-pp.error_entry
3:4 -12% 3:4 perf-profile.children.cycles-pp.error_entry
1:4 -6% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
235891 -16.5% 197085 vm-scalability.median
18881481 -16.5% 15769081 vm-scalability.throughput
316.19 +14.4% 361.58 vm-scalability.time.elapsed_time
316.19 +14.4% 361.58 vm-scalability.time.elapsed_time.max
22924 +15.9% 26576 vm-scalability.time.system_time
3254041 ± 9% +36.4% 4437311 ± 3% vm-scalability.time.voluntary_context_switches
277831 ± 3% +9.5% 304359 interrupts.CAL:Function_call_interrupts
102367 ± 2% +10.1% 112694 ± 2% meminfo.Shmem
6.67 ± 5% -0.9 5.76 ± 2% mpstat.cpu.usr%
0.49 -5.0% 0.46 pmeter.Average_Active_Power
38678749 -12.1% 34005251 pmeter.performance_per_watt
2621420 ± 38% +59.2% 4173292 ± 3% turbostat.C1
62964314 ± 10% +18.7% 74735975 turbostat.IRQ
20821 ± 10% +20.6% 25103 ± 2% vmstat.system.cs
192700 ± 8% +5.9% 204006 vmstat.system.in
76742 +3.7% 79550 proc-vmstat.nr_active_anon
25578 ± 2% +10.1% 28154 ± 2% proc-vmstat.nr_shmem
76742 +3.7% 79550 proc-vmstat.nr_zone_active_anon
34211075 ± 14% +28.7% 44023085 ± 3% cpuidle.C1.time
2628057 ± 37% +59.1% 4179955 ± 3% cpuidle.C1.usage
200488 ± 20% +75.5% 351836 ± 13% cpuidle.POLL.time
57706 ± 49% +93.1% 111419 ± 18% cpuidle.POLL.usage
2.08 ± 14% +20.7% 2.51 ± 4% sched_debug.cfs_rq:/.nr_spread_over.avg
50.05 ± 36% -38.0% 31.04 ± 24% sched_debug.cpu.cpu_load[1].max
0.25 ± 14% +17.4% 0.29 ± 7% sched_debug.cpu.nr_running.stddev
42905 ± 12% +26.2% 54143 ± 3% sched_debug.cpu.nr_switches.avg
19996 ± 17% +43.0% 28586 ± 7% sched_debug.cpu.nr_switches.min
43774 ± 12% +26.5% 55370 ± 3% sched_debug.cpu.sched_count.avg
20285 ± 17% +43.1% 29024 ± 8% sched_debug.cpu.sched_count.min
19949 ± 12% +28.0% 25530 ± 3% sched_debug.cpu.sched_goidle.avg
9260 ± 16% +44.9% 13422 ± 8% sched_debug.cpu.sched_goidle.min
23108 ± 12% +26.0% 29110 ± 3% sched_debug.cpu.ttwu_count.avg
25905 ± 11% +25.8% 32593 ± 2% sched_debug.cpu.ttwu_count.max
21683 ± 12% +26.0% 27323 ± 3% sched_debug.cpu.ttwu_count.min
73.74 -3.6 70.12 perf-stat.cache-miss-rate%
2.83e+10 ± 2% +5.5% 2.985e+10 perf-stat.cache-misses
3.838e+10 +10.9% 4.257e+10 perf-stat.cache-references
6787110 ± 9% +35.5% 9197959 ± 3% perf-stat.context-switches
3.17 +11.1% 3.52 perf-stat.cpi
7.609e+13 +14.5% 8.715e+13 perf-stat.cpu-cycles
21380 +11.1% 23753 perf-stat.cpu-migrations
0.08 -0.0 0.07 perf-stat.dTLB-load-miss-rate%
6.634e+12 +3.8% 6.888e+12 perf-stat.dTLB-loads
0.13 -0.0 0.12 perf-stat.dTLB-store-miss-rate%
1.135e+09 -5.6% 1.071e+09 perf-stat.dTLB-store-misses
2.184e+09 -2.3% 2.135e+09 perf-stat.iTLB-load-misses
2.404e+13 +3.1% 2.479e+13 perf-stat.instructions
11006 +5.5% 11614 perf-stat.instructions-per-iTLB-miss
0.32 -10.0% 0.28 perf-stat.ipc
2.898e+09 +15.2% 3.337e+09 ± 2% perf-stat.node-load-misses
7.235e+08 +19.1% 8.615e+08 ± 4% perf-stat.node-store-misses
4975 +5.3% 5236 perf-stat.path-length
1.10 -0.1 0.97 ± 2% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link
0.68 ± 2% -0.1 0.59 perf-profile.calltrace.cycles-pp.vma_interval_tree_insert.vma_link.mmap_region.do_mmap.vm_mmap_pgoff
0.59 ± 3% -0.0 0.55 ± 2% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_numa_work.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.04 ± 5% +0.1 1.19 ± 3% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.64 ± 2% +0.4 2.00 perf-profile.calltrace.cycles-pp.page_fault
1.57 ± 2% +0.4 1.93 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
1.59 ± 2% +0.4 1.96 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
0.65 +0.5 1.19 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.00 +1.0 1.03 ± 4% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.10 -0.1 0.97 ± 2% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.68 ± 2% -0.1 0.59 perf-profile.children.cycles-pp.vma_interval_tree_insert
0.62 ± 2% -0.1 0.55 ± 2% perf-profile.children.cycles-pp.native_irq_return_iret
0.47 -0.1 0.41 perf-profile.children.cycles-pp.sync_regs
0.32 ± 4% -0.1 0.27 ± 3% perf-profile.children.cycles-pp.get_unmapped_area
0.26 ± 3% -0.1 0.21 ± 3% perf-profile.children.cycles-pp.__perf_sw_event
0.21 ± 4% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.find_vma
0.27 ± 3% -0.0 0.22 ± 3% perf-profile.children.cycles-pp.unmapped_area_topdown
0.11 ± 42% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.29 ± 2% -0.0 0.24 ± 3% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.19 ± 4% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.___perf_sw_event
0.13 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.vma_policy_mof
0.59 ± 3% -0.0 0.56 ± 2% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.16 ± 2% -0.0 0.13 perf-profile.children.cycles-pp.__rb_insert_augmented
0.19 ± 2% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.perf_event_mmap
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.vmacache_find
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__fget
0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.d_path
0.09 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.__vma_link_rb
0.01 ±173% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.osq_unlock
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_work_run
1.19 ± 3% +0.2 1.36 ± 2% perf-profile.children.cycles-pp.task_numa_work
1.66 ± 2% +0.4 2.01 perf-profile.children.cycles-pp.page_fault
1.59 ± 2% +0.4 1.96 perf-profile.children.cycles-pp.do_page_fault
1.58 ± 2% +0.4 1.95 perf-profile.children.cycles-pp.__do_page_fault
0.66 +0.5 1.20 ± 4% perf-profile.children.cycles-pp.handle_mm_fault
0.47 +0.6 1.04 ± 4% perf-profile.children.cycles-pp.__handle_mm_fault
1.09 -0.1 0.96 ± 2% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.67 ± 2% -0.1 0.59 ± 2% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.62 ± 2% -0.1 0.55 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret
0.46 -0.1 0.40 perf-profile.self.cycles-pp.sync_regs
0.43 -0.1 0.37 ± 2% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.30 ± 5% -0.1 0.25 ± 3% perf-profile.self.cycles-pp.__do_page_fault
0.11 ± 42% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.27 ± 3% -0.0 0.22 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown
0.17 ± 3% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.___perf_sw_event
0.14 ± 8% -0.0 0.11 perf-profile.self.cycles-pp.mmap_region
0.18 ± 2% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.handle_mm_fault
0.15 -0.0 0.12 ± 4% perf-profile.self.cycles-pp.__rb_insert_augmented
0.12 ± 4% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.find_vma
0.08 ± 5% -0.0 0.06 perf-profile.self.cycles-pp.vma_policy_mof
0.08 ± 8% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.vmacache_find
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__fget
0.07 ± 6% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__perf_sw_event
0.06 -0.0 0.05 perf-profile.self.cycles-pp.d_path
0.08 ± 5% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.down_write
0.11 ± 4% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.up_write
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.__vma_link_rb
0.18 ± 9% +0.1 0.28 ± 6% perf-profile.self.cycles-pp.rwsem_down_write_failed
0.01 ±173% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.osq_unlock
1.05 ± 4% +0.2 1.26 ± 2% perf-profile.self.cycles-pp.task_numa_work
0.35 ± 2% +0.6 0.95 ± 5% perf-profile.self.cycles-pp.__handle_mm_fault
vm-scalability.time.system_time
30000 +-+-----------------------------------------------------------------+
| O O |
25000 O-O O O O O O O O O O O O O O O O O O O O O |
|.+..+.+..+.+..+.+.+..+.+..+.+..+.+ .+..+.+.+..+.+..+.+..+.|
| : + + |
20000 +-+ : : : |
| : :: : |
15000 +-+ : : : : |
| : : : : |
10000 +-+ : : : : |
| : : : : |
| : : : : |
5000 +-+ :: :: |
| : : |
0 +-+-----------------------------------------------------------------+
vm-scalability.time.elapsed_time
400 +-+-------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O |
350 +-+ |
300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.|
| : : : |
250 +-+ : :: : |
| : : : : |
200 +-+ : : : : |
| : : : : |
150 +-+ : : : : |
100 +-+ : : : : |
| : : : : |
50 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.time.elapsed_time.max
400 +-+-------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O O O O O O |
350 +-+ |
300 +-++.+..+.+..+.+..+.+..+.+..+.+..+.+ + +..+.+..+.+..+.+..+.+..+.|
| : : : |
250 +-+ : :: : |
| : : : : |
200 +-+ : : : : |
| : : : : |
150 +-+ : : : : |
100 +-+ : : : : |
| : : : : |
50 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.throughput
2e+07 +-+---------------------------------------------------------------+
1.8e+07 +-+..+.+.+..+.+..+.+.+..+.+.+..+.+ + +..+.+..+.+.+..+.+.+..+.|
| : : : |
1.6e+07 O-O O O O O O O O O O O O O O O O O O O O O O O |
1.4e+07 +-+ : :: : |
| : : : : |
1.2e+07 +-+ : : : : |
1e+07 +-+ : : : : |
8e+06 +-+ : : : : |
| : : : : |
6e+06 +-+ : : : : |
4e+06 +-+ :: : |
| : : |
2e+06 +-+ : : |
0 +-+---------------------------------------------------------------+
vm-scalability.median
250000 +-+----------------------------------------------------------------+
|.+..+.+..+.+.+..+.+..+.+.+..+ + + +.+..+.+..+.+.+..+.+..+.|
| : : : |
200000 O-O O O O O O O O O O O O O O O O O O O O O O O |
| : :: : |
| : : : : |
150000 +-+ : : : : |
| : : : : |
100000 +-+ : : : : |
| : : : : |
| : : : : |
50000 +-+ : :: |
| : : |
| : : |
0 +-+----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-bdw-ep3b: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.2/100%/debian-x86_64-2018-04-03.cgz/300s/lkp-bdw-ep3b/shell8/unixbench/0xb00002e
commit:
f32f004cdd ("ida: Convert to XArray")
eb797a8ee0 ("page cache: Rearrange address_space")
f32f004cddf86d63 eb797a8ee0ab4cd03df556980c
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x
:4 25% 1:4 dmesg.WARNING:at_ip__slab_free/0x
:4 25% 1:4 dmesg.WARNING:at_ip_filename_lookup/0x
1:4 -25% :4 dmesg.WARNING:at_ip_fsnotify/0x
1:4 -25% :4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x
1:4 9% 2:4 perf-profile.children.cycles-pp.error_entry
1:4 7% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
39940 +20.9% 48288 unixbench.score
641.38 +1.0% 647.51 unixbench.time.elapsed_time
641.38 +1.0% 647.51 unixbench.time.elapsed_time.max
24220392 +29.1% 31263367 ± 2% unixbench.time.involuntary_context_switches
1.836e+09 +20.8% 2.217e+09 unixbench.time.minor_page_faults
7052 +2.1% 7200 unixbench.time.percent_of_cpu_this_job_got
36337 -2.7% 35347 unixbench.time.system_time
8893 +26.8% 11279 ± 2% unixbench.time.user_time
85632909 +4.3% 89281018 unixbench.time.voluntary_context_switches
15301176 +21.7% 18622462 unixbench.workload
42884872 +19.0% 51033794 softirqs.RCU
43387938 ± 6% -12.9% 37797790 ± 2% cpuidle.C1.usage
1155156 ± 4% -24.0% 878414 ± 4% cpuidle.POLL.usage
152008 ± 9% +15.2% 175048 ± 7% meminfo.DirectMap4k
255196 +13.6% 289806 meminfo.Shmem
100.25 +26.7% 127.00 ± 2% vmstat.procs.r
337268 +3.6% 349315 vmstat.system.cs
19.30 -1.7 17.59 mpstat.cpu.idle%
0.01 ± 30% +0.0 0.02 ± 35% mpstat.cpu.iowait%
15.54 +3.6 19.11 mpstat.cpu.usr%
7.086e+08 +20.8% 8.56e+08 ± 2% numa-numastat.node0.local_node
7.086e+08 +20.8% 8.561e+08 ± 2% numa-numastat.node0.numa_hit
7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.local_node
7.053e+08 +21.3% 8.558e+08 numa-numastat.node1.numa_hit
2274 +2.1% 2322 turbostat.Avg_MHz
43383925 ± 6% -12.9% 37793914 ± 2% turbostat.C1
14.41 ± 2% -17.4% 11.90 ± 7% turbostat.CPU%c1
243.24 +2.2% 248.48 turbostat.PkgWatt
14.16 +8.1% 15.30 turbostat.RAMWatt
6807 ± 4% +48.1% 10084 ± 5% slabinfo.files_cache.active_objs
6807 ± 4% +48.2% 10090 ± 5% slabinfo.files_cache.num_objs
3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.active_objs
3616 +23.8% 4475 ± 5% slabinfo.kmalloc-256.num_objs
17134 ± 4% +13.8% 19493 ± 2% slabinfo.proc_inode_cache.active_objs
17134 ± 4% +14.0% 19524 ± 2% slabinfo.proc_inode_cache.num_objs
3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.active_objs
3393 ± 6% +17.7% 3994 ± 3% slabinfo.sock_inode_cache.num_objs
1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.active_objs
1241 ± 8% +15.0% 1427 ± 6% slabinfo.task_group.num_objs
713963 ± 14% -20.9% 564405 ± 4% numa-meminfo.node0.FilePages
20539 ± 9% -19.7% 16496 ± 15% numa-meminfo.node0.Mapped
1281514 ± 9% -10.6% 1145886 ± 4% numa-meminfo.node0.MemUsed
683.75 ± 11% +54.1% 1053 ± 12% numa-meminfo.node0.Mlocked
48239 ± 4% -19.8% 38686 ± 17% numa-meminfo.node0.SReclaimable
669804 ± 15% +27.8% 856173 ± 3% numa-meminfo.node1.FilePages
4719 ± 56% +227.5% 15456 ± 43% numa-meminfo.node1.Inactive
4644 ± 57% +232.0% 15419 ± 43% numa-meminfo.node1.Inactive(anon)
14609 ± 12% +47.2% 21499 ± 11% numa-meminfo.node1.Mapped
40126 ± 6% +29.6% 52000 ± 12% numa-meminfo.node1.SReclaimable
119605 ± 96% +131.3% 276593 ± 3% numa-meminfo.node1.Shmem
130207 +18.0% 153583 ± 5% numa-meminfo.node1.Slab
547652 ± 4% +5.4% 577200 ± 4% numa-meminfo.node1.Unevictable
178549 ± 14% -21.0% 141123 ± 4% numa-vmstat.node0.nr_file_pages
5179 ± 9% -20.3% 4130 ± 16% numa-vmstat.node0.nr_mapped
170.50 ± 12% +54.5% 263.50 ± 13% numa-vmstat.node0.nr_mlock
12061 ± 4% -19.8% 9670 ± 17% numa-vmstat.node0.nr_slab_reclaimable
3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_hit
3.542e+08 +21.5% 4.304e+08 ± 2% numa-vmstat.node0.numa_local
167459 ± 15% +27.9% 214111 ± 3% numa-vmstat.node1.nr_file_pages
1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_inactive_anon
3673 ± 11% +49.4% 5488 ± 13% numa-vmstat.node1.nr_mapped
29911 ± 96% +131.3% 69188 ± 3% numa-vmstat.node1.nr_shmem
10036 ± 6% +29.5% 13000 ± 12% numa-vmstat.node1.nr_slab_reclaimable
22541 +12.7% 25401 ± 3% numa-vmstat.node1.nr_slab_unreclaimable
136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_unevictable
1150 ± 57% +234.3% 3845 ± 44% numa-vmstat.node1.nr_zone_inactive_anon
136898 ± 4% +5.4% 144317 ± 4% numa-vmstat.node1.nr_zone_unevictable
3.525e+08 +22.0% 4.301e+08 ± 2% numa-vmstat.node1.numa_hit
3.523e+08 +22.0% 4.299e+08 ± 2% numa-vmstat.node1.numa_local
149893 +6.3% 159383 proc-vmstat.nr_active_anon
345938 +2.7% 355212 proc-vmstat.nr_file_pages
6075 +9.3% 6643 proc-vmstat.nr_inactive_anon
30490 +2.2% 31159 proc-vmstat.nr_kernel_stack
8870 +8.1% 9585 proc-vmstat.nr_mapped
9254 +2.3% 9471 proc-vmstat.nr_page_table_pages
63803 +13.6% 72460 proc-vmstat.nr_shmem
22097 +2.6% 22671 proc-vmstat.nr_slab_reclaimable
47965 +6.9% 51274 proc-vmstat.nr_slab_unreclaimable
149893 +6.3% 159383 proc-vmstat.nr_zone_active_anon
6075 +9.3% 6643 proc-vmstat.nr_zone_inactive_anon
1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_hit
1.414e+09 +21.1% 1.712e+09 proc-vmstat.numa_local
47447 +10.8% 52569 proc-vmstat.pgactivate
1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgalloc_normal
1.846e+09 +20.7% 2.228e+09 proc-vmstat.pgfault
1.487e+09 +21.1% 1.801e+09 proc-vmstat.pgfree
63795 +20.6% 76962 proc-vmstat.thp_deferred_split_page
63790 +20.6% 76940 proc-vmstat.thp_fault_alloc
26894638 +20.9% 32515246 proc-vmstat.unevictable_pgs_culled
1.556e+13 +4.9% 1.632e+13 perf-stat.branch-instructions
1.54 +0.2 1.75 perf-stat.branch-miss-rate%
2.399e+11 +19.4% 2.863e+11 perf-stat.branch-misses
1.034e+11 +17.1% 1.21e+11 ± 2% perf-stat.cache-misses
9.784e+11 +18.6% 1.161e+12 perf-stat.cache-references
2.18e+08 +4.6% 2.281e+08 perf-stat.context-switches
1.60 -1.0% 1.59 perf-stat.cpi
1.281e+14 +3.2% 1.322e+14 perf-stat.cpu-cycles
46095973 +22.0% 56220581 perf-stat.cpu-migrations
0.19 +0.0 0.23 ± 2% perf-stat.dTLB-load-miss-rate%
4.148e+10 +23.3% 5.113e+10 ± 2% perf-stat.dTLB-load-misses
2.213e+13 +2.1% 2.261e+13 perf-stat.dTLB-loads
5.537e+09 +22.2% 6.767e+09 ± 2% perf-stat.dTLB-store-misses
8.001e+12 +20.3% 9.625e+12 perf-stat.dTLB-stores
2.034e+10 +20.1% 2.443e+10 perf-stat.iTLB-load-misses
1.3e+10 +17.1% 1.522e+10 perf-stat.iTLB-loads
7.991e+13 +4.3% 8.332e+13 perf-stat.instructions
3929 -13.2% 3411 perf-stat.instructions-per-iTLB-miss
1.81e+09 +20.7% 2.184e+09 perf-stat.minor-faults
91.68 -2.3 89.39 perf-stat.node-load-miss-rate%
3.395e+10 +14.5% 3.889e+10 perf-stat.node-load-misses
3.083e+09 +49.7% 4.616e+09 ± 3% perf-stat.node-loads
1.018e+10 +20.2% 1.224e+10 ± 2% perf-stat.node-store-misses
8.896e+09 +21.3% 1.079e+10 ± 2% perf-stat.node-stores
1.81e+09 +20.7% 2.184e+09 perf-stat.page-faults
5222880 -14.3% 4475405 perf-stat.path-length
1942 ± 7% +37.3% 2665 ± 18% sched_debug.cfs_rq:/.exec_clock.stddev
47.72 ± 7% +18.8% 56.67 ± 2% sched_debug.cfs_rq:/.load_avg.avg
4.95 ± 9% +44.0% 7.14 ± 7% sched_debug.cfs_rq:/.load_avg.min
265960 ± 8% +36.3% 362493 ± 15% sched_debug.cfs_rq:/.min_vruntime.stddev
0.33 ± 6% -11.5% 0.29 ± 5% sched_debug.cfs_rq:/.nr_running.stddev
2.77 ± 7% +88.4% 5.23 ± 3% sched_debug.cfs_rq:/.nr_spread_over.avg
7.18 ± 5% +79.1% 12.86 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max
0.27 ± 52% +358.3% 1.25 ± 25% sched_debug.cfs_rq:/.nr_spread_over.min
1.57 ± 2% +40.9% 2.21 ± 2% sched_debug.cfs_rq:/.nr_spread_over.stddev
27.36 ± 5% +13.2% 30.98 ± 6% sched_debug.cfs_rq:/.removed.load_avg.avg
1263 ± 5% +14.1% 1442 ± 6% sched_debug.cfs_rq:/.removed.runnable_sum.avg
265962 ± 8% +36.3% 362499 ± 15% sched_debug.cfs_rq:/.spread0.stddev
8169 ± 28% +64.2% 13411 ± 21% sched_debug.cpu.avg_idle.min
298.80 ± 11% +57.4% 470.43 ± 28% sched_debug.cpu.cpu_load[0].max
7.46 ± 5% +34.4% 10.03 ± 12% sched_debug.cpu.cpu_load[1].avg
212.55 ± 15% +52.5% 324.14 ± 17% sched_debug.cpu.cpu_load[1].max
25.69 ± 9% +52.4% 39.15 ± 19% sched_debug.cpu.cpu_load[1].stddev
7.18 ± 3% +32.7% 9.53 ± 5% sched_debug.cpu.cpu_load[2].avg
151.27 ± 16% +51.9% 229.80 ± 11% sched_debug.cpu.cpu_load[2].max
19.45 ± 11% +50.2% 29.22 ± 10% sched_debug.cpu.cpu_load[2].stddev
6.92 ± 2% +29.5% 8.96 ± 4% sched_debug.cpu.cpu_load[3].avg
106.45 ± 23% +52.6% 162.50 ± 15% sched_debug.cpu.cpu_load[3].max
14.94 ± 15% +48.0% 22.10 ± 10% sched_debug.cpu.cpu_load[3].stddev
6.45 ± 2% +25.9% 8.12 ± 6% sched_debug.cpu.cpu_load[4].avg
79.82 ± 34% +56.2% 124.64 ± 25% sched_debug.cpu.cpu_load[4].max
11.70 ± 23% +47.3% 17.23 ± 17% sched_debug.cpu.cpu_load[4].stddev
422565 ± 24% +22.7% 518276 ± 15% sched_debug.cpu.load.max
0.00 ± 3% +23.4% 0.00 ± 14% sched_debug.cpu.next_balance.stddev
1.14 ± 5% +31.4% 1.50 ± 7% sched_debug.cpu.nr_running.avg
3.16 ± 2% +38.1% 4.36 ± 9% sched_debug.cpu.nr_running.max
0.71 ± 2% +33.7% 0.95 ± 7% sched_debug.cpu.nr_running.stddev
39284 ± 7% +47.6% 57979 ± 20% sched_debug.cpu.nr_switches.stddev
1658 ± 12% +73.9% 2884 ± 11% sched_debug.cpu.nr_uninterruptible.max
-1902 +212.1% -5938 sched_debug.cpu.nr_uninterruptible.min
716.66 ± 9% +107.5% 1487 ± 30% sched_debug.cpu.nr_uninterruptible.stddev
43221 ± 7% +46.5% 63340 ± 18% sched_debug.cpu.sched_count.stddev
351785 ± 3% -14.1% 302212 sched_debug.cpu.sched_goidle.min
21765 ± 7% +51.5% 32969 ± 24% sched_debug.cpu.sched_goidle.stddev
148360 +23.9% 183753 ± 2% sched_debug.cpu.ttwu_local.avg
152765 +24.4% 190065 ± 2% sched_debug.cpu.ttwu_local.max
2051 ± 10% +87.1% 3838 ± 32% sched_debug.cpu.ttwu_local.stddev
0.00 ± 25% +2.1e+05% 0.56 ± 46% sched_debug.rt_rq:/.rt_time.avg
0.02 ± 25% +2.1e+05% 49.46 ± 46% sched_debug.rt_rq:/.rt_time.max
0.00 ± 25% +2.1e+05% 5.24 ± 46% sched_debug.rt_rq:/.rt_time.stddev
20.84 ± 2% -4.4 16.42 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma
21.69 ± 2% -4.4 17.32 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables
17.27 ± 2% -3.4 13.86 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.exit_mmap
17.44 -3.4 14.05 ± 3% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.exit_mmap.mmput
36.96 -3.1 33.88 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
36.94 -3.1 33.87 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.69 -2.2 10.53 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.71 -2.2 10.55 ± 2% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.36 -2.0 11.41 perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
8.96 ± 2% -1.9 7.03 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma
8.63 ± 2% -1.9 6.71 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.__vma_adjust
13.61 -1.9 11.71 perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.11 -1.8 6.36 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process
8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.copy_process._do_fork.do_syscall_64
8.44 -1.7 6.70 ± 2% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.copy_process._do_fork
8.50 -1.7 6.76 ± 2% perf-profile.calltrace.cycles-pp.down_write.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.70 ± 2% -1.7 7.01 ± 3% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.flush_old_exec
9.06 -1.6 7.47 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.exit_mmap.mmput.do_exit
9.36 ± 2% -1.6 7.77 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.flush_old_exec.load_elf_binary
9.71 -1.5 8.21 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.exit_mmap.mmput.do_exit.do_group_exit
6.71 ± 2% -1.5 5.26 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.mprotect_fixup
6.77 ± 2% -1.4 5.32 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey
9.54 -1.3 8.23 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
10.17 -1.3 8.86 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64
9.31 -1.3 8.01 ± 4% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
10.04 -1.3 8.74 ± 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
7.63 ± 2% -1.3 6.33 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect
10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
10.04 -1.3 8.75 ± 3% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
7.34 -1.3 6.05 ± 2% perf-profile.calltrace.cycles-pp.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
7.71 ± 2% -1.3 6.43 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64
10.84 -1.2 9.62 perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
8.01 ± 2% -1.2 6.80 ± 2% perf-profile.calltrace.cycles-pp.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.09 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.17 -1.2 9.99 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fork
11.16 -1.2 9.99 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
11.15 -1.2 9.98 perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
11.80 -1.1 10.73 perf-profile.calltrace.cycles-pp.__libc_fork
4.28 -1.1 3.21 ± 3% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link
4.44 ± 2% -1.0 3.47 ± 2% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.unmap_region
4.45 -1.0 3.49 ± 2% perf-profile.calltrace.cycles-pp.down_write.unlink_file_vma.free_pgtables.unmap_region.do_munmap
11.18 -1.0 10.22 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler
4.48 -1.0 3.52 ± 2% perf-profile.calltrace.cycles-pp.unlink_file_vma.free_pgtables.unmap_region.do_munmap.mmap_region
11.19 -1.0 10.23 perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file
4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.vma_link.mmap_region.do_mmap
4.43 -0.9 3.48 ± 8% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.vma_link.mmap_region
4.67 -0.9 3.73 ± 2% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.do_munmap.mmap_region.do_mmap
4.45 -0.9 3.51 ± 9% perf-profile.calltrace.cycles-pp.down_write.vma_link.mmap_region.do_mmap.vm_mmap_pgoff
11.30 -0.9 10.38 perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve
4.85 -0.9 3.98 ± 2% perf-profile.calltrace.cycles-pp.unmap_region.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
5.40 -0.8 4.57 ± 2% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.down_write.__vma_adjust.__split_vma.do_munmap.mmap_region
2.25 -0.5 1.78 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.do_munmap
2.42 -0.4 1.98 ± 2% perf-profile.calltrace.cycles-pp.__vma_adjust.__split_vma.do_munmap.mmap_region.do_mmap
2.43 -0.4 1.99 ± 2% perf-profile.calltrace.cycles-pp.__split_vma.do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
13.17 -0.3 12.82 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
13.17 -0.3 12.83 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
2.69 ± 2% -0.1 2.56 perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.56 +0.2 0.72 ± 2% perf-profile.calltrace.cycles-pp._IO_default_xsputn
0.63 +0.2 0.78 ± 3% perf-profile.calltrace.cycles-pp.copy_strings.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.75 +0.2 0.92 ± 2% perf-profile.calltrace.cycles-pp.wp_page_copy.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
0.82 +0.2 1.01 ± 2% perf-profile.calltrace.cycles-pp.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.94 ± 2% +0.2 1.16 perf-profile.calltrace.cycles-pp._dl_addr
0.64 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.ret_from_fork
0.63 ± 2% +0.2 0.87 ± 4% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
0.67 ± 2% +0.2 0.91 ± 4% perf-profile.calltrace.cycles-pp.page_remove_rmap.unmap_page_range.unmap_vmas.exit_mmap.mmput
0.87 +0.2 1.12 ± 2% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.88 +0.2 1.13 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
0.70 ± 2% +0.3 0.96 ± 3% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec
1.10 +0.3 1.37 ± 2% perf-profile.calltrace.cycles-pp.__strcoll_l
0.70 ± 2% +0.3 0.97 ± 3% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.flush_old_exec.load_elf_binary
1.04 +0.3 1.32 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
0.89 +0.3 1.17 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.flush_old_exec
0.95 +0.3 1.25 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.flush_old_exec.load_elf_binary
1.15 +0.3 1.46 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.setlocale
4.73 +0.3 5.04 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.15 +0.3 1.46 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.setlocale
1.07 +0.3 1.39 perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
1.09 ± 2% +0.3 1.42 perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
1.11 ± 2% +0.3 1.45 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.mmap64
1.11 +0.3 1.44 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.mmap64
0.26 ±100% +0.3 0.60 perf-profile.calltrace.cycles-pp.copy_page_range.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.85 +0.3 5.19 perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.39 ± 57% +0.4 0.74 ± 3% perf-profile.calltrace.cycles-pp.wait4
1.20 +0.4 1.56 perf-profile.calltrace.cycles-pp.mmap64
13.89 +0.4 14.25 perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
13.91 +0.4 14.28 perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.78 ± 2% +0.4 2.19 perf-profile.calltrace.cycles-pp.vfprintf.__vsnprintf_chk
0.55 ± 3% +0.4 0.99 ± 3% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary
0.60 ± 4% +0.5 1.06 ± 3% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler
0.66 ± 3% +0.5 1.12 ± 2% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.elf_map.load_elf_binary.search_binary_handler.__do_execve_file
5.43 +0.5 5.91 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
5.45 +0.5 5.92 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
0.00 +0.5 0.51 perf-profile.calltrace.cycles-pp.page_fault.setlocale
0.00 +0.5 0.51 ± 3% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
5.58 +0.5 6.09 perf-profile.calltrace.cycles-pp.page_fault
0.00 +0.5 0.52 ± 4% perf-profile.calltrace.cycles-pp.smpboot_thread_fn.kthread.ret_from_fork
0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.37 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit
1.38 ± 2% +0.5 1.90 ± 5% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit
0.00 +0.5 0.53 ± 3% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.73 ± 2% +0.5 2.26 ± 3% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit
0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
0.00 +0.5 0.54 ± 3% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
2.69 +0.5 3.24 perf-profile.calltrace.cycles-pp.__vsnprintf_chk
1.80 ± 2% +0.6 2.35 ± 3% perf-profile.calltrace.cycles-pp.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit
0.00 +0.6 0.56 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +0.6 0.56 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
2.46 +0.6 3.03 ± 2% perf-profile.calltrace.cycles-pp.setlocale
0.00 +0.6 0.58 ± 3% perf-profile.calltrace.cycles-pp.write
0.00 +0.6 0.58 ± 2% perf-profile.calltrace.cycles-pp.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait4
0.12 ±173% +0.6 0.71 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.6 0.61 ± 3% perf-profile.calltrace.cycles-pp.read
0.00 +0.6 0.61 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.62 ± 5% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.6 0.63 ± 4% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
1.63 ± 2% +0.7 2.31 ± 5% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap
0.00 +0.7 0.74 ± 3% perf-profile.calltrace.cycles-pp.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.elf_map
0.12 ±173% +0.8 0.91 ± 3% perf-profile.calltrace.cycles-pp.do_munmap.vm_munmap.elf_map.load_elf_binary.search_binary_handler
2.05 ± 2% +0.8 2.84 ± 4% perf-profile.calltrace.cycles-pp.tlb_flush_mmu_free.arch_tlb_finish_mmu.tlb_finish_mmu.exit_mmap.mmput
0.13 ±173% +0.8 0.92 ± 4% perf-profile.calltrace.cycles-pp.vm_munmap.elf_map.load_elf_binary.search_binary_handler.__do_execve_file
15.67 +0.8 16.48 perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
15.68 +0.8 16.50 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
15.71 +0.8 16.53 perf-profile.calltrace.cycles-pp.execve
1.16 ± 3% +0.9 2.05 ± 3% perf-profile.calltrace.cycles-pp.elf_map.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve
42.48 -8.6 33.85 ± 3% perf-profile.children.cycles-pp.osq_lock
44.24 -8.5 35.76 ± 2% perf-profile.children.cycles-pp.rwsem_down_write_failed
44.25 -8.5 35.78 ± 2% perf-profile.children.cycles-pp.call_rwsem_down_write_failed
44.77 -8.4 36.37 ± 2% perf-profile.children.cycles-pp.down_write
22.58 -4.1 18.50 ± 2% perf-profile.children.cycles-pp.unlink_file_vma
24.10 -3.9 20.25 ± 2% perf-profile.children.cycles-pp.free_pgtables
13.81 -1.8 11.97 perf-profile.children.cycles-pp.ksys_mmap_pgoff
69.44 -1.8 67.68 perf-profile.children.cycles-pp.do_syscall_64
69.50 -1.8 67.74 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
10.31 ± 2% -1.5 8.80 ± 2% perf-profile.children.cycles-pp.__vma_adjust
13.93 -1.5 12.43 perf-profile.children.cycles-pp.mmap_region
10.40 -1.5 8.90 ± 2% perf-profile.children.cycles-pp.__split_vma
14.23 -1.4 12.80 perf-profile.children.cycles-pp.do_mmap
14.44 -1.4 13.06 perf-profile.children.cycles-pp.vm_mmap_pgoff
9.67 -1.3 8.35 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
24.58 -1.3 23.26 perf-profile.children.cycles-pp.mmput
24.55 -1.3 23.24 perf-profile.children.cycles-pp.exit_mmap
9.44 -1.3 8.12 ± 4% perf-profile.children.cycles-pp.intel_idle
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.secondary_startup_64
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
10.17 -1.3 8.86 ± 4% perf-profile.children.cycles-pp.do_idle
10.04 -1.3 8.75 ± 3% perf-profile.children.cycles-pp.start_secondary
11.07 -1.2 9.82 perf-profile.children.cycles-pp.copy_process
8.02 ± 2% -1.2 6.80 ± 2% perf-profile.children.cycles-pp.mprotect_fixup
11.38 -1.2 10.18 perf-profile.children.cycles-pp._do_fork
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.do_mprotect_pkey
8.10 ± 2% -1.2 6.90 ± 2% perf-profile.children.cycles-pp.__x64_sys_mprotect
11.84 -1.1 10.77 perf-profile.children.cycles-pp.__libc_fork
11.51 -0.9 10.57 perf-profile.children.cycles-pp.flush_old_exec
8.20 -0.8 7.44 perf-profile.children.cycles-pp.do_munmap
5.36 -0.6 4.79 perf-profile.children.cycles-pp.unmap_region
5.70 ± 2% -0.5 5.21 perf-profile.children.cycles-pp.filemap_map_pages
5.81 -0.4 5.39 perf-profile.children.cycles-pp.vma_link
0.29 ± 3% -0.1 0.15 perf-profile.children.cycles-pp.radix_tree_next_chunk
0.39 ± 3% -0.0 0.36 perf-profile.children.cycles-pp.time
0.16 ± 4% -0.0 0.13 perf-profile.children.cycles-pp.find_busiest_group
0.30 -0.0 0.29 perf-profile.children.cycles-pp.load_balance
0.23 -0.0 0.21 ± 2% perf-profile.children.cycles-pp.__strcasecmp
0.17 -0.0 0.15 ± 3% perf-profile.children.cycles-pp.fopen
0.05 +0.0 0.06 perf-profile.children.cycles-pp.__put_task_struct
0.05 +0.0 0.06 perf-profile.children.cycles-pp.vm_brk_flags
0.05 +0.0 0.06 perf-profile.children.cycles-pp.__perf_event__output_id_sample
0.05 +0.0 0.06 perf-profile.children.cycles-pp.security_mmap_addr
0.05 +0.0 0.06 perf-profile.children.cycles-pp.selinux_file_open
0.06 +0.0 0.07 perf-profile.children.cycles-pp.__switch_to
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__x64_sys_pipe
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.do_pipe2
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.unmap_single_vma
0.07 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__errno_location
0.05 +0.0 0.06 ± 6% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.perf_event_task_output
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.load_elf_phdrs
0.17 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending
0.06 ± 6% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.cpumask_next
0.06 +0.0 0.07 ± 5% perf-profile.children.cycles-pp.kfree
0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.do_signal
0.08 ± 6% +0.0 0.09 perf-profile.children.cycles-pp.memcpy
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.__pipe
0.08 +0.0 0.10 ± 5% perf-profile.children.cycles-pp.vfs_getattr
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.security_inode_getattr
0.08 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.avc_has_perm
0.07 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.fsnotify
0.07 +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__tsearch
0.07 ± 7% +0.0 0.08 perf-profile.children.cycles-pp.memchr
0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.file_has_perm
0.05 ± 8% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__alloc_fd
0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.free_unref_page_commit
0.05 +0.0 0.07 ± 7% perf-profile.children.cycles-pp.up_read
0.29 +0.0 0.30 ± 2% perf-profile.children.cycles-pp.save_stack_trace_tsk
0.13 ± 3% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.pipe_wait
0.06 +0.0 0.08 ± 6% perf-profile.children.cycles-pp.__put_anon_vma
0.06 ± 11% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.wake_up_page_bit
0.05 ± 9% +0.0 0.07 perf-profile.children.cycles-pp.dup_fd
0.19 ± 2% +0.0 0.21 perf-profile.children.cycles-pp.dequeue_entity
0.10 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.move_queued_task
0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.__list_add_valid
0.08 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.find_next_bit
0.07 ± 5% +0.0 0.09 ± 7% perf-profile.children.cycles-pp.arch_dup_task_struct
0.11 +0.0 0.13 ± 3% perf-profile.children.cycles-pp.find_get_entry
0.07 ± 10% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.cp_new_stat
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.load_new_mm_cr3
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.set_next_entity
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.__install_special_mapping
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp._IO_setb
0.07 ± 6% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.trailing_symlink
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.setup_new_exec
0.06 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.perf_event_task
0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.__legitimize_mnt
0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.vma_gap_callbacks_rotate
0.05 +0.0 0.07 ± 6% perf-profile.children.cycles-pp.security_file_free
0.05 ± 8% +0.0 0.07 perf-profile.children.cycles-pp.down_write_killable
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.available_idle_cpu
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp._vm_normal_page
0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.expand_downwards
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp._copy_to_user
0.06 +0.0 0.08 ± 5% perf-profile.children.cycles-pp.__unlock_page_memcg
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.security_file_alloc
0.17 ± 2% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.osq_unlock
0.10 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.finish_fault
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.may_open
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.perf_output_copy
0.10 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.selinux_mmap_file
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.try_charge
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.___slab_alloc
0.08 ± 6% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__pthread_once_slow
0.07 +0.0 0.09 perf-profile.children.cycles-pp.move_page_tables
0.07 +0.0 0.09 perf-profile.children.cycles-pp.touch_atime
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.queue_work_on
0.09 ± 7% +0.0 0.11 perf-profile.children.cycles-pp.filp_close
0.08 ± 8% +0.0 0.10 perf-profile.children.cycles-pp.selinux_vm_enough_memory
0.09 ± 4% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.sync_regs
0.08 +0.0 0.10 perf-profile.children.cycles-pp.__inode_security_revalidate
0.07 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles-pp.prepend_name
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.complete_walk
0.06 +0.0 0.08 ± 8% perf-profile.children.cycles-pp.unlock_page_memcg
0.06 ± 11% +0.0 0.08 perf-profile.children.cycles-pp.cred_has_capability
0.06 +0.0 0.08 perf-profile.children.cycles-pp.security_file_open
0.06 +0.0 0.08 perf-profile.children.cycles-pp.__queue_work
0.05 ± 8% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.copyin
0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_stage2
0.06 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.simple_write_begin
0.06 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.security_file_permission
0.14 ± 5% +0.0 0.16 ± 2% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.13 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__anon_vma_prepare
0.10 ± 7% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.migration_cpu_stop
0.09 ± 7% +0.0 0.11 ± 3% perf-profile.children.cycles-pp._IO_file_close
0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.__call_rcu
0.07 +0.0 0.09 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc_trace
0.11 ± 4% +0.0 0.13 perf-profile.children.cycles-pp.do_brk_flags
0.10 ± 8% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.prepare_creds
0.09 +0.0 0.11 ± 3% perf-profile.children.cycles-pp.put_task_stack
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__slab_alloc
0.09 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__x64_sys_brk
0.08 ± 5% +0.0 0.10 perf-profile.children.cycles-pp.map_vdso
0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.get_zeroed_page
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.anon_vma_interval_tree_remove
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__libc_sigaction
0.11 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.cpu_stopper_thread
0.10 ± 5% +0.0 0.12 ± 5% perf-profile.children.cycles-pp.prepare_binprm
0.09 +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__d_alloc
0.09 ± 4% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.simple_lookup
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.vm_area_alloc
0.04 ± 57% +0.0 0.06 ± 6% perf-profile.children.cycles-pp.alloc_pid
0.11 ± 4% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.brk
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.memset_erms
0.11 ± 3% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.__get_user_8
0.09 ± 5% +0.0 0.11 ± 3% perf-profile.children.cycles-pp.evict
0.15 ± 3% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.avc_has_perm_noaudit
0.13 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.sched_move_task
0.11 ± 7% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.__dentry_kill
0.10 ± 4% +0.0 0.13 ± 5% perf-profile.children.cycles-pp.unmapped_area_topdown
0.10 ± 4% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.__snprintf_chk
0.09 ± 4% +0.0 0.11 ± 7% perf-profile.children.cycles-pp.select_idle_sibling
0.08 ± 5% +0.0 0.11 ± 8% perf-profile.children.cycles-pp.lockref_get_not_dead
0.07 +0.0 0.10 ± 4% perf-profile.children.cycles-pp.d_add
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.do_huge_pmd_anonymous_page
0.11 +0.0 0.14 ± 3% perf-profile.children.cycles-pp.fput
0.11 ± 6% +0.0 0.14 ± 3% perf-profile.children.cycles-pp._exit
0.12 ± 6% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.security_vm_enough_memory_mm
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.free_pgd_range
0.11 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.vm_area_dup
0.10 ± 7% +0.0 0.13 perf-profile.children.cycles-pp.vma_interval_tree_augment_rotate
0.10 ± 5% +0.0 0.12 ± 4% perf-profile.children.cycles-pp.rcu_all_qs
0.09 ± 4% +0.0 0.12 ± 3% perf-profile.children.cycles-pp.munmap
0.08 ± 6% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__mmdrop
0.07 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.truncate_inode_pages_range
0.04 ± 57% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.12 ± 3% +0.0 0.15 ± 2% perf-profile.children.cycles-pp.__lru_cache_add
0.11 ± 4% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.prepend_path
0.14 ± 3% +0.0 0.17 ± 6% perf-profile.children.cycles-pp.security_mmap_file
0.14 ± 3% +0.0 0.17 ± 7% perf-profile.children.cycles-pp.mem_cgroup_try_charge
0.12 ± 3% +0.0 0.15 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.13 +0.0 0.16 ± 2% perf-profile.children.cycles-pp.lockref_put_or_lock
0.14 ± 6% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.kernel_read
0.12 ± 3% +0.0 0.15 ± 3% perf-profile.children.cycles-pp.__put_user_4
0.09 +0.0 0.12 ± 8% perf-profile.children.cycles-pp.file_free_rcu
0.11 ± 4% +0.0 0.15 ± 5% perf-profile.children.cycles-pp.__x64_sys_close
0.20 ± 3% +0.0 0.23 ± 2% perf-profile.children.cycles-pp.update_load_avg
0.16 +0.0 0.20 ± 5% perf-profile.children.cycles-pp.vfs_statx_fd
0.17 ± 3% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_path
0.15 ± 3% +0.0 0.19 ± 3% perf-profile.children.cycles-pp.stop_one_cpu
0.16 +0.0 0.20 ± 2% perf-profile.children.cycles-pp.anon_vma_clone
0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.vma_compute_subtree_gap
0.16 ± 2% +0.0 0.20 ± 2% perf-profile.children.cycles-pp.getenv
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp._init
0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.__pud_alloc
0.12 ± 4% +0.0 0.16 ± 4% perf-profile.children.cycles-pp.__getrlimit
0.09 +0.0 0.12 ± 4% perf-profile.children.cycles-pp.wake_q_add
0.30 ± 2% +0.0 0.34 ± 3% perf-profile.children.cycles-pp.strchrnul
0.18 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.open_exec
0.14 +0.0 0.18 ± 2% perf-profile.children.cycles-pp.shift_arg_pages
0.14 ± 5% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.preempt_schedule_common
0.19 ± 4% +0.0 0.23 perf-profile.children.cycles-pp.getname_flags
0.17 ± 4% +0.0 0.21 ± 2% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.14 ± 3% +0.0 0.18 ± 5% perf-profile.children.cycles-pp.__might_fault
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.perf_event_mmap_output
0.13 ± 6% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.dentry_kill
0.13 ± 5% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.13 ± 3% +0.0 0.17 ± 3% perf-profile.children.cycles-pp.do_unlinkat
0.11 +0.0 0.15 ± 2% perf-profile.children.cycles-pp.inode_permission
0.14 ± 5% +0.0 0.18 perf-profile.children.cycles-pp.free_pcppages_bulk
0.08 +0.0 0.12 ± 11% perf-profile.children.cycles-pp.rcu_cblist_dequeue
0.23 ± 2% +0.0 0.27 ± 4% perf-profile.children.cycles-pp.ptep_clear_flush
0.18 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.change_protection_range
0.16 ± 2% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.memcpy_erms
0.15 ± 3% +0.0 0.20 ± 4% perf-profile.children.cycles-pp.pagecache_get_page
0.14 ± 3% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.legitimize_path
0.39 ± 2% +0.0 0.43 ± 3% perf-profile.children.cycles-pp.malloc
0.54 +0.0 0.58 perf-profile.children.cycles-pp.ttwu_do_activate
0.25 ± 3% +0.0 0.29 perf-profile.children.cycles-pp.dequeue_task_fair
0.19 ± 2% +0.0 0.23 ± 3% perf-profile.children.cycles-pp._copy_from_user
0.18 ± 2% +0.0 0.22 ± 3% perf-profile.children.cycles-pp.vmacache_find
0.18 ± 2% +0.0 0.22 perf-profile.children.cycles-pp.open64
0.14 ± 3% +0.0 0.18 perf-profile.children.cycles-pp.lock_page_memcg
0.01 ±173% +0.0 0.05 ± 9% perf-profile.children.cycles-pp.__follow_mount_rcu
0.21 ± 6% +0.0 0.26 ± 3% perf-profile.children.cycles-pp._IO_file_xsputn
0.17 ± 3% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.signal_wake_up_state
0.14 ± 3% +0.0 0.18 ± 3% perf-profile.children.cycles-pp.count
0.13 ± 3% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.unlinkat
0.11 ± 7% +0.0 0.15 ± 9% perf-profile.children.cycles-pp.__get_vm_area_node
0.09 ± 4% +0.0 0.14 ± 13% perf-profile.children.cycles-pp.alloc_vmap_area
0.20 ± 2% +0.0 0.24 ± 3% perf-profile.children.cycles-pp.__vma_link_rb
0.17 ± 2% +0.0 0.21 ± 3% perf-profile.children.cycles-pp.schedule_tail
0.14 ± 3% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__rb_erase_color
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.insert_vm_struct
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.put_prev_entity
0.19 ± 2% +0.0 0.24 ± 2% perf-profile.children.cycles-pp.copy_strings_kernel
0.19 ± 2% +0.0 0.24 ± 5% perf-profile.children.cycles-pp.setup_arg_pages
0.17 ± 4% +0.0 0.22 perf-profile.children.cycles-pp.__pmd_alloc
0.15 ± 3% +0.0 0.19 ± 5% perf-profile.children.cycles-pp.unlazy_walk
0.14 ± 5% +0.0 0.19 ± 4% perf-profile.children.cycles-pp.__get_free_pages
0.01 ±173% +0.0 0.06 perf-profile.children.cycles-pp.__free_pages_ok
0.15 +0.0 0.20 ± 4% perf-profile.children.cycles-pp.mark_page_accessed
0.15 ± 2% +0.0 0.20 ± 3% perf-profile.children.cycles-pp.d_alloc
0.57 +0.0 0.61 perf-profile.children.cycles-pp.enqueue_entity
0.23 +0.0 0.28 ± 4% perf-profile.children.cycles-pp.__do_sys_newfstat
0.16 ± 5% +0.0 0.21 ± 6% perf-profile.children.cycles-pp.__generic_file_write_iter
0.15 ± 7% +0.0 0.20 ± 5% perf-profile.children.cycles-pp.generic_perform_write
0.00 +0.1 0.05 perf-profile.children.cycles-pp.vma_merge
0.00 +0.1 0.05 perf-profile.children.cycles-pp.free_one_page
0.00 +0.1 0.05 perf-profile.children.cycles-pp.rcu_segcblist_enqueue
0.00 +0.1 0.05 perf-profile.children.cycles-pp.__fget_light
0.17 ± 7% +0.1 0.22 ± 5% perf-profile.children.cycles-pp.generic_file_write_iter
0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.anon_vma_fork
0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay
0.19 +0.1 0.24 ± 3% perf-profile.children.cycles-pp.finish_task_switch
0.18 ± 2% +0.1 0.24 ± 3% perf-profile.children.cycles-pp.__send_signal
0.18 ± 2% +0.1 0.23 ± 2% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__pagevec_release
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__perf_event_header__init_id
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.check_preempt_curr
0.21 ± 2% +0.1 0.27 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function
0.21 ± 3% +0.1 0.27 ± 3% perf-profile.children.cycles-pp.generic_file_read_iter
0.30 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.wake_up_new_task
0.25 +0.1 0.30 perf-profile.children.cycles-pp.get_unmapped_area
0.19 ± 3% +0.1 0.24 ± 4% perf-profile.children.cycles-pp.get_user_arg_ptr
0.17 ± 2% +0.1 0.22 ± 3% perf-profile.children.cycles-pp.pgd_alloc
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.page_add_new_anon_rmap
0.21 ± 2% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__might_sleep
0.31 +0.1 0.36 perf-profile.children.cycles-pp.native_flush_tlb_one_user
0.26 ± 3% +0.1 0.31 ± 2% perf-profile.children.cycles-pp.do_open_execat
0.20 ± 4% +0.1 0.25 ± 7% perf-profile.children.cycles-pp.__vmalloc_node_range
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__mod_node_page_state
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert
0.22 +0.1 0.28 ± 4% perf-profile.children.cycles-pp.__wake_up_common_lock
0.22 ± 3% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.do_notify_parent
0.28 ± 2% +0.1 0.34 ± 5% perf-profile.children.cycles-pp.__rb_insert_augmented
0.23 ± 2% +0.1 0.29 perf-profile.children.cycles-pp.strlen
0.19 ± 2% +0.1 0.25 ± 5% perf-profile.children.cycles-pp.copyout
0.19 ± 4% +0.1 0.25 ± 3% perf-profile.children.cycles-pp.mm_init
0.64 +0.1 0.70 perf-profile.children.cycles-pp.enqueue_task_fair
0.29 ± 2% +0.1 0.35 ± 3% perf-profile.children.cycles-pp.___perf_sw_event
0.24 ± 2% +0.1 0.30 ± 3% perf-profile.children.cycles-pp.terminate_walk
0.26 ± 3% +0.1 0.33 perf-profile.children.cycles-pp.free_unref_page_list
0.23 +0.1 0.30 ± 5% perf-profile.children.cycles-pp.__wake_up_common
0.32 +0.1 0.38 perf-profile.children.cycles-pp.__perf_sw_event
0.28 ± 2% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.get_user_pages_remote
0.25 ± 2% +0.1 0.32 ± 4% perf-profile.children.cycles-pp.pipe_write
0.22 ± 3% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.copy_page_to_iter
0.23 ± 2% +0.1 0.29 ± 2% perf-profile.children.cycles-pp._IO_file_open
0.32 ± 3% +0.1 0.38 ± 2% perf-profile.children.cycles-pp._fini
0.28 +0.1 0.34 ± 4% perf-profile.children.cycles-pp.__get_user_pages
0.34 ± 2% +0.1 0.41 perf-profile.children.cycles-pp.unlock_page
0.30 ± 2% +0.1 0.36 ± 4% perf-profile.children.cycles-pp.__pte_alloc
0.32 +0.1 0.39 perf-profile.children.cycles-pp.vma_interval_tree_remove
0.29 ± 2% +0.1 0.36 ± 3% perf-profile.children.cycles-pp.pipe_read
0.23 +0.1 0.30 ± 2% perf-profile.children.cycles-pp.do_dentry_open
0.10 ± 5% +0.1 0.16 ± 10% perf-profile.children.cycles-pp.run_ksoftirqd
0.22 ± 3% +0.1 0.29 ± 3% perf-profile.children.cycles-pp.d_alloc_parallel
0.39 +0.1 0.46 ± 3% perf-profile.children.cycles-pp.__fxstat64
0.34 +0.1 0.41 perf-profile.children.cycles-pp.flush_tlb_func_common
0.27 ± 3% +0.1 0.34 ± 3% perf-profile.children.cycles-pp.__d_lookup_rcu
0.34 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._IO_padn
0.16 ± 2% +0.1 0.23 ± 3% perf-profile.children.cycles-pp.release_task
0.24 +0.1 0.31 ± 3% perf-profile.children.cycles-pp.__lookup_slow
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.do_prlimit
0.32 +0.1 0.40 ± 2% perf-profile.children.cycles-pp.selinux_inode_permission
0.39 ± 2% +0.1 0.46 ± 2% perf-profile.children.cycles-pp.find_vma
0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.__x64_sys_getrlimit
0.59 +0.1 0.67 ± 2% perf-profile.children.cycles-pp.schedule
0.28 +0.1 0.36 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid
0.35 ± 2% +0.1 0.42 ± 2% perf-profile.children.cycles-pp.security_inode_permission
0.32 ± 3% +0.1 0.40 ± 3% perf-profile.children.cycles-pp.__do_sys_newstat
0.27 ± 3% +0.1 0.35 ± 2% perf-profile.children.cycles-pp.lookup_slow
0.33 ± 2% +0.1 0.41 ± 2% perf-profile.children.cycles-pp._cond_resched
0.32 +0.1 0.40 ± 3% perf-profile.children.cycles-pp.remove_vma
0.30 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.perf_iterate_sb
0.13 ± 5% +0.1 0.21 ± 14% perf-profile.children.cycles-pp.find_vmap_area
0.33 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.vfs_statx
0.39 ± 2% +0.1 0.47 ± 2% perf-profile.children.cycles-pp._IO_fwrite
0.29 ± 2% +0.1 0.38 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop
0.18 ± 8% +0.1 0.27 ± 12% perf-profile.children.cycles-pp.__vunmap
0.43 +0.1 0.52 ± 2% perf-profile.children.cycles-pp.flush_tlb_mm_range
0.37 ± 3% +0.1 0.46 ± 4% perf-profile.children.cycles-pp.___might_sleep
0.40 ± 3% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.__slab_free
0.29 +0.1 0.38 ± 2% perf-profile.children.cycles-pp.create_elf_tables
0.18 ± 7% +0.1 0.27 ± 10% perf-profile.children.cycles-pp.free_work
0.37 ± 2% +0.1 0.46 perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.18 ± 4% +0.1 0.28 ± 4% perf-profile.children.cycles-pp.wait_consider_task
0.39 ± 2% +0.1 0.48 ± 3% perf-profile.children.cycles-pp.__xstat64
0.39 +0.1 0.48 ± 2% perf-profile.children.cycles-pp.pte_alloc_one
0.29 ± 2% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.__alloc_file
0.40 ± 2% +0.1 0.49 ± 2% perf-profile.children.cycles-pp.unlink_anon_vmas
0.32 ± 2% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.alloc_empty_file
0.44 +0.1 0.54 perf-profile.children.cycles-pp.page_add_file_rmap
0.41 ± 2% +0.1 0.51 ± 2% perf-profile.children.cycles-pp.sched_exec
0.39 +0.1 0.48 perf-profile.children.cycles-pp.copy_page
0.31 ± 3% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.52 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret
0.20 ± 6% +0.1 0.30 ± 9% perf-profile.children.cycles-pp.process_one_work
0.36 ± 2% +0.1 0.47 ± 3% perf-profile.children.cycles-pp.__fput
0.51 +0.1 0.62 ± 2% perf-profile.children.cycles-pp.copy_page_range
0.40 ± 2% +0.1 0.50 ± 3% perf-profile.children.cycles-pp.__clear_user
0.36 ± 2% +0.1 0.47 perf-profile.children.cycles-pp.__x64_sys_munmap
0.35 +0.1 0.46 perf-profile.children.cycles-pp.strnlen_user
0.23 ± 5% +0.1 0.34 ± 9% perf-profile.children.cycles-pp.worker_thread
0.48 ± 2% +0.1 0.59 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.40 ± 2% +0.1 0.51 ± 3% perf-profile.children.cycles-pp.dput
0.44 +0.1 0.55 ± 4% perf-profile.children.cycles-pp.lookup_fast
1.14 +0.1 1.25 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start
0.42 ± 2% +0.1 0.54 ± 2% perf-profile.children.cycles-pp.free_pages_and_swap_cache
1.08 ± 2% +0.1 1.20 ± 2% perf-profile.children.cycles-pp.__sched_text_start
0.51 +0.1 0.63 ± 2% perf-profile.children.cycles-pp.ksys_read
0.40 +0.1 0.52 ± 4% perf-profile.children.cycles-pp.smpboot_thread_fn
0.46 +0.1 0.58 ± 3% perf-profile.children.cycles-pp.write
0.49 +0.1 0.62 ± 3% perf-profile.children.cycles-pp.read
0.42 ± 2% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.__vfs_write
0.44 +0.1 0.57 ± 2% perf-profile.children.cycles-pp.task_work_run
0.99 ± 2% +0.1 1.12 ± 4% perf-profile.children.cycles-pp.rcu_process_callbacks
0.55 ± 2% +0.1 0.67 ± 2% perf-profile.children.cycles-pp.kmem_cache_free
0.54 +0.1 0.66 ± 3% perf-profile.children.cycles-pp.__vfs_read
0.62 +0.1 0.75 ± 3% perf-profile.children.cycles-pp.select_task_rq_fair
0.46 +0.1 0.59 ± 4% perf-profile.children.cycles-pp.vfs_write
0.45 ± 2% +0.1 0.58 ± 2% perf-profile.children.cycles-pp.do_faccessat
0.47 +0.1 0.60 ± 3% perf-profile.children.cycles-pp.ksys_write
0.15 ± 6% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.queued_write_lock_slowpath
0.14 ± 8% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.queued_read_lock_slowpath
0.51 ± 3% +0.1 0.65 perf-profile.children.cycles-pp.kmem_cache_alloc
0.58 +0.1 0.72 ± 2% perf-profile.children.cycles-pp.__entry_SYSCALL_64_trampoline
0.62 +0.1 0.77 perf-profile.children.cycles-pp.vfs_read
0.63 +0.2 0.78 ± 2% perf-profile.children.cycles-pp.perf_event_mmap
0.62 +0.2 0.77 ± 2% perf-profile.children.cycles-pp.alloc_pages_vma
0.35 ± 4% +0.2 0.51 ± 4% perf-profile.children.cycles-pp.lru_add_drain
0.35 ± 3% +0.2 0.52 ± 5% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.60 ± 2% +0.2 0.78 ± 2% perf-profile.children.cycles-pp.path_lookupat
0.62 ± 2% +0.2 0.80 ± 2% perf-profile.children.cycles-pp.filename_lookup
0.43 ± 2% +0.2 0.61 ± 3% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.64 +0.2 0.83 ± 3% perf-profile.children.cycles-pp.walk_component
0.75 ± 2% +0.2 0.95 ± 2% perf-profile.children.cycles-pp._IO_default_xsputn
0.86 +0.2 1.07 ± 3% perf-profile.children.cycles-pp.clear_page_erms
0.84 +0.2 1.04 ± 3% perf-profile.children.cycles-pp.copy_strings
0.41 ± 4% +0.2 0.62 ± 5% perf-profile.children.cycles-pp.do_wait
0.43 ± 5% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.__do_sys_wait4
0.42 ± 4% +0.2 0.64 ± 5% perf-profile.children.cycles-pp.kernel_wait4
0.95 ± 2% +0.2 1.16 perf-profile.children.cycles-pp._dl_addr
0.95 +0.2 1.17 ± 2% perf-profile.children.cycles-pp.wp_page_copy
0.80 +0.2 1.02 ± 2% perf-profile.children.cycles-pp.link_path_walk
0.93 +0.2 1.16 perf-profile.children.cycles-pp.vma_interval_tree_insert
0.95 +0.2 1.18 perf-profile.children.cycles-pp.alloc_set_pte
0.51 ± 3% +0.2 0.74 ± 3% perf-profile.children.cycles-pp.wait4
0.63 ± 2% +0.2 0.87 ± 4% perf-profile.children.cycles-pp.kthread
1.04 +0.2 1.27 ± 2% perf-profile.children.cycles-pp.do_wp_page
1.29 +0.2 1.54 ± 3% perf-profile.children.cycles-pp.wake_up_q
2.06 +0.3 2.33 ± 2% perf-profile.children.cycles-pp.up_write
9.02 +0.3 9.29 perf-profile.children.cycles-pp.handle_mm_fault
1.53 +0.3 1.79 ± 2% perf-profile.children.cycles-pp.rwsem_wake
0.81 +0.3 1.08 ± 3% perf-profile.children.cycles-pp.ret_from_fork
1.53 +0.3 1.81 ± 2% perf-profile.children.cycles-pp.call_rwsem_wake
1.10 +0.3 1.38 ± 2% perf-profile.children.cycles-pp.__strcoll_l
0.81 ± 2% +0.3 1.08 ± 4% perf-profile.children.cycles-pp._raw_spin_lock
0.93 +0.3 1.23 perf-profile.children.cycles-pp.rwsem_spin_on_owner
1.24 +0.3 1.54 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist
1.35 +0.3 1.69 ± 3% perf-profile.children.cycles-pp.__alloc_pages_nodemask
1.68 +0.4 2.04 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
1.22 +0.4 1.58 perf-profile.children.cycles-pp.mmap64
14.16 +0.4 14.53 perf-profile.children.cycles-pp.load_elf_binary
1.05 ± 2% +0.4 1.42 ± 4% perf-profile.children.cycles-pp.page_remove_rmap
14.19 +0.4 14.56 perf-profile.children.cycles-pp.search_binary_handler
2.09 ± 2% +0.4 2.52 perf-profile.children.cycles-pp.vfprintf
9.80 +0.5 10.26 perf-profile.children.cycles-pp.__do_page_fault
9.82 +0.5 10.29 perf-profile.children.cycles-pp.do_page_fault
1.27 ± 2% +0.5 1.79 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.96 +0.5 2.49 ± 2% perf-profile.children.cycles-pp.path_openat
2.01 +0.5 2.54 perf-profile.children.cycles-pp.do_sys_open
1.98 +0.5 2.52 ± 2% perf-profile.children.cycles-pp.do_filp_open
0.86 ± 2% +0.5 1.40 ± 2% perf-profile.children.cycles-pp.vm_munmap
10.22 +0.6 10.78 perf-profile.children.cycles-pp.page_fault
2.73 +0.6 3.29 perf-profile.children.cycles-pp.__vsnprintf_chk
2.76 +0.6 3.39 ± 2% perf-profile.children.cycles-pp.setlocale
1.77 ± 2% +0.7 2.50 ± 4% perf-profile.children.cycles-pp.release_pages
1.47 +0.8 2.27 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
2.12 ± 2% +0.8 2.93 ± 4% perf-profile.children.cycles-pp.tlb_flush_mmu_free
15.71 +0.8 16.53 perf-profile.children.cycles-pp.execve
16.01 +0.8 16.84 perf-profile.children.cycles-pp.__do_execve_file
16.02 +0.8 16.86 perf-profile.children.cycles-pp.__x64_sys_execve
2.24 ± 2% +0.8 3.09 ± 4% perf-profile.children.cycles-pp.arch_tlb_finish_mmu
2.25 ± 2% +0.8 3.10 ± 4% perf-profile.children.cycles-pp.tlb_finish_mmu
2.77 +0.9 3.62 ± 3% perf-profile.children.cycles-pp.unmap_page_range
2.89 +0.9 3.77 ± 3% perf-profile.children.cycles-pp.unmap_vmas
1.18 ± 3% +0.9 2.09 ± 2% perf-profile.children.cycles-pp.elf_map
41.69 -8.5 33.23 ± 3% perf-profile.self.cycles-pp.osq_lock
9.44 -1.3 8.12 ± 4% perf-profile.self.cycles-pp.intel_idle
4.14 ± 2% -0.6 3.53 perf-profile.self.cycles-pp.filemap_map_pages
0.54 ± 2% -0.2 0.37 perf-profile.self.cycles-pp.rwsem_down_write_failed
0.28 ± 3% -0.1 0.15 ± 2% perf-profile.self.cycles-pp.radix_tree_next_chunk
0.13 ± 6% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.find_busiest_group
0.05 +0.0 0.06 perf-profile.self.cycles-pp.anon_vma_fork
0.05 +0.0 0.06 perf-profile.self.cycles-pp.__call_rcu
0.05 +0.0 0.06 perf-profile.self.cycles-pp.__unlock_page_memcg
0.06 +0.0 0.07 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.06 +0.0 0.07 perf-profile.self.cycles-pp.do_wp_page
0.06 +0.0 0.07 perf-profile.self.cycles-pp.kfree
0.06 +0.0 0.07 perf-profile.self.cycles-pp.__switch_to
0.07 ± 5% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.find_next_bit
0.07 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__tsearch
0.05 ± 8% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.path_openat
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.d_alloc_parallel
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.unlock_page_memcg
0.05 +0.0 0.06 ± 6% perf-profile.self.cycles-pp.up_read
0.06 +0.0 0.07 ± 5% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.06 ± 6% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.__perf_sw_event
0.06 ± 7% +0.0 0.07 perf-profile.self.cycles-pp.strncpy_from_user
0.09 ± 4% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.update_load_avg
0.07 +0.0 0.09 ± 5% perf-profile.self.cycles-pp.find_get_entry
0.05 +0.0 0.07 ± 7% perf-profile.self.cycles-pp.__d_alloc
0.05 ± 9% +0.0 0.07 perf-profile.self.cycles-pp.create_elf_tables
0.17 ± 3% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.osq_unlock
0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp.__alloc_pages_nodemask
0.07 ± 5% +0.0 0.09 perf-profile.self.cycles-pp.getenv
0.07 ± 11% +0.0 0.09 perf-profile.self.cycles-pp._vm_normal_page
0.11 ± 7% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.__sched_text_start
0.09 ± 4% +0.0 0.11 ± 6% perf-profile.self.cycles-pp._cond_resched
0.09 ± 4% +0.0 0.11 perf-profile.self.cycles-pp.__list_add_valid
0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.perf_iterate_sb
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__vma_adjust
0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.sync_regs
0.07 ± 7% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.load_new_mm_cr3
0.06 ± 6% +0.0 0.08 perf-profile.self.cycles-pp._IO_setb
0.05 +0.0 0.07 ± 6% perf-profile.self.cycles-pp.__legitimize_mnt
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__libc_fork
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.change_protection_range
0.06 +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memchr
0.08 ± 6% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.anon_vma_interval_tree_remove
0.07 ± 12% +0.0 0.09 ± 9% perf-profile.self.cycles-pp.try_charge
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.inode_permission
0.07 +0.0 0.09 perf-profile.self.cycles-pp.avc_has_perm
0.08 +0.0 0.10 ± 7% perf-profile.self.cycles-pp.free_pgd_range
0.07 ± 7% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.prepend_name
0.05 ± 8% +0.0 0.07 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_stage2
0.08 ± 10% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.available_idle_cpu
0.10 ± 8% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.unlink_anon_vmas
0.10 ± 7% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.memset_erms
0.07 ± 5% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.rcu_all_qs
0.08 ± 6% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.lockref_get_not_dead
0.06 ± 9% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.memcpy
0.08 ± 5% +0.0 0.10 perf-profile.self.cycles-pp.fput
0.12 ± 6% +0.0 0.15 ± 4% perf-profile.self.cycles-pp.do_syscall_64
0.07 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__snprintf_chk
0.04 ± 57% +0.0 0.06 ± 6% perf-profile.self.cycles-pp.vm_area_dup
0.11 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.__get_user_8
0.08 ± 5% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.file_free_rcu
0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__vma_link_rb
0.13 ± 5% +0.0 0.16 ± 5% perf-profile.self.cycles-pp.copy_page_range
0.11 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.perf_event_mmap
0.18 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.find_vma
0.14 +0.0 0.17 ± 2% perf-profile.self.cycles-pp.copy_process
0.10 ± 4% +0.0 0.13 perf-profile.self.cycles-pp.link_path_walk
0.08 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.__fput
0.08 ± 8% +0.0 0.11 ± 4% perf-profile.self.cycles-pp.free_pcppages_bulk
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.do_mmap
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc_trace
0.10 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.vma_interval_tree_augment_rotate
0.15 ± 2% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.vma_compute_subtree_gap
0.14 ± 3% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.avc_has_perm_noaudit
0.12 +0.0 0.15 ± 2% perf-profile.self.cycles-pp.lock_page_memcg
0.11 ± 4% +0.0 0.15 ± 2% perf-profile.self.cycles-pp._init
0.10 ± 5% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.unmapped_area_topdown
0.11 +0.0 0.14 ± 3% perf-profile.self.cycles-pp.lockref_put_or_lock
0.03 ±100% +0.0 0.06 perf-profile.self.cycles-pp.unmap_vmas
0.18 +0.0 0.21 ± 4% perf-profile.self.cycles-pp.handle_mm_fault
0.09 +0.0 0.12 ± 4% perf-profile.self.cycles-pp.wake_q_add
0.15 ± 5% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.kmem_cache_free
0.08 ± 5% +0.0 0.12 ± 5% perf-profile.self.cycles-pp.queued_write_lock_slowpath
0.18 ± 3% +0.0 0.22 ± 3% perf-profile.self.cycles-pp._IO_file_xsputn
0.17 ± 2% +0.0 0.21 ± 3% perf-profile.self.cycles-pp.strchrnul
0.16 ± 5% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.memcpy_erms
0.12 ± 3% +0.0 0.16 ± 4% perf-profile.self.cycles-pp.__rb_erase_color
0.12 ± 7% +0.0 0.15 ± 3% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.17 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.vmacache_find
0.08 +0.0 0.12 ± 11% perf-profile.self.cycles-pp.rcu_cblist_dequeue
0.16 +0.0 0.20 perf-profile.self.cycles-pp.mmap_region
0.14 +0.0 0.18 ± 2% perf-profile.self.cycles-pp.mark_page_accessed
0.07 ± 6% +0.0 0.11 ± 11% perf-profile.self.cycles-pp.queued_read_lock_slowpath
0.21 ± 2% +0.0 0.26 ± 4% perf-profile.self.cycles-pp.get_page_from_freelist
0.17 ± 2% +0.0 0.22 perf-profile.self.cycles-pp.malloc
0.16 ± 2% +0.0 0.21 ± 2% perf-profile.self.cycles-pp.strlen
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.down_read_trylock
0.01 ±173% +0.0 0.06 ± 7% perf-profile.self.cycles-pp.__errno_location
0.17 ± 2% +0.0 0.22 ± 3% perf-profile.self.cycles-pp.selinux_inode_permission
0.26 +0.0 0.30 ± 5% perf-profile.self.cycles-pp.__rb_insert_augmented
0.18 ± 2% +0.0 0.23 ± 5% perf-profile.self.cycles-pp.__might_sleep
0.00 +0.1 0.05 perf-profile.self.cycles-pp.load_elf_binary
0.00 +0.1 0.05 perf-profile.self.cycles-pp.page_fault
0.00 +0.1 0.05 perf-profile.self.cycles-pp.pagevec_lru_move_fn
0.00 +0.1 0.05 perf-profile.self.cycles-pp.flush_tlb_mm_range
0.00 +0.1 0.05 perf-profile.self.cycles-pp.__inode_security_revalidate
0.00 +0.1 0.05 perf-profile.self.cycles-pp.dup_fd
0.00 +0.1 0.05 perf-profile.self.cycles-pp.acct_collect
0.00 +0.1 0.05 perf-profile.self.cycles-pp.vma_merge
0.00 +0.1 0.05 perf-profile.self.cycles-pp.rcu_segcblist_enqueue
0.24 ± 2% +0.1 0.30 ± 2% perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.mem_cgroup_throttle_swaprate
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert
0.44 ± 2% +0.1 0.49 ± 4% perf-profile.self.cycles-pp.down_write
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__might_fault
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.__mod_node_page_state
0.22 +0.1 0.28 ± 3% perf-profile.self.cycles-pp.__vsnprintf_chk
0.15 ± 2% +0.1 0.21 ± 5% perf-profile.self.cycles-pp.__alloc_file
0.30 +0.1 0.36 perf-profile.self.cycles-pp.native_flush_tlb_one_user
0.18 ± 4% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.__do_page_fault
0.31 ± 2% +0.1 0.37 perf-profile.self.cycles-pp._IO_padn
0.33 ± 3% +0.1 0.40 perf-profile.self.cycles-pp.unlock_page
0.21 ± 3% +0.1 0.28 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.20 ± 2% +0.1 0.27 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.36 +0.1 0.43 ± 2% perf-profile.self.cycles-pp.page_add_file_rmap
0.31 +0.1 0.38 perf-profile.self.cycles-pp.vma_interval_tree_remove
0.27 ± 3% +0.1 0.34 ± 3% perf-profile.self.cycles-pp.__d_lookup_rcu
0.28 +0.1 0.35 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid
0.41 +0.1 0.49 ± 3% perf-profile.self.cycles-pp.select_task_rq_fair
0.34 +0.1 0.42 perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.35 ± 3% +0.1 0.43 ± 3% perf-profile.self.cycles-pp.___might_sleep
0.29 ± 3% +0.1 0.38 perf-profile.self.cycles-pp.kmem_cache_alloc
0.36 ± 3% +0.1 0.45 perf-profile.self.cycles-pp._IO_fwrite
0.44 +0.1 0.53 perf-profile.self.cycles-pp.__handle_mm_fault
0.39 ± 3% +0.1 0.48 ± 2% perf-profile.self.cycles-pp.__slab_free
0.32 ± 2% +0.1 0.41 perf-profile.self.cycles-pp.alloc_set_pte
0.38 +0.1 0.47 perf-profile.self.cycles-pp.copy_page
0.52 +0.1 0.62 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret
0.34 ± 2% +0.1 0.45 ± 2% perf-profile.self.cycles-pp.strnlen_user
0.41 ± 2% +0.1 0.52 ± 2% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.47 ± 2% +0.1 0.59 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.51 +0.1 0.64 ± 4% perf-profile.self.cycles-pp._raw_spin_lock
0.53 +0.1 0.66 perf-profile.self.cycles-pp.__entry_SYSCALL_64_trampoline
0.65 ± 2% +0.2 0.82 perf-profile.self.cycles-pp._IO_default_xsputn
0.84 +0.2 1.05 ± 3% perf-profile.self.cycles-pp.clear_page_erms
0.91 ± 2% +0.2 1.13 perf-profile.self.cycles-pp._dl_addr
0.91 +0.2 1.14 perf-profile.self.cycles-pp.vma_interval_tree_insert
1.08 +0.3 1.35 ± 2% perf-profile.self.cycles-pp.__strcoll_l
0.91 +0.3 1.20 perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.92 ± 2% +0.3 1.26 ± 4% perf-profile.self.cycles-pp.page_remove_rmap
1.33 +0.4 1.72 ± 2% perf-profile.self.cycles-pp.unmap_page_range
1.75 ± 2% +0.4 2.18 perf-profile.self.cycles-pp.vfprintf
1.23 ± 2% +0.5 1.73 ± 5% perf-profile.self.cycles-pp.release_pages
1.47 +0.8 2.26 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 11 months
c438cfd46e ("blk-mq: fix changelog"): BUG: unable to handle kernel NULL pointer dereference at 00000000
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core.git debugfs_cleanup
commit c438cfd46e37a6dd9e370219a6f0d397cc3c1a36
Author: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org>
AuthorDate: Fri Jan 4 14:06:22 2019 +0100
Commit: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org>
CommitDate: Thu Jan 31 14:18:25 2019 +0100
blk-mq: fix changelog
ddd7d0ff2d wireless: fix changelog
c438cfd46e blk-mq: fix changelog
31b092d47f lib: WIP, break up
+------------------------------------------+------------+------------+------------+
| | ddd7d0ff2d | c438cfd46e | 31b092d47f |
+------------------------------------------+------------+------------+------------+
| boot_successes | 37 | 0 | 0 |
| boot_failures | 0 | 26 | 26 |
| BUG:unable_to_handle_kernel | 0 | 26 | 26 |
| Oops:#[##] | 0 | 26 | 26 |
| EIP:debugfs_create_files | 0 | 26 | 26 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 26 | 26 |
+------------------------------------------+------------+------------+------------+
[ 7.740649] igt_debug 0x0000000000000a00-0x0000000000000e00: 1024: used
[ 7.741350] igt_debug 0x0000000000000e00-0x0000000000001000: 512: free
[ 7.742149] igt_debug total: 4096, used 2048 free 2048
[ 42.726577] [drm] Initialized vgem 1.0.0 20120112 for vgem on minor 0
[ 42.728241] Floppy drive(s): fd0 is 2.88M AMI BIOS
[ 42.729334] BUG: unable to handle kernel NULL pointer dereference at 00000000
[ 42.729735] #PF error: [normal kernel read fault]
[ 42.729735] *pde = 00000000
[ 42.729735] Oops: 0000 [#1]
[ 42.729735] CPU: 0 PID: 1 Comm: swapper Not tainted 5.0.0-rc2-00115-gc438cfd #113
[ 42.729735] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 42.729735] EIP: debugfs_create_files+0x6b/0xa0
[ 42.729735] Code: 00 00 00 00 0f 97 c0 31 c9 89 c7 0f b6 d0 b8 68 ab 7b 82 e8 57 6d be ff 89 f8 84 c0 75 38 8b 46 30 8b 7d f0 89 b8 fc 01 00 00 <8b> 03 85 c0 74 26 8d b4 26 00 00 00 00 0f b7 53 04 89 1c 24 89 f1
[ 42.729735] EAX: 9efb5000 EBX: 00000000 ECX: 00000000 EDX: 00000000
[ 42.729735] ESI: 9efb3840 EDI: 9d6cf800 EBP: 80243e3c ESP: 80243e24
[ 42.729735] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00210246
[ 42.729735] CR0: 80050033 CR2: 00000000 CR3: 02924000 CR4: 001406d0
[ 42.729735] Call Trace:
[ 42.729735] blk_mq_debugfs_register_sched_hctx+0x34/0x40
[ 42.729735] blk_mq_debugfs_register+0xb1/0xc0
[ 42.729735] blk_register_queue+0x108/0x230
[ 42.729735] __device_add_disk+0x44f/0x640
[ 42.729735] device_add_disk+0x17/0x20
[ 42.729735] loop_add+0x217/0x2c0
[ 42.729735] loop_init+0xf9/0x11a
[ 42.729735] ? floppy_async_init+0xd4c/0xd4c
[ 42.729735] do_one_initcall+0xdd/0x25d
[ 42.729735] kernel_init_freeable+0x25a/0x2d7
[ 42.729735] ? rest_init+0x140/0x140
[ 42.729735] kernel_init+0x10/0x100
[ 42.729735] ? schedule_tail_wrapper+0x9/0x10
[ 42.729735] ret_from_fork+0x19/0x30
[ 42.729735] CR2: 0000000000000000
[ 42.729735] _warn_unseeded_randomness: 35 callbacks suppressed
[ 42.729735] random: get_random_bytes called from init_oops_id+0x3f/0x50 with crng_init=1
[ 42.729735] ---[ end trace 25be250042fb0fd4 ]---
[ 42.729735] EIP: debugfs_create_files+0x6b/0xa0
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 0e9ac1e5b38fa1032c8809b7f375c5f20aa8c2be f17b5f06cb92ef2250513a1e154c47b78df07d40 --
git bisect good f095dea55a4ac7fdb83f505523ad417274e54192 # 01:00 G 10 0 0 0 Merge 'ulf.hansson-mmc/next' into devel-catchup-201901312352
git bisect good f1ac64a048ea54cd0bfa9d1d455056c135e3e597 # 01:08 G 11 0 0 0 Merge 'alaahl/for-linust' into devel-catchup-201901312352
git bisect bad 4f28883ea4af13b4d15f7ae2f7efb5fa81cc4f84 # 01:14 B 0 9 34 11 Merge 'driver-core/debugfs_cleanup' into devel-catchup-201901312352
git bisect good 52c070b7c8809576d3065d4b6a4cf1154d7acde2 # 01:33 G 10 0 0 0 cw1200: no need to check return value of debugfs_create functions
git bisect good 3000a51bc760ad362eeab65de07a92c47b2353eb # 01:43 G 10 0 0 0 f2fs: no need to check return value of debugfs_create functions
git bisect good 50b82e5dd6c2fad0af36a80baff41b37c18e091b # 02:00 G 11 0 0 0 xen-netback: fix changelog
git bisect bad 6a37bbef02b8607940a432c864e3f635293cb1e3 # 02:04 B 0 2 16 0 pstore: fix changelog
git bisect good c3cbe3160fcb8ea6dc6a6d2939af4f2bf05c11a2 # 02:29 G 11 0 0 0 sunrpc: fix changelog
git bisect good ddd7d0ff2d7b4f80e2c4b54718f66c5601fd25c1 # 02:35 G 11 0 0 0 wireless: fix changelog
git bisect bad c438cfd46e37a6dd9e370219a6f0d397cc3c1a36 # 02:39 B 0 1 15 0 blk-mq: fix changelog
# first bad commit: [c438cfd46e37a6dd9e370219a6f0d397cc3c1a36] blk-mq: fix changelog
git bisect good ddd7d0ff2d7b4f80e2c4b54718f66c5601fd25c1 # 02:48 G 30 0 0 0 wireless: fix changelog
# extra tests with debug options
git bisect bad c438cfd46e37a6dd9e370219a6f0d397cc3c1a36 # 02:53 B 0 2 16 0 blk-mq: fix changelog
# extra tests on HEAD of linux-devel/devel-catchup-201901312352
git bisect bad 0e9ac1e5b38fa1032c8809b7f375c5f20aa8c2be # 02:58 B 0 17 34 0 0day head guard for 'devel-catchup-201901312352'
# extra tests on tree/branch driver-core/debugfs_cleanup
git bisect bad 31b092d47f0a16ce1ece9593a387a883d64acab8 # 03:03 B 0 1 15 0 lib: WIP, break up
# extra tests with first bad commit reverted
git bisect good 29828fbf7aa1702254ce9767e2943ac944784316 # 03:28 G 10 0 0 0 Revert "blk-mq: fix changelog"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
2 years
[mm] 9bc8039e71: will-it-scale.per_thread_ops -64.1% regression
by kernel test robot
Greeting,
FYI, we noticed a -64.1% regression of will-it-scale.per_thread_ops due to commit:
commit: 9bc8039e715da3b53dbac89525323a9f2f69b7b5 ("mm: brk: downgrade mmap_sem to read when shrinking")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 8 threads Ivy Bridge with 16G memory
with following parameters:
nr_task: 100%
mode: thread
test: brk1
ucode: 0x20
cpufreq_governor: performance
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.2/thread/100%/debian-x86_64-2018-04-03.cgz/lkp-ivb-d01/brk1/will-it-scale/0x20
commit:
85a06835f6 ("mm: mremap: downgrade mmap_sem to read when shrinking")
9bc8039e71 ("mm: brk: downgrade mmap_sem to read when shrinking")
85a06835f6f1ba79 9bc8039e715da3b53dbac89525
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 kmsg.a0f723>]usb_hcd_irq
:4 25% 1:4 kmsg.b6a4a7>]usb_hcd_irq
1:4 -25% :4 kmsg.cae42e>]usb_hcd_irq
:4 25% 1:4 kmsg.fb#f87>]usb_hcd_irq
:4 25% 1:4 kmsg.fd#>]usb_hcd_irq
%stddev %change %stddev
\ | \
196250 ± 8% -64.1% 70494 will-it-scale.per_thread_ops
127330 ± 19% -98.0% 2525 ± 24% will-it-scale.time.involuntary_context_switches
727.50 ± 2% -77.0% 167.25 will-it-scale.time.percent_of_cpu_this_job_got
2141 ± 2% -77.6% 479.12 will-it-scale.time.system_time
50.48 ± 7% -48.5% 25.98 will-it-scale.time.user_time
34925294 ± 18% +270.3% 1.293e+08 ± 4% will-it-scale.time.voluntary_context_switches
1570007 ± 8% -64.1% 563958 will-it-scale.workload
6435 ± 2% -6.4% 6024 proc-vmstat.nr_shmem
1298 ± 16% -44.5% 721.00 ± 18% proc-vmstat.pgactivate
2341 +16.4% 2724 slabinfo.kmalloc-96.active_objs
2341 +16.4% 2724 slabinfo.kmalloc-96.num_objs
6346 ±150% -87.8% 776.25 ± 9% softirqs.NET_RX
160107 ± 8% +151.9% 403273 softirqs.SCHED
1097999 -13.0% 955526 softirqs.TIMER
5.50 ± 9% -81.8% 1.00 vmstat.procs.r
230700 ± 19% +269.9% 853292 ± 4% vmstat.system.cs
26706 ± 3% +15.7% 30910 ± 5% vmstat.system.in
11.24 ± 23% +72.2 83.39 mpstat.cpu.idle%
0.00 ±131% +0.0 0.04 ± 99% mpstat.cpu.iowait%
86.32 ± 2% -70.8 15.54 mpstat.cpu.sys%
2.44 ± 7% -1.4 1.04 ± 8% mpstat.cpu.usr%
20610709 ± 15% +2376.0% 5.103e+08 ± 34% cpuidle.C1.time
3233399 ± 8% +241.5% 11042785 ± 25% cpuidle.C1.usage
36172040 ± 6% +931.3% 3.73e+08 ± 15% cpuidle.C1E.time
783605 ± 4% +548.7% 5083041 ± 18% cpuidle.C1E.usage
28753819 ± 39% +1054.5% 3.319e+08 ± 49% cpuidle.C3.time
283912 ± 25% +688.4% 2238225 ± 34% cpuidle.C3.usage
1.507e+08 ± 47% +292.3% 5.913e+08 ± 28% cpuidle.C6.time
339861 ± 37% +549.7% 2208222 ± 24% cpuidle.C6.usage
2709719 ± 5% +824.2% 25043444 cpuidle.POLL.time
28602864 ± 18% +173.7% 78276116 ± 10% cpuidle.POLL.usage
3338 ± 2% -71.8% 941.75 turbostat.Avg_MHz
90.40 ± 2% -65.1 25.31 turbostat.Busy%
3233316 ± 8% +241.5% 11042588 ± 25% turbostat.C1
0.83 ± 16% +20.2 21.02 ± 35% turbostat.C1%
783559 ± 4% +548.7% 5082972 ± 18% turbostat.C1E
1.46 ± 7% +13.9 15.34 ± 15% turbostat.C1E%
283898 ± 25% +688.4% 2238202 ± 34% turbostat.C3
1.17 ± 39% +12.5 13.66 ± 49% turbostat.C3%
339857 ± 37% +549.7% 2208205 ± 24% turbostat.C6
6.05 ± 46% +18.2 24.30 ± 28% turbostat.C6%
6.12 ± 18% +755.7% 52.39 ± 9% turbostat.CPU%c1
2.18 ±105% +735.9% 18.18 ± 45% turbostat.CPU%c3
1.30 ±117% +216.3% 4.12 ± 92% turbostat.CPU%c6
38.31 -37.2% 24.06 turbostat.CorWatt
8285923 ± 2% +13.9% 9436075 ± 6% turbostat.IRQ
43.17 -33.4% 28.77 turbostat.PkgWatt
8.92e+11 -67.9% 2.862e+11 ± 31% perf-stat.branch-instructions
0.55 ± 4% +1.0 1.53 ± 5% perf-stat.branch-miss-rate%
0.19 ± 22% +0.7 0.89 ± 69% perf-stat.cache-miss-rate%
2.401e+10 -57.3% 1.025e+10 ± 28% perf-stat.cache-references
71517245 ± 18% +264.5% 2.607e+08 ± 4% perf-stat.context-switches
1.85 -21.9% 1.44 ± 2% perf-stat.cpi
8.223e+12 ± 2% -76.8% 1.904e+12 ± 32% perf-stat.cpu-cycles
0.34 ± 11% +0.3 0.63 ± 9% perf-stat.dTLB-load-miss-rate%
4.563e+09 ± 10% -50.7% 2.252e+09 ± 27% perf-stat.dTLB-load-misses
1.357e+12 -73.2% 3.63e+11 ± 31% perf-stat.dTLB-loads
0.01 ± 28% +0.0 0.02 ± 10% perf-stat.dTLB-store-miss-rate%
20813820 ± 31% +109.2% 43542782 ± 25% perf-stat.dTLB-store-misses
97.04 -13.4 83.65 ± 2% perf-stat.iTLB-load-miss-rate%
5.871e+08 ± 8% -48.9% 3.001e+08 ± 35% perf-stat.iTLB-load-misses
17851698 ± 4% +235.7% 59936365 ± 41% perf-stat.iTLB-loads
4.456e+12 -70.6% 1.311e+12 ± 31% perf-stat.instructions
7651 ± 9% -41.0% 4513 ± 11% perf-stat.instructions-per-iTLB-miss
0.54 +28.2% 0.69 ± 2% perf-stat.ipc
131812 ± 2% -75.7% 31973 sched_debug.cfs_rq:/.exec_clock.avg
133451 ± 2% -67.5% 43371 ± 30% sched_debug.cfs_rq:/.exec_clock.max
130067 ± 4% -83.3% 21767 ± 30% sched_debug.cfs_rq:/.exec_clock.min
1220 ± 87% +592.8% 8456 ± 98% sched_debug.cfs_rq:/.exec_clock.stddev
229519 ± 6% +70.6% 391456 ± 4% sched_debug.cfs_rq:/.load.max
65462 ± 11% +141.1% 157808 ± 4% sched_debug.cfs_rq:/.load.stddev
82.00 ± 3% -83.5% 13.54 ± 30% sched_debug.cfs_rq:/.load_avg.min
985041 ± 4% -90.8% 90737 sched_debug.cfs_rq:/.min_vruntime.avg
1004586 ± 4% -87.2% 128180 ± 21% sched_debug.cfs_rq:/.min_vruntime.max
969836 ± 5% -93.6% 62139 ± 28% sched_debug.cfs_rq:/.min_vruntime.min
0.77 ± 5% -42.6% 0.44 ± 10% sched_debug.cfs_rq:/.nr_running.avg
0.34 ± 12% +39.5% 0.48 sched_debug.cfs_rq:/.nr_running.stddev
1.79 ± 7% -63.1% 0.66 ± 22% sched_debug.cfs_rq:/.nr_spread_over.avg
10.54 ± 20% -68.0% 3.38 ± 26% sched_debug.cfs_rq:/.nr_spread_over.max
3.52 ± 18% -68.3% 1.12 ± 25% sched_debug.cfs_rq:/.nr_spread_over.stddev
96.05 ± 6% -33.5% 63.92 ± 8% sched_debug.cfs_rq:/.runnable_load_avg.avg
237.58 ± 7% +31.3% 311.83 ± 2% sched_debug.cfs_rq:/.runnable_load_avg.max
67.84 ± 9% +55.7% 105.65 sched_debug.cfs_rq:/.runnable_load_avg.stddev
200408 ± 8% +80.6% 361912 ± 6% sched_debug.cfs_rq:/.runnable_weight.max
56555 ± 14% +160.3% 147211 ± 5% sched_debug.cfs_rq:/.runnable_weight.stddev
936.14 ± 2% -55.3% 418.09 ± 6% sched_debug.cfs_rq:/.util_avg.avg
1341 ± 11% -43.2% 762.54 ± 11% sched_debug.cfs_rq:/.util_avg.max
587.25 ± 18% -69.6% 178.75 ± 23% sched_debug.cfs_rq:/.util_avg.min
518.64 ± 11% -90.2% 50.84 ± 29% sched_debug.cfs_rq:/.util_est_enqueued.avg
1018 ± 4% -70.8% 297.75 ± 23% sched_debug.cfs_rq:/.util_est_enqueued.max
386.54 ± 6% -73.6% 102.24 ± 21% sched_debug.cfs_rq:/.util_est_enqueued.stddev
116574 ± 30% +67.2% 194964 ± 30% sched_debug.cpu.avg_idle.avg
93.29 ± 16% -35.1% 60.54 ± 8% sched_debug.cpu.cpu_load[0].avg
221.08 ± 8% +34.3% 296.96 ± 9% sched_debug.cpu.cpu_load[0].max
63.60 ± 9% +57.6% 100.26 ± 9% sched_debug.cpu.cpu_load[0].stddev
95.54 ± 13% -47.7% 49.98 ± 7% sched_debug.cpu.cpu_load[1].avg
41.00 ± 52% -97.7% 0.96 ± 68% sched_debug.cpu.cpu_load[1].min
44.57 ± 16% +38.2% 61.57 ± 8% sched_debug.cpu.cpu_load[1].stddev
98.62 ± 10% -58.2% 41.19 ± 7% sched_debug.cpu.cpu_load[2].avg
169.42 ± 8% -28.1% 121.79 ± 9% sched_debug.cpu.cpu_load[2].max
58.04 ± 35% -94.5% 3.17 ± 47% sched_debug.cpu.cpu_load[2].min
100.91 ± 8% -64.5% 35.80 ± 10% sched_debug.cpu.cpu_load[3].avg
155.21 ± 5% -39.6% 93.79 ± 13% sched_debug.cpu.cpu_load[3].max
70.42 ± 22% -93.3% 4.71 ± 36% sched_debug.cpu.cpu_load[3].min
102.59 ± 6% -68.9% 31.92 ± 17% sched_debug.cpu.cpu_load[4].avg
144.54 ± 5% -44.9% 79.71 ± 28% sched_debug.cpu.cpu_load[4].max
78.79 ± 15% -92.6% 5.83 ± 30% sched_debug.cpu.cpu_load[4].min
1044 ± 5% -33.5% 694.38 ± 4% sched_debug.cpu.curr->pid.avg
835.66 ± 4% +19.0% 994.65 sched_debug.cpu.curr->pid.stddev
228643 ± 6% +71.3% 391578 ± 4% sched_debug.cpu.load.max
64674 ± 11% +143.6% 157538 ± 4% sched_debug.cpu.load.stddev
0.00 ± 5% -48.4% 0.00 ± 46% sched_debug.cpu.next_balance.stddev
1.03 ± 16% -44.9% 0.57 ± 13% sched_debug.cpu.nr_running.avg
6206533 ± 12% +167.7% 16616895 ± 4% sched_debug.cpu.nr_switches.avg
6795551 ± 18% +222.4% 21911344 ± 19% sched_debug.cpu.nr_switches.max
5666982 ± 9% +115.3% 12201219 ± 17% sched_debug.cpu.nr_switches.min
351168 ± 73% +837.8% 3293280 ± 72% sched_debug.cpu.nr_switches.stddev
0.32 ± 21% +109.8% 0.67 ± 8% sched_debug.cpu.nr_uninterruptible.avg
6297340 ± 12% +163.9% 16617675 ± 4% sched_debug.cpu.sched_count.avg
6887997 ± 18% +218.1% 21912464 ± 19% sched_debug.cpu.sched_count.max
5753875 ± 8% +112.1% 12201952 ± 17% sched_debug.cpu.sched_count.min
352908 ± 73% +833.2% 3293323 ± 71% sched_debug.cpu.sched_count.stddev
3067826 ± 12% +170.7% 8305951 ± 4% sched_debug.cpu.sched_goidle.avg
3361061 ± 18% +225.9% 10953485 ± 19% sched_debug.cpu.sched_goidle.max
2798299 ± 9% +117.9% 6098033 ± 17% sched_debug.cpu.sched_goidle.min
175049 ± 72% +840.7% 1646720 ± 72% sched_debug.cpu.sched_goidle.stddev
3232125 ± 11% +159.6% 8389199 ± 4% sched_debug.cpu.ttwu_count.avg
3533980 ± 16% +275.2% 13260800 ± 36% sched_debug.cpu.ttwu_count.max
271212 ±109% +1140.0% 3363044 ± 83% sched_debug.cpu.ttwu_count.stddev
107111 ± 9% +30.6% 139843 ± 17% sched_debug.cpu.ttwu_local.max
85459 ± 6% -29.3% 60381 ± 44% sched_debug.cpu.ttwu_local.min
6551 ± 69% +374.8% 31104 ± 78% sched_debug.cpu.ttwu_local.stddev
82.07 -72.2 9.87 ± 5% perf-profile.calltrace.cycles-pp.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
81.23 -72.0 9.20 ± 5% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
81.17 -72.0 9.18 ± 5% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk.do_syscall_64
68.76 -68.8 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
94.12 -54.6 39.55 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.54 -54.4 40.16 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
94.69 -54.3 40.35 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
10.16 ± 3% -10.0 0.19 ±173% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
0.89 ± 10% -0.2 0.67 ± 6% perf-profile.calltrace.cycles-pp.anon_vma_clone.__split_vma.__do_munmap.__x64_sys_brk.do_syscall_64
0.66 ± 6% +0.4 1.03 ± 8% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk
0.74 ± 6% +0.4 1.16 ± 8% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
1.42 ± 7% +0.4 1.85 ± 6% perf-profile.calltrace.cycles-pp.vma_merge.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.59 ± 11% perf-profile.calltrace.cycles-pp.__task_rq_lock.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +0.6 0.63 ± 13% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry
0.00 +0.7 0.66 ± 18% perf-profile.calltrace.cycles-pp.tick_nohz_idle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +0.7 0.67 ± 9% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +0.7 0.67 ± 11% perf-profile.calltrace.cycles-pp.unlink_anon_vmas.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk
0.00 +0.7 0.67 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_idle.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +0.7 0.68 ± 12% perf-profile.calltrace.cycles-pp.find_next_bit.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length
0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.67 ± 7% +0.7 1.35 ± 9% perf-profile.calltrace.cycles-pp.perf_event_mmap.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.14 ±173% +0.7 0.87 ± 5% perf-profile.calltrace.cycles-pp.get_unmapped_area.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.77 ± 8% perf-profile.calltrace.cycles-pp.security_vm_enough_memory_mm.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.78 ± 11% perf-profile.calltrace.cycles-pp.free_pgtables.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
0.00 +0.9 0.87 ± 17% perf-profile.calltrace.cycles-pp.unwind_next_frame.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
0.00 +0.9 0.91 ± 8% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
1.75 ± 10% +0.9 2.66 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.0 0.98 ± 7% perf-profile.calltrace.cycles-pp.__switch_to
0.00 +1.0 0.98 ± 9% perf-profile.calltrace.cycles-pp.__switch_to_asm
0.00 +1.1 1.10 ± 3% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule
0.00 +1.1 1.11 ± 20% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +1.2 1.20 ± 6% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.00 +1.6 1.64 ± 7% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle
0.00 +1.9 1.86 ± 14% perf-profile.calltrace.cycles-pp.__save_stack_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
5.75 ± 4% +1.9 7.64 ± 5% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.9 1.91 ± 14% perf-profile.calltrace.cycles-pp.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate
0.00 +2.1 2.09 ± 11% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
3.38 ± 5% +2.1 5.47 ± 4% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.2 2.25 ± 14% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
0.00 +2.5 2.46 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry
0.00 +2.5 2.46 ± 10% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +3.1 3.06 ± 6% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +3.5 3.52 ± 4% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable
0.00 +3.8 3.80 ± 8% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.00 +4.1 4.10 ± 3% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable
0.00 +4.7 4.66 ± 11% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +4.8 4.83 ± 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +5.3 5.27 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.91 ± 16% +5.5 6.44 ± 4% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_write
0.95 ± 15% +5.7 6.70 ± 4% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk
1.73 ± 11% +5.8 7.53 ± 4% perf-profile.calltrace.cycles-pp.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +6.2 6.15 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q
1.15 ± 17% +6.2 7.33 ± 4% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64
1.15 ± 17% +6.2 7.36 ± 4% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_write.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +6.9 6.93 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake.up_read
0.00 +6.9 6.95 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake
0.00 +7.1 7.15 ± 3% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk
0.00 +7.3 7.33 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake.call_rwsem_wake
0.00 +7.8 7.75 ± 3% perf-profile.calltrace.cycles-pp.rwsem_wake.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64
0.00 +7.8 7.79 ± 3% perf-profile.calltrace.cycles-pp.call_rwsem_wake.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +7.9 7.90 ± 3% perf-profile.calltrace.cycles-pp.up_read.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +8.0 8.00 ± 4% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable
0.00 +8.2 8.22 ± 4% perf-profile.calltrace.cycles-pp.schedule.rwsem_down_write_failed_killable.call_rwsem_down_write_failed_killable.down_write_killable.__x64_sys_brk
0.83 ± 27% +25.9 26.75 ± 11% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
1.09 ± 32% +30.9 31.97 ± 10% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.62 ± 36% +44.4 46.01 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.63 ± 36% +44.5 46.18 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
1.63 ± 36% +44.6 46.21 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
82.10 -72.2 9.91 ± 6% perf-profile.children.cycles-pp.down_write_killable
81.23 -72.0 9.20 ± 5% perf-profile.children.cycles-pp.call_rwsem_down_write_failed_killable
81.20 -72.0 9.18 ± 5% perf-profile.children.cycles-pp.rwsem_down_write_failed_killable
68.78 -68.8 0.01 ±173% perf-profile.children.cycles-pp.osq_lock
94.15 -54.6 39.58 ± 2% perf-profile.children.cycles-pp.__x64_sys_brk
94.59 -54.3 40.28 ± 3% perf-profile.children.cycles-pp.do_syscall_64
94.74 -54.3 40.48 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
10.16 ± 3% -9.8 0.38 ± 61% perf-profile.children.cycles-pp.rwsem_spin_on_owner
1.25 ± 11% -0.5 0.78 ± 5% perf-profile.children.cycles-pp.find_vma
0.89 ± 10% -0.2 0.67 ± 7% perf-profile.children.cycles-pp.anon_vma_clone
0.27 ± 31% -0.1 0.12 ± 5% perf-profile.children.cycles-pp.tlb_gather_mmu
0.07 ± 7% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.cap_mmap_addr
0.03 ±100% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.tlb_flush_mmu_free
0.00 +0.1 0.05 perf-profile.children.cycles-pp.irq_work_run_list
0.08 ± 25% +0.1 0.14 ± 13% perf-profile.children.cycles-pp.arch_tlb_finish_mmu
0.01 ±173% +0.1 0.07 ± 12% perf-profile.children.cycles-pp.cap_capable
0.07 ± 12% +0.1 0.13 ± 23% perf-profile.children.cycles-pp.selinux_mmap_addr
0.04 ± 60% +0.1 0.10 ± 27% perf-profile.children.cycles-pp.free_pgd_range
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.strlen
0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.sched_idle_set_state
0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.__list_add_valid
0.03 ±102% +0.1 0.10 ± 14% perf-profile.children.cycles-pp.__vm_enough_memory
0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.08 ± 30% perf-profile.children.cycles-pp.rcu_note_context_switch
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.__enqueue_entity
0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.perf_exclude_event
0.04 ± 58% +0.1 0.12 ± 31% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.in_sched_functions
0.09 ± 20% +0.1 0.18 ± 26% perf-profile.children.cycles-pp.tick_sched_handle
0.09 ± 21% +0.1 0.17 ± 26% perf-profile.children.cycles-pp.update_process_times
0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.09 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret
0.23 ± 15% +0.1 0.32 ± 13% perf-profile.children.cycles-pp.remove_vma
0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.get_cpu_device
0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.vma_adjust_trans_huge
0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.rb_insert_color_cached
0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.hugepage_vma_check
0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.put_prev_task_idle
0.10 ± 15% +0.1 0.19 ± 13% perf-profile.children.cycles-pp.__vma_link_rb
0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.userfaultfd_unmap_prep
0.10 ± 19% +0.1 0.20 ± 21% perf-profile.children.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.clear_buddies
0.16 ± 14% +0.1 0.27 ± 22% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.03 ±100% +0.1 0.13 ± 5% perf-profile.children.cycles-pp.khugepaged_enter_vma_merge
0.13 ± 19% +0.1 0.23 ± 13% perf-profile.children.cycles-pp.tlb_finish_mmu
0.00 +0.1 0.10 ± 28% perf-profile.children.cycles-pp.pm_qos_request
0.00 +0.1 0.10 ± 34% perf-profile.children.cycles-pp.stack_access_ok
0.00 +0.1 0.11 ± 37% perf-profile.children.cycles-pp.perf_swevent_event
0.17 ± 27% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.avc_has_perm_noaudit
0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.00 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.reschedule_interrupt
0.00 +0.1 0.11 ± 19% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +0.1 0.11 ± 42% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.10 ± 15% +0.1 0.22 ± 24% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.can_stop_idle_tick
0.53 ± 4% +0.1 0.66 ± 9% perf-profile.children.cycles-pp.vma_compute_subtree_gap
0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.native_load_tls
0.00 +0.1 0.13 ± 33% perf-profile.children.cycles-pp.load_new_mm_cr3
0.07 ± 23% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.cap_vm_enough_memory
0.00 +0.1 0.14 ± 19% perf-profile.children.cycles-pp.__update_idle_core
0.00 +0.1 0.14 ± 15% perf-profile.children.cycles-pp.update_min_vruntime
0.00 +0.1 0.14 ± 26% perf-profile.children.cycles-pp.leave_mm
0.33 ± 6% +0.1 0.47 ± 14% perf-profile.children.cycles-pp.___might_sleep
0.00 +0.2 0.15 ± 24% perf-profile.children.cycles-pp.ttwu_stat
0.09 ± 20% +0.2 0.24 ± 13% perf-profile.children.cycles-pp.perf_event_mmap_output
0.14 ± 9% +0.2 0.30 ± 20% perf-profile.children.cycles-pp.strlcpy
0.01 ±173% +0.2 0.18 ± 31% perf-profile.children.cycles-pp.__softirqentry_text_start
0.00 +0.2 0.17 ± 25% perf-profile.children.cycles-pp.deactivate_task
0.00 +0.2 0.18 ± 12% perf-profile.children.cycles-pp.orc_find
0.00 +0.2 0.18 ± 14% perf-profile.children.cycles-pp.sched_ttwu_pending
0.24 ± 14% +0.2 0.42 ± 7% perf-profile.children.cycles-pp.security_mmap_addr
0.00 +0.2 0.18 ± 11% perf-profile.children.cycles-pp.rcu_eqs_exit
0.00 +0.2 0.19 ± 15% perf-profile.children.cycles-pp.rcu_eqs_enter
0.20 ± 10% +0.2 0.40 ± 14% perf-profile.children.cycles-pp.__might_sleep
0.07 ± 21% +0.2 0.27 ± 18% perf-profile.children.cycles-pp.__vma_rb_erase
0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.rb_next
0.00 +0.2 0.20 ± 20% perf-profile.children.cycles-pp.__list_del_entry_valid
0.00 +0.2 0.20 ± 22% perf-profile.children.cycles-pp.save_stack_address
0.22 ± 19% +0.2 0.43 ± 9% perf-profile.children.cycles-pp.cred_has_capability
0.00 +0.2 0.22 ± 25% perf-profile.children.cycles-pp.__orc_find
0.00 +0.2 0.23 ± 14% perf-profile.children.cycles-pp.kernel_text_address
0.03 ±100% +0.2 0.25 ± 24% perf-profile.children.cycles-pp.irq_exit
0.00 +0.2 0.23 ± 27% perf-profile.children.cycles-pp.__rwsem_mark_wake
0.00 +0.2 0.24 ± 22% perf-profile.children.cycles-pp.nr_iowait_cpu
0.00 +0.2 0.25 ± 12% perf-profile.children.cycles-pp.call_cpuidle
0.24 ± 13% +0.3 0.50 ± 9% perf-profile.children.cycles-pp.perf_iterate_sb
0.38 ± 13% +0.3 0.63 ± 14% perf-profile.children.cycles-pp.vm_area_dup
0.32 ± 7% +0.3 0.57 ± 9% perf-profile.children.cycles-pp.kmem_cache_alloc
0.00 +0.3 0.26 ± 8% perf-profile.children.cycles-pp.put_prev_entity
0.16 ± 12% +0.3 0.42 ± 11% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +0.3 0.27 ± 24% perf-profile.children.cycles-pp.menu_reflect
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.activate_task
0.00 +0.3 0.27 ± 23% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.account_entity_dequeue
0.00 +0.3 0.28 ± 18% perf-profile.children.cycles-pp.__kernel_text_address
0.00 +0.3 0.28 ± 8% perf-profile.children.cycles-pp.get_iowait_load
0.27 ± 13% +0.3 0.56 ± 12% perf-profile.children.cycles-pp.selinux_vm_enough_memory
0.41 ± 2% +0.3 0.70 ± 9% perf-profile.children.cycles-pp.unlink_anon_vmas
0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.pick_next_entity
0.00 +0.3 0.31 ± 4% perf-profile.children.cycles-pp.rb_erase_cached
0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.account_entity_enqueue
0.00 +0.3 0.33 ± 8% perf-profile.children.cycles-pp.available_idle_cpu
0.00 +0.3 0.34 ± 14% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.3 0.34 ± 12% perf-profile.children.cycles-pp.unwind_get_return_address
0.00 +0.3 0.35 ± 20% perf-profile.children.cycles-pp.rwsem_downgrade_wake
0.45 ± 3% +0.4 0.80 ± 11% perf-profile.children.cycles-pp.free_pgtables
0.00 +0.4 0.37 ± 8% perf-profile.children.cycles-pp.__calc_delta
0.00 +0.4 0.37 ± 24% perf-profile.children.cycles-pp.call_rwsem_downgrade_wake
0.00 +0.4 0.38 ± 8% perf-profile.children.cycles-pp.select_idle_sibling
0.68 ± 6% +0.4 1.06 ± 7% perf-profile.children.cycles-pp.unmap_page_range
0.00 +0.4 0.39 ± 7% perf-profile.children.cycles-pp.put_prev_task_fair
0.22 ± 8% +0.4 0.62 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt
0.00 +0.4 0.41 ± 2% perf-profile.children.cycles-pp.rcu_idle_exit
0.50 ± 11% +0.4 0.91 ± 6% perf-profile.children.cycles-pp.get_unmapped_area
0.00 +0.4 0.42 ± 3% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.36 ± 11% +0.4 0.79 ± 9% perf-profile.children.cycles-pp.security_vm_enough_memory_mm
0.75 ± 6% +0.4 1.19 ± 8% perf-profile.children.cycles-pp.unmap_vmas
1.42 ± 7% +0.4 1.86 ± 5% perf-profile.children.cycles-pp.vma_merge
0.00 +0.5 0.46 ± 15% perf-profile.children.cycles-pp.__unwind_start
0.00 +0.5 0.46 ± 32% perf-profile.children.cycles-pp.resched_curr
0.12 ± 8% +0.5 0.62 ± 12% perf-profile.children.cycles-pp.__indirect_thunk_start
0.01 ±173% +0.5 0.53 ± 14% perf-profile.children.cycles-pp.read_tsc
0.00 +0.5 0.52 ± 23% perf-profile.children.cycles-pp.downgrade_write
0.06 ± 62% +0.5 0.58 ± 12% perf-profile.children.cycles-pp.wake_q_add
0.44 ± 26% +0.6 1.00 ± 25% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.00 +0.6 0.62 ± 13% perf-profile.children.cycles-pp.reweight_entity
0.04 ±106% +0.6 0.67 ± 6% perf-profile.children.cycles-pp.native_write_msr
0.00 +0.6 0.63 ± 13% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.6 0.64 ± 6% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.7 0.68 ± 7% perf-profile.children.cycles-pp.pick_next_task_idle
0.28 ± 9% +0.7 0.96 ± 10% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.04 ±100% +0.7 0.72 ± 10% perf-profile.children.cycles-pp.__task_rq_lock
0.02 ±173% +0.7 0.71 ± 9% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.7 0.70 ± 10% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.7 0.72 ± 6% perf-profile.children.cycles-pp.__update_load_avg_se
0.68 ± 6% +0.7 1.40 ± 9% perf-profile.children.cycles-pp.perf_event_mmap
0.00 +0.7 0.74 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.29 ± 8% +0.7 1.03 ± 10% perf-profile.children.cycles-pp.apic_timer_interrupt
0.01 ±173% +0.7 0.76 ± 6% perf-profile.children.cycles-pp.finish_task_switch
0.01 ±173% +0.8 0.81 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.03 ±100% +0.8 0.84 ± 11% perf-profile.children.cycles-pp.ktime_get
0.02 ±173% +0.8 0.83 ± 21% perf-profile.children.cycles-pp.check_preempt_curr
0.01 ±173% +0.8 0.83 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.03 ±105% +0.9 0.88 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.02 ±173% +0.9 0.92 ± 20% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.46 ± 26% +0.9 1.36 ± 20% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.75 ± 10% +0.9 2.67 ± 5% perf-profile.children.cycles-pp.unmap_region
0.01 ±173% +0.9 0.95 ± 11% perf-profile.children.cycles-pp.find_next_bit
0.01 ±173% +1.0 0.99 ± 7% perf-profile.children.cycles-pp.update_cfs_group
0.03 ±105% +1.0 1.04 ± 8% perf-profile.children.cycles-pp.__switch_to_asm
0.04 ± 57% +1.0 1.07 ± 10% perf-profile.children.cycles-pp.update_curr
0.03 ±100% +1.2 1.24 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair
0.01 ±173% +1.2 1.23 ± 6% perf-profile.children.cycles-pp.__switch_to
0.28 ± 12% +1.3 1.55 ± 10% perf-profile.children.cycles-pp._raw_spin_lock
0.01 ±173% +1.3 1.34 ± 13% perf-profile.children.cycles-pp.native_sched_clock
0.02 ±173% +1.4 1.37 ± 12% perf-profile.children.cycles-pp.sched_clock
0.00 +1.4 1.36 ± 12% perf-profile.children.cycles-pp.unwind_next_frame
0.04 ± 63% +1.4 1.49 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu
0.03 ±100% +1.5 1.48 ± 10% perf-profile.children.cycles-pp.__next_timer_interrupt
0.08 ± 38% +1.7 1.77 ± 5% perf-profile.children.cycles-pp.set_next_entity
5.79 ± 4% +1.9 7.71 ± 5% perf-profile.children.cycles-pp.__do_munmap
0.00 +2.1 2.09 ± 9% perf-profile.children.cycles-pp.__save_stack_trace
3.38 ± 5% +2.1 5.47 ± 4% perf-profile.children.cycles-pp.do_brk_flags
0.00 +2.1 2.13 ± 9% perf-profile.children.cycles-pp.save_stack_trace_tsk
0.05 ± 61% +2.2 2.22 ± 7% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.01 ±173% +2.5 2.53 ± 8% perf-profile.children.cycles-pp.__account_scheduler_latency
0.11 ± 47% +2.5 2.65 ± 2% perf-profile.children.cycles-pp.update_load_avg
0.06 ± 60% +2.6 2.66 ± 7% perf-profile.children.cycles-pp.tick_nohz_next_event
0.15 ± 42% +3.2 3.33 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair
0.09 ± 31% +3.4 3.51 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.14 ± 35% +3.5 3.62 ± 3% perf-profile.children.cycles-pp.dequeue_entity
0.16 ± 36% +4.0 4.12 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair
0.24 ± 44% +4.1 4.30 ± 5% perf-profile.children.cycles-pp.poll_idle
0.24 ± 50% +5.3 5.54 ± 4% perf-profile.children.cycles-pp.schedule_idle
2.34 ± 9% +5.6 7.90 ± 4% perf-profile.children.cycles-pp.up_write
0.19 ± 35% +5.8 5.99 ± 6% perf-profile.children.cycles-pp.menu_select
0.20 ± 33% +6.1 6.30 ± 2% perf-profile.children.cycles-pp.enqueue_entity
0.22 ± 32% +6.7 6.96 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair
0.24 ± 29% +7.1 7.35 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +7.9 7.91 ± 3% perf-profile.children.cycles-pp.up_read
0.32 ± 37% +7.9 8.23 ± 4% perf-profile.children.cycles-pp.schedule
0.91 ± 15% +12.5 13.40 ± 3% perf-profile.children.cycles-pp.try_to_wake_up
0.95 ± 15% +12.9 13.85 ± 3% perf-profile.children.cycles-pp.wake_up_q
0.55 ± 43% +13.0 13.52 ± 4% perf-profile.children.cycles-pp.__sched_text_start
1.15 ± 17% +14.0 15.11 ± 3% perf-profile.children.cycles-pp.rwsem_wake
1.15 ± 17% +14.0 15.15 ± 3% perf-profile.children.cycles-pp.call_rwsem_wake
0.88 ± 20% +29.8 30.72 ± 5% perf-profile.children.cycles-pp.intel_idle
1.16 ± 24% +35.6 36.74 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
1.63 ± 36% +44.6 46.21 ± 9% perf-profile.children.cycles-pp.start_secondary
1.74 ± 29% +51.1 52.81 ± 2% perf-profile.children.cycles-pp.do_idle
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.secondary_startup_64
1.73 ± 29% +51.1 52.86 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
68.56 -68.5 0.01 ±173% perf-profile.self.cycles-pp.osq_lock
10.12 ± 4% -9.7 0.38 ± 61% perf-profile.self.cycles-pp.rwsem_spin_on_owner
1.41 ± 7% -0.9 0.51 ± 17% perf-profile.self.cycles-pp.rwsem_down_write_failed_killable
1.16 ± 4% -0.6 0.52 ± 12% perf-profile.self.cycles-pp.up_write
1.02 ± 14% -0.5 0.48 ± 9% perf-profile.self.cycles-pp.find_vma
1.16 ± 5% -0.2 0.94 ± 2% perf-profile.self.cycles-pp.__vma_adjust
0.38 ± 10% -0.2 0.20 ± 17% perf-profile.self.cycles-pp.anon_vma_clone
0.26 ± 31% -0.1 0.12 ± 5% perf-profile.self.cycles-pp.tlb_gather_mmu
0.06 ± 15% +0.0 0.09 ± 15% perf-profile.self.cycles-pp.cap_mmap_addr
0.06 +0.0 0.10 ± 8% perf-profile.self.cycles-pp.__split_vma
0.01 ±173% +0.0 0.06 ± 14% perf-profile.self.cycles-pp.remove_vma
0.04 ± 58% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.tlb_finish_mmu
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.strlen
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.unwind_get_return_address
0.04 ± 60% +0.1 0.10 ± 27% perf-profile.self.cycles-pp.free_pgd_range
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.cap_capable
0.00 +0.1 0.06 ± 34% perf-profile.self.cycles-pp.__list_add_valid
0.04 ± 58% +0.1 0.11 ± 28% perf-profile.self.cycles-pp.lru_add_drain_cpu
0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.kernel_text_address
0.00 +0.1 0.07 ± 34% perf-profile.self.cycles-pp.put_prev_task_idle
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.hugepage_vma_check
0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.rcu_note_context_switch
0.00 +0.1 0.08 ± 24% perf-profile.self.cycles-pp.__save_stack_trace
0.00 +0.1 0.08 ± 16% perf-profile.self.cycles-pp.clear_buddies
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__enqueue_entity
0.10 ± 31% +0.1 0.17 ± 13% perf-profile.self.cycles-pp.security_mmap_addr
0.04 ± 58% +0.1 0.12 ± 32% perf-profile.self.cycles-pp.selinux_vm_enough_memory
0.00 +0.1 0.08 ± 34% perf-profile.self.cycles-pp.free_pgtables
0.09 ± 13% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.unlink_anon_vmas
0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.rb_insert_color_cached
0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.get_cpu_device
0.04 ± 58% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.selinux_mmap_addr
0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.vma_adjust_trans_huge
0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.05 ± 8% +0.1 0.14 ± 33% perf-profile.self.cycles-pp.userfaultfd_unmap_complete
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.__vma_link_rb
0.00 +0.1 0.09 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.1 0.09 ± 12% perf-profile.self.cycles-pp.ttwu_do_wakeup
0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.irq_work_needs_cpu
0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.update_ts_time_stats
0.00 +0.1 0.09 ± 32% perf-profile.self.cycles-pp.tick_nohz_tick_stopped
0.00 +0.1 0.09 ± 36% perf-profile.self.cycles-pp.stack_access_ok
0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.userfaultfd_unmap_prep
0.00 +0.1 0.10 ± 11% perf-profile.self.cycles-pp.__unwind_start
0.00 +0.1 0.10 ± 29% perf-profile.self.cycles-pp.pm_qos_request
0.50 ± 4% +0.1 0.60 ± 12% perf-profile.self.cycles-pp.vma_compute_subtree_gap
0.15 ± 12% +0.1 0.25 ± 9% perf-profile.self.cycles-pp.perf_iterate_sb
0.03 ±100% +0.1 0.12 ± 22% perf-profile.self.cycles-pp.rwsem_wake
0.00 +0.1 0.10 ± 23% perf-profile.self.cycles-pp.ttwu_do_activate
0.09 ± 17% +0.1 0.20 ± 22% perf-profile.self.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.save_stack_address
0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.hrtimer_next_event_without
0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.tick_nohz_idle_exit
0.17 ± 28% +0.1 0.27 ± 9% perf-profile.self.cycles-pp.avc_has_perm_noaudit
0.01 ±173% +0.1 0.12 ± 15% perf-profile.self.cycles-pp.cap_vm_enough_memory
0.00 +0.1 0.11 ± 31% perf-profile.self.cycles-pp.sched_clock_cpu
0.09 ± 19% +0.1 0.20 ± 21% perf-profile.self.cycles-pp.arch_get_unmapped_area_topdown
0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.native_load_tls
0.00 +0.1 0.12 ± 33% perf-profile.self.cycles-pp.can_stop_idle_tick
0.00 +0.1 0.12 ± 15% perf-profile.self.cycles-pp.up_read
0.00 +0.1 0.13 ± 18% perf-profile.self.cycles-pp.__update_idle_core
0.00 +0.1 0.13 ± 33% perf-profile.self.cycles-pp.load_new_mm_cr3
0.00 +0.1 0.13 ± 12% perf-profile.self.cycles-pp.update_min_vruntime
0.32 ± 7% +0.1 0.45 ± 13% perf-profile.self.cycles-pp.___might_sleep
0.03 ±100% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.cred_has_capability
0.11 ± 21% +0.1 0.24 ± 14% perf-profile.self.cycles-pp.get_unmapped_area
0.00 +0.1 0.14 ± 19% perf-profile.self.cycles-pp.put_prev_task_fair
0.00 +0.1 0.14 ± 30% perf-profile.self.cycles-pp.deactivate_task
0.00 +0.1 0.14 ± 46% perf-profile.self.cycles-pp.downgrade_write
0.09 ± 20% +0.1 0.23 ± 16% perf-profile.self.cycles-pp.perf_event_mmap_output
0.00 +0.1 0.15 ± 19% perf-profile.self.cycles-pp.pick_next_task_idle
0.00 +0.1 0.15 ± 13% perf-profile.self.cycles-pp.schedule_idle
0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.ttwu_stat
0.00 +0.2 0.15 ± 24% perf-profile.self.cycles-pp.cpu_startup_entry
0.01 ±173% +0.2 0.17 ± 28% perf-profile.self.cycles-pp.strlcpy
0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.schedule
0.18 ± 8% +0.2 0.34 ± 13% perf-profile.self.cycles-pp.__might_sleep
0.00 +0.2 0.16 ± 26% perf-profile.self.cycles-pp.rb_next
0.24 ± 6% +0.2 0.41 ± 11% perf-profile.self.cycles-pp.kmem_cache_alloc
0.18 ± 27% +0.2 0.35 ± 8% perf-profile.self.cycles-pp.vma_merge
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.sched_ttwu_pending
0.00 +0.2 0.18 ± 22% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.orc_find
0.00 +0.2 0.18 ± 18% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.18 ± 12% perf-profile.self.cycles-pp.rcu_eqs_exit
0.00 +0.2 0.19 ± 18% perf-profile.self.cycles-pp.__list_del_entry_valid
0.01 ±173% +0.2 0.21 ± 20% perf-profile.self.cycles-pp.__vma_rb_erase
0.00 +0.2 0.21 ± 27% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.00 +0.2 0.22 ± 13% perf-profile.self.cycles-pp.rcu_idle_exit
0.00 +0.2 0.22 ± 25% perf-profile.self.cycles-pp.__orc_find
0.00 +0.2 0.22 ± 21% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.2 0.22 ± 28% perf-profile.self.cycles-pp.menu_reflect
0.00 +0.2 0.23 ± 27% perf-profile.self.cycles-pp.__rwsem_mark_wake
0.00 +0.2 0.23 ± 21% perf-profile.self.cycles-pp.nr_iowait_cpu
0.00 +0.2 0.24 ± 13% perf-profile.self.cycles-pp.account_entity_dequeue
0.00 +0.2 0.24 ± 3% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.2 0.24 ± 10% perf-profile.self.cycles-pp.call_cpuidle
0.25 ± 5% +0.2 0.49 ± 9% perf-profile.self.cycles-pp.perf_event_mmap
0.00 +0.2 0.25 ± 5% perf-profile.self.cycles-pp.rb_erase_cached
0.00 +0.2 0.25 ± 16% perf-profile.self.cycles-pp.pick_next_entity
0.38 ± 9% +0.2 0.63 ± 7% perf-profile.self.cycles-pp.__x64_sys_brk
0.00 +0.2 0.25 ± 7% perf-profile.self.cycles-pp.put_prev_entity
0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.activate_task
0.00 +0.3 0.28 ± 8% perf-profile.self.cycles-pp.get_iowait_load
0.24 ± 7% +0.3 0.52 ± 13% perf-profile.self.cycles-pp.__do_munmap
0.00 +0.3 0.28 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state
0.00 +0.3 0.29 ± 14% perf-profile.self.cycles-pp.account_entity_enqueue
0.00 +0.3 0.29 ± 7% perf-profile.self.cycles-pp.ktime_get
0.00 +0.3 0.33 ± 12% perf-profile.self.cycles-pp.check_preempt_curr
0.00 +0.3 0.33 ± 7% perf-profile.self.cycles-pp.available_idle_cpu
0.00 +0.3 0.33 ± 8% perf-profile.self.cycles-pp.__account_scheduler_latency
0.00 +0.3 0.35 ± 4% perf-profile.self.cycles-pp.__calc_delta
0.37 ± 5% +0.4 0.73 ± 6% perf-profile.self.cycles-pp.unmap_page_range
0.01 ±173% +0.4 0.45 ± 3% perf-profile.self.cycles-pp.wake_up_q
0.00 +0.4 0.44 ± 15% perf-profile.self.cycles-pp.dequeue_task_fair
0.12 ± 13% +0.4 0.56 ± 12% perf-profile.self.cycles-pp.__indirect_thunk_start
0.00 +0.5 0.46 ± 32% perf-profile.self.cycles-pp.resched_curr
0.00 +0.5 0.48 ± 10% perf-profile.self.cycles-pp.___perf_sw_event
0.01 ±173% +0.5 0.51 ± 14% perf-profile.self.cycles-pp.read_tsc
0.06 ± 62% +0.5 0.58 ± 12% perf-profile.self.cycles-pp.wake_q_add
0.44 ± 26% +0.6 0.99 ± 24% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.02 ±173% +0.6 0.58 ± 13% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.01 ±173% +0.6 0.59 ± 17% perf-profile.self.cycles-pp.update_curr
0.00 +0.6 0.59 ± 17% perf-profile.self.cycles-pp.dequeue_entity
0.04 ±106% +0.6 0.66 ± 6% perf-profile.self.cycles-pp.native_write_msr
0.00 +0.6 0.62 ± 13% perf-profile.self.cycles-pp.reweight_entity
0.00 +0.6 0.65 ± 13% perf-profile.self.cycles-pp.__next_timer_interrupt
0.23 ± 11% +0.7 0.89 ± 13% perf-profile.self.cycles-pp._raw_spin_lock
0.00 +0.7 0.66 ± 10% perf-profile.self.cycles-pp.enqueue_task_fair
0.01 ±173% +0.7 0.69 ± 4% perf-profile.self.cycles-pp.finish_task_switch
0.00 +0.7 0.69 ± 8% perf-profile.self.cycles-pp.__update_load_avg_se
0.02 ±173% +0.8 0.80 ± 2% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.01 ±173% +0.8 0.80 ± 5% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.8 0.78 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair
0.00 +0.8 0.80 ± 11% perf-profile.self.cycles-pp.unwind_next_frame
0.00 +0.8 0.83 ± 9% perf-profile.self.cycles-pp.find_next_bit
0.07 ± 17% +0.9 0.97 ± 9% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.01 ±173% +0.9 0.96 ± 7% perf-profile.self.cycles-pp.update_cfs_group
0.03 ±105% +1.0 0.98 ± 8% perf-profile.self.cycles-pp.set_next_entity
0.02 ±173% +1.0 1.01 ± 7% perf-profile.self.cycles-pp.pick_next_task_fair
0.03 ±105% +1.0 1.04 ± 8% perf-profile.self.cycles-pp.__switch_to_asm
0.04 ±103% +1.1 1.10 ± 9% perf-profile.self.cycles-pp.update_load_avg
0.01 ±173% +1.2 1.18 ± 7% perf-profile.self.cycles-pp.do_idle
0.01 ±173% +1.2 1.18 ± 5% perf-profile.self.cycles-pp.__switch_to
0.04 ±107% +1.2 1.28 ± 7% perf-profile.self.cycles-pp.enqueue_entity
0.01 ±173% +1.3 1.31 ± 14% perf-profile.self.cycles-pp.native_sched_clock
0.07 ± 28% +1.5 1.60 ± 6% perf-profile.self.cycles-pp.try_to_wake_up
0.08 ± 33% +1.7 1.81 ± 9% perf-profile.self.cycles-pp.menu_select
0.10 ± 43% +2.2 2.32 ± 9% perf-profile.self.cycles-pp.__sched_text_start
0.22 ± 44% +3.8 4.05 ± 6% perf-profile.self.cycles-pp.poll_idle
0.88 ± 20% +29.7 30.58 ± 5% perf-profile.self.cycles-pp.intel_idle
will-it-scale.per_thread_ops
220000 +-+----------------------------------------------------------------+
|. + + + +. + + +. :+ + .+. + + |
200000 +-+ +. + + .+ : + +. + + +. .+. + + .+ + + + |
180000 +-+ + + + .+. : + + +. .+ + + + +|
| + + + + |
160000 +-+ |
| |
140000 +-+ |
| |
120000 +-+ |
100000 +-O |
| |
80000 O-+ O O O O |
| O O O O O O O O O O O O O O O O O O O |
60000 +-+----------------------------------------------------------------+
will-it-scale.workload
1.8e+06 +-+---------------------------------------------------------------+
| .+ + .+ .+ + .+. .+. |
1.6e+06 +-+ + + + .+ +.+ + .+.+ + .+. + :.+ + + + |
| +.+ + + +. + +.+ +.+ +. .+ + + + +|
1.4e+06 +-+ + + + + |
| |
1.2e+06 +-+ |
| |
1e+06 +-+ |
| |
800000 +-O |
O O O |
600000 +-+ O O O O OO O O O O O O O O O O O O O |
| O O |
400000 +-+---------------------------------------------------------------+
will-it-scale.time.user_time
60 +-+--------------------------------------------------------------------+
| |
55 +-+.+ .+ .+ + .+.. .+. |
50 +-+ + .+.. .+ +.+ + .+..+ + .+. : + .+ + + + |
| +.+ + + .+. + +.+ +.+ +. : + + + +|
45 +-+ + + +.+ + |
| |
40 +-+ |
| |
35 +-+ |
30 +-O |
O O O O O O O O |
25 +-+ O O O O O O O O O O O O |
| O O O O |
20 +-+--------------------------------------------------------------------+
will-it-scale.time.system_time
2400 +-+------------------------------------------------------------------+
2200 +-+.+.+.+.+. .+.+.+.+.+.+..+.+.+.+.+.+. .+. |
| +.+.+.+.+ +.+ +.+.+.+.+.+.+.+.|
2000 +-+ |
1800 +-+ |
| |
1600 +-+ |
1400 +-+ |
1200 +-+ |
| |
1000 +-+ |
800 +-+ |
| |
600 O-O O O O O O O O O O O O O O O O O O O O O O |
400 +-+---------------------------O----O---------------------------------+
will-it-scale.time.percent_of_cpu_this_job_got
800 +-+-------------------------------------------------------------------+
|.+.+.+.+.+.+.+. .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+..+.+.+.+. .+.+.+.|
700 +-+ +. + |
| |
600 +-+ |
| |
500 +-+ |
| |
400 +-+ |
| |
300 +-+ |
| |
200 O-O O O O O O |
| O O O O O O O O O O O O O O O O O O |
100 +-+-------------------------------------------------------------------+
will-it-scale.time.voluntary_context_switches
1.6e+08 +-+---------------------------------------------------------------+
| O O O O O |
1.4e+08 +-O O O O O O O |
1.2e+08 O-+ O O OO O O O O |
| O O O O |
1e+08 +-+ |
| |
8e+07 +-+ |
| |
6e+07 +-+ |
4e+07 +-+ + .|
| .+. + :.+. .+.+.+.++.+.+.+.+.+.+.+ |
2e+07 +-+. .+.+.+ + + +.+. .+.+.+.+. .+.+.+ |
| + + + |
0 +-+---------------------------------------------------------------+
will-it-scale.time.involuntary_context_switches
200000 +-+----------------------------------------------------------------+
180000 +-+ + .+ : + + .+ + + .+ |
| + : : + + : |
160000 +-+ : : : + + |
140000 +-+ + + +.: +.+. + + .+ + + |
| + + : : + +.+ +.+.+ : + + |
120000 +-+ + : : : + :|
100000 +-+ + + :|
80000 +-+ |
| |
60000 +-+ |
40000 +-+ |
| |
20000 +-+ |
0 O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-O-OO-O-O-O-O-O-O-------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years
[drm/bochs] 7a0483ac4f: BUG:unable_to_handle_kernel
by kernel test robot
FYI, we noticed the following commit (built with gcc-6):
commit: 7a0483ac4ffca4998945c159b28afdde8353cc84 ("drm/bochs: switch to generic drm fbdev emulation")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 768M
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------+------------+------------+
| | 132a45340a | 7a0483ac4f |
+-----------------------------------------------------+------------+------------+
| boot_successes | 48 | 6 |
| boot_failures | 0 | 44 |
| BUG:unable_to_handle_kernel | 0 | 44 |
| Oops:#[##] | 0 | 44 |
| RIP:restore_fbdev_mode | 0 | 44 |
| WARNING:at_kernel/locking/lockdep.c:#lock_downgrade | 0 | 14 |
| RIP:lock_downgrade | 0 | 14 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 44 |
+-----------------------------------------------------+------------+------------+
[ 9.996031] BUG: unable to handle kernel NULL pointer dereference at 0000000000000020
[ 9.996169] ------------[ cut here ]------------
[ 9.996991] #PF error: [normal kernel read fault]
[ 9.997548] downgrading a read lock
[ 9.997571] WARNING: CPU: 0 PID: 479 at kernel/locking/lockdep.c:3553 lock_downgrade+0xd1/0x190
[ 9.998095] PGD 800000001c3f1067 P4D 800000001c3f1067 PUD 1c148067 PMD 0
[ 9.998516] Modules linked in:
[ 9.999778] Oops: 0000 [#1] PREEMPT SMP PTI
[ 10.000594] CPU: 0 PID: 479 Comm: mkdir Not tainted 5.0.0-rc1-00140-g7a0483a #1
[ 10.000967] CPU: 1 PID: 239 Comm: plymouthd Not tainted 5.0.0-rc1-00140-g7a0483a #1
[ 10.001478] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 10.002351] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 10.003269] RIP: 0010:lock_downgrade+0xd1/0x190
[ 10.004274] RIP: 0010:restore_fbdev_mode+0x1b/0x1e0
[ 10.005272] Code: 8b 54 24 0c 89 93 28 0b 00 00 48 8b 08 48 89 8b 20 0b 00 00 f6 40 32 03 74 1a 48 c7 c7 10 56 53 82 48 89 04 24 e8 8f 60 fa ff <0f> 0b 8b 54 24 0c 48 8b 04 24 0f b6 48 32 4c 89 60 08 44 89 ee 48
[ 10.005824] Code: 41 5c 41 5d 41 5e 41 5f c3 66 0f 1f 44 00 00 41 57 41 56 41 55 41 54 49 89 fc 55 53 48 83 ec 08 e8 2a f8 ba ff 4d 8b 6c 24 40 <49> 8b 55 20 41 8b 45 50 25 00 00 01 00 85 82 78 01 00 00 0f 85 47
[ 10.006415] RSP: 0018:ffffc9000066fe28 EFLAGS: 00010096
[ 10.008634] RSP: 0018:ffffc9000045bdb0 EFLAGS: 00010293
[ 10.010881] RAX: 0000000000000017 RBX: ffff88802cabc000 RCX: 0000000000000001
[ 10.011513] RAX: 0000000000000000 RBX: ffff88801c1e6d40 RCX: 0000000000000000
[ 10.012142] RDX: ffff88802cabc000 RSI: ffffffff81132f29 RDI: 00000000ffffffff
[ 10.012999] RDX: ffff88802f834000 RSI: ffffffff815d0886 RDI: ffff88801c1e6d40
[ 10.013855] RBP: ffff88802d830128 R08: 00000002c324869d R09: ffffc9000066fdb8
[ 10.014712] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000001
[ 10.015571] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff811f1db8
[ 10.016430] R10: ffffc9000045bdf0 R11: 0000000000000001 R12: ffff88801c1e6d40
[ 10.017283] R13: 0000000000000003 R14: 0000000000000246 R15: 00007fa7532b9000
[ 10.018145] R13: 0000000000000000 R14: ffff88801c255278 R15: ffffffff815d2680
[ 10.019010] FS: 00007fa7532b47c0(0000) GS:ffff888029600000(0000) knlGS:0000000000000000
[ 10.019885] FS: 00007f8ba8290700(0000) GS:ffff888029a00000(0000) knlGS:0000000000000000
[ 10.020747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 10.021715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 10.022684] CR2: 00007fa7532b8000 CR3: 000000002d86a000 CR4: 00000000000406f0
[ 10.023390] CR2: 0000000000000020 CR3: 000000001c16e000 CR4: 00000000000406e0
[ 10.024078] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 10.024927] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 10.025781] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 10.026632] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 10.027485] Call Trace:
[ 10.028342] Call Trace:
[ 10.029195] downgrade_write+0x12/0x80
[ 10.029501] ? drm_fb_helper_lastclose+0x20/0x20
[ 10.029820] __do_munmap+0x3d8/0x5c0
[ 10.030273] drm_fb_helper_restore_fbdev_mode_unlocked+0x4a/0xa0
[ 10.030835] __vm_munmap+0x67/0xc0
[ 10.031268] drm_fbdev_client_restore+0x11/0x20
[ 10.031969] __x64_sys_munmap+0x1b/0x20
[ 10.032390] drm_client_dev_restore+0xa8/0xe0
[ 10.032936] do_syscall_64+0xb5/0x200
[ 10.033405] drm_release+0xc0/0x120
[ 10.033933] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 10.034381] ? drm_lastclose+0x100/0x100
[ 10.034806] RIP: 0033:0x7fa752bab897
[ 10.035422] __fput+0x15c/0x250
[ 10.035904] Code: f0 ff ff 73 01 c3 48 8b 0d a6 75 2c 00 31 d2 48 29 c2 64 89 11 48 83 c8 ff eb ea 90 90 90 90 90 90 90 90 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 79 75 2c 00 31 d2 48 29 c2 64
[ 10.036344] task_work_run+0x9d/0xd0
[ 10.036726] RSP: 002b:00007ffc66b50a38 EFLAGS: 00000206 ORIG_RAX: 000000000000000b
[ 10.038945] exit_to_usermode_loop+0x7a/0xc0
[ 10.039383] RAX: ffffffffffffffda RBX: 000000000060c010 RCX: 00007fa752bab897
[ 10.040280] do_syscall_64+0x1c9/0x200
[ 10.040804] RDX: 0000000000000000 RSI: 0000000000001000 RDI: 00007fa7532b8000
[ 10.041662] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 10.042113] RBP: 0000000000000000 R08: 0000000000000010 R09: 00000000ffffffff
[ 10.042964] RIP: 0033:0x7f8ba7973040
[ 10.043574] R10: 00007ffc66b50840 R11: 0000000000000206 R12: 0000000000000000
[ 10.044426] Code: 40 75 0b 31 c0 48 83 c4 08 e9 0c ff ff ff 48 8d 3d c5 99 09 00 e8 a0 3f 02 00 83 3d 9d 71 2d 00 00 75 10 b8 03 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 9e b1 01 00 48 89 04 24
[ 10.044860] R13: 00007ffc66b50bb8 R14: 00007fa753096d00 R15: 0000000000000000
[ 10.045722] RSP: 002b:00007ffe098cf568 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[ 10.047994] ---[ end trace 2efaa9fea56af290 ]---
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
2 years
Test monitoring on custom github repo
by Thomas Garnier
Hi,
I am working on KASLR (PIE for x86_64). I previously used Kees (CCed)
branches for lkp bot testing but someone told be I could ask you to add a
custom github path to monitor all branches on it.
I pushed my changes to: https://github.com/thgarnie/linux (kasrl_pie_v2
right now)
Can you add it? Anything I need to do?
Thanks,
--
Thomas
2 years, 1 month
[/proc/stat] 3047027b34: reaim.jobs_per_min -4.8% regression
by kernel test robot
Greeting,
FYI, we noticed a -4.8% regression of reaim.jobs_per_min due to commit:
commit: 3047027b34b8c6404b509903058b89836093acc7 ("[PATCH 2/2] /proc/stat: Add sysctl parameter to control irq counts latency")
url: https://github.com/0day-ci/linux/commits/Waiman-Long/proc-stat-Reduce-irq...
in testcase: reaim
on test machine: 56 threads Intel(R) Xeon(R) CPU E5-2695 v3 @ 2.30GHz with 256G memory
with following parameters:
runtime: 300s
nr_task: 5000
test: shared_memory
cpufreq_governor: performance
ucode: 0x3d
test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.2/5000/debian-x86_64-2018-04-03.cgz/300s/lkp-hsw-ep5/shared_memory/reaim/0x3d
commit:
51e8bce392 ("/proc/stat: Extract irqs counting code into show_stat_irqs()")
3047027b34 ("/proc/stat: Add sysctl parameter to control irq counts latency")
51e8bce392dd2cc9 3047027b34b8c6404b50990305
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 kmsg.igb#:#:#:exceed_max#second
%stddev %change %stddev
\ | \
101.96 +7.5% 109.60 reaim.child_systime
33.32 -1.8% 32.73 reaim.child_utime
5534451 -4.8% 5271308 reaim.jobs_per_min
1106 -4.8% 1054 reaim.jobs_per_min_child
5800927 -4.9% 5517884 reaim.max_jobs_per_min
5.42 +5.0% 5.69 reaim.parent_time
1.51 +5.3% 1.59 reaim.std_dev_time
29374932 -2.8% 28558608 reaim.time.minor_page_faults
1681 +1.6% 1708 reaim.time.percent_of_cpu_this_job_got
3841 +4.5% 4012 reaim.time.system_time
1234 -4.4% 1180 reaim.time.user_time
18500000 -2.7% 18000000 reaim.workload
5495296 ± 9% -9.5% 4970496 meminfo.DirectMap2M
5142 ± 18% -43.2% 2920 ± 46% numa-vmstat.node0.nr_shmem
29.00 ± 32% +56.9% 45.50 ± 10% vmstat.procs.r
67175 ± 37% +66.6% 111910 ± 20% numa-meminfo.node0.AnonHugePages
20591 ± 18% -43.2% 11691 ± 46% numa-meminfo.node0.Shmem
64688 ± 6% -36.8% 40906 ± 19% slabinfo.kmalloc-8.active_objs
64691 ± 6% -36.8% 40908 ± 19% slabinfo.kmalloc-8.num_objs
37.36 ± 7% +11.1% 41.53 ± 4% boot-time.boot
29.15 ± 6% +14.3% 33.31 ± 3% boot-time.dhcp
847.73 ± 9% +12.9% 957.09 ± 4% boot-time.idle
202.50 ±100% +101.7% 408.50 proc-vmstat.nr_mlock
8018 ± 9% -12.3% 7034 ± 2% proc-vmstat.nr_shmem
29175944 -2.8% 28369676 proc-vmstat.numa_hit
29170351 -2.8% 28364111 proc-vmstat.numa_local
5439 ± 5% -18.7% 4423 ± 7% proc-vmstat.pgactivate
30220220 -2.8% 29374906 proc-vmstat.pgalloc_normal
30182224 -2.7% 29368266 proc-vmstat.pgfault
30186671 -2.8% 29341792 proc-vmstat.pgfree
69510 ± 12% -34.2% 45759 ± 33% sched_debug.cfs_rq:/.load.avg
30.21 ± 24% -33.6% 20.05 ± 20% sched_debug.cfs_rq:/.runnable_load_avg.avg
66447 ± 12% -37.6% 41460 ± 37% sched_debug.cfs_rq:/.runnable_weight.avg
12.35 ± 4% +88.0% 23.22 ± 15% sched_debug.cpu.clock.stddev
12.35 ± 4% +88.0% 23.22 ± 15% sched_debug.cpu.clock_task.stddev
30.06 ± 12% -26.5% 22.10 ± 13% sched_debug.cpu.cpu_load[0].avg
29.37 ± 9% -22.6% 22.72 ± 13% sched_debug.cpu.cpu_load[1].avg
28.71 ± 6% -21.1% 22.66 ± 16% sched_debug.cpu.cpu_load[2].avg
17985 -12.0% 15823 ± 2% sched_debug.cpu.curr->pid.max
67478 ± 6% -32.5% 45531 ± 24% sched_debug.cpu.load.avg
10369 ± 49% -100.0% 0.00 sched_debug.cpu.load.min
0.21 ± 34% -100.0% 0.00 sched_debug.cpu.nr_running.min
12.98 -16.3% 10.86 ± 11% perf-stat.i.MPKI
5.712e+09 -3.8% 5.492e+09 perf-stat.i.branch-instructions
1.024e+08 -3.7% 98557208 perf-stat.i.branch-misses
8.17 +0.4 8.58 ± 2% perf-stat.i.cache-miss-rate%
7839589 +10.5% 8659798 perf-stat.i.cache-misses
86324420 +3.8% 89595898 ± 2% perf-stat.i.cache-references
1.55 ± 2% -4.0% 1.49 perf-stat.i.cpi
2290 -1.9% 2246 perf-stat.i.cpu-migrations
4667 -10.9% 4160 perf-stat.i.cycles-between-cache-misses
8.749e+09 -3.9% 8.409e+09 perf-stat.i.dTLB-loads
527660 ± 3% -15.0% 448539 ± 5% perf-stat.i.dTLB-store-misses
5.747e+09 -4.3% 5.499e+09 perf-stat.i.dTLB-stores
53047071 -3.5% 51190942 perf-stat.i.iTLB-load-misses
20576112 -13.7% 17759009 ± 2% perf-stat.i.iTLB-loads
3.207e+10 -3.9% 3.083e+10 perf-stat.i.instructions
0.77 -2.3% 0.75 perf-stat.i.ipc
99933 -3.8% 96127 perf-stat.i.minor-faults
4325719 +5.6% 4568226 perf-stat.i.node-load-misses
52.39 -2.0 50.36 perf-stat.i.node-store-miss-rate%
1411700 +20.9% 1706321 perf-stat.i.node-store-misses
883790 +34.1% 1184836 perf-stat.i.node-stores
99933 -3.8% 96127 perf-stat.i.page-faults
2.69 +7.9% 2.91 perf-stat.overall.MPKI
9.08 +0.6 9.67 ± 2% perf-stat.overall.cache-miss-rate%
1.13 +5.0% 1.19 perf-stat.overall.cpi
4633 -8.6% 4233 perf-stat.overall.cycles-between-cache-misses
0.01 ± 2% -0.0 0.01 ± 4% perf-stat.overall.dTLB-store-miss-rate%
72.05 +2.2 74.24 perf-stat.overall.iTLB-load-miss-rate%
0.88 -4.8% 0.84 perf-stat.overall.ipc
78.12 +1.4 79.52 perf-stat.overall.node-load-miss-rate%
61.49 -2.5 59.01 perf-stat.overall.node-store-miss-rate%
5.688e+09 -3.8% 5.471e+09 perf-stat.ps.branch-instructions
1.02e+08 -3.7% 98177745 perf-stat.ps.branch-misses
7807912 +10.5% 8626353 perf-stat.ps.cache-misses
85999504 +3.8% 89266688 ± 2% perf-stat.ps.cache-references
2282 -1.9% 2239 perf-stat.ps.cpu-migrations
8.713e+09 -3.9% 8.376e+09 perf-stat.ps.dTLB-loads
525761 ± 3% -15.0% 446967 ± 5% perf-stat.ps.dTLB-store-misses
5.723e+09 -4.3% 5.478e+09 perf-stat.ps.dTLB-stores
52823322 -3.5% 50990190 perf-stat.ps.iTLB-load-misses
20490261 -13.7% 17689923 ± 2% perf-stat.ps.iTLB-loads
3.193e+10 -3.8% 3.071e+10 perf-stat.ps.instructions
99560 -3.8% 95786 perf-stat.ps.minor-faults
4308031 +5.6% 4550453 perf-stat.ps.node-load-misses
1405805 +20.9% 1699670 perf-stat.ps.node-store-misses
880319 +34.1% 1180378 perf-stat.ps.node-stores
99560 -3.8% 95786 perf-stat.ps.page-faults
9.664e+12 -2.8% 9.397e+12 perf-stat.total.instructions
33.09 ± 7% -25.0 8.10 ± 45% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
32.21 ± 7% -24.3 7.92 ± 45% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.36 ± 7% -17.1 5.24 ± 49% perf-profile.calltrace.cycles-pp.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.57 ± 5% -8.3 2.31 ± 48% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
9.60 ± 4% -7.6 2.03 ± 49% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
3.68 ± 8% -3.3 0.43 ±102% perf-profile.calltrace.cycles-pp.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.37 ± 9% -2.8 1.60 ± 50% perf-profile.calltrace.cycles-pp.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.30 ± 2% -1.9 0.44 ±102% perf-profile.calltrace.cycles-pp.security_sem_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.10 ± 3% -1.6 3.46 ± 10% perf-profile.calltrace.cycles-pp.ipc_has_perm.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.20 -1.3 1.95 ± 23% perf-profile.calltrace.cycles-pp.avc_has_perm.ipc_has_perm.security_ipc_permission.do_semtimedop.do_syscall_64
2.12 ± 3% -0.4 1.76 ± 4% perf-profile.calltrace.cycles-pp.avc_has_perm.ipc_has_perm.security_sem_semop.do_semtimedop.do_syscall_64
1.03 ± 2% -0.1 0.94 ± 3% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
1.06 ± 2% -0.1 0.97 ± 3% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
1.06 ± 2% -0.1 0.98 ± 3% perf-profile.calltrace.cycles-pp.page_fault
0.91 ± 3% -0.1 0.82 ± 3% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.86 ± 3% -0.1 0.78 ± 3% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.61 ± 12% +0.2 0.79 ± 12% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry
0.61 ± 10% +0.2 0.79 ± 10% perf-profile.calltrace.cycles-pp.shm_close.remove_vma.__do_munmap.ksys_shmdt.do_syscall_64
0.67 ± 11% +0.2 0.86 ± 10% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.40 ± 57% +0.2 0.62 ± 8% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.do_shmat.__x64_sys_shmat.do_syscall_64
0.40 ± 57% +0.2 0.62 ± 7% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.do_shmat.__x64_sys_shmat
0.43 ± 57% +0.2 0.66 ± 7% perf-profile.calltrace.cycles-pp.down_write.do_shmat.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.41 ± 57% +0.3 0.67 ± 9% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.shm_close.remove_vma.__do_munmap
0.40 ± 57% +0.3 0.66 ± 7% perf-profile.calltrace.cycles-pp.down_write.ipcget.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.41 ± 57% +0.3 0.67 ± 9% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.shm_close.remove_vma
0.44 ± 57% +0.3 0.71 ± 9% perf-profile.calltrace.cycles-pp.down_write.shm_close.remove_vma.__do_munmap.ksys_shmdt
0.26 ±100% +0.4 0.67 ± 8% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
0.28 ±100% +0.4 0.71 ± 7% perf-profile.calltrace.cycles-pp.__might_fault._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.58 ± 10% +0.4 1.03 ± 6% perf-profile.calltrace.cycles-pp.shmctl_down.ksys_shmctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl
0.59 ± 10% +0.5 1.05 ± 6% perf-profile.calltrace.cycles-pp.ksys_shmctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl
0.13 ±173% +0.5 0.62 ± 7% perf-profile.calltrace.cycles-pp.call_rwsem_down_write_failed.down_write.ipcget.__x64_sys_shmget.do_syscall_64
0.13 ±173% +0.5 0.62 ± 7% perf-profile.calltrace.cycles-pp.rwsem_down_write_failed.call_rwsem_down_write_failed.down_write.ipcget.__x64_sys_shmget
0.12 ±173% +0.5 0.66 ± 8% perf-profile.calltrace.cycles-pp.dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop
0.00 +0.6 0.58 ± 7% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.60 ± 7% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.61 ± 7% perf-profile.calltrace.cycles-pp.wait_consider_task.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.00 +0.6 0.62 ± 4% perf-profile.calltrace.cycles-pp.semctl_down.ksys_semctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl
0.75 ± 8% +0.6 1.38 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_semop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
0.00 +0.6 0.65 ± 9% perf-profile.calltrace.cycles-pp.ipcperms.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
0.00 +0.6 0.65 ± 8% perf-profile.calltrace.cycles-pp.__dentry_kill.dentry_kill.dput.__fput.task_work_run
0.89 ± 11% +0.7 1.57 ± 8% perf-profile.calltrace.cycles-pp.do_shmat.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat
0.90 ± 11% +0.7 1.58 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat
0.90 ± 10% +0.7 1.58 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_shmat.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmat
0.00 +0.7 0.68 ± 5% perf-profile.calltrace.cycles-pp.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.wait
0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.00 +0.7 0.69 ± 6% perf-profile.calltrace.cycles-pp.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.90 ± 11% +0.7 1.59 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmat
0.00 +0.7 0.69 ± 5% perf-profile.calltrace.cycles-pp.wait
0.27 ±100% +0.7 0.99 ± 7% perf-profile.calltrace.cycles-pp.perform_atomic_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
0.95 ± 11% +0.7 1.67 ± 8% perf-profile.calltrace.cycles-pp.shmat
0.00 +0.7 0.73 ± 6% perf-profile.calltrace.cycles-pp.ipcget.ksys_semget.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget
0.00 +0.7 0.74 ± 8% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl
0.72 ± 9% +0.7 1.46 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
0.00 +0.8 0.75 ± 5% perf-profile.calltrace.cycles-pp.ksys_semget.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget
0.00 +0.8 0.76 ± 8% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl
0.89 ± 9% +0.8 1.65 ± 9% perf-profile.calltrace.cycles-pp.__do_munmap.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt
0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semget
0.00 +0.8 0.76 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semget
0.90 ± 9% +0.8 1.68 ± 9% perf-profile.calltrace.cycles-pp.ksys_shmdt.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt
0.00 +0.8 0.78 ± 6% perf-profile.calltrace.cycles-pp.ksys_semctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl
0.00 +0.8 0.80 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semctl
0.00 +0.8 0.80 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semctl
0.00 +0.8 0.85 ± 5% perf-profile.calltrace.cycles-pp.semget
0.97 ± 9% +0.8 1.82 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmctl
0.97 ± 9% +0.8 1.82 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmctl
0.94 ± 10% +0.9 1.79 ± 6% perf-profile.calltrace.cycles-pp._copy_from_user.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
1.04 ± 9% +0.9 1.91 ± 6% perf-profile.calltrace.cycles-pp.ipcget.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget
1.05 ± 9% +0.9 1.92 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_shmget.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget
1.05 ± 9% +0.9 1.93 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmget
1.05 ± 9% +0.9 1.93 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmget
1.02 ± 9% +0.9 1.92 ± 7% perf-profile.calltrace.cycles-pp.shmctl
1.00 ± 9% +0.9 1.93 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.shmdt
1.00 ± 8% +0.9 1.94 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.shmdt
1.13 ± 8% +0.9 2.08 ± 6% perf-profile.calltrace.cycles-pp.shmget
0.00 +1.0 0.97 ± 5% perf-profile.calltrace.cycles-pp.semctl
1.03 ± 9% +1.0 1.99 ± 5% perf-profile.calltrace.cycles-pp.do_smart_update.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
1.04 ± 8% +1.0 2.03 ± 9% perf-profile.calltrace.cycles-pp.shmdt
2.61 ± 9% +1.3 3.89 ± 14% perf-profile.calltrace.cycles-pp.security_ipc_permission.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
1.65 ± 13% +2.0 3.65 ± 7% perf-profile.calltrace.cycles-pp.security_sem_semop.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
1.61 ± 6% +5.3 6.89 ± 2% perf-profile.calltrace.cycles-pp.idr_find.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.45 ± 9% +6.2 12.63 ± 6% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.semop
2.92 ± 5% +8.0 10.88 ± 7% perf-profile.calltrace.cycles-pp.ipc_obtain_object_check.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
9.07 ± 8% +8.8 17.85 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.semop
15.56 ± 8% +18.8 34.38 ± 6% perf-profile.calltrace.cycles-pp.do_semtimedop.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
17.40 ± 8% +20.4 37.82 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.semop
17.99 ± 8% +21.0 39.00 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.semop
33.85 ± 8% +36.1 69.98 ± 6% perf-profile.calltrace.cycles-pp.semop
reaim.time.percent_of_cpu_this_job_got
1800 +-+------------------------------------------------------------------+
| O |
1780 +-OO O O O |
1760 O-+ O O OO |
| |
1740 +-+ |
| |
1720 +-+ O .+. |
| O O + + |
1700 +-+ O .+ : |
1680 +-+ .+ .+. .+ .+.+ .+ : +. .+.++.|
|.++.+.++ : .++ ++.+ + +.+.++.++ +.+.++.+.+ ++ |
1660 +-+ : + |
| + |
1640 +-+------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 1 month
[PM] 8234f6734c: will-it-scale.per_process_ops -3.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -3.6% regression of will-it-scale.per_process_ops due to commit:
commit: 8234f6734c5d74ac794e5517437f51c57d65f865 ("PM-runtime: Switch autosuspend over to using hrtimers")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 104 threads Skylake with 192G memory
with following parameters:
nr_task: 100%
mode: process
test: poll2
cpufreq_governor: performance
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.2/process/100%/debian-x86_64-2018-04-03.cgz/lkp-skl-fpga01/poll2/will-it-scale
commit:
v4.20-rc7
8234f6734c ("PM-runtime: Switch autosuspend over to using hrtimers")
v4.20-rc7 8234f6734c5d74ac794e551743
---------------- --------------------------
fail:runs %reproduction fail:runs
| | |
:2 50% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
240408 -3.6% 231711 will-it-scale.per_process_ops
25002520 -3.6% 24097991 will-it-scale.workload
351914 -1.7% 345882 interrupts.CAL:Function_call_interrupts
1.77 ± 45% -1.1 0.64 mpstat.cpu.idle%
106164 ± 24% -23.2% 81494 ± 28% numa-meminfo.node0.AnonHugePages
326430 ± 8% -11.3% 289513 softirqs.SCHED
1294 -2.0% 1268 vmstat.system.cs
3178 +48.4% 4716 ± 16% slabinfo.eventpoll_pwq.active_objs
3178 +48.4% 4716 ± 16% slabinfo.eventpoll_pwq.num_objs
336.32 -100.0% 0.00 uptime.boot
3192 -100.0% 0.00 uptime.idle
3.456e+08 ± 76% -89.9% 34913819 ± 62% cpuidle.C1E.time
747832 ± 72% -87.5% 93171 ± 45% cpuidle.C1E.usage
16209 ± 26% -38.2% 10021 ± 44% cpuidle.POLL.time
6352 ± 32% -39.5% 3843 ± 48% cpuidle.POLL.usage
885259 ± 2% -13.8% 763434 ± 7% numa-vmstat.node0.numa_hit
865117 ± 2% -13.9% 744992 ± 7% numa-vmstat.node0.numa_local
405085 ± 7% +38.0% 558905 ± 9% numa-vmstat.node1.numa_hit
254056 ± 11% +59.7% 405824 ± 13% numa-vmstat.node1.numa_local
738158 ± 73% -88.5% 85078 ± 47% turbostat.C1E
1.07 ± 76% -1.0 0.11 ± 62% turbostat.C1E%
1.58 ± 49% -65.4% 0.55 ± 6% turbostat.CPU%c1
0.15 ± 13% -35.0% 0.10 ± 38% turbostat.CPU%c6
153.97 ± 16% -54.7 99.31 turbostat.PKG_%
64141 +1.5% 65072 proc-vmstat.nr_anon_pages
19541 -7.0% 18178 ± 8% proc-vmstat.nr_shmem
18296 +1.1% 18506 proc-vmstat.nr_slab_reclaimable
713938 -2.3% 697489 proc-vmstat.numa_hit
693688 -2.4% 677228 proc-vmstat.numa_local
772220 -1.9% 757334 proc-vmstat.pgalloc_normal
798565 -1.8% 784042 proc-vmstat.pgfault
732336 -2.7% 712661 proc-vmstat.pgfree
20.33 ± 4% -7.0% 18.92 sched_debug.cfs_rq:/.runnable_load_avg.max
160603 -44.5% 89108 ± 38% sched_debug.cfs_rq:/.spread0.avg
250694 -29.3% 177358 ± 18% sched_debug.cfs_rq:/.spread0.max
1109 ± 4% -7.0% 1031 sched_debug.cfs_rq:/.util_avg.max
20.33 ± 4% -7.2% 18.88 sched_debug.cpu.cpu_load[0].max
-10.00 +35.0% -13.50 sched_debug.cpu.nr_uninterruptible.min
3.56 ± 10% +44.2% 5.14 ± 18% sched_debug.cpu.nr_uninterruptible.stddev
87.10 ± 24% -34.0% 57.44 ± 37% sched_debug.cpu.sched_goidle.avg
239.48 -25.6% 178.07 ± 18% sched_debug.cpu.sched_goidle.stddev
332.67 ± 7% -25.5% 247.83 ± 13% sched_debug.cpu.ttwu_count.min
231.67 ± 8% -15.4% 195.96 ± 12% sched_debug.cpu.ttwu_local.min
95.47 -95.5 0.00 perf-profile.calltrace.cycles-pp.poll
90.26 -90.3 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.poll
90.08 -90.1 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll
89.84 -89.8 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll
88.04 -88.0 0.00 perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe.poll
2.66 -0.1 2.54 perf-profile.calltrace.cycles-pp._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.90 -0.1 1.81 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_from_user.do_sys_poll.__x64_sys_poll.do_syscall_64
2.56 +0.1 2.64 perf-profile.calltrace.cycles-pp.__fdget.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.3 2.29 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.00 +2.3 2.34 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
17.45 +3.8 21.24 perf-profile.calltrace.cycles-pp.__fget_light.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +92.7 92.66 perf-profile.calltrace.cycles-pp.do_sys_poll.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +94.5 94.51 perf-profile.calltrace.cycles-pp.__x64_sys_poll.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +94.8 94.75 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +94.9 94.92 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
96.03 -96.0 0.00 perf-profile.children.cycles-pp.poll
90.29 -90.3 0.00 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
90.11 -90.1 0.00 perf-profile.children.cycles-pp.do_syscall_64
89.87 -89.9 0.00 perf-profile.children.cycles-pp.__x64_sys_poll
89.39 -89.4 0.00 perf-profile.children.cycles-pp.do_sys_poll
16.19 -16.2 0.00 perf-profile.children.cycles-pp.__fget_light
68.59 -68.6 0.00 perf-profile.self.cycles-pp.do_sys_poll
14.84 -14.8 0.00 perf-profile.self.cycles-pp.__fget_light
1.759e+13 -100.0% 0.00 perf-stat.branch-instructions
0.28 -0.3 0.00 perf-stat.branch-miss-rate%
4.904e+10 -100.0% 0.00 perf-stat.branch-misses
6.79 ± 3% -6.8 0.00 perf-stat.cache-miss-rate%
1.071e+08 ± 4% -100.0% 0.00 perf-stat.cache-misses
1.578e+09 -100.0% 0.00 perf-stat.cache-references
385311 ± 2% -100.0% 0.00 perf-stat.context-switches
1.04 -100.0% 0.00 perf-stat.cpi
8.643e+13 -100.0% 0.00 perf-stat.cpu-cycles
13787 -100.0% 0.00 perf-stat.cpu-migrations
0.00 ± 4% -0.0 0.00 perf-stat.dTLB-load-miss-rate%
23324811 ± 5% -100.0% 0.00 perf-stat.dTLB-load-misses
1.811e+13 -100.0% 0.00 perf-stat.dTLB-loads
0.00 -0.0 0.00 perf-stat.dTLB-store-miss-rate%
2478029 -100.0% 0.00 perf-stat.dTLB-store-misses
8.775e+12 -100.0% 0.00 perf-stat.dTLB-stores
99.66 -99.7 0.00 perf-stat.iTLB-load-miss-rate%
7.527e+09 -100.0% 0.00 perf-stat.iTLB-load-misses
25540468 ± 39% -100.0% 0.00 perf-stat.iTLB-loads
8.33e+13 -100.0% 0.00 perf-stat.instructions
11066 -100.0% 0.00 perf-stat.instructions-per-iTLB-miss
0.96 -100.0% 0.00 perf-stat.ipc
777357 -100.0% 0.00 perf-stat.minor-faults
81.69 -81.7 0.00 perf-stat.node-load-miss-rate%
20040093 -100.0% 0.00 perf-stat.node-load-misses
4491667 ± 7% -100.0% 0.00 perf-stat.node-loads
75.23 ± 10% -75.2 0.00 perf-stat.node-store-miss-rate%
3418662 ± 30% -100.0% 0.00 perf-stat.node-store-misses
1027183 ± 11% -100.0% 0.00 perf-stat.node-stores
777373 -100.0% 0.00 perf-stat.page-faults
3331644 -100.0% 0.00 perf-stat.path-length
will-it-scale.per_process_ops
242000 +-+----------------------------------------------------------------+
| +.+.. .+..+. .+.+..+.+.+. .+.+.. |
240000 +-+ + +.+ +.+..+ +..+ +.|
238000 +-+..+.+. .+. .+..+ |
| +. +.+ |
236000 +-+ |
| |
234000 +-+ |
| O O O O |
232000 +-+ O O O O O O O O O O O O O |
230000 +-+ O O O O O O |
| O |
228000 O-+ O O |
| O O |
226000 +-+----------------------------------------------------------------+
will-it-scale.workload
2.52e+07 +-+--------------------------------------------------------------+
| +..+. .+..+. .+. .+.+..+. .+..+. |
2.5e+07 +-+ + +.+ +.+.+. + +.+ +.|
2.48e+07 +-+.+..+. .+. .+.+ |
| + +..+ |
2.46e+07 +-+ |
2.44e+07 +-+ |
| |
2.42e+07 +-+ O O O O O O O O |
2.4e+07 +-+ O O O O O O O O O O |
| O O O O O O |
2.38e+07 O-+ O |
2.36e+07 +-O O O |
| |
2.34e+07 +-+--------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 1 month
a8cc099c95 ("ARC: adjust memblock_reserve of kernel memory"): BUG: kernel reboot-without-warning in boot stage
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/0day-ci/linux/commits/Eugeniy-Paltsev/ARC-adjust-membl...
commit a8cc099c956012905a3de91ebe031526a29f5eee
Author: Eugeniy Paltsev <Eugeniy.Paltsev(a)synopsys.com>
AuthorDate: Wed Dec 19 19:16:16 2018 +0300
Commit: 0day robot <lkp(a)intel.com>
CommitDate: Fri Dec 21 16:37:55 2018 +0800
ARC: adjust memblock_reserve of kernel memory
In setup_arch_memory we reserve the memory area wherein the kernel
is located. Current implementation may reserve more memory than
it actually required in case of CONFIG_LINUX_LINK_BASE is not
equal to CONFIG_LINUX_RAM_BASE. This happens because we calculate
start of the reserved region relatively to the CONFIG_LINUX_RAM_BASE
and end of the region relatively to the CONFIG_LINUX_RAM_BASE.
For example in case of HSDK board we wasted 256MiB of physical memory:
------------------->8------------------------------
Memory: 770416K/1048576K available (5496K kernel code,
240K rwdata, 1064K rodata, 2200K init, 275K bss,
278160K reserved, 0K cma-reserved)
------------------->8------------------------------
Fix that.
Cc: stable(a)vger.kernel.org
Signed-off-by: Eugeniy Paltsev <Eugeniy.Paltsev(a)synopsys.com>
4fbd8d194f Linux 4.15-rc1
a8cc099c95 ARC: adjust memblock_reserve of kernel memory
+-------------------------------------------------+-----------+------------+
| | v4.15-rc1 | a8cc099c95 |
+-------------------------------------------------+-----------+------------+
| boot_successes | 56 | 0 |
| boot_failures | 5 | 28 |
| End_of_test:RCU_HOTPLUG | 3 | |
| Mem-Info | 2 | |
| BUG:kernel_reboot-without-warning_in_boot_stage | 0 | 28 |
+-------------------------------------------------+-----------+------------+
output_len: 0x00000000016a69a8
kernel_total_size: 0x0000000001948000
Decompressing Linux... Parsing ELF... done.
Booting the kernel.
BUG: kernel reboot-without-warning in boot stage
Linux version 4.15.0-rc1-00001-ga8cc099 #1
Command line: root=/dev/ram0 hung_task_panic=1 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 net.ifnames=0 printk.devkmsg=on panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 drbd.minor_count=8 systemd.log_level=err ignore_loglevel console=tty0 earlyprintk=ttyS0,115200 console=ttyS0,115200 vga=normal rw link=/cephfs/kbuild/run-queue/kvm/x86_64-rhel-7.2-clear/linux-review:Eugeniy-Paltsev:ARC-adjust-memblock_reserve-of-kernel-memory:20181221-163750:a8cc099c956012905a3de91ebe031526a29f5eee/.vmlinuz-a8cc099c956012905a3de91ebe031526a29f5eee-20190117183135-5:yocto-vm-yocto-235 branch=linux-review/Eugeniy-Paltsev/ARC-adjust-memblock_reserve-of-kernel-memory/20181221-163750 BOOT_IMAGE=/pkg/linux/x86_64-rhel-7.2-clear/gcc-7/a8cc099c956012905a3de91ebe031526a29f5eee/vmlinuz-4.15.0-rc1-00001-ga8cc099 drbd.minor_count=8 rcuperf.shutdown=0
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start a8cc099c956012905a3de91ebe031526a29f5eee 4fbd8d194f06c8a3fd2af1ce560ddb31f7ec8323 --
# first bad commit: [a8cc099c956012905a3de91ebe031526a29f5eee] ARC: adjust memblock_reserve of kernel memory
git bisect good 4fbd8d194f06c8a3fd2af1ce560ddb31f7ec8323 # 21:34 G 31 0 3 14 Linux 4.15-rc1
# extra tests on HEAD of linux-review/Eugeniy-Paltsev/ARC-adjust-memblock_reserve-of-kernel-memory/20181221-163750
git bisect bad a8cc099c956012905a3de91ebe031526a29f5eee # 21:35 B 0 28 61 0 ARC: adjust memblock_reserve of kernel memory
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
2 years, 1 month