July 2019 - LKP - Ml01.01.Org

[sched/fair] e1f4f2a13d: reaim.jobs_per_min -20.1% regression

by kernel test robot

Greeting, FYI, we noticed a -20.1% regression of reaim.jobs_per_min due to commit: commit: e1f4f2a13d35480157bd3b83255757b8f15ed90f ("sched/fair: rework load_balance") https://git.linaro.org/people/vincent.guittot/kernel.git sched-rework-load_balance in testcase: reaim on test machine: 40 threads Skylake-SP with 64G memory with following parameters: runtime: 300s nr_task: 100% test: fserver cpufreq_governor: performance test-description: REAIM is an updated and improved version of AIM 7 benchmark. test-url: https://sourceforge.net/projects/re-aim-7/ In addition to that, the commit also has significant impact on the following tests: +------------------+----------------------------------------------------------------------+ | testcase: change | hackbench: hackbench.throughput -1.4% regression | | test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory | | test parameters | cpufreq_governor=performance | | | ipc=pipe | | | mode=threads | | | nr_threads=50% | | | ucode=0xb000036 | +------------------+----------------------------------------------------------------------+ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase: gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-sp2/fserver/reaim commit: 6824881809 ("sched/fair: rename sum_nr_running to sum_h_nr_running") e1f4f2a13d ("sched/fair: rework load_balance") 6824881809407252 e1f4f2a13d35480157bd3b83255 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 2:4 11% 2:4 perf-profile.calltrace.cycles-pp.error_entry 2:4 12% 3:4 perf-profile.children.cycles-pp.error_entry 1:4 8% 1:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 3.87 -17.5% 3.20 reaim.child_systime 13.47 -6.8% 12.56 reaim.child_utime 484360 -20.1% 387225 reaim.jobs_per_min 12109 -20.1% 9680 reaim.jobs_per_min_child 97.09 -2.9% 94.30 reaim.jti 497270 -18.8% 404000 reaim.max_jobs_per_min 0.50 +25.1% 0.63 reaim.parent_time 2.38 +118.3% 5.19 reaim.std_dev_percent 0.01 +190.6% 0.03 reaim.std_dev_time 95893567 -5.2% 90925485 reaim.time.minor_page_faults 688.25 -13.4% 595.75 reaim.time.percent_of_cpu_this_job_got 466.54 -21.6% 365.87 reaim.time.system_time 1617 -11.4% 1432 reaim.time.user_time 930114 -14.5% 795589 reaim.time.voluntary_context_switches 480000 -5.0% 456000 reaim.workload 0.03 -0.0 0.02 mpstat.cpu.all.soft% 4.80 -0.9 3.90 mpstat.cpu.all.sys% 12.84 -1.6 11.25 mpstat.cpu.all.usr% 584.25 -14.2% 501.50 turbostat.Avg_MHz 21.63 ± 3% -3.7 17.96 turbostat.Busy% 64.94 ± 14% +19.6% 77.69 ± 9% turbostat.CPU%c1 63.49 ± 2% +6.3% 67.52 ± 2% turbostat.PkgWatt 82.00 +2.4% 84.00 vmstat.cpu.id 12.00 -8.3% 11.00 vmstat.cpu.us 7.00 +14.3% 8.00 vmstat.procs.r 10856 +8.4% 11767 vmstat.system.cs 14157 -0.9% 14027 proc-vmstat.nr_slab_reclaimable 29868 -2.2% 29221 proc-vmstat.nr_slab_unreclaimable 90466060 -5.4% 85612219 proc-vmstat.numa_hit 90466060 -5.4% 85612219 proc-vmstat.numa_local 28134 +21.2% 34106 proc-vmstat.pgactivate 92547154 -5.5% 87485227 proc-vmstat.pgalloc_normal 96344232 -5.2% 91372003 proc-vmstat.pgfault 92521547 -5.5% 87459976 proc-vmstat.pgfree 24219 +14.2% 27655 slabinfo.anon_vma_chain.active_objs 24308 +14.1% 27727 slabinfo.anon_vma_chain.num_objs 71134 -33.7% 47163 ± 2% slabinfo.kmalloc-32.active_objs 555.50 -33.8% 368.00 ± 2% slabinfo.kmalloc-32.active_slabs 71171 -33.7% 47163 ± 2% slabinfo.kmalloc-32.num_objs 555.50 -33.8% 368.00 ± 2% slabinfo.kmalloc-32.num_slabs 1032 ± 5% -25.6% 768.00 ± 20% slabinfo.kmalloc-rcl-128.active_objs 1032 ± 5% -25.6% 768.00 ± 20% slabinfo.kmalloc-rcl-128.num_objs 3280 ± 2% -24.4% 2480 slabinfo.pid.active_objs 3280 ± 2% -24.4% 2480 slabinfo.pid.num_objs 3793 -31.8% 2588 ± 3% slabinfo.signal_cache.active_objs 3812 -32.1% 2588 ± 3% slabinfo.signal_cache.num_objs 4389 ± 2% -17.5% 3621 ± 2% slabinfo.task_delay_info.active_objs 4389 ± 2% -17.5% 3621 ± 2% slabinfo.task_delay_info.num_objs 16772 +10.9% 18600 slabinfo.vm_area_struct.active_objs 16801 +10.9% 18632 slabinfo.vm_area_struct.num_objs 26215 -26.5% 19277 ± 10% sched_debug.cfs_rq:/.exec_clock.avg 31037 ± 4% -22.1% 24191 ± 3% sched_debug.cfs_rq:/.exec_clock.max 25628 -27.8% 18508 ± 10% sched_debug.cfs_rq:/.exec_clock.min 46.85 ± 18% +31.1% 61.42 ± 13% sched_debug.cfs_rq:/.load_avg.avg 920636 -33.9% 608944 ± 10% sched_debug.cfs_rq:/.min_vruntime.avg 1008783 ± 2% -31.7% 689236 ± 6% sched_debug.cfs_rq:/.min_vruntime.max 900473 -34.7% 587753 ± 10% sched_debug.cfs_rq:/.min_vruntime.min 0.27 ± 5% +17.2% 0.32 ± 3% sched_debug.cfs_rq:/.nr_running.stddev 145.48 ± 36% +38.3% 201.16 ± 34% sched_debug.cfs_rq:/.util_avg.avg 128190 ± 14% +23.4% 158225 ± 4% sched_debug.cpu.avg_idle.stddev 18406 -42.6% 10573 ± 10% sched_debug.cpu.curr->pid.max 0.13 ± 50% +53.6% 0.20 ± 40% sched_debug.cpu.nr_running.avg 0.27 ± 6% +27.8% 0.34 ± 13% sched_debug.cpu.nr_running.stddev 36.54 ± 14% -26.7% 26.79 ± 5% sched_debug.cpu.nr_uninterruptible.max -29.92 -21.7% -23.43 sched_debug.cpu.nr_uninterruptible.min 15.18 ± 10% -28.0% 10.93 ± 9% sched_debug.cpu.nr_uninterruptible.stddev 10011 ± 2% +19.5% 11964 ± 11% sched_debug.cpu.sched_goidle.min 1220 ± 10% -17.5% 1007 ± 11% sched_debug.cpu.sched_goidle.stddev 16483 -17.6% 13588 ± 10% sched_debug.cpu.ttwu_count.avg 14875 -17.5% 12267 ± 11% sched_debug.cpu.ttwu_count.min 7897 -15.1% 6708 ± 10% sched_debug.cpu.ttwu_local.avg 8676 -16.4% 7257 ± 9% sched_debug.cpu.ttwu_local.max 332.21 ± 12% -30.4% 231.14 ± 8% sched_debug.cpu.ttwu_local.stddev 2.331e+09 -4.8% 2.219e+09 perf-stat.i.branch-instructions 31648910 ± 5% -12.9% 27554102 ± 3% perf-stat.i.branch-misses 66054221 ± 13% -20.9% 52232556 ± 11% perf-stat.i.cache-references 10908 +8.1% 11789 perf-stat.i.context-switches 2.51 ± 12% -22.8% 1.94 ± 13% perf-stat.i.cpi 2.296e+10 -14.6% 1.961e+10 perf-stat.i.cpu-cycles 4070 -40.4% 2424 perf-stat.i.cpu-migrations 2.258e+09 -4.8% 2.15e+09 perf-stat.i.dTLB-loads 1561835 -6.0% 1468144 perf-stat.i.dTLB-store-misses 1.224e+09 -4.8% 1.165e+09 perf-stat.i.dTLB-stores 1593761 ± 4% -9.5% 1442915 ± 5% perf-stat.i.iTLB-load-misses 1.468e+10 -4.8% 1.397e+10 perf-stat.i.instructions 0.50 ± 6% +18.3% 0.59 ± 5% perf-stat.i.ipc 314246 -5.1% 298289 perf-stat.i.minor-faults 250295 +4.8% 262228 perf-stat.i.node-loads 314245 -5.1% 298288 perf-stat.i.page-faults 1.36 ± 6% -0.1 1.24 ± 4% perf-stat.overall.branch-miss-rate% 1.56 -10.3% 1.40 perf-stat.overall.cpi 39.29 ± 3% -2.9 36.37 ± 5% perf-stat.overall.iTLB-load-miss-rate% 0.64 +11.4% 0.71 perf-stat.overall.ipc 2.322e+09 -4.8% 2.211e+09 perf-stat.ps.branch-instructions 31534886 ± 5% -12.9% 27455873 ± 3% perf-stat.ps.branch-misses 65820893 ± 13% -20.9% 52046355 ± 11% perf-stat.ps.cache-references 10869 +8.1% 11746 perf-stat.ps.context-switches 2.287e+10 -14.6% 1.954e+10 perf-stat.ps.cpu-cycles 4055 -40.4% 2416 perf-stat.ps.cpu-migrations 2.25e+09 -4.8% 2.142e+09 perf-stat.ps.dTLB-loads 1556081 -6.0% 1462781 perf-stat.ps.dTLB-store-misses 1.219e+09 -4.8% 1.161e+09 perf-stat.ps.dTLB-stores 1587991 ± 4% -9.5% 1437722 ± 5% perf-stat.ps.iTLB-load-misses 1.462e+10 -4.8% 1.392e+10 perf-stat.ps.instructions 313084 -5.1% 297198 perf-stat.ps.minor-faults 249390 +4.8% 261293 perf-stat.ps.node-loads 313083 -5.1% 297196 perf-stat.ps.page-faults 4.431e+12 -5.2% 4.201e+12 perf-stat.total.instructions 97508 ± 6% +18.6% 115660 ± 8% softirqs.CPU0.TIMER 67484 ± 2% -9.9% 60810 ± 2% softirqs.CPU1.RCU 66767 ± 2% -11.2% 59300 ± 4% softirqs.CPU10.RCU 64911 ± 2% -10.8% 57931 ± 2% softirqs.CPU12.RCU 64303 ± 2% -7.7% 59326 ± 5% softirqs.CPU13.RCU 65820 ± 3% -10.6% 58850 softirqs.CPU14.RCU 63480 ± 2% -9.8% 57277 ± 3% softirqs.CPU15.RCU 93784 ± 3% +12.1% 105169 ± 7% softirqs.CPU15.TIMER 65991 ± 2% -11.3% 58552 softirqs.CPU16.RCU 65084 ± 3% -9.3% 59027 softirqs.CPU17.RCU 65370 ± 4% -10.9% 58274 softirqs.CPU18.RCU 65250 ± 3% -10.1% 58678 ± 2% softirqs.CPU19.RCU 67231 ± 3% -13.0% 58495 softirqs.CPU2.RCU 142574 ± 8% -15.5% 120453 ± 4% softirqs.CPU2.TIMER 64807 ± 3% -10.4% 58081 ± 3% softirqs.CPU20.RCU 65897 ± 3% -12.2% 57884 softirqs.CPU21.RCU 64836 ± 5% -9.8% 58514 softirqs.CPU23.RCU 64896 -9.9% 58498 ± 2% softirqs.CPU24.RCU 63980 ± 2% -13.9% 55055 ± 3% softirqs.CPU25.RCU 62771 ± 3% -8.4% 57522 softirqs.CPU26.RCU 62248 -9.6% 56292 ± 2% softirqs.CPU27.NET_RX 64517 ± 3% -10.4% 57799 softirqs.CPU27.RCU 63900 -10.5% 57161 ± 2% softirqs.CPU28.RCU 64220 ± 3% -10.2% 57696 ± 2% softirqs.CPU29.RCU 63362 ± 3% -8.9% 57692 ± 2% softirqs.CPU30.RCU 63691 -10.5% 56985 softirqs.CPU31.RCU 64601 ± 2% -13.5% 55902 ± 3% softirqs.CPU32.RCU 64135 -11.0% 57072 ± 4% softirqs.CPU33.RCU 63714 ± 3% -11.7% 56250 ± 2% softirqs.CPU35.RCU 63763 ± 2% -9.9% 57419 ± 3% softirqs.CPU36.RCU 63773 ± 2% -10.8% 56911 softirqs.CPU38.RCU 64713 ± 5% -12.0% 56956 softirqs.CPU39.RCU 90979 ± 2% +35.7% 123432 ± 16% softirqs.CPU5.TIMER 64366 ± 2% -8.2% 59076 softirqs.CPU6.RCU 62134 ± 3% -8.0% 57156 softirqs.CPU7.NET_RX 65082 -11.8% 57371 ± 3% softirqs.CPU8.RCU 2582721 -10.1% 2322807 softirqs.RCU 1.00 ±173% +4600.0% 47.00 ±112% interrupts.63:PCI-MSI.54001693-edge.i40e-eth0-TxRx-28 148.50 ±160% -99.3% 1.00 ±100% interrupts.74:PCI-MSI.54001704-edge.i40e-eth0-TxRx-39 176898 ± 2% +77.6% 314184 interrupts.CAL:Function_call_interrupts 4539 ± 3% +69.9% 7714 ± 2% interrupts.CPU0.CAL:Function_call_interrupts 1462 ± 5% -39.2% 889.00 ± 37% interrupts.CPU0.RES:Rescheduling_interrupts 1330 ± 4% +255.4% 4726 ± 7% interrupts.CPU0.TLB:TLB_shootdowns 4511 ± 2% +74.5% 7872 ± 2% interrupts.CPU1.CAL:Function_call_interrupts 1347 +255.4% 4787 ± 4% interrupts.CPU1.TLB:TLB_shootdowns 4401 ± 3% +78.8% 7871 ± 3% interrupts.CPU10.CAL:Function_call_interrupts 598.50 ± 4% -29.2% 423.50 ± 24% interrupts.CPU10.RES:Rescheduling_interrupts 1308 ± 2% +261.0% 4722 ± 5% interrupts.CPU10.TLB:TLB_shootdowns 4431 ± 2% +75.8% 7791 interrupts.CPU11.CAL:Function_call_interrupts 620.75 ± 4% -38.8% 380.00 ± 21% interrupts.CPU11.RES:Rescheduling_interrupts 1331 +250.9% 4673 ± 4% interrupts.CPU11.TLB:TLB_shootdowns 4474 ± 3% +75.3% 7843 interrupts.CPU12.CAL:Function_call_interrupts 638.75 ± 9% -52.7% 302.25 ± 18% interrupts.CPU12.RES:Rescheduling_interrupts 1335 ± 2% +256.0% 4754 ± 2% interrupts.CPU12.TLB:TLB_shootdowns 4510 ± 3% +73.1% 7809 ± 3% interrupts.CPU13.CAL:Function_call_interrupts 635.75 ± 4% -48.4% 328.25 ± 14% interrupts.CPU13.RES:Rescheduling_interrupts 1355 ± 2% +249.0% 4730 ± 4% interrupts.CPU13.TLB:TLB_shootdowns 4370 ± 2% +80.7% 7896 ± 2% interrupts.CPU14.CAL:Function_call_interrupts 651.00 ± 10% -51.8% 314.00 ± 11% interrupts.CPU14.RES:Rescheduling_interrupts 1413 ± 12% +237.8% 4774 ± 4% interrupts.CPU14.TLB:TLB_shootdowns 4487 +76.3% 7912 ± 2% interrupts.CPU15.CAL:Function_call_interrupts 667.25 ± 12% -53.3% 311.75 ± 13% interrupts.CPU15.RES:Rescheduling_interrupts 1327 ± 3% +265.1% 4847 ± 2% interrupts.CPU15.TLB:TLB_shootdowns 4478 +76.0% 7880 ± 2% interrupts.CPU16.CAL:Function_call_interrupts 587.00 ± 3% -49.4% 297.25 ± 15% interrupts.CPU16.RES:Rescheduling_interrupts 1335 ± 2% +257.6% 4774 ± 3% interrupts.CPU16.TLB:TLB_shootdowns 4508 ± 3% +74.6% 7869 ± 2% interrupts.CPU17.CAL:Function_call_interrupts 597.50 ± 3% -43.8% 335.50 ± 22% interrupts.CPU17.RES:Rescheduling_interrupts 1346 ± 4% +252.7% 4747 ± 3% interrupts.CPU17.TLB:TLB_shootdowns 4437 +78.0% 7900 ± 3% interrupts.CPU18.CAL:Function_call_interrupts 696.25 ± 15% -45.2% 381.50 ± 26% interrupts.CPU18.RES:Rescheduling_interrupts 1399 ± 10% +241.1% 4774 ± 6% interrupts.CPU18.TLB:TLB_shootdowns 4414 +76.3% 7783 ± 2% interrupts.CPU19.CAL:Function_call_interrupts 762.00 ± 14% -59.4% 309.25 ± 16% interrupts.CPU19.RES:Rescheduling_interrupts 1341 ± 2% +248.7% 4677 ± 4% interrupts.CPU19.TLB:TLB_shootdowns 4426 ± 2% +79.0% 7921 ± 2% interrupts.CPU2.CAL:Function_call_interrupts 1324 ± 4% +260.4% 4771 ± 5% interrupts.CPU2.TLB:TLB_shootdowns 4330 +78.5% 7728 ± 2% interrupts.CPU20.CAL:Function_call_interrupts 595.75 ± 3% -48.9% 304.25 ± 15% interrupts.CPU20.RES:Rescheduling_interrupts 1264 +267.6% 4646 ± 4% interrupts.CPU20.TLB:TLB_shootdowns 4358 ± 3% +80.4% 7862 ± 2% interrupts.CPU21.CAL:Function_call_interrupts 642.75 ± 15% -59.7% 259.25 ± 8% interrupts.CPU21.RES:Rescheduling_interrupts 1243 ± 2% +277.8% 4697 ± 4% interrupts.CPU21.TLB:TLB_shootdowns 4432 +80.1% 7984 interrupts.CPU22.CAL:Function_call_interrupts 588.75 ± 6% -45.4% 321.50 ± 20% interrupts.CPU22.RES:Rescheduling_interrupts 1270 +279.8% 4825 ± 3% interrupts.CPU22.TLB:TLB_shootdowns 4365 ± 2% +77.5% 7746 ± 2% interrupts.CPU23.CAL:Function_call_interrupts 600.50 ± 3% -47.3% 316.25 ± 20% interrupts.CPU23.RES:Rescheduling_interrupts 1252 ± 2% +265.4% 4576 ± 4% interrupts.CPU23.TLB:TLB_shootdowns 4326 ± 3% +80.9% 7826 interrupts.CPU24.CAL:Function_call_interrupts 650.00 ± 11% -50.1% 324.25 ± 31% interrupts.CPU24.RES:Rescheduling_interrupts 1243 ± 3% +278.1% 4702 ± 3% interrupts.CPU24.TLB:TLB_shootdowns 4355 ± 3% +77.3% 7721 ± 2% interrupts.CPU25.CAL:Function_call_interrupts 651.25 ± 10% -57.9% 274.25 ± 7% interrupts.CPU25.RES:Rescheduling_interrupts 1262 ± 4% +271.3% 4685 ± 4% interrupts.CPU25.TLB:TLB_shootdowns 4363 ± 3% +78.2% 7777 ± 5% interrupts.CPU26.CAL:Function_call_interrupts 581.00 ± 5% -45.4% 317.00 ± 17% interrupts.CPU26.RES:Rescheduling_interrupts 1245 ± 3% +280.8% 4741 ± 8% interrupts.CPU26.TLB:TLB_shootdowns 4363 ± 2% +81.5% 7919 interrupts.CPU27.CAL:Function_call_interrupts 625.50 ± 7% -40.0% 375.50 ± 35% interrupts.CPU27.RES:Rescheduling_interrupts 1290 ± 2% +270.6% 4783 ± 4% interrupts.CPU27.TLB:TLB_shootdowns 1.00 ±173% +4550.0% 46.50 ±114% interrupts.CPU28.63:PCI-MSI.54001693-edge.i40e-eth0-TxRx-28 4416 +74.8% 7722 ± 2% interrupts.CPU28.CAL:Function_call_interrupts 600.50 ± 8% -54.7% 271.75 ± 6% interrupts.CPU28.RES:Rescheduling_interrupts 1262 +263.2% 4586 ± 3% interrupts.CPU28.TLB:TLB_shootdowns 4400 ± 2% +79.3% 7890 ± 3% interrupts.CPU29.CAL:Function_call_interrupts 584.50 ± 7% -44.4% 325.00 ± 17% interrupts.CPU29.RES:Rescheduling_interrupts 1267 +278.5% 4795 ± 5% interrupts.CPU29.TLB:TLB_shootdowns 4423 ± 2% +79.4% 7936 interrupts.CPU3.CAL:Function_call_interrupts 1254 ± 4% +285.7% 4838 ± 3% interrupts.CPU3.TLB:TLB_shootdowns 4377 ± 3% +79.4% 7851 ± 2% interrupts.CPU30.CAL:Function_call_interrupts 592.50 ± 4% -47.8% 309.50 ± 21% interrupts.CPU30.RES:Rescheduling_interrupts 1272 ± 3% +274.9% 4769 ± 3% interrupts.CPU30.TLB:TLB_shootdowns 4351 ± 3% +79.7% 7819 interrupts.CPU31.CAL:Function_call_interrupts 651.50 ± 6% -57.3% 278.25 ± 6% interrupts.CPU31.RES:Rescheduling_interrupts 1284 ± 2% +271.1% 4766 ± 3% interrupts.CPU31.TLB:TLB_shootdowns 4338 ± 3% +81.8% 7886 ± 5% interrupts.CPU32.CAL:Function_call_interrupts 576.25 ± 5% -45.7% 312.75 ± 9% interrupts.CPU32.RES:Rescheduling_interrupts 1278 ± 2% +275.4% 4797 ± 5% interrupts.CPU32.TLB:TLB_shootdowns 4391 ± 3% +77.1% 7778 interrupts.CPU33.CAL:Function_call_interrupts 596.50 ± 3% -52.0% 286.50 ± 7% interrupts.CPU33.RES:Rescheduling_interrupts 1278 ± 2% +562.1% 8463 ± 78% interrupts.CPU33.TLB:TLB_shootdowns 4385 ± 2% +81.8% 7974 ± 2% interrupts.CPU34.CAL:Function_call_interrupts 642.50 -47.6% 336.50 ± 30% interrupts.CPU34.RES:Rescheduling_interrupts 1259 ± 2% +280.2% 4789 ± 5% interrupts.CPU34.TLB:TLB_shootdowns 4416 +80.0% 7951 interrupts.CPU35.CAL:Function_call_interrupts 779.25 ± 33% -56.6% 338.25 ± 10% interrupts.CPU35.RES:Rescheduling_interrupts 1268 +279.4% 4812 ± 2% interrupts.CPU35.TLB:TLB_shootdowns 4362 ± 2% +79.4% 7827 ± 3% interrupts.CPU36.CAL:Function_call_interrupts 625.00 ± 7% -55.7% 276.75 ± 9% interrupts.CPU36.RES:Rescheduling_interrupts 1277 +270.4% 4731 ± 5% interrupts.CPU36.TLB:TLB_shootdowns 4421 +78.2% 7877 ± 2% interrupts.CPU37.CAL:Function_call_interrupts 586.25 ± 2% -50.1% 292.50 ± 9% interrupts.CPU37.RES:Rescheduling_interrupts 1315 +261.2% 4751 ± 4% interrupts.CPU37.TLB:TLB_shootdowns 4470 +77.1% 7918 ± 2% interrupts.CPU38.CAL:Function_call_interrupts 629.50 ± 5% -46.3% 337.75 ± 21% interrupts.CPU38.RES:Rescheduling_interrupts 1294 ± 3% +267.9% 4760 ± 5% interrupts.CPU38.TLB:TLB_shootdowns 148.00 ±161% -99.5% 0.75 ±110% interrupts.CPU39.74:PCI-MSI.54001704-edge.i40e-eth0-TxRx-39 4382 ± 2% +76.0% 7711 ± 2% interrupts.CPU39.CAL:Function_call_interrupts 642.50 ± 9% -59.3% 261.75 ± 11% interrupts.CPU39.RES:Rescheduling_interrupts 1282 ± 2% +256.9% 4576 ± 4% interrupts.CPU39.TLB:TLB_shootdowns 4467 +79.4% 8013 ± 2% interrupts.CPU4.CAL:Function_call_interrupts 1313 +270.4% 4866 ± 4% interrupts.CPU4.TLB:TLB_shootdowns 4457 ± 3% +74.3% 7767 interrupts.CPU5.CAL:Function_call_interrupts 849.50 ± 23% -60.8% 332.75 ± 7% interrupts.CPU5.RES:Rescheduling_interrupts 1334 ± 3% +252.7% 4705 ± 3% interrupts.CPU5.TLB:TLB_shootdowns 4489 +75.4% 7874 interrupts.CPU6.CAL:Function_call_interrupts 676.75 ± 13% -52.7% 320.25 ± 16% interrupts.CPU6.RES:Rescheduling_interrupts 1318 ± 2% +267.9% 4849 ± 6% interrupts.CPU6.TLB:TLB_shootdowns 4453 ± 2% +79.1% 7974 interrupts.CPU7.CAL:Function_call_interrupts 720.75 ± 20% -45.2% 395.25 ± 29% interrupts.CPU7.RES:Rescheduling_interrupts 1326 ± 3% +264.2% 4830 interrupts.CPU7.TLB:TLB_shootdowns 4509 ± 2% +76.1% 7942 interrupts.CPU8.CAL:Function_call_interrupts 762.00 ± 16% -53.0% 358.00 ± 36% interrupts.CPU8.RES:Rescheduling_interrupts 1348 ± 3% +257.9% 4827 ± 3% interrupts.CPU8.TLB:TLB_shootdowns 4498 ± 2% +74.2% 7834 ± 3% interrupts.CPU9.CAL:Function_call_interrupts 674.00 ± 13% -47.9% 351.00 ± 24% interrupts.CPU9.RES:Rescheduling_interrupts 1345 ± 2% +251.7% 4731 ± 5% interrupts.CPU9.TLB:TLB_shootdowns 26941 ± 5% -45.2% 14752 ± 12% interrupts.RES:Rescheduling_interrupts 52147 +271.4% 193667 ± 5% interrupts.TLB:TLB_shootdowns 27.61 ± 2% -4.9 22.68 ± 8% perf-profile.calltrace.cycles-pp.string_rtns_1 4.09 ± 7% -1.9 2.24 ± 9% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 3.90 ± 7% -1.8 2.06 ± 10% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 4.31 ± 7% -1.8 2.48 ± 10% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk 4.31 ± 7% -1.8 2.48 ± 10% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 4.58 ± 7% -1.8 2.75 ± 10% perf-profile.calltrace.cycles-pp.brk 2.80 ± 8% -1.5 1.28 ± 11% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64 2.77 ± 8% -1.5 1.26 ± 11% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk 2.20 ± 11% -1.4 0.76 ± 13% perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap 3.42 ± 8% -1.3 2.08 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.29 ± 3% -0.6 3.65 ± 8% perf-profile.calltrace.cycles-pp.div_long 4.66 -0.6 4.08 ± 8% perf-profile.calltrace.cycles-pp.add_int.add_int 2.41 ± 3% -0.5 1.93 ± 9% perf-profile.calltrace.cycles-pp.mem_rtns_1 3.05 ± 3% -0.4 2.64 ± 8% perf-profile.calltrace.cycles-pp.add_short.add_short 1.67 ± 2% -0.4 1.29 ± 8% perf-profile.calltrace.cycles-pp.creat 3.03 ± 5% -0.4 2.65 ± 2% perf-profile.calltrace.cycles-pp.execve 3.00 ± 4% -0.4 2.62 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 3.00 ± 4% -0.4 2.62 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 3.00 ± 4% -0.4 2.62 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 2.98 ± 4% -0.4 2.60 ± 2% perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 1.52 ± 2% -0.3 1.18 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 1.51 ± 3% -0.3 1.17 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 1.24 ± 13% -0.3 0.92 ± 17% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 1.36 ± 3% -0.3 1.06 ± 7% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 1.21 ± 3% -0.3 0.92 ± 6% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 1.20 ± 3% -0.3 0.92 ± 6% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.72 ± 4% -0.3 0.44 ± 58% perf-profile.calltrace.cycles-pp.write 2.14 ± 4% -0.3 1.87 ± 2% perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.13 ± 4% -0.3 1.87 ± 2% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64 1.92 ± 5% -0.1 1.77 ± 6% perf-profile.calltrace.cycles-pp.div_short 1.08 ± 3% -0.1 0.94 ± 4% perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file 1.07 ± 3% -0.1 0.93 ± 4% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler 1.11 ± 3% -0.1 0.98 ± 4% perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve 0.57 ± 3% +0.0 0.61 ± 2% perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode 0.56 +0.2 0.71 ± 2% perf-profile.calltrace.cycles-pp._dl_addr 0.13 ±173% +0.6 0.73 ± 18% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64 0.13 ±173% +0.6 0.73 ± 18% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64 0.13 ±173% +0.6 0.73 ± 18% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64 18.80 ± 10% +8.7 27.45 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 18.80 ± 10% +8.7 27.45 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 18.78 ± 10% +8.7 27.44 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 19.21 ± 11% +9.0 28.18 ± 9% perf-profile.calltrace.cycles-pp.secondary_startup_64 16.88 ± 10% +9.0 25.92 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 17.10 ± 10% +9.0 26.14 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 13.76 ± 9% +10.1 23.87 ± 9% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 27.74 ± 2% -4.9 22.79 ± 8% perf-profile.children.cycles-pp.string_rtns_1 4.60 ± 7% -1.8 2.76 ± 10% perf-profile.children.cycles-pp.brk 2.25 ± 14% -1.5 0.71 ± 7% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 2.40 ± 12% -1.5 0.89 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 19.05 ± 4% -1.4 17.61 ± 5% perf-profile.children.cycles-pp.do_syscall_64 19.09 ± 4% -1.4 17.66 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 4.30 ± 7% -1.3 2.96 ± 4% perf-profile.children.cycles-pp.__do_munmap 4.09 ± 7% -1.3 2.75 ± 5% perf-profile.children.cycles-pp.__x64_sys_brk 3.68 ± 8% -1.3 2.38 ± 4% perf-profile.children.cycles-pp.unmap_region 2.70 ± 9% -1.3 1.42 ± 5% perf-profile.children.cycles-pp.release_pages 3.34 ± 7% -1.2 2.15 ± 4% perf-profile.children.cycles-pp.tlb_flush_mmu 3.38 ± 7% -1.2 2.18 ± 4% perf-profile.children.cycles-pp.tlb_finish_mmu 4.29 ± 3% -0.6 3.66 ± 8% perf-profile.children.cycles-pp.div_long 4.66 -0.6 4.08 ± 8% perf-profile.children.cycles-pp.add_int 2.43 ± 3% -0.5 1.94 ± 9% perf-profile.children.cycles-pp.mem_rtns_1 1.36 ± 11% -0.5 0.91 ± 15% perf-profile.children.cycles-pp.write 3.05 ± 3% -0.4 2.64 ± 8% perf-profile.children.cycles-pp.add_short 1.70 ± 2% -0.4 1.31 ± 8% perf-profile.children.cycles-pp.creat 0.89 ± 20% -0.4 0.50 ± 26% perf-profile.children.cycles-pp.vprintk_emit 3.03 ± 5% -0.4 2.65 ± 2% perf-profile.children.cycles-pp.execve 1.28 ± 14% -0.3 0.95 ± 18% perf-profile.children.cycles-pp.menu_select 1.19 ± 14% -0.3 0.87 ± 11% perf-profile.children.cycles-pp.vfs_write 1.15 ± 14% -0.3 0.83 ± 11% perf-profile.children.cycles-pp.new_sync_write 1.20 ± 14% -0.3 0.88 ± 10% perf-profile.children.cycles-pp.ksys_write 0.64 ± 21% -0.3 0.34 ± 35% perf-profile.children.cycles-pp._fini 0.64 ± 21% -0.3 0.34 ± 35% perf-profile.children.cycles-pp.devkmsg_write 0.64 ± 21% -0.3 0.34 ± 35% perf-profile.children.cycles-pp.devkmsg_emit 0.84 ± 9% -0.2 0.63 ± 7% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.79 ± 21% -0.2 0.58 ± 19% perf-profile.children.cycles-pp.console_unlock 0.72 ± 20% -0.2 0.52 ± 20% perf-profile.children.cycles-pp.serial8250_console_write 0.70 ± 20% -0.2 0.51 ± 19% perf-profile.children.cycles-pp.wait_for_xmitr 0.68 ± 21% -0.2 0.50 ± 21% perf-profile.children.cycles-pp.uart_console_write 0.66 ± 20% -0.2 0.49 ± 20% perf-profile.children.cycles-pp.serial8250_console_putchar 0.54 ± 21% -0.2 0.36 ± 20% perf-profile.children.cycles-pp.io_serial_in 0.65 ± 18% -0.2 0.48 ± 21% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.52 ± 11% -0.2 0.36 ± 8% perf-profile.children.cycles-pp.lru_add_drain 0.51 ± 11% -0.2 0.36 ± 8% perf-profile.children.cycles-pp.lru_add_drain_cpu 1.92 ± 5% -0.1 1.78 ± 6% perf-profile.children.cycles-pp.div_short 0.51 ± 17% -0.1 0.38 ± 22% perf-profile.children.cycles-pp.tick_nohz_next_event 0.53 ± 5% -0.1 0.45 ± 7% perf-profile.children.cycles-pp.kill 0.42 ± 6% -0.1 0.35 ± 2% perf-profile.children.cycles-pp.down_write 0.22 ± 9% -0.1 0.16 ± 2% perf-profile.children.cycles-pp.smpboot_thread_fn 0.40 ± 5% -0.1 0.34 ± 3% perf-profile.children.cycles-pp.__lru_cache_add 0.36 ± 3% -0.1 0.30 ± 4% perf-profile.children.cycles-pp.malloc 0.21 ± 2% -0.1 0.16 ± 15% perf-profile.children.cycles-pp.free 0.27 ± 8% -0.1 0.22 ± 8% perf-profile.children.cycles-pp.unlink 0.12 ± 9% -0.0 0.08 ± 12% perf-profile.children.cycles-pp.link 0.12 ± 3% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.rwsem_down_write_failed 0.12 ± 13% -0.0 0.10 ± 9% perf-profile.children.cycles-pp.vfprintf 0.10 ± 10% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.run_ksoftirqd 0.11 ± 7% -0.0 0.09 ± 5% perf-profile.children.cycles-pp.compar2 0.12 ± 3% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.09 ± 4% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.mul_short 0.07 ± 14% -0.0 0.06 ± 15% perf-profile.children.cycles-pp.lseek64 0.09 ± 12% +0.0 0.12 ± 13% perf-profile.children.cycles-pp.inet_recvmsg 0.15 ± 7% +0.0 0.18 ± 6% perf-profile.children.cycles-pp.page_add_file_rmap 0.10 ± 11% +0.0 0.13 ± 13% perf-profile.children.cycles-pp.sock_read_iter 0.32 ± 2% +0.0 0.35 perf-profile.children.cycles-pp.alloc_set_pte 0.29 ± 7% +0.0 0.33 ± 3% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.28 ± 8% +0.0 0.32 perf-profile.children.cycles-pp.vfs_read 0.17 ± 9% +0.0 0.21 ± 9% perf-profile.children.cycles-pp.___perf_sw_event 0.04 ± 58% +0.0 0.08 ± 15% perf-profile.children.cycles-pp.schedule_idle 0.24 ± 10% +0.0 0.28 ± 4% perf-profile.children.cycles-pp.ksys_read 0.14 ± 8% +0.0 0.19 ± 6% perf-profile.children.cycles-pp.__x64_sys_munmap 0.35 ± 5% +0.0 0.40 ± 5% perf-profile.children.cycles-pp.sync_regs 0.18 ± 7% +0.1 0.23 ± 4% perf-profile.children.cycles-pp.new_sync_read 0.68 ± 3% +0.1 0.74 ± 3% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.02 ±173% +0.1 0.11 ± 10% perf-profile.children.cycles-pp.wake_up_klogd_work_func 0.72 ± 2% +0.1 0.82 ± 2% perf-profile.children.cycles-pp.flush_tlb_mm_range 0.62 ± 3% +0.1 0.72 ± 2% perf-profile.children.cycles-pp.flush_tlb_func_common 0.59 ± 3% +0.1 0.69 ± 2% perf-profile.children.cycles-pp.native_flush_tlb_one_user 0.39 ± 13% +0.1 0.49 ± 9% perf-profile.children.cycles-pp.clockevents_program_event 0.56 +0.2 0.71 ± 2% perf-profile.children.cycles-pp._dl_addr 0.41 ± 33% +0.3 0.73 ± 18% perf-profile.children.cycles-pp.start_kernel 18.80 ± 10% +8.7 27.45 ± 9% perf-profile.children.cycles-pp.start_secondary 19.22 ± 11% +9.0 28.19 ± 9% perf-profile.children.cycles-pp.do_idle 19.21 ± 11% +9.0 28.18 ± 9% perf-profile.children.cycles-pp.secondary_startup_64 19.21 ± 11% +9.0 28.18 ± 9% perf-profile.children.cycles-pp.cpu_startup_entry 17.47 ± 10% +9.4 26.82 ± 9% perf-profile.children.cycles-pp.cpuidle_enter_state 17.48 ± 10% +9.4 26.83 ± 9% perf-profile.children.cycles-pp.cpuidle_enter 14.07 ± 9% +9.9 23.99 ± 9% perf-profile.children.cycles-pp.intel_idle 27.51 ± 2% -4.9 22.62 ± 8% perf-profile.self.cycles-pp.string_rtns_1 2.25 ± 14% -1.5 0.71 ± 7% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 4.27 ± 3% -0.6 3.63 ± 8% perf-profile.self.cycles-pp.div_long 4.62 -0.6 4.06 ± 8% perf-profile.self.cycles-pp.add_int 2.40 ± 3% -0.5 1.92 ± 9% perf-profile.self.cycles-pp.mem_rtns_1 3.03 ± 3% -0.4 2.62 ± 8% perf-profile.self.cycles-pp.add_short 0.54 ± 21% -0.2 0.36 ± 20% perf-profile.self.cycles-pp.io_serial_in 0.16 ± 5% -0.1 0.10 ± 15% perf-profile.self.cycles-pp.free 0.33 ± 3% -0.1 0.28 ± 7% perf-profile.self.cycles-pp.malloc 0.11 ± 7% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.compar2 0.09 ± 7% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.copy_page 0.15 ± 8% +0.0 0.18 ± 8% perf-profile.self.cycles-pp.___perf_sw_event 0.35 ± 4% +0.0 0.40 ± 6% perf-profile.self.cycles-pp.sync_regs 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__fput 0.66 ± 2% +0.1 0.72 ± 3% perf-profile.self.cycles-pp.prepare_exit_to_usermode 0.44 ± 4% +0.1 0.51 perf-profile.self.cycles-pp._raw_spin_lock 0.61 ± 6% +0.1 0.69 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.59 ± 3% +0.1 0.69 perf-profile.self.cycles-pp.native_flush_tlb_one_user 0.55 +0.1 0.70 ± 3% perf-profile.self.cycles-pp._dl_addr 0.00 +0.2 0.16 ± 22% perf-profile.self.cycles-pp.find_busiest_group 1.17 ± 3% +0.2 1.34 ± 7% perf-profile.self.cycles-pp.do_syscall_64 14.04 ± 9% +9.9 23.97 ± 9% perf-profile.self.cycles-pp.intel_idle reaim.time.user_time 1800 +-+------------------------------------------------------------------+ |.++.+.++.+.++.++.+.++.+.+ +.++.+.++.++.+ +.+.++.+.++.+.++.++.+.++.| 1600 O-+O O OO O OO OO O OO O OO O OO O OO : : | 1400 +-+ : : OO O O: | | : : : : | 1200 +-+ : : : : | 1000 +-+ : : : : | | : : : : | 800 +-+ :: :: | 600 +-+ :: :: | | :: :: | 400 +-+ : : | 200 +-+ : : | | : : | 0 +-O------------------------------------------------------------------+ reaim.time.system_time 500 +-+-------------------------------------------------------------------+ 450 +-++.+.++.+.++.+.+ ++.+ +.+.++.+.++.+.+ +.++.+.++.+.++.+.++.+.++.| | : : : : | 400 O-+O O OO O OO O OO O OO O OO O OO O O : : | 350 +-+ : : O O OO : | | : : : : | 300 +-+ : : : : | 250 +-+ : : : : | 200 +-+ :: :: | | :: :: | 150 +-+ :: :: | 100 +-+ : : | | : : | 50 +-+ : : | 0 +-O-------------------------------------------------------------------+ reaim.time.percent_of_cpu_this_job_got 800 +-+-------------------------------------------------------------------+ | | 700 +-++.+.++.+.++.+.++.+.++.+ +.+.++.+.++.+.+ +.++.+.++.+.++.+.++.+.++.| 600 O-+O O OO O OO O OO O OO O OO O OO O O : : | | : : O O OO : | 500 +-+ : : : : | | : : : : | 400 +-+ : : : : | | : : :: | 300 +-+ :: :: | 200 +-+ :: :: | | : :: | 100 +-+ : : | | : : | 0 +-O-------------------------------------------------------------------+ reaim.time.minor_page_faults 1e+08 +-+-----------------------------------------------------------------+ 9e+07 O-+O.OO.O.OO.O.OO OO O.OO O OO.OO.O.OO.OO O ++.+.++.++.+.++.+.++.++.| | : : : : | 8e+07 +-+ : : : : | 7e+07 +-+ : : : : | | : : : : | 6e+07 +-+ : : : : | 5e+07 +-+ : : : : | 4e+07 +-+ : : : : | | : : : : | 3e+07 +-+ : : : : | 2e+07 +-+ : : | | : : | 1e+07 +-+ : : | 0 +-O-----------------------------------------------------------------+ reaim.parent_time 0.7 +-+-------------------------------------------------------------------+ | O O O | 0.6 +-+ O OO O OO O O O | O O O OO O OO O OO O OO | 0.5 +-++.+.++.+.++.+.++.+.++.+ +.+.++.+.++.+.+ +.++.+.++.+.++.+.++.+.++.| | : : : : | 0.4 +-+ : : : : | | : : : : | 0.3 +-+ : : : : | | : : :: | 0.2 +-+ :: :: | | :: :: | 0.1 +-+ : : | | : : | 0 +-O-------------------------------------------------------------------+ reaim.child_systime 4 +-+-------------------------------------------------------------------+ | + : : : : +.++ | 3.5 O-+O O OO O OO O OO O OO O OO O OO O O : : | 3 +-+ : : O O OO : | | : : : : | 2.5 +-+ : : : : | | : : : : | 2 +-+ : : :: | | :: :: | 1.5 +-+ :: :: | 1 +-+ :: :: | | : : | 0.5 +-+ : : | | : : | 0 +-O-------------------------------------------------------------------+ reaim.child_utime 14 +-+--------------------------------------------------------------------+ O.+O.O.OO O O OO O OO O.OO O OO.O.O.OO.O.OO O ++.+.++.+.++.+.+ +.+.++.| 12 +-+ : : : : | | : : : : | 10 +-+ : : : : | | : : : : | 8 +-+ : : : : | | : : : : | 6 +-+ : : : : | | : : : : | 4 +-+ : : : : | | : : | 2 +-+ : : | | : : | 0 +-O--------------------------------------------------------------------+ reaim.jobs_per_min 600000 +-+----------------------------------------------------------------+ | | 500000 +-+ .+.++.++.+.++. | |.++.++ ++.+ +.++.+.++.++.+ +.++.++.+.++.++.+.++.++.| O O OO O OO OO O OO OO O OO OO O OO : : | 400000 +-+ : : OO OO : | | : : : : | 300000 +-+ : : : : | | : : : : | 200000 +-+ :: :: | | :: :: | | :: :: | 100000 +-+ : : | | : : | 0 +-O----------------------------------------------------------------+ reaim.jobs_per_min_child 14000 +-+-----------------------------------------------------------------+ | +.+. | 12000 +-++.++.+.+ ++.++.+.++ ++.++.+.++.++ ++.+.++.++.+.++.+.++.++.| O O OO O OO O OO OO O O: O : O : : | 10000 +-+ O OO O O OO OO O : | | : : : : | 8000 +-+ : : : : | | : : : : | 6000 +-+ : : : : | | : : : : | 4000 +-+ : : : : | | :: :: | 2000 +-+ : : | | : : | 0 +-O-----------------------------------------------------------------+ reaim.std_dev_time 0.03 +-+------------------------------------OO-O-------------------------+ | O | 0.025 +-+ | | | | O O OO OO O O | 0.02 O-+O OO O OO O OO OO O O | | | 0.015 +-+ | | | 0.01 +-++.++.+.++.+.++.++.+.++ ++.++.+.++.++ ++.+.++.++.+.++.+.++.++.| | : : : : | | : : : : | 0.005 +-+ : : : : | | : : | 0 +-O-----------------------------------------------------------------+ reaim.std_dev_percent 6 +-+---------------------------------------------------------------------+ | | 5 +-+ O O O O | | | | O O O O | 4 O-+O O O OO O OO O O OO O O O O O | | | 3 +-+ | |.++.+.+. +. .+. +. .+ .+.++.+.++. .+ .+.++.+.+.++.+.++.+.+. +.| 2 +-+ + +.++ +.+ + : + + : + + | | : : : : | | :: : : | 1 +-+ :: :: | | : : | 0 +-O---------------------------------------------------------------------+ reaim.jti 100 +-+-------------------------------------------------------------------+ 90 O-+O O OO O OO O OO O OO O OO O OO O OO O OO : | | : : : : | 80 +-+ : : : : | 70 +-+ : : : : | | : : : : | 60 +-+ : : : : | 50 +-+ : : :: | 40 +-+ :: :: | | :: :: | 30 +-+ :: :: | 20 +-+ : : | | : : | 10 +-+ : : | 0 +-O-------------------------------------------------------------------+ reaim.max_jobs_per_min 600000 +-+----------------------------------------------------------------+ | | 500000 +-++.++.+.++.++.+.++.++.+ +.++.+.++.++.+ +.++.++.+.++.++.+.++.++.| | : : : : | O O OO O OO OO O OO OO O OO OO O OO : : | 400000 +-+ : : OO OO : | | : : : : | 300000 +-+ : : : : | | : : :: | 200000 +-+ :: :: | | :: :: | | : :: | 100000 +-+ : : | | : : | 0 +-O----------------------------------------------------------------+ reaim.workload 500000 +-+----------------------------------------------------------------+ 450000 O-+O.OO.O.OO.OO.O OO OO.O OO.OO.O.OO.OO.OO +.++.++.+.++.++.+.++.++.| | : : : : | 400000 +-+ : : : : | 350000 +-+ : : : : | | : : : : | 300000 +-+ : : : : | 250000 +-+ : : : : | 200000 +-+ :: :: | | :: :: | 150000 +-+ :: :: | 100000 +-+ : : | | : : | 50000 +-+ : : | 0 +-O----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-bdw-ep3: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/process/50%/debian-x86_64-2019-05-14.cgz/lkp-bdw-ep3/hackbench/0xb000036 commit: 6824881809 ("sched/fair: rename sum_nr_running to sum_h_nr_running") e1f4f2a13d ("sched/fair: rework load_balance") 6824881809407252 e1f4f2a13d35480157bd3b83255 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :2 150% 3:4 dmesg.WARNING:at_ip__fsnotify_parent/0x %stddev %change %stddev \ | \ 22729 ± 24% -49.8% 11419 ± 60% numa-numastat.node1.other_node 17257 +2.8% 17744 proc-vmstat.nr_page_table_pages 11516 ± 3% -8.3% 10554 ± 3% softirqs.CPU1.SCHED 11094 ± 2% -8.0% 10212 ± 5% softirqs.CPU14.SCHED 22158 ± 11% -50.1% 11066 ± 93% numa-vmstat.node0.nr_shmem 11883 ± 13% -24.1% 9017 ± 23% numa-vmstat.node0.nr_slab_reclaimable 5938 ± 92% +190.6% 17260 ± 39% numa-vmstat.node0.numa_other 47539 ± 13% -24.1% 36069 ± 23% numa-meminfo.node0.KReclaimable 12583 ± 19% -11.4% 11145 ± 19% numa-meminfo.node0.Mapped 47539 ± 13% -24.1% 36069 ± 23% numa-meminfo.node0.SReclaimable 88559 ± 11% -50.0% 44323 ± 93% numa-meminfo.node0.Shmem 14.07 +2.0% 14.34 perf-stat.i.MPKI 1.506e+09 +1.9% 1.535e+09 perf-stat.i.cache-references 14.06 +2.0% 14.34 perf-stat.overall.MPKI 1.504e+09 +1.9% 1.533e+09 perf-stat.ps.cache-references 995.50 ± 9% -63.3% 365.00 ± 4% interrupts.34:PCI-MSI.3145731-edge.eth0-TxRx-2 740.50 -50.3% 368.25 ± 3% interrupts.38:PCI-MSI.3145735-edge.eth0-TxRx-6 995.50 ± 9% -63.3% 365.00 ± 4% interrupts.CPU13.34:PCI-MSI.3145731-edge.eth0-TxRx-2 740.50 -50.3% 368.25 ± 3% interrupts.CPU17.38:PCI-MSI.3145735-edge.eth0-TxRx-6 7.00 ± 71% +746.4% 59.25 ± 73% interrupts.CPU61.TLB:TLB_shootdowns 1326 ± 9% +94.8% 2583 ± 30% interrupts.TLB:TLB_shootdowns 3336 ± 14% -39.8% 2009 ± 22% sched_debug.cfs_rq:/.load.min 30.14 -8.5% 27.57 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.max 106.01 ± 11% -16.0% 89.03 ± 11% sched_debug.cpu.clock.stddev 106.01 ± 11% -16.0% 89.03 ± 11% sched_debug.cpu.clock_task.stddev 0.00 ± 10% -14.6% 0.00 ± 8% sched_debug.cpu.next_balance.stddev 2.32 ± 5% -9.8% 2.09 ± 6% sched_debug.cpu.nr_running.min 1.51 ± 4% -6.1% 1.42 ± 3% sched_debug.cpu.nr_uninterruptible.avg 0.70 ± 2% -0.0 0.65 ± 2% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.64 -0.0 0.60 ± 4% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64 0.56 +0.0 0.58 perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.89 +0.0 0.92 perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.52 +0.0 0.54 perf-profile.calltrace.cycles-pp.update_curr.reweight_entity.dequeue_task_fair.__schedule.schedule 0.97 +0.0 1.00 perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 1.04 +0.0 1.07 perf-profile.calltrace.cycles-pp.reweight_entity.dequeue_task_fair.__schedule.schedule.pipe_wait 1.06 +0.0 1.10 perf-profile.calltrace.cycles-pp.load_new_mm_cr3.switch_mm_irqs_off.__schedule.schedule.pipe_wait 2.37 +0.1 2.43 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.pipe_wait.pipe_read 1.92 +0.1 1.99 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read 17.42 +0.3 17.73 perf-profile.calltrace.cycles-pp.pipe_wait.pipe_read.new_sync_read.vfs_read.ksys_read 1.37 -0.1 1.28 ± 3% perf-profile.children.cycles-pp.file_has_perm 0.52 -0.1 0.46 ± 8% perf-profile.children.cycles-pp.reschedule_interrupt 0.91 ± 2% -0.1 0.84 ± 3% perf-profile.children.cycles-pp.avc_has_perm 0.45 -0.0 0.42 ± 2% perf-profile.children.cycles-pp.prepare_to_wait 0.25 ± 4% -0.0 0.23 ± 7% perf-profile.children.cycles-pp.rw_verify_area 0.13 -0.0 0.11 ± 6% perf-profile.children.cycles-pp.task_tick_fair 0.28 -0.0 0.26 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.21 ± 2% -0.0 0.19 ± 2% perf-profile.children.cycles-pp.tick_sched_timer 0.18 ± 2% -0.0 0.17 ± 2% perf-profile.children.cycles-pp.tick_sched_handle 0.18 ± 2% -0.0 0.17 ± 2% perf-profile.children.cycles-pp.update_process_times 0.16 +0.0 0.17 ± 2% perf-profile.children.cycles-pp.resched_curr 2.19 +0.1 2.25 perf-profile.children.cycles-pp.reweight_entity 1.21 +0.1 1.28 perf-profile.children.cycles-pp.set_next_entity 17.55 +0.3 17.86 perf-profile.children.cycles-pp.pipe_wait 0.89 ± 2% -0.1 0.83 ± 2% perf-profile.self.cycles-pp.avc_has_perm 0.71 ± 2% -0.0 0.67 perf-profile.self.cycles-pp.try_to_wake_up 0.24 ± 4% -0.0 0.22 ± 6% perf-profile.self.cycles-pp.rw_verify_area 0.23 ± 4% -0.0 0.21 ± 6% perf-profile.self.cycles-pp.ksys_write 0.27 -0.0 0.25 ± 2% perf-profile.self.cycles-pp.prepare_to_wait 0.96 +0.0 0.98 perf-profile.self.cycles-pp.enqueue_task_fair 0.65 +0.0 0.67 perf-profile.self.cycles-pp.__calc_delta 0.30 +0.0 0.33 ± 4% perf-profile.self.cycles-pp.schedule 0.86 +0.0 0.89 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.28 ± 3% +0.0 0.32 ± 3% perf-profile.self.cycles-pp.rb_erase_cached 0.91 +0.0 0.95 ± 2% perf-profile.self.cycles-pp._raw_spin_lock *************************************************************************************************** lkp-bdw-ep3: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/pipe/x86_64-rhel-7.6/threads/50%/debian-x86_64-2019-05-14.cgz/lkp-bdw-ep3/hackbench/0xb000036 commit: 6824881809 ("sched/fair: rename sum_nr_running to sum_h_nr_running") e1f4f2a13d ("sched/fair: rework load_balance") 6824881809407252 e1f4f2a13d35480157bd3b83255 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :2 50% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x :2 50% 1:4 dmesg.WARNING:at_ip__mutex_lock/0x %stddev %change %stddev \ | \ 127594 -1.4% 125832 hackbench.throughput 19993169 ± 8% +43.1% 28618199 ± 13% cpuidle.C1E.time 992796 ± 4% -6.7% 926759 ± 7% numa-meminfo.node0.MemUsed 8020 ± 3% +17.0% 9387 ± 6% softirqs.CPU1.SCHED 692877 ± 4% +21.3% 840432 ± 10% turbostat.C1E 18474747 -1.1% 18272710 vmstat.system.cs 37.61 -1.3% 37.10 boot-time.boot 2865 -0.7% 2843 boot-time.idle 5762437 ± 5% -12.3% 5050885 ± 7% numa-vmstat.node1.numa_hit 5605653 ± 5% -12.6% 4896930 ± 7% numa-vmstat.node1.numa_local 18247 -0.9% 18088 proc-vmstat.nr_slab_reclaimable 19442 ± 6% +12.9% 21952 ± 4% proc-vmstat.pgactivate 610118 ± 12% -18.5% 497215 ± 11% sched_debug.cfs_rq:/.spread0.stddev 3342 ± 53% -53.2% 1563 ± 4% sched_debug.cpu.avg_idle.min -844.09 +13.7% -959.51 sched_debug.cpu.nr_uninterruptible.min 342.78 +15.9% 397.15 ± 6% sched_debug.cpu.nr_uninterruptible.stddev 1917 ± 3% -15.1% 1627 ± 11% slabinfo.UNIX.active_objs 1917 ± 3% -15.1% 1627 ± 11% slabinfo.UNIX.num_objs 9091 ± 4% -8.2% 8348 ± 2% slabinfo.kmalloc-512.active_objs 9250 ± 4% -8.3% 8484 ± 2% slabinfo.kmalloc-512.num_objs 594.00 +23.3% 732.50 ± 7% slabinfo.skbuff_ext_cache.num_objs 3562 ± 3% -13.6% 3078 ± 9% slabinfo.sock_inode_cache.active_objs 3562 ± 3% -13.6% 3078 ± 9% slabinfo.sock_inode_cache.num_objs 12.06 +3.5% 12.49 perf-stat.i.MPKI 2.542e+10 -2.0% 2.492e+10 perf-stat.i.branch-instructions 1.93 +2.0% 1.97 perf-stat.i.cpi 20617 ± 32% -46.7% 10992 ± 51% perf-stat.i.cycles-between-cache-misses 3.761e+10 -1.8% 3.695e+10 perf-stat.i.dTLB-loads 26224314 -1.3% 25874600 perf-stat.i.dTLB-store-misses 2.385e+10 -1.7% 2.345e+10 perf-stat.i.dTLB-stores 1780038 ± 4% -12.4% 1559944 ± 6% perf-stat.i.iTLB-loads 1.263e+11 -2.0% 1.238e+11 perf-stat.i.instructions 0.52 -2.0% 0.51 perf-stat.i.ipc 12.03 +3.6% 12.46 perf-stat.overall.MPKI 1.93 +2.0% 1.97 perf-stat.overall.cpi 8150 ± 31% -35.1% 5286 ± 39% perf-stat.overall.cycles-between-cache-misses 0.52 -2.0% 0.51 perf-stat.overall.ipc 2.538e+10 -1.9% 2.488e+10 perf-stat.ps.branch-instructions 3.755e+10 -1.8% 3.689e+10 perf-stat.ps.dTLB-loads 26183203 -1.3% 25834588 perf-stat.ps.dTLB-store-misses 2.381e+10 -1.7% 2.341e+10 perf-stat.ps.dTLB-stores 1777307 ± 4% -12.4% 1557519 ± 6% perf-stat.ps.iTLB-loads 1.261e+11 -2.0% 1.236e+11 perf-stat.ps.instructions 1115 -30.9% 771.00 ± 12% interrupts.32:PCI-MSI.3145729-edge.eth0-TxRx-0 1115 -30.9% 771.00 ± 12% interrupts.CPU11.32:PCI-MSI.3145729-edge.eth0-TxRx-0 6190099 +13.1% 7002452 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts 6428408 +9.4% 7034643 ± 3% interrupts.CPU19.RES:Rescheduling_interrupts 6108717 ± 2% +10.8% 6765874 ± 4% interrupts.CPU2.RES:Rescheduling_interrupts 6201667 +11.4% 6911496 ± 3% interrupts.CPU20.RES:Rescheduling_interrupts 6626353 ± 5% -6.7% 6183467 ± 5% interrupts.CPU28.RES:Rescheduling_interrupts 3957 +75.5% 6944 ± 24% interrupts.CPU43.NMI:Non-maskable_interrupts 3957 +75.5% 6944 ± 24% interrupts.CPU43.PMI:Performance_monitoring_interrupts 3971 +74.9% 6947 ± 24% interrupts.CPU45.NMI:Non-maskable_interrupts 3971 +74.9% 6947 ± 24% interrupts.CPU45.PMI:Performance_monitoring_interrupts 6263858 +12.5% 7043735 ± 3% interrupts.CPU5.RES:Rescheduling_interrupts 5820732 ± 4% +15.5% 6724700 ± 5% interrupts.CPU51.RES:Rescheduling_interrupts 3957 +75.6% 6947 ± 24% interrupts.CPU52.NMI:Non-maskable_interrupts 3957 +75.6% 6947 ± 24% interrupts.CPU52.PMI:Performance_monitoring_interrupts 6188932 +14.6% 7095450 ± 5% interrupts.CPU53.RES:Rescheduling_interrupts 3970 +99.9% 7934 interrupts.CPU54.NMI:Non-maskable_interrupts 3970 +99.9% 7934 interrupts.CPU54.PMI:Performance_monitoring_interrupts 6043697 ± 4% +15.6% 6985466 ± 4% interrupts.CPU56.RES:Rescheduling_interrupts 5941533 +20.2% 7142469 ± 4% interrupts.CPU60.RES:Rescheduling_interrupts 5820575 ± 4% +15.1% 6701035 ± 4% interrupts.CPU64.RES:Rescheduling_interrupts 3964 +99.7% 7919 interrupts.CPU87.NMI:Non-maskable_interrupts 3964 +99.7% 7919 interrupts.CPU87.PMI:Performance_monitoring_interrupts 5762147 ± 4% +21.9% 7021575 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts 3.35 ± 4% -0.2 3.12 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 1.21 -0.0 1.17 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.55 ± 2% -0.0 0.54 ± 2% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.55 ± 2% +0.0 0.59 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 1.37 +0.1 1.46 ± 2% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_write.new_sync_write.vfs_write.ksys_write 1.25 +0.1 1.34 ± 2% perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule 1.88 ± 2% +0.1 2.01 ± 3% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.26 ±100% +0.3 0.54 ± 3% perf-profile.calltrace.cycles-pp.mutex_unlock.pipe_read.new_sync_read.vfs_read.ksys_read 0.00 +0.5 0.53 ± 4% perf-profile.calltrace.cycles-pp.__update_load_avg_se.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule 3.35 ± 4% -0.2 3.12 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64 2.73 -0.1 2.67 perf-profile.children.cycles-pp.reweight_entity 0.20 ± 7% -0.0 0.15 ± 7% perf-profile.children.cycles-pp.inode_has_perm 1.23 -0.0 1.19 ± 2% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.22 -0.0 0.19 ± 4% perf-profile.children.cycles-pp.__x64_sys_read 0.23 ± 2% -0.0 0.22 ± 5% perf-profile.children.cycles-pp.set_next_buddy 0.39 +0.0 0.41 ± 2% perf-profile.children.cycles-pp.anon_pipe_buf_release 1.46 +0.0 1.50 perf-profile.children.cycles-pp.set_next_entity 1.39 +0.0 1.43 perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.32 ± 7% +0.1 0.38 ± 4% perf-profile.children.cycles-pp.update_cfs_rq_h_load 1.58 +0.1 1.64 perf-profile.children.cycles-pp.__update_load_avg_se 2.33 +0.1 2.41 perf-profile.children.cycles-pp.mutex_lock 0.39 ± 9% +0.1 0.48 ± 10% perf-profile.children.cycles-pp.cpus_share_cache 5.29 +0.1 5.40 perf-profile.children.cycles-pp.pick_next_task_fair 1.88 ± 2% +0.1 2.01 ± 3% perf-profile.children.cycles-pp.switch_fpu_return 2.00 +0.1 2.15 ± 2% perf-profile.children.cycles-pp.mutex_unlock 4.12 +0.2 4.36 perf-profile.children.cycles-pp.update_load_avg 3.35 ± 4% -0.2 3.12 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.77 -0.1 0.70 ± 3% perf-profile.self.cycles-pp.try_to_wake_up 0.23 ± 4% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.ksys_write 0.17 ± 8% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.inode_has_perm 0.19 -0.0 0.16 ± 5% perf-profile.self.cycles-pp.__x64_sys_read 0.45 -0.0 0.43 perf-profile.self.cycles-pp.check_preempt_wakeup 0.36 +0.0 0.38 perf-profile.self.cycles-pp.anon_pipe_buf_release 0.71 ± 2% +0.0 0.76 perf-profile.self.cycles-pp.vfs_read 1.29 +0.0 1.34 perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.32 ± 6% +0.0 0.37 ± 5% perf-profile.self.cycles-pp.update_cfs_rq_h_load 1.54 +0.1 1.60 perf-profile.self.cycles-pp.__update_load_avg_se 1.15 +0.1 1.21 ± 2% perf-profile.self.cycles-pp.enqueue_task_fair 0.56 ± 2% +0.1 0.62 ± 2% perf-profile.self.cycles-pp.__wake_up_common 1.44 +0.1 1.52 perf-profile.self.cycles-pp.mutex_lock 1.15 ± 2% +0.1 1.24 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 0.39 ± 9% +0.1 0.48 ± 10% perf-profile.self.cycles-pp.cpus_share_cache 1.86 ± 2% +0.1 2.00 ± 3% perf-profile.self.cycles-pp.switch_fpu_return 1.96 +0.1 2.10 perf-profile.self.cycles-pp.mutex_unlock Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

10 months, 3 weeks

1
0
0 / 0

[0-Day CI notification] the service had met instability issue and was downgraded

by Li, Philip

Hi all, FYI, this is from 0-Day CI test service team that our service had met instability issue which prevented the effective testing in last week. You may see less bisect report or incomplete testing. We are working on it to recover it, currently, the earliest time we expect it can be back to normal is tomorrow. Thanks

10 months, 3 weeks

1
0
0 / 0

c522ad0637: kernel hang in boot stage

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: c522ad0637cacca1775a3849c2b554f46577b98d ("ACPICA: Update table load object initialization") https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git master in testcase: fio with following parameters: runtime: 300s disk: 1SSD fs: ext4 nr_task: 1 test_size: 128G rw: write bs: 4k ioengine: sync direct: direct test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user. test-url:https://github.com/axboe/fio on test machine: Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): [ 5.408282] smp: Brought up 2 nodes, 72 CPUs [ 5.409283] smpboot: Max logical packages: 2 [ 5.410282] smpboot: Total of 72 processors activated (331375.89 BogoMIPS) [ 5.605290] node 0 initialised, 15956993 pages in 192ms [ 5.611291] node 1 initialised, 16343433 pages in 198ms [ 5.621060] devtmpfs: initialized [ 5.621340] x86/mm: Memory block size: 2048MB [ 5.622967] PM: Registering ACPI NVS region [mem 0x6b521000-0x6bf50fff] (10682368 bytes) [ 5.623599] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 5.624357] futex hash table entries: 32768 (order: 9, 2097152 bytes) [ 5.626618] pinctrl core: initialized pinctrl subsystem [ 5.627368] PM: RTC time: 06:13:50, date: 2019-07-09 [ 5.628697] NET: Registered protocol family 16 [ 5.629457] audit: initializing netlink subsys (disabled) [ 5.630299] audit: type=2000 audit(1562652826.903:1): state=initialized audit_enabled=0 res=1 [ 5.638286] cpuidle: using governor menu [ 5.642292] Detected 1 PCC Subspaces [ 5.646314] Registering PCC driver as Mailbox controller [ 5.651409] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 5.659283] ACPI: bus type PCI registered [ 5.663282] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 5.669472] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 5.679302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 5.680293] PCI: Using configuration type 1 for base access [ 5.685300] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 5.691283] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 5.702283] ACPI: Added _OSI(Module Device) [ 5.706285] ACPI: Added _OSI(Processor Device) [ 5.710282] ACPI: Added _OSI(3.0 _SCP Extensions) [ 5.715281] ACPI: Added _OSI(Processor Aggregator Device) [ 5.720282] ACPI: Added _OSI(Linux-Dell-Video) [ 5.725282] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 5.730282] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 5.776862] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 5.786441] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 5.809488] ACPI: Dynamic OEM Table Load: IFWI Version: SE5C620.86B.OR.64.2018.28.1.01.0847.selfboot Primary Bios Version: SE5C620.86B.00.01.0014.070920180847 Backup Bios Version: SE5C620.86B.00.01.0014.070920180847 System is booting from BIOS Primary Area! BMC Firmware Version: 1.60.56383BEF SDR Version: SDR Package 1.60 ME Firmware Version: 04.00.04.340 Platform ID: S2600WF System memory detected: 131072 MB Current memory speed: 2666 MT/s Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz Number of physical processors identified: 2 AHCI Capable Controller 1 enabling 8 ports of 6Gb/s SATA AHCI Capable Controller 2 enabling 6 ports of 6Gb/s SATA USB Keyboard detected USB Mouse detected BMC BaseBoard IP Address 1 : 192.168.3.35 BMC BaseBoard IP Address 2 : 192.168.3.35 BMC Dedicated NIC IP Address : 192.168.3.36 Press [Enter] to directly boot. Press [F2] to enter setup and select boot options. Press [F6] to show boot menu options. Press [F12] to boot from network. Best Regards, Rong Chen

10 months, 3 weeks

4
7
0 / 0

94cc25049f: hackbench.throughput -19.4% regression

by kernel test robot

Greeting, FYI, we noticed a -19.4% regression of hackbench.throughput due to commit: commit: 94cc25049f407162b193b52c60859e0a8fc6c695 (" iQEzBAABCAAdFiEEghj4iEmqxSLpTPRwpekojE+kFfoFAl0jffgACgkQpekojE+k") https://github.com/zen-kernel/zen-kernel 5.2/zen-tune in testcase: hackbench on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory with following parameters: nr_threads: 50% mode: process ipc: socket cpufreq_governor: performance ucode: 0xb000036 test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler. test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc... In addition to that, the commit also has significant impact on the following tests: Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-7/performance/socket/x86_64-rhel-7.6/process/50%/debian-x86_64-2019-05-14.cgz/lkp-bdw-ep3/hackbench/0xb000036 commit: v5.2 94cc25049f (" iQEzBAABCAAdFiEEghj4iEmqxSLpTPRwpekojE+kFfoFAl0jffgACgkQpekojE+k") v5.2 94cc25049f407162b193b52c608 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :7 14% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x :7 43% 3:4 dmesg.WARNING:at_ip__slab_free/0x %stddev %change %stddev \ | \ 186160 -19.4% 149993 hackbench.throughput 1.166e+08 ± 6% +702.6% 9.361e+08 ± 5% hackbench.time.involuntary_context_switches 882616 -14.7% 753249 hackbench.time.minor_page_faults 8542 +1.6% 8676 hackbench.time.percent_of_cpu_this_job_got 39778 +8.9% 43318 hackbench.time.system_time 12454 -15.5% 10526 hackbench.time.user_time 4.887e+08 ± 3% +322.1% 2.063e+09 ± 5% hackbench.time.voluntary_context_switches 1.162e+09 -18.2% 9.504e+08 hackbench.workload 281856 -10.0% 253669 meminfo.SUnreclaim 93646 ± 5% -26.4% 68963 ± 23% numa-meminfo.node0.AnonHugePages 3.22 ± 14% -1.8 1.46 ± 7% mpstat.cpu.all.idle% 23.08 -3.9 19.17 mpstat.cpu.all.usr% 72.75 +8.2% 78.75 vmstat.cpu.sy 23.00 -19.6% 18.50 ± 2% vmstat.cpu.us 592.50 +25.3% 742.25 vmstat.procs.r 1124000 ± 3% +338.0% 4923650 ± 4% vmstat.system.cs 308255 +233.9% 1029354 ± 4% vmstat.system.in 1.001e+09 -76.2% 2.381e+08 ± 13% cpuidle.C1.time 70321015 -54.7% 31845456 ± 6% cpuidle.C1.usage 1.041e+08 ± 5% -54.4% 47410378 ± 4% cpuidle.C1E.time 3698696 ± 7% +82.5% 6748329 ± 9% cpuidle.C3.usage 24339475 ± 2% +137.0% 57694119 ± 6% cpuidle.POLL.time 11094713 ± 2% +209.0% 34283466 ± 7% cpuidle.POLL.usage 2712 +1.8% 2762 turbostat.Avg_MHz 70318553 -54.7% 31842326 ± 6% turbostat.C1 1.85 -1.4 0.43 ± 15% turbostat.C1% 0.19 ± 5% -0.1 0.08 ± 5% turbostat.C1E% 3697870 ± 7% +82.5% 6747475 ± 9% turbostat.C3 2.42 ± 8% -67.6% 0.79 ± 8% turbostat.CPU%c1 1.897e+08 +238.6% 6.422e+08 ± 5% turbostat.IRQ 10.55 +4.1% 10.99 turbostat.RAMWatt 1580657 +100.3% 3166230 proc-vmstat.nr_dirty_background_threshold 3165179 +150.1% 7917510 proc-vmstat.nr_dirty_threshold 4811 -2.1% 4710 proc-vmstat.nr_inactive_anon 41003 -1.1% 40544 proc-vmstat.nr_kernel_stack 21342 -2.1% 20887 proc-vmstat.nr_slab_reclaimable 70422 -9.9% 63446 proc-vmstat.nr_slab_unreclaimable 4811 -2.1% 4710 proc-vmstat.nr_zone_inactive_anon 2568016 +30.8% 3359096 ± 2% proc-vmstat.numa_hit 2539513 +31.2% 3330581 ± 2% proc-vmstat.numa_local 3444968 +77.5% 6115510 ± 3% proc-vmstat.pgalloc_normal 2444132 -7.0% 2274101 proc-vmstat.pgfault 3377366 +78.8% 6038072 ± 3% proc-vmstat.pgfree 9598 ± 2% -9.5% 8687 ± 2% slabinfo.UNIX.active_objs 9601 ± 2% -9.1% 8732 ± 2% slabinfo.UNIX.num_objs 13920 -13.4% 12051 slabinfo.files_cache.active_objs 13922 -13.4% 12062 slabinfo.files_cache.num_objs 58574 -27.8% 42305 ± 2% slabinfo.kmalloc-512.active_objs 2556 -34.4% 1678 ± 3% slabinfo.kmalloc-512.active_slabs 81806 -34.3% 53714 ± 2% slabinfo.kmalloc-512.num_objs 2556 -34.4% 1678 ± 3% slabinfo.kmalloc-512.num_slabs 10443 -11.3% 9267 ± 2% slabinfo.mm_struct.active_objs 10458 -10.9% 9323 ± 3% slabinfo.mm_struct.num_objs 13730 -12.8% 11968 ± 3% slabinfo.pid.active_objs 13730 -12.8% 11969 ± 3% slabinfo.pid.num_objs 1102 +8.6% 1197 ± 3% slabinfo.proc_dir_entry.active_objs 1102 +8.6% 1197 ± 3% slabinfo.proc_dir_entry.num_objs 716.75 ± 8% -19.1% 580.00 ± 2% slabinfo.skbuff_ext_cache.active_objs 726.00 ± 8% -10.5% 650.00 slabinfo.skbuff_ext_cache.num_objs 533.25 ± 2% -18.7% 433.75 ± 9% slabinfo.skbuff_fclone_cache.active_objs 533.25 ± 2% -18.7% 433.75 ± 9% slabinfo.skbuff_fclone_cache.num_objs 54214 -30.1% 37916 ± 2% slabinfo.skbuff_head_cache.active_objs 2412 -36.4% 1533 ± 3% slabinfo.skbuff_head_cache.active_slabs 77223 -36.4% 49092 ± 3% slabinfo.skbuff_head_cache.num_objs 2412 -36.4% 1533 ± 3% slabinfo.skbuff_head_cache.num_slabs 13279 ± 4% -9.2% 12058 ± 2% slabinfo.sock_inode_cache.active_objs 13279 ± 4% -9.2% 12059 ± 2% slabinfo.sock_inode_cache.num_objs 15048 -10.3% 13494 slabinfo.task_delay_info.active_objs 15048 -10.3% 13494 slabinfo.task_delay_info.num_objs 343.25 ± 12% -34.6% 224.50 ± 16% slabinfo.xfrm_state.active_objs 343.25 ± 12% -34.6% 224.50 ± 16% slabinfo.xfrm_state.num_objs 14.31 ± 2% +12.8% 16.15 perf-stat.i.MPKI 1.886e+10 +2.8% 1.939e+10 perf-stat.i.branch-instructions 2.02 +0.1 2.10 perf-stat.i.branch-miss-rate% 3.769e+08 +8.0% 4.069e+08 perf-stat.i.branch-misses 5.86 -0.5 5.39 perf-stat.i.cache-miss-rate% 81073345 +5.9% 85881068 ± 2% perf-stat.i.cache-misses 1.387e+09 +16.1% 1.611e+09 perf-stat.i.cache-references 1121375 ± 3% +340.7% 4942018 ± 4% perf-stat.i.context-switches 2.379e+11 +1.8% 2.421e+11 perf-stat.i.cpu-cycles 215470 ± 3% +254.7% 764231 ± 2% perf-stat.i.cpu-migrations 0.37 ± 2% +0.6 0.95 ± 2% perf-stat.i.dTLB-load-miss-rate% 1.085e+08 ± 2% +160.7% 2.828e+08 ± 2% perf-stat.i.dTLB-load-misses 0.27 ± 2% +0.0 0.29 perf-stat.i.dTLB-store-miss-rate% 56471246 ± 2% +5.2% 59429129 perf-stat.i.dTLB-store-misses 2.106e+10 -2.6% 2.051e+10 perf-stat.i.dTLB-stores 81.75 -13.6 68.15 perf-stat.i.iTLB-load-miss-rate% 50088478 +52.2% 76241583 ± 2% perf-stat.i.iTLB-load-misses 11770543 ± 2% +212.5% 36779986 ± 4% perf-stat.i.iTLB-loads 9.822e+10 +1.6% 9.977e+10 perf-stat.i.instructions 1977 -31.8% 1349 ± 3% perf-stat.i.instructions-per-iTLB-miss 3880 -7.8% 3578 perf-stat.i.minor-faults 91.26 +6.6 97.87 perf-stat.i.node-load-miss-rate% 26647037 +45.0% 38646711 ± 3% perf-stat.i.node-load-misses 2465744 ± 5% -70.4% 729956 ± 6% perf-stat.i.node-loads 87.30 -9.5 77.78 perf-stat.i.node-store-miss-rate% 14654283 +23.8% 18148009 ± 2% perf-stat.i.node-store-misses 2151357 ± 2% +155.7% 5501820 ± 4% perf-stat.i.node-stores 3880 -7.8% 3578 perf-stat.i.page-faults 14.12 +14.4% 16.15 perf-stat.overall.MPKI 2.00 +0.1 2.10 perf-stat.overall.branch-miss-rate% 5.85 -0.5 5.33 perf-stat.overall.cache-miss-rate% 2934 -3.9% 2820 ± 2% perf-stat.overall.cycles-between-cache-misses 0.37 ± 2% +0.6 0.95 ± 2% perf-stat.overall.dTLB-load-miss-rate% 0.27 ± 2% +0.0 0.29 perf-stat.overall.dTLB-store-miss-rate% 80.97 -13.5 67.46 perf-stat.overall.iTLB-load-miss-rate% 1961 -33.2% 1309 ± 3% perf-stat.overall.instructions-per-iTLB-miss 91.53 +6.6 98.14 perf-stat.overall.node-load-miss-rate% 87.20 -10.5 76.75 perf-stat.overall.node-store-miss-rate% 51810 +25.7% 65111 perf-stat.overall.path-length 1.883e+10 +2.8% 1.935e+10 perf-stat.ps.branch-instructions 3.762e+08 +8.0% 4.062e+08 perf-stat.ps.branch-misses 80939745 +5.9% 85744186 ± 2% perf-stat.ps.cache-misses 1.385e+09 +16.1% 1.608e+09 perf-stat.ps.cache-references 1119435 ± 3% +340.7% 4933555 ± 4% perf-stat.ps.context-switches 2.375e+11 +1.8% 2.417e+11 perf-stat.ps.cpu-cycles 215097 ± 3% +254.7% 762943 ± 2% perf-stat.ps.cpu-migrations 1.083e+08 ± 2% +160.7% 2.823e+08 ± 2% perf-stat.ps.dTLB-load-misses 56377190 ± 2% +5.2% 59331167 perf-stat.ps.dTLB-store-misses 2.103e+10 -2.6% 2.048e+10 perf-stat.ps.dTLB-stores 50004610 +52.2% 76113883 ± 2% perf-stat.ps.iTLB-load-misses 11750442 ± 2% +212.5% 36717457 ± 4% perf-stat.ps.iTLB-loads 9.806e+10 +1.6% 9.96e+10 perf-stat.ps.instructions 3874 -7.8% 3573 perf-stat.ps.minor-faults 26602986 +45.0% 38584440 ± 3% perf-stat.ps.node-load-misses 2461704 ± 5% -70.4% 728877 ± 6% perf-stat.ps.node-loads 14630120 +23.8% 18119069 ± 2% perf-stat.ps.node-store-misses 2147799 ± 2% +155.7% 5492741 ± 4% perf-stat.ps.node-stores 3874 -7.8% 3573 perf-stat.ps.page-faults 6.018e+13 +2.8% 6.188e+13 perf-stat.total.instructions 9829288 ± 30% -65.2% 3425365 ± 88% sched_debug.cfs_rq:/.MIN_vruntime.max 1082863 ± 34% -65.5% 373825 ± 88% sched_debug.cfs_rq:/.MIN_vruntime.stddev 28943 ± 6% +94.1% 56192 ± 71% sched_debug.cfs_rq:/.load.max 116.11 ±173% +702.9% 932.30 ± 49% sched_debug.cfs_rq:/.load.min 5289 +64.3% 8689 ± 47% sched_debug.cfs_rq:/.load.stddev 9829288 ± 30% -65.2% 3425365 ± 88% sched_debug.cfs_rq:/.max_vruntime.max 1082863 ± 34% -65.5% 373825 ± 88% sched_debug.cfs_rq:/.max_vruntime.stddev 24222061 +14.2% 27660112 sched_debug.cfs_rq:/.min_vruntime.avg 25005940 +20.4% 30113412 sched_debug.cfs_rq:/.min_vruntime.max 342616 ± 4% +190.2% 994342 ± 13% sched_debug.cfs_rq:/.min_vruntime.stddev 0.07 ±110% +333.3% 0.30 ± 25% sched_debug.cfs_rq:/.nr_running.min 0.17 ± 6% -30.7% 0.12 ± 13% sched_debug.cfs_rq:/.nr_running.stddev 0.02 ±173% +1300.0% 0.32 ± 42% sched_debug.cfs_rq:/.runnable_load_avg.min 27877 ± 4% +99.4% 55578 ± 71% sched_debug.cfs_rq:/.runnable_weight.max 36.64 ±173% +823.1% 338.18 ± 48% sched_debug.cfs_rq:/.runnable_weight.min 6634 +46.6% 9727 ± 42% sched_debug.cfs_rq:/.runnable_weight.stddev 768141 ± 41% +263.3% 2790315 ± 18% sched_debug.cfs_rq:/.spread0.max -688157 +140.8% -1656893 sched_debug.cfs_rq:/.spread0.min 342419 ± 3% +190.2% 993722 ± 13% sched_debug.cfs_rq:/.spread0.stddev 469.77 ± 4% +13.8% 534.70 ± 3% sched_debug.cfs_rq:/.util_avg.min 238.37 -12.0% 209.81 ± 2% sched_debug.cfs_rq:/.util_avg.stddev 318.19 ± 2% +36.6% 434.56 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.avg 956.93 +24.6% 1192 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.max 0.11 ± 66% +13360.0% 15.30 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.min 210.55 ± 2% +26.1% 265.56 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.stddev 93513 ± 6% -25.7% 69448 ± 3% sched_debug.cpu.avg_idle.avg 24.14 ± 14% +77.1% 42.76 ± 8% sched_debug.cpu.clock.stddev 24.14 ± 14% +77.1% 42.76 ± 8% sched_debug.cpu.clock_task.stddev 0.05 ±173% +1200.0% 0.59 ± 17% sched_debug.cpu.cpu_load[0].min 7.03 +43.7% 10.10 ± 38% sched_debug.cpu.cpu_load[0].stddev 26.48 ± 7% +116.1% 57.20 ± 64% sched_debug.cpu.cpu_load[1].max 5.09 ± 3% +78.3% 9.08 ± 42% sched_debug.cpu.cpu_load[1].stddev 23.75 ± 4% +133.1% 55.36 ± 67% sched_debug.cpu.cpu_load[2].max 2.34 ± 13% -31.1% 1.61 ± 10% sched_debug.cpu.cpu_load[2].min 4.21 +101.3% 8.47 ± 45% sched_debug.cpu.cpu_load[2].stddev 22.36 ± 6% +141.9% 54.09 ± 71% sched_debug.cpu.cpu_load[3].max 2.73 ± 8% -38.3% 1.68 ± 11% sched_debug.cpu.cpu_load[3].min 3.72 ± 3% +118.3% 8.11 ± 48% sched_debug.cpu.cpu_load[3].stddev 27.00 ± 11% +123.1% 60.23 ± 70% sched_debug.cpu.cpu_load[4].max 2.61 ± 7% -35.7% 1.68 ± 11% sched_debug.cpu.cpu_load[4].min 4.02 ± 7% +115.9% 8.68 ± 48% sched_debug.cpu.cpu_load[4].stddev 17756 -12.4% 15546 sched_debug.cpu.curr->pid.avg 19813 -12.4% 17357 sched_debug.cpu.curr->pid.max 605.70 ±100% +920.4% 6180 ± 41% sched_debug.cpu.curr->pid.min 3300 ± 8% -52.1% 1579 ± 21% sched_debug.cpu.curr->pid.stddev 425.25 ±118% +294.0% 1675 ± 23% sched_debug.cpu.load.min 5266 ± 2% +63.2% 8594 ± 47% sched_debug.cpu.load.stddev 500103 -49.7% 251307 sched_debug.cpu.max_idle_balance_cost.avg 507505 -37.8% 315414 ± 19% sched_debug.cpu.max_idle_balance_cost.max 500000 -50.0% 250000 sched_debug.cpu.max_idle_balance_cost.min 0.00 ± 6% +16.5% 0.00 ± 4% sched_debug.cpu.next_balance.stddev 6.07 +24.9% 7.57 ± 3% sched_debug.cpu.nr_running.avg 15.73 ± 4% +42.1% 22.34 ± 4% sched_debug.cpu.nr_running.max 0.09 ±122% +400.0% 0.45 ± 14% sched_debug.cpu.nr_running.min 3.67 +33.5% 4.90 ± 3% sched_debug.cpu.nr_running.stddev 3971700 ± 6% +327.3% 16971708 ± 4% sched_debug.cpu.nr_switches.avg 4272583 ± 8% +331.4% 18433855 ± 5% sched_debug.cpu.nr_switches.max 3758954 ± 5% +318.6% 15735621 ± 4% sched_debug.cpu.nr_switches.min 96452 ± 24% +516.1% 594193 ± 20% sched_debug.cpu.nr_switches.stddev 24.00 -33.3% 16.00 sched_debug.sysctl_sched.sysctl_sched_latency 3.00 -46.7% 1.60 sched_debug.sysctl_sched.sysctl_sched_min_granularity 4.00 -50.0% 2.00 sched_debug.sysctl_sched.sysctl_sched_wakeup_granularity 10.55 ± 15% -10.6 0.00 perf-profile.calltrace.cycles-pp.__GI___libc_write 9.52 ± 16% -9.5 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write 9.45 ± 16% -9.5 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 9.09 ± 15% -9.1 0.00 perf-profile.calltrace.cycles-pp.__GI___libc_read 7.90 ± 15% -7.9 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read 7.83 ± 15% -7.8 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 7.80 ± 16% -7.8 0.00 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 7.51 ± 16% -7.5 0.00 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 6.42 ± 16% -6.4 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 6.25 ± 16% -6.2 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 2.12 ± 5% -1.3 0.78 ± 88% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 2.87 ± 6% -1.3 1.57 ± 33% perf-profile.calltrace.cycles-pp.secondary_startup_64 2.84 ± 6% -1.3 1.55 ± 33% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 2.84 ± 6% -1.3 1.55 ± 33% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 2.83 ± 6% -1.3 1.55 ± 33% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 2.30 ± 5% -1.2 1.06 ± 50% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 2.29 ± 5% -1.2 1.06 ± 50% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 0.73 ± 2% +0.1 0.81 ± 8% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64 0.55 ± 4% +0.1 0.63 ± 9% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 0.68 ± 4% +0.1 0.77 ± 6% perf-profile.calltrace.cycles-pp.security_socket_recvmsg.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read 0.79 ± 4% +0.1 0.89 ± 7% perf-profile.calltrace.cycles-pp.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read 0.94 ± 2% +0.1 1.04 ± 9% perf-profile.calltrace.cycles-pp.__slab_free.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 0.98 ± 4% +0.1 1.12 ± 9% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.21 ± 3% +0.2 1.38 ± 8% perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb 1.14 ± 3% +0.2 1.37 ± 6% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 0.58 ± 4% +0.2 0.81 ± 4% perf-profile.calltrace.cycles-pp.mutex_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 1.83 ± 4% +0.2 2.08 ± 8% perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic 1.08 ± 3% +0.2 1.33 perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 1.65 ± 5% +0.3 1.94 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 1.83 ± 5% +0.3 2.13 ± 7% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor 3.94 ± 3% +0.5 4.43 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64 0.12 ±173% +0.5 0.65 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 0.00 +0.6 0.57 ± 6% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 23.23 ± 4% +8.2 31.43 ± 4% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 27.95 ± 4% +8.3 36.21 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 23.94 ± 3% +8.4 32.32 ± 4% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 29.32 ± 4% +8.4 37.77 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 67.15 ± 3% +19.2 86.39 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 67.66 ± 3% +19.4 87.04 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 10.64 ± 15% -10.6 0.00 perf-profile.children.cycles-pp.__GI___libc_write 9.18 ± 15% -9.2 0.00 perf-profile.children.cycles-pp.__GI___libc_read 2.87 ± 6% -1.3 1.57 ± 33% perf-profile.children.cycles-pp.do_idle 2.87 ± 6% -1.3 1.57 ± 33% perf-profile.children.cycles-pp.secondary_startup_64 2.87 ± 6% -1.3 1.57 ± 33% perf-profile.children.cycles-pp.cpu_startup_entry 2.84 ± 6% -1.3 1.55 ± 33% perf-profile.children.cycles-pp.start_secondary 2.15 ± 5% -1.3 0.90 ± 65% perf-profile.children.cycles-pp.intel_idle 2.33 ± 5% -1.3 1.07 ± 51% perf-profile.children.cycles-pp.cpuidle_enter 2.33 ± 5% -1.3 1.07 ± 51% perf-profile.children.cycles-pp.cpuidle_enter_state 3.45 ± 5% -0.5 2.98 ± 8% perf-profile.children.cycles-pp.skb_copy_datagram_from_iter 0.07 ± 10% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__vfs_read 0.07 ± 7% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__vfs_write 0.76 +0.1 0.83 ± 3% perf-profile.children.cycles-pp.mutex_lock 5.83 +0.3 6.08 perf-profile.children.cycles-pp._raw_spin_lock 5.64 +0.5 6.14 ± 2% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 84.58 +1.9 86.51 perf-profile.children.cycles-pp.do_syscall_64 85.24 +1.9 87.17 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 2.14 ± 5% -1.3 0.89 ± 66% perf-profile.self.cycles-pp.intel_idle 0.06 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.__vfs_write 0.13 ± 3% -0.0 0.11 ± 6% perf-profile.self.cycles-pp.wait_for_unix_gc 0.08 ± 6% +0.0 0.10 ± 5% perf-profile.self.cycles-pp.__slab_alloc 0.62 +0.0 0.65 perf-profile.self.cycles-pp.sock_wfree 0.46 ± 2% +0.1 0.52 ± 4% perf-profile.self.cycles-pp.new_sync_read 0.58 ± 4% +0.1 0.70 ± 7% perf-profile.self.cycles-pp.___slab_alloc 2.04 +0.2 2.20 ± 3% perf-profile.self.cycles-pp.unix_stream_read_generic 5.62 +0.5 6.12 ± 2% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 660.00 ± 46% +80.1% 1188 ± 26% interrupts.39:PCI-MSI.3145736-edge.eth0-TxRx-7 762.75 ± 7% -8.3% 699.25 interrupts.9:IO-APIC.9-fasteoi.acpi 925673 ± 4% +580.4% 6298086 ± 7% interrupts.CPU0.RES:Rescheduling_interrupts 762.75 ± 7% -8.3% 699.25 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 914026 ± 5% +589.5% 6302138 ± 7% interrupts.CPU1.RES:Rescheduling_interrupts 909968 ± 4% +586.8% 6250075 ± 7% interrupts.CPU10.RES:Rescheduling_interrupts 901457 ± 4% +579.2% 6122367 ± 7% interrupts.CPU11.RES:Rescheduling_interrupts 885989 ± 5% +597.1% 6176190 ± 7% interrupts.CPU12.RES:Rescheduling_interrupts 900091 ± 4% +578.6% 6108137 ± 9% interrupts.CPU13.RES:Rescheduling_interrupts 916030 ± 4% +579.3% 6222876 ± 6% interrupts.CPU14.RES:Rescheduling_interrupts 907387 ± 3% +580.4% 6173726 ± 7% interrupts.CPU15.RES:Rescheduling_interrupts 906462 ± 3% +584.5% 6205125 ± 7% interrupts.CPU16.RES:Rescheduling_interrupts 892967 ± 4% +579.9% 6071200 ± 8% interrupts.CPU17.RES:Rescheduling_interrupts 660.00 ± 46% +80.1% 1188 ± 26% interrupts.CPU18.39:PCI-MSI.3145736-edge.eth0-TxRx-7 883497 ± 3% +590.0% 6095740 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts 895170 ± 5% +590.4% 6180136 ± 7% interrupts.CPU19.RES:Rescheduling_interrupts 920768 ± 4% +579.8% 6259793 ± 8% interrupts.CPU2.RES:Rescheduling_interrupts 897528 ± 4% +580.2% 6104818 ± 8% interrupts.CPU20.RES:Rescheduling_interrupts 890291 ± 4% +606.9% 6293257 ± 9% interrupts.CPU21.RES:Rescheduling_interrupts 921105 ± 5% +569.1% 6162675 ± 7% interrupts.CPU22.RES:Rescheduling_interrupts 934751 ± 4% +559.2% 6162001 ± 6% interrupts.CPU23.RES:Rescheduling_interrupts 926805 ± 5% +565.8% 6170704 ± 7% interrupts.CPU24.RES:Rescheduling_interrupts 922681 ± 5% +577.7% 6252842 ± 6% interrupts.CPU25.RES:Rescheduling_interrupts 936049 ± 5% +567.3% 6246646 ± 6% interrupts.CPU26.RES:Rescheduling_interrupts 902602 ± 4% +578.3% 6122067 ± 5% interrupts.CPU27.RES:Rescheduling_interrupts 932255 ± 6% +576.9% 6310357 ± 6% interrupts.CPU28.RES:Rescheduling_interrupts 915340 ± 5% +579.8% 6222851 ± 5% interrupts.CPU29.RES:Rescheduling_interrupts 906245 ± 3% +603.2% 6373161 ± 7% interrupts.CPU3.RES:Rescheduling_interrupts 905647 ± 4% +587.3% 6224841 ± 5% interrupts.CPU30.RES:Rescheduling_interrupts 912558 ± 4% +577.6% 6183543 ± 7% interrupts.CPU31.RES:Rescheduling_interrupts 906350 ± 4% +583.7% 6196414 ± 6% interrupts.CPU32.RES:Rescheduling_interrupts 904780 ± 4% +578.3% 6137556 ± 6% interrupts.CPU33.RES:Rescheduling_interrupts 899080 ± 5% +573.5% 6054977 ± 6% interrupts.CPU34.RES:Rescheduling_interrupts 897373 ± 4% +593.8% 6225607 ± 6% interrupts.CPU35.RES:Rescheduling_interrupts 919071 ± 4% +560.4% 6069648 ± 5% interrupts.CPU36.RES:Rescheduling_interrupts 909253 ± 3% +567.4% 6068575 ± 6% interrupts.CPU37.RES:Rescheduling_interrupts 929529 ± 6% +556.6% 6102919 ± 6% interrupts.CPU38.RES:Rescheduling_interrupts 902204 ± 5% +573.2% 6073921 ± 7% interrupts.CPU39.RES:Rescheduling_interrupts 909667 ± 4% +594.3% 6315416 ± 7% interrupts.CPU4.RES:Rescheduling_interrupts 891308 ± 6% +590.8% 6157161 ± 7% interrupts.CPU40.RES:Rescheduling_interrupts 908411 ± 6% +578.3% 6161643 ± 7% interrupts.CPU41.RES:Rescheduling_interrupts 906106 ± 4% +574.9% 6115742 ± 6% interrupts.CPU42.RES:Rescheduling_interrupts 928420 ± 6% +556.2% 6092084 ± 6% interrupts.CPU43.RES:Rescheduling_interrupts 918605 ± 5% +581.0% 6255941 ± 8% interrupts.CPU44.RES:Rescheduling_interrupts 925149 ± 3% +578.0% 6272327 ± 7% interrupts.CPU45.RES:Rescheduling_interrupts 913916 ± 4% +592.9% 6332293 ± 7% interrupts.CPU46.RES:Rescheduling_interrupts 903308 ± 4% +590.5% 6237458 ± 8% interrupts.CPU47.RES:Rescheduling_interrupts 906960 ± 4% +595.7% 6309330 ± 6% interrupts.CPU48.RES:Rescheduling_interrupts 898670 ± 2% +596.3% 6257070 ± 5% interrupts.CPU49.RES:Rescheduling_interrupts 904056 ± 4% +585.4% 6196200 ± 5% interrupts.CPU5.RES:Rescheduling_interrupts 921663 ± 3% +587.9% 6340403 ± 7% interrupts.CPU50.RES:Rescheduling_interrupts 921589 ± 5% +576.6% 6235610 ± 7% interrupts.CPU51.RES:Rescheduling_interrupts 920120 ± 3% +570.5% 6169861 ± 8% interrupts.CPU52.RES:Rescheduling_interrupts 53.50 ± 79% -75.7% 13.00 ±111% interrupts.CPU52.TLB:TLB_shootdowns 907652 ± 5% +582.0% 6190117 ± 9% interrupts.CPU53.RES:Rescheduling_interrupts 907563 ± 5% +587.5% 6239226 ± 8% interrupts.CPU54.RES:Rescheduling_interrupts 916945 ± 3% +574.3% 6183137 ± 6% interrupts.CPU55.RES:Rescheduling_interrupts 895538 ± 5% +601.1% 6278286 ± 6% interrupts.CPU56.RES:Rescheduling_interrupts 884652 ± 5% +591.1% 6114236 ± 10% interrupts.CPU57.RES:Rescheduling_interrupts 892337 ± 5% +596.8% 6217512 ± 7% interrupts.CPU58.RES:Rescheduling_interrupts 914771 ± 2% +569.0% 6119824 ± 8% interrupts.CPU59.RES:Rescheduling_interrupts 914171 ± 5% +584.8% 6260168 ± 8% interrupts.CPU6.RES:Rescheduling_interrupts 902117 ± 4% +590.4% 6227990 ± 7% interrupts.CPU60.RES:Rescheduling_interrupts 885288 ± 4% +598.6% 6184631 ± 8% interrupts.CPU61.RES:Rescheduling_interrupts 878833 ± 4% +598.7% 6140823 ± 8% interrupts.CPU62.RES:Rescheduling_interrupts 899149 ± 4% +589.3% 6197789 ± 8% interrupts.CPU63.RES:Rescheduling_interrupts 900729 ± 4% +590.9% 6223358 ± 8% interrupts.CPU64.RES:Rescheduling_interrupts 136.50 ± 90% -74.5% 34.75 ±134% interrupts.CPU64.TLB:TLB_shootdowns 897133 ± 3% +600.4% 6283243 ± 8% interrupts.CPU65.RES:Rescheduling_interrupts 925816 ± 5% +556.7% 6079971 ± 7% interrupts.CPU66.RES:Rescheduling_interrupts 917527 ± 5% +570.8% 6155190 ± 5% interrupts.CPU67.RES:Rescheduling_interrupts 919350 ± 5% +567.3% 6134541 ± 7% interrupts.CPU68.RES:Rescheduling_interrupts 898265 ± 5% +592.4% 6219990 ± 6% interrupts.CPU69.RES:Rescheduling_interrupts 916558 ± 4% +583.6% 6266016 ± 7% interrupts.CPU7.RES:Rescheduling_interrupts 916060 ± 5% +573.1% 6165772 ± 6% interrupts.CPU70.RES:Rescheduling_interrupts 900704 ± 5% +585.5% 6174141 ± 7% interrupts.CPU71.RES:Rescheduling_interrupts 915386 ± 4% +591.7% 6331697 ± 7% interrupts.CPU72.RES:Rescheduling_interrupts 911494 ± 4% +580.5% 6202621 ± 5% interrupts.CPU73.RES:Rescheduling_interrupts 914152 ± 4% +579.1% 6208012 ± 5% interrupts.CPU74.RES:Rescheduling_interrupts 919469 ± 4% +567.9% 6141356 ± 7% interrupts.CPU75.RES:Rescheduling_interrupts 897632 ± 4% +600.6% 6288603 ± 6% interrupts.CPU76.RES:Rescheduling_interrupts 894843 ± 5% +585.7% 6136288 ± 7% interrupts.CPU77.RES:Rescheduling_interrupts 899897 ± 5% +569.2% 6022419 ± 7% interrupts.CPU78.RES:Rescheduling_interrupts 896111 ± 4% +591.2% 6194069 ± 6% interrupts.CPU79.RES:Rescheduling_interrupts 911418 ± 4% +572.3% 6127868 ± 7% interrupts.CPU8.RES:Rescheduling_interrupts 899998 ± 6% +586.2% 6175781 ± 5% interrupts.CPU80.RES:Rescheduling_interrupts 904633 ± 5% +580.2% 6153552 ± 6% interrupts.CPU81.RES:Rescheduling_interrupts 912989 ± 5% +574.1% 6154076 ± 5% interrupts.CPU82.RES:Rescheduling_interrupts 890987 ± 6% +587.7% 6127712 ± 6% interrupts.CPU83.RES:Rescheduling_interrupts 909524 ± 5% +574.1% 6131352 ± 6% interrupts.CPU84.RES:Rescheduling_interrupts 887671 ± 5% +598.6% 6201025 ± 6% interrupts.CPU85.RES:Rescheduling_interrupts 922918 ± 7% +567.2% 6157723 ± 5% interrupts.CPU86.RES:Rescheduling_interrupts 924721 ± 8% +564.6% 6146038 ± 5% interrupts.CPU87.RES:Rescheduling_interrupts 911674 ± 6% +575.7% 6160493 ± 9% interrupts.CPU9.RES:Rescheduling_interrupts 79925641 ± 4% +581.6% 5.448e+08 ± 6% interrupts.RES:Rescheduling_interrupts 58677 +33.7% 78438 ± 2% softirqs.CPU0.RCU 62136 -34.5% 40712 ± 4% softirqs.CPU0.SCHED 59057 +34.9% 79666 softirqs.CPU1.RCU 58087 -36.3% 36979 ± 3% softirqs.CPU1.SCHED 58735 +36.2% 80007 ± 2% softirqs.CPU10.RCU 57523 -35.9% 36897 ± 3% softirqs.CPU10.SCHED 58893 +34.1% 78965 ± 3% softirqs.CPU11.RCU 57406 -35.4% 37075 ± 2% softirqs.CPU11.SCHED 58865 +36.3% 80236 ± 3% softirqs.CPU12.RCU 57257 -37.4% 35843 ± 3% softirqs.CPU12.SCHED 59183 +35.7% 80281 ± 3% softirqs.CPU13.RCU 57012 -36.5% 36197 ± 2% softirqs.CPU13.SCHED 59266 +37.4% 81408 ± 3% softirqs.CPU14.RCU 58226 -38.4% 35866 ± 2% softirqs.CPU14.SCHED 61379 +36.0% 83456 ± 2% softirqs.CPU15.RCU 58616 -36.6% 37181 ± 2% softirqs.CPU15.SCHED 61622 +38.5% 85353 ± 3% softirqs.CPU16.RCU 58312 -37.6% 36374 ± 4% softirqs.CPU16.SCHED 61225 +38.1% 84576 ± 3% softirqs.CPU17.RCU 57373 -36.8% 36242 ± 4% softirqs.CPU17.SCHED 61348 +38.4% 84883 ± 3% softirqs.CPU18.RCU 57212 -36.9% 36080 ± 6% softirqs.CPU18.SCHED 61419 +35.5% 83228 softirqs.CPU19.RCU 57815 -36.1% 36934 ± 2% softirqs.CPU19.SCHED 59327 +37.0% 81302 softirqs.CPU2.RCU 58339 -38.2% 36039 ± 3% softirqs.CPU2.SCHED 61521 +39.3% 85705 ± 3% softirqs.CPU20.RCU 58315 -38.7% 35730 ± 4% softirqs.CPU20.SCHED 61303 +36.5% 83660 ± 2% softirqs.CPU21.RCU 58219 -37.4% 36452 ± 5% softirqs.CPU21.SCHED 62716 +40.5% 88094 ± 5% softirqs.CPU22.RCU 59118 ± 2% -39.6% 35707 ± 5% softirqs.CPU22.SCHED 61657 +40.8% 86814 ± 3% softirqs.CPU23.RCU 58433 -40.0% 35081 ± 4% softirqs.CPU23.SCHED 61266 +41.2% 86502 ± 3% softirqs.CPU24.RCU 57837 ± 2% -38.0% 35859 ± 5% softirqs.CPU24.SCHED 61037 +40.9% 86028 ± 4% softirqs.CPU25.RCU 57656 -37.1% 36246 ± 5% softirqs.CPU25.SCHED 60944 +41.3% 86115 ± 4% softirqs.CPU26.RCU 57748 -38.8% 35337 ± 3% softirqs.CPU26.SCHED 60939 +40.7% 85741 ± 4% softirqs.CPU27.RCU 57479 ± 2% -38.3% 35452 ± 4% softirqs.CPU27.SCHED 61905 ± 2% +39.9% 86610 ± 3% softirqs.CPU28.RCU 58315 -40.5% 34682 ± 4% softirqs.CPU28.SCHED 61113 +34.2% 82040 ± 6% softirqs.CPU29.RCU 58094 -38.5% 35707 ± 5% softirqs.CPU29.SCHED 58790 +35.5% 79661 ± 2% softirqs.CPU3.RCU 57557 -37.3% 36063 ± 3% softirqs.CPU3.SCHED 60586 +36.0% 82415 softirqs.CPU30.RCU 57599 -38.2% 35574 ± 4% softirqs.CPU30.SCHED 60304 +36.5% 82319 softirqs.CPU31.RCU 57851 -37.6% 36115 ± 2% softirqs.CPU31.SCHED 60324 +36.4% 82277 softirqs.CPU32.RCU 57639 ± 2% -38.8% 35263 ± 3% softirqs.CPU32.SCHED 60037 +36.3% 81855 ± 2% softirqs.CPU33.RCU 57420 -38.9% 35079 ± 4% softirqs.CPU33.SCHED 60156 +33.8% 80467 ± 2% softirqs.CPU34.RCU 57464 ± 2% -37.9% 35700 ± 5% softirqs.CPU34.SCHED 60986 +34.6% 82080 ± 2% softirqs.CPU35.RCU 57413 ± 2% -37.1% 36086 ± 3% softirqs.CPU35.SCHED 60617 +36.6% 82795 ± 2% softirqs.CPU36.RCU 58369 -39.0% 35594 ± 5% softirqs.CPU36.SCHED 61261 +36.5% 83642 ± 2% softirqs.CPU37.RCU 58398 -41.5% 34146 ± 4% softirqs.CPU37.SCHED 60849 +36.2% 82865 softirqs.CPU38.RCU 58527 ± 2% -39.8% 35253 ± 3% softirqs.CPU38.SCHED 60454 +34.8% 81482 ± 2% softirqs.CPU39.RCU 57462 -38.8% 35174 ± 5% softirqs.CPU39.SCHED 58921 +35.6% 79901 ± 2% softirqs.CPU4.RCU 57398 -35.0% 37291 softirqs.CPU4.SCHED 59983 +35.6% 81310 ± 2% softirqs.CPU40.RCU 57495 -37.5% 35949 ± 3% softirqs.CPU40.SCHED 60086 +33.9% 80460 ± 3% softirqs.CPU41.RCU 57358 -38.7% 35182 ± 4% softirqs.CPU41.SCHED 61416 ± 2% +31.7% 80887 ± 2% softirqs.CPU42.RCU 58654 ± 2% -39.7% 35395 ± 5% softirqs.CPU42.SCHED 60646 +33.2% 80753 ± 3% softirqs.CPU43.RCU 58587 -40.2% 35012 ± 4% softirqs.CPU43.SCHED 54349 +31.1% 71257 ± 2% softirqs.CPU44.RCU 58145 -38.0% 36074 ± 3% softirqs.CPU44.SCHED 65618 ± 2% +25.6% 82444 ± 4% softirqs.CPU45.RCU 58325 -38.2% 36062 ± 2% softirqs.CPU45.SCHED 60360 +36.3% 82298 ± 2% softirqs.CPU46.RCU 58041 -38.0% 35986 ± 5% softirqs.CPU46.SCHED 59401 +36.8% 81253 ± 2% softirqs.CPU47.RCU 57339 -37.8% 35645 ± 4% softirqs.CPU47.SCHED 59694 +37.7% 82214 ± 2% softirqs.CPU48.RCU 57253 -34.6% 37460 softirqs.CPU48.SCHED 59659 ± 2% +39.4% 83171 ± 4% softirqs.CPU49.RCU 57313 -35.9% 36738 ± 4% softirqs.CPU49.SCHED 58982 +35.1% 79708 ± 2% softirqs.CPU5.RCU 57375 -36.1% 36665 ± 4% softirqs.CPU5.SCHED 59984 +37.5% 82477 softirqs.CPU50.RCU 58032 -37.5% 36284 ± 2% softirqs.CPU50.SCHED 59934 +37.6% 82466 ± 2% softirqs.CPU51.RCU 58122 -37.5% 36313 ± 4% softirqs.CPU51.SCHED 59879 +38.0% 82608 ± 2% softirqs.CPU52.RCU 57973 -36.1% 37070 ± 3% softirqs.CPU52.SCHED 59850 ± 2% +37.0% 82025 ± 2% softirqs.CPU53.RCU 57550 -36.3% 36659 ± 4% softirqs.CPU53.SCHED 59785 ± 2% +37.3% 82068 ± 2% softirqs.CPU54.RCU 57572 -35.7% 37000 ± 3% softirqs.CPU54.SCHED 59828 +34.7% 80584 ± 2% softirqs.CPU55.RCU 56891 -35.5% 36678 ± 3% softirqs.CPU55.SCHED 59674 +36.6% 81506 ± 3% softirqs.CPU56.RCU 57322 -36.9% 36170 ± 4% softirqs.CPU56.SCHED 59422 +36.8% 81278 ± 3% softirqs.CPU57.RCU 56682 -36.0% 36257 ± 5% softirqs.CPU57.SCHED 59664 +38.4% 82564 ± 4% softirqs.CPU58.RCU 58281 -37.7% 36334 ± 3% softirqs.CPU58.SCHED 60104 +37.2% 82456 ± 4% softirqs.CPU59.RCU 58250 -36.9% 36771 ± 3% softirqs.CPU59.SCHED 59052 +35.2% 79851 ± 2% softirqs.CPU6.RCU 58102 ± 2% -38.1% 35938 softirqs.CPU6.SCHED 60319 +39.1% 83925 ± 3% softirqs.CPU60.RCU 57942 -37.2% 36412 ± 4% softirqs.CPU60.SCHED 59653 +39.9% 83439 ± 3% softirqs.CPU61.RCU 57018 -35.8% 36591 ± 3% softirqs.CPU61.SCHED 59764 +40.1% 83740 ± 4% softirqs.CPU62.RCU 57479 -36.6% 36434 ± 5% softirqs.CPU62.SCHED 59996 +38.7% 83234 ± 2% softirqs.CPU63.RCU 58008 -36.4% 36870 ± 3% softirqs.CPU63.SCHED 60025 +40.3% 84231 ± 4% softirqs.CPU64.RCU 58603 -37.8% 36425 ± 3% softirqs.CPU64.SCHED 60032 +36.6% 82011 softirqs.CPU65.RCU 58419 -37.3% 36608 ± 3% softirqs.CPU65.SCHED 61568 +40.3% 86368 ± 3% softirqs.CPU66.RCU 58633 -39.6% 35410 ± 3% softirqs.CPU66.SCHED 61611 +41.0% 86891 ± 3% softirqs.CPU67.RCU 58323 ± 2% -39.7% 35142 ± 3% softirqs.CPU67.SCHED 61397 +40.8% 86423 ± 2% softirqs.CPU68.RCU 58069 -37.0% 36595 ± 5% softirqs.CPU68.SCHED 61168 +39.8% 85500 ± 3% softirqs.CPU69.RCU 57442 ± 2% -37.3% 35990 ± 6% softirqs.CPU69.SCHED 59050 +35.9% 80273 ± 2% softirqs.CPU7.RCU 58390 -38.0% 36184 ± 2% softirqs.CPU7.SCHED 61171 +39.9% 85568 ± 3% softirqs.CPU70.RCU 57497 ± 2% -37.6% 35871 ± 4% softirqs.CPU70.SCHED 61074 +40.9% 86077 ± 3% softirqs.CPU71.RCU 57464 -37.8% 35715 ± 2% softirqs.CPU71.SCHED 61345 +41.1% 86558 ± 3% softirqs.CPU72.RCU 58120 -39.6% 35127 ± 5% softirqs.CPU72.SCHED 61293 +34.2% 82238 ± 4% softirqs.CPU73.RCU 58342 -38.6% 35804 ± 4% softirqs.CPU73.SCHED 60943 +33.6% 81410 ± 4% softirqs.CPU74.RCU 57499 -38.0% 35623 ± 3% softirqs.CPU74.SCHED 56943 +32.1% 75237 ± 3% softirqs.CPU75.RCU 57730 -37.7% 35982 ± 3% softirqs.CPU75.SCHED 56725 +33.9% 75965 softirqs.CPU76.RCU 57373 -38.4% 35320 ± 2% softirqs.CPU76.SCHED 56919 +35.4% 77082 ± 2% softirqs.CPU77.RCU 57509 -38.7% 35232 ± 4% softirqs.CPU77.SCHED 56528 +36.3% 77066 ± 2% softirqs.CPU78.RCU 57255 -37.5% 35765 ± 5% softirqs.CPU78.SCHED 57562 ± 2% +33.2% 76651 ± 2% softirqs.CPU79.RCU 57279 ± 2% -36.9% 36164 ± 3% softirqs.CPU79.SCHED 58916 +36.2% 80229 ± 2% softirqs.CPU8.RCU 57850 -36.5% 36710 ± 2% softirqs.CPU8.SCHED 56932 +37.1% 78080 ± 2% softirqs.CPU80.RCU 58409 ± 2% -38.9% 35703 ± 4% softirqs.CPU80.SCHED 189033 ± 2% +11.6% 210927 ± 5% softirqs.CPU80.TIMER 56970 +37.2% 78145 ± 3% softirqs.CPU81.RCU 58583 -41.3% 34378 ± 3% softirqs.CPU81.SCHED 56840 +36.9% 77809 ± 2% softirqs.CPU82.RCU 58526 -38.1% 36249 ± 5% softirqs.CPU82.SCHED 57395 +33.7% 76732 ± 2% softirqs.CPU83.RCU 57260 ± 2% -38.4% 35262 ± 5% softirqs.CPU83.SCHED 56606 +36.5% 77282 ± 3% softirqs.CPU84.RCU 57485 -37.0% 36234 ± 2% softirqs.CPU84.SCHED 57138 +33.6% 76325 ± 2% softirqs.CPU85.RCU 57783 -38.6% 35451 ± 4% softirqs.CPU85.SCHED 57065 +31.5% 75019 ± 4% softirqs.CPU86.RCU 58430 -38.7% 35797 ± 4% softirqs.CPU86.SCHED 188971 ± 2% +24.2% 234770 ± 20% softirqs.CPU86.TIMER 56871 +33.2% 75740 ± 4% softirqs.CPU87.RCU 58398 -39.7% 35211 ± 4% softirqs.CPU87.SCHED 59024 +35.5% 79965 ± 2% softirqs.CPU9.RCU 57479 -35.9% 36869 ± 3% softirqs.CPU9.SCHED 5262948 +36.6% 7191775 ± 2% softirqs.RCU 5094938 -37.7% 3172832 softirqs.SCHED hackbench.throughput 200000 +-+----------------------------------------------------------------+ 180000 +-+.+ ++ +.+.+.+.+ +.+.++ + +.+.+.+ ++.+.+ | | : :: : : : : : : : : : | 160000 O-+ : O O O: O O O O O O : O O : O O : O O : : | 140000 +-+ : :: : : O O O O : O O : O O : : | | : : : : : : : : : : : : : :| 120000 +-+ : : : : : : : : : : : : : :| 100000 +-+ : : : : : : : : : : : : : :| 80000 +-+ : : : : : : : : : : : : : :| | : : : : : : : : : : : : : :| 60000 +-+ : : : : : : : : : : : : : :| 40000 +-+ : : : : : : : : : : : : | | : : : : : : : : : : : : | 20000 +-+ : : : : : : : : : : : : | 0 +-O-O------O---------------------O--O------------------------------+ hackbench.time.percent_of_cpu_this_job_got 9000 +-+-----------------------O-O-O-O--------O-O-----O-O-----------------+ O.+.+ O O O.+ O O.O.O.O.O +.+.+O O + O.O.+.+ O O +.+.+.+ | 8000 +-+ : : : : : : : : : : : : | 7000 +-+ : : : : : : : : : : : : | | : : : : : : : : : : : : | 6000 +-+ : : : : : : : : : : : : : :| 5000 +-+ : : : : : : : : : : : : : :| | : : : : : : : : : : : : : :| 4000 +-+ : : : : : : : : : : : : : :| 3000 +-+ : : : : : : : : : : : : : :| | : : : : : : : : : : : : : :| 2000 +-+ : : : : : : : : : : : : | 1000 +-+ : : : : : : : : : : : : | | : : : : : : : : : : : : | 0 +-O-O-------O---------------------O--O-------------------------------+ hackbench.time.voluntary_context_switches 2.5e+09 +-+---------------------------O-----------------------------------+ | O O | | O OO O O | 2e+09 +-+ O O O O O O O O | O O O O O O | | O O | 1.5e+09 +-+ | | | 1e+09 +-+ | | | | | 5e+08 +-+.+ +.+ .+.+.+.+ +.+.+.+ + +.+.+.+ +.++.+ | | : : : + : : : :: : : : : :| | : : : + : : : : :: : : : :| 0 +-O-O------O--------------------O---O-----------------------------+ hackbench.time.involuntary_context_switches 1.2e+09 +-+---------------------------------------------------------------+ | O | 1e+09 +-+ OO O O O | | O O O O O O | | O O O O O O O O | 8e+08 O-+ O | | O O | 6e+08 +-+ | | | 4e+08 +-+ | | | | | 2e+08 +-+ | |.+.+. +.+. .+.+.+.+.+. .+.+.+.+. .+ .+.+.+.+. .+.++.+. .| 0 +-O-O------O--------------------O---O-----------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-bdw-ep3c: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory *************************************************************************************************** lkp-bdw-ep3d: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode: gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-2019-05-14.cgz/300s/lkp-bdw-ep3d/shared/reaim/0xb000036 commit: v5.2 94cc25049f (" iQEzBAABCAAdFiEEghj4iEmqxSLpTPRwpekojE+kFfoFAl0jffgACgkQpekojE+k") v5.2 94cc25049f407162b193b52c608 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:5 -20% :2 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x 1:5 -20% :2 dmesg.WARNING:stack_recursion Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

10 months, 4 weeks

1
0
0 / 0

7457c0da02 [ 0.733186] BUG: KASAN: unknown-crash in unwind_next_frame

by kernel test robot

Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git master commit 7457c0da024b181a9143988d740001f9bc98698d Author: Peter Zijlstra <peterz(a)infradead.org> AuthorDate: Fri May 3 12:22:47 2019 +0200 Commit: Ingo Molnar <mingo(a)kernel.org> CommitDate: Tue Jun 25 10:23:50 2019 +0200 x86/alternatives: Add int3_emulate_call() selftest Given that the entry_*.S changes for this functionality are somewhat tricky, make sure the paths are tested every boot, instead of on the rare occasion when we trip an INT3 while rewriting text. Requested-by: Andy Lutomirski <luto(a)kernel.org> Signed-off-by: Peter Zijlstra (Intel) <peterz(a)infradead.org> Reviewed-by: Josh Poimboeuf <jpoimboe(a)redhat.com> Acked-by: Andy Lutomirski <luto(a)kernel.org> Cc: Linus Torvalds <torvalds(a)linux-foundation.org> Cc: Peter Zijlstra <peterz(a)infradead.org> Cc: Thomas Gleixner <tglx(a)linutronix.de> Signed-off-by: Ingo Molnar <mingo(a)kernel.org> faeedb0679 x86/stackframe/32: Allow int3_emulate_push() 7457c0da02 x86/alternatives: Add int3_emulate_call() selftest +-------------------------------------------------------+------------+------------+ | | faeedb0679 | 7457c0da02 | +-------------------------------------------------------+------------+------------+ | boot_successes | 33 | 8 | | boot_failures | 2 | 4 | | WARNING:possible_circular_locking_dependency_detected | 2 | | | BUG:KASAN:unknown-crash_in_u | 0 | 4 | +-------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 0.726834] CPU: GenuineIntel Intel Core Processor (Haswell) (family: 0x6, model: 0x3c, stepping: 0x1) [ 0.728007] Spectre V2 : Spectre mitigation: kernel not compiled with retpoline; no mitigation available! [ 0.728009] Speculative Store Bypass: Vulnerable [ 0.729969] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.732269] ================================================================== [ 0.733186] BUG: KASAN: unknown-crash in unwind_next_frame+0x3f6/0x490 [ 0.734146] Read of size 8 at addr ffffffff84007db0 by task swapper/0 [ 0.734963] [ 0.735168] CPU: 0 PID: 0 Comm: swapper Tainted: G T 5.2.0-rc6-00013-g7457c0d #1 [ 0.736266] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 0.737374] Call Trace: [ 0.737697] dump_stack+0x19/0x1b [ 0.738129] print_address_description+0x1b0/0x2b2 [ 0.738745] ? unwind_next_frame+0x3f6/0x490 [ 0.739370] __kasan_report+0x10f/0x171 [ 0.739959] ? unwind_next_frame+0x3f6/0x490 [ 0.739959] kasan_report+0x12/0x1c [ 0.739959] __asan_load8+0x54/0x81 [ 0.739959] unwind_next_frame+0x3f6/0x490 [ 0.739959] ? unwind_dump+0x24e/0x24e [ 0.739959] unwind_next_frame+0x1b/0x23 [ 0.739959] ? create_prof_cpu_mask+0x20/0x20 [ 0.739959] arch_stack_walk+0x68/0xa5 [ 0.739959] ? set_memory_4k+0x2a/0x2c [ 0.739959] stack_trace_save+0x7b/0xa0 [ 0.739959] ? stack_trace_consume_entry+0x89/0x89 [ 0.739959] save_trace+0x3c/0x93 [ 0.739959] mark_lock+0x1ef/0x9b1 [ 0.739959] ? sched_clock_local+0x86/0xa6 [ 0.739959] __lock_acquire+0x3ba/0x1bea [ 0.739959] ? __asan_loadN+0xf/0x11 [ 0.739959] ? mark_held_locks+0x8e/0x8e [ 0.739959] ? mark_lock+0xb4/0x9b1 [ 0.739959] ? sched_clock_local+0x86/0xa6 [ 0.739959] lock_acquire+0x122/0x221 [ 0.739959] ? _vm_unmap_aliases+0x141/0x183 [ 0.739959] __mutex_lock+0xb6/0x731 [ 0.739959] ? _vm_unmap_aliases+0x141/0x183 [ 0.739959] ? sched_clock_cpu+0xac/0xb1 [ 0.739959] ? __mutex_add_waiter+0xae/0xae [ 0.739959] ? lock_downgrade+0x368/0x368 [ 0.739959] ? _vm_unmap_aliases+0x40/0x183 [ 0.739959] mutex_lock_nested+0x16/0x18 [ 0.739959] _vm_unmap_aliases+0x141/0x183 [ 0.739959] ? _vm_unmap_aliases+0x40/0x183 [ 0.739959] vm_unmap_aliases+0x14/0x16 [ 0.739959] change_page_attr_set_clr+0x15e/0x2f2 [ 0.739959] ? __set_pages_p+0x111/0x111 [ 0.739959] ? alternative_instructions+0xd8/0x118 [ 0.739959] ? arch_init_ideal_nops+0x181/0x181 [ 0.739959] set_memory_4k+0x2a/0x2c [ 0.739959] check_bugs+0x11fd/0x1298 [ 0.739959] ? l1tf_cmdline+0x1dc/0x1dc [ 0.739959] ? proc_create_single_data+0x5f/0x6e [ 0.739959] ? cgroup_init+0x2b1/0x2f6 [ 0.739959] start_kernel+0x793/0x7eb [ 0.739959] ? thread_stack_cache_init+0x2e/0x2e [ 0.739959] ? idt_setup_early_handler+0x70/0xb1 [ 0.739959] x86_64_start_reservations+0x55/0x76 [ 0.739959] x86_64_start_kernel+0x87/0xaa [ 0.739959] secondary_startup_64+0xa4/0xb0 [ 0.739959] [ 0.739959] Memory state around the buggy address: [ 0.739959] ffffffff84007c80: 00 00 00 00 00 00 00 00 00 00 00 00 00 f1 f1 f1 [ 0.739959] ffffffff84007d00: f1 00 00 00 00 00 00 00 00 00 f2 f2 f2 f3 f3 f3 [ 0.739959] >ffffffff84007d80: f3 79 be 52 49 79 be 00 00 00 00 00 00 00 00 f1 # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start ce0af1f7ff3c78bd4d9327a981a4c6e609200157 6fbc7275c7a9ba97877050335f290341a1fd8dbf -- git bisect good c43a6604c14fd6095c098e373f113a01fe4b2f73 # 10:26 G 11 0 0 0 Merge 'linux-review/Sergey-Senozhatsky/cifs-fix-build-by-selecting-CONFIG_KEYS/20190701-192530' into devel-hourly-2019070602 git bisect bad 592eb776845425e370f815b3f8f213b8f2d14faf # 10:36 B 0 6 21 0 Merge 'linux-review/Alan-Stern/USB-core-Fix-compiler-warnings-in-devio-c/20190627-045941' into devel-hourly-2019070602 git bisect good 5b6207d86d7b287567a39f61e9a713b3522dfd6a # 10:54 G 11 0 1 1 Merge 'tip/x86/timers' into devel-hourly-2019070602 git bisect bad 264b8443817826a38479ad52596c8ae2f854b4f6 # 11:05 B 0 2 17 0 Merge 'tip/x86/asm' into devel-hourly-2019070602 git bisect good 5b30b22f870ee5e1a3ac000bde0b582a19a5c44f # 11:21 G 11 0 0 0 Merge 'linux-review/Liu-Changcheng/RDMA-i40iw-set-queue-pair-state-when-being-queried/20190628-175445' into devel-hourly-2019070602 git bisect good 4705370afadb21a3c7b2d9bc5c5e5fdb43f918a8 # 11:49 G 11 0 4 4 Merge 'm68k/m68k-queue' into devel-hourly-2019070602 git bisect good 39081077793b516f91c47aadf935569618e7fe69 # 12:11 G 11 0 1 1 Merge 'krzk/next/dt' into devel-hourly-2019070602 git bisect good b56298be8511287dc67d9d8c501bb6703698f229 # 12:38 G 11 0 1 1 Merge 'tip/timers/vdso' into devel-hourly-2019070602 git bisect good f7ffb2c7f16fa3618b243a0dcd0bbbb65263f57b # 12:59 G 11 0 3 3 Merge 'thermal/next' into devel-hourly-2019070602 git bisect good 5e1246ff2d3707992e3bf3eaa45551f7fab97983 # 13:30 G 12 0 2 2 x86/entry/32: Clean up return from interrupt preemption path git bisect good ea1ed38dba64b64a245ab8ca1406269d17b99485 # 13:54 G 11 0 2 2 x86/stackframe, x86/ftrace: Add pt_regs frame annotations git bisect good faeedb0679bee39ebffc6d53111e86932dea189a # 14:21 G 11 0 0 0 x86/stackframe/32: Allow int3_emulate_push() git bisect bad 7457c0da024b181a9143988d740001f9bc98698d # 14:29 B 0 1 16 0 x86/alternatives: Add int3_emulate_call() selftest # first bad commit: [7457c0da024b181a9143988d740001f9bc98698d] x86/alternatives: Add int3_emulate_call() selftest git bisect good faeedb0679bee39ebffc6d53111e86932dea189a # 14:42 G 34 0 2 2 x86/stackframe/32: Allow int3_emulate_push() # extra tests on HEAD of linux-devel/devel-hourly-2019070602 git bisect bad ce0af1f7ff3c78bd4d9327a981a4c6e609200157 # 14:43 B 5 7 0 1 0day head guard for 'devel-hourly-2019070602' # extra tests on tree/branch linux-next/master # extra tests with first bad commit reverted --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/pipermail/lkp Intel Corporation

11 months

6
10
0 / 0

[ptrace] cd5bbb3047: kernel_selftests.seccomp.seccomp_bpf.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: cd5bbb3047bf73353767d70a03db986600ca372a ("ptrace: add PTRACE_GET_SYSCALL_INFO request") https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git master in testcase: kernel_selftests with following parameters: group: kselftests-02 test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel. test-url: https://www.kernel.org/doc/Documentation/kselftest.txt on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> # selftests: seccomp: seccomp_bpf # [==========] Running 74 tests from 1 test cases. # [ RUN ] global.mode_strict_support # [ OK ] global.mode_strict_support # [ RUN ] global.mode_strict_cannot_call_prctl # [ OK ] global.mode_strict_cannot_call_prctl # [ RUN ] global.no_new_privs_support # [ OK ] global.no_new_privs_support # [ RUN ] global.mode_filter_support # [ OK ] global.mode_filter_support # [ RUN ] global.mode_filter_without_nnp # [ OK ] global.mode_filter_without_nnp # [ RUN ] global.filter_size_limits # [ OK ] global.filter_size_limits # [ RUN ] global.filter_chain_limits # [ OK ] global.filter_chain_limits # [ RUN ] global.mode_filter_cannot_move_to_strict # [ OK ] global.mode_filter_cannot_move_to_strict # [ RUN ] global.mode_filter_get_seccomp # [ OK ] global.mode_filter_get_seccomp # [ RUN ] global.ALLOW_all # [ OK ] global.ALLOW_all # [ RUN ] global.empty_prog # [ OK ] global.empty_prog # [ RUN ] global.log_all # [ OK ] global.log_all # [ RUN ] global.unknown_ret_is_kill_inside # [ OK ] global.unknown_ret_is_kill_inside # [ RUN ] global.unknown_ret_is_kill_above_allow # [ OK ] global.unknown_ret_is_kill_above_allow # [ RUN ] global.KILL_all # [ OK ] global.KILL_all # [ RUN ] global.KILL_one # [ OK ] global.KILL_one # [ RUN ] global.KILL_one_arg_one # [ OK ] global.KILL_one_arg_one # [ RUN ] global.KILL_one_arg_six # [ OK ] global.KILL_one_arg_six # [ RUN ] global.KILL_thread # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_redirected:Expected 0 (0) == msg (1) # TRACE_syscall.ptrace_syscall_redirected: Test failed at step #15 # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_errno:Expected 0 (0) == msg (1) # TRACE_syscall.ptrace_syscall_errno: Test failed at step #15 # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.ptrace_syscall_faked:Expected 0 (0) == msg (1) # TRACE_syscall.ptrace_syscall_faked: Test failed at step #15 # [==========] Running 74 tests from 1 test cases. # [ RUN ] global.mode_strict_support # [ OK ] global.mode_strict_support # [ RUN ] global.mode_strict_cannot_call_prctl # [ OK ] global.mode_strict_cannot_call_prctl # [ RUN ] global.no_new_privs_support # [ OK ] global.no_new_privs_support # [ RUN ] global.mode_filter_support # [ OK ] global.mode_filter_support # [ RUN ] global.mode_filter_without_nnp # [ OK ] global.mode_filter_without_nnp # [ RUN ] global.filter_size_limits # [ OK ] global.filter_size_limits # [ RUN ] global.filter_chain_limits # [ OK ] global.filter_chain_limits # [ RUN ] global.mode_filter_cannot_move_to_strict # [ OK ] global.mode_filter_cannot_move_to_strict # [ RUN ] global.mode_filter_get_seccomp # [ OK ] global.mode_filter_get_seccomp # [ RUN ] global.ALLOW_all # [ OK ] global.ALLOW_all # [ RUN ] global.empty_prog # [ OK ] global.empty_prog # [ RUN ] global.log_all # [ OK ] global.log_all # [ RUN ] global.unknown_ret_is_kill_inside # [ OK ] global.unknown_ret_is_kill_inside # [ RUN ] global.unknown_ret_is_kill_above_allow # [ OK ] global.unknown_ret_is_kill_above_allow # [ RUN ] global.KILL_all # [ OK ] global.KILL_all # [ RUN ] global.KILL_one # [ OK ] global.KILL_one # [ RUN ] global.KILL_one_arg_one # [ OK ] global.KILL_one_arg_one # [ RUN ] global.KILL_one_arg_six # [ OK ] global.KILL_one_arg_six # [ RUN ] global.KILL_thread # [ OK ] global.KILL_thread # [ RUN ] global.KILL_process # [ OK ] global.KILL_process # [ RUN ] global.arg_out_of_range # [ OK ] global.arg_out_of_range # [ RUN ] global.ERRNO_valid # [ OK ] global.ERRNO_valid # [ RUN ] global.ERRNO_zero # [ OK ] global.ERRNO_zero # [ RUN ] global.ERRNO_capped # [ OK ] global.ERRNO_capped # [ RUN ] global.ERRNO_order # [ OK ] global.ERRNO_order # [ RUN ] TRAP.dfl # [ OK ] TRAP.dfl # [ RUN ] TRAP.ign # [ OK ] TRAP.ign # [ RUN ] TRAP.handler # [ OK ] TRAP.handler # [ RUN ] precedence.allow_ok # [ OK ] precedence.allow_ok # [ RUN ] precedence.kill_is_highest # [ OK ] precedence.kill_is_highest # [ RUN ] precedence.kill_is_highest_in_any_order # [ OK ] precedence.kill_is_highest_in_any_order # [ RUN ] precedence.trap_is_second # [ OK ] precedence.trap_is_second # [ RUN ] precedence.trap_is_second_in_any_order # [ OK ] precedence.trap_is_second_in_any_order # [ RUN ] precedence.errno_is_third # [ OK ] precedence.errno_is_third # [ RUN ] precedence.errno_is_third_in_any_order # [ OK ] precedence.errno_is_third_in_any_order # [ RUN ] precedence.trace_is_fourth # [ OK ] precedence.trace_is_fourth # [ RUN ] precedence.trace_is_fourth_in_any_order # [ OK ] precedence.trace_is_fourth_in_any_order # [ RUN ] precedence.log_is_fifth # [ OK ] precedence.log_is_fifth # [ RUN ] precedence.log_is_fifth_in_any_order # [ OK ] precedence.log_is_fifth_in_any_order # [ RUN ] TRACE_poke.read_has_side_effects # [ OK ] TRACE_poke.read_has_side_effects # [ RUN ] TRACE_poke.getpid_runs_normally # [ OK ] TRACE_poke.getpid_runs_normally # [ RUN ] TRACE_syscall.ptrace_syscall_redirected # [ FAIL ] TRACE_syscall.ptrace_syscall_redirected # [ RUN ] TRACE_syscall.ptrace_syscall_errno # [ FAIL ] TRACE_syscall.ptrace_syscall_errno # [ RUN ] TRACE_syscall.ptrace_syscall_faked # [ FAIL ] TRACE_syscall.ptrace_syscall_faked # [ RUN ] TRACE_syscall.syscall_allowed # [ OK ] TRACE_syscall.syscall_allowed # [ RUN ] TRACE_syscall.syscall_redirected # [ OK ] TRACE_syscall.syscall_redirected # [ RUN ] TRACE_syscall.syscall_errno # [ OK ] TRACE_syscall.syscall_errno # [ RUN ] TRACE_syscall.syscall_faked # [ OK ] TRACE_syscall.syscall_faked # [ RUN ] TRACE_syscall.skip_after_RET_TRACE # [ OK ] TRACE_syscall.skip_after_RET_TRACE # [ RUN ] TRACE_syscall.kill_after_RET_TRACE # [ OK ] TRACE_syscall.kill_after_RET_TRACE # [ RUN ] TRACE_syscall.skip_aseccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.skip_after_ptrace:Expected 0 (0) == msg (1) # TRACE_syscall.skip_after_ptrace: Test failed at step #17 # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (1) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (2) # seccomp_bpf.c:1781:TRACE_syscall.kill_after_ptrace:Expected 0 (0) == msg (1) # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # [ OK ] global.user_notification_child_pid_ns # [ RUN ] global.user_notification_sibling_pid_ns # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # [ OK ] global.user_notification_child_pid_ns # [ RUN ] global.user_notification_sibling_pid_ns # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # [ OK ] global.user_notification_child_pid_ns # [ RUN ] global.user_notification_sibling_pid_ns # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # [ OK ] global.user_notification_child_pid_ns # [ RUN ] global.user_notification_sibling_pid_ns # [ OK ] global.user_notification_sibling_pid_ns # [ RUN ] global.user_notification_fault_recv # fter_ptrace # [ FAIL ] TRACE_syscall.skip_after_ptrace # [ RUN ] TRACE_syscall.kill_after_ptrace # [ OK ] TRACE_syscall.kill_after_ptrace # [ RUN ] global.seccomp_syscall # [ OK ] global.seccomp_syscall # [ RUN ] global.seccomp_syscall_mode_lock # [ OK ] global.seccomp_syscall_mode_lock # [ RUN ] global.detect_seccomp_filter_flags # [ OK ] global.detect_seccomp_filter_flags # [ RUN ] global.TSYNC_first # [ OK ] global.TSYNC_first # [ RUN ] TSYNC.siblings_fail_prctl # [ OK ] TSYNC.siblings_fail_prctl # [ RUN ] TSYNC.two_siblings_with_ancestor # [ OK ] TSYNC.two_siblings_with_ancestor # [ RUN ] TSYNC.two_sibling_want_nnp # [ OK ] TSYNC.two_sibling_want_nnp # [ RUN ] TSYNC.two_siblings_with_no_filter # [ OK ] TSYNC.two_siblings_with_no_filter # [ RUN ] TSYNC.two_siblings_with_one_divergence # [ OK ] TSYNC.two_siblings_with_one_divergence # [ RUN ] TSYNC.two_siblings_not_under_filter # [ OK ] TSYNC.two_siblings_not_under_filter # [ RUN ] global.syscall_restart # [ OK ] global.syscall_restart # [ RUN ] global.filter_flag_log # [ OK ] global.filter_flag_log # [ RUN ] global.get_action_avail # [ OK ] global.get_action_avail # [ RUN ] global.get_metadata # [ OK ] global.get_metadata # [ RUN ] global.user_notification_basic # [ OK ] global.user_notification_basic # [ RUN ] global.user_notification_kill_in_middle # [ OK ] global.user_notification_kill_in_middle # [ RUN ] global.user_notification_signal # [ OK ] global.user_notification_signal # [ RUN ] global.user_notification_closed_listener # [ OK ] global.user_notification_closed_listener # [ RUN ] global.user_notification_child_pid_ns # [ OK ] global.user_notification_child_pid_ns # [ RUN ] global.user_notification_sibling_pid_ns # [ OK ] global.user_notification_sibling_pid_ns # [ RUN ] global.user_notification_fault_recv # [ OK ] global.user_notification_fault_recv # [ RUN ] global.seccomp_get_notif_sizes # [ OK ] global.seccomp_get_notif_sizes # [==========] 70 / 74 tests passed. # [ FAILED ] not ok 1 selftests: seccomp: seccomp_bpf To reproduce: # build kernel cd linux cp config-5.2.0-rc4-00289-gcd5bbb3047bf7 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

11 months

4
3
0 / 0

Cool day

by Hallie

11 months

1
0
0 / 0

[PATCH] xfs: don't update lastino for FSBULKSTAT_SINGLE

by Darrick J. Wong

From: Darrick J. Wong <darrick.wong(a)oracle.com> The kernel test robot found a regression of xfs/054 in the conversion of bulkstat to use the new iwalk infrastructure -- if a caller set *lastip = 128 and invoked FSBULKSTAT_SINGLE, the bstat info would be for inode 128, but *lastip would be increased by the kernel to 129. FSBULKSTAT_SINGLE never incremented lastip before, so it's incorrect to make such an update to the internal lastino value now. Fixes: 2810bd6840e463 ("xfs: convert bulkstat to new iwalk infrastructure") Reported-by: kernel test robot <rong.a.chen(a)intel.com> Signed-off-by: Darrick J. Wong <darrick.wong(a)oracle.com> --- fs/xfs/xfs_ioctl.c | 1 - 1 file changed, 1 deletion(-) diff --git a/fs/xfs/xfs_ioctl.c b/fs/xfs/xfs_ioctl.c index 6bf04e71325b..1876461e5104 100644 --- a/fs/xfs/xfs_ioctl.c +++ b/fs/xfs/xfs_ioctl.c @@ -797,7 +797,6 @@ xfs_ioc_fsbulkstat( breq.startino = lastino; breq.icount = 1; error = xfs_bulkstat_one(&breq, xfs_fsbulkstat_one_fmt); - lastino = breq.startino; } else { /* XFS_IOC_FSBULKSTAT */ breq.startino = lastino ? lastino + 1 : 0; error = xfs_bulkstat(&breq, xfs_fsbulkstat_one_fmt);

11 months

3
2
0 / 0

[xfs] 490d451fa5: aim7.jobs-per-min -6.3% regression

by kernel test robot

Greeting, FYI, we noticed a -6.3% regression of aim7.jobs-per-min due to commit: commit: 490d451fa5188975c21246f7f8f4914cd3f2d6f2 ("xfs: fix inode_cluster_size rounding mayhem") https://kernel.googlesource.com/pub/scm/fs/xfs/xfs-linux.git xfs-5.3-merge in testcase: aim7 on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory with following parameters: disk: 4BRD_12G md: RAID0 fs: xfs test: disk_src load: 3000 cpufreq_governor: performance ucode: 0x200005e test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode: gcc-7/performance/4BRD_12G/xfs/x86_64-rhel-7.6/3000/RAID0/debian-x86_64-2019-05-14.cgz/lkp-skl-2sp7/disk_src/aim7/0x200005e commit: 494dba7b27 ("xfs: refactor inode geometry setup routines") 490d451fa5 ("xfs: fix inode_cluster_size rounding mayhem") 494dba7b276e12bc 490d451fa5188975c21246f7f8f ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x %stddev %change %stddev \ | \ 85540 -6.3% 80176 aim7.jobs-per-min 210.66 +6.7% 224.75 aim7.time.elapsed_time 210.66 +6.7% 224.75 aim7.time.elapsed_time.max 1331 +4.0% 1384 aim7.time.system_time 19562090 -3.3% 18914487 aim7.time.voluntary_context_switches 8.45 -2.4% 8.25 iostat.cpu.system 16359 ± 24% -78.0% 3597 ±167% numa-numastat.node0.other_node 184824 -9.4% 167476 vmstat.system.cs 7985664 ± 5% -15.9% 6715392 ± 10% meminfo.DirectMap2M 344940 ± 4% -11.7% 304492 ± 11% meminfo.DirectMap4k 320.00 -2.5% 312.00 turbostat.Avg_MHz 8.74 ± 3% -1.0 7.78 ± 3% turbostat.C1% 42.55 -1.1% 42.07 turbostat.RAMWatt 9263 -6.4% 8669 ± 4% proc-vmstat.nr_shmem 687031 +3.4% 710693 proc-vmstat.numa_hit 663468 +3.6% 687162 proc-vmstat.numa_local 4201 ± 3% -17.8% 3455 ± 11% proc-vmstat.pgactivate 774593 +3.2% 799333 proc-vmstat.pgalloc_normal 715182 +4.4% 746954 proc-vmstat.pgfault 12681 ± 11% +48.8% 18874 ± 15% numa-vmstat.node0.nr_slab_reclaimable 16222 ± 24% -77.9% 3590 ±166% numa-vmstat.node0.numa_other 333.75 ± 5% -55.4% 149.00 ±101% numa-vmstat.node1.nr_inactive_file 4773 ± 2% -67.6% 1548 ±110% numa-vmstat.node1.nr_shmem 17450 ± 8% -35.4% 11267 ± 27% numa-vmstat.node1.nr_slab_reclaimable 41685 -32.5% 28147 ± 42% numa-vmstat.node1.nr_slab_unreclaimable 333.75 ± 5% -55.4% 149.00 ±101% numa-vmstat.node1.nr_zone_inactive_file 50756 ± 11% +48.8% 75513 ± 15% numa-meminfo.node0.KReclaimable 50756 ± 11% +48.8% 75513 ± 15% numa-meminfo.node0.SReclaimable 1335 ± 5% -55.2% 598.00 ±101% numa-meminfo.node1.Inactive(file) 69836 ± 8% -35.4% 45087 ± 27% numa-meminfo.node1.KReclaimable 1459618 ± 2% -22.8% 1126350 ± 21% numa-meminfo.node1.MemUsed 69836 ± 8% -35.4% 45087 ± 27% numa-meminfo.node1.SReclaimable 166770 -32.4% 112702 ± 42% numa-meminfo.node1.SUnreclaim 19096 ± 2% -67.6% 6193 ±110% numa-meminfo.node1.Shmem 236606 ± 3% -33.3% 157789 ± 36% numa-meminfo.node1.Slab 13.48 ± 11% -27.6% 9.75 ± 22% sched_debug.cfs_rq:/.util_est_enqueued.avg 17417 ± 4% +102.4% 35258 ± 25% sched_debug.cpu.avg_idle.min 200170 ± 3% -11.3% 177551 ± 3% sched_debug.cpu.nr_switches.min 224927 -9.5% 203656 sched_debug.cpu.sched_count.avg 243511 -9.9% 219425 sched_debug.cpu.sched_count.max 197972 ± 4% -10.6% 177000 ± 3% sched_debug.cpu.sched_count.min 112286 -9.5% 101655 sched_debug.cpu.sched_goidle.avg 121611 -9.9% 109518 sched_debug.cpu.sched_goidle.max 98719 ± 4% -10.5% 88352 ± 3% sched_debug.cpu.sched_goidle.min 112397 -9.5% 101751 sched_debug.cpu.ttwu_count.avg 99155 ± 4% -9.3% 89884 ± 3% sched_debug.cpu.ttwu_count.min 3.088e+09 -7.1% 2.869e+09 perf-stat.i.branch-instructions 83196224 -6.9% 77422910 perf-stat.i.branch-misses 39.31 +1.4 40.67 perf-stat.i.cache-miss-rate% 186802 -9.3% 169481 perf-stat.i.context-switches 2.246e+10 -2.8% 2.183e+10 perf-stat.i.cpu-cycles 301.96 ± 3% -14.4% 258.37 ± 5% perf-stat.i.cpu-migrations 3030899 -7.0% 2817923 ± 4% perf-stat.i.dTLB-load-misses 3.663e+09 -6.6% 3.422e+09 perf-stat.i.dTLB-loads 155564 ± 5% -8.8% 141852 ± 7% perf-stat.i.dTLB-store-misses 1.719e+09 -6.3% 1.612e+09 perf-stat.i.dTLB-stores 1132323 ± 7% -8.1% 1040500 ± 2% perf-stat.i.iTLB-load-misses 7997681 -6.1% 7508178 perf-stat.i.iTLB-loads 1.487e+10 -7.0% 1.383e+10 perf-stat.i.instructions 0.65 -3.8% 0.63 perf-stat.i.ipc 3223 -2.0% 3160 perf-stat.i.minor-faults 12807723 +1.8% 13034193 perf-stat.i.node-load-misses 2062331 +5.3% 2171538 perf-stat.i.node-loads 2819059 -7.5% 2608335 perf-stat.i.node-store-misses 130481 -5.4% 123403 perf-stat.i.node-stores 3223 -2.0% 3160 perf-stat.i.page-faults 7.83 +5.4% 8.26 perf-stat.overall.MPKI 40.38 +1.5 41.86 perf-stat.overall.cache-miss-rate% 1.51 +4.5% 1.58 perf-stat.overall.cpi 477.65 -4.4% 456.87 perf-stat.overall.cycles-between-cache-misses 0.66 -4.3% 0.63 perf-stat.overall.ipc 3.073e+09 -7.1% 2.855e+09 perf-stat.ps.branch-instructions 82794308 -6.9% 77071761 perf-stat.ps.branch-misses 185887 -9.2% 168701 perf-stat.ps.context-switches 2.236e+10 -2.8% 2.173e+10 perf-stat.ps.cpu-cycles 300.52 ± 3% -14.4% 257.28 ± 5% perf-stat.ps.cpu-migrations 3016180 -7.0% 2805027 ± 4% perf-stat.ps.dTLB-load-misses 3.645e+09 -6.6% 3.406e+09 perf-stat.ps.dTLB-loads 154823 ± 5% -8.8% 141216 ± 7% perf-stat.ps.dTLB-store-misses 1.711e+09 -6.2% 1.604e+09 perf-stat.ps.dTLB-stores 1126828 ± 7% -8.1% 1035738 ± 2% perf-stat.ps.iTLB-load-misses 7958612 -6.1% 7473724 perf-stat.ps.iTLB-loads 1.48e+10 -7.0% 1.377e+10 perf-stat.ps.instructions 3209 -1.9% 3149 perf-stat.ps.minor-faults 12744993 +1.8% 12974158 perf-stat.ps.node-load-misses 2052251 +5.3% 2161551 perf-stat.ps.node-loads 2805253 -7.4% 2596325 perf-stat.ps.node-store-misses 129870 -5.4% 122873 perf-stat.ps.node-stores 3209 -1.9% 3149 perf-stat.ps.page-faults 75633 ± 2% +13.8% 86075 ± 8% softirqs.CPU0.TIMER 66792 ± 2% +12.2% 74934 ± 9% softirqs.CPU1.TIMER 68311 +12.2% 76617 ± 11% softirqs.CPU10.TIMER 29860 ± 2% +8.8% 32499 ± 2% softirqs.CPU11.SCHED 67495 ± 3% +13.9% 76899 ± 12% softirqs.CPU11.TIMER 30084 +9.0% 32788 ± 2% softirqs.CPU12.SCHED 69794 ± 6% +11.8% 78012 ± 11% softirqs.CPU12.TIMER 30384 +7.9% 32777 ± 2% softirqs.CPU13.SCHED 68705 +14.4% 78630 ± 11% softirqs.CPU13.TIMER 29805 +7.6% 32057 ± 3% softirqs.CPU14.SCHED 66776 +12.0% 74781 ± 10% softirqs.CPU14.TIMER 55769 +10.4% 61544 softirqs.CPU15.RCU 67027 ± 2% +13.1% 75809 ± 10% softirqs.CPU15.TIMER 30420 +8.4% 32967 ± 2% softirqs.CPU16.SCHED 68713 +13.6% 78081 ± 11% softirqs.CPU16.TIMER 53587 ± 5% +14.7% 61442 softirqs.CPU17.RCU 30995 ± 2% +9.2% 33862 ± 3% softirqs.CPU18.SCHED 69520 ± 4% +17.1% 81388 ± 12% softirqs.CPU18.TIMER 30143 +10.0% 33145 ± 2% softirqs.CPU2.SCHED 68273 +15.1% 78551 ± 10% softirqs.CPU2.TIMER 68008 ± 2% +12.7% 76628 ± 9% softirqs.CPU20.TIMER 67197 ± 2% +12.9% 75868 ± 9% softirqs.CPU21.TIMER 67291 ± 2% +11.6% 75123 ± 10% softirqs.CPU22.TIMER 65606 +12.1% 73533 ± 7% softirqs.CPU23.TIMER 68790 +11.0% 76388 ± 9% softirqs.CPU26.TIMER 65092 ± 2% +13.5% 73886 ± 8% softirqs.CPU27.TIMER 67028 ± 3% +14.1% 76472 ± 9% softirqs.CPU28.TIMER 67306 ± 2% +11.3% 74920 ± 8% softirqs.CPU29.TIMER 67033 ± 2% +12.7% 75519 ± 9% softirqs.CPU30.TIMER 67820 ± 2% +12.1% 76004 ± 10% softirqs.CPU31.TIMER 66204 +11.6% 73887 ± 8% softirqs.CPU32.TIMER 67556 ± 2% +10.7% 74781 ± 8% softirqs.CPU33.TIMER 29106 +9.4% 31847 ± 3% softirqs.CPU36.SCHED 28942 ± 2% +8.9% 31512 ± 3% softirqs.CPU37.SCHED 29150 +9.7% 31984 ± 3% softirqs.CPU38.SCHED 67927 +16.7% 79249 ± 11% softirqs.CPU4.TIMER 29114 ± 2% +11.1% 32332 ± 5% softirqs.CPU40.SCHED 65775 +28.9% 84766 ± 24% softirqs.CPU40.TIMER 29101 ± 2% +7.9% 31395 ± 3% softirqs.CPU41.SCHED 29161 ± 3% +11.1% 32385 softirqs.CPU42.SCHED 64737 +15.1% 74538 ± 9% softirqs.CPU42.TIMER 29585 ± 2% +9.9% 32515 ± 3% softirqs.CPU43.SCHED 66414 ± 2% +12.1% 74465 ± 10% softirqs.CPU43.TIMER 29083 +9.1% 31718 ± 4% softirqs.CPU44.SCHED 60441 ± 3% +13.5% 68597 ± 2% softirqs.CPU45.RCU 29010 ± 2% +10.5% 32052 ± 4% softirqs.CPU45.SCHED 61581 +9.8% 67620 softirqs.CPU48.RCU 29491 +9.9% 32406 ± 3% softirqs.CPU48.SCHED 65730 +10.1% 72370 ± 7% softirqs.CPU48.TIMER 61858 +9.7% 67844 softirqs.CPU49.RCU 65309 +11.8% 72991 ± 8% softirqs.CPU49.TIMER 28966 +7.9% 31269 ± 4% softirqs.CPU50.SCHED 29145 ± 2% +8.5% 31618 ± 4% softirqs.CPU51.SCHED 61437 +11.4% 68414 ± 2% softirqs.CPU52.RCU 29869 +8.1% 32292 ± 2% softirqs.CPU52.SCHED 66283 ± 2% +11.6% 73997 ± 9% softirqs.CPU52.TIMER 30109 ± 4% +6.9% 32172 ± 2% softirqs.CPU53.SCHED 66547 ± 2% +7.4% 71490 ± 5% softirqs.CPU54.TIMER 65625 +10.3% 72402 ± 6% softirqs.CPU55.TIMER 65739 +8.7% 71459 ± 5% softirqs.CPU56.TIMER 29338 +8.5% 31825 ± 2% softirqs.CPU57.SCHED 65624 +8.3% 71073 ± 4% softirqs.CPU57.TIMER 29326 +7.9% 31644 ± 3% softirqs.CPU58.SCHED 59934 ± 3% +9.2% 65474 ± 4% softirqs.CPU6.RCU 68921 ± 3% +16.1% 79996 ± 10% softirqs.CPU6.TIMER 66408 ± 2% +7.3% 71233 ± 3% softirqs.CPU62.TIMER 28503 +8.2% 30839 ± 2% softirqs.CPU63.SCHED 66373 +9.8% 72889 ± 8% softirqs.CPU64.TIMER 28778 +8.7% 31277 ± 3% softirqs.CPU66.SCHED 30149 +11.1% 33496 softirqs.CPU7.SCHED 68019 ± 2% +32.6% 90193 ± 19% softirqs.CPU7.TIMER 66562 ± 2% +28.9% 85777 ± 22% softirqs.CPU71.TIMER 30044 +8.3% 32542 ± 2% softirqs.CPU8.SCHED 29713 +8.2% 32162 ± 3% softirqs.CPU9.SCHED 66744 ± 2% +16.2% 77537 ± 14% softirqs.CPU9.TIMER 2148925 +8.1% 2323738 ± 2% softirqs.SCHED 4878934 +10.8% 5408187 ± 7% softirqs.TIMER 171333 +7.5% 184170 interrupts.CAL:Function_call_interrupts 1042 ± 4% -11.2% 925.75 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts 1046 ± 3% -11.7% 923.50 ± 3% interrupts.CPU16.RES:Rescheduling_interrupts 2227 ± 7% +16.6% 2596 interrupts.CPU18.CAL:Function_call_interrupts 1192 ± 13% -16.0% 1001 ± 4% interrupts.CPU2.RES:Rescheduling_interrupts 1026 ± 4% -10.6% 917.50 ± 7% interrupts.CPU20.RES:Rescheduling_interrupts 1529 ± 6% -22.2% 1189 ± 22% interrupts.CPU21.NMI:Non-maskable_interrupts 1529 ± 6% -22.2% 1189 ± 22% interrupts.CPU21.PMI:Performance_monitoring_interrupts 1643 ± 2% -25.4% 1225 ± 23% interrupts.CPU23.NMI:Non-maskable_interrupts 1643 ± 2% -25.4% 1225 ± 23% interrupts.CPU23.PMI:Performance_monitoring_interrupts 1062 ± 4% -11.3% 942.75 ± 3% interrupts.CPU23.RES:Rescheduling_interrupts 2291 ± 4% +12.6% 2581 ± 2% interrupts.CPU24.CAL:Function_call_interrupts 1576 ± 6% -26.5% 1159 ± 21% interrupts.CPU24.NMI:Non-maskable_interrupts 1576 ± 6% -26.5% 1159 ± 21% interrupts.CPU24.PMI:Performance_monitoring_interrupts 1623 ± 4% -23.0% 1250 ± 28% interrupts.CPU26.NMI:Non-maskable_interrupts 1623 ± 4% -23.0% 1250 ± 28% interrupts.CPU26.PMI:Performance_monitoring_interrupts 1560 ± 3% -24.8% 1174 ± 24% interrupts.CPU28.NMI:Non-maskable_interrupts 1560 ± 3% -24.8% 1174 ± 24% interrupts.CPU28.PMI:Performance_monitoring_interrupts 2356 ± 2% +10.1% 2594 interrupts.CPU29.CAL:Function_call_interrupts 1539 ± 5% -23.3% 1181 ± 22% interrupts.CPU29.NMI:Non-maskable_interrupts 1539 ± 5% -23.3% 1181 ± 22% interrupts.CPU29.PMI:Performance_monitoring_interrupts 1427 ± 20% -32.7% 961.00 ± 3% interrupts.CPU3.RES:Rescheduling_interrupts 1630 ± 9% -21.9% 1273 ± 24% interrupts.CPU30.NMI:Non-maskable_interrupts 1630 ± 9% -21.9% 1273 ± 24% interrupts.CPU30.PMI:Performance_monitoring_interrupts 1044 ± 5% -9.4% 946.25 ± 5% interrupts.CPU32.RES:Rescheduling_interrupts 1516 ± 4% -19.7% 1217 ± 26% interrupts.CPU34.NMI:Non-maskable_interrupts 1516 ± 4% -19.7% 1217 ± 26% interrupts.CPU34.PMI:Performance_monitoring_interrupts 1625 ± 4% -21.9% 1269 ± 23% interrupts.CPU35.NMI:Non-maskable_interrupts 1625 ± 4% -21.9% 1269 ± 23% interrupts.CPU35.PMI:Performance_monitoring_interrupts 1098 ± 5% -13.0% 956.00 ± 4% interrupts.CPU35.RES:Rescheduling_interrupts 1580 ± 6% -22.4% 1226 ± 22% interrupts.CPU37.NMI:Non-maskable_interrupts 1580 ± 6% -22.4% 1226 ± 22% interrupts.CPU37.PMI:Performance_monitoring_interrupts 1107 ± 5% -8.1% 1017 interrupts.CPU37.RES:Rescheduling_interrupts 1082 ± 2% -8.4% 991.50 ± 3% interrupts.CPU41.RES:Rescheduling_interrupts 1053 ± 4% -8.8% 961.25 ± 5% interrupts.CPU48.RES:Rescheduling_interrupts 1580 ± 6% -9.4% 1432 ± 5% interrupts.CPU5.NMI:Non-maskable_interrupts 1580 ± 6% -9.4% 1432 ± 5% interrupts.CPU5.PMI:Performance_monitoring_interrupts 1529 ± 9% -29.6% 1076 ± 25% interrupts.CPU51.NMI:Non-maskable_interrupts 1529 ± 9% -29.6% 1076 ± 25% interrupts.CPU51.PMI:Performance_monitoring_interrupts 1066 ± 6% -10.6% 953.00 ± 8% interrupts.CPU52.RES:Rescheduling_interrupts 1544 -31.8% 1053 ± 29% interrupts.CPU54.NMI:Non-maskable_interrupts 1544 -31.8% 1053 ± 29% interrupts.CPU54.PMI:Performance_monitoring_interrupts 1528 ± 4% -31.1% 1052 ± 26% interrupts.CPU55.NMI:Non-maskable_interrupts 1528 ± 4% -31.1% 1052 ± 26% interrupts.CPU55.PMI:Performance_monitoring_interrupts 1575 ± 3% -35.1% 1022 ± 27% interrupts.CPU56.NMI:Non-maskable_interrupts 1575 ± 3% -35.1% 1022 ± 27% interrupts.CPU56.PMI:Performance_monitoring_interrupts 1519 ± 5% -32.9% 1019 ± 26% interrupts.CPU57.NMI:Non-maskable_interrupts 1519 ± 5% -32.9% 1019 ± 26% interrupts.CPU57.PMI:Performance_monitoring_interrupts 1552 ± 2% -34.1% 1022 ± 23% interrupts.CPU58.NMI:Non-maskable_interrupts 1552 ± 2% -34.1% 1022 ± 23% interrupts.CPU58.PMI:Performance_monitoring_interrupts 1631 ± 5% -36.5% 1036 ± 27% interrupts.CPU59.NMI:Non-maskable_interrupts 1631 ± 5% -36.5% 1036 ± 27% interrupts.CPU59.PMI:Performance_monitoring_interrupts 1011 ± 3% -8.0% 930.00 ± 5% interrupts.CPU6.RES:Rescheduling_interrupts 2339 ± 3% +10.4% 2582 interrupts.CPU60.CAL:Function_call_interrupts 1576 ± 5% -37.3% 989.00 ± 27% interrupts.CPU60.NMI:Non-maskable_interrupts 1576 ± 5% -37.3% 989.00 ± 27% interrupts.CPU60.PMI:Performance_monitoring_interrupts 1552 ± 2% -28.8% 1105 ± 29% interrupts.CPU61.NMI:Non-maskable_interrupts 1552 ± 2% -28.8% 1105 ± 29% interrupts.CPU61.PMI:Performance_monitoring_interrupts 1611 ± 4% -33.2% 1076 ± 30% interrupts.CPU62.NMI:Non-maskable_interrupts 1611 ± 4% -33.2% 1076 ± 30% interrupts.CPU62.PMI:Performance_monitoring_interrupts 1573 ± 4% -35.0% 1023 ± 26% interrupts.CPU63.NMI:Non-maskable_interrupts 1573 ± 4% -35.0% 1023 ± 26% interrupts.CPU63.PMI:Performance_monitoring_interrupts 1576 ± 2% -37.9% 978.75 ± 24% interrupts.CPU64.NMI:Non-maskable_interrupts 1576 ± 2% -37.9% 978.75 ± 24% interrupts.CPU64.PMI:Performance_monitoring_interrupts 1538 ± 4% -36.1% 982.50 ± 27% interrupts.CPU65.NMI:Non-maskable_interrupts 1538 ± 4% -36.1% 982.50 ± 27% interrupts.CPU65.PMI:Performance_monitoring_interrupts 1556 ± 9% -30.5% 1081 ± 25% interrupts.CPU66.NMI:Non-maskable_interrupts 1556 ± 9% -30.5% 1081 ± 25% interrupts.CPU66.PMI:Performance_monitoring_interrupts 1518 ± 7% -31.9% 1034 ± 29% interrupts.CPU68.NMI:Non-maskable_interrupts 1518 ± 7% -31.9% 1034 ± 29% interrupts.CPU68.PMI:Performance_monitoring_interrupts 1581 ± 6% -34.1% 1042 ± 28% interrupts.CPU69.NMI:Non-maskable_interrupts 1581 ± 6% -34.1% 1042 ± 28% interrupts.CPU69.PMI:Performance_monitoring_interrupts 1535 ± 2% -31.8% 1047 ± 31% interrupts.CPU70.NMI:Non-maskable_interrupts 1535 ± 2% -31.8% 1047 ± 31% interrupts.CPU70.PMI:Performance_monitoring_interrupts 1566 ± 3% -21.6% 1228 ± 20% interrupts.CPU71.NMI:Non-maskable_interrupts 1566 ± 3% -21.6% 1228 ± 20% interrupts.CPU71.PMI:Performance_monitoring_interrupts 109885 ± 4% -18.8% 89259 ± 12% interrupts.NMI:Non-maskable_interrupts 109885 ± 4% -18.8% 89259 ± 12% interrupts.PMI:Performance_monitoring_interrupts 0.60 ± 6% -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task 0.57 ± 8% -0.2 0.39 ± 57% perf-profile.calltrace.cycles-pp.xfs_mod_ifree.xfs_trans_unreserve_and_mod_sb.xfs_log_commit_cil.__xfs_trans_commit.xfs_create 1.14 ± 6% -0.1 1.01 perf-profile.calltrace.cycles-pp.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.97 ± 6% -0.1 0.85 ± 3% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle 0.98 ± 6% -0.1 0.86 ± 3% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry 1.00 ± 9% -0.1 0.89 perf-profile.calltrace.cycles-pp.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive 0.98 ± 6% -0.1 0.86 ± 3% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary 0.83 ± 10% -0.1 0.72 perf-profile.calltrace.cycles-pp.xfs_buf_item_unlock.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree 0.90 ± 6% -0.1 0.79 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending 1.14 ± 4% -0.1 1.04 ± 4% perf-profile.calltrace.cycles-pp.__xstat64 0.73 ± 6% -0.1 0.63 ± 3% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.77 ± 10% -0.1 0.67 ± 2% perf-profile.calltrace.cycles-pp.xfs_buf_unlock.xfs_buf_item_unlock.xfs_trans_free_items.xfs_log_commit_cil.__xfs_trans_commit 1.00 ± 5% -0.1 0.90 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__xstat64 0.99 ± 5% -0.1 0.90 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64 0.73 ± 9% -0.1 0.65 ± 2% perf-profile.calltrace.cycles-pp.up.xfs_buf_unlock.xfs_buf_item_unlock.xfs_trans_free_items.xfs_log_commit_cil 0.67 ± 10% -0.1 0.59 ± 3% perf-profile.calltrace.cycles-pp.try_to_wake_up.up.xfs_buf_unlock.xfs_buf_item_unlock.xfs_trans_free_items 0.85 ± 5% -0.1 0.78 ± 4% perf-profile.calltrace.cycles-pp.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64 0.78 ± 4% -0.1 0.72 ± 3% perf-profile.calltrace.cycles-pp.vfs_statx.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64 0.57 ± 4% -0.0 0.54 perf-profile.calltrace.cycles-pp.xfs_trans_read_buf_map.xfs_read_agi.xfs_ialloc_read_agi.xfs_dialloc.xfs_ialloc 0.80 ± 4% +0.1 0.87 ± 4% perf-profile.calltrace.cycles-pp.xfs_btree_lookup_get_block.xfs_btree_lookup.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc 0.53 +0.1 0.60 perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree 0.74 ± 4% +0.1 0.85 perf-profile.calltrace.cycles-pp.xfs_difree_finobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive 0.68 ± 5% +0.1 0.78 ± 2% perf-profile.calltrace.cycles-pp.xfs_verify_ino.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_removename 0.76 ± 6% +0.1 0.88 ± 7% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.66 ± 6% +0.1 0.79 ± 3% perf-profile.calltrace.cycles-pp.xfs_verify_ino.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_addname 1.16 ± 3% +0.1 1.30 ± 2% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree 0.73 ± 5% +0.1 0.87 ± 5% perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc 0.67 ± 8% +0.1 0.81 ± 11% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 0.79 ± 6% +0.1 0.94 ± 3% perf-profile.calltrace.cycles-pp.xfs_verify_ino.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_lookup_int 0.88 ± 6% +0.2 1.03 ± 8% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.97 ± 5% +0.2 1.14 ± 3% perf-profile.calltrace.cycles-pp.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_removename.xfs_dir_removename 1.55 ± 4% +0.2 1.72 perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive 0.95 ± 6% +0.2 1.14 perf-profile.calltrace.cycles-pp.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_addname.xfs_dir_createname 1.16 ± 3% +0.2 1.35 ± 2% perf-profile.calltrace.cycles-pp.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_lookup_int.xfs_dir2_block_removename 2.03 ± 3% +0.2 2.27 ± 3% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc 4.39 ± 3% +0.3 4.67 ± 2% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat 2.42 ± 4% +0.3 2.72 perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode 3.65 ± 3% +0.3 3.96 ± 3% perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create 2.77 ± 3% +0.3 3.08 ± 3% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create 0.44 ± 58% +0.3 0.76 ± 18% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel 0.45 ± 58% +0.3 0.77 ± 18% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64 3.44 ± 5% +0.3 3.77 perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_fs_destroy_inode.destroy_inode 0.47 ± 58% +0.3 0.81 ± 18% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64 0.47 ± 58% +0.3 0.81 ± 18% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64 0.47 ± 58% +0.3 0.81 ± 18% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64 3.63 ± 3% +0.3 3.97 ± 6% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 3.91 ± 2% +0.4 4.27 ± 5% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.42 ± 58% +1.4 1.82 perf-profile.calltrace.cycles-pp.xfs_agino_range.xfs_verify_ino.xfs_dir_ino_validate.__xfs_dir3_data_check.xfs_dir3_data_check 1.92 ± 6% -0.2 1.69 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate 1.92 ± 6% -0.2 1.68 ± 2% perf-profile.children.cycles-pp.activate_task 1.91 ± 6% -0.2 1.68 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair 1.81 ± 6% -0.2 1.59 ± 2% perf-profile.children.cycles-pp.enqueue_entity 1.48 ± 6% -0.2 1.29 ± 2% perf-profile.children.cycles-pp.__account_scheduler_latency 1.54 ± 6% -0.2 1.37 ± 2% perf-profile.children.cycles-pp.try_to_wake_up 1.22 ± 6% -0.2 1.07 ± 2% perf-profile.children.cycles-pp.stack_trace_save_tsk 1.33 ± 7% -0.1 1.19 ± 2% perf-profile.children.cycles-pp.xfs_buf_item_unlock 1.13 ± 6% -0.1 1.00 ± 3% perf-profile.children.cycles-pp.arch_stack_walk 1.16 ± 6% -0.1 1.03 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending 1.24 ± 4% -0.1 1.12 ± 5% perf-profile.children.cycles-pp.xfs_dir3_data_entsize 0.84 ± 3% -0.1 0.73 ± 2% perf-profile.children.cycles-pp.xfs_errortag_test 1.15 ± 4% -0.1 1.04 ± 4% perf-profile.children.cycles-pp.__xstat64 0.79 ± 7% -0.1 0.69 ± 3% perf-profile.children.cycles-pp.unwind_next_frame 0.71 ± 3% -0.1 0.60 perf-profile.children.cycles-pp.rwsem_wake 1.08 ± 7% -0.1 0.97 ± 3% perf-profile.children.cycles-pp.up 0.59 ± 4% -0.1 0.49 perf-profile.children.cycles-pp.wake_up_q 1.09 ± 3% -0.1 1.00 ± 3% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.76 ± 4% -0.1 0.68 ± 7% perf-profile.children.cycles-pp.xfs_dir3_data_entry_tag_p 0.74 -0.1 0.67 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.85 ± 5% -0.1 0.78 ± 4% perf-profile.children.cycles-pp.__do_sys_newstat 0.79 ± 5% -0.1 0.72 ± 3% perf-profile.children.cycles-pp.vfs_statx 0.53 ± 4% -0.1 0.47 ± 3% perf-profile.children.cycles-pp.filename_lookup 0.51 ± 3% -0.1 0.46 ± 2% perf-profile.children.cycles-pp.path_lookupat 0.61 ± 5% -0.1 0.56 ± 4% perf-profile.children.cycles-pp.schedule 0.37 ± 5% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.orc_find 0.27 ± 5% -0.0 0.23 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64 0.31 ± 5% -0.0 0.27 ± 8% perf-profile.children.cycles-pp.__orc_find 0.30 ± 4% -0.0 0.27 ± 3% perf-profile.children.cycles-pp.dequeue_task_fair 0.17 ± 12% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.xlog_grant_add_space 0.10 ± 7% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.15 ± 2% -0.0 0.12 ± 4% perf-profile.children.cycles-pp.update_curr 0.08 ± 8% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.__unwind_start 0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.xfs_dir2_isblock 0.05 ± 8% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.__next_timer_interrupt 0.06 ± 6% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.run_timer_softirq 0.05 ± 8% +0.0 0.07 ± 12% perf-profile.children.cycles-pp.menu_reflect 0.07 ± 10% +0.0 0.09 ± 8% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.15 ± 3% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.run_rebalance_domains 0.15 ± 3% +0.0 0.19 ± 10% perf-profile.children.cycles-pp.xfs_inobt_init_cursor 0.04 ± 58% +0.0 0.07 ± 11% perf-profile.children.cycles-pp.xfs_verify_agino_or_null 0.26 ± 7% +0.0 0.30 ± 4% perf-profile.children.cycles-pp.xfs_next_bit 0.14 ± 3% +0.0 0.17 ± 5% perf-profile.children.cycles-pp.update_blocked_averages 0.11 ± 6% +0.0 0.15 ± 10% perf-profile.children.cycles-pp._raw_spin_trylock 0.22 ± 4% +0.0 0.26 ± 10% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt 0.09 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.xfs_log_calc_unit_res 0.08 ± 5% +0.0 0.13 ± 6% perf-profile.children.cycles-pp.xfs_verify_fsbno 0.03 ±100% +0.0 0.07 ± 5% perf-profile.children.cycles-pp.ret_from_fork 0.03 ±100% +0.0 0.07 ± 5% perf-profile.children.cycles-pp.kthread 0.19 ± 9% +0.0 0.24 perf-profile.children.cycles-pp.rebalance_domains 0.31 ± 8% +0.0 0.35 ± 9% perf-profile.children.cycles-pp.rcu_core 0.19 ± 9% +0.1 0.25 ± 3% perf-profile.children.cycles-pp.xfs_trans_add_item 0.33 ± 7% +0.1 0.39 ± 5% perf-profile.children.cycles-pp.xfs_inode_item_format_data_fork 0.31 ± 8% +0.1 0.37 ± 6% perf-profile.children.cycles-pp.xfs_iextents_copy 0.20 ± 2% +0.1 0.26 ± 9% perf-profile.children.cycles-pp.__radix_tree_lookup 0.51 ± 2% +0.1 0.58 ± 3% perf-profile.children.cycles-pp.xfs_btree_increment 0.21 ± 14% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.xfs_trans_free 1.12 ± 2% +0.1 1.20 perf-profile.children.cycles-pp.xfs_btree_check_sblock 0.20 ± 5% +0.1 0.28 ± 6% perf-profile.children.cycles-pp.xfs_bmap_validate_extent 0.26 ± 6% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.xfs_inobt_btrec_to_irec 0.34 ± 4% +0.1 0.44 ± 3% perf-profile.children.cycles-pp.xfs_ag_block_count 0.26 ± 8% +0.1 0.35 ± 6% perf-profile.children.cycles-pp.xfs_btree_check_ptr 0.75 ± 4% +0.1 0.85 perf-profile.children.cycles-pp.xfs_difree_finobt 0.84 ± 2% +0.1 0.95 perf-profile.children.cycles-pp.__xfs_btree_check_sblock 0.81 ± 4% +0.1 0.93 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start 1.37 ± 3% +0.1 1.50 ± 3% perf-profile.children.cycles-pp.ktime_get 0.33 ± 9% +0.1 0.46 ± 4% perf-profile.children.cycles-pp.xfs_verify_agbno 0.33 ± 7% +0.1 0.46 ± 7% perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr 1.94 ± 4% +0.2 2.10 ± 2% perf-profile.children.cycles-pp.xfs_btree_lookup 0.97 ± 6% +0.2 1.13 ± 7% perf-profile.children.cycles-pp.clockevents_program_event 1.55 ± 4% +0.2 1.72 perf-profile.children.cycles-pp.xfs_difree_inobt 1.50 ± 4% +0.2 1.67 ± 3% perf-profile.children.cycles-pp.xfs_btree_lookup_get_block 0.57 ± 7% +0.2 0.82 ± 6% perf-profile.children.cycles-pp.xfs_verify_agino 0.56 ± 22% +0.3 0.81 ± 18% perf-profile.children.cycles-pp.start_kernel 2.45 ± 3% +0.3 2.71 ± 5% perf-profile.children.cycles-pp.hrtimer_interrupt 4.39 ± 3% +0.3 4.67 ± 2% perf-profile.children.cycles-pp.xfs_ialloc 0.61 ± 10% +0.3 0.91 ± 2% perf-profile.children.cycles-pp.xfs_verify_dir_ino 1.70 ± 4% +0.3 2.00 ± 2% perf-profile.children.cycles-pp.xfs_inobt_get_rec 2.42 ± 4% +0.3 2.73 perf-profile.children.cycles-pp.xfs_difree 3.65 ± 3% +0.3 3.96 ± 3% perf-profile.children.cycles-pp.xfs_dialloc 2.77 ± 3% +0.3 3.08 ± 3% perf-profile.children.cycles-pp.xfs_dialloc_ag 3.44 ± 5% +0.3 3.77 perf-profile.children.cycles-pp.xfs_ifree 3.97 ± 2% +0.4 4.32 ± 5% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 4.27 ± 2% +0.4 4.63 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt 3.41 ± 4% +0.4 3.81 ± 3% perf-profile.children.cycles-pp.xfs_check_agi_freecount 2.76 ± 5% +0.5 3.31 perf-profile.children.cycles-pp.xfs_verify_ino 3.93 ± 4% +0.7 4.68 perf-profile.children.cycles-pp.xfs_dir_ino_validate 2.48 ± 5% +0.8 3.29 ± 2% perf-profile.children.cycles-pp.xfs_agino_range 4.27 ± 6% -0.7 3.58 ± 4% perf-profile.self.cycles-pp.__xfs_dir3_data_check 0.83 ± 4% -0.1 0.72 ± 2% perf-profile.self.cycles-pp.xfs_errortag_test 0.96 ± 2% -0.1 0.87 ± 4% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 1.04 ± 5% -0.1 0.96 ± 5% perf-profile.self.cycles-pp.xfs_dir3_data_entsize 0.62 ± 5% -0.1 0.55 ± 8% perf-profile.self.cycles-pp.xfs_dir3_data_entry_tag_p 0.58 -0.1 0.51 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.95 ± 4% -0.1 0.90 perf-profile.self.cycles-pp.xfs_log_commit_cil 0.24 ± 7% -0.0 0.20 ± 9% perf-profile.self.cycles-pp.xfs_buf_get_map 0.43 ± 3% -0.0 0.39 perf-profile.self.cycles-pp.xfs_perag_get 0.31 ± 5% -0.0 0.27 ± 8% perf-profile.self.cycles-pp.__orc_find 0.23 ± 7% -0.0 0.20 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64 0.33 ± 3% -0.0 0.30 ± 3% perf-profile.self.cycles-pp.xfs_buf_item_init 0.17 ± 12% -0.0 0.14 ± 5% perf-profile.self.cycles-pp.xlog_grant_add_space 0.16 ± 5% -0.0 0.14 ± 3% perf-profile.self.cycles-pp.rwsem_down_write_failed 0.08 ± 15% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.stack_trace_save_tsk 0.10 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.xfs_btree_read_buf_block 0.06 ± 11% +0.0 0.08 ± 13% perf-profile.self.cycles-pp.update_blocked_averages 0.07 ± 11% +0.0 0.10 ± 10% perf-profile.self.cycles-pp.xfs_btree_ptr_to_daddr 0.11 ± 6% +0.0 0.15 ± 10% perf-profile.self.cycles-pp._raw_spin_trylock 0.09 ± 4% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.xfs_log_calc_unit_res 0.01 ±173% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.run_timer_softirq 0.06 ± 14% +0.0 0.10 ± 12% perf-profile.self.cycles-pp.xfs_inobt_init_cursor 0.24 ± 9% +0.0 0.28 ± 5% perf-profile.self.cycles-pp.xfs_trans_alloc 0.16 ± 9% +0.0 0.21 ± 5% perf-profile.self.cycles-pp.xfs_read_agi 0.06 +0.0 0.11 ± 4% perf-profile.self.cycles-pp.xfs_verify_fsbno 0.20 ± 13% +0.1 0.27 ± 7% perf-profile.self.cycles-pp.xfs_trans_free 0.18 ± 7% +0.1 0.25 ± 3% perf-profile.self.cycles-pp.xfs_trans_add_item 0.19 ± 2% +0.1 0.26 ± 9% perf-profile.self.cycles-pp.__radix_tree_lookup 0.23 ± 9% +0.1 0.32 ± 6% perf-profile.self.cycles-pp.xfs_verify_agbno 0.32 ± 5% +0.1 0.41 ± 3% perf-profile.self.cycles-pp.xfs_ag_block_count 0.25 ± 6% +0.1 0.35 ± 4% perf-profile.self.cycles-pp.xfs_inobt_btrec_to_irec 0.52 ± 4% +0.1 0.63 ± 3% perf-profile.self.cycles-pp.__xfs_btree_check_sblock 1.17 ± 4% +0.1 1.29 ± 5% perf-profile.self.cycles-pp.ktime_get 0.58 ± 10% +0.3 0.88 ± 2% perf-profile.self.cycles-pp.xfs_verify_dir_ino 2.23 ± 5% +0.7 2.97 ± 2% perf-profile.self.cycles-pp.xfs_agino_range aim7.jobs-per-min 89000 +-+-----------------------------------------------------------------+ 88000 +-+ .+.. .+.+.. .+. | |.+..+.+.+.+..+.+.+ +.+ + + | 87000 +-+ + | 86000 +-+ + + | | +.+. + | 85000 +-+ + | 84000 +-+ | 83000 +-+ | | | 82000 +-+ | 81000 +-O O O O O O O O O | O O O O O O O O O O O O O O O | 80000 +-+ O O O O O O O 79000 +-+-----------------------------------------------------------------+ aim7.time.elapsed_time 230 +-+-------------------------------------------------------------------+ | | 225 +-+ O O O O O O O O O O O O O O O O O O O O O O O O O | | O O O O O O | 220 +-+ | | | 215 +-+ | | .+.. | 210 +-+ +.+ | | .. + | |. .+.+.+..+. .+..+. .+..+. .+. .+ | 205 +-+. + + +.+. + | | | 200 +-+-------------------------------------------------------------------+ aim7.time.elapsed_time.max 230 +-+-------------------------------------------------------------------+ | | 225 +-+ O O O O O O O O O O O O O O O O O O O O O O O O O | | O O O O O O | 220 +-+ | | | 215 +-+ | | .+.. | 210 +-+ +.+ | | .. + | |. .+.+.+..+. .+..+. .+..+. .+. .+ | 205 +-+. + + +.+. + | | | 200 +-+-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

11 months

1
0
0 / 0

Re: [LKP] [SUNRPC] 0472e47660: fsmark.app_overhead 16.0% regression

by Xing Zhengjun

On 5/31/2019 3:10 AM, Trond Myklebust wrote: > On Thu, 2019-05-30 at 15:20 +0800, Xing Zhengjun wrote: >> >> On 5/30/2019 10:00 AM, Trond Myklebust wrote: >>> Hi Xing, >>> >>> On Thu, 2019-05-30 at 09:35 +0800, Xing Zhengjun wrote: >>>> Hi Trond, >>>> >>>> On 5/20/2019 1:54 PM, kernel test robot wrote: >>>>> Greeting, >>>>> >>>>> FYI, we noticed a 16.0% improvement of fsmark.app_overhead due >>>>> to >>>>> commit: >>>>> >>>>> >>>>> commit: 0472e476604998c127f3c80d291113e77c5676ac ("SUNRPC: >>>>> Convert >>>>> socket page send code to use iov_iter()") >>>>> https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git >>>>> master >>>>> >>>>> in testcase: fsmark >>>>> on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ >>>>> 3.00GHz with 384G memory >>>>> with following parameters: >>>>> >>>>> iterations: 1x >>>>> nr_threads: 64t >>>>> disk: 1BRD_48G >>>>> fs: xfs >>>>> fs2: nfsv4 >>>>> filesize: 4M >>>>> test_size: 40G >>>>> sync_method: fsyncBeforeClose >>>>> cpufreq_governor: performance >>>>> >>>>> test-description: The fsmark is a file system benchmark to test >>>>> synchronous write workloads, for example, mail servers >>>>> workload. >>>>> test-url: https://sourceforge.net/projects/fsmark/ >>>>> >>>>> >>>>> >>>>> Details are as below: >>>>> ------------------------------------------------------------- >>>>> ---- >>>>> ---------------------------------> >>>>> >>>>> >>>>> To reproduce: >>>>> >>>>> git clone https://github.com/intel/lkp-tests.git >>>>> cd lkp-tests >>>>> bin/lkp install job.yaml # job file is attached in >>>>> this >>>>> email >>>>> bin/lkp run job.yaml >>>>> >>>>> =============================================================== >>>>> ==== >>>>> ====================== >>>>> compiler/cpufreq_governor/disk/filesize/fs2/fs/iterations/kconf >>>>> ig/n >>>>> r_threads/rootfs/sync_method/tbox_group/test_size/testcase: >>>>> gcc-7/performance/1BRD_48G/4M/nfsv4/xfs/1x/x86_64-rhel- >>>>> 7.6/64t/debian-x86_64-2018-04-03.cgz/fsyncBeforeClose/lkp-ivb- >>>>> ep01/40G/fsmark >>>>> >>>>> commit: >>>>> e791f8e938 ("SUNRPC: Convert xs_send_kvec() to use >>>>> iov_iter_kvec()") >>>>> 0472e47660 ("SUNRPC: Convert socket page send code to use >>>>> iov_iter()") >>>>> >>>>> e791f8e9380d945e 0472e476604998c127f3c80d291 >>>>> ---------------- --------------------------- >>>>> fail:runs %reproduction fail:runs >>>>> | | | >>>>> :4 50% 2:4 dmesg.WARNING:a >>>>> t#for >>>>> _ip_interrupt_entry/0x >>>>> %stddev %change %stddev >>>>> \ | \ >>>>> 15118573 >>>>> ± 2% +16.0% 17538083 fsmark.app_overhead >>>>> 510.93 - >>>>> 22.7% 395.12 fsmark.files_per_sec >>>>> 24.90 +22.8% 30.57 fsmark.time.ela >>>>> psed_ >>>>> time >>>>> 24.90 +22.8% 30.57 fsmark.time.ela >>>>> psed_ >>>>> time.max >>>>> 288.00 ± 2% - >>>>> 27.8% 208.00 fsmark.time.percent_of_cpu_this_job_got >>>>> 70.03 ± 2% - >>>>> 11.3% 62.14 fsmark.time.system_time >>>>> >>>> >>>> Do you have time to take a look at this regression? >>> >>> From your stats, it looks to me as if the problem is increased >>> NUMA >>> overhead. Pretty much everything else appears to be the same or >>> actually performing better than previously. Am I interpreting that >>> correctly? >> The real regression is the throughput(fsmark.files_per_sec) is >> decreased >> by 22.7%. > > Understood, but I'm trying to make sense of why. I'm not able to > reproduce this, so I have to rely on your performance stats to > understand where the 22.7% regression is coming from. As far as I can > see, the only numbers in the stats you published that are showing a > performance regression (other than the fsmark number itself), are the > NUMA numbers. Is that a correct interpretation? > We re-test the case yesterday, the test result almost is the same. we will do more test and also check the test case itself, if you need more information, please let me know, thanks. >>> If my interpretation above is correct, then I'm not seeing where >>> this >>> patch would be introducing new NUMA regressions. It is just >>> converting >>> from using one method of doing socket I/O to another. Could it >>> perhaps >>> be a memory artefact due to your running the NFS client and server >>> on >>> the same machine? >>> >>> Apologies for pushing back a little, but I just don't have the >>> hardware available to test NUMA configurations, so I'm relying on >>> external testing for the above kind of scenario. >>> >> Thanks for looking at this. If you need more information, please let >> me >> know. >>> Thanks >>> Trond >>> -- Zhengjun Xing

11 months

1
1
0 / 0

2020

2019

2018

2017

2016

2015

2014

2013

LKP July 2019