[btrfs] 6e6bf23ae8: fxmark.hdd_btrfs_MWUL_1_directio.works/sec 104.3% improvement
by kernel test robot
Greeting,
FYI, we noticed a 104.3% improvement of fxmark.hdd_btrfs_MWUL_1_directio.works/sec due to commit:
commit: 6e6bf23ae8f4d52636986ed160250f59781abae8 ("btrfs: reserve extra space during evict")
https://github.com/kdave/btrfs-devel.git misc-next
in testcase: fxmark
on test machine: 48 threads Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz with 64G memory
with following parameters:
disk: 1HDD
media: hdd
test: MWUL
fstype: btrfs
directio: directio
cpufreq_governor: performance
ucode: 0x42d
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/directio/disk/fstype/kconfig/media/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/directio/1HDD/btrfs/x86_64-rhel-7.2/hdd/debian-x86_64-2018-04-03.cgz/ivb44/MWUL/fxmark/0x42d
commit:
31eff64dbe ("btrfs: be more explicit about allowed flush states")
6e6bf23ae8 ("btrfs: reserve extra space during evict")
31eff64dbe082abd 6e6bf23ae8f4d52636986ed1602
---------------- ---------------------------
%stddev %change %stddev
\ | \
7.95 ± 7% -60.0% 3.18 ± 2% fxmark.hdd_btrfs_MWUL_1_directio.iowait_sec
78.70 -18.2% 64.40 fxmark.hdd_btrfs_MWUL_1_directio.iowait_util
10.18 ± 6% -50.9% 5.00 fxmark.hdd_btrfs_MWUL_1_directio.real_sec
10.12 ± 6% -51.2% 4.94 fxmark.hdd_btrfs_MWUL_1_directio.secs
0.07 ± 17% -73.1% 0.02 ± 24% fxmark.hdd_btrfs_MWUL_1_directio.softirq_sec
0.64 ± 11% -44.5% 0.36 ± 25% fxmark.hdd_btrfs_MWUL_1_directio.softirq_util
1.93 ± 2% -15.9% 1.62 fxmark.hdd_btrfs_MWUL_1_directio.sys_sec
19.20 ± 3% +71.5% 32.92 fxmark.hdd_btrfs_MWUL_1_directio.sys_util
0.15 ± 7% -22.0% 0.12 ± 9% fxmark.hdd_btrfs_MWUL_1_directio.user_sec
1.46 ± 5% +59.2% 2.33 ± 9% fxmark.hdd_btrfs_MWUL_1_directio.user_util
4060 ± 6% +104.3% 8296 fxmark.hdd_btrfs_MWUL_1_directio.works/sec
1212624 -18.7% 985968 ± 3% fxmark.time.file_system_outputs
62596 ± 5% +68.8% 105664 fxmark.time.involuntary_context_switches
81266 ± 99% -68.1% 25888 cpuidle.POLL.time
55908 ± 40% -32.1% 37947 ± 4% cpuidle.POLL.usage
266296 ± 4% -15.1% 226003 ± 8% numa-vmstat.node0.nr_dirtied
263547 ± 4% -15.3% 223215 ± 8% numa-vmstat.node0.nr_written
64.16 -7.4% 59.43 ± 3% iostat.cpu.iowait
113.57 -11.1% 101.01 ± 9% iostat.sda.w/s
22331 -13.9% 19216 ± 10% iostat.sda.wkB/s
2.08 ± 16% -15.7% 1.75 ± 7% sched_debug.cpu.clock.stddev
2.08 ± 16% -15.7% 1.75 ± 7% sched_debug.cpu.clock_task.stddev
6.70 ± 6% -15.2% 5.68 ± 11% sched_debug.cpu.cpu_load[2].avg
67.50 -8.1% 62.00 ± 3% vmstat.cpu.wa
42277 ± 2% -15.2% 35846 ± 9% vmstat.io.bo
8002 ± 2% +23.0% 9846 ± 8% vmstat.system.cs
603227 -18.9% 489496 ± 5% proc-vmstat.nr_dirtied
594227 -19.1% 480567 ± 5% proc-vmstat.nr_written
46585 -7.3% 43190 proc-vmstat.pgactivate
3216570 -19.2% 2598853 ± 5% proc-vmstat.pgpgout
7769 ± 2% +24.0% 9633 ± 9% perf-stat.i.context-switches
4437 ± 31% +48.5% 6590 ± 11% perf-stat.i.iTLB-loads
8977 ± 3% +10.1% 9887 ± 7% perf-stat.i.msec
7670 ± 3% +23.8% 9499 ± 9% perf-stat.ps.context-switches
4400 ± 31% +48.2% 6523 ± 11% perf-stat.ps.iTLB-loads
8878 ± 3% +10.1% 9775 ± 7% perf-stat.ps.msec
3979 ± 3% +13.5% 4518 ± 3% slabinfo.anon_vma_chain.active_objs
4010 ± 3% -12.4% 3512 ± 7% slabinfo.btrfs_delayed_ref_head.active_objs
4125 ± 3% -12.8% 3596 ± 7% slabinfo.btrfs_delayed_ref_head.num_objs
537.00 ± 9% +15.0% 617.75 ± 9% slabinfo.pde_opener.active_objs
1697 ± 2% +11.2% 1887 ± 2% slabinfo.pde_opener.num_objs
327.50 ± 12% +44.0% 471.75 ± 10% slabinfo.xfrm_dst_cache.active_objs
12871 ± 3% -14.3% 11025 ± 2% interrupts.53:IR-PCI-MSI.2097152-edge.isci-msix
6352 ± 2% -19.4% 5117 ± 2% interrupts.CPU0.53:IR-PCI-MSI.2097152-edge.isci-msix
21339 ± 18% +25.0% 26665 ± 6% interrupts.CPU0.RES:Rescheduling_interrupts
4469 ± 16% +23.8% 5534 ± 4% interrupts.CPU12.LOC:Local_timer_interrupts
4880 ± 18% +22.2% 5962 ± 4% interrupts.CPU13.LOC:Local_timer_interrupts
2.50 ± 44% +3490.0% 89.75 ±149% interrupts.CPU13.RES:Rescheduling_interrupts
5369 ± 19% +21.0% 6499 ± 3% interrupts.CPU14.LOC:Local_timer_interrupts
5608 ± 21% +25.6% 7042 ± 9% interrupts.CPU15.LOC:Local_timer_interrupts
6052 ± 19% +37.4% 8312 ± 7% interrupts.CPU17.LOC:Local_timer_interrupts
6724 ± 18% +34.3% 9030 ± 7% interrupts.CPU18.LOC:Local_timer_interrupts
7343 ± 12% +32.7% 9742 ± 6% interrupts.CPU19.LOC:Local_timer_interrupts
7425 ± 16% +39.8% 10380 ± 6% interrupts.CPU20.LOC:Local_timer_interrupts
7470 ± 21% +47.0% 10981 ± 8% interrupts.CPU21.LOC:Local_timer_interrupts
7911 ± 19% +43.4% 11343 ± 8% interrupts.CPU22.LOC:Local_timer_interrupts
8013 ± 18% +46.2% 11714 ± 8% interrupts.CPU23.LOC:Local_timer_interrupts
9346 ± 11% +27.4% 11908 ± 11% interrupts.CPU24.LOC:Local_timer_interrupts
8893 ± 17% +34.6% 11966 ± 9% interrupts.CPU25.LOC:Local_timer_interrupts
8422 ± 25% +42.6% 12013 ± 10% interrupts.CPU30.LOC:Local_timer_interrupts
8487 ± 25% +39.4% 11828 ± 9% interrupts.CPU31.LOC:Local_timer_interrupts
9974 ± 13% +25.7% 12537 ± 10% interrupts.CPU36.LOC:Local_timer_interrupts
9983 ± 21% +40.5% 14026 ± 7% interrupts.CPU38.LOC:Local_timer_interrupts
10212 ± 18% +41.7% 14467 ± 7% interrupts.CPU39.LOC:Local_timer_interrupts
10403 ± 24% +41.4% 14708 ± 8% interrupts.CPU40.LOC:Local_timer_interrupts
11618 ± 19% +31.7% 15305 ± 7% interrupts.CPU41.LOC:Local_timer_interrupts
10834 ± 26% +48.4% 16077 ± 8% interrupts.CPU42.LOC:Local_timer_interrupts
11748 ± 21% +39.4% 16379 ± 8% interrupts.CPU43.LOC:Local_timer_interrupts
11361 ± 28% +45.7% 16555 ± 8% interrupts.CPU44.LOC:Local_timer_interrupts
12539 ± 21% +36.4% 17100 ± 9% interrupts.CPU45.LOC:Local_timer_interrupts
11879 ± 28% +45.5% 17285 ± 8% interrupts.CPU46.LOC:Local_timer_interrupts
11786 ± 28% +48.1% 17458 ± 9% interrupts.CPU47.LOC:Local_timer_interrupts
4109 ± 20% +24.7% 5125 ± 3% interrupts.CPU5.LOC:Local_timer_interrupts
4056 ± 16% +26.2% 5120 ± 2% interrupts.CPU9.LOC:Local_timer_interrupts
40631 ± 5% +17.7% 47828 ± 2% interrupts.RES:Rescheduling_interrupts
fxmark.hdd_btrfs_MWUL_1_directio.works_sec
18000 +-+-----------------------------------------------------------------+
OO O OO OO OOO O |
16000 +-+ OO O O O |
14000 +-+O |
| |
12000 +-+ |
10000 +-+ |
| OOO OOO OO O |
8000 +-+ OO OOO |
6000 +-+ |
| |
4000 +-+ ++.++++.+|
2000 +-+ : |
|+.++++.+++.++++.+++.++++.+++.++++.++++.+++.++++.+++.++++.+ |
0 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 6 months
- 1
- 0
[route] 3be5fb4873: INFO:rcu_sched_self-detected_stall_on_CPU
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 3be5fb4873d0c2b007a33813aa3be487aa478199 ("[PATCH net] route: Avoid crash from dereferencing NULL rt->from")
url: https://github.com/0day-ci/linux/commits/Jonathan-Lemon/route-Avoid-crash...
in testcase: rcutorture
with following parameters:
runtime: 300s
test: default
torture_type: tasks
test-description: rcutorture is rcutorture kernel module load/unload test.
test-url: https://www.kernel.org/doc/Documentation/RCU/torture.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------+------------+------------+
| | 7324880182 | 3be5fb4873 |
+-------------------------------------------------+------------+------------+
| boot_successes | 6 | 6 |
| boot_failures | 0 | 10 |
| BUG:kernel_reboot-without-warning_in_test_stage | 0 | 4 |
| INFO:rcu_sched_self-detected_stall_on_CPU | 0 | 3 |
| RIP:e1000_xmit_frame | 0 | 3 |
| INFO:rcu_tasks_detected_stalls_on_tasks | 0 | 1 |
| RIP:rcu_gp_kthread | 0 | 1 |
| INFO:rcu_sched_detected_stalls_on_CPUs/tasks | 0 | 3 |
| RIP:default_idle | 0 | 1 |
| RIP:_raw_spin_unlock_irqrestore | 0 | 1 |
+-------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 433.373241] rcu: INFO: rcu_sched self-detected stall on CPU
[ 433.373241] rcu: 1-...!: (1 ticks this GP) idle=396/1/0x4000000000000002 softirq=24930/24930 fqs=0
[ 1303.421117] rcu: (t=217466 jiffies g=59689 q=10)
[ 1303.452767] rcu: rcu_sched kthread starved for 217466 jiffies! g59689 f0x0 RCU_GP_INIT(4) ->state=0x0 ->cpu=1
[ 1303.510249] rcu: RCU grace-period kthread stack dump:
[ 1303.510249] rcu_sched R running task 0 10 2 0x80000008
[ 1303.510249] Call Trace:
[ 1303.510249] <IRQ>
[ 1303.510249] sched_show_task+0x110/0x142
[ 1303.510249] rcu_check_gp_kthread_starvation+0x9f/0xab
[ 1303.801293] rcu_sched_clock_irq+0x268/0x5ab
[ 1303.801293] ? __accumulate_pelt_segments+0x29/0x3a
[ 1303.801293] ? tick_sched_handle+0x3e/0x3e
[ 1303.801293] update_process_times+0x28/0x4a
[ 1303.801293] tick_sched_handle+0x34/0x3e
[ 1303.801293] tick_sched_timer+0x3b/0x69
[ 1303.801293] __hrtimer_run_queues+0x16e/0x22c
[ 1303.801293] ? kvm_clock_read+0x14/0x1c
[ 1303.801293] hrtimer_interrupt+0xf9/0x212
[ 1303.801293] smp_apic_timer_interrupt+0xd0/0x13a
[ 1303.801293] apic_timer_interrupt+0xf/0x20
[ 1303.801293] </IRQ>
[ 1303.801293] RIP: 0010:rcu_gp_kthread+0x343/0x875
[ 1304.241071] Code: b0 43 01 ff c8 39 c2 75 11 48 8b 53 08 4c 89 e1 48 89 de e8 8b ed ff ff eb 10 c6 03 00 e8 4f 33 05 00 fb 65 ff 0d 50 0d e7 7e <65> 48 8b 04 25 80 4d 01 00 8a 90 f0 02 00 00 84 d2 74 07 c6 80 f0
[ 1304.241071] RSP: 0000:ffffc90000ca3ed0 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
[ 1304.241071] RAX: 0000000080000002 RBX: ffffffff8246ae00 RCX: 3fffffffffff122d
[ 1304.241071] RDX: 0000000080000002 RSI: 0000000000000000 RDI: ffffffff811a3fb8
[ 1304.241071] RBP: 0000000000022200 R08: 0000000080000001 R09: 0000000000000000
[ 1304.241071] R10: ffffc90001113dd0 R11: ffffc90001113b20 R12: 0000000000000246
[ 1304.241071] R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff811a3c7d
[ 1304.241071] ? rcu_fwd_progress_check+0x115/0x115
[ 1304.241071] ? rcu_gp_kthread+0x33b/0x875
[ 1304.241071] kthread+0x121/0x129
[ 1304.241071] ? kthread_park+0x76/0x76
[ 1304.241071] ret_from_fork+0x3a/0x50
[ 1304.241071] NMI backtrace for cpu 1
[ 1304.241071] CPU: 1 PID: 10 Comm: rcu_sched Not tainted 5.1.0-rc4-00123-g3be5fb4 #2
[ 1304.241071] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 1304.241071] Call Trace:
[ 1304.241071] <IRQ>
[ 1304.241071] dump_stack+0x67/0x8e
[ 1304.241071] nmi_cpu_backtrace+0x71/0x83
[ 1304.241071] ? lapic_can_unplug_cpu+0x93/0x93
[ 1306.330098] nmi_trigger_cpumask_backtrace+0x5e/0xe3
[ 1306.345384] rcu_dump_cpu_stacks+0x91/0xb9
[ 1306.345384] rcu_sched_clock_irq+0x26d/0x5ab
[ 1306.345384] ? __accumulate_pelt_segments+0x29/0x3a
[ 1306.345384] ? tick_sched_handle+0x3e/0x3e
[ 1306.345384] update_process_times+0x28/0x4a
[ 1306.345384] tick_sched_handle+0x34/0x3e
[ 1306.345384] tick_sched_timer+0x3b/0x69
[ 1306.345384] __hrtimer_run_queues+0x16e/0x22c
[ 1306.345384] ? kvm_clock_read+0x14/0x1c
[ 1306.345384] hrtimer_interrupt+0xf9/0x212
[ 1306.345384] smp_apic_timer_interrupt+0xd0/0x13a
[ 1306.345384] apic_timer_interrupt+0xf/0x20
[ 1306.345384] </IRQ>
[ 1306.345384] RIP: 0010:rcu_gp_kthread+0x343/0x875
[ 1306.345384] Code: b0 43 01 ff c8 39 c2 75 11 48 8b 53 08 4c 89 e1 48 89 de e8 8b ed ff ff eb 10 c6 03 00 e8 4f 33 05 00 fb 65 ff 0d 50 0d e7 7e <65> 48 8b 04 25 80 4d 01 00 8a 90 f0 02 00 00 84 d2 74 07 c6 80 f0
[ 1306.345384] RSP: 0000:ffffc90000ca3ed0 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
[ 1306.345384] RAX: 0000000080000002 RBX: ffffffff8246ae00 RCX: 3fffffffffff122d
[ 1306.345384] RDX: 0000000080000002 RSI: 0000000000000000 RDI: ffffffff811a3fb8
[ 1306.345384] RBP: 0000000000022200 R08: 0000000080000001 R09: 0000000000000000
[ 1306.345384] R10: ffffc90001113dd0 R11: ffffc90001113b20 R12: 0000000000000246
[ 1306.345384] R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff811a3c7d
[ 1306.345384] ? rcu_fwd_progress_check+0x115/0x115
[ 1306.345384] ? rcu_gp_kthread+0x33b/0x875
[ 1306.345384] kthread+0x121/0x129
[ 1306.345384] ? kthread_park+0x76/0x76
[ 1306.345384] ret_from_fork+0x3a/0x50
Starting Cleanup of Temporary Directories...
[ 1310.495777] tasks-torture:--- Start of test: nreaders=1 nfakewriters=4 stat_interval=60 verbose=1 test_no_idle_hz=1 shuffle_interval=3 stutter=5 irqreader=1 fqs_duration=0 fqs_holdoff=0 fqs_stutter=3 test_boost=1/0 test_boost_interval=7 test_boost_duration=4 shutdown_secs=0 stall_cpu=0 stall_cpu_holdoff=10 stall_cpu_irqsoff=0 n_barrier_cbs=0 onoff_interval=0 onoff_holdoff=0
[ 1310.835122] tasks-torture: Creating rcu_torture_writer task
[ 1312.087846] tasks-torture: Creating rcu_torture_fakewriter task
[ 1312.232201] tasks-torture: rcu_torture_writer task started
[ 1312.271956] rcu_torture_writer: Testing expedited GPs.
[ 1312.391586] rcu_torture_writer: Testing asynchronous GPs.
[
[ 1312.501542] rcu_torture_writer: Testing normal GPs.
[ 1313.218748] tasks-torture: rcu_torture_fakewriter task started
[ 1313.474662] tasks-torture: Creating rcu_torture_fakewriter task
[ 1313.597156] tasks-torture: rcu_torture_fakewriter task started
[ 1314.092357] tasks-torture: Creating rcu_torture_fakewriter task
[ 1314.331123] tasks-torture: rcu_torture_fakewriter task started
Starting watchdog daemon...
[ 1314.815156] tasks-torture: Creating rcu_torture_reader task
[ 1314.817143] tasks-torture: rcu_torture_fakewriter task started
[ 1315.117809] tasks-torture: Creating rcu_torture_stats task
[ 1315.290265] tasks-torture: rcu_torture_reader task started
[ 1315.472111] tasks-torture: Creating torture_shuffle task
[ 1315.607589] tasks-torture: rcu_torture_stats task started
[ 1316.004729] tasks-torture: Creating torture_stutter task
[ 1316.109365] tasks-torture: torture_shuffle task started
[ 1316.349951] tasks-torture: torture_stutter task started
Starting Update UTMP about System Runlevel Changes...
[ 1338.941389] random: crng init done
[ 1338.941389] random: 2 urandom warning(s) missed due to ratelimiting
[ 1377.751185] tasks-torture: rtc: 000000003d6fec49 ver: 1 tfle: 0 rta: 2 rtaf: 0 rtf: 0 rtmbe: 0 rtbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 156 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=250) barrier: 0/0:0
[ 1377.812382] tasks-torture: Reader Pipe: 299081 0 0 0 0 0 0 0 0 0 0
[ 1377.836340] tasks-torture: Reader Batch: 299081 0 0 0 0 0 0 0 0 0 0
To reproduce:
# build kernel
cd linux
cp config-5.1.0-rc4-00123-g3be5fb4 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
1 year, 6 months
- 1
- 0
[locking/rwsem] 21471c203e: WARNING:at_kernel/locking/rwsem.c:#downgrade_write
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 21471c203eb7f02124c15127f806f1b145e8d663 ("locking/rwsem: Disable reader optimistic spinning adaptively")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git WIP.locking/core
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------+------------+------------+
| | ce474d0a73 | 21471c203e |
+----------------------------------------------------+------------+------------+
| boot_successes | 35 | 19 |
| boot_failures | 1 | 17 |
| IP-Config:Auto-configuration_of_network_failed | 1 | |
| WARNING:at_kernel/locking/rwsem.c:#downgrade_write | 0 | 16 |
| RIP:downgrade_write | 0 | 16 |
| WARNING:at_net/sched/sch_generic.c:#dev_watchdog | 0 | 1 |
| RIP:dev_watchdog | 0 | 1 |
+----------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 184.736582] WARNING: CPU: 0 PID: 260 at kernel/locking/rwsem.c:1453 downgrade_write+0x161/0x2b9
[ 184.739158] CPU: 0 PID: 260 Comm: in:imuxsock Not tainted 5.1.0-rc4-00088-g21471c2 #1
[ 184.741175] RIP: 0010:downgrade_write+0x161/0x2b9
[ 184.742351] Code: 00 48 8b 13 4c 8b 4c 24 08 48 89 e9 4c 8b 04 24 48 c7 c6 80 a2 c6 82 48 c7 c7 20 a1 c6 82 e8 7d 62 f5 ff 48 ff 05 a7 ba cd 04 <0f> 0b 48 ff 05 a6 ba cd 04 e9 0a 01 00 00 48 c7 c7 98 e5 ac 83 48
[ 184.747015] RSP: 0000:ffff88804fd4fd50 EFLAGS: 00010202
[ 184.748361] RAX: 0000000000000000 RBX: ffff8880557e32b8 RCX: 0000000000000000
[ 184.750147] RDX: 000000835cf46100 RSI: ffffffff811e19a8 RDI: ffffed1009fa9f9f
[ 184.752181] RBP: ffff88805cf46102 R08: ffffed100d07ccd9 R09: 0000000000000007
[ 184.754022] R10: ffffed100aafc658 R11: ffffed100d07ccd8 R12: 1ffff11009fa9fac
[ 184.755826] R13: ffff8880557e3318 R14: ffff8880557e32c0 R15: ffff88804fe06aa8
[ 184.757646] FS: 00007fdfee986700(0000) GS:ffff888068200000(0000) knlGS:0000000000000000
[ 184.759599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 184.761147] CR2: 00007f81d536b6e0 CR3: 000000004f1e5000 CR4: 00000000000006f0
[ 184.762891] Call Trace:
[ 184.763579] ? up_write+0x1eb/0x1eb
[ 184.764599] ? vma_compute_subtree_gap+0x139/0x141
[ 184.765784] ? __vma_rb_erase+0x4c3/0x534
[ 184.766955] ? vma_compute_subtree_gap+0x139/0x141
[ 184.768170] __do_munmap+0x612/0x77b
[ 184.769080] __vm_munmap+0xd9/0x149
[ 184.770009] ? __do_munmap+0x77b/0x77b
[ 184.771061] ? mark_held_locks+0x92/0xa8
[ 184.772061] __se_sys_munmap+0x35/0x41
[ 184.773037] __x64_sys_munmap+0x33/0x3d
[ 184.774136] do_syscall_64+0xb2/0x3bd
[ 184.775128] entry_SYSCALL_64_after_hwframe+0x49/0xbe
[ 184.776364] RIP: 0033:0x7fdfefcd94a7
[ 184.777377] Code: c7 c0 ff ff ff ff eb 8d 48 8b 15 ec 49 2b 00 f7 d8 64 89 02 e9 5b ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c1 49 2b 00 f7 d8 64 89 01 48
[ 184.781760] RSP: 002b:00007fdfee985c78 EFLAGS: 00000206 ORIG_RAX: 000000000000000b
[ 184.783625] RAX: ffffffffffffffda RBX: 00007fdfe8000000 RCX: 00007fdfefcd94a7
[ 184.785364] RDX: 0000000000000000 RSI: 0000000001e7b000 RDI: 00007fdfe6185000
[ 184.787183] RBP: 0000000000023000 R08: ffffffffffffffff R09: 0000000000000000
[ 184.788862] R10: 0000000000004022 R11: 0000000000000206 R12: 0000000001e7b000
[ 184.790694] R13: 00007fffab1ef6cf R14: 0000000000000000 R15: 00007fdff1213040
[ 184.792370] irq event stamp: 132
[ 184.793270] hardirqs last enabled at (131): [<ffffffff811deaa6>] console_unlock+0xa36/0xa9c
[ 184.795376] hardirqs last disabled at (132): [<ffffffff810023f1>] trace_hardirqs_off_thunk+0x1a/0x1c
[ 184.797645] softirqs last enabled at (128): [<ffffffff82a00735>] __do_softirq+0x735/0x7a7
[ 184.799642] softirqs last disabled at (123): [<ffffffff8111bdc8>] irq_exit+0xba/0xff
[ 184.801532] ---[ end trace 230952bfbdc12d4d ]---
To reproduce:
# build kernel
cd linux
cp config-5.1.0-rc4-00088-g21471c2 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
eywa
1 year, 6 months
- 1
- 0
[ALSA] feb689025f: WARNING:possible_recursive_locking_detected
by kernel test robot
FYI, we noticed the following commit (built with gcc-5):
commit: feb689025fbb6f0aa6297d3ddf97de945ea4ad32 ("ALSA: seq: Protect in-kernel ioctl calls with mutex")
https://git.kernel.org/cgit/linux/kernel/git/tiwai/sound.git for-next
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------+------------+------------+
| | f823b8a755 | feb689025f |
+-------------------------------------------------+------------+------------+
| boot_successes | 0 | 0 |
| boot_failures | 8 | 4 |
| BUG:kernel_reboot-without-warning_in_test_stage | 8 | |
| WARNING:possible_recursive_locking_detected | 0 | 4 |
+-------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 17.585148] WARNING: possible recursive locking detected
[ 17.585148] 5.1.0-rc1-00023-gfeb6890 #1 Not tainted
[ 17.585148] --------------------------------------------
[ 17.585148] modprobe/226 is trying to acquire lock:
[ 17.585148] (____ptrval____) (&client->ioctl_mutex){+.+.}, at: snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148]
[ 17.585148] but task is already holding lock:
[ 17.585148] (____ptrval____) (&client->ioctl_mutex){+.+.}, at: snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148]
[ 17.585148] other info that might help us debug this:
[ 17.585148] Possible unsafe locking scenario:
[ 17.585148]
[ 17.585148] CPU0
[ 17.585148] ----
[ 17.585148] lock(&client->ioctl_mutex);
[ 17.585148] lock(&client->ioctl_mutex);
[ 17.585148]
[ 17.585148] *** DEADLOCK ***
[ 17.585148]
[ 17.585148] May be due to missing lock nesting notation
[ 17.585148]
[ 17.585148] 2 locks held by modprobe/226:
[ 17.585148] #0: (____ptrval____) (&client->ioctl_mutex){+.+.}, at: snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] #1: (____ptrval____) (&grp->list_mutex/1){.+.+}, at: snd_seq_deliver_event+0x1f3/0x260
[ 17.585148]
[ 17.585148] stack backtrace:
[ 17.585148] CPU: 0 PID: 226 Comm: modprobe Not tainted 5.1.0-rc1-00023-gfeb6890 #1
[ 17.585148] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 17.585148] Call Trace:
[ 17.585148] __lock_acquire+0x2de/0x1120
[ 17.585148] lock_acquire+0xae/0x150
[ 17.585148] ? snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] ? snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] __mutex_lock+0x73/0x590
[ 17.585148] ? snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] ? snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] ? snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] snd_seq_kernel_client_ctl+0x71/0x90
[ 17.585148] receive_announce+0x40/0x60
[ 17.585148] receive_announce+0x35/0x40
[ 17.585148] snd_seq_deliver_single_event+0x101/0x210
[ 17.585148] snd_seq_deliver_event+0x11e/0x260
[ 17.585148] snd_seq_kernel_client_dispatch+0x5f/0x70
[ 17.585148] snd_seq_system_broadcast+0x62/0x70
[ 17.585148] snd_seq_ioctl_create_port+0x65/0x110
[ 17.585148] snd_seq_kernel_client_ctl+0x7a/0x90
[ 17.585148] create_port+0x10d/0x136 [snd_seq_dummy]
[ 17.585148] ? dummy_free+0x10/0x10 [snd_seq_dummy]
[ 17.585148] ? 0xffffffffa0000000
[ 17.585148] alsa_seq_dummy_init+0x4f/0xeca [snd_seq_dummy]
[ 17.585148] ? create_port+0x136/0x136 [snd_seq_dummy]
[ 17.585148] do_one_initcall+0x66/0x234
[ 17.585148] ? do_init_module+0x21/0x43d
[ 17.585148] ? rcu_read_lock_sched_held+0x2e/0x60
[ 17.585148] ? kmem_cache_alloc_trace+0x172/0x280
[ 17.585148] ? do_init_module+0x21/0x43d
[ 17.585148] do_init_module+0x58/0x43d
[ 17.585148] load_module+0x15cb/0x1b50
[ 17.585148] ? kernel_read+0x25/0x40
[ 17.585148] ? __do_sys_finit_module+0xa8/0xb0
[ 17.585148] __do_sys_finit_module+0xa8/0xb0
[ 17.585148] do_syscall_64+0x4b/0x4c0
[ 17.585148] entry_SYSCALL_64_after_hwframe+0x49/0xbe
[ 17.585148] RIP: 0033:0x7f52758cb229
[ 17.585148] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 3f 4c 2b 00 f7 d8 64 89 01 48
[ 17.585148] RSP: 002b:00007ffdbeb1a4a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 17.585148] RAX: ffffffffffffffda RBX: 000055620d2944d0 RCX: 00007f52758cb229
[ 17.585148] RDX: 0000000000000000 RSI: 000055620c571638 RDI: 0000000000000000
[ 17.585148] RBP: 000055620c571638 R08: 0000000000000000 R09: 000055620d293290
[ 17.585148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 17.585148] R13: 000055620d294580 R14: 0000000000040000 R15: 0000000000000000
[ 17.758439] Segment Routing with IPv6
[ 17.760350] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[ 17.763895] 9pnet: Installing 9P2000 support
[ 17.766159] start plist test
[ 17.770969] end plist test
[ 17.773352] ... APIC ID: 00000000 (0)
[ 17.774143] ... APIC VERSION: 00050014
[ 17.774143] 0000000000000000000000000000000000000000000000000000000000000000
[ 17.774143] 0000000000000000000000000000000000000000000000000000000000000000
[ 17.774143] 0000000000000000000000000000000000000000000000000000000000001000
[ 17.786873] number of MP IRQ sources: 15.
[ 17.800175] number of IO-APIC #0 registers: 24.
[ 17.802406] testing the IO APIC.......................
[ 17.804942] IO APIC #0......
[ 17.806554] .... register #00: 00000000
[ 17.808477] ....... : physical APIC id: 00
[ 17.820300] ....... : Delivery Type: 0
[ 17.822419] ....... : LTS : 0
[ 17.824383] .... register #01: 00170011
[ 17.826323] ....... : max redirection entries: 17
[ 17.828826] ....... : PRQ implemented: 0
[ 17.843383] ....... : IO APIC version: 11
[ 17.845625] .... register #02: 00000000
[ 17.847635] ....... : arbitration: 00
[ 17.849577] .... IRQ redirection table:
[ 17.851562] IOAPIC 0:
[ 17.852949] pin00, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
[ 17.858011] pin01, enabled , edge , high, V(22), IRR(0), S(0), physical, D(00), M(0)
[ 17.861853] pin02, enabled , edge , high, V(30), IRR(0), S(0), physical, D(00), M(0)
[ 17.875020] pin03, disabled, edge , high, V(00), IRR(0), S(0), physical, D(00), M(0)
To reproduce:
# build kernel
cd linux
cp config-5.1.0-rc1-00023-gfeb6890 .config
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 prepare
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 6 months
- 2
- 1
[sched] bd468e4da3: WARNING:at_kernel/sched/sched.h:#pick_next_task_fair
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: bd468e4da363438700eb784d5c16ebe8c6616c03 ("sched: Add task_struct pointer to sched_class::set_curr_task")
2019-04-18 01:50:07
in testcase: rcutorture
with following parameters:
runtime: 300s
test: cpuhotplug
torture_type: rcu
test-description: rcutorture is rcutorture kernel module load/unload test.
test-url: https://www.kernel.org/doc/Documentation/RCU/torture.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------+------------+------------+
| | c0d5cd3996 | bd468e4da3 |
+------------------------------------------------------+------------+------------+
| boot_successes | 6 | 0 |
| boot_failures | 0 | 8 |
| WARNING:at_kernel/sched/sched.h:#pick_next_task_fair | 0 | 8 |
| RIP:pick_next_task_fair | 0 | 8 |
| WARNING:at_kernel/sched/sched.h:#sched_cpu_dying | 0 | 8 |
| RIP:sched_cpu_dying | 0 | 8 |
+------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 59.132278] WARNING: CPU: 0 PID: 11 at kernel/sched/sched.h:1719 pick_next_task_fair+0x2e0/0xd70
[ 59.134942] Modules linked in: rcutorture torture crc32_pclmul bochs_drm ttm aesni_intel aes_x86_64 serio_raw drm_kms_helper drm processor stm_p_basic
[ 59.138423] CPU: 0 PID: 11 Comm: migration/0 Not tainted 5.0.0-rc7-00498-gbd468e4 #3
[ 59.140397] RIP: 0010:pick_next_task_fair+0x2e0/0xd70
[ 59.141711] Code: 4d 39 e7 0f 95 c0 31 c9 31 d2 41 89 c6 44 89 f6 e8 c5 2c 0c 00 49 63 c6 48 83 c0 02 48 83 04 c5 38 0a 99 82 01 4d 39 e7 74 02 <0f> 0b 31 c9 31 d2 44 89 f6 48 c7 c7 08 18 87 82 e8 9b 2c 0c 00 48
[ 59.146393] RSP: 0000:ffffc9000005bca8 EFLAGS: 00010006
[ 59.147714] RAX: 0000000000000003 RBX: ffff88823fbde880 RCX: 0000000000000000
[ 59.149529] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff82871838
[ 59.151309] RBP: ffffc9000005bd10 R08: 00000000e31e2fd2 R09: 0000000000000001
[ 59.153076] R10: ffffc9000005bca8 R11: 0000000000000000 R12: ffff888107dca040
[ 59.154871] R13: ffffffff82986a30 R14: 0000000000000001 R15: ffffffff82658940
[ 59.156631] FS: 0000000000000000(0000) GS:ffff88823fa00000(0000) knlGS:0000000000000000
[ 59.158678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 59.160102] CR2: 0000557e157f9ff0 CR3: 000000021aae8000 CR4: 00000000000006b0
[ 59.161891] Call Trace:
[ 59.162558] ? update_irq_load_avg+0x11a/0x2f0
[ 59.163700] sched_cpu_dying+0x26a/0x660
[ 59.164703] ? sched_cpu_starting+0x40/0x40
[ 59.165926] cpuhp_invoke_callback+0x23e/0xd70
[ 59.167052] ? do_raw_spin_unlock+0x109/0x140
[ 59.168189] take_cpu_down+0xca/0x140
[ 59.169168] multi_cpu_stop+0xf2/0x1c0
[ 59.170161] ? cpu_stop_queue_work+0xc0/0xc0
[ 59.171255] cpu_stopper_thread+0xd3/0x210
[ 59.172325] ? smpboot_thread_fn+0x28/0x3e0
[ 59.173420] smpboot_thread_fn+0x3b6/0x3e0
[ 59.174447] ? sort_range+0x20/0x20
[ 59.175377] kthread+0x1a0/0x1b0
[ 59.176213] ? kthread_stop+0x2e0/0x2e0
[ 59.177185] ret_from_fork+0x24/0x30
[ 59.178121] ---[ end trace bcb463759ec7e7ba ]---
To reproduce:
# build kernel
cd linux
cp config-5.0.0-rc7-00498-gbd468e4 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
eywa
1 year, 6 months
- 1
- 0
e00164a0f0 [ 7.566387] WARNING: CPU: 0 PID: 1 at kernel/locking/lockdep.c:1025 lockdep_register_key
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/tty.git tty-linus
commit e00164a0f000de893944981f41a568c981aca658
Author: Guoqing Jiang <gqjiang(a)suse.com>
AuthorDate: Tue Apr 9 16:16:38 2019 +0800
Commit: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org>
CommitDate: Tue Apr 16 15:24:38 2019 +0200
sc16is7xx: move label 'err_spi' to correct section
err_spi is used when SERIAL_SC16IS7XX_SPI is enabled, so make
the label only available under SERIAL_SC16IS7XX_SPI option.
Otherwise, the below warning appears.
drivers/tty/serial/sc16is7xx.c:1523:1: warning: label ‘err_spi’ defined but not used [-Wunused-label]
err_spi:
^~~~~~~
Signed-off-by: Guoqing Jiang <gqjiang(a)suse.com>
Fixes: ac0cdb3d9901 ("sc16is7xx: missing unregister/delete driver on error in sc16is7xx_init()")
Signed-off-by: Arnd Bergmann <arnd(a)arndb.de>
Signed-off-by: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org>
6b87784b53 serial: sh-sci: Fix HSCIF RX sampling point adjustment
e00164a0f0 sc16is7xx: move label 'err_spi' to correct section
+-----------------------------------------------------------+------------+------------+
| | 6b87784b53 | e00164a0f0 |
+-----------------------------------------------------------+------------+------------+
| boot_successes | 201 | 32 |
| boot_failures | 1 | 3 |
| BUG:soft_lockup-CPU##stuck_for#s | 1 | |
| EIP:event_create_dir | 1 | |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 1 | |
| WARNING:at_kernel/locking/lockdep.c:#lockdep_register_key | 0 | 3 |
| EIP:lockdep_register_key | 0 | 3 |
+-----------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 7.510650] IPMI poweroff: Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot
[ 7.534084] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 7.545328] ACPI: Power Button [PWRF]
[ 7.554398] Warning: Processor Platform Limit event detected, but not handled.
[ 7.563385] Consider compiling CPUfreq support into your kernel.
[ 7.566387] WARNING: CPU: 0 PID: 1 at kernel/locking/lockdep.c:1025 lockdep_register_key+0x100/0x110
[ 7.569720] CPU: 0 PID: 1 Comm: swapper Not tainted 5.1.0-rc3-00003-ge00164a #237
[ 7.571684] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 7.573298] EIP: lockdep_register_key+0x100/0x110
[ 7.573298] Code: 0c 2c 6f 5c 85 c0 0f 85 52 ff ff ff 68 85 54 16 5c 68 84 1f 13 5c e8 2f a4 fc ff 0f 0b 59 5b e9 3a ff ff ff 8d b6 00 00 00 00 <0f> 0b 8d 65 f8 5b 5e 5d c3 8d b4 26 00 00 00 00 55 89 e5 57 56 53
[ 7.573298] EAX: 00000001 EBX: 5d5406a4 ECX: 5c7ec208 EDX: 5d5406a4
[ 7.573298] ESI: 00000018 EDI: 5d5406c4 EBP: 40255ef4 ESP: 40255eec
[ 7.573298] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00210202
[ 7.573298] CR0: 80050033 CR2: 00000000 CR3: 1c7de000 CR4: 00000690
[ 7.573298] Call Trace:
[ 7.573298] ? alloc_workqueue+0xeb/0x380
[ 7.573298] ? acpi_container_init+0x19/0x19
[ 7.573298] ? acpi_thermal_init+0x3d/0x74
[ 7.573298] ? do_one_initcall+0x6d/0x14b
[ 7.573298] ? kernel_init_freeable+0xda/0x176
[ 7.573298] ? kernel_init_freeable+0xfc/0x176
[ 7.573298] ? rest_init+0x100/0x100
[ 7.573298] ? kernel_init+0xd/0xf0
[ 7.573298] ? ret_from_fork+0x19/0x30
[ 7.573298] random: get_random_bytes called from init_oops_id+0x3f/0x50 with crng_init=1
[ 7.573298] ---[ end trace 545f90114983ba96 ]---
[ 7.828642] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start e00164a0f000de893944981f41a568c981aca658 79a3aaa7b82e3106be97842dedfd8429248896e6 --
git bisect good ace965696da2611af759f0284e26342b7b6cec89 # 22:48 G 65 0 0 0 serial: sh-sci: Fix HSCIF RX sampling point calculation
git bisect good 6b87784b53592a90d21576be8eff688b56d93cce # 23:03 G 66 0 0 0 serial: sh-sci: Fix HSCIF RX sampling point adjustment
# first bad commit: [e00164a0f000de893944981f41a568c981aca658] sc16is7xx: move label 'err_spi' to correct section
git bisect good 6b87784b53592a90d21576be8eff688b56d93cce # 23:11 G 196 0 1 1 serial: sh-sci: Fix HSCIF RX sampling point adjustment
# extra tests on HEAD of tty/tty-linus
git bisect bad e00164a0f000de893944981f41a568c981aca658 # 23:11 B 32 3 0 0 sc16is7xx: move label 'err_spi' to correct section
# extra tests on tree/branch tty/tty-linus
git bisect bad e00164a0f000de893944981f41a568c981aca658 # 23:18 B 32 3 0 0 sc16is7xx: move label 'err_spi' to correct section
# extra tests with first bad commit reverted
git bisect good a3d4c63910ec84ad8387b4a83aa6e0901e2f3888 # 23:38 G 63 0 0 0 Revert "sc16is7xx: move label 'err_spi' to correct section"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
1 year, 6 months
- 1
- 0
94bdd46124 ("netfilter: nf_nat: register ftp NAT helper."): kernel BUG at net/netfilter/nf_conntrack_helper.c:547!
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/0day-ci/linux/commits/Flavio-Leitner/openvswitch-load-...
commit 94bdd461241f07a2315f2322ea3e715f0eba0082
Author: Flavio Leitner <fbl(a)redhat.com>
AuthorDate: Sat Apr 13 20:17:12 2019 -0300
Commit: 0day robot <lkp(a)intel.com>
CommitDate: Mon Apr 15 17:50:32 2019 +0800
netfilter: nf_nat: register ftp NAT helper.
Signed-off-by: Flavio Leitner <fbl(a)redhat.com>
293f439662 netfilter: nf_nat: register amanda NAT helper.
94bdd46124 netfilter: nf_nat: register ftp NAT helper.
4c826f1cd2 openvswitch: load and reference the NAT helper.
+---------------------------------------------------+------------+------------+------------+
| | 293f439662 | 94bdd46124 | 4c826f1cd2 |
+---------------------------------------------------+------------+------------+------------+
| boot_successes | 32 | 0 | 0 |
| boot_failures | 1 | 11 | 11 |
| BUG:soft_lockup-CPU##stuck_for#s | 1 | | |
| RIP:_raw_spin_unlock_irqrestore | 1 | | |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 1 | | |
| kernel_BUG_at_net/netfilter/nf_conntrack_helper.c | 0 | 11 | 11 |
| invalid_opcode:#[##] | 0 | 11 | 11 |
| RIP:nf_nat_helper_register | 0 | 11 | 11 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 11 | 11 |
+---------------------------------------------------+------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 14.368932] pcengines_apuv2: failed to detect apu board via dmi
[ 14.372264] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input3
[ 14.373722] evbug: Connected device: input3 (AT Translated Set 2 keyboard at isa0060/serio0/input0)
[ 14.375952] oprofile: using NMI timer interrupt.
[ 14.377317] ------------[ cut here ]------------
[ 14.377938] kernel BUG at net/netfilter/nf_conntrack_helper.c:547!
[ 14.379004] invalid opcode: 0000 [#1] SMP PTI
[ 14.379577] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.1.0-rc4-00761-g94bdd46 #1
[ 14.380545] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 14.381628] RIP: 0010:nf_nat_helper_register+0x18/0x80
[ 14.382297] Code: ff 75 e1 eb d6 0f 1f 00 66 2e 0f 1f 84 00 00 00 00 00 41 54 55 53 48 89 fb e8 d4 29 7d ff 48 83 7b 20 00 75 07 e8 c8 29 7d ff <0f> 0b e8 c1 29 7d ff 31 f6 48 c7 c7 a0 2d 97 82 49 c7 c4 20 e2 9c
[ 14.382314] RSP: 0000:ffff88800fc9fe88 EFLAGS: 00010293
[ 14.388185] RAX: 0000000000000000 RBX: ffffffff829733e0 RCX: 0000000000000001
[ 14.388185] RDX: ffff88800fc9a000 RSI: ffffffff819e1b28 RDI: ffffffff829733e0
[ 14.388185] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[ 14.388185] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff82c38bd2
[ 14.388185] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000
[ 14.388185] FS: 0000000000000000(0000) GS:ffff88801da00000(0000) knlGS:0000000000000000
[ 14.388185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 14.388185] CR2: 0000000000000000 CR3: 0000000002828000 CR4: 00000000000006b0
[ 14.388185] Call Trace:
[ 14.388185] ? nf_nat_init+0x12f/0x12f
[ 14.388185] ? nf_nat_ftp_init+0x27/0x35
[ 14.388185] ? do_one_initcall+0x13b/0x332
[ 14.388185] ? do_early_param+0xb9/0xb9
[ 14.388185] ? rcu_read_lock_sched_held+0x66/0x90
[ 14.388185] ? trace_initcall_level+0xfc/0x133
[ 14.388185] ? do_early_param+0xb9/0xb9
[ 14.388185] ? kernel_init_freeable+0x143/0x201
[ 14.388185] ? rest_init+0x290/0x290
[ 14.388185] ? kernel_init+0xf/0x160
[ 14.388185] ? _raw_spin_unlock_irq+0x24/0x30
[ 14.388185] ? rest_init+0x290/0x290
[ 14.388185] ? ret_from_fork+0x24/0x30
[ 14.406283] ---[ end trace 2d671cf8c9f1c6c8 ]---
[ 14.406895] RIP: 0010:nf_nat_helper_register+0x18/0x80
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start b7920c0aa518df6798a57622542814f96c1adbb1 dc4060a5dc2557e6b5aa813bf5b73677299d62d2 --
git bisect bad 84b5238e4e776fc9d22720edfe2fbb504e2748bb # 23:32 B 0 5 19 0 Merge 'linux-review/Daniel-Borkmann/tools-add-smp_-barrier-variants-to-include-infrastructure/20190410-091514' into devel-hourly-2019041608
git bisect bad 5e2afb160ca1f1aaa7219629064e779c8ddaa702 # 23:51 B 0 4 18 0 Merge 'linuxppc/topic/ppc-kvm' into devel-hourly-2019041608
git bisect good 4b6c07ce7b1c0ab27b909f2c3c1a76df003db04a # 00:18 G 10 0 0 0 0day base guard for 'devel-hourly-2019041608'
git bisect bad dee0bc940b90b9e64d42d64ce0d3f4d3aef1e871 # 00:41 B 0 3 17 0 Merge 'linux-review/Colin-King/qede-fix-write-to-free-d-pointer-error-and-double-free-of-ptp/20190414-010546' into devel-hourly-2019041608
git bisect good 384f6fb191ce7ce01c38f45808c028982509d2bb # 01:13 G 10 0 0 0 Merge 'ambarus/spi-nor/next' into devel-hourly-2019041608
git bisect bad 6d801c6df32a8e2b2ecba8af9e733abb6fd6a2fb # 01:27 B 0 4 18 0 Merge 'linux-review/UPDATE-20190414-165328/Shawn-Landden/new-flag-COPY_FILE_RANGE_FILESIZE-for-copy_file_range/20190414-073458' into devel-hourly-2019041608
git bisect good cdbf7634713abe1d0dd5a3259100c916b454f593 # 01:46 G 11 0 0 0 Merge 'vkoul-soundwire/next' into devel-hourly-2019041608
git bisect good 6f02d19ae8ccb18b7eefd39da670e49531a16262 # 02:03 G 11 0 0 0 Merge 'linux-review/Colin-King/RDMA-cxgb4-fix-null-pointer-dereference-on-alloc_skb-failure/20190414-103521' into devel-hourly-2019041608
git bisect bad 207abd8a5669bb57e4397e4813caad42616c2918 # 02:13 B 0 8 22 0 Merge 'linux-review/Hans-de-Goede/usb-typec-tcpm-Add-start_srp_connection_detect-callback/20190414-094926' into devel-hourly-2019041608
git bisect bad 39ba5ca894ccc4dc03dda00adc702736bc77b63e # 02:21 B 0 8 22 0 Merge 'linux-review/Flavio-Leitner/openvswitch-load-and-reference-the-NAT-helper/20190415-175030' into devel-hourly-2019041608
git bisect bad 94bdd461241f07a2315f2322ea3e715f0eba0082 # 02:33 B 0 7 21 0 netfilter: nf_nat: register ftp NAT helper.
git bisect good ac824d37d68e21a1214b0de672515eba348929e8 # 02:45 G 11 0 0 0 netfilter: add API to manage NAT helpers.
git bisect good 293f439662715da7efbf21c268b35ee8fb9fe8e8 # 03:08 G 10 0 0 0 netfilter: nf_nat: register amanda NAT helper.
# first bad commit: [94bdd461241f07a2315f2322ea3e715f0eba0082] netfilter: nf_nat: register ftp NAT helper.
git bisect good 293f439662715da7efbf21c268b35ee8fb9fe8e8 # 03:12 G 32 0 1 1 netfilter: nf_nat: register amanda NAT helper.
# extra tests with debug options
git bisect bad 94bdd461241f07a2315f2322ea3e715f0eba0082 # 03:23 B 0 1 15 0 netfilter: nf_nat: register ftp NAT helper.
# extra tests on HEAD of linux-devel/devel-hourly-2019041608
git bisect bad b7920c0aa518df6798a57622542814f96c1adbb1 # 03:28 B 0 13 30 0 0day head guard for 'devel-hourly-2019041608'
# extra tests on tree/branch linux-review/Flavio-Leitner/openvswitch-load-and-reference-the-NAT-helper/20190415-175030
git bisect bad 4c826f1cd2d4d1b4872086e1dac8080e9b6322ce # 03:39 B 0 6 20 0 openvswitch: load and reference the NAT helper.
# extra tests with first bad commit reverted
git bisect bad c8b33f6f4fa63383848b2b3654b456fb61f7873d # 03:48 B 0 3 17 0 Revert "netfilter: nf_nat: register ftp NAT helper."
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
1 year, 6 months
- 1
- 0
4673fbd10a ("devlink: Add packet trap interface"): WARNING: CPU: 1 PID: 18 at net/core/devlink.c:5581 devlink_free
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/jpirko/linux_mlxsw idosch_devlink
commit 4673fbd10a42eb855bab8e9408d27de1c8fb1383
Author: Ido Schimmel <idosch(a)mellanox.com>
AuthorDate: Sat Apr 13 19:37:52 2019 +0300
Commit: Ido Schimmel <idosch(a)mellanox.com>
CommitDate: Mon Apr 15 10:00:23 2019 +0300
devlink: Add packet trap interface
XXX: Write me
Signed-off-by: Ido Schimmel <idosch(a)mellanox.com>
b52d1680c2 netdevsim: implement ndo_get_devlink_port
4673fbd10a devlink: Add packet trap interface
+---------------------------------------------+------------+------------+
| | b52d1680c2 | 4673fbd10a |
+---------------------------------------------+------------+------------+
| boot_successes | 33 | 0 |
| boot_failures | 0 | 11 |
| WARNING:at_net/core/devlink.c:#devlink_free | 0 | 11 |
| EIP:devlink_free | 0 | 11 |
+---------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 21.718654] dsa-loop fixed-0:1f lan1 (uninitialized): PHY [dsa-0.0:00] driver [Generic PHY]
[ 21.720897] dsa-loop fixed-0:1f lan2 (uninitialized): PHY [dsa-0.0:01] driver [Generic PHY]
[ 21.722905] dsa-loop fixed-0:1f lan3 (uninitialized): PHY [dsa-0.0:02] driver [Generic PHY]
[ 21.724960] dsa-loop fixed-0:1f lan4 (uninitialized): PHY [dsa-0.0:03] driver [Generic PHY]
[ 21.727537] DSA: tree 0 setup
[ 21.773196] WARNING: CPU: 1 PID: 18 at net/core/devlink.c:5581 devlink_free+0x40/0x230
[ 21.774167] CPU: 1 PID: 18 Comm: kworker/1:0 Tainted: G S 5.1.0-rc4-00805-g4673fbd #1
[ 21.775039] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 21.775853] Workqueue: events deferred_probe_work_func
[ 21.776373] EIP: devlink_free+0x40/0x230
[ 21.776767] Code: 8d 7b 48 e8 62 46 fc fe 8b 73 48 31 c0 6a 00 39 f7 0f 95 c0 31 c9 89 45 f0 89 c2 b8 60 97 eb c2 e8 f5 e4 05 ff 39 f7 58 74 08 <0f> 0b 8d b6 00 00 00 00 8b 55 f0 6a 00 31 c9 b8 48 97 eb c2 8d 7b
[ 21.778612] EAX: 00000000 EBX: d756c738 ECX: 00000000 EDX: 00000001
[ 21.779211] ESI: 00000000 EDI: d756c780 EBP: dde3fe0c ESP: dde3fdfc
[ 21.792173] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00210282
[ 21.792826] CR0: 80050033 CR2: ffffffff CR3: 0302d000 CR4: 00000690
[ 21.793429] Call Trace:
[ 21.793680] dsa_tree_teardown+0xda/0x120
[ 21.794080] dsa_unregister_switch+0x25/0x50
[ 21.794512] dsa_loop_drv_remove+0x17/0x30
[ 21.794925] mdio_remove+0x17/0x30
[ 21.795274] really_probe+0x1d5/0x330
[ 21.795644] driver_probe_device+0xf9/0x120
[ 21.796063] ? mdio_device_bus_match+0x1b/0x30
[ 21.796511] __device_attach_driver+0x67/0x70
[ 21.796945] ? driver_allows_async_probing+0x40/0x40
[ 21.797429] bus_for_each_drv+0x54/0x90
[ 21.797819] __device_attach+0x73/0xd0
[ 21.798198] ? driver_allows_async_probing+0x40/0x40
[ 21.798696] device_initial_probe+0x12/0x20
[ 21.799116] bus_probe_device+0x27/0x80
[ 21.799506] deferred_probe_work_func+0x72/0xa0
[ 21.799960] process_one_work+0x3be/0x800
[ 21.800362] worker_thread+0x3fd/0x5f0
[ 21.800726] kthread+0x126/0x130
[ 21.801046] ? process_one_work+0x800/0x800
[ 21.801455] ? __kthread_bind_mask+0x90/0x90
[ 21.801888] ret_from_fork+0x19/0x24
[ 21.802250] irq event stamp: 5772
[ 21.802589] hardirqs last enabled at (5771): [<c24ba71d>] _raw_spin_unlock_irqrestore+0x3d/0x50
[ 21.803439] hardirqs last disabled at (5772): [<c1001396>] trace_hardirqs_off_thunk+0xc/0x16
[ 21.804256] softirqs last enabled at (5288): [<c20ab74b>] dev_mc_flush+0x2b/0x30
[ 21.807522] softirqs last disabled at (5286): [<c20ab739>] dev_mc_flush+0x19/0x30
[ 21.808274] ---[ end trace 2080830d9359617c ]---
[ 21.808796] DSA: tree 0 torn down
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 3dc5075ebcd4186679cfc379cbd049899d4ee4e4 dc4060a5dc2557e6b5aa813bf5b73677299d62d2 --
git bisect bad 8ccb1e0bee51a1b17b39dab2f4923f027a8a20ac # 19:49 B 0 5 19 0 Merge 'vireshk-pm/opp/linux-next' into devel-hourly-2019041615
git bisect bad 38ea4287978ddf2fdaa0937272f3580bd6993265 # 20:08 B 0 7 21 0 Merge 'linux-review/Dan-Carpenter/IB-mlx5-add-checking-for-vf-from-do_setvfinfo/20190413-161504' into devel-hourly-2019041615
git bisect good 183d164d9db39e87154a045eb989e6fbfc553777 # 20:26 G 11 0 2 2 Merge 'hch-misc/riscv-misc-cleanups' into devel-hourly-2019041615
git bisect good 4c13ed9e5b1f254f1086f11748b21a24438ff2de # 20:44 G 10 0 0 0 Merge 'ambarus/spi-nor/next' into devel-hourly-2019041615
git bisect bad b6957fe38cb50c72a8f303124f252654e3ad7d73 # 20:56 B 0 4 18 0 Merge 'linux-review/UPDATE-20190414-165328/Shawn-Landden/new-flag-COPY_FILE_RANGE_FILESIZE-for-copy_file_range/20190414-073458' into devel-hourly-2019041615
git bisect bad 1141b6d47d2f50136889511b48ada5d39d80d566 # 21:14 B 0 2 17 1 Merge 'jwboyer-fedora/rawhide' into devel-hourly-2019041615
git bisect bad 097588212904b623f46a97013b6da7efd9a87ee6 # 21:33 B 0 4 18 0 Merge 'wsa/i2c/for-next' into devel-hourly-2019041615
git bisect bad 34a4a774375e27bd9550174699bfd5d567ae2c42 # 21:59 B 0 9 23 0 Merge 'jpirko-mlxsw/idosch_devlink' into devel-hourly-2019041615
git bisect good 8f100cd4bdc97f0c3aa168a809b1f0ab317ee812 # 22:12 G 11 0 0 0 Merge 'linux-review/Wen-Gong/ath10k-Remove-ATH10K_STATE_RESTARTED-in-simulate-fw-crash/20190414-161252' into devel-hourly-2019041615
git bisect good 4e7efa0e4f808b8a1e5c7257ac8b285f7929328a # 22:29 G 11 0 0 0 netdevsim: add bus attributes to add new and delete devices
git bisect good c6a6ab54629c2af9e8289d427eeeee2d2a47cd80 # 22:43 G 10 0 0 0 netdevsim: change debugfs tree topology
git bisect good d332b58c74d8c0b65c61878a310d6f718eef483c # 23:07 G 10 0 0 0 netdevsim: move netdev creation/destruction to dev probe
git bisect bad 4673fbd10a42eb855bab8e9408d27de1c8fb1383 # 23:27 B 0 4 18 0 devlink: Add packet trap interface
git bisect good b52d1680c2000be4da133f82b07e745260bffd3f # 23:48 G 10 0 0 0 netdevsim: implement ndo_get_devlink_port
# first bad commit: [4673fbd10a42eb855bab8e9408d27de1c8fb1383] devlink: Add packet trap interface
git bisect good b52d1680c2000be4da133f82b07e745260bffd3f # 23:51 G 30 0 0 0 netdevsim: implement ndo_get_devlink_port
# extra tests with debug options
git bisect bad 4673fbd10a42eb855bab8e9408d27de1c8fb1383 # 00:02 B 0 9 23 0 devlink: Add packet trap interface
# extra tests on HEAD of linux-devel/devel-hourly-2019041615
git bisect bad 3dc5075ebcd4186679cfc379cbd049899d4ee4e4 # 00:03 B 0 13 30 0 0day head guard for 'devel-hourly-2019041615'
# extra tests on tree/branch jpirko-mlxsw/idosch_devlink
git bisect bad 4673fbd10a42eb855bab8e9408d27de1c8fb1383 # 00:06 B 0 11 25 0 devlink: Add packet trap interface
# extra tests with first bad commit reverted
git bisect good 151fe144ba6e8f0e112f0297023e50209255e2ab # 00:25 G 11 0 0 0 Revert "devlink: Add packet trap interface"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
1 year, 6 months
- 1
- 0
[vfs] 9af1f3b769: vm-scalability.median 18.5% improvement
by kernel test robot
Greeting,
FYI, we noticed a 18.5% improvement of vm-scalability.median due to commit:
commit: 9af1f3b769482f60b1e42a1f52cd26ff32ecd08c ("vfs: Convert ramfs, shmem, tmpfs, devtmpfs, rootfs to use the new mount API")
https://git.kernel.org/cgit/linux/kernel/git/dhowells/linux-fs.git mount-api-viro
in testcase: vm-scalability
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
with following parameters:
runtime: 300s
size: 256G
test: lru-shm-rand
cpufreq_governor: performance
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/size/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/debian-x86_64-2018-04-03.cgz/300s/256G/lkp-bdw-ep2/lru-shm-rand/vm-scalability
commit:
f4febcb76d ("vfs: Convert smackfs to use the new mount API")
9af1f3b769 ("vfs: Convert ramfs, shmem, tmpfs, devtmpfs, rootfs to use the new mount API")
f4febcb76d41fcaa 9af1f3b769482f60b1e42a1f52c
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
2:4 -50% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
2:4 -50% :4 dmesg.WARNING:stack_recursion
%stddev %change %stddev
\ | \
0.03 -52.2% 0.01 vm-scalability.free_time
54201 +18.5% 64250 vm-scalability.median
0.00 ± 32% +244.9% 0.01 ± 27% vm-scalability.median_stddev
0.00 ± 27% +240.8% 0.01 ± 24% vm-scalability.stddev
4769703 +18.2% 5637863 vm-scalability.throughput
193.60 -10.5% 173.26 vm-scalability.time.elapsed_time
193.60 -10.5% 173.26 vm-scalability.time.elapsed_time.max
64080 ± 6% -9.7% 57865 ± 5% vm-scalability.time.involuntary_context_switches
750511 -49.9% 376100 vm-scalability.time.maximum_resident_set_size
5678 -5.6% 5359 vm-scalability.time.percent_of_cpu_this_job_got
882.78 -6.6% 824.09 vm-scalability.time.system_time
10110 -16.3% 8462 vm-scalability.time.user_time
10291 +98.7% 20445 vm-scalability.time.voluntary_context_switches
12908 ± 77% +55.4% 20058 ± 42% numa-numastat.node1.other_node
937394 ± 14% +2084.6% 20478032 ±157% cpuidle.C1.time
22450 ± 20% +3395.0% 784618 ±159% cpuidle.C1.usage
38959 ± 12% +1379.3% 576346 ±135% cpuidle.POLL.time
22444 ± 12% +498.6% 134349 ±117% cpuidle.POLL.usage
1826 -4.8% 1737 turbostat.Avg_MHz
18546 ± 34% +4093.6% 777763 ±160% turbostat.C1
0.00 ±173% +0.1 0.14 ±156% turbostat.C1%
35611698 ± 2% -16.4% 29755779 ± 7% turbostat.IRQ
22.61 -2.9% 21.96 turbostat.RAMWatt
35.50 ± 3% +9.9% 39.00 vmstat.cpu.id
58.00 -5.6% 54.75 vmstat.cpu.us
54773378 -49.7% 27528605 vmstat.memory.cache
76174609 +35.8% 1.034e+08 vmstat.memory.free
1998 ± 3% +45.7% 2911 ± 2% vmstat.system.cs
1693 ± 21% -28.0% 1219 ± 26% slabinfo.pool_workqueue.active_objs
1694 ± 21% -28.1% 1219 ± 26% slabinfo.pool_workqueue.num_objs
236153 -47.7% 123522 slabinfo.radix_tree_node.active_objs
4241 -47.4% 2228 slabinfo.radix_tree_node.active_slabs
237535 -47.4% 124836 slabinfo.radix_tree_node.num_objs
4241 -47.4% 2228 slabinfo.radix_tree_node.num_slabs
54678160 -49.9% 27395539 meminfo.Cached
53911660 -50.7% 26569866 meminfo.Committed_AS
53640490 -50.9% 26362720 meminfo.Inactive
53639047 -50.9% 26361142 meminfo.Inactive(anon)
201401 -32.6% 135717 meminfo.KReclaimable
39979706 -52.9% 18829701 meminfo.Mapped
75550616 +36.2% 1.029e+08 meminfo.MemAvailable
76068066 +36.0% 1.034e+08 meminfo.MemFree
55824496 -49.0% 28447534 meminfo.Memused
88875 -48.4% 45820 meminfo.PageTables
201401 -32.6% 135717 meminfo.SReclaimable
53653007 -50.8% 26370725 meminfo.Shmem
336342 -19.2% 271926 meminfo.Slab
357948 -42.4% 206080 meminfo.max_used_kB
66376 -2.0% 65028 proc-vmstat.nr_active_anon
121.50 +57.2% 191.00 proc-vmstat.nr_dirtied
1884328 +36.2% 2566207 proc-vmstat.nr_dirty_background_threshold
3773443 +36.2% 5138817 proc-vmstat.nr_dirty_threshold
13660846 -49.8% 6855789 proc-vmstat.nr_file_pages
19026159 +35.9% 25854659 proc-vmstat.nr_free_pages
13400786 -50.8% 6596946 proc-vmstat.nr_inactive_anon
360.25 +9.4% 394.25 proc-vmstat.nr_inactive_file
9989472 -52.9% 4702769 proc-vmstat.nr_mapped
22157 -48.6% 11391 proc-vmstat.nr_page_table_pages
13404300 -50.8% 6599326 proc-vmstat.nr_shmem
50301 -32.6% 33919 proc-vmstat.nr_slab_reclaimable
117.75 +47.1% 173.25 proc-vmstat.nr_written
66376 -2.0% 65028 proc-vmstat.nr_zone_active_anon
13400786 -50.8% 6596946 proc-vmstat.nr_zone_inactive_anon
360.25 +9.4% 394.25 proc-vmstat.nr_zone_inactive_file
25.75 ± 75% +192.2% 75.25 ± 28% numa-vmstat.node0.nr_dirtied
7034387 ± 2% -52.1% 3369632 ± 3% numa-vmstat.node0.nr_file_pages
9270078 ± 2% +39.6% 12940096 numa-vmstat.node0.nr_free_pages
6907523 ± 2% -53.1% 3237570 ± 3% numa-vmstat.node0.nr_inactive_anon
5062171 -53.4% 2357077 numa-vmstat.node0.nr_mapped
11389 ± 2% -47.4% 5991 numa-vmstat.node0.nr_page_table_pages
6908755 ± 2% -53.1% 3238980 ± 3% numa-vmstat.node0.nr_shmem
26068 -29.0% 18517 ± 5% numa-vmstat.node0.nr_slab_reclaimable
6907512 ± 2% -53.1% 3237557 ± 3% numa-vmstat.node0.nr_zone_inactive_anon
6626537 ± 3% -47.8% 3458887 ± 2% numa-vmstat.node1.nr_file_pages
9755978 ± 2% +32.7% 12941913 numa-vmstat.node1.nr_free_pages
6493347 ± 3% -48.7% 3332085 ± 3% numa-vmstat.node1.nr_inactive_anon
4889629 ± 2% -52.3% 2331832 numa-vmstat.node1.nr_mapped
10723 ± 2% -49.7% 5397 numa-vmstat.node1.nr_page_table_pages
6495622 ± 3% -48.7% 3333077 ± 3% numa-vmstat.node1.nr_shmem
24262 ± 2% -36.7% 15369 ± 7% numa-vmstat.node1.nr_slab_reclaimable
6493337 ± 3% -48.7% 3332077 ± 3% numa-vmstat.node1.nr_zone_inactive_anon
28088325 ± 3% -51.8% 13539226 ± 3% numa-meminfo.node0.FilePages
27581274 ± 3% -52.8% 13011988 ± 3% numa-meminfo.node0.Inactive
27580810 ± 3% -52.8% 13011041 ± 3% numa-meminfo.node0.Inactive(anon)
104273 ± 2% -29.0% 74051 ± 5% numa-meminfo.node0.KReclaimable
20163532 -53.1% 9457441 numa-meminfo.node0.Mapped
37129631 ± 2% +39.2% 51699555 numa-meminfo.node0.MemFree
28737652 ± 2% -50.7% 14167727 ± 2% numa-meminfo.node0.MemUsed
45567 ± 2% -47.5% 23940 numa-meminfo.node0.PageTables
104273 ± 2% -29.0% 74051 ± 5% numa-meminfo.node0.SReclaimable
27585793 ± 3% -52.8% 13016613 ± 3% numa-meminfo.node0.Shmem
176449 ± 2% -14.3% 151189 ± 6% numa-meminfo.node0.Slab
26456715 ± 3% -47.5% 13900809 ± 3% numa-meminfo.node1.FilePages
25924831 ± 3% -48.3% 13394293 ± 3% numa-meminfo.node1.Inactive
25923853 ± 3% -48.3% 13393662 ± 3% numa-meminfo.node1.Inactive(anon)
97017 ± 2% -36.7% 61458 ± 7% numa-meminfo.node1.KReclaimable
19566158 -52.0% 9393352 numa-meminfo.node1.Mapped
39073497 ± 2% +32.3% 51702190 numa-meminfo.node1.MemFree
26951781 ± 3% -46.9% 14323093 ± 2% numa-meminfo.node1.MemUsed
43050 ± 2% -49.8% 21623 ± 2% numa-meminfo.node1.PageTables
97017 ± 2% -36.7% 61458 ± 7% numa-meminfo.node1.SReclaimable
25933051 ± 3% -48.3% 13397562 ± 3% numa-meminfo.node1.Shmem
159789 ± 2% -24.6% 120526 ± 8% numa-meminfo.node1.Slab
12925 ± 18% -42.0% 7496 ± 7% sched_debug.cfs_rq:/.load.avg
351.12 +33.3% 468.04 ± 13% sched_debug.cfs_rq:/.load_avg.max
5503987 ± 2% -60.9% 2150595 ± 35% sched_debug.cfs_rq:/.min_vruntime.avg
5588392 ± 2% -60.5% 2205353 ± 35% sched_debug.cfs_rq:/.min_vruntime.max
5278969 ± 3% -61.5% 2034957 ± 36% sched_debug.cfs_rq:/.min_vruntime.min
10.26 ± 9% -33.0% 6.87 ± 9% sched_debug.cfs_rq:/.runnable_load_avg.avg
12815 ± 17% -42.6% 7358 ± 8% sched_debug.cfs_rq:/.runnable_weight.avg
217861 ± 29% -73.5% 57660 ± 37% sched_debug.cfs_rq:/.spread0.avg
301992 ± 19% -62.8% 112422 ± 34% sched_debug.cfs_rq:/.spread0.max
-6653 +766.2% -57632 sched_debug.cfs_rq:/.spread0.min
137640 ± 3% -40.6% 81740 ± 17% sched_debug.cpu.clock.avg
137649 ± 3% -40.6% 81748 ± 17% sched_debug.cpu.clock.max
137633 ± 3% -40.6% 81731 ± 17% sched_debug.cpu.clock.min
137640 ± 3% -40.6% 81740 ± 17% sched_debug.cpu.clock_task.avg
137649 ± 3% -40.6% 81748 ± 17% sched_debug.cpu.clock_task.max
137633 ± 3% -40.6% 81731 ± 17% sched_debug.cpu.clock_task.min
8.12 ± 5% -15.1% 6.89 ± 9% sched_debug.cpu.cpu_load[0].avg
8.26 ± 5% -14.1% 7.10 ± 8% sched_debug.cpu.cpu_load[1].avg
8.57 ± 8% -13.0% 7.46 ± 7% sched_debug.cpu.cpu_load[2].avg
9086 ± 2% -18.5% 7402 ± 8% sched_debug.cpu.load.avg
96906 -55.1% 43550 ± 30% sched_debug.cpu.nr_load_updates.avg
107802 ± 2% -54.4% 49136 ± 28% sched_debug.cpu.nr_load_updates.max
92760 -58.6% 38426 ± 35% sched_debug.cpu.nr_load_updates.min
0.21 ± 6% +15.1% 0.24 ± 2% sched_debug.cpu.nr_running.stddev
2995 ± 4% -31.8% 2042 ± 21% sched_debug.cpu.nr_switches.avg
14.00 ± 29% -41.1% 8.25 ± 10% sched_debug.cpu.nr_uninterruptible.max
137632 ± 3% -40.6% 81731 ± 17% sched_debug.cpu_clk
133579 ± 3% -41.8% 77692 ± 18% sched_debug.ktime
138509 ± 3% -40.0% 83079 ± 17% sched_debug.sched_clk
45.39 ± 65% -45.2 0.20 ±173% perf-profile.calltrace.cycles-pp.apic_timer_interrupt
42.94 ± 65% -42.8 0.19 ±173% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt
33.42 ± 65% -33.3 0.16 ±173% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
24.97 ± 65% -25.0 0.00 perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
18.13 ± 58% -18.1 0.00 perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
16.45 ± 57% -16.4 0.00 perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
16.16 ± 58% -16.2 0.00 perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
11.53 ± 61% -11.5 0.00 perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
8.87 ± 64% -8.9 0.00 perf-profile.calltrace.cycles-pp.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer
6.17 ±109% -6.0 0.19 ±173% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
6.16 ±109% -6.0 0.19 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.65 ±121% -5.5 0.17 ±173% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64
5.65 ±121% -5.5 0.17 ±173% perf-profile.calltrace.cycles-pp.__do_munmap.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.65 ±121% -5.5 0.17 ±173% perf-profile.calltrace.cycles-pp.__vm_munmap.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.65 ±121% -5.5 0.17 ±173% perf-profile.calltrace.cycles-pp.__x64_sys_munmap.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.62 ±121% -5.5 0.17 ±173% perf-profile.calltrace.cycles-pp.unmap_vmas.unmap_region.__do_munmap.__vm_munmap.__x64_sys_munmap
5.61 ±121% -5.4 0.17 ±173% perf-profile.calltrace.cycles-pp.unmap_page_range.unmap_vmas.unmap_region.__do_munmap.__vm_munmap
4.25 ± 75% -4.3 0.00 perf-profile.calltrace.cycles-pp.interrupt_entry
4.14 ± 71% -4.1 0.00 perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
3.54 ± 73% -3.5 0.00 perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
3.33 ± 74% -3.3 0.00 perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +1.4 1.42 ± 19% perf-profile.calltrace.cycles-pp.nrand48_r
0.00 +1.5 1.52 ± 64% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma
0.00 +1.5 1.54 ± 64% perf-profile.calltrace.cycles-pp._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page
0.00 +1.6 1.60 ± 61% perf-profile.calltrace.cycles-pp.clear_page_erms.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault
0.00 +2.0 2.00 ± 63% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page
0.00 +2.1 2.09 ± 63% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp
0.00 +2.1 2.13 ± 63% perf-profile.calltrace.cycles-pp.alloc_pages_vma.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_fault
0.00 +2.2 2.19 ± 63% perf-profile.calltrace.cycles-pp.shmem_alloc_page.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_fault.__do_fault
0.00 +2.5 2.52 ± 62% perf-profile.calltrace.cycles-pp.shmem_alloc_and_acct_page.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault
0.00 +3.0 2.95 ± 20% perf-profile.calltrace.cycles-pp.do_rw_once
0.00 +4.0 3.98 ± 60% perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.00 +5.9 5.95 ± 61% perf-profile.calltrace.cycles-pp.shmem_getpage_gfp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.00 +6.1 6.06 ± 61% perf-profile.calltrace.cycles-pp.shmem_fault.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
0.00 +6.1 6.08 ± 61% perf-profile.calltrace.cycles-pp.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.17 ±173% +10.3 10.46 ± 60% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.00 +10.6 10.56 ± 60% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.do_access
0.00 +10.9 10.87 ± 60% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.do_access
0.00 +10.9 10.95 ± 60% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.do_access
0.00 +12.0 11.95 ± 64% perf-profile.calltrace.cycles-pp.page_fault.do_access
0.00 +83.7 83.71 ± 8% perf-profile.calltrace.cycles-pp.do_access
21.13 ± 5% -7.8% 19.49 ± 2% perf-stat.i.MPKI
8.747e+09 +12.7% 9.859e+09 perf-stat.i.branch-instructions
19600078 ± 2% +12.6% 22060460 ± 5% perf-stat.i.branch-misses
52.90 ± 2% -9.3 43.59 perf-stat.i.cache-miss-rate%
5.781e+08 -10.4% 5.183e+08 perf-stat.i.cache-misses
8.127e+08 +9.2% 8.872e+08 perf-stat.i.cache-references
1951 ± 4% +46.8% 2864 ± 2% perf-stat.i.context-switches
3.59 ± 2% -16.6% 3.00 perf-stat.i.cpi
1.605e+11 -4.9% 1.527e+11 perf-stat.i.cpu-cycles
58.65 ± 6% +55.5% 91.23 perf-stat.i.cpu-migrations
2.94 -0.5 2.48 perf-stat.i.dTLB-load-miss-rate%
4.458e+08 -3.1% 4.318e+08 perf-stat.i.dTLB-load-misses
1.096e+10 +12.7% 1.235e+10 perf-stat.i.dTLB-loads
4.295e+09 +12.5% 4.831e+09 perf-stat.i.dTLB-stores
3.847e+10 +13.0% 4.348e+10 perf-stat.i.instructions
483843 ± 10% -30.4% 336961 ± 29% perf-stat.i.instructions-per-iTLB-miss
0.32 ± 5% +15.0% 0.37 perf-stat.i.ipc
670331 ± 2% +13.8% 762606 perf-stat.i.minor-faults
17.94 ± 6% -2.3 15.68 ± 3% perf-stat.i.node-load-miss-rate%
5.578e+08 -10.7% 4.98e+08 perf-stat.i.node-loads
1936763 ± 4% +12.3% 2175171 ± 10% perf-stat.i.node-stores
670503 ± 2% +13.7% 762685 perf-stat.i.page-faults
21.11 -3.4% 20.40 perf-stat.overall.MPKI
71.03 -12.6 58.40 perf-stat.overall.cache-miss-rate%
4.17 -15.8% 3.51 perf-stat.overall.cpi
277.99 +6.0% 294.64 perf-stat.overall.cycles-between-cache-misses
3.90 -0.5 3.38 perf-stat.overall.dTLB-load-miss-rate%
0.24 +18.7% 0.28 perf-stat.overall.ipc
8.723e+09 +12.7% 9.832e+09 perf-stat.ps.branch-instructions
19707289 ± 2% +11.7% 22019855 ± 5% perf-stat.ps.branch-misses
5.755e+08 -10.2% 5.166e+08 perf-stat.ps.cache-misses
8.101e+08 +9.2% 8.846e+08 perf-stat.ps.cache-references
1949 ± 4% +46.9% 2863 ± 3% perf-stat.ps.context-switches
1.6e+11 -4.8% 1.522e+11 perf-stat.ps.cpu-cycles
58.95 ± 6% +55.0% 91.37 perf-stat.ps.cpu-migrations
4.435e+08 -3.0% 4.303e+08 perf-stat.ps.dTLB-load-misses
1.094e+10 +12.7% 1.232e+10 perf-stat.ps.dTLB-loads
4.29e+09 +12.4% 4.82e+09 perf-stat.ps.dTLB-stores
3.838e+10 +13.0% 4.336e+10 perf-stat.ps.instructions
683420 +12.3% 767202 perf-stat.ps.minor-faults
5.55e+08 -10.6% 4.964e+08 perf-stat.ps.node-loads
1970958 ± 3% +11.0% 2186993 ± 10% perf-stat.ps.node-stores
683420 +12.3% 767202 perf-stat.ps.page-faults
28735 ± 6% -22.8% 22173 ± 10% softirqs.CPU0.RCU
79928 ± 7% -14.1% 68686 ± 3% softirqs.CPU0.TIMER
31531 ± 3% -26.6% 23143 ± 9% softirqs.CPU1.RCU
77733 ± 8% -12.5% 67979 ± 4% softirqs.CPU1.TIMER
30901 ± 31% -33.5% 20541 ± 12% softirqs.CPU10.RCU
11547 ± 15% -13.6% 9972 ± 2% softirqs.CPU10.SCHED
80547 ± 11% -17.8% 66204 softirqs.CPU10.TIMER
28615 ± 14% -25.3% 21367 ± 9% softirqs.CPU11.RCU
11955 ± 8% -17.1% 9912 ± 3% softirqs.CPU11.SCHED
80541 ± 4% -17.3% 66585 ± 2% softirqs.CPU11.TIMER
29443 ± 19% -28.1% 21179 ± 5% softirqs.CPU12.RCU
76956 ± 4% -12.6% 67257 ± 3% softirqs.CPU12.TIMER
77394 ± 5% -12.4% 67791 ± 4% softirqs.CPU13.TIMER
29301 ± 12% -25.9% 21713 ± 9% softirqs.CPU14.RCU
80862 ± 8% -13.1% 70277 ± 6% softirqs.CPU14.TIMER
28148 ± 15% -30.4% 19591 ± 3% softirqs.CPU15.RCU
83380 ± 7% -14.3% 71431 ± 8% softirqs.CPU15.TIMER
26659 ± 9% -29.2% 18884 ± 3% softirqs.CPU16.RCU
80370 ± 5% -12.7% 70191 ± 3% softirqs.CPU16.TIMER
80371 ± 4% -16.1% 67411 ± 3% softirqs.CPU17.TIMER
77569 ± 7% -11.6% 68595 ± 4% softirqs.CPU18.TIMER
24628 ± 14% -30.3% 17162 ± 4% softirqs.CPU19.RCU
78226 ± 5% -13.1% 67979 ± 3% softirqs.CPU19.TIMER
29163 ± 10% -27.3% 21191 ± 7% softirqs.CPU2.RCU
79571 ± 9% -13.0% 69246 ± 4% softirqs.CPU2.TIMER
84313 ± 5% -16.6% 70301 ± 7% softirqs.CPU20.TIMER
80638 ± 6% -12.9% 70222 ± 6% softirqs.CPU21.TIMER
26465 ± 9% -21.3% 20840 ± 9% softirqs.CPU22.RCU
78235 ± 6% -14.0% 67274 ± 8% softirqs.CPU22.TIMER
76146 ± 5% -12.8% 66378 ± 8% softirqs.CPU23.TIMER
75433 ± 4% -15.2% 63977 ± 8% softirqs.CPU24.TIMER
73466 ± 5% -14.1% 63072 ± 9% softirqs.CPU25.TIMER
74460 ± 5% -13.8% 64174 ± 9% softirqs.CPU26.TIMER
73433 ± 4% -13.2% 63749 ± 8% softirqs.CPU27.TIMER
75941 ± 4% -14.0% 65324 ± 8% softirqs.CPU28.TIMER
75377 ± 5% -14.7% 64289 ± 8% softirqs.CPU29.TIMER
78494 ± 5% -13.9% 67600 ± 2% softirqs.CPU3.TIMER
75458 ± 5% -14.9% 64240 ± 8% softirqs.CPU30.TIMER
74756 ± 3% -14.7% 63750 ± 9% softirqs.CPU31.TIMER
25932 ± 13% -22.5% 20101 ± 6% softirqs.CPU33.RCU
73217 ± 6% -14.1% 62870 ± 9% softirqs.CPU33.TIMER
75115 ± 7% -14.7% 64070 ± 9% softirqs.CPU34.TIMER
74654 ± 5% -14.5% 63794 ± 8% softirqs.CPU35.TIMER
77110 ± 8% -16.2% 64606 ± 8% softirqs.CPU36.TIMER
30782 ± 15% -23.0% 23715 ± 5% softirqs.CPU37.RCU
76534 ± 8% -15.5% 64685 ± 8% softirqs.CPU37.TIMER
74670 ± 6% -12.8% 65119 ± 8% softirqs.CPU38.TIMER
75169 ± 4% -15.4% 63630 ± 9% softirqs.CPU39.TIMER
27007 ± 7% -25.2% 20210 ± 3% softirqs.CPU4.RCU
73482 ± 5% -15.6% 62038 ± 10% softirqs.CPU40.TIMER
32879 ± 14% -29.7% 23116 ± 7% softirqs.CPU41.RCU
75671 ± 7% -15.8% 63714 ± 9% softirqs.CPU41.TIMER
10289 ± 6% -10.6% 9197 ± 4% softirqs.CPU42.SCHED
77060 ± 8% -15.0% 65477 ± 8% softirqs.CPU42.TIMER
30464 ± 14% -31.3% 20923 ± 13% softirqs.CPU43.RCU
75102 ± 4% -7.7% 69320 ± 4% softirqs.CPU43.TIMER
10596 ± 4% -7.1% 9844 ± 3% softirqs.CPU44.SCHED
78834 ± 8% -14.2% 67638 softirqs.CPU44.TIMER
33531 ± 12% -21.4% 26340 ± 12% softirqs.CPU45.RCU
85036 ± 9% -17.8% 69895 ± 6% softirqs.CPU45.TIMER
27949 ± 2% -18.8% 22708 ± 6% softirqs.CPU46.RCU
84435 ± 14% -19.8% 67700 softirqs.CPU46.TIMER
78482 ± 4% -14.6% 67040 ± 2% softirqs.CPU47.TIMER
27861 ± 14% -25.8% 20679 ± 12% softirqs.CPU48.RCU
78024 ± 5% -13.3% 67615 ± 3% softirqs.CPU48.TIMER
26448 ± 9% -21.9% 20656 ± 11% softirqs.CPU49.RCU
76848 ± 5% -12.9% 66957 ± 3% softirqs.CPU49.TIMER
26063 ± 9% -21.9% 20350 ± 11% softirqs.CPU5.RCU
76318 ± 6% -13.6% 65956 ± 2% softirqs.CPU5.TIMER
79929 ± 5% -12.1% 70235 ± 5% softirqs.CPU50.TIMER
28387 ± 10% -24.3% 21494 ± 7% softirqs.CPU51.RCU
79190 ± 4% -12.4% 69357 ± 5% softirqs.CPU51.TIMER
76442 ± 5% -12.0% 67296 ± 2% softirqs.CPU52.TIMER
26409 ± 3% -25.3% 19722 ± 8% softirqs.CPU53.RCU
78987 ± 3% -14.6% 67418 ± 2% softirqs.CPU53.TIMER
25920 ± 6% -20.4% 20627 ± 5% softirqs.CPU54.RCU
11042 -8.6% 10088 ± 2% softirqs.CPU54.SCHED
76834 ± 5% -13.7% 66310 softirqs.CPU54.TIMER
26173 ± 10% -23.2% 20091 ± 4% softirqs.CPU55.RCU
11441 ± 4% -11.2% 10163 ± 2% softirqs.CPU55.SCHED
78035 ± 3% -15.5% 65910 ± 2% softirqs.CPU55.TIMER
76397 ± 5% -11.9% 67342 ± 2% softirqs.CPU56.TIMER
76941 ± 6% -13.1% 66898 ± 4% softirqs.CPU57.TIMER
28085 ± 7% -19.1% 22729 ± 10% softirqs.CPU58.RCU
80794 ± 7% -12.5% 70686 ± 5% softirqs.CPU58.TIMER
27762 ± 9% -19.1% 22469 ± 6% softirqs.CPU59.RCU
83151 ± 7% -15.5% 70265 ± 7% softirqs.CPU59.TIMER
79490 ± 6% -13.2% 69015 ± 3% softirqs.CPU6.TIMER
24814 ± 14% -27.4% 18012 ± 4% softirqs.CPU60.RCU
79404 ± 7% -13.7% 68540 ± 4% softirqs.CPU60.TIMER
83404 ± 13% -19.7% 66980 softirqs.CPU61.TIMER
77739 ± 8% -12.6% 67926 ± 4% softirqs.CPU62.TIMER
77585 ± 5% -13.5% 67098 ± 2% softirqs.CPU63.TIMER
25575 ± 11% -27.7% 18499 ± 4% softirqs.CPU64.RCU
88236 ± 10% -20.7% 70014 ± 7% softirqs.CPU64.TIMER
26729 ± 10% -28.4% 19141 ± 6% softirqs.CPU65.RCU
81039 ± 8% -15.0% 68889 ± 6% softirqs.CPU65.TIMER
81904 ± 21% -21.8% 64034 ± 9% softirqs.CPU66.TIMER
75497 ± 5% -14.0% 64933 ± 8% softirqs.CPU67.TIMER
30050 ± 19% -25.5% 22378 ± 7% softirqs.CPU68.RCU
75419 ± 3% -15.1% 64068 ± 8% softirqs.CPU68.TIMER
73179 ± 5% -14.0% 62907 ± 8% softirqs.CPU69.TIMER
31506 ± 7% -32.5% 21257 ± 8% softirqs.CPU7.RCU
79371 ± 5% -15.0% 67448 ± 2% softirqs.CPU7.TIMER
74319 ± 5% -13.6% 64234 ± 8% softirqs.CPU70.TIMER
10411 ± 4% -5.2% 9869 ± 4% softirqs.CPU71.SCHED
73739 ± 3% -14.7% 62896 ± 8% softirqs.CPU71.TIMER
28094 ± 14% -23.3% 21555 ± 5% softirqs.CPU72.RCU
76168 ± 7% -15.3% 64534 ± 8% softirqs.CPU72.TIMER
75364 ± 4% -15.0% 64026 ± 8% softirqs.CPU73.TIMER
75068 ± 4% -14.8% 63922 ± 8% softirqs.CPU74.TIMER
23582 ± 11% -23.3% 18076 ± 9% softirqs.CPU75.RCU
75510 ± 3% -14.9% 64250 ± 8% softirqs.CPU75.TIMER
74050 ± 6% -15.3% 62745 ± 9% softirqs.CPU76.TIMER
72917 ± 7% -15.3% 61775 ± 11% softirqs.CPU77.TIMER
25099 ± 7% -18.5% 20455 ± 6% softirqs.CPU78.RCU
10475 ± 5% -6.6% 9783 ± 4% softirqs.CPU78.SCHED
75033 ± 8% -15.1% 63688 ± 9% softirqs.CPU78.TIMER
24765 ± 14% -18.8% 20121 ± 18% softirqs.CPU79.RCU
10615 ± 6% -7.8% 9790 ± 4% softirqs.CPU79.SCHED
74833 ± 5% -15.2% 63433 ± 9% softirqs.CPU79.TIMER
78656 ± 5% -14.4% 67353 ± 3% softirqs.CPU8.TIMER
31079 ± 22% -33.7% 20612 ± 10% softirqs.CPU80.RCU
77361 ± 9% -16.2% 64864 ± 8% softirqs.CPU80.TIMER
76210 ± 8% -15.0% 64795 ± 8% softirqs.CPU81.TIMER
25843 ± 15% -18.6% 21025 ± 13% softirqs.CPU82.RCU
75243 ± 6% -13.3% 65253 ± 8% softirqs.CPU82.TIMER
25000 ± 16% -24.5% 18884 ± 14% softirqs.CPU83.RCU
75518 ± 6% -15.6% 63732 ± 10% softirqs.CPU83.TIMER
23664 ± 16% -23.8% 18022 ± 11% softirqs.CPU84.RCU
73762 ± 5% -15.2% 62575 ± 10% softirqs.CPU84.TIMER
28232 ± 21% -30.7% 19567 ± 11% softirqs.CPU85.RCU
75421 ± 8% -15.5% 63713 ± 9% softirqs.CPU85.TIMER
27091 ± 15% -26.7% 19848 ± 13% softirqs.CPU86.RCU
76360 ± 8% -14.3% 65406 ± 8% softirqs.CPU86.TIMER
27283 ± 10% -39.4% 16543 ± 31% softirqs.CPU87.RCU
76960 ± 5% -12.8% 67127 ± 2% softirqs.CPU9.TIMER
19352 ± 31% -55.7% 8576 softirqs.NET_RX
2380177 ± 11% -22.6% 1842128 ± 2% softirqs.RCU
6813074 ± 5% -14.2% 5846804 ± 5% softirqs.TIMER
114.75 ± 15% -21.1% 90.50 ± 4% interrupts.41:IR-PCI-MSI.1572871-edge.eth0-TxRx-7
97.50 ± 4% -12.8% 85.00 interrupts.51:IR-PCI-MSI.1572881-edge.eth0-TxRx-17
106.00 ± 15% -19.8% 85.00 interrupts.63:IR-PCI-MSI.1572893-edge.eth0-TxRx-29
96.75 ± 3% -11.6% 85.50 interrupts.65:IR-PCI-MSI.1572895-edge.eth0-TxRx-31
98.50 ± 5% -13.7% 85.00 interrupts.68:IR-PCI-MSI.1572898-edge.eth0-TxRx-34
130.25 ± 42% -34.5% 85.25 interrupts.77:IR-PCI-MSI.1572905-edge.eth0-TxRx-41
99.00 ± 7% -14.1% 85.00 interrupts.78:IR-PCI-MSI.1572906-edge.eth0-TxRx-42
97.00 ± 3% -11.9% 85.50 interrupts.80:IR-PCI-MSI.1572908-edge.eth0-TxRx-44
98.25 ± 5% -13.5% 85.00 interrupts.82:IR-PCI-MSI.1572910-edge.eth0-TxRx-46
137.25 ± 50% -37.2% 86.25 ± 2% interrupts.88:IR-PCI-MSI.1572916-edge.eth0-TxRx-52
98.00 ± 2% -13.3% 85.00 interrupts.90:IR-PCI-MSI.1572918-edge.eth0-TxRx-54
99.75 ± 3% -14.3% 85.50 interrupts.98:IR-PCI-MSI.1572926-edge.eth0-TxRx-62
293.00 ± 2% -10.3% 262.75 ± 2% interrupts.9:IR-IO-APIC.9-fasteoi.acpi
193913 -8.4% 177712 interrupts.CAL:Function_call_interrupts
386808 -16.1% 324681 ± 7% interrupts.CPU0.LOC:Local_timer_interrupts
293.00 ± 2% -10.3% 262.75 ± 2% interrupts.CPU1.9:IR-IO-APIC.9-fasteoi.acpi
389080 -16.1% 326540 ± 7% interrupts.CPU1.LOC:Local_timer_interrupts
2215 -9.4% 2007 ± 2% interrupts.CPU10.CAL:Function_call_interrupts
389644 -15.9% 327573 ± 6% interrupts.CPU10.LOC:Local_timer_interrupts
389359 -16.9% 323419 ± 6% interrupts.CPU11.LOC:Local_timer_interrupts
386855 -15.5% 326817 ± 7% interrupts.CPU12.LOC:Local_timer_interrupts
387551 -15.7% 326616 ± 7% interrupts.CPU13.LOC:Local_timer_interrupts
7026 ± 18% -44.7% 3883 ± 28% interrupts.CPU13.NMI:Non-maskable_interrupts
7026 ± 18% -44.7% 3883 ± 28% interrupts.CPU13.PMI:Performance_monitoring_interrupts
389466 -16.5% 325099 ± 7% interrupts.CPU14.LOC:Local_timer_interrupts
389252 -16.2% 326223 ± 7% interrupts.CPU15.LOC:Local_timer_interrupts
7075 ± 17% -45.1% 3881 ± 30% interrupts.CPU15.NMI:Non-maskable_interrupts
7075 ± 17% -45.1% 3881 ± 30% interrupts.CPU15.PMI:Performance_monitoring_interrupts
168.25 ± 48% -55.7% 74.50 ± 32% interrupts.CPU15.RES:Rescheduling_interrupts
2217 ± 2% -8.6% 2026 interrupts.CPU16.CAL:Function_call_interrupts
389253 -16.4% 325386 ± 7% interrupts.CPU16.LOC:Local_timer_interrupts
97.50 ± 4% -12.8% 85.00 interrupts.CPU17.51:IR-PCI-MSI.1572881-edge.eth0-TxRx-17
2214 ± 2% -11.2% 1966 ± 4% interrupts.CPU17.CAL:Function_call_interrupts
389068 -16.6% 324358 ± 6% interrupts.CPU17.LOC:Local_timer_interrupts
84.25 ± 39% +1537.1% 1379 ± 99% interrupts.CPU17.RES:Rescheduling_interrupts
388835 -16.5% 324790 ± 6% interrupts.CPU18.LOC:Local_timer_interrupts
387421 -15.9% 325903 ± 7% interrupts.CPU19.LOC:Local_timer_interrupts
389241 -16.3% 325927 ± 7% interrupts.CPU2.LOC:Local_timer_interrupts
388081 -16.2% 325074 ± 7% interrupts.CPU20.LOC:Local_timer_interrupts
2240 ± 2% -9.0% 2038 interrupts.CPU21.CAL:Function_call_interrupts
389389 -16.2% 326164 ± 7% interrupts.CPU21.LOC:Local_timer_interrupts
376711 ± 2% -15.9% 316963 ± 9% interrupts.CPU22.LOC:Local_timer_interrupts
7376 ± 13% -31.4% 5060 ± 26% interrupts.CPU22.NMI:Non-maskable_interrupts
7376 ± 13% -31.4% 5060 ± 26% interrupts.CPU22.PMI:Performance_monitoring_interrupts
385685 ± 2% -14.8% 328791 ± 7% interrupts.CPU23.LOC:Local_timer_interrupts
389444 -15.6% 328648 ± 7% interrupts.CPU24.LOC:Local_timer_interrupts
389223 -15.6% 328438 ± 7% interrupts.CPU25.LOC:Local_timer_interrupts
388691 -15.8% 327321 ± 7% interrupts.CPU26.LOC:Local_timer_interrupts
6996 ± 19% -40.0% 4197 ± 22% interrupts.CPU26.NMI:Non-maskable_interrupts
6996 ± 19% -40.0% 4197 ± 22% interrupts.CPU26.PMI:Performance_monitoring_interrupts
2219 ± 2% -10.7% 1982 ± 5% interrupts.CPU27.CAL:Function_call_interrupts
385376 ± 2% -14.7% 328864 ± 7% interrupts.CPU27.LOC:Local_timer_interrupts
2213 ± 2% -13.9% 1904 ± 4% interrupts.CPU28.CAL:Function_call_interrupts
389258 -15.5% 328941 ± 7% interrupts.CPU28.LOC:Local_timer_interrupts
93.00 ± 64% +168.5% 249.75 ± 38% interrupts.CPU28.RES:Rescheduling_interrupts
106.00 ± 15% -19.8% 85.00 interrupts.CPU29.63:IR-PCI-MSI.1572893-edge.eth0-TxRx-29
389229 -15.7% 328300 ± 7% interrupts.CPU29.LOC:Local_timer_interrupts
389429 -16.3% 325830 ± 7% interrupts.CPU3.LOC:Local_timer_interrupts
389512 -15.7% 328444 ± 7% interrupts.CPU30.LOC:Local_timer_interrupts
96.75 ± 3% -11.6% 85.50 interrupts.CPU31.65:IR-PCI-MSI.1572895-edge.eth0-TxRx-31
387455 -15.6% 326952 ± 8% interrupts.CPU31.LOC:Local_timer_interrupts
387090 -16.2% 324546 ± 7% interrupts.CPU32.LOC:Local_timer_interrupts
2220 -11.2% 1972 ± 4% interrupts.CPU33.CAL:Function_call_interrupts
388607 -16.0% 326588 ± 7% interrupts.CPU33.LOC:Local_timer_interrupts
98.50 ± 5% -13.7% 85.00 interrupts.CPU34.68:IR-PCI-MSI.1572898-edge.eth0-TxRx-34
389248 -16.0% 327059 ± 7% interrupts.CPU34.LOC:Local_timer_interrupts
387161 -15.4% 327696 ± 7% interrupts.CPU35.LOC:Local_timer_interrupts
2224 ± 2% -8.2% 2042 interrupts.CPU36.CAL:Function_call_interrupts
389398 -16.0% 327127 ± 7% interrupts.CPU36.LOC:Local_timer_interrupts
389205 -15.5% 328971 ± 7% interrupts.CPU37.LOC:Local_timer_interrupts
2230 ± 2% -8.0% 2051 interrupts.CPU38.CAL:Function_call_interrupts
388679 -15.5% 328300 ± 7% interrupts.CPU38.LOC:Local_timer_interrupts
389045 -16.1% 326591 ± 6% interrupts.CPU39.LOC:Local_timer_interrupts
2237 -9.2% 2031 interrupts.CPU4.CAL:Function_call_interrupts
389277 -16.4% 325298 ± 7% interrupts.CPU4.LOC:Local_timer_interrupts
1840 ± 76% -89.5% 193.25 ± 64% interrupts.CPU4.RES:Rescheduling_interrupts
385870 ± 2% -16.1% 323651 ± 7% interrupts.CPU40.LOC:Local_timer_interrupts
130.25 ± 42% -34.5% 85.25 interrupts.CPU41.77:IR-PCI-MSI.1572905-edge.eth0-TxRx-41
389286 -15.6% 328620 ± 7% interrupts.CPU41.LOC:Local_timer_interrupts
99.00 ± 7% -14.1% 85.00 interrupts.CPU42.78:IR-PCI-MSI.1572906-edge.eth0-TxRx-42
389414 -15.4% 329570 ± 7% interrupts.CPU42.LOC:Local_timer_interrupts
385254 ± 2% -14.7% 328570 ± 6% interrupts.CPU43.LOC:Local_timer_interrupts
1684 ± 12% -26.0% 1246 ± 24% interrupts.CPU43.RES:Rescheduling_interrupts
97.00 ± 3% -11.9% 85.50 interrupts.CPU44.80:IR-PCI-MSI.1572908-edge.eth0-TxRx-44
388409 -16.7% 323557 ± 6% interrupts.CPU44.LOC:Local_timer_interrupts
2227 ± 2% -7.9% 2051 interrupts.CPU45.CAL:Function_call_interrupts
389284 -16.0% 326872 ± 7% interrupts.CPU45.LOC:Local_timer_interrupts
98.25 ± 5% -13.5% 85.00 interrupts.CPU46.82:IR-PCI-MSI.1572910-edge.eth0-TxRx-46
2247 -8.9% 2048 interrupts.CPU46.CAL:Function_call_interrupts
389316 -17.1% 322687 ± 6% interrupts.CPU46.LOC:Local_timer_interrupts
389167 -16.9% 323395 ± 7% interrupts.CPU47.LOC:Local_timer_interrupts
389180 -16.2% 326248 ± 7% interrupts.CPU48.LOC:Local_timer_interrupts
389195 -16.2% 325973 ± 7% interrupts.CPU49.LOC:Local_timer_interrupts
84.00 ± 38% +433.0% 447.75 ± 5% interrupts.CPU49.RES:Rescheduling_interrupts
2233 -11.4% 1979 ± 7% interrupts.CPU5.CAL:Function_call_interrupts
389143 -16.6% 324362 ± 7% interrupts.CPU5.LOC:Local_timer_interrupts
389052 -16.1% 326392 ± 7% interrupts.CPU50.LOC:Local_timer_interrupts
2234 -8.2% 2050 interrupts.CPU51.CAL:Function_call_interrupts
389201 -16.2% 326313 ± 7% interrupts.CPU51.LOC:Local_timer_interrupts
133.25 ±106% +439.0% 718.25 ± 96% interrupts.CPU51.RES:Rescheduling_interrupts
137.25 ± 50% -37.2% 86.25 ± 2% interrupts.CPU52.88:IR-PCI-MSI.1572916-edge.eth0-TxRx-52
389195 -15.8% 327796 ± 6% interrupts.CPU52.LOC:Local_timer_interrupts
2231 ± 2% -11.3% 1980 ± 5% interrupts.CPU53.CAL:Function_call_interrupts
389397 -17.1% 322746 ± 6% interrupts.CPU53.LOC:Local_timer_interrupts
98.00 ± 2% -13.3% 85.00 interrupts.CPU54.90:IR-PCI-MSI.1572918-edge.eth0-TxRx-54
2226 ± 2% -9.8% 2009 interrupts.CPU54.CAL:Function_call_interrupts
389392 -15.7% 328139 ± 6% interrupts.CPU54.LOC:Local_timer_interrupts
2202 ± 3% -8.0% 2026 interrupts.CPU55.CAL:Function_call_interrupts
389020 -16.8% 323564 ± 6% interrupts.CPU55.LOC:Local_timer_interrupts
2201 ± 3% -8.0% 2024 interrupts.CPU56.CAL:Function_call_interrupts
389101 -16.2% 325920 ± 7% interrupts.CPU56.LOC:Local_timer_interrupts
389340 -16.5% 325226 ± 7% interrupts.CPU57.LOC:Local_timer_interrupts
389268 -16.7% 324348 ± 7% interrupts.CPU58.LOC:Local_timer_interrupts
389262 -16.3% 325733 ± 7% interrupts.CPU59.LOC:Local_timer_interrupts
389162 -16.2% 326293 ± 7% interrupts.CPU6.LOC:Local_timer_interrupts
389204 -16.5% 325121 ± 7% interrupts.CPU60.LOC:Local_timer_interrupts
389264 -17.3% 321878 ± 6% interrupts.CPU61.LOC:Local_timer_interrupts
99.75 ± 3% -14.3% 85.50 interrupts.CPU62.98:IR-PCI-MSI.1572926-edge.eth0-TxRx-62
389266 -16.3% 325806 ± 7% interrupts.CPU62.LOC:Local_timer_interrupts
389141 -16.2% 326016 ± 7% interrupts.CPU63.LOC:Local_timer_interrupts
2229 ± 2% -8.5% 2038 interrupts.CPU64.CAL:Function_call_interrupts
389386 -16.6% 324669 ± 7% interrupts.CPU64.LOC:Local_timer_interrupts
2228 ± 2% -8.5% 2040 interrupts.CPU65.CAL:Function_call_interrupts
387216 -15.7% 326368 ± 7% interrupts.CPU65.LOC:Local_timer_interrupts
63.75 ± 79% +296.9% 253.00 ± 74% interrupts.CPU65.RES:Rescheduling_interrupts
2227 ± 2% -10.2% 1999 ± 4% interrupts.CPU66.CAL:Function_call_interrupts
385255 ± 2% -14.8% 328054 ± 7% interrupts.CPU66.LOC:Local_timer_interrupts
389119 -15.5% 328876 ± 7% interrupts.CPU67.LOC:Local_timer_interrupts
2248 -9.5% 2033 interrupts.CPU68.CAL:Function_call_interrupts
389281 -15.5% 328872 ± 7% interrupts.CPU68.LOC:Local_timer_interrupts
2238 -8.9% 2038 interrupts.CPU69.CAL:Function_call_interrupts
387641 -15.1% 329127 ± 7% interrupts.CPU69.LOC:Local_timer_interrupts
114.75 ± 15% -21.1% 90.50 ± 4% interrupts.CPU7.41:IR-PCI-MSI.1572871-edge.eth0-TxRx-7
2237 -9.6% 2022 interrupts.CPU7.CAL:Function_call_interrupts
389222 -15.9% 327428 ± 6% interrupts.CPU7.LOC:Local_timer_interrupts
2237 -12.5% 1958 ± 4% interrupts.CPU70.CAL:Function_call_interrupts
389161 -15.4% 329317 ± 7% interrupts.CPU70.LOC:Local_timer_interrupts
2235 -14.1% 1921 ± 6% interrupts.CPU71.CAL:Function_call_interrupts
387094 -16.0% 325053 ± 7% interrupts.CPU71.LOC:Local_timer_interrupts
2230 -12.2% 1959 ± 7% interrupts.CPU72.CAL:Function_call_interrupts
385218 ± 3% -14.7% 328724 ± 7% interrupts.CPU72.LOC:Local_timer_interrupts
2228 -11.8% 1965 ± 5% interrupts.CPU73.CAL:Function_call_interrupts
389190 -15.6% 328359 ± 7% interrupts.CPU73.LOC:Local_timer_interrupts
2206 ± 2% -8.0% 2030 ± 3% interrupts.CPU74.CAL:Function_call_interrupts
389224 -15.6% 328332 ± 7% interrupts.CPU74.LOC:Local_timer_interrupts
389201 -15.4% 329338 ± 7% interrupts.CPU75.LOC:Local_timer_interrupts
388615 -15.9% 326680 ± 6% interrupts.CPU76.LOC:Local_timer_interrupts
7019 ± 18% -44.2% 3920 ± 28% interrupts.CPU76.NMI:Non-maskable_interrupts
7019 ± 18% -44.2% 3920 ± 28% interrupts.CPU76.PMI:Performance_monitoring_interrupts
387475 ± 2% -16.4% 323884 ± 8% interrupts.CPU77.LOC:Local_timer_interrupts
130.75 ± 65% +182.2% 369.00 ± 40% interrupts.CPU77.RES:Rescheduling_interrupts
389252 -15.6% 328557 ± 7% interrupts.CPU78.LOC:Local_timer_interrupts
389118 -16.1% 326275 ± 7% interrupts.CPU79.LOC:Local_timer_interrupts
2236 -9.6% 2021 interrupts.CPU8.CAL:Function_call_interrupts
389379 -15.7% 328370 ± 6% interrupts.CPU8.LOC:Local_timer_interrupts
389202 -15.5% 328727 ± 7% interrupts.CPU80.LOC:Local_timer_interrupts
389241 -15.5% 328995 ± 7% interrupts.CPU81.LOC:Local_timer_interrupts
7823 -42.3% 4515 ± 24% interrupts.CPU81.NMI:Non-maskable_interrupts
7823 -42.3% 4515 ± 24% interrupts.CPU81.PMI:Performance_monitoring_interrupts
36.75 ±105% +498.6% 220.00 ± 57% interrupts.CPU81.RES:Rescheduling_interrupts
2236 -8.8% 2039 interrupts.CPU82.CAL:Function_call_interrupts
389213 -15.7% 328062 ± 7% interrupts.CPU82.LOC:Local_timer_interrupts
2234 -8.9% 2035 interrupts.CPU83.CAL:Function_call_interrupts
389278 -16.7% 324286 ± 8% interrupts.CPU83.LOC:Local_timer_interrupts
48.75 ± 69% +1204.6% 636.00 ± 87% interrupts.CPU83.RES:Rescheduling_interrupts
2233 -10.7% 1994 ± 3% interrupts.CPU84.CAL:Function_call_interrupts
389378 -16.6% 324550 ± 7% interrupts.CPU84.LOC:Local_timer_interrupts
2238 ± 2% -9.1% 2034 interrupts.CPU85.CAL:Function_call_interrupts
389196 -15.5% 328979 ± 7% interrupts.CPU85.LOC:Local_timer_interrupts
2221 ± 3% -8.5% 2031 interrupts.CPU86.CAL:Function_call_interrupts
389301 -15.3% 329588 ± 6% interrupts.CPU86.LOC:Local_timer_interrupts
274.75 ±119% -86.0% 38.50 ± 66% interrupts.CPU86.RES:Rescheduling_interrupts
388613 -21.3% 306006 ± 13% interrupts.CPU87.LOC:Local_timer_interrupts
56.50 ± 82% +496.9% 337.25 ± 8% interrupts.CPU87.RES:Rescheduling_interrupts
389464 -16.0% 327073 ± 6% interrupts.CPU9.LOC:Local_timer_interrupts
34191771 -16.0% 28711614 ± 7% interrupts.LOC:Local_timer_interrupts
296.75 ± 18% +75.7% 521.50 ± 3% interrupts.TLB:TLB_shootdowns
vm-scalability.time.user_time
10200 +-+-----------------------------------------------------------------+
10000 +-+.++.+.+.+.+ +.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+ +.+.|
| |
9800 +-+ |
9600 +-+ |
| |
9400 +-+ |
9200 +-+ |
9000 +-+ |
| |
8800 +-+ |
8600 +-+ O O O |
O O OO O O O O O O O O OO O O O O |
8400 +-+ O O O O O O |
8200 +-+-----------------------------------------------------------------+
vm-scalability.time.maximum_resident_set_size
800000 +-+----------------------------------------------------------------+
| |
750000 +-+.++.+.+.++.+.+.++.+.+.++.+.+.+.++.+.+.++.+.+.++.+.+.++.+.+.++.+.|
700000 +-+ |
| |
650000 +-+ |
600000 +-+ |
| |
550000 +-+ |
500000 +-+ |
| |
450000 +-+ |
400000 +-+ |
O O OO O O OO O O OO O O OO O O O OO O O OO O O |
350000 +-+----------------------------------------------------------------+
vm-scalability.time.voluntary_context_switches
22000 +-+-----------------------------------------------------------------+
| |
20000 O-O OO O O O OO O O OO O O O OO O O O OO O O O O |
| |
| |
18000 +-+ |
| |
16000 +-+ |
| |
14000 +-+ |
| |
| |
12000 +-+ |
| |
10000 +-+-----------------------------------------------------------------+
vm-scalability.throughput
5.8e+06 +-+---------------------------------------------------------------+
5.7e+06 +-+ O O O O |
O OO O O O O OO O OO O OO O OO O |
5.6e+06 +-+ O O O |
5.5e+06 +-+ O |
5.4e+06 +-+ |
5.3e+06 +-+ |
| |
5.2e+06 +-+ |
5.1e+06 +-+ |
5e+06 +-+ |
4.9e+06 +-+ |
| +.+.+.++. |
4.8e+06 +-++.+.+.++.+.+.+ +.+.++.+.++.+.+.++.+.+.++.+.+.++.+.+.++.|
4.7e+06 +-+---------------------------------------------------------------+
vm-scalability.free_time
0.032 +-+-----------------------------------------------------------------+
|.+.++.+.+.+.++.+.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+.++.+.|
0.03 +-+ |
0.028 +-+ |
| |
0.026 +-+ |
0.024 +-+ |
| |
0.022 +-+ |
0.02 +-+ |
| |
0.018 +-+ |
0.016 +-+ |
O O OO O O O O O OO O O O OO O O O |
0.014 +-+------O-O--O-O-O-OO-------------------------O--------------------+
vm-scalability.median
66000 +-+-----------------------------------------------------------------+
O O O O O O O O |
64000 +-O OO O O O O OO O O OO O O O O |
| O O |
62000 +-+ |
| |
60000 +-+ |
| |
58000 +-+ |
| |
56000 +-+ |
| .+ .+.+.++.+.+. +. |
54000 +-+.++.+.+.+ + +.++.+.+.+.++.+.+.+.++.+.+.+ +.+.+.++.+.|
| |
52000 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 6 months
- 1
- 0
[modpost] 4a4d992c4e: WARNING:at_lib/kobject.c:#kobject_add_internal
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 4a4d992c4e5e2411df7c10065e2c3473681eb1e7 ("modpost: drop irrelevant .gnu.linkonce section")
https://github.com/ClangBuiltLinux/linux comdat
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------+------------+------------+
| | 4443f8e6ac | 4a4d992c4e |
+-------------------------------------------------+------------+------------+
| boot_successes | 3 | 2 |
| boot_failures | 4 | 6 |
| BUG:kernel_reboot-without-warning_in_test_stage | 4 | |
| WARNING:at_lib/kobject.c:#kobject_add_internal | 0 | 4 |
| RIP:kobject_add_internal | 0 | 4 |
| BUG:unable_to_handle_kernel | 0 | 1 |
| Oops:#[##] | 0 | 1 |
| RIP:kfree | 0 | 6 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 6 |
| kernel_BUG_at_mm/slub.c | 0 | 5 |
| invalid_opcode:#[##] | 0 | 5 |
+-------------------------------------------------+------------+------------+
[ 12.961581] WARNING: CPU: 1 PID: 264 at lib/kobject.c:228 kobject_add_internal+0x2bc/0x2e0
[ 12.964795] Modules linked in: (+)
[ 12.965833] CPU: 1 PID: 264 Comm: systemd-udevd Not tainted 5.1.0-rc4-00256-g4a4d992 #3
[ 12.968025] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 12.970279] RIP: 0010:kobject_add_internal+0x2bc/0x2e0
[ 12.971677] Code: 0f 98 48 c7 c7 e8 d4 39 98 e8 8e c9 69 ff e9 5c fe ff ff 0f 0b eb 9d 0f 0b eb 90 48 89 de 48 c7 c7 48 d4 39 98 e8 34 47 63 ff <0f> 0b bd ea ff ff ff e9 39 fe ff ff bd fe ff ff ff e9 2f fe ff ff
[ 12.977896] RSP: 0000:ffffad00405dfc80 EFLAGS: 00010282
[ 12.979373] RAX: 0000000000000000 RBX: ffffffffc01cb050 RCX: 0000000000000000
[ 12.981304] RDX: ffff897dabf1ef00 RSI: ffff897dabf16938 RDI: ffff897dabf16938
[ 12.983203] RBP: ffffad00405dfd30 R08: 000000000000026d R09: 0000000000000057
[ 12.985060] R10: ffffad00405dfd40 R11: ffffad00405dfb20 R12: ffffffff9835dd01
[ 12.986895] R13: ffffad00405dfd40 R14: 0000000000000000 R15: ffffffffc01cb018
[ 12.988706] FS: 00007f60e9f358c0(0000) GS:ffff897dabf00000(0000) knlGS:0000000000000000
[ 12.990956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 12.992481] CR2: 000055bc7c083058 CR3: 000000007e07e000 CR4: 00000000000406e0
[ 12.994311] Call Trace:
[ 12.995695] kobject_init_and_add+0x6f/0xb0
[ 12.996903] ? notifier_call_chain+0x47/0x70
[ 12.998118] load_module+0x226c/0x2980
[ 12.999225] ? finish_wait+0x80/0x80
[ 13.000302] ? __do_sys_finit_module+0xe9/0x110
[ 13.001567] __do_sys_finit_module+0xe9/0x110
[ 13.002797] do_syscall_64+0x5b/0x1a0
[ 13.003879] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.005255] RIP: 0033:0x7f60e8db2229
[ 13.006318] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 3f 4c 2b 00 f7 d8 64 89 01 48
[ 13.010973] RSP: 002b:00007ffc6f03bc48 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.013067] RAX: ffffffffffffffda RBX: 0000562c842fcc90 RCX: 00007f60e8db2229
[ 13.014874] RDX: 0000000000000000 RSI: 00007f60e96cb265 RDI: 000000000000000f
[ 13.016683] RBP: 00007f60e96cb265 R08: 0000000000000000 R09: 0000562c842f9880
[ 13.018490] R10: 000000000000000f R11: 0000000000000246 R12: 0000000000000000
[ 13.020297] R13: 0000562c842fc690 R14: 0000000000020000 R15: 0000562c828b8cbc
[ 13.022234] ---[ end trace 49245153fd3825d6 ]---
To reproduce:
# build kernel
cd linux
cp config-5.1.0-rc4-00256-g4a4d992 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 6 months
- 1
- 0