[mm, vmscan] 6963dd6128: vm-scalability.throughput -3.3% regression
by kernel test robot
FYI, we noticed vm-scalability.throughput -3.3% regression with the following commit:
https://git.kernel.org/pub/scm/linux/kernel/git/mel/linux mm-vmscan-node-lru-v5r9
commit 6963dd61283e853c4e17eb6c120fc595f3644638 ("mm, vmscan: Begin reclaiming pages on a per-node basis")
on test machine: lkp-sb02: threads Sandy Bridge-EP with 4G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase:
gcc-4.9/performance/x86_64-rhel/debian-x86_64-2015-02-07.cgz/300s/lkp-sb02/lru-file-readonce/vm-scalability
commit:
4365c69d07757b4f26cb23d4213be619269642b8
6963dd61283e853c4e17eb6c120fc595f3644638
4365c69d07757b4f 6963dd61283e853c4e17eb6c12
---------------- --------------------------
%stddev %change %stddev
\ | \
6128518 ± 0% -3.3% 5924537 ± 0% vm-scalability.throughput
205895 ± 3% +634.7% 1512732 ± 1% vm-scalability.time.involuntary_context_switches
314.00 ± 0% -2.4% 306.50 ± 0% vm-scalability.time.percent_of_cpu_this_job_got
916.83 ± 0% -2.4% 895.21 ± 0% vm-scalability.time.system_time
106053 ± 6% +29.9% 137776 ± 1% softirqs.RCU
205895 ± 3% +634.7% 1512732 ± 1% time.involuntary_context_switches
3572 ± 23% +290.8% 13963 ± 1% vmstat.system.cs
10102 ± 59% +90.7% 19268 ± 6% cpuidle.C1E-SNB.usage
18650 ±150% -92.7% 1361 ± 6% cpuidle.C6-SNB.usage
2364 ± 3% +40.6% 3322 ± 1% meminfo.Active(anon)
71205 ± 7% -14.4% 60965 ± 3% meminfo.DirectMap4k
36.17 ± 29% +18.0% 42.68 ± 0% turbostat.CorWatt
40.26 ± 26% +16.4% 46.88 ± 0% turbostat.PkgWatt
39566 ± 0% -10.8% 35289 ± 0% slabinfo.dentry.active_objs
1852 ± 2% -66.0% 629.50 ± 28% slabinfo.proc_inode_cache.active_objs
1908 ± 4% -61.1% 743.25 ± 27% slabinfo.proc_inode_cache.num_objs
366.53 ± 8% -18.0% 300.58 ± 10% sched_debug.cfs_rq:/.load.stddev
10247 ± 33% +54.8% 15858 ± 13% sched_debug.cfs_rq:/.min_vruntime.stddev
-8727 ±-83% +251.1% -30642 ±-35% sched_debug.cfs_rq:/.spread0.min
10247 ± 33% +54.8% 15859 ± 13% sched_debug.cfs_rq:/.spread0.stddev
442302 ± 30% -51.6% 214062 ± 17% sched_debug.cpu.avg_idle.avg
611019 ± 17% -36.6% 387365 ± 23% sched_debug.cpu.avg_idle.max
337551 ± 39% -66.5% 113210 ± 8% sched_debug.cpu.avg_idle.min
0.60 ± 6% -19.2% 0.48 ± 5% sched_debug.cpu.nr_running.stddev
191526 ± 27% +175.2% 527070 ± 0% sched_debug.cpu.nr_switches.avg
208823 ± 25% +167.9% 559430 ± 3% sched_debug.cpu.nr_switches.max
173499 ± 28% +186.7% 497478 ± 0% sched_debug.cpu.nr_switches.min
13313 ± 30% +79.3% 23868 ± 35% sched_debug.cpu.nr_switches.stddev
265997 ± 9% +107.6% 552287 ± 1% proc-vmstat.allocstall
759089 ± 36% -93.1% 52705 ±173% proc-vmstat.compact_free_scanned
11241 ± 67% -99.9% 8.25 ±173% proc-vmstat.compact_isolated
6959 ± 56% -99.9% 8.25 ±173% proc-vmstat.compact_migrate_scanned
128.25 ± 44% +385.8% 623.00 ± 5% proc-vmstat.kswapd_high_wmark_hit_quickly
604.25 ± 7% +35.9% 821.00 ± 0% proc-vmstat.nr_alloc_batch
3.475e+08 ± 0% -83.4% 57704068 ± 6% proc-vmstat.pgalloc_dma32
1.127e+08 ± 1% +243.5% 3.87e+08 ± 1% proc-vmstat.pgalloc_normal
5549 ± 68% -100.0% 0.25 ±173% proc-vmstat.pgmigrate_success
52969115 ± 9% -99.6% 224089 ± 2% proc-vmstat.pgscan_direct
4.06e+08 ± 1% +9.2% 4.434e+08 ± 0% proc-vmstat.pgscan_kswapd
52906329 ± 9% -99.6% 224088 ± 2% proc-vmstat.pgsteal_direct
4.059e+08 ± 1% +9.2% 4.433e+08 ± 0% proc-vmstat.pgsteal_kswapd
10.60 ± 2% +19.9% 12.71 ± 6% perf-profile.cycles.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead
5.55 ± 6% +50.9% 8.37 ± 10% perf-profile.cycles.__alloc_pages_slowpath.constprop.102.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead
0.00 ± -1% +Inf% 4.30 ± 1% perf-profile.cycles.__list_del_entry.isolate_lru_pages.shrink_inactive_list.shrink_zone_memcg.shrink_node
3.87 ± 2% -100.0% 0.00 ± -1% perf-profile.cycles.__list_del_entry.isolate_lru_pages.shrink_inactive_list.shrink_zone_memcg.shrink_zone
1.12 ± 12% -33.2% 0.75 ± 4% perf-profile.cycles.__list_del_entry.list_del.__rmqueue.get_page_from_freelist.__alloc_pages_nodemask
11.18 ± 1% +18.1% 13.20 ± 6% perf-profile.cycles.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.generic_file_read_iter
1.04 ± 1% -15.6% 0.88 ± 3% perf-profile.cycles.__radix_tree_create.__add_to_page_cache_locked.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages
0.00 ± -1% +Inf% 5.00 ± 0% perf-profile.cycles.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
5.88 ± 1% -100.0% 0.00 ± -1% perf-profile.cycles.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_zone
1.61 ± 10% -25.0% 1.21 ± 4% perf-profile.cycles.__rmqueue.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
0.00 ± -1% +Inf% 2.66 ± 18% perf-profile.cycles._raw_spin_lock.list_lru_count_one.super_cache_count.shrink_slab.shrink_node
1.19 ± 3% -27.2% 0.86 ± 2% perf-profile.cycles._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_zone_memcg
11.00 ± 1% +18.4% 13.03 ± 6% perf-profile.cycles.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead
2.84 ± 6% +103.6% 5.78 ± 17% perf-profile.cycles.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current
0.00 ± -1% +Inf% 7.12 ± 2% perf-profile.cycles.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
6.66 ± 0% -100.0% 0.00 ± -1% perf-profile.cycles.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_zone
5.23 ± 1% +10.7% 5.79 ± 1% perf-profile.cycles.free_pcppages_bulk.free_hot_cold_page.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list
4.39 ± 5% -16.0% 3.68 ± 2% perf-profile.cycles.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead
1.68 ± 7% +12.5% 1.89 ± 5% perf-profile.cycles.get_page_from_freelist.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
0.00 ± -1% +Inf% 5.64 ± 1% perf-profile.cycles.isolate_lru_pages.isra.52.shrink_inactive_list.shrink_zone_memcg.shrink_node.kswapd
4.95 ± 1% -100.0% 0.00 ± -1% perf-profile.cycles.isolate_lru_pages.isra.52.shrink_inactive_list.shrink_zone_memcg.shrink_zone.kswapd
1.17 ± 12% -29.2% 0.83 ± 4% perf-profile.cycles.list_del.__rmqueue.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current
0.00 ± -1% +Inf% 3.07 ± 19% perf-profile.cycles.list_lru_count_one.super_cache_count.shrink_slab.shrink_node.do_try_to_free_pages
0.00 ± -1% +Inf% 21.54 ± 1% perf-profile.cycles.shrink_inactive_list.shrink_zone_memcg.shrink_node.kswapd.kthread
2.48 ± 6% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_inactive_list.shrink_zone_memcg.shrink_zone.do_try_to_free_pages.try_to_free_pages
19.70 ± 0% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_inactive_list.shrink_zone_memcg.shrink_zone.kswapd.kthread
0.00 ± -1% +Inf% 5.30 ± 17% perf-profile.cycles.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
0.00 ± -1% +Inf% 22.54 ± 1% perf-profile.cycles.shrink_node.kswapd.kthread.ret_from_fork
0.00 ± -1% +Inf% 15.28 ± 1% perf-profile.cycles.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node.kswapd
1.79 ± 6% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_zone.do_try_to_free_pages
14.18 ± 0% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_zone.kswapd
0.00 ± -1% +Inf% 4.77 ± 17% perf-profile.cycles.shrink_slab.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
2.82 ± 6% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_zone.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
20.79 ± 0% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_zone.kswapd.kthread.ret_from_fork
0.00 ± -1% +Inf% 21.68 ± 1% perf-profile.cycles.shrink_zone_memcg.shrink_node.kswapd.kthread.ret_from_fork
2.58 ± 6% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_zone_memcg.shrink_zone.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
19.84 ± 0% -100.0% 0.00 ± -1% perf-profile.cycles.shrink_zone_memcg.shrink_zone.kswapd.kthread.ret_from_fork
0.00 ± -1% +Inf% 3.46 ± 18% perf-profile.cycles.super_cache_count.shrink_slab.shrink_node.do_try_to_free_pages.try_to_free_pages
2.85 ± 6% +103.7% 5.80 ± 17% perf-profile.cycles.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
1.61 ± 1% -21.4% 1.27 ± 1% perf-profile.cycles.unlock_page.do_mpage_readpage.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead
To reproduce:
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Xiaolong
4 years, 1 month
Re: [LKP] [lkp] [sched/fair] 41e0d37f7a: divide error: 0000 [#1] SMP
by Rafael J. Wysocki
On Tue, May 3, 2016 at 11:25 AM, Wanpeng Li <kernellwp(a)gmail.com> wrote:
> 2016-05-03 17:19 GMT+08:00 Wanpeng Li <kernellwp(a)gmail.com>:
>> 2016-05-03 16:32 GMT+08:00 Peter Zijlstra <peterz(a)infradead.org>:
>>> On Tue, May 03, 2016 at 09:10:51AM +0800, kernel test robot wrote:
>>>> FYI, we noticed the following commit:
>>>>
>>>> https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git sched/core
>>>> commit 41e0d37f7ac81297c07ba311e4ad39465b8c8295 ("sched/fair: Do not call cpufreq hook unless util changed")
>>>
>>>
>>>> [ 14.860950] Freeing unused kernel memory: 260K (ffff88103edbf000 - ffff88103ee00000)
>>>> [ 14.873013] systemd[1]: RTC configured in localtime, applying delta of 480 minutes to system time.
>>>> [ 14.884474] random: systemd urandom read with 5 bits of entropy available
>>>> [ 14.903975] divide error: 0000 [#1] SMP
>>>> [ 14.908375] Modules linked in:
>>>> [ 14.911793] CPU: 39 PID: 1 Comm: systemd Not tainted 4.6.0-rc4-00016-g41e0d37 #1
>>>> [ 14.920051] Hardware name: Intel Corporation S2600WP/S2600WP, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013
>>>> [ 14.931509] task: ffff8810101d8000 ti: ffff88081ab20000 task.ti: ffff88081ab20000
>>>> [ 14.939862] RIP: 0010:[<ffffffff8176ad32>] [<ffffffff8176ad32>] intel_pstate_get+0x32/0x40
>>>> [ 14.949202] RSP: 0018:ffff88081ab23d70 EFLAGS: 00010006
>>>> [ 14.955129] RAX: 0000000000000000 RBX: 0000000000000024 RCX: ffff8808091e0300
>>>> [ 14.963094] RDX: 0000000000000000 RSI: 0000000000000100 RDI: 0000000000000024
>>>> [ 14.971057] RBP: ffff88081ab23d88 R08: 0000000000001000 R09: 00000000096a1000
>>>> [ 14.979022] R10: 0000000000ffff10 R11: 000000000000000f R12: 0000000000000202
>>>> [ 14.986984] R13: ffff88101390a040 R14: ffff88100e48e180 R15: ffff88101390a040
>>>> [ 14.994950] FS: 00007f66fe117880(0000) GS:ffff8810139c0000(0000) knlGS:0000000000000000
>>>> [ 15.003982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>>> [ 15.010393] CR2: 000055f78b760098 CR3: 000000103d759000 CR4: 00000000001406e0
>>>> [ 15.018359] Stack:
>>>> [ 15.020602] ffffffff81764dad 0000000000000024 ffff88100e48e180 ffff88081ab23dc8
>>>> [ 15.028899] ffffffff81040267 ffff88101390a0ac 0000000000000340 ffff88081ab23f20
>>>> [ 15.037197] ffff88103cd7c400 ffff88100e48e180 ffff88101390a040 ffff88081ab23e30
>>>> [ 15.045493] Call Trace:
>>>> [ 15.048223] [<ffffffff81764dad>] ? cpufreq_quick_get+0x3d/0x90
>>>> [ 15.054832] [<ffffffff81040267>] show_cpuinfo+0x3c7/0x410
>>>> [ 15.060956] [<ffffffff8121f5c4>] seq_read+0x2c4/0x3a0
>>>> [ 15.066685] [<ffffffff81266ea8>] proc_reg_read+0x48/0x70
>>>> [ 15.072713] [<ffffffff811f9d58>] __vfs_read+0x28/0xd0
>>>> [ 15.078451] [<ffffffff813bab63>] ? security_file_permission+0xa3/0xc0
>>>> [ 15.085737] [<ffffffff811faa97>] ? rw_verify_area+0x57/0xd0
>>>> [ 15.092054] [<ffffffff811fab96>] vfs_read+0x86/0x130
>>>> [ 15.097691] [<ffffffff811fbf96>] SyS_read+0x46/0xa0
>>>> [ 15.103234] [<ffffffff818f71b2>] entry_SYSCALL_64_fastpath+0x1a/0xa4
>>>> [ 15.110421] Code: 05 dc 1b c3 00 89 ff 55 48 89 e5 48 8b 0c f8 48 85 c9 74 1f 48 63 51 1c 48 63 41 20 5d 48 0f af c2 31 d2 48 0f af 81 88 00 00 00 <48> f7 b1 90 00 00 00 c3 31 c0 5d c3 66 90 0f 1f 44 00 00 8b 77
>>>> [ 15.132161] RIP [<ffffffff8176ad32>] intel_pstate_get+0x32/0x40
>>>> [ 15.138875] RSP <ffff88081ab23d70>
>>>> [ 15.142770] ---[ end trace e5d5a8bedf5502e1 ]---
>>>> [ 15.149323] Kernel panic - not syncing: Fatal exception
>>>>
>>>
>>> That's intel_pstate.c:get_avg_frequency(), which assumes mperf != 0. It
>>> being 0 seems to suggest intel_pstate_sample() hasn't been called yet or
>>> so.
>>
>> I think one sample should be called during intel_pstate driver
>> initialization, how about the below patch(untested)?
>>
>> ----snip----
>>
>> diff --git a/drivers/cpufreq/intel_pstate.c b/drivers/cpufreq/intel_pstate.c
>> index 8b5a415..57b3843 100644
>> --- a/drivers/cpufreq/intel_pstate.c
>> +++ b/drivers/cpufreq/intel_pstate.c
>> @@ -1241,6 +1241,7 @@ static int intel_pstate_init_cpu(unsigned int cpunum)
>> intel_pstate_get_cpu_pstates(cpu);
>>
>> intel_pstate_busy_pid_reset(cpu);
>> + intel_pstate_sample(cpu);
>
> intel_pstate_sample(cpu, 0);
>
>>
>> cpu->update_util.func = intel_pstate_update_util;
That would avoid the divide by 0, but the value returned by
intel_pstate_get() would still be bogus.
4 years, 1 month
[lkp] [md] 8caa6068fa: kernel BUG at mm/slub.c:3656!
by kernel test robot
FYI, we noticed the following commit:
https://github.com/0day-ci/linux Michal-Hocko/tree-wide-get-rid-of-__GFP_REPEAT-for-order-0-allocations-part-I/20160428-212857
commit 8caa6068fa57b7187daedbfa9507d5ba4f962a41 ("md: simplify free_params for kmalloc vs vmalloc fallback")
on test machine: vm-lkp-wsx03-1G: 1 threads qemu-system-x86_64 -enable-kvm -cpu host with 1G memory
caused below changes:
+------------------------------------------+------------+------------+
| | 0b9466ab4a | 8caa6068fa |
+------------------------------------------+------------+------------+
| boot_successes | 10 | 2 |
| boot_failures | 0 | 6 |
| kernel_BUG_at_mm/slub.c | 0 | 6 |
| invalid_opcode:#[##]SMP | 0 | 6 |
| RIP:kfree | 0 | 6 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 6 |
| backtrace:do_vfs_ioctl | 0 | 6 |
| backtrace:SyS_ioctl | 0 | 6 |
+------------------------------------------+------------+------------+
[ 15.781036] device-mapper: uevent: version 1.0.3
[ 15.782750] device-mapper: ioctl: 4.34.0-ioctl (2015-10-28) initialised: dm-devel(a)redhat.com
[ 15.785199] ------------[ cut here ]------------
[ 15.786335] kernel BUG at mm/slub.c:3656!
[ 15.787557] invalid opcode: 0000 [#1] SMP
[ 15.788798] Modules linked in: dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver sg sr_mod cdrom ata_generic pata_acpi ppdev crc32c_intel snd_pcm snd_timer snd soundcore pcspkr serio_raw ata_piix i2c_piix4 libata parport_pc floppy parport acpi_cpufreq
[ 15.795806] CPU: 0 PID: 415 Comm: dmsetup Not tainted 4.6.0-rc3-00055-g8caa606 #1
[ 15.797800] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Debian-1.8.2-1 04/01/2014
[ 15.800016] task: ffff88003e87a440 ti: ffff88003f5d8000 task.ti: ffff88003f5d8000
[ 15.802071] RIP: 0010:[<ffffffff811d99f1>] [<ffffffff811d99f1>] kfree+0x131/0x170
[ 15.804179] RSP: 0018:ffff88003f5dbcd0 EFLAGS: 00010246
[ 15.805395] RAX: dead000000000100 RBX: ffff88003f5dbd28 RCX: 0000000000000000
[ 15.806812] RDX: 0000000000000000 RSI: ffff88003f5dbd28 RDI: ffff88003f5dbd28
[ 15.808348] RBP: ffff88003f5dbce8 R08: 0000000000000131 R09: 0000000000000000
[ 15.809769] R10: ffffea0000fd76c0 R11: 0000000000000000 R12: 0000000000000000
[ 15.811216] R13: ffffffff811944ca R14: ffff88003f5dbd28 R15: 0000000000000000
[ 15.812635] FS: 00007fda6089c800(0000) GS:ffff880037000000(0000) knlGS:0000000000000000
[ 15.814653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 15.815906] CR2: 000055ad4817a000 CR3: 000000003ee67000 CR4: 00000000000006f0
[ 15.817353] Stack:
[ 15.818142] 000055ad48177120 0000000000000000 0000000000000000 ffff88003f5dbcf8
[ 15.820375] ffffffff811944ca ffff88003f5dbe88 ffffffffa01d6552 ffff88003f5dbd80
[ 15.822589] ffffffff811ce6a3 0000000100000001 0000000000000131 0000002200000004
[ 15.824802] Call Trace:
[ 15.825674] [<ffffffff811944ca>] kvfree+0x2a/0x40
[ 15.826803] [<ffffffffa01d6552>] ctl_ioctl+0x262/0x520 [dm_mod]
[ 15.828097] [<ffffffff811ce6a3>] ? alloc_pages_vma+0xb3/0x230
[ 15.829374] [<ffffffffa01d6823>] dm_ctl_ioctl+0x13/0x20 [dm_mod]
[ 15.830670] [<ffffffff8120e4ff>] do_vfs_ioctl+0x8f/0x670
[ 15.831903] [<ffffffff813babb3>] ? security_file_ioctl+0x43/0x60
[ 15.833219] [<ffffffff8120eb59>] SyS_ioctl+0x79/0x90
[ 15.834403] [<ffffffff818f96b2>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[ 15.835747] Code: da 4c 89 ee ff d0 49 8b 04 24 48 85 c0 75 e6 65 ff 0d 7c 39 e3 7e e9 f9 fe ff ff 49 8b 02 f6 c4 40 75 0a 49 8b 42 20 a8 01 75 02 <0f> 0b 49 8b 02 31 f6 f6 c4 40 74 04 41 8b 72 6c 4c 89 d7 e8 07
[ 15.844575] RIP [<ffffffff811d99f1>] kfree+0x131/0x170
[ 15.845849] RSP <ffff88003f5dbcd0>
[ 15.846853] ---[ end trace 3d847d94459925d4 ]---
[ 15.848721] Kernel panic - not syncing: Fatal exception
FYI, raw QEMU command line is:
qemu-system-x86_64 -enable-kvm -cpu host -kernel /pkg/linux/x86_64-rhel/gcc-4.9/8caa6068fa57b7187daedbfa9507d5ba4f962a41/vmlinuz-4.6.0-rc3-00055-g8caa606 -append 'root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-lkp-wsx03-1G-5/bisect_fsmark-1x-32t-1HDD-btrfs-9B-400M-fsyncBeforeClose-16d-256fpd-debian-x86_64-2015-02-07.cgz-x86_64-rhel-8caa6068fa57b7187daedbfa9507d5ba4f962a41-20160429-80077-zxsib7-0.yaml ARCH=x86_64 kconfig=x86_64-rhel branch=linux-devel/devel-hourly-2016042901 commit=8caa6068fa57b7187daedbfa9507d5ba4f962a41 BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/8caa6068fa57b7187daedbfa9507d5ba4f962a41/vmlinuz-4.6.0-rc3-00055-g8caa606 max_uptime=2016 RESULT_ROOT=/result/fsmark/1x-32t-1HDD-btrfs-9B-400M-fsyncBeforeClose-16d-256fpd/vm-lkp-wsx03-1G/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/8caa6068fa57b7187daedbfa9507d5ba4f962a41/0 LKP_SERVER=inn earlyprintk=ttyS0,115200 systemd.log_level=err debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal rw ip=::::vm-lkp-wsx03-1G-5::dhcp' -initrd /fs/sdc1/initrd-vm-lkp-wsx03-1G-5 -m 1024 -smp 1 -device e1000,netdev=net0 -netdev user,id=net0,hostfwd=tcp::23604-:22 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -drive file=/fs/sdc1/disk0-vm-lkp-wsx03-1G-5,media=disk,if=virtio -drive file=/fs/sdc1/disk1-vm-lkp-wsx03-1G-5,media=disk,if=virtio -pidfile /dev/shm/kboot/pid-vm-lkp-wsx03-1G-5 -serial file:/dev/shm/kboot/serial-vm-lkp-wsx03-1G-5 -daemonize -display none -monitor null
To reproduce:
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Kernel Test Robot
4 years, 1 month
[lkp] [ASoC] 24164c2d37: BUG: unable to handle kernel
by kernel test robot
FYI, we noticed the following commit:
https://github.com/0day-ci/linux vedang-patel-intel-com/ASoC-Reduce-audio-related-kernel-spew/20160427-070807
commit 24164c2d37ef871e14780078cb1ff4fe90f76e78 ("ASoC: Intel: Skylake: Increase loglevel of debug messages.")
on test machine: vm-kbuild-1G: 2 threads qemu-system-x86_64 -enable-kvm -cpu Haswell,+smep,+smap with 1G memory
caused below changes:
[ 1.250173] Performance Events:
[ 1.250173] Performance Events: unsupported p6 CPU model 60 unsupported p6 CPU model 60 no PMU driver, software events only.
no PMU driver, software events only.
[ 1.286862] BUG: unable to handle kernel
[ 1.286862] BUG: unable to handle kernel NULL pointer dereferenceNULL pointer dereference at (null)
at (null)
[ 1.302122] IP:
[ 1.302122] IP: [<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[ 1.308529] PGD 0
[ 1.308529] PGD 0
[ 1.309125] Oops: 0000 [#1]
[ 1.309125] Oops: 0000 [#1]
[ 1.311225] CPU: 0 PID: 1 Comm: swapper Not tainted 4.6.0-rc5-00127-g24164c2 #2
[ 1.311225] CPU: 0 PID: 1 Comm: swapper Not tainted 4.6.0-rc5-00127-g24164c2 #2
[ 1.313394] task: ffff88000011a000 ti: ffff88000011c000 task.ti: ffff88000011c000
[ 1.313394] task: ffff88000011a000 ti: ffff88000011c000 task.ti: ffff88000011c000
[ 1.325487] RIP: 0010:[<ffffffff8800c361>]
[ 1.325487] RIP: 0010:[<ffffffff8800c361>] [<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[ 1.338189] RSP: 0000:ffff88000011fde0 EFLAGS: 00010286
[ 1.338189] RSP: 0000:ffff88000011fde0 EFLAGS: 00010286
[ 1.339640] RAX: 0000000000000000 RBX: 0000000000000004 RCX: ffffffffffffffff
[ 1.339640] RAX: 0000000000000000 RBX: 0000000000000004 RCX: ffffffffffffffff
[ 1.345523] RDX: ffffffffffffffc4 RSI: ffffffff84875105 RDI: 0000000000000000
[ 1.345523] RDX: ffffffffffffffc4 RSI: ffffffff84875105 RDI: 0000000000000000
[ 1.350793] RBP: ffff88000011fe30 R08: ffffffffffffffef R09: ffffffffffffffe9
[ 1.350793] RBP: ffff88000011fe30 R08: ffffffffffffffef R09: ffffffffffffffe9
[ 1.352935] R10: ffff88000011fd90 R11: 0000000000008001 R12: ffffffff8772b1e8
[ 1.352935] R10: ffff88000011fd90 R11: 0000000000008001 R12: ffffffff8772b1e8
[ 1.366765] R13: 00000000000001d1 R14: 0000000000000000 R15: ffffffff84875105
[ 1.366765] R13: 00000000000001d1 R14: 0000000000000000 R15: ffffffff84875105
[ 1.371474] FS: 0000000000000000(0000) GS:ffffffff84b4c000(0000) knlGS:0000000000000000
[ 1.371474] FS: 0000000000000000(0000) GS:ffffffff84b4c000(0000) knlGS:0000000000000000
[ 1.376489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1.376489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1.381509] CR2: 0000000000000000 CR3: 0000000004a0c000 CR4: 00000000000406f0
[ 1.381509] CR2: 0000000000000000 CR3: 0000000004a0c000 CR4: 00000000000406f0
[ 1.383648] Stack:
[ 1.383648] Stack:
[ 1.390087] 00000000787097a8
[ 1.390087] 00000000787097a8 0000000000000282 0000000000000282 0000000000000aec 0000000000000aec ffffffff8772b148 ffffffff8772b148
[ 1.397447] 00000cbe00052d61
[ 1.397447] 00000cbe00052d61 ffffffff8800c207 ffffffff8800c207 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 1.402442] 0000000000000002
[ 1.402442] 0000000000000002 000000000000000c 000000000000000c ffff88000011fec8 ffff88000011fec8 ffffffff87f4ab40 ffffffff87f4ab40
[ 1.412369] Call Trace:
[ 1.412369] Call Trace:
[ 1.413129] [<ffffffff8800c207>] ? dynamic_debug_init_debugfs+0x1e0/0x1e0
[ 1.413129] [<ffffffff8800c207>] ? dynamic_debug_init_debugfs+0x1e0/0x1e0
[ 1.420767] [<ffffffff87f4ab40>] do_one_initcall+0x430/0x7f4
[ 1.420767] [<ffffffff87f4ab40>] do_one_initcall+0x430/0x7f4
[ 1.422502] [<ffffffff81139e00>] ? native_irq_disable+0x7/0x7
[ 1.422502] [<ffffffff81139e00>] ? native_irq_disable+0x7/0x7
[ 1.431393] [<ffffffff83d31d10>] ? _raw_spin_unlock_irq+0x53/0xe4
[ 1.431393] [<ffffffff83d31d10>] ? _raw_spin_unlock_irq+0x53/0xe4
[ 1.433155] [<ffffffff87f4affe>] kernel_init_freeable+0xfa/0x499
[ 1.433155] [<ffffffff87f4affe>] kernel_init_freeable+0xfa/0x499
[ 1.441677] [<ffffffff83d13b83>] kernel_init+0x17/0x3fa
[ 1.441677] [<ffffffff83d13b83>] kernel_init+0x17/0x3fa
[ 1.447926] [<ffffffff83d331d2>] ret_from_fork+0x22/0x50
[ 1.447926] [<ffffffff83d331d2>] ret_from_fork+0x22/0x50
[ 1.449567] [<ffffffff83d13b6c>] ? rest_init+0x243/0x243
[ 1.449567] [<ffffffff83d13b6c>] ? rest_init+0x243/0x243
[ 1.457948] Code:
[ 1.457948] Code: f7 f7 f2 f2 ae ae 49 49 8b 8b 7c 7c 24 24 08 08 49 49 89 89 c8 c8 48 48 83 83 c9 c9 ff ff f2 f2 ae ae 49 49 8b 8b 7c 7c 24 24 10 10 49 49 89 89 c9 c9 48 48 83 83 c9 c9 ff ff f2 f2 ae ae 49 49 8b 8b 7c 7c 24 24 18 18 48 48 89 89 ca ca 48 48 83 83 c9 c9 ff ff <f2> <f2> ae ae 4c 4c 89 89 ff ff 48 48 89 89 c8 c8 8b 8b 4d 4d d0 d0 48 48 f7 f7 d0 d0 44 44 29 29 c9 c9 44 44 29 29 c1 c1 29 29
[ 1.479779] RIP
[ 1.479779] RIP [<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[<ffffffff8800c361>] dynamic_debug_init+0x15a/0x669
[ 1.488480] RSP <ffff88000011fde0>
[ 1.488480] RSP <ffff88000011fde0>
[ 1.489588] CR2: 0000000000000000
[ 1.489588] CR2: 0000000000000000
[ 1.497304] ---[ end trace 13f41c3d0b577fa5 ]---
[ 1.497304] ---[ end trace 13f41c3d0b577fa5 ]---
FYI, raw QEMU command line is:
qemu-system-x86_64 -enable-kvm -cpu Haswell,+smep,+smap -kernel /pkg/linux/x86_64-randconfig-v0-04271113/gcc-5/24164c2d37ef871e14780078cb1ff4fe90f76e78/vmlinuz-4.6.0-rc5-00127-g24164c2 -append 'root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-kbuild-1G-10/bisect_boot-1-debian-x86_64-2015-02-07.cgz-x86_64-randconfig-v0-04271113-24164c2d37ef871e14780078cb1ff4fe90f76e78-20160427-74012-1a1njq3-0.yaml ARCH=x86_64 kconfig=x86_64-randconfig-v0-04271113 branch=linux-devel/devel-spot-201604271010 commit=24164c2d37ef871e14780078cb1ff4fe90f76e78 BOOT_IMAGE=/pkg/linux/x86_64-randconfig-v0-04271113/gcc-5/24164c2d37ef871e14780078cb1ff4fe90f76e78/vmlinuz-4.6.0-rc5-00127-g24164c2 max_uptime=600 RESULT_ROOT=/result/boot/1/vm-kbuild-1G/debian-x86_64-2015-02-07.cgz/x86_64-randconfig-v0-04271113/gcc-5/24164c2d37ef871e14780078cb1ff4fe90f76e78/0 LKP_SERVER=inn earlyprintk=ttyS0,115200 systemd.log_level=err debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal rw ip=::::vm-kbuild-1G-10::dhcp' -initrd /fs/sde1/initrd-vm-kbuild-1G-10 -m 1024 -smp 2 -device e1000,netdev=net0 -netdev user,id=net0,hostfwd=tcp::23009-:22 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -device virtio-scsi-pci,id=scsi0 -drive file=/fs/sde1/disk0-vm-kbuild-1G-10,if=none,id=hd0,media=disk,aio=native,cache=none -device scsi-hd,bus=scsi0.0,drive=hd0,scsi-id=1,lun=0 -drive file=/fs/sde1/disk1-vm-kbuild-1G-10,if=none,id=hd1,media=disk,aio=native,cache=none -device scsi-hd,bus=scsi0.0,drive=hd1,scsi-id=1,lun=1 -drive file=/fs/sde1/disk2-vm-kbuild-1G-10,if=none,id=hd2,media=disk,aio=native,cache=none -device scsi-hd,bus=scsi0.0,drive=hd2,scsi-id=1,lun=2 -drive file=/fs/sde1/disk3-vm-kbuild-1G-10,if=none,id=hd3,media=disk,aio=native,cache=none -device scsi-hd,bus=scsi0.0,drive=hd3,scsi-id=1,lun=3 -drive file=/fs/sde1/disk4-vm-kbuild-1G-10,if=none,id=hd4,media=disk,aio=native,cache=none -device scsi-hd,bus=scsi0.0,drive=hd4,scsi-id=1,lun=4 -pidfile /dev/shm/kboot/pid-vm-kbuild-1G-10 -serial file:/dev/shm/kboot/serial-vm-kbuild-1G-10 -daemonize -display none -monitor null
Thanks,
Kernel Test Robot
4 years, 1 month
[lkp] 729be9b1d9: BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
by kernel test robot
FYI, we noticed the following commit:
https://github.com/goldwynr/linux kobjectify-fs
commit 729be9b1d9546819dcda6ed1c8f2a95f42f51047 ("Add kobject to super_block")
on test machine: vm-kbuild-yocto-ia32: 1 threads qemu-system-x86_64 -enable-kvm -cpu Westmere with 320M memory
caused below changes:
+------------------------------------------+------------+------------+
| | 7d7340c46f | 729be9b1d9 |
+------------------------------------------+------------+------------+
| boot_successes | 6 | 2 |
| boot_failures | 0 | 4 |
| BUG:unable_to_handle_kernel | 0 | 4 |
| Oops | 0 | 4 |
| RIP:destroy_super | 0 | 4 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 4 |
| backtrace:do_mount | 0 | 4 |
| backtrace:compat_SyS_mount | 0 | 4 |
+------------------------------------------+------------+------------+
[ 15.522335] floppy: error -5 while reading block 0
[ 15.542332] floppy: error -5 while reading block 0
[ 15.562325] floppy: error -5 while reading block 0
[ 15.563200] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
[ 15.563226] IP: [<ffffffff812158b7>] destroy_super+0x6d/0x82
[ 15.563229] PGD 29d9b067 PUD 29d7f067 PMD 0
[ 15.563231] Oops: 0000 [#1] SMP
[ 15.563233] Modules linked in:
[ 15.563236] CPU: 0 PID: 704 Comm: mount Not tainted 4.6.0-rc5-00002-g729be9b #2
[ 15.563237] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Debian-1.8.2-1 04/01/2014
[ 15.563238] task: ffff880029ccc0c0 ti: ffff880029cd0000 task.ti: ffff880029cd0000
[ 15.563241] RIP: 0010:[<ffffffff812158b7>] [<ffffffff812158b7>] destroy_super+0x6d/0x82
[ 15.563242] RSP: 0000:ffff880029cd3d50 EFLAGS: 00010287
[ 15.563244] RAX: 0000000000000000 RBX: ffff88002aeb4000 RCX: 0000000000000001
[ 15.563245] RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000246
[ 15.563246] RBP: ffff880029cd3d58 R08: 0000000000000080 R09: 0000000000000004
[ 15.563247] R10: ffff880029cd3cd0 R11: 00000000000042ad R12: 00000000ffffffea
[ 15.563248] R13: ffff88002aeb4000 R14: ffffffff81693d96 R15: ffffffff81693dad
[ 15.563250] FS: 0000000000000000(0000) GS:ffff880033600000(0063) knlGS:00000000f77826c0
[ 15.563251] CS: 0010 DS: 002b ES: 002b CR0: 0000000080050033
[ 15.563252] CR2: 0000000000000008 CR3: 000000002a25d000 CR4: 00000000000006f0
[ 15.563256] Stack:
[ 15.563259] ffffffff841343e0 ffff880029cd3db0 ffffffff812166cf 0000000000000010
[ 15.563261] ffff88002aeb4070 0000000000008010 0000000000000000 0000000000000000
[ 15.563264] 0000000000008010 ffff88002a372c20 ffffffff84134340 0000000000008010
[ 15.563264] Call Trace:
[ 15.563267] [<ffffffff812166cf>] sget+0x381/0x41c
[ 15.563272] [<ffffffff816945b2>] gfs2_mount_meta+0x76/0xdf
[ 15.563274] [<ffffffff812172ef>] mount_fs+0x67/0x131
[ 15.563278] [<ffffffff8122e8eb>] vfs_kern_mount+0x6c/0xde
[ 15.563280] [<ffffffff8123136d>] do_mount+0x8ce/0xa0f
[ 15.563283] [<ffffffff811cdd4b>] ? strndup_user+0x3f/0x59
[ 15.563286] [<ffffffff81257ea9>] compat_SyS_mount+0x185/0x1ae
[ 15.563290] [<ffffffff81003c35>] do_int80_syscall_32+0x5c/0x6b
[ 15.563295] [<ffffffff82eab59b>] entry_INT80_compat+0x3b/0x50
[ 15.563319] Code: 00 00 00 48 c7 c7 37 87 9e 83 e8 20 b2 ec ff 48 8b bb a8 09 00 00 e8 45 ad fe ff 48 8b bb b0 09 00 00 e8 39 ad fe ff 48 8b 43 28 <f6> 40 08 80 74 0c 48 8d bb 98 0b 00 00 e8 9e 83 55 00 5b 5d c3
[ 15.563321] RIP [<ffffffff812158b7>] destroy_super+0x6d/0x82
[ 15.563322] RSP <ffff880029cd3d50>
[ 15.563323] CR2: 0000000000000008
[ 15.563326] ---[ end trace 0e3e2869f15184ee ]---
[ 15.563328] Kernel panic - not syncing: Fatal exception
FYI, raw QEMU command line is:
qemu-system-x86_64 -enable-kvm -cpu Westmere -kernel /pkg/linux/x86_64-allyesdebian/gcc-5/729be9b1d9546819dcda6ed1c8f2a95f42f51047/vmlinuz-4.6.0-rc5-00002-g729be9b -append 'root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-kbuild-yocto-ia32-27/bisect_boot-1-yocto-minimal-i386.cgz-x86_64-allyesdebian-729be9b1d9546819dcda6ed1c8f2a95f42f51047-20160428-33921-171gjb8-0.yaml ARCH=x86_64 kconfig=x86_64-allyesdebian branch=linux-devel/devel-spot-201604281343 commit=729be9b1d9546819dcda6ed1c8f2a95f42f51047 BOOT_IMAGE=/pkg/linux/x86_64-allyesdebian/gcc-5/729be9b1d9546819dcda6ed1c8f2a95f42f51047/vmlinuz-4.6.0-rc5-00002-g729be9b max_uptime=600 RESULT_ROOT=/result/boot/1/vm-kbuild-yocto-ia32/yocto-minimal-i386.cgz/x86_64-allyesdebian/gcc-5/729be9b1d9546819dcda6ed1c8f2a95f42f51047/0 LKP_SERVER=inn earlyprintk=ttyS0,115200 systemd.log_level=err debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal rw ip=::::vm-kbuild-yocto-ia32-27::dhcp drbd.minor_count=8' -initrd /fs/sdf1/initrd-vm-kbuild-yocto-ia32-27 -m 832 -smp 1 -device e1000,netdev=net0 -netdev user,id=net0 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -drive file=/fs/sdf1/disk0-vm-kbuild-yocto-ia32-27,media=disk,if=virtio -pidfile /dev/shm/kboot/pid-vm-kbuild-yocto-ia32-27 -serial file:/dev/shm/kboot/serial-vm-kbuild-yocto-ia32-27 -daemonize -display none -monitor null
Thanks,
Kernel Test Robot
4 years, 1 month
[lkp] [pci] 5d7f599a3b: BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
by kernel test robot
FYI, we noticed the following commit:
https://github.com/0day-ci/linux Arnd-Bergmann/pci-add-new-method-for-register-PCI-hosts/20160430-070604
commit 5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1 ("pci: add new method for register PCI hosts")
on test machine: vm-lkp-wsx03-quantal-x86_64: 2 threads qemu-system-x86_64 -enable-kvm -cpu Haswell,+smep,+smap with 360M memory
caused below changes:
+------------------------------------------+------------+------------+
| | a84e2b702b | 5d7f599a3b |
+------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 0 | 3 |
| BUG:unable_to_handle_kernel | 0 | 3 |
| Oops | 0 | 3 |
| RIP:pci_create_root_bus_msi | 0 | 3 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 3 |
| backtrace:acpi_bus_scan | 0 | 3 |
| backtrace:acpi_scan_init | 0 | 3 |
| backtrace:acpi_init | 0 | 3 |
| backtrace:kernel_init_freeable | 0 | 3 |
+------------------------------------------+------------+------------+
[ 1.017131] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 1.018786] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[ 1.020369] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 1.023216] BUG: unable to handle kernel NULL pointer dereference at 0000000000000008
[ 1.025687] IP: [<ffffffff81510035>] pci_create_root_bus_msi+0xa9/0xd4
[ 1.027400] PGD 0
[ 1.028402] Oops: 0002 [#1] SMP
[ 1.029675] Modules linked in:
[ 1.030833] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 4.6.0-rc2-00033-g5d7f599 #1
[ 1.033064] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Debian-1.8.2-1 04/01/2014
[ 1.035492] task: ffff8800139e0000 ti: ffff8800139e8000 task.ti: ffff8800139e8000
[ 1.037783] RIP: 0010:[<ffffffff81510035>] [<ffffffff81510035>] pci_create_root_bus_msi+0xa9/0xd4
[ 1.040325] RSP: 0000:ffff8800139ebbd8 EFLAGS: 00010202
[ 1.041713] RAX: 0000000000000000 RBX: ffff880012ffc400 RCX: ffff880013b2d3c0
[ 1.043368] RDX: ffff880013b2d4e0 RSI: ffff880012ffc6c8 RDI: ffff880012ffc800
[ 1.045084] RBP: ffff8800139ebc10 R08: ffff880013b2d558 R09: 0000000000000000
[ 1.046799] R10: ffffea00004ecb40 R11: 000000000000ffff R12: ffff880013b2d578
[ 1.048447] R13: ffffffff823519e0 R14: 0000000000000000 R15: 0000000000000000
[ 1.050213] FS: 0000000000000000(0000) GS:ffff880014b00000(0000) knlGS:0000000000000000
[ 1.052748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1.054242] CR2: 0000000000000008 CR3: 0000000002206000 CR4: 00000000000006e0
[ 1.056014] Stack:
[ 1.056932] ffff880013b2d558 0000000000000000 ffff880013b2d540 ffff880013b29280
[ 1.059563] ffffffff82351900 ffff880013b2d558 ffff880013b2d3c0 ffff8800139ebc20
[ 1.062296] ffffffff81510071 ffff8800139ebc80 ffffffff8153beaa ffff880013b2d740
[ 1.065172] Call Trace:
[ 1.066875] [<ffffffff81510071>] pci_create_root_bus+0x11/0x13
[ 1.068622] [<ffffffff8153beaa>] acpi_pci_root_create+0x172/0x1de
[ 1.070129] [<ffffffff81932c57>] pci_acpi_scan_root+0x15b/0x191
[ 1.071603] [<ffffffff8153bb41>] acpi_pci_root_add+0x394/0x46c
[ 1.073019] [<ffffffff81537052>] acpi_bus_attach+0xd4/0x171
[ 1.074350] [<ffffffff815370ac>] acpi_bus_attach+0x12e/0x171
[ 1.075646] [<ffffffff815370ac>] acpi_bus_attach+0x12e/0x171
[ 1.077012] [<ffffffff815371f8>] acpi_bus_scan+0x5c/0x67
[ 1.078269] [<ffffffff8241e77e>] ? acpi_sleep_proc_init+0x28/0x28
[ 1.079631] [<ffffffff8241ec24>] acpi_scan_init+0x5b/0x190
[ 1.080913] [<ffffffff8241e77e>] ? acpi_sleep_proc_init+0x28/0x28
[ 1.082334] [<ffffffff8241e9f2>] acpi_init+0x274/0x291
[ 1.083563] [<ffffffff8100041a>] do_one_initcall+0xfd/0x18f
[ 1.084856] [<ffffffff823d4095>] kernel_init_freeable+0x196/0x21e
[ 1.086268] [<ffffffff81a8178e>] kernel_init+0xe/0xfd
[ 1.087491] [<ffffffff81a8c6e2>] ret_from_fork+0x22/0x50
[ 1.088809] [<ffffffff81a81780>] ? rest_init+0x87/0x87
[ 1.090040] Code: 4c 89 88 e8 02 00 00 49 8b 00 49 39 c0 74 27 48 8b 83 c8 02 00 00 49 8b 08 49 8b 50 08 48 89 71 08 48 89 8b c8 02 00 00 48 89 02 <48> 89 50 08 4d 89 00 4d 89 40 08 48 89 df e8 85 fb ff ff 85 c0
[ 1.099281] RIP [<ffffffff81510035>] pci_create_root_bus_msi+0xa9/0xd4
[ 1.100837] RSP <ffff8800139ebbd8>
[ 1.101905] CR2: 0000000000000008
[ 1.102903] ---[ end trace 4d306c15f7e3fb5d ]---
[ 1.104056] Kernel panic - not syncing: Fatal exception
FYI, raw QEMU command line is:
qemu-system-x86_64 -enable-kvm -cpu Haswell,+smep,+smap -kernel /pkg/linux/x86_64-lkp/gcc-4.9/5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1/vmlinuz-4.6.0-rc2-00033-g5d7f599 -append 'root=/dev/ram0 user=lkp job=/lkp/scheduled/vm-lkp-wsx03-quantal-x86_64-3/bisect_boot-1-quantal-core-x86_64.cgz-x86_64-lkp-5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1-20160430-100053-yxcns7-1.yaml ARCH=x86_64 kconfig=x86_64-lkp branch=linux-devel/devel-hourly-2016043008 commit=5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1 BOOT_IMAGE=/pkg/linux/x86_64-lkp/gcc-4.9/5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1/vmlinuz-4.6.0-rc2-00033-g5d7f599 max_uptime=600 RESULT_ROOT=/result/boot/1/vm-lkp-wsx03-quantal-x86_64/quantal-core-x86_64.cgz/x86_64-lkp/gcc-4.9/5d7f599a3b4fa1e1bcb10108ad2f728d4117aec1/0 LKP_SERVER=inn earlyprintk=ttyS0,115200 systemd.log_level=err debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal rw ip=::::vm-lkp-wsx03-quantal-x86_64-3::dhcp drbd.minor_count=8' -initrd /fs/sdc1/initrd-vm-lkp-wsx03-quantal-x86_64-3 -m 360 -smp 2 -device e1000,netdev=net0 -netdev user,id=net0 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -pidfile /dev/shm/kboot/pid-vm-lkp-wsx03-quantal-x86_64-3 -serial file:/dev/shm/kboot/serial-vm-lkp-wsx03-quantal-x86_64-3 -daemonize -display none -monitor null
Thanks,
Kernel Test Robot
4 years, 1 month
[lkp] [locking] 0b9e226a28: Kernel panic - not syncing: Hard LOCKUP
by kernel test robot
FYI, we noticed the following commit:
https://git.kernel.org/pub/scm/linux/kernel/git/peterz/queue.git locking/rfc
commit 0b9e226a281932811abc450b7026b3881c0dc2a7 ("locking: Introduce cmpwait()")
on test machine: lkp-snb01: Sandy Bridge-EP with 32G memory
caused below changes:
+--------------------------------------+------------+------------+
| | 21a0aef0cf | 0b9e226a28 |
+--------------------------------------+------------+------------+
| boot_successes | 11 | 19 |
| boot_failures | 0 | 10 |
| Kernel_panic-not_syncing:Hard_LOCKUP | 0 | 8 |
| backtrace:do_group_exit | 0 | 8 |
| backtrace:SyS_exit_group | 0 | 8 |
| invoked_oom-killer:gfp_mask=0x | 0 | 2 |
| Mem-Info | 0 | 2 |
| Out_of_memory:Kill_process | 0 | 2 |
| backtrace:vm_mmap_pgoff | 0 | 1 |
| backtrace:SyS_mmap_pgoff | 0 | 1 |
| backtrace:SyS_mmap | 0 | 1 |
| backtrace:_do_fork | 0 | 1 |
| backtrace:SyS_clone | 0 | 1 |
+--------------------------------------+------------+------------+
[ 133.726890] perf: interrupt took too long (3131 > 3130), lowering kernel.perf_event_max_sample_rate to 63000
[ 133.923128] perf: interrupt took too long (3953 > 3913), lowering kernel.perf_event_max_sample_rate to 50000
[ 231.641909] NMI watchdog: Watchdog detected hard LOCKUP on cpu 10
[ 231.648552] Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver sg sr_mod sd_mod cdrom x86_pkg_temp_thermal coretemp kvm_intel mgag200 snd_pcm isci ttm snd_timer kvm irqbypass libsas ahci crct10dif_pclmul crc32_pclmul snd crc32c_intel drm_kms_helper ghash_clmulni_intel aesni_intel soundcore libahci ipmi_devintf lrw syscopyarea sysfillrect sysimgblt fb_sys_fops scsi_transport_sas drm gf128mul sb_edac glue_helper libata pcspkr ablk_helper cryptd edac_core shpchp wmi ipmi_si ipmi_msghandler
[ 231.704107] CPU: 10 PID: 18817 Comm: hackbench Not tainted 4.6.0-rc5-00015-g0b9e226 #1
[ 231.714082] Hardware name: Intel Corporation S2600CP/S2600CP, BIOS SE5C600.86B.99.99.x036.091920111209 09/19/2011
[ 231.726725] 0000000000000000 ffff880824485bd0 ffffffff8142e6aa 0000000000000000
[ 231.736223] 0000000000000000 ffff880824485be8 ffffffff81129d9f ffff8808223f0000
[ 231.745740] ffff880824485c20 ffffffff8116a838 0000000000000001 ffff88082448a3c0
[ 231.755273] Call Trace:
[ 231.759216] <NMI> [<ffffffff8142e6aa>] dump_stack+0x63/0x89
[ 231.766883] [<ffffffff81129d9f>] watchdog_overflow_callback+0xbf/0xe0
[ 231.775415] [<ffffffff8116a838>] __perf_event_overflow+0x88/0x210
[ 231.783561] [<ffffffff8116b374>] perf_event_overflow+0x14/0x20
[ 231.791419] [<ffffffff8100c7ee>] intel_pmu_handle_irq+0x1ce/0x470
[ 231.799571] [<ffffffff81866e9a>] ? unix_destruct_scm+0xa/0x80
[ 231.807342] [<ffffffff811b79ec>] ? vunmap_page_range+0x20c/0x330
[ 231.815392] [<ffffffff811b7b21>] ? unmap_kernel_range_noflush+0x11/0x20
[ 231.824142] [<ffffffff814fedfe>] ? ghes_copy_tofrom_phys+0x11e/0x2a0
[ 231.832554] [<ffffffff8105890b>] ? native_apic_msr_write+0x2b/0x30
[ 231.840769] [<ffffffff8105878d>] ? x2apic_send_IPI_self+0x1d/0x20
[ 231.848892] [<ffffffff81032bc5>] ? arch_irq_work_raise+0x35/0x40
[ 231.856946] [<ffffffff81005afd>] perf_event_nmi_handler+0x2d/0x50
[ 231.865027] [<ffffffff810311bd>] nmi_handle+0x6d/0x130
[ 231.872029] [<ffffffff810317d8>] default_do_nmi+0x108/0x130
[ 231.879520] [<ffffffff810318e2>] do_nmi+0xe2/0x130
[ 231.886128] [<ffffffff818fa131>] end_repeat_nmi+0x1a/0x1e
[ 231.893392] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 231.902792] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 231.912180] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 231.921534] <<EOE>> [<ffffffff810c9de3>] queued_write_lock_slowpath+0x93/0xa0
[ 231.930809] [<ffffffff818f783d>] _raw_write_lock_irq+0x2d/0x30
[ 231.938498] [<ffffffff8107fa4c>] do_exit+0x3dc/0xb60
[ 231.945215] [<ffffffff81080255>] do_group_exit+0x45/0xb0
[ 231.952325] [<ffffffff810802d4>] SyS_exit_group+0x14/0x20
[ 231.959502] [<ffffffff818f7b72>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[ 231.967752] Kernel panic - not syncing: Hard LOCKUP
[ 231.974240] CPU: 10 PID: 18817 Comm: hackbench Not tainted 4.6.0-rc5-00015-g0b9e226 #1
[ 231.984129] Hardware name: Intel Corporation S2600CP/S2600CP, BIOS SE5C600.86B.99.99.x036.091920111209 09/19/2011
[ 231.996664] 0000000000000000 ffff880824485b40 ffffffff8142e6aa ffffffff81c99ad2
[ 232.006052] ffff880824485bd0 ffff880824485bc0 ffffffff81172df3 0000000000000010
[ 232.015422] ffff880824485bd0 ffff880824485b68 ffff880824485ba8 ffffffff81c9befb
[ 232.024772] Call Trace:
[ 232.028539] <NMI> [<ffffffff8142e6aa>] dump_stack+0x63/0x89
[ 232.036032] [<ffffffff81172df3>] panic+0xd0/0x217
[ 232.042424] [<ffffffff8107b72b>] nmi_panic+0x3b/0x40
[ 232.049079] [<ffffffff81129db0>] watchdog_overflow_callback+0xd0/0xe0
[ 232.057382] [<ffffffff8116a838>] __perf_event_overflow+0x88/0x210
[ 232.065271] [<ffffffff8116b374>] perf_event_overflow+0x14/0x20
[ 232.072910] [<ffffffff8100c7ee>] intel_pmu_handle_irq+0x1ce/0x470
[ 232.080751] [<ffffffff81866e9a>] ? unix_destruct_scm+0xa/0x80
[ 232.088172] [<ffffffff811b79ec>] ? vunmap_page_range+0x20c/0x330
[ 232.095852] [<ffffffff811b7b21>] ? unmap_kernel_range_noflush+0x11/0x20
[ 232.104200] [<ffffffff814fedfe>] ? ghes_copy_tofrom_phys+0x11e/0x2a0
[ 232.112240] [<ffffffff8105890b>] ? native_apic_msr_write+0x2b/0x30
[ 232.120080] [<ffffffff8105878d>] ? x2apic_send_IPI_self+0x1d/0x20
[ 232.127818] [<ffffffff81032bc5>] ? arch_irq_work_raise+0x35/0x40
[ 232.135452] [<ffffffff81005afd>] perf_event_nmi_handler+0x2d/0x50
[ 232.143184] [<ffffffff810311bd>] nmi_handle+0x6d/0x130
[ 232.149823] [<ffffffff810317d8>] default_do_nmi+0x108/0x130
[ 232.156946] [<ffffffff810318e2>] do_nmi+0xe2/0x130
[ 232.163195] [<ffffffff818fa131>] end_repeat_nmi+0x1a/0x1e
[ 232.170125] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 232.179199] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 232.188258] [<ffffffff810c89f2>] ? native_queued_spin_lock_slowpath+0x1a2/0x1d0
[ 232.197305] <<EOE>> [<ffffffff810c9de3>] queued_write_lock_slowpath+0x93/0xa0
[ 232.206287] [<ffffffff818f783d>] _raw_write_lock_irq+0x2d/0x30
[ 232.213687] [<ffffffff8107fa4c>] do_exit+0x3dc/0xb60
[ 232.220119] [<ffffffff81080255>] do_group_exit+0x45/0xb0
[ 232.226939] [<ffffffff810802d4>] SyS_exit_group+0x14/0x20
[ 232.233861] [<ffffffff818f7b72>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[ 232.761949] NMI watchdog: Watchdog detected hard LOCKUP on cpu 9
[ 232.768485] Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver sg sr_mod sd_mod cdrom x86_pkg_temp_thermal coretemp kvm_intel mgag200 snd_pcm isci ttm snd_timer kvm irqbypass libsas ahci crct10dif_pclmul crc32_pclmul snd crc32c_intel drm_kms_helper ghash_clmulni_intel aesni_intel soundcore libahci ipmi_devintf lrw syscopyarea sysfillrect sysimgblt fb_sys_fops scsi_transport_sas drm gf128mul sb_edac glue_helper libata pcspkr ablk_helper cryptd edac_core shpchp wmi ipmi_si ipmi_msghandler
[ 232.823222] CPU: 9 PID: 20066 Comm: hackbench Not tainted 4.6.0-rc5-00015-g0b9e226 #1
[ 232.832938] Hardware name: Intel Corporation S2600CP/S2600CP, BIOS SE5C600.86B.99.99.x036.091920111209 09/19/2011
[ 232.845398] 0000000000000000 ffff880824445bd0 ffffffff8142e6aa 0000000000000000
[ 232.854704] 0000000000000000 ffff880824445be8 ffffffff81129d9f ffff8808223a8000
[ 232.864014] ffff880824445c20 ffffffff8116a838 0000000000000001 ffff88082444a3c0
[ 232.873329] Call Trace:
[ 232.877061] <NMI> [<ffffffff8142e6aa>] dump_stack+0x63/0x89
[ 232.884509] [<ffffffff81129d9f>] watchdog_overflow_callback+0xbf/0xe0
[ 232.892812] [<ffffffff8116a838>] __perf_event_overflow+0x88/0x210
[ 232.900714] [<ffffffff8116b374>] perf_event_overflow+0x14/0x20
[ 232.908305] [<ffffffff8100c7ee>] intel_pmu_handle_irq+0x1ce/0x470
[ 232.916181] [<ffffffff818692f3>] ? unix_stream_read_generic+0x333/0x940
[ 232.924632] [<ffffffff811b79ec>] ? vunmap_page_range+0x20c/0x330
[ 232.932402] [<ffffffff811b7b21>] ? unmap_kernel_range_noflush+0x11/0x20
[ 232.940844] [<ffffffff814fedfe>] ? ghes_copy_tofrom_phys+0x11e/0x2a0
[ 232.948991] [<ffffffff814feff6>] ? ghes_read_estatus+0x76/0x140
[ 232.956644] [<ffffffff81005afd>] perf_event_nmi_handler+0x2d/0x50
[ 232.964520] [<ffffffff810311bd>] nmi_handle+0x6d/0x130
[ 232.971303] [<ffffffff81031714>] default_do_nmi+0x44/0x130
[ 232.978488] [<ffffffff810318e2>] do_nmi+0xe2/0x130
[ 232.984881] [<ffffffff818fa131>] end_repeat_nmi+0x1a/0x1e
[ 232.991945] [<ffffffff810c89ef>] ? native_queued_spin_lock_slowpath+0x19f/0x1d0
[ 233.001159] [<ffffffff810c89ef>] ? native_queued_spin_lock_slowpath+0x19f/0x1d0
[ 233.010357] [<ffffffff810c89ef>] ? native_queued_spin_lock_slowpath+0x19f/0x1d0
[ 233.019532] <<EOE>> [<ffffffff810c9de3>] queued_write_lock_slowpath+0x93/0xa0
[ 233.028649] [<ffffffff818f783d>] _raw_write_lock_irq+0x2d/0x30
[ 233.036192] [<ffffffff8107fa4c>] do_exit+0x3dc/0xb60
[ 233.042764] [<ffffffff81080255>] do_group_exit+0x45/0xb0
[ 233.049726] [<ffffffff810802d4>] SyS_exit_group+0x14/0x20
[ 233.056777] [<ffffffff818f7b72>] entry_SYSCALL_64_fastpath+0x1a/0xa4
[ 233.289338] Shutting down cpus with NMI
To reproduce:
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Kernel Test Robot
4 years, 1 month