Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://git.kernel.org/pub/scm/linux/kernel/git/luto/linux.git x86/vmap_stack commit 5b669fb2e4a787ffe6844537b0d517cda6d3280f Author: Andy Lutomirski <luto(a)kernel.org&gt; AuthorDate: Mon Jun 20 09:14:57 2016 -0700 Commit: Andy Lutomirski <luto(a)kernel.org&gt; CommitDate: Sun Jun 26 21:33:07 2016 -0700 [DEBUG] force-enable CONFIG_VMAP_STACK +------------------------------------------------------------------+------------+------------+-----------------+ | | 475aeb9a05 | 5b669fb2e4 | v4.7-rc5_062712 | +------------------------------------------------------------------+------------+------------+-----------------+ | boot_successes | 910 | 304 | 126 | | boot_failures | 0 | 10 | 71 | | BUG:kernel_test_crashed | 0 | 4 | 3 | | BUG:unable_to_handle_kernel | 0 | 2 | 18 | | Oops | 0 | 2 | 18 | | RIP:_raw_spin_lock_irq | 0 | 2 | 18 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 2 | 17 | | backtrace:kthread_stop | 0 | 1 | | | backtrace:lock_torture_cleanup | 0 | 1 | | | backtrace:SyS_delete_module | 0 | 1 | | | invoked_oom-killer:gfp_mask=0x | 0 | 2 | | | Mem-Info | 0 | 2 | | | Kernel_panic-not_syncing:Out_of_memory_and_no_killable_processes | 0 | 2 | | | backtrace:vfs_write | 0 | 2 | | | backtrace:SyS_write | 0 | 2 | | | backtrace:populate_rootfs | 0 | 2 | | | backtrace:kernel_init_freeable | 0 | 2 | | | WARNING:at_kernel/fork.c:#free_task | 0 | 2 | 38 | | backtrace:_do_fork | 0 | 2 | 38 | | backtrace:SyS_clone | 0 | 2 | 38 | | backtrace:do_mount | 0 | 1 | 3 | | backtrace:SyS_mount | 0 | 1 | 3 | | WARNING:at_kernel/smp.c:#smp_call_function_many | 0 | 0 | 24 | | backtrace:schedule | 0 | 0 | 1 | | backtrace:cpu_startup_entry | 0 | 0 | 2 | | backtrace:do_wait | 0 | 0 | 3 | | backtrace:SyS_wait4 | 0 | 0 | 3 | | backtrace:async_run_entry_fn | 0 | 0 | 2 | | backtrace:do_vfs_ioctl | 0 | 0 | 2 | | backtrace:SyS_ioctl | 0 | 0 | 2 | | backtrace:sigsuspend | 0 | 0 | 1 | | backtrace:SyS_rt_sigsuspend | 0 | 0 | 1 | | BUG:kernel_boot_hang | 0 | 0 | 1 | +------------------------------------------------------------------+------------+------------+-----------------+ [ 1.664272] Write protecting the kernel read-only data: 14336k [ 1.665756] Freeing unused kernel memory: 896K (ffff880001920000 - ffff880001a00000) [ 1.667865] Freeing unused kernel memory: 176K (ffff880001dd4000 - ffff880001e00000) [ 1.790697] BUG: unable to handle kernel paging request at ffffc90000837f18 [ 1.792361] IP: [<ffffffff81916a2e>] _raw_spin_lock_irq+0x1e/0x40 [ 1.793598] PGD eca4067 PUD eca5067 PMD cb20067 PTE 0 [ 1.794916] Oops: 0002 [#1] SMP [ 1.795735] Modules linked in: [ 1.796613] CPU: 0 PID: 383 Comm: mount Not tainted 4.7.0-rc4-00257-g5b669fb #1 [ 1.798292] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Debian-1.8.2-1 04/01/2014 [ 1.800167] task: ffff88000c588000 ti: ffff88000c588000 task.ti: ffff88000c588000 [ 1.801958] RIP: 0010:[<ffffffff81916a2e>] [<ffffffff81916a2e>] _raw_spin_lock_irq+0x1e/0x40 [ 1.803858] RSP: 0018:ffffc900006efc80 EFLAGS: 00010046 [ 1.804914] RAX: 0000000000000000 RBX: ffffc90000837f18 RCX: 0000000000002766 [ 1.806174] RDX: 0000000000000001 RSI: ffff88000f61b880 RDI: ffffc90000837f18 [ 1.807440] RBP: ffffc900006efc80 R08: 000000000001b880 R09: ffffffff811bd531 [ 1.808712] R10: ffffea0000024b80 R11: ffff88000c605fc0 R12: 7fffffffffffffff [ 1.809981] R13: ffffc90000837f10 R14: ffff88000c588000 R15: ffff880000931000 [ 1.811238] FS: 00007f8b98446700(0000) GS:ffff88000f600000(0000) knlGS:0000000000000000 [ 1.813021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1.814135] CR2: ffffc90000837f18 CR3: 000000000093c000 CR4: 00000000001406f0 [ 1.815403] Stack: [ 1.816105] ffffc900006efcd8 ffffffff819131a7 0000000000000001 ffff88000c588000 [ 1.818151] ffffffff810a7fc0 ffffc90000837f20 ffffc90000837f20 ffffc90000837f10 [ 1.820134] ffff88000c644b80 0000000000000040 00000000ffffffea ffffc900006efd00 [ 1.822105] Call Trace: [ 1.822848] [<ffffffff819131a7>] wait_for_completion+0x107/0x130 [ 1.823992] [<ffffffff810a7fc0>] ? wake_up_q+0x70/0x70 [ 1.825046] [<ffffffff8109cf3f>] kthread_stop+0x4f/0x120 [ 1.826151] [<ffffffff81095f53>] destroy_workqueue+0x133/0x220 [ 1.827293] [<ffffffff813795c1>] xfs_destroy_mount_workqueues+0x31/0x70 [ 1.828524] [<ffffffff8137a17e>] xfs_fs_fill_super+0x2ee/0x4a0 [ 1.829663] [<ffffffff8120207d>] mount_bdev+0x17d/0x1b0 [ 1.830724] [<ffffffff81379e90>] ? xfs_test_remount_options+0x60/0x60 [ 1.832397] [<ffffffff81378d75>] xfs_fs_mount+0x15/0x20 [ 1.833471] [<ffffffff812029a8>] mount_fs+0x38/0x170 [ 1.834512] [<ffffffff8119de25>] ? __alloc_percpu+0x15/0x20 [ 1.835619] [<ffffffff8121fa84>] vfs_kern_mount+0x64/0x110 [ 1.836712] [<ffffffff812220e6>] do_mount+0x226/0xd70 [ 1.837762] [<ffffffff810a3afa>] ? __might_sleep+0x4a/0x90 [ 1.838862] [<ffffffff811987f3>] ? memdup_user+0x53/0x80 [ 1.839932] [<ffffffff81222f24>] SyS_mount+0x94/0xd0 [ 1.840964] [<ffffffff81916cf7>] entry_SYSCALL_64_fastpath+0x1a/0xa9 [ 1.842147] Code: 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 fa 66 0f 1f 44 00 00 65 ff 05 b1 69 6f 7e 31 c0 ba 01 00 00 00 <3e> 0f b1 17 85 c0 75 02 5d c3 89 c6 e8 b1 2f 7b ff 66 90 5d c3 [ 1.850137] RIP [<ffffffff81916a2e>] _raw_spin_lock_irq+0x1e/0x40 [ 1.851371] RSP <ffffc900006efc80> [ 1.852243] CR2: ffffc90000837f18 [ 1.853093] ---[ end trace 850c3fb5abd89a34 ]--- [ 1.854080] Kernel panic - not syncing: Fatal exception git bisect start 3e0297f63f1c298a01895959f0021b7050eb034d 4c2e07c6a29e0129e975727b9f57eede813eea85 -- git bisect bad 10f00b4cff1e2b0d0d6671f5caf780bdce2f0e27 # 17:11 0- 3 Merge 'linux-review/Peter-Ujfalusi/mfd-twl6040-Handle-mclk-used-for-HPPLL-and-optional-internal-clock-source/20160620-221638' into devel-hourly-2016062712 git bisect bad a5bd9669dce1b5183971f08089ac538aae1347b8 # 17:31 38- 1 Merge 'linux-review/Bin-Gao/mfd-intel_soc_pmic_bxtwc-Add-Intel-BXT-WhiskeyCove-PMIC-ADC-thermal-channel-mapping-and-USB-type-C-resources/20160623-154052' into devel-hourly-2016062712 git bisect bad 9456b80435dc296f6a2c0945c408280efc4da3d0 # 17:42 1- 2 Merge 'linux-review/Markus-Pargmann/nbd-make-nbd-device-wait-for-its-users/20160624-173511' into devel-hourly-2016062712 git bisect bad bcfb4e77aba0964def04f59e4ed0fc4e59aee111 # 18:09 130- 9 Merge 'hverkuil-media/cec-topic' into devel-hourly-2016062712 git bisect bad 5ebf9f0623eccc4410ab44826e47357ebee5ae32 # 18:22 0- 4 Merge 'linux-review/Stephen-Boyd/pinctrl-qcom-Clear-all-function-selection-bits/20160627-094125' into devel-hourly-2016062712 git bisect bad 2e09e40536bcbd6fb228d1560f5671bb8a275442 # 18:37 38- 2 Merge 'linux-review/Pan-Xinhui/implement-vcpu-preempted-check/20160627-103931' into devel-hourly-2016062712 git bisect bad 449b8398a9c65093a813e07d530b8b5b0bfe4165 # 18:48 5- 4 Merge 'linux-review/Darren-Stevens/Proposed-Patch-to-fix-boot-on-PA6T/20160627-104836' into devel-hourly-2016062712 git bisect bad a44879e2a1d44286a91aeaad5ce1ae7c57fdd018 # 19:00 0- 1 Merge 'luto/x86/vmap_stack' into devel-hourly-2016062712 git bisect good dbcb61cb87a8d6b210e7ea32282c7d0652d84448 # 19:30 305+ 2 0day base guard for 'devel-hourly-2016062712' git bisect good 949754d9791e3da2d70a9bb92e625b4d82e3ee6b # 19:45 310+ 4 Merge 'linux-review/neerajbadlani-gmail-com/update-makefile-message-for-installing-required-libs/20160627-125131' into devel-hourly-2016062712 git bisect good efad3585eef8334bc26a90f8debc16bfa1ed4d82 # 20:12 310+ 0 x86/mm: Improve stack-overflow #PF handling git bisect good 90f2d0658c9288e388be613b0fdec4c387c2b53c # 20:33 310+ 2 x86/entry: Get rid of pt_regs_to_thread_info() git bisect good 56c8928ebabd0c51b34056128ba686e38c867fe1 # 20:58 300+ 8 sched: Free the stack early if CONFIG_THREAD_INFO_IN_TASK git bisect bad 5b669fb2e4a787ffe6844537b0d517cda6d3280f # 21:14 49- 1 [DEBUG] force-enable CONFIG_VMAP_STACK git bisect good 475aeb9a05f564947e0e494b39faad7d874f5ef2 # 21:30 310+ 0 fork: Cache two thread stacks per cpu if CONFIG_VMAP_STACK is set # first bad commit: [5b669fb2e4a787ffe6844537b0d517cda6d3280f] [DEBUG] force-enable CONFIG_VMAP_STACK git bisect good 475aeb9a05f564947e0e494b39faad7d874f5ef2 # 21:44 910+ 0 fork: Cache two thread stacks per cpu if CONFIG_VMAP_STACK is set # extra tests on HEAD of linux-devel/devel-hourly-2016062712 git bisect bad 3e0297f63f1c298a01895959f0021b7050eb034d # 21:44 0- 71 0day head guard for 'devel-hourly-2016062712' # extra tests on tree/branch luto/x86/vmap_stack git bisect bad 53dae9db922e4446150ca9619ea33003f53bb90e # 21:45 0- 5 scatterlist: Support virtually-mapped stacks in sg_init_stackbuf() # extra tests with first bad commit reverted git bisect good 55011dd70992549a750639bf0ba51bd882e4adfb # 22:33 910+ 15 Revert "[DEBUG] force-enable CONFIG_VMAP_STACK" # extra tests on tree/branch linus/master git bisect good 4c2e07c6a29e0129e975727b9f57eede813eea85 # 22:48 910+ 15 Linux 4.7-rc5 # extra tests on tree/branch linux-next/master git bisect good aa20c9aa490a2b73f97bceae9828ccfaa9cb1b4f # 23:02 903+ 14 Add linux-next specific files for 20160627 This script may reproduce the error. ---------------------------------------------------------------------------- #!/bin/bash kernel=$1 initrd=yocto-minimal-x86_64.cgz wget --no-clobber https://github.com/fengguang/reproduce-kernel-bug/raw/master/initrd/$initrd kvm=( qemu-system-x86_64 -enable-kvm -cpu Haswell,+smep,+smap -kernel $kernel -initrd $initrd -m 256 -smp 1 -device e1000,netdev=net0 -netdev user,id=net0 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -serial stdio -display none -monitor null ) append=( hung_task_panic=1 earlyprintk=ttyS0,115200 systemd.log_level=err debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw drbd.minor_count=8 ) "${kvm[@]}" --append "${append[*]}" ---------------------------------------------------------------------------- --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/pipermail/lkp Intel Corporation