5:30 p.m.
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 3626a285f87dceb4ca649d0ef015d7b295206cdf ("btrfs: introduce dedicated helper
to scrub simple-stripe based range")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: xfstests
version: xfstests-x86_64-1de1db8-1_20220217
with following parameters:
disk: 6HDD
fs: btrfs
test: btrfs-group-07
ucode: 0x28
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G
memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 65.408303][ T3224] BTRFS info (device sdb2): flagging fs with big metadata feature
[ 65.415944][ T3224] BTRFS info (device sdb2): disk space caching is enabled
[ 65.422842][ T3224] BTRFS info (device sdb2): has skinny extents
[ 65.436656][ T3224] BTRFS info (device sdb2): checking UUID tree
[ 66.134430][ T3293] BTRFS info (device sdb2): dev_replace from /dev/sdb3 (devid 2) to
/dev/sdb6 started
[ 67.823326][ T3293] divide error: 0000 [#1] SMP KASAN PTI
[ 67.828668][ T3293] CPU: 3 PID: 3293 Comm: btrfs Not tainted
5.17.0-rc5-00101-g3626a285f87d #1
[ 67.837169][ T3293] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
[ 67.844982][ T3293] RIP: 0010:scrub_stripe (kbuild/src/consumer/fs/btrfs/scrub.c:3448
kbuild/src/consumer/fs/btrfs/scrub.c:3486 kbuild/src/consumer/fs/btrfs/scrub.c:3644)
btrfs
[ 67.850976][ T3293] Code: 00 00 fc ff df 48 89 f9 48 c1 e9 03 0f b6 0c 11 48 89 fa 83 e2
07 83 c2 03 38 ca 7c 08 84 c9 0f 85 27 09 00 00 41 8b 5d 1c 99 <f7> fb 48 8b 54 24
30 48 c1 ea 03 48 63 e8 48 b8 00 00 00 00 00 fc
All code
========
0: 00 00 add %al,(%rax)
2: fc cld
3: ff (bad)
4: df 48 89 fisttps -0x77(%rax)
7: f9 stc
8: 48 c1 e9 03 shr $0x3,%rcx
c: 0f b6 0c 11 movzbl (%rcx,%rdx,1),%ecx
10: 48 89 fa mov %rdi,%rdx
13: 83 e2 07 and $0x7,%edx
16: 83 c2 03 add $0x3,%edx
19: 38 ca cmp %cl,%dl
1b: 7c 08 jl 0x25
1d: 84 c9 test %cl,%cl
1f: 0f 85 27 09 00 00 jne 0x94c
25: 41 8b 5d 1c mov 0x1c(%r13),%ebx
29: 99 cltd
2a:* f7 fb idiv %ebx <-- trapping instruction
2c: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
31: 48 c1 ea 03 shr $0x3,%rdx
35: 48 63 e8 movslq %eax,%rbp
38: 48 rex.W
39: b8 00 00 00 00 mov $0x0,%eax
3e: 00 fc add %bh,%ah
Code starting with the faulting instruction
===========================================
0: f7 fb idiv %ebx
2: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
7: 48 c1 ea 03 shr $0x3,%rdx
b: 48 63 e8 movslq %eax,%rbp
e: 48 rex.W
f: b8 00 00 00 00 mov $0x0,%eax
14: 00 fc add %bh,%ah
[ 67.870187][ T3293] RSP: 0018:ffffc9000a71f450 EFLAGS: 00010246
[ 67.876028][ T3293] RAX: 0000000000000004 RBX: 0000000000000000 RCX: 0000000000000000
[ 67.883756][ T3293] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff888129ec6d1c
[ 67.891491][ T3293] RBP: ffff8881453682a0 R08: 0000000000000001 R09: 0000000000000000
[ 67.899230][ T3293] R10: ffff88821534a063 R11: ffffed1042a6940c R12: ffff888121238000
[ 67.906955][ T3293] R13: ffff888129ec6d00 R14: ffff888145368000 R15: 0000000000000008
[ 67.914680][ T3293] FS: 00007f2851eb08c0(0000) GS:ffff8881a6d80000(0000)
knlGS:0000000000000000
[ 67.923351][ T3293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 67.929709][ T3293] CR2: 00007ffea4ff07f8 CR3: 000000010a0fc005 CR4: 00000000001706e0
[ 67.937437][ T3293] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 67.945163][ T3293] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 67.952891][ T3293] Call Trace:
[ 67.955992][ T3293] <TASK>
[ 67.958749][ T3293] ? kasan_save_stack (kbuild/src/consumer/mm/kasan/common.c:39)
[ 67.963395][ T3293] ? kasan_set_track (kbuild/src/consumer/mm/kasan/common.c:45)
[ 67.967951][ T3293] ? kasan_set_free_info (kbuild/src/consumer/mm/kasan/generic.c:372)
[ 67.972851][ T3293] ? mutex_unlock
(kbuild/src/consumer/arch/x86/include/asm/atomic64_64.h:190
kbuild/src/consumer/include/linux/atomic/atomic-long.h:449
kbuild/src/consumer/include/linux/atomic/atomic-instrumented.h:1790
kbuild/src/consumer/kernel/locking/mutex.c:178
kbuild/src/consumer/kernel/locking/mutex.c:537)
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation
Thanks,
Oliver Sang
6:47 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
On 2022/3/1 14:30, kernel test robot wrote:
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 3626a285f87dceb4ca649d0ef015d7b295206cdf ("btrfs: introduce dedicated helper
to scrub simple-stripe based range")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: xfstests
version: xfstests-x86_64-1de1db8-1_20220217
with following parameters:
disk: 6HDD
fs: btrfs
test: btrfs-group-07
ucode: 0x28
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G
memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 65.408303][ T3224] BTRFS info (device sdb2): flagging fs with big metadata feature
[ 65.415944][ T3224] BTRFS info (device sdb2): disk space caching is enabled
[ 65.422842][ T3224] BTRFS info (device sdb2): has skinny extents
[ 65.436656][ T3224] BTRFS info (device sdb2): checking UUID tree
[ 66.134430][ T3293] BTRFS info (device sdb2): dev_replace from /dev/sdb3 (devid 2) to
/dev/sdb6 started
[ 67.823326][ T3293] divide error: 0000 [#1] SMP KASAN PTI
[ 67.828668][ T3293] CPU: 3 PID: 3293 Comm: btrfs Not tainted
5.17.0-rc5-00101-g3626a285f87d #1
[ 67.837169][ T3293] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
[ 67.844982][ T3293] RIP: 0010:scrub_stripe (kbuild/src/consumer/fs/btrfs/scrub.c:3448
kbuild/src/consumer/fs/btrfs/scrub.c:3486 kbuild/src/consumer/fs/btrfs/scrub.c:3644)
btrfs
[ 67.850976][ T3293] Code: 00 00 fc ff df 48 89 f9 48 c1 e9 03 0f b6 0c 11 48 89 fa 83 e2
07 83 c2 03 38 ca 7c 08 84 c9 0f 85 27 09 00 00 41 8b 5d 1c 99 <f7> fb 48 8b 54 24
30 48 c1 ea 03 48 63 e8 48 b8 00 00 00 00 00 fc
All code
This is weird, the code is from simple_stripe_full_stripe_len(), which
means the chunk map must be RAID0 or RAID10.
In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
which all have either 1 or 2 sub_stripes.
Although the code is old, not the latest version, it should still not
cause such problem.
Mind to retest with my branch to see if it can be reproduced?
https://github.com/adam900710/linux/tree/refactor_scrub
Thanks,
Qu
> ========
> 0: 00 00 add %al,(%rax)
> 2: fc cld
> 3: ff (bad)
> 4: df 48 89 fisttps -0x77(%rax)
> 7: f9 stc
> 8: 48 c1 e9 03 shr $0x3,%rcx
> c: 0f b6 0c 11 movzbl (%rcx,%rdx,1),%ecx
> 10: 48 89 fa mov %rdi,%rdx
> 13: 83 e2 07 and $0x7,%edx
> 16: 83 c2 03 add $0x3,%edx
> 19: 38 ca cmp %cl,%dl
> 1b: 7c 08 jl 0x25
> 1d: 84 c9 test %cl,%cl
> 1f: 0f 85 27 09 00 00 jne 0x94c
> 25: 41 8b 5d 1c mov 0x1c(%r13),%ebx
> 29: 99 cltd
> 2a:* f7 fb idiv %ebx <-- trapping instruction
> 2c: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
> 31: 48 c1 ea 03 shr $0x3,%rdx
> 35: 48 63 e8 movslq %eax,%rbp
> 38: 48 rex.W
> 39: b8 00 00 00 00 mov $0x0,%eax
> 3e: 00 fc add %bh,%ah
>
> Code starting with the faulting instruction
> ===========================================
> 0: f7 fb idiv %ebx
> 2: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
> 7: 48 c1 ea 03 shr $0x3,%rdx
> b: 48 63 e8 movslq %eax,%rbp
> e: 48 rex.W
> f: b8 00 00 00 00 mov $0x0,%eax
> 14: 00 fc add %bh,%ah
> [ 67.870187][ T3293] RSP: 0018:ffffc9000a71f450 EFLAGS: 00010246
> [ 67.876028][ T3293] RAX: 0000000000000004 RBX: 0000000000000000 RCX:
0000000000000000
> [ 67.883756][ T3293] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff888129ec6d1c
> [ 67.891491][ T3293] RBP: ffff8881453682a0 R08: 0000000000000001 R09:
0000000000000000
> [ 67.899230][ T3293] R10: ffff88821534a063 R11: ffffed1042a6940c R12:
ffff888121238000
> [ 67.906955][ T3293] R13: ffff888129ec6d00 R14: ffff888145368000 R15:
0000000000000008
> [ 67.914680][ T3293] FS: 00007f2851eb08c0(0000) GS:ffff8881a6d80000(0000)
knlGS:0000000000000000
> [ 67.923351][ T3293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 67.929709][ T3293] CR2: 00007ffea4ff07f8 CR3: 000000010a0fc005 CR4:
00000000001706e0
> [ 67.937437][ T3293] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
> [ 67.945163][ T3293] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
0000000000000400
> [ 67.952891][ T3293] Call Trace:
> [ 67.955992][ T3293] <TASK>
> [ 67.958749][ T3293] ? kasan_save_stack (kbuild/src/consumer/mm/kasan/common.c:39)
> [ 67.963395][ T3293] ? kasan_set_track (kbuild/src/consumer/mm/kasan/common.c:45)
> [ 67.967951][ T3293] ? kasan_set_free_info
(kbuild/src/consumer/mm/kasan/generic.c:372)
> [ 67.972851][ T3293] ? mutex_unlock
(kbuild/src/consumer/arch/x86/include/asm/atomic64_64.h:190
kbuild/src/consumer/include/linux/atomic/atomic-long.h:449
kbuild/src/consumer/include/linux/atomic/atomic-instrumented.h:1790
kbuild/src/consumer/kernel/locking/mutex.c:178
kbuild/src/consumer/kernel/locking/mutex.c:537)
>
>
> To reproduce:
>
> git clone https://github.com/intel/lkp-tests.git
> cd lkp-tests
> sudo bin/lkp install job.yaml # job file is attached in this
email
> bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp
run
> sudo bin/lkp run generated-yaml-file
>
> # if come across any failure that blocks the test,
> # please remove ~/.lkp and /lkp dir to run from a clean state.
>
>
>
> ---
> 0DAY/LKP+ Test Infrastructure Open Source Technology Center
> https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation
>
> Thanks,
> Oliver Sang
>
7:44 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
Hi Qu,
On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
On 2022/3/1 14:30, kernel test robot wrote:
>
>
> Greeting,
>
> FYI, we noticed the following commit (built with gcc-9):
>
> commit: 3626a285f87dceb4ca649d0ef015d7b295206cdf ("btrfs: introduce dedicated
helper to scrub simple-stripe based range")
> https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
>
> in testcase: xfstests
> version: xfstests-x86_64-1de1db8-1_20220217
> with following parameters:
>
> disk: 6HDD
> fs: btrfs
> test: btrfs-group-07
> ucode: 0x28
>
> test-description: xfstests is a regression test suite for xfs and other files
ystems.
> test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
>
>
> on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G
memory
>
> caused below changes (please refer to attached dmesg/kmsg for entire
log/backtrace):
>
>
>
> If you fix the issue, kindly add following tag
> Reported-by: kernel test robot <oliver.sang(a)intel.com>
>
>
> [ 65.408303][ T3224] BTRFS info (device sdb2): flagging fs with big metadata
feature
> [ 65.415944][ T3224] BTRFS info (device sdb2): disk space caching is enabled
> [ 65.422842][ T3224] BTRFS info (device sdb2): has skinny extents
> [ 65.436656][ T3224] BTRFS info (device sdb2): checking UUID tree
> [ 66.134430][ T3293] BTRFS info (device sdb2): dev_replace from /dev/sdb3 (devid
2) to /dev/sdb6 started
> [ 67.823326][ T3293] divide error: 0000 [#1] SMP KASAN PTI
> [ 67.828668][ T3293] CPU: 3 PID: 3293 Comm: btrfs Not tainted
5.17.0-rc5-00101-g3626a285f87d #1
> [ 67.837169][ T3293] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
> [ 67.844982][ T3293] RIP: 0010:scrub_stripe
(kbuild/src/consumer/fs/btrfs/scrub.c:3448 kbuild/src/consumer/fs/btrfs/scrub.c:3486
kbuild/src/consumer/fs/btrfs/scrub.c:3644) btrfs
> [ 67.850976][ T3293] Code: 00 00 fc ff df 48 89 f9 48 c1 e9 03 0f b6 0c 11 48 89 fa
83 e2 07 83 c2 03 38 ca 7c 08 84 c9 0f 85 27 09 00 00 41 8b 5d 1c 99 <f7> fb 48 8b
54 24 30 48 c1 ea 03 48 63 e8 48 b8 00 00 00 00 00 fc
> All code
This is weird, the code is from simple_stripe_full_stripe_len(), which
means the chunk map must be RAID0 or RAID10.
In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
which all have either 1 or 2 sub_stripes.
Although the code is old, not the latest version, it should still not
cause such problem.
Mind to retest with my branch to see if it can be reproduced?
https://github.com/adam900710/linux/tree/refactor_scrub
we tested head of this branch:
d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
and:
fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based range
on this branch.
by attached config.
still reproduce the same issue.
attached dmesgs FYI.
Thanks,
Qu
> ========
> 0: 00 00 add %al,(%rax)
> 2: fc cld
> 3: ff (bad)
> 4: df 48 89 fisttps -0x77(%rax)
> 7: f9 stc
> 8: 48 c1 e9 03 shr $0x3,%rcx
> c: 0f b6 0c 11 movzbl (%rcx,%rdx,1),%ecx
> 10: 48 89 fa mov %rdi,%rdx
> 13: 83 e2 07 and $0x7,%edx
> 16: 83 c2 03 add $0x3,%edx
> 19: 38 ca cmp %cl,%dl
> 1b: 7c 08 jl 0x25
> 1d: 84 c9 test %cl,%cl
> 1f: 0f 85 27 09 00 00 jne 0x94c
> 25: 41 8b 5d 1c mov 0x1c(%r13),%ebx
> 29: 99 cltd
> 2a:* f7 fb idiv %ebx <-- trapping instruction
> 2c: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
> 31: 48 c1 ea 03 shr $0x3,%rdx
> 35: 48 63 e8 movslq %eax,%rbp
> 38: 48 rex.W
> 39: b8 00 00 00 00 mov $0x0,%eax
> 3e: 00 fc add %bh,%ah
>
> Code starting with the faulting instruction
> ===========================================
> 0: f7 fb idiv %ebx
> 2: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
> 7: 48 c1 ea 03 shr $0x3,%rdx
> b: 48 63 e8 movslq %eax,%rbp
> e: 48 rex.W
> f: b8 00 00 00 00 mov $0x0,%eax
> 14: 00 fc add %bh,%ah
> [ 67.870187][ T3293] RSP: 0018:ffffc9000a71f450 EFLAGS: 00010246
> [ 67.876028][ T3293] RAX: 0000000000000004 RBX: 0000000000000000 RCX:
0000000000000000
> [ 67.883756][ T3293] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff888129ec6d1c
> [ 67.891491][ T3293] RBP: ffff8881453682a0 R08: 0000000000000001 R09:
0000000000000000
> [ 67.899230][ T3293] R10: ffff88821534a063 R11: ffffed1042a6940c R12:
ffff888121238000
> [ 67.906955][ T3293] R13: ffff888129ec6d00 R14: ffff888145368000 R15:
0000000000000008
> [ 67.914680][ T3293] FS: 00007f2851eb08c0(0000) GS:ffff8881a6d80000(0000)
knlGS:0000000000000000
> [ 67.923351][ T3293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 67.929709][ T3293] CR2: 00007ffea4ff07f8 CR3: 000000010a0fc005 CR4:
00000000001706e0
> [ 67.937437][ T3293] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
> [ 67.945163][ T3293] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
0000000000000400
> [ 67.952891][ T3293] Call Trace:
> [ 67.955992][ T3293] <TASK>
> [ 67.958749][ T3293] ? kasan_save_stack (kbuild/src/consumer/mm/kasan/common.c:39)
> [ 67.963395][ T3293] ? kasan_set_track (kbuild/src/consumer/mm/kasan/common.c:45)
> [ 67.967951][ T3293] ? kasan_set_free_info
(kbuild/src/consumer/mm/kasan/generic.c:372)
> [ 67.972851][ T3293] ? mutex_unlock
(kbuild/src/consumer/arch/x86/include/asm/atomic64_64.h:190
kbuild/src/consumer/include/linux/atomic/atomic-long.h:449
kbuild/src/consumer/include/linux/atomic/atomic-instrumented.h:1790
kbuild/src/consumer/kernel/locking/mutex.c:178
kbuild/src/consumer/kernel/locking/mutex.c:537)
>
>
> To reproduce:
>
> git clone https://github.com/intel/lkp-tests.git
> cd lkp-tests
> sudo bin/lkp install job.yaml # job file is attached in this
email
> bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp
run
> sudo bin/lkp run generated-yaml-file
>
> # if come across any failure that blocks the test,
> # please remove ~/.lkp and /lkp dir to run from a clean state.
>
>
>
> ---
> 0DAY/LKP+ Test Infrastructure Open Source Technology Center
> https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation
>
> Thanks,
> Oliver Sang
>
6:26 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
On 2022/3/2 16:44, Oliver Sang wrote:
Hi Qu,
On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>
>
> On 2022/3/1 14:30, kernel test robot wrote:
>>
>>
>> Greeting,
>>
>> FYI, we noticed the following commit (built with gcc-9):
>>
>> commit: 3626a285f87dceb4ca649d0ef015d7b295206cdf ("btrfs: introduce
dedicated helper to scrub simple-stripe based range")
>> https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
>>
>> in testcase: xfstests
>> version: xfstests-x86_64-1de1db8-1_20220217
>> with following parameters:
>>
>> disk: 6HDD
>> fs: btrfs
>> test: btrfs-group-07
>> ucode: 0x28
>>
>> test-description: xfstests is a regression test suite for xfs and other files
ystems.
>> test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
>>
>>
>> on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with
8G memory
>>
>> caused below changes (please refer to attached dmesg/kmsg for entire
log/backtrace):
>>
>>
>>
>> If you fix the issue, kindly add following tag
>> Reported-by: kernel test robot <oliver.sang(a)intel.com>
>>
>>
>> [ 65.408303][ T3224] BTRFS info (device sdb2): flagging fs with big metadata
feature
>> [ 65.415944][ T3224] BTRFS info (device sdb2): disk space caching is enabled
>> [ 65.422842][ T3224] BTRFS info (device sdb2): has skinny extents
>> [ 65.436656][ T3224] BTRFS info (device sdb2): checking UUID tree
>> [ 66.134430][ T3293] BTRFS info (device sdb2): dev_replace from /dev/sdb3
(devid 2) to /dev/sdb6 started
>> [ 67.823326][ T3293] divide error: 0000 [#1] SMP KASAN PTI
>> [ 67.828668][ T3293] CPU: 3 PID: 3293 Comm: btrfs Not tainted
5.17.0-rc5-00101-g3626a285f87d #1
>> [ 67.837169][ T3293] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
>> [ 67.844982][ T3293] RIP: 0010:scrub_stripe
(kbuild/src/consumer/fs/btrfs/scrub.c:3448 kbuild/src/consumer/fs/btrfs/scrub.c:3486
kbuild/src/consumer/fs/btrfs/scrub.c:3644) btrfs
>> [ 67.850976][ T3293] Code: 00 00 fc ff df 48 89 f9 48 c1 e9 03 0f b6 0c 11 48 89
fa 83 e2 07 83 c2 03 38 ca 7c 08 84 c9 0f 85 27 09 00 00 41 8b 5d 1c 99 <f7> fb 48
8b 54 24 30 48 c1 ea 03 48 63 e8 48 b8 00 00 00 00 00 fc
>> All code
>
> This is weird, the code is from simple_stripe_full_stripe_len(), which
> means the chunk map must be RAID0 or RAID10.
>
> In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
>
> In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
> which all have either 1 or 2 sub_stripes.
>
>
> Although the code is old, not the latest version, it should still not
> cause such problem.
>
> Mind to retest with my branch to see if it can be reproduced?
> https://github.com/adam900710/linux/tree/refactor_scrub
we tested head of this branch:
d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
and:
fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based range
on this branch.
by attached config.
still reproduce the same issue.
attached dmesgs FYI.
Still failed to reproduce here.
Those btrfs/07[0123] tests are already in scrub/replace group, thus I
ran them almost hourly during the development.
Although there are some ASSERT()s doing extra sanity checks, they should
not affect the result anyway.
Thus I pushed a branch with more explicit BUG_ON()s to catch the
possible divide by zero bugs.
(https://github.com/adam900710/linux/tree/refactor_scrub_testing)
Mind to give it a try?
Thanks,
Qu
>
>
>>
>> Thanks,
>> Qu
>>
>>> ========
>>> 0: 00 00 add %al,(%rax)
>>> 2: fc cld
>>> 3: ff (bad)
>>> 4: df 48 89 fisttps -0x77(%rax)
>>> 7: f9 stc
>>> 8: 48 c1 e9 03 shr $0x3,%rcx
>>> c: 0f b6 0c 11 movzbl (%rcx,%rdx,1),%ecx
>>> 10: 48 89 fa mov %rdi,%rdx
>>> 13: 83 e2 07 and $0x7,%edx
>>> 16: 83 c2 03 add $0x3,%edx
>>> 19: 38 ca cmp %cl,%dl
>>> 1b: 7c 08 jl 0x25
>>> 1d: 84 c9 test %cl,%cl
>>> 1f: 0f 85 27 09 00 00 jne 0x94c
>>> 25: 41 8b 5d 1c mov 0x1c(%r13),%ebx
>>> 29: 99 cltd
>>> 2a:* f7 fb idiv %ebx <-- trapping instruction
>>> 2c: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
>>> 31: 48 c1 ea 03 shr $0x3,%rdx
>>> 35: 48 63 e8 movslq %eax,%rbp
>>> 38: 48 rex.W
>>> 39: b8 00 00 00 00 mov $0x0,%eax
>>> 3e: 00 fc add %bh,%ah
>>>
>>> Code starting with the faulting instruction
>>> ===========================================
>>> 0: f7 fb idiv %ebx
>>> 2: 48 8b 54 24 30 mov 0x30(%rsp),%rdx
>>> 7: 48 c1 ea 03 shr $0x3,%rdx
>>> b: 48 63 e8 movslq %eax,%rbp
>>> e: 48 rex.W
>>> f: b8 00 00 00 00 mov $0x0,%eax
>>> 14: 00 fc add %bh,%ah
>>> [ 67.870187][ T3293] RSP: 0018:ffffc9000a71f450 EFLAGS: 00010246
>>> [ 67.876028][ T3293] RAX: 0000000000000004 RBX: 0000000000000000 RCX:
0000000000000000
>>> [ 67.883756][ T3293] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff888129ec6d1c
>>> [ 67.891491][ T3293] RBP: ffff8881453682a0 R08: 0000000000000001 R09:
0000000000000000
>>> [ 67.899230][ T3293] R10: ffff88821534a063 R11: ffffed1042a6940c R12:
ffff888121238000
>>> [ 67.906955][ T3293] R13: ffff888129ec6d00 R14: ffff888145368000 R15:
0000000000000008
>>> [ 67.914680][ T3293] FS: 00007f2851eb08c0(0000) GS:ffff8881a6d80000(0000)
knlGS:0000000000000000
>>> [ 67.923351][ T3293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>> [ 67.929709][ T3293] CR2: 00007ffea4ff07f8 CR3: 000000010a0fc005 CR4:
00000000001706e0
>>> [ 67.937437][ T3293] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
>>> [ 67.945163][ T3293] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
0000000000000400
>>> [ 67.952891][ T3293] Call Trace:
>>> [ 67.955992][ T3293] <TASK>
>>> [ 67.958749][ T3293] ? kasan_save_stack
(kbuild/src/consumer/mm/kasan/common.c:39)
>>> [ 67.963395][ T3293] ? kasan_set_track
(kbuild/src/consumer/mm/kasan/common.c:45)
>>> [ 67.967951][ T3293] ? kasan_set_free_info
(kbuild/src/consumer/mm/kasan/generic.c:372)
>>> [ 67.972851][ T3293] ? mutex_unlock
(kbuild/src/consumer/arch/x86/include/asm/atomic64_64.h:190
kbuild/src/consumer/include/linux/atomic/atomic-long.h:449
kbuild/src/consumer/include/linux/atomic/atomic-instrumented.h:1790
kbuild/src/consumer/kernel/locking/mutex.c:178
kbuild/src/consumer/kernel/locking/mutex.c:537)
>>>
>>>
>>> To reproduce:
>>>
>>> git clone https://github.com/intel/lkp-tests.git
>>> cd lkp-tests
>>> sudo bin/lkp install job.yaml # job file is attached in
this email
>>> bin/lkp split-job --compatible job.yaml # generate the yaml file
for lkp run
>>> sudo bin/lkp run generated-yaml-file
>>>
>>> # if come across any failure that blocks the test,
>>> # please remove ~/.lkp and /lkp dir to run from a clean state.
>>>
>>>
>>>
>>> ---
>>> 0DAY/LKP+ Test Infrastructure Open Source Technology
Center
>>> https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel
Corporation
>>>
>>> Thanks,
>>> Oliver Sang
>>>
6:49 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
Hi Qu,
On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
On 2022/3/2 16:44, Oliver Sang wrote:
> Hi Qu,
>
> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
> >
> >
> > This is weird, the code is from simple_stripe_full_stripe_len(), which
> > means the chunk map must be RAID0 or RAID10.
> >
> > In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
> >
> > In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
> > which all have either 1 or 2 sub_stripes.
> >
> >
> > Although the code is old, not the latest version, it should still not
> > cause such problem.
> >
> > Mind to retest with my branch to see if it can be reproduced?
> > https://github.com/adam900710/linux/tree/refactor_scrub
>
> we tested head of this branch:
> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
> and:
> fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based
range
> on this branch.
>
> by attached config.
>
> still reproduce the same issue.
>
> attached dmesgs FYI.
Still failed to reproduce here.
Those btrfs/07[0123] tests are already in scrub/replace group, thus I
ran them almost hourly during the development.
Although there are some ASSERT()s doing extra sanity checks, they should
not affect the result anyway.
Thus I pushed a branch with more explicit BUG_ON()s to catch the
possible divide by zero bugs.
(https://github.com/adam900710/linux/tree/refactor_scrub_testing)
Mind to give it a try?
in our tests, it seems one BUG_ON you added is triggered
(full dmesg attached):
[ 75.279958][ T3602] ------------[ cut here ]------------
[ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
[ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
[ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
5.17.0-rc4-00095-g6b837d4c40d5 #1
[ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
[ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
[ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4 f9 96 c0 e9
26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f> 0b 0f
0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
[ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
[ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX: ffff88810231d61c
[ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff8881023a2458
[ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09: ffffed102828100d
[ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12: 0000000000000000
[ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15: ffff888129c9c000
[ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000)
knlGS:0000000000000000
[ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4: 00000000001706e0
[ 75.404785][ T3602] Call Trace:
[ 75.407886][ T3602] <TASK>
[ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
[ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
[ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
[ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
[ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
[ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
[ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
[ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
[ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
[ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
[ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
[ 75.473121][ T3602] ? down_read+0x137/0x240
[ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
[ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
[ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
[ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
[ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
[ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
[ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
[ 75.517428][ T3602] ? finish_wait+0x280/0x280
[ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
[ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
[ 75.535440][ T3602] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
[ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
[ 75.547691][ T3602] ? fput_many+0xaa/0x140
[ 75.551823][ T3602] ? filp_close+0xef/0x140
[ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
[ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
[ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
[ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
[ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
[ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
[ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
[ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
[ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
[ 75.606837][ T3602] ? __might_fault+0x4d/0x80
[ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
[ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
[ 75.621461][ T3602] ? __fget_light+0x57/0x540
[ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
[ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
[ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
[ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7 c0
ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01
f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
[ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX:
0000000000000010
[ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX: 00007f94c25df427
[ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI: 0000000000000004
[ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09: 000055d51e9fa580
[ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffd06a4e97a
[ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000005
[ 75.710600][ T3602] </TASK>
[ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf ipmi_msghandler
intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915
kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops rapl
ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video ip_tables
[ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
Thanks,
Qu
7:42 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
On 2022/3/9 15:49, Oliver Sang wrote:
Hi Qu,
On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>
>
> On 2022/3/2 16:44, Oliver Sang wrote:
>> Hi Qu,
>>
>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>
>>>
>>> This is weird, the code is from simple_stripe_full_stripe_len(), which
>>> means the chunk map must be RAID0 or RAID10.
>>>
>>> In that case, their sub_stripes should be either 1 or 2, why we got 0 there?
>>>
>>> In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
>>> which all have either 1 or 2 sub_stripes.
>>>
>>>
>>> Although the code is old, not the latest version, it should still not
>>> cause such problem.
>>>
>>> Mind to retest with my branch to see if it can be reproduced?
>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>
>> we tested head of this branch:
>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related members
>> and:
>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub simple-stripe based
range
>> on this branch.
>>
>> by attached config.
>>
>> still reproduce the same issue.
>>
>> attached dmesgs FYI.
>
> Still failed to reproduce here.
>
> Those btrfs/07[0123] tests are already in scrub/replace group, thus I
> ran them almost hourly during the development.
>
>
> Although there are some ASSERT()s doing extra sanity checks, they should
> not affect the result anyway.
>
> Thus I pushed a branch with more explicit BUG_ON()s to catch the
> possible divide by zero bugs.
> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>
> Mind to give it a try?
in our tests, it seems one BUG_ON you added is triggered
(full dmesg attached):
What the heck...
It's indeed some weird extent mapping has its sub-stripes as 0...
I must be insane or there is something fundamental wrong.
Mind to try that branch again? I have updated the branch, now it will
trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
I'm wondering if it's old btrfs-progs involved (which may not properly
initialize btrfs_chunk::sub_stripes) now.
Thanks,
Qu
>
>
> [ 75.279958][ T3602] ------------[ cut here ]------------
> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
5.17.0-rc4-00095-g6b837d4c40d5 #1
> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4 f9 96 c0
e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f> 0b 0f
> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX:
ffff88810231d61c
> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff8881023a2458
> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09:
ffffed102828100d
> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12:
0000000000000000
> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15:
ffff888129c9c000
> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000)
knlGS:0000000000000000
> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4:
00000000001706e0
> [ 75.404785][ T3602] Call Trace:
> [ 75.407886][ T3602] <TASK>
> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
> [ 75.473121][ T3602] ? down_read+0x137/0x240
> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
> [ 75.535440][ T3602] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
> [ 75.551823][ T3602] ? filp_close+0xef/0x140
> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48 c7
c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01
> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX:
0000000000000010
> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX:
00007f94c25df427
> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI:
0000000000000004
> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09:
000055d51e9fa580
> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12:
00007ffd06a4e97a
> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15:
0000000000000005
> [ 75.710600][ T3602] </TASK>
> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf ipmi_msghandler
> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915
kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops rapl
ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video ip_tables
> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>
>
>>
>> Thanks,
>> Qu
>>
1:05 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
Hi Qu,
On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
On 2022/3/9 15:49, Oliver Sang wrote:
> Hi Qu,
>
> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
> >
> >
> > On 2022/3/2 16:44, Oliver Sang wrote:
> > > Hi Qu,
> > >
> > > On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
> > > >
> > > >
> > > > This is weird, the code is from simple_stripe_full_stripe_len(),
which
> > > > means the chunk map must be RAID0 or RAID10.
> > > >
> > > > In that case, their sub_stripes should be either 1 or 2, why we got 0
there?
> > > >
> > > > In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
> > > > which all have either 1 or 2 sub_stripes.
> > > >
> > > >
> > > > Although the code is old, not the latest version, it should still
not
> > > > cause such problem.
> > > >
> > > > Mind to retest with my branch to see if it can be reproduced?
> > > > https://github.com/adam900710/linux/tree/refactor_scrub
> > >
> > > we tested head of this branch:
> > > d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related
members
> > > and:
> > > fdad4a9615f180 btrfs: introduce dedicated helper to scrub
simple-stripe based range
> > > on this branch.
> > >
> > > by attached config.
> > >
> > > still reproduce the same issue.
> > >
> > > attached dmesgs FYI.
> >
> > Still failed to reproduce here.
> >
> > Those btrfs/07[0123] tests are already in scrub/replace group, thus I
> > ran them almost hourly during the development.
> >
> >
> > Although there are some ASSERT()s doing extra sanity checks, they should
> > not affect the result anyway.
> >
> > Thus I pushed a branch with more explicit BUG_ON()s to catch the
> > possible divide by zero bugs.
> > (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
> >
> > Mind to give it a try?
>
>
> in our tests, it seems one BUG_ON you added is triggered
> (full dmesg attached):
What the heck...
It's indeed some weird extent mapping has its sub-stripes as 0...
I must be insane or there is something fundamental wrong.
Mind to try that branch again? I have updated the branch, now it will
trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
I'm wondering if it's old btrfs-progs involved (which may not properly
initialize btrfs_chunk::sub_stripes) now.
below BUG print was caught by your new patch (detail dmesg attached):
[ 44.577527][ T1980] ------------[ cut here ]------------
[ 44.583552][ T335]
[ 44.583990][ T337] 512+0 records out
[ 44.583997][ T337]
[ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
[ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
[ 44.598832][ T335] Data: single 8.00MiB
[ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted
5.17.0-rc4-00095-g7f159e82828e #1
[ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
[ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
[ 44.605509][ T335]
[ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2
0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c
89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
[ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
[ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000 RCX: 0000000000000000
[ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff5200057ce75
[ 44.612227][ T335] Metadata: DUP 1.00GiB
[ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
[ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff888214586b40
[ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c R15: 0000000000000022
[ 44.616876][ T1980] FS: 00007fad1bd12100(0000) GS:ffff8881a6e80000(0000)
knlGS:0000000000000000
[ 44.622475][ T335]
[ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003 CR4: 00000000001706e0
[ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 44.628588][ T1980] Call Trace:
[ 44.638095][ T335] System: DUP 8.00MiB
[ 44.645166][ T1980] <TASK>
[ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
[ 44.651206][ T335]
[ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
[ 44.653395][ T1980] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
[ 44.673370][ T335] SSD detected: no
[ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
[ 44.686756][ T335]
[ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
[ 44.701187][ T335] Zoned device: no
[ 44.708574][ T1980] ? memcpy+0x39/0x80
[ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
[ 44.716449][ T335]
[ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
[ 44.734138][ T335] Incompat features: extref, skinny-metadata, no-holes
[ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
[ 44.741786][ T335]
[ 44.749628][ T1980] ? mutex_lock+0x80/0x100
[ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
[ 44.758164][ T335] Runtime features: free-space-tree
[ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
[ 44.768515][ T335]
[ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
[ 44.777966][ T335] Checksum: crc32c
[ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
[ 44.784268][ T335]
[ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
[ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 44.796977][ T335] Number of devices: 1
[ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 44.806131][ T335]
[ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
[ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 44.814273][ T335] Devices:
[ 44.818205][ T1980] legacy_get_tree+0xef/0x200
[ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
[ 44.822077][ T335]
[ 44.827928][ T1980] fc_mount+0xf/0x80
[ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
[ 44.830557][ T335] ID SIZE PATH
[ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
[ 44.842730][ T335]
[ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
[ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
[ 44.850862][ T335] 1 300.00GiB /dev/sdb4
[ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
[ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 44.859803][ T335]
[ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
[ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 44.871101][ T335]
[ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
[ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 44.878354][ T335]
[ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
[ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
[ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
[ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 44.895501][ T335]
[ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
[ 44.901435][ T1980] legacy_get_tree+0xef/0x200
[ 44.901448][ T1980] ? security_capable+0x56/0xc0
[ 44.905612][ T335] btrfs
[ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
[ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
[ 44.913278][ T335]
[ 44.918247][ T1980] path_mount+0x7fc/0x1a40
[ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
[ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1 /fs/sdb1
[ 44.927087][ T1980] ? finish_automount+0x600/0x600
[ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
[ 44.931642][ T335]
[ 44.935926][ T1980] do_mount+0xca/0x100
[ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
[ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
[ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
[ 44.941885][ T1980] ? memdup_user+0x4e/0x80
[ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
[ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
[ 44.946884][ T335]
[ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
[ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f
1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01
f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
[ 44.956197][ T335] btrfs
[ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246 ORIG_RAX:
00000000000000a5
[ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970 RCX: 00007fad1bf10fea
[ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0 RDI: 00005628efc57ba0
[ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000 R09: 00005628efc5a890
[ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 44.962993][ T335]
[ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0 R15: 00005628efc57b80
[ 44.967616][ T1980] </TASK>
[ 44.967617][ T1980] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
[ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2 /fs/sdb2
[ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
[ 44.983019][ T335]
[ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr
intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel
[ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
[ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul
crc32_pclmul crc32c_intel ghash_clmulni_intel syscopyarea sysfillrect
[ 44.998174][ T335]
[ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix intel_cstate libata
drm mei_me mei intel_uncore video ip_tables
[ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
Thanks,
Qu
>
>
> [ 75.279958][ T3602] ------------[ cut here ]------------
> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
5.17.0-rc4-00095-g6b837d4c40d5 #1
> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4 f9 96
c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f> 0b 0f
> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX:
ffff88810231d61c
> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff8881023a2458
> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09:
ffffed102828100d
> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12:
0000000000000000
> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15:
ffff888129c9c000
> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000)
knlGS:0000000000000000
> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4:
00000000001706e0
> [ 75.404785][ T3602] Call Trace:
> [ 75.407886][ T3602] <TASK>
> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
> [ 75.473121][ T3602] ? down_read+0x137/0x240
> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
> [ 75.535440][ T3602] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
> [ 75.551823][ T3602] ? filp_close+0xef/0x140
> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00 00 48
c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01
> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX:
0000000000000010
> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX:
00007f94c25df427
> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI:
0000000000000004
> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09:
000055d51e9fa580
> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12:
00007ffd06a4e97a
> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15:
0000000000000005
> [ 75.710600][ T3602] </TASK>
> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf ipmi_msghandler
> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915
kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
rapl ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video ip_tables
> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>
>
> >
> > Thanks,
> > Qu
> >
1:24 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
On 2022/3/14 10:05, Oliver Sang wrote:
Hi Qu,
On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>
>
> On 2022/3/9 15:49, Oliver Sang wrote:
>> Hi Qu,
>>
>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>
>>>
>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>> Hi Qu,
>>>>
>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>
>>>>>
>>>>> This is weird, the code is from simple_stripe_full_stripe_len(),
which
>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>
>>>>> In that case, their sub_stripes should be either 1 or 2, why we got 0
there?
>>>>>
>>>>> In fact, from volumes.c, all sub_stripes is from btrfs_raid_array[],
>>>>> which all have either 1 or 2 sub_stripes.
>>>>>
>>>>>
>>>>> Although the code is old, not the latest version, it should still
not
>>>>> cause such problem.
>>>>>
>>>>> Mind to retest with my branch to see if it can be reproduced?
>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>
>>>> we tested head of this branch:
>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related
members
>>>> and:
>>>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub
simple-stripe based range
>>>> on this branch.
>>>>
>>>> by attached config.
>>>>
>>>> still reproduce the same issue.
>>>>
>>>> attached dmesgs FYI.
>>>
>>> Still failed to reproduce here.
>>>
>>> Those btrfs/07[0123] tests are already in scrub/replace group, thus I
>>> ran them almost hourly during the development.
>>>
>>>
>>> Although there are some ASSERT()s doing extra sanity checks, they should
>>> not affect the result anyway.
>>>
>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>> possible divide by zero bugs.
>>> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>
>>> Mind to give it a try?
>>
>>
>> in our tests, it seems one BUG_ON you added is triggered
>> (full dmesg attached):
>
> What the heck...
>
> It's indeed some weird extent mapping has its sub-stripes as 0...
>
> I must be insane or there is something fundamental wrong.
>
> Mind to try that branch again? I have updated the branch, now it will
> trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
>
> I'm wondering if it's old btrfs-progs involved (which may not properly
> initialize btrfs_chunk::sub_stripes) now.
below BUG print was caught by your new patch (detail dmesg attached):
Thank you very much for the detailed report!
The triggered BUG_ON() means, we're getting sub_stripes == 0, for
unrelated chunks (in this case, it's DUP from sys chunk array, from the
full dmesg).
And from the code context, it's from super-block, thus there must be
something wrong with the mkfs.btrfs.
But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
still no reproduce.
Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2" and
"btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of it?
As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
Thanks,
Qu
>
> [ 44.577527][ T1980] ------------[ cut here ]------------
> [ 44.583552][ T335]
> [ 44.583990][ T337] 512+0 records out
> [ 44.583997][ T337]
> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 44.598832][ T335] Data: single 8.00MiB
> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted
5.17.0-rc4-00095-g7f159e82828e #1
> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
> [ 44.605509][ T335]
> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84
d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c
> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000 RCX:
0000000000000000
> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
fffff5200057ce75
> [ 44.612227][ T335] Metadata: DUP 1.00GiB
> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e R09:
ffffed1034dd6791
> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
ffff888214586b40
> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c R15:
0000000000000022
> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000) GS:ffff8881a6e80000(0000)
knlGS:0000000000000000
> [ 44.622475][ T335]
> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003 CR4:
00000000001706e0
> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
0000000000000400
> [ 44.628588][ T1980] Call Trace:
> [ 44.638095][ T335] System: DUP 8.00MiB
> [ 44.645166][ T1980] <TASK>
> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
> [ 44.651206][ T335]
> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
> [ 44.653395][ T1980] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 44.673370][ T335] SSD detected: no
> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
> [ 44.686756][ T335]
> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
> [ 44.701187][ T335] Zoned device: no
> [ 44.708574][ T1980] ? memcpy+0x39/0x80
> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
> [ 44.716449][ T335]
> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
> [ 44.734138][ T335] Incompat features: extref, skinny-metadata, no-holes
> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
> [ 44.741786][ T335]
> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
> [ 44.758164][ T335] Runtime features: free-space-tree
> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
> [ 44.768515][ T335]
> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
> [ 44.777966][ T335] Checksum: crc32c
> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
> [ 44.784268][ T335]
> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.796977][ T335] Number of devices: 1
> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.806131][ T335]
> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.814273][ T335] Devices:
> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.822077][ T335]
> [ 44.827928][ T1980] fc_mount+0xf/0x80
> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
> [ 44.830557][ T335] ID SIZE PATH
> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
> [ 44.842730][ T335]
> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.859803][ T335]
> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.871101][ T335]
> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.878354][ T335]
> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.895501][ T335]
> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
> [ 44.905612][ T335] btrfs
> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
> [ 44.913278][ T335]
> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1 /fs/sdb1
> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
> [ 44.931642][ T335]
> [ 44.935926][ T1980] do_mount+0xca/0x100
> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
> [ 44.946884][ T335]
> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e
0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01
> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
> [ 44.956197][ T335] btrfs
> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246 ORIG_RAX:
00000000000000a5
> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970 RCX:
00007fad1bf10fea
> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0 RDI:
00005628efc57ba0
> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000 R09:
00005628efc5a890
> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246 R12:
0000000000000000
> [ 44.962993][ T335]
> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0 R15:
00005628efc57b80
> [ 44.967616][ T1980] </TASK>
> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2 /fs/sdb2
> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
> [ 44.983019][ T335]
> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr
intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel
> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper irqbypass
crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel syscopyarea sysfillrect
> [ 44.998174][ T335]
> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix intel_cstate
libata drm mei_me mei intel_uncore video ip_tables
> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>
>
>>
>> Thanks,
>> Qu
>>
>>>
>>>
>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
5.17.0-rc4-00095-g6b837d4c40d5 #1
>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS
A05 12/05/2013
>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4
f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f>
0b 0f
>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX:
ffff88810231d61c
>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff8881023a2458
>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09:
ffffed102828100d
>>> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12:
0000000000000000
>>> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15:
ffff888129c9c000
>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000)
knlGS:0000000000000000
>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4:
00000000001706e0
>>> [ 75.404785][ T3602] Call Trace:
>>> [ 75.407886][ T3602] <TASK>
>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
>>> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
>>> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0
[btrfs]
>>> [ 75.535440][ T3602] ?
__raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40
[btrfs]
>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00
00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48>
3d 01
>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX:
0000000000000010
>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX:
00007f94c25df427
>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI:
0000000000000004
>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09:
000055d51e9fa580
>>> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12:
00007ffd06a4e97a
>>> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15:
0000000000000005
>>> [ 75.710600][ T3602] </TASK>
>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor
raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf
ipmi_msghandler
>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp
coretemp i915 kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul
crc32c_intel
>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video
ip_tables
>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>
>>>
>>>>
>>>> Thanks,
>>>> Qu
>>>>
3:37 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
Hi Qu,
On 3/14/2022 10:24, Qu Wenruo wrote:
On 2022/3/14 10:05, Oliver Sang wrote:
> Hi Qu,
>
> On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>>
>>
>> On 2022/3/9 15:49, Oliver Sang wrote:
>>> Hi Qu,
>>>
>>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>>
>>>>
>>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>>> Hi Qu,
>>>>>
>>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>>
>>>>>>
>>>>>> This is weird, the code is from simple_stripe_full_stripe_len(),
which
>>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>>
>>>>>> In that case, their sub_stripes should be either 1 or 2, why we
got 0 there?
>>>>>>
>>>>>> In fact, from volumes.c, all sub_stripes is from
btrfs_raid_array[],
>>>>>> which all have either 1 or 2 sub_stripes.
>>>>>>
>>>>>>
>>>>>> Although the code is old, not the latest version, it should still
not
>>>>>> cause such problem.
>>>>>>
>>>>>> Mind to retest with my branch to see if it can be reproduced?
>>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>>
>>>>> we tested head of this branch:
>>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and related
members
>>>>> and:
>>>>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub
simple-stripe based range
>>>>> on this branch.
>>>>>
>>>>> by attached config.
>>>>>
>>>>> still reproduce the same issue.
>>>>>
>>>>> attached dmesgs FYI.
>>>>
>>>> Still failed to reproduce here.
>>>>
>>>> Those btrfs/07[0123] tests are already in scrub/replace group, thus I
>>>> ran them almost hourly during the development.
>>>>
>>>>
>>>> Although there are some ASSERT()s doing extra sanity checks, they should
>>>> not affect the result anyway.
>>>>
>>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>>> possible divide by zero bugs.
>>>> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>>
>>>> Mind to give it a try?
>>>
>>>
>>> in our tests, it seems one BUG_ON you added is triggered
>>> (full dmesg attached):
>>
>> What the heck...
>>
>> It's indeed some weird extent mapping has its sub-stripes as 0...
>>
>> I must be insane or there is something fundamental wrong.
>>
>> Mind to try that branch again? I have updated the branch, now it will
>> trigger BUG_ON() as soon as it finds a chunk mapping with sub_stripes == 0.
>>
>> I'm wondering if it's old btrfs-progs involved (which may not properly
>> initialize btrfs_chunk::sub_stripes) now.
>
> below BUG print was caught by your new patch (detail dmesg attached):
Thank you very much for the detailed report!
The triggered BUG_ON() means, we're getting sub_stripes == 0, for
unrelated chunks (in this case, it's DUP from sys chunk array, from the
full dmesg).
And from the code context, it's from super-block, thus there must be
something wrong with the mkfs.btrfs.
But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
still no reproduce.
Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2" and
"btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of it?
As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
We have added the "btrfs ins dump" commands after mkfs btrfs call, and got below
log:
(full dmesg attached)
[ 83.859614][ T337] 2022-03-17 03:28:07 ~~~~~~~~~~~~~~ /dev/sdb2 start ~~~~~~~~~~~~~~
[ 83.859620][ T337]
[ 83.870522][ T337] 2022-03-17 03:28:07 mkfs -t btrfs /dev/sdb2
[ 83.870528][ T337]
[ 84.160841][ T1446] BTRFS: device fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e devid 1
transid 6 /dev/sdb2 scanned by mkfs.btrfs (1446)
[ 84.173707][ T337] btrfs-progs v5.15.1
[ 84.173714][ T337]
[ 84.180774][ T337] See http://btrfs.wiki.kernel.org for more information.
[ 84.180781][ T337]
[ 84.189916][ T337]
[ 84.189930][ T337]
[ 84.195706][ T337] NOTE: several default settings have changed in version 5.15, please
make sure
[ 84.195712][ T337]
[ 84.207588][ T337] this does not affect your deployments:
[ 84.207594][ T337]
[ 84.216415][ T337] - DUP for metadata (-m dup)
[ 84.216420][ T337]
[ 84.224369][ T337] - enabled no-holes (-O no-holes)
[ 84.224374][ T337]
[ 84.233011][ T337] - enabled free-space-tree (-R free-space-tree)
[ 84.233017][ T337]
[ 84.241956][ T337]
[ 84.241961][ T337]
[ 84.246811][ T337] Label: (null)
[ 84.246817][ T337]
[ 84.254487][ T337] UUID: 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 84.254493][ T337]
[ 84.264219][ T337] Node size: 16384
[ 84.264224][ T337]
[ 84.271244][ T337] Sector size: 4096
[ 84.271250][ T337]
[ 84.278261][ T337] Filesystem size: 300.00GiB
[ 84.278266][ T337]
[ 84.285545][ T337] Block group profiles:
[ 84.285551][ T337]
[ 84.292560][ T337] Data: single 8.00MiB
[ 84.292566][ T337]
[ 84.301673][ T337] Metadata: DUP 1.00GiB
[ 84.301678][ T337]
[ 84.310792][ T337] System: DUP 8.00MiB
[ 84.310798][ T337]
[ 84.319517][ T337] SSD detected: no
[ 84.319523][ T337]
[ 84.326270][ T337] Zoned device: no
[ 84.326275][ T337]
[ 84.333495][ T337] Incompat features: extref, skinny-metadata, no-holes
[ 84.333500][ T337]
[ 84.343101][ T337] Runtime features: free-space-tree
[ 84.343107][ T337]
[ 84.350971][ T337] Checksum: crc32c
[ 84.350977][ T337]
[ 84.357993][ T337] Number of devices: 1
[ 84.357998][ T337]
[ 84.364376][ T337] Devices:
[ 84.364381][ T337]
[ 84.369859][ T337] ID SIZE PATH
[ 84.369864][ T337]
[ 84.376746][ T337] 1 300.00GiB /dev/sdb2
[ 84.376752][ T337]
[ 84.383603][ T337]
[ 84.383608][ T337]
[ 84.388521][ T337] 2022-03-17 03:28:08 sleep 10
[ 84.388526][ T337]
[ 94.181546][ T337] 2022-03-17 03:28:18 btrfs ins dump-tree -t chunk /dev/sdb2
[ 94.181556][ T337]
[ 94.215558][ T337] btrfs-progs v4.20.1
[ 94.215568][ T337]
[ 94.221902][ T337] chunk tree
[ 94.221908][ T337]
[ 94.228420][ T337] leaf 22036480 items 4 free space 15781 generation 6 owner
CHUNK_TREE
[ 94.228425][ T337]
[ 94.239630][ T337] leaf 22036480 flags 0x1(WRITTEN) backref revision 1
[ 94.239636][ T337]
[ 94.249280][ T337] fs uuid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 94.249286][ T337]
[ 94.258358][ T337] chunk uuid a7c33201-4d1f-44e0-8491-d386f70f1ac7
[ 94.258363][ T337]
[ 94.267903][ T337] item 0 key (DEV_ITEMS DEV_ITEM 1) itemoff 16185 itemsize 98
[ 94.267909][ T337]
[ 94.278519][ T337] devid 1 total_bytes 322122547200 bytes_used 2172649472
[ 94.278524][ T337]
[ 94.288713][ T337] io_align 4096 io_width 4096 sector_size 4096 type 0
[ 94.288718][ T337]
[ 94.298450][ T337] generation 0 start_offset 0 dev_group 0
[ 94.298455][ T337]
[ 94.306862][ T337] seek_speed 0 bandwidth 0
[ 94.306868][ T337]
[ 94.314295][ T337] uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.314300][ T337]
[ 94.323221][ T337] fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 94.323235][ T337]
[ 94.332728][ T337] item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM 13631488) itemoff 16105
itemsize 80
[ 94.332733][ T337]
[ 94.344629][ T337] length 8388608 owner 2 stripe_len 65536 type DATA
[ 94.344635][ T337]
[ 94.354342][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.354348][ T337]
[ 94.363469][ T337] num_stripes 1 sub_stripes 1
[ 94.363475][ T337]
[ 94.370987][ T337] stripe 0 devid 1 offset 13631488
[ 94.370993][ T337]
[ 94.379293][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.379298][ T337]
[ 94.389332][ T337] item 2 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096) itemoff 15993
itemsize 112
[ 94.389337][ T337]
[ 94.401456][ T337] length 8388608 owner 2 stripe_len 65536 type SYSTEM|DUP
[ 94.401461][ T337]
[ 94.411651][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.411657][ T337]
[ 94.420718][ T337] num_stripes 2 sub_stripes 1
[ 94.420723][ T337]
[ 94.428297][ T337] stripe 0 devid 1 offset 22020096
[ 94.428302][ T337]
[ 94.436583][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.436588][ T337]
[ 94.445784][ T337] stripe 1 devid 1 offset 30408704
[ 94.445789][ T337]
[ 94.454060][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.454066][ T337]
[ 94.463995][ T337] item 3 key (FIRST_CHUNK_TREE CHUNK_ITEM 30408704) itemoff 15881
itemsize 112
[ 94.464001][ T337]
[ 94.476279][ T337] length 1073741824 owner 2 stripe_len 65536 type
METADATA|DUP
[ 94.476288][ T337]
[ 94.486957][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 94.486963][ T337]
[ 94.496023][ T337] num_stripes 2 sub_stripes 1
[ 94.496029][ T337]
[ 94.503588][ T337] stripe 0 devid 1 offset 38797312
[ 94.503594][ T337]
[ 94.511891][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.511897][ T337]
[ 94.521097][ T337] stripe 1 devid 1 offset 1112539136
[ 94.521102][ T337]
[ 94.529560][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 94.529566][ T337]
[ 94.538649][ T337] 2022-03-17 03:28:18 sleep 10
[ 94.538654][ T337]
[ 104.223120][ T337] 2022-03-17 03:28:28 btrfs ins dump-super -f /dev/sdb2
[ 104.223129][ T337]
[ 104.232956][ T337] superblock: bytenr=65536, device=/dev/sdb2
[ 104.232962][ T337]
[ 104.242015][ T337] ---------------------------------------------------------
[ 104.242021][ T337]
[ 104.251907][ T337] csum_type 0 (crc32c)
[ 104.251912][ T337]
[ 104.258378][ T337] csum_size 4
[ 104.258383][ T337]
[ 104.264296][ T337] csum 0xe574a9d1 [match]
[ 104.264300][ T337]
[ 104.271125][ T337] bytenr 65536
[ 104.271130][ T337]
[ 104.276917][ T337] flags 0x1
[ 104.276922][ T337]
[ 104.282504][ T337] ( WRITTEN )
[ 104.282509][ T337]
[ 104.288568][ T337] magic _BHRfS_M [match]
[ 104.288573][ T337]
[ 104.295818][ T337] fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 104.295823][ T337]
[ 104.304849][ T337] metadata_uuid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[ 104.304854][ T337]
[ 104.313828][ T337] label
[ 104.313833][ T337]
[ 104.319132][ T337] generation 6
[ 104.319136][ T337]
[ 104.324922][ T337] root 30654464
[ 104.324927][ T337]
[ 104.330926][ T337] sys_array_size 129
[ 104.330931][ T337]
[ 104.337401][ T337] chunk_root_generation 6
[ 104.337406][ T337]
[ 104.344026][ T337] root_level 0
[ 104.344031][ T337]
[ 104.349877][ T337] chunk_root 22036480
[ 104.349882][ T337]
[ 104.356346][ T337] chunk_root_level 0
[ 104.356351][ T337]
[ 104.362501][ T337] log_root 0
[ 104.362506][ T337]
[ 104.368192][ T337] log_root_transid 0
[ 104.368197][ T337]
[ 104.374462][ T337] log_root_level 0
[ 104.374467][ T337]
[ 104.380741][ T337] total_bytes 322122547200
[ 104.380746][ T337]
[ 104.387601][ T337] bytes_used 196608
[ 104.387606][ T337]
[ 104.393820][ T337] sectorsize 4096
[ 104.393825][ T337]
[ 104.399864][ T337] nodesize 16384
[ 104.399869][ T337]
[ 104.406022][ T337] leafsize (deprecated) 16384
[ 104.406027][ T337]
[ 104.413112][ T337] stripesize 4096
[ 104.413117][ T337]
[ 104.419095][ T337] root_dir 6
[ 104.419099][ T337]
[ 104.424681][ T337] num_devices 1
[ 104.424686][ T337]
[ 104.430566][ T337] compat_flags 0x0
[ 104.430571][ T337]
[ 104.436779][ T337] compat_ro_flags 0x3
[ 104.436784][ T337]
[ 104.443332][ T337] ( FREE_SPACE_TREE |
[ 104.443337][ T337]
[ 104.450096][ T337] FREE_SPACE_TREE_VALID )
[ 104.450101][ T337]
[ 104.457309][ T337] incompat_flags 0x341
[ 104.457314][ T337]
[ 104.463873][ T337] ( MIXED_BACKREF |
[ 104.463878][ T337]
[ 104.470372][ T337] EXTENDED_IREF |
[ 104.470377][ T337]
[ 104.476866][ T337] SKINNY_METADATA |
[ 104.476871][ T337]
[ 104.483439][ T337] NO_HOLES )
[ 104.483444][ T337]
[ 104.489482][ T337] cache_generation 0
[ 104.489487][ T337]
[ 104.495818][ T337] uuid_tree_generation 0
[ 104.495823][ T337]
[ 104.503027][ T337] dev_item.uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.503032][ T337]
[ 104.512859][ T337] dev_item.fsid 3f698242-c4db-4b90-9aef-804b56f2bb6e
[match]
[ 104.512864][ T337]
[ 104.522669][ T337] dev_item.type 0
[ 104.522674][ T337]
[ 104.529015][ T337] dev_item.total_bytes 322122547200
[ 104.529020][ T337]
[ 104.536786][ T337] dev_item.bytes_used 2172649472
[ 104.536791][ T337]
[ 104.544214][ T337] dev_item.io_align 4096
[ 104.544227][ T337]
[ 104.550886][ T337] dev_item.io_width 4096
[ 104.550890][ T337]
[ 104.557600][ T337] dev_item.sector_size 4096
[ 104.557605][ T337]
[ 104.564490][ T337] dev_item.devid 1
[ 104.564495][ T337]
[ 104.570702][ T337] dev_item.dev_group 0
[ 104.570707][ T337]
[ 104.577224][ T337] dev_item.seek_speed 0
[ 104.577229][ T337]
[ 104.583769][ T337] dev_item.bandwidth 0
[ 104.583774][ T337]
[ 104.590288][ T337] dev_item.generation 0
[ 104.590293][ T337]
[ 104.596867][ T337] sys_chunk_array[2048]:
[ 104.596872][ T337]
[ 104.604027][ T337] item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 22020096)
[ 104.604032][ T337]
[ 104.613761][ T337] length 8388608 owner 2 stripe_len 65536 type SYSTEM|DUP
[ 104.613766][ T337]
[ 104.623962][ T337] io_align 65536 io_width 65536 sector_size 4096
[ 104.623967][ T337]
[ 104.633004][ T337] num_stripes 2 sub_stripes 1
[ 104.633008][ T337]
[ 104.640526][ T337] stripe 0 devid 1 offset 22020096
[ 104.640531][ T337]
[ 104.648803][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.648808][ T337]
[ 104.657956][ T337] stripe 1 devid 1 offset 30408704
[ 104.657961][ T337]
[ 104.666236][ T337] dev_uuid 2acf3fb5-c521-4863-99c0-2cccde7f72af
[ 104.666241][ T337]
[ 104.675067][ T337] backup_roots[4]:
[ 104.675072][ T337]
[ 104.681035][ T337] backup 0:
[ 104.681040][ T337]
[ 104.687028][ T337] backup_tree_root: 30490624 gen: 5 level: 0
[ 104.687033][ T337]
[ 104.696005][ T337] backup_chunk_root: 22020096 gen: 5 level: 0
[ 104.696010][ T337]
[ 104.705091][ T337] backup_extent_root: 30507008 gen: 5 level: 0
[ 104.705096][ T337]
[ 104.714236][ T337] backup_fs_root: 30474240 gen: 5 level: 0
[ 104.714241][ T337]
[ 104.723079][ T337] backup_dev_root: 30523392 gen: 5 level: 0
[ 104.723084][ T337]
[ 104.731944][ T337] backup_csum_root: 30539776 gen: 5 level: 0
[ 104.731949][ T337]
[ 104.740749][ T337] backup_total_bytes: 322122547200
[ 104.740754][ T337]
[ 104.748608][ T337] backup_bytes_used: 196608
[ 104.748613][ T337]
[ 104.755736][ T337] backup_num_devices: 1
[ 104.755741][ T337]
[ 104.762131][ T337]
[ 104.762135][ T337]
[ 104.766687][ T337] backup 1:
[ 104.766692][ T337]
[ 104.772697][ T337] backup_tree_root: 30654464 gen: 6 level: 0
[ 104.772702][ T337]
[ 104.781702][ T337] backup_chunk_root: 22036480 gen: 6 level: 0
[ 104.781707][ T337]
[ 104.790822][ T337] backup_extent_root: 30408704 gen: 6 level: 0
[ 104.790827][ T337]
[ 104.799929][ T337] backup_fs_root: 30474240 gen: 5 level: 0
[ 104.799934][ T337]
[ 104.808842][ T337] backup_dev_root: 30425088 gen: 6 level: 0
[ 104.808847][ T337]
[ 104.817759][ T337] backup_csum_root: 30539776 gen: 5 level: 0
[ 104.817764][ T337]
[ 104.826590][ T337] backup_total_bytes: 322122547200
[ 104.826595][ T337]
[ 104.834424][ T337] backup_bytes_used: 196608
[ 104.834429][ T337]
[ 104.841566][ T337] backup_num_devices: 1
[ 104.841571][ T337]
[ 104.847961][ T337]
[ 104.847965][ T337]
[ 104.852537][ T337] backup 2:
[ 104.852542][ T337]
[ 104.858545][ T337] backup_tree_root: 5308416 gen: 3 level: 0
[ 104.858550][ T337]
[ 104.867455][ T337] backup_chunk_root: 1048576 gen: 3 level: 0
[ 104.867460][ T337]
[ 104.876485][ T337] backup_extent_root: 5275648 gen: 3 level: 0
[ 104.876490][ T337]
[ 104.885519][ T337] backup_fs_root: 5324800 gen: 3 level: 0
[ 104.885523][ T337]
[ 104.894298][ T337] backup_dev_root: 5259264 gen: 3 level: 0
[ 104.894303][ T337]
[ 104.903075][ T337] backup_csum_root: 1130496 gen: 1 level: 0
[ 104.903080][ T337]
[ 104.911786][ T337] backup_total_bytes: 322122547200
[ 104.911791][ T337]
[ 104.919634][ T337] backup_bytes_used: 114688
[ 104.919639][ T337]
[ 104.926750][ T337] backup_num_devices: 1
[ 104.926755][ T337]
[ 104.933181][ T337]
[ 104.933194][ T337]
[ 104.937748][ T337] backup 3:
[ 104.937753][ T337]
[ 104.943802][ T337] backup_tree_root: 30457856 gen: 4 level: 0
[ 104.943807][ T337]
[ 104.952813][ T337] backup_chunk_root: 1064960 gen: 4 level: 0
[ 104.952818][ T337]
[ 104.961824][ T337] backup_extent_root: 5341184 gen: 4 level: 0
[ 104.961829][ T337]
[ 104.970886][ T337] backup_fs_root: 5324800 gen: 3 level: 0
[ 104.970891][ T337]
[ 104.979687][ T337] backup_dev_root: 5242880 gen: 4 level: 0
[ 104.979692][ T337]
[ 104.988495][ T337] backup_csum_root: 1130496 gen: 1 level: 0
[ 104.988500][ T337]
[ 104.997229][ T337] backup_total_bytes: 322122547200
[ 104.997234][ T337]
[ 105.005037][ T337] backup_bytes_used: 163840
[ 105.005042][ T337]
[ 105.012209][ T337] backup_num_devices: 1
[ 105.012214][ T337]
[ 105.018623][ T337]
[ 105.018627][ T337]
[ 105.023017][ T337]
[ 105.023022][ T337]
[ 105.027867][ T337] 2022-03-17 03:28:28 sleep 10
[ 105.027872][ T337]
[ 114.237911][ T337] 2022-03-17 03:28:38 ~~~~~~~~~~~~~~ /dev/sdb2 end ~~~~~~~~~~~~~~
......
[ 237.925789][ T337] 2022-03-17 03:30:41 export TEST_DIR=/fs/sdb1
[ 237.925803][ T337]
[ 237.936048][ T337] 2022-03-17 03:30:41 export TEST_DEV=/dev/sdb1
[ 237.936060][ T337]
[ 237.945651][ T337] 2022-03-17 03:30:42 export FSTYP=btrfs
[ 237.945662][ T337]
[ 237.954997][ T337] 2022-03-17 03:30:42 export SCRATCH_MNT=/fs/scratch
[ 237.955008][ T337]
[ 237.965136][ T337] 2022-03-17 03:30:42 mkdir /fs/scratch -p
[ 237.965147][ T337]
[ 237.976340][ T337] 2022-03-17 03:30:42 export SCRATCH_DEV_POOL="/dev/sdb2
/dev/sdb3 /dev/sdb4 /dev/sdb5 /dev/sdb6"
[ 237.976352][ T337]
[ 237.990723][ T337] 2022-03-17 03:30:42 sed "s:^:btrfs/:"
//lkp/benchmarks/xfstests/tests/btrfs-group-07
[ 237.990730][ T337]
[ 238.005026][ T337] 2022-03-17 03:30:42 ./check btrfs/070 btrfs/071 btrfs/072 btrfs/073
btrfs/074 btrfs/075 btrfs/076 btrfs/077 btrfs/078 btrfs/079
[ 238.005036][ T337]
[ 238.131570][ T1922] BTRFS info (device sdb1): flagging fs with big metadata feature
[ 238.139579][ T1922] BTRFS info (device sdb1): using free space tree
[ 238.145869][ T1922] BTRFS info (device sdb1): has skinny extents
[ 238.394777][ T337] FSTYP -- btrfs
[ 238.394787][ T337]
[ 238.407841][ T337] PLATFORM -- Linux/x86_64 lkp-hsw-d01
5.17.0-rc4-00095-g7f159e82828e #1 SMP Fri Mar 11 09:25:41 CST 2022
[ 238.407849][ T337]
[ 238.422205][ T337] MKFS_OPTIONS -- /dev/sdb2
[ 238.422213][ T337]
[ 238.429812][ T337] MOUNT_OPTIONS -- /dev/sdb2 /fs/scratch
[ 238.429820][ T337]
[ 238.437551][ T337]
[ 238.437556][ T337]
[ 238.509573][ T2041] BTRFS: device fsid 00974d0e-c70a-4d86-a40a-ad3675406027 devid 1
transid 5 /dev/sdb2 scanned by mkfs.btrfs (2041)
[ 238.543241][ T2052] BTRFS info (device sdb2): flagging fs with big metadata feature
[ 238.550999][ T2052] BTRFS info (device sdb2): disk space caching is enabled
[ 238.557986][ T2052] BTRFS info (device sdb2): has skinny extents
[ 238.565970][ T2052] BTRFS info (device sdb2): leaf 65536 gen 30556160 total ptrs 0 free
space 16283 owner 22036480
[ 238.576361][ T2052] ------------[ cut here ]------------
[ 238.581694][ T2052] kernel BUG at fs/btrfs/volumes.c:7157!
[ 238.587222][ T2052] invalid opcode: 0000 [#1] SMP KASAN PTI
[ 238.592808][ T2052] CPU: 5 PID: 2052 Comm: mount Not tainted
5.17.0-rc4-00095-g7f159e82828e #1
[ 238.601424][ T2052] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05 12/05/2013
[ 238.609347][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
[ 238.615411][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2
0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c 89 c7
e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
[ 238.634889][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
[ 238.640817][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX: 0000000000000000
[ 238.648652][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff52000679e75
[ 238.656487][ T2052] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
[ 238.661055][ T339] 512+0 records in
[ 238.664320][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff88812830c500
[ 238.664322][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15: 0000000000000022
[ 238.664323][ T2052] FS: 00007f66fb9b4100(0000) GS:ffff8881a6e80000(0000)
knlGS:0000000000000000
[ 238.664325][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 238.664327][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4: 00000000001706e0
[ 238.667935][ T339]
[ 238.675758][ T2052] Call Trace:
[ 238.675761][ T2052] <TASK>
[ 238.675762][ T2052] ? _raw_spin_lock+0x81/0x100
[ 238.719432][ T2052] ? _raw_spin_lock_bh+0x100/0x100
[ 238.724404][ T2052] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
[ 238.731635][ T2052] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
[ 238.731805][ T339] 512+0 records out
[ 238.737188][ T339]
[ 238.737177][ T2052] ? btrfs_get_token_64+0x700/0x700 [btrfs]
[ 238.748791][ T2052] ? memcpy+0x39/0x80
[ 238.752632][ T2052] ? write_extent_buffer+0x192/0x240 [btrfs]
[ 238.758510][ T2052] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
[ 238.764301][ T2052] ? read_one_dev+0x13c0/0x13c0 [btrfs]
[ 238.769742][ T2052] ? mutex_lock+0x80/0x100
[ 238.774016][ T2052] ? __mutex_lock_slowpath+0x40/0x40
[ 238.779169][ T2052] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
[ 238.785244][ T2052] open_ctree+0x16ac/0x2656 [btrfs]
[ 238.790345][ T2052] btrfs_mount_root.cold+0x13/0x192 [btrfs]
[ 238.796139][ T2052] ? arch_stack_walk+0x9e/0x100
[ 238.800848][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 238.806803][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 238.812382][ T2052] ? legacy_parse_param+0x6a/0x7c0
[ 238.817352][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
[ 238.823313][ T2052] legacy_get_tree+0xef/0x200
[ 238.827848][ T2052] vfs_get_tree+0x84/0x2c0
[ 238.832122][ T2052] fc_mount+0xf/0x80
[ 238.835879][ T2052] vfs_kern_mount+0x71/0xc0
[ 238.840852][ T2052] btrfs_mount+0x1fc/0xa40 [btrfs]
[ 238.845864][ T2052] ? kasan_save_stack+0x1e/0x40
[ 238.850573][ T2052] ? kasan_set_track+0x21/0x40
[ 238.855202][ T2052] ? kasan_set_free_info+0x20/0x40
[ 238.860181][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 238.865988][ T2052] ? __x64_sys_mount+0x12c/0x1c0
[ 238.870784][ T2052] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 238.876709][ T2052] ? terminate_walk+0x203/0x4c0
[ 238.881415][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
[ 238.886993][ T2052] ? legacy_parse_param+0x6a/0x7c0
[ 238.891963][ T2052] ? vfs_parse_fs_string+0xd7/0x140
[ 238.897021][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
[ 238.902809][ T2052] ? legacy_get_tree+0xef/0x200
[ 238.907519][ T2052] legacy_get_tree+0xef/0x200
[ 238.912051][ T2052] ? security_capable+0x56/0xc0
[ 238.916761][ T2052] vfs_get_tree+0x84/0x2c0
[ 238.921036][ T2052] ? ns_capable_common+0x57/0x100
[ 238.925921][ T2052] path_mount+0x7fc/0x1a40
[ 238.930205][ T2052] ? kasan_set_track+0x21/0x40
[ 238.934838][ T2052] ? finish_automount+0x600/0x600
[ 238.939722][ T2052] ? kmem_cache_free+0xa1/0x400
[ 238.944434][ T2052] do_mount+0xca/0x100
[ 238.948362][ T2052] ? path_mount+0x1a40/0x1a40
[ 238.952900][ T2052] ? _copy_from_user+0x94/0x100
[ 238.957609][ T2052] ? memdup_user+0x4e/0x80
[ 238.961886][ T2052] __x64_sys_mount+0x12c/0x1c0
[ 238.966510][ T2052] do_syscall_64+0x3b/0xc0
[ 238.970791][ T2052] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 238.976554][ T2052] RIP: 0033:0x7f66fbbb2fea
[ 238.980840][ T2052] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f
1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff
ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
[ 239.000318][ T2052] RSP: 002b:00007fffa196f178 EFLAGS: 00000246 ORIG_RAX:
00000000000000a5
[ 239.008593][ T2052] RAX: ffffffffffffffda RBX: 0000562feab9a970 RCX: 00007f66fbbb2fea
[ 239.016430][ T2052] RDX: 0000562feab9ab80 RSI: 0000562feab9abc0 RDI: 0000562feab9aba0
[ 239.024264][ T2052] RBP: 00007f66fbf001c4 R08: 0000000000000000 R09: 0000562feab9d890
[ 239.032108][ T2052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 239.039946][ T2052] R13: 0000000000000000 R14: 0000562feab9aba0 R15: 0000562feab9ab80
[ 239.047783][ T2052] </TASK>
[ 239.050664][ T2052] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
zstd_compress libcrc32c sd_mod t10_pi sg ipmi_devintf ata_generic ipmi_msghandler
intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915
kvm_intel kvm intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul
crc32c_intel syscopyarea ghash_clmulni_intel sysfillrect mei_wdt sysimgblt fb_sys_fops
ata_piix rapl intel_cstate mei_me drm libata mei intel_uncore video ip_tables
[ 239.094228][ T2052] ---[ end trace 0000000000000000 ]---
[ 239.099560][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
[ 239.105641][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84 d2
0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c 89 c7
e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
[ 239.125151][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
[ 239.131117][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX: 0000000000000000
[ 239.138981][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI: fffff52000679e75
[ 239.146847][ T2052] RBP: 000000000000033c R08: 000000000000005e R09: ffffed1034dd6791
[ 239.154710][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12: ffff88812830c500
[ 239.162579][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15: 0000000000000022
[ 239.170443][ T2052] FS: 00007f66fb9b4100(0000) GS:ffff8881a6e80000(0000)
knlGS:0000000000000000
[ 239.179267][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 239.185742][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4: 00000000001706e0
[ 239.193607][ T2052] Kernel panic - not syncing: Fatal exception
[ 239.199567][ T2052] Kernel Offset: disabled
Thanks,
Qu
>
> [ 44.577527][ T1980] ------------[ cut here ]------------
> [ 44.583552][ T335]
> [ 44.583990][ T337] 512+0 records out
> [ 44.583997][ T337]
> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 44.598832][ T335] Data: single 8.00MiB
> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted
5.17.0-rc4-00095-g7f159e82828e #1
> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS A05
12/05/2013
> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
> [ 44.605509][ T335]
> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03 38 d0 7c 08 84
d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85 19 fb ff ff <0f> 0b 4c
> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000 RCX:
0000000000000000
> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
fffff5200057ce75
> [ 44.612227][ T335] Metadata: DUP 1.00GiB
> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e R09:
ffffed1034dd6791
> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
ffff888214586b40
> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c R15:
0000000000000022
> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000) GS:ffff8881a6e80000(0000)
knlGS:0000000000000000
> [ 44.622475][ T335]
> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003 CR4:
00000000001706e0
> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
0000000000000400
> [ 44.628588][ T1980] Call Trace:
> [ 44.638095][ T335] System: DUP 8.00MiB
> [ 44.645166][ T1980] <TASK>
> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
> [ 44.651206][ T335]
> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
> [ 44.653395][ T1980] ? __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 44.673370][ T335] SSD detected: no
> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
> [ 44.686756][ T335]
> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
> [ 44.701187][ T335] Zoned device: no
> [ 44.708574][ T1980] ? memcpy+0x39/0x80
> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
> [ 44.716449][ T335]
> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
> [ 44.734138][ T335] Incompat features: extref, skinny-metadata, no-holes
> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
> [ 44.741786][ T335]
> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
> [ 44.758164][ T335] Runtime features: free-space-tree
> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
> [ 44.768515][ T335]
> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
> [ 44.777966][ T335] Checksum: crc32c
> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
> [ 44.784268][ T335]
> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.796977][ T335] Number of devices: 1
> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.806131][ T335]
> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 44.814273][ T335] Devices:
> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.822077][ T335]
> [ 44.827928][ T1980] fc_mount+0xf/0x80
> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
> [ 44.830557][ T335] ID SIZE PATH
> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
> [ 44.842730][ T335]
> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.859803][ T335]
> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.871101][ T335]
> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 44.878354][ T335]
> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 44.895501][ T335]
> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
> [ 44.905612][ T335] btrfs
> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
> [ 44.913278][ T335]
> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1 /fs/sdb1
> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
> [ 44.931642][ T335]
> [ 44.935926][ T1980] do_mount+0xca/0x100
> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
> [ 44.946884][ T335]
> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e
0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01
> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
> [ 44.956197][ T335] btrfs
> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246 ORIG_RAX:
00000000000000a5
> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970 RCX:
00007fad1bf10fea
> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0 RDI:
00005628efc57ba0
> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000 R09:
00005628efc5a890
> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246 R12:
0000000000000000
> [ 44.962993][ T335]
> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0 R15:
00005628efc57b80
> [ 44.967616][ T1980] </TASK>
> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs blake2b_generic xor raid6_pq
> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2 /fs/sdb2
> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
> [ 44.983019][ T335]
> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler intel_rapl_msr
intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel
> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper irqbypass
crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel syscopyarea sysfillrect
> [ 44.998174][ T335]
> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix intel_cstate
libata drm mei_me mei intel_uncore video ip_tables
> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>
>
>>
>> Thanks,
>> Qu
>>
>>>
>>>
>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
5.17.0-rc4-00095-g6b837d4c40d5 #1
>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN, BIOS
A05 12/05/2013
>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff ff e8 c4
f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8 96 c0 e9 3b f4 ff ff <0f>
0b 0f
>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600 RCX:
ffff88810231d61c
>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004 RDI:
ffff8881023a2458
>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001 R09:
ffffed102828100d
>>> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c R12:
0000000000000000
>>> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000 R15:
ffff888129c9c000
>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000) GS:ffff8881a6d00000(0000)
knlGS:0000000000000000
>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004 CR4:
00000000001706e0
>>> [ 75.404785][ T3602] Call Trace:
>>> [ 75.407886][ T3602] <TASK>
>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40 [btrfs]
>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
>>> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0 [btrfs]
>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300 [btrfs]
>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200 [btrfs]
>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340 [btrfs]
>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80 [btrfs]
>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180 [btrfs]
>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720 [btrfs]
>>> [ 75.528483][ T3602] ? btrfs_finish_block_group_to_copy+0x3c0/0x3c0
[btrfs]
>>> [ 75.535440][ T3602] ?
__raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.570838][ T3602] ? btrfs_ioctl_get_supported_features+0x40/0x40
[btrfs]
>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00 26 00 00
00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48>
3d 01
>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246 ORIG_RAX:
0000000000000010
>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0 RCX:
00007f94c25df427
>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435 RDI:
0000000000000004
>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000 R09:
000055d51e9fa580
>>> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246 R12:
00007ffd06a4e97a
>>> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000 R15:
0000000000000005
>>> [ 75.710600][ T3602] </TASK>
>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs blake2b_generic xor
raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ata_generic ipmi_devintf
ipmi_msghandler
>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp
coretemp i915 kvm_intel kvm intel_gtt ttm irqbypass crct10dif_pclmul crc32_pclmul
crc32c_intel
>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm libata mei_me intel_uncore mei video
ip_tables
>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>
>>>
>>>>
>>>> Thanks,
>>>> Qu
>>>>
_______________________________________________
LKP mailing list -- lkp(a)lists.01.org
To unsubscribe send an email to lkp-leave(a)lists.01.org
4:25 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
On 2022/3/17 12:37, Yujie Liu wrote:
Hi Qu,
On 3/14/2022 10:24, Qu Wenruo wrote:
>
>
> On 2022/3/14 10:05, Oliver Sang wrote:
>> Hi Qu,
>>
>> On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>>>
>>>
>>> On 2022/3/9 15:49, Oliver Sang wrote:
>>>> Hi Qu,
>>>>
>>>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>>>
>>>>>
>>>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>>>> Hi Qu,
>>>>>>
>>>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>>>
>>>>>>>
>>>>>>> This is weird, the code is from
simple_stripe_full_stripe_len(),
>>>>>>> which
>>>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>>>
>>>>>>> In that case, their sub_stripes should be either 1 or 2, why
we
>>>>>>> got 0 there?
>>>>>>>
>>>>>>> In fact, from volumes.c, all sub_stripes is from
>>>>>>> btrfs_raid_array[],
>>>>>>> which all have either 1 or 2 sub_stripes.
>>>>>>>
>>>>>>>
>>>>>>> Although the code is old, not the latest version, it should
>>>>>>> still not
>>>>>>> cause such problem.
>>>>>>>
>>>>>>> Mind to retest with my branch to see if it can be
reproduced?
>>>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>>>
>>>>>> we tested head of this branch:
>>>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev and
>>>>>> related members
>>>>>> and:
>>>>>> fdad4a9615f180 btrfs: introduce dedicated helper to scrub
>>>>>> simple-stripe based range
>>>>>> on this branch.
>>>>>>
>>>>>> by attached config.
>>>>>>
>>>>>> still reproduce the same issue.
>>>>>>
>>>>>> attached dmesgs FYI.
>>>>>
>>>>> Still failed to reproduce here.
>>>>>
>>>>> Those btrfs/07[0123] tests are already in scrub/replace group, thus
I
>>>>> ran them almost hourly during the development.
>>>>>
>>>>>
>>>>> Although there are some ASSERT()s doing extra sanity checks, they
>>>>> should
>>>>> not affect the result anyway.
>>>>>
>>>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>>>> possible divide by zero bugs.
>>>>> (https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>>>
>>>>> Mind to give it a try?
>>>>
>>>>
>>>> in our tests, it seems one BUG_ON you added is triggered
>>>> (full dmesg attached):
>>>
>>> What the heck...
>>>
>>> It's indeed some weird extent mapping has its sub-stripes as 0...
>>>
>>> I must be insane or there is something fundamental wrong.
>>>
>>> Mind to try that branch again? I have updated the branch, now it will
>>> trigger BUG_ON() as soon as it finds a chunk mapping with
>>> sub_stripes == 0.
>>>
>>> I'm wondering if it's old btrfs-progs involved (which may not
properly
>>> initialize btrfs_chunk::sub_stripes) now.
>>
>> below BUG print was caught by your new patch (detail dmesg attached):
>
> Thank you very much for the detailed report!
>
> The triggered BUG_ON() means, we're getting sub_stripes == 0, for
> unrelated chunks (in this case, it's DUP from sys chunk array, from the
> full dmesg).
>
> And from the code context, it's from super-block, thus there must be
> something wrong with the mkfs.btrfs.
>
> But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
> still no reproduce.
>
> Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2" and
> "btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of it?
>
> As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
We have added the "btrfs ins dump" commands after mkfs btrfs call, and
got below log:
(full dmesg attached)
[...]
[ 94.332728][ T337] item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM
13631488) itemoff 16105 itemsize 80
[ 94.332733][ T337]
[ 94.344629][ T337] length 8388608 owner 2 stripe_len 65536
type DATA
[ 94.344635][ T337]
[ 94.354342][ T337] io_align 65536 io_width 65536
sector_size 4096
[ 94.354348][ T337]
[ 94.363469][ T337] num_stripes 1 sub_stripes 1
Correct value.
[ 94.420718][ T337] num_stripes 2 sub_stripes 1
Correct value too.
[...]
[ 94.454066][ T337]
[ 94.463995][ T337] item 3 key (FIRST_CHUNK_TREE CHUNK_ITEM
30408704) itemoff 15881 itemsize 112
[ 94.464001][ T337]
[ 94.476279][ T337] length 1073741824 owner 2 stripe_len
65536 type METADATA|DUP
[ 94.476288][ T337]
[ 94.486957][ T337] io_align 65536 io_width 65536
sector_size 4096
[ 94.486963][ T337]
[ 94.496023][ T337] num_stripes 2 sub_stripes 1
All the sub_stripes values are correct.
So the on-disk values are correct, not something wrong in btrfs-progs.
[ 238.576361][ T2052] ------------[ cut here ]------------
[ 238.581694][ T2052] kernel BUG at fs/btrfs/volumes.c:7157!
But we still got a sub_stripes value as 0, from the super block
sys_chunk_array.
I have no idea why this could even happen.
There used to be some bug in misc-next, that makes extent buffer read to
always return 0.
But I don't think that's still in my tree.
Anyway, I have updated the refactor_scrub_testing branch, with one new
RFC patch, and rebased its base.
(Of course, I tested it locally using the scrub and replace group
without crash)
Mind to give it a try?
This branch will no longer trust the sub_stripe value from on-disk data,
and the branch base is much newer, definitely without the old possible
read extent buffer value bug.
Although the debugging BUG_ON()s are removed, if the divide error still
happens, I really need to check my sanity then...
Thanks,
Qu
> [ 238.587222][ T2052] invalid opcode: 0000 [#1] SMP KASAN PTI
> [ 238.592808][ T2052] CPU: 5 PID: 2052 Comm: mount Not tainted
> 5.17.0-rc4-00095-g7f159e82828e #1
> [ 238.601424][ T2052] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN,
> BIOS A05 12/05/2013
> [ 238.609347][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
> [ 238.615411][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03
> 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85
> 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b
> 7c 24 78
> [ 238.634889][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
> [ 238.640817][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX:
> 0000000000000000
> [ 238.648652][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
> fffff52000679e75
> [ 238.656487][ T2052] RBP: 000000000000033c R08: 000000000000005e R09:
> ffffed1034dd6791
> [ 238.661055][ T339] 512+0 records in
> [ 238.664320][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
> ffff88812830c500
> [ 238.664322][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15:
> 0000000000000022
> [ 238.664323][ T2052] FS: 00007f66fb9b4100(0000)
> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
> [ 238.664325][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 238.664327][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4:
> 00000000001706e0
> [ 238.667935][ T339]
> [ 238.675758][ T2052] Call Trace:
> [ 238.675761][ T2052] <TASK>
> [ 238.675762][ T2052] ? _raw_spin_lock+0x81/0x100
> [ 238.719432][ T2052] ? _raw_spin_lock_bh+0x100/0x100
> [ 238.724404][ T2052] ?
> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
> [ 238.731635][ T2052] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
> [ 238.731805][ T339] 512+0 records out
> [ 238.737188][ T339]
> [ 238.737177][ T2052] ? btrfs_get_token_64+0x700/0x700 [btrfs]
> [ 238.748791][ T2052] ? memcpy+0x39/0x80
> [ 238.752632][ T2052] ? write_extent_buffer+0x192/0x240 [btrfs]
> [ 238.758510][ T2052] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
> [ 238.764301][ T2052] ? read_one_dev+0x13c0/0x13c0 [btrfs]
> [ 238.769742][ T2052] ? mutex_lock+0x80/0x100
> [ 238.774016][ T2052] ? __mutex_lock_slowpath+0x40/0x40
> [ 238.779169][ T2052] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
> [ 238.785244][ T2052] open_ctree+0x16ac/0x2656 [btrfs]
> [ 238.790345][ T2052] btrfs_mount_root.cold+0x13/0x192 [btrfs]
> [ 238.796139][ T2052] ? arch_stack_walk+0x9e/0x100
> [ 238.800848][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 238.806803][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 238.812382][ T2052] ? legacy_parse_param+0x6a/0x7c0
> [ 238.817352][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
> [ 238.823313][ T2052] legacy_get_tree+0xef/0x200
> [ 238.827848][ T2052] vfs_get_tree+0x84/0x2c0
> [ 238.832122][ T2052] fc_mount+0xf/0x80
> [ 238.835879][ T2052] vfs_kern_mount+0x71/0xc0
> [ 238.840852][ T2052] btrfs_mount+0x1fc/0xa40 [btrfs]
> [ 238.845864][ T2052] ? kasan_save_stack+0x1e/0x40
> [ 238.850573][ T2052] ? kasan_set_track+0x21/0x40
> [ 238.855202][ T2052] ? kasan_set_free_info+0x20/0x40
> [ 238.860181][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 238.865988][ T2052] ? __x64_sys_mount+0x12c/0x1c0
> [ 238.870784][ T2052] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 238.876709][ T2052] ? terminate_walk+0x203/0x4c0
> [ 238.881415][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
> [ 238.886993][ T2052] ? legacy_parse_param+0x6a/0x7c0
> [ 238.891963][ T2052] ? vfs_parse_fs_string+0xd7/0x140
> [ 238.897021][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
> [ 238.902809][ T2052] ? legacy_get_tree+0xef/0x200
> [ 238.907519][ T2052] legacy_get_tree+0xef/0x200
> [ 238.912051][ T2052] ? security_capable+0x56/0xc0
> [ 238.916761][ T2052] vfs_get_tree+0x84/0x2c0
> [ 238.921036][ T2052] ? ns_capable_common+0x57/0x100
> [ 238.925921][ T2052] path_mount+0x7fc/0x1a40
> [ 238.930205][ T2052] ? kasan_set_track+0x21/0x40
> [ 238.934838][ T2052] ? finish_automount+0x600/0x600
> [ 238.939722][ T2052] ? kmem_cache_free+0xa1/0x400
> [ 238.944434][ T2052] do_mount+0xca/0x100
> [ 238.948362][ T2052] ? path_mount+0x1a40/0x1a40
> [ 238.952900][ T2052] ? _copy_from_user+0x94/0x100
> [ 238.957609][ T2052] ? memdup_user+0x4e/0x80
> [ 238.961886][ T2052] __x64_sys_mount+0x12c/0x1c0
> [ 238.966510][ T2052] do_syscall_64+0x3b/0xc0
> [ 238.970791][ T2052] entry_SYSCALL_64_after_hwframe+0x44/0xae
> [ 238.976554][ T2052] RIP: 0033:0x7f66fbbb2fea
> [ 238.980840][ T2052] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83
> c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
534513d9f513c4b9a622b34c8fb11281d9ee5a0644 00 00 49 89 ca b8 a5 00
> 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64
> 89 01 48
> [ 239.000318][ T2052] RSP: 002b:00007fffa196f178 EFLAGS: 00000246
> ORIG_RAX: 00000000000000a5
> [ 239.008593][ T2052] RAX: ffffffffffffffda RBX: 0000562feab9a970 RCX:
> 00007f66fbbb2fea
> [ 239.016430][ T2052] RDX: 0000562feab9ab80 RSI: 0000562feab9abc0 RDI:
> 0000562feab9aba0
> [ 239.024264][ T2052] RBP: 00007f66fbf001c4 R08: 0000000000000000 R09:
> 0000562feab9d890
> [ 239.032108][ T2052] R10: 0000000000000000 R11: 0000000000000246 R12:
> 0000000000000000
> [ 239.039946][ T2052] R13: 0000000000000000 R14: 0000562feab9aba0 R15:
> 0000562feab9ab80
> [ 239.047783][ T2052] </TASK>
> [ 239.050664][ T2052] Modules linked in: dm_mod btrfs blake2b_generic
> xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ipmi_devintf
> ata_generic ipmi_msghandler intel_rapl_msr intel_rapl_common
> x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm
> intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul
> crc32c_intel syscopyarea ghash_clmulni_intel sysfillrect mei_wdt
> sysimgblt fb_sys_fops ata_piix rapl intel_cstate mei_me drm libata mei
> intel_uncore video ip_tables
> [ 239.094228][ T2052] ---[ end trace 0000000000000000 ]---
> [ 239.099560][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
> [ 239.105641][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03
> 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85
> 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b
> 7c 24 78
> [ 239.125151][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
> [ 239.131117][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX:
> 0000000000000000
> [ 239.138981][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
> fffff52000679e75
> [ 239.146847][ T2052] RBP: 000000000000033c R08: 000000000000005e R09:
> ffffed1034dd6791
> [ 239.154710][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
> ffff88812830c500
> [ 239.162579][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15:
> 0000000000000022
> [ 239.170443][ T2052] FS: 00007f66fb9b4100(0000)
> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
> [ 239.179267][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 239.185742][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4:
> 00000000001706e0
> [ 239.193607][ T2052] Kernel panic - not syncing: Fatal exception
> [ 239.199567][ T2052] Kernel Offset: disabled
>
>>
>> Thanks,
>> Qu
>>>
>>> [ 44.577527][ T1980] ------------[ cut here ]------------
>>> [ 44.583552][ T335]
>>> [ 44.583990][ T337] 512+0 records out
>>> [ 44.583997][ T337]
>>> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
>>> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
>>> [ 44.598832][ T335] Data: single 8.00MiB
>>> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted
>>> 5.17.0-rc4-00095-g7f159e82828e #1
>>> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN,
>>> BIOS A05 12/05/2013
>>> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
>>> [ 44.605509][ T335]
>>> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0
>>> 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2
>>> 0f 85 19 fb ff ff <0f> 0b 4c
>>> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
>>> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
>>> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000
>>> RCX: 0000000000000000
>>> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008
>>> RDI: fffff5200057ce75
>>> [ 44.612227][ T335] Metadata: DUP 1.00GiB
>>> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e
>>> R09: ffffed1034dd6791
>>> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790
>>> R12: ffff888214586b40
>>> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c
>>> R15: 0000000000000022
>>> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000)
>>> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
>>> [ 44.622475][ T335]
>>> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003
>>> CR4: 00000000001706e0
>>> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000
>>> DR2: 0000000000000000
>>> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0
>>> DR7: 0000000000000400
>>> [ 44.628588][ T1980] Call Trace:
>>> [ 44.638095][ T335] System: DUP 8.00MiB
>>> [ 44.645166][ T1980] <TASK>
>>> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
>>> [ 44.651206][ T335]
>>> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
>>> [ 44.653395][ T1980] ?
>>> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>> [ 44.673370][ T335] SSD detected: no
>>> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
>>> [ 44.686756][ T335]
>>> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
>>> [ 44.701187][ T335] Zoned device: no
>>> [ 44.708574][ T1980] ? memcpy+0x39/0x80
>>> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
>>> [ 44.716449][ T335]
>>> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
>>> [ 44.734138][ T335] Incompat features: extref, skinny-metadata,
>>> no-holes
>>> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
>>> [ 44.741786][ T335]
>>> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
>>> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
>>> [ 44.758164][ T335] Runtime features: free-space-tree
>>> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
>>> [ 44.768515][ T335]
>>> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
>>> [ 44.777966][ T335] Checksum: crc32c
>>> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
>>> [ 44.784268][ T335]
>>> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
>>> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>>> [ 44.796977][ T335] Number of devices: 1
>>> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>>> [ 44.806131][ T335]
>>> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
>>> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>>> [ 44.814273][ T335] Devices:
>>> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
>>> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
>>> [ 44.822077][ T335]
>>> [ 44.827928][ T1980] fc_mount+0xf/0x80
>>> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
>>> [ 44.830557][ T335] ID SIZE PATH
>>> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
>>> [ 44.842730][ T335]
>>> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
>>> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
>>> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
>>> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
>>> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>>> [ 44.859803][ T335]
>>> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
>>> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 44.871101][ T335]
>>> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
>>> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>>> [ 44.878354][ T335]
>>> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
>>> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
>>> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
>>> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>>> [ 44.895501][ T335]
>>> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
>>> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
>>> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
>>> [ 44.905612][ T335] btrfs
>>> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
>>> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
>>> [ 44.913278][ T335]
>>> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
>>> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
>>> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1
>>> /fs/sdb1
>>> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
>>> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
>>> [ 44.931642][ T335]
>>> [ 44.935926][ T1980] do_mount+0xca/0x100
>>> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
>>> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
>>> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
>>> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
>>> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
>>> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
>>> [ 44.946884][ T335]
>>> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
>>> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48
>>> 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8
>>> a5 00 00 00 0f 05 <48> 3d 01
>>> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
>>> [ 44.956197][ T335] btrfs
>>> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246
>>> ORIG_RAX: 00000000000000a5
>>> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970
>>> RCX: 00007fad1bf10fea
>>> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0
>>> RDI: 00005628efc57ba0
>>> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000
>>> R09: 00005628efc5a890
>>> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246
>>> R12: 0000000000000000
>>> [ 44.962993][ T335]
>>> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0
>>> R15: 00005628efc57b80
>>> [ 44.967616][ T1980] </TASK>
>>> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs
>>> blake2b_generic xor raid6_pq
>>> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2
>>> /fs/sdb2
>>> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
>>> [ 44.983019][ T335]
>>> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler
>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal
>>> intel_powerclamp coretemp kvm_intel
>>> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
>>> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper
>>> irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>> ghash_clmulni_intel syscopyarea sysfillrect
>>> [ 44.998174][ T335]
>>> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix
>>> intel_cstate libata drm mei_me mei intel_uncore video ip_tables
>>> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>>>
>>>
>>>>
>>>> Thanks,
>>>> Qu
>>>>
>>>>>
>>>>>
>>>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
>>>>> 5.17.0-rc4-00095-g6b837d4c40d5 #1
>>>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex
>>>>> 9020/0DNKMN, BIOS A05 12/05/2013
>>>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340 [btrfs]
>>>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3 ff
>>>>> ff e8 c4 f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2 f8
>>>>> 96 c0 e9 3b f4 ff ff <0f> 0b 0f
>>>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS: 00010246
>>>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX: ffff88810231d600
>>>>> RCX: ffff88810231d61c
>>>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI: 0000000000000004
>>>>> RDI: ffff8881023a2458
>>>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08: 0000000000000001
>>>>> R09: ffffed102828100d
>>>>> [ 75.366550][ T3602] R10: ffff888141408063 R11: ffffed102828100c
>>>>> R12: 0000000000000000
>>>>> [ 75.374282][ T3602] R13: 0000000000100000 R14: ffff888141408000
>>>>> R15: ffff888129c9c000
>>>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000)
>>>>> GS:ffff8881a6d00000(0000) knlGS:0000000000000000
>>>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0:
>>>>> 0000000080050033
>>>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3: 000000020a796004
>>>>> CR4: 00000000001706e0
>>>>> [ 75.404785][ T3602] Call Trace:
>>>>> [ 75.407886][ T3602] <TASK>
>>>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40
>>>>> [btrfs]
>>>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0 [btrfs]
>>>>> [ 75.422853][ T3602] ? btrfs_remove_ordered_extent+0xbc0/0xbc0
>>>>> [btrfs]
>>>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300
[btrfs]
>>>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340 [btrfs]
>>>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200
[btrfs]
>>>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0 [btrfs]
>>>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340
[btrfs]
>>>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80
>>>>> [btrfs]
>>>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180
>>>>> [btrfs]
>>>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>>>> [ 75.521819][ T3602] btrfs_dev_replace_by_ioctl.cold+0x62c/0x720
>>>>> [btrfs]
>>>>> [ 75.528483][ T3602] ?
>>>>> btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
>>>>> [ 75.535440][ T3602] ?
>>>>> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>>>> [ 75.564991][ T3602] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>>> [ 75.570838][ T3602] ?
>>>>> btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
>>>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>>>> [ 75.601075][ T3602] ? __x64_sys_pidfd_send_signal+0x600/0x600
>>>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7 00
>>>>> 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00
>>>>> b8 10 00 00 00 0f 05 <48> 3d 01
>>>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS: 00000246
>>>>> ORIG_RAX: 0000000000000010
>>>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX: 000055d51e9f72a0
>>>>> RCX: 00007f94c25df427
>>>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI: 00000000ca289435
>>>>> RDI: 0000000000000004
>>>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08: 0000000000000000
>>>>> R09: 000055d51e9fa580
>>>>> [ 75.695137][ T3602] R10: 0000000000000008 R11: 0000000000000246
>>>>> R12: 00007ffd06a4e97a
>>>>> [ 75.702868][ T3602] R13: 0000000000000004 R14: 0000000000000000
>>>>> R15: 0000000000000005
>>>>> [ 75.710600][ T3602] </TASK>
>>>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs
>>>>> blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi
>>>>> sg ata_generic ipmi_devintf ipmi_msghandler
>>>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal
>>>>> intel_powerclamp coretemp i915 kvm_intel kvm intel_gtt ttm
>>>>> irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect
>>>>> sysimgblt fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm libata
>>>>> mei_me intel_uncore mei video ip_tables
>>>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>>>
>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Qu
>>>>>>
>> _______________________________________________
>> LKP mailing list -- lkp(a)lists.01.org
>> To unsubscribe send an email to lkp-leave(a)lists.01.org
12:54 p.m.
New subject: [btrfs] 3626a285f8: divide_error:#[##]
Hi Qu,
On 3/17/2022 13:25, Qu Wenruo wrote:
On 2022/3/17 12:37, Yujie Liu wrote:
> Hi Qu,
>
> On 3/14/2022 10:24, Qu Wenruo wrote:
>>
>>
>> On 2022/3/14 10:05, Oliver Sang wrote:
>>> Hi Qu,
>>>
>>> On Wed, Mar 09, 2022 at 04:42:41PM +0800, Qu Wenruo wrote:
>>>>
>>>>
>>>> On 2022/3/9 15:49, Oliver Sang wrote:
>>>>> Hi Qu,
>>>>>
>>>>> On Fri, Mar 04, 2022 at 03:26:19PM +0800, Qu Wenruo wrote:
>>>>>>
>>>>>>
>>>>>> On 2022/3/2 16:44, Oliver Sang wrote:
>>>>>>> Hi Qu,
>>>>>>>
>>>>>>> On Tue, Mar 01, 2022 at 03:47:38PM +0800, Qu Wenruo wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>> This is weird, the code is from
simple_stripe_full_stripe_len(),
>>>>>>>> which
>>>>>>>> means the chunk map must be RAID0 or RAID10.
>>>>>>>>
>>>>>>>> In that case, their sub_stripes should be either 1 or 2,
why we
>>>>>>>> got 0 there?
>>>>>>>>
>>>>>>>> In fact, from volumes.c, all sub_stripes is from
>>>>>>>> btrfs_raid_array[],
>>>>>>>> which all have either 1 or 2 sub_stripes.
>>>>>>>>
>>>>>>>>
>>>>>>>> Although the code is old, not the latest version, it
should
>>>>>>>> still not
>>>>>>>> cause such problem.
>>>>>>>>
>>>>>>>> Mind to retest with my branch to see if it can be
reproduced?
>>>>>>>> https://github.com/adam900710/linux/tree/refactor_scrub
>>>>>>>
>>>>>>> we tested head of this branch:
>>>>>>> d6e3a8c42f2fad btrfs: scrub: rename scrub_bio::pagev
and
>>>>>>> related members
>>>>>>> and:
>>>>>>> fdad4a9615f180 btrfs: introduce dedicated helper to
scrub
>>>>>>> simple-stripe based range
>>>>>>> on this branch.
>>>>>>>
>>>>>>> by attached config.
>>>>>>>
>>>>>>> still reproduce the same issue.
>>>>>>>
>>>>>>> attached dmesgs FYI.
>>>>>>
>>>>>> Still failed to reproduce here.
>>>>>>
>>>>>> Those btrfs/07[0123] tests are already in scrub/replace group,
thus I
>>>>>> ran them almost hourly during the development.
>>>>>>
>>>>>>
>>>>>> Although there are some ASSERT()s doing extra sanity checks,
they
>>>>>> should
>>>>>> not affect the result anyway.
>>>>>>
>>>>>> Thus I pushed a branch with more explicit BUG_ON()s to catch the
>>>>>> possible divide by zero bugs.
>>>>>>
(https://github.com/adam900710/linux/tree/refactor_scrub_testing)
>>>>>>
>>>>>> Mind to give it a try?
>>>>>
>>>>>
>>>>> in our tests, it seems one BUG_ON you added is triggered
>>>>> (full dmesg attached):
>>>>
>>>> What the heck...
>>>>
>>>> It's indeed some weird extent mapping has its sub-stripes as 0...
>>>>
>>>> I must be insane or there is something fundamental wrong.
>>>>
>>>> Mind to try that branch again? I have updated the branch, now it will
>>>> trigger BUG_ON() as soon as it finds a chunk mapping with
>>>> sub_stripes == 0.
>>>>
>>>> I'm wondering if it's old btrfs-progs involved (which may not
properly
>>>> initialize btrfs_chunk::sub_stripes) now.
>>>
>>> below BUG print was caught by your new patch (detail dmesg attached):
>>
>> Thank you very much for the detailed report!
>>
>> The triggered BUG_ON() means, we're getting sub_stripes == 0, for
>> unrelated chunks (in this case, it's DUP from sys chunk array, from the
>> full dmesg).
>>
>> And from the code context, it's from super-block, thus there must be
>> something wrong with the mkfs.btrfs.
>>
>> But unfortunately, I re-compiled my btrfs-progs v5.15.1, retried, and
>> still no reproduce.
>>
>> Mind to share the result of "btrfs ins dump-tree -t chunk /dev/sdb2"
and
>> "btrfs ins dump-super -f /dev/sdb2" just after the mkfs.btrfs call of
it?
>>
>> As the BUG_ON() mostly means, the result from mkfs.btrfs is not correct.
>
>
> We have added the "btrfs ins dump" commands after mkfs btrfs call, and
> got below log:
> (full dmesg attached)
>
[...]
> [ 94.332728][ T337] item 1 key (FIRST_CHUNK_TREE CHUNK_ITEM
> 13631488) itemoff 16105 itemsize 80
> [ 94.332733][ T337]
> [ 94.344629][ T337] length 8388608 owner 2 stripe_len 65536
> type DATA
> [ 94.344635][ T337]
> [ 94.354342][ T337] io_align 65536 io_width 65536
> sector_size 4096
> [ 94.354348][ T337]
> [ 94.363469][ T337] num_stripes 1 sub_stripes 1
Correct value.
> [ 94.420718][ T337] num_stripes 2 sub_stripes 1
Correct value too.
[...]
> [ 94.454066][ T337]
> [ 94.463995][ T337] item 3 key (FIRST_CHUNK_TREE CHUNK_ITEM
> 30408704) itemoff 15881 itemsize 112
> [ 94.464001][ T337]
> [ 94.476279][ T337] length 1073741824 owner 2 stripe_len
> 65536 type METADATA|DUP
> [ 94.476288][ T337]
> [ 94.486957][ T337] io_align 65536 io_width 65536
> sector_size 4096
> [ 94.486963][ T337]
> [ 94.496023][ T337] num_stripes 2 sub_stripes 1
All the sub_stripes values are correct.
So the on-disk values are correct, not something wrong in btrfs-progs.
> [ 238.576361][ T2052] ------------[ cut here ]------------
> [ 238.581694][ T2052] kernel BUG at fs/btrfs/volumes.c:7157!
But we still got a sub_stripes value as 0, from the super block
sys_chunk_array.
I have no idea why this could even happen.
There used to be some bug in misc-next, that makes extent buffer read to
always return 0.
But I don't think that's still in my tree.
Anyway, I have updated the refactor_scrub_testing branch, with one new
RFC patch, and rebased its base.
(Of course, I tested it locally using the scrub and replace group
without crash)
Mind to give it a try?
This branch will no longer trust the sub_stripe value from on-disk data,
and the branch base is much newer, definitely without the old possible
read extent buffer value bug.
we have tested the new head of refactor_scrub_testing branch
(55a862df9ec6af btrfs: don't trust sub_stripes from disk)
and found the issue is gone.
=========================================================================================
compiler/disk/fs/kconfig/rootfs/test/testcase/ucode:
gcc-9/6HDD/btrfs/x86_64-rhel-8.3-func/debian-10.4-x86_64-20200603.cgz/btrfs-group-07/xfstests/0x28
commit:
3626a285f87d (btrfs: introduce dedicated helper to scrub simple-stripe based range)
55a862df9ec6 (btrfs: don't trust sub_stripes from disk)
3626a285f87dceb4 55a862df9ec6af825501b7550ca
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
6:7 -86% :12 dmesg.RIP:scrub_stripe[btrfs]
6:7 -86% :12 dmesg.divide_error:#[##]
=========================================================================================
compiler/disk/fs/kconfig/rootfs/test/testcase/ucode:
gcc-9/6HDD/btrfs/x86_64-rhel-8.3-func/debian-10.4-x86_64-20200603.cgz/btrfs-group-07/xfstests/0x28
commit:
7f159e82828e (btrfs: debug the divide error)
55a862df9ec6 (btrfs: don't trust sub_stripes from disk)
7f159e82828e70d3 55a862df9ec6af825501b7550ca
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
10:11 -91% :6 dmesg.kernel_BUG_at_fs/btrfs/volumes.c
> Although the debugging BUG_ON()s are removed, if the divide error still
> happens, I really need to check my sanity then...
>
> Thanks,
> Qu
>
>
>
>> [ 238.587222][ T2052] invalid opcode: 0000 [#1] SMP KASAN PTI
>> [ 238.592808][ T2052] CPU: 5 PID: 2052 Comm: mount Not tainted
>> 5.17.0-rc4-00095-g7f159e82828e #1
>> [ 238.601424][ T2052] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN,
>> BIOS A05 12/05/2013
>> [ 238.609347][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
>> [ 238.615411][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03
>> 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85
>> 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b
>> 7c 24 78
>> [ 238.634889][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
>> [ 238.640817][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX:
>> 0000000000000000
>> [ 238.648652][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
>> fffff52000679e75
>> [ 238.656487][ T2052] RBP: 000000000000033c R08: 000000000000005e R09:
>> ffffed1034dd6791
>> [ 238.661055][ T339] 512+0 records in
>> [ 238.664320][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
>> ffff88812830c500
>> [ 238.664322][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15:
>> 0000000000000022
>> [ 238.664323][ T2052] FS: 00007f66fb9b4100(0000)
>> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
>> [ 238.664325][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [ 238.664327][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4:
>> 00000000001706e0
>> [ 238.667935][ T339]
>> [ 238.675758][ T2052] Call Trace:
>> [ 238.675761][ T2052] <TASK>
>> [ 238.675762][ T2052] ? _raw_spin_lock+0x81/0x100
>> [ 238.719432][ T2052] ? _raw_spin_lock_bh+0x100/0x100
>> [ 238.724404][ T2052] ?
>> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>> [ 238.731635][ T2052] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
>> [ 238.731805][ T339] 512+0 records out
>> [ 238.737188][ T339]
>> [ 238.737177][ T2052] ? btrfs_get_token_64+0x700/0x700 [btrfs]
>> [ 238.748791][ T2052] ? memcpy+0x39/0x80
>> [ 238.752632][ T2052] ? write_extent_buffer+0x192/0x240 [btrfs]
>> [ 238.758510][ T2052] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
>> [ 238.764301][ T2052] ? read_one_dev+0x13c0/0x13c0 [btrfs]
>> [ 238.769742][ T2052] ? mutex_lock+0x80/0x100
>> [ 238.774016][ T2052] ? __mutex_lock_slowpath+0x40/0x40
>> [ 238.779169][ T2052] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
>> [ 238.785244][ T2052] open_ctree+0x16ac/0x2656 [btrfs]
>> [ 238.790345][ T2052] btrfs_mount_root.cold+0x13/0x192 [btrfs]
>> [ 238.796139][ T2052] ? arch_stack_walk+0x9e/0x100
>> [ 238.800848][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
>> [ 238.806803][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
>> [ 238.812382][ T2052] ? legacy_parse_param+0x6a/0x7c0
>> [ 238.817352][ T2052] ? parse_rescue_options+0x300/0x300 [btrfs]
>> [ 238.823313][ T2052] legacy_get_tree+0xef/0x200
>> [ 238.827848][ T2052] vfs_get_tree+0x84/0x2c0
>> [ 238.832122][ T2052] fc_mount+0xf/0x80
>> [ 238.835879][ T2052] vfs_kern_mount+0x71/0xc0
>> [ 238.840852][ T2052] btrfs_mount+0x1fc/0xa40 [btrfs]
>> [ 238.845864][ T2052] ? kasan_save_stack+0x1e/0x40
>> [ 238.850573][ T2052] ? kasan_set_track+0x21/0x40
>> [ 238.855202][ T2052] ? kasan_set_free_info+0x20/0x40
>> [ 238.860181][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>> [ 238.865988][ T2052] ? __x64_sys_mount+0x12c/0x1c0
>> [ 238.870784][ T2052] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>> [ 238.876709][ T2052] ? terminate_walk+0x203/0x4c0
>> [ 238.881415][ T2052] ? vfs_parse_fs_param_source+0x3b/0x1c0
>> [ 238.886993][ T2052] ? legacy_parse_param+0x6a/0x7c0
>> [ 238.891963][ T2052] ? vfs_parse_fs_string+0xd7/0x140
>> [ 238.897021][ T2052] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>> [ 238.902809][ T2052] ? legacy_get_tree+0xef/0x200
>> [ 238.907519][ T2052] legacy_get_tree+0xef/0x200
>> [ 238.912051][ T2052] ? security_capable+0x56/0xc0
>> [ 238.916761][ T2052] vfs_get_tree+0x84/0x2c0
>> [ 238.921036][ T2052] ? ns_capable_common+0x57/0x100
>> [ 238.925921][ T2052] path_mount+0x7fc/0x1a40
>> [ 238.930205][ T2052] ? kasan_set_track+0x21/0x40
>> [ 238.934838][ T2052] ? finish_automount+0x600/0x600
>> [ 238.939722][ T2052] ? kmem_cache_free+0xa1/0x400
>> [ 238.944434][ T2052] do_mount+0xca/0x100
>> [ 238.948362][ T2052] ? path_mount+0x1a40/0x1a40
>> [ 238.952900][ T2052] ? _copy_from_user+0x94/0x100
>> [ 238.957609][ T2052] ? memdup_user+0x4e/0x80
>> [ 238.961886][ T2052] __x64_sys_mount+0x12c/0x1c0
>> [ 238.966510][ T2052] do_syscall_64+0x3b/0xc0
>> [ 238.970791][ T2052] entry_SYSCALL_64_after_hwframe+0x44/0xae
>> [ 238.976554][ T2052] RIP: 0033:0x7f66fbbb2fea
>> [ 238.980840][ T2052] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48 83
>> c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
534513d9f513c4b9a622b34c8fb11281d9ee5a0644 00 00 49 89 ca b8 a5 00
>> 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64
>> 89 01 48
>> [ 239.000318][ T2052] RSP: 002b:00007fffa196f178 EFLAGS: 00000246
>> ORIG_RAX: 00000000000000a5
>> [ 239.008593][ T2052] RAX: ffffffffffffffda RBX: 0000562feab9a970 RCX:
>> 00007f66fbbb2fea
>> [ 239.016430][ T2052] RDX: 0000562feab9ab80 RSI: 0000562feab9abc0 RDI:
>> 0000562feab9aba0
>> [ 239.024264][ T2052] RBP: 00007f66fbf001c4 R08: 0000000000000000 R09:
>> 0000562feab9d890
>> [ 239.032108][ T2052] R10: 0000000000000000 R11: 0000000000000246 R12:
>> 0000000000000000
>> [ 239.039946][ T2052] R13: 0000000000000000 R14: 0000562feab9aba0 R15:
>> 0000562feab9ab80
>> [ 239.047783][ T2052] </TASK>
>> [ 239.050664][ T2052] Modules linked in: dm_mod btrfs blake2b_generic
>> xor raid6_pq zstd_compress libcrc32c sd_mod t10_pi sg ipmi_devintf
>> ata_generic ipmi_msghandler intel_rapl_msr intel_rapl_common
>> x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm
>> intel_gtt ttm drm_kms_helper irqbypass crct10dif_pclmul crc32_pclmul
>> crc32c_intel syscopyarea ghash_clmulni_intel sysfillrect mei_wdt
>> sysimgblt fb_sys_fops ata_piix rapl intel_cstate mei_me drm libata mei
>> intel_uncore video ip_tables
>> [ 239.094228][ T2052] ---[ end trace 0000000000000000 ]---
>> [ 239.099560][ T2052] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
>> [ 239.105641][ T2052] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0 03
>> 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2 0f 85
>> 19 fb ff ff <0f> 0b 4c 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b
>> 7c 24 78
>> [ 239.125151][ T2052] RSP: 0018:ffffc900033cf6c8 EFLAGS: 00010246
>> [ 239.131117][ T2052] RAX: ffff8881028b2980 RBX: 0000000000000000 RCX:
>> 0000000000000000
>> [ 239.138981][ T2052] RDX: 0000000000000000 RSI: 0000000000000008 RDI:
>> fffff52000679e75
>> [ 239.146847][ T2052] RBP: 000000000000033c R08: 000000000000005e R09:
>> ffffed1034dd6791
>> [ 239.154710][ T2052] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790 R12:
>> ffff88812830c500
>> [ 239.162579][ T2052] R13: ffff8881028b2998 R14: ffff8881028b299c R15:
>> 0000000000000022
>> [ 239.170443][ T2052] FS: 00007f66fb9b4100(0000)
>> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
>> [ 239.179267][ T2052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [ 239.185742][ T2052] CR2: 000055f0bbc19d40 CR3: 0000000209c0a005 CR4:
>> 00000000001706e0
>> [ 239.193607][ T2052] Kernel panic - not syncing: Fatal exception
>> [ 239.199567][ T2052] Kernel Offset: disabled
>>
>>>
>>> Thanks,
>>> Qu
>>>>
>>>> [ 44.577527][ T1980] ------------[ cut here ]------------
>>>> [ 44.583552][ T335]
>>>> [ 44.583990][ T337] 512+0 records out
>>>> [ 44.583997][ T337]
>>>> [ 44.593932][ T1980] kernel BUG at fs/btrfs/volumes.c:7157!
>>>> [ 44.593940][ T1980] invalid opcode: 0000 [#1] SMP KASAN PTI
>>>> [ 44.598832][ T335] Data: single 8.00MiB
>>>> [ 44.603293][ T1980] CPU: 5 PID: 1980 Comm: mount Not tainted
>>>> 5.17.0-rc4-00095-g7f159e82828e #1
>>>> [ 44.603297][ T1980] Hardware name: Dell Inc. OptiPlex 9020/0DNKMN,
>>>> BIOS A05 12/05/2013
>>>> [ 44.603299][ T1980] RIP: 0010:read_one_chunk+0xa02/0xc80 [btrfs]
>>>> [ 44.605509][ T335]
>>>> [ 44.609168][ T1980] Code: 03 0f b6 14 02 4c 89 f0 83 e0 07 83 c0
>>>> 03 38 d0 7c 08 84 d2 0f 85 14 01 00 00 48 8b 44 24 10 8b 50 1c 85 d2
>>>> 0f 85 19 fb ff ff <0f> 0b 4c
>>>> 89 c7 e8 f4 b0 fa ff 31 c0 e9 4d ff ff ff 48 8b 7c 24 78
>>>> [ 44.609171][ T1980] RSP: 0018:ffffc90002be76c8 EFLAGS: 00010246
>>>> [ 44.609175][ T1980] RAX: ffff888102c98e00 RBX: 0000000000000000
>>>> RCX: 0000000000000000
>>>> [ 44.609178][ T1980] RDX: 0000000000000000 RSI: 0000000000000008
>>>> RDI: fffff5200057ce75
>>>> [ 44.612227][ T335] Metadata: DUP 1.00GiB
>>>> [ 44.616871][ T1980] RBP: 000000000000033c R08: 000000000000005e
>>>> R09: ffffed1034dd6791
>>>> [ 44.616873][ T1980] R10: ffff8881a6eb3c87 R11: ffffed1034dd6790
>>>> R12: ffff888214586b40
>>>> [ 44.616874][ T1980] R13: ffff888102c98e18 R14: ffff888102c98e1c
>>>> R15: 0000000000000022
>>>> [ 44.616876][ T1980] FS: 00007fad1bd12100(0000)
>>>> GS:ffff8881a6e80000(0000) knlGS:0000000000000000
>>>> [ 44.622475][ T335]
>>>> [ 44.628578][ T1980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>>>> [ 44.628580][ T1980] CR2: 00007fff9d90df68 CR3: 00000001407fc003
>>>> CR4: 00000000001706e0
>>>> [ 44.628583][ T1980] DR0: 0000000000000000 DR1: 0000000000000000
>>>> DR2: 0000000000000000
>>>> [ 44.628585][ T1980] DR3: 0000000000000000 DR6: 00000000fffe0ff0
>>>> DR7: 0000000000000400
>>>> [ 44.628588][ T1980] Call Trace:
>>>> [ 44.638095][ T335] System: DUP 8.00MiB
>>>> [ 44.645166][ T1980] <TASK>
>>>> [ 44.645168][ T1980] ? _raw_spin_lock+0x81/0x100
>>>> [ 44.651206][ T335]
>>>> [ 44.653388][ T1980] ? _raw_spin_lock_bh+0x100/0x100
>>>> [ 44.653395][ T1980] ?
>>>> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>>> [ 44.673370][ T335] SSD detected: no
>>>> [ 44.678876][ T1980] ? add_missing_dev+0x3c0/0x3c0 [btrfs]
>>>> [ 44.686756][ T335]
>>>> [ 44.694598][ T1980] ? btrfs_get_token_64+0x700/0x700 [btrfs]
>>>> [ 44.701187][ T335] Zoned device: no
>>>> [ 44.708574][ T1980] ? memcpy+0x39/0x80
>>>> [ 44.708581][ T1980] ? write_extent_buffer+0x192/0x240 [btrfs]
>>>> [ 44.716449][ T335]
>>>> [ 44.724294][ T1980] btrfs_read_sys_array+0x2c7/0x380 [btrfs]
>>>> [ 44.734138][ T335] Incompat features: extref, skinny-metadata,
>>>> no-holes
>>>> [ 44.735313][ T1980] ? read_one_dev+0x13c0/0x13c0 [btrfs]
>>>> [ 44.741786][ T335]
>>>> [ 44.749628][ T1980] ? mutex_lock+0x80/0x100
>>>> [ 44.749634][ T1980] ? __mutex_lock_slowpath+0x40/0x40
>>>> [ 44.758164][ T335] Runtime features: free-space-tree
>>>> [ 44.765352][ T1980] ? btrfs_init_workqueues+0x4c1/0x7ba [btrfs]
>>>> [ 44.768515][ T335]
>>>> [ 44.774620][ T1980] open_ctree+0x16ac/0x2656 [btrfs]
>>>> [ 44.777966][ T335] Checksum: crc32c
>>>> [ 44.782064][ T1980] btrfs_mount_root.cold+0x13/0x192 [btrfs]
>>>> [ 44.784268][ T335]
>>>> [ 44.789241][ T1980] ? arch_stack_walk+0x9e/0x100
>>>> [ 44.789247][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>>>> [ 44.796977][ T335] Number of devices: 1
>>>> [ 44.800614][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>>>> [ 44.806131][ T335]
>>>> [ 44.808314][ T1980] ? legacy_parse_param+0x6a/0x7c0
>>>> [ 44.808320][ T1980] ? parse_rescue_options+0x300/0x300 [btrfs]
>>>> [ 44.814273][ T335] Devices:
>>>> [ 44.818205][ T1980] legacy_get_tree+0xef/0x200
>>>> [ 44.818210][ T1980] vfs_get_tree+0x84/0x2c0
>>>> [ 44.822077][ T335]
>>>> [ 44.827928][ T1980] fc_mount+0xf/0x80
>>>> [ 44.827934][ T1980] vfs_kern_mount+0x71/0xc0
>>>> [ 44.830557][ T335] ID SIZE PATH
>>>> [ 44.835890][ T1980] btrfs_mount+0x1fc/0xa40 [btrfs]
>>>> [ 44.842730][ T335]
>>>> [ 44.848134][ T1980] ? kasan_save_stack+0x1e/0x40
>>>> [ 44.848149][ T1980] ? kasan_set_track+0x21/0x40
>>>> [ 44.850862][ T335] 1 300.00GiB /dev/sdb4
>>>> [ 44.854618][ T1980] ? kasan_set_free_info+0x20/0x40
>>>> [ 44.854624][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>>>> [ 44.859803][ T335]
>>>> [ 44.865032][ T1980] ? __x64_sys_mount+0x12c/0x1c0
>>>> [ 44.865036][ T1980] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>> [ 44.871101][ T335]
>>>> [ 44.873263][ T1980] ? terminate_walk+0x203/0x4c0
>>>> [ 44.873268][ T1980] ? vfs_parse_fs_param_source+0x3b/0x1c0
>>>> [ 44.878354][ T335]
>>>> [ 44.882803][ T1980] ? legacy_parse_param+0x6a/0x7c0
>>>> [ 44.882808][ T1980] ? vfs_parse_fs_string+0xd7/0x140
>>>> [ 44.889280][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb1
>>>> [ 44.890770][ T1980] ? btrfs_show_options+0xf00/0xf00 [btrfs]
>>>> [ 44.895501][ T335]
>>>> [ 44.901430][ T1980] ? legacy_get_tree+0xef/0x200
>>>> [ 44.901435][ T1980] legacy_get_tree+0xef/0x200
>>>> [ 44.901448][ T1980] ? security_capable+0x56/0xc0
>>>> [ 44.905612][ T335] btrfs
>>>> [ 44.911057][ T1980] vfs_get_tree+0x84/0x2c0
>>>> [ 44.911062][ T1980] ? ns_capable_common+0x57/0x100
>>>> [ 44.913278][ T335]
>>>> [ 44.918247][ T1980] path_mount+0x7fc/0x1a40
>>>> [ 44.918252][ T1980] ? kasan_set_track+0x21/0x40
>>>> [ 44.925201][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb1
>>>> /fs/sdb1
>>>> [ 44.927087][ T1980] ? finish_automount+0x600/0x600
>>>> [ 44.927092][ T1980] ? kmem_cache_free+0xa1/0x400
>>>> [ 44.931642][ T335]
>>>> [ 44.935926][ T1980] do_mount+0xca/0x100
>>>> [ 44.935931][ T1980] ? path_mount+0x1a40/0x1a40
>>>> [ 44.935933][ T1980] ? _copy_from_user+0x94/0x100
>>>> [ 44.938799][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb2
>>>> [ 44.941885][ T1980] ? memdup_user+0x4e/0x80
>>>> [ 44.941890][ T1980] __x64_sys_mount+0x12c/0x1c0
>>>> [ 44.941893][ T1980] do_syscall_64+0x3b/0xc0
>>>> [ 44.946884][ T335]
>>>> [ 44.951068][ T1980] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>> [ 44.951074][ T1980] RIP: 0033:0x7fad1bf10fea
>>>> [ 44.951077][ T1980] Code: 48 8b 0d a9 0e 0c 00 f7 d8 64 89 01 48
>>>> 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8
>>>> a5 00 00 00 0f 05 <48> 3d 01
>>>> f0 ff ff 73 01 c3 48 8b 0d 76 0e 0c 00 f7 d8 64 89 01 48
>>>> [ 44.956197][ T335] btrfs
>>>> [ 44.958245][ T1980] RSP: 002b:00007fff9d90f878 EFLAGS: 00000246
>>>> ORIG_RAX: 00000000000000a5
>>>> [ 44.958249][ T1980] RAX: ffffffffffffffda RBX: 00005628efc57970
>>>> RCX: 00007fad1bf10fea
>>>> [ 44.958251][ T1980] RDX: 00005628efc57b80 RSI: 00005628efc57bc0
>>>> RDI: 00005628efc57ba0
>>>> [ 44.958263][ T1980] RBP: 00007fad1c25e1c4 R08: 0000000000000000
>>>> R09: 00005628efc5a890
>>>> [ 44.958264][ T1980] R10: 0000000000000000 R11: 0000000000000246
>>>> R12: 0000000000000000
>>>> [ 44.962993][ T335]
>>>> [ 44.967613][ T1980] R13: 0000000000000000 R14: 00005628efc57ba0
>>>> R15: 00005628efc57b80
>>>> [ 44.967616][ T1980] </TASK>
>>>> [ 44.967617][ T1980] Modules linked in: dm_mod btrfs
>>>> blake2b_generic xor raid6_pq
>>>> [ 44.973257][ T335] 2022-03-14 01:34:21 mount -t btrfs /dev/sdb2
>>>> /fs/sdb2
>>>> [ 44.977243][ T1980] zstd_compress libcrc32c sd_mod t10_pi sg
>>>> [ 44.983019][ T335]
>>>> [ 44.985203][ T1980] ipmi_devintf ata_generic ipmi_msghandler
>>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal
>>>> intel_powerclamp coretemp kvm_intel
>>>> [ 44.990720][ T335] 2022-03-14 01:34:21 mkdir -p /fs/sdb3
>>>> [ 44.995962][ T1980] i915 kvm intel_gtt ttm drm_kms_helper
>>>> irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>>> ghash_clmulni_intel syscopyarea sysfillrect
>>>> [ 44.998174][ T335]
>>>> [ 45.002882][ T1980] sysimgblt rapl mei_wdt fb_sys_fops ata_piix
>>>> intel_cstate libata drm mei_me mei intel_uncore video ip_tables
>>>> [ 45.002919][ T1980] ---[ end trace 0000000000000000 ]---
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>> Qu
>>>>>
>>>>>>
>>>>>>
>>>>>> [ 75.279958][ T3602] ------------[ cut here ]------------
>>>>>> [ 75.285221][ T3602] kernel BUG at fs/btrfs/scrub.c:3387!
>>>>>> [ 75.290490][ T3602] invalid opcode: 0000 [#1] SMP KASAN PTI
>>>>>> [ 75.296010][ T3602] CPU: 2 PID: 3602 Comm: btrfs Not tainted
>>>>>> 5.17.0-rc4-00095-g6b837d4c40d5 #1
>>>>>> [ 75.304521][ T3602] Hardware name: Dell Inc. OptiPlex
>>>>>> 9020/0DNKMN, BIOS A05 12/05/2013
>>>>>> [ 75.312344][ T3602] RIP: 0010:scrub_stripe+0xed3/0x1340
[btrfs]
>>>>>> [ 75.318250][ T3602] Code: 90 00 00 00 e8 0e f9 96 c0 e9 98 f3
ff
>>>>>> ff e8 c4 f9 96 c0 e9 26 f3 ff ff 48 8b bc 24 80 00 00 00 e8 f2
f8
>>>>>> 96 c0 e9 3b f4 ff ff <0f> 0b 0f
>>>>>> 0b 4c 8d a4 24 b8 01 00 00 31 f6 4c 8d bd 20 02 00 00 4c
>>>>>> [ 75.337480][ T3602] RSP: 0018:ffffc9000b47f550 EFLAGS:
00010246
>>>>>> [ 75.343340][ T3602] RAX: 0000000000000007 RBX:
ffff88810231d600
>>>>>> RCX: ffff88810231d61c
>>>>>> [ 75.351074][ T3602] RDX: 0000000000000000 RSI:
0000000000000004
>>>>>> RDI: ffff8881023a2458
>>>>>> [ 75.358807][ T3602] RBP: ffff8881097ad800 R08:
0000000000000001
>>>>>> R09: ffffed102828100d
>>>>>> [ 75.366550][ T3602] R10: ffff888141408063 R11:
ffffed102828100c
>>>>>> R12: 0000000000000000
>>>>>> [ 75.374282][ T3602] R13: 0000000000100000 R14:
ffff888141408000
>>>>>> R15: ffff888129c9c000
>>>>>> [ 75.382016][ T3602] FS: 00007f94c24ec8c0(0000)
>>>>>> GS:ffff8881a6d00000(0000) knlGS:0000000000000000
>>>>>> [ 75.390691][ T3602] CS: 0010 DS: 0000 ES: 0000 CR0:
>>>>>> 0000000080050033
>>>>>> [ 75.397054][ T3602] CR2: 00007ffe454aa8e8 CR3:
000000020a796004
>>>>>> CR4: 00000000001706e0
>>>>>> [ 75.404785][ T3602] Call Trace:
>>>>>> [ 75.407886][ T3602] <TASK>
>>>>>> [ 75.410645][ T3602] ? btrfs_wait_ordered_extents+0x9a1/0xe40
>>>>>> [btrfs]
>>>>>> [ 75.417049][ T3602] ? scrub_raid56_parity+0x5c0/0x5c0
[btrfs]
>>>>>> [ 75.422853][ T3602] ?
btrfs_remove_ordered_extent+0xbc0/0xbc0
>>>>>> [btrfs]
>>>>>> [ 75.429341][ T3602] ? mutex_unlock+0x80/0x100
>>>>>> [ 75.433733][ T3602] ? __wake_up_common_lock+0xe3/0x140
>>>>>> [ 75.438897][ T3602] ? __lookup_extent_mapping+0x215/0x300
[btrfs]
>>>>>> [ 75.445037][ T3602] scrub_chunk+0x294/0x480 [btrfs]
>>>>>> [ 75.449984][ T3602] scrub_enumerate_chunks+0x643/0x1340
[btrfs]
>>>>>> [ 75.455962][ T3602] ? scrub_chunk+0x480/0x480 [btrfs]
>>>>>> [ 75.461083][ T3602] ? __scrub_blocked_if_needed+0xb9/0x200
[btrfs]
>>>>>> [ 75.467317][ T3602] ? scrub_checksum_data+0x4c0/0x4c0
[btrfs]
>>>>>> [ 75.473121][ T3602] ? down_read+0x137/0x240
>>>>>> [ 75.477339][ T3602] ? mutex_unlock+0x80/0x100
>>>>>> [ 75.481726][ T3602] ? __mutex_unlock_slowpath+0x300/0x300
>>>>>> [ 75.487743][ T3602] ? btrfs_find_device+0xac/0x240 [btrfs]
>>>>>> [ 75.493285][ T3602] btrfs_scrub_dev+0x535/0xc00 [btrfs]
>>>>>> [ 75.498578][ T3602] ? scrub_enumerate_chunks+0x1340/0x1340
[btrfs]
>>>>>> [ 75.504812][ T3602] ? btrfs_apply_pending_changes+0x80/0x80
>>>>>> [btrfs]
>>>>>> [ 75.511120][ T3602] ? btrfs_record_root_in_trans+0x4d/0x180
>>>>>> [btrfs]
>>>>>> [ 75.517428][ T3602] ? finish_wait+0x280/0x280
>>>>>> [ 75.521819][ T3602]
btrfs_dev_replace_by_ioctl.cold+0x62c/0x720
>>>>>> [btrfs]
>>>>>> [ 75.528483][ T3602] ?
>>>>>> btrfs_finish_block_group_to_copy+0x3c0/0x3c0 [btrfs]
>>>>>> [ 75.535440][ T3602] ?
>>>>>> __raw_callee_save___native_queued_spin_unlock+0x11/0x1e
>>>>>> [ 75.542575][ T3602] btrfs_ioctl+0x37ee/0x51c0 [btrfs]
>>>>>> [ 75.547691][ T3602] ? fput_many+0xaa/0x140
>>>>>> [ 75.551823][ T3602] ? filp_close+0xef/0x140
>>>>>> [ 75.556041][ T3602] ? __x64_sys_close+0x2d/0x80
>>>>>> [ 75.560600][ T3602] ? do_syscall_64+0x3b/0xc0
>>>>>> [ 75.564991][ T3602] ?
entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>>>> [ 75.570838][ T3602] ?
>>>>>> btrfs_ioctl_get_supported_features+0x40/0x40 [btrfs]
>>>>>> [ 75.577756][ T3602] ? _raw_spin_lock_irq+0x82/0xd2
>>>>>> [ 75.582572][ T3602] ? _raw_spin_lock+0x100/0x100
>>>>>> [ 75.587218][ T3602] ? fiemap_prep+0x200/0x200
>>>>>> [ 75.591607][ T3602] ? lockref_put_or_lock+0xc4/0x1c0
>>>>>> [ 75.596600][ T3602] ? do_sigaction+0x4b3/0x840
>>>>>> [ 75.601075][ T3602] ?
__x64_sys_pidfd_send_signal+0x600/0x600
>>>>>> [ 75.606837][ T3602] ? __might_fault+0x4d/0x80
>>>>>> [ 75.611226][ T3602] ? __x64_sys_rt_sigaction+0x1d0/0x240
>>>>>> [ 75.616558][ T3602] ? __ia32_sys_signal+0x140/0x140
>>>>>> [ 75.621461][ T3602] ? __fget_light+0x57/0x540
>>>>>> [ 75.625854][ T3602] __x64_sys_ioctl+0x127/0x1c0
>>>>>> [ 75.630414][ T3602] do_syscall_64+0x3b/0xc0
>>>>>> [ 75.634633][ T3602] entry_SYSCALL_64_after_hwframe+0x44/0xae
>>>>>> [ 75.640307][ T3602] RIP: 0033:0x7f94c25df427
>>>>>> [ 75.644533][ T3602] Code: 00 00 90 48 8b 05 69 aa 0c 00 64 c7
00
>>>>>> 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00
00
>>>>>> b8 10 00 00 00 0f 05 <48> 3d 01
>>>>>> f0 ff ff 73 01 c3 48 8b 0d 39 aa 0c 00 f7 d8 64 89 01 48
>>>>>> [ 75.663771][ T3602] RSP: 002b:00007ffd06a4acc8 EFLAGS:
00000246
>>>>>> ORIG_RAX: 0000000000000010
>>>>>> [ 75.671937][ T3602] RAX: ffffffffffffffda RBX:
000055d51e9f72a0
>>>>>> RCX: 00007f94c25df427
>>>>>> [ 75.679671][ T3602] RDX: 00007ffd06a4b108 RSI:
00000000ca289435
>>>>>> RDI: 0000000000000004
>>>>>> [ 75.687404][ T3602] RBP: 00000000ffffffff R08:
0000000000000000
>>>>>> R09: 000055d51e9fa580
>>>>>> [ 75.695137][ T3602] R10: 0000000000000008 R11:
0000000000000246
>>>>>> R12: 00007ffd06a4e97a
>>>>>> [ 75.702868][ T3602] R13: 0000000000000004 R14:
0000000000000000
>>>>>> R15: 0000000000000005
>>>>>> [ 75.710600][ T3602] </TASK>
>>>>>> [ 75.713445][ T3602] Modules linked in: dm_mod btrfs
>>>>>> blake2b_generic xor raid6_pq zstd_compress libcrc32c sd_mod
t10_pi
>>>>>> sg ata_generic ipmi_devintf ipmi_msghandler
>>>>>> intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal
>>>>>> intel_powerclamp coretemp i915 kvm_intel kvm intel_gtt ttm
>>>>>> irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel
>>>>>> ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect
>>>>>> sysimgblt fb_sys_fops rapl ata_piix mei_wdt intel_cstate drm
libata
>>>>>> mei_me intel_uncore mei video ip_tables
>>>>>> [ 75.756460][ T3602] ---[ end trace 0000000000000000 ]---
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Qu
>>>>>>>
>>> _______________________________________________
>>> LKP mailing list -- lkp(a)lists.01.org
>>> To unsubscribe send an email to lkp-leave(a)lists.01.org
184
days inactive
201
days old
10 comments
4 participants
participants (4)
-
kernel test robot -
Oliver Sang
-
Qu Wenruo -
Yujie Liu