[iomap] a24ec005a6: xfstests.generic.322.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: a24ec005a6111af4ed8d600b6605dba66fced357 ("iomap: add struct iomap_ctx")
https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git buffered-uncached
in testcase: xfstests
with following parameters:
disk: 4HDD
fs: xfs
test: generic-group16
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 24.495879] run fstests generic/322 at 2020-02-15 11:53:33
[ 25.845279] 262144 bytes (262 kB, 256 KiB) copied, 0.00456977 s, 57.4 MB/s
[ 25.852132] 512+0 records in
[ 25.855605] 512+0 records out
[ 25.862061] 262144 bytes (262 kB, 256 KiB) copied, 0.0157573 s, 16.6 MB/s
[ 25.867693] 512+0 records in
[ 25.876837] 512+0 records out
[ 25.887788] 262144 bytes (262 kB, 256 KiB) copied, 0.0354247 s, 7.4 MB/s
[ 26.331208] XFS (dm-0): Mounting V5 Filesystem
[ 26.337463] XFS (dm-0): Ending clean mount
[ 26.339813] xfs filesystem being mounted at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 26.418176] XFS (dm-0): Unmounting Filesystem
[ 26.439908] XFS (dm-0): Mounting V5 Filesystem
[ 26.446998] XFS (dm-0): Starting recovery (logdev: internal)
[ 26.450071] XFS (dm-0): Ending recovery (logdev: internal)
[ 26.452709] xfs filesystem being mounted at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 26.481332] XFS (dm-0): Unmounting Filesystem
[ 26.945352] install debs round one: dpkg -i --force-confdef --force-depends /opt/deb/uuid-runtime_2.29.2-1+deb9u1_amd64.deb
[ 26.949569] /opt/deb/libssl1.1_1.1.0k-1~deb9u1_amd64.deb
[ 26.952383] /opt/deb/attr_1%3a2.4.47-2+b2_amd64.deb
[ 26.957315] /opt/deb/gawk_1%3a4.1.4+dfsg-1_amd64.deb
[ 26.963677] Selecting previously unselected package uuid-runtime.
[ 26.971328] (Reading database ... 16194 files and directories currently installed.)
[ 26.978919] Preparing to unpack .../uuid-runtime_2.29.2-1+deb9u1_amd64.deb ...
[ 26.985485] Unpacking uuid-runtime (2.29.2-1+deb9u1) ...
[ 26.992587] Preparing to unpack .../libssl1.1_1.1.0k-1~deb9u1_amd64.deb ...
[ 27.000292] Unpacking libssl1.1:amd64 (1.1.0k-1~deb9u1) over (1.1.0f-3+deb9u1) ...
[ 27.006978] Selecting previously unselected package attr.
[ 27.013743] Preparing to unpack .../attr_1%3a2.4.47-2+b2_amd64.deb ...
[ 27.018132] Unpacking attr (1:2.4.47-2+b2) ...
[ 27.021222] Selecting previously unselected package gawk.
[ 27.025238] Preparing to unpack .../gawk_1%3a4.1.4+dfsg-1_amd64.deb ...
[ 27.028292] Unpacking gawk (1:4.1.4+dfsg-1) ...
[ 27.031629] Setting up uuid-runtime (2.29.2-1+deb9u1) ...
[ 27.034576] Adding group `uuidd' (GID 111) ...
[ 27.037036] Done.
[ 27.037678] XFS (dm-0): Mounting V5 Filesystem
[ 27.040685] Warning: The home dir /run/uuidd you specified can't be accessed: No such file or directory
[ 27.044778] Adding system user `uuidd' (UID 108) ...
[ 27.045881] XFS (dm-0): Ending clean mount
[ 27.048105] Adding new user `uuidd' (UID 108) with group `uuidd' ...
[ 27.050357] xfs filesystem being mounted at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 27.051809] Not creating home directory `/run/uuidd'.
[ 27.056563] Setting up libssl1.1:amd64 (1.1.0k-1~deb9u1) ...
[ 27.062225] Setting up attr (1:2.4.47-2+b2) ...
[ 27.068198] Setting up gawk (1:4.1.4+dfsg-1) ...
[ 27.074856] Processing triggers for systemd (232-25+deb9u2) ...
[ 27.081558] Processing triggers for libc-bin (2.24-11+deb9u3) ...
[ 27.087126] /lkp/lkp/src/bin/run-lkp
[ 27.096078] XFS (dm-0): Unmounting Filesystem
[ 27.103091] XFS (dm-0): Mounting V5 Filesystem
[ 27.110303] XFS (dm-0): Ending clean mount
[ 27.113903] xfs filesystem being mounted at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 27.207834] XFS (dm-0): Unmounting Filesystem
[ 27.236431] XFS (dm-0): Mounting V5 Filesystem
[ 27.244481] XFS (dm-0): Starting recovery (logdev: internal)
[ 27.247519] XFS (dm-0): Ending recovery (logdev: internal)
[ 27.250096] xfs filesystem being mounted at /fs/scratch supports timestamps until 2038 (0x7fffffff)
[ 27.289556] ------------[ cut here ]------------
[ 27.291456] WARNING: CPU: 0 PID: 1917 at /kbuild/src/consumer/fs/iomap/buffered-io.c:481 iomap_readpages+0x1a3/0x200
[ 27.293937] Modules linked in: dm_flakey xfs libcrc32c dm_mod intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul sr_mod cdrom crc32c_intel bochs_drm sg drm_vram_helper drm_ttm_helper ata_generic ghash_clmulni_intel pata_acpi ppdev ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops snd_pcm drm aesni_intel crypto_simd snd_timer cryptd glue_helper snd soundcore joydev serio_raw pcspkr ata_piix parport_pc floppy parport libata i2c_piix4 ip_tables
[ 27.303534] CPU: 0 PID: 1917 Comm: md5sum Not tainted 5.5.0-08198-ga24ec005a6111 #1
[ 27.309028] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 27.310326] RIP: 0010:iomap_readpages+0x1a3/0x200
[ 27.311338] Code: 57 48 8b 47 08 8b 80 d0 00 00 00 83 e8 01 83 f8 01 77 45 e8 5f 78 ec ff 48 85 db 75 0f 48 8b 44 24 18 48 8b 10 48 39 d0 74 02 <0f> 0b 48 8b 4c 24 48 65 48 33 0c 25 28 00 00 00 89 e8 75 35 48 83
[ 27.314138] RSP: 0018:ffffbdb2420efb38 EFLAGS: 00010293
[ 27.315218] RAX: ffffbdb2420efc80 RBX: 0000000000000000 RCX: 0000000000000000
[ 27.316468] RDX: fffff694474e8348 RSI: 0000000000000000 RDI: fffff69447515f40
[ 27.317710] RBP: 0000000000000000 R08: ffffbdb2420ef970 R09: ffff98df1457d000
[ 27.318963] R10: 0000000000000000 R11: 0000000000001000 R12: ffffffff8915ded0
[ 27.320239] R13: ffff98df16ae5958 R14: ffffbdb2420efc80 R15: ffff98df16ae5ac8
[ 27.321480] FS: 00007ffaf58fc480(0000) GS:ffff98df7fc00000(0000) knlGS:0000000000000000
[ 27.322792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 27.323939] CR2: 00005569e5b2e000 CR3: 000000015e2ee000 CR4: 00000000000406f0
[ 27.325191] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 27.326453] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 27.327702] Call Trace:
[ 27.328628] read_pages+0x6d/0x190
[ 27.329583] ? __do_page_cache_readahead+0x191/0x1d0
[ 27.330634] __do_page_cache_readahead+0x191/0x1d0
[ 27.331680] ondemand_readahead+0x117/0x300
[ 27.333091] generic_file_read_iter+0x8e3/0xd50
[ 27.334113] ? _cond_resched+0x19/0x30
[ 27.335219] xfs_file_buffered_aio_read+0x53/0xf0 [xfs]
[ 27.336350] xfs_file_read_iter+0x6e/0xd0 [xfs]
[ 27.337378] new_sync_read+0x12a/0x1c0
[ 27.338340] vfs_read+0x9b/0x160
[ 27.339254] ksys_read+0xa1/0xe0
[ 27.340172] do_syscall_64+0x5b/0x1f0
[ 27.341112] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 27.342150] RIP: 0033:0x7ffaf541b910
[ 27.343080] Code: b6 fe ff ff 48 8d 3d 0f be 08 00 48 83 ec 08 e8 06 db 01 00 66 0f 1f 44 00 00 83 3d f9 2d 2c 00 00 75 10 b8 00 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 de 9b 01 00 48 89 04 24
[ 27.345877] RSP: 002b:00007fff977bab78 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 27.347153] RAX: ffffffffffffffda RBX: 00005569e5b27060 RCX: 00007ffaf541b910
[ 27.348835] RDX: 0000000000008000 RSI: 00005569e5b27290 RDI: 0000000000000004
[ 27.350666] RBP: 00007ffaf56d6440 R08: 0000000000000b40 R09: 0000000016268636
[ 27.352543] R10: 000000001b5b9ecc R11: 0000000000000246 R12: 0000000000008000
[ 27.355354] R13: 0000000000000d68 R14: 00005569e5b27290 R15: 00007ffaf56d5900
[ 27.359159] ---[ end trace 2fc4caf82302047d ]---
[ 27.427444] XFS (dm-0): Unmounting Filesystem
[ 27.475811] XFS (vda): Unmounting Filesystem
To reproduce:
# build kernel
cd linux
cp config-5.5.0-08198-ga24ec005a6111 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 3 months
[mac80211] 30b2f0be23: hwsim.rrm_beacon_req_ap_errors.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 30b2f0be23fb40e58d0ad2caf8702c2a44cda2e1 ("mac80211: add ieee80211_is_any_nullfunc()")
https://git.kernel.org/cgit/linux/kernel/git/jberg/mac80211-next.git master
in testcase: hwsim
with following parameters:
group: hwsim-27
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2020-02-14 14:11:29 ./run-tests.py rrm_beacon_req_ap_errors
DEV: wlan0: 02:00:00:00:00:00
DEV: wlan1: 02:00:00:00:01:00
DEV: wlan2: 02:00:00:00:02:00
APDEV: wlan3
APDEV: wlan4
START rrm_beacon_req_ap_errors 1/1
Test: Beacon request - AP error cases
Starting AP wlan3 (old add_ap argument type)
Connect STA wlan0 to AP
Connect STA wlan1 to AP
REQ_BEACON failed
Traceback (most recent call last):
File "./run-tests.py", line 521, in main
t(dev, apdev)
File "/lkp/benchmarks/hwsim/tests/hwsim/test_rrm.py", line 1769, in test_rrm_beacon_req_ap_errors
run_rrm_beacon_req_ap_errors(dev, apdev)
File "/lkp/benchmarks/hwsim/tests/hwsim/test_rrm.py", line 1807, in run_rrm_beacon_req_ap_errors
raise Exception("REQ_BEACON failed")
Exception: REQ_BEACON failed
wlan0: Waiting for scan operation to complete before continuing
Run FLUSH again since scan was in progress
FAIL rrm_beacon_req_ap_errors 1.551882 2020-02-14 14:11:31.351984
passed 0 test case(s)
skipped 0 test case(s)
failed tests: rrm_beacon_req_ap_errors
To reproduce:
# build kernel
cd linux
cp config-5.5.0-rc4-00725-g30b2f0be23fb40 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 3 months
[perf/x86/amd] 471af006a7: will-it-scale.per_process_ops -7.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -7.6% regression of will-it-scale.per_process_ops due to commit:
commit: 471af006a747f1c535c8a8c6c0973c320fe01b22 ("perf/x86/amd: Constrain Large Increment per Cycle events")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
with following parameters:
nr_task: 16
mode: process
test: mmap1
cpufreq_governor: performance
ucode: 0xb000038
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/16/debian-x86_64-20191114.cgz/lkp-bdw-ep6/mmap1/will-it-scale/0xb000038
commit:
1e0f17724a ("perf/x86/intel/rapl: Add Comet Lake support")
471af006a7 ("perf/x86/amd: Constrain Large Increment per Cycle events")
1e0f17724a74c8e9 471af006a747f1c535c8a8c6c09
---------------- ---------------------------
%stddev %change %stddev
\ | \
140938 -7.6% 130210 will-it-scale.per_process_ops
2255019 -7.6% 2083371 will-it-scale.workload
837580 ±166% -96.5% 28917 ± 3% cpuidle.C1.usage
7166976 ± 6% -14.5% 6128128 ± 8% meminfo.DirectMap2M
836885 ±166% -96.7% 27303 ± 5% turbostat.C1
14685 ± 16% -45.3% 8033 ± 59% numa-meminfo.node0.Inactive
14479 ± 17% -45.6% 7878 ± 59% numa-meminfo.node0.Inactive(anon)
3619 ± 17% -45.5% 1971 ± 59% numa-vmstat.node0.nr_inactive_anon
3619 ± 17% -45.5% 1971 ± 59% numa-vmstat.node0.nr_zone_inactive_anon
0.92 ± 37% +72.7% 1.58 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max
0.18 ± 31% +80.5% 0.32 ± 22% sched_debug.cfs_rq:/.nr_spread_over.stddev
823.50 ± 11% +21.3% 999.25 ± 6% slabinfo.task_group.active_objs
823.50 ± 11% +21.3% 999.25 ± 6% slabinfo.task_group.num_objs
28461 ± 45% +226.7% 92971 ± 52% softirqs.CPU2.SCHED
140190 ± 16% -22.1% 109224 ± 4% softirqs.CPU26.TIMER
22312 ± 59% +118.2% 48678 ± 35% softirqs.CPU27.SCHED
137328 ± 19% -24.1% 104166 ± 4% softirqs.CPU30.TIMER
136600 ± 19% -24.8% 102717 ± 4% softirqs.CPU31.TIMER
138650 ± 18% -26.7% 101647 ± 7% softirqs.CPU32.TIMER
157659 ± 7% -24.6% 118910 ± 10% softirqs.CPU36.TIMER
11534 ± 93% -58.8% 4756 softirqs.CPU52.SCHED
140233 ± 17% -23.3% 107504 ± 4% softirqs.CPU68.TIMER
140175 ± 17% -21.5% 110106 ± 4% softirqs.CPU69.TIMER
137837 ± 18% -21.7% 107989 ± 3% softirqs.CPU71.TIMER
136668 ± 19% -24.1% 103782 ± 4% softirqs.CPU74.TIMER
135588 ± 19% -24.9% 101806 ± 4% softirqs.CPU75.TIMER
21298 ± 59% +103.1% 43251 softirqs.CPU8.SCHED
6.983e+09 -4.2% 6.688e+09 perf-stat.i.branch-instructions
1.67 +6.0% 1.77 perf-stat.i.cpi
8.465e+09 -5.3% 8.019e+09 perf-stat.i.dTLB-loads
14870770 ± 14% -25.5% 11075131 ± 8% perf-stat.i.iTLB-load-misses
3.001e+10 -4.4% 2.869e+10 perf-stat.i.instructions
2068 ± 13% +26.5% 2616 ± 8% perf-stat.i.instructions-per-iTLB-miss
0.60 -5.7% 0.56 perf-stat.i.ipc
1.67 +6.0% 1.77 perf-stat.overall.cpi
2056 ± 13% +26.9% 2610 ± 8% perf-stat.overall.instructions-per-iTLB-miss
0.60 -5.7% 0.56 perf-stat.overall.ipc
4007121 +3.5% 4145942 perf-stat.overall.path-length
6.96e+09 -4.2% 6.666e+09 perf-stat.ps.branch-instructions
8.436e+09 -5.3% 7.992e+09 perf-stat.ps.dTLB-loads
14820211 ± 14% -25.5% 11037555 ± 8% perf-stat.ps.iTLB-load-misses
2.99e+10 -4.4% 2.859e+10 perf-stat.ps.instructions
9.036e+12 -4.4% 8.638e+12 perf-stat.total.instructions
0.80 ± 16% +0.2 1.04 ± 9% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.61 ± 58% +0.3 0.93 ± 5% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.06 ± 18% +0.3 1.38 ± 3% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.09 ± 15% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.find_next_bit
0.06 ± 58% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.__remove_hrtimer
0.10 ± 10% +0.0 0.14 ± 8% perf-profile.children.cycles-pp.native_write_msr
0.10 ± 12% +0.0 0.14 ± 8% perf-profile.children.cycles-pp.lapic_next_deadline
0.06 ± 58% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.01 ±173% +0.0 0.05 ± 9% perf-profile.children.cycles-pp.interrupt_entry
0.15 ± 21% +0.0 0.20 ± 5% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.20 ± 10% +0.0 0.24 ± 2% perf-profile.children.cycles-pp.clockevents_program_event
0.15 ± 15% +0.0 0.20 ± 7% perf-profile.children.cycles-pp.__next_timer_interrupt
0.22 ± 20% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.15 ± 22% +0.1 0.22 ± 13% perf-profile.children.cycles-pp.tick_irq_enter
0.32 ± 16% +0.1 0.40 ± 3% perf-profile.children.cycles-pp.tick_nohz_next_event
0.18 ± 20% +0.1 0.27 ± 12% perf-profile.children.cycles-pp.irq_enter
0.41 ± 15% +0.1 0.51 ± 4% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.84 ± 20% +0.2 1.06 ± 4% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.81 ± 16% +0.2 1.05 ± 9% perf-profile.children.cycles-pp.menu_select
1.23 ± 17% +0.3 1.56 ± 3% perf-profile.children.cycles-pp.hrtimer_interrupt
0.11 ± 9% +0.0 0.13 ± 7% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.09 +0.0 0.11 ± 11% perf-profile.self.cycles-pp.read_tsc
0.07 ± 17% +0.0 0.09 ± 5% perf-profile.self.cycles-pp.__next_timer_interrupt
0.08 ± 17% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.find_next_bit
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.10 ± 10% +0.0 0.14 ± 8% perf-profile.self.cycles-pp.native_write_msr
0.01 ±173% +0.0 0.05 ± 9% perf-profile.self.cycles-pp.interrupt_entry
0.03 ±100% +0.0 0.07 perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.05 perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.25 ± 14% +0.1 0.32 ± 5% perf-profile.self.cycles-pp.cpuidle_enter_state
0.99 ± 8% +0.2 1.17 ± 8% perf-profile.self.cycles-pp.percpu_counter_add_batch
4969 ± 21% -46.7% 2649 ± 27% interrupts.CPU10.NMI:Non-maskable_interrupts
4969 ± 21% -46.7% 2649 ± 27% interrupts.CPU10.PMI:Performance_monitoring_interrupts
4973 ± 21% -35.1% 3227 ± 48% interrupts.CPU13.NMI:Non-maskable_interrupts
4973 ± 21% -35.1% 3227 ± 48% interrupts.CPU13.PMI:Performance_monitoring_interrupts
412.50 ± 31% +66.5% 687.00 ± 5% interrupts.CPU25.NMI:Non-maskable_interrupts
412.50 ± 31% +66.5% 687.00 ± 5% interrupts.CPU25.PMI:Performance_monitoring_interrupts
396.75 ± 35% +69.0% 670.50 ± 7% interrupts.CPU27.NMI:Non-maskable_interrupts
396.75 ± 35% +69.0% 670.50 ± 7% interrupts.CPU27.PMI:Performance_monitoring_interrupts
487.00 ± 26% +39.6% 680.00 ± 5% interrupts.CPU31.NMI:Non-maskable_interrupts
487.00 ± 26% +39.6% 680.00 ± 5% interrupts.CPU31.PMI:Performance_monitoring_interrupts
495.75 ± 31% +39.2% 690.25 ± 5% interrupts.CPU32.NMI:Non-maskable_interrupts
495.75 ± 31% +39.2% 690.25 ± 5% interrupts.CPU32.PMI:Performance_monitoring_interrupts
502.75 ± 31% +38.9% 698.50 ± 7% interrupts.CPU33.NMI:Non-maskable_interrupts
502.75 ± 31% +38.9% 698.50 ± 7% interrupts.CPU33.PMI:Performance_monitoring_interrupts
534.75 ± 25% +34.5% 719.00 ± 4% interrupts.CPU34.NMI:Non-maskable_interrupts
534.75 ± 25% +34.5% 719.00 ± 4% interrupts.CPU34.PMI:Performance_monitoring_interrupts
157.50 ±110% -99.7% 0.50 ±100% interrupts.CPU36.RES:Rescheduling_interrupts
537.75 ± 27% +35.4% 728.25 ± 9% interrupts.CPU38.NMI:Non-maskable_interrupts
537.75 ± 27% +35.4% 728.25 ± 9% interrupts.CPU38.PMI:Performance_monitoring_interrupts
512.25 ± 26% +37.2% 703.00 ± 5% interrupts.CPU39.NMI:Non-maskable_interrupts
512.25 ± 26% +37.2% 703.00 ± 5% interrupts.CPU39.PMI:Performance_monitoring_interrupts
2977 ± 11% +32.1% 3934 ± 14% interrupts.CPU52.CAL:Function_call_interrupts
3185 ± 13% +32.5% 4221 ± 13% interrupts.CPU53.CAL:Function_call_interrupts
515.25 ± 31% +37.3% 707.50 ± 5% interrupts.CPU66.NMI:Non-maskable_interrupts
515.25 ± 31% +37.3% 707.50 ± 5% interrupts.CPU66.PMI:Performance_monitoring_interrupts
493.75 ± 34% +42.2% 702.25 ± 4% interrupts.CPU67.NMI:Non-maskable_interrupts
493.75 ± 34% +42.2% 702.25 ± 4% interrupts.CPU67.PMI:Performance_monitoring_interrupts
509.00 ± 29% +37.1% 698.00 ± 5% interrupts.CPU68.NMI:Non-maskable_interrupts
509.00 ± 29% +37.1% 698.00 ± 5% interrupts.CPU68.PMI:Performance_monitoring_interrupts
4967 ± 21% -35.0% 3229 ± 48% interrupts.CPU7.NMI:Non-maskable_interrupts
4967 ± 21% -35.0% 3229 ± 48% interrupts.CPU7.PMI:Performance_monitoring_interrupts
478.25 ± 34% +46.8% 702.00 ± 9% interrupts.CPU72.NMI:Non-maskable_interrupts
478.25 ± 34% +46.8% 702.00 ± 9% interrupts.CPU72.PMI:Performance_monitoring_interrupts
465.00 ± 30% +38.4% 643.75 ± 4% interrupts.CPU74.NMI:Non-maskable_interrupts
465.00 ± 30% +38.4% 643.75 ± 4% interrupts.CPU74.PMI:Performance_monitoring_interrupts
4978 ± 21% -42.2% 2877 interrupts.CPU9.NMI:Non-maskable_interrupts
4978 ± 21% -42.2% 2877 interrupts.CPU9.PMI:Performance_monitoring_interrupts
will-it-scale.per_process_ops
142000 +-+----------------------------------------------------------------+
|..+..+..+..+..+..+..+..+. +. +..+..+..+..+..+..+..+..+..+..|
140000 +-+ |
| |
138000 O-+ O O O O |
| O O |
136000 +-+ |
| |
134000 +-+ |
| |
132000 +-+ O O |
| O O O O O O O O O |
130000 +-+ O O O O O
| |
128000 +-+----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 3 months
[fs] 2b7884f8b7: BUG:KASAN:null-ptr-deref_in_m
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 2b7884f8b7273e88f23ed394edfea03fae508023 ("fs: Convert mpage_readpages to mpage_readahead")
https://github.com/0day-ci/linux/commits/Matthew-Wilcox/Change-readahead-...
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+---------------------------------------------+------------+------------+
| | 91db051048 | 2b7884f8b7 |
+---------------------------------------------+------------+------------+
| boot_successes | 24 | 0 |
| boot_failures | 4 | 24 |
| BUG:kernel_hang_in_boot_stage | 4 | 3 |
| BUG:KASAN:null-ptr-deref_in_m | 0 | 21 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 21 |
| Oops:#[##] | 0 | 21 |
| RIP:mpage_readahead | 0 | 21 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 21 |
+---------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 114.125212] BUG: KASAN: null-ptr-deref in mpage_readahead+0xb6/0x210
[ 114.125964] Read of size 8 at addr 0000000000000008 by task systemd-udevd/341
[ 114.126795]
[ 114.126997] CPU: 0 PID: 341 Comm: systemd-udevd Not tainted 5.5.0-08731-g2b7884f8b7273 #1
[ 114.127955] Call Trace:
[ 114.128299] ? mpage_readahead+0xb6/0x210
[ 114.128785] __kasan_report+0x15c/0x173
[ 114.129268] ? mpage_readahead+0xb6/0x210
[ 114.129938] ? blkdev_direct_IO+0x880/0x880
[ 114.130455] mpage_readahead+0xb6/0x210
[ 114.130923] ? do_mpage_readpage+0xce0/0xce0
[ 114.131452] ? blkdev_direct_IO+0x880/0x880
[ 114.131952] ? __add_to_page_cache_locked+0x2b4/0x4c0
[ 114.132556] read_pages+0xeb/0x380
[ 114.132972] ? file_ra_state_init+0xb0/0xb0
[ 114.133498] ? __lru_cache_add+0xd7/0x100
[ 114.133933] ? tcp_ack+0x1590/0x22d0
[ 114.134261] ? add_to_page_cache_locked+0x30/0x30
[ 114.134694] ? __do_page_cache_readahead+0x371/0x3d0
[ 114.135119] __do_page_cache_readahead+0x371/0x3d0
[ 114.135538] ? read_cache_pages+0x270/0x270
[ 114.135910] force_page_cache_readahead+0x116/0x160
[ 114.136330] generic_file_read_iter+0xaba/0x1320
[ 114.136746] ? filemap_write_and_wait_range+0x80/0x80
[ 114.137216] ? iov_iter_init+0x8c/0xc0
[ 114.137548] new_sync_read+0x245/0x340
[ 114.137876] ? vfs_dedupe_file_range+0x2d0/0x2d0
[ 114.138275] ? __fsnotify_parent+0x8f/0x230
[ 114.138637] ? fsnotify+0x66a/0x690
[ 114.138964] ? security_file_permission+0xd7/0x170
[ 114.139381] vfs_read+0xbf/0x1a0
[ 114.139669] ksys_read+0x10a/0x150
[ 114.139969] ? kernel_write+0xb0/0xb0
[ 114.140300] do_syscall_64+0xa7/0x7a0
[ 114.140619] ? syscall_return_slowpath+0x3c0/0x3c0
[ 114.141204] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 114.141701] RIP: 0033:0x7f08f77e36e0
[ 114.142015] Code: 73 01 c3 48 8b 0d c8 88 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 09 cd 20 00 00 75 10 b8 00 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ee fc ff ff 48 89 04 24
[ 114.143557] RSP: 002b:00007fff8ca47a38 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 114.144346] RAX: ffffffffffffffda RBX: 0000003e7fff0000 RCX: 00007f08f77e36e0
[ 114.144947] RDX: 0000000000000040 RSI: 000055d489d54958 RDI: 0000000000000009
[ 114.145561] RBP: 000055d489d54930 R08: 0000000000000005 R09: 0000000000000068
[ 114.146164] R10: 00007fff8ca474a0 R11: 0000000000000246 R12: 000055d489d60480
[ 114.146763] R13: 0000000000000040 R14: 000055d489d604d0 R15: 000055d489d54948
[ 114.147499] ==================================================================
[ 114.148104] Disabling lock debugging due to kernel taint
[ 114.148754] BUG: kernel NULL pointer dereference, address: 0000000000000008
[ 114.149363] #PF: supervisor read access in kernel mode
[ 114.149805] #PF: error_code(0x0000) - not-present page
[ 114.150240] PGD 0 P4D 0
[ 114.150468] Oops: 0000 [#1] KASAN PTI
[ 114.150784] CPU: 0 PID: 341 Comm: systemd-udevd Tainted: G B 5.5.0-08731-g2b7884f8b7273 #1
[ 114.151578] RIP: 0010:mpage_readahead+0xb6/0x210
[ 114.151969] Code: 44 24 44 01 0f 84 cf 00 00 00 48 8b 04 24 4c 8d 76 01 48 8d 78 08 e8 99 98 e2 00 4c 8d 60 08 49 89 c7 4c 89 e7 e8 fa 88 f7 ff <49> 8b 47 08 be 08 00 00 00 48 8d 58 ff a8 01 49 0f 44 df 48 89 df
[ 114.153661] RSP: 0018:ffff88819808f728 EFLAGS: 00010286
[ 114.154142] RAX: ffff8881add30c00 RBX: ffffffffab375260 RCX: ffffffffab1323c6
[ 114.154737] RDX: 0000000000000003 RSI: dffffc0000000000 RDI: ffffffffad337200
[ 114.155328] RBP: 0000000000000000 R08: fffffbfff5b296b6 R09: 0000000000000000
[ 114.155921] R10: ffffffffad94b5ab R11: fffffbfff5b296b6 R12: 0000000000000008
[ 114.156514] R13: 1ffff11033011ee7 R14: 0000000003e7fff0 R15: 0000000000000000
[ 114.157108] FS: 00007f08f88a88c0(0000) GS:ffffffffad076000(0000) knlGS:0000000000000000
[ 114.157791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 114.158275] CR2: 0000000000000008 CR3: 00000001c5fd6000 CR4: 00000000000406f0
[ 114.158871] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 114.159510] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 114.160212] Call Trace:
[ 114.160432] ? do_mpage_readpage+0xce0/0xce0
[ 114.160799] ? blkdev_direct_IO+0x880/0x880
[ 114.161164] ? __add_to_page_cache_locked+0x2b4/0x4c0
[ 114.161594] read_pages+0xeb/0x380
[ 114.161888] ? file_ra_state_init+0xb0/0xb0
[ 114.162253] ? __lru_cache_add+0xd7/0x100
[ 114.162601] ? tcp_ack+0x1590/0x22d0
[ 114.162909] ? add_to_page_cache_locked+0x30/0x30
[ 114.163310] ? __do_page_cache_readahead+0x371/0x3d0
[ 114.163727] __do_page_cache_readahead+0x371/0x3d0
[ 114.164132] ? read_cache_pages+0x270/0x270
[ 114.164490] force_page_cache_readahead+0x116/0x160
[ 114.164904] generic_file_read_iter+0xaba/0x1320
[ 114.165315] ? filemap_write_and_wait_range+0x80/0x80
[ 114.165744] ? iov_iter_init+0x8c/0xc0
[ 114.166097] new_sync_read+0x245/0x340
[ 114.166543] ? vfs_dedupe_file_range+0x2d0/0x2d0
[ 114.166977] ? __fsnotify_parent+0x8f/0x230
[ 114.167334] ? fsnotify+0x66a/0x690
[ 114.167638] ? security_file_permission+0xd7/0x170
[ 114.168044] vfs_read+0xbf/0x1a0
[ 114.168324] ksys_read+0x10a/0x150
[ 114.168649] ? kernel_write+0xb0/0xb0
[ 114.169209] do_syscall_64+0xa7/0x7a0
[ 114.169725] ? syscall_return_slowpath+0x3c0/0x3c0
[ 114.170404] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 114.171095] RIP: 0033:0x7f08f77e36e0
[ 114.171584] Code: 73 01 c3 48 8b 0d c8 88 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 09 cd 20 00 00 75 10 b8 00 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ee fc ff ff 48 89 04 24
[ 114.186260] RSP: 002b:00007fff8ca47a38 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 114.187297] RAX: ffffffffffffffda RBX: 0000003e7fff0000 RCX: 00007f08f77e36e0
[ 114.188281] RDX: 0000000000000040 RSI: 000055d489d54958 RDI: 0000000000000009
[ 114.189278] RBP: 000055d489d54930 R08: 0000000000000005 R09: 0000000000000068
[ 114.190234] R10: 00007fff8ca474a0 R11: 0000000000000246 R12: 000055d489d60480
[ 114.191219] R13: 0000000000000040 R14: 000055d489d604d0 R15: 000055d489d54948
[ 114.192205] Modules linked in: crc32_pclmul crc32c_intel ata_piix input_leds serio_raw qemu_fw_cfg intel_agp intel_gtt evbug agpgart piix i2c_piix4 autofs4
[ 114.194114] CR2: 0000000000000008
[ 114.194679] ---[ end trace d7003214cba57fd2 ]---
To reproduce:
# build kernel
cd linux
cp config-5.5.0-08731-g2b7884f8b7273 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 3 months
[apparmor] 6413f852ce: ltp.proc01.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 6413f852ce086c0f95817012c08d481ce24d8b1a ("apparmor: add proc subdir to attrs")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: ltp
with following parameters:
disk: 1HDD
fs: xfs
test: fs-02
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
<<<test_start>>>
tag=proc01 stime=1581538074
cmdline="proc01 -m 128"
contacts=""
analysis=exit
<<<test_output>>>
proc01 0 TINFO : /proc/sys/fs/binfmt_misc/register: is write-only.
proc01 0 TINFO : /proc/sys/net/ipv6/conf/all/stable_secret: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/sys/net/ipv6/conf/default/stable_secret: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/sys/net/ipv6/conf/eth0/stable_secret: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/sys/net/ipv6/conf/lo/stable_secret: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/kmsg: known issue: errno=EAGAIN/EWOULDBLOCK(11): Resource temporarily unavailable
proc01 0 TINFO : /proc/sysrq-trigger: is write-only.
proc01 0 TINFO : /proc/self/task/2646/mem: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/self/task/2646/clear_refs: is write-only.
proc01 0 TINFO : /proc/self/task/2646/pagemap: reached maxmbytes (-m)
proc01 1 TFAIL : proc01.c:397: read failed: /proc/self/task/2646/attr/apparmor/current: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : proc01.c:397: read failed: /proc/self/task/2646/attr/apparmor/prev: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : proc01.c:397: read failed: /proc/self/task/2646/attr/apparmor/exec: errno=EINVAL(22): Invalid argument
proc01 0 TINFO : /proc/self/mem: known issue: errno=EIO(5): Input/output error
proc01 0 TINFO : /proc/self/clear_refs: is write-only.
proc01 0 TINFO : /proc/self/pagemap: reached maxmbytes (-m)
proc01 4 TFAIL : proc01.c:397: read failed: /proc/self/attr/apparmor/current: errno=EINVAL(22): Invalid argument
proc01 5 TFAIL : proc01.c:397: read failed: /proc/self/attr/apparmor/prev: errno=EINVAL(22): Invalid argument
proc01 6 TFAIL : proc01.c:397: read failed: /proc/self/attr/apparmor/exec: errno=EINVAL(22): Invalid argument
proc01 7 TFAIL : proc01.c:466: readproc() failed with 6 errors.
<<<execution_status>>>
initiation_status="ok"
duration=1 termination_type=exited termination_id=1 corefile=no
cutime=7 cstime=89
<<<test_end>>>
To reproduce:
# build kernel
cd linux
cp config-5.5.0-rc5-00005-g6413f852ce086 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 3 months
Re: [PATCH v2] tracing: Remove bogus 64-bit synth_event_trace() vararg assumption
by Steven Rostedt
On Wed, 12 Feb 2020 14:13:02 -0600
Tom Zanussi <tzanussi(a)gmail.com> wrote:
> The vararg code in synth_event_trace() assumed the args were 64 bit
> which is not the case on 32-bit systems. Just use long which should
> work on every system.
>
> Also remove all the u64 casts from the synth event test module, which
> also cause compile warnings on 32-bit compiles.
>
> This fixes the bug reported by the kernel test robot/Rong Chen as
> reported here:
>
> https://lore.kernel.org/lkml/20200212113444.GS12867@shao2-debian/
>
> With this commit, the lkp-tests tests now pass, as do the synth/kprobe
> event test modules and selftests on x86_64.
Did you test this on 32 bit? I just ran it on a 32 bit kernel, and I
get this in the tracing output:
modprobe-1731 [003] .... 919.039758: gen_synth_test: next_pid_field=777(null)next_comm_field=hula hoops ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=thneed my_int_field=598(null)
modprobe-1731 [003] .... 919.039904: empty_synth_test: next_pid_field=777(null)next_comm_field=tiddlywinks ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=thneed_2.0 my_int_field=399(null)
modprobe-1731 [003] .... 919.040055: create_synth_test: next_pid_field=777(null)next_comm_field=tiddlywinks ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=thneed my_int_field=398(null)
modprobe-1731 [003] .... 919.040055: gen_synth_test: next_pid_field=777(null)next_comm_field=slinky ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=thneed_2.01 my_int_field=395(null)
modprobe-1731 [003] .... 919.040056: gen_synth_test: next_pid_field=777(null)next_comm_field=silly putty ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=thneed_9 my_int_field=3999(null)
modprobe-1731 [003] .... 919.040057: create_synth_test: next_pid_field=444(null)next_comm_field=clackers ts_ns=1000000 ts_ms=1000 cpu=3(null)my_string_field=Thneed my_int_field=999(null)
-- Steve
>
> Reported-by: kernel test robot <rong.a.chen(a)intel.com>
> Signed-off-by: Tom Zanussi <zanussi(a)kernel.org>
> ---
> kernel/trace/synth_event_gen_test.c | 24 ++++++++++++------------
> kernel/trace/trace_events_hist.c | 6 +++---
> 2 files changed, 15 insertions(+), 15 deletions(-)
>
> diff --git a/kernel/trace/synth_event_gen_test.c b/kernel/trace/synth_event_gen_test.c
> index 4aefe003cb7c..f0e14106048c 100644
> --- a/kernel/trace/synth_event_gen_test.c
> +++ b/kernel/trace/synth_event_gen_test.c
> @@ -111,11 +111,11 @@ static int __init test_gen_synth_cmd(void)
> /* Create some bogus values just for testing */
>
> vals[0] = 777; /* next_pid_field */
> - vals[1] = (u64)"hula hoops"; /* next_comm_field */
> + vals[1] = (long)"hula hoops"; /* next_comm_field */
> vals[2] = 1000000; /* ts_ns */
> vals[3] = 1000; /* ts_ms */
> vals[4] = smp_processor_id(); /* cpu */
> - vals[5] = (u64)"thneed"; /* my_string_field */
> + vals[5] = (long)"thneed"; /* my_string_field */
> vals[6] = 598; /* my_int_field */
>
> /* Now generate a gen_synth_test event */
> @@ -218,11 +218,11 @@ static int __init test_empty_synth_event(void)
> /* Create some bogus values just for testing */
>
> vals[0] = 777; /* next_pid_field */
> - vals[1] = (u64)"tiddlywinks"; /* next_comm_field */
> + vals[1] = (long)"tiddlywinks"; /* next_comm_field */
> vals[2] = 1000000; /* ts_ns */
> vals[3] = 1000; /* ts_ms */
> vals[4] = smp_processor_id(); /* cpu */
> - vals[5] = (u64)"thneed_2.0"; /* my_string_field */
> + vals[5] = (long)"thneed_2.0"; /* my_string_field */
> vals[6] = 399; /* my_int_field */
>
> /* Now trace an empty_synth_test event */
> @@ -290,11 +290,11 @@ static int __init test_create_synth_event(void)
> /* Create some bogus values just for testing */
>
> vals[0] = 777; /* next_pid_field */
> - vals[1] = (u64)"tiddlywinks"; /* next_comm_field */
> + vals[1] = (long)"tiddlywinks"; /* next_comm_field */
> vals[2] = 1000000; /* ts_ns */
> vals[3] = 1000; /* ts_ms */
> vals[4] = smp_processor_id(); /* cpu */
> - vals[5] = (u64)"thneed"; /* my_string_field */
> + vals[5] = (long)"thneed"; /* my_string_field */
> vals[6] = 398; /* my_int_field */
>
> /* Now generate a create_synth_test event */
> @@ -330,7 +330,7 @@ static int __init test_add_next_synth_val(void)
> goto out;
>
> /* next_comm_field */
> - ret = synth_event_add_next_val((u64)"slinky", &trace_state);
> + ret = synth_event_add_next_val((long)"slinky", &trace_state);
> if (ret)
> goto out;
>
> @@ -350,7 +350,7 @@ static int __init test_add_next_synth_val(void)
> goto out;
>
> /* my_string_field */
> - ret = synth_event_add_next_val((u64)"thneed_2.01", &trace_state);
> + ret = synth_event_add_next_val((long)"thneed_2.01", &trace_state);
> if (ret)
> goto out;
>
> @@ -396,12 +396,12 @@ static int __init test_add_synth_val(void)
> if (ret)
> goto out;
>
> - ret = synth_event_add_val("next_comm_field", (u64)"silly putty",
> + ret = synth_event_add_val("next_comm_field", (long)"silly putty",
> &trace_state);
> if (ret)
> goto out;
>
> - ret = synth_event_add_val("my_string_field", (u64)"thneed_9",
> + ret = synth_event_add_val("my_string_field", (long)"thneed_9",
> &trace_state);
> if (ret)
> goto out;
> @@ -424,11 +424,11 @@ static int __init test_trace_synth_event(void)
> /* Trace some bogus values just for testing */
> ret = synth_event_trace(create_synth_test, 7, /* number of values */
> 444, /* next_pid_field */
> - (u64)"clackers", /* next_comm_field */
> + "clackers", /* next_comm_field */
> 1000000, /* ts_ns */
> 1000, /* ts_ms */
> smp_processor_id(), /* cpu */
> - (u64)"Thneed", /* my_string_field */
> + "Thneed", /* my_string_field */
> 999); /* my_int_field */
> return ret;
> }
> diff --git a/kernel/trace/trace_events_hist.c b/kernel/trace/trace_events_hist.c
> index 483b3fd1094f..b8dd28f546d8 100644
> --- a/kernel/trace/trace_events_hist.c
> +++ b/kernel/trace/trace_events_hist.c
> @@ -1887,12 +1887,12 @@ int synth_event_trace(struct trace_event_file *file, unsigned int n_vals, ...)
>
> va_start(args, n_vals);
> for (i = 0, n_u64 = 0; i < state.event->n_fields; i++) {
> - u64 val;
> + long val;
>
> - val = va_arg(args, u64);
> + val = va_arg(args, long);
>
> if (state.event->fields[i]->is_string) {
> - char *str_val = (char *)(long)val;
> + char *str_val = (char *)val;
> char *str_field = (char *)&state.entry->fields[n_u64];
>
> strscpy(str_field, str_val, STR_VAR_LEN_MAX);
2 years, 3 months
[tracing] 9fe41efaca: BUG:unable_to_handle_page_fault_for_address
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 9fe41efaca08416657efa8731c0d47ccb6a3f3eb ("tracing: Add synth event generation test module")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: rcuperf
with following parameters:
runtime: 300s
perf_type: rcu
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+---------------------------------------------+------------+------------+
| | 8dcc53ad95 | 9fe41efaca |
+---------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 0 | 4 |
| BUG:unable_to_handle_page_fault_for_address | 0 | 4 |
| Oops:#[##] | 0 | 4 |
| EIP:strscpy | 0 | 4 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 4 |
+---------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 3.208397] BUG: unable to handle page fault for address: ffffffff
[ 3.209051] #PF: supervisor read access in kernel mode
[ 3.209588] #PF: error_code(0x0000) - not-present page
[ 3.210192] *pdpt = 0000000002a22001 *pde = 0000000002a24063 *pte = 0000000000000000
[ 3.210583] Oops: 0000 [#1] PREEMPT PTI
[ 3.210583] CPU: 0 PID: 1 Comm: swapper Not tainted 5.5.0-rc6-00065-g9fe41efaca084 #1
[ 3.210583] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 3.210583] EIP: strscpy+0x140/0x190
[ 3.210583] Code: 21 f9 81 e1 80 80 80 80 74 a0 e9 6b ff ff ff 8d 76 00 8b 45 ec 85 c9 74 41 8d 1c 02 8d 3c 06 eb 09 8b 4d f0 89 f7 89 d3 31 c0 <0f> b6 1b 88 1f 84 db 74 31 8d 58 01 8d 3c 08 eb 15 8d b4 26 00 00
[ 3.210583] EAX: 00000000 EBX: ffffffff ECX: 00000020 EDX: ffffffff
[ 3.210583] ESI: ec65d26c EDI: ec65d26c EBP: ec769e34 ESP: ec769e20
[ 3.210583] DS: 007b ES: 007b FS: 0000 GS: 00e0 SS: 0068 EFLAGS: 00010246
[ 3.210583] CR0: 80050033 CR2: ffffffff CR3: 02a26000 CR4: 000406b0
[ 3.210583] Call Trace:
[ 3.210583] synth_event_trace+0x241/0x2b0
[ 3.210583] synth_event_gen_test_init+0xeb3/0xf04
[ 3.210583] ? print_synth_event+0x450/0x450
[ 3.210583] ? init_trace_printk+0x2b/0x2b
[ 3.210583] do_one_initcall+0xc5/0x220
[ 3.210583] ? do_one_initcall+0xc5/0x220
[ 3.210583] kernel_init_freeable+0x137/0x19b
[ 3.210583] ? rest_init+0xf0/0xf0
[ 3.210583] kernel_init+0xd/0x110
[ 3.210583] ret_from_fork+0x2e/0x38
[ 3.210583] Modules linked in:
[ 3.210583] CR2: 00000000ffffffff
[ 3.210583] ---[ end trace d4429bd882710c19 ]---
To reproduce:
# build kernel
cd linux
cp config-5.5.0-rc6-00065-g9fe41efaca084 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
2 years, 3 months
[perf x86] b77491648e: will-it-scale.per_process_ops -2.1% regression
by kernel test robot
Greeting,
FYI, we noticed a -2.1% regression of will-it-scale.per_process_ops due to commit:
commit: b77491648e6eb2f26b6edf5eaea859adc17f4dcc ("perf x86: Infrastructure for exposing an Uncore unit to PMON mapping")
https://github.com/0day-ci/linux/commits/roman-sudarikov-linux-intel-com/...
in testcase: will-it-scale
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
with following parameters:
nr_task: 100%
mode: process
test: signal1
cpufreq_governor: performance
ucode: 0xb000038
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-20191114.cgz/lkp-bdw-ep6/signal1/will-it-scale/0xb000038
commit:
v5.4
b77491648e ("perf x86: Infrastructure for exposing an Uncore unit to PMON mapping")
v5.4 b77491648e6eb2f26b6edf5eaea
---------------- ---------------------------
%stddev %change %stddev
\ | \
47986 -2.1% 46989 will-it-scale.per_process_ops
4222852 -2.1% 4135110 will-it-scale.workload
427194 ± 9% +13.8% 486344 ± 4% numa-vmstat.node1.numa_local
12.88 ± 2% -8.5% 11.79 ± 4% turbostat.RAMWatt
8846 ± 10% +23.9% 10964 ± 9% softirqs.CPU0.SCHED
14442 ± 4% -5.2% 13697 ± 5% softirqs.CPU71.RCU
78696 ± 9% +14.4% 89993 ± 8% sched_debug.cfs_rq:/.min_vruntime.stddev
78411 ± 9% +14.5% 89817 ± 8% sched_debug.cfs_rq:/.spread0.stddev
9.77 ± 4% +15.0% 11.23 ± 3% sched_debug.cpu.clock.stddev
9.77 ± 4% +15.0% 11.23 ± 3% sched_debug.cpu.clock_task.stddev
4.072e+09 -1.9% 3.996e+09 perf-stat.i.branch-instructions
44948352 -1.8% 44159252 perf-stat.i.branch-misses
35.25 +4.3 39.56 perf-stat.i.cache-miss-rate%
12569960 +5.2% 13223444 perf-stat.i.cache-misses
35888855 ± 2% -6.2% 33680305 ± 2% perf-stat.i.cache-references
11.75 +1.8% 11.96 perf-stat.i.cpi
19377 -5.0% 18403 perf-stat.i.cycles-between-cache-misses
27157347 -2.1% 26595986 perf-stat.i.dTLB-load-misses
6.739e+09 -2.0% 6.602e+09 perf-stat.i.dTLB-loads
27809165 -1.9% 27268405 perf-stat.i.dTLB-store-misses
5.461e+09 -1.9% 5.356e+09 perf-stat.i.dTLB-stores
2.072e+10 -1.9% 2.034e+10 perf-stat.i.instructions
0.09 -1.7% 0.08 perf-stat.i.ipc
917994 +2.6% 941599 perf-stat.i.node-load-misses
96.93 -1.1 95.81 perf-stat.i.node-store-miss-rate%
5499191 +5.0% 5774707 perf-stat.i.node-store-misses
169716 ± 8% +45.2% 246479 ± 6% perf-stat.i.node-stores
1.73 ± 2% -4.4% 1.66 ± 2% perf-stat.overall.MPKI
35.03 +4.2 39.27 perf-stat.overall.cache-miss-rate%
11.77 +1.8% 11.98 perf-stat.overall.cpi
19401 -5.0% 18428 perf-stat.overall.cycles-between-cache-misses
0.08 -1.8% 0.08 perf-stat.overall.ipc
97.01 -1.1 95.91 perf-stat.overall.node-store-miss-rate%
4.058e+09 -1.8% 3.983e+09 perf-stat.ps.branch-instructions
44798305 -1.7% 44014351 perf-stat.ps.branch-misses
12526500 +5.2% 13178368 perf-stat.ps.cache-misses
35771706 ± 2% -6.2% 33569906 ± 2% perf-stat.ps.cache-references
27063288 -2.1% 26505363 perf-stat.ps.dTLB-load-misses
6.716e+09 -2.0% 6.58e+09 perf-stat.ps.dTLB-loads
27712662 -1.9% 27175399 perf-stat.ps.dTLB-store-misses
5.442e+09 -1.9% 5.338e+09 perf-stat.ps.dTLB-stores
2.065e+10 -1.9% 2.027e+10 perf-stat.ps.instructions
914841 +2.6% 938399 perf-stat.ps.node-load-misses
5480102 +5.0% 5754996 perf-stat.ps.node-store-misses
169148 ± 8% +45.2% 245649 ± 6% perf-stat.ps.node-stores
6.242e+12 -1.6% 6.142e+12 perf-stat.total.instructions
481.50 ± 26% -41.7% 280.75 ± 28% interrupts.37:IR-PCI-MSI.1572868-edge.eth0-TxRx-3
772.75 ± 63% -70.0% 231.75 ± 28% interrupts.CPU1.RES:Rescheduling_interrupts
481.50 ± 26% -41.7% 280.75 ± 28% interrupts.CPU16.37:IR-PCI-MSI.1572868-edge.eth0-TxRx-3
954.25 ± 10% -71.8% 269.50 ± 76% interrupts.CPU19.RES:Rescheduling_interrupts
932.50 ± 48% -68.4% 294.75 ± 72% interrupts.CPU20.RES:Rescheduling_interrupts
583.75 ± 59% -79.5% 119.75 ± 54% interrupts.CPU21.RES:Rescheduling_interrupts
513.00 ± 42% +145.8% 1261 ± 17% interrupts.CPU22.RES:Rescheduling_interrupts
256.25 ± 40% +253.9% 906.75 ± 39% interrupts.CPU24.RES:Rescheduling_interrupts
475.25 ± 19% +133.5% 1109 ± 41% interrupts.CPU26.RES:Rescheduling_interrupts
734.50 ± 36% +99.1% 1462 ± 26% interrupts.CPU27.RES:Rescheduling_interrupts
905.75 ± 48% -64.9% 318.00 ± 85% interrupts.CPU3.RES:Rescheduling_interrupts
363.00 ± 35% +114.3% 777.75 ± 26% interrupts.CPU30.RES:Rescheduling_interrupts
6915 ± 24% -29.1% 4904 ± 34% interrupts.CPU37.NMI:Non-maskable_interrupts
6915 ± 24% -29.1% 4904 ± 34% interrupts.CPU37.PMI:Performance_monitoring_interrupts
436.50 ± 48% +166.7% 1164 ± 41% interrupts.CPU38.RES:Rescheduling_interrupts
6950 ± 24% -29.1% 4926 ± 34% interrupts.CPU39.NMI:Non-maskable_interrupts
6950 ± 24% -29.1% 4926 ± 34% interrupts.CPU39.PMI:Performance_monitoring_interrupts
6906 ± 24% -28.9% 4910 ± 35% interrupts.CPU41.NMI:Non-maskable_interrupts
6906 ± 24% -28.9% 4910 ± 35% interrupts.CPU41.PMI:Performance_monitoring_interrupts
216.00 ± 70% -76.6% 50.50 ± 22% interrupts.CPU46.RES:Rescheduling_interrupts
2607 ± 47% +51.4% 3948 ± 8% interrupts.CPU50.CAL:Function_call_interrupts
3220 ± 10% +22.4% 3940 ± 8% interrupts.CPU51.CAL:Function_call_interrupts
4914 ± 34% +59.9% 7855 interrupts.CPU56.NMI:Non-maskable_interrupts
4914 ± 34% +59.9% 7855 interrupts.CPU56.PMI:Performance_monitoring_interrupts
4937 ± 34% +59.7% 7885 interrupts.CPU58.NMI:Non-maskable_interrupts
4937 ± 34% +59.7% 7885 interrupts.CPU58.PMI:Performance_monitoring_interrupts
4919 ± 34% +59.6% 7849 interrupts.CPU59.NMI:Non-maskable_interrupts
4919 ± 34% +59.6% 7849 interrupts.CPU59.PMI:Performance_monitoring_interrupts
4925 ± 34% +59.9% 7878 interrupts.CPU61.NMI:Non-maskable_interrupts
4925 ± 34% +59.9% 7878 interrupts.CPU61.PMI:Performance_monitoring_interrupts
4906 ± 33% +60.3% 7867 interrupts.CPU63.NMI:Non-maskable_interrupts
4906 ± 33% +60.3% 7867 interrupts.CPU63.PMI:Performance_monitoring_interrupts
890.00 ± 75% -82.0% 160.00 ± 46% interrupts.CPU63.RES:Rescheduling_interrupts
135.00 ± 52% +911.7% 1365 ± 76% interrupts.CPU70.RES:Rescheduling_interrupts
110.25 ± 14% +388.7% 538.75 ± 30% interrupts.CPU71.RES:Rescheduling_interrupts
3285 ± 3% +15.4% 3791 ± 3% interrupts.CPU73.CAL:Function_call_interrupts
186.50 ± 60% +274.4% 698.25 ± 77% interrupts.CPU81.RES:Rescheduling_interrupts
1.22 ± 2% -0.2 1.02 perf-profile.calltrace.cycles-pp.recalc_sigpending.dequeue_signal.get_signal.do_signal.exit_to_usermode_loop
3.95 -0.2 3.79 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
4.07 -0.2 3.92 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
1.93 -0.1 1.79 perf-profile.calltrace.cycles-pp.fpu__clear.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.66 -0.1 0.59 ± 3% perf-profile.calltrace.cycles-pp.__set_task_blocked.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.65 ± 2% -0.1 0.57 ± 2% perf-profile.calltrace.cycles-pp.recalc_sigpending.__set_task_blocked.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64
0.85 -0.1 0.79 ± 2% perf-profile.calltrace.cycles-pp.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.03 -0.0 0.98 perf-profile.calltrace.cycles-pp.signal_setup_done.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.81 -0.0 0.76 ± 2% perf-profile.calltrace.cycles-pp.fpregs_mark_activate.fpu__clear.do_signal.exit_to_usermode_loop.do_syscall_64
0.98 -0.0 0.94 perf-profile.calltrace.cycles-pp.__set_current_blocked.signal_setup_done.do_signal.exit_to_usermode_loop.do_syscall_64
1.10 -0.0 1.07 perf-profile.calltrace.cycles-pp.copy_fpstate_to_sigframe.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.52 +0.0 0.55 ± 3% perf-profile.calltrace.cycles-pp.fpregs_mark_activate.__fpu__restore_sig.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.87 +0.1 1.95 perf-profile.calltrace.cycles-pp.__fpu__restore_sig.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
23.79 +0.3 24.06 perf-profile.calltrace.cycles-pp.__sigqueue_alloc.__send_signal.do_send_sig_info.do_send_specific.do_tkill
24.02 +0.3 24.29 perf-profile.calltrace.cycles-pp.__send_signal.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill
89.84 +0.3 90.14 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
89.46 +0.3 89.78 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
36.84 +0.4 37.20 perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
36.43 +0.4 36.80 perf-profile.calltrace.cycles-pp.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
25.64 +0.4 26.09 perf-profile.calltrace.cycles-pp.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe
25.58 +0.5 26.04 perf-profile.calltrace.cycles-pp.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe
25.35 +0.5 25.82 perf-profile.calltrace.cycles-pp.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe
24.66 +0.5 25.18 perf-profile.calltrace.cycles-pp.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64
30.40 +0.6 30.97 perf-profile.calltrace.cycles-pp.dequeue_signal.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64
31.58 +0.6 32.18 perf-profile.calltrace.cycles-pp.get_signal.do_signal.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
29.13 +0.8 29.91 perf-profile.calltrace.cycles-pp.__dequeue_signal.dequeue_signal.get_signal.do_signal.exit_to_usermode_loop
28.90 +0.8 29.68 perf-profile.calltrace.cycles-pp.__sigqueue_free.__dequeue_signal.dequeue_signal.get_signal.do_signal
3.46 -0.2 3.21 ± 2% perf-profile.children.cycles-pp.recalc_sigpending
3.95 -0.2 3.79 perf-profile.children.cycles-pp.entry_SYSCALL_64
4.42 -0.2 4.26 perf-profile.children.cycles-pp.syscall_return_via_sysret
1.93 -0.1 1.80 ± 2% perf-profile.children.cycles-pp.fpu__clear
3.62 -0.1 3.54 perf-profile.children.cycles-pp.__set_current_blocked
0.27 -0.1 0.21 ± 3% perf-profile.children.cycles-pp.fpregs_assert_state_consistent
0.84 -0.0 0.79 ± 2% perf-profile.children.cycles-pp._copy_from_user
1.03 -0.0 0.99 perf-profile.children.cycles-pp.signal_setup_done
0.34 -0.0 0.30 ± 5% perf-profile.children.cycles-pp.restore_altstack
0.73 -0.0 0.70 perf-profile.children.cycles-pp.__might_fault
1.11 -0.0 1.08 perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
0.37 ± 2% -0.0 0.35 perf-profile.children.cycles-pp.___might_sleep
0.27 -0.0 0.26 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
1.89 +0.1 1.96 perf-profile.children.cycles-pp.__fpu__restore_sig
0.29 ± 7% +0.2 0.53 ± 6% perf-profile.children.cycles-pp.__lock_task_sighand
0.29 ± 7% +0.2 0.53 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
24.03 +0.3 24.29 perf-profile.children.cycles-pp.__send_signal
23.80 +0.3 24.06 perf-profile.children.cycles-pp.__sigqueue_alloc
90.00 +0.3 90.30 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
89.60 +0.3 89.92 perf-profile.children.cycles-pp.do_syscall_64
36.86 +0.4 37.22 perf-profile.children.cycles-pp.exit_to_usermode_loop
36.45 +0.4 36.81 perf-profile.children.cycles-pp.do_signal
25.65 +0.4 26.10 perf-profile.children.cycles-pp.__x64_sys_tgkill
25.59 +0.5 26.04 perf-profile.children.cycles-pp.do_tkill
25.36 +0.5 25.82 perf-profile.children.cycles-pp.do_send_specific
24.67 +0.5 25.19 perf-profile.children.cycles-pp.do_send_sig_info
30.41 +0.6 30.98 perf-profile.children.cycles-pp.dequeue_signal
31.60 +0.6 32.20 perf-profile.children.cycles-pp.get_signal
29.14 +0.8 29.92 perf-profile.children.cycles-pp.__dequeue_signal
28.90 +0.8 29.69 perf-profile.children.cycles-pp.__sigqueue_free
19.11 -0.4 18.75 perf-profile.self.cycles-pp.do_syscall_64
2.58 -0.2 2.34 perf-profile.self.cycles-pp.recalc_sigpending
3.95 -0.2 3.79 perf-profile.self.cycles-pp.entry_SYSCALL_64
4.41 -0.2 4.25 perf-profile.self.cycles-pp.syscall_return_via_sysret
0.95 -0.1 0.86 ± 2% perf-profile.self.cycles-pp.fpu__clear
0.25 -0.1 0.19 ± 2% perf-profile.self.cycles-pp.fpregs_assert_state_consistent
0.15 ± 2% -0.0 0.12 ± 6% perf-profile.self.cycles-pp._copy_from_user
0.74 -0.0 0.71 perf-profile.self.cycles-pp.copy_fpstate_to_sigframe
0.34 -0.0 0.31 perf-profile.self.cycles-pp.__x64_sys_rt_sigprocmask
0.46 ± 2% -0.0 0.44 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.36 ± 3% -0.0 0.34 perf-profile.self.cycles-pp.___might_sleep
0.26 -0.0 0.24 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
1.10 +0.0 1.15 perf-profile.self.cycles-pp.__fpu__restore_sig
0.28 ± 6% +0.2 0.53 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
23.71 +0.3 23.96 perf-profile.self.cycles-pp.__sigqueue_alloc
12.65 +0.6 13.24 perf-profile.self.cycles-pp.__sigqueue_free
will-it-scale.per_process_ops
52000 +-+-----------------------------------------------------------------+
|.. |
51000 +-++.+..+.+ |
50000 +-+ : |
| : |
49000 +-+ : |
| +..+. .+.+..+.+..+..+.+..+.+..+.. |
48000 +-+ +..+. +.+..+..+.+..+.+..|
| O O O O O O |
47000 +-+ O O O O O O |
46000 +-+ |
| |
45000 +-+ O O |
O O O O O O O O O |
44000 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 3 months
c488a041dc ("mc-entity.c: use WARN_ON, validate link pads"): [ 8.931848] WARNING: CPU: 1 PID: 1 at drivers/media/mc/mc-entity.c:671 media_create_pad_link
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/0day-ci/linux/commits/Hans-Verkuil/mc-entity-c-use-WAR...
commit c488a041dc93ca14925f0cc2092c45c7e31a84bb
Author: Hans Verkuil <hverkuil(a)xs4all.nl>
AuthorDate: Tue Feb 4 19:13:13 2020 +0100
Commit: 0day robot <lkp(a)intel.com>
CommitDate: Wed Feb 5 04:51:19 2020 +0800
mc-entity.c: use WARN_ON, validate link pads
Use WARN_ON instead of BUG_ON.
Add two new WARN_ONs to verify that the source pad is really a source
and that the sink pad is really a sink.
Signed-off-by: Hans Verkuil <hverkuil-cisco(a)xs4all.nl>
1697d98124 media: staging/intel-ipu3: remove TODO item about acronyms
c488a041dc mc-entity.c: use WARN_ON, validate link pads
+----------------------------------------------------------------+------------+------------+
| | 1697d98124 | c488a041dc |
+----------------------------------------------------------------+------------+------------+
| boot_successes | 35 | 0 |
| boot_failures | 1 | 11 |
| WARNING:at_lib/kobject.c:#kobject_put | 1 | |
| EIP:kobject_put | 1 | |
| WARNING:at_lib/refcount.c:#refcount_warn_saturate | 1 | |
| EIP:refcount_warn_saturate | 1 | |
| BUG:kernel_NULL_pointer_dereference,address | 1 | |
| Oops:#[##] | 1 | |
| EIP:__list_del_entry_valid | 1 | |
| Kernel_panic-not_syncing:Fatal_exception | 1 | |
| WARNING:at_drivers/media/mc/mc-entity.c:#media_create_pad_link | 0 | 11 |
| EIP:media_create_pad_link | 0 | 11 |
+----------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 8.927083] vivid-000: V4L2 metadata capture device registered as video2
[ 8.928030] vivid-000: V4L2 metadata output device registered as video3
[ 8.929014] vivid-000: V4L2 touch capture device registered as v4l-touch0
[ 8.930568] vim2m vim2m.0: Device registered as /dev/video4
[ 8.931315] ------------[ cut here ]------------
[ 8.931848] WARNING: CPU: 1 PID: 1 at drivers/media/mc/mc-entity.c:671 media_create_pad_link+0x72/0x124
[ 8.933076] Modules linked in:
[ 8.933429] CPU: 1 PID: 1 Comm: swapper/0 Tainted: G T 5.5.0-rc5-00209-gc488a041dc93ca #1
[ 8.934471] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 8.935408] EIP: media_create_pad_link+0x72/0x124
[ 8.935938] Code: 0b eb ea 8b 56 2c c1 e7 05 89 7d ec f6 44 3a 1c 02 75 04 0f 0b eb d6 c1 e0 05 89 45 e8 8b 43 2c 8b 4d e8 f6 44 08 1c 01 75 04 <0f> 0b eb bf 8d 46 30 e8 87 fc ff ff 89 45 f0 b8 f4 ff ff ff 83 7d
[ 8.938080] EAX: f0d232e8 EBX: f0d23298 ECX: 00000020 EDX: f0d23208
[ 8.938780] ESI: f09be874 EDI: 00000000 EBP: b03dbdf8 ESP: b03dbde0
[ 8.938780] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246
[ 8.938780] CR0: 80050033 CR2: ffffffff CR3: 027a7000 CR4: 00040690
[ 8.938780] Call Trace:
[ 8.938780] v4l2_m2m_register_media_controller+0xb0/0x1a2
[ 8.938780] vim2m_probe+0x1d3/0x22e
[ 8.938780] platform_drv_probe+0x41/0x7d
[ 8.938780] really_probe+0x114/0x2c5
[ 8.938780] driver_probe_device+0xdd/0x118
[ 8.938780] device_driver_attach+0x36/0x49
[ 8.938780] __driver_attach+0x82/0x89
[ 8.938780] bus_for_each_dev+0x44/0x70
[ 8.938780] driver_attach+0x1c/0x21
[ 8.938780] ? device_driver_attach+0x49/0x49
[ 8.938780] bus_add_driver+0xc1/0x17c
[ 8.938780] driver_register+0x8c/0xbe
[ 8.938780] __platform_driver_register+0x35/0x39
[ 8.938780] ? vivid_init+0x73/0x73
[ 8.938780] vim2m_init+0x3c/0x73
[ 8.938780] ? vivid_init+0x73/0x73
[ 8.938780] do_one_initcall+0xa2/0x1d3
[ 8.938780] ? trace_initcall_level+0x77/0x7b
[ 8.938780] ? kernel_init_freeable+0x1a9/0x269
[ 8.938780] kernel_init_freeable+0x1c4/0x269
[ 8.938780] ? rest_init+0xdc/0xdc
[ 8.938780] kernel_init+0xd/0xda
[ 8.938780] ret_from_fork+0x1e/0x28
[ 8.938780] random: get_random_bytes called from init_oops_id+0x28/0x3f with crng_init=0
[ 8.938780] ---[ end trace db4e5087d0e8da6d ]---
[ 8.968305] vim2m vim2m.0: Failed to init mem2mem media controller
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 1c77f50bd0619008004af8a9510697ffc9a14056 b3a987b0264d3ddbb24293ebff10eddfc472f653 --
git bisect good 66cdd670814f7f62b4ecbd5dbf831f5e7574ae88 # 07:30 G 10 0 1 1 Merge 'linux-review/Dan-Murphy/net-phy-dp83867-Add-speed-optimization-feature/20200205-045548' into devel-catchup-202002050542
git bisect good 55f7f760a632072e67f40f3a227110f18b51b10d # 07:58 G 10 0 0 0 Merge 'sound/for-next' into devel-catchup-202002050542
git bisect bad 61e24d7f5f2cdc1604fa5ccf93e8f0273fe81145 # 08:14 B 0 6 26 4 Merge 'linux-review/Hans-Verkuil/mc-entity-c-use-WARN_ON-validate-link-pads/20200205-045118' into devel-catchup-202002050542
git bisect good 1a6c0b36dd19c51cdd76895d009c5deba2286ebb # 09:06 G 11 0 1 1 media: v4l2-core: fix VIDIOC_DQEVENT for time64 ABI
git bisect good 1ec4c6efe23154b4ab44c1a34dbc0eb121eb614a # 10:00 G 11 0 1 1 media: saa7146: Avoid using BUG_ON as an assertion
git bisect good 402e77c4c7fdfbbd48f91160314c26fc39741d31 # 10:36 G 10 0 0 0 media: usb: dvb-usb-v2: anysee: convert to use i2c_new_client_device()
git bisect good bae1155cf5798cc65fedeecfa82c2f48fa3ed18b # 10:58 G 10 0 1 1 media: staging: rkisp1: add output device for parameters
git bisect good 1dd2e8f942574e2be18374ebb81751082d8d467c # 11:21 G 11 0 0 0 media: uvcvideo: Add a quirk to force GEO GC6500 Camera bits-per-pixel value
git bisect good 0b09f98987568842422610f6622068c14e79b707 # 11:42 G 11 0 0 0 media: Revert "media: staging/intel-ipu3: make imgu use fixed running mode"
git bisect good 1697d98124819aab09b86602978bd4f50e101e2d # 12:05 G 10 0 0 0 media: staging/intel-ipu3: remove TODO item about acronyms
git bisect bad c488a041dc93ca14925f0cc2092c45c7e31a84bb # 12:24 B 0 1 17 0 mc-entity.c: use WARN_ON, validate link pads
# first bad commit: [c488a041dc93ca14925f0cc2092c45c7e31a84bb] mc-entity.c: use WARN_ON, validate link pads
git bisect good 1697d98124819aab09b86602978bd4f50e101e2d # 12:36 G 31 0 2 2 media: staging/intel-ipu3: remove TODO item about acronyms
# extra tests with debug options
git bisect good c488a041dc93ca14925f0cc2092c45c7e31a84bb # 13:25 G 10 0 5 8 mc-entity.c: use WARN_ON, validate link pads
# extra tests on head commit of linux-review/Hans-Verkuil/mc-entity-c-use-WARN_ON-validate-link-pads/20200205-045118
git bisect bad c488a041dc93ca14925f0cc2092c45c7e31a84bb # 13:46 B 0 11 27 0 mc-entity.c: use WARN_ON, validate link pads
# bad: [c488a041dc93ca14925f0cc2092c45c7e31a84bb] mc-entity.c: use WARN_ON, validate link pads
# extra tests on revert first bad commit
git bisect good 50f9a2ce1041b0b2ebe9da640c89c2f1dde201e9 # 14:41 G 10 0 0 0 Revert "mc-entity.c: use WARN_ON, validate link pads"
# good: [50f9a2ce1041b0b2ebe9da640c89c2f1dde201e9] Revert "mc-entity.c: use WARN_ON, validate link pads"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation
2 years, 3 months
[x86,sched] 8e663d38f1: reaim.jobs_per_min -2.1% regression
by kernel test robot
Greeting,
FYI, we noticed a -2.1% regression of reaim.jobs_per_min due to commit:
commit: 8e663d38f1ce6ed9151c949f952765dd24fbdb22 ("x86,sched: Add support for frequency invariance")
https://github.com/0day-ci/linux/commits/Giovanni-Gherdovich/Add-support-...
in testcase: reaim
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 128G memory
with following parameters:
runtime: 300s
nr_task: 100%
test: compute
cpufreq_governor: performance
ucode: 0xb000038
test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-20191114.cgz/300s/lkp-bdw-ep6/compute/reaim/0xb000038
commit:
248ed51048 ("x86/nmi: Remove irq_work from the long duration NMI handler")
8e663d38f1 ("x86,sched: Add support for frequency invariance")
248ed51048c40d36 8e663d38f1ce6ed9151c949f952
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
2:4 1% 2:4 perf-profile.children.cycles-pp.error_entry
1:4 2% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
546252 -2.1% 534691 reaim.jobs_per_min
6207 -2.1% 6076 reaim.jobs_per_min_child
562840 -1.8% 552636 reaim.max_jobs_per_min
0.98 +2.2% 1.00 reaim.parent_time
1.88 +23.9% 2.33 reaim.std_dev_percent
0.02 +8.3% 0.02 reaim.std_dev_time
125280 +6.7% 133627 reaim.time.involuntary_context_switches
2676 -1.1% 2647 reaim.time.percent_of_cpu_this_job_got
506010 -11.4% 448390 reaim.time.voluntary_context_switches
35831 ± 2% +47.1% 52701 ± 3% turbostat.C1
4503 +14.5% 5155 vmstat.system.cs
947553 ± 3% +33.5% 1265411 ± 3% cpuidle.C1.time
36765 ± 2% +46.5% 53879 ± 3% cpuidle.C1.usage
103178 ± 3% +18.8% 122529 ± 3% cpuidle.POLL.time
33743 ± 5% +14.5% 38636 ± 4% cpuidle.POLL.usage
74648 +4.5% 78014 proc-vmstat.nr_active_anon
70661 +4.6% 73934 proc-vmstat.nr_anon_pages
14719 +0.9% 14859 proc-vmstat.nr_kernel_stack
44619 -1.5% 43969 proc-vmstat.nr_slab_unreclaimable
74648 +4.5% 78014 proc-vmstat.nr_zone_active_anon
43255 -2.3% 42247 proc-vmstat.pgactivate
10538 ± 5% -11.2% 9362 ± 2% softirqs.CPU15.NET_RX
86956 ± 4% +6.6% 92671 ± 4% softirqs.CPU3.RCU
9969 ± 3% -8.0% 9175 ± 4% softirqs.CPU44.NET_RX
10274 ± 4% -8.5% 9403 ± 7% softirqs.CPU48.NET_RX
9432 ± 3% +7.6% 10147 ± 3% softirqs.CPU73.NET_RX
29906 ± 3% +4.9% 31360 ± 4% softirqs.CPU79.SCHED
9365 ± 8% +13.1% 10591 ± 4% softirqs.CPU8.NET_RX
30010 ± 3% +5.0% 31520 ± 4% softirqs.CPU84.SCHED
2634992 +3.1% 2716654 perf-stat.i.cache-misses
4510 +14.8% 5176 perf-stat.i.context-switches
483.73 +43.6% 694.51 perf-stat.i.cpu-migrations
30358 ± 3% -15.3% 25712 ± 2% perf-stat.i.cycles-between-cache-misses
82.01 +2.8 84.80 perf-stat.i.node-load-miss-rate%
858999 +5.2% 903580 perf-stat.i.node-load-misses
174029 -6.9% 162061 perf-stat.i.node-loads
1.10 ± 2% +0.0 1.14 perf-stat.overall.branch-miss-rate%
0.28 +0.0 0.29 perf-stat.overall.cache-miss-rate%
30703 -3.5% 29631 perf-stat.overall.cycles-between-cache-misses
83.14 +1.6 84.79 perf-stat.overall.node-load-miss-rate%
8.424e+09 -1.0% 8.344e+09 perf-stat.ps.branch-instructions
2620634 +3.0% 2699663 perf-stat.ps.cache-misses
4487 +14.7% 5146 perf-stat.ps.context-switches
480.47 +43.5% 689.70 perf-stat.ps.cpu-migrations
6.271e+10 -1.0% 6.212e+10 perf-stat.ps.instructions
406885 -1.0% 402757 perf-stat.ps.minor-faults
854104 +5.1% 897717 perf-stat.ps.node-load-misses
173148 -7.0% 161075 perf-stat.ps.node-loads
406885 -1.0% 402757 perf-stat.ps.page-faults
170908 ±133% +301.7% 686613 ± 32% sched_debug.cfs_rq:/.load.max
26898 ±137% +246.3% 93142 ± 30% sched_debug.cfs_rq:/.load.stddev
5.69 ± 31% -69.3% 1.75 ± 41% sched_debug.cfs_rq:/.load_avg.min
0.73 ± 26% -53.0% 0.34 ± 22% sched_debug.cfs_rq:/.nr_running.avg
113.63 ±131% +285.0% 437.54 ± 45% sched_debug.cfs_rq:/.runnable_load_avg.max
159449 ±143% +328.6% 683368 ± 32% sched_debug.cfs_rq:/.runnable_weight.max
25239 ±148% +267.5% 92754 ± 31% sched_debug.cfs_rq:/.runnable_weight.stddev
736.96 ± 26% -54.9% 332.09 ± 20% sched_debug.cfs_rq:/.util_avg.avg
1225 ± 14% -23.0% 943.50 ± 9% sched_debug.cfs_rq:/.util_avg.max
502.59 ± 36% -72.8% 136.75 ± 49% sched_debug.cfs_rq:/.util_avg.min
577.11 ± 30% -63.6% 210.12 ± 27% sched_debug.cfs_rq:/.util_est_enqueued.avg
5.03 ± 30% -37.1% 3.17 ± 5% sched_debug.cpu.clock.stddev
5.03 ± 30% -37.1% 3.17 ± 5% sched_debug.cpu.clock_task.stddev
32433 ± 34% -66.8% 10782 ± 7% sched_debug.cpu.curr->pid.avg
40168 ± 6% -8.4% 36800 sched_debug.cpu.curr->pid.max
4951 ±115% -96.9% 154.50 ±100% sched_debug.cpu.curr->pid.min
0.00 ± 14% -32.7% 0.00 ± 14% sched_debug.cpu.next_balance.stddev
8579 ± 8% +22.0% 10471 sched_debug.cpu.nr_switches.avg
6285 ± 8% +21.3% 7627 ± 5% sched_debug.cpu.nr_switches.min
7011 ± 10% +31.3% 9209 sched_debug.cpu.sched_count.avg
5325 ± 12% +33.1% 7090 ± 3% sched_debug.cpu.sched_count.min
1792 ± 10% +67.9% 3010 sched_debug.cpu.sched_goidle.avg
1153 ± 11% +88.6% 2175 ± 2% sched_debug.cpu.sched_goidle.min
869.40 ± 2% +18.1% 1026 ± 9% sched_debug.cpu.sched_goidle.stddev
3785 ± 7% -25.3% 2826 ± 4% sched_debug.cpu.ttwu_local.max
349.73 ± 11% -34.0% 230.74 ± 12% sched_debug.cpu.ttwu_local.stddev
311.00 ± 13% +243.7% 1069 ± 55% interrupts.CPU1.RES:Rescheduling_interrupts
292.50 ± 9% +75.4% 513.00 ± 20% interrupts.CPU10.RES:Rescheduling_interrupts
292.00 ± 9% +56.6% 457.25 ± 4% interrupts.CPU12.RES:Rescheduling_interrupts
328.00 ± 14% +45.6% 477.50 ± 4% interrupts.CPU13.RES:Rescheduling_interrupts
328.50 ± 11% +39.4% 458.00 ± 4% interrupts.CPU14.RES:Rescheduling_interrupts
302.75 ± 7% +58.1% 478.75 ± 7% interrupts.CPU15.RES:Rescheduling_interrupts
283.75 ± 18% +59.6% 453.00 ± 13% interrupts.CPU16.RES:Rescheduling_interrupts
307.50 ± 13% +38.0% 424.25 ± 8% interrupts.CPU17.RES:Rescheduling_interrupts
300.00 ± 5% +55.9% 467.75 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts
321.25 ± 21% +36.7% 439.25 ± 7% interrupts.CPU19.RES:Rescheduling_interrupts
309.75 ± 19% +50.1% 465.00 ± 10% interrupts.CPU20.RES:Rescheduling_interrupts
277.75 ± 10% +78.8% 496.50 ± 9% interrupts.CPU21.RES:Rescheduling_interrupts
339.50 ± 18% +32.5% 449.75 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts
313.75 ± 6% +37.7% 432.00 ± 3% interrupts.CPU23.RES:Rescheduling_interrupts
338.50 ± 12% +29.8% 439.25 ± 6% interrupts.CPU24.RES:Rescheduling_interrupts
309.50 ± 19% +45.5% 450.25 ± 9% interrupts.CPU25.RES:Rescheduling_interrupts
2165 ± 31% +41.8% 3070 ± 2% interrupts.CPU26.NMI:Non-maskable_interrupts
2165 ± 31% +41.8% 3070 ± 2% interrupts.CPU26.PMI:Performance_monitoring_interrupts
308.25 ± 4% +52.1% 469.00 ± 6% interrupts.CPU26.RES:Rescheduling_interrupts
301.50 ± 6% +54.7% 466.50 ± 8% interrupts.CPU27.RES:Rescheduling_interrupts
311.75 ± 4% +46.0% 455.25 ± 3% interrupts.CPU28.RES:Rescheduling_interrupts
284.25 ± 10% +65.4% 470.25 ± 7% interrupts.CPU29.RES:Rescheduling_interrupts
330.75 ± 14% +30.4% 431.25 ± 7% interrupts.CPU30.RES:Rescheduling_interrupts
295.50 ± 7% +61.7% 477.75 ± 17% interrupts.CPU31.RES:Rescheduling_interrupts
312.25 ± 9% +41.8% 442.75 ± 12% interrupts.CPU32.RES:Rescheduling_interrupts
336.50 ± 21% +41.7% 476.75 ± 15% interrupts.CPU33.RES:Rescheduling_interrupts
291.00 ± 6% +51.7% 441.50 ± 5% interrupts.CPU34.RES:Rescheduling_interrupts
326.75 ± 5% +37.5% 449.25 ± 6% interrupts.CPU35.RES:Rescheduling_interrupts
318.00 ± 4% +36.6% 434.50 ± 6% interrupts.CPU36.RES:Rescheduling_interrupts
333.25 ± 16% +41.0% 470.00 ± 5% interrupts.CPU39.RES:Rescheduling_interrupts
308.00 ± 16% +41.2% 434.75 ± 8% interrupts.CPU40.RES:Rescheduling_interrupts
319.25 ± 13% +42.8% 456.00 ± 10% interrupts.CPU41.RES:Rescheduling_interrupts
300.00 ± 5% +60.5% 481.50 ± 12% interrupts.CPU42.RES:Rescheduling_interrupts
3648 ± 21% -58.0% 1532 ± 15% interrupts.CPU43.RES:Rescheduling_interrupts
293.25 ± 15% +48.8% 436.25 ± 7% interrupts.CPU44.RES:Rescheduling_interrupts
272.75 ± 7% +63.1% 444.75 ± 9% interrupts.CPU45.RES:Rescheduling_interrupts
2189 ± 30% +41.2% 3091 ± 3% interrupts.CPU49.NMI:Non-maskable_interrupts
2189 ± 30% +41.2% 3091 ± 3% interrupts.CPU49.PMI:Performance_monitoring_interrupts
355.75 ± 11% +35.8% 483.00 ± 12% interrupts.CPU51.RES:Rescheduling_interrupts
3496 ± 3% -9.1% 3178 ± 7% interrupts.CPU52.CAL:Function_call_interrupts
2147 ± 32% +42.6% 3062 ± 2% interrupts.CPU52.NMI:Non-maskable_interrupts
2147 ± 32% +42.6% 3062 ± 2% interrupts.CPU52.PMI:Performance_monitoring_interrupts
322.75 ± 5% +38.3% 446.25 ± 4% interrupts.CPU52.RES:Rescheduling_interrupts
272.00 ± 4% +57.0% 427.00 ± 8% interrupts.CPU53.RES:Rescheduling_interrupts
300.50 ± 12% +52.0% 456.75 interrupts.CPU55.RES:Rescheduling_interrupts
290.75 ± 7% +46.9% 427.25 ± 8% interrupts.CPU56.RES:Rescheduling_interrupts
315.75 ± 16% +33.7% 422.25 ± 4% interrupts.CPU57.RES:Rescheduling_interrupts
334.75 ± 16% +26.9% 424.75 ± 5% interrupts.CPU59.RES:Rescheduling_interrupts
357.50 ± 17% +30.8% 467.50 ± 5% interrupts.CPU6.RES:Rescheduling_interrupts
274.00 ± 11% +60.9% 440.75 ± 5% interrupts.CPU60.RES:Rescheduling_interrupts
310.50 ± 6% +52.7% 474.25 ± 15% interrupts.CPU62.RES:Rescheduling_interrupts
311.25 ± 9% +35.3% 421.25 ± 2% interrupts.CPU63.RES:Rescheduling_interrupts
280.50 ± 9% +52.6% 428.00 ± 8% interrupts.CPU64.RES:Rescheduling_interrupts
265.50 ± 10% +67.7% 445.25 ± 4% interrupts.CPU65.RES:Rescheduling_interrupts
303.50 ± 20% +53.2% 465.00 ± 2% interrupts.CPU66.RES:Rescheduling_interrupts
308.25 ± 20% +48.0% 456.25 ± 2% interrupts.CPU68.RES:Rescheduling_interrupts
278.75 ± 4% +56.1% 435.25 ± 6% interrupts.CPU69.RES:Rescheduling_interrupts
328.25 ± 9% +40.4% 460.75 ± 11% interrupts.CPU7.RES:Rescheduling_interrupts
289.25 ± 5% +44.3% 417.25 ± 2% interrupts.CPU70.RES:Rescheduling_interrupts
280.25 ± 11% +55.8% 436.75 ± 8% interrupts.CPU71.RES:Rescheduling_interrupts
297.25 ± 4% +53.8% 457.25 ± 7% interrupts.CPU72.RES:Rescheduling_interrupts
276.25 ± 4% +68.3% 465.00 ± 9% interrupts.CPU73.RES:Rescheduling_interrupts
293.50 ± 7% +46.2% 429.00 ± 5% interrupts.CPU74.RES:Rescheduling_interrupts
282.75 ± 7% +53.8% 435.00 ± 8% interrupts.CPU75.RES:Rescheduling_interrupts
288.00 ± 9% +51.6% 436.50 ± 5% interrupts.CPU76.RES:Rescheduling_interrupts
276.25 ± 6% +49.6% 413.25 ± 12% interrupts.CPU77.RES:Rescheduling_interrupts
277.50 ± 3% +65.8% 460.00 ± 12% interrupts.CPU78.RES:Rescheduling_interrupts
304.75 ± 6% +45.8% 444.25 ± 12% interrupts.CPU79.RES:Rescheduling_interrupts
288.50 ± 8% +46.8% 423.50 ± 2% interrupts.CPU8.RES:Rescheduling_interrupts
324.25 ± 13% +42.9% 463.50 ± 19% interrupts.CPU80.RES:Rescheduling_interrupts
298.75 ± 5% +44.8% 432.50 ± 7% interrupts.CPU81.RES:Rescheduling_interrupts
274.75 ± 10% +60.9% 442.00 ± 6% interrupts.CPU83.RES:Rescheduling_interrupts
288.75 ± 11% +59.0% 459.25 ± 20% interrupts.CPU85.RES:Rescheduling_interrupts
278.75 ± 15% +59.6% 445.00 ± 3% interrupts.CPU86.RES:Rescheduling_interrupts
254.50 ± 8% +78.6% 454.50 ± 11% interrupts.CPU87.RES:Rescheduling_interrupts
327.00 ± 14% +35.8% 444.00 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts
34175 ± 2% +24.0% 42384 interrupts.RES:Rescheduling_interrupts
696.00 ± 23% +60.6% 1118 ± 21% interrupts.TLB:TLB_shootdowns
8.75 ± 2% -1.5 7.21 ± 8% perf-profile.calltrace.cycles-pp.__strncat_chk
5.61 -1.2 4.45 ± 7% perf-profile.calltrace.cycles-pp.brk
4.87 -1.0 3.85 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk
4.84 -1.0 3.82 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
4.85 -0.9 3.99 ± 6% perf-profile.calltrace.cycles-pp.__strcat_chk
3.90 -0.8 3.08 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
2.01 -0.4 1.60 ± 6% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
1.55 -0.4 1.19 ± 5% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
1.40 ± 2% -0.3 1.09 ± 6% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64
1.38 ± 2% -0.3 1.08 ± 6% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk
0.81 ± 47% -0.3 0.55 ± 2% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
0.80 ± 4% -0.2 0.60 ± 6% perf-profile.calltrace.cycles-pp.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap
1.07 ± 3% -0.2 0.88 ± 2% perf-profile.calltrace.cycles-pp.expm1
0.77 ± 4% -0.2 0.58 ± 6% perf-profile.calltrace.cycles-pp.flush_tlb_func_common.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu.unmap_region
0.75 ± 4% -0.2 0.57 ± 7% perf-profile.calltrace.cycles-pp.native_flush_tlb_one_user.flush_tlb_func_common.flush_tlb_mm_range.tlb_flush_mmu.tlb_finish_mmu
1.69 ± 2% -0.1 1.60 ± 2% perf-profile.calltrace.cycles-pp.execve
1.67 ± 2% -0.1 1.58 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve
1.67 ± 2% -0.1 1.58 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
1.67 ± 2% -0.1 1.58 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
1.65 ± 2% -0.1 1.57 ± 2% perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
0.68 ± 3% -0.1 0.61 ± 2% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
0.69 ± 3% -0.1 0.64 ± 2% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
1.10 -0.0 1.05 ± 2% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
0.70 ± 5% +0.1 0.76 ± 3% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
0.70 ± 6% +0.1 0.77 ± 4% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.95 ± 3% +0.1 1.07 ± 5% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.95 ± 3% +0.1 1.07 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.95 ± 3% +0.1 1.07 ± 5% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.83 ± 9% +0.1 0.95 ± 6% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.07 ± 7% +0.1 1.21 ± 6% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.83 +0.2 2.02 ± 5% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.71 ± 9% +0.2 2.95 ± 3% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.00 +0.6 0.64 ± 6% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.49 ± 58% +0.8 1.24 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.32 ±101% +0.9 1.22 perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
3.67 ± 9% +1.7 5.34 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.67 ± 10% +1.7 5.37 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
8.76 ± 2% -1.5 7.23 ± 8% perf-profile.children.cycles-pp.__strncat_chk
5.67 -1.2 4.48 ± 7% perf-profile.children.cycles-pp.brk
4.86 -0.9 3.99 ± 6% perf-profile.children.cycles-pp.__strcat_chk
1.07 ± 2% -0.2 0.89 ± 2% perf-profile.children.cycles-pp.expm1
1.69 ± 2% -0.1 1.60 ± 2% perf-profile.children.cycles-pp.execve
0.71 ± 4% -0.1 0.63 ± 7% perf-profile.children.cycles-pp.__xstat64
0.42 ± 2% -0.1 0.35 ± 6% perf-profile.children.cycles-pp.malloc
0.26 ± 8% -0.0 0.21 ± 6% perf-profile.children.cycles-pp.random_r
0.17 ± 9% -0.0 0.13 ± 6% perf-profile.children.cycles-pp.tanh
0.08 ± 14% -0.0 0.04 ± 60% perf-profile.children.cycles-pp.sincos
0.17 ± 4% -0.0 0.14 ± 10% perf-profile.children.cycles-pp.security_mmap_addr
0.13 ± 12% -0.0 0.11 ± 8% perf-profile.children.cycles-pp.__count_memcg_events
0.09 ± 4% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.__ctype_toupper_loc
0.05 +0.0 0.06 perf-profile.children.cycles-pp.ip_make_skb
0.25 ± 4% +0.0 0.28 perf-profile.children.cycles-pp._dl_addr
0.13 ± 5% +0.0 0.15 ± 7% perf-profile.children.cycles-pp.do_wait
0.11 ± 7% +0.0 0.13 ± 8% perf-profile.children.cycles-pp.perf_event_mmap_output
0.15 ± 11% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.__vm_munmap
0.09 ± 8% +0.0 0.12 ± 10% perf-profile.children.cycles-pp.vma_interval_tree_insert
0.04 ± 58% +0.0 0.07 ± 5% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.07 ± 17% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.irq_work_needs_cpu
0.10 ± 15% +0.0 0.14 ± 6% perf-profile.children.cycles-pp.vma_link
0.09 ± 12% +0.0 0.12 ± 8% perf-profile.children.cycles-pp.unlink_file_vma
0.03 ±100% +0.0 0.06 ± 6% perf-profile.children.cycles-pp.__rb_insert_augmented
0.22 ± 8% +0.0 0.26 ± 2% perf-profile.children.cycles-pp.sock_write_iter
0.11 ± 14% +0.0 0.14 ± 5% perf-profile.children.cycles-pp.rcu_idle_exit
0.12 ± 18% +0.0 0.16 ± 7% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.04 ± 59% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.rcu_eqs_exit
0.22 ± 3% +0.0 0.26 ± 4% perf-profile.children.cycles-pp.page_remove_rmap
0.13 ± 17% +0.0 0.17 ± 7% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.27 ± 8% +0.0 0.31 perf-profile.children.cycles-pp.free_pgtables
0.01 ±173% +0.0 0.06 ± 14% perf-profile.children.cycles-pp.__vma_link_rb
0.27 ± 12% +0.1 0.32 ± 5% perf-profile.children.cycles-pp.__split_vma
0.03 ±100% +0.1 0.08 ± 12% perf-profile.children.cycles-pp.do_task_dead
0.05 ± 61% +0.1 0.11 ± 10% perf-profile.children.cycles-pp.rb_insert_color
0.64 ± 4% +0.1 0.70 ± 6% perf-profile.children.cycles-pp.filename_lookup
0.53 ± 2% +0.1 0.59 ± 7% perf-profile.children.cycles-pp.flush_old_exec
0.64 ± 7% +0.1 0.71 ± 6% perf-profile.children.cycles-pp.path_openat
0.38 ± 8% +0.1 0.45 ± 5% perf-profile.children.cycles-pp.ksys_mmap_pgoff
0.08 ± 11% +0.1 0.14 ± 7% perf-profile.children.cycles-pp.newidle_balance
0.10 ± 5% +0.1 0.16 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair
0.54 ± 6% +0.1 0.61 ± 6% perf-profile.children.cycles-pp.link_path_walk
0.65 ± 7% +0.1 0.72 ± 7% perf-profile.children.cycles-pp.do_filp_open
0.12 ± 15% +0.1 0.20 ± 11% perf-profile.children.cycles-pp.update_cfs_group
0.35 ± 4% +0.1 0.43 ± 5% perf-profile.children.cycles-pp.mmap_region
0.21 ± 28% +0.1 0.29 ± 6% perf-profile.children.cycles-pp.timerqueue_add
0.43 ± 4% +0.1 0.52 ± 6% perf-profile.children.cycles-pp.do_mmap
0.24 ± 27% +0.1 0.33 ± 7% perf-profile.children.cycles-pp.enqueue_hrtimer
0.48 ± 3% +0.1 0.57 ± 5% perf-profile.children.cycles-pp.vm_mmap_pgoff
1.15 ± 2% +0.1 1.25 perf-profile.children.cycles-pp.load_elf_binary
1.15 ± 2% +0.1 1.25 perf-profile.children.cycles-pp.search_binary_handler
0.97 ± 3% +0.1 1.09 ± 6% perf-profile.children.cycles-pp.__x64_sys_exit_group
0.97 ± 3% +0.1 1.09 ± 6% perf-profile.children.cycles-pp.do_group_exit
0.96 ± 3% +0.1 1.09 ± 6% perf-profile.children.cycles-pp.do_exit
1.19 ± 3% +0.1 1.32 ± 3% perf-profile.children.cycles-pp.mmput
1.18 ± 4% +0.1 1.32 ± 3% perf-profile.children.cycles-pp.exit_mmap
1.72 ± 3% +0.1 1.86 perf-profile.children.cycles-pp.__do_execve_file
1.74 ± 3% +0.1 1.88 perf-profile.children.cycles-pp.__x64_sys_execve
0.00 +0.1 0.15 ± 15% perf-profile.children.cycles-pp.native_read_msr
0.00 +0.2 0.21 ± 15% perf-profile.children.cycles-pp.arch_scale_freq_tick
1.09 ± 12% +0.2 1.32 perf-profile.children.cycles-pp.scheduler_tick
3.78 ± 7% +0.4 4.15 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
8.68 ± 2% -1.5 7.16 ± 8% perf-profile.self.cycles-pp.__strncat_chk
4.80 -0.8 3.96 ± 6% perf-profile.self.cycles-pp.__strcat_chk
1.06 ± 3% -0.2 0.87 ± 2% perf-profile.self.cycles-pp.expm1
0.40 ± 3% -0.1 0.33 ± 6% perf-profile.self.cycles-pp.malloc
0.41 ± 6% -0.1 0.36 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.23 ± 6% -0.0 0.19 ± 5% perf-profile.self.cycles-pp.random_r
0.18 ± 8% -0.0 0.14 ± 17% perf-profile.self.cycles-pp.free
0.20 ± 9% -0.0 0.16 ± 8% perf-profile.self.cycles-pp.__sinh_finite
0.16 ± 7% -0.0 0.13 ± 6% perf-profile.self.cycles-pp.tanh
0.08 ± 11% -0.0 0.04 ± 60% perf-profile.self.cycles-pp.sincos
0.12 ± 8% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.__count_memcg_events
0.08 ± 15% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.__mod_lruvec_state
0.09 ± 4% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__ctype_toupper_loc
0.08 ± 11% +0.0 0.09 ± 8% perf-profile.self.cycles-pp.perf_event_mmap_output
0.10 ± 11% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.copy_p4d_range
0.25 ± 2% +0.0 0.27 perf-profile.self.cycles-pp._dl_addr
0.08 ± 11% +0.0 0.10 ± 18% perf-profile.self.cycles-pp.free_pages_and_swap_cache
0.09 ± 7% +0.0 0.12 ± 7% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.04 ± 59% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.hrtimer_forward
0.18 +0.0 0.21 ± 5% perf-profile.self.cycles-pp.page_remove_rmap
0.04 ± 57% +0.0 0.07 ± 10% perf-profile.self.cycles-pp.up_read
0.03 ±100% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.05 ± 60% +0.0 0.09 ± 9% perf-profile.self.cycles-pp.irq_work_needs_cpu
0.01 ±173% +0.0 0.06 ± 14% perf-profile.self.cycles-pp.__vma_link_rb
0.48 ± 5% +0.0 0.53 ± 5% perf-profile.self.cycles-pp.unmap_page_range
0.05 ± 61% +0.0 0.10 ± 13% perf-profile.self.cycles-pp.rb_insert_color
0.12 ± 15% +0.1 0.20 ± 11% perf-profile.self.cycles-pp.update_cfs_group
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.00 +0.1 0.14 ± 18% perf-profile.self.cycles-pp.native_read_msr
reaim.time.percent_of_cpu_this_job_got
2685 +-+------------------------------------------------------------------+
| .+..+.+..+.. .+.+.. |
2680 +-+ .+. +.+..+. +.+..+..+.+..+..+. |
2675 +-++.+.. .+ +..+..+ |
| +. |
2670 +-+ |
2665 +-+ |
| |
2660 +-+ |
2655 +-+ O |
| O O |
2650 +-+ O O O O O O O O |
2645 O-+ O O O O O O O O |
| O O O O O O O
2640 +-+------------------------------------------------------------------+
reaim.time.voluntary_context_switches
520000 +-+----------------------------------------------------------------+
| .+.+..+..+.+..+.+..+..+.+..+.+.. |
510000 +-++.+.. .+. +. .+.. .+..+. .+ |
500000 +-+ + +. + +. |
| |
490000 +-+ |
| |
480000 +-+ |
| |
470000 +-+ |
460000 +-+ |
O O O O O O O O O O O |
450000 +-+ O O O O O O |
| O O O O O O O O O O
440000 +-+----------------------------------------------------------------+
reaim.parent_time
1.005 +-+-------------------------------------------------------O---------+
| O O |
1 O-+ O O O O O
| O O O O O O O O O O O O O |
0.995 +-+ O O O |
| O O |
0.99 +-+ |
| |
0.985 +-+ |
| |
0.98 +-++. + + + |
|.. +..+. .. + .+.+..+.. + + +..+..+.+.. .. |
0.975 +-+ + + .+..+..+.+. + + + +..+.+ |
| + + |
0.97 +-+-----------------------------------------------------------------+
reaim.jobs_per_min
550000 +-+----------------------------------------------------------------+
548000 +-+ +.. +.. |
|.. .+.. : +..+.+..+. .+.. : .+.. .+.+..+.+.. |
546000 +-+ .+..+ : +..+..+ : + +. |
544000 +-++ + + + |
| |
542000 +-+ |
540000 +-+ |
538000 +-+ |
| O O O O |
536000 +-+ O O O O |
534000 O-+ O O O O O O O O O O O O O O
| O O O |
532000 +-+ O |
530000 +-+----------------------------------------------------------------+
reaim.jobs_per_min_child
6240 +-+------------------------------------------------------------------+
6220 +-+ + +.. .+.. +.. |
|.. .+.. .. : + + +..+.+.. .+.. + +..+.+..+..+.+..+.. |
6200 +-++ + : + +..+ + |
6180 +-+ + + |
| |
6160 +-+ |
6140 +-+ |
6120 +-+ |
| |
6100 +-+O O O O O |
6080 +-+ O O O O O O O O O |
O O O O O O O O O O
6060 +-+ O O |
6040 +-+-------------------------------------------------------O----------+
reaim.std_dev_percent
2.5 +-+-------------------------------------------------------------------+
| |
2.4 +-+ O O O |
O O O O O O O O O O O O O O O
2.3 +-+O O O O O O O O |
| O |
2.2 +-+ |
| |
2.1 +-+ |
| |
2 +-+ |
| +. .+.. |
1.9 +-++.+..+.. .+.. .+.. .+.. .. +. +..+. .+..+ |
|. + +..+..+.+..+..+.+. + + +. |
1.8 +-+-------------------------------------------------------------------+
reaim.max_jobs_per_min
568000 +-+----------------------------------------------------------------+
566000 +-+: : : : : : : :: |
| : : : : : : : : : : |
564000 +-+ : : : : : : : : : |
562000 +-+ : : : : :: : : : |
| +..+.+ +..+ + +.+..+.+..+..+ +.+..+ |
560000 +-+ |
558000 +-+ |
556000 +-+ |
| O O O O O O O O O O O O O O O |
554000 +-+ |
552000 +-+ |
| |
550000 O-+ O O O O O O O O O O O
548000 +-+----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
2 years, 3 months