[cgroup] a34faa3910: WARNING:at_kernel/cgroup/freezer.c:#cgroup_dec_frozen_cnt
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: a34faa3910a331647b386effe277c5c1e3012592 ("cgroup: cgroup v2 freezer")
https://github.com/rgushchin/linux.git freezer.9
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 1G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------+------------+------------+
| | 8839558790 | a34faa3910 |
+-----------------------------------------------------------+------------+------------+
| boot_successes | 8 | 0 |
| boot_failures | 0 | 6 |
| WARNING:at_kernel/cgroup/freezer.c:#cgroup_dec_frozen_cnt | 0 | 6 |
| RIP:cgroup_dec_frozen_cnt | 0 | 6 |
+-----------------------------------------------------------+------------+------------+
[ 11.018293] WARNING: CPU: 0 PID: 1609 at kernel/cgroup/freezer.c:95 cgroup_dec_frozen_cnt+0x5/0x8
[ 11.028205] Modules linked in:
[ 11.031538] CPU: 0 PID: 1609 Comm: plymouthd Not tainted 5.0.0-rc4-00086-ga34faa3 #1
[ 11.038244] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 11.045218] RIP: 0010:cgroup_dec_frozen_cnt+0x5/0x8
[ 11.049379] Code: 08 08 00 00 e8 a4 17 9e 00 48 8b 44 24 08 65 48 33 04 25 28 00 00 00 74 05 e8 56 31 f7 ff 48 83 c4 10 5b 5d c3 66 66 66 66 90 <0f> 0b c3 66 66 66 66 90 41 54 55 53 48 8b 87 f0 00 00 00 48 89 fb
[ 11.069775] RSP: 0000:ffffc9000117bdf0 EFLAGS: 00010096
[ 11.073838] RAX: ffffffff82477e40 RBX: 0000000000000001 RCX: ffff88802e871dc0
[ 11.078708] RDX: ffffffff824780f0 RSI: 0000000000000000 RDI: ffffffff82bf6044
[ 11.083446] RBP: ffff88802e79e580 R08: 0000000080000001 R09: 0000000000000000
[ 11.088156] R10: ffffc9000027bd48 R11: 0000000000000000 R12: ffffc9000117beb0
[ 11.093382] R13: 0000000000000000 R14: ffff88802e871dc0 R15: ffff88802e79e580
[ 11.098369] FS: 0000000000000000(0000) GS:ffff88802f600000(0063) knlGS:00000000f7cd86c0
[ 11.105584] CS: 0010 DS: 002b ES: 002b CR0: 0000000080050033
[ 11.109823] CR2: 00000000f7f0023c CR3: 000000003ed52000 CR4: 00000000000406f0
[ 11.114602] Call Trace:
[ 11.117421] cgroup_leave_stopped+0x3f/0x83
[ 11.121430] get_signal+0x17f/0x66c
[ 11.124801] ? trace_hardirqs_on_thunk+0x1a/0x1c
[ 11.128917] do_signal+0x36/0x583
[ 11.132291] ? retint_kernel+0x10/0x10
[ 11.135835] ? exit_to_usermode_loop+0x11/0xac
[ 11.139718] exit_to_usermode_loop+0x37/0xac
[ 11.143801] syscall_return_slowpath+0xa1/0xa8
[ 11.147409] ret_from_fork+0x15/0x50
[ 11.150752] RIP: 0023:0xf7f061b2
[ 11.153957] Code: Bad RIP value.
[ 11.157173] RSP: 002b:00000000ffa817ec EFLAGS: 00000286 ORIG_RAX: 0000000000000078
[ 11.163858] RAX: 0000000000000000 RBX: 0000000001200011 RCX: 0000000000000000
[ 11.168894] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000f7cd8728
[ 11.173955] RBP: 00000000ffa81888 R08: 0000000000000000 R09: 0000000000000000
[ 11.179228] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
[ 11.184673] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 11.189954] ---[ end trace 69e90c98e60f2c85 ]---
To reproduce:
# build kernel
cd linux
cp config-5.0.0-rc4-00086-ga34faa3 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
1 year, 7 months
- 1
- 0
06ee97d935 ("perf: Paper over the hw.target problems"): WARNING: CPU: 1 PID: 1302 at kernel/events/core.c:8313 perf_swevent_add
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/0day-ci/linux/commits/UPDATE-20190311-000524/Alexander...
commit 06ee97d935f50d6cd636b90956f143bc4e744c73
Author: Alexander Shishkin <alexander.shishkin(a)linux.intel.com>
AuthorDate: Fri Mar 8 14:38:51 2019 +0200
Commit: 0day robot <lkp(a)intel.com>
CommitDate: Mon Mar 11 00:05:25 2019 +0800
perf: Paper over the hw.target problems
Xie XiuQi <xiexiuqi(a)huawei.com> writes:
> From: Cheng Jian <cj.chengjian(a)huawei.com>
>
> Hi Alexander,
Hi Cheng Jian,
> I have tested this patch and merged into 4.19 stable branch,
> syzkaller reported some new issues(WANRING), the C program
> generated by syzkaller can inevitably reproduce the issue
> (only in patched kernel).
>
> I put the syzkaller log and the manual test log in the attachment.
Thanks a lot for taking the time and providing all the details. Please
find an updated version below, which should not exhibit that warning.
From 1576f66b4311fe81107c3c39c38060178bc89457 Mon Sep 17 00:00:00 2001
From: Alexander Shishkin <alexander.shishkin(a)linux.intel.com>
Date: Thu, 28 Feb 2019 15:24:04 +0200
Subject: [RFC PATCH v1] perf: Paper over the hw.target problems
First, we have a race between perf_event_release_kernel() and
perf_free_event(), which happens when parent's event is released while the
child's fork fails (because of a fatal signal, for example), that looks
like this:
cpu X cpu Y
----- -----
copy_process() error path
perf_release(parent) +->perf_event_free_task()
+-> lock(child_ctx->mutex) | |
+-> remove_from_context(child) | |
+-> unlock(child_ctx->mutex) | |
| | +-> lock(child_ctx->mutex)
| | +-> unlock(child_ctx->mutex)
| +-> free_task(child_task)
+-> put_task_struct(child_task)
Technically, we're still holding a reference to the task via
parent->hw.target, that's not stopping free_task(), so we end up poking at
free'd memory, as is pointed out by KASAN in the syzkaller report (see Link
below). The straightforward fix is to drop the hw.target reference while
the task is still around.
Therein lies the second problem: the users of hw.target (uprobe) assume
that it's around at ->destroy() callback time, where they use it for
context. So, in order to not break the uprobe teardown and avoid leaking
stuff, we need to call ->destroy() at the same time.
This patch fixes the race and the subsequent fallout by doing both these
things at remove_from_context time.
Signed-off-by: Alexander Shishkin <alexander.shishkin(a)linux.intel.com>
Link: https://syzkaller.appspot.com/bug?extid=a24c397a29ad22d86c98
c978b9460f Merge tag 'perf-core-for-mingo-5.1-20190225' of git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux into perf/core
06ee97d935 perf: Paper over the hw.target problems
+---------------------------------------------------------+------------+------------+
| | c978b9460f | 06ee97d935 |
+---------------------------------------------------------+------------+------------+
| boot_successes | 952 | 843 |
| boot_failures | 19 | 34 |
| Mem-Info | 5 | 4 |
| invoked_oom-killer:gfp_mask=0x | 1 | 3 |
| Out_of_memory:Kill_process | 1 | |
| Out_of_memory_and_no_killable_processes | 1 | |
| Kernel_panic-not_syncing:System_is_deadlocked_on_memory | 1 | |
| EIP:page_address | 1 | 2 |
| EIP:_raw_write_unlock_irq | 13 | 24 |
| INFO:rcu_preempt_detected_stalls_on_CPUs/tasks | 6 | 9 |
| EIP:_raw_write_unlock_irqrestore | 7 | 10 |
| BUG:kernel_hang_in_test_stage | 6 | 11 |
| INFO:rcu_preempt_self-detected_stall_on_CPU | 6 | 14 |
| EIP:_raw_spin_lock | 1 | |
| EIP:__slab_free | 1 | 1 |
| EIP:slab_pad_check | 1 | |
| EIP:__d_free | 1 | |
| EIP:kmem_cache_free | 1 | 2 |
| EIP:__do_softirq | 3 | 8 |
| EIP:clocksource_watchdog | 1 | 3 |
| BUG:kernel_timeout_in_test_stage | 4 | 3 |
| WARNING:at_kernel/events/core.c:#perf_swevent_add | 0 | 6 |
| EIP:perf_swevent_add | 0 | 6 |
| EIP:memchr_inv | 0 | 3 |
| EIP:preempt_schedule | 0 | 1 |
| EIP:__free_slab | 0 | 2 |
| EIP:unmap_vmas | 0 | 1 |
| EIP:__free_pages | 0 | 1 |
| EIP:fd_install | 0 | 1 |
| EIP:munlock_vma_pages_range | 0 | 1 |
| EIP:pty_close | 0 | 1 |
| EIP:generic_exec_single | 0 | 5 |
| EIP:follow_page_mask | 0 | 1 |
| EIP:check_object | 0 | 1 |
| EIP:__fdget_pos | 0 | 1 |
| EIP:exit_mmap | 0 | 1 |
| EIP:proc_i_callback | 0 | 1 |
| EIP:preempt_schedule_common | 0 | 1 |
| EIP:check_bytes_and_report | 0 | 1 |
| EIP:__put_cred | 0 | 1 |
| EIP:xas_load | 0 | 1 |
| EIP:preempt_count_add | 0 | 1 |
| EIP:process_timeout | 0 | 1 |
| EIP:free_unref_page_list | 0 | 1 |
+---------------------------------------------------------+------------+------------+
[ 58.480492] futex_wake_op: trinity-c1 tries to shift op by -161; fix this program
[ 58.627062] tty ttyS2: uevent: failed to send synthetic uevent
[ 61.539662] can: request_module (can-proto-2) failed.
[ 74.523956] can: request_module (can-proto-1) failed.
Sending all processes the KILL signal...
[ 92.592340] WARNING: CPU: 1 PID: 1302 at kernel/events/core.c:8313 perf_swevent_add+0xa8/0xc0
[ 92.604827] Modules linked in:
[ 92.608039] CPU: 1 PID: 1302 Comm: trinity-c1 Not tainted 5.0.0-rc8-00252-g06ee97d #1
[ 92.613945] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 92.619508] EIP: perf_swevent_add+0xa8/0xc0
[ 92.622876] Code: 5d c3 8b 83 78 01 00 00 8b 93 7c 01 00 00 89 83 80 01 00 00 89 93 84 01 00 00 89 d8 e8 31 fd ff ff eb 88 8d b4 26 00 00 00 00 <0f> 0b b8 ea ff ff ff 5b 5e 5f 5d c3 8d b6 00 00 00 00 8d bf 00 00
[ 92.637240] EAX: 00000001 EBX: cfa104c0 ECX: 00000007 EDX: 00000001
[ 92.642828] ESI: 00000000 EDI: 00000000 EBP: cf845b34 ESP: cf845b28
[ 92.649579] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010046
[ 92.655469] CR0: 80050033 CR2: 47f7c0d0 CR3: 17f19520 CR4: 001406f0
[ 92.659489] Call Trace:
[ 92.662293] event_sched_in+0x82/0x190
[ 92.666255] ? sched_clock+0x9/0x10
[ 92.669387] group_sched_in+0x49/0x130
[ 92.673274] flexible_sched_in+0x70/0x140
[ 92.679583] ? sched_clock_cpu+0x19/0x130
[ 92.684020] ? pinned_sched_in+0x140/0x140
[ 92.687985] visit_groups_merge+0xe6/0x170
[ 92.692774] ctx_sched_in+0x84/0xf0
[ 92.696305] perf_event_sched_in+0x43/0x70
[ 92.704408] __perf_event_task_sched_in+0x127/0x130
[ 92.710783] finish_task_switch+0x192/0x230
[ 92.716645] __schedule+0x1ba/0x4b0
[ 92.718857] preempt_schedule_irq+0x34/0x60
[ 92.722022] resume_kernel+0x22/0x24
[ 92.727819] EIP: memchr_inv+0xc3/0x150
[ 92.736572] Code: f7 e2 89 c7 89 d0 09 f8 89 c2 89 c8 83 e0 f8 01 d8 89 45 ec 89 f0 8b 75 ec 88 45 eb 89 4d ec 89 d1 8d b6 00 00 00 00 8b 53 04 <8b> 03 31 ca 31 f8 09 c2 75 63 83 c3 08 39 f3 75 ec 8b 4d ec 0f b6
[ 92.774811] EAX: 00000000 EBX: d7ffce80 ECX: 6b6b6b6b EDX: 6b6b6b6b
[ 92.784355] ESI: d7ffcf88 EDI: 6b6b6b6b EBP: cf845cd4 ESP: cf845cbc
[ 92.794470] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00000293
[ 92.807304] ? sys_ptrace+0x46b/0x500
[ 92.815796] check_bytes_and_report+0x1e/0xd0
[ 92.823353] check_object+0x223/0x270
[ 92.866820] __free_slab+0x80/0x2a0
[ 92.874065] discard_slab+0x2d/0x40
[ 92.881517] __slab_free+0x331/0x360
[ 92.889988] kmem_cache_free+0x152/0x180
[ 92.898326] ? kmem_cache_free+0x152/0x180
[ 92.906491] ? __put_task_struct+0x72/0xa0
[ 92.915716] ? __put_task_struct+0x72/0xa0
[ 92.924682] __put_task_struct+0x72/0xa0
[ 92.933920] perf_remove_from_context+0x9d/0xc0
[ 92.944156] perf_event_release_kernel+0xc8/0x2d0
[ 92.954155] ? _raw_spin_unlock+0x8/0x10
[ 92.961122] ? locks_remove_file+0x15e/0x1b0
[ 92.968475] perf_release+0xe/0x20
[ 92.977054] __fput+0xaf/0x1e0
[ 92.983260] ____fput+0x8/0x10
[ 92.989794] task_work_run+0x77/0xa0
[ 92.997169] do_exit+0x2ec/0xaa0
[ 93.005338] ? __schedule+0x1ba/0x4b0
[ 93.013182] ? __might_sleep+0x2e/0x80
[ 93.020337] do_group_exit+0x2a/0x90
[ 93.028950] get_signal+0xde/0x6c0
[ 93.039279] do_signal+0x1f/0x5b0
[ 93.047913] ? hrtimer_nanosleep_restart+0x32/0x40
[ 93.059067] exit_to_usermode_loop+0x88/0xb0
[ 93.072746] do_int80_syscall_32+0xc7/0xd0
[ 93.080183] entry_INT80_32+0xc3/0xc3
[ 93.088351] EIP: 0xb7f87861
[ 93.095093] Code: Bad RIP value.
[ 93.099368] EAX: fffffdfc EBX: 00000001 ECX: 00000000 EDX: b7114000
[ 93.105191] ESI: b7114004 EDI: fffffffb EBP: 00000000 ESP: bfaf60dc
[ 93.110029] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 007b EFLAGS: 00000292
[ 93.114482] ---[ end trace a9ee5eb8bc0b6bde ]---
Unmounting remote filesystems...
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 604b3b6419b4e9f7746a03007564cf837cc76446 1c163f4c7b3f621efff9b28a47abb36f7378d783 --
git bisect bad dbd257345e86dbc0cbc6708f933f7e64646282e2 # 00:07 B 719 1 33 61 Merge 'linux-review/Aditya-Pakki/net-ethernet-Fix-phy_set_max_speed-by-checking-for-NULL/20190305-141621' into devel-hourly-2019031306
git bisect good 86195513f6a45b1a6134347ee7fdb2cca6256bcd # 04:27 G 909 0 91 96 Merge 'anholt/bcm2835-dt-next' into devel-hourly-2019031306
git bisect bad d8fc6b6bb7f85aa8eeb65584fcfddeb0275d623d # 07:48 B 57 1 4 6 Merge 'linux-review/sean-wang-mediatek-com/Bluetooth-mediatek-Fixed-incorrect-type-in-assignment/20190305-114433' into devel-hourly-2019031306
git bisect good c86b94abae78134e042d1a0a8ae60c04b6b99ba1 # 00:26 G 908 0 90 105 Merge 'linux-review/Andrii-Nakryiko/libbpf-handle-BTF-parsing-and-loading-properly/20190309-135944' into devel-hourly-2019031306
git bisect good 1fc85a4dd15ffceda1affc963a94eab244e86f89 # 01:31 G 904 0 46 50 Merge 'linux-review/Tamizh-chelvam/ath-DFS-JP-domain-W56-fixed-pulse-type-3-RADAR-detection/20190308-084725' into devel-hourly-2019031306
git bisect good 7c27e6733dde3d5b9e7a24dde98dbaf7731ca7b5 # 02:34 G 901 0 54 59 Merge 'linux-review/Zhiyong-Tao/pinctrl-add-drive-for-I2C-related-pins-on-MT8183/20190303-191833' into devel-hourly-2019031306
git bisect bad 16b6fc214f909eeeb15f45c727836ba7d9dbc1ee # 03:33 B 98 1 1 1 Merge 'linux-review/Tony-Lindgren/clk-ti-clkctrl-Fix-clkdm_name-regression-for-TI_CLK_CLKCTRL_COMPAT/20190308-131000' into devel-hourly-2019031306
git bisect good d51280977159e8d14cc883221f657e3de9acb50e # 04:32 G 900 0 39 41 Merge 'linux-review/Kangjie-Lu/net-spi-fix-a-potential-NULL-pointer-dereference/20190311-062215' into devel-hourly-2019031306
git bisect bad c29456dee7ca46ba0ec17c86eb06ac152b91e748 # 05:12 B 250 1 14 14 Merge 'linux-review/UPDATE-20190311-000524/Alexander-Shishkin/perf-Paper-over-the-hw-target-problems/20190301-093808' into devel-hourly-2019031306
git bisect bad 06ee97d935f50d6cd636b90956f143bc4e744c73 # 05:50 B 137 1 5 5 perf: Paper over the hw.target problems
# first bad commit: [06ee97d935f50d6cd636b90956f143bc4e744c73] perf: Paper over the hw.target problems
git bisect good c978b9460fe1d4a1e1effa0abd6bd69b18a098a8 # 06:41 G 1000 0 50 50 Merge tag 'perf-core-for-mingo-5.1-20190225' of git://git.kernel.org/pub/scm/linux/kernel/git/acme/linux into perf/core
# extra tests with debug options
git bisect bad 06ee97d935f50d6cd636b90956f143bc4e744c73 # 07:09 B 61 1 1 1 perf: Paper over the hw.target problems
# extra tests on HEAD of linux-devel/devel-hourly-2019031306
git bisect bad 604b3b6419b4e9f7746a03007564cf837cc76446 # 07:09 B 70 2 0 14 0day head guard for 'devel-hourly-2019031306'
# extra tests on tree/branch linux-review/UPDATE-20190311-000524/Alexander-Shishkin/perf-Paper-over-the-hw-target-problems/20190301-093808
git bisect bad 06ee97d935f50d6cd636b90956f143bc4e744c73 # 07:12 B 841 6 0 63 perf: Paper over the hw.target problems
# extra tests with first bad commit reverted
git bisect good c7beb69d127f4b99eb2416e55869aad28c47c2f9 # 08:01 G 901 0 52 52 Revert "perf: Paper over the hw.target problems"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
1 year, 7 months
- 1
- 0
[x86, retpolines] ce02ef06fc: will-it-scale.per_thread_ops 3.1% improvement
by kernel test robot
Greeting,
FYI, we noticed a 3.1% improvement of will-it-scale.per_thread_ops due to commit:
commit: ce02ef06fcf7a399a6276adb83f37373d10cbbe1 ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
with following parameters:
nr_task: 100%
mode: thread
test: futex3
cpufreq_governor: performance
ucode: 0xb00002e
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 4.3% improvement |
| test machine | 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=50% |
| | test=futex3 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 2.5% improvement |
| test machine | 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=50% |
| | test=futex1 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 5.8% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=50% |
| | test=futex3 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 2.6% improvement |
| test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory |
| test parameters | cpufreq_governor=performance |
| | test=futex1 |
| | ucode=0xb00002e |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops 2.5% improvement |
| test machine | 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=50% |
| | test=futex2 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_thread_ops 3.1% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | mode=thread |
| | nr_task=50% |
| | test=futex4 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_thread_ops 5.4% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | mode=thread |
| | nr_task=16 |
| | test=futex3 |
+------------------+---------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_thread_ops 3.0% improvement |
| test machine | 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory |
| test parameters | cpufreq_governor=performance |
| | mode=thread |
| | nr_task=16 |
| | test=futex4 |
+------------------+---------------------------------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-8/performance/x86_64-rhel-7.6/thread/100%/debian-x86_64-2018-04-03.cgz/lkp-bdw-ep3b/futex3/will-it-scale/0xb00002e
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
2879155 +3.1% 2967432 will-it-scale.per_thread_ops
17102 -4.3% 16361 ± 4% will-it-scale.time.system_time
9373 +7.9% 10115 ± 6% will-it-scale.time.user_time
2.534e+08 +3.1% 2.611e+08 will-it-scale.workload
342984 ± 3% -17.5% 283080 ± 9% meminfo.DirectMap4k
731997 ± 3% +8.0% 790813 ± 3% numa-vmstat.node1.numa_hit
542485 ± 4% +9.1% 591663 ± 6% numa-vmstat.node1.numa_local
71365 ± 26% -61.7% 27347 ±103% turbostat.C3
93437 ± 8% +89.5% 177023 ± 62% turbostat.C6
64.00 -5.5% 60.50 ± 4% vmstat.cpu.sy
34.00 +10.3% 37.50 ± 6% vmstat.cpu.us
1102 -4.2% 1055 vmstat.system.cs
73.25 ± 35% +498.0% 438.00 ± 42% interrupts.CPU1.RES:Rescheduling_interrupts
14.00 ± 56% +937.5% 145.25 ± 96% interrupts.CPU44.RES:Rescheduling_interrupts
34.50 ± 36% +5674.6% 1992 ±152% interrupts.CPU71.RES:Rescheduling_interrupts
39.50 ± 27% +1055.1% 456.25 ± 86% interrupts.CPU81.RES:Rescheduling_interrupts
30470003 ± 26% -65.9% 10405023 ±132% cpuidle.C3.time
71763 ± 26% -61.2% 27879 ±100% cpuidle.C3.usage
101566 ± 7% +84.3% 187224 ± 59% cpuidle.C6.usage
3666 ± 9% +261.9% 13269 ±105% cpuidle.POLL.time
2069 ± 11% +60.3% 3317 ± 21% cpuidle.POLL.usage
20.55 -2.5 18.10 perf-profile.calltrace.cycles-pp.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
26.37 -1.9 24.46 perf-profile.calltrace.cycles-pp.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
34.04 -1.4 32.68 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
32.05 -0.9 31.17 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.66 +0.2 2.84 perf-profile.calltrace.cycles-pp.get_futex_key_refs.get_futex_key.futex_wake.do_futex.__x64_sys_futex
6.21 +0.5 6.68 perf-profile.calltrace.cycles-pp.get_futex_key.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
13.85 +0.7 14.59 perf-profile.calltrace.cycles-pp.futex_wake.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
30.81 +0.9 31.76 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
28.95 +1.0 29.94 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
25620 ± 3% +178.3% 71307 ±105% sched_debug.cfs_rq:/.load.max
28.67 ± 12% +36.0% 38.98 ± 7% sched_debug.cfs_rq:/.load_avg.stddev
1.90 ± 70% +127.6% 4.32 ± 36% sched_debug.cfs_rq:/.removed.load_avg.avg
15.09 ± 60% +73.2% 26.14 ± 19% sched_debug.cfs_rq:/.removed.load_avg.stddev
87.67 ± 70% +127.5% 199.49 ± 36% sched_debug.cfs_rq:/.removed.runnable_sum.avg
696.69 ± 60% +73.1% 1205 ± 19% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
8.26 ± 6% -41.2% 4.86 ± 25% sched_debug.cpu.clock.stddev
8.26 ± 6% -41.2% 4.86 ± 25% sched_debug.cpu.clock_task.stddev
25549 ± 3% +13.0% 28872 ± 7% sched_debug.cpu.load.max
2572 ± 2% -7.0% 2391 ± 2% sched_debug.cpu.nr_switches.stddev
0.04 ± 8% +186.1% 0.11 ±105% perf-stat.i.MPKI
1.728e+10 +4.5% 1.806e+10 perf-stat.i.branch-instructions
2.95 -1.5 1.47 perf-stat.i.branch-miss-rate%
5.093e+08 -48.1% 2.641e+08 perf-stat.i.branch-misses
4.46 ± 4% -0.7 3.74 ± 6% perf-stat.i.cache-miss-rate%
1071 -4.3% 1025 perf-stat.i.context-switches
2.04 -3.1% 1.98 perf-stat.i.cpi
0.00 ± 3% +0.0 0.00 ± 91% perf-stat.i.dTLB-load-miss-rate%
122225 ± 3% +64.5% 201098 ± 4% perf-stat.i.dTLB-load-misses
3.044e+10 +1.3% 3.083e+10 perf-stat.i.dTLB-loads
1.195e+11 +3.4% 1.236e+11 perf-stat.i.instructions
0.49 +3.4% 0.51 perf-stat.i.ipc
2.95 -1.5 1.46 perf-stat.overall.branch-miss-rate%
4.36 ± 3% -0.7 3.65 ± 6% perf-stat.overall.cache-miss-rate%
2.04 -3.4% 1.97 perf-stat.overall.cpi
0.00 ± 3% +0.0 0.00 ± 4% perf-stat.overall.dTLB-load-miss-rate%
0.49 +3.5% 0.51 perf-stat.overall.ipc
1.722e+10 +4.5% 1.8e+10 perf-stat.ps.branch-instructions
5.076e+08 -48.1% 2.632e+08 perf-stat.ps.branch-misses
1068 -4.3% 1022 perf-stat.ps.context-switches
121934 ± 3% +64.5% 200584 ± 4% perf-stat.ps.dTLB-load-misses
3.034e+10 +1.3% 3.072e+10 perf-stat.ps.dTLB-loads
1.191e+11 +3.4% 1.232e+11 perf-stat.ps.instructions
3.597e+13 +3.6% 3.726e+13 perf-stat.total.instructions
27179 ± 3% -10.4% 24364 ± 4% softirqs.CPU0.RCU
26245 ± 3% -7.7% 24218 ± 2% softirqs.CPU1.RCU
99697 ± 4% +14.1% 113712 ± 12% softirqs.CPU22.TIMER
95660 ± 3% +9.2% 104482 ± 6% softirqs.CPU23.TIMER
95210 ± 2% +11.2% 105917 ± 7% softirqs.CPU24.TIMER
95588 ± 3% +14.8% 109761 ± 15% softirqs.CPU26.TIMER
95590 ± 3% +8.7% 103931 ± 6% softirqs.CPU27.TIMER
95292 ± 3% +9.8% 104606 ± 7% softirqs.CPU28.TIMER
29507 ± 4% -10.1% 26537 ± 4% softirqs.CPU30.RCU
95494 ± 2% +13.6% 108483 ± 14% softirqs.CPU30.TIMER
95431 ± 3% +7.3% 102396 ± 5% softirqs.CPU31.TIMER
95509 ± 2% +9.2% 104339 ± 7% softirqs.CPU32.TIMER
31809 ± 12% -18.3% 25999 ± 7% softirqs.CPU34.RCU
30307 ± 7% -10.2% 27211 ± 5% softirqs.CPU36.RCU
30101 ± 2% -10.1% 27065 ± 4% softirqs.CPU37.RCU
32484 ± 13% -16.7% 27065 ± 5% softirqs.CPU38.RCU
28942 ± 4% -22.8% 22330 ± 11% softirqs.CPU43.RCU
29357 ± 11% -16.5% 24505 ± 3% softirqs.CPU53.RCU
27787 ± 2% -12.8% 24225 ± 4% softirqs.CPU55.RCU
26839 ± 6% +25.9% 33785 ± 11% softirqs.CPU56.RCU
27853 ± 5% -9.1% 25319 ± 6% softirqs.CPU59.RCU
23808 ± 6% -11.5% 21068 ± 6% softirqs.CPU61.RCU
23696 ± 3% -11.1% 21065 ± 11% softirqs.CPU63.RCU
94741 ± 2% +14.8% 108720 ± 13% softirqs.CPU66.TIMER
95004 ± 3% +8.4% 102943 ± 6% softirqs.CPU67.TIMER
94691 ± 3% +12.2% 106209 ± 7% softirqs.CPU68.TIMER
95364 ± 3% +15.0% 109629 ± 16% softirqs.CPU70.TIMER
95723 ± 4% +8.6% 103936 ± 7% softirqs.CPU71.TIMER
95124 ± 3% +10.6% 105166 ± 7% softirqs.CPU72.TIMER
95167 ± 2% +14.1% 108618 ± 14% softirqs.CPU74.TIMER
95123 ± 3% +8.1% 102817 ± 5% softirqs.CPU75.TIMER
25308 ± 20% -17.3% 20941 ± 4% softirqs.CPU85.RCU
23201 ± 4% -10.0% 20876 softirqs.CPU87.RCU
will-it-scale.workload
2.66e+08 +-+--O-O----------------------------------------O----------------+
2.64e+08 O-OO OO O O OO O O O |
| O OO O O O O OO O OO O OO O |
2.62e+08 +-+ OO O OO O
2.6e+08 +-+ O O |
| |
2.58e+08 +-+ |
2.56e+08 +-+ |
2.54e+08 +-+ +. |
| ++ : +.+. |
2.52e+08 +-+ : : : + |
2.5e+08 +-+ : : +.+.++. .+ |
|.++.+.+. +.+.+.++.+.++.+.+ +.+ +. .+ .+ |
2.48e+08 +-+ ++.+.+ + + |
2.46e+08 +-+--------------------------------------------------------------+
will-it-scale.time.user_time
11500 +-+-----------------------------------------------------------------+
| O O |
| |
11000 +-+ |
| |
| |
10500 +-+ |
| |
10000 +-+ |
| O O O O |
O O O O O OO O O OO O O O OO O O O OO O O O O O OO O O OO O
9500 +-+ |
|.+.++. .+.+.++. .+.+.++. .+.+.++.+.+.+.++.+.+.++.+.+.+.++ |
| +.+.+.++ + + |
9000 +-+-----------------------------------------------------------------+
will-it-scale.time.system_time
17500 +-+-----------------------------------------------------------------+
| .+.+.++. |
|.+.++.+ +.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.+.++.+.+.+.++ |
17000 +-+ |
| O OO O O OO O O O OO O O O OO O O O O O OO O O OO O
O O O O O O O O |
16500 +-+ |
| |
16000 +-+ |
| |
| |
15500 +-+ |
| |
| O O |
15000 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-skl-2sp5: 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03.cgz/lkp-skl-2sp5/futex3/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
%stddev %change %stddev
\ | \
2735813 +4.3% 2852635 will-it-scale.per_process_ops
1.532e+08 +4.3% 1.597e+08 will-it-scale.workload
0.00 ± 5% -0.0 0.00 ±146% mpstat.cpu.-1.iowait%
3.125e+09 ±167% +221.3% 1.004e+10 ± 61% cpuidle.C6.time
3890771 ±168% +200.8% 11703776 ± 56% cpuidle.C6.usage
3870516 ±168% +201.8% 11681235 ± 56% turbostat.C6
9.20 ±167% +20.4 29.59 ± 61% turbostat.C6%
16963 -11.4% 15029 ± 6% numa-meminfo.node0.Mapped
39861 ± 48% -31.9% 27147 ± 49% numa-meminfo.node0.Shmem
7374 ± 4% +12.0% 8258 ± 8% numa-meminfo.node1.KernelStack
578.25 ± 6% -11.2% 513.50 sched_debug.cfs_rq:/.util_est_enqueued.max
5.54 ± 3% -17.4% 4.58 ± 2% sched_debug.cpu.clock.stddev
5.54 ± 3% -17.4% 4.58 ± 2% sched_debug.cpu.clock_task.stddev
22.21 ± 16% -50.5% 11.00 ± 14% sched_debug.cpu.nr_uninterruptible.max
5.85 ± 15% -32.3% 3.96 ± 10% sched_debug.cpu.nr_uninterruptible.stddev
4327 -11.7% 3821 ± 7% numa-vmstat.node0.nr_mapped
9956 ± 48% -31.9% 6782 ± 49% numa-vmstat.node0.nr_shmem
13.00 ±173% +830.8% 121.00 ± 61% numa-vmstat.node1.nr_active_file
11.00 ±173% +2050.0% 236.50 ± 94% numa-vmstat.node1.nr_dirtied
7375 ± 4% +12.0% 8260 ± 8% numa-vmstat.node1.nr_kernel_stack
9.75 ±173% +2300.0% 234.00 ± 95% numa-vmstat.node1.nr_written
13.00 ±173% +830.8% 121.00 ± 61% numa-vmstat.node1.nr_zone_active_file
44.34 ± 10% -8.2 36.17 ± 11% perf-profile.calltrace.cycles-pp.secondary_startup_64
43.59 ± 10% -8.1 35.52 ± 11% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
43.59 ± 10% -8.1 35.52 ± 11% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
43.59 ± 10% -8.1 35.52 ± 11% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
43.48 ± 10% -8.1 35.42 ± 11% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
43.30 ± 10% -8.0 35.30 ± 11% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
1.44 ± 7% +0.2 1.69 ± 6% perf-profile.calltrace.cycles-pp.hash_futex.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
1.64 ± 7% +0.4 2.07 ± 7% perf-profile.calltrace.cycles-pp.get_futex_key_refs.get_futex_key.futex_wake.do_futex.__x64_sys_futex
3.12 ± 8% +0.7 3.86 ± 6% perf-profile.calltrace.cycles-pp.get_futex_key.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
6.78 ± 8% +1.0 7.80 ± 6% perf-profile.calltrace.cycles-pp.futex_wake.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
16.75 ± 7% +3.3 20.04 ± 6% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
19.34 ± 8% +3.8 23.12 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
6256 -38.7% 3832 ± 35% interrupts.CPU102.NMI:Non-maskable_interrupts
6256 -38.7% 3832 ± 35% interrupts.CPU102.PMI:Performance_monitoring_interrupts
101.25 ± 89% -85.2% 15.00 ±118% interrupts.CPU11.RES:Rescheduling_interrupts
13.00 ± 93% +41876.9% 5457 ±161% interrupts.CPU20.RES:Rescheduling_interrupts
590.75 ±111% -90.6% 55.50 ±110% interrupts.CPU29.RES:Rescheduling_interrupts
4676 ± 22% -42.3% 2697 ± 29% interrupts.CPU36.NMI:Non-maskable_interrupts
4676 ± 22% -42.3% 2697 ± 29% interrupts.CPU36.PMI:Performance_monitoring_interrupts
1338 ±166% -99.6% 5.25 ± 97% interrupts.CPU37.RES:Rescheduling_interrupts
4690 ± 22% -41.8% 2730 ± 30% interrupts.CPU39.NMI:Non-maskable_interrupts
4690 ± 22% -41.8% 2730 ± 30% interrupts.CPU39.PMI:Performance_monitoring_interrupts
4696 ± 22% -42.3% 2711 ± 29% interrupts.CPU47.NMI:Non-maskable_interrupts
4696 ± 22% -42.3% 2711 ± 29% interrupts.CPU47.PMI:Performance_monitoring_interrupts
4702 ± 22% -42.7% 2693 ± 28% interrupts.CPU49.NMI:Non-maskable_interrupts
4702 ± 22% -42.7% 2693 ± 28% interrupts.CPU49.PMI:Performance_monitoring_interrupts
1.058e+10 +5.6% 1.118e+10 perf-stat.i.branch-instructions
2.95 -1.5 1.48 perf-stat.i.branch-miss-rate%
3.123e+08 -46.9% 1.657e+08 perf-stat.i.branch-misses
4839609 +8.3% 5241207 perf-stat.i.cache-references
1.70 -4.4% 1.62 perf-stat.i.cpi
1.394e+08 ± 7% +16.6% 1.626e+08 ± 3% perf-stat.i.iTLB-load-misses
7.293e+10 +4.6% 7.629e+10 perf-stat.i.instructions
525.91 ± 6% -10.6% 469.98 ± 3% perf-stat.i.instructions-per-iTLB-miss
0.59 +4.7% 0.62 perf-stat.i.ipc
0.07 +3.6% 0.07 perf-stat.overall.MPKI
2.95 -1.5 1.48 perf-stat.overall.branch-miss-rate%
1.70 -4.4% 1.62 perf-stat.overall.cpi
525.68 ± 6% -10.6% 469.79 ± 3% perf-stat.overall.instructions-per-iTLB-miss
0.59 +4.7% 0.62 perf-stat.overall.ipc
1.054e+10 +5.6% 1.114e+10 perf-stat.ps.branch-instructions
3.112e+08 -46.9% 1.652e+08 perf-stat.ps.branch-misses
4829390 +8.3% 5231132 perf-stat.ps.cache-references
1.39e+08 ± 7% +16.6% 1.62e+08 ± 3% perf-stat.ps.iTLB-load-misses
7.268e+10 +4.6% 7.603e+10 perf-stat.ps.instructions
2.194e+13 +4.5% 2.293e+13 perf-stat.total.instructions
87108 ± 4% +7.0% 93168 ± 4% softirqs.CPU100.TIMER
87250 ± 4% +7.0% 93347 ± 4% softirqs.CPU101.TIMER
87532 ± 4% +7.1% 93724 ± 3% softirqs.CPU103.TIMER
87157 ± 4% +7.4% 93568 ± 3% softirqs.CPU104.TIMER
87006 ± 3% +8.0% 93944 ± 3% softirqs.CPU105.TIMER
87194 ± 4% +8.0% 94175 ± 3% softirqs.CPU106.TIMER
87091 ± 4% +7.2% 93323 ± 4% softirqs.CPU107.TIMER
87273 ± 4% +6.9% 93328 ± 3% softirqs.CPU109.TIMER
87091 ± 4% +15.1% 100221 ± 14% softirqs.CPU110.TIMER
87820 ± 4% +6.9% 93881 ± 4% softirqs.CPU56.TIMER
87539 ± 2% +5.8% 92644 ± 4% softirqs.CPU57.TIMER
87788 ± 4% +7.2% 94067 ± 5% softirqs.CPU60.TIMER
87845 ± 4% +6.7% 93725 ± 5% softirqs.CPU61.TIMER
87755 ± 4% +23.3% 108227 ± 26% softirqs.CPU62.TIMER
87710 ± 3% +7.0% 93811 ± 5% softirqs.CPU63.TIMER
87524 ± 4% +10.8% 97017 ± 4% softirqs.CPU65.TIMER
88028 ± 4% +6.8% 94003 ± 5% softirqs.CPU66.TIMER
87694 ± 4% +7.0% 93871 ± 5% softirqs.CPU67.TIMER
87750 ± 4% +7.0% 93888 ± 4% softirqs.CPU68.TIMER
8299 ±108% -64.7% 2925 ± 2% softirqs.CPU69.SCHED
87688 ± 4% +6.8% 93630 ± 5% softirqs.CPU71.TIMER
87272 ± 4% +11.2% 97026 ± 5% softirqs.CPU72.TIMER
87384 ± 4% +10.8% 96860 ± 4% softirqs.CPU75.TIMER
87742 ± 4% +6.7% 93629 ± 5% softirqs.CPU76.TIMER
87454 ± 4% +6.8% 93425 ± 5% softirqs.CPU77.TIMER
87407 ± 4% +7.7% 94142 ± 5% softirqs.CPU78.TIMER
88299 ± 4% +6.2% 93751 ± 5% softirqs.CPU79.TIMER
11503 ±126% -75.0% 2870 ± 2% softirqs.CPU80.SCHED
88007 ± 4% +5.9% 93173 ± 5% softirqs.CPU81.TIMER
87710 ± 4% +6.5% 93386 ± 5% softirqs.CPU82.TIMER
87681 ± 3% +6.7% 93587 ± 5% softirqs.CPU83.TIMER
87235 ± 4% +10.1% 96031 ± 3% softirqs.CPU85.TIMER
87644 ± 4% +7.9% 94599 ± 2% softirqs.CPU87.TIMER
88170 ± 4% +8.2% 95367 ± 2% softirqs.CPU88.TIMER
87392 ± 4% +7.5% 93982 ± 3% softirqs.CPU89.TIMER
87811 ± 4% +7.1% 94080 ± 3% softirqs.CPU90.TIMER
87043 ± 4% +10.4% 96088 ± 4% softirqs.CPU91.TIMER
86998 ± 4% +7.4% 93467 ± 4% softirqs.CPU92.TIMER
87124 ± 4% +7.3% 93481 ± 4% softirqs.CPU93.TIMER
87072 ± 4% +7.3% 93388 ± 3% softirqs.CPU94.TIMER
87099 ± 4% +6.8% 93051 ± 4% softirqs.CPU95.TIMER
86845 ± 4% +6.6% 92604 ± 5% softirqs.CPU96.TIMER
87200 ± 4% +7.3% 93598 ± 3% softirqs.CPU97.TIMER
87953 ± 4% +6.0% 93269 ± 4% softirqs.CPU98.TIMER
87211 ± 4% +6.9% 93271 ± 4% softirqs.CPU99.TIMER
***************************************************************************************************
lkp-skl-2sp5: 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03.cgz/lkp-skl-2sp5/futex1/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
%stddev %change %stddev
\ | \
2117652 +2.5% 2170754 will-it-scale.per_process_ops
1.186e+08 +2.5% 1.216e+08 will-it-scale.workload
472944 ± 3% -8.8% 431109 ± 2% meminfo.Committed_AS
5506 ±169% +228.9% 18112 ± 34% numa-numastat.node0.other_node
70481 -1.7% 69272 proc-vmstat.nr_active_anon
70481 -1.7% 69272 proc-vmstat.nr_zone_active_anon
13912 ± 8% -10.8% 12404 ± 5% proc-vmstat.pgactivate
109265 ± 20% +35.4% 147962 ± 14% numa-meminfo.node0.AnonPages
45308 ± 31% -43.2% 25756 ± 47% numa-meminfo.node0.Shmem
95438 ± 13% -33.0% 63947 ± 35% numa-meminfo.node1.AnonHugePages
134950 ± 16% -29.2% 95525 ± 22% numa-meminfo.node1.AnonPages
27320 ± 20% +35.4% 36992 ± 14% numa-vmstat.node0.nr_anon_pages
11332 ± 32% -43.2% 6435 ± 47% numa-vmstat.node0.nr_shmem
33731 ± 16% -29.2% 23886 ± 22% numa-vmstat.node1.nr_anon_pages
207313 ± 4% -6.1% 194680 ± 3% numa-vmstat.node1.numa_other
714.00 ± 4% -17.6% 588.00 ± 5% slabinfo.mnt_cache.active_objs
714.00 ± 4% -17.6% 588.00 ± 5% slabinfo.mnt_cache.num_objs
7378 ± 2% -9.8% 6652 slabinfo.shmem_inode_cache.active_objs
7378 ± 2% -9.8% 6652 slabinfo.shmem_inode_cache.num_objs
4614486 ± 43% -49.5% 2332387 ± 10% sched_debug.cpu.avg_idle.max
398823 ± 42% -49.3% 202390 ± 12% sched_debug.cpu.avg_idle.stddev
5.52 ± 3% -17.9% 4.53 ± 3% sched_debug.cpu.clock.stddev
5.52 ± 3% -17.9% 4.53 ± 3% sched_debug.cpu.clock_task.stddev
0.00 ± 43% -32.2% 0.00 ± 2% sched_debug.cpu.next_balance.stddev
88789 ± 4% +14.2% 101399 ± 14% softirqs.CPU100.TIMER
21774 ± 10% +24.5% 27109 ± 13% softirqs.CPU18.RCU
99823 ± 2% +11.4% 111178 ± 10% softirqs.CPU18.TIMER
24198 ± 11% +17.6% 28451 ± 14% softirqs.CPU19.RCU
21333 ± 11% +30.0% 27729 ± 12% softirqs.CPU26.RCU
98344 ± 2% +13.5% 111624 ± 10% softirqs.CPU26.TIMER
102128 ± 4% +9.4% 111696 ± 11% softirqs.CPU34.TIMER
98109 +13.0% 110860 ± 11% softirqs.CPU37.TIMER
2890 ± 4% +303.7% 11667 ±126% softirqs.CPU59.SCHED
88353 ± 3% +8.8% 96087 ± 10% softirqs.CPU59.TIMER
16819 ± 8% +20.5% 20274 ± 11% softirqs.CPU6.RCU
29308 ± 52% +44.4% 42332 ± 4% softirqs.CPU6.SCHED
88560 ± 3% +27.9% 113276 ± 27% softirqs.CPU83.TIMER
88853 ± 4% +13.7% 101031 ± 15% softirqs.CPU94.TIMER
88666 ± 4% +4.9% 92996 ± 5% softirqs.CPU96.TIMER
1.52e+10 +3.4% 1.571e+10 perf-stat.i.branch-instructions
1.61 -0.8 0.81 perf-stat.i.branch-miss-rate%
2.427e+08 -47.4% 1.277e+08 perf-stat.i.branch-misses
494521 ± 3% +7.5% 531576 ± 2% perf-stat.i.cache-misses
4861656 ± 4% +6.1% 5157364 ± 3% perf-stat.i.cache-references
1.20 -3.1% 1.16 perf-stat.i.cpi
27.28 ± 3% -5.6% 25.76 ± 3% perf-stat.i.cpu-migrations
271004 ± 3% -7.6% 250275 ± 2% perf-stat.i.cycles-between-cache-misses
0.00 ±130% -0.0 0.00 ± 7% perf-stat.i.dTLB-load-miss-rate%
69139 ± 8% -39.5% 41823 ± 2% perf-stat.i.dTLB-load-misses
2.427e+10 +4.6% 2.539e+10 ± 3% perf-stat.i.dTLB-loads
1.037e+11 +2.8% 1.066e+11 perf-stat.i.instructions
0.84 +2.8% 0.86 perf-stat.i.ipc
95449 ± 2% +10.2% 105213 ± 4% perf-stat.i.node-load-misses
1.60 -0.8 0.81 perf-stat.overall.branch-miss-rate%
1.19 -2.6% 1.16 perf-stat.overall.cpi
249918 ± 3% -6.9% 232651 ± 2% perf-stat.overall.cycles-between-cache-misses
0.00 ± 9% -0.0 0.00 ± 4% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 2% -0.0 0.00 ± 3% perf-stat.overall.dTLB-store-miss-rate%
0.84 +2.7% 0.86 perf-stat.overall.ipc
83.36 +2.3 85.61 perf-stat.overall.node-load-miss-rate%
1.515e+10 +3.4% 1.566e+10 perf-stat.ps.branch-instructions
2.419e+08 -47.4% 1.273e+08 perf-stat.ps.branch-misses
493395 ± 3% +7.5% 530214 ± 2% perf-stat.ps.cache-misses
4852831 ± 4% +6.0% 5145509 ± 3% perf-stat.ps.cache-references
27.21 ± 3% -5.6% 25.69 ± 3% perf-stat.ps.cpu-migrations
69088 ± 8% -39.5% 41817 ± 2% perf-stat.ps.dTLB-load-misses
2.419e+10 +4.6% 2.53e+10 ± 3% perf-stat.ps.dTLB-loads
1.033e+11 +2.8% 1.062e+11 perf-stat.ps.instructions
95170 ± 2% +10.2% 104903 ± 4% perf-stat.ps.node-load-misses
3.122e+13 +2.6% 3.204e+13 perf-stat.total.instructions
179.50 ± 9% +33.4% 239.50 ± 6% interrupts.71:PCI-MSI.12589060-edge.eth3-TxRx-3
6526 ±165% -99.9% 7.00 ± 74% interrupts.CPU27.RES:Rescheduling_interrupts
2870 +25.2% 3594 ± 24% interrupts.CPU32.NMI:Non-maskable_interrupts
2870 +25.2% 3594 ± 24% interrupts.CPU32.PMI:Performance_monitoring_interrupts
2872 +25.6% 3607 ± 24% interrupts.CPU34.NMI:Non-maskable_interrupts
2872 +25.6% 3607 ± 24% interrupts.CPU34.PMI:Performance_monitoring_interrupts
2930 ± 3% +46.6% 4295 ± 32% interrupts.CPU35.NMI:Non-maskable_interrupts
2930 ± 3% +46.6% 4295 ± 32% interrupts.CPU35.PMI:Performance_monitoring_interrupts
2877 +24.9% 3593 ± 24% interrupts.CPU36.NMI:Non-maskable_interrupts
2877 +24.9% 3593 ± 24% interrupts.CPU36.PMI:Performance_monitoring_interrupts
2871 +64.6% 4727 ± 32% interrupts.CPU38.NMI:Non-maskable_interrupts
2871 +64.6% 4727 ± 32% interrupts.CPU38.PMI:Performance_monitoring_interrupts
2871 +52.1% 4367 ± 30% interrupts.CPU40.NMI:Non-maskable_interrupts
2871 +52.1% 4367 ± 30% interrupts.CPU40.PMI:Performance_monitoring_interrupts
2872 +23.9% 3560 ± 24% interrupts.CPU41.NMI:Non-maskable_interrupts
2872 +23.9% 3560 ± 24% interrupts.CPU41.PMI:Performance_monitoring_interrupts
12.25 ± 94% +5675.5% 707.50 ±110% interrupts.CPU42.RES:Rescheduling_interrupts
2875 +37.4% 3951 ± 34% interrupts.CPU44.NMI:Non-maskable_interrupts
2875 +37.4% 3951 ± 34% interrupts.CPU44.PMI:Performance_monitoring_interrupts
6196 -49.8% 3112 interrupts.CPU66.NMI:Non-maskable_interrupts
6196 -49.8% 3112 interrupts.CPU66.PMI:Performance_monitoring_interrupts
6223 -49.9% 3118 interrupts.CPU67.NMI:Non-maskable_interrupts
6223 -49.9% 3118 interrupts.CPU67.PMI:Performance_monitoring_interrupts
179.50 ± 9% +33.4% 239.50 ± 6% interrupts.CPU68.71:PCI-MSI.12589060-edge.eth3-TxRx-3
6225 -50.1% 3108 interrupts.CPU68.NMI:Non-maskable_interrupts
6225 -50.1% 3108 interrupts.CPU68.PMI:Performance_monitoring_interrupts
6198 -50.0% 3098 interrupts.CPU69.NMI:Non-maskable_interrupts
6198 -50.0% 3098 interrupts.CPU69.PMI:Performance_monitoring_interrupts
6193 -49.6% 3118 interrupts.CPU70.NMI:Non-maskable_interrupts
6193 -49.6% 3118 interrupts.CPU70.PMI:Performance_monitoring_interrupts
6234 -56.5% 2713 ± 25% interrupts.CPU71.NMI:Non-maskable_interrupts
6234 -56.5% 2713 ± 25% interrupts.CPU71.PMI:Performance_monitoring_interrupts
6195 -49.4% 3137 interrupts.CPU72.NMI:Non-maskable_interrupts
6195 -49.4% 3137 interrupts.CPU72.PMI:Performance_monitoring_interrupts
6239 -49.9% 3123 interrupts.CPU73.NMI:Non-maskable_interrupts
6239 -49.9% 3123 interrupts.CPU73.PMI:Performance_monitoring_interrupts
6255 -37.4% 3913 ± 34% interrupts.CPU75.NMI:Non-maskable_interrupts
6255 -37.4% 3913 ± 34% interrupts.CPU75.PMI:Performance_monitoring_interrupts
6215 -37.3% 3894 ± 34% interrupts.CPU76.NMI:Non-maskable_interrupts
6215 -37.3% 3894 ± 34% interrupts.CPU76.PMI:Performance_monitoring_interrupts
6198 -37.5% 3877 ± 34% interrupts.CPU77.NMI:Non-maskable_interrupts
6198 -37.5% 3877 ± 34% interrupts.CPU77.PMI:Performance_monitoring_interrupts
6225 -43.4% 3526 ± 46% interrupts.CPU78.NMI:Non-maskable_interrupts
6225 -43.4% 3526 ± 46% interrupts.CPU78.PMI:Performance_monitoring_interrupts
6236 -37.7% 3887 ± 34% interrupts.CPU79.NMI:Non-maskable_interrupts
6236 -37.7% 3887 ± 34% interrupts.CPU79.PMI:Performance_monitoring_interrupts
6239 -51.5% 3028 ± 3% interrupts.CPU83.NMI:Non-maskable_interrupts
6239 -51.5% 3028 ± 3% interrupts.CPU83.PMI:Performance_monitoring_interrupts
***************************************************************************************************
lkp-bdw-ep3d: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03-no-ucode.cgz/lkp-bdw-ep3d/futex3/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
%stddev %change %stddev
\ | \
3606506 +5.8% 3817348 will-it-scale.per_process_ops
1.587e+08 +5.8% 1.68e+08 will-it-scale.workload
777050 ± 7% +3986.1% 31751409 ±168% cpuidle.C1.time
1630 -100.0% 0.00 meminfo.Mlocked
16.00 +10.9% 17.75 ± 2% vmstat.cpu.us
4032 ± 3% -9.6% 3647 ± 6% slabinfo.kmalloc-rcl-64.active_objs
4032 ± 3% -9.6% 3647 ± 6% slabinfo.kmalloc-rcl-64.num_objs
219.50 ± 12% -100.0% 0.00 numa-vmstat.node0.nr_mlock
3159 ± 20% -17.3% 2611 ± 11% numa-vmstat.node1.nr_mapped
187.00 ± 16% -100.0% 0.00 numa-vmstat.node1.nr_mlock
-1244 +479.3% -7208 sched_debug.cfs_rq:/.spread0.min
3.52 ± 5% -20.8% 2.79 sched_debug.cpu.clock.stddev
3.52 ± 5% -20.8% 2.79 sched_debug.cpu.clock_task.stddev
54.50 ± 59% -57.4% 23.21 ± 14% sched_debug.cpu.cpu_load[1].max
42.67 ± 10% +15.3% 49.21 ± 8% sched_debug.cpu.cpu_load[4].max
21.00 ± 12% -39.5% 12.71 ± 27% sched_debug.cpu.nr_uninterruptible.max
4.03 ± 8% -22.1% 3.14 ± 10% sched_debug.cpu.nr_uninterruptible.stddev
70467 -3.5% 67987 proc-vmstat.nr_active_anon
61221 -0.9% 60664 proc-vmstat.nr_anon_pages
4462 -1.2% 4407 proc-vmstat.nr_inactive_anon
6942 -2.6% 6765 proc-vmstat.nr_mapped
407.25 -100.0% 0.00 proc-vmstat.nr_mlock
70467 -3.5% 67987 proc-vmstat.nr_zone_active_anon
4462 -1.2% 4407 proc-vmstat.nr_zone_inactive_anon
697001 -1.0% 690247 proc-vmstat.numa_hit
679834 -1.0% 673107 proc-vmstat.numa_local
22560 ± 20% +30.4% 29420 ± 7% softirqs.CPU26.RCU
22786 ± 15% +34.9% 30730 ± 9% softirqs.CPU27.RCU
21637 ± 5% +11.2% 24052 ± 3% softirqs.CPU47.RCU
23104 ± 8% +16.0% 26810 ± 14% softirqs.CPU5.RCU
19255 ± 22% +27.1% 24481 ± 4% softirqs.CPU51.RCU
21604 ± 5% +11.9% 24173 ± 3% softirqs.CPU52.RCU
22073 ± 5% +9.4% 24150 ± 2% softirqs.CPU55.RCU
19672 ± 13% +18.7% 23358 ± 2% softirqs.CPU56.RCU
18526 ± 13% +16.4% 21570 ± 2% softirqs.CPU61.RCU
17650 ± 17% +22.7% 21662 ± 2% softirqs.CPU80.RCU
19156 ± 5% +12.1% 21468 ± 5% softirqs.CPU82.RCU
17920 ± 17% +22.6% 21966 ± 3% softirqs.CPU83.RCU
19130 ± 4% +12.2% 21459 ± 7% softirqs.CPU86.RCU
1545 ± 86% -89.5% 163.00 ± 87% interrupts.CPU1.RES:Rescheduling_interrupts
4908 ± 16% -33.1% 3282 ± 47% interrupts.CPU11.NMI:Non-maskable_interrupts
4908 ± 16% -33.1% 3282 ± 47% interrupts.CPU11.PMI:Performance_monitoring_interrupts
5416 ± 29% -39.4% 3284 ± 47% interrupts.CPU12.NMI:Non-maskable_interrupts
5416 ± 29% -39.4% 3284 ± 47% interrupts.CPU12.PMI:Performance_monitoring_interrupts
4951 ± 15% -33.7% 3283 ± 47% interrupts.CPU13.NMI:Non-maskable_interrupts
4951 ± 15% -33.7% 3283 ± 47% interrupts.CPU13.PMI:Performance_monitoring_interrupts
4929 ± 16% -26.1% 3641 ± 33% interrupts.CPU16.NMI:Non-maskable_interrupts
4929 ± 16% -26.1% 3641 ± 33% interrupts.CPU16.PMI:Performance_monitoring_interrupts
61.00 ± 76% +531.6% 385.25 ± 89% interrupts.CPU2.RES:Rescheduling_interrupts
41.00 ± 64% +1479.3% 647.50 ± 89% interrupts.CPU23.RES:Rescheduling_interrupts
30.75 ± 72% +155.3% 78.50 ± 31% interrupts.CPU25.RES:Rescheduling_interrupts
71.25 ±128% +1377.2% 1052 ± 95% interrupts.CPU26.RES:Rescheduling_interrupts
5.75 ± 60% +2652.2% 158.25 ±124% interrupts.CPU32.RES:Rescheduling_interrupts
13.00 ± 55% +640.4% 96.25 ± 42% interrupts.CPU36.RES:Rescheduling_interrupts
790.25 ± 57% -75.5% 194.00 ±136% interrupts.CPU5.RES:Rescheduling_interrupts
6924 ± 24% -32.5% 4672 ± 40% interrupts.CPU52.NMI:Non-maskable_interrupts
6924 ± 24% -32.5% 4672 ± 40% interrupts.CPU52.PMI:Performance_monitoring_interrupts
7881 -37.2% 4953 ± 34% interrupts.CPU57.NMI:Non-maskable_interrupts
7881 -37.2% 4953 ± 34% interrupts.CPU57.PMI:Performance_monitoring_interrupts
7912 -37.5% 4942 ± 34% interrupts.CPU58.NMI:Non-maskable_interrupts
7912 -37.5% 4942 ± 34% interrupts.CPU58.PMI:Performance_monitoring_interrupts
7902 -37.5% 4940 ± 34% interrupts.CPU60.NMI:Non-maskable_interrupts
7902 -37.5% 4940 ± 34% interrupts.CPU60.PMI:Performance_monitoring_interrupts
7884 -37.4% 4939 ± 34% interrupts.CPU62.NMI:Non-maskable_interrupts
7884 -37.4% 4939 ± 34% interrupts.CPU62.PMI:Performance_monitoring_interrupts
4932 ± 16% -33.3% 3290 ± 46% interrupts.CPU9.NMI:Non-maskable_interrupts
4932 ± 16% -33.3% 3290 ± 46% interrupts.CPU9.PMI:Performance_monitoring_interrupts
0.08 -6.9% 0.07 perf-stat.i.MPKI
1.09e+10 +7.4% 1.17e+10 perf-stat.i.branch-instructions
2.96 -1.5 1.48 perf-stat.i.branch-miss-rate%
3.218e+08 -46.2% 1.731e+08 perf-stat.i.branch-misses
1.64 -5.9% 1.54 perf-stat.i.cpi
0.00 ± 15% -0.0 0.00 ± 7% perf-stat.i.dTLB-load-miss-rate%
271193 ± 15% -57.7% 114745 ± 5% perf-stat.i.dTLB-load-misses
1.916e+10 +3.9% 1.991e+10 perf-stat.i.dTLB-loads
0.00 ± 27% -0.0 0.00 ± 15% perf-stat.i.dTLB-store-miss-rate%
245430 ± 25% -88.7% 27715 ± 9% perf-stat.i.dTLB-store-misses
1.451e+10 +3.5% 1.501e+10 perf-stat.i.dTLB-stores
7.52e+10 +6.3% 7.995e+10 perf-stat.i.instructions
0.61 +6.3% 0.65 perf-stat.i.ipc
0.07 -6.3% 0.06 perf-stat.overall.MPKI
2.95 -1.5 1.48 perf-stat.overall.branch-miss-rate%
1.64 -5.9% 1.54 perf-stat.overall.cpi
727812 ± 4% +9.0% 793642 ± 3% perf-stat.overall.cycles-between-cache-misses
0.00 ± 15% -0.0 0.00 ± 5% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 25% -0.0 0.00 ± 9% perf-stat.overall.dTLB-store-miss-rate%
0.61 +6.3% 0.65 perf-stat.overall.ipc
1.086e+10 +7.4% 1.166e+10 perf-stat.ps.branch-instructions
3.207e+08 -46.2% 1.725e+08 perf-stat.ps.branch-misses
270777 ± 15% -57.7% 114522 ± 5% perf-stat.ps.dTLB-load-misses
1.91e+10 +3.9% 1.984e+10 perf-stat.ps.dTLB-loads
245104 ± 25% -88.7% 27670 ± 9% perf-stat.ps.dTLB-store-misses
1.446e+10 +3.5% 1.496e+10 perf-stat.ps.dTLB-stores
7.495e+10 +6.3% 7.968e+10 perf-stat.ps.instructions
2.263e+13 +6.3% 2.406e+13 perf-stat.total.instructions
***************************************************************************************************
lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/tbox_group/test/testcase/ucode:
gcc-8/performance/x86_64-rhel-7.6/debian-x86_64-2018-04-03.cgz/lkp-bdw-ex2/futex1/will-it-scale/0xb00002e
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:2 50% 1:3 dmesg.WARNING:at#for_ip_interrupt_entry/0x
1:2 -50% :3 stderr.mount.nfs:Connection_timed_out
:2 50% 1:3 kmsg.Not_tainted
:2 50% 1:3 kmsg.echo#>/proc/sys/kernel/hung_task_timeout_secs~disables_this_message
%stddev %change %stddev
\ | \
2496467 +2.6% 2560919 will-it-scale.per_process_ops
515041 -3.1% 499149 ± 2% will-it-scale.per_thread_ops
0.70 +6.4% 0.75 ± 2% will-it-scale.scalability
118.88 -4.3% 113.80 ± 4% will-it-scale.time.user_time
1.153e+09 +3.5% 1.194e+09 will-it-scale.workload
28.99 -0.8% 28.77 boot-time.dhcp
7866 ± 5% +1874.1% 155290 ± 57% numa-numastat.node0.local_node
26516 +532.8% 167786 ± 49% numa-numastat.node0.numa_hit
11983872 -14.0% 10309632 ± 5% meminfo.DirectMap2M
470472 ± 5% -15.6% 397085 ± 8% meminfo.DirectMap4k
816.50 ± 41% -47.4% 429.33 ± 36% meminfo.Mlocked
95.50 ± 4% -8.2% 87.67 ± 6% proc-vmstat.nr_inactive_file
203.50 ± 40% -47.3% 107.33 ± 37% proc-vmstat.nr_mlock
17078 ± 5% +9.8% 18746 ± 3% proc-vmstat.nr_shmem
95.50 ± 4% -8.2% 87.67 ± 6% proc-vmstat.nr_zone_inactive_file
11669 ± 10% +22.2% 14262 proc-vmstat.pgactivate
1847 ± 5% -9.3% 1676 ± 4% slabinfo.avtab_node.active_objs
1847 ± 5% -9.3% 1676 ± 4% slabinfo.avtab_node.num_objs
2192 +8.4% 2377 ± 4% slabinfo.pool_workqueue.num_objs
578.00 ± 52% -60.8% 226.67 ± 14% slabinfo.tw_sock_TCP.active_objs
578.00 ± 52% -60.8% 226.67 ± 14% slabinfo.tw_sock_TCP.num_objs
9566399 ± 51% -82.9% 1634223 ± 18% cpuidle.C1.time
204936 ± 53% -74.1% 53035 ± 8% cpuidle.C1.usage
2.985e+09 ± 14% -97.8% 66052113 ± 80% cpuidle.C1E.time
35865693 ± 13% -99.3% 265794 ± 66% cpuidle.C1E.usage
1.324e+10 ± 63% +148.3% 3.288e+10 ± 7% cpuidle.C3.time
29716500 ± 21% +151.6% 74755358 ± 3% cpuidle.C3.usage
3.532e+10 ± 21% -64.9% 1.241e+10 ± 98% cpuidle.C6.time
41301763 ± 25% -51.6% 20007429 ±104% cpuidle.C6.usage
1230402 ± 10% -49.7% 618946 ± 66% sched_debug.cfs_rq:/.min_vruntime.min
0.75 +72.9% 1.30 ± 26% sched_debug.cfs_rq:/.removed.load_avg.avg
10.35 +33.2% 13.80 ± 14% sched_debug.cfs_rq:/.removed.load_avg.stddev
34.63 ± 2% +71.6% 59.44 ± 26% sched_debug.cfs_rq:/.removed.runnable_sum.avg
478.65 ± 2% +32.2% 633.00 ± 14% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
0.38 ± 2% +59.1% 0.60 ± 19% sched_debug.cfs_rq:/.removed.util_avg.avg
5.23 ± 2% +25.3% 6.55 ± 6% sched_debug.cfs_rq:/.removed.util_avg.stddev
173210 -57.9% 72904 ± 56% sched_debug.cpu.avg_idle.min
62774 ± 15% -35.9% 40218 ± 34% sched_debug.cpu.nr_switches.max
5673 ± 3% -32.6% 3823 ± 23% sched_debug.cpu.nr_switches.stddev
-12.00 -13.9% -10.33 sched_debug.cpu.nr_uninterruptible.min
202540 ± 54% -74.7% 51287 ± 8% turbostat.C1
0.01 ± 33% -0.0 0.00 turbostat.C1%
35860488 ± 13% -99.3% 261162 ± 68% turbostat.C1E
4.01 ± 15% -3.9 0.09 ± 62% turbostat.C1E%
29716034 ± 21% +151.6% 74753457 ± 3% turbostat.C3
17.71 ± 63% +32.3 49.97 ± 20% turbostat.C3%
41237740 ± 25% -51.7% 19937579 ±104% turbostat.C6
47.43 ± 21% -31.4 16.06 ± 87% turbostat.C6%
33.64 ± 4% +15.7% 38.94 ± 2% turbostat.CPU%c1
24.96 ± 28% -74.9% 6.26 ±111% turbostat.CPU%c6
25.88 -21.5% 20.30 ± 9% turbostat.Pkg%pc2
4673 ± 53% -62.2% 1767 ±117% numa-vmstat.node0.nr_inactive_anon
2835 ± 22% -20.9% 2242 ± 37% numa-vmstat.node0.nr_mapped
4673 ± 53% -62.2% 1767 ±117% numa-vmstat.node0.nr_zone_inactive_anon
31071 ± 7% -36.0% 19898 ± 65% numa-vmstat.node1.nr_active_anon
30838 ± 6% -47.3% 16251 ± 70% numa-vmstat.node1.nr_anon_pages
2712 ± 72% +187.0% 7784 ± 29% numa-vmstat.node1.nr_shmem
6316 ± 13% +31.2% 8288 ± 5% numa-vmstat.node1.nr_slab_reclaimable
31071 ± 7% -36.0% 19898 ± 65% numa-vmstat.node1.nr_zone_active_anon
18107 ± 22% -60.8% 7090 ±136% numa-vmstat.node2.nr_anon_pages
6591 ± 4% -10.9% 5873 ± 7% numa-vmstat.node2.nr_kernel_stack
65.00 ± 61% -66.7% 21.67 ± 39% numa-vmstat.node2.nr_mlock
567.00 ± 34% -57.5% 241.00 ± 76% numa-vmstat.node2.nr_page_table_pages
14392 ± 94% +143.6% 35066 ± 13% numa-vmstat.node3.nr_active_anon
9457 ± 95% +271.6% 35143 ± 13% numa-vmstat.node3.nr_anon_pages
198.50 ± 48% +89.6% 376.33 ± 6% numa-vmstat.node3.nr_page_table_pages
14392 ± 94% +143.6% 35066 ± 13% numa-vmstat.node3.nr_zone_active_anon
3.84 ± 15% -1.6 2.24 ± 64% perf-stat.i.branch-miss-rate%
1.547e+08 ± 2% -41.0% 91259839 ± 5% perf-stat.i.branch-misses
14.20 +6.7% 15.15 perf-stat.i.cpi
236467 +7.5% 254135 ± 4% perf-stat.i.cycles-between-cache-misses
638431 +52.6% 974297 ± 26% perf-stat.i.dTLB-store-misses
79.49 +6.8 86.31 perf-stat.i.iTLB-load-miss-rate%
1.265e+08 -29.3% 89456361 ± 11% perf-stat.i.iTLB-load-misses
738.29 ± 2% +18.9% 878.12 ± 8% perf-stat.i.instructions-per-iTLB-miss
1.81 ± 2% -0.9 0.93 ± 9% perf-stat.overall.branch-miss-rate%
2.62 -3.7% 2.52 ± 2% perf-stat.overall.cpi
96.82 -1.3 95.51 perf-stat.overall.iTLB-load-miss-rate%
464.17 ± 2% +63.7% 759.84 ± 5% perf-stat.overall.instructions-per-iTLB-miss
1.522e+08 ± 2% -41.0% 89728767 ± 4% perf-stat.ps.branch-misses
634910 +52.1% 965837 ± 26% perf-stat.ps.dTLB-store-misses
1.241e+08 ± 2% -29.3% 87765598 ± 11% perf-stat.ps.iTLB-load-misses
2.229e+13 +3.5% 2.307e+13 perf-stat.total.instructions
18696 ± 53% -61.0% 7295 ±115% numa-meminfo.node0.Inactive
18694 ± 53% -62.2% 7067 ±117% numa-meminfo.node0.Inactive(anon)
11339 ± 22% -23.8% 8636 ± 36% numa-meminfo.node0.Mapped
124395 ± 7% -36.0% 79620 ± 65% numa-meminfo.node1.Active
124287 ± 7% -35.9% 79620 ± 65% numa-meminfo.node1.Active(anon)
107555 ± 3% -49.5% 54262 ± 77% numa-meminfo.node1.AnonHugePages
123351 ± 6% -47.3% 64996 ± 70% numa-meminfo.node1.AnonPages
25266 ± 13% +31.2% 33157 ± 5% numa-meminfo.node1.KReclaimable
25266 ± 13% +31.2% 33157 ± 5% numa-meminfo.node1.SReclaimable
10856 ± 72% +187.1% 31171 ± 29% numa-meminfo.node1.Shmem
86531 +11.9% 96794 numa-meminfo.node1.Slab
56683 ± 38% -59.7% 22853 ±141% numa-meminfo.node2.AnonHugePages
72407 ± 22% -60.8% 28350 ±136% numa-meminfo.node2.AnonPages
6571 ± 3% -10.7% 5866 ± 7% numa-meminfo.node2.KernelStack
2259 ± 34% -57.8% 954.00 ± 76% numa-meminfo.node2.PageTables
57693 ± 94% +143.1% 140270 ± 13% numa-meminfo.node3.Active
57693 ± 94% +143.1% 140270 ± 13% numa-meminfo.node3.Active(anon)
25926 ±100% +354.0% 117714 ± 19% numa-meminfo.node3.AnonHugePages
37807 ± 95% +271.8% 140574 ± 13% numa-meminfo.node3.AnonPages
792.00 ± 48% +90.4% 1508 ± 6% numa-meminfo.node3.PageTables
30.68 ± 5% -6.2 24.43 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
29.36 ± 4% -6.0 23.31 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
28.09 ± 5% -5.9 22.18 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
24.84 ± 5% -5.1 19.71 ± 2% perf-profile.calltrace.cycles-pp.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.09 ± 5% -3.6 18.49 ± 2% perf-profile.calltrace.cycles-pp.futex_wake.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.96 ± 5% -2.9 15.11 ± 2% perf-profile.calltrace.cycles-pp.get_futex_key.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
16.11 ± 4% -2.4 13.70 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
13.50 ± 5% -1.9 11.59 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
12.85 ± 5% -1.9 10.96 ± 2% perf-profile.calltrace.cycles-pp.get_user_pages_fast.get_futex_key.futex_wake.do_futex.__x64_sys_futex
11.27 ± 5% -1.6 9.63 ± 2% perf-profile.calltrace.cycles-pp.gup_pgd_range.get_user_pages_fast.get_futex_key.futex_wake.do_futex
2.13 ± 18% -0.6 1.56 ± 13% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry
2.30 ± 17% -0.5 1.75 ± 12% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
1.31 ± 13% -0.4 0.94 ± 12% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle
1.78 ± 5% -0.3 1.48 ± 2% perf-profile.calltrace.cycles-pp.get_futex_key_refs.get_futex_key.futex_wake.do_futex.__x64_sys_futex
0.85 ± 9% -0.2 0.61 ± 10% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.25 ± 6% -0.2 1.03 ± 2% perf-profile.calltrace.cycles-pp.drop_futex_key_refs.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
1.29 ± 2% -0.2 1.11 ± 2% perf-profile.calltrace.cycles-pp.hash_futex.futex_wake.do_futex.__x64_sys_futex.do_syscall_64
0.83 ± 2% -0.1 0.69 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
36.46 ± 8% +11.1 47.52 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
36.46 ± 8% +11.1 47.52 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
36.45 ± 8% +11.1 47.52 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
36.85 ± 8% +11.2 48.01 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
35.20 ± 8% +11.3 46.47 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
32.78 ± 8% +11.9 44.64 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
31888 ± 12% -21.0% 25192 ± 24% softirqs.CPU0.SCHED
34289 ± 14% -24.0% 26070 ± 29% softirqs.CPU1.RCU
34567 ± 10% -30.5% 24026 ± 33% softirqs.CPU1.SCHED
32531 ± 2% -20.8% 25760 ± 20% softirqs.CPU108.RCU
25490 ± 8% -22.4% 19783 ± 22% softirqs.CPU114.RCU
32019 -29.3% 22624 ± 30% softirqs.CPU118.RCU
30997 ± 8% -28.9% 22027 ± 31% softirqs.CPU119.RCU
31873 ± 6% -20.9% 25222 ± 20% softirqs.CPU132.RCU
33363 ± 6% -13.0% 29035 ± 14% softirqs.CPU137.SCHED
33894 ± 12% -15.8% 28533 ± 17% softirqs.CPU139.SCHED
32677 ± 7% -18.0% 26807 ± 21% softirqs.CPU140.SCHED
33447 ± 8% -14.2% 28692 ± 15% softirqs.CPU141.SCHED
36590 ± 4% -21.2% 28824 ± 15% softirqs.CPU142.SCHED
37643 -23.3% 28882 ± 15% softirqs.CPU143.SCHED
164778 ± 21% -20.9% 130261 ± 19% softirqs.CPU143.TIMER
35481 ± 6% -24.8% 26691 ± 26% softirqs.CPU146.RCU
32886 -32.2% 22305 ± 20% softirqs.CPU148.RCU
35817 ± 2% -26.8% 26208 ± 15% softirqs.CPU153.RCU
39524 ± 4% -32.0% 26867 ± 38% softirqs.CPU157.RCU
32255 ± 21% -22.9% 24866 ± 23% softirqs.CPU161.RCU
27970 ± 6% -25.8% 20754 ± 15% softirqs.CPU162.RCU
34679 ± 10% -38.6% 21287 ± 15% softirqs.CPU163.RCU
36891 ± 10% -29.2% 26124 ± 36% softirqs.CPU165.RCU
34348 -31.8% 23438 ± 19% softirqs.CPU168.RCU
135565 ± 5% -3.5% 130798 ± 6% softirqs.CPU168.TIMER
33609 ± 7% -38.0% 20840 ± 25% softirqs.CPU169.RCU
138004 ± 7% -7.0% 128364 ± 3% softirqs.CPU169.TIMER
31693 ± 3% -26.4% 23322 ± 18% softirqs.CPU170.RCU
137904 ± 3% -7.2% 127942 ± 2% softirqs.CPU170.TIMER
31190 ± 12% -37.9% 19366 ± 5% softirqs.CPU171.RCU
135343 ± 5% -9.4% 122587 ± 2% softirqs.CPU171.TIMER
32093 ± 6% -32.0% 21809 ± 14% softirqs.CPU172.RCU
135088 ± 6% -5.7% 127421 ± 3% softirqs.CPU172.TIMER
33396 -39.0% 20369 ± 22% softirqs.CPU173.RCU
33154 -36.0% 21227 ± 27% softirqs.CPU174.RCU
134831 ± 6% -5.2% 127815 ± 4% softirqs.CPU174.TIMER
32295 -45.1% 17733 ± 7% softirqs.CPU175.RCU
135104 ± 6% -5.8% 127215 ± 3% softirqs.CPU175.TIMER
38022 -22.4% 29512 ± 17% softirqs.CPU176.RCU
142550 ± 5% -7.7% 131547 ± 7% softirqs.CPU176.TIMER
144473 ± 4% -6.3% 135320 ± 6% softirqs.CPU177.TIMER
36694 ± 2% -25.4% 27366 ± 9% softirqs.CPU178.RCU
142513 ± 5% -7.4% 131975 ± 6% softirqs.CPU178.TIMER
35080 ± 16% -21.1% 27684 ± 6% softirqs.CPU179.RCU
142200 ± 5% -8.4% 130241 ± 5% softirqs.CPU179.TIMER
25564 ± 9% -16.8% 21275 ± 22% softirqs.CPU18.RCU
35852 ± 4% -25.2% 26821 ± 26% softirqs.CPU180.RCU
142217 ± 5% -7.0% 132249 ± 6% softirqs.CPU180.TIMER
38047 ± 2% -22.9% 29335 ± 17% softirqs.CPU181.RCU
141419 ± 6% -7.0% 131498 ± 6% softirqs.CPU181.TIMER
40784 -23.1% 31365 ± 17% softirqs.CPU182.RCU
142421 ± 6% -6.7% 132915 ± 7% softirqs.CPU182.TIMER
142474 ± 6% -5.8% 134151 ± 8% softirqs.CPU183.TIMER
40752 ± 3% -18.6% 33186 ± 20% softirqs.CPU186.SCHED
142550 ± 5% -6.8% 132791 ± 7% softirqs.CPU186.TIMER
141886 ± 6% -5.7% 133755 ± 8% softirqs.CPU187.TIMER
141386 ± 5% -6.0% 132865 ± 7% softirqs.CPU188.TIMER
141389 ± 6% -4.9% 134434 ± 8% softirqs.CPU190.TIMER
142156 ± 5% -5.7% 134100 ± 7% softirqs.CPU191.TIMER
32108 ± 4% -27.3% 23333 ± 28% softirqs.CPU23.RCU
37312 ± 13% -31.6% 25514 ± 29% softirqs.CPU23.SCHED
35687 ± 9% -22.9% 27503 ± 25% softirqs.CPU24.SCHED
167185 ± 18% -21.1% 131935 ± 20% softirqs.CPU27.TIMER
30756 ± 12% -24.3% 23280 ± 33% softirqs.CPU3.SCHED
31470 ± 4% -23.0% 24238 ± 14% softirqs.CPU35.RCU
35117 -22.3% 27296 ± 20% softirqs.CPU40.SCHED
33658 ± 4% -14.8% 28669 ± 15% softirqs.CPU41.SCHED
43560 ± 24% -30.9% 30087 ± 33% softirqs.CPU43.SCHED
39178 ± 15% -21.7% 30690 ± 24% softirqs.CPU48.SCHED
32934 -22.4% 25567 ± 15% softirqs.CPU52.RCU
38551 ± 5% -27.3% 28039 ± 29% softirqs.CPU56.RCU
36428 ± 2% -26.5% 26778 ± 17% softirqs.CPU57.RCU
34695 ± 3% -26.2% 25597 ± 21% softirqs.CPU6.RCU
36344 ± 10% -20.6% 28844 ± 27% softirqs.CPU60.RCU
40092 ± 2% -24.5% 30260 ± 25% softirqs.CPU63.RCU
32098 ± 20% -17.2% 26573 ± 21% softirqs.CPU65.RCU
32184 ± 14% -25.2% 24060 ± 13% softirqs.CPU67.RCU
35961 ± 12% -22.4% 27912 ± 30% softirqs.CPU69.RCU
29635 ± 24% -22.4% 22992 ± 32% softirqs.CPU7.SCHED
41084 ± 7% -19.4% 33099 ± 23% softirqs.CPU70.SCHED
35943 ± 2% -32.8% 24163 ± 14% softirqs.CPU72.RCU
33269 -34.7% 21719 ± 27% softirqs.CPU73.RCU
35198 -32.6% 23740 ± 15% softirqs.CPU74.RCU
143966 ± 3% -8.9% 131173 softirqs.CPU74.TIMER
33372 ± 5% -36.8% 21101 ± 4% softirqs.CPU75.RCU
32488 ± 8% -28.8% 23137 ± 10% softirqs.CPU76.RCU
144842 ± 2% -8.6% 132441 ± 2% softirqs.CPU76.TIMER
34795 -38.4% 21426 ± 15% softirqs.CPU77.RCU
144610 ± 2% -9.8% 130385 ± 2% softirqs.CPU77.TIMER
34656 ± 4% -32.8% 23299 ± 16% softirqs.CPU78.RCU
32988 ± 3% -32.8% 22171 ± 14% softirqs.CPU79.RCU
38438 ± 2% -22.8% 29682 ± 18% softirqs.CPU80.RCU
148881 ± 4% -8.1% 136791 ± 5% softirqs.CPU80.TIMER
147100 ± 4% -7.8% 135590 ± 7% softirqs.CPU81.TIMER
38189 -26.5% 28076 ± 12% softirqs.CPU82.RCU
35589 ± 8% -23.4% 27269 ± 11% softirqs.CPU83.RCU
149704 ± 3% -9.3% 135755 ± 3% softirqs.CPU83.TIMER
33771 ± 7% -16.2% 28300 ± 15% softirqs.CPU84.RCU
150278 ± 3% -9.1% 136582 ± 4% softirqs.CPU84.TIMER
39465 -27.4% 28644 ± 16% softirqs.CPU85.RCU
149894 ± 3% -8.7% 136794 ± 4% softirqs.CPU85.TIMER
38696 -19.9% 31006 ± 16% softirqs.CPU86.RCU
149493 ± 3% -7.3% 138570 ± 5% softirqs.CPU86.TIMER
150904 ± 3% -6.8% 140701 ± 7% softirqs.CPU87.TIMER
150105 ± 3% -8.1% 137895 ± 5% softirqs.CPU90.TIMER
149503 ± 3% -6.8% 139333 ± 7% softirqs.CPU91.TIMER
43187 -23.7% 32947 ± 23% softirqs.CPU92.SCHED
148634 ± 4% -6.5% 138999 ± 6% softirqs.CPU92.TIMER
148999 ± 4% -6.6% 139212 ± 6% softirqs.CPU93.TIMER
148447 ± 4% -5.6% 140189 ± 6% softirqs.CPU94.TIMER
149868 ± 3% -7.4% 138782 ± 6% softirqs.CPU95.TIMER
1198 ± 82% -84.7% 183.33 ± 14% interrupts.115:IR-PCI-MSI.1574917-edge.eth1-TxRx-5
220.50 ± 3% -5.8% 207.67 interrupts.116:IR-PCI-MSI.1574918-edge.eth1-TxRx-6
208.50 ± 8% -16.5% 174.00 ± 16% interrupts.118:IR-PCI-MSI.1574920-edge.eth1-TxRx-8
340.50 ± 43% -47.9% 177.33 ± 16% interrupts.119:IR-PCI-MSI.1574921-edge.eth1-TxRx-9
276.50 ± 29% -30.7% 191.67 ± 12% interrupts.124:IR-PCI-MSI.1574922-edge.eth1-TxRx-10
327.00 ± 4% -42.7% 187.33 ± 21% interrupts.126:IR-PCI-MSI.1574924-edge.eth1-TxRx-12
273.00 ± 30% -36.4% 173.67 ± 15% interrupts.139:IR-PCI-MSI.1574937-edge.eth1-TxRx-25
212.00 ± 10% -18.2% 173.33 ± 16% interrupts.142:IR-PCI-MSI.1574940-edge.eth1-TxRx-28
377.50 -46.0% 204.00 ± 70% interrupts.179:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
1634 ± 12% +208.9% 5049 ± 40% interrupts.CPU0.NMI:Non-maskable_interrupts
1634 ± 12% +208.9% 5049 ± 40% interrupts.CPU0.PMI:Performance_monitoring_interrupts
1648 ± 12% +222.6% 5316 ± 7% interrupts.CPU1.NMI:Non-maskable_interrupts
1648 ± 12% +222.6% 5316 ± 7% interrupts.CPU1.PMI:Performance_monitoring_interrupts
16162 ± 29% -91.5% 1378 ± 50% interrupts.CPU1.RES:Rescheduling_interrupts
276.50 ± 29% -30.7% 191.67 ± 12% interrupts.CPU10.124:IR-PCI-MSI.1574922-edge.eth1-TxRx-10
3295 ± 12% +60.6% 5294 ± 7% interrupts.CPU10.NMI:Non-maskable_interrupts
3295 ± 12% +60.6% 5294 ± 7% interrupts.CPU10.PMI:Performance_monitoring_interrupts
3282 ± 12% +61.4% 5298 ± 7% interrupts.CPU11.NMI:Non-maskable_interrupts
3282 ± 12% +61.4% 5298 ± 7% interrupts.CPU11.PMI:Performance_monitoring_interrupts
327.00 ± 4% -42.7% 187.33 ± 21% interrupts.CPU12.126:IR-PCI-MSI.1574924-edge.eth1-TxRx-12
3306 ± 13% +61.0% 5323 ± 6% interrupts.CPU12.NMI:Non-maskable_interrupts
3306 ± 13% +61.0% 5323 ± 6% interrupts.CPU12.PMI:Performance_monitoring_interrupts
4826 ± 4% -11.8% 4254 ± 2% interrupts.CPU120.CAL:Function_call_interrupts
3309 ± 12% +60.6% 5315 ± 6% interrupts.CPU13.NMI:Non-maskable_interrupts
3309 ± 12% +60.6% 5315 ± 6% interrupts.CPU13.PMI:Performance_monitoring_interrupts
263.50 ± 36% +54.6% 407.33 ± 2% interrupts.CPU138.NMI:Non-maskable_interrupts
263.50 ± 36% +54.6% 407.33 ± 2% interrupts.CPU138.PMI:Performance_monitoring_interrupts
3292 ± 12% +61.2% 5307 ± 6% interrupts.CPU14.NMI:Non-maskable_interrupts
3292 ± 12% +61.2% 5307 ± 6% interrupts.CPU14.PMI:Performance_monitoring_interrupts
334.50 ± 22% +46.9% 491.33 ± 4% interrupts.CPU144.NMI:Non-maskable_interrupts
334.50 ± 22% +46.9% 491.33 ± 4% interrupts.CPU144.PMI:Performance_monitoring_interrupts
329.00 ± 25% +47.8% 486.33 ± 2% interrupts.CPU145.NMI:Non-maskable_interrupts
329.00 ± 25% +47.8% 486.33 ± 2% interrupts.CPU145.PMI:Performance_monitoring_interrupts
341.50 ± 25% +46.0% 498.67 ± 3% interrupts.CPU146.NMI:Non-maskable_interrupts
341.50 ± 25% +46.0% 498.67 ± 3% interrupts.CPU146.PMI:Performance_monitoring_interrupts
99.00 ± 74% -78.5% 21.33 ± 37% interrupts.CPU146.RES:Rescheduling_interrupts
331.00 ± 20% +53.9% 509.33 interrupts.CPU147.NMI:Non-maskable_interrupts
331.00 ± 20% +53.9% 509.33 interrupts.CPU147.PMI:Performance_monitoring_interrupts
354.50 ± 31% +50.3% 532.67 ± 6% interrupts.CPU148.NMI:Non-maskable_interrupts
354.50 ± 31% +50.3% 532.67 ± 6% interrupts.CPU148.PMI:Performance_monitoring_interrupts
332.00 ± 23% +66.4% 552.33 ± 12% interrupts.CPU149.NMI:Non-maskable_interrupts
332.00 ± 23% +66.4% 552.33 ± 12% interrupts.CPU149.PMI:Performance_monitoring_interrupts
3312 ± 13% +60.9% 5329 ± 6% interrupts.CPU15.NMI:Non-maskable_interrupts
3312 ± 13% +60.9% 5329 ± 6% interrupts.CPU15.PMI:Performance_monitoring_interrupts
339.50 ± 23% +56.1% 530.00 ± 4% interrupts.CPU151.NMI:Non-maskable_interrupts
339.50 ± 23% +56.1% 530.00 ± 4% interrupts.CPU151.PMI:Performance_monitoring_interrupts
349.50 ± 24% +42.0% 496.33 ± 2% interrupts.CPU152.NMI:Non-maskable_interrupts
349.50 ± 24% +42.0% 496.33 ± 2% interrupts.CPU152.PMI:Performance_monitoring_interrupts
325.50 ± 21% +53.7% 500.33 ± 3% interrupts.CPU153.NMI:Non-maskable_interrupts
325.50 ± 21% +53.7% 500.33 ± 3% interrupts.CPU153.PMI:Performance_monitoring_interrupts
340.50 ± 26% +57.6% 536.67 ± 3% interrupts.CPU154.NMI:Non-maskable_interrupts
340.50 ± 26% +57.6% 536.67 ± 3% interrupts.CPU154.PMI:Performance_monitoring_interrupts
324.00 ± 22% +56.9% 508.33 ± 3% interrupts.CPU155.NMI:Non-maskable_interrupts
324.00 ± 22% +56.9% 508.33 ± 3% interrupts.CPU155.PMI:Performance_monitoring_interrupts
322.50 ± 25% +68.7% 544.00 ± 6% interrupts.CPU158.NMI:Non-maskable_interrupts
322.50 ± 25% +68.7% 544.00 ± 6% interrupts.CPU158.PMI:Performance_monitoring_interrupts
3309 ± 13% +59.8% 5286 ± 7% interrupts.CPU16.NMI:Non-maskable_interrupts
3309 ± 13% +59.8% 5286 ± 7% interrupts.CPU16.PMI:Performance_monitoring_interrupts
377.00 ± 99% -100.0% 0.00 interrupts.CPU160.TLB:TLB_shootdowns
478.00 +12.6% 538.00 ± 5% interrupts.CPU163.NMI:Non-maskable_interrupts
478.00 +12.6% 538.00 ± 5% interrupts.CPU163.PMI:Performance_monitoring_interrupts
217.50 ± 99% -100.0% 0.00 interrupts.CPU163.TLB:TLB_shootdowns
437.50 ± 9% +28.5% 562.00 ± 2% interrupts.CPU165.NMI:Non-maskable_interrupts
437.50 ± 9% +28.5% 562.00 ± 2% interrupts.CPU165.PMI:Performance_monitoring_interrupts
365.50 ± 75% -87.4% 46.00 ± 88% interrupts.CPU166.RES:Rescheduling_interrupts
3313 ± 13% +59.9% 5299 ± 6% interrupts.CPU17.NMI:Non-maskable_interrupts
3313 ± 13% +59.9% 5299 ± 6% interrupts.CPU17.PMI:Performance_monitoring_interrupts
333.00 ± 29% +48.5% 494.67 ± 2% interrupts.CPU170.NMI:Non-maskable_interrupts
333.00 ± 29% +48.5% 494.67 ± 2% interrupts.CPU170.PMI:Performance_monitoring_interrupts
333.50 ± 28% +49.0% 497.00 ± 5% interrupts.CPU171.NMI:Non-maskable_interrupts
333.50 ± 28% +49.0% 497.00 ± 5% interrupts.CPU171.PMI:Performance_monitoring_interrupts
339.50 ± 24% +47.0% 499.00 ± 4% interrupts.CPU173.NMI:Non-maskable_interrupts
339.50 ± 24% +47.0% 499.00 ± 4% interrupts.CPU173.PMI:Performance_monitoring_interrupts
16.50 ± 27% +1370.7% 242.67 ±125% interrupts.CPU175.RES:Rescheduling_interrupts
357.50 ± 26% +43.8% 514.00 ± 5% interrupts.CPU177.NMI:Non-maskable_interrupts
357.50 ± 26% +43.8% 514.00 ± 5% interrupts.CPU177.PMI:Performance_monitoring_interrupts
16.00 ± 50% +343.8% 71.00 ± 83% interrupts.CPU177.RES:Rescheduling_interrupts
365.00 ± 27% +43.6% 524.00 ± 6% interrupts.CPU178.NMI:Non-maskable_interrupts
365.00 ± 27% +43.6% 524.00 ± 6% interrupts.CPU178.PMI:Performance_monitoring_interrupts
352.50 ± 21% +47.7% 520.67 ± 2% interrupts.CPU179.NMI:Non-maskable_interrupts
352.50 ± 21% +47.7% 520.67 ± 2% interrupts.CPU179.PMI:Performance_monitoring_interrupts
3286 ± 12% +61.5% 5307 ± 6% interrupts.CPU18.NMI:Non-maskable_interrupts
3286 ± 12% +61.5% 5307 ± 6% interrupts.CPU18.PMI:Performance_monitoring_interrupts
349.00 ± 27% +45.6% 508.00 ± 3% interrupts.CPU180.NMI:Non-maskable_interrupts
349.00 ± 27% +45.6% 508.00 ± 3% interrupts.CPU180.PMI:Performance_monitoring_interrupts
331.00 ± 25% +48.3% 491.00 ± 6% interrupts.CPU181.NMI:Non-maskable_interrupts
331.00 ± 25% +48.3% 491.00 ± 6% interrupts.CPU181.PMI:Performance_monitoring_interrupts
350.00 ± 28% +54.5% 540.67 ± 5% interrupts.CPU183.NMI:Non-maskable_interrupts
350.00 ± 28% +54.5% 540.67 ± 5% interrupts.CPU183.PMI:Performance_monitoring_interrupts
326.50 ± 27% +64.2% 536.00 ± 7% interrupts.CPU184.NMI:Non-maskable_interrupts
326.50 ± 27% +64.2% 536.00 ± 7% interrupts.CPU184.PMI:Performance_monitoring_interrupts
349.50 ± 33% +58.1% 552.67 ± 6% interrupts.CPU185.NMI:Non-maskable_interrupts
349.50 ± 33% +58.1% 552.67 ± 6% interrupts.CPU185.PMI:Performance_monitoring_interrupts
456.00 ± 4% +13.3% 516.67 ± 4% interrupts.CPU191.NMI:Non-maskable_interrupts
456.00 ± 4% +13.3% 516.67 ± 4% interrupts.CPU191.PMI:Performance_monitoring_interrupts
1635 ± 12% +225.0% 5313 ± 7% interrupts.CPU2.NMI:Non-maskable_interrupts
1635 ± 12% +225.0% 5313 ± 7% interrupts.CPU2.PMI:Performance_monitoring_interrupts
3335 ± 12% +59.8% 5330 ± 6% interrupts.CPU20.NMI:Non-maskable_interrupts
3335 ± 12% +59.8% 5330 ± 6% interrupts.CPU20.PMI:Performance_monitoring_interrupts
2601 ± 44% +104.3% 5314 ± 6% interrupts.CPU21.NMI:Non-maskable_interrupts
2601 ± 44% +104.3% 5314 ± 6% interrupts.CPU21.PMI:Performance_monitoring_interrupts
2598 ± 44% +104.7% 5318 ± 6% interrupts.CPU22.NMI:Non-maskable_interrupts
2598 ± 44% +104.7% 5318 ± 6% interrupts.CPU22.PMI:Performance_monitoring_interrupts
26782 ± 46% -99.9% 25.33 ± 44% interrupts.CPU23.RES:Rescheduling_interrupts
9012 ± 99% -99.7% 31.00 ± 53% interrupts.CPU24.RES:Rescheduling_interrupts
273.00 ± 30% -36.4% 173.67 ± 15% interrupts.CPU25.139:IR-PCI-MSI.1574937-edge.eth1-TxRx-25
19.00 ± 31% +15038.6% 2876 ±139% interrupts.CPU25.RES:Rescheduling_interrupts
212.00 ± 10% -18.2% 173.33 ± 16% interrupts.CPU28.142:IR-PCI-MSI.1574940-edge.eth1-TxRx-28
1636 ± 12% +224.6% 5312 ± 6% interrupts.CPU3.NMI:Non-maskable_interrupts
1636 ± 12% +224.6% 5312 ± 6% interrupts.CPU3.PMI:Performance_monitoring_interrupts
3283 ± 12% +62.9% 5350 ± 6% interrupts.CPU33.NMI:Non-maskable_interrupts
3283 ± 12% +62.9% 5350 ± 6% interrupts.CPU33.PMI:Performance_monitoring_interrupts
3259 ± 11% +64.1% 5348 ± 6% interrupts.CPU34.NMI:Non-maskable_interrupts
3259 ± 11% +64.1% 5348 ± 6% interrupts.CPU34.PMI:Performance_monitoring_interrupts
3293 ± 12% +62.1% 5337 ± 6% interrupts.CPU35.NMI:Non-maskable_interrupts
3293 ± 12% +62.1% 5337 ± 6% interrupts.CPU35.PMI:Performance_monitoring_interrupts
3286 ± 12% +61.6% 5310 ± 6% interrupts.CPU36.NMI:Non-maskable_interrupts
3286 ± 12% +61.6% 5310 ± 6% interrupts.CPU36.PMI:Performance_monitoring_interrupts
3261 ± 11% +63.3% 5325 ± 6% interrupts.CPU37.NMI:Non-maskable_interrupts
3261 ± 11% +63.3% 5325 ± 6% interrupts.CPU37.PMI:Performance_monitoring_interrupts
3279 ± 12% +61.9% 5309 ± 6% interrupts.CPU38.NMI:Non-maskable_interrupts
3279 ± 12% +61.9% 5309 ± 6% interrupts.CPU38.PMI:Performance_monitoring_interrupts
3341 ± 13% +59.5% 5331 ± 6% interrupts.CPU39.NMI:Non-maskable_interrupts
3341 ± 13% +59.5% 5331 ± 6% interrupts.CPU39.PMI:Performance_monitoring_interrupts
1622 ± 11% +228.4% 5327 ± 6% interrupts.CPU4.NMI:Non-maskable_interrupts
1622 ± 11% +228.4% 5327 ± 6% interrupts.CPU4.PMI:Performance_monitoring_interrupts
365.00 ± 3% +17.0% 427.00 ± 7% interrupts.CPU41.NMI:Non-maskable_interrupts
365.00 ± 3% +17.0% 427.00 ± 7% interrupts.CPU41.PMI:Performance_monitoring_interrupts
11.00 ± 9% +375.8% 52.33 ± 90% interrupts.CPU41.RES:Rescheduling_interrupts
355.00 ± 5% +24.0% 440.33 interrupts.CPU42.NMI:Non-maskable_interrupts
355.00 ± 5% +24.0% 440.33 interrupts.CPU42.PMI:Performance_monitoring_interrupts
24378 ± 99% -75.3% 6030 ±140% interrupts.CPU43.RES:Rescheduling_interrupts
435.00 ± 10% +22.8% 534.33 ± 6% interrupts.CPU48.NMI:Non-maskable_interrupts
435.00 ± 10% +22.8% 534.33 ± 6% interrupts.CPU48.PMI:Performance_monitoring_interrupts
18756 ± 99% -99.9% 27.33 ± 33% interrupts.CPU48.RES:Rescheduling_interrupts
1198 ± 82% -84.7% 183.33 ± 14% interrupts.CPU5.115:IR-PCI-MSI.1574917-edge.eth1-TxRx-5
1619 ± 11% +226.6% 5289 ± 7% interrupts.CPU5.NMI:Non-maskable_interrupts
1619 ± 11% +226.6% 5289 ± 7% interrupts.CPU5.PMI:Performance_monitoring_interrupts
70.00 ± 77% -81.4% 13.00 ± 16% interrupts.CPU58.RES:Rescheduling_interrupts
60.50 ± 65% -70.2% 18.00 ± 31% interrupts.CPU59.RES:Rescheduling_interrupts
220.50 ± 3% -5.8% 207.67 interrupts.CPU6.116:IR-PCI-MSI.1574918-edge.eth1-TxRx-6
2583 ± 44% +105.6% 5309 ± 6% interrupts.CPU6.NMI:Non-maskable_interrupts
2583 ± 44% +105.6% 5309 ± 6% interrupts.CPU6.PMI:Performance_monitoring_interrupts
295.00 ± 92% -95.7% 12.67 ± 3% interrupts.CPU60.RES:Rescheduling_interrupts
334.50 ± 30% +63.1% 545.67 ± 3% interrupts.CPU62.NMI:Non-maskable_interrupts
334.50 ± 30% +63.1% 545.67 ± 3% interrupts.CPU62.PMI:Performance_monitoring_interrupts
343.00 ± 29% +55.3% 532.67 ± 3% interrupts.CPU63.NMI:Non-maskable_interrupts
343.00 ± 29% +55.3% 532.67 ± 3% interrupts.CPU63.PMI:Performance_monitoring_interrupts
357.50 ± 30% +58.2% 565.67 ± 2% interrupts.CPU64.NMI:Non-maskable_interrupts
357.50 ± 30% +58.2% 565.67 ± 2% interrupts.CPU64.PMI:Performance_monitoring_interrupts
433.00 ± 6% +16.7% 505.33 interrupts.CPU68.NMI:Non-maskable_interrupts
433.00 ± 6% +16.7% 505.33 interrupts.CPU68.PMI:Performance_monitoring_interrupts
350.50 ± 29% +52.0% 532.67 interrupts.CPU69.NMI:Non-maskable_interrupts
350.50 ± 29% +52.0% 532.67 interrupts.CPU69.PMI:Performance_monitoring_interrupts
2579 ± 44% +106.5% 5326 ± 6% interrupts.CPU7.NMI:Non-maskable_interrupts
2579 ± 44% +106.5% 5326 ± 6% interrupts.CPU7.PMI:Performance_monitoring_interrupts
351.50 ± 24% +60.1% 562.67 ± 4% interrupts.CPU70.NMI:Non-maskable_interrupts
351.50 ± 24% +60.1% 562.67 ± 4% interrupts.CPU70.PMI:Performance_monitoring_interrupts
8765 ± 98% -95.8% 366.67 ±137% interrupts.CPU70.RES:Rescheduling_interrupts
12.00 ± 25% +83638.9% 10048 ±140% interrupts.CPU76.RES:Rescheduling_interrupts
208.50 ± 8% -16.5% 174.00 ± 16% interrupts.CPU8.118:IR-PCI-MSI.1574920-edge.eth1-TxRx-8
2600 ± 44% +103.9% 5302 ± 7% interrupts.CPU8.NMI:Non-maskable_interrupts
2600 ± 44% +103.9% 5302 ± 7% interrupts.CPU8.PMI:Performance_monitoring_interrupts
18.00 +1.6e+05% 28221 ± 73% interrupts.CPU8.RES:Rescheduling_interrupts
11.50 ± 39% +1253.6% 155.67 ± 55% interrupts.CPU85.RES:Rescheduling_interrupts
5548 ± 99% -96.9% 170.67 ±129% interrupts.CPU87.RES:Rescheduling_interrupts
8.50 ± 17% +2182.4% 194.00 ±123% interrupts.CPU88.RES:Rescheduling_interrupts
340.50 ± 43% -47.9% 177.33 ± 16% interrupts.CPU9.119:IR-PCI-MSI.1574921-edge.eth1-TxRx-9
3298 ± 12% +62.7% 5366 ± 5% interrupts.CPU9.NMI:Non-maskable_interrupts
3298 ± 12% +62.7% 5366 ± 5% interrupts.CPU9.PMI:Performance_monitoring_interrupts
7.50 ± 46% +84597.8% 6352 ±140% interrupts.CPU90.RES:Rescheduling_interrupts
16.00 ± 68% +22747.9% 3655 ±122% interrupts.CPU91.RES:Rescheduling_interrupts
433127 ± 10% +26.8% 549204 ± 2% interrupts.NMI:Non-maskable_interrupts
433127 ± 10% +26.8% 549204 ± 2% interrupts.PMI:Performance_monitoring_interrupts
***************************************************************************************************
lkp-skl-2sp5: 112 threads Intel(R) Xeon(R) Platinum 8170 CPU @ 2.10GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/process/50%/debian-x86_64-2018-04-03.cgz/lkp-skl-2sp5/futex2/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 kmsg.usb#-#:can't_read_configurations,error
1:4 -25% :4 kmsg.usb#-#:unable_to_read_config_index#descriptor/all
%stddev %change %stddev
\ | \
1780260 +2.5% 1824313 will-it-scale.per_process_ops
99694583 +2.5% 1.022e+08 will-it-scale.workload
0.00 ± 6% -0.0 0.00 ±167% mpstat.cpu.-1.iowait%
5.446e+09 ± 91% -92.5% 4.098e+08 ± 49% cpuidle.C6.time
7644348 ± 90% -92.7% 558721 ± 52% cpuidle.C6.usage
7621943 ± 91% -92.9% 541456 ± 54% turbostat.C6
16.06 ± 91% -14.9 1.19 ± 50% turbostat.C6%
0.74 ± 10% +0.1 0.86 ± 8% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_kernel
0.74 ± 10% +0.1 0.88 ± 8% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.74 ± 10% +0.1 0.88 ± 7% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.74 ± 10% +0.1 0.88 ± 7% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
0.74 ± 10% +0.1 0.88 ± 7% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
69598 +3.0% 71654 proc-vmstat.nr_active_anon
4658 +1.0% 4705 proc-vmstat.nr_inactive_anon
13814 ± 9% +13.2% 15637 proc-vmstat.nr_shmem
69598 +3.0% 71654 proc-vmstat.nr_zone_active_anon
4658 +1.0% 4705 proc-vmstat.nr_zone_inactive_anon
2144 ±130% -96.4% 76.25 ±144% proc-vmstat.numa_hint_faults
1909 ±149% -98.7% 24.75 ±164% proc-vmstat.numa_hint_faults_local
700177 +1.1% 707887 proc-vmstat.numa_hit
678374 +1.1% 686063 proc-vmstat.numa_local
27069 ± 14% -13.8% 23325 ± 15% softirqs.CPU16.RCU
27517 ± 10% -20.8% 21794 ± 14% softirqs.CPU33.RCU
25029 ± 6% -14.8% 21319 ± 10% softirqs.CPU34.RCU
26362 ± 10% -20.8% 20887 softirqs.CPU35.RCU
26078 ± 12% -16.0% 21918 ± 16% softirqs.CPU37.RCU
27103 ± 9% -23.8% 20659 ± 23% softirqs.CPU38.RCU
27840 ± 13% -23.7% 21236 ± 24% softirqs.CPU39.RCU
27102 ± 12% -18.1% 22205 ± 15% softirqs.CPU40.RCU
27838 ± 13% -18.2% 22779 ± 17% softirqs.CPU41.RCU
27996 ± 14% -18.4% 22836 ± 16% softirqs.CPU47.RCU
12.71 ± 8% +15.9% 14.73 ± 3% sched_debug.cfs_rq:/.load_avg.avg
30.68 ± 12% +46.2% 44.85 ± 22% sched_debug.cfs_rq:/.load_avg.stddev
1.11 ±109% +206.5% 3.40 ± 19% sched_debug.cfs_rq:/.removed.load_avg.avg
9.42 ±102% +205.7% 28.80 ± 38% sched_debug.cfs_rq:/.removed.load_avg.stddev
51.21 ±109% +206.5% 156.94 ± 19% sched_debug.cfs_rq:/.removed.runnable_sum.avg
435.14 ±101% +205.3% 1328 ± 38% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
0.40 ±120% +314.7% 1.65 ± 25% sched_debug.cfs_rq:/.removed.util_avg.avg
32.33 ±107% +304.4% 130.75 ± 57% sched_debug.cfs_rq:/.removed.util_avg.max
3.35 ±110% +322.6% 14.17 ± 43% sched_debug.cfs_rq:/.removed.util_avg.stddev
5.66 ± 2% -20.5% 4.50 ± 3% sched_debug.cpu.clock.stddev
5.66 ± 2% -20.5% 4.50 ± 3% sched_debug.cpu.clock_task.stddev
1.421e+10 +2.3% 1.454e+10 perf-stat.i.branch-instructions
1.44 -0.7 0.74 perf-stat.i.branch-miss-rate%
2.051e+08 -47.4% 1.079e+08 perf-stat.i.branch-misses
479525 ± 5% +12.6% 539837 ± 5% perf-stat.i.cache-misses
4870102 ± 2% +5.6% 5143022 perf-stat.i.cache-references
1.27 -2.3% 1.24 perf-stat.i.cpi
278227 ± 5% -12.1% 244626 ± 5% perf-stat.i.cycles-between-cache-misses
1.563e+10 +2.5% 1.601e+10 perf-stat.i.dTLB-stores
1.078e+08 ± 9% -12.9% 93908148 ± 10% perf-stat.i.iTLB-load-misses
4631458 ± 14% -21.8% 3623934 ± 10% perf-stat.i.iTLB-loads
9.725e+10 +2.3% 9.947e+10 perf-stat.i.instructions
0.79 +2.4% 0.81 perf-stat.i.ipc
0.05 ± 2% +3.2% 0.05 perf-stat.overall.MPKI
1.44 -0.7 0.74 perf-stat.overall.branch-miss-rate%
1.27 -2.3% 1.24 perf-stat.overall.cpi
258391 ± 5% -11.3% 229282 ± 5% perf-stat.overall.cycles-between-cache-misses
0.79 +2.4% 0.81 perf-stat.overall.ipc
1.416e+10 +2.3% 1.449e+10 perf-stat.ps.branch-instructions
2.044e+08 -47.4% 1.075e+08 perf-stat.ps.branch-misses
478404 ± 5% +12.5% 538400 ± 5% perf-stat.ps.cache-misses
4859880 ± 2% +5.6% 5131025 perf-stat.ps.cache-references
1.558e+10 +2.5% 1.596e+10 perf-stat.ps.dTLB-stores
1.074e+08 ± 9% -12.9% 93588790 ± 10% perf-stat.ps.iTLB-load-misses
4615690 ± 14% -21.8% 3611652 ± 10% perf-stat.ps.iTLB-loads
9.691e+10 +2.3% 9.913e+10 perf-stat.ps.instructions
2.923e+13 +2.4% 2.992e+13 perf-stat.total.instructions
342.50 ± 13% +32.8% 455.00 ± 10% interrupts.68:PCI-MSI.12589057-edge.eth3-TxRx-0
3327 ± 15% +45.8% 4850 ± 9% interrupts.CPU0.NMI:Non-maskable_interrupts
3327 ± 15% +45.8% 4850 ± 9% interrupts.CPU0.PMI:Performance_monitoring_interrupts
3303 ± 14% +44.9% 4786 ± 9% interrupts.CPU1.NMI:Non-maskable_interrupts
3303 ± 14% +44.9% 4786 ± 9% interrupts.CPU1.PMI:Performance_monitoring_interrupts
3308 ± 14% +44.0% 4763 ± 10% interrupts.CPU10.NMI:Non-maskable_interrupts
3308 ± 14% +44.0% 4763 ± 10% interrupts.CPU10.PMI:Performance_monitoring_interrupts
3303 ± 14% +43.7% 4747 ± 10% interrupts.CPU11.NMI:Non-maskable_interrupts
3303 ± 14% +43.7% 4747 ± 10% interrupts.CPU11.PMI:Performance_monitoring_interrupts
3328 ± 15% +43.4% 4773 ± 10% interrupts.CPU12.NMI:Non-maskable_interrupts
3328 ± 15% +43.4% 4773 ± 10% interrupts.CPU12.PMI:Performance_monitoring_interrupts
19.50 ± 59% +2679.5% 542.00 ±139% interrupts.CPU15.RES:Rescheduling_interrupts
2013 ± 26% +109.1% 4208 ± 28% interrupts.CPU18.NMI:Non-maskable_interrupts
2013 ± 26% +109.1% 4208 ± 28% interrupts.CPU18.PMI:Performance_monitoring_interrupts
2005 ± 27% +108.9% 4189 ± 29% interrupts.CPU19.NMI:Non-maskable_interrupts
2005 ± 27% +108.9% 4189 ± 29% interrupts.CPU19.PMI:Performance_monitoring_interrupts
3343 ± 16% +42.6% 4769 ± 10% interrupts.CPU2.NMI:Non-maskable_interrupts
3343 ± 16% +42.6% 4769 ± 10% interrupts.CPU2.PMI:Performance_monitoring_interrupts
2187 ± 52% +90.6% 4170 ± 28% interrupts.CPU21.NMI:Non-maskable_interrupts
2187 ± 52% +90.6% 4170 ± 28% interrupts.CPU21.PMI:Performance_monitoring_interrupts
9.00 ± 27% +1941.7% 183.75 ±129% interrupts.CPU21.RES:Rescheduling_interrupts
2179 ± 52% +64.9% 3595 ± 37% interrupts.CPU22.NMI:Non-maskable_interrupts
2179 ± 52% +64.9% 3595 ± 37% interrupts.CPU22.PMI:Performance_monitoring_interrupts
2180 ± 52% +63.8% 3570 ± 37% interrupts.CPU23.NMI:Non-maskable_interrupts
2180 ± 52% +63.8% 3570 ± 37% interrupts.CPU23.PMI:Performance_monitoring_interrupts
2189 ± 52% +63.2% 3572 ± 37% interrupts.CPU24.NMI:Non-maskable_interrupts
2189 ± 52% +63.2% 3572 ± 37% interrupts.CPU24.PMI:Performance_monitoring_interrupts
2171 ± 52% +63.7% 3554 ± 38% interrupts.CPU25.NMI:Non-maskable_interrupts
2171 ± 52% +63.7% 3554 ± 38% interrupts.CPU25.PMI:Performance_monitoring_interrupts
2169 ± 52% +71.3% 3715 ± 43% interrupts.CPU27.NMI:Non-maskable_interrupts
2169 ± 52% +71.3% 3715 ± 43% interrupts.CPU27.PMI:Performance_monitoring_interrupts
2165 ± 52% +115.3% 4662 ± 32% interrupts.CPU28.NMI:Non-maskable_interrupts
2165 ± 52% +115.3% 4662 ± 32% interrupts.CPU28.PMI:Performance_monitoring_interrupts
2628 ± 41% +69.4% 4453 ± 27% interrupts.CPU29.NMI:Non-maskable_interrupts
2628 ± 41% +69.4% 4453 ± 27% interrupts.CPU29.PMI:Performance_monitoring_interrupts
2157 ± 50% +94.6% 4197 ± 28% interrupts.CPU30.NMI:Non-maskable_interrupts
2157 ± 50% +94.6% 4197 ± 28% interrupts.CPU30.PMI:Performance_monitoring_interrupts
2190 ± 52% +88.0% 4118 ± 29% interrupts.CPU31.NMI:Non-maskable_interrupts
2190 ± 52% +88.0% 4118 ± 29% interrupts.CPU31.PMI:Performance_monitoring_interrupts
2891 ± 29% +63.3% 4723 ± 10% interrupts.CPU33.NMI:Non-maskable_interrupts
2891 ± 29% +63.3% 4723 ± 10% interrupts.CPU33.PMI:Performance_monitoring_interrupts
2859 ± 27% +66.1% 4751 ± 10% interrupts.CPU34.NMI:Non-maskable_interrupts
2859 ± 27% +66.1% 4751 ± 10% interrupts.CPU34.PMI:Performance_monitoring_interrupts
2885 ± 28% +63.5% 4717 ± 10% interrupts.CPU35.NMI:Non-maskable_interrupts
2885 ± 28% +63.5% 4717 ± 10% interrupts.CPU35.PMI:Performance_monitoring_interrupts
3303 ± 14% +57.0% 5186 ± 14% interrupts.CPU36.NMI:Non-maskable_interrupts
3303 ± 14% +57.0% 5186 ± 14% interrupts.CPU36.PMI:Performance_monitoring_interrupts
3306 ± 14% +43.4% 4740 ± 10% interrupts.CPU37.NMI:Non-maskable_interrupts
3306 ± 14% +43.4% 4740 ± 10% interrupts.CPU37.PMI:Performance_monitoring_interrupts
3296 ± 14% +57.0% 5174 ± 14% interrupts.CPU38.NMI:Non-maskable_interrupts
3296 ± 14% +57.0% 5174 ± 14% interrupts.CPU38.PMI:Performance_monitoring_interrupts
3319 ± 14% +54.7% 5136 ± 15% interrupts.CPU39.NMI:Non-maskable_interrupts
3319 ± 14% +54.7% 5136 ± 15% interrupts.CPU39.PMI:Performance_monitoring_interrupts
3295 ± 14% +42.7% 4701 ± 10% interrupts.CPU4.NMI:Non-maskable_interrupts
3295 ± 14% +42.7% 4701 ± 10% interrupts.CPU4.PMI:Performance_monitoring_interrupts
3277 ± 14% +44.4% 4731 ± 10% interrupts.CPU40.NMI:Non-maskable_interrupts
3277 ± 14% +44.4% 4731 ± 10% interrupts.CPU40.PMI:Performance_monitoring_interrupts
9.25 ± 64% +6537.8% 614.00 ±112% interrupts.CPU48.RES:Rescheduling_interrupts
4174 ± 6% +22.3% 5106 ± 7% interrupts.CPU5.NMI:Non-maskable_interrupts
4174 ± 6% +22.3% 5106 ± 7% interrupts.CPU5.PMI:Performance_monitoring_interrupts
2620 ± 46% +80.3% 4725 ± 11% interrupts.CPU50.NMI:Non-maskable_interrupts
2620 ± 46% +80.3% 4725 ± 11% interrupts.CPU50.PMI:Performance_monitoring_interrupts
2612 ± 45% +82.4% 4763 ± 10% interrupts.CPU51.NMI:Non-maskable_interrupts
2612 ± 45% +82.4% 4763 ± 10% interrupts.CPU51.PMI:Performance_monitoring_interrupts
3355 ± 12% +51.8% 5094 ± 15% interrupts.CPU52.NMI:Non-maskable_interrupts
3355 ± 12% +51.8% 5094 ± 15% interrupts.CPU52.PMI:Performance_monitoring_interrupts
3381 ± 14% +64.2% 5553 ± 15% interrupts.CPU53.NMI:Non-maskable_interrupts
3381 ± 14% +64.2% 5553 ± 15% interrupts.CPU53.PMI:Performance_monitoring_interrupts
3350 ± 12% +52.2% 5099 ± 15% interrupts.CPU54.NMI:Non-maskable_interrupts
3350 ± 12% +52.2% 5099 ± 15% interrupts.CPU54.PMI:Performance_monitoring_interrupts
2949 ± 33% +59.4% 4701 ± 11% interrupts.CPU55.NMI:Non-maskable_interrupts
2949 ± 33% +59.4% 4701 ± 11% interrupts.CPU55.PMI:Performance_monitoring_interrupts
342.50 ± 13% +32.8% 455.00 ± 10% interrupts.CPU65.68:PCI-MSI.12589057-edge.eth3-TxRx-0
3325 ± 15% +42.4% 4735 ± 10% interrupts.CPU7.NMI:Non-maskable_interrupts
3325 ± 15% +42.4% 4735 ± 10% interrupts.CPU7.PMI:Performance_monitoring_interrupts
3333 ± 14% +42.2% 4739 ± 10% interrupts.CPU8.NMI:Non-maskable_interrupts
3333 ± 14% +42.2% 4739 ± 10% interrupts.CPU8.PMI:Performance_monitoring_interrupts
3333 ± 14% +43.3% 4777 ± 10% interrupts.CPU9.NMI:Non-maskable_interrupts
3333 ± 14% +43.3% 4777 ± 10% interrupts.CPU9.PMI:Performance_monitoring_interrupts
468484 ± 15% +21.6% 569837 interrupts.NMI:Non-maskable_interrupts
468484 ± 15% +21.6% 569837 interrupts.PMI:Performance_monitoring_interrupts
***************************************************************************************************
lkp-bdw-ep3d: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/thread/50%/debian-x86_64-2018-04-03-no-ucode.cgz/lkp-bdw-ep3d/futex4/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
2901967 +3.1% 2990951 will-it-scale.per_thread_ops
9330 -1.8% 9159 will-it-scale.time.system_time
3914 +4.4% 4084 will-it-scale.time.user_time
1.277e+08 +3.1% 1.316e+08 will-it-scale.workload
86447 +67.7% 145013 ± 58% cpuidle.POLL.time
79592 ± 48% +5261.0% 4266935 ±168% turbostat.C1E
14.00 +7.1% 15.00 vmstat.cpu.us
10229 +17.3% 11997 ± 15% sched_debug.cfs_rq:/.load.avg
10210 +17.3% 11981 ± 15% sched_debug.cfs_rq:/.runnable_weight.avg
10427 +100.4% 20894 ± 51% sched_debug.cfs_rq:/.runnable_weight.stddev
3.65 -21.3% 2.87 ± 2% sched_debug.cpu.clock.stddev
3.65 -21.3% 2.87 ± 2% sched_debug.cpu.clock_task.stddev
539.75 ± 51% -58.6% 223.25 ± 33% interrupts.36:PCI-MSI.3145733-edge.eth0-TxRx-4
539.75 ± 51% -58.6% 223.25 ± 33% interrupts.CPU15.36:PCI-MSI.3145733-edge.eth0-TxRx-4
58.00 ±163% -97.4% 1.50 ± 57% interrupts.CPU24.RES:Rescheduling_interrupts
33.75 ± 63% +2124.4% 750.75 ± 48% interrupts.CPU47.RES:Rescheduling_interrupts
5374 ± 33% -34.0% 3546 ± 32% interrupts.CPU72.NMI:Non-maskable_interrupts
5374 ± 33% -34.0% 3546 ± 32% interrupts.CPU72.PMI:Performance_monitoring_interrupts
5411 ± 32% -34.6% 3540 ± 32% interrupts.CPU79.NMI:Non-maskable_interrupts
5411 ± 32% -34.6% 3540 ± 32% interrupts.CPU79.PMI:Performance_monitoring_interrupts
11276 ± 6% +694.2% 89560 ±148% interrupts.RES:Rescheduling_interrupts
20950 +11.1% 23285 ± 6% softirqs.CPU11.RCU
19588 ± 2% +19.7% 23450 ± 5% softirqs.CPU15.RCU
18353 ± 14% +24.2% 22793 ± 6% softirqs.CPU16.RCU
20000 +11.7% 22349 ± 6% softirqs.CPU18.RCU
19975 +14.1% 22794 ± 5% softirqs.CPU19.RCU
20267 ± 2% +12.6% 22814 ± 3% softirqs.CPU20.RCU
20115 +15.1% 23144 ± 9% softirqs.CPU23.RCU
17876 ± 15% +20.3% 21509 ± 6% softirqs.CPU25.RCU
19571 +16.3% 22768 ± 4% softirqs.CPU26.RCU
19793 +16.2% 22992 ± 6% softirqs.CPU27.RCU
20419 +9.5% 22360 ± 7% softirqs.CPU3.RCU
128667 ± 27% -29.1% 91177 ± 3% softirqs.CPU33.TIMER
24150 ± 20% +28.9% 31140 ± 14% softirqs.CPU68.RCU
19588 ± 8% +16.8% 22885 ± 6% softirqs.CPU7.RCU
39375 ± 8% -17.1% 32661 ± 26% softirqs.CPU70.SCHED
24754 ± 18% +26.9% 31423 ± 14% softirqs.CPU72.RCU
39326 ± 9% -9.6% 35566 ± 13% softirqs.CPU78.SCHED
0.08 ± 2% -4.0% 0.07 ± 2% perf-stat.i.MPKI
1.058e+10 +3.0% 1.09e+10 perf-stat.i.branch-instructions
2.46 -1.2 1.25 perf-stat.i.branch-miss-rate%
2.599e+08 -47.6% 1.361e+08 perf-stat.i.branch-misses
1.68 -3.0% 1.63 perf-stat.i.cpi
1.89e+10 +2.6% 1.939e+10 ± 2% perf-stat.i.dTLB-loads
0.00 ± 29% -0.0 0.00 ± 5% perf-stat.i.dTLB-store-miss-rate%
103680 ± 34% -72.3% 28748 ± 12% perf-stat.i.dTLB-store-misses
1.678e+10 +2.0% 1.711e+10 perf-stat.i.dTLB-stores
7.327e+10 +3.0% 7.55e+10 perf-stat.i.instructions
0.59 +3.1% 0.61 perf-stat.i.ipc
68719 ± 2% +9.5% 75261 ± 6% perf-stat.i.node-load-misses
0.07 ± 2% -3.9% 0.07 ± 2% perf-stat.overall.MPKI
2.46 -1.2 1.25 perf-stat.overall.branch-miss-rate%
1.68 -3.0% 1.63 perf-stat.overall.cpi
0.00 ± 34% -0.0 0.00 ± 12% perf-stat.overall.dTLB-store-miss-rate%
0.59 +3.1% 0.61 perf-stat.overall.ipc
1.055e+10 +3.0% 1.086e+10 perf-stat.ps.branch-instructions
2.59e+08 -47.6% 1.357e+08 perf-stat.ps.branch-misses
1.883e+10 +2.6% 1.932e+10 ± 2% perf-stat.ps.dTLB-loads
103440 ± 34% -72.2% 28709 ± 12% perf-stat.ps.dTLB-store-misses
1.673e+10 +2.0% 1.705e+10 perf-stat.ps.dTLB-stores
7.302e+10 +3.0% 7.525e+10 perf-stat.ps.instructions
68505 ± 2% +9.5% 75031 ± 6% perf-stat.ps.node-load-misses
2.205e+13 +3.0% 2.272e+13 perf-stat.total.instructions
***************************************************************************************************
lkp-bdw-ep3d: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/thread/16/debian-x86_64-2018-04-03-no-ucode.cgz/lkp-bdw-ep3d/futex3/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
3600203 +5.4% 3793291 will-it-scale.per_thread_ops
3151 -3.0% 3058 will-it-scale.time.system_time
1664 +5.6% 1757 will-it-scale.time.user_time
57603256 +5.4% 60692675 will-it-scale.workload
1501 ±165% +378.2% 7180 ± 64% numa-numastat.node1.other_node
10.65 ± 7% -1.4 9.29 ± 7% perf-profile.calltrace.cycles-pp.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
29694546 ± 20% -64.2% 10632710 ± 96% cpuidle.C3.usage
8.85e+09 ± 54% +83.0% 1.62e+10 ± 22% cpuidle.C6.time
9019 ± 3% -6.7% 8412 ± 3% proc-vmstat.nr_shmem
5981 ± 7% -15.6% 5046 ± 9% proc-vmstat.pgactivate
1333 ± 2% -11.8% 1176 ± 7% slabinfo.kmalloc-rcl-96.active_objs
1333 ± 2% -11.8% 1176 ± 7% slabinfo.kmalloc-rcl-96.num_objs
6.25 ±138% +9.1e+05% 56693 ± 94% interrupts.CPU27.RES:Rescheduling_interrupts
705.25 ± 8% -23.1% 542.00 ± 24% interrupts.CPU31.NMI:Non-maskable_interrupts
705.25 ± 8% -23.1% 542.00 ± 24% interrupts.CPU31.PMI:Performance_monitoring_interrupts
29694116 ± 20% -64.2% 10631962 ± 96% turbostat.C3
33.23 ± 54% +27.6 60.82 ± 22% turbostat.C6%
42.30 ± 5% -12.9% 36.82 ± 7% turbostat.CPU%c1
13.87 ± 89% +148.9% 34.52 ± 30% turbostat.CPU%c6
130.83 -2.6% 127.37 turbostat.PkgWatt
130462 ± 18% -31.6% 89297 ± 24% numa-meminfo.node0.AnonHugePages
173402 ± 19% -24.7% 130542 ± 15% numa-meminfo.node0.AnonPages
13748 ± 45% +91.1% 26267 ± 27% numa-meminfo.node0.Shmem
68045 ± 51% +61.9% 110144 ± 19% numa-meminfo.node1.AnonPages
5645 ±117% -88.0% 678.50 ± 55% numa-meminfo.node1.Inactive
22332 ± 33% -66.9% 7389 ± 84% numa-meminfo.node1.Shmem
3.24 ± 6% -24.3% 2.45 ± 4% sched_debug.cpu.clock.stddev
3.24 ± 6% -24.3% 2.45 ± 4% sched_debug.cpu.clock_task.stddev
19.63 +12.4% 22.06 ± 10% sched_debug.cpu.cpu_load[1].stddev
19.88 +8.7% 21.61 ± 5% sched_debug.cpu.cpu_load[2].stddev
2798 ± 33% +52.9% 4278 ± 17% sched_debug.cpu.nr_load_updates.stddev
343.42 ± 3% -10.5% 307.33 ± 4% sched_debug.cpu.nr_switches.min
43351 ± 19% -24.7% 32635 ± 15% numa-vmstat.node0.nr_anon_pages
3436 ± 45% +91.0% 6564 ± 26% numa-vmstat.node0.nr_shmem
651210 ± 5% +15.3% 750851 ± 7% numa-vmstat.node0.numa_hit
635494 ± 5% +16.6% 740858 ± 7% numa-vmstat.node0.numa_local
15715 ± 15% -36.4% 9992 ± 46% numa-vmstat.node0.numa_other
17011 ± 51% +61.9% 27534 ± 19% numa-vmstat.node1.nr_anon_pages
3002 ± 13% -15.3% 2541 ± 10% numa-vmstat.node1.nr_mapped
5575 ± 33% -66.9% 1846 ± 84% numa-vmstat.node1.nr_shmem
17950 ± 9% +40.4% 25202 ± 19% softirqs.CPU17.RCU
41369 ± 5% +69.8% 70245 ± 38% softirqs.CPU27.SCHED
26213 ± 15% -25.1% 19636 ± 8% softirqs.CPU30.RCU
147213 ± 16% -24.0% 111950 ± 25% softirqs.CPU31.TIMER
29368 ± 11% -23.7% 22409 ± 8% softirqs.CPU33.RCU
40180 ± 7% -31.5% 27524 ± 31% softirqs.CPU48.SCHED
36027 ± 18% -21.8% 28180 ± 23% softirqs.CPU59.SCHED
17332 ± 6% +38.8% 24057 ± 18% softirqs.CPU61.RCU
23112 ± 17% -19.8% 18526 ± 2% softirqs.CPU74.RCU
146744 ± 16% -24.4% 110909 ± 24% softirqs.CPU75.TIMER
25217 ± 11% -16.6% 21027 ± 7% softirqs.CPU77.RCU
4.052e+09 +7.8% 4.368e+09 perf-stat.i.branch-instructions
3.09 ± 2% -1.4 1.72 ± 3% perf-stat.i.branch-miss-rate%
1.253e+08 ± 2% -40.0% 75127073 ± 2% perf-stat.i.branch-misses
1.81 -6.9% 1.69 perf-stat.i.cpi
0.64 ± 10% +24.4% 0.79 ± 12% perf-stat.i.cpu-migrations
2399825 ± 9% -18.4% 1957160 ± 15% perf-stat.i.dTLB-load-misses
0.01 ± 15% -0.0 0.01 ± 13% perf-stat.i.dTLB-store-miss-rate%
816574 ± 16% -42.9% 466292 ± 15% perf-stat.i.dTLB-store-misses
5.561e+09 +2.6% 5.708e+09 perf-stat.i.dTLB-stores
82665670 ± 7% +48.0% 1.223e+08 ± 23% perf-stat.i.iTLB-load-misses
2.772e+10 +6.8% 2.961e+10 perf-stat.i.instructions
0.55 +7.4% 0.59 perf-stat.i.ipc
40.59 ± 20% +13.6 54.15 ± 5% perf-stat.i.node-store-miss-rate%
3.09 ± 2% -1.4 1.72 ± 3% perf-stat.overall.branch-miss-rate%
1.81 -6.9% 1.69 perf-stat.overall.cpi
0.01 ± 15% -0.0 0.01 ± 13% perf-stat.overall.dTLB-store-miss-rate%
336.83 ± 6% -24.0% 255.95 ± 23% perf-stat.overall.instructions-per-iTLB-miss
0.55 +7.4% 0.59 perf-stat.overall.ipc
41.10 ± 18% +12.7 53.75 ± 4% perf-stat.overall.node-store-miss-rate%
144710 +1.4% 146728 perf-stat.overall.path-length
4.038e+09 +7.8% 4.354e+09 perf-stat.ps.branch-instructions
1.249e+08 ± 2% -40.0% 74877676 ± 2% perf-stat.ps.branch-misses
0.64 ± 10% +24.3% 0.80 ± 12% perf-stat.ps.cpu-migrations
2391882 ± 9% -18.4% 1950697 ± 15% perf-stat.ps.dTLB-load-misses
813904 ± 16% -42.9% 464755 ± 15% perf-stat.ps.dTLB-store-misses
5.542e+09 +2.6% 5.689e+09 perf-stat.ps.dTLB-stores
82386090 ± 7% +48.0% 1.219e+08 ± 23% perf-stat.ps.iTLB-load-misses
2.763e+10 +6.8% 2.951e+10 perf-stat.ps.instructions
8.336e+12 +6.8% 8.905e+12 perf-stat.total.instructions
***************************************************************************************************
lkp-bdw-ep3d: 88 threads Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz with 64G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-8/performance/x86_64-rhel-7.6/thread/16/debian-x86_64-2018-04-03-no-ucode.cgz/lkp-bdw-ep3d/futex4/will-it-scale
commit:
e6d7bc0bdf ("x86/build: Use the single-argument OUTPUT_FORMAT() linker script command")
ce02ef06fc ("x86, retpolines: Raise limit for generating indirect calls from switch-case")
e6d7bc0bdf4155e8 ce02ef06fcf7a399a6276adb83f
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
2901594 +3.0% 2989036 will-it-scale.per_thread_ops
3403 -2.0% 3333 will-it-scale.time.system_time
1413 +4.9% 1482 will-it-scale.time.user_time
46425522 +3.0% 47824586 will-it-scale.workload
5680 ± 4% +11.8% 6349 ± 8% numa-meminfo.node1.KernelStack
71724 ± 5% +9568.2% 6934407 ±102% turbostat.C1E
1037 -5.4% 981.00 ± 2% vmstat.system.cs
1093 ± 8% +21.7% 1330 ± 6% slabinfo.Acpi-Parse.active_objs
1093 ± 8% +21.7% 1330 ± 6% slabinfo.Acpi-Parse.num_objs
787410 ± 9% -13.4% 682189 ± 8% numa-vmstat.node0.numa_hit
773168 ± 9% -12.7% 674989 ± 8% numa-vmstat.node0.numa_local
5679 ± 4% +11.8% 6349 ± 8% numa-vmstat.node1.nr_kernel_stack
521.67 ± 3% +43.0% 745.92 ± 30% sched_debug.cfs_rq:/.util_est_enqueued.max
69097 ± 42% +170.3% 186784 ± 31% sched_debug.cpu.avg_idle.min
2683 ± 18% +70.7% 4580 ± 17% sched_debug.cpu.nr_load_updates.stddev
10622 ± 2% +17.4% 12471 ± 9% softirqs.CPU15.RCU
25703 ± 27% -35.0% 16703 ± 5% softirqs.CPU24.RCU
36148 ± 18% -31.8% 24645 ± 39% softirqs.CPU40.RCU
41400 ± 5% -30.7% 28681 ± 12% softirqs.CPU45.SCHED
39116 ± 3% -10.1% 35171 ± 7% softirqs.CPU47.RCU
42614 -48.3% 22023 ± 48% softirqs.CPU48.SCHED
39308 ± 4% -13.1% 34165 ± 9% softirqs.CPU52.RCU
40085 ± 4% -8.6% 36638 ± 5% softirqs.CPU55.RCU
35150 ± 16% -53.0% 16504 ± 39% softirqs.CPU79.RCU
52.73 ± 15% -11.1 41.65 ± 13% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
52.73 ± 15% -11.1 41.65 ± 13% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
52.72 ± 15% -11.1 41.63 ± 13% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.38 ± 19% +0.4 1.77 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock.futex_wait_setup.futex_wait.do_futex.__x64_sys_futex
1.07 ± 18% +0.5 1.54 ± 10% perf-profile.calltrace.cycles-pp.get_futex_key_refs.get_futex_key.futex_wait_setup.futex_wait.do_futex
3.06 ± 18% +1.0 4.03 ± 9% perf-profile.calltrace.cycles-pp.get_futex_value_locked.futex_wait_setup.futex_wait.do_futex.__x64_sys_futex
1.83 ± 17% +1.1 2.90 ± 11% perf-profile.calltrace.cycles-pp.get_futex_key.futex_wait_setup.futex_wait.do_futex.__x64_sys_futex
10.46 ± 19% +3.2 13.64 ± 8% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
11.64 ± 18% +3.6 15.28 ± 10% perf-profile.calltrace.cycles-pp.futex_wait_setup.futex_wait.do_futex.__x64_sys_futex.do_syscall_64
12.36 ± 18% +3.9 16.29 ± 10% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
13.77 ± 18% +4.1 17.91 ± 10% perf-profile.calltrace.cycles-pp.futex_wait.do_futex.__x64_sys_futex.do_syscall_64.entry_SYSCALL_64_after_hwframe
283155 -1.8% 278155 interrupts.CAL:Function_call_interrupts
686.25 ± 6% -22.3% 533.50 ± 24% interrupts.CPU26.NMI:Non-maskable_interrupts
686.25 ± 6% -22.3% 533.50 ± 24% interrupts.CPU26.PMI:Performance_monitoring_interrupts
651.25 ± 5% -27.1% 474.75 ± 33% interrupts.CPU27.NMI:Non-maskable_interrupts
651.25 ± 5% -27.1% 474.75 ± 33% interrupts.CPU27.PMI:Performance_monitoring_interrupts
30826 ±171% -100.0% 7.00 ± 67% interrupts.CPU27.RES:Rescheduling_interrupts
646.75 ± 7% -27.1% 471.50 ± 32% interrupts.CPU30.NMI:Non-maskable_interrupts
646.75 ± 7% -27.1% 471.50 ± 32% interrupts.CPU30.PMI:Performance_monitoring_interrupts
690.25 ± 9% -42.6% 396.50 ± 31% interrupts.CPU31.NMI:Non-maskable_interrupts
690.25 ± 9% -42.6% 396.50 ± 31% interrupts.CPU31.PMI:Performance_monitoring_interrupts
672.50 ± 8% -40.9% 397.75 ± 31% interrupts.CPU32.NMI:Non-maskable_interrupts
672.50 ± 8% -40.9% 397.75 ± 31% interrupts.CPU32.PMI:Performance_monitoring_interrupts
4895 ± 34% +61.0% 7883 interrupts.CPU5.NMI:Non-maskable_interrupts
4895 ± 34% +61.0% 7883 interrupts.CPU5.PMI:Performance_monitoring_interrupts
1.50 ±100% +3433.3% 53.00 ±154% interrupts.CPU67.RES:Rescheduling_interrupts
684.00 ± 6% -28.5% 488.75 ± 35% interrupts.CPU70.NMI:Non-maskable_interrupts
684.00 ± 6% -28.5% 488.75 ± 35% interrupts.CPU70.PMI:Performance_monitoring_interrupts
672.75 ± 5% -30.2% 469.50 ± 31% interrupts.CPU75.NMI:Non-maskable_interrupts
672.75 ± 5% -30.2% 469.50 ± 31% interrupts.CPU75.PMI:Performance_monitoring_interrupts
717.00 ± 8% -32.2% 486.00 ± 32% interrupts.CPU81.NMI:Non-maskable_interrupts
717.00 ± 8% -32.2% 486.00 ± 32% interrupts.CPU81.PMI:Performance_monitoring_interrupts
3.981e+09 +2.4% 4.078e+09 perf-stat.i.branch-instructions
2.71 -1.2 1.50 ± 2% perf-stat.i.branch-miss-rate%
1.076e+08 -43.4% 60927361 ± 2% perf-stat.i.branch-misses
0.26 ± 3% +0.1 0.36 ± 18% perf-stat.i.cache-miss-rate%
149100 +15.8% 172637 ± 9% perf-stat.i.cache-misses
1004 -5.5% 948.79 ± 3% perf-stat.i.context-switches
1.86 -4.3% 1.78 perf-stat.i.cpi
381642 -15.9% 321003 ± 9% perf-stat.i.cycles-between-cache-misses
2.733e+10 +2.4% 2.8e+10 perf-stat.i.instructions
442.76 ± 4% +19.7% 529.79 ± 18% perf-stat.i.instructions-per-iTLB-miss
0.54 +4.5% 0.56 perf-stat.i.ipc
61815 ± 9% +29.4% 80005 ± 9% perf-stat.i.node-load-misses
20179 ± 19% +49.9% 30255 ± 17% perf-stat.i.node-stores
2.70 -1.2 1.49 ± 2% perf-stat.overall.branch-miss-rate%
0.26 ± 3% +0.1 0.37 ± 19% perf-stat.overall.cache-miss-rate%
1.86 -4.3% 1.78 perf-stat.overall.cpi
341445 -14.6% 291501 ± 9% perf-stat.overall.cycles-between-cache-misses
438.67 ± 3% +20.4% 528.04 ± 18% perf-stat.overall.instructions-per-iTLB-miss
0.54 +4.5% 0.56 perf-stat.overall.ipc
3.968e+09 +2.4% 4.064e+09 perf-stat.ps.branch-instructions
1.073e+08 -43.4% 60725347 ± 2% perf-stat.ps.branch-misses
148665 +15.8% 172139 ± 9% perf-stat.ps.cache-misses
1000 -5.5% 945.65 ± 3% perf-stat.ps.context-switches
2.724e+10 +2.4% 2.79e+10 perf-stat.ps.instructions
61624 ± 9% +29.4% 79753 ± 9% perf-stat.ps.node-load-misses
20119 ± 19% +49.9% 30162 ± 17% perf-stat.ps.node-stores
8.225e+12 +2.4% 8.419e+12 perf-stat.total.instructions
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 7 months
- 2
- 1
[net] a410c2b2f6: WARNING:at_kernel/locking/lockdep.c:#lock_release
by kernel test robot
FYI, we noticed the following commit (built with gcc-5):
commit: a410c2b2f6fb75626ec604371f0765d9438c7d37 ("net: devlink: Don't take devlink_mutex for devlink_compat_*")
https://github.com/jpirko/linux_mlxsw jiri_devel_devlink
in testcase: locktorture
with following parameters:
runtime: 300s
test: default
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------+------------+------------+
| | 81357dcdda | a410c2b2f6 |
+-----------------------------------------------------+------------+------------+
| boot_successes | 10 | 2 |
| boot_failures | 2 | 10 |
| BUG:kernel_in_stage | 2 | |
| WARNING:at_kernel/locking/lockdep.c:#lock_release | 0 | 10 |
| RIP:lock_release | 0 | 10 |
| WARNING:at_kernel/locking/lockdep.c:#lock_downgrade | 0 | 3 |
| RIP:lock_downgrade | 0 | 3 |
+-----------------------------------------------------+------------+------------+
[ 25.261666] WARNING: CPU: 0 PID: 311 at kernel/locking/lockdep.c:3592 lock_release+0x8a/0x204
[ 25.264607] Modules linked in: button ipv6 autofs4
[ 25.265612] CPU: 0 PID: 311 Comm: systemd-udevd Not tainted 5.0.0-rc8-02528-ga410c2b #2
[ 25.267230] RIP: 0010:lock_release+0x8a/0x204
[ 25.268037] Code: 29 00 85 c0 0f 84 a0 00 00 00 83 3d 96 21 24 01 00 0f 85 93 00 00 00 48 c7 c6 7b a0 ea 81 48 c7 c7 a4 d1 e9 81 e8 a8 9d fd ff <0f> 0b eb 7c 48 8d 4c 24 0c 44 89 e2 4c 89 f6 48 89 ef e8 76 e3 ff
[ 25.271924] RSP: 0018:ffffc900007f3c60 EFLAGS: 00010082
[ 25.272977] RAX: 000000000000001f RBX: ffffffff822bfd20 RCX: 0000000000000000
[ 25.274411] RDX: ffffffff8109f1b4 RSI: 0000000000000001 RDI: ffffffff82219220
[ 25.275772] RBP: ffff88807d408000 R08: 000000000000001f R09: 0000000000000004
[ 25.277237] R10: ffffc900007f3d48 R11: ffffc900007f3a9d R12: 0000000000000000
[ 25.278637] R13: 0000000000000246 R14: ffffffff822bfd88 R15: ffffffff815f991f
[ 25.280070] FS: 00007f9c2ec358c0(0000) GS:ffffffff82046000(0000) knlGS:0000000000000000
[ 25.281681] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 25.282812] CR2: 000055d17cff2948 CR3: 000000007d40a000 CR4: 00000000000006b0
[ 25.284263] Call Trace:
[ 25.284754] __mutex_unlock_slowpath+0x35/0x1e9
[ 25.285670] __rtnl_unlock+0x20/0x4b
[ 25.286419] netdev_run_todo+0x4a/0x226
[ 25.287208] dev_ioctl+0x394/0x457
[ 25.287857] sock_do_ioctl+0xc5/0x102
[ 25.288832] ? do_wp_page+0x23f/0x247
[ 25.289585] ? sock_ioctl+0x2bf/0x2d7
[ 25.290352] ? __handle_mm_fault+0x751/0x783
[ 25.291234] sock_ioctl+0x2bf/0x2d7
[ 25.291916] ? vfs_ioctl+0x16/0x23
[ 25.292661] vfs_ioctl+0x16/0x23
[ 25.293344] do_vfs_ioctl+0x588/0x5fa
[ 25.294055] ? up_read+0x17/0x2b
[ 25.294742] ? __do_page_fault+0x329/0x3bc
[ 25.295572] ksys_ioctl+0x3b/0x59
[ 25.296269] __x64_sys_ioctl+0x11/0x14
[ 25.296995] do_syscall_64+0x53/0x61
[ 25.297726] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 25.298711] RIP: 0033:0x7f9c2daaedd7
[ 25.299451] Code: 00 00 00 48 8b 05 c1 80 2b 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 91 80 2b 00 f7 d8 64 89 01 48
[ 25.303180] RSP: 002b:00007ffe1c209878 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 25.304700] RAX: ffffffffffffffda RBX: 00007ffe1c2098c0 RCX: 00007f9c2daaedd7
[ 25.306065] RDX: 00007ffe1c209890 RSI: 0000000000008946 RDI: 0000000000000007
[ 25.307535] RBP: 00007ffe1c209a30 R08: 0000000000000000 R09: 00007f9c2dafbf20
[ 25.308933] R10: 0000000000000001 R11: 0000000000000246 R12: 000055d17cff2940
[ 25.310381] R13: 00007ffe1c209890 R14: 0000000000000001 R15: 0000000000000000
[ 25.311815] ---[ end trace 541c01cf83dcde04 ]---
To reproduce:
# build kernel
cd linux
cp config-5.0.0-rc8-02528-ga410c2b .config
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 prepare
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-5 CC=gcc-5 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 7 months
- 1
- 0
Re: [LKP] [ext4] fde872682e: fsmark.files_per_sec -38.0% regression
by Theodore Ts'o
On Wed, Mar 13, 2019 at 03:26:39PM +0800, huang ying wrote:
> >
> >
> > commit: fde872682e175743e0c3ef939c89e3c6008a1529 ("ext4: force inode writes when nfsd calls commit_metadata()")
> > https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
>
> It appears that this is a performance regression caused by a
> functionality fixing. So we should ignore this?
Yes, this is a correctness issue that we discovered while tracking
down user data loss issue after a crash of the NFS server, so this is
a change we have to keep. When the NFS folks added the
commit_metadata() hook, they didn't realize that the fallback path in
nfsd/vfs.c using sync_inode_metadata() doesn't work on all file
systems --- and in particular doesn't work for ext3 and ext4 because
of how we do journalling.
It only applies to NFS serving, not local ext4 use cases, so most ext4
users won't be impacted on it; only those who export those file
systems using NFS.
I do have some plans on how to claw back the performance hit. The
good news is that it won't require an on-disk format change; the bad
news is that it's a non-trivial change to how journalling works, and
it's not something we can backport to the stable kernel series. It's
something we're going to have to leave to a distribution who is
willing to do a lot of careful regression testing, once the change is
available, maybe in 3 months or so.
- Ted
P.S. I *believe* all other file systems should be OK, and I didn't
want to impose a performance tax on all other file systems (such as
btrfs), so I fixed it in an ext4-specific way. The more
general/conservative change would be to fall back to using fsync in
nfs/vfs.c:commit_metadata() unless the file system specifically set a
superblock flag indicating that using sync_inode_metadata is safe.
OTOH we lived with this flaw in ext3/ext4 for *years* without anyone
noticing or complaining, so....
1 year, 7 months
- 2
- 1
[btrfs] 44fe89de7d: aim7.jobs-per-min -15.1% regression
by kernel test robot
Greeting,
FYI, we noticed a -15.1% regression of aim7.jobs-per-min due to commit:
commit: 44fe89de7d5157a4f31f13d94802c7619e23f462 ("btrfs: Do mandatory tree block check before submitting bio")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: aim7
on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
with following parameters:
disk: 4BRD_12G
md: RAID0
fs: btrfs
test: sync_disk_rw
load: 20
cpufreq_governor: performance
test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/
In addition to that, the commit also has significant impact on the following tests:
+------------------+-----------------------------------------------------------------------+
| testcase: change | aim7: aim7.jobs-per-min -20.8% regression |
| test machine | 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory |
| test parameters | cpufreq_governor=performance |
| | disk=4BRD_12G |
| | fs=btrfs |
| | load=20 |
| | md=RAID0 |
| | test=sync_disk_rw |
+------------------+-----------------------------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase:
gcc-8/performance/4BRD_12G/btrfs/x86_64-rhel-7.6/20/RAID0/debian-x86_64-2018-04-03.cgz/lkp-skl-2sp7/sync_disk_rw/aim7
commit:
a92e9c3a3c ("btrfs: extent_io: Handle error better in extent_writepages()")
44fe89de7d ("btrfs: Do mandatory tree block check before submitting bio")
a92e9c3a3cef4c0c 44fe89de7d5157a4f31f13d9480
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
%stddev %change %stddev
\ | \
1204 -15.1% 1022 aim7.jobs-per-min
99.66 +18.3% 117.93 aim7.time.elapsed_time
99.66 +18.3% 117.93 aim7.time.elapsed_time.max
3014 ± 2% -3.1% 2921 aim7.time.minor_page_faults
1.236e+09 +44.6% 1.787e+09 ± 27% cpuidle.C1.time
90473 +15.8% 104758 ± 2% meminfo.AnonHugePages
102742 -16.5% 85841 ± 2% meminfo.max_used_kB
11.68 -1.8 9.85 mpstat.cpu.-1.sys%
0.07 ± 7% -0.0 0.05 ± 17% mpstat.cpu.-1.usr%
664.25 ± 4% +18.1% 784.25 ± 6% slabinfo.dmaengine-unmap-16.active_objs
664.25 ± 4% +18.1% 784.25 ± 6% slabinfo.dmaengine-unmap-16.num_objs
88.00 +2.3% 90.00 vmstat.cpu.id
346712 -15.5% 293086 vmstat.io.bo
558192 -15.4% 472096 vmstat.system.cs
88.42 +2.0% 90.19 iostat.cpu.idle
11.50 -15.3% 9.74 iostat.cpu.system
19892 -15.2% 16877 iostat.md0.w/s
451087 -15.4% 381436 iostat.md0.wkB/s
252.75 ± 2% -19.8% 202.67 ± 16% sched_debug.cfs_rq:/.removed.util_avg.max
57.62 ± 2% +71.4% 98.79 ± 51% sched_debug.cpu.cpu_load[1].max
47.75 ± 13% +81.6% 86.71 ± 43% sched_debug.cpu.cpu_load[2].max
7.35 ± 13% -16.4% 6.14 ± 4% sched_debug.cpu.cpu_load[4].avg
422.75 -14.3% 362.50 turbostat.Avg_MHz
14.00 -2.0 12.04 turbostat.Busy%
15068782 +15.6% 17424116 ± 2% turbostat.IRQ
163.49 -2.2% 159.86 turbostat.PkgWatt
516444 +2.0% 526872 proc-vmstat.nr_active_file
890319 +1.4% 902554 proc-vmstat.nr_file_pages
4668 -1.7% 4591 proc-vmstat.nr_inactive_anon
516444 +2.0% 526872 proc-vmstat.nr_zone_active_file
4668 -1.7% 4591 proc-vmstat.nr_zone_inactive_anon
288573 +14.8% 331243 proc-vmstat.pgfault
716355 +7.5% 770096 proc-vmstat.pgfree
24648391 -12.7% 21521966 ± 5% perf-stat.i.branch-misses
27.60 -1.9 25.66 ± 2% perf-stat.i.cache-miss-rate%
33238901 -22.5% 25763877 ± 2% perf-stat.i.cache-misses
1.163e+08 -13.8% 1.002e+08 ± 3% perf-stat.i.cache-references
570181 -15.7% 480734 perf-stat.i.context-switches
4.53 ± 3% -20.6% 3.60 ± 2% perf-stat.i.cpi
3.02e+10 -14.5% 2.581e+10 perf-stat.i.cpu-cycles
12.93 ± 11% -23.2% 9.92 ± 7% perf-stat.i.cpu-migrations
1.81e+09 +8.7% 1.968e+09 ± 3% perf-stat.i.dTLB-loads
1.018e+09 +10.9% 1.129e+09 perf-stat.i.dTLB-stores
8329645 -15.2% 7063121 perf-stat.i.iTLB-loads
6.662e+09 +9.5% 7.297e+09 perf-stat.i.instructions
93411 ± 7% +20.1% 112199 ± 6% perf-stat.i.instructions-per-iTLB-miss
0.24 ± 4% +21.3% 0.30 perf-stat.i.ipc
2719 -2.6% 2650 perf-stat.i.minor-faults
10179150 -22.8% 7861388 ± 2% perf-stat.i.node-load-misses
819501 -18.0% 672068 perf-stat.i.node-loads
79.98 -3.6 76.35 perf-stat.i.node-store-miss-rate%
3971266 -23.9% 3020404 perf-stat.i.node-store-misses
760058 ± 3% -7.2% 705596 perf-stat.i.node-stores
2720 -2.6% 2650 perf-stat.i.page-faults
17.46 -21.4% 13.73 ± 2% perf-stat.overall.MPKI
1.87 -0.3 1.59 ± 3% perf-stat.overall.branch-miss-rate%
28.58 -2.8 25.75 ± 4% perf-stat.overall.cache-miss-rate%
4.53 -22.0% 3.54 perf-stat.overall.cpi
908.69 +10.3% 1002 ± 2% perf-stat.overall.cycles-between-cache-misses
0.22 +28.1% 0.28 perf-stat.overall.ipc
83.93 -2.9 81.06 perf-stat.overall.node-store-miss-rate%
24408968 -12.5% 21345782 ± 5% perf-stat.ps.branch-misses
32896998 -22.4% 25539476 ± 2% perf-stat.ps.cache-misses
1.151e+08 -13.7% 99343827 ± 3% perf-stat.ps.cache-references
564308 -15.6% 476544 perf-stat.ps.context-switches
2.989e+10 -14.4% 2.558e+10 perf-stat.ps.cpu-cycles
12.79 ± 11% -23.1% 9.84 ± 7% perf-stat.ps.cpu-migrations
1.792e+09 +8.9% 1.951e+09 ± 3% perf-stat.ps.dTLB-loads
1.008e+09 +11.1% 1.12e+09 perf-stat.ps.dTLB-stores
8244056 -15.1% 7001712 perf-stat.ps.iTLB-loads
6.595e+09 +9.7% 7.235e+09 perf-stat.ps.instructions
2693 -2.4% 2628 perf-stat.ps.minor-faults
10074272 -22.6% 7792778 ± 2% perf-stat.ps.node-load-misses
811079 -17.9% 666222 perf-stat.ps.node-loads
3930342 -23.8% 2994037 perf-stat.ps.node-store-misses
752248 ± 3% -7.0% 699463 perf-stat.ps.node-stores
2693 -2.4% 2628 perf-stat.ps.page-faults
6.6e+11 +29.8% 8.564e+11 perf-stat.total.instructions
44.42 -3.1 41.36 ± 3% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
46.97 -2.2 44.77 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
50.60 -1.9 48.74 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
49.88 -1.7 48.21 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
49.90 -1.7 48.24 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
49.90 -1.7 48.24 ± 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
4.89 ± 12% -1.0 3.84 ± 6% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io
4.89 ± 12% -1.0 3.84 ± 6% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper
5.75 ± 6% -0.7 5.07 ± 3% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents
2.90 ± 11% -0.6 2.30 ± 5% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent
5.82 ± 2% -0.5 5.35 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot
1.78 ± 14% -0.4 1.34 ± 6% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent
4.25 ± 7% -0.4 3.82 perf-profile.calltrace.cycles-pp.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents
2.73 ± 7% -0.3 2.43 ± 4% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
8.78 -0.3 8.49 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot
1.78 ± 8% -0.3 1.52 ± 3% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
8.54 -0.3 8.28 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node
2.15 ± 2% -0.2 1.99 ± 5% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_insert_empty_items
1.43 -0.1 1.36 ± 3% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_csum
1.02 ± 2% -0.1 0.97 perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_csum_file_blocks.btrfs_log_changed_extents.btrfs_log_inode
1.02 ± 3% -0.0 0.97 perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_csum_file_blocks.btrfs_log_changed_extents
0.95 ± 5% +0.2 1.11 ± 7% perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__filemap_fdatawrite_range
1.12 ± 2% +0.2 1.32 ± 6% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file
1.05 ± 3% +0.2 1.24 ± 5% perf-profile.calltrace.cycles-pp.extent_write_cache_pages.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range
1.25 ± 2% +0.2 1.46 ± 5% perf-profile.calltrace.cycles-pp.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter
0.68 ± 6% +0.2 0.92 ± 6% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
1.45 ± 2% +0.2 1.70 ± 4% perf-profile.calltrace.cycles-pp.wait_log_commit.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter.__vfs_write
0.84 ± 13% +0.3 1.10 ± 3% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.70 ± 6% +0.3 0.95 ± 6% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.25 ±100% +0.3 0.56 ± 5% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages
1.55 ± 2% +0.3 1.87 ± 5% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file
1.55 ± 2% +0.3 1.87 ± 5% perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops
1.57 ± 2% +0.3 1.89 ± 5% perf-profile.calltrace.cycles-pp.start_ordered_ops.btrfs_sync_file.btrfs_file_write_iter.__vfs_write.vfs_write
1.56 ± 2% +0.3 1.88 ± 5% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.btrfs_file_write_iter
1.56 ± 2% +0.3 1.88 ± 5% perf-profile.calltrace.cycles-pp.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.btrfs_file_write_iter.__vfs_write
0.26 ±100% +0.4 0.62 ± 6% perf-profile.calltrace.cycles-pp.submit_one_bio.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range
0.26 ±100% +0.4 0.62 ± 6% perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.extent_writepages.do_writepages.__filemap_fdatawrite_range
0.00 +0.6 0.56 ± 5% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages
0.00 +0.6 0.56 ± 5% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.btrfs_map_bio.btree_submit_bio_hook.submit_one_bio
0.00 +0.6 0.58 ± 6% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages.do_writepages
0.19 ±173% +0.6 0.78 ± 27% perf-profile.calltrace.cycles-pp.btrfs_next_old_leaf.btrfs_csum_file_blocks.btrfs_log_changed_extents.btrfs_log_inode.btrfs_log_inode_parent
0.00 +0.8 0.84 ± 5% perf-profile.calltrace.cycles-pp.btrfs_get_token_32.check_leaf.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook
0.00 +1.3 1.32 ± 6% perf-profile.calltrace.cycles-pp.check_leaf.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio
0.00 +1.4 1.39 ± 5% perf-profile.calltrace.cycles-pp.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages
0.00 +1.4 1.39 ± 6% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages
0.75 ± 4% +1.5 2.23 ± 5% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
0.76 ± 3% +1.5 2.24 ± 5% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter.__vfs_write
0.75 ± 4% +1.5 2.23 ± 5% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter
0.75 ± 4% +1.5 2.23 ± 5% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
0.38 ± 57% +1.6 1.96 ± 6% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range
0.38 ± 57% +1.6 1.96 ± 5% perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents
2.42 ± 2% +1.8 4.18 ± 4% perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter.__vfs_write.vfs_write
38.62 +2.5 41.15 ± 3% perf-profile.calltrace.cycles-pp.btrfs_sync_file.btrfs_file_write_iter.__vfs_write.vfs_write.ksys_write
39.95 +2.6 42.52 ± 3% perf-profile.calltrace.cycles-pp.__vfs_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
39.95 +2.6 42.52 ± 3% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.__vfs_write.vfs_write.ksys_write.do_syscall_64
39.99 +2.6 42.56 ± 3% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
39.98 +2.6 42.55 ± 3% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
40.19 +2.6 42.81 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
40.19 +2.6 42.81 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
97.75 ± 21% +77.5% 173.50 ± 21% interrupts.70:PCI-MSI.12589059-edge.eth3-TxRx-2
63.25 ± 9% +51.4% 95.75 ± 25% interrupts.71:PCI-MSI.12589060-edge.eth3-TxRx-3
202.50 +17.8% 238.50 interrupts.9:IO-APIC.9-fasteoi.acpi
88724 +12.8% 100056 interrupts.CAL:Function_call_interrupts
1255 +12.4% 1410 interrupts.CPU0.CAL:Function_call_interrupts
201136 +17.1% 235497 ± 2% interrupts.CPU0.LOC:Local_timer_interrupts
202.50 +17.8% 238.50 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
1242 +13.2% 1407 interrupts.CPU1.CAL:Function_call_interrupts
200860 +16.6% 234199 ± 2% interrupts.CPU1.LOC:Local_timer_interrupts
3195 ± 24% -60.2% 1273 ± 95% interrupts.CPU1.NMI:Non-maskable_interrupts
3195 ± 24% -60.2% 1273 ± 95% interrupts.CPU1.PMI:Performance_monitoring_interrupts
200768 +16.8% 234566 interrupts.CPU10.LOC:Local_timer_interrupts
200322 +17.1% 234482 ± 2% interrupts.CPU11.LOC:Local_timer_interrupts
1174 ± 11% +18.3% 1389 interrupts.CPU12.CAL:Function_call_interrupts
200965 +16.4% 233853 interrupts.CPU12.LOC:Local_timer_interrupts
1209 ± 4% +15.4% 1396 interrupts.CPU13.CAL:Function_call_interrupts
199915 +17.6% 235085 ± 2% interrupts.CPU13.LOC:Local_timer_interrupts
1187 ± 8% +18.1% 1403 interrupts.CPU14.CAL:Function_call_interrupts
200677 +17.2% 235290 ± 2% interrupts.CPU14.LOC:Local_timer_interrupts
1208 ± 5% +13.2% 1367 ± 4% interrupts.CPU15.CAL:Function_call_interrupts
200566 +17.3% 235226 ± 2% interrupts.CPU15.LOC:Local_timer_interrupts
200800 +17.1% 235099 ± 2% interrupts.CPU16.LOC:Local_timer_interrupts
1217 ± 4% +15.3% 1403 interrupts.CPU17.CAL:Function_call_interrupts
200473 +16.6% 233816 interrupts.CPU17.LOC:Local_timer_interrupts
1246 +12.8% 1406 interrupts.CPU18.CAL:Function_call_interrupts
200863 +16.4% 233829 ± 3% interrupts.CPU18.LOC:Local_timer_interrupts
1243 +12.7% 1400 interrupts.CPU19.CAL:Function_call_interrupts
200576 +16.0% 232732 ± 2% interrupts.CPU19.LOC:Local_timer_interrupts
1247 +12.9% 1407 interrupts.CPU2.CAL:Function_call_interrupts
200971 +16.9% 234895 ± 2% interrupts.CPU2.LOC:Local_timer_interrupts
1247 +12.7% 1406 interrupts.CPU20.CAL:Function_call_interrupts
200473 +16.6% 233803 ± 3% interrupts.CPU20.LOC:Local_timer_interrupts
1247 +12.6% 1404 interrupts.CPU21.CAL:Function_call_interrupts
200696 +16.2% 233299 ± 2% interrupts.CPU21.LOC:Local_timer_interrupts
1247 +13.1% 1411 interrupts.CPU22.CAL:Function_call_interrupts
200814 +16.4% 233758 ± 3% interrupts.CPU22.LOC:Local_timer_interrupts
4891 ± 12% -24.7% 3681 ± 12% interrupts.CPU22.RES:Rescheduling_interrupts
1247 +13.0% 1410 interrupts.CPU23.CAL:Function_call_interrupts
200828 +16.4% 233716 ± 3% interrupts.CPU23.LOC:Local_timer_interrupts
1247 +14.3% 1426 ± 3% interrupts.CPU24.CAL:Function_call_interrupts
200833 +16.5% 233997 ± 3% interrupts.CPU24.LOC:Local_timer_interrupts
1246 +12.9% 1407 interrupts.CPU25.CAL:Function_call_interrupts
201055 +16.3% 233920 ± 3% interrupts.CPU25.LOC:Local_timer_interrupts
1265 ± 2% +12.7% 1425 ± 2% interrupts.CPU26.CAL:Function_call_interrupts
201132 +15.9% 233180 ± 3% interrupts.CPU26.LOC:Local_timer_interrupts
1173 ± 10% +20.0% 1407 interrupts.CPU27.CAL:Function_call_interrupts
201166 +15.9% 233210 ± 3% interrupts.CPU27.LOC:Local_timer_interrupts
1263 ± 2% +11.4% 1407 interrupts.CPU28.CAL:Function_call_interrupts
201049 +16.3% 233848 ± 3% interrupts.CPU28.LOC:Local_timer_interrupts
1241 +13.5% 1409 interrupts.CPU29.CAL:Function_call_interrupts
200963 +16.3% 233774 ± 3% interrupts.CPU29.LOC:Local_timer_interrupts
97.75 ± 21% +77.5% 173.50 ± 21% interrupts.CPU3.70:PCI-MSI.12589059-edge.eth3-TxRx-2
1210 ± 5% +13.2% 1369 ± 3% interrupts.CPU3.CAL:Function_call_interrupts
199954 +17.1% 234167 ± 2% interrupts.CPU3.LOC:Local_timer_interrupts
1181 ± 9% +19.1% 1407 interrupts.CPU30.CAL:Function_call_interrupts
200986 +16.4% 233892 ± 3% interrupts.CPU30.LOC:Local_timer_interrupts
1127 ± 18% +24.7% 1406 interrupts.CPU31.CAL:Function_call_interrupts
201110 +16.2% 233756 ± 3% interrupts.CPU31.LOC:Local_timer_interrupts
1249 +13.0% 1412 interrupts.CPU32.CAL:Function_call_interrupts
200832 +16.4% 233787 ± 3% interrupts.CPU32.LOC:Local_timer_interrupts
1249 +13.3% 1416 interrupts.CPU33.CAL:Function_call_interrupts
200969 +16.3% 233758 ± 3% interrupts.CPU33.LOC:Local_timer_interrupts
1246 +13.4% 1413 interrupts.CPU34.CAL:Function_call_interrupts
199891 +17.1% 234012 ± 3% interrupts.CPU34.LOC:Local_timer_interrupts
1234 +13.3% 1399 interrupts.CPU35.CAL:Function_call_interrupts
200721 +16.2% 233256 ± 2% interrupts.CPU35.LOC:Local_timer_interrupts
3994 ± 14% -50.7% 1970 ± 48% interrupts.CPU35.RES:Rescheduling_interrupts
1242 +12.9% 1402 ± 2% interrupts.CPU36.CAL:Function_call_interrupts
199765 +17.7% 235071 ± 2% interrupts.CPU36.LOC:Local_timer_interrupts
200843 +16.6% 234175 ± 2% interrupts.CPU37.LOC:Local_timer_interrupts
1248 +13.4% 1415 interrupts.CPU38.CAL:Function_call_interrupts
200016 +17.0% 234095 ± 2% interrupts.CPU38.LOC:Local_timer_interrupts
1249 +13.0% 1411 interrupts.CPU39.CAL:Function_call_interrupts
200714 +17.2% 235250 ± 2% interrupts.CPU39.LOC:Local_timer_interrupts
63.25 ± 9% +51.4% 95.75 ± 25% interrupts.CPU4.71:PCI-MSI.12589060-edge.eth3-TxRx-3
1246 +13.9% 1419 ± 2% interrupts.CPU4.CAL:Function_call_interrupts
200637 +17.2% 235179 ± 2% interrupts.CPU4.LOC:Local_timer_interrupts
200593 +17.2% 235093 ± 2% interrupts.CPU40.LOC:Local_timer_interrupts
1248 +13.0% 1410 interrupts.CPU41.CAL:Function_call_interrupts
200998 +16.6% 234380 interrupts.CPU41.LOC:Local_timer_interrupts
1249 +12.9% 1410 interrupts.CPU42.CAL:Function_call_interrupts
200934 +16.6% 234357 interrupts.CPU42.LOC:Local_timer_interrupts
1246 +13.2% 1411 interrupts.CPU43.CAL:Function_call_interrupts
200894 +16.9% 234942 ± 2% interrupts.CPU43.LOC:Local_timer_interrupts
1211 ± 5% +16.3% 1408 interrupts.CPU44.CAL:Function_call_interrupts
200154 +17.4% 235070 ± 2% interrupts.CPU44.LOC:Local_timer_interrupts
2454 ± 23% +50.0% 3682 ± 14% interrupts.CPU44.RES:Rescheduling_interrupts
1248 +13.0% 1410 interrupts.CPU45.CAL:Function_call_interrupts
200774 +16.7% 234259 ± 2% interrupts.CPU45.LOC:Local_timer_interrupts
1246 +13.1% 1410 interrupts.CPU46.CAL:Function_call_interrupts
201184 +16.8% 234966 ± 2% interrupts.CPU46.LOC:Local_timer_interrupts
1246 +13.1% 1409 interrupts.CPU47.CAL:Function_call_interrupts
200672 +16.7% 234200 interrupts.CPU47.LOC:Local_timer_interrupts
200070 +17.7% 235463 ± 2% interrupts.CPU48.LOC:Local_timer_interrupts
1251 +12.6% 1409 interrupts.CPU49.CAL:Function_call_interrupts
200232 +17.4% 235071 ± 2% interrupts.CPU49.LOC:Local_timer_interrupts
200450 +17.4% 235328 ± 2% interrupts.CPU5.LOC:Local_timer_interrupts
1216 ± 5% +15.7% 1407 interrupts.CPU50.CAL:Function_call_interrupts
201051 +16.5% 234316 interrupts.CPU50.LOC:Local_timer_interrupts
1252 +12.6% 1410 interrupts.CPU51.CAL:Function_call_interrupts
200007 +17.5% 235046 ± 2% interrupts.CPU51.LOC:Local_timer_interrupts
1253 +12.4% 1408 interrupts.CPU52.CAL:Function_call_interrupts
200770 +17.0% 234811 ± 2% interrupts.CPU52.LOC:Local_timer_interrupts
1252 +12.2% 1405 interrupts.CPU53.CAL:Function_call_interrupts
200095 +17.4% 235004 ± 2% interrupts.CPU53.LOC:Local_timer_interrupts
1252 +12.6% 1410 interrupts.CPU54.CAL:Function_call_interrupts
200697 +16.5% 233818 ± 3% interrupts.CPU54.LOC:Local_timer_interrupts
1252 +12.6% 1409 interrupts.CPU55.CAL:Function_call_interrupts
200852 +16.5% 234024 ± 3% interrupts.CPU55.LOC:Local_timer_interrupts
1251 +12.5% 1407 interrupts.CPU56.CAL:Function_call_interrupts
200874 +16.4% 233828 ± 3% interrupts.CPU56.LOC:Local_timer_interrupts
1251 +12.3% 1404 interrupts.CPU57.CAL:Function_call_interrupts
200887 +16.5% 233974 ± 3% interrupts.CPU57.LOC:Local_timer_interrupts
1250 +12.8% 1411 interrupts.CPU58.CAL:Function_call_interrupts
200837 +16.4% 233702 ± 3% interrupts.CPU58.LOC:Local_timer_interrupts
1250 +12.8% 1410 interrupts.CPU59.CAL:Function_call_interrupts
199809 +17.1% 233932 ± 3% interrupts.CPU59.LOC:Local_timer_interrupts
1262 ± 2% +10.5% 1394 interrupts.CPU6.CAL:Function_call_interrupts
201108 +16.6% 234545 interrupts.CPU6.LOC:Local_timer_interrupts
1253 +12.6% 1411 interrupts.CPU60.CAL:Function_call_interrupts
200941 +16.4% 233857 ± 3% interrupts.CPU60.LOC:Local_timer_interrupts
2285 ± 53% -55.3% 1021 ± 85% interrupts.CPU60.NMI:Non-maskable_interrupts
2285 ± 53% -55.3% 1021 ± 85% interrupts.CPU60.PMI:Performance_monitoring_interrupts
1213 ± 4% +16.2% 1410 interrupts.CPU61.CAL:Function_call_interrupts
200849 +16.4% 233812 ± 3% interrupts.CPU61.LOC:Local_timer_interrupts
1250 +12.7% 1408 interrupts.CPU62.CAL:Function_call_interrupts
200858 +16.4% 233847 ± 3% interrupts.CPU62.LOC:Local_timer_interrupts
1249 +12.7% 1408 interrupts.CPU63.CAL:Function_call_interrupts
200846 +16.3% 233509 ± 3% interrupts.CPU63.LOC:Local_timer_interrupts
1249 +12.6% 1407 interrupts.CPU64.CAL:Function_call_interrupts
201010 +16.3% 233868 ± 3% interrupts.CPU64.LOC:Local_timer_interrupts
1249 +12.6% 1407 interrupts.CPU65.CAL:Function_call_interrupts
201188 +16.2% 233840 ± 3% interrupts.CPU65.LOC:Local_timer_interrupts
1249 +12.6% 1405 interrupts.CPU66.CAL:Function_call_interrupts
201142 +16.3% 233885 ± 3% interrupts.CPU66.LOC:Local_timer_interrupts
1249 +12.6% 1406 interrupts.CPU67.CAL:Function_call_interrupts
200840 +16.5% 233913 ± 3% interrupts.CPU67.LOC:Local_timer_interrupts
1249 +12.7% 1408 interrupts.CPU68.CAL:Function_call_interrupts
200815 +16.4% 233774 ± 3% interrupts.CPU68.LOC:Local_timer_interrupts
1249 +12.8% 1409 interrupts.CPU69.CAL:Function_call_interrupts
200983 +16.3% 233829 ± 3% interrupts.CPU69.LOC:Local_timer_interrupts
200912 +17.1% 235169 ± 2% interrupts.CPU7.LOC:Local_timer_interrupts
1249 +13.0% 1412 interrupts.CPU70.CAL:Function_call_interrupts
200821 +16.4% 233823 ± 3% interrupts.CPU70.LOC:Local_timer_interrupts
1247 +12.9% 1408 interrupts.CPU71.CAL:Function_call_interrupts
200673 +16.4% 233586 ± 3% interrupts.CPU71.LOC:Local_timer_interrupts
3112 ± 28% -55.8% 1376 ± 92% interrupts.CPU71.NMI:Non-maskable_interrupts
3112 ± 28% -55.8% 1376 ± 92% interrupts.CPU71.PMI:Performance_monitoring_interrupts
2655 ± 18% +53.3% 4071 ± 21% interrupts.CPU71.RES:Rescheduling_interrupts
1088 ± 16% +25.1% 1361 ± 4% interrupts.CPU8.CAL:Function_call_interrupts
201291 +16.9% 235317 ± 2% interrupts.CPU8.LOC:Local_timer_interrupts
201246 +16.4% 234250 interrupts.CPU9.LOC:Local_timer_interrupts
14452726 +16.7% 16865906 ± 2% interrupts.LOC:Local_timer_interrupts
25553 ± 7% +26.4% 32295 softirqs.CPU0.RCU
17578 +14.6% 20147 ± 2% softirqs.CPU0.SCHED
40851 +20.4% 49167 ± 3% softirqs.CPU0.TIMER
40546 +17.0% 47455 ± 5% softirqs.CPU1.TIMER
25814 +27.1% 32807 ± 10% softirqs.CPU10.RCU
38717 ± 2% +14.6% 44386 ± 5% softirqs.CPU10.TIMER
38245 +16.3% 44468 ± 5% softirqs.CPU11.TIMER
26439 ± 4% +21.3% 32083 ± 4% softirqs.CPU12.RCU
15582 ± 4% +14.4% 17827 ± 2% softirqs.CPU12.SCHED
38686 +17.5% 45474 ± 4% softirqs.CPU12.TIMER
25962 ± 4% +18.3% 30720 ± 4% softirqs.CPU13.RCU
16126 ± 5% +17.9% 19013 ± 5% softirqs.CPU13.SCHED
25846 ± 2% +20.4% 31108 ± 5% softirqs.CPU14.RCU
15629 ± 4% +21.3% 18953 ± 6% softirqs.CPU14.SCHED
37591 +17.9% 44326 ± 5% softirqs.CPU14.TIMER
24676 ± 2% +20.2% 29658 softirqs.CPU15.RCU
38217 +16.0% 44331 ± 4% softirqs.CPU15.TIMER
24680 ± 2% +18.6% 29278 ± 5% softirqs.CPU16.RCU
38783 +17.9% 45709 ± 4% softirqs.CPU16.TIMER
24738 +20.6% 29833 ± 10% softirqs.CPU17.RCU
39088 +16.3% 45476 ± 5% softirqs.CPU17.TIMER
27971 +24.7% 34880 ± 4% softirqs.CPU18.RCU
27800 +19.7% 33276 ± 2% softirqs.CPU19.RCU
16069 ± 5% +14.6% 18417 ± 3% softirqs.CPU19.SCHED
39339 +18.2% 46516 ± 5% softirqs.CPU19.TIMER
26084 +10.4% 28804 ± 5% softirqs.CPU2.RCU
16601 ± 8% +15.0% 19085 ± 10% softirqs.CPU2.SCHED
38625 +22.4% 47291 ± 5% softirqs.CPU2.TIMER
27472 +27.0% 34877 ± 7% softirqs.CPU20.RCU
16088 ± 3% +10.7% 17811 ± 4% softirqs.CPU20.SCHED
38845 +17.6% 45674 ± 3% softirqs.CPU20.TIMER
28205 ± 6% +20.2% 33906 ± 7% softirqs.CPU21.RCU
39324 +13.8% 44753 ± 4% softirqs.CPU21.TIMER
27282 ± 9% +20.0% 32736 ± 4% softirqs.CPU22.RCU
39542 +13.9% 45038 ± 3% softirqs.CPU22.TIMER
27295 ± 7% +22.3% 33387 ± 2% softirqs.CPU23.RCU
15694 ± 3% +13.2% 17772 ± 3% softirqs.CPU23.SCHED
37452 +16.5% 43645 ± 5% softirqs.CPU23.TIMER
25529 ± 10% +30.1% 33204 softirqs.CPU24.RCU
16068 ± 6% +13.8% 18289 ± 4% softirqs.CPU24.SCHED
39129 +29.4% 50648 ± 17% softirqs.CPU24.TIMER
27444 ± 3% +18.3% 32463 ± 4% softirqs.CPU25.RCU
38658 +14.6% 44286 ± 6% softirqs.CPU25.TIMER
27586 ± 2% +21.4% 33496 softirqs.CPU26.RCU
39631 +13.9% 45136 ± 4% softirqs.CPU26.TIMER
27618 ± 3% +15.9% 32011 ± 2% softirqs.CPU27.RCU
26884 +24.1% 33355 ± 7% softirqs.CPU28.RCU
39120 +14.6% 44813 ± 5% softirqs.CPU28.TIMER
27542 ± 4% +21.4% 33433 ± 5% softirqs.CPU29.RCU
38659 ± 2% +15.9% 44815 ± 5% softirqs.CPU29.TIMER
27539 ± 3% +14.2% 31446 softirqs.CPU3.RCU
16465 ± 4% +16.6% 19192 ± 6% softirqs.CPU3.SCHED
38875 +17.9% 45849 ± 5% softirqs.CPU3.TIMER
26139 +23.5% 32277 ± 4% softirqs.CPU30.RCU
39666 +11.6% 44285 ± 5% softirqs.CPU30.TIMER
26559 ± 2% +23.7% 32855 ± 8% softirqs.CPU31.RCU
16278 ± 2% +19.3% 19420 ± 10% softirqs.CPU31.SCHED
39178 +15.2% 45121 ± 4% softirqs.CPU31.TIMER
25781 +20.9% 31163 ± 2% softirqs.CPU32.RCU
37670 +13.6% 42811 ± 5% softirqs.CPU32.TIMER
27107 ± 5% +16.7% 31625 ± 4% softirqs.CPU33.RCU
16098 ± 2% +12.3% 18071 ± 2% softirqs.CPU33.SCHED
38565 +15.6% 44572 ± 4% softirqs.CPU33.TIMER
26241 ± 3% +18.9% 31209 ± 5% softirqs.CPU34.RCU
38223 +18.1% 45160 ± 5% softirqs.CPU34.TIMER
25360 ± 6% +27.0% 32210 ± 2% softirqs.CPU35.RCU
39986 ± 2% +13.8% 45494 ± 3% softirqs.CPU35.TIMER
26626 ± 2% +23.9% 32987 ± 4% softirqs.CPU36.RCU
16281 ± 5% +12.6% 18329 softirqs.CPU36.SCHED
27227 +23.8% 33703 ± 2% softirqs.CPU37.RCU
26701 ± 2% +29.1% 34462 ± 8% softirqs.CPU38.RCU
15157 ± 5% +15.5% 17507 ± 4% softirqs.CPU38.SCHED
37119 ± 4% +37.9% 51191 ± 27% softirqs.CPU38.TIMER
28007 ± 2% +21.4% 33990 ± 2% softirqs.CPU39.RCU
15700 ± 2% +11.8% 17545 ± 3% softirqs.CPU39.SCHED
37509 ± 2% +14.9% 43109 ± 6% softirqs.CPU39.TIMER
25877 +24.6% 32254 ± 3% softirqs.CPU4.RCU
38648 +16.9% 45191 ± 5% softirqs.CPU4.TIMER
27903 +17.8% 32867 ± 2% softirqs.CPU40.RCU
15256 ± 2% +12.8% 17202 ± 7% softirqs.CPU40.SCHED
36371 ± 2% +17.0% 42572 ± 4% softirqs.CPU40.TIMER
26560 ± 5% +19.9% 31840 ± 6% softirqs.CPU41.RCU
15067 ± 3% +13.8% 17142 ± 4% softirqs.CPU41.SCHED
36473 ± 3% +14.2% 41657 ± 4% softirqs.CPU41.TIMER
27250 +22.5% 33387 ± 2% softirqs.CPU42.RCU
15376 ± 4% +15.4% 17744 ± 3% softirqs.CPU42.SCHED
37838 +13.4% 42895 ± 3% softirqs.CPU42.TIMER
27137 ± 4% +23.2% 33425 softirqs.CPU43.RCU
27818 ± 3% +22.5% 34073 ± 6% softirqs.CPU44.RCU
14305 ± 4% +22.5% 17522 ± 2% softirqs.CPU44.SCHED
36151 ± 4% +16.7% 42187 ± 4% softirqs.CPU44.TIMER
25734 ± 3% +25.6% 32319 ± 4% softirqs.CPU45.RCU
14522 +14.8% 16674 ± 6% softirqs.CPU45.SCHED
36594 +15.8% 42364 ± 5% softirqs.CPU45.TIMER
28660 ± 3% +18.8% 34052 ± 7% softirqs.CPU46.RCU
15306 ± 4% +13.5% 17370 ± 7% softirqs.CPU46.SCHED
37095 ± 3% +14.3% 42388 ± 5% softirqs.CPU46.TIMER
28906 ± 5% +15.3% 33324 ± 7% softirqs.CPU47.RCU
14758 ± 5% +13.7% 16775 ± 5% softirqs.CPU47.SCHED
36736 ± 3% +14.2% 41969 ± 4% softirqs.CPU47.TIMER
28049 ± 4% +24.0% 34791 ± 2% softirqs.CPU48.RCU
14583 ± 4% +18.9% 17340 ± 8% softirqs.CPU48.SCHED
36095 ± 4% +19.5% 43117 ± 6% softirqs.CPU48.TIMER
27551 ± 5% +21.0% 33349 ± 4% softirqs.CPU49.RCU
36024 +18.1% 42545 ± 4% softirqs.CPU49.TIMER
25870 ± 2% +22.4% 31677 ± 3% softirqs.CPU5.RCU
15740 ± 6% +26.8% 19951 ± 9% softirqs.CPU5.SCHED
37622 +33.5% 50234 ± 18% softirqs.CPU5.TIMER
27424 +19.6% 32798 ± 2% softirqs.CPU50.RCU
14010 ± 2% +21.8% 17060 ± 6% softirqs.CPU50.SCHED
36485 ± 3% +14.7% 41862 ± 4% softirqs.CPU50.TIMER
27884 +18.9% 33160 ± 3% softirqs.CPU51.RCU
36212 ± 3% +16.6% 42210 ± 4% softirqs.CPU51.TIMER
27031 ± 7% +29.8% 35075 ± 5% softirqs.CPU52.RCU
14772 ± 2% +18.1% 17451 ± 4% softirqs.CPU52.SCHED
37031 ± 4% +17.9% 43648 ± 4% softirqs.CPU52.TIMER
25188 ± 12% +28.7% 32423 ± 3% softirqs.CPU53.RCU
16289 ± 6% +18.4% 19280 ± 5% softirqs.CPU53.SCHED
37616 ± 3% +35.6% 51010 ± 21% softirqs.CPU53.TIMER
26693 ± 3% +19.4% 31870 ± 2% softirqs.CPU54.RCU
38094 +16.5% 44379 ± 4% softirqs.CPU54.TIMER
26082 ± 2% +23.1% 32100 softirqs.CPU55.RCU
37589 ± 2% +16.5% 43779 ± 5% softirqs.CPU55.TIMER
26352 ± 2% +18.7% 31284 softirqs.CPU56.RCU
15591 ± 4% +15.9% 18066 ± 8% softirqs.CPU56.SCHED
37070 +16.8% 43309 ± 2% softirqs.CPU56.TIMER
27520 ± 4% +15.7% 31841 ± 5% softirqs.CPU57.RCU
37916 ± 2% +13.9% 43170 ± 2% softirqs.CPU57.TIMER
27067 +20.8% 32709 ± 7% softirqs.CPU58.RCU
15059 +19.1% 17935 ± 8% softirqs.CPU58.SCHED
37123 +13.8% 42241 softirqs.CPU58.TIMER
25199 ± 4% +19.6% 30126 ± 6% softirqs.CPU59.RCU
36384 ± 2% +16.8% 42479 ± 2% softirqs.CPU59.TIMER
25871 ± 3% +17.5% 30409 ± 3% softirqs.CPU6.RCU
16584 ± 2% +14.8% 19032 ± 5% softirqs.CPU6.SCHED
38784 +15.6% 44850 ± 4% softirqs.CPU6.TIMER
24777 ± 5% +15.0% 28502 ± 5% softirqs.CPU60.RCU
37468 +14.2% 42794 ± 6% softirqs.CPU60.TIMER
23108 ± 3% +30.1% 30065 ± 2% softirqs.CPU61.RCU
15059 ± 6% +16.5% 17540 ± 6% softirqs.CPU61.SCHED
37002 +16.8% 43227 ± 3% softirqs.CPU61.TIMER
23023 ± 7% +33.6% 30769 ± 6% softirqs.CPU62.RCU
37164 ± 2% +16.2% 43203 ± 2% softirqs.CPU62.TIMER
23069 ± 2% +25.1% 28850 softirqs.CPU63.RCU
14642 ± 5% +15.4% 16900 ± 8% softirqs.CPU63.SCHED
36254 ± 2% +15.4% 41854 ± 3% softirqs.CPU63.TIMER
24304 ± 2% +25.9% 30593 ± 2% softirqs.CPU64.RCU
14666 +15.5% 16938 ± 3% softirqs.CPU64.SCHED
37048 +15.7% 42877 ± 4% softirqs.CPU64.TIMER
24438 ± 9% +23.6% 30212 ± 5% softirqs.CPU65.RCU
37505 +12.8% 42288 ± 2% softirqs.CPU65.TIMER
24568 +20.4% 29569 softirqs.CPU66.RCU
15290 ± 5% +8.4% 16569 ± 4% softirqs.CPU66.SCHED
37381 +14.9% 42968 ± 3% softirqs.CPU66.TIMER
23253 ± 9% +29.7% 30150 ± 2% softirqs.CPU67.RCU
14645 ± 6% +13.4% 16613 ± 6% softirqs.CPU67.SCHED
37012 +14.1% 42221 ± 2% softirqs.CPU67.TIMER
36993 +15.0% 42536 ± 4% softirqs.CPU68.TIMER
24695 ± 7% +23.7% 30551 ± 3% softirqs.CPU69.RCU
14441 ± 3% +11.4% 16089 ± 4% softirqs.CPU69.SCHED
36999 +14.3% 42299 softirqs.CPU69.TIMER
26022 ± 3% +21.4% 31579 ± 2% softirqs.CPU7.RCU
38481 +18.7% 45661 ± 3% softirqs.CPU7.TIMER
25083 ± 8% +18.5% 29721 ± 2% softirqs.CPU70.RCU
14845 ± 7% +15.7% 17173 ± 4% softirqs.CPU70.SCHED
37094 +18.5% 43948 ± 3% softirqs.CPU70.TIMER
24438 ± 2% +20.6% 29461 ± 2% softirqs.CPU71.RCU
15821 ± 4% +13.6% 17978 ± 4% softirqs.CPU71.SCHED
26912 ± 7% +22.3% 32925 ± 6% softirqs.CPU8.RCU
39193 +15.2% 45167 ± 4% softirqs.CPU8.TIMER
25829 ± 2% +20.7% 31178 softirqs.CPU9.RCU
37434 ± 2% +16.6% 43665 ± 5% softirqs.CPU9.TIMER
1897274 +21.5% 2304570 ± 2% softirqs.RCU
1150548 +11.9% 1287616 softirqs.SCHED
2757329 +15.8% 3193002 ± 3% softirqs.TIMER
aim7.jobs-per-min
1400 +-+------------------------------------------------------------------+
| |
1200 +-+++.++.++.+++.++.++ + ++.+ + +++.++ + ++.++.++.++.+++.++.++.+|
| : : : : : : : : : |
1000 OO+OO OO OO OOO OO OO OOO OO OO OO OOO OO OO OOO O |
| : : : : : : : :: : |
800 +-+ : : : : :: : : :: : |
| : : : : :: : : :: : |
600 +-+ : ::: :: :: : :: : |
| :: :: :: :: :: :: |
400 +-+ :: :: :: :: :: :: |
| : :: :: :: : : |
200 +-+ : : : : : : |
| : : : : : : |
0 +-+------------------------------------------------------------------+
aim7.time.elapsed_time
140 +-+-------------------------------------------------------------------+
| |
120 OO+OO OO OO OO OO O O OO OO O OO OOO OO OO OO OO O |
| O O |
100 +-+++.++.++.++.++.+++ + +.++ + ++.++.+ + ++.++.+++.++.++.++.++.+|
| : : : : : : : : : |
80 +-+ : : : : : : : : : |
| : :: : : :: : : :: : |
60 +-+ : :: : : :: : : :: : |
| : :: : : :: : :: :: |
40 +-+ :: :: :: :: :: :: |
| :: :: :: :: :: :: |
20 +-+ : : : : : : |
| : : : : : : |
0 +-+-------------------------------------------------------------------+
aim7.time.elapsed_time.max
140 +-+-------------------------------------------------------------------+
| |
120 OO+OO OO OO OO OO O O OO OO O OO OOO OO OO OO OO O |
| O O |
100 +-+++.++.++.++.++.+++ + +.++ + ++.++.+ + ++.++.+++.++.++.++.++.+|
| : : : : : : : : : |
80 +-+ : : : : : : : : : |
| : :: : : :: : : :: : |
60 +-+ : :: : : :: : : :: : |
| : :: : : :: : :: :: |
40 +-+ :: :: :: :: :: :: |
| :: :: :: :: :: :: |
20 +-+ : : : : : : |
| : : : : : : |
0 +-+-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-ivb-ep01: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase:
gcc-8/performance/4BRD_12G/btrfs/x86_64-rhel-7.6/20/RAID0/debian-x86_64-2018-04-03.cgz/lkp-ivb-ep01/sync_disk_rw/aim7
commit:
a92e9c3a3c ("btrfs: extent_io: Handle error better in extent_writepages()")
44fe89de7d ("btrfs: Do mandatory tree block check before submitting bio")
a92e9c3a3cef4c0c 44fe89de7d5157a4f31f13d9480
---------------- ---------------------------
%stddev %change %stddev
\ | \
474.71 -20.8% 376.09 aim7.jobs-per-min
252.89 +26.2% 319.19 aim7.time.elapsed_time
252.89 +26.2% 319.19 aim7.time.elapsed_time.max
8376 ± 3% +9.4% 9167 ± 3% aim7.time.minor_page_faults
1760 +6.3% 1872 aim7.time.system_time
22.58 -1.5% 22.24 boot-time.dhcp
40945 ± 2% -22.3% 31813 ± 3% meminfo.max_used_kB
670014 +24.2% 832471 proc-vmstat.pgfault
1013780 +13.7% 1152374 proc-vmstat.pgfree
3.022e+09 ± 4% +50.2% 4.54e+09 ± 19% cpuidle.C1.time
34330913 ± 2% +16.1% 39848597 ± 9% cpuidle.C1.usage
2.611e+09 ± 16% +48.9% 3.887e+09 ± 3% cpuidle.C6.time
0.02 ± 15% -0.0 0.00 ±113% mpstat.cpu.-1.soft%
21.36 -3.4 17.98 mpstat.cpu.-1.sys%
0.14 -0.0 0.12 mpstat.cpu.-1.usr%
78.00 +4.8% 81.75 vmstat.cpu.id
138672 -21.1% 109467 vmstat.io.bo
299636 -21.0% 236781 vmstat.system.cs
78.64 +4.3% 81.99 iostat.cpu.idle
21.21 -15.7% 17.88 iostat.cpu.system
7947 -20.5% 6318 iostat.md0.w/s
180043 -20.9% 142377 iostat.md0.wkB/s
3098 ± 30% +270.4% 11475 ± 34% numa-meminfo.node0.Inactive(anon)
9526 +37.0% 13052 ± 15% numa-meminfo.node0.Mapped
5474 ± 26% +188.7% 15807 ± 23% numa-meminfo.node0.Shmem
75040 ± 2% +10.4% 82807 ± 7% numa-meminfo.node0.Slab
16192 ± 5% -51.6% 7838 ± 51% numa-meminfo.node1.Inactive(anon)
20174 ± 7% -50.1% 10076 ± 36% numa-meminfo.node1.Shmem
774.25 ± 30% +270.4% 2867 ± 34% numa-vmstat.node0.nr_inactive_anon
2474 ± 2% +35.6% 3354 ± 14% numa-vmstat.node0.nr_mapped
1367 ± 26% +188.9% 3950 ± 23% numa-vmstat.node0.nr_shmem
774.25 ± 30% +270.4% 2867 ± 34% numa-vmstat.node0.nr_zone_inactive_anon
4046 ± 5% -51.6% 1958 ± 51% numa-vmstat.node1.nr_inactive_anon
5042 ± 7% -50.1% 2518 ± 36% numa-vmstat.node1.nr_shmem
4046 ± 5% -51.6% 1958 ± 51% numa-vmstat.node1.nr_zone_inactive_anon
312.25 -15.1% 265.25 turbostat.Avg_MHz
25.87 -3.9 22.02 turbostat.Busy%
34326534 ± 2% +16.1% 39845190 ± 9% turbostat.C1
33.45 -4.6% 31.92 turbostat.CorWatt
21163841 +25.1% 26466542 turbostat.IRQ
59.45 -2.7% 57.87 turbostat.PkgWatt
32.25 -1.7% 31.71 turbostat.RAMWatt
20330 +26.1% 25630 turbostat.SMI
6.46 ± 2% -0.6 5.89 ± 3% perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.btrfs_log_changed_extents.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
2.75 ± 5% -0.6 2.19 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot
5.46 ± 2% -0.5 4.92 ± 3% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.btrfs_log_changed_extents.btrfs_log_inode
5.46 ± 2% -0.5 4.93 ± 3% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.btrfs_log_changed_extents.btrfs_log_inode.btrfs_log_inode_parent
0.69 ± 9% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write
1.74 ± 6% -0.4 1.39 ± 8% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.__vfs_write.vfs_write.ksys_write
0.63 ± 3% -0.3 0.30 ±100% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_writepages
2.35 ± 4% -0.2 2.13 ± 3% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.btrfs_log_changed_extents
0.92 ± 9% -0.1 0.80 ± 7% perf-profile.calltrace.cycles-pp.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages
0.86 ± 10% -0.1 0.74 ± 9% perf-profile.calltrace.cycles-pp.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages
0.85 ± 9% -0.1 0.73 ± 8% perf-profile.calltrace.cycles-pp.cow_file_range.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages
0.70 ± 5% -0.1 0.57 ± 3% perf-profile.calltrace.cycles-pp.queued_read_lock_slowpath.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent
1.40 ± 5% +0.2 1.55 perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.65 ± 11% +0.3 0.94 ± 23% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.79 ± 8% +0.3 1.13 ± 21% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle
0.26 ±100% +0.3 0.61 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
1.44 ± 8% +0.4 1.87 ± 17% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle
0.14 ±173% +0.6 0.70 ± 27% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
2.44 ± 5% +0.6 3.04 ± 7% perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter.__vfs_write.vfs_write
0.00 +0.7 0.72 ± 2% perf-profile.calltrace.cycles-pp.btrfs_get_token_32.check_leaf.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook
2.51 ± 6% +0.8 3.30 ± 16% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry
2.71 ± 6% +0.8 3.53 ± 16% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
0.73 ± 6% +1.0 1.69 ± 2% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter.__vfs_write
0.72 ± 6% +1.0 1.69 ± 2% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
0.72 ± 6% +1.0 1.69 ± 2% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.btrfs_file_write_iter
0.72 ± 6% +1.0 1.69 ± 2% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
0.00 +1.0 1.05 perf-profile.calltrace.cycles-pp.check_leaf.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio
0.00 +1.1 1.08 perf-profile.calltrace.cycles-pp.csum_tree_block.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages
0.00 +1.1 1.09 perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages
0.00 +1.5 1.46 perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents
0.00 +1.5 1.46 perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range
71.60 ± 7% -16.2% 59.98 ± 8% sched_debug.cfs_rq:/.load_avg.avg
96.11 ± 10% -16.2% 80.58 ± 6% sched_debug.cfs_rq:/.load_avg.stddev
187997 -8.8% 171461 ± 2% sched_debug.cfs_rq:/.min_vruntime.avg
226472 ± 2% -10.8% 202016 ± 6% sched_debug.cfs_rq:/.min_vruntime.max
17261 ± 7% -21.5% 13550 ± 15% sched_debug.cfs_rq:/.min_vruntime.stddev
8.89 ± 47% -64.7% 3.14 ± 57% sched_debug.cfs_rq:/.removed.load_avg.avg
204.15 -38.5% 125.58 ± 57% sched_debug.cfs_rq:/.removed.load_avg.max
40.32 ± 22% -51.4% 19.61 ± 57% sched_debug.cfs_rq:/.removed.load_avg.stddev
409.91 ± 47% -64.8% 144.41 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.avg
9437 -38.8% 5776 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.max
1859 ± 22% -51.5% 901.87 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
2.95 ± 44% -79.5% 0.60 ± 75% sched_debug.cfs_rq:/.removed.util_avg.avg
72.25 ± 8% -66.6% 24.17 ± 75% sched_debug.cfs_rq:/.removed.util_avg.max
13.53 ± 23% -72.1% 3.77 ± 75% sched_debug.cfs_rq:/.removed.util_avg.stddev
9.43 ± 5% +27.0% 11.97 ± 14% sched_debug.cfs_rq:/.runnable_load_avg.avg
103.80 ± 10% +62.1% 168.29 ± 27% sched_debug.cfs_rq:/.runnable_load_avg.max
22.41 ± 7% +39.0% 31.15 ± 20% sched_debug.cfs_rq:/.runnable_load_avg.stddev
12421 ± 59% +64.4% 20419 ± 40% sched_debug.cfs_rq:/.spread0.avg
-24890 -69.6% -7575 sched_debug.cfs_rq:/.spread0.min
17263 ± 7% -21.5% 13551 ± 15% sched_debug.cfs_rq:/.spread0.stddev
325.68 ± 2% -14.6% 278.27 ± 3% sched_debug.cfs_rq:/.util_avg.avg
186.27 ± 3% -11.0% 165.84 ± 2% sched_debug.cfs_rq:/.util_avg.stddev
132.45 -12.4% 116.05 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.stddev
155113 +19.3% 185086 sched_debug.cpu.clock.avg
155121 +19.3% 185093 sched_debug.cpu.clock.max
155106 +19.3% 185079 sched_debug.cpu.clock.min
155113 +19.3% 185086 sched_debug.cpu.clock_task.avg
155121 +19.3% 185093 sched_debug.cpu.clock_task.max
155106 +19.3% 185079 sched_debug.cpu.clock_task.min
104.40 ± 7% +61.5% 168.62 ± 27% sched_debug.cpu.cpu_load[0].max
96.20 ± 8% +74.1% 167.46 ± 30% sched_debug.cpu.cpu_load[1].max
4871 +14.8% 5592 sched_debug.cpu.curr->pid.max
127731 +23.5% 157685 sched_debug.cpu.nr_load_updates.avg
134899 +20.9% 163058 sched_debug.cpu.nr_load_updates.max
125325 +24.0% 155428 sched_debug.cpu.nr_load_updates.min
155106 +19.3% 185079 sched_debug.cpu_clk
151513 +19.8% 181485 sched_debug.ktime
155537 +19.3% 185526 sched_debug.sched_clk
19.77 -15.1% 16.78 ± 3% perf-stat.i.MPKI
8.783e+08 -9.0% 7.989e+08 perf-stat.i.branch-instructions
19.44 -0.2 19.21 perf-stat.i.cache-miss-rate%
14932557 -19.1% 12081970 perf-stat.i.cache-misses
77250252 -18.0% 63363496 perf-stat.i.cache-references
302132 -21.2% 238146 perf-stat.i.context-switches
3.13 -11.6% 2.77 ± 2% perf-stat.i.cpi
1.254e+10 -15.4% 1.061e+10 perf-stat.i.cpu-cycles
229.12 ± 3% -21.3% 180.36 ± 3% perf-stat.i.cpu-migrations
840.12 +4.5% 877.89 perf-stat.i.cycles-between-cache-misses
1.129e+09 -5.4% 1.068e+09 perf-stat.i.dTLB-loads
0.10 ± 4% -0.0 0.09 ± 5% perf-stat.i.dTLB-store-miss-rate%
538827 ± 3% -16.1% 452028 ± 4% perf-stat.i.dTLB-store-misses
47.32 +3.3 50.67 ± 3% perf-stat.i.iTLB-load-miss-rate%
2556829 -20.4% 2034861 ± 2% perf-stat.i.iTLB-loads
4.153e+09 -4.5% 3.964e+09 perf-stat.i.instructions
0.33 +12.2% 0.37 ± 2% perf-stat.i.ipc
6672298 -19.6% 5364393 perf-stat.i.node-load-misses
7193961 -19.6% 5786904 perf-stat.i.node-loads
4765580 -20.6% 3784168 perf-stat.i.node-store-misses
6965089 -20.3% 5548679 perf-stat.i.node-stores
18.60 -14.0% 15.99 ± 2% perf-stat.overall.MPKI
19.33 -0.3 19.07 perf-stat.overall.cache-miss-rate%
3.02 -11.3% 2.68 ± 2% perf-stat.overall.cpi
839.71 +4.6% 878.19 perf-stat.overall.cycles-between-cache-misses
0.10 ± 4% -0.0 0.08 ± 5% perf-stat.overall.dTLB-store-miss-rate%
45.63 +3.8 49.47 ± 3% perf-stat.overall.iTLB-load-miss-rate%
0.33 +12.8% 0.37 ± 2% perf-stat.overall.ipc
8.748e+08 -9.0% 7.964e+08 perf-stat.ps.branch-instructions
14872846 -19.0% 12043692 perf-stat.ps.cache-misses
76941024 -17.9% 63162394 perf-stat.ps.cache-references
300917 -21.1% 237386 perf-stat.ps.context-switches
1.249e+10 -15.3% 1.058e+10 perf-stat.ps.cpu-cycles
228.20 ± 3% -21.2% 179.78 ± 3% perf-stat.ps.cpu-migrations
1.124e+09 -5.3% 1.065e+09 perf-stat.ps.dTLB-loads
536681 ± 3% -16.0% 450604 ± 4% perf-stat.ps.dTLB-store-misses
2546543 -20.3% 2028370 ± 2% perf-stat.ps.iTLB-loads
4.137e+09 -4.5% 3.952e+09 perf-stat.ps.instructions
6645469 -19.5% 5347283 perf-stat.ps.node-load-misses
7165042 -19.5% 5768454 perf-stat.ps.node-loads
4746415 -20.5% 3772102 perf-stat.ps.node-store-misses
6937096 -20.3% 5531006 perf-stat.ps.node-stores
1.049e+12 +20.4% 1.263e+12 perf-stat.total.instructions
160.75 ± 18% +49.5% 240.25 ± 27% interrupts.42:IR-PCI-MSI.524294-edge.eth0-TxRx-5
123.75 +26.3% 156.25 interrupts.76:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
100313 ± 7% +13.4% 113737 interrupts.CAL:Function_call_interrupts
508519 +26.0% 640668 interrupts.CPU0.LOC:Local_timer_interrupts
2437 ± 12% +18.1% 2877 ± 4% interrupts.CPU1.CAL:Function_call_interrupts
508036 +26.1% 640579 interrupts.CPU1.LOC:Local_timer_interrupts
2521 ± 10% +14.3% 2882 ± 5% interrupts.CPU10.CAL:Function_call_interrupts
507477 +26.1% 639993 interrupts.CPU10.LOC:Local_timer_interrupts
2519 ± 2% +17.9% 2969 ± 6% interrupts.CPU11.CAL:Function_call_interrupts
508051 +26.1% 640531 interrupts.CPU11.LOC:Local_timer_interrupts
508353 +25.8% 639418 interrupts.CPU12.LOC:Local_timer_interrupts
508289 +26.0% 640385 interrupts.CPU13.LOC:Local_timer_interrupts
508136 +25.8% 639470 interrupts.CPU14.LOC:Local_timer_interrupts
2417 ± 5% +20.2% 2906 ± 6% interrupts.CPU15.CAL:Function_call_interrupts
508330 +25.9% 640229 interrupts.CPU15.LOC:Local_timer_interrupts
508351 +25.9% 639790 interrupts.CPU16.LOC:Local_timer_interrupts
2508 ± 10% +18.4% 2968 ± 6% interrupts.CPU17.CAL:Function_call_interrupts
508084 +26.0% 640420 interrupts.CPU17.LOC:Local_timer_interrupts
17327 ± 18% +26.1% 21856 ± 4% interrupts.CPU17.RES:Rescheduling_interrupts
508457 +25.8% 639737 interrupts.CPU18.LOC:Local_timer_interrupts
508140 +26.0% 640214 interrupts.CPU19.LOC:Local_timer_interrupts
2280 ± 8% +22.2% 2786 ± 5% interrupts.CPU2.CAL:Function_call_interrupts
508336 +26.0% 640548 interrupts.CPU2.LOC:Local_timer_interrupts
507912 +26.1% 640315 interrupts.CPU20.LOC:Local_timer_interrupts
2595 ± 7% +13.4% 2943 ± 5% interrupts.CPU21.CAL:Function_call_interrupts
508108 +26.1% 640485 interrupts.CPU21.LOC:Local_timer_interrupts
508306 +26.0% 640244 interrupts.CPU22.LOC:Local_timer_interrupts
1303 ± 34% -29.2% 922.75 ± 32% interrupts.CPU22.NMI:Non-maskable_interrupts
1303 ± 34% -29.2% 922.75 ± 32% interrupts.CPU22.PMI:Performance_monitoring_interrupts
2522 ± 9% +17.2% 2956 ± 4% interrupts.CPU23.CAL:Function_call_interrupts
508123 +26.1% 640526 interrupts.CPU23.LOC:Local_timer_interrupts
508372 +26.0% 640372 interrupts.CPU24.LOC:Local_timer_interrupts
507678 +26.1% 640435 interrupts.CPU25.LOC:Local_timer_interrupts
508375 +26.0% 640407 interrupts.CPU26.LOC:Local_timer_interrupts
2406 ± 11% +19.9% 2885 ± 5% interrupts.CPU27.CAL:Function_call_interrupts
508242 +26.0% 640265 interrupts.CPU27.LOC:Local_timer_interrupts
2449 ± 11% +21.8% 2982 ± 5% interrupts.CPU28.CAL:Function_call_interrupts
508292 +26.0% 640304 interrupts.CPU28.LOC:Local_timer_interrupts
2510 ± 6% +14.4% 2870 ± 5% interrupts.CPU29.CAL:Function_call_interrupts
508085 +26.0% 640167 interrupts.CPU29.LOC:Local_timer_interrupts
508172 +26.0% 640443 interrupts.CPU3.LOC:Local_timer_interrupts
508342 +25.9% 639891 interrupts.CPU30.LOC:Local_timer_interrupts
508009 +26.1% 640402 interrupts.CPU31.LOC:Local_timer_interrupts
2522 ± 11% +16.8% 2946 ± 4% interrupts.CPU32.CAL:Function_call_interrupts
508138 +25.9% 639578 interrupts.CPU32.LOC:Local_timer_interrupts
508010 +26.1% 640577 interrupts.CPU33.LOC:Local_timer_interrupts
508029 +25.9% 639405 interrupts.CPU34.LOC:Local_timer_interrupts
2464 ± 8% +15.3% 2840 ± 5% interrupts.CPU35.CAL:Function_call_interrupts
508216 +26.0% 640171 interrupts.CPU35.LOC:Local_timer_interrupts
160.75 ± 18% +49.5% 240.25 ± 27% interrupts.CPU36.42:IR-PCI-MSI.524294-edge.eth0-TxRx-5
507990 +25.9% 639575 interrupts.CPU36.LOC:Local_timer_interrupts
508010 +26.0% 640200 interrupts.CPU37.LOC:Local_timer_interrupts
2536 ± 8% +13.9% 2888 ± 6% interrupts.CPU38.CAL:Function_call_interrupts
507853 +25.9% 639351 interrupts.CPU38.LOC:Local_timer_interrupts
2414 ± 7% +19.6% 2887 ± 7% interrupts.CPU39.CAL:Function_call_interrupts
507619 +26.0% 639416 interrupts.CPU39.LOC:Local_timer_interrupts
508318 +25.9% 640069 interrupts.CPU4.LOC:Local_timer_interrupts
2463 ± 12% +26.6% 3119 ± 2% interrupts.CPU5.CAL:Function_call_interrupts
508112 +26.1% 640497 interrupts.CPU5.LOC:Local_timer_interrupts
123.75 +26.3% 156.25 interrupts.CPU6.76:IR-PCI-MSI.512000-edge.ahci[0000:00:1f.2]
2351 ± 9% +21.5% 2856 ± 5% interrupts.CPU6.CAL:Function_call_interrupts
508563 +25.8% 639582 interrupts.CPU6.LOC:Local_timer_interrupts
2592 ± 4% +13.6% 2943 ± 4% interrupts.CPU7.CAL:Function_call_interrupts
508150 +26.0% 640378 interrupts.CPU7.LOC:Local_timer_interrupts
508498 +25.9% 640139 interrupts.CPU8.LOC:Local_timer_interrupts
2501 ± 10% +18.4% 2960 ± 7% interrupts.CPU9.CAL:Function_call_interrupts
508092 +26.0% 640432 interrupts.CPU9.LOC:Local_timer_interrupts
20326190 +26.0% 25605623 interrupts.LOC:Local_timer_interrupts
26401 ± 5% -9.9% 23785 ± 4% interrupts.NMI:Non-maskable_interrupts
26401 ± 5% -9.9% 23785 ± 4% interrupts.PMI:Performance_monitoring_interrupts
69901 ± 3% +27.9% 89422 ± 3% softirqs.CPU0.RCU
45503 ± 2% +18.1% 53752 softirqs.CPU0.SCHED
90281 ± 2% +17.4% 105987 ± 2% softirqs.CPU0.TIMER
72001 ± 4% +30.7% 94130 ± 2% softirqs.CPU1.RCU
42373 +18.9% 50374 ± 2% softirqs.CPU1.SCHED
89928 ± 3% +18.5% 106554 ± 4% softirqs.CPU1.TIMER
73216 ± 6% +24.5% 91156 ± 3% softirqs.CPU10.RCU
42693 +16.8% 49881 ± 2% softirqs.CPU10.SCHED
86975 ± 2% +19.4% 103822 ± 3% softirqs.CPU10.TIMER
71035 +31.2% 93194 ± 2% softirqs.CPU11.RCU
42794 +19.6% 51168 ± 2% softirqs.CPU11.SCHED
86533 +18.9% 102845 ± 4% softirqs.CPU11.TIMER
70358 ± 3% +33.3% 93810 ± 3% softirqs.CPU12.RCU
42548 +17.2% 49878 softirqs.CPU12.SCHED
87303 ± 2% +21.8% 106341 ± 3% softirqs.CPU12.TIMER
70364 ± 3% +31.7% 92648 ± 4% softirqs.CPU13.RCU
42421 +18.9% 50428 softirqs.CPU13.SCHED
86875 +19.5% 103817 ± 3% softirqs.CPU13.TIMER
69128 ± 2% +30.7% 90331 ± 3% softirqs.CPU14.RCU
42975 ± 2% +15.4% 49575 softirqs.CPU14.SCHED
84688 ± 3% +21.6% 102994 ± 3% softirqs.CPU14.TIMER
72010 ± 2% +30.6% 94068 ± 3% softirqs.CPU15.RCU
42893 +17.0% 50178 softirqs.CPU15.SCHED
86458 +20.4% 104117 ± 4% softirqs.CPU15.TIMER
70886 ± 2% +30.3% 92387 ± 2% softirqs.CPU16.RCU
42970 +16.3% 49975 softirqs.CPU16.SCHED
87944 ± 2% +19.7% 105244 ± 2% softirqs.CPU16.TIMER
70757 ± 2% +30.5% 92359 ± 2% softirqs.CPU17.RCU
42742 +17.7% 50310 ± 2% softirqs.CPU17.SCHED
87096 ± 2% +17.9% 102652 ± 3% softirqs.CPU17.TIMER
69077 ± 3% +32.6% 91630 ± 3% softirqs.CPU18.RCU
42942 +17.0% 50245 ± 2% softirqs.CPU18.SCHED
68722 ± 2% +29.7% 89150 ± 2% softirqs.CPU19.RCU
42964 ± 2% +17.2% 50334 ± 2% softirqs.CPU19.SCHED
84910 ± 4% +24.0% 105326 ± 7% softirqs.CPU19.TIMER
72687 ± 4% +25.6% 91315 ± 3% softirqs.CPU2.RCU
42688 +16.2% 49622 softirqs.CPU2.SCHED
88869 ± 5% +16.3% 103332 softirqs.CPU2.TIMER
70693 ± 2% +26.6% 89525 ± 4% softirqs.CPU20.RCU
42228 +17.5% 49611 ± 2% softirqs.CPU20.SCHED
88647 ± 2% +16.4% 103227 ± 2% softirqs.CPU20.TIMER
70857 ± 3% +32.1% 93633 ± 3% softirqs.CPU21.RCU
42878 +17.2% 50239 softirqs.CPU21.SCHED
87325 +18.2% 103214 ± 4% softirqs.CPU21.TIMER
71099 ± 3% +29.0% 91711 ± 3% softirqs.CPU22.RCU
42534 +17.3% 49888 softirqs.CPU22.SCHED
87698 ± 3% +19.3% 104642 softirqs.CPU22.TIMER
72098 ± 2% +30.3% 93930 ± 3% softirqs.CPU23.RCU
42771 +17.0% 50022 ± 2% softirqs.CPU23.SCHED
87931 +17.5% 103319 ± 3% softirqs.CPU23.TIMER
70804 ± 3% +33.4% 94432 ± 6% softirqs.CPU24.RCU
42554 ± 3% +16.4% 49516 ± 2% softirqs.CPU24.SCHED
71435 ± 3% +35.0% 96465 ± 3% softirqs.CPU25.RCU
42605 +16.9% 49815 softirqs.CPU25.SCHED
87163 +21.2% 105672 softirqs.CPU25.TIMER
70216 +31.0% 91964 ± 3% softirqs.CPU26.RCU
42147 +19.0% 50165 ± 2% softirqs.CPU26.SCHED
88215 ± 3% +36.3% 120217 ± 21% softirqs.CPU26.TIMER
70713 +32.5% 93695 ± 6% softirqs.CPU27.RCU
42528 +18.2% 50249 ± 2% softirqs.CPU27.SCHED
88110 +38.5% 122002 ± 24% softirqs.CPU27.TIMER
69654 ± 2% +34.1% 93398 ± 3% softirqs.CPU28.RCU
42052 +18.0% 49636 ± 2% softirqs.CPU28.SCHED
86876 ± 2% +21.6% 105634 ± 2% softirqs.CPU28.TIMER
70230 ± 2% +37.8% 96776 ± 5% softirqs.CPU29.RCU
42440 +17.0% 49673 ± 2% softirqs.CPU29.SCHED
87058 +18.9% 103502 ± 2% softirqs.CPU29.TIMER
70519 ± 3% +34.2% 94624 ± 2% softirqs.CPU3.RCU
43299 +16.2% 50322 ± 2% softirqs.CPU3.SCHED
87572 +19.2% 104386 ± 4% softirqs.CPU3.TIMER
70538 ± 2% +31.0% 92391 ± 5% softirqs.CPU30.RCU
42038 ± 2% +17.9% 49574 softirqs.CPU30.SCHED
86446 ± 3% +20.6% 104284 softirqs.CPU30.TIMER
71140 ± 2% +33.6% 95050 ± 3% softirqs.CPU31.RCU
42599 +16.5% 49608 ± 2% softirqs.CPU31.SCHED
86417 +19.6% 103393 ± 3% softirqs.CPU31.TIMER
59293 ± 2% +29.7% 76894 ± 4% softirqs.CPU32.RCU
42200 +17.8% 49711 softirqs.CPU32.SCHED
86726 +18.8% 103045 ± 3% softirqs.CPU32.TIMER
58507 +31.6% 76967 softirqs.CPU33.RCU
42587 +16.7% 49683 softirqs.CPU33.SCHED
86567 +19.1% 103101 ± 3% softirqs.CPU33.TIMER
59394 ± 2% +27.1% 75493 ± 5% softirqs.CPU34.RCU
42682 +16.6% 49753 softirqs.CPU34.SCHED
59949 ± 3% +29.2% 77459 softirqs.CPU35.RCU
42681 ± 2% +17.3% 50047 ± 2% softirqs.CPU35.SCHED
85785 +19.9% 102825 ± 2% softirqs.CPU35.TIMER
61089 +25.4% 76612 softirqs.CPU36.RCU
42662 +16.9% 49870 softirqs.CPU36.SCHED
87784 ± 2% +17.3% 102973 ± 3% softirqs.CPU36.TIMER
60018 +29.3% 77596 softirqs.CPU37.RCU
42378 ± 2% +18.0% 50012 softirqs.CPU37.SCHED
85919 +20.3% 103386 ± 2% softirqs.CPU37.TIMER
59781 ± 2% +28.6% 76877 softirqs.CPU38.RCU
42779 +17.1% 50105 softirqs.CPU38.SCHED
85246 ± 4% +20.7% 102859 ± 2% softirqs.CPU38.TIMER
59657 +26.9% 75699 ± 2% softirqs.CPU39.RCU
43011 ± 2% +17.6% 50580 ± 3% softirqs.CPU39.SCHED
98669 ± 20% +36.3% 134491 ± 24% softirqs.CPU39.TIMER
68912 ± 2% +32.7% 91479 ± 2% softirqs.CPU4.RCU
43101 +15.9% 49946 softirqs.CPU4.SCHED
86425 ± 5% +18.4% 102344 ± 3% softirqs.CPU4.TIMER
70893 ± 3% +32.1% 93618 ± 3% softirqs.CPU5.RCU
42977 +17.2% 50381 softirqs.CPU5.SCHED
87301 +17.7% 102788 ± 3% softirqs.CPU5.TIMER
71151 +25.0% 88965 ± 3% softirqs.CPU6.RCU
42864 +17.3% 50282 softirqs.CPU6.SCHED
87741 ± 2% +22.5% 107458 ± 4% softirqs.CPU6.TIMER
71242 ± 4% +30.5% 92999 ± 3% softirqs.CPU7.RCU
43014 ± 2% +17.7% 50619 softirqs.CPU7.SCHED
87907 +15.8% 101781 ± 5% softirqs.CPU7.TIMER
69638 ± 2% +32.6% 92309 ± 4% softirqs.CPU8.RCU
42479 +17.6% 49947 softirqs.CPU8.SCHED
86964 ± 2% +18.6% 103128 ± 3% softirqs.CPU8.TIMER
69585 ± 2% +36.1% 94684 ± 2% softirqs.CPU9.RCU
42667 +18.0% 50343 softirqs.CPU9.SCHED
86913 +19.2% 103596 ± 4% softirqs.CPU9.TIMER
2739272 +30.7% 3580875 ± 2% softirqs.RCU
1709285 +17.3% 2005342 softirqs.SCHED
3539953 +19.4% 4226728 ± 2% softirqs.TIMER
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 7 months
- 2
- 1
[selftests/vm] a05ef00c97: kernel_selftests.vm.vmalloc_stability_smoke_test.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-8):
commit: a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd ("selftests/vm: add script helper for CONFIG_TEST_VMALLOC_MODULE")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: kernel_selftests
with following parameters:
group: kselftests-03
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
KERNEL SELFTESTS: linux_headers_dir is /usr/src/linux-headers-x86_64-rhel-7.6-a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd
2019-03-08 14:32:43 ln -sf /usr/bin/clang-7 /usr/bin/clang
2019-03-08 14:32:43 ln -sf /usr/bin/llc-7 /usr/bin/llc
------------------------------------
running vmalloc stability smoke test
------------------------------------
./run_vmtests: line 217: ./test_vmalloc.sh: Permission denied
[FAIL]
not ok 1..1 selftests: vm: run_vmtests [FAIL]
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd/tools/testing/selftests/vm'
watchdog test: not in Makefile
2019-03-08 14:42:35 make TARGETS=watchdog
make[1]: Entering directory '/usr/src/perf_selftests-x86_64-rhel-7.6-a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd/tools/testing/selftests/watchdog'
gcc watchdog-test.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd/tools/testing/selftests/watchdog/watchdog-test
make[1]: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-a05ef00c97900f69f6e69d88e8a657b7a4ef8cbd/tools/testing/selftests/watchdog'
ignored_by_lkp watchdog test
ignored_by_lkp x86.mov_ss_trap test
To reproduce:
# build kernel
cd linux
cp config-5.0.0-03309-ga05ef00 .config
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 7 months
- 3
- 2
4989526755 ("vimc: use new release op"): BUG: KASAN: use-after-free in vimc_ent_sd_unregister
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/0day-ci/linux/commits/Hans-Verkuil/Various-core-and-vi...
commit 4989526755a71e7e84450994a46672cf02f89063
Author: Hans Verkuil <hverkuil-cisco(a)xs4all.nl>
AuthorDate: Fri Mar 8 14:56:25 2019 +0100
Commit: 0day robot <lkp(a)intel.com>
CommitDate: Sat Mar 9 06:05:59 2019 +0800
vimc: use new release op
Use the new v4l2_subdev_internal_ops release op to free the
subdev memory only once the last user closed the file handle.
Signed-off-by: Hans Verkuil <hverkuil-cisco(a)xs4all.nl>
Reviewed-by: Laurent Pinchart <laurent.pinchart(a)ideasonboard.com>
30b4b1112f vimc: free vimc_cap_device when the last user disappears
4989526755 vimc: use new release op
+-------------------------------+------------+------------+
| | 30b4b1112f | 4989526755 |
+-------------------------------+------------+------------+
| boot_successes | 44 | 0 |
| boot_failures | 0 | 12 |
| BUG:KASAN:use-after-free_in_v | 0 | 12 |
+-------------------------------+------------+------------+
[ 33.321603] vimc vimc.0: bound vimc-capture.5.auto (ops vimc_cap_comp_ops)
[ 33.328846] vimc vimc.0: bound vimc-sensor.6.auto (ops vimc_sen_comp_ops)
[ 33.341183] vimc vimc.0: bound vimc-scaler.7.auto (ops vimc_sca_comp_ops)
[ 33.343315] vimc vimc.0: bound vimc-capture.8.auto (ops vimc_cap_comp_ops)
[ 33.376481] ==================================================================
[ 33.377685] BUG: KASAN: use-after-free in vimc_ent_sd_unregister+0x2b/0x35
[ 33.378739] Read of size 8 at addr ffff888018543450 by task swapper/1
[ 33.379016]
[ 33.379016] CPU: 0 PID: 1 Comm: swapper Not tainted 5.0.0-rc7-00356-g4989526 #3
[ 33.379016] Call Trace:
[ 33.379016] print_address_description+0x6f/0x249
[ 33.379016] ? vimc_ent_sd_unregister+0x2b/0x35
[ 33.379016] kasan_report+0x13c/0x181
[ 33.379016] ? vimc_ent_sd_unregister+0x2b/0x35
[ 33.379016] ? vimc_sca_remove+0x13/0x13
[ 33.379016] vimc_ent_sd_unregister+0x2b/0x35
[ 33.379016] component_unbind+0xd7/0x130
[ 33.379016] component_unbind_all+0x177/0x188
[ 33.379016] ? vimc_remove+0x42/0x42
[ 33.379016] vimc_comp_unbind+0x43/0x51
[ 33.379016] take_down_master+0x76/0xca
[ 33.379016] component_del+0xf7/0x146
[ 33.379016] vimc_sen_remove+0x10/0x13
[ 33.379016] really_probe+0x493/0x9f5
[ 33.379016] ? driver_probe_device+0x20a/0x20a
[ 33.379016] __driver_attach+0x190/0x229
[ 33.379016] bus_for_each_dev+0xfa/0x144
[ 33.379016] ? bus_remove_file+0x56/0x56
[ 33.379016] bus_add_driver+0x372/0x513
[ 33.379016] driver_register+0x236/0x2ac
[ 33.379016] ? vimc_sca_pdrv_init+0xe/0xe
[ 33.379016] do_one_initcall+0x158/0x311
[ 33.379016] ? start_kernel+0x6ca/0x6ca
[ 33.379016] ? kernel_init_freeable+0x17d/0x326
[ 33.379016] ? rcu_dynticks_curr_cpu_in_eqs+0x11/0x20
[ 33.379016] kernel_init_freeable+0x288/0x326
[ 33.379016] ? rest_init+0xbb/0xbb
[ 33.379016] kernel_init+0x7/0xfe
[ 33.379016] ? rest_init+0xbb/0xbb
[ 33.379016] ret_from_fork+0x24/0x30
[ 33.379016]
[ 33.379016] Allocated by task 1:
[ 33.379016] __kasan_kmalloc+0x85/0x96
[ 33.379016] kmem_cache_alloc_trace+0xe9/0x10d
[ 33.379016] vimc_sca_comp_bind+0xbd/0x30b
[ 33.379016] component_bind_all+0x331/0x634
[ 33.379016] vimc_comp_bind+0xc4/0x3ca
[ 33.379016] try_to_bring_up_master+0x579/0x60e
[ 33.379016] component_add+0x1b8/0x22b
[ 33.379016] platform_drv_probe+0x97/0xec
[ 33.379016] really_probe+0x419/0x9f5
[ 33.379016] __driver_attach+0x190/0x229
[ 33.379016] bus_for_each_dev+0xfa/0x144
[ 33.379016] bus_add_driver+0x372/0x513
[ 33.379016] driver_register+0x236/0x2ac
[ 33.379016] do_one_initcall+0x158/0x311
[ 33.379016] kernel_init_freeable+0x288/0x326
[ 33.379016] kernel_init+0x7/0xfe
[ 33.379016] ret_from_fork+0x24/0x30
[ 33.379016]
[ 33.379016] Freed by task 1:
[ 33.379016] __kasan_slab_free+0x107/0x129
[ 33.379016] slab_free_freelist_hook+0x79/0xc5
[ 33.379016] kfree+0x130/0x1b9
[ 33.379016] v4l2_device_release_subdev_node+0x32/0x3b
[ 33.379016] v4l2_device_release+0x25a/0x274
[ 33.379016] device_release+0x119/0x180
[ 33.379016] kobject_release+0x292/0x2cd
[ 33.379016] vimc_ent_sd_unregister+0xc/0x35
[ 33.379016] component_unbind+0xd7/0x130
[ 33.379016] component_unbind_all+0x177/0x188
[ 33.379016] vimc_comp_unbind+0x43/0x51
[ 33.379016] take_down_master+0x76/0xca
[ 33.379016] component_del+0xf7/0x146
[ 33.379016] vimc_sen_remove+0x10/0x13
[ 33.379016] really_probe+0x493/0x9f5
[ 33.379016] __driver_attach+0x190/0x229
[ 33.379016] bus_for_each_dev+0xfa/0x144
[ 33.379016] bus_add_driver+0x372/0x513
[ 33.379016] driver_register+0x236/0x2ac
[ 33.379016] do_one_initcall+0x158/0x311
[ 33.379016] kernel_init_freeable+0x288/0x326
[ 33.379016] kernel_init+0x7/0xfe
[ 33.379016] ret_from_fork+0x24/0x30
[ 33.379016]
[ 33.379016] The buggy address belongs to the object at ffff888018543448
[ 33.379016] which belongs to the cache kmalloc-512 of size 512
[ 33.379016] The buggy address is located 8 bytes inside of
[ 33.379016] 512-byte region [ffff888018543448, ffff888018543648)
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 5d5133a94de8e0d50448f396b6f69e403a455ee6 1c163f4c7b3f621efff9b28a47abb36f7378d783 --
git bisect bad ce7a21816c3967429d1708b09de6a50bdc52111c # 13:29 B 0 10 24 0 Merge 'linux-review/Mao-Wenan/net-sit-fix-memory-leak-in-sit_init_net/20190302-073924' into devel-hourly-2019031108
git bisect good a6fddb985ddd6d2950acbc3fd2e58c7343a8d131 # 13:44 G 10 0 0 0 Merge 'linux-review/Dan-Carpenter/mt76-Fix-an-IS_ERR-vs-NULL-check-in-mt76_wmac_probe/20190308-190445' into devel-hourly-2019031108
git bisect bad 248b78cd61684a442ce2f0be89a59a20141477db # 14:04 B 0 2 16 0 Merge 'linux-review/Aditya-Pakki/rsi-Fix-NULL-pointer-dereference-in-kmalloc/20190303-074907' into devel-hourly-2019031108
git bisect bad 82ba62776b86677a0d0981ca6e94b3f1d9cc904a # 14:29 B 0 5 19 0 Merge 'linux-review/Chuck-Lever/SUNRPC-Avoid-digging-into-the-ATOMIC-pool/20190305-165241' into devel-hourly-2019031108
git bisect bad b6accb3f82b5932c4c36cdd93b9e8d804690d04e # 14:55 B 0 3 17 0 Merge 'linux-review/Ido-Schimmel/team-Free-BPF-filter-when-unregistering-netdev/20190303-163813' into devel-hourly-2019031108
git bisect good e586ad3b1f2a07009cd9a6a3e9d51b9a764554b9 # 15:41 G 11 0 0 0 Merge 'linux-review/UPDATE-20190305-003004/Adrian-Hunter/perf-probe-Fix-getting-the-kernel-map/20190228-072842' into devel-hourly-2019031108
git bisect good 0ab126594027f442841ae4beec1151b9f253b622 # 15:59 G 11 0 0 0 Merge 'linux-review/Jin-Yao/perf-diff-Add-new-filter-options/20190304-150507' into devel-hourly-2019031108
git bisect bad b455715b9d18892d596090db7eb3077f057650f2 # 16:20 B 0 11 26 1 Merge 'linux-review/Baolin-Wang/Add-new-features-for-the-Spreadtrum-serial-controller/20190305-042651' into devel-hourly-2019031108
git bisect good 1abf4400f8471e0aee9888b8b04d1e1f1def0ac2 # 16:37 G 11 0 0 0 Merge 'linux-review/Ido-Schimmel/ip6mr-Do-not-call-__IP6_INC_STATS-from-preemptible-context/20190303-165422' into devel-hourly-2019031108
git bisect bad 14a91a14c631612437752f4d527033d653d37f04 # 17:14 B 0 3 17 0 Merge 'linux-review/Hans-Verkuil/Various-core-and-virtual-driver-fixes/20190309-060555' into devel-hourly-2019031108
git bisect good 24bc9d9131a92ff81b83d7d3e6b2a8ed2fc6d4f5 # 17:40 G 11 0 0 0 v4l2-subdev: add release() internal op
git bisect good 1dea0dd3364378ee34a027b16f15d9cc0eab40f9 # 18:08 G 10 0 0 0 vimc: zero the media_device on probe
git bisect bad 4989526755a71e7e84450994a46672cf02f89063 # 18:26 B 0 9 24 1 vimc: use new release op
git bisect good 30b4b1112f0f74ef477f3f4b98bb58cea302e7b9 # 18:38 G 10 0 0 0 vimc: free vimc_cap_device when the last user disappears
# first bad commit: [4989526755a71e7e84450994a46672cf02f89063] vimc: use new release op
git bisect good 30b4b1112f0f74ef477f3f4b98bb58cea302e7b9 # 18:41 G 32 0 0 0 vimc: free vimc_cap_device when the last user disappears
# extra tests with debug options
git bisect bad 4989526755a71e7e84450994a46672cf02f89063 # 18:54 B 0 1 15 0 vimc: use new release op
# extra tests on HEAD of linux-devel/devel-hourly-2019031108
git bisect bad 5d5133a94de8e0d50448f396b6f69e403a455ee6 # 18:59 B 0 13 30 0 0day head guard for 'devel-hourly-2019031108'
# extra tests on tree/branch linux-review/Hans-Verkuil/Various-core-and-virtual-driver-fixes/20190309-060555
git bisect bad 4989526755a71e7e84450994a46672cf02f89063 # 19:02 B 0 12 26 0 vimc: use new release op
# extra tests with first bad commit reverted
git bisect good 0ce80d460710675d2b250d08978e976cfdf47424 # 19:18 G 10 0 0 0 Revert "vimc: use new release op"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
1 year, 7 months
- 1
- 0
[lib/test_bitmap.c] ecdc93614a: kernel_selftests.lib.bitmap.sh.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-8):
commit: ecdc93614ac2e83d11b08e8b603ebd14e90c39c2 ("[PATCH v9 2/9] lib/test_bitmap.c: Add for_each_set_clump8 test cases")
url: https://github.com/0day-ci/linux/commits/William-Breathitt-Gray/Introduce...
base: https://git.kernel.org/cgit/linux/kernel/git/linusw/linux-gpio.git for-next
in testcase: kernel_selftests
with following parameters:
group: kselftests-01
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
KERNEL SELFTESTS: linux_headers_dir is /usr/src/linux-headers-x86_64-rhel-7.6-ecdc93614ac2e83d11b08e8b603ebd14e90c39c2
2019-03-08 11:24:52 ln -sf /usr/bin/clang-7 /usr/bin/clang
2019-03-08 11:24:52 ln -sf /usr/bin/llc-7 /usr/bin/llc
2019-03-08 11:28:25 make run_tests -C lib
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-7.6-ecdc93614ac2e83d11b08e8b603ebd14e90c39c2/tools/testing/selftests/lib'
TAP version 13
selftests: lib: printf.sh
========================================
printf: ok
ok 1..1 selftests: lib: printf.sh [PASS]
selftests: lib: bitmap.sh
========================================
bitmap: [FAIL]
not ok 1..2 selftests: lib: bitmap.sh [FAIL]
selftests: lib: prime_numbers.sh
========================================
prime_numbers: ok
ok 1..3 selftests: lib: prime_numbers.sh [PASS]
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-ecdc93614ac2e83d11b08e8b603ebd14e90c39c2/tools/testing/selftests/lib'
locking test: not in Makefile
To reproduce:
# build kernel
cd linux
cp config-5.0.0-rc6-00113-gecdc936 .config
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 7 months
- 1
- 0
[proc] e483b02087: kernel_selftests.proc.proc-pid-vm.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-8):
commit: e483b0208784146864a2c195e316230647e9d297 ("proc: test /proc/*/maps, smaps, smaps_rollup, statm")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: kernel_selftests
with following parameters:
group: kselftests-02
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
KERNEL SELFTESTS: linux_headers_dir is /usr/src/linux-headers-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297
2019-03-08 13:51:08 ln -sf /usr/bin/clang-7 /usr/bin/clang
2019-03-08 13:51:08 ln -sf /usr/bin/llc-7 /usr/bin/llc
2019-03-08 13:56:30 make run_tests -C proc
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc'
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE fd-001-lookup.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/fd-001-lookup
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE fd-002-posix-eq.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/fd-002-posix-eq
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE fd-003-kthread.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/fd-003-kthread
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-loadavg-001.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-loadavg-001
proc-loadavg-001.c:17:0: warning: "_GNU_SOURCE" redefined
#define _GNU_SOURCE
<command-line>:0:0: note: this is the location of the previous definition
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-pid-vm.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-pid-vm
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-self-map-files-001.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-self-map-files-001
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-self-map-files-002.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-self-map-files-002
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-self-syscall.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-self-syscall
proc-self-syscall.c:16:0: warning: "_GNU_SOURCE" redefined
#define _GNU_SOURCE
<command-line>:0:0: note: this is the location of the previous definition
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-self-wchan.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-self-wchan
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-uptime-001.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-uptime-001
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE proc-uptime-002.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/proc-uptime-002
proc-uptime-002.c:18:0: warning: "_GNU_SOURCE" redefined
#define _GNU_SOURCE
<command-line>:0:0: note: this is the location of the previous definition
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE read.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/read
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE self.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/self
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE setns-dcache.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/setns-dcache
gcc -Wall -O2 -Wno-unused-function -D_GNU_SOURCE thread-self.c -o /usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc/thread-self
TAP version 13
selftests: proc: fd-001-lookup
========================================
ok 1..1 selftests: proc: fd-001-lookup [PASS]
selftests: proc: fd-002-posix-eq
========================================
ok 1..2 selftests: proc: fd-002-posix-eq [PASS]
selftests: proc: fd-003-kthread
========================================
ok 1..3 selftests: proc: fd-003-kthread [PASS]
selftests: proc: proc-loadavg-001
========================================
ok 1..4 selftests: proc: proc-loadavg-001 [PASS]
selftests: proc: proc-pid-vm
========================================
proc-pid-vm: proc-pid-vm.c:277: main: Assertion `rv == strlen(buf0)' failed.
Aborted
not ok 1..5 selftests: proc: proc-pid-vm [FAIL]
selftests: proc: proc-self-map-files-001
========================================
ok 1..6 selftests: proc: proc-self-map-files-001 [PASS]
selftests: proc: proc-self-map-files-002
========================================
ok 1..7 selftests: proc: proc-self-map-files-002 [PASS]
selftests: proc: proc-self-syscall
========================================
ok 1..8 selftests: proc: proc-self-syscall [PASS]
selftests: proc: proc-self-wchan
========================================
ok 1..9 selftests: proc: proc-self-wchan [PASS]
selftests: proc: proc-uptime-001
========================================
ok 1..10 selftests: proc: proc-uptime-001 [PASS]
selftests: proc: proc-uptime-002
========================================
ok 1..11 selftests: proc: proc-uptime-002 [PASS]
selftests: proc: read
========================================
ok 1..12 selftests: proc: read [PASS]
selftests: proc: self
========================================
ok 1..13 selftests: proc: self [PASS]
selftests: proc: setns-dcache
========================================
ok 1..14 selftests: proc: setns-dcache [PASS]
selftests: proc: thread-self
========================================
ok 1..15 selftests: proc: thread-self [PASS]
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-e483b0208784146864a2c195e316230647e9d297/tools/testing/selftests/proc'
To reproduce:
# build kernel
cd linux
cp config-5.0.0-03428-ge483b02 .config
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-8 CC=gcc-8 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 7 months
- 1
- 0