[mount] eced5272a0: WARNING:at_fs/namespace.c:#do_mount
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: eced5272a09a41dc7fecc6e1af525fc12763bce6 ("mount: Add mount warning for impending timestamp expiry")
https://github.com/deepa-hub/vfs next-20190614
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 32G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+---------------------------------------------------------+------------+------------+
| | 0a1bd595eb | eced5272a0 |
+---------------------------------------------------------+------------+------------+
| boot_successes | 19 | 0 |
| boot_failures | 13 | 34 |
| BUG:kernel_reboot-without-warning_in_test_stage | 11 | |
| invoked_oom-killer:gfp_mask=0x | 2 | |
| Mem-Info | 2 | |
| Out_of_memory_and_no_killable_processes | 2 | |
| Kernel_panic-not_syncing:System_is_deadlocked_on_memory | 2 | |
| WARNING:at_fs/namespace.c:#do_mount | 0 | 34 |
| RIP:do_mount | 0 | 34 |
| BUG:kernel_hang_in_test_stage | 0 | 1 |
+---------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 12.235247] WARNING: CPU: 0 PID: 21 at fs/namespace.c:3129 do_mount+0x384/0xa70
[ 12.236023] Modules linked in:
[ 12.236023] CPU: 0 PID: 21 Comm: kdevtmpfs Not tainted 5.2.0-rc4-next-20190614-00004-geced5272a09a4 #1
[ 12.236023] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 12.236023] RIP: 0010:do_mount+0x384/0xa70
[ 12.236023] Code: e4 ff 48 8b 8b f0 03 00 00 48 05 00 09 64 38 48 39 c8 7d e2 48 8b 43 28 4c 89 e2 48 c7 c7 b0 61 af 9b 48 8b 30 e8 6c e4 db ff <0f> 0b 31 c0 e9 41 fd ff ff bf 15 00 00 00 89 14 24 e8 86 9a dc ff
[ 12.236023] RSP: 0000:ffffaa11400bfe28 EFLAGS: 00010286
[ 12.236023] RAX: 0000000000000000 RBX: ffff9aee07c48800 RCX: ffffffff9be68f08
[ 12.236023] RDX: 0000000000000001 RSI: 0000000000000092 RDI: 0000000000000246
[ 12.236023] RBP: ffff9aee07d74920 R08: 00000000000000ec R09: 0000000000000062
[ 12.236023] R10: ffffe05f441fae80 R11: ffffaa11400bfcc8 R12: ffffffff9bb089f3
[ 12.236023] R13: ffff9aee07d74900 R14: ffff9aee07c012e0 R15: 0000000000000020
[ 12.236023] FS: 0000000000000000(0000) GS:ffff9af53fc00000(0000) knlGS:0000000000000000
[ 12.236023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 12.236023] CR2: ffffaa11400c0000 CR3: 00000002f6c0a000 CR4: 00000000000006f0
[ 12.236023] Call Trace:
[ 12.236023] ksys_mount+0x80/0xd0
[ 12.236023] ? handle_create+0x1f0/0x1f0
[ 12.236023] devtmpfsd+0x6d/0x190
[ 12.236023] kthread+0x11e/0x140
[ 12.236023] ? kthread_park+0x90/0x90
[ 12.236023] ret_from_fork+0x35/0x40
[ 12.236023] ---[ end trace f70ed54bb287f49d ]---
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc4-next-20190614-00004-geced5272a09a4 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months
- 1
- 0
[loopback] 4de83b88c6: WARNING:suspicious_RCU_usage
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 4de83b88c66a1e4dba426b29766fb68e61d93792 ("loopback: create blackhole net device similar to loopack.")
https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git master
in testcase: trinity
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------------------------+------------+------------+
| | 8909783cb5 | 4de83b88c6 |
+------------------------------------------------------------------------+------------+------------+
| boot_successes | 14 | 0 |
| boot_failures | 2 | 10 |
| BUG:kernel_hang_in_boot-around-mounting-root_stage | 1 | |
| IP-Config:Auto-configuration_of_network_failed | 1 | 1 |
| WARNING:suspicious_RCU_usage | 0 | 10 |
| include/linux/rtnetlink.h:#suspicious_rcu_dereference_protected()usage | 0 | 10 |
+------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 14.675051] WARNING: suspicious RCU usage
[ 14.675847] 5.2.0-rc6-01699-g4de83b8 #1 Tainted: G T
[ 14.676977] -----------------------------
[ 14.677767] include/linux/rtnetlink.h:85 suspicious rcu_dereference_protected() usage!
[ 14.679506]
[ 14.679506] other info that might help us debug this:
[ 14.679506]
[ 14.681054]
[ 14.681054] rcu_scheduler_active = 2, debug_locks = 1
[ 14.682294] no locks held by swapper/0/1.
[ 14.683126]
[ 14.683126] stack backtrace:
[ 14.684050] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G T 5.2.0-rc6-01699-g4de83b8 #1
[ 14.685659] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 14.687184] Call Trace:
[ 14.687749] dump_stack+0x7c/0xc3
[ 14.688437] dev_init_scheduler+0xd7/0x190
[ 14.689246] ? net_olddevs_init+0x5d/0x5d
[ 14.690051] ? do_early_param+0xb3/0xb3
[ 14.690821] blackhole_netdev_init+0x42/0x85
[ 14.691647] do_one_initcall+0x17c/0x380
[ 14.692432] ? initcall_blacklisted+0x150/0x150
[ 14.693106] ? lock_downgrade+0x250/0x2b0
[ 14.693106] ? lock_acquire+0x1b6/0x1f0
[ 14.693106] ? do_early_param+0xb3/0xb3
[ 14.693106] kernel_init_freeable+0x3a6/0x45e
[ 14.693106] ? rest_init+0x240/0x240
[ 14.693106] kernel_init+0xf/0x120
[ 14.693106] ? _raw_spin_unlock_irq+0x34/0x50
[ 14.693106] ? rest_init+0x240/0x240
[ 14.693106] ret_from_fork+0x24/0x30
[ 14.703089] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI
[ 14.704437] e1000: Copyright (c) 1999-2006 Intel Corporation.
[ 18.732818] PCI Interrupt Link [LNKC] enabled at IRQ 11
[ 19.159911] e1000 0000:00:03.0 eth0: (PCI:33MHz:32-bit) 52:54:00:12:34:56
[ 19.161267] e1000 0000:00:03.0 eth0: Intel(R) PRO/1000 Network Connection
[ 24.301353] rcu-perf: rcu_perf_writer 1 has 100 measurements
[ 24.303083] rcu-perf: rcu_perf_writer 0 has 100 measurements
[ 24.413125] Dumping ftrace buffer:
[ 24.414212] (ftrace buffer empty)
[ 24.414980] rcu-perf: Test complete
[ 27.308838] e1000 0000:00:03.0 eth0: (PCI:33MHz:32-bit) 52:54:00:12:34:56
[ 27.310641] e1000 0000:00:03.0 eth0: Intel(R) PRO/1000 Network Connection
[ 27.313807] usbcore: registered new interface driver usbtmc
[ 27.315047] usbcore: registered new interface driver usb-storage
[ 27.316263] usbcore: registered new interface driver ums_eneub6250
[ 27.317604] usbcore: registered new interface driver adutux
[ 27.318784] usbcore: registered new interface driver appledisplay
[ 27.320032] usbcore: registered new interface driver cytherm
[ 27.321206] usbcore: registered new interface driver emi26 - firmware loader
[ 27.322593] usbcore: registered new interface driver iowarrior
[ 27.323906] usbcore: registered new interface driver isight_firmware
[ 27.325189] usbcore: registered new interface driver usblcd
[ 27.326348] usbcore: registered new interface driver legousbtower
[ 27.327594] usbcore: registered new interface driver rio500
[ 27.328824] usbcore: registered new interface driver usbtest
[ 27.330009] usbcore: registered new interface driver lvs
[ 27.331820] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 27.335179] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 27.336854] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 27.340657] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[ 27.345403] usbcore: registered new interface driver xpad
[ 27.346683] usbcore: registered new interface driver gtco
[ 27.347836] usbcore: registered new interface driver pegasus_notetaker
[ 27.350101] mk712: device not present
[ 27.351056] usbcore: registered new interface driver usbtouchscreen
[ 27.353198] usbcore: registered new interface driver ati_remote2
[ 27.354824] usbcore: registered new interface driver keyspan_remote
[ 27.358901] rtc_cmos 00:00: RTC can wake from S4
[ 27.362193] rtc rtc0: alarm rollover: day
[ 27.363910] rtc_cmos 00:00: char device (0:0)
[ 27.363914] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 27.364984] rtc_cmos 00:00: registered as rtc0
[ 27.368376] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram, hpet irqs
[ 27.371730] rtc_cmos 00:00: RTC can wake from S4
[ 27.373382] rtc rtc1: alarm rollover: day
[ 27.376906] rtc_cmos 00:00: char device (0:1)
[ 27.378153] rtc_cmos 00:00: registered as rtc1
[ 27.379656] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram, hpet irqs
[ 27.384627] i2c /dev entries driver
[ 27.385769] i2c-parport-light: adapter type unspecified
[ 27.387136] usbcore: registered new interface driver RobotFuzz Open Source InterFace, OSIF
[ 27.389221] usbcore: registered new interface driver i2c-tiny-usb
[ 27.391172] IR Sharp protocol handler initialized
[ 27.392282] ir_imon_decoder: IR iMON protocol handler initialized
[ 27.393738] IR RCMM protocol handler initialized
[ 27.394834] Driver for 1-wire Dallas network protocol.
[ 27.399165] intel_powerclamp: CPU does not support MWAIT
[ 27.400646] advantechwdt: WDT driver for Advantech single board computer initialising
[ 27.403903] advantechwdt: initialized. timeout=60 sec (nowayout=1)
[ 27.405481] ib700wdt: WDT driver for IB700 single board computer initialising
[ 27.407789] ib700wdt: START method I/O 443 is not available
[ 27.409106] ib700wdt: probe of ib700wdt failed with error -5
[ 27.411021] it87_wdt: no device
[ 27.411836] pc87413_wdt: Version 1.1 at io 0x2E
[ 27.412931] pc87413_wdt: cannot register miscdev on minor=130 (err=-16)
[ 27.414580] w83877f_wdt: I/O address 0x0443 already in use
[ 27.415849] w83977f_wdt: driver v1.00
[ 27.416776] w83977f_wdt: cannot register miscdev on minor=130 (err=-16)
[ 27.418248] machzwd: MachZ ZF-Logic Watchdog driver initializing
[ 27.419607] machzwd: no ZF-Logic found
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc6-01699-g4de83b8 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months
- 1
- 0
[selftests/bpf] 6135bdd95f: kernel_selftests.bpf.test_offload.py.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 6135bdd95f26fe417db4e46d1e517de41e0ab9c1 ("[PATCH v2 bpf-next 4/4] selftests/bpf: convert legacy BPF maps to BTF-defined ones")
url: https://github.com/0day-ci/linux/commits/Andrii-Nakryiko/capture-integers...
base: https://kernel.googlesource.com/pub/scm/linux/kernel/git/bpf/bpf-next.git master
in testcase: kernel_selftests
with following parameters:
group: kselftests-00
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
# selftests: bpf: test_offload.py
# Test destruction of generic XDP...
# Test TC non-offloaded...
# Test TC non-offloaded isn't getting bound...
# Test TC offloads are off by default...
# Test TC offload by default...
# Test TC cBPF bytcode tries offload by default...
# Test TC cBPF unbound bytecode doesn't offload...
# Test non-0 chain offload...
# Test TC replace...
# Test TC replace bad flags...
# Test spurious extack from the driver...
# Test TC offloads work...
# Test TC offload basics...
# Test TC offload is device-bound...
# Test disabling TC offloads is rejected while filters installed...
# Test qdisc removal frees things...
# Test disabling TC offloads is OK without filters...
# Test destroying device gets rid of TC filters...
# Test destroying device gets rid of XDP...
# Test XDP prog reporting...
# Test XDP prog replace without force...
# Test XDP prog replace with force...
# Test XDP prog replace with bad flags...
# Test XDP prog remove with bad flags...
# Test MTU restrictions...
# Test non-offload XDP attaching to HW...
# Test offload XDP attaching to drv...
# Test XDP offload...
# Test XDP offload is device bound...
# Test removing XDP program many times...
# Test attempt to use a program for a wrong device...
# Test multi-attachment XDP - default + offload...
# Test multi-attachment XDP - replace...
# Test multi-attachment XDP - detach...
# Test multi-attachment XDP - reattach...
# Test multi-attachment XDP - device remove...
# Test multi-attachment XDP - drv + offload...
# Test multi-attachment XDP - replace...
# Test multi-attachment XDP - detach...
# Test multi-attachment XDP - reattach...
# Test multi-attachment XDP - device remove...
# Test multi-attachment XDP - generic + offload...
# Test multi-attachment XDP - replace...
# Test multi-attachment XDP - reattach...
# Test multi-attachment XDP - device remove...
# Test mixing of TC and XDP...
# Test binding TC from pinned...
# Test binding XDP from pinned...
# Test offload of wrong type fails...
# Test asking for TC offload of two filters...
# Test if netdev removal waits for translation...
# Test loading program with maps...
# Traceback (most recent call last):
# File "./test_offload.py", line 1153, in <module>
# sim.set_xdp(map_obj, "offload", JSON=False) # map fixup msg breaks JSON
# File "./test_offload.py", line 469, in set_xdp
# fail=fail, include_stderr=include_stderr)
# File "./test_offload.py", line 230, in ip
# fail=fail, include_stderr=include_stderr)
# File "./test_offload.py", line 155, in tool
# fail=fail, include_stderr=False)
# File "./test_offload.py", line 108, in cmd
# return cmd_result(proc, include_stderr=include_stderr, fail=fail)
# File "./test_offload.py", line 130, in cmd_result
# raise Exception("Command failed: %s\n%s" % (proc.args, stderr))
# Exception: Command failed: ip link set dev eth1 xdpoffload obj /usr/src/perf_selftests-x86_64-rhel-7.6-6135bdd95f26fe417db4e46d1e517de41e0ab9c1/tools/testing/selftests/bpf/sample_map_ret0.o sec .text
#
#
# BTF debug data section '.BTF' rejected: Invalid argument (22)!
# - Length: 811
# Verifier analysis:
#
# magic: 0xeb9f
# version: 1
# flags: 0x0
# hdr_len: 24
# type_off: 0
# type_len: 384
# str_off: 384
# str_len: 403
# btf_total_size: 811
# [1] FUNC_PROTO (anon) return=2 args=(void)
# [2] INT int size=4 bits_offset=0 nr_bits=32 encoding=SIGNED
# [3] FUNC func type_id=1
# [4] STRUCT (anon) size=32 vlen=4
# type type_id=5 bits_offset=0
# max_entries type_id=8 bits_offset=64
# key type_id=10 bits_offset=128
# value type_id=13 bits_offset=192
# [5] PTR (anon) type_id=6
# [6] ARRAY (anon) type_id=2 index_type_id=7 nr_elems=1
# [7] INT __ARRAY_SIZE_TYPE__ size=4 bits_offset=0 nr_bits=32 encoding=(none)
# [8] PTR (anon) type_id=9
# [9] ARRAY (anon) type_id=2 index_type_id=7 nr_elems=2
# [10] PTR (anon) type_id=11
# [11] TYPEDEF __u32 type_id=12
# [12] INT unsigned int size=4 bits_offset=0 nr_bits=32 encoding=(none)
# [13] PTR (anon) type_id=14
# [14] INT long int size=8 bits_offset=0 nr_bits=64 encoding=SIGNED
# [15] VAR htab type_id=4 linkage=1
# [16] STRUCT (anon) size=32 vlen=4
# type type_id=8 bits_offset=0
# max_entries type_id=8 bits_offset=64
# key type_id=10 bits_offset=128
# value type_id=13 bits_offset=192
# [17] VAR array type_id=16 linkage=1
# [18] DATASEC .maps size=0 vlen=2 size == 0
#
#
# Prog section '.text' rejected: Permission denied (13)!
# - Type: 6
# - Instructions: 21 (0 over limit)
# - License:
#
# Verifier analysis:
#
# 0: (b7) r1 = 0
# 1: (7b) *(u64 *)(r10 -8) = r1
# last_idx 1 first_idx 0
# regs=2 stack=0 before 0: (b7) r1 = 0
# 2: (63) *(u32 *)(r10 -12) = r1
# 3: (bf) r2 = r10
# 4: (07) r2 += -12
# 5: (18) r1 = 0x0
# 7: (85) call bpf_map_lookup_elem#1
# R1 type=inv expected=map_ptr
# processed 7 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0
#
# Error fetching program/map!
not ok 34 selftests: bpf: test_offload.py
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc5-01621-g6135bdd95f26f .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months
- 1
- 0
922c7b4064 ("locking/mutex: Test for initialized mutex"): WARNING: CPU: 0 PID: 0 at kernel/locking/mutex.c:912 __mutex_lock
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://kernel.googlesource.com/pub/scm/linux/kernel/git/bigeasy/staging.git fpu
commit 922c7b406473a362269dae9d1a1a1c65e23368c7
Author: Sebastian Andrzej Siewior <bigeasy(a)linutronix.de>
AuthorDate: Wed Jul 3 11:10:47 2019 +0200
Commit: Sebastian Andrzej Siewior <bigeasy(a)linutronix.de>
CommitDate: Wed Jul 3 11:10:47 2019 +0200
locking/mutex: Test for initialized mutex
An uninitialized/ zeroed mutex will go unnoticed because there is no
check for it. There is a magic check in the unlock's slowpath path which
might go unnoticed if the unlock happens in the fastpath.
Add a ->magic check early in the mutex_lock() and mutex_trylock() path.
Signed-off-by: Sebastian Andrzej Siewior <bigeasy(a)linutronix.de>
f4237c7374 x86/fpu: Make no387 and nofxsr work a little better on modern CPUs
922c7b4064 locking/mutex: Test for initialized mutex
78abee03d6 x86/fpu: Inline fpu__xstate_clear_all_cpu_caps()
+----------------------------------------------------+------------+------------+------------+
| | f4237c7374 | 922c7b4064 | 78abee03d6 |
+----------------------------------------------------+------------+------------+------------+
| boot_successes | 15 | 0 | 0 |
| boot_failures | 12 | 11 | 11 |
| BUG:kernel_hang_in_boot-around-mounting-root_stage | 10 | 6 | |
| invoked_oom-killer:gfp_mask=0x | 2 | | |
| Mem-Info | 2 | | |
| RIP:__get_user_8 | 1 | | |
| WARNING:at_kernel/locking/mutex.c:#__mutex_lock | 0 | 11 | 11 |
| RIP:__mutex_lock | 0 | 11 | 11 |
+----------------------------------------------------+------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 0.621357] pid_max: default: 4096 minimum: 301
[ 0.622902] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.623681] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.634284] ------------[ cut here ]------------
[ 0.634824] DEBUG_LOCKS_WARN_ON(lock->magic != lock)
[ 0.634846] WARNING: CPU: 0 PID: 0 at kernel/locking/mutex.c:912 __mutex_lock+0x1b9/0x14b8
[ 0.636559] Modules linked in:
[ 0.636918] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.2.0-rc6-00002-g922c7b4 #1
[ 0.637767] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 0.638714] RIP: 0010:__mutex_lock+0x1b9/0x14b8
[ 0.639240] Code: 83 3d d5 5d d6 02 00 75 31 48 c7 c6 c0 e3 06 83 48 c7 c7 a0 e2 06 83 48 ff 05 4e 55 52 03 e8 bb f2 61 fe 48 ff 05 4a 55 52 03 <0f> 0b 48 ff 05 49 55 52 03 48 ff 05 4a 55 52 03 65 ff 05 9b 1e 4c
[ 0.640372] RSP: 0000:ffffffff84207ae0 EFLAGS: 00010202
[ 0.640372] RAX: 0000000000000000 RBX: ffffffff86bc08e0 RCX: 0000000000000000
[ 0.640372] RDX: 1ffffffff0b19100 RSI: 0000000000000004 RDI: fffffbfff0840f51
[ 0.640372] RBP: ffffffff84207c60 R08: fffffbfff0890b49 R09: 296b636f6c203d21
[ 0.640372] R10: fffffbfff0b191aa R11: fffffbfff0890b48 R12: 0000000000000000
[ 0.640372] R13: 0000000000000000 R14: dffffc0000000000 R15: ffffffff84682f28
[ 0.640372] FS: 0000000000000000(0000) GS:ffff888019e00000(0000) knlGS:0000000000000000
[ 0.640372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 0.640372] CR2: 00000000ffffffff CR3: 0000000004214001 CR4: 00000000000606b0
[ 0.640372] Call Trace:
[ 0.640372] ? ldt_dup_context+0x42/0x201
[ 0.640372] ? find_held_lock+0x34/0x132
[ 0.640372] ? __ww_mutex_check_waiters+0x17a/0x17a
[ 0.640372] ? get_mm_exe_file+0x2c8/0x320
[ 0.640372] ? reacquire_held_locks+0x379/0x379
[ 0.640372] ? get_mm_exe_file+0x2ee/0x320
[ 0.640372] ? lock_acquire+0x319/0x37a
[ 0.640372] ? mutex_lock_nested+0x20/0x28
[ 0.640372] mutex_lock_nested+0x20/0x28
[ 0.640372] ldt_dup_context+0x42/0x201
[ 0.640372] dup_mmap+0x108e/0x11f7
[ 0.640372] ? vm_area_free+0x1e/0x1e
[ 0.640372] ? kasan_check_write+0x1e/0x26
[ 0.640372] ? __init_rwsem+0x11a/0x159
[ 0.640372] dup_mm+0x7d/0x323
[ 0.640372] copy_init_mm+0x15/0x1d
[ 0.640372] poking_init+0x80/0x366
[ 0.640372] ? trace_event_define_fields_tlb_flush+0xfe/0xfe
[ 0.640372] ? cgroup_init+0x1018/0x107d
[ 0.640372] start_kernel+0xae2/0xb6b
[ 0.640372] ? thread_stack_cache_init+0x35/0x35
[ 0.640372] x86_64_start_reservations+0x71/0x99
[ 0.640372] x86_64_start_kernel+0xdc/0x106
[ 0.640372] secondary_startup_64+0xa4/0xb0
[ 0.640372] irq event stamp: 2619
[ 0.640372] hardirqs last enabled at (2619): [<ffffffff814defe6>] bad_range+0xfe/0x2c0
[ 0.640372] hardirqs last disabled at (2618): [<ffffffff814def6e>] bad_range+0x86/0x2c0
[ 0.640372] softirqs last enabled at (2600): [<ffffffff8134e81c>] cgroup_idr_alloc+0x6f/0x8d
[ 0.640372] softirqs last disabled at (2596): [<ffffffff8134e7e5>] cgroup_idr_alloc+0x38/0x8d
[ 0.640372] random: get_random_bytes called from init_oops_id+0x24/0x41 with crng_init=0
[ 0.640372] ---[ end trace e0e06c60ad508010 ]---
[ 0.640693] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 3515546e8cfa1665e1ee8446cfe40287b247b94a 6fbc7275c7a9ba97877050335f290341a1fd8dbf --
git bisect good 1cfe51da6ea261625b1f3dbf45eec436973b8479 # 18:02 G 11 0 11 11 Merge 'linux-review/Liu-Changcheng/RDMA-i40iw-set-queue-pair-state-when-being-queried/20190628-175445' into devel-hourly-2019070405
git bisect good 02a240a9da2d60332a068604499ed739621a6e5d # 18:53 G 10 0 10 10 Merge 'stm32/stm32-next' into devel-hourly-2019070405
git bisect good 91c9b081a9aacc697bfa192179864d27c1a8a513 # 19:47 G 11 0 11 11 Merge 'linux-review/Eiichi-Tsukata/net-ipv6-Fix-misuse-of-proc_dointvec-flowlabel_reflect/20190628-140120' into devel-hourly-2019070405
git bisect good 0aec672a6c60a9ae49bfeab71da4a1825d508238 # 20:17 G 11 0 11 11 Merge 'linux-review/sameehj-amazon-com/net-ena-Fix-bug-where-ring-allocation-backoff-stopped-too-late/20190623-163224' into devel-hourly-2019070405
git bisect good 34be0df1387f3e23825cc0f8066bc54be9f1fc62 # 21:08 G 10 0 10 10 Merge 'luto/x86/syscalls_x32' into devel-hourly-2019070405
git bisect bad cb3d3ea1aa19f237fbc17c31a7d6d67530dd1129 # 22:09 B 0 1 36 20 Merge 'gpio/fixes' into devel-hourly-2019070405
git bisect good c55a01ea7a0d010a21870f35f59ba456937d0589 # 00:38 G 11 0 11 11 Merge 'pci/pci/peer-to-peer' into devel-hourly-2019070405
git bisect good 8df4e94b710512e37723bde91fae5571542692c2 # 02:00 G 10 0 10 10 Merge 'lpieralisi-pci/not-to-merge/pci/mobiveil' into devel-hourly-2019070405
git bisect bad f32b9ccfbf6c9dc9874a5c05a63638434a176293 # 03:27 B 0 6 26 5 Merge 'bigeasy-staging/fpu' into devel-hourly-2019070405
git bisect bad 922c7b406473a362269dae9d1a1a1c65e23368c7 # 05:04 B 0 1 16 0 locking/mutex: Test for initialized mutex
git bisect good f4237c73742576c35922aec9a7402f44f86b32b4 # 05:23 G 10 0 3 3 x86/fpu: Make no387 and nofxsr work a little better on modern CPUs
# first bad commit: [922c7b406473a362269dae9d1a1a1c65e23368c7] locking/mutex: Test for initialized mutex
git bisect good f4237c73742576c35922aec9a7402f44f86b32b4 # 05:32 G 33 0 18 21 x86/fpu: Make no387 and nofxsr work a little better on modern CPUs
# extra tests on HEAD of linux-devel/devel-hourly-2019070405
git bisect bad 3515546e8cfa1665e1ee8446cfe40287b247b94a # 05:32 B 0 343 361 0 0day head guard for 'devel-hourly-2019070405'
# extra tests on tree/branch bigeasy-staging/fpu
git bisect bad 78abee03d6d3925d6d13678677e08f1f18ebbbcb # 05:55 B 0 1 16 0 x86/fpu: Inline fpu__xstate_clear_all_cpu_caps()
# extra tests with first bad commit reverted
git bisect good 25dbd99895ab7d14e8e6fb74e8a0164a5c71c80d # 06:19 G 11 0 5 5 Revert "locking/mutex: Test for initialized mutex"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
11 months
- 2
- 1
[sched/fair] d2a99d2651: reaim.jobs_per_min -2.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -2.3% regression of reaim.jobs_per_min due to commit:
commit: d2a99d26519c181c5101e25d47ef8917fa0466d0 ("sched/fair: rework load_balance")
https://git.linaro.org/people/vincent.guittot/kernel.git sched-rework-load_balance
in testcase: reaim
on test machine: 40 threads Skylake-SP with 64G memory
with following parameters:
runtime: 300s
nr_task: 100%
test: alltests
cpufreq_governor: performance
test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-sp2/alltests/reaim
commit:
5d006c9501 ("sched/fair: rename sum_nr_running to sum_h_nr_running")
d2a99d2651 ("sched/fair: rework load_balance")
5d006c950191b606 d2a99d26519c181c5101e25d47e
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
1:4 3% 1:4 perf-profile.children.cycles-pp.error_entry
0:4 -0% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
2.52 -5.3% 2.38 reaim.child_systime
22.52 -2.8% 21.89 reaim.child_utime
41304 -2.3% 40370 reaim.jobs_per_min
1032 -2.3% 1009 reaim.jobs_per_min_child
41499 -1.6% 40815 reaim.max_jobs_per_min
5.69 +2.3% 5.83 reaim.parent_time
0.41 +122.6% 0.90 reaim.std_dev_percent
0.02 +132.5% 0.05 reaim.std_dev_time
89126 -15.4% 75409 reaim.time.involuntary_context_switches
324.50 -4.6% 309.50 reaim.time.percent_of_cpu_this_job_got
100.59 -6.5% 94.08 reaim.time.system_time
890.37 -4.0% 854.36 reaim.time.user_time
672692 -3.2% 650868 reaim.time.voluntary_context_switches
4677143 ± 43% -42.8% 2676698 cpuidle.C1.time
256588 ±110% -66.5% 86042 cpuidle.C1.usage
524.75 ± 3% +25.9% 660.50 ± 2% slabinfo.mnt_cache.active_objs
524.75 ± 3% +25.9% 660.50 ± 2% slabinfo.mnt_cache.num_objs
290.25 ± 2% -4.7% 276.75 turbostat.Avg_MHz
249433 ±113% -68.1% 79561 turbostat.C1
91.00 +1.1% 92.00 vmstat.cpu.id
6891 +1.7% 7006 vmstat.system.cs
31343 ± 3% +16.8% 36614 ± 6% softirqs.CPU2.RCU
29460 ± 4% +12.1% 33031 ± 2% softirqs.CPU5.RCU
31921 ± 5% +11.9% 35725 ± 5% softirqs.CPU8.RCU
69131 -1.0% 68462 proc-vmstat.nr_active_anon
5791 -6.3% 5428 proc-vmstat.nr_shmem
69131 -1.0% 68462 proc-vmstat.nr_zone_active_anon
20869825 -1.4% 20582081 proc-vmstat.numa_hit
20869825 -1.4% 20582081 proc-vmstat.numa_local
7937 -3.1% 7692 proc-vmstat.pgactivate
21791521 -1.5% 21462075 proc-vmstat.pgalloc_normal
21769885 -1.5% 21441355 proc-vmstat.pgfree
3.39 ± 66% -1.4 1.98 perf-stat.i.branch-miss-rate%
18889254 ± 9% -6.8% 17597592 perf-stat.i.branch-misses
49316843 ± 21% -15.7% 41564282 perf-stat.i.cache-references
6925 +1.8% 7053 perf-stat.i.context-switches
1.119e+10 ± 3% -4.2% 1.072e+10 perf-stat.i.cpu-cycles
729.80 -39.3% 443.17 perf-stat.i.cpu-migrations
2.021e+09 -1.1% 1.999e+09 perf-stat.i.dTLB-loads
1.4e+09 -1.1% 1.384e+09 perf-stat.i.dTLB-stores
8.907e+09 -1.1% 8.811e+09 perf-stat.i.instructions
72196 -1.6% 71036 perf-stat.i.minor-faults
114942 +2.1% 117407 perf-stat.i.node-loads
72196 -1.6% 71036 perf-stat.i.page-faults
5.54 ± 21% -14.9% 4.72 perf-stat.overall.MPKI
18826618 ± 9% -6.8% 17537743 perf-stat.ps.branch-misses
49148836 ± 21% -15.7% 41420135 perf-stat.ps.cache-references
6901 +1.8% 7028 perf-stat.ps.context-switches
1.115e+10 ± 3% -4.2% 1.068e+10 perf-stat.ps.cpu-cycles
727.29 -39.3% 441.62 perf-stat.ps.cpu-migrations
2.014e+09 -1.1% 1.992e+09 perf-stat.ps.dTLB-loads
1.395e+09 -1.2% 1.379e+09 perf-stat.ps.dTLB-stores
8.876e+09 -1.1% 8.781e+09 perf-stat.ps.instructions
71947 -1.6% 70787 perf-stat.ps.minor-faults
114554 +2.1% 117003 perf-stat.ps.node-loads
71947 -1.6% 70787 perf-stat.ps.page-faults
0.00 ± 5% +3.1e+25% 93.21 ±104% sched_debug.cfs_rq:/.MIN_vruntime.stddev
655865 ± 2% -20.5% 521628 ± 13% sched_debug.cfs_rq:/.load.max
162805 ± 10% -26.5% 119586 ± 9% sched_debug.cfs_rq:/.load.stddev
0.54 ± 73% +178.5% 1.51 ± 20% sched_debug.cfs_rq:/.load_avg.min
0.00 ± 5% +3.1e+25% 93.21 ±104% sched_debug.cfs_rq:/.max_vruntime.stddev
381033 -16.2% 319192 ± 8% sched_debug.cfs_rq:/.min_vruntime.avg
422689 -13.4% 366081 ± 10% sched_debug.cfs_rq:/.min_vruntime.max
354983 -19.1% 287191 ± 10% sched_debug.cfs_rq:/.min_vruntime.min
16066 ± 7% +17.8% 18931 ± 6% sched_debug.cfs_rq:/.min_vruntime.stddev
0.15 ± 15% +91.4% 0.28 ± 11% sched_debug.cfs_rq:/.nr_running.avg
9.50 ± 49% +159.1% 24.62 ± 24% sched_debug.cfs_rq:/.removed.load_avg.avg
438.79 ± 49% +159.0% 1136 ± 24% sched_debug.cfs_rq:/.removed.runnable_sum.avg
635.08 ± 2% -28.1% 456.38 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.max
143.07 ± 11% -32.1% 97.18 ± 6% sched_debug.cfs_rq:/.runnable_load_avg.stddev
650555 ± 2% -20.3% 518583 ± 13% sched_debug.cfs_rq:/.runnable_weight.max
161813 ± 10% -26.6% 118724 ± 9% sched_debug.cfs_rq:/.runnable_weight.stddev
16067 ± 7% +17.8% 18931 ± 6% sched_debug.cfs_rq:/.spread0.stddev
164.59 ± 8% +93.1% 317.85 ± 12% sched_debug.cfs_rq:/.util_avg.avg
779.75 ± 3% +12.8% 879.77 ± 7% sched_debug.cfs_rq:/.util_avg.max
12.58 ±120% +335.6% 54.81 ± 25% sched_debug.cfs_rq:/.util_avg.min
21.87 ± 15% +375.7% 104.04 ± 20% sched_debug.cfs_rq:/.util_est_enqueued.avg
292.92 ± 10% +50.1% 439.56 ± 14% sched_debug.cfs_rq:/.util_est_enqueued.max
67.69 ± 9% +108.5% 141.15 ± 12% sched_debug.cfs_rq:/.util_est_enqueued.stddev
607.05 ± 9% +376.7% 2893 ± 42% sched_debug.cpu.curr->pid.avg
15860 +20.8% 19156 ± 6% sched_debug.cpu.curr->pid.max
2738 ± 2% +66.0% 4544 ± 10% sched_debug.cpu.curr->pid.stddev
0.00 ± 9% +41.5% 0.00 ± 4% sched_debug.cpu.next_balance.stddev
0.11 ± 10% +179.8% 0.31 ± 12% sched_debug.cpu.nr_running.avg
1.00 +54.2% 1.54 ± 17% sched_debug.cpu.nr_running.max
0.28 ± 2% +51.5% 0.42 ± 6% sched_debug.cpu.nr_running.stddev
36800 ± 4% +27.1% 46786 ± 14% sched_debug.cpu.nr_switches.max
3039 ± 7% +45.2% 4414 ± 15% sched_debug.cpu.nr_switches.stddev
3124 ± 11% +39.0% 4343 ± 18% sched_debug.cpu.sched_count.stddev
15212 ± 5% +38.4% 21056 ± 16% sched_debug.cpu.sched_goidle.max
1184 ± 7% +62.2% 1921 ± 18% sched_debug.cpu.sched_goidle.stddev
1197 ± 6% +38.9% 1663 ± 14% sched_debug.cpu.ttwu_count.stddev
150.00 -75.0% 37.50 ±173% interrupts.275:PCI-MSI.288768-edge.ahci[0000:00:11.5]
146606 ± 3% +8.5% 159137 interrupts.CAL:Function_call_interrupts
3660 ± 3% +11.2% 4071 ± 2% interrupts.CPU0.CAL:Function_call_interrupts
1166 ± 16% -37.2% 733.00 ± 5% interrupts.CPU0.NMI:Non-maskable_interrupts
1166 ± 16% -37.2% 733.00 ± 5% interrupts.CPU0.PMI:Performance_monitoring_interrupts
506.25 ± 5% +62.3% 821.75 ± 8% interrupts.CPU0.TLB:TLB_shootdowns
1103 ± 6% -37.3% 692.25 ± 14% interrupts.CPU1.NMI:Non-maskable_interrupts
1103 ± 6% -37.3% 692.25 ± 14% interrupts.CPU1.PMI:Performance_monitoring_interrupts
577.25 ± 2% +35.6% 783.00 ± 4% interrupts.CPU1.TLB:TLB_shootdowns
1073 ± 7% -32.2% 728.50 ± 16% interrupts.CPU10.NMI:Non-maskable_interrupts
1073 ± 7% -32.2% 728.50 ± 16% interrupts.CPU10.PMI:Performance_monitoring_interrupts
547.50 ± 8% +55.1% 849.00 ± 5% interrupts.CPU10.TLB:TLB_shootdowns
1103 ± 12% -28.1% 793.25 ± 19% interrupts.CPU11.NMI:Non-maskable_interrupts
1103 ± 12% -28.1% 793.25 ± 19% interrupts.CPU11.PMI:Performance_monitoring_interrupts
563.25 ± 13% +40.6% 791.75 ± 3% interrupts.CPU11.TLB:TLB_shootdowns
1140 ± 14% -31.9% 776.50 ± 12% interrupts.CPU12.NMI:Non-maskable_interrupts
1140 ± 14% -31.9% 776.50 ± 12% interrupts.CPU12.PMI:Performance_monitoring_interrupts
577.00 ± 11% +38.3% 798.25 ± 7% interrupts.CPU12.TLB:TLB_shootdowns
1063 ± 3% -23.7% 811.50 ± 4% interrupts.CPU13.NMI:Non-maskable_interrupts
1063 ± 3% -23.7% 811.50 ± 4% interrupts.CPU13.PMI:Performance_monitoring_interrupts
261.25 ± 25% -39.5% 158.00 ± 7% interrupts.CPU13.RES:Rescheduling_interrupts
570.50 ± 9% +38.1% 788.00 interrupts.CPU13.TLB:TLB_shootdowns
3518 ± 5% +12.0% 3941 ± 3% interrupts.CPU14.CAL:Function_call_interrupts
1057 ± 12% -32.5% 714.00 ± 7% interrupts.CPU14.NMI:Non-maskable_interrupts
1057 ± 12% -32.5% 714.00 ± 7% interrupts.CPU14.PMI:Performance_monitoring_interrupts
280.00 ± 33% -43.5% 158.25 ± 16% interrupts.CPU14.RES:Rescheduling_interrupts
1071 ± 16% -27.0% 782.00 ± 13% interrupts.CPU15.NMI:Non-maskable_interrupts
1071 ± 16% -27.0% 782.00 ± 13% interrupts.CPU15.PMI:Performance_monitoring_interrupts
540.75 ± 8% +43.5% 775.75 ± 3% interrupts.CPU15.TLB:TLB_shootdowns
1095 ± 8% -34.2% 720.75 ± 16% interrupts.CPU16.NMI:Non-maskable_interrupts
1095 ± 8% -34.2% 720.75 ± 16% interrupts.CPU16.PMI:Performance_monitoring_interrupts
558.75 ± 9% +44.5% 807.50 ± 7% interrupts.CPU16.TLB:TLB_shootdowns
551.25 ± 7% +53.8% 847.75 ± 4% interrupts.CPU17.TLB:TLB_shootdowns
1140 ± 2% -30.2% 796.00 ± 13% interrupts.CPU18.NMI:Non-maskable_interrupts
1140 ± 2% -30.2% 796.00 ± 13% interrupts.CPU18.PMI:Performance_monitoring_interrupts
218.25 ± 6% -33.0% 146.25 ± 14% interrupts.CPU18.RES:Rescheduling_interrupts
1106 ± 7% -29.6% 779.25 ± 21% interrupts.CPU19.NMI:Non-maskable_interrupts
1106 ± 7% -29.6% 779.25 ± 21% interrupts.CPU19.PMI:Performance_monitoring_interrupts
556.50 ± 15% +53.0% 851.25 ± 7% interrupts.CPU19.TLB:TLB_shootdowns
558.00 ± 10% +47.0% 820.25 ± 9% interrupts.CPU2.TLB:TLB_shootdowns
1135 ± 13% -35.1% 736.25 ± 12% interrupts.CPU20.NMI:Non-maskable_interrupts
1135 ± 13% -35.1% 736.25 ± 12% interrupts.CPU20.PMI:Performance_monitoring_interrupts
196.00 ± 12% -25.8% 145.50 ± 6% interrupts.CPU20.RES:Rescheduling_interrupts
537.00 ± 12% +43.8% 772.25 ± 3% interrupts.CPU20.TLB:TLB_shootdowns
1150 ± 8% -38.5% 707.25 ± 3% interrupts.CPU21.NMI:Non-maskable_interrupts
1150 ± 8% -38.5% 707.25 ± 3% interrupts.CPU21.PMI:Performance_monitoring_interrupts
201.50 ± 10% -25.2% 150.75 ± 16% interrupts.CPU21.RES:Rescheduling_interrupts
537.25 ± 2% +45.4% 781.00 ± 3% interrupts.CPU21.TLB:TLB_shootdowns
1081 ± 8% -33.7% 716.75 ± 9% interrupts.CPU22.NMI:Non-maskable_interrupts
1081 ± 8% -33.7% 716.75 ± 9% interrupts.CPU22.PMI:Performance_monitoring_interrupts
528.50 ± 6% +49.3% 789.00 ± 3% interrupts.CPU22.TLB:TLB_shootdowns
1015 ± 7% -29.0% 721.25 ± 10% interrupts.CPU23.NMI:Non-maskable_interrupts
1015 ± 7% -29.0% 721.25 ± 10% interrupts.CPU23.PMI:Performance_monitoring_interrupts
188.75 ± 6% -29.4% 133.25 ± 5% interrupts.CPU23.RES:Rescheduling_interrupts
499.50 ± 8% +51.5% 756.50 ± 6% interrupts.CPU23.TLB:TLB_shootdowns
1055 ± 10% -24.2% 800.00 ± 21% interrupts.CPU24.NMI:Non-maskable_interrupts
1055 ± 10% -24.2% 800.00 ± 21% interrupts.CPU24.PMI:Performance_monitoring_interrupts
226.25 ± 29% -39.9% 136.00 ± 14% interrupts.CPU24.RES:Rescheduling_interrupts
515.75 ± 6% +44.8% 746.75 ± 8% interrupts.CPU24.TLB:TLB_shootdowns
1141 ± 12% -38.7% 699.75 ± 17% interrupts.CPU25.NMI:Non-maskable_interrupts
1141 ± 12% -38.7% 699.75 ± 17% interrupts.CPU25.PMI:Performance_monitoring_interrupts
220.75 ± 29% -36.0% 141.25 ± 6% interrupts.CPU25.RES:Rescheduling_interrupts
525.25 ± 7% +40.8% 739.50 ± 5% interrupts.CPU25.TLB:TLB_shootdowns
1126 ± 7% -33.0% 755.00 ± 23% interrupts.CPU26.NMI:Non-maskable_interrupts
1126 ± 7% -33.0% 755.00 ± 23% interrupts.CPU26.PMI:Performance_monitoring_interrupts
769.50 ±125% -81.3% 144.25 ± 8% interrupts.CPU26.RES:Rescheduling_interrupts
532.50 ± 6% +39.8% 744.25 ± 5% interrupts.CPU26.TLB:TLB_shootdowns
1165 ± 11% -34.5% 762.75 ± 15% interrupts.CPU27.NMI:Non-maskable_interrupts
1165 ± 11% -34.5% 762.75 ± 15% interrupts.CPU27.PMI:Performance_monitoring_interrupts
225.25 ± 26% -27.7% 162.75 ± 13% interrupts.CPU27.RES:Rescheduling_interrupts
517.50 ± 4% +57.0% 812.25 ± 5% interrupts.CPU27.TLB:TLB_shootdowns
1159 ± 13% -35.5% 748.25 ± 9% interrupts.CPU28.NMI:Non-maskable_interrupts
1159 ± 13% -35.5% 748.25 ± 9% interrupts.CPU28.PMI:Performance_monitoring_interrupts
523.00 ± 4% +55.2% 811.50 ± 5% interrupts.CPU28.TLB:TLB_shootdowns
1133 ± 16% -33.9% 749.25 ± 22% interrupts.CPU29.NMI:Non-maskable_interrupts
1133 ± 16% -33.9% 749.25 ± 22% interrupts.CPU29.PMI:Performance_monitoring_interrupts
513.50 ± 5% +58.0% 811.25 ± 10% interrupts.CPU29.TLB:TLB_shootdowns
1105 ± 10% -36.5% 702.25 ± 8% interrupts.CPU3.NMI:Non-maskable_interrupts
1105 ± 10% -36.5% 702.25 ± 8% interrupts.CPU3.PMI:Performance_monitoring_interrupts
807.75 ± 39% -65.0% 282.75 ± 54% interrupts.CPU3.RES:Rescheduling_interrupts
535.50 ± 4% +49.7% 801.75 ± 4% interrupts.CPU3.TLB:TLB_shootdowns
3560 ± 6% +13.3% 4034 interrupts.CPU30.CAL:Function_call_interrupts
1095 ± 11% -35.2% 709.75 ± 16% interrupts.CPU30.NMI:Non-maskable_interrupts
1095 ± 11% -35.2% 709.75 ± 16% interrupts.CPU30.PMI:Performance_monitoring_interrupts
265.75 ± 41% -48.0% 138.25 ± 6% interrupts.CPU30.RES:Rescheduling_interrupts
477.50 ± 8% +69.8% 811.00 ± 2% interrupts.CPU30.TLB:TLB_shootdowns
1222 ± 15% -32.9% 821.00 ± 7% interrupts.CPU31.NMI:Non-maskable_interrupts
1222 ± 15% -32.9% 821.00 ± 7% interrupts.CPU31.PMI:Performance_monitoring_interrupts
507.75 ± 9% +56.0% 792.00 ± 10% interrupts.CPU31.TLB:TLB_shootdowns
3602 ± 3% +11.0% 3997 interrupts.CPU32.CAL:Function_call_interrupts
1063 ± 5% -30.6% 737.25 ± 7% interrupts.CPU32.NMI:Non-maskable_interrupts
1063 ± 5% -30.6% 737.25 ± 7% interrupts.CPU32.PMI:Performance_monitoring_interrupts
194.50 ± 12% -22.4% 151.00 ± 18% interrupts.CPU32.RES:Rescheduling_interrupts
507.50 ± 3% +55.3% 788.25 ± 5% interrupts.CPU32.TLB:TLB_shootdowns
1144 ± 13% -31.8% 780.50 ± 2% interrupts.CPU33.NMI:Non-maskable_interrupts
1144 ± 13% -31.8% 780.50 ± 2% interrupts.CPU33.PMI:Performance_monitoring_interrupts
501.50 ± 3% +56.0% 782.25 ± 5% interrupts.CPU33.TLB:TLB_shootdowns
1071 ± 12% -34.9% 697.50 ± 8% interrupts.CPU34.NMI:Non-maskable_interrupts
1071 ± 12% -34.9% 697.50 ± 8% interrupts.CPU34.PMI:Performance_monitoring_interrupts
162.50 ± 6% -11.5% 143.75 ± 10% interrupts.CPU34.RES:Rescheduling_interrupts
530.25 ± 2% +49.9% 794.75 ± 4% interrupts.CPU34.TLB:TLB_shootdowns
1076 ± 10% -26.5% 791.50 ± 13% interrupts.CPU35.NMI:Non-maskable_interrupts
1076 ± 10% -26.5% 791.50 ± 13% interrupts.CPU35.PMI:Performance_monitoring_interrupts
512.25 ± 5% +50.2% 769.50 ± 8% interrupts.CPU35.TLB:TLB_shootdowns
1126 ± 7% -30.9% 778.00 ± 19% interrupts.CPU36.NMI:Non-maskable_interrupts
1126 ± 7% -30.9% 778.00 ± 19% interrupts.CPU36.PMI:Performance_monitoring_interrupts
539.25 ± 4% +49.2% 804.50 ± 5% interrupts.CPU36.TLB:TLB_shootdowns
1077 ± 17% -36.3% 686.50 ± 22% interrupts.CPU37.NMI:Non-maskable_interrupts
1077 ± 17% -36.3% 686.50 ± 22% interrupts.CPU37.PMI:Performance_monitoring_interrupts
483.75 ± 7% +58.6% 767.25 interrupts.CPU37.TLB:TLB_shootdowns
3635 ± 2% +8.4% 3942 ± 2% interrupts.CPU38.CAL:Function_call_interrupts
1080 ± 9% -25.3% 807.25 ± 14% interrupts.CPU38.NMI:Non-maskable_interrupts
1080 ± 9% -25.3% 807.25 ± 14% interrupts.CPU38.PMI:Performance_monitoring_interrupts
552.25 ± 8% +43.1% 790.00 ± 3% interrupts.CPU38.TLB:TLB_shootdowns
1176 ± 10% -33.4% 783.75 ± 9% interrupts.CPU39.NMI:Non-maskable_interrupts
1176 ± 10% -33.4% 783.75 ± 9% interrupts.CPU39.PMI:Performance_monitoring_interrupts
199.75 ± 11% -25.8% 148.25 ± 9% interrupts.CPU39.RES:Rescheduling_interrupts
545.50 ± 6% +43.4% 782.00 ± 7% interrupts.CPU39.TLB:TLB_shootdowns
1073 ± 11% -26.7% 786.00 ± 19% interrupts.CPU4.NMI:Non-maskable_interrupts
1073 ± 11% -26.7% 786.00 ± 19% interrupts.CPU4.PMI:Performance_monitoring_interrupts
346.00 ± 80% -55.4% 154.25 ± 8% interrupts.CPU4.RES:Rescheduling_interrupts
574.00 ± 6% +38.3% 794.00 ± 3% interrupts.CPU4.TLB:TLB_shootdowns
1093 ± 8% -36.1% 699.25 ± 18% interrupts.CPU5.NMI:Non-maskable_interrupts
1093 ± 8% -36.1% 699.25 ± 18% interrupts.CPU5.PMI:Performance_monitoring_interrupts
545.75 ± 9% +51.9% 828.75 ± 11% interrupts.CPU5.TLB:TLB_shootdowns
1133 ± 8% -33.2% 756.75 ± 15% interrupts.CPU6.NMI:Non-maskable_interrupts
1133 ± 8% -33.2% 756.75 ± 15% interrupts.CPU6.PMI:Performance_monitoring_interrupts
537.50 ± 9% +57.5% 846.75 ± 6% interrupts.CPU6.TLB:TLB_shootdowns
1136 ± 20% -37.9% 706.00 ± 17% interrupts.CPU7.NMI:Non-maskable_interrupts
1136 ± 20% -37.9% 706.00 ± 17% interrupts.CPU7.PMI:Performance_monitoring_interrupts
522.00 ± 10% +46.6% 765.00 ± 5% interrupts.CPU7.TLB:TLB_shootdowns
1192 ± 5% -40.8% 705.50 ± 14% interrupts.CPU8.NMI:Non-maskable_interrupts
1192 ± 5% -40.8% 705.50 ± 14% interrupts.CPU8.PMI:Performance_monitoring_interrupts
489.25 ± 7% +72.5% 843.75 ± 2% interrupts.CPU8.TLB:TLB_shootdowns
1029 ± 12% -24.3% 779.00 ± 16% interrupts.CPU9.NMI:Non-maskable_interrupts
1029 ± 12% -24.3% 779.00 ± 16% interrupts.CPU9.PMI:Performance_monitoring_interrupts
545.75 ± 8% +55.6% 849.25 ± 8% interrupts.CPU9.TLB:TLB_shootdowns
44104 ± 8% -32.1% 29967 ± 10% interrupts.NMI:Non-maskable_interrupts
44104 ± 8% -32.1% 29967 ± 10% interrupts.PMI:Performance_monitoring_interrupts
10489 ± 9% -20.7% 8313 ± 12% interrupts.RES:Rescheduling_interrupts
23729 ± 12% +34.2% 31835 interrupts.TLB:TLB_shootdowns
6.54 ± 9% -4.2 2.31 ± 26% perf-profile.calltrace.cycles-pp.string_rtns_1
8.18 ± 10% -4.1 4.07 ± 11% perf-profile.calltrace.cycles-pp.add_double.add_double
6.67 ± 11% -3.6 3.08 ± 21% perf-profile.calltrace.cycles-pp.sieve
5.47 ± 10% -3.0 2.46 ± 12% perf-profile.calltrace.cycles-pp.add_float.add_float
3.73 ± 7% -1.7 2.07 ± 24% perf-profile.calltrace.cycles-pp.mul_float.mul_float
2.13 ± 9% -1.2 0.97 ± 11% perf-profile.calltrace.cycles-pp.add_long.add_long
2.04 ± 10% -1.1 0.91 ± 7% perf-profile.calltrace.cycles-pp.add_int.add_int
3.58 ± 9% -1.1 2.49 ± 7% perf-profile.calltrace.cycles-pp.mul_double.mul_double
1.31 ± 10% -0.8 0.51 ± 57% perf-profile.calltrace.cycles-pp.add_short.add_short
1.72 -0.5 1.18 ± 10% perf-profile.calltrace.cycles-pp.array_rtns
0.65 ± 6% -0.4 0.28 ±100% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
1.39 ± 3% -0.3 1.08 ± 20% perf-profile.calltrace.cycles-pp.div_float
1.58 ± 4% -0.3 1.31 ± 5% perf-profile.calltrace.cycles-pp.brk
1.52 ± 7% -0.3 1.25 ± 9% perf-profile.calltrace.cycles-pp.div_double
0.99 ± 3% -0.2 0.76 ± 8% perf-profile.calltrace.cycles-pp.div_long
1.22 ± 4% -0.2 1.00 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk
1.19 ± 4% -0.2 0.99 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
0.91 ± 5% -0.2 0.72 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
1.47 ± 7% +0.2 1.63 ± 7% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.41 ± 7% +0.2 1.57 ± 7% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.67 ± 7% +0.2 1.89 ± 7% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
1.69 ± 7% +0.2 1.93 ± 7% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
1.73 ± 7% +0.2 1.98 ± 7% perf-profile.calltrace.cycles-pp.page_fault
0.73 ± 31% +0.3 1.06 ± 16% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.14 ±173% +0.4 0.55 ± 8% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.73 ± 25% +0.4 1.15 ± 5% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.42 ± 58% +0.5 0.91 ± 11% perf-profile.calltrace.cycles-pp.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.26 ±100% +0.5 0.75 ± 13% perf-profile.calltrace.cycles-pp.dup_mm.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.45 ± 57% +0.5 0.95 ± 11% perf-profile.calltrace.cycles-pp._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.35 ±104% +0.6 0.92 ± 8% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.93 ± 25% +0.6 1.51 ± 8% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.82 ± 25% +0.6 1.40 ± 20% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
0.83 ± 24% +0.6 1.41 ± 20% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.00 +0.6 0.60 ± 7% perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.90 ± 21% +0.6 1.51 ± 18% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.90 ± 21% +0.6 1.51 ± 18% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
0.90 ± 21% +0.6 1.51 ± 18% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
0.27 ±100% +0.6 0.90 ± 11% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +0.7 0.67 ± 14% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.80 ± 23% +0.8 1.55 ± 7% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
1.89 ± 29% +0.8 2.73 ± 15% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
2.51 ± 14% +1.5 4.05 ± 4% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
4.97 ± 5% +1.6 6.57 ± 11% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.98 ± 5% +1.6 6.60 ± 11% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
4.12 ± 23% +1.9 6.04 ± 5% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
4.52 ± 21% +3.0 7.52 ± 4% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
28.85 ± 9% +16.8 45.64 ± 4% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
33.42 ± 12% +18.5 51.93 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
33.82 ± 12% +18.6 52.40 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
36.39 ± 13% +19.8 56.18 ± 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
36.40 ± 13% +19.8 56.20 ± 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
36.40 ± 13% +19.8 56.20 ± 3% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
37.30 ± 12% +20.4 57.71 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64
6.56 ± 9% -4.2 2.33 ± 26% perf-profile.children.cycles-pp.string_rtns_1
8.19 ± 10% -4.1 4.08 ± 11% perf-profile.children.cycles-pp.add_double
6.67 ± 11% -3.6 3.09 ± 21% perf-profile.children.cycles-pp.sieve
5.47 ± 10% -3.0 2.46 ± 12% perf-profile.children.cycles-pp.add_float
3.73 ± 7% -1.7 2.08 ± 24% perf-profile.children.cycles-pp.mul_float
2.13 ± 9% -1.2 0.97 ± 11% perf-profile.children.cycles-pp.add_long
2.04 ± 11% -1.1 0.91 ± 7% perf-profile.children.cycles-pp.add_int
3.58 ± 9% -1.1 2.49 ± 7% perf-profile.children.cycles-pp.mul_double
1.31 ± 10% -0.7 0.62 ± 16% perf-profile.children.cycles-pp.add_short
1.72 -0.5 1.18 ± 10% perf-profile.children.cycles-pp.array_rtns
1.39 ± 3% -0.3 1.09 ± 20% perf-profile.children.cycles-pp.div_float
1.60 ± 4% -0.3 1.33 ± 5% perf-profile.children.cycles-pp.brk
1.52 ± 7% -0.3 1.25 ± 9% perf-profile.children.cycles-pp.div_double
0.99 ± 3% -0.2 0.76 ± 8% perf-profile.children.cycles-pp.div_long
0.22 ± 10% -0.1 0.14 ± 31% perf-profile.children.cycles-pp.creat
0.14 ± 22% -0.1 0.08 ± 23% perf-profile.children.cycles-pp.mem_rtns_1
0.10 ± 8% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.lru_add_drain
0.12 ± 8% +0.0 0.16 ± 15% perf-profile.children.cycles-pp.__wake_up_common_lock
0.07 ± 17% +0.0 0.11 ± 23% perf-profile.children.cycles-pp.__account_scheduler_latency
0.12 ± 16% +0.0 0.16 ± 17% perf-profile.children.cycles-pp.do_wait
0.11 ± 9% +0.0 0.15 ± 16% perf-profile.children.cycles-pp.__wake_up_common
0.04 ± 58% +0.0 0.08 ± 8% perf-profile.children.cycles-pp.sock_write_iter
0.07 ± 16% +0.0 0.11 ± 10% perf-profile.children.cycles-pp.schedule_tail
0.13 ± 15% +0.0 0.17 ± 12% perf-profile.children.cycles-pp.__do_sys_wait4
0.09 ± 5% +0.0 0.13 ± 11% perf-profile.children.cycles-pp.do_notify_parent
0.04 ± 58% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.finish_task_switch
0.12 ± 16% +0.0 0.17 ± 12% perf-profile.children.cycles-pp.kernel_wait4
0.04 ± 59% +0.0 0.09 ± 20% perf-profile.children.cycles-pp.__put_user_4
0.14 ± 8% +0.0 0.18 ± 16% perf-profile.children.cycles-pp.enqueue_task_fair
0.11 ± 11% +0.0 0.16 ± 19% perf-profile.children.cycles-pp.ttwu_do_activate
0.12 ± 8% +0.0 0.17 ± 14% perf-profile.children.cycles-pp.enqueue_entity
0.11 ± 23% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.schedule
0.21 ± 13% +0.1 0.26 ± 12% perf-profile.children.cycles-pp.flush_tlb_func_common
0.04 ± 58% +0.1 0.09 ± 24% perf-profile.children.cycles-pp.call_cpuidle
0.13 ± 11% +0.1 0.18 ± 16% perf-profile.children.cycles-pp.activate_task
0.04 ±101% +0.1 0.10 ± 11% perf-profile.children.cycles-pp.run_local_timers
0.05 ± 58% +0.1 0.10 ± 17% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.19 ± 13% +0.1 0.25 ± 13% perf-profile.children.cycles-pp.native_flush_tlb_one_user
0.03 ±100% +0.1 0.09 ± 21% perf-profile.children.cycles-pp.rcu_irq_exit
0.29 ± 7% +0.1 0.35 ± 10% perf-profile.children.cycles-pp.anon_vma_fork
0.22 ± 8% +0.1 0.29 ± 5% perf-profile.children.cycles-pp.vfs_read
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.lf
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.con_scroll
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.fbcon_scroll
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.fbcon_redraw
0.24 ± 12% +0.1 0.31 ± 7% perf-profile.children.cycles-pp.flush_tlb_mm_range
0.21 ± 5% +0.1 0.27 ± 8% perf-profile.children.cycles-pp.ksys_read
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.vt_console_print
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.fbcon_putcs
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.bit_putcs
0.32 ± 8% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.ret_from_fork
0.19 ± 15% +0.1 0.26 ± 7% perf-profile.children.cycles-pp.down_write
0.16 ± 10% +0.1 0.23 ± 8% perf-profile.children.cycles-pp.try_to_wake_up
0.08 ± 58% +0.1 0.15 ± 5% perf-profile.children.cycles-pp.schedule_idle
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.__run_perf_stat
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.process_interval
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.read_counters
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.perf_evsel__read_counter
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.__read_nocancel
0.08 ± 27% +0.1 0.15 ± 8% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.37 ± 4% +0.1 0.44 ± 10% perf-profile.children.cycles-pp.release_pages
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.cmd_stat
0.48 ± 8% +0.1 0.56 ± 5% perf-profile.children.cycles-pp.do_wp_page
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.__strcspn_sse42
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.generic_start_main
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.main
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.run_builtin
0.46 ± 6% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.36 ± 12% +0.1 0.45 ± 5% perf-profile.children.cycles-pp._raw_spin_lock
0.09 ± 17% +0.1 0.17 ± 6% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.22 ± 13% +0.1 0.31 ± 10% perf-profile.children.cycles-pp.sched_clock_cpu
0.20 ± 5% +0.1 0.29 ± 11% perf-profile.children.cycles-pp.sched_clock
0.18 ± 6% +0.1 0.29 ± 10% perf-profile.children.cycles-pp.native_sched_clock
0.25 ± 8% +0.1 0.36 ± 13% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.23 ± 18% +0.1 0.34 ± 13% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.50 ± 10% +0.1 0.62 ± 8% perf-profile.children.cycles-pp.copy_p4d_range
0.51 ± 10% +0.1 0.63 ± 8% perf-profile.children.cycles-pp.copy_page_range
0.27 ± 18% +0.1 0.38 ± 12% perf-profile.children.cycles-pp.find_next_bit
0.25 ± 19% +0.1 0.38 ± 8% perf-profile.children.cycles-pp.__schedule
0.18 ± 24% +0.1 0.32 ± 21% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.33 ± 31% +0.2 0.52 ± 12% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
2.08 ± 7% +0.2 2.28 ± 5% perf-profile.children.cycles-pp.__handle_mm_fault
0.33 ± 3% +0.2 0.55 ± 16% perf-profile.children.cycles-pp.read_tsc
0.42 ± 27% +0.2 0.65 ± 8% perf-profile.children.cycles-pp.__next_timer_interrupt
0.58 ± 2% +0.2 0.82 ± 9% perf-profile.children.cycles-pp.native_irq_return_iret
2.45 ± 7% +0.3 2.71 ± 5% perf-profile.children.cycles-pp.__do_page_fault
0.39 ± 6% +0.3 0.65 ± 5% perf-profile.children.cycles-pp.lapic_next_deadline
0.24 ± 32% +0.3 0.50 ± 19% perf-profile.children.cycles-pp.tick_nohz_irq_exit
1.12 ± 6% +0.3 1.38 ± 6% perf-profile.children.cycles-pp.dup_mm
0.40 ± 6% +0.3 0.67 perf-profile.children.cycles-pp.native_write_msr
2.49 ± 7% +0.3 2.77 ± 5% perf-profile.children.cycles-pp.do_page_fault
2.66 ± 7% +0.3 2.96 ± 4% perf-profile.children.cycles-pp.page_fault
1.40 ± 5% +0.3 1.71 ± 7% perf-profile.children.cycles-pp.copy_process
1.49 ± 6% +0.3 1.82 ± 7% perf-profile.children.cycles-pp._do_fork
0.60 ± 28% +0.3 0.94 ± 8% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.91 ± 24% +0.4 1.31 ± 11% perf-profile.children.cycles-pp.tick_sched_timer
0.76 ± 26% +0.4 1.18 ± 4% perf-profile.children.cycles-pp.tick_nohz_next_event
0.97 ± 26% +0.6 1.55 ± 8% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.90 ± 21% +0.6 1.51 ± 18% perf-profile.children.cycles-pp.start_kernel
0.88 ± 19% +0.8 1.64 ± 6% perf-profile.children.cycles-pp.clockevents_program_event
1.96 ± 30% +0.9 2.82 ± 14% perf-profile.children.cycles-pp.menu_select
1.00 ± 18% +1.0 1.96 ± 9% perf-profile.children.cycles-pp.ktime_get
10.12 ± 4% +1.3 11.37 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
10.07 ± 4% +1.3 11.32 ± 6% perf-profile.children.cycles-pp.do_syscall_64
2.91 ± 14% +1.6 4.50 ± 5% perf-profile.children.cycles-pp.hrtimer_interrupt
4.68 ± 22% +2.0 6.65 ± 6% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
5.14 ± 20% +2.3 7.48 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt
28.97 ± 9% +16.7 45.64 ± 4% perf-profile.children.cycles-pp.intel_idle
34.65 ± 11% +19.1 53.80 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
34.66 ± 11% +19.2 53.81 ± 4% perf-profile.children.cycles-pp.cpuidle_enter
36.40 ± 13% +19.8 56.20 ± 3% perf-profile.children.cycles-pp.start_secondary
37.30 ± 12% +20.4 57.71 ± 4% perf-profile.children.cycles-pp.secondary_startup_64
37.30 ± 12% +20.4 57.71 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
37.31 ± 12% +20.4 57.74 ± 4% perf-profile.children.cycles-pp.do_idle
6.52 ± 9% -4.2 2.31 ± 26% perf-profile.self.cycles-pp.string_rtns_1
8.15 ± 10% -4.1 4.06 ± 11% perf-profile.self.cycles-pp.add_double
6.64 ± 11% -3.6 3.06 ± 21% perf-profile.self.cycles-pp.sieve
5.45 ± 10% -3.0 2.45 ± 12% perf-profile.self.cycles-pp.add_float
3.71 ± 7% -1.6 2.07 ± 25% perf-profile.self.cycles-pp.mul_float
2.13 ± 9% -1.2 0.96 ± 11% perf-profile.self.cycles-pp.add_long
2.03 ± 11% -1.1 0.90 ± 7% perf-profile.self.cycles-pp.add_int
3.57 ± 9% -1.1 2.46 ± 7% perf-profile.self.cycles-pp.mul_double
1.30 ± 10% -0.7 0.62 ± 16% perf-profile.self.cycles-pp.add_short
1.71 -0.5 1.17 ± 10% perf-profile.self.cycles-pp.array_rtns
1.38 ± 3% -0.3 1.08 ± 20% perf-profile.self.cycles-pp.div_float
1.51 ± 7% -0.3 1.24 ± 9% perf-profile.self.cycles-pp.div_double
0.99 ± 3% -0.2 0.75 ± 9% perf-profile.self.cycles-pp.div_long
0.14 ± 22% -0.1 0.08 ± 23% perf-profile.self.cycles-pp.mem_rtns_1
0.09 ± 17% +0.0 0.12 ± 15% perf-profile.self.cycles-pp.hrtimer_interrupt
0.07 ± 24% +0.0 0.11 ± 9% perf-profile.self.cycles-pp.strnlen_user
0.08 ± 6% +0.0 0.12 ± 18% perf-profile.self.cycles-pp.lapic_next_deadline
0.04 ± 58% +0.0 0.09 ± 20% perf-profile.self.cycles-pp.call_cpuidle
0.05 ± 58% +0.1 0.10 ± 18% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.12 ± 16% +0.1 0.18 ± 3% perf-profile.self.cycles-pp.down_write
0.04 ±102% +0.1 0.09 ± 11% perf-profile.self.cycles-pp.run_local_timers
0.19 ± 13% +0.1 0.25 ± 13% perf-profile.self.cycles-pp.native_flush_tlb_one_user
0.03 ±100% +0.1 0.09 ± 21% perf-profile.self.cycles-pp.rcu_irq_exit
0.03 ±102% +0.1 0.10 ± 22% perf-profile.self.cycles-pp.rcu_idle_exit
0.00 +0.1 0.07 perf-profile.self.cycles-pp.tick_sched_timer
0.20 ± 10% +0.1 0.27 ± 8% perf-profile.self.cycles-pp.release_pages
0.46 ± 6% +0.1 0.55 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.34 ± 13% +0.1 0.43 ± 6% perf-profile.self.cycles-pp._raw_spin_lock
0.21 ± 7% +0.1 0.30 ± 19% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.18 ± 5% +0.1 0.29 ± 9% perf-profile.self.cycles-pp.native_sched_clock
0.19 ± 9% +0.1 0.32 ± 12% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.15 ± 40% +0.1 0.28 ± 15% perf-profile.self.cycles-pp.do_idle
0.83 ± 5% +0.2 0.98 ± 8% perf-profile.self.cycles-pp.do_syscall_64
0.20 ± 28% +0.2 0.36 ± 9% perf-profile.self.cycles-pp.__next_timer_interrupt
0.01 ±173% +0.2 0.21 ± 14% perf-profile.self.cycles-pp.find_busiest_group
0.30 ± 4% +0.2 0.52 ± 15% perf-profile.self.cycles-pp.read_tsc
0.58 ± 2% +0.2 0.81 ± 9% perf-profile.self.cycles-pp.native_irq_return_iret
0.40 ± 6% +0.3 0.67 ± 2% perf-profile.self.cycles-pp.native_write_msr
0.54 ± 17% +0.4 0.93 ± 9% perf-profile.self.cycles-pp.cpuidle_enter_state
0.72 ± 29% +0.7 1.47 ± 9% perf-profile.self.cycles-pp.ktime_get
28.95 ± 9% +16.7 45.63 ± 4% perf-profile.self.cycles-pp.intel_idle
reaim.time.user_time
1000 +-+------------------------------------------------------------------+
900 +-+ .+.. .+.. .+.. .+. .+..|
O..O..O.O..O..O..O O O..O..O O O. O O.O O O. O +..+ +.+. |
800 +-+ : : : : |
700 +-+ : : : : |
| : : : : |
600 +-+ : : : : |
500 +-+ : : : : |
400 +-+ : : : : |
| : : : : |
300 +-+ : : : : |
200 +-+ : : : : |
| :: :: |
100 +-+ : : |
0 +-+------------------------------------------------------------------+
reaim.time.system_time
120 +-+-------------------------------------------------------------------+
| |
100 +-++..+.+..+..+..+..+.+..+..+..+..+.+..+..+ +.+..+..+ +.+..+..|
O. O O O O O O O O O O O O O O O O O O : : |
| : : : : |
80 +-+ : : : : |
| : : : : |
60 +-+ : : : : |
| : : : : |
40 +-+ : : : : |
| : : : : |
| : : : : |
20 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
reaim.time.percent_of_cpu_this_job_got
350 +-+-------------------------------------------------------------------+
|..+..+.+..+..+..+..+.+..+..+..+..+.+..+..+ +.+..+..+ +.+..+..|
300 O-+O O O O O O O O O O O O O O O O O O : : |
| : : : : |
250 +-+ : : : : |
| : : : : |
200 +-+ : : : : |
| : : : : |
150 +-+ : : : : |
| : : : : |
100 +-+ : : : : |
| : : : : |
50 +-+ : : |
| : : |
0 +-+-------------------------------------------------------------------+
reaim.time.voluntary_context_switches
700000 +-+----------------------------------------------------------------+
O..O.O..O..O.O..O. O O..O..O O O. O O.O O O O +..+ +..+ |
600000 +-+ : : : : |
| : : : : |
500000 +-+ : : : : |
| : : : : |
400000 +-+ : : : : |
| : : : : |
300000 +-+ : : : : |
| : : : : |
200000 +-+ : : : : |
| : : :: |
100000 +-+ : : |
| : : |
0 +-+----------------------------------------------------------------+
reaim.time.involuntary_context_switches
100000 +-+----------------------------------------------------------------+
90000 +-+ .+.. .+. .+. .+.. .+.. .+ .+..|
|..+ +. +..+. +..+..+ +. + : +.+..+..+ +..+ |
80000 +-+ O O O O O O O O : O O : : |
70000 O-+O O O O O O O: O : : : |
| : : : : |
60000 +-+ : : : : |
50000 +-+ : : : : |
40000 +-+ : : : : |
| : : : : |
30000 +-+ : : : : |
20000 +-+ : : :: |
| :: :: |
10000 +-+ : : |
0 +-+----------------------------------------------------------------+
reaim.parent_time
6 O-+O--O--O--O-O--O--O--O--O--O--O--O-O--O--O--O--O--O-------------------+
|..+..+..+..+.+..+..+..+..+..+..+..+.+..+..+ +..+..+..+ +..+..+..|
5 +-+ : : : : |
| : : : : |
| : : : : |
4 +-+ : : : : |
| : : : : |
3 +-+ : : : : |
| : : : : |
2 +-+ : : : : |
| : : : : |
| : : :: |
1 +-+ : : |
| : : |
0 +-+---------------------------------------------------------------------+
reaim.child_systime
3 +-+-------------------------------------------------------------------+
| |
2.5 +-++..+.+..+..+..+..+.+..+..+..+..+.+..+..+ +.+..+..+ +.+..+..|
O O O O O O O O O O O O O O O O O O O : : |
| : : : : |
2 +-+ : : : : |
| : : : : |
1.5 +-+ : : : : |
| : : : : |
1 +-+ : : : : |
| : : : : |
| : : : : |
0.5 +-+ :: :: |
| : : |
0 +-+-------------------------------------------------------------------+
reaim.child_utime
25 +-+--------------------------------------------------------------------+
|..+..+..+.+..+..+..+..+..+.+..+..+..+..+..+ +..+..+..+ +..+..+..|
O O O O O O O O O O O O O O O O O O O : : |
20 +-+ : : : : |
| : : : : |
| : : : : |
15 +-+ : : : : |
| : : : : |
10 +-+ : : : : |
| : : : : |
| : : : : |
5 +-+ :: :: |
| : : |
| : : |
0 +-+--------------------------------------------------------------------+
reaim.jobs_per_min
45000 +-+-----------------------------------------------------------------+
O..O.O..O..O..O.O..O..O.O..O..O..O.O..O..O O O..O..+.+ +..+.+..|
40000 +-+ : : : : |
35000 +-+ : : : : |
| : : : : |
30000 +-+ : : : : |
25000 +-+ : : : : |
| : : : : |
20000 +-+ : : : : |
15000 +-+ : : : : |
| : : : : |
10000 +-+ :: : : |
5000 +-+ : : |
| : : |
0 +-+-----------------------------------------------------------------+
reaim.jobs_per_min_child
1200 +-+------------------------------------------------------------------+
| |
1000 O-+O..O.O..O..O..O.O..O..O..O.O..O..O..O.O O O..O.+..+ +.+..+..|
| : : : : |
| : : : : |
800 +-+ : : : : |
| : : : : |
600 +-+ : : : : |
| : : : : |
400 +-+ : : : : |
| : : : : |
| : : : : |
200 +-+ :: :: |
| : : |
0 +-+------------------------------------------------------------------+
reaim.std_dev_time
0.06 +-+------------------------------------------------------------------+
| |
0.05 O-+O O O O O O O O O O O O O O O O O |
| O |
| |
0.04 +-+ |
| |
0.03 +-+ |
| .+. |
0.02 +-++..+.+..+..+..+.+..+..+..+.+..+..+. + +..+.+..+ +.+..+..|
| : : : : |
| : : : : |
0.01 +-+ : : : : |
| : : : : |
0 +-+------------------------------------------------------------------+
reaim.std_dev_percent
1 +-+-------------------------------------------------------------------+
0.9 +-+ O O O O O O O O O O O O O O |
O O O O O |
0.8 +-+ |
0.7 +-+ |
| |
0.6 +-+ |
0.5 +-+ |
0.4 +-++..+.+..+..+..+..+.+..+..+..+..+.+..+..+ +.+..+..+ +.+..+..|
| : : : : |
0.3 +-+ : : : : |
0.2 +-+ : : : : |
| : : : : |
0.1 +-+ :: :: |
0 +-+-------------------------------------------------------------------+
reaim.max_jobs_per_min
45000 +-+-----------------------------------------------------------------+
O..O.O..O..O..O.O..O..O.O..O..O..O.O..O..O O O..O..+.+ +..+.+..|
40000 +-+ : : : : |
35000 +-+ : : : : |
| : : : : |
30000 +-+ : : : : |
25000 +-+ : : : : |
| : : : : |
20000 +-+ : : : : |
15000 +-+ : : : : |
| : : : : |
10000 +-+ :: : : |
5000 +-+ : : |
| : : |
0 +-+-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
11 months
- 1
- 0
Re: [LKP] [BUG] kvm: APIC emulation problem - was Re: [x86/hotplug] ...
by Thomas Gleixner
Wanpeng,
On Tue, 2 Jul 2019, Wanpeng Li wrote:
> On Tue, 2 Jul 2019 at 06:44, Thomas Gleixner <tglx(a)linutronix.de> wrote:
> >
> > While that CPU0 hotplug test case is surely an esoteric issue, the APIC
> > emulation is still wrong, Even if the play_dead() code would not enable
> > interrupts then the pending IRR bit would turn into an ISR .. interrupt
> > when the APIC is reenabled on startup.
>
> >From SDM 10.4.7.2 Local APIC State After It Has Been Software Disabled
> * Pending interrupts in the IRR and ISR registers are held and require
> masking or handling by the CPU.
Correct.
> In your testing, hardware cpu will not respect soft disable APIC when
> IRR has already been set or APICv posted-interrupt is in flight, so we
> can skip soft disable APIC checking when clearing IRR and set ISR,
> continue to respect soft disable APIC when attempting to set IRR.
> Could you try below fix?
> diff --git a/arch/x86/kvm/lapic.c b/arch/x86/kvm/lapic.c
> index 05d8934..f857a12 100644
> --- a/arch/x86/kvm/lapic.c
> +++ b/arch/x86/kvm/lapic.c
> @@ -2376,7 +2376,7 @@ int kvm_apic_has_interrupt(struct kvm_vcpu *vcpu)
> struct kvm_lapic *apic = vcpu->arch.apic;
> u32 ppr;
>
> - if (!apic_enabled(apic))
> + if (!kvm_apic_hw_enabled(apic))
> return -1;
>
> __apic_update_ppr(apic, &ppr);
Yes. That fixes it and works as expected. Thanks for the quick
resolution. I surely stared at that function, but was not sure how to fix
it proper.
Tested-by: Thomas Gleixner <tglx(a)linutronix.de>
Please add a Cc: stable... tag when you post the patch.
Thanks,
tglx
11 months, 1 week
- 1
- 0
07173c3ec2: stderr.fio:pid=#, err=#/file:filesetup.c:#, func=fsync, error=Input/output_error
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 07173c3ec276cbb18dc0e0687d37d310e98a1480 ("block: enable multipage bvecs")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: fio-basic
on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 256G memory
with following parameters:
runtime: 300s
nr_task: 8t
disk: 1SSD
fs: xfs
rw: randread
bs: 2M
ioengine: sync
test_size: 512g
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
fio: pid=0, err=5/file:filesetup.c:190, func=fsync, error=Input/output error
fio: pid=0, err=5/file:filesetup.c:190, func=fsync, error=Input/output error
To reproduce:
git clonehttps://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
11 months, 1 week
- 3
- 19
[x86/hotplug] e1056a25da: WARNING:at_arch/x86/kernel/apic/apic.c:#setup_local_APIC
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: e1056a25daa6460c95e92d7d6853d05ad62458f7 ("x86/hotplug: Silence APIC and NMI when CPU is dead")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git WIP.x86/ipi
in testcase: locktorture
with following parameters:
runtime: 300s
test: cpuhotplug
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------+------------+------------+
| | c1257b49b9 | e1056a25da |
+----------------------------------------------------------+------------+------------+
| boot_successes | 8 | 6 |
| boot_failures | 51 | 48 |
| BUG:kernel_reboot-without-warning_in_test_stage | 50 | 22 |
| BUG:soft_lockup-CPU##stuck_for#s | 1 | |
| RIP:__memcpy | 1 | |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 1 | |
| WARNING:at_arch/x86/kernel/apic/apic.c:#setup_local_APIC | 0 | 26 |
| RIP:setup_local_APIC | 0 | 26 |
+----------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 216.682229] WARNING: CPU: 0 PID: 0 at arch/x86/kernel/apic/apic.c:1473 setup_local_APIC+0x250/0x3b0
[ 216.724190] Modules linked in: locktorture torture sr_mod cdrom ata_generic pata_acpi bochs_drm ttm ppdev drm_kms_helper ata_piix syscopyarea snd_pcm sysfillrect sysimgblt libata fb_sys_fops snd_timer snd drm crc32c_intel soundcore joydev serio_raw pcspkr i2c_piix4 parport_pc parport floppy
[ 216.771348] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.2.0-rc5-00003-ge1056a2 #1
[ 216.785027] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 216.800351] RIP: 0010:setup_local_APIC+0x250/0x3b0
[ 216.809104] Code: 30 8b 0d eb 78 7d 01 85 c9 74 26 0f 31 c1 e1 0a 48 c1 e2 20 41 89 ce 4c 03 34 24 48 09 d0 49 29 c6 4d 85 f6 0f 8f 74 fe ff ff <0f> 0b e9 22 ff ff ff 49 83 ee 01 eb ea a9 00 00 01 00 8b 15 2c ac
[ 216.843098] RSP: 0000:ffffffff89a03ee0 EFLAGS: 00010082
[ 216.852617] RAX: 00000076a573f693 RBX: 0000000000000020 RCX: 0000000089ff6800
[ 216.865848] RDX: 0000007600000000 RSI: 0000000000000020 RDI: ffffffff89a03ef0
[ 216.878971] RBP: 0000000000000000 R08: ffffffff8a348de2 R09: 0000000000000032
[ 216.892080] R10: ffffffff89a03ee8 R11: 0000000000000000 R12: 00000000000000f0
[ 216.905019] R13: 0000000000001000 R14: fffffffffffc1cfb R15: 0000000000000000
[ 216.918205] FS: 0000000000000000(0000) GS:ffff89af74800000(0000) knlGS:0000000000000000
[ 216.941317] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 216.951812] CR2: 0000000057567184 CR3: 000000000ba0a000 CR4: 00000000000006f0
[ 216.964997] Call Trace:
[ 216.969667] apic_ap_setup+0xa/0x20
[ 216.976266] start_secondary+0x78/0x1e0
[ 216.983423] secondary_startup_64+0xb6/0xc0
[ 216.991271] ---[ end trace 06172ec0274b1dfa ]---
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc5-00003-ge1056a2 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months, 1 week
- 4
- 19
[btrfs] 7c7e301406: WARNING:at_fs/kernfs/dir.c:#kernfs_remove_by_name_ns
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 7c7e301406d0a93051d236600a72066278c2e4dc ("btrfs: sysfs: Replace default_attrs in ktypes with groups")
https://git.kernel.org/cgit/linux/kernel/git/gregkh/driver-core.git driver-core-testing
in testcase: xfstests
with following parameters:
disk: 6HDD
fs: btrfs
test: btrfs-group1
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------+------------+------------+
| | d252768216 | 7c7e301406 |
+------------------------------------------------------+------------+------------+
| boot_successes | 3 | 0 |
| boot_failures | 20 | 32 |
| BUG:kernel_reboot-without-warning_in_test_stage | 19 | 4 |
| BUG:kernel_NULL_pointer_dereference,address | 1 | |
| Oops:#[##] | 1 | |
| RIP:raid#_sse21_gen_syndrome[raid#_pq] | 1 | |
| Kernel_panic-not_syncing:Fatal_exception | 1 | |
| WARNING:at_fs/kernfs/dir.c:#kernfs_remove_by_name_ns | 0 | 28 |
| RIP:kernfs_remove_by_name_ns | 0 | 28 |
+------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 326.982029] WARNING: CPU: 1 PID: 5231 at fs/kernfs/dir.c:1505 kernfs_remove_by_name_ns+0x84/0x90
[ 326.984875] Modules linked in: btrfs xor zstd_decompress zstd_compress raid6_pq libcrc32c dm_mod sr_mod cdrom crct10dif_pclmul sg crc32_pclmul crc32c_intel ata_generic pata_acpi ghash_clmulni_intel ppdev snd_pcm ata_piix aesni_intel snd_timer bochs_drm snd ttm crypto_simd drm_kms_helper cryptd joydev glue_helper libata syscopyarea sysfillrect soundcore sysimgblt serio_raw fb_sys_fops pcspkr drm i2c_piix4 floppy parport_pc parport ip_tables
[ 326.996328] CPU: 1 PID: 5231 Comm: umount Not tainted 5.2.0-rc3-00058-g7c7e301406d0a #1
[ 326.998371] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 327.000473] RIP: 0010:kernfs_remove_by_name_ns+0x84/0x90
[ 327.002110] Code: 00 31 c0 5b 5d 41 5c c3 48 c7 c7 20 a4 32 8b e8 d2 27 70 00 b8 fe ff ff ff 5b 5d 41 5c c3 48 c7 c7 18 8a ef 8a e8 7c 81 d4 ff <0f> 0b b8 fe ff ff ff eb d0 0f 1f 00 66 66 66 66 90 41 57 41 56 41
[ 327.006665] RSP: 0018:ffffab59834bfd60 EFLAGS: 00010282
[ 327.008340] RAX: 0000000000000000 RBX: ffffffffc05924b8 RCX: 0000000000000000
[ 327.010327] RDX: ffff97273fd26d40 RSI: ffff97273fd17778 RDI: ffff97273fd17778
[ 327.012326] RBP: ffffffffc053c818 R08: 00000000000004a1 R09: 0000000000aaaaaa
[ 327.014338] R10: ffffd09d01f8bb40 R11: ffff97271c40f520 R12: ffffffffc0535000
[ 327.016365] R13: ffff972678ae25e0 R14: ffff97267e10a9c8 R15: dead000000000100
[ 327.018411] FS: 00007fe85f144e40(0000) GS:ffff97273fd00000(0000) knlGS:0000000000000000
[ 327.020627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 327.022473] CR2: 00000000004216d0 CR3: 000000007c81e000 CR4: 00000000000406e0
[ 327.024539] Call Trace:
[ 327.025934] remove_files+0x30/0x70
[ 327.027530] sysfs_remove_group+0x3d/0x80
[ 327.029104] sysfs_remove_groups+0x29/0x40
[ 327.030697] kobject_del+0x20/0x60
[ 327.032213] btrfs_free_block_groups+0x335/0x420 [btrfs]
[ 327.034019] close_ctree+0x17a/0x300 [btrfs]
[ 327.035619] generic_shutdown_super+0x6c/0x120
[ 327.037270] kill_anon_super+0xe/0x30
[ 327.038823] btrfs_kill_super+0x12/0xa0 [btrfs]
[ 327.040484] deactivate_locked_super+0x3f/0x70
[ 327.042143] cleanup_mnt+0x3b/0x80
[ 327.043655] task_work_run+0xa3/0xe0
[ 327.047924] exit_to_usermode_loop+0xeb/0xf0
[ 327.049515] do_syscall_64+0x1a7/0x1e0
[ 327.051022] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 327.052729] RIP: 0033:0x7fe85ea28d77
[ 327.054183] Code: 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 31 f6 e9 09 00 00 00 66 0f 1f 84 00 00 00 00 00 b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 00 2b 00 f7 d8 64 89 01 48
[ 327.058914] RSP: 002b:00007fff3462bf78 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
[ 327.061036] RAX: 0000000000000000 RBX: 000055c942629080 RCX: 00007fe85ea28d77
[ 327.063153] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 000055c942629260
[ 327.065213] RBP: 000055c942629260 R08: 000055c94262a600 R09: 0000000000000015
[ 327.067315] R10: 00000000000006b4 R11: 0000000000000246 R12: 00007fe85ef2ae64
[ 327.069427] R13: 0000000000000000 R14: 0000000000000000 R15: 00007fff3462c200
[ 327.071527] ---[ end trace 83bb75461b78c5f8 ]---
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc3-00058-g7c7e301406d0a .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months, 1 week
- 1
- 0
[mm, swap] a839bbfc83: vm-scalability.median -85.4% regression
by kernel test robot
Greeting,
FYI, we noticed a -85.4% regression of vm-scalability.median due to commit:
commit: a839bbfc83241459f456e2210e1bf809c09d101d ("mm, swap: Fix huge page swap out")
git://bee.sh.intel.com/git/yhuang/linux.git fix_swap_bio
in testcase: vm-scalability
on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
with following parameters:
runtime: 300
thp_enabled: always
thp_defrag: always
nr_task: 32
nr_ssd: 1
test: swap-w-seq
cpufreq_governor: performance
ucode: 0x200005e
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
In addition to that, the commit also has significant impact on the following tests:
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode:
gcc-7/performance/x86_64-rhel-7.6/1/32/debian-x86_64-2019-05-14.cgz/300/lkp-skl-2sp7/swap-w-seq/vm-scalability/always/always/0x200005e
commit:
v5.2-rc5
a839bbfc83 ("mm, swap: Fix huge page swap out")
v5.2-rc5 a839bbfc83241459f456e2210e1
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 75% 3:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
:4 75% 3:4 dmesg.WARNING:stack_recursion
%stddev %change %stddev
\ | \
0.04 ± 2% +181.7% 0.11 ± 27% vm-scalability.free_time
953234 ± 7% -85.4% 139036 ± 33% vm-scalability.median
12.07 ± 7% +303.5% 48.71 ± 14% vm-scalability.stddev
33549668 ± 4% -73.2% 8987587 ± 20% vm-scalability.throughput
16.67 ± 6% +650.0% 125.05 ± 23% vm-scalability.time.elapsed_time
16.67 ± 6% +650.0% 125.05 ± 23% vm-scalability.time.elapsed_time.max
3439 ± 14% -36.9% 2168 ± 13% vm-scalability.time.involuntary_context_switches
230.00 ± 6% +394.8% 1138 ± 72% vm-scalability.time.major_page_faults
264826 ± 8% -20.8% 209807 ± 7% vm-scalability.time.minor_page_faults
2225 -91.2% 195.00 ± 26% vm-scalability.time.percent_of_cpu_this_job_got
247.83 ± 6% -59.0% 101.53 ± 5% vm-scalability.time.system_time
123.16 ± 3% +4.4% 128.53 ± 2% vm-scalability.time.user_time
935.67 ± 4% +3212.2% 30991 ± 22% vm-scalability.time.voluntary_context_switches
969.00 ± 74% +114.7% 2080 meminfo.Buffers
1180 ± 55% +85.8% 2192 ± 5% meminfo.Inactive(file)
1746145 -94.2% 101259 ± 4% meminfo.SwapCached
6436495 ± 8% -84.8% 975283 ± 28% meminfo.max_used_kB
0.78 ± 2% +26.3 27.04 ± 7% mpstat.cpu.all.iowait%
0.00 ± 72% +0.0 0.01 ± 10% mpstat.cpu.all.soft%
20.25 -19.0 1.27 ± 24% mpstat.cpu.all.sys%
10.33 ± 5% -8.7 1.59 ± 26% mpstat.cpu.all.usr%
245998 ± 12% +38.6% 340874 ± 17% numa-numastat.node0.local_node
250771 ± 10% +39.2% 349047 ± 16% numa-numastat.node0.numa_hit
212801 ± 8% +55.7% 331268 ± 15% numa-numastat.node1.local_node
231431 ± 5% +49.7% 346434 ± 13% numa-numastat.node1.numa_hit
595113 ± 17% +4530.2% 27554834 ±140% cpuidle.C1.time
11096 ± 6% +1244.6% 149198 ±113% cpuidle.C1.usage
6.575e+08 ± 37% +1111.8% 7.967e+09 ± 36% cpuidle.C1E.time
1471353 ± 23% +1048.4% 16897071 ± 31% cpuidle.C1E.usage
12370 ± 6% +1418.9% 187894 ± 27% cpuidle.POLL.time
3451 ± 12% +580.2% 23478 ± 20% cpuidle.POLL.usage
36414 ± 9% -19.6% 29288 ± 11% numa-meminfo.node0.KReclaimable
6647 ± 3% +12.0% 7447 ± 6% numa-meminfo.node0.KernelStack
36414 ± 9% -19.6% 29288 ± 11% numa-meminfo.node0.SReclaimable
33221 ± 8% +13.8% 37811 ± 4% numa-meminfo.node1.KReclaimable
11386 ± 19% +27.6% 14534 ± 3% numa-meminfo.node1.Mapped
33221 ± 8% +13.8% 37811 ± 4% numa-meminfo.node1.SReclaimable
96718 ± 6% +11.1% 107498 numa-meminfo.node1.Slab
7.67 ±114% +832.6% 71.50 ± 85% numa-vmstat.node0.nr_active_file
1.67 ± 74% +8420.0% 142.00 ±151% numa-vmstat.node0.nr_dirtied
6644 ± 3% +12.1% 7451 ± 6% numa-vmstat.node0.nr_kernel_stack
9105 ± 9% -19.6% 7323 ± 11% numa-vmstat.node0.nr_slab_reclaimable
7.67 ±114% +832.6% 71.50 ± 85% numa-vmstat.node0.nr_zone_active_file
2889 ± 18% +27.8% 3693 ± 4% numa-vmstat.node1.nr_mapped
8310 ± 7% +13.8% 9456 ± 4% numa-vmstat.node1.nr_slab_reclaimable
0.00 +2.6e+103% 26.00 ± 9% vmstat.cpu.wa
11137 ± 2% +3339.6% 383093 ± 3% vmstat.io.bo
936.67 ± 75% +121.4% 2073 vmstat.memory.buff
1796364 +804.8% 16254389 ± 31% vmstat.memory.swpd
0.00 +2e+103% 19.75 ± 8% vmstat.procs.b
20.33 ± 2% -91.4% 1.75 ± 47% vmstat.procs.r
11031 ± 2% +3372.7% 383068 ± 3% vmstat.swap.so
2502 ± 2% +15.6% 2892 ± 5% vmstat.system.cs
135091 +8.5% 146600 vmstat.system.in
412.33 ± 3% +24.5% 513.50 ± 12% slabinfo.biovec-128.active_objs
412.33 ± 3% +24.5% 513.50 ± 12% slabinfo.biovec-128.num_objs
1630 ± 9% +30.6% 2130 ± 4% slabinfo.blkdev_ioc.active_objs
1630 ± 9% +30.6% 2130 ± 4% slabinfo.blkdev_ioc.num_objs
623.67 ± 5% +105.2% 1279 ± 2% slabinfo.mnt_cache.active_objs
623.67 ± 5% +105.2% 1279 ± 2% slabinfo.mnt_cache.num_objs
25798 -19.6% 20743 ± 2% slabinfo.radix_tree_node.active_objs
26576 -21.3% 20914 ± 2% slabinfo.radix_tree_node.num_objs
7670 +32.2% 10138 ± 5% slabinfo.vmap_area.active_objs
7927 ± 2% +28.7% 10204 ± 5% slabinfo.vmap_area.num_objs
31.67 +457.4% 176.50 slabinfo.xfs_btree_cur.active_objs
31.67 +457.4% 176.50 slabinfo.xfs_btree_cur.num_objs
936.67 -87.1% 120.50 ± 19% turbostat.Avg_MHz
30.58 -25.1 5.46 ± 13% turbostat.Busy%
3074 -28.5% 2198 ± 5% turbostat.Bzy_MHz
4036 ± 7% +3462.7% 143803 ±117% turbostat.C1
0.03 +0.2 0.26 ±133% turbostat.C1%
1478185 ± 23% +1042.9% 16894079 ± 31% turbostat.C1E
66.60 +41.2% 94.04 turbostat.CPU%c1
2.82 ± 9% -82.0% 0.51 ± 55% turbostat.CPU%c6
2550806 ± 6% +622.0% 18418061 ± 22% turbostat.IRQ
11.66 ± 36% -9.6 2.08 ± 24% turbostat.PKG_%
218.62 -50.0% 109.29 ± 6% turbostat.PkgWatt
76.15 ± 2% -55.4% 33.95 ± 6% turbostat.RAMWatt
0.71 +3659.1% 26.73 ± 8% iostat.cpu.iowait
18.33 -93.1% 1.26 ± 23% iostat.cpu.system
9.36 ± 4% -83.5% 1.54 ± 25% iostat.cpu.user
1.55 ± 2% +3462.9% 55.14 ± 2% iostat.sdc.avgqu-sz
50.86 ± 35% +3429.1% 1794 ± 4% iostat.sdc.avgrq-sz
3.55 ± 29% +3626.4% 132.20 ± 3% iostat.sdc.await
40.25 ± 13% +329.3% 172.79 ± 12% iostat.sdc.await.max
0.33 ± 37% +15296.1% 50.60 ± 17% iostat.sdc.r_await
2.41 ± 55% +5212.5% 128.21 ± 5% iostat.sdc.r_await.max
3.76 ± 17% +919.3% 38.28 ± 2% iostat.sdc.util
28.57 ± 11% +1212.7% 375.03 iostat.sdc.w/s
49.50 ± 77% +172.0% 134.65 ± 3% iostat.sdc.w_await
463.33 ± 61% -62.5% 173.62 ± 13% iostat.sdc.w_await.max
10995 ± 2% +3318.5% 375862 ± 3% iostat.sdc.wkB/s
2720 ± 2% -89.7% 279.14 ± 26% iostat.sdc.wrqm/s
8088 ± 86% +116.0% 17473 ± 49% sched_debug.cfs_rq:/.load.avg
1336 ± 32% -33.9% 883.25 ± 13% sched_debug.cfs_rq:/.load_avg.max
271.84 ± 26% -32.8% 182.61 ± 10% sched_debug.cfs_rq:/.load_avg.stddev
0.20 ± 12% -35.2% 0.13 ± 35% sched_debug.cfs_rq:/.nr_running.avg
0.40 ± 5% -20.5% 0.32 ± 16% sched_debug.cfs_rq:/.nr_running.stddev
218.14 ± 34% -51.2% 106.39 ± 32% sched_debug.cfs_rq:/.removed.load_avg.stddev
47525 -50.1% 23717 ± 57% sched_debug.cfs_rq:/.removed.runnable_sum.max
10082 ± 34% -51.2% 4916 ± 32% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
472.33 ± 14% -55.6% 209.58 ± 30% sched_debug.cfs_rq:/.removed.util_avg.max
86.27 ± 36% -55.3% 38.55 ± 14% sched_debug.cfs_rq:/.removed.util_avg.stddev
2.65 ± 15% +312.5% 10.94 ± 43% sched_debug.cfs_rq:/.runnable_load_avg.avg
5.47 ± 7% +844.8% 51.67 ± 55% sched_debug.cfs_rq:/.runnable_load_avg.stddev
459.64 ± 3% -48.1% 238.77 ± 46% sched_debug.cfs_rq:/.util_avg.avg
697.67 ± 33% -51.1% 340.83 ± 36% sched_debug.cfs_rq:/.util_est_enqueued.max
133.93 ± 22% -41.5% 78.33 ± 45% sched_debug.cfs_rq:/.util_est_enqueued.stddev
624974 ± 2% +26.8% 792617 ± 11% sched_debug.cpu.avg_idle.avg
3115 ± 69% +3424.7% 109819 ±105% sched_debug.cpu.avg_idle.min
254002 ± 5% -28.0% 182859 ± 24% sched_debug.cpu.avg_idle.stddev
16.33 ± 2% +1670.4% 289.17 ± 62% sched_debug.cpu.cpu_load[1].max
63.67 ± 39% +269.2% 235.08 ± 37% sched_debug.cpu.cpu_load[3].max
8.63 ± 25% +246.8% 29.93 ± 38% sched_debug.cpu.cpu_load[3].stddev
221.33 ± 32% +36.4% 301.83 ± 13% sched_debug.cpu.cpu_load[4].max
27.73 ± 22% +34.3% 37.23 ± 16% sched_debug.cpu.cpu_load[4].stddev
321.64 ± 13% -37.0% 202.77 ± 29% sched_debug.cpu.curr->pid.avg
1817 +69.6% 3081 ± 23% sched_debug.cpu.curr->pid.max
849036 ± 19% -30.4% 590573 ± 23% sched_debug.cpu.max_idle_balance_cost.max
40847 ± 48% -74.1% 10599 ±155% sched_debug.cpu.max_idle_balance_cost.stddev
13201 ± 11% +345.9% 58871 ± 43% sched_debug.cpu.nr_load_updates.max
4940 ± 11% +930.9% 50927 ± 51% sched_debug.cpu.nr_load_updates.min
0.20 ± 11% -44.2% 0.11 ± 36% sched_debug.cpu.nr_running.avg
0.40 ± 4% -27.8% 0.29 ± 19% sched_debug.cpu.nr_running.stddev
909.98 ± 3% +205.1% 2776 ± 38% sched_debug.cpu.nr_switches.avg
39.00 ± 13% +126.3% 88.25 ± 69% proc-vmstat.nr_active_file
46.67 ± 2% +558.4% 307.25 ±144% proc-vmstat.nr_dirtied
700624 -58.5% 290892 ± 2% proc-vmstat.nr_file_pages
294.67 ± 55% +85.9% 547.75 ± 5% proc-vmstat.nr_inactive_file
1924 ± 26% +417.7% 9959 ± 7% proc-vmstat.nr_isolated_anon
13089 +2.0% 13346 proc-vmstat.nr_kernel_stack
32840 +2.3% 33610 proc-vmstat.nr_slab_unreclaimable
2192566 ± 11% -97.5% 53726 ± 14% proc-vmstat.nr_vmscan_write
53342 ± 6% +39.9% 74649 ± 10% proc-vmstat.nr_written
39.00 ± 13% +126.3% 88.25 ± 69% proc-vmstat.nr_zone_active_file
294.67 ± 55% +85.9% 547.75 ± 5% proc-vmstat.nr_zone_inactive_file
65737 ± 9% -54.5% 29878 ± 59% proc-vmstat.numa_foreign
5233 ± 63% -94.2% 301.00 ±135% proc-vmstat.numa_hint_faults
502654 ± 4% +42.7% 717531 ± 8% proc-vmstat.numa_hit
91566 ± 2% -13.1% 79554 ± 5% proc-vmstat.numa_huge_pte_updates
479242 ± 4% +44.9% 694184 ± 8% proc-vmstat.numa_local
65737 ± 9% -54.5% 29878 ± 59% proc-vmstat.numa_miss
89149 ± 7% -40.3% 53225 ± 33% proc-vmstat.numa_other
7296 ± 37% -92.1% 576.75 ±116% proc-vmstat.numa_pages_migrated
46953489 ± 2% -13.2% 40761186 ± 5% proc-vmstat.numa_pte_updates
1440566 ± 6% +1413.2% 21798218 ± 19% proc-vmstat.pgdeactivate
332918 ± 8% +69.6% 564633 ± 13% proc-vmstat.pgfault
13371 ± 33% -68.0% 4273 ±107% proc-vmstat.pgmigrate_success
215189 ± 5% +22457.3% 48540898 ± 25% proc-vmstat.pgpgout
40255 ± 11% +1741.5% 741324 ± 66% proc-vmstat.pgrefill
52370 ± 5% +38.4% 72464 ± 11% proc-vmstat.pgrotated
4865666 ± 10% -73.6% 1283432 ± 54% proc-vmstat.pgscan_direct
53567 ± 5% +47.1% 78817 ± 10% proc-vmstat.pgsteal_direct
53285 ± 6% +22672.7% 12134455 ± 25% proc-vmstat.pswpout
694484 ± 4% -89.5% 72902 ± 46% proc-vmstat.slabs_scanned
411.67 ± 23% +136.3% 972.75 ± 41% proc-vmstat.swap_ra
637567 ± 7% -100.0% 22.75 ±158% proc-vmstat.thp_split_page_failed
2714 ± 7% +769.3% 23598 ± 25% proc-vmstat.thp_split_pmd
17.86 ± 71% -17.9 0.00 perf-profile.calltrace.cycles-pp.__run_perf_stat
17.86 ± 71% -17.9 0.00 perf-profile.calltrace.cycles-pp.process_interval.__run_perf_stat
17.86 ± 71% -17.9 0.00 perf-profile.calltrace.cycles-pp.read_counters.process_interval.__run_perf_stat
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__read_nocancel.perf_evsel__read_counter.read_counters
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__read_nocancel.perf_evsel__read_counter.read_counters.process_interval
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.perf_evsel__read_counter.read_counters.process_interval.__run_perf_stat
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.__read_nocancel.perf_evsel__read_counter.read_counters.process_interval.__run_perf_stat
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__read_nocancel.perf_evsel__read_counter
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__read_nocancel
13.10 ± 78% -13.1 0.00 perf-profile.calltrace.cycles-pp.perf_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__ioctl.perf_evlist__enable.cmd_record.run_builtin
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.__strcspn_sse42
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.generic_start_main.__strcspn_sse42
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.main.generic_start_main.__strcspn_sse42
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.run_builtin.main.generic_start_main.__strcspn_sse42
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.cmd_record.run_builtin.main.generic_start_main.__strcspn_sse42
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.perf_evlist__enable.cmd_record.run_builtin.main.generic_start_main
9.72 ± 72% -9.7 0.00 perf-profile.calltrace.cycles-pp.__ioctl.perf_evlist__enable.cmd_record.run_builtin.main
8.93 ± 71% -8.9 0.00 perf-profile.calltrace.cycles-pp.page_fault
8.93 ± 71% -8.9 0.00 perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
8.93 ± 71% -8.9 0.00 perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
9.72 ± 72% -6.6 3.12 ±173% perf-profile.calltrace.cycles-pp.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl
9.72 ± 72% -6.6 3.12 ±173% perf-profile.calltrace.cycles-pp.smp_call_function_single.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__ioctl.perf_evlist__enable.cmd_record
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__ioctl.perf_evlist__enable
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.calltrace.cycles-pp.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl
37.90 ± 10% +15.1 52.98 ± 13% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
37.90 ± 10% +15.6 53.47 ± 14% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
37.90 ± 10% +20.2 58.09 ± 17% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
37.90 ± 10% +20.2 58.11 ± 17% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
37.90 ± 10% +20.2 58.11 ± 17% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
37.90 ± 10% +21.3 59.16 ± 17% perf-profile.calltrace.cycles-pp.secondary_startup_64
14.49 ± 11% -11.3 3.17 ±170% perf-profile.children.cycles-pp.main
9.72 ± 72% -9.7 0.04 ±173% perf-profile.children.cycles-pp.__strcspn_sse42
9.72 ± 72% -9.7 0.04 ±173% perf-profile.children.cycles-pp.generic_start_main
9.72 ± 72% -9.7 0.04 ±173% perf-profile.children.cycles-pp.run_builtin
9.72 ± 72% -6.6 3.12 ±173% perf-profile.children.cycles-pp.event_function_call
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.cmd_record
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.perf_evlist__enable
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.__ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.__x64_sys_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.ksys_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.do_vfs_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.perf_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp._perf_ioctl
9.72 ± 72% -3.5 6.25 ±173% perf-profile.children.cycles-pp.perf_event_for_each_child
37.90 ± 10% +16.5 54.43 ± 12% perf-profile.children.cycles-pp.cpuidle_enter_state
37.90 ± 10% +16.6 54.45 ± 12% perf-profile.children.cycles-pp.cpuidle_enter
37.90 ± 10% +20.2 58.11 ± 17% perf-profile.children.cycles-pp.start_secondary
37.90 ± 10% +21.3 59.16 ± 17% perf-profile.children.cycles-pp.secondary_startup_64
37.90 ± 10% +21.3 59.16 ± 17% perf-profile.children.cycles-pp.cpu_startup_entry
37.90 ± 10% +21.3 59.20 ± 17% perf-profile.children.cycles-pp.do_idle
8.68 ± 3% -26.8% 6.36 ± 5% perf-stat.i.MPKI
2.502e+10 ± 5% -87.2% 3.198e+09 ± 26% perf-stat.i.branch-instructions
0.11 ± 13% +0.8 0.90 ± 26% perf-stat.i.branch-miss-rate%
23382905 ± 11% -75.5% 5721801 ± 15% perf-stat.i.branch-misses
41.93 -23.6 18.29 ± 14% perf-stat.i.cache-miss-rate%
2.81e+08 ± 3% -94.3% 16145030 ± 27% perf-stat.i.cache-misses
6.988e+08 ± 3% -92.3% 53497791 ± 25% perf-stat.i.cache-references
2067 ± 2% +33.6% 2762 ± 5% perf-stat.i.context-switches
0.92 ± 5% +67.8% 1.55 ± 17% perf-stat.i.cpi
7.293e+10 ± 2% -89.3% 7.801e+09 ± 19% perf-stat.i.cpu-cycles
21.45 ± 13% -67.6% 6.96 ± 29% perf-stat.i.cpu-migrations
272.89 +431.1% 1449 ± 29% perf-stat.i.cycles-between-cache-misses
0.00 ± 8% +0.0 0.04 ± 92% perf-stat.i.dTLB-load-miss-rate%
496385 ± 4% -64.9% 174362 ± 78% perf-stat.i.dTLB-load-misses
1.784e+10 ± 5% -87.3% 2.258e+09 ± 24% perf-stat.i.dTLB-loads
0.00 ± 7% +0.0 0.01 ± 73% perf-stat.i.dTLB-store-miss-rate%
132773 ± 3% -73.2% 35517 ± 53% perf-stat.i.dTLB-store-misses
5.645e+09 ± 5% -85.6% 8.13e+08 ± 23% perf-stat.i.dTLB-stores
934340 +5.1% 982061 perf-stat.i.iTLB-loads
8.302e+10 ± 5% -87.5% 1.037e+10 ± 25% perf-stat.i.instructions
1306296 ± 18% -78.1% 285960 ± 11% perf-stat.i.instructions-per-iTLB-miss
1.25 ± 2% -19.6% 1.01 ± 13% perf-stat.i.ipc
19396 -78.1% 4241 ± 10% perf-stat.i.minor-faults
17.49 +17.5 35.01 ± 15% perf-stat.i.node-load-miss-rate%
11479900 ± 4% -97.6% 270100 ± 21% perf-stat.i.node-load-misses
45237538 ± 4% -98.5% 684482 ± 22% perf-stat.i.node-loads
4.61 ± 6% +24.6 29.17 ± 42% perf-stat.i.node-store-miss-rate%
1222952 -95.6% 53410 ± 30% perf-stat.i.node-store-misses
33871357 ± 6% -88.1% 4029966 ± 26% perf-stat.i.node-stores
19443 -77.9% 4290 ± 10% perf-stat.i.page-faults
8.41 ± 2% -38.8% 5.15 perf-stat.overall.MPKI
0.09 ± 7% +0.1 0.18 ± 12% perf-stat.overall.branch-miss-rate%
40.24 -9.9 30.34 ± 6% perf-stat.overall.cache-miss-rate%
0.88 ± 3% -14.7% 0.75 ± 5% perf-stat.overall.cpi
259.86 +85.4% 481.88 ± 7% perf-stat.overall.cycles-between-cache-misses
0.00 ± 8% +0.0 0.01 ± 47% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 8% +0.0 0.00 ± 26% perf-stat.overall.dTLB-store-miss-rate%
806679 ± 24% -64.2% 288426 ± 30% perf-stat.overall.instructions-per-iTLB-miss
1.14 ± 3% +17.5% 1.34 ± 5% perf-stat.overall.ipc
20.25 ± 2% +7.4 27.64 ± 8% perf-stat.overall.node-load-miss-rate%
3.48 ± 4% -2.2 1.29 ± 29% perf-stat.overall.node-store-miss-rate%
2.351e+10 ± 5% -85.9% 3.306e+09 ± 27% perf-stat.ps.branch-instructions
22052695 ± 10% -74.2% 5690976 ± 13% perf-stat.ps.branch-misses
2.639e+08 ± 2% -93.6% 16805109 ± 29% perf-stat.ps.cache-misses
6.559e+08 ± 3% -91.6% 55112928 ± 26% perf-stat.ps.cache-references
1948 +41.6% 2758 ± 4% perf-stat.ps.context-switches
6.856e+10 ± 2% -88.4% 7.929e+09 ± 20% perf-stat.ps.cpu-cycles
20.25 ± 13% -62.9% 7.52 ± 23% perf-stat.ps.cpu-migrations
466503 ± 4% -63.7% 169477 ± 76% perf-stat.ps.dTLB-load-misses
1.676e+10 ± 4% -86.1% 2.328e+09 ± 25% perf-stat.ps.dTLB-loads
125298 ± 3% -71.4% 35890 ± 53% perf-stat.ps.dTLB-store-misses
5.306e+09 ± 5% -84.2% 8.359e+08 ± 23% perf-stat.ps.dTLB-stores
877745 +10.8% 972135 perf-stat.ps.iTLB-loads
7.801e+10 ± 4% -86.3% 1.07e+10 ± 26% perf-stat.ps.instructions
18304 ± 2% -76.2% 4359 ± 12% perf-stat.ps.minor-faults
135297 +5.5% 142756 perf-stat.ps.msec
10756810 ± 4% -97.5% 267283 ± 20% perf-stat.ps.node-load-misses
42385394 ± 4% -98.3% 706344 ± 23% perf-stat.ps.node-loads
1146060 -95.4% 53221 ± 29% perf-stat.ps.node-store-misses
31870738 ± 5% -86.9% 4174842 ± 27% perf-stat.ps.node-stores
18348 ± 2% -76.0% 4411 ± 12% perf-stat.ps.page-faults
2239 ± 6% +2452.5% 57158 ± 23% interrupts.272:PCI-MSI.376832-edge.ahci[0000:00:17.0]
63879 ± 5% +176.1% 176360 ± 17% interrupts.CAL:Function_call_interrupts
785.00 ± 7% +173.8% 2149 ± 19% interrupts.CPU0.CAL:Function_call_interrupts
34552 ± 5% +628.7% 251770 ± 22% interrupts.CPU0.LOC:Local_timer_interrupts
1067 ± 24% +81.9% 1940 ± 12% interrupts.CPU1.CAL:Function_call_interrupts
34279 ± 6% +633.6% 251473 ± 22% interrupts.CPU1.LOC:Local_timer_interrupts
916.67 ± 11% +103.8% 1867 ± 21% interrupts.CPU10.CAL:Function_call_interrupts
34252 ± 6% +634.9% 251708 ± 22% interrupts.CPU10.LOC:Local_timer_interrupts
872.33 ± 14% +115.5% 1880 ± 17% interrupts.CPU11.CAL:Function_call_interrupts
34452 ± 6% +630.1% 251540 ± 22% interrupts.CPU11.LOC:Local_timer_interrupts
719.00 ± 7% +158.3% 1857 ± 20% interrupts.CPU12.CAL:Function_call_interrupts
34352 ± 6% +632.8% 251721 ± 22% interrupts.CPU12.LOC:Local_timer_interrupts
34606 ± 6% +627.4% 251728 ± 22% interrupts.CPU13.LOC:Local_timer_interrupts
825.00 ± 4% +126.4% 1867 ± 9% interrupts.CPU14.CAL:Function_call_interrupts
34473 ± 6% +629.5% 251481 ± 22% interrupts.CPU14.LOC:Local_timer_interrupts
7.00 ± 46% +8878.6% 628.50 ±164% interrupts.CPU14.RES:Rescheduling_interrupts
870.00 ± 6% +106.6% 1797 ± 17% interrupts.CPU15.CAL:Function_call_interrupts
34286 ± 6% +633.4% 251458 ± 23% interrupts.CPU15.LOC:Local_timer_interrupts
990.67 ± 16% +79.5% 1778 ± 18% interrupts.CPU16.CAL:Function_call_interrupts
34444 ± 6% +629.8% 251364 ± 22% interrupts.CPU16.LOC:Local_timer_interrupts
776.33 ± 5% +137.6% 1844 ± 21% interrupts.CPU17.CAL:Function_call_interrupts
34538 ± 5% +628.0% 251440 ± 22% interrupts.CPU17.LOC:Local_timer_interrupts
1025 ± 7% +293.4% 4032 ± 37% interrupts.CPU18.CAL:Function_call_interrupts
34282 ± 6% +633.7% 251541 ± 23% interrupts.CPU18.LOC:Local_timer_interrupts
379.33 ± 66% +551.7% 2472 ± 88% interrupts.CPU18.TLB:TLB_shootdowns
899.33 ± 22% +177.1% 2491 ± 45% interrupts.CPU19.CAL:Function_call_interrupts
34374 ± 6% +631.4% 251399 ± 22% interrupts.CPU19.LOC:Local_timer_interrupts
1076 ± 27% +77.8% 1914 ± 13% interrupts.CPU2.CAL:Function_call_interrupts
34508 ± 5% +628.8% 251504 ± 22% interrupts.CPU2.LOC:Local_timer_interrupts
2.00 ±141% +5362.5% 109.25 ± 75% interrupts.CPU2.NMI:Non-maskable_interrupts
2.00 ±141% +5362.5% 109.25 ± 75% interrupts.CPU2.PMI:Performance_monitoring_interrupts
856.00 ± 6% +261.2% 3092 ± 40% interrupts.CPU20.CAL:Function_call_interrupts
34346 ± 6% +631.8% 251357 ± 22% interrupts.CPU20.LOC:Local_timer_interrupts
18.67 ± 37% +600.4% 130.75 ±124% interrupts.CPU20.RES:Rescheduling_interrupts
310.33 ± 95% +121.6% 687.75 ± 58% interrupts.CPU20.TLB:TLB_shootdowns
927.00 ± 21% +231.4% 3072 ± 38% interrupts.CPU21.CAL:Function_call_interrupts
34220 ± 6% +635.0% 251505 ± 22% interrupts.CPU21.LOC:Local_timer_interrupts
963.33 ± 27% +199.7% 2887 ± 18% interrupts.CPU22.CAL:Function_call_interrupts
34158 ± 6% +636.3% 251495 ± 22% interrupts.CPU22.LOC:Local_timer_interrupts
34.33 ±117% +425.0% 180.25 ±134% interrupts.CPU22.RES:Rescheduling_interrupts
836.00 ± 24% +223.1% 2700 ± 40% interrupts.CPU23.CAL:Function_call_interrupts
34440 ± 6% +630.4% 251571 ± 23% interrupts.CPU23.LOC:Local_timer_interrupts
915.67 ± 14% +158.0% 2362 ± 38% interrupts.CPU24.CAL:Function_call_interrupts
34355 ± 5% +631.6% 251341 ± 22% interrupts.CPU24.LOC:Local_timer_interrupts
899.00 ± 13% +217.6% 2855 ± 29% interrupts.CPU25.CAL:Function_call_interrupts
34317 ± 6% +633.1% 251586 ± 22% interrupts.CPU25.LOC:Local_timer_interrupts
878.33 ± 12% +260.7% 3168 ± 22% interrupts.CPU26.CAL:Function_call_interrupts
34310 ± 6% +632.7% 251378 ± 23% interrupts.CPU26.LOC:Local_timer_interrupts
871.00 ± 10% +262.4% 3156 ± 30% interrupts.CPU27.CAL:Function_call_interrupts
34282 ± 6% +632.8% 251219 ± 22% interrupts.CPU27.LOC:Local_timer_interrupts
34347 ± 6% +632.6% 251642 ± 23% interrupts.CPU28.LOC:Local_timer_interrupts
921.33 ± 12% +298.1% 3668 ± 42% interrupts.CPU29.CAL:Function_call_interrupts
34298 ± 6% +633.7% 251649 ± 22% interrupts.CPU29.LOC:Local_timer_interrupts
1018 ± 35% +99.0% 2026 ± 12% interrupts.CPU3.CAL:Function_call_interrupts
34273 ± 6% +633.7% 251467 ± 22% interrupts.CPU3.LOC:Local_timer_interrupts
911.67 ± 10% +298.8% 3636 ± 52% interrupts.CPU30.CAL:Function_call_interrupts
34294 ± 6% +633.2% 251433 ± 23% interrupts.CPU30.LOC:Local_timer_interrupts
783.00 ± 6% +253.7% 2769 ± 29% interrupts.CPU31.CAL:Function_call_interrupts
34227 ± 6% +634.8% 251505 ± 22% interrupts.CPU31.LOC:Local_timer_interrupts
1031 ± 27% +158.8% 2668 ± 25% interrupts.CPU32.CAL:Function_call_interrupts
34359 ± 6% +632.3% 251598 ± 22% interrupts.CPU32.LOC:Local_timer_interrupts
813.33 ± 10% +289.8% 3170 ± 45% interrupts.CPU33.CAL:Function_call_interrupts
34360 ± 5% +631.9% 251498 ± 22% interrupts.CPU33.LOC:Local_timer_interrupts
48.33 ±139% +416.2% 249.50 ±106% interrupts.CPU33.TLB:TLB_shootdowns
837.33 ± 10% +224.8% 2719 ± 31% interrupts.CPU34.CAL:Function_call_interrupts
34292 ± 6% +633.6% 251557 ± 23% interrupts.CPU34.LOC:Local_timer_interrupts
815.67 ± 9% +336.9% 3563 ± 27% interrupts.CPU35.CAL:Function_call_interrupts
34397 ± 6% +631.0% 251448 ± 22% interrupts.CPU35.LOC:Local_timer_interrupts
47.33 ±138% +451.9% 261.25 ± 67% interrupts.CPU35.TLB:TLB_shootdowns
1015 ± 19% +107.4% 2105 ± 19% interrupts.CPU36.CAL:Function_call_interrupts
34274 ± 6% +633.3% 251325 ± 23% interrupts.CPU36.LOC:Local_timer_interrupts
0.00 +1.1e+105% 1122 ±137% interrupts.CPU36.NMI:Non-maskable_interrupts
0.00 +1.1e+105% 1122 ±137% interrupts.CPU36.PMI:Performance_monitoring_interrupts
791.33 ± 3% +135.3% 1862 ± 24% interrupts.CPU37.CAL:Function_call_interrupts
34360 ± 5% +631.6% 251387 ± 23% interrupts.CPU37.LOC:Local_timer_interrupts
773.00 ± 2% +156.6% 1983 ± 15% interrupts.CPU38.CAL:Function_call_interrupts
34185 ± 5% +635.5% 251423 ± 22% interrupts.CPU38.LOC:Local_timer_interrupts
710.67 ± 13% +235.5% 2384 ± 47% interrupts.CPU39.CAL:Function_call_interrupts
34388 ± 5% +631.3% 251483 ± 22% interrupts.CPU39.LOC:Local_timer_interrupts
8.00 ± 66% +43987.5% 3527 ±172% interrupts.CPU39.RES:Rescheduling_interrupts
728.33 ± 15% +172.9% 1987 ± 8% interrupts.CPU4.CAL:Function_call_interrupts
34292 ± 6% +633.0% 251371 ± 22% interrupts.CPU4.LOC:Local_timer_interrupts
10.00 ± 35% +2400.0% 250.00 ± 83% interrupts.CPU4.RES:Rescheduling_interrupts
824.67 ± 12% +131.4% 1908 ± 13% interrupts.CPU40.CAL:Function_call_interrupts
34263 ± 6% +633.7% 251396 ± 22% interrupts.CPU40.LOC:Local_timer_interrupts
798.00 ± 6% +150.7% 2000 ± 29% interrupts.CPU41.CAL:Function_call_interrupts
34020 ± 5% +639.2% 251494 ± 22% interrupts.CPU41.LOC:Local_timer_interrupts
886.67 ± 15% +145.0% 2172 ± 43% interrupts.CPU42.CAL:Function_call_interrupts
34329 ± 6% +632.4% 251442 ± 22% interrupts.CPU42.LOC:Local_timer_interrupts
884.00 ± 20% +107.9% 1838 ± 22% interrupts.CPU43.CAL:Function_call_interrupts
34266 ± 6% +634.0% 251509 ± 22% interrupts.CPU43.LOC:Local_timer_interrupts
807.33 ± 8% +124.9% 1816 ± 21% interrupts.CPU44.CAL:Function_call_interrupts
34333 ± 5% +632.5% 251501 ± 22% interrupts.CPU44.LOC:Local_timer_interrupts
816.67 ± 10% +116.6% 1769 ± 18% interrupts.CPU45.CAL:Function_call_interrupts
34240 ± 6% +634.6% 251520 ± 22% interrupts.CPU45.LOC:Local_timer_interrupts
791.33 ± 6% +127.9% 1803 ± 20% interrupts.CPU46.CAL:Function_call_interrupts
34163 ± 5% +635.8% 251387 ± 22% interrupts.CPU46.LOC:Local_timer_interrupts
874.67 ± 10% +185.1% 2494 ± 60% interrupts.CPU47.CAL:Function_call_interrupts
34418 ± 5% +630.4% 251393 ± 23% interrupts.CPU47.LOC:Local_timer_interrupts
851.00 ± 9% +113.8% 1819 ± 21% interrupts.CPU48.CAL:Function_call_interrupts
34389 ± 6% +631.1% 251424 ± 23% interrupts.CPU48.LOC:Local_timer_interrupts
882.67 ± 20% +95.9% 1728 ± 16% interrupts.CPU49.CAL:Function_call_interrupts
34353 ± 6% +632.2% 251524 ± 22% interrupts.CPU49.LOC:Local_timer_interrupts
956.33 ± 19% +97.3% 1886 ± 15% interrupts.CPU5.CAL:Function_call_interrupts
34198 ± 5% +635.0% 251368 ± 22% interrupts.CPU5.LOC:Local_timer_interrupts
870.33 ± 18% +110.2% 1829 ± 23% interrupts.CPU50.CAL:Function_call_interrupts
34329 ± 6% +632.4% 251422 ± 23% interrupts.CPU50.LOC:Local_timer_interrupts
844.67 ± 14% +109.6% 1770 ± 18% interrupts.CPU51.CAL:Function_call_interrupts
34445 ± 6% +630.1% 251479 ± 22% interrupts.CPU51.LOC:Local_timer_interrupts
842.33 ± 14% +117.3% 1830 ± 22% interrupts.CPU52.CAL:Function_call_interrupts
33947 ± 6% +641.3% 251659 ± 22% interrupts.CPU52.LOC:Local_timer_interrupts
651.00 ± 11% +159.6% 1690 ± 16% interrupts.CPU53.CAL:Function_call_interrupts
34090 ± 6% +636.5% 251090 ± 23% interrupts.CPU53.LOC:Local_timer_interrupts
872.00 ± 13% +169.0% 2345 ± 30% interrupts.CPU54.CAL:Function_call_interrupts
34298 ± 6% +630.3% 250493 ± 22% interrupts.CPU54.LOC:Local_timer_interrupts
886.33 ± 15% +194.0% 2605 ± 37% interrupts.CPU55.CAL:Function_call_interrupts
34273 ± 6% +633.7% 251457 ± 23% interrupts.CPU55.LOC:Local_timer_interrupts
970.67 ± 23% +125.1% 2184 ± 19% interrupts.CPU56.CAL:Function_call_interrupts
34281 ± 6% +632.9% 251249 ± 22% interrupts.CPU56.LOC:Local_timer_interrupts
821.33 ± 16% +156.0% 2102 ± 14% interrupts.CPU57.CAL:Function_call_interrupts
34281 ± 6% +633.3% 251377 ± 22% interrupts.CPU57.LOC:Local_timer_interrupts
931.33 ± 18% +296.3% 3691 ± 47% interrupts.CPU58.CAL:Function_call_interrupts
34585 ± 5% +626.8% 251365 ± 22% interrupts.CPU58.LOC:Local_timer_interrupts
961.67 ± 19% +152.9% 2432 ± 29% interrupts.CPU59.CAL:Function_call_interrupts
34228 ± 5% +634.4% 251370 ± 22% interrupts.CPU59.LOC:Local_timer_interrupts
815.00 ± 3% +130.0% 1874 ± 16% interrupts.CPU6.CAL:Function_call_interrupts
34432 ± 6% +630.3% 251452 ± 22% interrupts.CPU6.LOC:Local_timer_interrupts
960.67 ± 20% +246.4% 3327 ± 42% interrupts.CPU60.CAL:Function_call_interrupts
34259 ± 6% +634.1% 251483 ± 23% interrupts.CPU60.LOC:Local_timer_interrupts
875.33 ± 14% +299.6% 3497 ± 28% interrupts.CPU61.CAL:Function_call_interrupts
34280 ± 6% +633.1% 251293 ± 22% interrupts.CPU61.LOC:Local_timer_interrupts
127.33 ± 84% +196.5% 377.50 ± 51% interrupts.CPU61.TLB:TLB_shootdowns
937.67 ± 16% +328.1% 4013 ± 38% interrupts.CPU62.CAL:Function_call_interrupts
34288 ± 6% +633.4% 251481 ± 23% interrupts.CPU62.LOC:Local_timer_interrupts
1007 ± 23% +211.2% 3135 ± 26% interrupts.CPU63.CAL:Function_call_interrupts
34294 ± 6% +633.4% 251500 ± 22% interrupts.CPU63.LOC:Local_timer_interrupts
890.33 ± 28% +296.6% 3531 ± 45% interrupts.CPU64.CAL:Function_call_interrupts
34601 ± 5% +626.7% 251459 ± 22% interrupts.CPU64.LOC:Local_timer_interrupts
903.33 ± 9% +244.4% 3111 ± 41% interrupts.CPU65.CAL:Function_call_interrupts
34212 ± 6% +635.0% 251445 ± 22% interrupts.CPU65.LOC:Local_timer_interrupts
954.33 +218.3% 3037 ± 49% interrupts.CPU66.CAL:Function_call_interrupts
34120 ± 6% +636.8% 251404 ± 22% interrupts.CPU66.LOC:Local_timer_interrupts
1047 ± 23% +141.0% 2523 ± 25% interrupts.CPU67.CAL:Function_call_interrupts
34230 ± 6% +634.4% 251394 ± 23% interrupts.CPU67.LOC:Local_timer_interrupts
863.67 ± 16% +277.8% 3262 ± 48% interrupts.CPU68.CAL:Function_call_interrupts
34235 ± 6% +634.6% 251477 ± 22% interrupts.CPU68.LOC:Local_timer_interrupts
966.67 ± 18% +133.7% 2259 ± 28% interrupts.CPU69.CAL:Function_call_interrupts
34304 ± 6% +633.0% 251443 ± 22% interrupts.CPU69.LOC:Local_timer_interrupts
897.67 ± 16% +147.0% 2217 ± 37% interrupts.CPU7.CAL:Function_call_interrupts
34340 ± 6% +632.2% 251436 ± 22% interrupts.CPU7.LOC:Local_timer_interrupts
936.00 ± 17% +195.6% 2767 ± 25% interrupts.CPU70.CAL:Function_call_interrupts
34446 ± 6% +629.9% 251415 ± 22% interrupts.CPU70.LOC:Local_timer_interrupts
1150 ± 17% +164.1% 3037 ± 37% interrupts.CPU71.CAL:Function_call_interrupts
34292 ± 6% +633.0% 251355 ± 22% interrupts.CPU71.LOC:Local_timer_interrupts
0.33 ±141% +1.8e+05% 602.50 ±131% interrupts.CPU71.NMI:Non-maskable_interrupts
0.33 ±141% +1.8e+05% 602.50 ±131% interrupts.CPU71.PMI:Performance_monitoring_interrupts
813.67 ± 13% +141.7% 1966 ± 19% interrupts.CPU8.CAL:Function_call_interrupts
34280 ± 5% +633.9% 251588 ± 22% interrupts.CPU8.LOC:Local_timer_interrupts
1024 ± 31% +72.1% 1762 ± 16% interrupts.CPU9.CAL:Function_call_interrupts
34209 ± 6% +634.4% 251234 ± 22% interrupts.CPU9.LOC:Local_timer_interrupts
2470742 ± 6% +632.7% 18104169 ± 22% interrupts.LOC:Local_timer_interrupts
14.00 ± 5% +1.8e+05% 25023 ± 88% interrupts.NMI:Non-maskable_interrupts
14.00 ± 5% +1.8e+05% 25023 ± 88% interrupts.PMI:Performance_monitoring_interrupts
1788 ± 4% +1529.0% 29137 ± 22% softirqs.BLOCK
2109 ± 40% +1192.8% 27265 ± 21% softirqs.CPU0.RCU
6031 ± 11% +218.9% 19236 ± 23% softirqs.CPU0.SCHED
13298 ± 7% +226.5% 43423 ± 20% softirqs.CPU0.TIMER
1263 ± 6% +1739.7% 23241 ± 25% softirqs.CPU1.RCU
3342 ± 16% +432.7% 17804 ± 26% softirqs.CPU1.SCHED
11830 ± 6% +257.1% 42242 ± 20% softirqs.CPU1.TIMER
1068 ± 6% +2474.9% 27508 ± 23% softirqs.CPU10.RCU
2646 ± 4% +543.7% 17033 ± 21% softirqs.CPU10.SCHED
11147 ± 5% +283.9% 42790 ± 22% softirqs.CPU10.TIMER
1352 ± 18% +1760.0% 25147 ± 29% softirqs.CPU11.RCU
3823 ± 32% +341.1% 16864 ± 22% softirqs.CPU11.SCHED
11735 ± 2% +258.9% 42113 ± 20% softirqs.CPU11.TIMER
1374 ± 13% +1788.8% 25958 ± 26% softirqs.CPU12.RCU
3612 ± 16% +375.2% 17166 ± 21% softirqs.CPU12.SCHED
11924 ± 5% +257.1% 42582 ± 20% softirqs.CPU12.TIMER
1171 ± 23% +2266.4% 27710 ± 25% softirqs.CPU13.RCU
2931 ± 3% +484.4% 17130 ± 21% softirqs.CPU13.SCHED
11724 ± 4% +262.9% 42547 ± 20% softirqs.CPU13.TIMER
1054 ± 5% +2360.7% 25944 ± 25% softirqs.CPU14.RCU
2889 ± 4% +485.6% 16921 ± 22% softirqs.CPU14.SCHED
11471 ± 7% +255.4% 40768 ± 20% softirqs.CPU14.TIMER
1110 ± 17% +1973.2% 23026 ± 26% softirqs.CPU15.RCU
2808 +497.3% 16771 ± 21% softirqs.CPU15.SCHED
11645 ± 7% +255.7% 41418 ± 20% softirqs.CPU15.TIMER
1752 ± 67% +1164.3% 22159 ± 25% softirqs.CPU16.RCU
2552 ± 4% +567.6% 17040 ± 20% softirqs.CPU16.SCHED
11298 ± 5% +274.2% 42278 ± 19% softirqs.CPU16.TIMER
1914 ± 67% +1134.9% 23644 ± 24% softirqs.CPU17.RCU
2850 ± 8% +502.9% 17183 ± 20% softirqs.CPU17.SCHED
11173 ± 6% +333.1% 48394 ± 8% softirqs.CPU17.TIMER
1930 ± 7% +1445.0% 29829 ± 23% softirqs.CPU18.RCU
3705 ± 17% +354.9% 16852 ± 17% softirqs.CPU18.SCHED
12227 ± 5% +329.9% 52566 ± 20% softirqs.CPU18.TIMER
1612 ± 21% +1660.5% 28378 ± 27% softirqs.CPU19.RCU
3237 ± 18% +426.5% 17045 ± 20% softirqs.CPU19.SCHED
12046 ± 4% +314.7% 49958 ± 19% softirqs.CPU19.TIMER
2952 ± 70% +859.7% 28329 ± 18% softirqs.CPU2.RCU
2611 ± 22% +542.2% 16770 ± 25% softirqs.CPU2.SCHED
15302 ± 17% +239.1% 51892 ± 30% softirqs.CPU2.TIMER
1268 ± 4% +2148.5% 28511 ± 24% softirqs.CPU20.RCU
3093 ± 13% +442.3% 16775 ± 20% softirqs.CPU20.SCHED
12050 ± 4% +315.2% 50026 ± 18% softirqs.CPU20.TIMER
1193 ± 5% +2328.4% 28986 ± 20% softirqs.CPU21.RCU
2767 ± 21% +505.5% 16757 ± 20% softirqs.CPU21.SCHED
10941 ± 6% +352.9% 49552 ± 18% softirqs.CPU21.TIMER
1384 ± 32% +1791.9% 26196 ± 42% softirqs.CPU22.RCU
2817 ± 20% +495.3% 16772 ± 20% softirqs.CPU22.SCHED
11002 ± 9% +352.7% 49808 ± 19% softirqs.CPU22.TIMER
2099 ± 57% +1233.4% 27988 ± 28% softirqs.CPU23.RCU
2906 ± 13% +470.6% 16584 ± 20% softirqs.CPU23.SCHED
11907 ± 7% +311.9% 49040 ± 18% softirqs.CPU23.TIMER
1530 ± 27% +1752.5% 28355 ± 26% softirqs.CPU24.RCU
2985 ± 15% +461.2% 16754 ± 21% softirqs.CPU24.SCHED
12057 ± 9% +313.1% 49808 ± 20% softirqs.CPU24.TIMER
1298 ± 14% +2061.3% 28053 ± 24% softirqs.CPU25.RCU
2977 ± 7% +464.7% 16816 ± 21% softirqs.CPU25.SCHED
11885 ± 8% +315.7% 49407 ± 19% softirqs.CPU25.TIMER
1156 ± 10% +2359.9% 28444 ± 25% softirqs.CPU26.RCU
3197 ± 8% +421.0% 16655 ± 20% softirqs.CPU26.SCHED
11643 ± 6% +328.4% 49874 ± 20% softirqs.CPU26.TIMER
1070 ± 6% +2402.2% 26773 ± 25% softirqs.CPU27.RCU
2929 ± 8% +462.9% 16491 ± 22% softirqs.CPU27.SCHED
11517 ± 7% +321.4% 48528 ± 19% softirqs.CPU27.TIMER
1484 ± 44% +1800.4% 28208 ± 25% softirqs.CPU28.RCU
3473 ± 16% +377.1% 16571 ± 23% softirqs.CPU28.SCHED
11433 ± 6% +331.9% 49380 ± 18% softirqs.CPU28.TIMER
1382 ± 15% +1942.8% 28238 ± 25% softirqs.CPU29.RCU
2883 ± 3% +481.4% 16764 ± 20% softirqs.CPU29.SCHED
11730 ± 3% +320.9% 49370 ± 19% softirqs.CPU29.TIMER
4306 ± 50% +575.5% 29089 ± 30% softirqs.CPU3.RCU
2480 ± 20% +555.3% 16254 ± 21% softirqs.CPU3.SCHED
13335 ± 15% +220.2% 42697 ± 22% softirqs.CPU3.TIMER
1137 ± 17% +2181.8% 25944 ± 24% softirqs.CPU30.RCU
2828 ± 4% +491.1% 16716 ± 22% softirqs.CPU30.SCHED
11661 +322.4% 49256 ± 19% softirqs.CPU30.TIMER
1101 ± 14% +2276.9% 26185 ± 25% softirqs.CPU31.RCU
3220 ± 3% +419.4% 16727 ± 21% softirqs.CPU31.SCHED
11568 +328.4% 49563 ± 19% softirqs.CPU31.TIMER
2311 ± 50% +1019.7% 25879 ± 25% softirqs.CPU32.RCU
2491 ± 23% +566.3% 16598 ± 21% softirqs.CPU32.SCHED
11892 ± 3% +309.2% 48669 ± 20% softirqs.CPU32.TIMER
1518 ± 39% +1592.5% 25703 ± 24% softirqs.CPU33.RCU
3028 ± 6% +453.6% 16762 ± 21% softirqs.CPU33.SCHED
12184 ± 2% +304.7% 49311 ± 19% softirqs.CPU33.TIMER
1290 ± 28% +1989.3% 26966 ± 28% softirqs.CPU34.RCU
3011 ± 12% +462.9% 16951 ± 20% softirqs.CPU34.SCHED
12161 +310.1% 49877 ± 20% softirqs.CPU34.TIMER
1206 ± 24% +2077.2% 26271 ± 25% softirqs.CPU35.RCU
3101 ± 9% +437.3% 16664 ± 20% softirqs.CPU35.SCHED
11963 +314.0% 49531 ± 19% softirqs.CPU35.TIMER
1249 ± 20% +1999.3% 26227 ± 26% softirqs.CPU36.RCU
2362 ± 11% +589.8% 16295 ± 22% softirqs.CPU36.SCHED
13658 ± 22% +198.3% 40745 ± 17% softirqs.CPU36.TIMER
944.67 ± 2% +2666.1% 26130 ± 26% softirqs.CPU37.RCU
2956 ± 13% +531.6% 18672 ± 28% softirqs.CPU37.SCHED
11209 ± 2% +254.8% 39768 ± 18% softirqs.CPU37.TIMER
948.33 ± 6% +2580.3% 25418 ± 28% softirqs.CPU38.RCU
4900 ± 67% +229.7% 16154 ± 26% softirqs.CPU38.SCHED
10892 ± 9% +267.8% 40063 ± 18% softirqs.CPU38.TIMER
1237 ± 27% +2006.9% 26076 ± 25% softirqs.CPU39.RCU
2857 ± 30% +527.4% 17926 ± 25% softirqs.CPU39.SCHED
10655 ± 11% +278.5% 40330 ± 19% softirqs.CPU39.TIMER
1282 ± 19% +1987.3% 26766 ± 25% softirqs.CPU4.RCU
2846 ± 7% +497.3% 17000 ± 22% softirqs.CPU4.SCHED
11364 ± 5% +277.1% 42859 ± 20% softirqs.CPU4.TIMER
1078 ± 14% +2368.3% 26608 ± 26% softirqs.CPU40.RCU
2914 ± 23% +465.4% 16477 ± 22% softirqs.CPU40.SCHED
10838 ± 3% +273.4% 40476 ± 19% softirqs.CPU40.TIMER
1144 ± 17% +2195.7% 26263 ± 25% softirqs.CPU41.RCU
3013 ± 18% +440.5% 16286 ± 21% softirqs.CPU41.SCHED
12466 ± 10% +218.0% 39643 ± 18% softirqs.CPU41.TIMER
1254 ± 32% +1971.1% 25972 ± 25% softirqs.CPU42.RCU
2804 ± 18% +481.0% 16293 ± 20% softirqs.CPU42.SCHED
10878 ± 4% +270.7% 40319 ± 18% softirqs.CPU42.TIMER
1047 ± 17% +2427.6% 26472 ± 26% softirqs.CPU43.RCU
2783 ± 29% +503.3% 16789 ± 22% softirqs.CPU43.SCHED
10885 +269.7% 40244 ± 20% softirqs.CPU43.TIMER
962.67 ± 4% +2698.0% 26935 ± 26% softirqs.CPU44.RCU
2929 ± 20% +476.3% 16881 ± 21% softirqs.CPU44.SCHED
11111 ± 2% +265.7% 40632 ± 19% softirqs.CPU44.TIMER
1173 ± 28% +2077.4% 25541 ± 23% softirqs.CPU45.RCU
2915 ± 24% +453.9% 16147 ± 20% softirqs.CPU45.SCHED
11345 +252.3% 39964 ± 19% softirqs.CPU45.TIMER
986.67 ± 10% +2648.6% 27120 ± 25% softirqs.CPU46.RCU
3093 ± 15% +446.7% 16912 ± 21% softirqs.CPU46.SCHED
11299 ± 4% +255.3% 40140 ± 20% softirqs.CPU46.TIMER
921.33 ± 5% +2841.0% 27096 ± 25% softirqs.CPU47.RCU
2696 ± 21% +546.4% 17430 ± 24% softirqs.CPU47.SCHED
11049 ± 4% +263.8% 40196 ± 18% softirqs.CPU47.TIMER
1037 ± 15% +2522.0% 27199 ± 25% softirqs.CPU48.RCU
2809 ± 24% +488.8% 16544 ± 21% softirqs.CPU48.SCHED
10784 ± 4% +269.2% 39810 ± 19% softirqs.CPU48.TIMER
934.00 ± 6% +2814.6% 27222 ± 26% softirqs.CPU49.RCU
2804 ± 27% +489.1% 16520 ± 20% softirqs.CPU49.SCHED
11242 ± 2% +254.7% 39874 ± 19% softirqs.CPU49.TIMER
1171 ± 4% +1999.3% 24582 ± 23% softirqs.CPU5.RCU
2918 ± 11% +498.9% 17475 ± 24% softirqs.CPU5.SCHED
11254 ± 5% +276.7% 42388 ± 21% softirqs.CPU5.TIMER
906.33 ± 7% +2870.6% 26923 ± 26% softirqs.CPU50.RCU
2700 ± 29% +527.0% 16931 ± 11% softirqs.CPU50.SCHED
10681 +274.4% 39991 ± 18% softirqs.CPU50.TIMER
897.00 ± 10% +2896.6% 26879 ± 25% softirqs.CPU51.RCU
2895 ± 23% +468.3% 16453 ± 20% softirqs.CPU51.SCHED
10910 ± 3% +264.8% 39800 ± 19% softirqs.CPU51.TIMER
852.67 ± 8% +3047.8% 26840 ± 25% softirqs.CPU52.RCU
2839 ± 21% +493.5% 16848 ± 21% softirqs.CPU52.SCHED
11092 ± 4% +335.4% 48295 ± 39% softirqs.CPU52.TIMER
855.67 ± 12% +2981.3% 26365 ± 30% softirqs.CPU53.RCU
3289 +411.4% 16821 ± 20% softirqs.CPU53.SCHED
10895 ± 4% +261.8% 39415 ± 20% softirqs.CPU53.TIMER
877.33 ± 5% +2967.1% 26909 ± 24% softirqs.CPU54.RCU
2879 ± 15% +478.6% 16659 ± 22% softirqs.CPU54.SCHED
11600 +320.8% 48810 ± 19% softirqs.CPU54.TIMER
1096 ± 7% +2346.1% 26817 ± 26% softirqs.CPU55.RCU
2923 ± 16% +475.9% 16836 ± 21% softirqs.CPU55.SCHED
11582 +318.1% 48425 ± 18% softirqs.CPU55.TIMER
1171 ± 27% +2177.1% 26680 ± 26% softirqs.CPU56.RCU
2611 ± 31% +537.0% 16635 ± 21% softirqs.CPU56.SCHED
11645 ± 2% +312.6% 48046 ± 19% softirqs.CPU56.TIMER
1222 ± 40% +2077.5% 26623 ± 25% softirqs.CPU57.RCU
3307 ± 40% +407.6% 16788 ± 21% softirqs.CPU57.SCHED
13823 ± 28% +250.2% 48405 ± 18% softirqs.CPU57.TIMER
1310 ± 22% +1932.3% 26637 ± 25% softirqs.CPU58.RCU
2704 ± 20% +506.9% 16415 ± 21% softirqs.CPU58.SCHED
14387 ± 17% +234.7% 48150 ± 18% softirqs.CPU58.TIMER
961.67 ± 11% +2563.0% 25608 ± 26% softirqs.CPU59.RCU
2434 ± 24% +578.6% 16521 ± 21% softirqs.CPU59.SCHED
11278 ± 3% +329.4% 48434 ± 18% softirqs.CPU59.TIMER
2174 ± 75% +1120.0% 26523 ± 25% softirqs.CPU6.RCU
3001 +460.0% 16808 ± 20% softirqs.CPU6.SCHED
11204 ± 4% +273.5% 41852 ± 19% softirqs.CPU6.TIMER
896.33 ± 10% +2789.6% 25900 ± 26% softirqs.CPU60.RCU
2509 ± 24% +563.6% 16649 ± 20% softirqs.CPU60.SCHED
11311 ± 2% +329.1% 48539 ± 19% softirqs.CPU60.TIMER
1096 ± 23% +2251.4% 25771 ± 25% softirqs.CPU61.RCU
2788 ± 11% +486.9% 16362 ± 20% softirqs.CPU61.SCHED
11694 ± 7% +311.3% 48102 ± 19% softirqs.CPU61.TIMER
986.00 ± 14% +2517.1% 25804 ± 25% softirqs.CPU62.RCU
2460 ± 26% +552.8% 16058 ± 20% softirqs.CPU62.SCHED
11534 ± 4% +317.2% 48123 ± 19% softirqs.CPU62.TIMER
1080 ± 19% +2097.6% 23749 ± 29% softirqs.CPU63.RCU
2563 ± 20% +520.2% 15898 ± 18% softirqs.CPU63.SCHED
11378 ± 6% +327.1% 48596 ± 18% softirqs.CPU63.TIMER
1376 ± 31% +1836.4% 26651 ± 23% softirqs.CPU64.RCU
2805 ± 28% +481.9% 16322 ± 22% softirqs.CPU64.SCHED
11687 ± 3% +314.4% 48429 ± 18% softirqs.CPU64.TIMER
863.33 ± 5% +2928.2% 26143 ± 26% softirqs.CPU65.RCU
2701 ± 24% +509.5% 16465 ± 20% softirqs.CPU65.SCHED
11201 ± 4% +333.9% 48597 ± 19% softirqs.CPU65.TIMER
1011 ± 17% +2355.1% 24837 ± 25% softirqs.CPU66.RCU
3085 ± 21% +423.0% 16138 ± 20% softirqs.CPU66.SCHED
11698 ± 3% +312.7% 48278 ± 19% softirqs.CPU66.TIMER
987.33 ± 21% +2486.1% 25533 ± 24% softirqs.CPU67.RCU
2281 ± 22% +616.2% 16338 ± 23% softirqs.CPU67.SCHED
11350 +330.2% 48824 ± 17% softirqs.CPU67.TIMER
889.67 ± 12% +2375.3% 22021 ± 32% softirqs.CPU68.RCU
2709 ± 28% +495.7% 16142 ± 19% softirqs.CPU68.SCHED
11425 ± 5% +324.5% 48506 ± 19% softirqs.CPU68.TIMER
1179 ± 16% +2028.6% 25103 ± 25% softirqs.CPU69.RCU
2178 ± 38% +647.2% 16274 ± 20% softirqs.CPU69.SCHED
11411 ± 3% +326.9% 48719 ± 19% softirqs.CPU69.TIMER
1383 ± 32% +1861.4% 27133 ± 26% softirqs.CPU7.RCU
2895 ± 5% +498.0% 17311 ± 20% softirqs.CPU7.SCHED
11360 ± 8% +280.3% 43200 ± 21% softirqs.CPU7.TIMER
977.00 ± 23% +2557.0% 25958 ± 25% softirqs.CPU70.RCU
2744 ± 27% +500.1% 16470 ± 21% softirqs.CPU70.SCHED
11477 ± 5% +321.8% 48415 ± 19% softirqs.CPU70.TIMER
837.67 ± 7% +3023.2% 26161 ± 25% softirqs.CPU71.RCU
2110 ± 26% +591.1% 14584 ± 25% softirqs.CPU71.SCHED
11291 ± 2% +328.5% 48377 ± 19% softirqs.CPU71.TIMER
1503 ± 35% +1756.0% 27902 ± 23% softirqs.CPU8.RCU
3350 ± 11% +417.1% 17325 ± 23% softirqs.CPU8.SCHED
11685 ± 5% +272.9% 43571 ± 21% softirqs.CPU8.TIMER
1132 ± 8% +2240.6% 26503 ± 25% softirqs.CPU9.RCU
2603 ± 11% +557.7% 17120 ± 21% softirqs.CPU9.SCHED
11343 ± 4% +354.4% 51546 ± 45% softirqs.CPU9.TIMER
93320 ± 2% +1939.8% 1903568 ± 25% softirqs.RCU
212226 +468.5% 1206438 ± 21% softirqs.SCHED
839661 +291.1% 3283605 ± 19% softirqs.TIMER
vm-scalability.time.system_time
300 +-+-------------------------------------------------------------------+
| + |
250 +-+ .+ +.. +.. .+. +.. ..: +. ..|
| +..+..+ : : +.. .+ : +. + : + : : + |
|: : : : + : + : : : : : |
200 +-+ : : : : : : : : : : |
|: : : : : :: : : : : : |
150 +-+ : : : : : : : : : : : |
| :O : O : : : : : : : : : : |
100 +-+ O:O O :O:O O :O:O : :O O O : : : : |
O : O : O : : O O : : :O: : : : : |
| : : : : : : : : : : :: |
50 +-+: : : :: :: :: :: |
| : : : : : : : |
0 +-+-------------------------------------------------------------------+
vm-scalability.time.percent_of_cpu_this_job_got
2500 +-+------------------------------------------------------------------+
| .+.. .+.. .+..|
| +..+.+..+ +..+.+..+ + +.+. + + + + |
2000 +-+ : : : : : : : : : : |
|: : : : : : : : : : : |
|: : : : : : : : : : : : |
1500 +-+ : : : : : : : : : : : |
|: : : : : : : : : : : : |
1000 +-+ : : : : : : : : : : : |
| : : : : : : : : : : : : |
| : : : : : : : : : : : : |
500 +-+ : :: :: :: :: :: |
| : O : :: O O :: O: :: :: |
O O O O O O O O O O O O : O O O : : |
0 +-+------------------------------------------------------------------+
vm-scalability.throughput
4e+07 +-+---------------------------------------------------------------+
| +.. + |
3.5e+07 +-+ +.+..+.+ + +.+ : .+.+.+ +..+. +..+.|
3e+07 +-+ : : + : : +. : : + : |
| : : : : :: : : : : : |
2.5e+07 +-+ : : : : : : : : : : : |
|: : : : : : : : : : : : |
2e+07 +-+ : : : : : : : : : : : |
|: : : : : : : : : : : : |
1.5e+07 +-+ : : : : : : : : : : |
1e+07 O-+ O : O + O O : : :O:O : : : : |
|: O: O O O O :: O : : O : : : : |
5e+06 +-O : O O : O : :: |
| : : O : : : : |
0 +-+---------------------------------------------------------------+
vm-scalability.median
1.2e+06 +-+---------------------------------------------------------------+
| |
1e+06 +-+ + .+. +.. +.. |
| +.+..+. +.+..+.+ : +. +.+ : +. : +.|
| : + : : :: : : : + : |
800000 +-+ : : : : :: : : : : : |
| : : : : : : : : : : : |
600000 +-+ : : : : : : : : : : : |
|: : : : : : : : : : : : |
400000 +-+ : : : : : : : : : : : |
|: : : : : : : : : : : : |
O: O : : : O : : :O: : : : : |
200000 +-+ : O :: O :: : :: :: |
| O O O O O O O O O O : O O O : : |
0 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-skl-2sp7: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
***************************************************************************************************
lkp-skl-2sp7: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_ssd/nr_task/rootfs/runtime/tbox_group/test/testcase/thp_defrag/thp_enabled/ucode:
gcc-7/performance/x86_64-rhel-7.6/1/32/debian-x86_64-2019-05-14.cgz/300/lkp-skl-2sp7/swap-w-rand-mt/vm-scalability/always/always/0x200005e
commit:
v5.2-rc5
a839bbfc83 ("mm, swap: Fix huge page swap out")
v5.2-rc5 a839bbfc83241459f456e2210e1
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 50% 2:10 dmesg.WARNING:at#for_ip_interrupt_entry/0x
2:4 -50% :10 dmesg.WARNING:at_ip___perf_sw_event/0x
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
11 months, 1 week
- 1
- 0