[iomap] b258228a4e: Assertion_failed
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: b258228a4ec66c542edd16af8ea06e997a2e5589 ("[PATCH RFC] iomap: only return IO error if no data has been transferred")
url: https://github.com/0day-ci/linux/commits/Jens-Axboe/iomap-only-return-IO-...
base: https://git.kernel.org/cgit/fs/xfs/xfs-linux.git for-next
in testcase: xfstests
version: xfstests-x86_64-d41dcbd-1_20201116
with following parameters:
disk: 4HDD
fs: xfs
test: xfs-reflink-22
ucode: 0x28
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 8 threads Intel(R) Core(TM) i7-4790 v3 @ 3.60GHz with 6G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 36.688664]
[ 36.693804] xfs/441 3s
[ 36.693805]
[ 86.291072] xfs/442 IPMI BMC is not supported on this machine, skip bmc-watchdog setup!
[ 86.291075]
[ 272.280685] XFS: Assertion failed: ret < 0 || ret == count, file: fs/xfs/xfs_file.c, line: 595
[ 272.289788] ------------[ cut here ]------------
[ 272.294895] kernel BUG at fs/xfs/xfs_message.c:110!
[ 272.300258] invalid opcode: 0000 [#1] SMP PTI
[ 272.305092] CPU: 2 PID: 3718 Comm: fsstress Not tainted 5.10.0-rc1-00013-gb258228a4ec6 #1
[ 272.313750] Hardware name: Dell Inc. OptiPlex 9020/03CPWF, BIOS A11 04/01/2015
[ 272.321515] RIP: 0010:assfail+0x23/0x28 [xfs]
[ 272.326364] Code: 67 fc ff ff 0f 0b c3 0f 1f 44 00 00 41 89 c8 48 89 d1 48 89 f2 48 c7 c6 e8 55 a6 c0 e8 82 f9 ff ff 80 3d 99 75 0a 00 00 74 02 <0f> 0b 0f 0b c3 48 8d 45 10 48 89 e2 4c 89 e6 48 89 1c 24 48 89 44
[ 272.346124] RSP: 0018:ffffc9000294bc48 EFLAGS: 00010202
[ 272.351882] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[ 272.359549] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc0a57aaf
[ 272.367187] RBP: ffff888015e11400 R08: 0000000000000000 R09: 0000000000000000
[ 272.374851] R10: 000000000000000a R11: f000000000000000 R12: 0000000000008e00
[ 272.382518] R13: 000000000000a400 R14: ffff888020809f00 R15: ffffc9000294bcc8
[ 272.390201] FS: 00007f9376915b80(0000) GS:ffff88819ea80000(0000) knlGS:0000000000000000
[ 272.398818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 272.405077] CR2: 00007f9376914000 CR3: 00000001935a8004 CR4: 00000000001706e0
[ 272.412739] Call Trace:
[ 272.415775] xfs_file_dio_aio_write+0x152/0x300 [xfs]
[ 272.421366] xfs_file_write_iter+0x93/0xe0 [xfs]
[ 272.426522] aio_write+0x116/0x200
[ 272.430458] ? filename_lookup+0xf1/0x180
[ 272.434961] ? __io_submit_one+0x390/0x480
[ 272.440613] ? __might_fault+0x20/0x40
[ 272.444873] __io_submit_one+0x390/0x480
[ 272.450315] ? cp_new_stat+0x150/0x180
[ 272.454577] ? _cond_resched+0x19/0x40
[ 272.458828] io_submit_one+0xed/0x580
[ 272.463042] __x64_sys_io_submit+0x8e/0x1c0
[ 272.467713] do_syscall_64+0x33/0x40
[ 272.471763] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 272.477268] RIP: 0033:0x7f9376a0af59
[ 272.481307] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 07 6f 0c 00 f7 d8 64 89 01 48
[ 272.501017] RSP: 002b:00007ffff0f2b9f8 EFLAGS: 00000246 ORIG_RAX: 00000000000000d1
[ 272.509037] RAX: ffffffffffffffda RBX: 00007f9376915b00 RCX: 00007f9376a0af59
[ 272.516660] RDX: 00007ffff0f2bac8 RSI: 0000000000000001 RDI: 00007f9376b0d000
[ 272.524250] RBP: 00007f9376b0d000 R08: 00005577d3761a10 R09: 0000000000000001
[ 272.531870] R10: 000000000000021f R11: 0000000000000246 R12: 0000000000000001
[ 272.539501] R13: 000000000000001c R14: 00007ffff0f2bac8 R15: 00005577d3757600
[ 272.547132] Modules linked in: xfs dm_mod ipmi_devintf ipmi_msghandler btrfs blake2b_generic xor zstd_compress raid6_pq libcrc32c sd_mod t10_pi sg intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp i915 kvm_intel kvm irqbypass crct10dif_pclmul intel_gtt crc32_pclmul crc32c_intel drm_kms_helper ghash_clmulni_intel mei_wdt syscopyarea ahci sysfillrect sysimgblt rapl libahci fb_sys_fops mei_me intel_cstate drm dcdbas intel_uncore libata mei joydev video ip_tables
[ 272.592615] ---[ end trace 9781325a480dd608 ]---
[ 272.597906] RIP: 0010:assfail+0x23/0x28 [xfs]
[ 272.602899] Code: 67 fc ff ff 0f 0b c3 0f 1f 44 00 00 41 89 c8 48 89 d1 48 89 f2 48 c7 c6 e8 55 a6 c0 e8 82 f9 ff ff 80 3d 99 75 0a 00 00 74 02 <0f> 0b 0f 0b c3 48 8d 45 10 48 89 e2 4c 89 e6 48 89 1c 24 48 89 44
[ 272.622799] RSP: 0018:ffffc9000294bc48 EFLAGS: 00010202
[ 272.628623] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[ 272.636329] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc0a57aaf
[ 272.644025] RBP: ffff888015e11400 R08: 0000000000000000 R09: 0000000000000000
[ 272.651758] R10: 000000000000000a R11: f000000000000000 R12: 0000000000008e00
[ 272.659472] R13: 000000000000a400 R14: ffff888020809f00 R15: ffffc9000294bcc8
[ 272.667155] FS: 00007f9376915b80(0000) GS:ffff88819ea80000(0000) knlGS:0000000000000000
[ 272.675863] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 272.682139] CR2: 00007f9376914000 CR3: 00000001935a8004 CR4: 00000000001706e0
[ 272.689831] Kernel panic - not syncing: Fatal exception
[ 272.695635] Kernel Offset: disabled
ACPI MEMORY or I/O RESET_REG.
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Oliver Sang
1 year, 7 months
[btrfs] ccb0edc68b: xfstests.btrfs.179.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: ccb0edc68b690d0a62e9377ab509eb2f7cb610d3 ("btrfs: stop running all delayed refs during snapshot")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: xfstests
version: xfstests-x86_64-d41dcbd-1_20201116
with following parameters:
disk: 6HDD
fs: btrfs
test: btrfs-group-03
ucode: 0x28
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 8 threads Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz with 8G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
2020-11-25 22:50:45 export TEST_DIR=/fs/sdb1
2020-11-25 22:50:45 export TEST_DEV=/dev/sdb1
2020-11-25 22:50:45 export FSTYP=btrfs
2020-11-25 22:50:45 export SCRATCH_MNT=/fs/scratch
2020-11-25 22:50:45 mkdir /fs/scratch -p
2020-11-25 22:50:45 export SCRATCH_DEV_POOL="/dev/sdb2 /dev/sdb3 /dev/sdb4 /dev/sdb5 /dev/sdb6"
2020-11-25 22:50:45 sed "s:^:btrfs/:" //lkp/benchmarks/xfstests/tests/btrfs-group-03
2020-11-25 22:50:45 ./check btrfs/150 btrfs/151 btrfs/152 btrfs/153 btrfs/155 btrfs/156 btrfs/157 btrfs/158 btrfs/159 btrfs/160 btrfs/161 btrfs/162 btrfs/163 btrfs/164 btrfs/165 btrfs/166 btrfs/167 btrfs/168 btrfs/169 btrfs/170 btrfs/171 btrfs/172 btrfs/173 btrfs/174 btrfs/175 btrfs/176 btrfs/177 btrfs/178 btrfs/179 btrfs/180 btrfs/181 btrfs/182 btrfs/183 btrfs/184 btrfs/185 btrfs/186 btrfs/187 btrfs/188 btrfs/189 btrfs/190 btrfs/191 btrfs/192 btrfs/193 btrfs/194 btrfs/195 btrfs/196 btrfs/197 btrfs/198 btrfs/199
FSTYP -- btrfs
PLATFORM -- Linux/x86_64 lkp-hsw-d01 5.10.0-rc5-00155-gccb0edc68b69 #1 SMP Thu Nov 26 04:34:38 CST 2020
MKFS_OPTIONS -- /dev/sdb2
MOUNT_OPTIONS -- /dev/sdb2 /fs/scratch
btrfs/150 1s
btrfs/151 2s
btrfs/152 6s
btrfs/153 3s
btrfs/155 1s
btrfs/156 [not run] FITRIM not supported on /fs/scratch
btrfs/157 2s
btrfs/158 2s
btrfs/159 11s
btrfs/160 2s
btrfs/161 1s
btrfs/162 3s
btrfs/163 - output mismatch (see /lkp/benchmarks/xfstests/results//btrfs/163.out.bad)
--- tests/btrfs/163.out 2020-11-16 06:09:57.000000000 +0000
+++ /lkp/benchmarks/xfstests/results//btrfs/163.out.bad 2020-11-25 22:51:22.553853766 +0000
@@ -1,8 +1,10 @@
QA output created by 163
+./common/btrfs: line 405: _require_loadable_fs_module: command not found
-- golden --
0000000 abab abab abab abab abab abab abab abab
*
20000000
+./common/btrfs: line 412: _reload_fs_module: command not found
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/btrfs/163.out /lkp/benchmarks/xfstests/results//btrfs/163.out.bad' to see the entire diff)
btrfs/164 [not run] Require module btrfs to be unloadable
btrfs/165 1s
btrfs/166 1s
btrfs/167 2s
btrfs/168 1s
btrfs/169 2s
btrfs/170 0s
btrfs/171 1s
btrfs/172 [not run] This test requires a valid $LOGWRITES_DEV
btrfs/173 1s
btrfs/174 1s
btrfs/175 15s
btrfs/176 6s
btrfs/177 8s
btrfs/178 1s
btrfs/179 _check_btrfs_filesystem: filesystem on /dev/sdb2 is inconsistent
(see /lkp/benchmarks/xfstests/results//btrfs/179.full for details)
btrfs/180 4s
btrfs/181 3s
btrfs/182 3s
btrfs/183 1s
btrfs/184 2s
btrfs/185 1s
btrfs/186 1s
btrfs/187 192s
btrfs/188 1s
btrfs/189 2s
btrfs/190 [not run] This test requires a valid $LOGWRITES_DEV
btrfs/191 2s
btrfs/192 [not run] This test requires a valid $LOGWRITES_DEV
btrfs/193 2s
btrfs/194 181s
btrfs/195 489s
btrfs/196 [not run] This test requires a valid $LOGWRITES_DEV
btrfs/197 7s
btrfs/198 3s
btrfs/199 10s
Ran: btrfs/150 btrfs/151 btrfs/152 btrfs/153 btrfs/155 btrfs/156 btrfs/157 btrfs/158 btrfs/159 btrfs/160 btrfs/161 btrfs/162 btrfs/163 btrfs/164 btrfs/165 btrfs/166 btrfs/167 btrfs/168 btrfs/169 btrfs/170 btrfs/171 btrfs/172 btrfs/173 btrfs/174 btrfs/175 btrfs/176 btrfs/177 btrfs/178 btrfs/179 btrfs/180 btrfs/181 btrfs/182 btrfs/183 btrfs/184 btrfs/185 btrfs/186 btrfs/187 btrfs/188 btrfs/189 btrfs/190 btrfs/191 btrfs/192 btrfs/193 btrfs/194 btrfs/195 btrfs/196 btrfs/197 btrfs/198 btrfs/199
Not run: btrfs/156 btrfs/164 btrfs/172 btrfs/190 btrfs/192 btrfs/196
Failures: btrfs/163 btrfs/179
Failed 2 of 49 tests
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Oliver Sang
1 year, 7 months
502aa8ade3: BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 502aa8ade32ad34847705b644a08feef8aa940e1 ("Allow to compile RT")
https://git.kernel.org/cgit/linux/kernel/git/bigeasy/staging.git rtmutex
in testcase: trinity
version: trinity-static-x86_64-x86_64-f93256fb_2019-08-28
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------------------------------------+------------+------------+
| | 8518a3148f | 502aa8ade3 |
+-------------------------------------------------------------------------------+------------+------------+
| boot_successes | 28 | 0 |
| boot_failures | 0 | 28 |
| BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h | 0 | 28 |
| initcall_inet_init_returned_with_disabled_interrupts | 0 | 28 |
| WARNING:at_init/main.c:#do_one_initcall | 0 | 28 |
| RIP:do_one_initcall | 0 | 28 |
| initcall_populate_rootfs_returned_with_disabled_interrupts | 0 | 28 |
| BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/rtmutex.c | 0 | 28 |
| BUG:scheduling_while_atomic | 0 | 28 |
| WARNING:at_kernel/locking/rtmutex.c:#__rt_mutex_trylock | 0 | 28 |
| RIP:__rt_mutex_trylock | 0 | 28 |
| kernel_BUG_at_kernel/locking/rtmutex.c | 0 | 28 |
| invalid_opcode:#[##] | 0 | 28 |
| RIP:task_blocks_on_rt_mutex | 0 | 28 |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 0 | 28 |
+-------------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 0.465654] BUG: sleeping function called from invalid context at mm/slab.h:506
[ 0.466362] in_atomic(): 0, irqs_disabled(): 1, non_block: 0, pid: 2, name: kthreadd
[ 0.466362] CPU: 0 PID: 2 Comm: kthreadd Not tainted 5.10.0-rc5-00023-g502aa8ade32a #1
[ 0.466362] Call Trace:
[ 0.466362] ___might_sleep.cold+0x85/0x93
[ 0.466362] kmem_cache_alloc+0xcb/0x170
[ 0.466362] prepare_creds+0x1c/0x190
[ 0.466362] copy_creds+0x25/0x150
[ 0.466362] copy_process+0x37e/0x14d0
[ 0.466362] ? kthreadd+0x73/0x130
[ 0.466362] kernel_clone+0x44/0x320
[ 0.466362] ? update_curr+0x4c/0xb0
[ 0.466362] ? set_next_entity+0x4d/0xa0
[ 0.466362] ? kthreadd+0x73/0x130
[ 0.466362] ? kthreadd+0x51/0x130
[ 0.466362] kernel_thread+0x42/0x50
[ 0.466362] ? kthread_create_on_node+0x40/0x40
[ 0.466362] kthreadd+0xdf/0x130
[ 0.466362] ? kthread_create_on_cpu+0x50/0x50
[ 0.466362] ret_from_fork+0x1f/0x30
[ 0.466498] Performance Events: unsupported p6 CPU model 42 no PMU driver, software events only.
[ 0.468882] rcu: Hierarchical SRCU implementation.
[ 0.470922] devtmpfs: initialized
[ 0.472187] random: get_random_bytes called from net_ns_init+0xd0/0x357 with crng_init=0
[ 0.472415] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.478401] futex hash table entries: 16 (order: -2, 1024 bytes, linear)
[ 0.480266] NET: Registered protocol family 16
[ 0.481902] thermal_sys: Registered thermal governor 'step_wise'
[ 0.481963] cpuidle: using governor ladder
[ 0.483721] ACPI: bus type PCI registered
[ 0.484977] PCI: Using configuration type 1 for base access
[ 0.487835] ACPI: Added _OSI(Module Device)
[ 0.489045] ACPI: Added _OSI(Processor Device)
[ 0.490263] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.490399] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.491775] ACPI: Added _OSI(Linux-Dell-Video)
[ 0.492847] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[ 0.494135] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[ 0.495361] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.498670] ACPI: Interpreter enabled
[ 0.499652] ACPI: (supports S0 S5)
[ 0.500526] ACPI: Using IOAPIC for interrupt routing
[ 0.501793] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.502535] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 0.507087] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.508601] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments HPX-Type3]
[ 0.510383] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.514510] PCI host bridge to bus 0000:00
[ 0.515897] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.517773] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.518384] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.520626] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[ 0.522376] pci_bus 0000:00: root bus resource [mem 0x240000000-0x2bfffffff window]
[ 0.524727] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.526467] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[ 0.528867] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[ 0.531102] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[ 0.538135] pci 0000:00:01.1: reg 0x20: [io 0xc040-0xc04f]
[ 0.540698] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 0.542379] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 0.543963] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 0.545655] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 0.546755] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[ 0.548643] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 0.550385] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 0.552601] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000
[ 0.555589] pci 0000:00:02.0: reg 0x10: [mem 0xfd000000-0xfdffffff pref]
[ 0.561803] pci 0000:00:02.0: reg 0x18: [mem 0xfebf0000-0xfebf0fff]
[ 0.570385] pci 0000:00:02.0: reg 0x30: [mem 0xfebe0000-0xfebeffff pref]
[ 0.572428] pci 0000:00:03.0: [8086:100e] type 00 class 0x020000
[ 0.576003] pci 0000:00:03.0: reg 0x10: [mem 0xfebc0000-0xfebdffff]
[ 0.578376] pci 0000:00:03.0: reg 0x14: [io 0xc000-0xc03f]
[ 0.587065] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
[ 0.589175] pci 0000:00:04.0: [8086:25ab] type 00 class 0x088000
[ 0.591175] pci 0000:00:04.0: reg 0x10: [mem 0xfebf1000-0xfebf100f]
[ 0.598132] pci_bus 0000:00: on NUMA node 0
[ 0.598944] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 0.600517] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 0.602003] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 0.602541] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 0.603990] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[ 0.605727] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[ 0.606376] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 0.608431] pci 0000:00:02.0: vgaarb: bridge control possible
[ 0.609836] vgaarb: loaded
[ 0.610624] PCI: Using ACPI for IRQ routing
[ 0.611776] PCI: pci_cache_line_size set to 64 bytes
[ 0.614517] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[ 0.615956] e820: reserve RAM buffer [mem 0xbffe0000-0xbfffffff]
[ 0.617634] clocksource: Switched to clocksource kvm-clock
[ 0.617634] pnp: PnP ACPI init
[ 0.617634] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 0.618508] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[ 0.619744] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
[ 0.619744] pnp 00:03: [dma 2]
[ 0.622628] pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active)
[ 0.624285] pnp 00:04: Plug and Play ACPI device, IDs PNP0400 (active)
[ 0.625890] pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
[ 0.627587] pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active)
[ 0.629431] pnp: PnP ACPI: found 7 devices
[ 0.637471] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc5-00023-g502aa8ade32a .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 7 months
[locking/rwsem] 25d0c60b0e: vm-scalability.throughput 316.2% improvement
by kernel test robot
Greeting,
FYI, we noticed a 316.2% improvement of vm-scalability.throughput due to commit:
commit: 25d0c60b0e409c6c69f7192516ccdb7bcb505c19 ("[PATCH v2 2/5] locking/rwsem: Prevent potential lock starvation")
url: https://github.com/0day-ci/linux/commits/Waiman-Long/locking-rwsem-Rework...
base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git 932f8c64d38bb08f69c8c26a2216ba0c36c6daa8
in testcase: vm-scalability
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
runtime: 300s
test: small-allocs-mt
cpufreq_governor: performance
ucode: 0x5003003
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap4/small-allocs-mt/vm-scalability/0x5003003
commit:
8348c157e0 ("locking/rwsem: Pass the current atomic count to rwsem_down_read_slowpath()")
25d0c60b0e ("locking/rwsem: Prevent potential lock starvation")
8348c157e07d3544 25d0c60b0e409c6c69f7192516c
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 5% 0:4 perf-profile.children.cycles-pp.error_return
0:4 32% 1:4 perf-profile.children.cycles-pp.error_entry
:4 12% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
1196 ± 2% +316.4% 4981 ± 8% vm-scalability.median
667.71 ± 6% -639.9 27.79 ± 44% vm-scalability.stddev%
229812 ± 2% +316.2% 956546 ± 8% vm-scalability.throughput
302.81 +1.8% 308.20 vm-scalability.time.elapsed_time
302.81 +1.8% 308.20 vm-scalability.time.elapsed_time.max
4115 +52.5% 6276 ± 35% vm-scalability.time.maximum_resident_set_size
15368012 ± 2% +315.4% 63837201 ± 8% vm-scalability.time.minor_page_faults
1061 ± 4% -60.1% 423.50 ± 6% vm-scalability.time.percent_of_cpu_this_job_got
3182 ± 4% -69.2% 978.79 ± 9% vm-scalability.time.system_time
33.47 ± 2% +878.4% 327.44 ± 4% vm-scalability.time.user_time
5953763 ± 3% +919.5% 60697236 ± 11% vm-scalability.time.voluntary_context_switches
69123365 ± 2% +315.5% 2.872e+08 ± 8% vm-scalability.workload
4.365e+08 ±150% -91.6% 36710725 ± 9% cpuidle.C1.time
2830867 ±112% -88.9% 315177 ± 9% cpuidle.POLL.usage
1.05 ± 6% +0.5 1.55 ± 7% mpstat.cpu.all.irq%
0.09 ± 4% +0.0 0.12 ± 13% mpstat.cpu.all.soft%
5.48 ± 4% -4.0 1.50 ± 12% mpstat.cpu.all.sys%
0.08 ± 2% +0.4 0.51 mpstat.cpu.all.usr%
92.75 +3.5% 96.00 vmstat.cpu.id
9.50 ± 11% -65.8% 3.25 ± 13% vmstat.procs.r
41257 ± 3% +846.0% 390307 ± 11% vmstat.system.cs
366656 ± 4% +6.5% 390355 vmstat.system.in
16646 ± 5% -27.9% 12003 meminfo.Active
16551 ± 5% -28.1% 11908 meminfo.Active(anon)
2917185 +22.4% 3570846 ± 2% meminfo.Memused
64381 +296.8% 255438 ± 8% meminfo.PageTables
442782 +116.3% 957779 ± 5% meminfo.SUnreclaim
566580 +90.2% 1077629 ± 5% meminfo.Slab
11471 +20.3% 13802 ± 3% meminfo.max_used_kB
4008 ± 3% +323.4% 16970 ± 11% numa-vmstat.node0.nr_page_table_pages
33153 ± 6% +105.0% 67963 ± 12% numa-vmstat.node0.nr_slab_unreclaimable
3967 ± 7% +296.6% 15734 ± 8% numa-vmstat.node1.nr_page_table_pages
26111 ± 9% +122.1% 57979 ± 3% numa-vmstat.node1.nr_slab_unreclaimable
2352 ± 30% -34.3% 1545 ± 3% numa-vmstat.node2.nr_mapped
4198 ± 9% +263.5% 15262 ± 12% numa-vmstat.node2.nr_page_table_pages
26562 ± 4% +109.3% 55584 ± 11% numa-vmstat.node2.nr_slab_unreclaimable
66550 ± 3% -6.9% 61940 ± 5% numa-vmstat.node2.nr_unevictable
66550 ± 3% -6.9% 61940 ± 5% numa-vmstat.node2.nr_zone_unevictable
2376 ± 20% -57.8% 1002 ± 15% numa-vmstat.node3.nr_active_anon
3906 ± 4% +306.9% 15894 ± 15% numa-vmstat.node3.nr_page_table_pages
8765 ±112% -81.6% 1609 ± 50% numa-vmstat.node3.nr_shmem
24897 +132.5% 57880 ± 10% numa-vmstat.node3.nr_slab_unreclaimable
2376 ± 20% -57.8% 1002 ± 15% numa-vmstat.node3.nr_zone_active_anon
4134 ± 5% -28.0% 2975 proc-vmstat.nr_active_anon
16125 +296.5% 63929 ± 8% proc-vmstat.nr_page_table_pages
30303 -3.8% 29143 proc-vmstat.nr_shmem
30948 -3.2% 29962 ± 3% proc-vmstat.nr_slab_reclaimable
110703 +116.3% 239400 ± 5% proc-vmstat.nr_slab_unreclaimable
4134 ± 5% -28.0% 2975 proc-vmstat.nr_zone_active_anon
1106323 +19.2% 1319145 ± 2% proc-vmstat.numa_hit
1013157 +21.0% 1225906 ± 2% proc-vmstat.numa_local
15861 ± 24% +39.2% 22071 ± 19% proc-vmstat.numa_pages_migrated
5504 ± 9% -43.7% 3096 ± 5% proc-vmstat.pgactivate
1227807 +28.8% 1581875 ± 2% proc-vmstat.pgalloc_normal
16526250 ± 2% +293.4% 65015954 ± 8% proc-vmstat.pgfault
1341677 +26.8% 1700733 ± 2% proc-vmstat.pgfree
15861 ± 24% +39.2% 22071 ± 19% proc-vmstat.pgmigrate_success
776705 ± 2% +32.2% 1026478 ± 17% numa-meminfo.node0.MemUsed
16065 ± 3% +322.6% 67896 ± 11% numa-meminfo.node0.PageTables
132651 ± 6% +104.9% 271835 ± 12% numa-meminfo.node0.SUnreclaim
170726 ± 7% +85.2% 316147 ± 13% numa-meminfo.node0.Slab
15896 ± 7% +296.0% 62943 ± 8% numa-meminfo.node1.PageTables
104481 ± 9% +122.0% 231901 ± 3% numa-meminfo.node1.SUnreclaim
134366 ± 9% +90.7% 256275 ± 4% numa-meminfo.node1.Slab
16837 ± 9% +262.7% 61059 ± 12% numa-meminfo.node2.PageTables
106291 ± 4% +109.1% 222297 ± 11% numa-meminfo.node2.SUnreclaim
137938 ± 7% +82.9% 252310 ± 11% numa-meminfo.node2.Slab
266206 ± 3% -6.9% 247762 ± 5% numa-meminfo.node2.Unevictable
9506 ± 20% -57.9% 4005 ± 16% numa-meminfo.node3.Active
9482 ± 20% -57.8% 4005 ± 16% numa-meminfo.node3.Active(anon)
661218 ± 3% +20.6% 797250 ± 4% numa-meminfo.node3.MemUsed
15657 ± 4% +306.3% 63614 ± 16% numa-meminfo.node3.PageTables
99634 +132.4% 231507 ± 10% numa-meminfo.node3.SUnreclaim
35078 ±112% -81.7% 6436 ± 50% numa-meminfo.node3.Shmem
123833 ± 6% +104.0% 252657 ± 9% numa-meminfo.node3.Slab
2885 ± 6% -16.3% 2414 ± 13% slabinfo.PING.active_objs
2885 ± 6% -16.3% 2414 ± 13% slabinfo.PING.num_objs
2267 ± 13% -30.6% 1573 ± 11% slabinfo.dmaengine-unmap-16.active_objs
2267 ± 13% -30.6% 1573 ± 11% slabinfo.dmaengine-unmap-16.num_objs
8926 ± 15% -31.4% 6125 ± 23% slabinfo.eventpoll_pwq.active_objs
8926 ± 15% -31.4% 6125 ± 23% slabinfo.eventpoll_pwq.num_objs
45756 +131.7% 106013 ± 6% slabinfo.kmalloc-512.active_objs
717.75 ± 2% +131.5% 1661 ± 6% slabinfo.kmalloc-512.active_slabs
45974 ± 2% +131.3% 106345 ± 6% slabinfo.kmalloc-512.num_objs
717.75 ± 2% +131.5% 1661 ± 6% slabinfo.kmalloc-512.num_slabs
3927 ± 6% -14.6% 3352 ± 5% slabinfo.kmalloc-rcl-512.active_objs
3927 ± 6% -14.6% 3352 ± 5% slabinfo.kmalloc-rcl-512.num_objs
16128 ± 7% -14.1% 13859 ± 15% slabinfo.pde_opener.active_objs
16128 ± 7% -14.1% 13859 ± 15% slabinfo.pde_opener.num_objs
13844 ± 2% -12.8% 12071 ± 10% slabinfo.pid.active_objs
13844 ± 2% -12.8% 12071 ± 10% slabinfo.pid.num_objs
767484 +321.9% 3238091 ± 8% slabinfo.vm_area_struct.active_objs
19187 +321.9% 80952 ± 8% slabinfo.vm_area_struct.active_slabs
767502 +321.9% 3238131 ± 8% slabinfo.vm_area_struct.num_objs
19187 +321.9% 80952 ± 8% slabinfo.vm_area_struct.num_slabs
7603 ± 14% -61.5% 2927 ± 8% sched_debug.cfs_rq:/.exec_clock.avg
10612 ± 11% -44.5% 5886 ± 5% sched_debug.cfs_rq:/.exec_clock.max
4793 ± 20% -53.3% 2237 ± 9% sched_debug.cfs_rq:/.exec_clock.min
809.62 ± 4% -51.2% 395.20 ± 18% sched_debug.cfs_rq:/.exec_clock.stddev
6538 ± 17% +29.4% 8463 ± 7% sched_debug.cfs_rq:/.load.avg
30298 ± 35% +56.1% 47283 ± 15% sched_debug.cfs_rq:/.load.stddev
141173 ± 9% -72.2% 39255 ± 12% sched_debug.cfs_rq:/.min_vruntime.avg
181613 ± 9% -66.7% 60537 ± 8% sched_debug.cfs_rq:/.min_vruntime.max
96324 ± 13% -71.6% 27369 ± 15% sched_debug.cfs_rq:/.min_vruntime.min
13658 ± 4% -66.0% 4644 ± 9% sched_debug.cfs_rq:/.min_vruntime.stddev
77.48 ± 17% -52.2% 37.03 ± 5% sched_debug.cfs_rq:/.runnable_avg.avg
856.14 ± 5% -15.2% 726.07 ± 4% sched_debug.cfs_rq:/.runnable_avg.max
164.08 ± 11% -49.2% 83.31 ± 2% sched_debug.cfs_rq:/.runnable_avg.stddev
32899 ± 56% -102.8% -928.20 sched_debug.cfs_rq:/.spread0.avg
73337 ± 24% -72.2% 20391 ± 20% sched_debug.cfs_rq:/.spread0.max
13662 ± 4% -66.0% 4646 ± 9% sched_debug.cfs_rq:/.spread0.stddev
77.42 ± 17% -52.3% 36.89 ± 5% sched_debug.cfs_rq:/.util_avg.avg
856.08 ± 5% -15.2% 726.02 ± 4% sched_debug.cfs_rq:/.util_avg.max
164.05 ± 11% -49.2% 83.28 ± 2% sched_debug.cfs_rq:/.util_avg.stddev
8.55 ± 38% -66.6% 2.85 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.avg
448.67 ± 18% -39.0% 273.87 ± 22% sched_debug.cfs_rq:/.util_est_enqueued.max
48.86 ± 26% -52.5% 23.20 ± 19% sched_debug.cfs_rq:/.util_est_enqueued.stddev
16762 ± 43% +455.0% 93037 ± 37% sched_debug.cpu.avg_idle.min
214208 ± 7% -16.2% 179508 ± 5% sched_debug.cpu.avg_idle.stddev
0.00 ± 20% -22.1% 0.00 ± 18% sched_debug.cpu.next_balance.stddev
30943 ± 13% +781.2% 272691 ± 17% sched_debug.cpu.nr_switches.avg
47808 ± 11% +554.7% 312982 ± 16% sched_debug.cpu.nr_switches.max
23676 ± 15% +755.2% 202476 ± 17% sched_debug.cpu.nr_switches.min
3440 ± 8% +606.4% 24301 ± 60% sched_debug.cpu.nr_switches.stddev
-34.81 -45.2% -19.06 sched_debug.cpu.nr_uninterruptible.min
29514 ± 13% +818.5% 271089 ± 17% sched_debug.cpu.sched_count.avg
44064 ± 13% +601.9% 309272 ± 16% sched_debug.cpu.sched_count.max
21857 ± 20% +797.1% 196073 ± 17% sched_debug.cpu.sched_count.min
3214 ± 8% +652.7% 24196 ± 60% sched_debug.cpu.sched_count.stddev
14584 ± 13% +828.8% 135457 ± 17% sched_debug.cpu.sched_goidle.avg
21841 ± 13% +607.6% 154542 ± 16% sched_debug.cpu.sched_goidle.max
10794 ± 20% +808.0% 98017 ± 17% sched_debug.cpu.sched_goidle.min
1588 ± 8% +661.3% 12090 ± 60% sched_debug.cpu.sched_goidle.stddev
14867 ± 14% +820.7% 136878 ± 17% sched_debug.cpu.ttwu_count.avg
22737 ± 19% +615.8% 162759 ± 17% sched_debug.cpu.ttwu_count.max
11312 ± 16% +771.4% 98581 ± 18% sched_debug.cpu.ttwu_count.min
1545 ± 11% +774.9% 13523 ± 50% sched_debug.cpu.ttwu_count.stddev
433.61 ± 12% -12.6% 378.89 ± 10% sched_debug.cpu.ttwu_local.avg
199.16 ± 26% -44.0% 111.58 ± 9% sched_debug.cpu.ttwu_local.stddev
3.36 ± 37% +294.6% 13.26 ± 61% perf-stat.i.MPKI
2.787e+09 ± 2% -30.6% 1.934e+09 ± 7% perf-stat.i.branch-instructions
0.42 ± 27% +0.7 1.07 ± 54% perf-stat.i.branch-miss-rate%
11297054 ± 25% +77.2% 20022864 ± 42% perf-stat.i.branch-misses
7444899 ± 4% +203.2% 22572633 ± 14% perf-stat.i.cache-misses
38212772 ± 35% +138.7% 91225234 ± 50% perf-stat.i.cache-references
41651 ± 3% +848.9% 395217 ± 11% perf-stat.i.context-switches
3.36 -37.5% 2.10 ± 14% perf-stat.i.cpi
4.162e+10 ± 2% -64.1% 1.493e+10 ± 6% perf-stat.i.cpu-cycles
1531 ± 4% -46.5% 819.49 ± 12% perf-stat.i.cpu-migrations
5753 ± 5% -88.0% 692.05 ± 23% perf-stat.i.cycles-between-cache-misses
0.03 ± 59% +0.1 0.15 ± 80% perf-stat.i.dTLB-load-miss-rate%
875229 ± 57% +224.4% 2839103 ± 69% perf-stat.i.dTLB-load-misses
3.169e+09 ± 3% -36.2% 2.021e+09 ± 6% perf-stat.i.dTLB-loads
133897 ± 45% +149.2% 333711 ± 35% perf-stat.i.dTLB-store-misses
4.066e+08 +79.3% 7.29e+08 ± 6% perf-stat.i.dTLB-stores
3558573 ± 6% +62.5% 5780994 ± 13% perf-stat.i.iTLB-load-misses
3514690 ± 11% +79.5% 6307992 perf-stat.i.iTLB-loads
1.24e+10 ± 2% -41.0% 7.316e+09 ± 6% perf-stat.i.instructions
3491 ± 7% -63.6% 1272 ± 7% perf-stat.i.instructions-per-iTLB-miss
0.30 +64.4% 0.49 ± 12% perf-stat.i.ipc
0.22 ± 2% -64.1% 0.08 ± 6% perf-stat.i.metric.GHz
33.37 ± 2% -25.2% 24.97 ± 5% perf-stat.i.metric.M/sec
54265 ± 2% +287.6% 210321 ± 8% perf-stat.i.minor-faults
93.72 +2.4 96.10 perf-stat.i.node-load-miss-rate%
1995262 +359.9% 9176181 ± 12% perf-stat.i.node-load-misses
138913 +169.7% 374605 ± 21% perf-stat.i.node-loads
731327 ± 3% +296.3% 2898344 ± 3% perf-stat.i.node-store-misses
23737 ± 30% +125.9% 53622 ± 12% perf-stat.i.node-stores
54266 ± 2% +287.6% 210321 ± 8% perf-stat.i.page-faults
3.07 ± 34% +323.2% 13.01 ± 60% perf-stat.overall.MPKI
0.41 ± 24% +0.7 1.08 ± 52% perf-stat.overall.branch-miss-rate%
3.36 -38.6% 2.06 ± 14% perf-stat.overall.cpi
5597 ± 5% -87.7% 685.84 ± 23% perf-stat.overall.cycles-between-cache-misses
0.03 ± 56% +0.1 0.15 ± 78% perf-stat.overall.dTLB-load-miss-rate%
3499 ± 7% -63.4% 1279 ± 7% perf-stat.overall.instructions-per-iTLB-miss
0.30 +65.6% 0.49 ± 12% perf-stat.overall.ipc
93.47 +2.6 96.10 perf-stat.overall.node-load-miss-rate%
54516 -85.5% 7894 perf-stat.overall.path-length
2.778e+09 ± 2% -30.7% 1.925e+09 ± 7% perf-stat.ps.branch-instructions
11269337 ± 25% +76.9% 19937196 ± 42% perf-stat.ps.branch-misses
7422896 ± 4% +202.7% 22465714 ± 14% perf-stat.ps.cache-misses
38100277 ± 35% +138.4% 90838247 ± 50% perf-stat.ps.cache-references
41502 ± 3% +846.6% 392864 ± 11% perf-stat.ps.context-switches
4.147e+10 ± 2% -64.1% 1.488e+10 ± 6% perf-stat.ps.cpu-cycles
1526 ± 4% -46.5% 816.01 ± 12% perf-stat.ps.cpu-migrations
872505 ± 57% +223.8% 2824945 ± 69% perf-stat.ps.dTLB-load-misses
3.158e+09 ± 3% -36.3% 2.012e+09 ± 6% perf-stat.ps.dTLB-loads
133483 ± 45% +148.8% 332159 ± 35% perf-stat.ps.dTLB-store-misses
4.054e+08 +79.1% 7.261e+08 ± 6% perf-stat.ps.dTLB-stores
3546688 ± 6% +62.2% 5754354 ± 13% perf-stat.ps.iTLB-load-misses
3502780 ± 11% +79.2% 6277848 perf-stat.ps.iTLB-loads
1.236e+10 ± 2% -41.0% 7.285e+09 ± 6% perf-stat.ps.instructions
54072 ± 2% +286.7% 209072 ± 8% perf-stat.ps.minor-faults
1989790 +359.0% 9132656 ± 12% perf-stat.ps.node-load-misses
138874 +169.9% 374856 ± 21% perf-stat.ps.node-loads
728929 ± 3% +295.3% 2881399 ± 3% perf-stat.ps.node-store-misses
23693 ± 30% +125.5% 53429 ± 12% perf-stat.ps.node-stores
54073 ± 2% +286.7% 209073 ± 8% perf-stat.ps.page-faults
3.768e+12 ± 2% -39.9% 2.264e+12 ± 7% perf-stat.total.instructions
13031 ± 16% +130.4% 30021 ± 8% softirqs.CPU0.RCU
9723 ± 8% +195.3% 28709 ± 10% softirqs.CPU1.RCU
9955 ± 9% +184.5% 28324 ± 10% softirqs.CPU10.RCU
9190 ± 7% +205.9% 28113 ± 14% softirqs.CPU100.RCU
9262 ± 6% +196.5% 27467 ± 13% softirqs.CPU101.RCU
9274 ± 8% +210.9% 28833 ± 11% softirqs.CPU102.RCU
9198 ± 8% +210.3% 28546 ± 11% softirqs.CPU103.RCU
9420 ± 5% +207.0% 28918 ± 10% softirqs.CPU104.RCU
9224 ± 6% +213.7% 28939 ± 9% softirqs.CPU105.RCU
9136 ± 6% +208.8% 28218 ± 10% softirqs.CPU106.RCU
9148 ± 10% +215.1% 28821 ± 11% softirqs.CPU107.RCU
9377 ± 8% +206.1% 28699 ± 11% softirqs.CPU108.RCU
9284 ± 6% +209.2% 28704 ± 12% softirqs.CPU109.RCU
9468 ± 16% +199.1% 28321 ± 13% softirqs.CPU11.RCU
9361 ± 6% +209.2% 28949 ± 11% softirqs.CPU110.RCU
9191 ± 6% +210.7% 28557 ± 12% softirqs.CPU111.RCU
9100 ± 8% +194.7% 26820 ± 11% softirqs.CPU112.RCU
9126 ± 4% +194.0% 26832 ± 11% softirqs.CPU113.RCU
9215 ± 7% +195.5% 27232 ± 11% softirqs.CPU114.RCU
8951 ± 5% +203.3% 27147 ± 8% softirqs.CPU115.RCU
9168 ± 7% +189.1% 26503 ± 9% softirqs.CPU116.RCU
9291 ± 5% +189.7% 26921 ± 10% softirqs.CPU117.RCU
9100 ± 6% +195.1% 26853 ± 11% softirqs.CPU118.RCU
9607 ± 7% +178.2% 26726 ± 10% softirqs.CPU119.RCU
9434 ± 6% +197.1% 28032 ± 11% softirqs.CPU12.RCU
9329 ± 6% +189.6% 27019 ± 10% softirqs.CPU120.RCU
9168 ± 6% +190.8% 26657 ± 10% softirqs.CPU121.RCU
9302 ± 6% +184.7% 26483 ± 10% softirqs.CPU122.RCU
9348 ± 6% +187.2% 26845 ± 11% softirqs.CPU123.RCU
9429 ± 5% +184.1% 26786 ± 11% softirqs.CPU124.RCU
9351 ± 7% +176.9% 25893 ± 11% softirqs.CPU125.RCU
9160 ± 6% +189.7% 26536 ± 9% softirqs.CPU126.RCU
9265 ± 7% +187.9% 26671 ± 10% softirqs.CPU127.RCU
9401 ± 6% +203.9% 28570 ± 9% softirqs.CPU128.RCU
9895 ± 11% +187.2% 28415 ± 9% softirqs.CPU129.RCU
9238 ± 5% +208.7% 28520 ± 9% softirqs.CPU13.RCU
9430 ± 6% +203.2% 28594 ± 9% softirqs.CPU130.RCU
9585 ± 7% +201.9% 28935 ± 10% softirqs.CPU131.RCU
9616 ± 5% +203.5% 29185 ± 9% softirqs.CPU132.RCU
9811 ± 6% +193.2% 28761 ± 10% softirqs.CPU133.RCU
9600 ± 7% +196.3% 28448 ± 8% softirqs.CPU134.RCU
9442 ± 6% +202.4% 28550 ± 9% softirqs.CPU135.RCU
9705 ± 9% +200.1% 29131 ± 10% softirqs.CPU136.RCU
9556 ± 7% +204.3% 29081 ± 10% softirqs.CPU137.RCU
9558 ± 7% +204.2% 29078 ± 9% softirqs.CPU138.RCU
9434 ± 7% +202.0% 28489 ± 10% softirqs.CPU139.RCU
9874 ± 3% +191.2% 28755 ± 12% softirqs.CPU14.RCU
9499 ± 6% +204.0% 28877 ± 9% softirqs.CPU140.RCU
9491 ± 7% +205.4% 28989 ± 10% softirqs.CPU141.RCU
9479 ± 9% +198.9% 28336 ± 9% softirqs.CPU142.RCU
9923 ± 6% +193.8% 29153 ± 10% softirqs.CPU143.RCU
9412 ± 7% +225.2% 30610 ± 8% softirqs.CPU144.RCU
9173 ± 6% +219.0% 29263 ± 10% softirqs.CPU145.RCU
9452 ± 6% +212.5% 29540 ± 10% softirqs.CPU146.RCU
9542 ± 6% +207.5% 29342 ± 10% softirqs.CPU147.RCU
9624 ± 6% +203.0% 29158 ± 9% softirqs.CPU148.RCU
9559 ± 7% +212.1% 29835 ± 9% softirqs.CPU149.RCU
9461 ± 7% +204.7% 28826 ± 11% softirqs.CPU15.RCU
9513 ± 6% +215.6% 30027 ± 10% softirqs.CPU150.RCU
9452 ± 8% +211.6% 29450 ± 10% softirqs.CPU151.RCU
9427 ± 8% +211.2% 29335 ± 11% softirqs.CPU152.RCU
9778 ± 10% +203.4% 29667 ± 11% softirqs.CPU153.RCU
9480 ± 6% +217.0% 30049 ± 10% softirqs.CPU154.RCU
9452 ± 7% +213.0% 29587 ± 10% softirqs.CPU155.RCU
9299 ± 6% +215.5% 29338 ± 10% softirqs.CPU156.RCU
9307 ± 6% +215.3% 29350 ± 9% softirqs.CPU157.RCU
9360 ± 7% +216.2% 29602 ± 10% softirqs.CPU158.RCU
9369 ± 6% +215.8% 29586 ± 10% softirqs.CPU159.RCU
9377 ± 6% +187.5% 26962 ± 11% softirqs.CPU16.RCU
9384 ± 8% +190.0% 27211 ± 10% softirqs.CPU160.RCU
9247 ± 7% +198.5% 27603 ± 10% softirqs.CPU161.RCU
9019 ± 9% +200.6% 27110 ± 9% softirqs.CPU162.RCU
9284 ± 8% +196.0% 27476 ± 11% softirqs.CPU163.RCU
9165 ± 7% +197.5% 27267 ± 10% softirqs.CPU164.RCU
9161 ± 8% +195.7% 27087 ± 10% softirqs.CPU165.RCU
9418 ± 9% +195.1% 27790 ± 11% softirqs.CPU166.RCU
9416 ± 9% +193.6% 27650 ± 10% softirqs.CPU167.RCU
8764 ± 6% +207.6% 26959 ± 9% softirqs.CPU168.RCU
8764 ± 7% +201.5% 26420 ± 9% softirqs.CPU169.RCU
9672 ± 4% +180.0% 27084 ± 11% softirqs.CPU17.RCU
8704 ± 6% +201.9% 26276 ± 9% softirqs.CPU170.RCU
8775 ± 6% +200.9% 26407 ± 9% softirqs.CPU171.RCU
8878 ± 7% +192.4% 25956 ± 9% softirqs.CPU172.RCU
8851 ± 9% +200.1% 26562 ± 9% softirqs.CPU173.RCU
8764 ± 6% +202.9% 26546 ± 9% softirqs.CPU174.RCU
8850 ± 6% +201.7% 26704 ± 9% softirqs.CPU175.RCU
8943 ± 7% +223.5% 28932 ± 8% softirqs.CPU176.RCU
8949 ± 8% +218.6% 28508 ± 8% softirqs.CPU177.RCU
8906 ± 8% +224.6% 28910 ± 10% softirqs.CPU178.RCU
8947 ± 8% +223.0% 28898 ± 10% softirqs.CPU179.RCU
9371 ± 5% +191.2% 27292 ± 11% softirqs.CPU18.RCU
8808 ± 8% +225.7% 28685 ± 10% softirqs.CPU180.RCU
8764 ± 7% +222.6% 28277 ± 10% softirqs.CPU181.RCU
8905 ± 8% +221.8% 28660 ± 9% softirqs.CPU182.RCU
8986 ± 7% +219.2% 28687 ± 9% softirqs.CPU183.RCU
8950 ± 8% +225.4% 29123 ± 10% softirqs.CPU184.RCU
9082 ± 7% +213.8% 28499 ± 9% softirqs.CPU185.RCU
8929 ± 7% +223.2% 28861 ± 8% softirqs.CPU186.RCU
9052 ± 9% +223.4% 29276 ± 9% softirqs.CPU187.RCU
8956 ± 7% +221.6% 28806 ± 10% softirqs.CPU188.RCU
8887 ± 8% +222.4% 28653 ± 9% softirqs.CPU189.RCU
9372 ± 6% +185.8% 26783 ± 11% softirqs.CPU19.RCU
8966 ± 8% +219.6% 28659 ± 9% softirqs.CPU190.RCU
8864 ± 7% +222.5% 28584 ± 10% softirqs.CPU191.RCU
9523 ± 6% +205.0% 29042 ± 11% softirqs.CPU2.RCU
9389 ± 4% +183.1% 26577 ± 9% softirqs.CPU20.RCU
9594 ± 4% +181.8% 27042 ± 10% softirqs.CPU21.RCU
9492 ± 7% +184.4% 26998 ± 11% softirqs.CPU22.RCU
9330 ± 5% +190.5% 27101 ± 10% softirqs.CPU23.RCU
9717 ± 7% +180.1% 27214 ± 11% softirqs.CPU24.RCU
9250 ± 6% +186.9% 26543 ± 10% softirqs.CPU25.RCU
9547 ± 6% +175.0% 26250 ± 10% softirqs.CPU26.RCU
9477 ± 6% +183.0% 26825 ± 10% softirqs.CPU27.RCU
9565 ± 5% +178.4% 26635 ± 10% softirqs.CPU28.RCU
9512 ± 6% +176.1% 26261 ± 12% softirqs.CPU29.RCU
9562 ± 6% +212.1% 29846 ± 13% softirqs.CPU3.RCU
9942 ± 7% +168.2% 26667 ± 10% softirqs.CPU30.RCU
9436 ± 6% +181.7% 26583 ± 10% softirqs.CPU31.RCU
9846 ± 6% +193.7% 28920 ± 9% softirqs.CPU32.RCU
9677 ± 6% +189.1% 27977 ± 9% softirqs.CPU33.RCU
9964 ± 4% +189.9% 28883 ± 9% softirqs.CPU34.RCU
9900 ± 6% +194.2% 29129 ± 10% softirqs.CPU35.RCU
9928 ± 6% +195.2% 29310 ± 9% softirqs.CPU36.RCU
9678 ± 6% +198.7% 28911 ± 10% softirqs.CPU37.RCU
9788 ± 5% +192.5% 28631 ± 8% softirqs.CPU38.RCU
9702 ± 6% +192.4% 28367 ± 9% softirqs.CPU39.RCU
9581 ± 7% +193.3% 28106 ± 17% softirqs.CPU4.RCU
9943 ± 7% +192.1% 29041 ± 10% softirqs.CPU40.RCU
9909 ± 5% +195.7% 29301 ± 9% softirqs.CPU41.RCU
9861 ± 6% +197.7% 29353 ± 9% softirqs.CPU42.RCU
9850 ± 6% +195.0% 29055 ± 9% softirqs.CPU43.RCU
9714 ± 5% +197.9% 28934 ± 10% softirqs.CPU44.RCU
9853 ± 5% +193.2% 28894 ± 10% softirqs.CPU45.RCU
9750 ± 6% +187.3% 28016 ± 10% softirqs.CPU46.RCU
9926 ± 6% +194.2% 29199 ± 10% softirqs.CPU47.RCU
9823 ± 7% +209.3% 30385 ± 9% softirqs.CPU48.RCU
10388 ± 23% +179.6% 29047 ± 10% softirqs.CPU49.RCU
9575 ± 7% +196.1% 28351 ± 11% softirqs.CPU5.RCU
9873 ± 8% +199.2% 29537 ± 10% softirqs.CPU50.RCU
9980 ± 6% +200.7% 30010 ± 10% softirqs.CPU51.RCU
10115 ± 6% +194.6% 29797 ± 10% softirqs.CPU52.RCU
10001 ± 8% +203.1% 30318 ± 9% softirqs.CPU53.RCU
9707 ± 6% +215.4% 30615 ± 10% softirqs.CPU54.RCU
9804 ± 7% +205.9% 29995 ± 10% softirqs.CPU55.RCU
9695 ± 7% +205.4% 29610 ± 10% softirqs.CPU56.RCU
9824 ± 5% +199.4% 29412 ± 10% softirqs.CPU57.RCU
10110 ± 5% +196.6% 29987 ± 10% softirqs.CPU58.RCU
10778 ± 12% +179.8% 30154 ± 8% softirqs.CPU59.RCU
9646 ± 5% +198.1% 28755 ± 11% softirqs.CPU6.RCU
9749 ± 5% +215.3% 30737 ± 11% softirqs.CPU60.RCU
9617 ± 6% +209.9% 29805 ± 9% softirqs.CPU61.RCU
10466 ± 6% +181.8% 29497 ± 10% softirqs.CPU62.RCU
9682 ± 7% +206.8% 29706 ± 10% softirqs.CPU63.RCU
9892 ± 12% +182.7% 27967 ± 9% softirqs.CPU64.RCU
9929 ± 5% +181.0% 27902 ± 10% softirqs.CPU65.RCU
9763 ± 5% +185.7% 27889 ± 11% softirqs.CPU66.RCU
9671 ± 4% +187.6% 27812 ± 10% softirqs.CPU67.RCU
9612 ± 7% +191.9% 28059 ± 11% softirqs.CPU68.RCU
9586 ± 7% +186.9% 27506 ± 10% softirqs.CPU69.RCU
9531 ± 7% +200.8% 28668 ± 12% softirqs.CPU7.RCU
9803 ± 4% +185.8% 28018 ± 10% softirqs.CPU70.RCU
9494 ± 7% +193.4% 27856 ± 10% softirqs.CPU71.RCU
9245 ± 7% +195.7% 27334 ± 10% softirqs.CPU72.RCU
9106 ± 6% +195.0% 26861 ± 10% softirqs.CPU73.RCU
9150 ± 7% +193.8% 26883 ± 9% softirqs.CPU74.RCU
9181 ± 7% +202.9% 27806 ± 13% softirqs.CPU75.RCU
9080 ± 7% +196.4% 26916 ± 9% softirqs.CPU76.RCU
9098 ± 7% +194.3% 26772 ± 9% softirqs.CPU77.RCU
9200 ± 7% +193.7% 27024 ± 9% softirqs.CPU78.RCU
9149 ± 6% +196.5% 27132 ± 9% softirqs.CPU79.RCU
9495 ± 6% +203.1% 28784 ± 11% softirqs.CPU8.RCU
9497 ± 8% +203.2% 28794 ± 9% softirqs.CPU80.RCU
9232 ± 7% +210.7% 28682 ± 8% softirqs.CPU81.RCU
9316 ± 8% +211.3% 29003 ± 10% softirqs.CPU82.RCU
9212 ± 8% +215.6% 29077 ± 10% softirqs.CPU83.RCU
9107 ± 6% +212.7% 28482 ± 9% softirqs.CPU84.RCU
9086 ± 6% +213.5% 28481 ± 10% softirqs.CPU85.RCU
9231 ± 7% +212.2% 28819 ± 9% softirqs.CPU86.RCU
9219 ± 7% +211.8% 28743 ± 9% softirqs.CPU87.RCU
9605 ± 7% +202.0% 29009 ± 9% softirqs.CPU88.RCU
9279 ± 8% +210.5% 28816 ± 9% softirqs.CPU89.RCU
9614 ± 7% +195.5% 28407 ± 11% softirqs.CPU9.RCU
9280 ± 8% +209.8% 28749 ± 8% softirqs.CPU90.RCU
9442 ± 10% +209.8% 29249 ± 9% softirqs.CPU91.RCU
9308 ± 7% +210.4% 28897 ± 9% softirqs.CPU92.RCU
9138 ± 7% +213.5% 28648 ± 10% softirqs.CPU93.RCU
9259 ± 7% +213.4% 29016 ± 10% softirqs.CPU94.RCU
9233 ± 7% +214.2% 29010 ± 10% softirqs.CPU95.RCU
9109 ± 7% +201.9% 27499 ± 11% softirqs.CPU96.RCU
9908 ± 11% +187.2% 28454 ± 10% softirqs.CPU97.RCU
9298 ± 6% +213.8% 29181 ± 11% softirqs.CPU98.RCU
9378 ± 7% +208.5% 28930 ± 9% softirqs.CPU99.RCU
1813814 ± 6% +199.9% 5440281 ± 9% softirqs.RCU
60299 ± 2% -15.0% 51225 ± 4% softirqs.TIMER
53.78 ± 5% -53.4 0.34 ±100% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
48.86 ± 5% -48.9 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
54.66 ± 5% -47.9 6.78 ± 19% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
55.11 ± 5% -45.7 9.38 ± 14% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
55.12 ± 5% -45.7 9.42 ± 14% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.do_access
55.19 ± 5% -44.7 10.50 ± 10% perf-profile.calltrace.cycles-pp.asm_exc_page_fault.do_access
55.32 ± 5% -43.5 11.85 ± 9% perf-profile.calltrace.cycles-pp.do_access
3.66 ± 59% -3.7 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
3.66 ± 59% -3.7 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.63 ± 59% -3.6 0.00 perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.62 ± 59% -3.6 0.00 perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.73 ± 20% -3.0 0.76 ± 57% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff
3.95 ± 19% -2.8 1.13 ± 24% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
4.06 ± 19% -1.7 2.33 ± 14% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
4.07 ± 19% -1.7 2.40 ± 13% perf-profile.calltrace.cycles-pp.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.56 ± 9% +0.4 1.00 ± 19% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.00 +0.5 0.53 ± 2% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry
0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault
0.00 +0.6 0.56 ± 14% perf-profile.calltrace.cycles-pp.arch_get_unmapped_area_topdown.get_unmapped_area.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
0.00 +0.6 0.57 perf-profile.calltrace.cycles-pp.unwind_next_frame.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity
0.00 +0.6 0.58 ± 14% perf-profile.calltrace.cycles-pp.get_unmapped_area.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.00 +0.7 0.66 ± 10% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
0.68 ± 14% +0.7 1.36 ± 12% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
0.00 +0.7 0.69 ± 7% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu
0.68 ± 14% +0.7 1.37 ± 11% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +0.7 0.69 ± 14% perf-profile.calltrace.cycles-pp.ttwu_queue_wakelist.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff
0.68 ± 15% +0.7 1.38 ± 11% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +0.7 0.72 ± 8% perf-profile.calltrace.cycles-pp.update_cfs_rq_h_load.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake
0.00 +0.7 0.72 ± 17% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +0.7 0.73 ± 16% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.8 0.76 ± 3% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.00 +0.8 0.77 ± 9% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +0.8 0.79 ± 8% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.rwsem_down_read_slowpath
0.00 +0.8 0.83 ± 2% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
0.00 +0.8 0.84 ± 7% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.78 ± 13% +0.8 1.62 ± 12% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.8 0.85 ± 6% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.42 ± 58% +0.9 1.28 ± 6% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.9 0.89 ± 6% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault
0.28 ±100% +0.9 1.20 ± 9% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.67 ± 12% +0.9 1.59 ± 8% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.00 +0.9 0.93 ± 11% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q
0.00 +1.0 0.97 ± 11% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake
0.00 +1.0 0.97 ± 11% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff
0.00 +1.0 0.97 ± 11% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.70 ± 12% +1.0 1.68 ± 9% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.90 ± 7% +1.0 1.90 ± 10% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +1.0 1.02 ± 9% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff
0.00 +1.1 1.08 ± 6% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
0.00 +1.1 1.10 ± 2% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
0.71 ± 9% +1.1 1.82 ± 5% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.00 +1.2 1.19 ± 2% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate
0.93 ± 13% +1.3 2.23 ± 6% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
1.00 ± 6% +1.3 2.32 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +1.4 1.41 ± 12% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +1.4 1.45 ± 11% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +1.4 1.45 ± 9% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.44 ± 12% +1.9 3.31 ± 6% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.00 +2.0 2.04 ± 4% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending
2.34 ± 25% +2.1 4.48 ± 6% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +2.4 2.35 ± 54% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
0.00 +2.4 2.40 ± 4% perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
0.00 +2.5 2.46 ± 4% perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
0.00 +2.6 2.60 ± 50% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
0.00 +3.1 3.14 ± 3% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle
0.00 +3.5 3.52 ± 12% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff
0.00 +3.5 3.53 ± 3% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle
0.00 +3.5 3.54 ± 3% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry
0.00 +3.6 3.63 ± 12% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
2.53 ± 11% +3.8 6.35 ± 2% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
2.57 ± 11% +3.9 6.47 ± 3% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
2.57 ± 11% +3.9 6.50 ± 3% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +4.1 4.08 ± 2% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +4.2 4.24 ± 12% perf-profile.calltrace.cycles-pp.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +4.5 4.46 ± 2% perf-profile.calltrace.cycles-pp.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +5.1 5.08 ± 7% perf-profile.calltrace.cycles-pp.do_rw_once
4.22 ± 12% +6.0 10.22 ± 3% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
5.61 ± 21% +6.8 12.43 ± 2% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.84 ±173% +7.3 8.15 ± 8% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.84 ±173% +7.4 8.22 ± 8% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.84 ±173% +7.4 8.23 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.84 ±173% +7.4 8.25 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__mmap
0.85 ±173% +7.6 8.40 ± 8% perf-profile.calltrace.cycles-pp.__mmap
29.85 ± 14% +18.6 48.47 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
36.40 ± 10% +26.2 62.55 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
35.61 ± 10% +26.3 61.89 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
39.30 ± 9% +35.2 74.48 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
39.30 ± 9% +35.2 74.54 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
39.30 ± 9% +35.2 74.55 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
39.54 ± 9% +35.3 74.86 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
58.12 ± 6% -56.5 1.65 ± 29% perf-profile.children.cycles-pp.rwsem_optimistic_spin
52.61 ± 6% -51.7 0.89 ± 29% perf-profile.children.cycles-pp.osq_lock
54.66 ± 5% -47.9 6.80 ± 19% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
55.14 ± 5% -45.7 9.45 ± 14% perf-profile.children.cycles-pp.do_user_addr_fault
55.14 ± 5% -45.7 9.48 ± 14% perf-profile.children.cycles-pp.exc_page_fault
55.23 ± 5% -45.0 10.27 ± 12% perf-profile.children.cycles-pp.asm_exc_page_fault
55.54 ± 5% -41.8 13.71 ± 6% perf-profile.children.cycles-pp.do_access
4.06 ± 19% -1.7 2.34 ± 14% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
4.07 ± 19% -1.7 2.40 ± 13% perf-profile.children.cycles-pp.down_write_killable
0.97 ± 9% -0.8 0.15 ± 28% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.vfs_read
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.__calc_delta
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.ksys_read
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.06 ± 17% perf-profile.children.cycles-pp.tick_check_broadcast_expired
0.20 ± 12% +0.1 0.27 ± 11% perf-profile.children.cycles-pp._raw_spin_trylock
0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.__unwind_start
0.03 ±100% +0.1 0.09 ± 11% perf-profile.children.cycles-pp.idle_cpu
0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.delay_tsc
0.01 ±173% +0.1 0.08 ± 13% perf-profile.children.cycles-pp.trigger_load_balance
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.switch_fpu_return
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.in_sched_functions
0.00 +0.1 0.07 ± 22% perf-profile.children.cycles-pp.cpumask_next_and
0.00 +0.1 0.07 ± 34% perf-profile.children.cycles-pp.worker_thread
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.__wrgsbase_inactive
0.12 ± 13% +0.1 0.19 ± 11% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.get_cpu_device
0.00 +0.1 0.08 ± 16% perf-profile.children.cycles-pp.put_prev_task_fair
0.00 +0.1 0.08 ± 30% perf-profile.children.cycles-pp.__hrtimer_get_next_event
0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.tick_nohz_tick_stopped
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.note_gp_changes
0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
0.12 ± 13% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.rb_next
0.00 +0.1 0.09 ± 7% perf-profile.children.cycles-pp.rb_erase
0.00 +0.1 0.09 ± 11% perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
0.00 +0.1 0.09 ± 11% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.01 ±173% +0.1 0.11 ± 13% perf-profile.children.cycles-pp.kthread
0.00 +0.1 0.10 ± 21% perf-profile.children.cycles-pp.is_bpf_text_address
0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.reweight_entity
0.01 ±173% +0.1 0.11 ± 15% perf-profile.children.cycles-pp.ret_from_fork
0.03 ±100% +0.1 0.12 ± 21% perf-profile.children.cycles-pp.timerqueue_del
0.00 +0.1 0.10 ± 7% perf-profile.children.cycles-pp.orc_find
0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.rb_insert_color
0.00 +0.1 0.10 ± 41% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
0.02 ±173% +0.1 0.12 ± 19% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.check_preempt_curr
0.00 +0.1 0.11 ± 20% perf-profile.children.cycles-pp.menu_reflect
0.10 ± 34% +0.1 0.21 ± 45% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.11 ± 31% perf-profile.children.cycles-pp.vm_area_alloc
0.00 +0.1 0.11 ± 14% perf-profile.children.cycles-pp.run_local_timers
0.00 +0.1 0.11 ± 13% perf-profile.children.cycles-pp.wake_q_add
0.00 +0.1 0.11 ± 23% perf-profile.children.cycles-pp.perf_event_mmap
0.00 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.call_cpuidle
0.03 ±100% +0.1 0.15 ± 21% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.1 0.12 ± 25% perf-profile.children.cycles-pp.kmem_cache_alloc
0.03 ±100% +0.1 0.15 ± 23% perf-profile.children.cycles-pp.timerqueue_add
0.07 ± 20% +0.1 0.20 ± 11% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.00 +0.1 0.13 ± 12% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.00 +0.1 0.13 ± 35% perf-profile.children.cycles-pp.io_serial_in
0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.00 +0.1 0.14 ± 12% perf-profile.children.cycles-pp.__perf_sw_event
0.03 ±100% +0.1 0.16 ± 18% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.1 0.14 ± 30% perf-profile.children.cycles-pp.vmacache_find
0.03 ±100% +0.1 0.17 ± 14% perf-profile.children.cycles-pp.rcu_eqs_exit
0.00 +0.1 0.15 ± 2% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.00 +0.2 0.15 ± 14% perf-profile.children.cycles-pp.wake_q_add_safe
0.03 ±100% +0.2 0.19 ± 13% perf-profile.children.cycles-pp.update_irq_load_avg
0.00 +0.2 0.16 ± 17% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
0.00 +0.2 0.16 ± 5% perf-profile.children.cycles-pp.sysvec_call_function_single
0.16 ± 26% +0.2 0.32 ± 19% perf-profile.children.cycles-pp.update_blocked_averages
0.15 ± 7% +0.2 0.30 ± 16% perf-profile.children.cycles-pp.calc_global_load_tick
0.00 +0.2 0.16 ± 32% perf-profile.children.cycles-pp.rcu_core
0.17 ± 24% +0.2 0.33 ± 18% perf-profile.children.cycles-pp.run_rebalance_domains
0.00 +0.2 0.17 ± 30% perf-profile.children.cycles-pp.rcu_eqs_enter
0.38 ± 20% +0.2 0.55 ± 6% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.01 ±173% +0.2 0.18 ± 32% perf-profile.children.cycles-pp.serial8250_console_putchar
0.00 +0.2 0.18 ± 4% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.01 ±173% +0.2 0.19 ± 33% perf-profile.children.cycles-pp.uart_console_write
0.01 ±173% +0.2 0.19 ± 32% perf-profile.children.cycles-pp.wait_for_xmitr
0.04 ± 58% +0.2 0.22 ± 4% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.01 ±173% +0.2 0.20 ± 32% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.2 0.19 ± 12% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.sysvec_irq_work
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.__sysvec_irq_work
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.irq_work_run
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.irq_work_single
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.printk
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.vprintk_emit
0.03 ±100% +0.2 0.21 ± 32% perf-profile.children.cycles-pp.console_unlock
0.03 ±100% +0.2 0.23 ± 20% perf-profile.children.cycles-pp.find_vma
0.03 ±100% +0.2 0.22 ± 32% perf-profile.children.cycles-pp.irq_work_run_list
0.08 ± 17% +0.2 0.28 ± 19% perf-profile.children.cycles-pp.newidle_balance
0.07 ± 19% +0.2 0.28 ± 12% perf-profile.children.cycles-pp.rcu_idle_exit
0.00 +0.2 0.20 ± 6% perf-profile.children.cycles-pp.__orc_find
0.04 ± 59% +0.2 0.25 ± 16% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.16 ± 10% +0.2 0.37 ± 9% perf-profile.children.cycles-pp.irqtime_account_irq
0.00 +0.2 0.21 ± 5% perf-profile.children.cycles-pp.__list_add_valid
0.00 +0.2 0.21 ± 7% perf-profile.children.cycles-pp.llist_reverse_order
0.00 +0.2 0.22 ± 16% perf-profile.children.cycles-pp.cpuacct_charge
0.04 ± 58% +0.2 0.26 ± 8% perf-profile.children.cycles-pp.down_read_trylock
0.06 ± 11% +0.2 0.29 ± 17% perf-profile.children.cycles-pp.down_read
0.16 ± 11% +0.2 0.39 ± 20% perf-profile.children.cycles-pp.update_sd_lb_stats
0.00 +0.2 0.23 ± 5% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.2 0.23 ± 17% perf-profile.children.cycles-pp.__switch_to_asm
0.00 +0.2 0.23 ± 14% perf-profile.children.cycles-pp.send_call_function_single_ipi
0.17 ± 13% +0.2 0.41 ± 21% perf-profile.children.cycles-pp.find_busiest_group
0.00 +0.2 0.25 ± 20% perf-profile.children.cycles-pp.sync_regs
0.00 +0.2 0.25 ± 11% perf-profile.children.cycles-pp.__list_del_entry_valid
0.04 ± 59% +0.3 0.30 ± 6% perf-profile.children.cycles-pp.update_cfs_group
0.00 +0.3 0.26 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se
0.00 +0.3 0.26 ± 7% perf-profile.children.cycles-pp.__switch_to
0.08 ± 11% +0.3 0.34 ± 12% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.3 0.28 ± 8% perf-profile.children.cycles-pp.flush_smp_call_function_queue
0.07 ± 10% +0.3 0.35 ± 6% perf-profile.children.cycles-pp.up_read
0.42 ± 13% +0.3 0.70 ± 8% perf-profile.children.cycles-pp.rebalance_domains
0.00 +0.3 0.30 ± 12% perf-profile.children.cycles-pp.kernel_text_address
0.09 ± 15% +0.3 0.39 ± 10% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.00 +0.3 0.30 ± 14% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.3 0.31 ± 18% perf-profile.children.cycles-pp.nr_iowait_cpu
0.06 ± 11% +0.3 0.38 ± 12% perf-profile.children.cycles-pp.do_anonymous_page
0.21 ± 13% +0.3 0.53 ± 20% perf-profile.children.cycles-pp.load_balance
0.03 ±100% +0.3 0.35 ± 4% perf-profile.children.cycles-pp.vma_interval_tree_insert
0.09 ± 15% +0.3 0.42 ± 4% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.18 ± 14% +0.3 0.51 ± 5% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.3 0.34 ± 9% perf-profile.children.cycles-pp.__kernel_text_address
0.00 +0.4 0.36 ± 9% perf-profile.children.cycles-pp.unwind_get_return_address
0.00 +0.4 0.38 ± 7% perf-profile.children.cycles-pp.set_next_entity
0.15 ± 14% +0.4 0.53 ± 4% perf-profile.children.cycles-pp.read_tsc
0.00 +0.4 0.38 ± 13% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.00 +0.4 0.38 ± 20% perf-profile.children.cycles-pp.llist_add_batch
0.00 +0.4 0.39 ± 7% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.4 0.39 ± 19% perf-profile.children.cycles-pp.__smp_call_single_queue
0.34 ± 16% +0.4 0.74 ± 16% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.10 ± 17% +0.4 0.51 ± 4% perf-profile.children.cycles-pp.update_rq_clock
0.13 ± 14% +0.4 0.54 ± 8% perf-profile.children.cycles-pp.native_sched_clock
0.14 ± 11% +0.4 0.57 ± 9% perf-profile.children.cycles-pp.sched_clock
0.47 ± 11% +0.4 0.91 ± 7% perf-profile.children.cycles-pp.scheduler_tick
0.56 ± 10% +0.4 1.00 ± 19% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.07 ± 16% +0.4 0.51 ± 4% perf-profile.children.cycles-pp.vma_link
0.15 ± 12% +0.5 0.62 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu
0.05 ± 58% +0.5 0.54 ± 12% perf-profile.children.cycles-pp.vm_unmapped_area
0.05 ± 58% +0.5 0.56 ± 14% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.28 ± 18% +0.5 0.80 ± 2% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.06 ± 13% +0.5 0.58 ± 14% perf-profile.children.cycles-pp.get_unmapped_area
0.15 ± 17% +0.5 0.70 ± 5% perf-profile.children.cycles-pp._raw_spin_lock
0.42 ± 20% +0.6 0.99 ± 11% perf-profile.children.cycles-pp.tick_irq_enter
0.32 ± 17% +0.6 0.94 ± 7% perf-profile.children.cycles-pp.native_irq_return_iret
0.04 ±100% +0.7 0.71 ±121% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.01 ±173% +0.7 0.71 ± 14% perf-profile.children.cycles-pp.rwsem_mark_wake
0.04 ± 58% +0.7 0.74 perf-profile.children.cycles-pp.finish_task_switch
0.69 ± 14% +0.7 1.40 ± 12% perf-profile.children.cycles-pp.__softirqentry_text_start
0.03 ±100% +0.7 0.73 ± 9% perf-profile.children.cycles-pp.update_curr
0.70 ± 14% +0.7 1.41 ± 12% perf-profile.children.cycles-pp.do_softirq_own_stack
0.51 ± 18% +0.7 1.23 ± 9% perf-profile.children.cycles-pp.irq_enter_rcu
0.00 +0.7 0.73 ± 15% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.00 +0.7 0.73 ± 9% perf-profile.children.cycles-pp.update_cfs_rq_h_load
0.10 ± 15% +0.7 0.83 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair
0.15 ± 10% +0.7 0.89 ± 3% perf-profile.children.cycles-pp.__handle_mm_fault
0.11 ± 17% +0.8 0.86 ± 6% perf-profile.children.cycles-pp.mmap_region
0.10 ± 17% +0.8 0.91 ± 5% perf-profile.children.cycles-pp.update_load_avg
0.04 ± 57% +0.8 0.85 ± 4% perf-profile.children.cycles-pp.unwind_next_frame
0.83 ± 11% +0.9 1.70 ± 9% perf-profile.children.cycles-pp.update_process_times
0.80 ± 12% +0.9 1.68 ± 13% perf-profile.children.cycles-pp.irq_exit_rcu
0.04 ± 58% +0.9 0.95 ± 7% perf-profile.children.cycles-pp.dequeue_entity
0.85 ± 11% +0.9 1.77 ± 9% perf-profile.children.cycles-pp.tick_sched_handle
0.17 ± 11% +1.0 1.14 ± 6% perf-profile.children.cycles-pp.handle_mm_fault
0.04 ± 59% +1.0 1.04 ± 6% perf-profile.children.cycles-pp.dequeue_task_fair
0.91 ± 6% +1.0 1.92 ± 10% perf-profile.children.cycles-pp.tick_nohz_next_event
0.04 ± 58% +1.0 1.06 ± 9% perf-profile.children.cycles-pp.select_task_rq_fair
0.17 ± 10% +1.0 1.19 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.78 ± 9% +1.1 1.89 ± 4% perf-profile.children.cycles-pp.clockevents_program_event
1.10 ± 12% +1.2 2.34 ± 7% perf-profile.children.cycles-pp.tick_sched_timer
0.17 ± 14% +1.3 1.46 ± 9% perf-profile.children.cycles-pp.do_mmap
1.01 ± 7% +1.3 2.34 ± 6% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.07 ± 14% +1.4 1.45 ± 12% perf-profile.children.cycles-pp.schedule_idle
0.06 ± 11% +1.4 1.47 ± 3% perf-profile.children.cycles-pp.arch_stack_walk
0.07 ± 15% +1.5 1.62 ± 3% perf-profile.children.cycles-pp.stack_trace_save_tsk
1.66 ± 11% +1.8 3.46 ± 6% perf-profile.children.cycles-pp.__hrtimer_run_queues
1.47 ± 13% +2.1 3.52 ± 4% perf-profile.children.cycles-pp.ktime_get
2.36 ± 25% +2.2 4.52 ± 6% perf-profile.children.cycles-pp.menu_select
0.24 ± 13% +2.7 2.91 ± 4% perf-profile.children.cycles-pp.schedule
0.12 ± 10% +2.7 2.82 ± 3% perf-profile.children.cycles-pp.__account_scheduler_latency
0.21 ± 32% +3.0 3.25 ± 41% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.15 ± 38% +3.1 3.25 ± 42% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.23 ± 8% +3.5 3.71 ± 12% perf-profile.children.cycles-pp.try_to_wake_up
0.23 ± 9% +3.6 3.82 ± 12% perf-profile.children.cycles-pp.wake_up_q
4.46 ± 17% +3.7 8.17 ± 8% perf-profile.children.cycles-pp.vm_mmap_pgoff
2.86 ± 11% +3.7 6.60 ± 3% perf-profile.children.cycles-pp.hrtimer_interrupt
4.47 ± 17% +3.8 8.23 ± 8% perf-profile.children.cycles-pp.ksys_mmap_pgoff
0.42 ± 11% +3.8 4.20 ± 4% perf-profile.children.cycles-pp.do_rw_once
2.89 ± 11% +3.8 6.72 ± 3% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
4.57 ± 17% +3.9 8.49 ± 8% perf-profile.children.cycles-pp.do_syscall_64
4.58 ± 17% +3.9 8.52 ± 8% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.31 ± 14% +4.0 4.28 ± 5% perf-profile.children.cycles-pp.__schedule
0.20 ± 12% +4.0 4.24 ± 3% perf-profile.children.cycles-pp.enqueue_entity
0.18 ± 17% +4.1 4.23 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending
0.29 ± 7% +4.2 4.48 ± 12% perf-profile.children.cycles-pp.rwsem_wake
0.19 ± 18% +4.3 4.48 ± 2% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.21 ± 14% +4.4 4.66 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair
0.21 ± 14% +4.5 4.69 ± 3% perf-profile.children.cycles-pp.ttwu_do_activate
3.62 ± 11% +4.8 8.46 ± 5% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
4.60 ± 12% +6.0 10.55 ± 4% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
5.46 ± 13% +6.3 11.78 ± 3% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.85 ±173% +7.6 8.42 ± 8% perf-profile.children.cycles-pp.__mmap
30.02 ± 15% +18.6 48.67 ± 2% perf-profile.children.cycles-pp.intel_idle
36.60 ± 10% +26.2 62.79 perf-profile.children.cycles-pp.cpuidle_enter_state
36.61 ± 10% +26.2 62.83 perf-profile.children.cycles-pp.cpuidle_enter
39.30 ± 9% +35.2 74.55 perf-profile.children.cycles-pp.start_secondary
39.54 ± 9% +35.3 74.83 perf-profile.children.cycles-pp.do_idle
39.54 ± 9% +35.3 74.86 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
39.54 ± 9% +35.3 74.86 perf-profile.children.cycles-pp.cpu_startup_entry
52.32 ± 6% -51.4 0.89 ± 29% perf-profile.self.cycles-pp.osq_lock
4.83 ± 11% -4.2 0.61 ± 38% perf-profile.self.cycles-pp.rwsem_optimistic_spin
0.59 ± 9% -0.5 0.10 ± 24% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.09 ± 13% +0.0 0.12 ± 11% perf-profile.self.cycles-pp.rebalance_domains
0.11 ± 29% +0.0 0.15 ± 14% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.__unwind_start
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.__calc_delta
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.menu_reflect
0.09 ± 19% +0.1 0.15 ± 8% perf-profile.self.cycles-pp.tick_sched_timer
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.__rb_insert_augmented
0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.tick_check_broadcast_expired
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.kernel_text_address
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.delay_tsc
0.20 ± 11% +0.1 0.27 ± 11% perf-profile.self.cycles-pp._raw_spin_trylock
0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.asm_exc_page_fault
0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.tick_nohz_tick_stopped
0.00 +0.1 0.07 ± 16% perf-profile.self.cycles-pp.switch_fpu_return
0.00 +0.1 0.07 ± 28% perf-profile.self.cycles-pp.tick_irq_enter
0.11 ± 14% +0.1 0.18 ± 13% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.flush_smp_call_function_queue
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.flush_smp_call_function_from_idle
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.trigger_load_balance
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.find_vma
0.00 +0.1 0.07 ± 15% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.07 ± 24% perf-profile.self.cycles-pp.cpuidle_governor_latency_req
0.11 ± 10% +0.1 0.18 ± 11% perf-profile.self.cycles-pp.irqtime_account_irq
0.01 ±173% +0.1 0.09 ± 7% perf-profile.self.cycles-pp.idle_cpu
0.00 +0.1 0.07 ± 29% perf-profile.self.cycles-pp.newidle_balance
0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.dequeue_task_fair
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__wrgsbase_inactive
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.check_preempt_curr
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.get_cpu_device
0.00 +0.1 0.08 ± 26% perf-profile.self.cycles-pp.load_balance
0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.rcu_eqs_exit
0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.mmap_region
0.00 +0.1 0.09 ± 26% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched
0.00 +0.1 0.09 ± 19% perf-profile.self.cycles-pp.pick_next_task_fair
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.rb_next
0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.rb_erase
0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.00 +0.1 0.09 ± 11% perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.orc_find
0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.__softirqentry_text_start
0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.reweight_entity
0.00 +0.1 0.10 ± 15% perf-profile.self.cycles-pp.rb_insert_color
0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.run_local_timers
0.00 +0.1 0.10 ± 41% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.rcu_idle_exit
0.00 +0.1 0.11 ± 13% perf-profile.self.cycles-pp.stack_trace_save_tsk
0.01 ±173% +0.1 0.12 ± 20% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.00 +0.1 0.11 ± 13% perf-profile.self.cycles-pp.wake_q_add
0.00 +0.1 0.11 ± 4% perf-profile.self.cycles-pp.call_cpuidle
0.00 +0.1 0.12 ± 9% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +0.1 0.12 ± 5% perf-profile.self.cycles-pp.hrtimer_interrupt
0.07 ± 20% +0.1 0.20 ± 11% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.00 +0.1 0.13 ± 19% perf-profile.self.cycles-pp.handle_mm_fault
0.00 +0.1 0.13 ± 14% perf-profile.self.cycles-pp.dequeue_entity
0.00 +0.1 0.13 ± 35% perf-profile.self.cycles-pp.io_serial_in
0.00 +0.1 0.14 ± 29% perf-profile.self.cycles-pp.vmacache_find
0.00 +0.1 0.14 ± 10% perf-profile.self.cycles-pp.wake_up_q
0.00 +0.1 0.15 ± 12% perf-profile.self.cycles-pp.rwsem_down_write_slowpath
0.14 ± 8% +0.1 0.28 ± 2% perf-profile.self.cycles-pp.update_process_times
0.00 +0.2 0.15 ± 12% perf-profile.self.cycles-pp.wake_q_add_safe
0.03 ±100% +0.2 0.19 ± 13% perf-profile.self.cycles-pp.update_irq_load_avg
0.14 ± 10% +0.2 0.30 ± 17% perf-profile.self.cycles-pp.calc_global_load_tick
0.03 ±100% +0.2 0.19 ± 18% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.10 ± 12% +0.2 0.28 ± 17% perf-profile.self.cycles-pp.update_sd_lb_stats
0.00 +0.2 0.18 ± 6% perf-profile.self.cycles-pp.___perf_sw_event
0.04 ± 58% +0.2 0.23 ± 11% perf-profile.self.cycles-pp.down_read
0.00 +0.2 0.20 ± 16% perf-profile.self.cycles-pp.set_next_entity
0.00 +0.2 0.20 ± 2% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.2 0.20 ± 6% perf-profile.self.cycles-pp.__list_add_valid
0.00 +0.2 0.20 ± 6% perf-profile.self.cycles-pp.__orc_find
0.00 +0.2 0.20 ± 8% perf-profile.self.cycles-pp.sched_ttwu_pending
0.00 +0.2 0.21 ± 7% perf-profile.self.cycles-pp.llist_reverse_order
0.24 ± 3% +0.2 0.45 ± 12% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.2 0.22 ± 16% perf-profile.self.cycles-pp.rwsem_mark_wake
0.00 +0.2 0.22 ± 16% perf-profile.self.cycles-pp.cpuacct_charge
0.04 ± 58% +0.2 0.26 ± 8% perf-profile.self.cycles-pp.down_read_trylock
0.04 ± 59% +0.2 0.28 ± 5% perf-profile.self.cycles-pp.update_cfs_group
0.00 +0.2 0.23 ± 17% perf-profile.self.cycles-pp.__switch_to_asm
0.00 +0.2 0.23 ± 14% perf-profile.self.cycles-pp.send_call_function_single_ipi
0.00 +0.2 0.24 ± 8% perf-profile.self.cycles-pp.__switch_to
0.00 +0.2 0.25 ± 19% perf-profile.self.cycles-pp.sync_regs
0.00 +0.2 0.25 ± 13% perf-profile.self.cycles-pp.__list_del_entry_valid
0.00 +0.3 0.25 ± 3% perf-profile.self.cycles-pp.__update_load_avg_se
0.04 ± 58% +0.3 0.30 ± 13% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.select_task_rq_fair
0.07 ± 10% +0.3 0.34 ± 6% perf-profile.self.cycles-pp.up_read
0.08 ± 13% +0.3 0.35 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.09 ± 13% +0.3 0.38 ± 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.3 0.30 ± 18% perf-profile.self.cycles-pp.nr_iowait_cpu
0.03 ±100% +0.3 0.35 ± 4% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.08 ± 11% +0.3 0.41 ± 6% perf-profile.self.cycles-pp.do_idle
0.17 ± 13% +0.3 0.51 ± 6% perf-profile.self.cycles-pp.lapic_next_deadline
0.00 +0.3 0.35 ± 3% perf-profile.self.cycles-pp.enqueue_entity
0.15 ± 12% +0.4 0.52 ± 4% perf-profile.self.cycles-pp.read_tsc
0.00 +0.4 0.38 ± 7% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.4 0.38 ± 20% perf-profile.self.cycles-pp.llist_add_batch
0.12 ± 12% +0.4 0.52 ± 10% perf-profile.self.cycles-pp.native_sched_clock
0.07 ± 17% +0.4 0.47 ± 6% perf-profile.self.cycles-pp.__handle_mm_fault
0.00 +0.4 0.41 ± 7% perf-profile.self.cycles-pp.update_curr
0.00 +0.4 0.42 ± 7% perf-profile.self.cycles-pp.enqueue_task_fair
0.56 ± 10% +0.4 1.00 ± 19% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.25 ± 17% +0.5 0.72 ± 3% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.5 0.48 ± 9% perf-profile.self.cycles-pp.unwind_next_frame
0.05 ± 58% +0.5 0.54 ± 12% perf-profile.self.cycles-pp.vm_unmapped_area
0.15 ± 15% +0.5 0.65 ± 5% perf-profile.self.cycles-pp._raw_spin_lock
0.00 +0.6 0.58 ± 17% perf-profile.self.cycles-pp.__account_scheduler_latency
0.04 ±100% +0.6 0.63 ±116% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.00 +0.6 0.60 perf-profile.self.cycles-pp.finish_task_switch
0.32 ± 17% +0.6 0.94 ± 7% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.6 0.65 ± 21% perf-profile.self.cycles-pp.try_to_wake_up
0.03 ±100% +0.7 0.70 ± 3% perf-profile.self.cycles-pp.__schedule
0.15 ± 7% +0.7 0.87 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.00 +0.7 0.73 ± 9% perf-profile.self.cycles-pp.update_cfs_rq_h_load
0.17 ± 10% +0.8 0.94 ± 4% perf-profile.self.cycles-pp.rwsem_down_read_slowpath
1.34 ± 13% +1.7 3.06 ± 4% perf-profile.self.cycles-pp.ktime_get
0.28 ± 11% +2.3 2.62 ± 10% perf-profile.self.cycles-pp.do_access
0.27 ± 11% +2.5 2.77 perf-profile.self.cycles-pp.do_rw_once
0.15 ± 40% +3.1 3.24 ± 42% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
30.02 ± 15% +18.6 48.66 ± 2% perf-profile.self.cycles-pp.intel_idle
1548 ± 77% +658.7% 11747 ± 65% interrupts.40:PCI-MSI.524291-edge.eth0-TxRx-2
451831 ± 15% +407.3% 2292365 ± 8% interrupts.CAL:Function_call_interrupts
1998 ± 34% +353.4% 9062 ± 13% interrupts.CPU0.CAL:Function_call_interrupts
687.25 ± 35% -69.7% 208.00 ± 35% interrupts.CPU0.NMI:Non-maskable_interrupts
687.25 ± 35% -69.7% 208.00 ± 35% interrupts.CPU0.PMI:Performance_monitoring_interrupts
108.50 ± 9% +376.5% 517.00 ± 16% interrupts.CPU0.RES:Rescheduling_interrupts
2139 ± 14% +454.4% 11862 ± 11% interrupts.CPU1.CAL:Function_call_interrupts
113.25 ± 27% +412.4% 580.25 ± 3% interrupts.CPU1.RES:Rescheduling_interrupts
2248 ± 19% +422.0% 11739 ± 13% interrupts.CPU10.CAL:Function_call_interrupts
647.75 ± 22% -49.3% 328.25 ± 7% interrupts.CPU10.NMI:Non-maskable_interrupts
647.75 ± 22% -49.3% 328.25 ± 7% interrupts.CPU10.PMI:Performance_monitoring_interrupts
110.25 ± 5% +397.3% 548.25 ± 11% interrupts.CPU10.RES:Rescheduling_interrupts
2512 ± 30% +388.3% 12269 ± 10% interrupts.CPU100.CAL:Function_call_interrupts
851.75 ± 28% -64.0% 306.50 ± 30% interrupts.CPU100.NMI:Non-maskable_interrupts
851.75 ± 28% -64.0% 306.50 ± 30% interrupts.CPU100.PMI:Performance_monitoring_interrupts
100.00 ± 30% +491.5% 591.50 ± 4% interrupts.CPU100.RES:Rescheduling_interrupts
2020 ± 26% +523.6% 12598 ± 9% interrupts.CPU101.CAL:Function_call_interrupts
789.75 ± 30% -58.1% 330.75 ± 3% interrupts.CPU101.NMI:Non-maskable_interrupts
789.75 ± 30% -58.1% 330.75 ± 3% interrupts.CPU101.PMI:Performance_monitoring_interrupts
85.75 ± 16% +673.2% 663.00 ± 23% interrupts.CPU101.RES:Rescheduling_interrupts
2688 ± 31% +342.8% 11903 ± 10% interrupts.CPU102.CAL:Function_call_interrupts
718.00 ± 23% -60.8% 281.25 ± 25% interrupts.CPU102.NMI:Non-maskable_interrupts
718.00 ± 23% -60.8% 281.25 ± 25% interrupts.CPU102.PMI:Performance_monitoring_interrupts
101.25 ± 27% +467.7% 574.75 ± 4% interrupts.CPU102.RES:Rescheduling_interrupts
2253 ± 16% +421.7% 11754 ± 8% interrupts.CPU103.CAL:Function_call_interrupts
859.00 ± 18% -63.5% 313.75 ± 5% interrupts.CPU103.NMI:Non-maskable_interrupts
859.00 ± 18% -63.5% 313.75 ± 5% interrupts.CPU103.PMI:Performance_monitoring_interrupts
107.25 ± 15% +493.2% 636.25 ± 13% interrupts.CPU103.RES:Rescheduling_interrupts
2106 ± 17% +479.0% 12194 ± 11% interrupts.CPU104.CAL:Function_call_interrupts
88.00 ± 15% +580.7% 599.00 ± 3% interrupts.CPU104.RES:Rescheduling_interrupts
45.50 ±110% +313.2% 188.00 ± 18% interrupts.CPU104.TLB:TLB_shootdowns
2266 ± 17% +423.6% 11868 ± 8% interrupts.CPU105.CAL:Function_call_interrupts
711.25 ± 20% -53.3% 332.50 ± 10% interrupts.CPU105.NMI:Non-maskable_interrupts
711.25 ± 20% -53.3% 332.50 ± 10% interrupts.CPU105.PMI:Performance_monitoring_interrupts
147.25 ± 35% +305.6% 597.25 ± 8% interrupts.CPU105.RES:Rescheduling_interrupts
2572 ± 16% +366.9% 12010 ± 12% interrupts.CPU106.CAL:Function_call_interrupts
727.25 ± 17% -56.4% 316.75 ± 5% interrupts.CPU106.NMI:Non-maskable_interrupts
727.25 ± 17% -56.4% 316.75 ± 5% interrupts.CPU106.PMI:Performance_monitoring_interrupts
137.25 ± 34% +314.2% 568.50 ± 4% interrupts.CPU106.RES:Rescheduling_interrupts
2120 ± 24% +491.9% 12550 ± 13% interrupts.CPU107.CAL:Function_call_interrupts
705.25 ± 34% -59.8% 283.50 ± 25% interrupts.CPU107.NMI:Non-maskable_interrupts
705.25 ± 34% -59.8% 283.50 ± 25% interrupts.CPU107.PMI:Performance_monitoring_interrupts
191.75 ± 89% +202.5% 580.00 interrupts.CPU107.RES:Rescheduling_interrupts
2098 ± 19% +476.2% 12090 ± 9% interrupts.CPU108.CAL:Function_call_interrupts
948.25 ± 40% -65.7% 325.00 interrupts.CPU108.NMI:Non-maskable_interrupts
948.25 ± 40% -65.7% 325.00 interrupts.CPU108.PMI:Performance_monitoring_interrupts
90.25 ± 20% +566.5% 601.50 ± 12% interrupts.CPU108.RES:Rescheduling_interrupts
2100 ± 18% +480.7% 12198 ± 9% interrupts.CPU109.CAL:Function_call_interrupts
700.75 ± 30% -53.6% 325.25 interrupts.CPU109.NMI:Non-maskable_interrupts
700.75 ± 30% -53.6% 325.25 interrupts.CPU109.PMI:Performance_monitoring_interrupts
107.75 ± 25% +446.6% 589.00 ± 6% interrupts.CPU109.RES:Rescheduling_interrupts
2088 ± 18% +474.7% 12000 ± 11% interrupts.CPU11.CAL:Function_call_interrupts
820.75 ± 21% -65.5% 283.00 ± 26% interrupts.CPU11.NMI:Non-maskable_interrupts
820.75 ± 21% -65.5% 283.00 ± 26% interrupts.CPU11.PMI:Performance_monitoring_interrupts
123.00 ± 37% +365.4% 572.50 ± 3% interrupts.CPU11.RES:Rescheduling_interrupts
2253 ± 25% +443.2% 12242 ± 11% interrupts.CPU110.CAL:Function_call_interrupts
871.75 ± 23% -63.7% 316.50 ± 6% interrupts.CPU110.NMI:Non-maskable_interrupts
871.75 ± 23% -63.7% 316.50 ± 6% interrupts.CPU110.PMI:Performance_monitoring_interrupts
90.50 ± 8% +527.9% 568.25 ± 2% interrupts.CPU110.RES:Rescheduling_interrupts
2272 ± 20% +435.9% 12179 ± 11% interrupts.CPU111.CAL:Function_call_interrupts
789.75 ± 26% -58.5% 327.50 ± 3% interrupts.CPU111.NMI:Non-maskable_interrupts
789.75 ± 26% -58.5% 327.50 ± 3% interrupts.CPU111.PMI:Performance_monitoring_interrupts
94.50 ± 15% +543.7% 608.25 ± 10% interrupts.CPU111.RES:Rescheduling_interrupts
2081 ± 21% +487.1% 12218 ± 11% interrupts.CPU112.CAL:Function_call_interrupts
932.50 ± 37% -62.6% 348.75 ± 12% interrupts.CPU112.NMI:Non-maskable_interrupts
932.50 ± 37% -62.6% 348.75 ± 12% interrupts.CPU112.PMI:Performance_monitoring_interrupts
86.25 ± 14% +595.1% 599.50 ± 5% interrupts.CPU112.RES:Rescheduling_interrupts
2368 ± 11% +417.8% 12260 ± 10% interrupts.CPU113.CAL:Function_call_interrupts
576.00 ± 22% -41.0% 339.75 ± 3% interrupts.CPU113.NMI:Non-maskable_interrupts
576.00 ± 22% -41.0% 339.75 ± 3% interrupts.CPU113.PMI:Performance_monitoring_interrupts
96.00 ± 15% +504.4% 580.25 ± 4% interrupts.CPU113.RES:Rescheduling_interrupts
2167 ± 15% +470.9% 12373 ± 11% interrupts.CPU114.CAL:Function_call_interrupts
940.00 ± 15% -65.1% 327.75 ± 6% interrupts.CPU114.NMI:Non-maskable_interrupts
940.00 ± 15% -65.1% 327.75 ± 6% interrupts.CPU114.PMI:Performance_monitoring_interrupts
111.50 ± 35% +424.4% 584.75 ± 4% interrupts.CPU114.RES:Rescheduling_interrupts
2154 ± 21% +478.2% 12455 ± 11% interrupts.CPU115.CAL:Function_call_interrupts
828.75 ± 34% -62.1% 313.75 ± 4% interrupts.CPU115.NMI:Non-maskable_interrupts
828.75 ± 34% -62.1% 313.75 ± 4% interrupts.CPU115.PMI:Performance_monitoring_interrupts
111.00 ± 18% +453.8% 614.75 ± 3% interrupts.CPU115.RES:Rescheduling_interrupts
2459 ± 26% +384.1% 11903 ± 14% interrupts.CPU116.CAL:Function_call_interrupts
763.75 ± 30% -60.8% 299.50 ± 6% interrupts.CPU116.NMI:Non-maskable_interrupts
763.75 ± 30% -60.8% 299.50 ± 6% interrupts.CPU116.PMI:Performance_monitoring_interrupts
88.75 ± 10% +546.5% 573.75 ± 9% interrupts.CPU116.RES:Rescheduling_interrupts
2557 ± 15% +380.3% 12282 ± 13% interrupts.CPU117.CAL:Function_call_interrupts
808.00 ± 39% -65.8% 276.00 ± 24% interrupts.CPU117.NMI:Non-maskable_interrupts
808.00 ± 39% -65.8% 276.00 ± 24% interrupts.CPU117.PMI:Performance_monitoring_interrupts
135.75 ± 39% +327.3% 580.00 interrupts.CPU117.RES:Rescheduling_interrupts
2157 ± 14% +462.2% 12128 ± 11% interrupts.CPU118.CAL:Function_call_interrupts
957.75 ± 12% -68.3% 303.75 ± 7% interrupts.CPU118.NMI:Non-maskable_interrupts
957.75 ± 12% -68.3% 303.75 ± 7% interrupts.CPU118.PMI:Performance_monitoring_interrupts
88.50 ± 11% +563.0% 586.75 ± 4% interrupts.CPU118.RES:Rescheduling_interrupts
2281 ± 13% +439.0% 12297 ± 11% interrupts.CPU119.CAL:Function_call_interrupts
935.50 ± 22% -69.7% 283.25 ± 25% interrupts.CPU119.NMI:Non-maskable_interrupts
935.50 ± 22% -69.7% 283.25 ± 25% interrupts.CPU119.PMI:Performance_monitoring_interrupts
94.25 ± 18% +504.8% 570.00 ± 4% interrupts.CPU119.RES:Rescheduling_interrupts
1548 ± 77% +658.7% 11747 ± 65% interrupts.CPU12.40:PCI-MSI.524291-edge.eth0-TxRx-2
2662 ± 40% +344.1% 11823 ± 10% interrupts.CPU12.CAL:Function_call_interrupts
950.25 ± 29% -66.1% 321.75 ± 3% interrupts.CPU12.NMI:Non-maskable_interrupts
950.25 ± 29% -66.1% 321.75 ± 3% interrupts.CPU12.PMI:Performance_monitoring_interrupts
101.25 ± 17% +452.1% 559.00 ± 2% interrupts.CPU12.RES:Rescheduling_interrupts
2174 ± 18% +485.4% 12728 ± 12% interrupts.CPU120.CAL:Function_call_interrupts
864.75 ± 35% -63.9% 312.50 ± 2% interrupts.CPU120.NMI:Non-maskable_interrupts
864.75 ± 35% -63.9% 312.50 ± 2% interrupts.CPU120.PMI:Performance_monitoring_interrupts
91.00 ± 15% +544.0% 586.00 ± 8% interrupts.CPU120.RES:Rescheduling_interrupts
2119 ± 10% +443.6% 11518 ± 9% interrupts.CPU121.CAL:Function_call_interrupts
865.50 ± 14% -69.5% 264.00 ± 22% interrupts.CPU121.NMI:Non-maskable_interrupts
865.50 ± 14% -69.5% 264.00 ± 22% interrupts.CPU121.PMI:Performance_monitoring_interrupts
90.00 ± 11% +525.6% 563.00 ± 6% interrupts.CPU121.RES:Rescheduling_interrupts
93.50 ± 67% +139.0% 223.50 ± 21% interrupts.CPU121.TLB:TLB_shootdowns
2092 ± 19% +446.6% 11435 ± 7% interrupts.CPU122.CAL:Function_call_interrupts
755.00 ± 18% -56.6% 327.75 ± 3% interrupts.CPU122.NMI:Non-maskable_interrupts
755.00 ± 18% -56.6% 327.75 ± 3% interrupts.CPU122.PMI:Performance_monitoring_interrupts
85.75 ± 12% +549.6% 557.00 ± 2% interrupts.CPU122.RES:Rescheduling_interrupts
102.25 ± 37% +85.6% 189.75 ± 25% interrupts.CPU122.TLB:TLB_shootdowns
2168 ± 18% +433.9% 11577 ± 8% interrupts.CPU123.CAL:Function_call_interrupts
754.50 ± 31% -57.8% 318.25 ± 6% interrupts.CPU123.NMI:Non-maskable_interrupts
754.50 ± 31% -57.8% 318.25 ± 6% interrupts.CPU123.PMI:Performance_monitoring_interrupts
79.75 ± 9% +573.4% 537.00 ± 4% interrupts.CPU123.RES:Rescheduling_interrupts
2081 ± 29% +460.5% 11666 ± 9% interrupts.CPU124.CAL:Function_call_interrupts
639.00 ± 5% -48.7% 328.00 ± 3% interrupts.CPU124.NMI:Non-maskable_interrupts
639.00 ± 5% -48.7% 328.00 ± 3% interrupts.CPU124.PMI:Performance_monitoring_interrupts
77.50 ± 32% +654.8% 585.00 ± 3% interrupts.CPU124.RES:Rescheduling_interrupts
2054 ± 27% +476.8% 11848 ± 10% interrupts.CPU125.CAL:Function_call_interrupts
893.25 ± 25% -63.5% 325.75 ± 5% interrupts.CPU125.NMI:Non-maskable_interrupts
893.25 ± 25% -63.5% 325.75 ± 5% interrupts.CPU125.PMI:Performance_monitoring_interrupts
83.25 ± 17% +575.7% 562.50 ± 4% interrupts.CPU125.RES:Rescheduling_interrupts
2038 ± 18% +477.9% 11781 ± 10% interrupts.CPU126.CAL:Function_call_interrupts
995.75 ± 23% -68.3% 315.75 ± 7% interrupts.CPU126.NMI:Non-maskable_interrupts
995.75 ± 23% -68.3% 315.75 ± 7% interrupts.CPU126.PMI:Performance_monitoring_interrupts
85.50 ± 8% +565.8% 569.25 ± 3% interrupts.CPU126.RES:Rescheduling_interrupts
2063 ± 18% +471.1% 11784 ± 9% interrupts.CPU127.CAL:Function_call_interrupts
790.75 ± 8% -56.2% 346.25 ± 9% interrupts.CPU127.NMI:Non-maskable_interrupts
790.75 ± 8% -56.2% 346.25 ± 9% interrupts.CPU127.PMI:Performance_monitoring_interrupts
73.00 ± 20% +670.2% 562.25 ± 7% interrupts.CPU127.RES:Rescheduling_interrupts
2072 ± 28% +456.8% 11539 ± 8% interrupts.CPU128.CAL:Function_call_interrupts
704.00 ± 19% -61.8% 268.75 ± 20% interrupts.CPU128.NMI:Non-maskable_interrupts
704.00 ± 19% -61.8% 268.75 ± 20% interrupts.CPU128.PMI:Performance_monitoring_interrupts
75.25 ± 13% +665.4% 576.00 ± 5% interrupts.CPU128.RES:Rescheduling_interrupts
1997 ± 17% +476.2% 11509 ± 9% interrupts.CPU129.CAL:Function_call_interrupts
740.50 ± 28% -59.4% 301.00 ± 4% interrupts.CPU129.NMI:Non-maskable_interrupts
740.50 ± 28% -59.4% 301.00 ± 4% interrupts.CPU129.PMI:Performance_monitoring_interrupts
78.00 ± 10% +625.0% 565.50 ± 7% interrupts.CPU129.RES:Rescheduling_interrupts
2297 ± 16% +421.6% 11983 ± 10% interrupts.CPU13.CAL:Function_call_interrupts
837.50 ± 31% -61.2% 324.75 ± 3% interrupts.CPU13.NMI:Non-maskable_interrupts
837.50 ± 31% -61.2% 324.75 ± 3% interrupts.CPU13.PMI:Performance_monitoring_interrupts
118.75 ± 55% +372.2% 560.75 ± 6% interrupts.CPU13.RES:Rescheduling_interrupts
2201 ± 20% +423.9% 11531 ± 10% interrupts.CPU130.CAL:Function_call_interrupts
715.50 ± 21% -56.1% 314.25 ± 8% interrupts.CPU130.NMI:Non-maskable_interrupts
715.50 ± 21% -56.1% 314.25 ± 8% interrupts.CPU130.PMI:Performance_monitoring_interrupts
88.00 ± 8% +525.3% 550.25 ± 5% interrupts.CPU130.RES:Rescheduling_interrupts
2189 ± 13% +438.1% 11779 ± 12% interrupts.CPU131.CAL:Function_call_interrupts
923.00 ± 27% -65.6% 317.25 ± 7% interrupts.CPU131.NMI:Non-maskable_interrupts
923.00 ± 27% -65.6% 317.25 ± 7% interrupts.CPU131.PMI:Performance_monitoring_interrupts
84.75 ± 16% +574.0% 571.25 ± 7% interrupts.CPU131.RES:Rescheduling_interrupts
1931 ± 15% +506.4% 11712 ± 11% interrupts.CPU132.CAL:Function_call_interrupts
894.75 ± 26% -65.2% 311.75 ± 9% interrupts.CPU132.NMI:Non-maskable_interrupts
894.75 ± 26% -65.2% 311.75 ± 9% interrupts.CPU132.PMI:Performance_monitoring_interrupts
82.00 ± 6% +600.6% 574.50 ± 4% interrupts.CPU132.RES:Rescheduling_interrupts
47.50 ± 75% +243.7% 163.25 ± 19% interrupts.CPU132.TLB:TLB_shootdowns
2144 ± 17% +439.3% 11564 ± 10% interrupts.CPU133.CAL:Function_call_interrupts
733.25 ± 11% -57.2% 314.00 ± 9% interrupts.CPU133.NMI:Non-maskable_interrupts
733.25 ± 11% -57.2% 314.00 ± 9% interrupts.CPU133.PMI:Performance_monitoring_interrupts
92.50 ± 10% +547.0% 598.50 ± 6% interrupts.CPU133.RES:Rescheduling_interrupts
80.00 ± 50% +108.4% 166.75 ± 10% interrupts.CPU133.TLB:TLB_shootdowns
2087 ± 22% +448.5% 11452 ± 11% interrupts.CPU134.CAL:Function_call_interrupts
831.75 ± 21% -61.7% 318.25 ± 5% interrupts.CPU134.NMI:Non-maskable_interrupts
831.75 ± 21% -61.7% 318.25 ± 5% interrupts.CPU134.PMI:Performance_monitoring_interrupts
74.50 ± 10% +646.6% 556.25 ± 3% interrupts.CPU134.RES:Rescheduling_interrupts
2103 ± 24% +443.9% 11440 ± 12% interrupts.CPU135.CAL:Function_call_interrupts
784.50 ± 16% -66.4% 263.75 ± 22% interrupts.CPU135.NMI:Non-maskable_interrupts
784.50 ± 16% -66.4% 263.75 ± 22% interrupts.CPU135.PMI:Performance_monitoring_interrupts
82.00 ± 14% +578.7% 556.50 ± 7% interrupts.CPU135.RES:Rescheduling_interrupts
83.75 ± 67% +113.7% 179.00 ± 22% interrupts.CPU135.TLB:TLB_shootdowns
2114 ± 24% +454.0% 11713 ± 10% interrupts.CPU136.CAL:Function_call_interrupts
771.50 ± 20% -61.0% 301.00 ± 7% interrupts.CPU136.NMI:Non-maskable_interrupts
771.50 ± 20% -61.0% 301.00 ± 7% interrupts.CPU136.PMI:Performance_monitoring_interrupts
72.00 ± 10% +701.4% 577.00 ± 5% interrupts.CPU136.RES:Rescheduling_interrupts
2097 ± 22% +464.9% 11849 ± 10% interrupts.CPU137.CAL:Function_call_interrupts
789.00 ± 40% -59.8% 317.00 ± 10% interrupts.CPU137.NMI:Non-maskable_interrupts
789.00 ± 40% -59.8% 317.00 ± 10% interrupts.CPU137.PMI:Performance_monitoring_interrupts
83.75 ± 11% +567.5% 559.00 ± 6% interrupts.CPU137.RES:Rescheduling_interrupts
109.75 ± 33% +61.7% 177.50 ± 18% interrupts.CPU137.TLB:TLB_shootdowns
2258 ± 27% +427.7% 11918 ± 10% interrupts.CPU138.CAL:Function_call_interrupts
685.00 ± 48% -54.1% 314.50 ± 8% interrupts.CPU138.NMI:Non-maskable_interrupts
685.00 ± 48% -54.1% 314.50 ± 8% interrupts.CPU138.PMI:Performance_monitoring_interrupts
86.00 ± 13% +531.7% 543.25 ± 5% interrupts.CPU138.RES:Rescheduling_interrupts
2057 ± 21% +465.4% 11629 ± 9% interrupts.CPU139.CAL:Function_call_interrupts
689.75 ± 28% -53.9% 317.75 ± 10% interrupts.CPU139.NMI:Non-maskable_interrupts
689.75 ± 28% -53.9% 317.75 ± 10% interrupts.CPU139.PMI:Performance_monitoring_interrupts
80.25 ± 16% +600.3% 562.00 ± 4% interrupts.CPU139.RES:Rescheduling_interrupts
2170 ± 13% +439.5% 11708 ± 9% interrupts.CPU14.CAL:Function_call_interrupts
782.75 ± 22% -64.7% 276.25 ± 25% interrupts.CPU14.NMI:Non-maskable_interrupts
782.75 ± 22% -64.7% 276.25 ± 25% interrupts.CPU14.PMI:Performance_monitoring_interrupts
83.50 ± 8% +582.6% 570.00 ± 2% interrupts.CPU14.RES:Rescheduling_interrupts
2243 ± 23% +424.8% 11772 ± 11% interrupts.CPU140.CAL:Function_call_interrupts
761.00 ± 38% -60.2% 302.50 ± 9% interrupts.CPU140.NMI:Non-maskable_interrupts
761.00 ± 38% -60.2% 302.50 ± 9% interrupts.CPU140.PMI:Performance_monitoring_interrupts
90.50 ± 15% +534.5% 574.25 ± 8% interrupts.CPU140.RES:Rescheduling_interrupts
2131 ± 18% +446.7% 11654 ± 10% interrupts.CPU141.CAL:Function_call_interrupts
629.50 ± 50% -56.8% 272.25 ± 28% interrupts.CPU141.NMI:Non-maskable_interrupts
629.50 ± 50% -56.8% 272.25 ± 28% interrupts.CPU141.PMI:Performance_monitoring_interrupts
75.50 ± 17% +631.1% 552.00 ± 8% interrupts.CPU141.RES:Rescheduling_interrupts
2127 ± 14% +455.4% 11815 ± 10% interrupts.CPU142.CAL:Function_call_interrupts
91.25 ± 12% +563.0% 605.00 ± 8% interrupts.CPU142.RES:Rescheduling_interrupts
2077 ± 18% +471.3% 11869 ± 8% interrupts.CPU143.CAL:Function_call_interrupts
692.00 ± 45% -54.0% 318.00 ± 7% interrupts.CPU143.NMI:Non-maskable_interrupts
692.00 ± 45% -54.0% 318.00 ± 7% interrupts.CPU143.PMI:Performance_monitoring_interrupts
81.00 ± 9% +581.8% 552.25 ± 3% interrupts.CPU143.RES:Rescheduling_interrupts
2308 ± 24% +478.9% 13364 ± 14% interrupts.CPU144.CAL:Function_call_interrupts
501.50 ± 32% -38.2% 310.00 ± 6% interrupts.CPU144.NMI:Non-maskable_interrupts
501.50 ± 32% -38.2% 310.00 ± 6% interrupts.CPU144.PMI:Performance_monitoring_interrupts
122.00 ± 38% +338.5% 535.00 ± 3% interrupts.CPU144.RES:Rescheduling_interrupts
2462 ± 18% +392.4% 12124 ± 11% interrupts.CPU145.CAL:Function_call_interrupts
536.25 ± 28% -50.7% 264.25 ± 22% interrupts.CPU145.NMI:Non-maskable_interrupts
536.25 ± 28% -50.7% 264.25 ± 22% interrupts.CPU145.PMI:Performance_monitoring_interrupts
125.50 ± 41% +327.9% 537.00 ± 5% interrupts.CPU145.RES:Rescheduling_interrupts
2393 ± 26% +409.7% 12199 ± 8% interrupts.CPU146.CAL:Function_call_interrupts
628.00 ± 41% -56.8% 271.25 ± 22% interrupts.CPU146.NMI:Non-maskable_interrupts
628.00 ± 41% -56.8% 271.25 ± 22% interrupts.CPU146.PMI:Performance_monitoring_interrupts
90.50 ± 18% +478.2% 523.25 ± 7% interrupts.CPU146.RES:Rescheduling_interrupts
2545 ± 20% +368.3% 11917 ± 12% interrupts.CPU147.CAL:Function_call_interrupts
759.75 ± 35% -64.4% 270.50 ± 24% interrupts.CPU147.NMI:Non-maskable_interrupts
759.75 ± 35% -64.4% 270.50 ± 24% interrupts.CPU147.PMI:Performance_monitoring_interrupts
103.75 ± 14% +377.6% 495.50 ± 4% interrupts.CPU147.RES:Rescheduling_interrupts
2379 ± 29% +395.6% 11793 ± 9% interrupts.CPU148.CAL:Function_call_interrupts
720.50 ± 50% -62.9% 267.00 ± 24% interrupts.CPU148.NMI:Non-maskable_interrupts
720.50 ± 50% -62.9% 267.00 ± 24% interrupts.CPU148.PMI:Performance_monitoring_interrupts
108.00 ± 51% +385.0% 523.75 ± 8% interrupts.CPU148.RES:Rescheduling_interrupts
2306 ± 27% +429.4% 12210 ± 10% interrupts.CPU149.CAL:Function_call_interrupts
106.00 ± 37% +400.0% 530.00 ± 6% interrupts.CPU149.RES:Rescheduling_interrupts
2604 ± 26% +368.1% 12190 ± 11% interrupts.CPU15.CAL:Function_call_interrupts
683.50 ± 19% -51.8% 329.50 ± 4% interrupts.CPU15.NMI:Non-maskable_interrupts
683.50 ± 19% -51.8% 329.50 ± 4% interrupts.CPU15.PMI:Performance_monitoring_interrupts
90.00 ± 22% +539.2% 575.25 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts
2409 ± 21% +402.1% 12097 ± 10% interrupts.CPU150.CAL:Function_call_interrupts
732.00 ± 8% -60.0% 292.50 ± 25% interrupts.CPU150.NMI:Non-maskable_interrupts
732.00 ± 8% -60.0% 292.50 ± 25% interrupts.CPU150.PMI:Performance_monitoring_interrupts
89.50 ± 34% +454.5% 496.25 ± 3% interrupts.CPU150.RES:Rescheduling_interrupts
32.00 ±167% +322.7% 135.25 ± 32% interrupts.CPU150.TLB:TLB_shootdowns
2514 ± 24% +376.3% 11974 ± 11% interrupts.CPU151.CAL:Function_call_interrupts
732.50 ± 24% -56.9% 316.00 interrupts.CPU151.NMI:Non-maskable_interrupts
732.50 ± 24% -56.9% 316.00 interrupts.CPU151.PMI:Performance_monitoring_interrupts
126.00 ± 36% +329.2% 540.75 ± 11% interrupts.CPU151.RES:Rescheduling_interrupts
2440 ± 27% +387.6% 11901 ± 9% interrupts.CPU152.CAL:Function_call_interrupts
700.75 ± 36% -55.6% 311.25 ± 2% interrupts.CPU152.NMI:Non-maskable_interrupts
700.75 ± 36% -55.6% 311.25 ± 2% interrupts.CPU152.PMI:Performance_monitoring_interrupts
117.00 ± 28% +347.6% 523.75 ± 4% interrupts.CPU152.RES:Rescheduling_interrupts
2159 ± 23% +467.0% 12246 ± 7% interrupts.CPU153.CAL:Function_call_interrupts
714.25 ± 24% -56.6% 309.75 ± 2% interrupts.CPU153.NMI:Non-maskable_interrupts
714.25 ± 24% -56.6% 309.75 ± 2% interrupts.CPU153.PMI:Performance_monitoring_interrupts
84.75 ± 22% +563.1% 562.00 ± 5% interrupts.CPU153.RES:Rescheduling_interrupts
2361 ± 29% +414.3% 12144 ± 9% interrupts.CPU154.CAL:Function_call_interrupts
919.00 ± 21% -69.4% 281.25 ± 25% interrupts.CPU154.NMI:Non-maskable_interrupts
919.00 ± 21% -69.4% 281.25 ± 25% interrupts.CPU154.PMI:Performance_monitoring_interrupts
94.25 ± 22% +492.8% 558.75 ± 11% interrupts.CPU154.RES:Rescheduling_interrupts
70.75 ± 58% +156.9% 181.75 ± 23% interrupts.CPU154.TLB:TLB_shootdowns
2698 ± 18% +346.4% 12044 ± 7% interrupts.CPU155.CAL:Function_call_interrupts
808.00 ± 33% -65.1% 281.75 ± 23% interrupts.CPU155.NMI:Non-maskable_interrupts
808.00 ± 33% -65.1% 281.75 ± 23% interrupts.CPU155.PMI:Performance_monitoring_interrupts
120.50 ± 34% +332.6% 521.25 ± 9% interrupts.CPU155.RES:Rescheduling_interrupts
2276 ± 20% +446.5% 12442 ± 7% interrupts.CPU156.CAL:Function_call_interrupts
689.75 ± 20% -65.4% 238.75 ± 36% interrupts.CPU156.NMI:Non-maskable_interrupts
689.75 ± 20% -65.4% 238.75 ± 36% interrupts.CPU156.PMI:Performance_monitoring_interrupts
102.25 ± 37% +453.3% 565.75 ± 13% interrupts.CPU156.RES:Rescheduling_interrupts
2513 ± 22% +396.6% 12481 ± 10% interrupts.CPU157.CAL:Function_call_interrupts
663.75 ± 20% -57.4% 282.75 ± 24% interrupts.CPU157.NMI:Non-maskable_interrupts
663.75 ± 20% -57.4% 282.75 ± 24% interrupts.CPU157.PMI:Performance_monitoring_interrupts
104.00 ± 39% +428.8% 550.00 ± 8% interrupts.CPU157.RES:Rescheduling_interrupts
2570 ± 22% +425.2% 13501 ± 22% interrupts.CPU158.CAL:Function_call_interrupts
753.50 ± 29% -62.2% 284.75 ± 25% interrupts.CPU158.NMI:Non-maskable_interrupts
753.50 ± 29% -62.2% 284.75 ± 25% interrupts.CPU158.PMI:Performance_monitoring_interrupts
99.50 ± 23% +469.3% 566.50 ± 4% interrupts.CPU158.RES:Rescheduling_interrupts
80.00 ± 82% +148.8% 199.00 ± 18% interrupts.CPU158.TLB:TLB_shootdowns
2700 ± 23% +335.8% 11767 ± 7% interrupts.CPU159.CAL:Function_call_interrupts
626.75 ± 34% -62.7% 234.00 ± 29% interrupts.CPU159.NMI:Non-maskable_interrupts
626.75 ± 34% -62.7% 234.00 ± 29% interrupts.CPU159.PMI:Performance_monitoring_interrupts
142.50 ± 46% +244.7% 491.25 ± 8% interrupts.CPU159.RES:Rescheduling_interrupts
2221 ± 17% +445.5% 12114 ± 11% interrupts.CPU16.CAL:Function_call_interrupts
837.00 ± 16% -64.1% 300.50 ± 27% interrupts.CPU16.NMI:Non-maskable_interrupts
837.00 ± 16% -64.1% 300.50 ± 27% interrupts.CPU16.PMI:Performance_monitoring_interrupts
104.75 ± 23% +471.6% 598.75 ± 5% interrupts.CPU16.RES:Rescheduling_interrupts
2407 ± 21% +411.4% 12310 ± 11% interrupts.CPU160.CAL:Function_call_interrupts
90.25 ± 26% +461.2% 506.50 ± 4% interrupts.CPU160.RES:Rescheduling_interrupts
2433 ± 24% +404.8% 12281 ± 9% interrupts.CPU161.CAL:Function_call_interrupts
577.75 ± 52% -53.1% 270.75 ± 25% interrupts.CPU161.NMI:Non-maskable_interrupts
577.75 ± 52% -53.1% 270.75 ± 25% interrupts.CPU161.PMI:Performance_monitoring_interrupts
102.25 ± 23% +388.8% 499.75 ± 3% interrupts.CPU161.RES:Rescheduling_interrupts
85.75 ± 74% +116.0% 185.25 ± 17% interrupts.CPU161.TLB:TLB_shootdowns
2371 ± 23% +415.9% 12237 ± 10% interrupts.CPU162.CAL:Function_call_interrupts
648.75 ± 38% -57.0% 278.75 ± 25% interrupts.CPU162.NMI:Non-maskable_interrupts
648.75 ± 38% -57.0% 278.75 ± 25% interrupts.CPU162.PMI:Performance_monitoring_interrupts
127.50 ± 32% +363.1% 590.50 ± 9% interrupts.CPU162.RES:Rescheduling_interrupts
2301 ± 26% +422.3% 12019 ± 8% interrupts.CPU163.CAL:Function_call_interrupts
572.00 ± 36% -58.3% 238.75 ± 33% interrupts.CPU163.NMI:Non-maskable_interrupts
572.00 ± 36% -58.3% 238.75 ± 33% interrupts.CPU163.PMI:Performance_monitoring_interrupts
97.25 ± 25% +451.7% 536.50 ± 8% interrupts.CPU163.RES:Rescheduling_interrupts
2421 ± 21% +402.2% 12160 ± 6% interrupts.CPU164.CAL:Function_call_interrupts
610.75 ± 40% -61.6% 234.25 ± 35% interrupts.CPU164.NMI:Non-maskable_interrupts
610.75 ± 40% -61.6% 234.25 ± 35% interrupts.CPU164.PMI:Performance_monitoring_interrupts
103.50 ± 21% +380.0% 496.75 ± 6% interrupts.CPU164.RES:Rescheduling_interrupts
2486 ± 23% +384.2% 12039 ± 7% interrupts.CPU165.CAL:Function_call_interrupts
523.75 ± 30% -55.6% 232.50 ± 38% interrupts.CPU165.NMI:Non-maskable_interrupts
523.75 ± 30% -55.6% 232.50 ± 38% interrupts.CPU165.PMI:Performance_monitoring_interrupts
116.75 ± 44% +365.1% 543.00 ± 6% interrupts.CPU165.RES:Rescheduling_interrupts
2401 ± 28% +412.7% 12313 ± 7% interrupts.CPU166.CAL:Function_call_interrupts
866.50 ± 28% -72.5% 238.50 ± 35% interrupts.CPU166.NMI:Non-maskable_interrupts
866.50 ± 28% -72.5% 238.50 ± 35% interrupts.CPU166.PMI:Performance_monitoring_interrupts
112.25 ± 58% +366.1% 523.25 ± 9% interrupts.CPU166.RES:Rescheduling_interrupts
2708 ± 25% +355.6% 12338 ± 9% interrupts.CPU167.CAL:Function_call_interrupts
108.50 ± 34% +376.3% 516.75 ± 4% interrupts.CPU167.RES:Rescheduling_interrupts
2216 ± 8% +482.2% 12906 ± 15% interrupts.CPU168.CAL:Function_call_interrupts
89.25 ± 3% +556.9% 586.25 ± 16% interrupts.CPU168.RES:Rescheduling_interrupts
2053 ± 5% +445.2% 11193 ± 12% interrupts.CPU169.CAL:Function_call_interrupts
582.75 ± 39% -53.7% 270.00 ± 25% interrupts.CPU169.NMI:Non-maskable_interrupts
582.75 ± 39% -53.7% 270.00 ± 25% interrupts.CPU169.PMI:Performance_monitoring_interrupts
91.00 ± 10% +515.1% 559.75 ± 12% interrupts.CPU169.RES:Rescheduling_interrupts
2290 ± 11% +419.7% 11904 ± 9% interrupts.CPU17.CAL:Function_call_interrupts
652.25 ± 17% -55.4% 290.75 ± 25% interrupts.CPU17.NMI:Non-maskable_interrupts
652.25 ± 17% -55.4% 290.75 ± 25% interrupts.CPU17.PMI:Performance_monitoring_interrupts
85.75 ± 13% +609.0% 608.00 ± 10% interrupts.CPU17.RES:Rescheduling_interrupts
2642 ± 11% +341.5% 11666 ± 12% interrupts.CPU170.CAL:Function_call_interrupts
464.75 ± 16% -38.7% 285.00 ± 25% interrupts.CPU170.NMI:Non-maskable_interrupts
464.75 ± 16% -38.7% 285.00 ± 25% interrupts.CPU170.PMI:Performance_monitoring_interrupts
102.00 ± 11% +454.9% 566.00 ± 12% interrupts.CPU170.RES:Rescheduling_interrupts
2208 ± 19% +428.6% 11674 ± 14% interrupts.CPU171.CAL:Function_call_interrupts
423.00 ± 20% -33.5% 281.50 ± 25% interrupts.CPU171.NMI:Non-maskable_interrupts
423.00 ± 20% -33.5% 281.50 ± 25% interrupts.CPU171.PMI:Performance_monitoring_interrupts
89.00 ± 12% +553.9% 582.00 ± 11% interrupts.CPU171.RES:Rescheduling_interrupts
2398 ± 19% +384.9% 11630 ± 15% interrupts.CPU172.CAL:Function_call_interrupts
93.25 ± 11% +538.3% 595.25 ± 8% interrupts.CPU172.RES:Rescheduling_interrupts
2535 ± 17% +353.2% 11492 ± 13% interrupts.CPU173.CAL:Function_call_interrupts
788.75 ± 33% -64.4% 280.50 ± 25% interrupts.CPU173.NMI:Non-maskable_interrupts
788.75 ± 33% -64.4% 280.50 ± 25% interrupts.CPU173.PMI:Performance_monitoring_interrupts
79.75 ± 13% +621.3% 575.25 ± 13% interrupts.CPU173.RES:Rescheduling_interrupts
39.50 ±163% +267.7% 145.25 ± 35% interrupts.CPU173.TLB:TLB_shootdowns
2371 ± 13% +399.8% 11850 ± 11% interrupts.CPU174.CAL:Function_call_interrupts
767.75 ± 14% -62.3% 289.75 ± 27% interrupts.CPU174.NMI:Non-maskable_interrupts
767.75 ± 14% -62.3% 289.75 ± 27% interrupts.CPU174.PMI:Performance_monitoring_interrupts
92.50 ± 18% +559.2% 609.75 ± 13% interrupts.CPU174.RES:Rescheduling_interrupts
2618 ± 14% +351.9% 11833 ± 15% interrupts.CPU175.CAL:Function_call_interrupts
688.00 ± 34% -64.8% 242.00 ± 34% interrupts.CPU175.NMI:Non-maskable_interrupts
688.00 ± 34% -64.8% 242.00 ± 34% interrupts.CPU175.PMI:Performance_monitoring_interrupts
94.00 ± 11% +499.2% 563.25 ± 12% interrupts.CPU175.RES:Rescheduling_interrupts
2190 ± 8% +426.1% 11520 ± 13% interrupts.CPU176.CAL:Function_call_interrupts
91.00 +550.5% 592.00 ± 9% interrupts.CPU176.RES:Rescheduling_interrupts
2348 ± 19% +392.3% 11562 ± 14% interrupts.CPU177.CAL:Function_call_interrupts
733.50 ± 25% -67.0% 242.25 ± 32% interrupts.CPU177.NMI:Non-maskable_interrupts
733.50 ± 25% -67.0% 242.25 ± 32% interrupts.CPU177.PMI:Performance_monitoring_interrupts
91.50 ± 19% +515.0% 562.75 ± 11% interrupts.CPU177.RES:Rescheduling_interrupts
2615 ± 14% +351.9% 11820 ± 14% interrupts.CPU178.CAL:Function_call_interrupts
582.00 ± 20% -53.7% 269.25 ± 24% interrupts.CPU178.NMI:Non-maskable_interrupts
582.00 ± 20% -53.7% 269.25 ± 24% interrupts.CPU178.PMI:Performance_monitoring_interrupts
89.25 ± 16% +538.9% 570.25 ± 14% interrupts.CPU178.RES:Rescheduling_interrupts
2363 ± 17% +408.5% 12016 ± 12% interrupts.CPU179.CAL:Function_call_interrupts
613.50 ± 25% -48.7% 315.00 ± 4% interrupts.CPU179.NMI:Non-maskable_interrupts
613.50 ± 25% -48.7% 315.00 ± 4% interrupts.CPU179.PMI:Performance_monitoring_interrupts
84.25 ± 19% +535.0% 535.00 ± 10% interrupts.CPU179.RES:Rescheduling_interrupts
2323 ± 17% +438.9% 12519 ± 12% interrupts.CPU18.CAL:Function_call_interrupts
667.50 ± 23% -54.3% 305.25 ± 32% interrupts.CPU18.NMI:Non-maskable_interrupts
667.50 ± 23% -54.3% 305.25 ± 32% interrupts.CPU18.PMI:Performance_monitoring_interrupts
96.00 ± 20% +515.6% 591.00 ± 5% interrupts.CPU18.RES:Rescheduling_interrupts
42.25 ±137% +234.9% 141.50 ± 22% interrupts.CPU18.TLB:TLB_shootdowns
2238 ± 13% +434.1% 11956 ± 12% interrupts.CPU180.CAL:Function_call_interrupts
85.50 ± 6% +583.3% 584.25 ± 10% interrupts.CPU180.RES:Rescheduling_interrupts
2208 ± 13% +423.9% 11570 ± 10% interrupts.CPU181.CAL:Function_call_interrupts
686.75 ± 28% -60.7% 270.00 ± 24% interrupts.CPU181.NMI:Non-maskable_interrupts
686.75 ± 28% -60.7% 270.00 ± 24% interrupts.CPU181.PMI:Performance_monitoring_interrupts
90.50 ± 10% +553.9% 591.75 ± 7% interrupts.CPU181.RES:Rescheduling_interrupts
2230 ± 19% +416.0% 11510 ± 11% interrupts.CPU182.CAL:Function_call_interrupts
524.75 ± 28% -47.7% 274.25 ± 25% interrupts.CPU182.NMI:Non-maskable_interrupts
524.75 ± 28% -47.7% 274.25 ± 25% interrupts.CPU182.PMI:Performance_monitoring_interrupts
79.00 ± 11% +618.0% 567.25 ± 11% interrupts.CPU182.RES:Rescheduling_interrupts
2319 ± 13% +400.7% 11613 ± 13% interrupts.CPU183.CAL:Function_call_interrupts
685.00 ± 20% -59.1% 280.25 ± 24% interrupts.CPU183.NMI:Non-maskable_interrupts
685.00 ± 20% -59.1% 280.25 ± 24% interrupts.CPU183.PMI:Performance_monitoring_interrupts
84.50 ± 12% +584.0% 578.00 ± 13% interrupts.CPU183.RES:Rescheduling_interrupts
146.50 ± 17% +31.2% 192.25 ± 11% interrupts.CPU183.TLB:TLB_shootdowns
2148 ± 20% +453.3% 11888 ± 12% interrupts.CPU184.CAL:Function_call_interrupts
759.25 ± 12% -64.3% 271.25 ± 25% interrupts.CPU184.NMI:Non-maskable_interrupts
759.25 ± 12% -64.3% 271.25 ± 25% interrupts.CPU184.PMI:Performance_monitoring_interrupts
79.00 ± 20% +621.8% 570.25 ± 11% interrupts.CPU184.RES:Rescheduling_interrupts
2426 ± 10% +389.0% 11862 ± 14% interrupts.CPU185.CAL:Function_call_interrupts
787.50 ± 20% -65.4% 272.50 ± 25% interrupts.CPU185.NMI:Non-maskable_interrupts
787.50 ± 20% -65.4% 272.50 ± 25% interrupts.CPU185.PMI:Performance_monitoring_interrupts
91.75 ± 3% +507.4% 557.25 ± 11% interrupts.CPU185.RES:Rescheduling_interrupts
2325 ± 10% +416.5% 12012 ± 13% interrupts.CPU186.CAL:Function_call_interrupts
577.25 ± 30% -53.5% 268.50 ± 23% interrupts.CPU186.NMI:Non-maskable_interrupts
577.25 ± 30% -53.5% 268.50 ± 23% interrupts.CPU186.PMI:Performance_monitoring_interrupts
97.75 ± 12% +526.9% 612.75 ± 8% interrupts.CPU186.RES:Rescheduling_interrupts
2359 ± 13% +410.1% 12034 ± 13% interrupts.CPU187.CAL:Function_call_interrupts
633.25 ± 29% -55.0% 285.00 ± 23% interrupts.CPU187.NMI:Non-maskable_interrupts
633.25 ± 29% -55.0% 285.00 ± 23% interrupts.CPU187.PMI:Performance_monitoring_interrupts
88.25 ± 7% +548.2% 572.00 ± 12% interrupts.CPU187.RES:Rescheduling_interrupts
2492 ± 10% +377.4% 11897 ± 12% interrupts.CPU188.CAL:Function_call_interrupts
88.75 ± 7% +545.1% 572.50 ± 11% interrupts.CPU188.RES:Rescheduling_interrupts
2492 ± 21% +383.5% 12052 ± 13% interrupts.CPU189.CAL:Function_call_interrupts
83.50 ± 15% +585.9% 572.75 ± 12% interrupts.CPU189.RES:Rescheduling_interrupts
2112 ± 12% +486.8% 12396 ± 10% interrupts.CPU19.CAL:Function_call_interrupts
857.75 ± 25% -68.4% 271.25 ± 24% interrupts.CPU19.NMI:Non-maskable_interrupts
857.75 ± 25% -68.4% 271.25 ± 24% interrupts.CPU19.PMI:Performance_monitoring_interrupts
113.00 ± 45% +433.6% 603.00 ± 7% interrupts.CPU19.RES:Rescheduling_interrupts
2504 ± 17% +380.6% 12035 ± 12% interrupts.CPU190.CAL:Function_call_interrupts
85.75 ± 8% +563.3% 568.75 ± 7% interrupts.CPU190.RES:Rescheduling_interrupts
2150 ± 14% +425.5% 11298 ± 12% interrupts.CPU191.CAL:Function_call_interrupts
620.50 ± 27% -48.6% 319.00 ± 6% interrupts.CPU191.NMI:Non-maskable_interrupts
620.50 ± 27% -48.6% 319.00 ± 6% interrupts.CPU191.PMI:Performance_monitoring_interrupts
86.50 ± 8% +528.6% 543.75 ± 14% interrupts.CPU191.RES:Rescheduling_interrupts
2399 ± 21% +399.3% 11982 ± 11% interrupts.CPU2.CAL:Function_call_interrupts
96.75 ± 14% +480.4% 561.50 ± 2% interrupts.CPU2.RES:Rescheduling_interrupts
23.75 ±136% +531.6% 150.00 ± 39% interrupts.CPU2.TLB:TLB_shootdowns
2620 ± 23% +353.1% 11871 ± 16% interrupts.CPU20.CAL:Function_call_interrupts
733.00 ± 19% -60.5% 289.25 ± 8% interrupts.CPU20.NMI:Non-maskable_interrupts
733.00 ± 19% -60.5% 289.25 ± 8% interrupts.CPU20.PMI:Performance_monitoring_interrupts
128.25 ± 46% +342.3% 567.25 ± 7% interrupts.CPU20.RES:Rescheduling_interrupts
2243 ± 15% +445.3% 12234 ± 12% interrupts.CPU21.CAL:Function_call_interrupts
974.00 ± 27% -68.4% 308.00 ± 5% interrupts.CPU21.NMI:Non-maskable_interrupts
974.00 ± 27% -68.4% 308.00 ± 5% interrupts.CPU21.PMI:Performance_monitoring_interrupts
118.75 ± 35% +396.6% 589.75 ± 4% interrupts.CPU21.RES:Rescheduling_interrupts
2692 ± 8% +355.7% 12268 ± 10% interrupts.CPU22.CAL:Function_call_interrupts
934.00 ± 13% -67.2% 306.00 ± 12% interrupts.CPU22.NMI:Non-maskable_interrupts
934.00 ± 13% -67.2% 306.00 ± 12% interrupts.CPU22.PMI:Performance_monitoring_interrupts
105.00 ± 26% +448.3% 575.75 ± 4% interrupts.CPU22.RES:Rescheduling_interrupts
2237 ± 22% +447.9% 12260 ± 11% interrupts.CPU23.CAL:Function_call_interrupts
892.25 ± 33% -64.6% 316.25 ± 4% interrupts.CPU23.NMI:Non-maskable_interrupts
892.25 ± 33% -64.6% 316.25 ± 4% interrupts.CPU23.PMI:Performance_monitoring_interrupts
88.75 ± 14% +538.0% 566.25 interrupts.CPU23.RES:Rescheduling_interrupts
2122 ± 13% +509.9% 12946 ± 11% interrupts.CPU24.CAL:Function_call_interrupts
858.25 ± 18% -68.3% 272.00 ± 27% interrupts.CPU24.NMI:Non-maskable_interrupts
858.25 ± 18% -68.3% 272.00 ± 27% interrupts.CPU24.PMI:Performance_monitoring_interrupts
94.25 ± 15% +514.9% 579.50 ± 2% interrupts.CPU24.RES:Rescheduling_interrupts
2380 ± 25% +387.3% 11602 ± 8% interrupts.CPU25.CAL:Function_call_interrupts
862.75 ± 31% -64.3% 307.75 ± 2% interrupts.CPU25.NMI:Non-maskable_interrupts
862.75 ± 31% -64.3% 307.75 ± 2% interrupts.CPU25.PMI:Performance_monitoring_interrupts
91.75 ± 10% +503.3% 553.50 ± 6% interrupts.CPU25.RES:Rescheduling_interrupts
2430 ± 20% +360.5% 11194 ± 8% interrupts.CPU26.CAL:Function_call_interrupts
682.25 ± 25% -60.1% 272.50 ± 22% interrupts.CPU26.NMI:Non-maskable_interrupts
682.25 ± 25% -60.1% 272.50 ± 22% interrupts.CPU26.PMI:Performance_monitoring_interrupts
90.75 ± 10% +549.6% 589.50 ± 11% interrupts.CPU26.RES:Rescheduling_interrupts
2753 ± 29% +329.7% 11831 ± 10% interrupts.CPU27.CAL:Function_call_interrupts
88.25 ± 22% +513.9% 541.75 ± 2% interrupts.CPU27.RES:Rescheduling_interrupts
2153 ± 18% +430.9% 11435 ± 8% interrupts.CPU28.CAL:Function_call_interrupts
84.00 ± 10% +544.6% 541.50 ± 3% interrupts.CPU28.RES:Rescheduling_interrupts
2390 ± 26% +392.4% 11769 ± 11% interrupts.CPU29.CAL:Function_call_interrupts
89.00 ± 16% +534.6% 564.75 ± 12% interrupts.CPU29.RES:Rescheduling_interrupts
2370 ± 10% +414.5% 12194 ± 13% interrupts.CPU3.CAL:Function_call_interrupts
102.75 ± 18% +435.5% 550.25 ± 6% interrupts.CPU3.RES:Rescheduling_interrupts
2335 ± 25% +402.0% 11723 ± 9% interrupts.CPU30.CAL:Function_call_interrupts
914.50 ± 22% -65.3% 317.75 ± 7% interrupts.CPU30.NMI:Non-maskable_interrupts
914.50 ± 22% -65.3% 317.75 ± 7% interrupts.CPU30.PMI:Performance_monitoring_interrupts
87.50 ± 10% +525.4% 547.25 ± 4% interrupts.CPU30.RES:Rescheduling_interrupts
2170 ± 14% +441.0% 11742 ± 9% interrupts.CPU31.CAL:Function_call_interrupts
875.00 ± 15% -61.8% 334.00 ± 5% interrupts.CPU31.NMI:Non-maskable_interrupts
875.00 ± 15% -61.8% 334.00 ± 5% interrupts.CPU31.PMI:Performance_monitoring_interrupts
87.75 ± 7% +551.0% 571.25 ± 3% interrupts.CPU31.RES:Rescheduling_interrupts
2292 ± 17% +405.6% 11593 ± 8% interrupts.CPU32.CAL:Function_call_interrupts
887.50 ± 9% -69.0% 275.25 ± 28% interrupts.CPU32.NMI:Non-maskable_interrupts
887.50 ± 9% -69.0% 275.25 ± 28% interrupts.CPU32.PMI:Performance_monitoring_interrupts
82.75 ± 13% +590.6% 571.50 ± 4% interrupts.CPU32.RES:Rescheduling_interrupts
2208 ± 16% +419.1% 11464 ± 9% interrupts.CPU33.CAL:Function_call_interrupts
840.25 ± 21% -67.7% 271.25 ± 26% interrupts.CPU33.NMI:Non-maskable_interrupts
840.25 ± 21% -67.7% 271.25 ± 26% interrupts.CPU33.PMI:Performance_monitoring_interrupts
86.50 ± 10% +520.8% 537.00 ± 3% interrupts.CPU33.RES:Rescheduling_interrupts
2385 ± 15% +398.7% 11896 ± 8% interrupts.CPU34.CAL:Function_call_interrupts
654.25 ± 32% -58.0% 274.75 ± 27% interrupts.CPU34.NMI:Non-maskable_interrupts
654.25 ± 32% -58.0% 274.75 ± 27% interrupts.CPU34.PMI:Performance_monitoring_interrupts
87.00 ± 10% +569.8% 582.75 ± 6% interrupts.CPU34.RES:Rescheduling_interrupts
2350 ± 23% +401.3% 11785 ± 9% interrupts.CPU35.CAL:Function_call_interrupts
89.00 ± 9% +507.0% 540.25 ± 3% interrupts.CPU35.RES:Rescheduling_interrupts
2095 ± 13% +468.8% 11919 ± 9% interrupts.CPU36.CAL:Function_call_interrupts
597.00 ± 35% -53.6% 277.00 ± 29% interrupts.CPU36.NMI:Non-maskable_interrupts
597.00 ± 35% -53.6% 277.00 ± 29% interrupts.CPU36.PMI:Performance_monitoring_interrupts
76.75 ± 2% +632.6% 562.25 ± 8% interrupts.CPU36.RES:Rescheduling_interrupts
2092 ± 17% +454.5% 11599 ± 10% interrupts.CPU37.CAL:Function_call_interrupts
735.25 ± 23% -68.1% 234.50 ± 36% interrupts.CPU37.NMI:Non-maskable_interrupts
735.25 ± 23% -68.1% 234.50 ± 36% interrupts.CPU37.PMI:Performance_monitoring_interrupts
92.75 ± 10% +507.0% 563.00 ± 8% interrupts.CPU37.RES:Rescheduling_interrupts
2215 ± 13% +426.0% 11651 ± 10% interrupts.CPU38.CAL:Function_call_interrupts
633.50 ± 15% -54.8% 286.25 ± 26% interrupts.CPU38.NMI:Non-maskable_interrupts
633.50 ± 15% -54.8% 286.25 ± 26% interrupts.CPU38.PMI:Performance_monitoring_interrupts
102.50 ± 10% +454.6% 568.50 ± 3% interrupts.CPU38.RES:Rescheduling_interrupts
2136 ± 17% +441.6% 11571 ± 11% interrupts.CPU39.CAL:Function_call_interrupts
662.50 ± 41% -53.6% 307.50 ± 6% interrupts.CPU39.NMI:Non-maskable_interrupts
662.50 ± 41% -53.6% 307.50 ± 6% interrupts.CPU39.PMI:Performance_monitoring_interrupts
87.25 ± 16% +543.0% 561.00 ± 7% interrupts.CPU39.RES:Rescheduling_interrupts
2402 ± 13% +414.5% 12360 ± 13% interrupts.CPU4.CAL:Function_call_interrupts
816.75 ± 32% -64.8% 287.75 ± 19% interrupts.CPU4.NMI:Non-maskable_interrupts
816.75 ± 32% -64.8% 287.75 ± 19% interrupts.CPU4.PMI:Performance_monitoring_interrupts
90.50 ± 10% +566.6% 603.25 ± 7% interrupts.CPU4.RES:Rescheduling_interrupts
67.75 ± 58% +125.8% 153.00 ± 31% interrupts.CPU4.TLB:TLB_shootdowns
2253 ± 17% +424.5% 11819 ± 9% interrupts.CPU40.CAL:Function_call_interrupts
668.25 ± 24% -60.7% 262.75 ± 26% interrupts.CPU40.NMI:Non-maskable_interrupts
668.25 ± 24% -60.7% 262.75 ± 26% interrupts.CPU40.PMI:Performance_monitoring_interrupts
81.75 ± 9% +605.8% 577.00 ± 7% interrupts.CPU40.RES:Rescheduling_interrupts
95.00 ± 98% +160.3% 247.25 ± 21% interrupts.CPU40.TLB:TLB_shootdowns
2255 ± 9% +425.1% 11842 ± 9% interrupts.CPU41.CAL:Function_call_interrupts
801.50 ± 18% -60.7% 315.25 ± 7% interrupts.CPU41.NMI:Non-maskable_interrupts
801.50 ± 18% -60.7% 315.25 ± 7% interrupts.CPU41.PMI:Performance_monitoring_interrupts
96.50 ± 12% +487.8% 567.25 ± 4% interrupts.CPU41.RES:Rescheduling_interrupts
2304 ± 12% +408.5% 11718 ± 9% interrupts.CPU42.CAL:Function_call_interrupts
576.00 ± 15% -44.7% 318.50 ± 7% interrupts.CPU42.NMI:Non-maskable_interrupts
576.00 ± 15% -44.7% 318.50 ± 7% interrupts.CPU42.PMI:Performance_monitoring_interrupts
86.25 ± 12% +560.6% 569.75 ± 5% interrupts.CPU42.RES:Rescheduling_interrupts
2416 ± 12% +384.4% 11705 ± 11% interrupts.CPU43.CAL:Function_call_interrupts
629.75 ± 22% -49.5% 318.25 ± 9% interrupts.CPU43.NMI:Non-maskable_interrupts
629.75 ± 22% -49.5% 318.25 ± 9% interrupts.CPU43.PMI:Performance_monitoring_interrupts
89.25 ± 17% +526.1% 558.75 ± 7% interrupts.CPU43.RES:Rescheduling_interrupts
2509 ± 11% +370.7% 11813 ± 10% interrupts.CPU44.CAL:Function_call_interrupts
593.00 ± 40% -54.3% 271.00 ± 27% interrupts.CPU44.NMI:Non-maskable_interrupts
593.00 ± 40% -54.3% 271.00 ± 27% interrupts.CPU44.PMI:Performance_monitoring_interrupts
95.00 ± 23% +462.9% 534.75 ± 4% interrupts.CPU44.RES:Rescheduling_interrupts
2177 ± 21% +432.8% 11602 ± 9% interrupts.CPU45.CAL:Function_call_interrupts
920.75 ± 27% -66.3% 310.00 ± 9% interrupts.CPU45.NMI:Non-maskable_interrupts
920.75 ± 27% -66.3% 310.00 ± 9% interrupts.CPU45.PMI:Performance_monitoring_interrupts
82.00 ± 24% +588.7% 564.75 ± 4% interrupts.CPU45.RES:Rescheduling_interrupts
2375 ± 18% +400.7% 11892 ± 9% interrupts.CPU46.CAL:Function_call_interrupts
692.00 ± 22% -53.1% 324.25 ± 6% interrupts.CPU46.NMI:Non-maskable_interrupts
692.00 ± 22% -53.1% 324.25 ± 6% interrupts.CPU46.PMI:Performance_monitoring_interrupts
79.50 ± 10% +598.7% 555.50 ± 5% interrupts.CPU46.RES:Rescheduling_interrupts
2041 ± 21% +473.4% 11706 ± 9% interrupts.CPU47.CAL:Function_call_interrupts
878.75 ± 16% -63.6% 319.75 ± 4% interrupts.CPU47.NMI:Non-maskable_interrupts
878.75 ± 16% -63.6% 319.75 ± 4% interrupts.CPU47.PMI:Performance_monitoring_interrupts
86.25 ± 11% +524.6% 538.75 ± 6% interrupts.CPU47.RES:Rescheduling_interrupts
3420 ± 43% +291.2% 13381 ± 13% interrupts.CPU48.CAL:Function_call_interrupts
740.75 ± 6% -56.1% 325.50 ± 7% interrupts.CPU48.NMI:Non-maskable_interrupts
740.75 ± 6% -56.1% 325.50 ± 7% interrupts.CPU48.PMI:Performance_monitoring_interrupts
135.50 ± 35% +319.6% 568.50 ± 6% interrupts.CPU48.RES:Rescheduling_interrupts
2409 ± 24% +397.2% 11978 ± 11% interrupts.CPU49.CAL:Function_call_interrupts
608.25 ± 16% -49.8% 305.25 ± 7% interrupts.CPU49.NMI:Non-maskable_interrupts
608.25 ± 16% -49.8% 305.25 ± 7% interrupts.CPU49.PMI:Performance_monitoring_interrupts
128.75 ± 39% +305.8% 522.50 ± 9% interrupts.CPU49.RES:Rescheduling_interrupts
2299 ± 26% +424.7% 12062 ± 11% interrupts.CPU5.CAL:Function_call_interrupts
111.50 ± 12% +435.2% 596.75 ± 8% interrupts.CPU5.RES:Rescheduling_interrupts
25.25 ±168% +462.4% 142.00 ± 24% interrupts.CPU5.TLB:TLB_shootdowns
2401 ± 25% +426.8% 12650 ± 8% interrupts.CPU50.CAL:Function_call_interrupts
675.75 ± 37% -54.5% 307.25 ± 3% interrupts.CPU50.NMI:Non-maskable_interrupts
675.75 ± 37% -54.5% 307.25 ± 3% interrupts.CPU50.PMI:Performance_monitoring_interrupts
98.00 ± 28% +390.8% 481.00 ± 5% interrupts.CPU50.RES:Rescheduling_interrupts
2622 ± 15% +361.0% 12089 ± 11% interrupts.CPU51.CAL:Function_call_interrupts
991.25 ± 5% -66.2% 334.75 ± 12% interrupts.CPU51.NMI:Non-maskable_interrupts
991.25 ± 5% -66.2% 334.75 ± 12% interrupts.CPU51.PMI:Performance_monitoring_interrupts
149.25 ± 65% +280.7% 568.25 ± 8% interrupts.CPU51.RES:Rescheduling_interrupts
2565 ± 13% +358.3% 11757 ± 10% interrupts.CPU52.CAL:Function_call_interrupts
111.00 ± 24% +395.9% 550.50 ± 12% interrupts.CPU52.RES:Rescheduling_interrupts
2873 ± 21% +330.3% 12364 ± 10% interrupts.CPU53.CAL:Function_call_interrupts
103.00 ± 22% +415.5% 531.00 ± 9% interrupts.CPU53.RES:Rescheduling_interrupts
2748 ± 30% +345.0% 12227 ± 10% interrupts.CPU54.CAL:Function_call_interrupts
115.75 ± 29% +351.8% 523.00 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts
2349 ± 20% +407.6% 11926 ± 10% interrupts.CPU55.CAL:Function_call_interrupts
649.75 ± 49% -49.2% 329.75 ± 5% interrupts.CPU55.NMI:Non-maskable_interrupts
649.75 ± 49% -49.2% 329.75 ± 5% interrupts.CPU55.PMI:Performance_monitoring_interrupts
103.25 ± 24% +398.8% 515.00 ± 4% interrupts.CPU55.RES:Rescheduling_interrupts
2361 ± 22% +399.4% 11794 ± 8% interrupts.CPU56.CAL:Function_call_interrupts
539.00 ± 26% -42.5% 309.75 interrupts.CPU56.NMI:Non-maskable_interrupts
539.00 ± 26% -42.5% 309.75 interrupts.CPU56.PMI:Performance_monitoring_interrupts
98.25 ± 21% +430.3% 521.00 ± 12% interrupts.CPU56.RES:Rescheduling_interrupts
112.75 ± 30% +51.7% 171.00 ± 10% interrupts.CPU56.TLB:TLB_shootdowns
2586 ± 27% +371.3% 12188 ± 9% interrupts.CPU57.CAL:Function_call_interrupts
759.75 ± 29% -57.6% 322.50 ± 10% interrupts.CPU57.NMI:Non-maskable_interrupts
759.75 ± 29% -57.6% 322.50 ± 10% interrupts.CPU57.PMI:Performance_monitoring_interrupts
88.75 ± 14% +493.8% 527.00 interrupts.CPU57.RES:Rescheduling_interrupts
2521 ± 24% +378.8% 12072 ± 9% interrupts.CPU58.CAL:Function_call_interrupts
788.50 ± 29% -60.8% 308.75 ± 5% interrupts.CPU58.NMI:Non-maskable_interrupts
788.50 ± 29% -60.8% 308.75 ± 5% interrupts.CPU58.PMI:Performance_monitoring_interrupts
127.00 ± 46% +311.0% 522.00 ± 6% interrupts.CPU58.RES:Rescheduling_interrupts
2312 ± 25% +422.9% 12090 ± 8% interrupts.CPU59.CAL:Function_call_interrupts
663.25 ± 14% -57.8% 279.75 ± 25% interrupts.CPU59.NMI:Non-maskable_interrupts
663.25 ± 14% -57.8% 279.75 ± 25% interrupts.CPU59.PMI:Performance_monitoring_interrupts
121.50 ± 20% +356.6% 554.75 ± 13% interrupts.CPU59.RES:Rescheduling_interrupts
2278 ± 14% +417.2% 11780 ± 12% interrupts.CPU6.CAL:Function_call_interrupts
894.25 ± 22% -63.8% 324.00 ± 3% interrupts.CPU6.NMI:Non-maskable_interrupts
894.25 ± 22% -63.8% 324.00 ± 3% interrupts.CPU6.PMI:Performance_monitoring_interrupts
119.25 ± 17% +353.7% 541.00 ± 8% interrupts.CPU6.RES:Rescheduling_interrupts
2423 ± 20% +399.2% 12097 ± 8% interrupts.CPU60.CAL:Function_call_interrupts
588.00 ± 15% -60.5% 232.25 ± 28% interrupts.CPU60.NMI:Non-maskable_interrupts
588.00 ± 15% -60.5% 232.25 ± 28% interrupts.CPU60.PMI:Performance_monitoring_interrupts
146.00 ± 52% +249.0% 509.50 ± 6% interrupts.CPU60.RES:Rescheduling_interrupts
2814 ± 30% +341.2% 12414 ± 9% interrupts.CPU61.CAL:Function_call_interrupts
746.75 ± 24% -68.0% 239.25 ± 30% interrupts.CPU61.NMI:Non-maskable_interrupts
746.75 ± 24% -68.0% 239.25 ± 30% interrupts.CPU61.PMI:Performance_monitoring_interrupts
136.25 ± 37% +335.4% 593.25 ± 12% interrupts.CPU61.RES:Rescheduling_interrupts
2779 ± 17% +339.5% 12216 ± 6% interrupts.CPU62.CAL:Function_call_interrupts
647.75 ± 25% -63.2% 238.25 ± 32% interrupts.CPU62.NMI:Non-maskable_interrupts
647.75 ± 25% -63.2% 238.25 ± 32% interrupts.CPU62.PMI:Performance_monitoring_interrupts
131.50 ± 54% +296.2% 521.00 ± 6% interrupts.CPU62.RES:Rescheduling_interrupts
2831 ± 24% +322.3% 11956 ± 8% interrupts.CPU63.CAL:Function_call_interrupts
714.25 ± 28% -67.4% 232.75 ± 31% interrupts.CPU63.NMI:Non-maskable_interrupts
714.25 ± 28% -67.4% 232.75 ± 31% interrupts.CPU63.PMI:Performance_monitoring_interrupts
112.50 ± 32% +365.1% 523.25 ± 5% interrupts.CPU63.RES:Rescheduling_interrupts
2512 ± 21% +399.1% 12538 ± 7% interrupts.CPU64.CAL:Function_call_interrupts
789.50 ± 25% -67.0% 260.75 ± 26% interrupts.CPU64.NMI:Non-maskable_interrupts
789.50 ± 25% -67.0% 260.75 ± 26% interrupts.CPU64.PMI:Performance_monitoring_interrupts
91.75 ± 17% +447.1% 502.00 ± 9% interrupts.CPU64.RES:Rescheduling_interrupts
2382 ± 15% +403.9% 12006 ± 8% interrupts.CPU65.CAL:Function_call_interrupts
96.00 ± 9% +436.2% 514.75 ± 3% interrupts.CPU65.RES:Rescheduling_interrupts
63.00 ±111% +181.3% 177.25 ± 37% interrupts.CPU65.TLB:TLB_shootdowns
2424 ± 19% +398.2% 12078 ± 6% interrupts.CPU66.CAL:Function_call_interrupts
108.75 ± 33% +391.3% 534.25 ± 6% interrupts.CPU66.RES:Rescheduling_interrupts
2301 ± 22% +425.4% 12093 ± 7% interrupts.CPU67.CAL:Function_call_interrupts
505.25 ± 31% -50.4% 250.75 ± 38% interrupts.CPU67.NMI:Non-maskable_interrupts
505.25 ± 31% -50.4% 250.75 ± 38% interrupts.CPU67.PMI:Performance_monitoring_interrupts
95.75 ± 8% +447.8% 524.50 ± 5% interrupts.CPU67.RES:Rescheduling_interrupts
2306 ± 17% +427.7% 12169 ± 7% interrupts.CPU68.CAL:Function_call_interrupts
580.25 ± 37% -53.1% 272.25 ± 24% interrupts.CPU68.NMI:Non-maskable_interrupts
580.25 ± 37% -53.1% 272.25 ± 24% interrupts.CPU68.PMI:Performance_monitoring_interrupts
88.75 ± 27% +490.4% 524.00 ± 13% interrupts.CPU68.RES:Rescheduling_interrupts
2404 ± 24% +389.6% 11771 ± 5% interrupts.CPU69.CAL:Function_call_interrupts
475.25 ± 28% -44.5% 264.00 ± 20% interrupts.CPU69.NMI:Non-maskable_interrupts
475.25 ± 28% -44.5% 264.00 ± 20% interrupts.CPU69.PMI:Performance_monitoring_interrupts
91.75 ± 22% +438.1% 493.75 ± 12% interrupts.CPU69.RES:Rescheduling_interrupts
79.25 ± 65% +119.9% 174.25 ± 21% interrupts.CPU69.TLB:TLB_shootdowns
2231 ± 14% +424.6% 11705 ± 12% interrupts.CPU7.CAL:Function_call_interrupts
770.75 ± 39% -59.4% 312.75 ± 5% interrupts.CPU7.NMI:Non-maskable_interrupts
770.75 ± 39% -59.4% 312.75 ± 5% interrupts.CPU7.PMI:Performance_monitoring_interrupts
124.75 ± 26% +357.5% 570.75 ± 15% interrupts.CPU7.RES:Rescheduling_interrupts
2482 ± 23% +382.3% 11971 ± 7% interrupts.CPU70.CAL:Function_call_interrupts
929.75 ± 27% -73.6% 245.00 ± 39% interrupts.CPU70.NMI:Non-maskable_interrupts
929.75 ± 27% -73.6% 245.00 ± 39% interrupts.CPU70.PMI:Performance_monitoring_interrupts
139.75 ± 66% +256.7% 498.50 ± 9% interrupts.CPU70.RES:Rescheduling_interrupts
2487 ± 23% +400.1% 12437 ± 9% interrupts.CPU71.CAL:Function_call_interrupts
811.50 ± 24% -66.3% 273.75 ± 21% interrupts.CPU71.NMI:Non-maskable_interrupts
811.50 ± 24% -66.3% 273.75 ± 21% interrupts.CPU71.PMI:Performance_monitoring_interrupts
128.75 ± 34% +308.7% 526.25 ± 7% interrupts.CPU71.RES:Rescheduling_interrupts
97.75 ± 58% +108.2% 203.50 ± 26% interrupts.CPU71.TLB:TLB_shootdowns
2289 ± 16% +458.8% 12796 ± 14% interrupts.CPU72.CAL:Function_call_interrupts
644.50 ± 27% -56.1% 283.00 ± 22% interrupts.CPU72.NMI:Non-maskable_interrupts
644.50 ± 27% -56.1% 283.00 ± 22% interrupts.CPU72.PMI:Performance_monitoring_interrupts
98.75 ± 18% +487.3% 580.00 ± 14% interrupts.CPU72.RES:Rescheduling_interrupts
2366 ± 12% +386.4% 11510 ± 12% interrupts.CPU73.CAL:Function_call_interrupts
658.50 ± 21% -59.5% 267.00 ± 23% interrupts.CPU73.NMI:Non-maskable_interrupts
658.50 ± 21% -59.5% 267.00 ± 23% interrupts.CPU73.PMI:Performance_monitoring_interrupts
110.75 ± 17% +415.8% 571.25 ± 13% interrupts.CPU73.RES:Rescheduling_interrupts
2513 ± 13% +365.4% 11696 ± 13% interrupts.CPU74.CAL:Function_call_interrupts
99.25 ± 16% +468.5% 564.25 ± 9% interrupts.CPU74.RES:Rescheduling_interrupts
2510 ± 14% +370.8% 11816 ± 13% interrupts.CPU75.CAL:Function_call_interrupts
94.00 ± 4% +497.6% 561.75 ± 10% interrupts.CPU75.RES:Rescheduling_interrupts
2801 ± 22% +319.1% 11742 ± 14% interrupts.CPU76.CAL:Function_call_interrupts
754.25 ± 26% -63.3% 277.00 ± 23% interrupts.CPU76.NMI:Non-maskable_interrupts
754.25 ± 26% -63.3% 277.00 ± 23% interrupts.CPU76.PMI:Performance_monitoring_interrupts
93.00 ± 18% +505.9% 563.50 ± 11% interrupts.CPU76.RES:Rescheduling_interrupts
2410 ± 4% +398.4% 12011 ± 13% interrupts.CPU77.CAL:Function_call_interrupts
97.75 ± 8% +474.4% 561.50 ± 10% interrupts.CPU77.RES:Rescheduling_interrupts
2780 ± 29% +336.4% 12132 ± 12% interrupts.CPU78.CAL:Function_call_interrupts
850.75 ± 35% -62.1% 322.25 ± 4% interrupts.CPU78.NMI:Non-maskable_interrupts
850.75 ± 35% -62.1% 322.25 ± 4% interrupts.CPU78.PMI:Performance_monitoring_interrupts
90.00 ± 21% +511.7% 550.50 ± 12% interrupts.CPU78.RES:Rescheduling_interrupts
2632 ± 15% +346.0% 11737 ± 13% interrupts.CPU79.CAL:Function_call_interrupts
746.75 ± 33% -57.3% 319.00 interrupts.CPU79.NMI:Non-maskable_interrupts
746.75 ± 33% -57.3% 319.00 interrupts.CPU79.PMI:Performance_monitoring_interrupts
92.50 ± 20% +509.7% 564.00 ± 13% interrupts.CPU79.RES:Rescheduling_interrupts
2107 ± 13% +457.3% 11744 ± 10% interrupts.CPU8.CAL:Function_call_interrupts
92.75 ± 11% +510.8% 566.50 ± 5% interrupts.CPU8.RES:Rescheduling_interrupts
50.50 ±121% +255.0% 179.25 ± 17% interrupts.CPU8.TLB:TLB_shootdowns
2856 ± 25% +306.1% 11599 ± 13% interrupts.CPU80.CAL:Function_call_interrupts
674.00 ± 27% -53.2% 315.75 ± 6% interrupts.CPU80.NMI:Non-maskable_interrupts
674.00 ± 27% -53.2% 315.75 ± 6% interrupts.CPU80.PMI:Performance_monitoring_interrupts
86.25 ± 10% +529.9% 543.25 ± 11% interrupts.CPU80.RES:Rescheduling_interrupts
2688 ± 23% +339.2% 11807 ± 13% interrupts.CPU81.CAL:Function_call_interrupts
689.75 ± 46% -60.4% 273.00 ± 21% interrupts.CPU81.NMI:Non-maskable_interrupts
689.75 ± 46% -60.4% 273.00 ± 21% interrupts.CPU81.PMI:Performance_monitoring_interrupts
88.50 ± 9% +549.4% 574.75 ± 13% interrupts.CPU81.RES:Rescheduling_interrupts
2630 ± 27% +352.4% 11900 ± 13% interrupts.CPU82.CAL:Function_call_interrupts
759.25 ± 43% -65.0% 266.00 ± 24% interrupts.CPU82.NMI:Non-maskable_interrupts
759.25 ± 43% -65.0% 266.00 ± 24% interrupts.CPU82.PMI:Performance_monitoring_interrupts
89.00 ± 6% +544.4% 573.50 ± 13% interrupts.CPU82.RES:Rescheduling_interrupts
2480 ± 14% +384.8% 12024 ± 10% interrupts.CPU83.CAL:Function_call_interrupts
681.00 ± 31% -66.3% 229.75 ± 31% interrupts.CPU83.NMI:Non-maskable_interrupts
681.00 ± 31% -66.3% 229.75 ± 31% interrupts.CPU83.PMI:Performance_monitoring_interrupts
87.75 ± 10% +550.4% 570.75 ± 11% interrupts.CPU83.RES:Rescheduling_interrupts
86.75 ± 60% +68.3% 146.00 ± 10% interrupts.CPU83.TLB:TLB_shootdowns
2302 ± 11% +408.4% 11704 ± 12% interrupts.CPU84.CAL:Function_call_interrupts
558.50 ± 26% -47.5% 293.00 ± 30% interrupts.CPU84.NMI:Non-maskable_interrupts
558.50 ± 26% -47.5% 293.00 ± 30% interrupts.CPU84.PMI:Performance_monitoring_interrupts
84.50 ± 7% +568.3% 564.75 ± 9% interrupts.CPU84.RES:Rescheduling_interrupts
2474 ± 19% +378.0% 11828 ± 12% interrupts.CPU85.CAL:Function_call_interrupts
677.50 ± 14% -60.6% 266.75 ± 27% interrupts.CPU85.NMI:Non-maskable_interrupts
677.50 ± 14% -60.6% 266.75 ± 27% interrupts.CPU85.PMI:Performance_monitoring_interrupts
93.50 ± 6% +514.7% 574.75 ± 8% interrupts.CPU85.RES:Rescheduling_interrupts
2453 ± 16% +376.5% 11687 ± 12% interrupts.CPU86.CAL:Function_call_interrupts
789.75 ± 27% -66.2% 266.75 ± 26% interrupts.CPU86.NMI:Non-maskable_interrupts
789.75 ± 27% -66.2% 266.75 ± 26% interrupts.CPU86.PMI:Performance_monitoring_interrupts
94.00 ± 13% +492.3% 556.75 ± 9% interrupts.CPU86.RES:Rescheduling_interrupts
93.25 ± 28% +53.9% 143.50 ± 27% interrupts.CPU86.TLB:TLB_shootdowns
2522 ± 10% +353.0% 11426 ± 12% interrupts.CPU87.CAL:Function_call_interrupts
651.50 ± 17% -57.4% 277.50 ± 26% interrupts.CPU87.NMI:Non-maskable_interrupts
651.50 ± 17% -57.4% 277.50 ± 26% interrupts.CPU87.PMI:Performance_monitoring_interrupts
98.00 ± 15% +475.5% 564.00 ± 10% interrupts.CPU87.RES:Rescheduling_interrupts
2427 ± 8% +388.6% 11859 ± 13% interrupts.CPU88.CAL:Function_call_interrupts
661.00 ± 15% -58.9% 271.50 ± 26% interrupts.CPU88.NMI:Non-maskable_interrupts
661.00 ± 15% -58.9% 271.50 ± 26% interrupts.CPU88.PMI:Performance_monitoring_interrupts
95.75 ± 9% +491.6% 566.50 ± 11% interrupts.CPU88.RES:Rescheduling_interrupts
119.00 ± 17% +56.3% 186.00 ± 21% interrupts.CPU88.TLB:TLB_shootdowns
2317 ± 21% +410.8% 11839 ± 14% interrupts.CPU89.CAL:Function_call_interrupts
785.00 ± 33% -64.3% 280.50 ± 29% interrupts.CPU89.NMI:Non-maskable_interrupts
785.00 ± 33% -64.3% 280.50 ± 29% interrupts.CPU89.PMI:Performance_monitoring_interrupts
89.50 ± 10% +523.7% 558.25 ± 4% interrupts.CPU89.RES:Rescheduling_interrupts
2135 ± 20% +448.0% 11703 ± 9% interrupts.CPU9.CAL:Function_call_interrupts
830.00 ± 34% -56.2% 363.25 ± 25% interrupts.CPU9.NMI:Non-maskable_interrupts
830.00 ± 34% -56.2% 363.25 ± 25% interrupts.CPU9.PMI:Performance_monitoring_interrupts
110.75 ± 46% +372.0% 522.75 ± 8% interrupts.CPU9.RES:Rescheduling_interrupts
2749 ± 17% +331.5% 11862 ± 13% interrupts.CPU90.CAL:Function_call_interrupts
801.25 ± 12% -70.6% 235.50 ± 38% interrupts.CPU90.NMI:Non-maskable_interrupts
801.25 ± 12% -70.6% 235.50 ± 38% interrupts.CPU90.PMI:Performance_monitoring_interrupts
98.50 ± 12% +474.6% 566.00 ± 10% interrupts.CPU90.RES:Rescheduling_interrupts
62.50 ± 63% +184.8% 178.00 ± 10% interrupts.CPU90.TLB:TLB_shootdowns
2348 ± 15% +408.3% 11938 ± 13% interrupts.CPU91.CAL:Function_call_interrupts
679.25 ± 20% -63.7% 246.75 ± 37% interrupts.CPU91.NMI:Non-maskable_interrupts
679.25 ± 20% -63.7% 246.75 ± 37% interrupts.CPU91.PMI:Performance_monitoring_interrupts
91.75 ± 15% +524.3% 572.75 ± 10% interrupts.CPU91.RES:Rescheduling_interrupts
2451 ± 15% +379.7% 11760 ± 13% interrupts.CPU92.CAL:Function_call_interrupts
796.75 ± 19% -64.6% 282.25 ± 26% interrupts.CPU92.NMI:Non-maskable_interrupts
796.75 ± 19% -64.6% 282.25 ± 26% interrupts.CPU92.PMI:Performance_monitoring_interrupts
83.00 ± 9% +589.5% 572.25 ± 9% interrupts.CPU92.RES:Rescheduling_interrupts
2211 ± 13% +428.2% 11679 ± 11% interrupts.CPU93.CAL:Function_call_interrupts
754.75 ± 29% -63.3% 277.25 ± 26% interrupts.CPU93.NMI:Non-maskable_interrupts
754.75 ± 29% -63.3% 277.25 ± 26% interrupts.CPU93.PMI:Performance_monitoring_interrupts
91.75 ± 11% +502.7% 553.00 ± 8% interrupts.CPU93.RES:Rescheduling_interrupts
2403 ± 18% +400.0% 12015 ± 14% interrupts.CPU94.CAL:Function_call_interrupts
759.50 ± 41% -62.6% 284.25 ± 26% interrupts.CPU94.NMI:Non-maskable_interrupts
759.50 ± 41% -62.6% 284.25 ± 26% interrupts.CPU94.PMI:Performance_monitoring_interrupts
83.50 ± 14% +563.5% 554.00 ± 10% interrupts.CPU94.RES:Rescheduling_interrupts
2307 ± 18% +402.2% 11586 ± 12% interrupts.CPU95.CAL:Function_call_interrupts
843.50 ± 28% -63.5% 307.50 ± 6% interrupts.CPU95.NMI:Non-maskable_interrupts
843.50 ± 28% -63.5% 307.50 ± 6% interrupts.CPU95.PMI:Performance_monitoring_interrupts
90.50 ± 3% +518.8% 560.00 ± 11% interrupts.CPU95.RES:Rescheduling_interrupts
2106 ± 22% +416.9% 10890 ± 12% interrupts.CPU96.CAL:Function_call_interrupts
746.00 ± 31% -62.1% 283.00 ± 4% interrupts.CPU96.NMI:Non-maskable_interrupts
746.00 ± 31% -62.1% 283.00 ± 4% interrupts.CPU96.PMI:Performance_monitoring_interrupts
82.25 ± 15% +700.9% 658.75 ± 13% interrupts.CPU96.RES:Rescheduling_interrupts
2540 ± 4% +376.4% 12101 ± 12% interrupts.CPU97.CAL:Function_call_interrupts
872.50 ± 42% -65.2% 303.25 ± 4% interrupts.CPU97.NMI:Non-maskable_interrupts
872.50 ± 42% -65.2% 303.25 ± 4% interrupts.CPU97.PMI:Performance_monitoring_interrupts
133.75 ± 22% +345.0% 595.25 ± 6% interrupts.CPU97.RES:Rescheduling_interrupts
50.75 ±109% +315.3% 210.75 ± 33% interrupts.CPU97.TLB:TLB_shootdowns
2180 ± 9% +452.4% 12046 ± 11% interrupts.CPU98.CAL:Function_call_interrupts
670.00 ± 36% -53.8% 309.25 ± 5% interrupts.CPU98.NMI:Non-maskable_interrupts
670.00 ± 36% -53.8% 309.25 ± 5% interrupts.CPU98.PMI:Performance_monitoring_interrupts
120.75 ± 34% +377.0% 576.00 ± 7% interrupts.CPU98.RES:Rescheduling_interrupts
70.00 ± 96% +189.6% 202.75 ± 21% interrupts.CPU98.TLB:TLB_shootdowns
2591 ± 10% +367.7% 12121 ± 11% interrupts.CPU99.CAL:Function_call_interrupts
804.25 ± 33% -59.3% 327.25 ± 3% interrupts.CPU99.NMI:Non-maskable_interrupts
804.25 ± 33% -59.3% 327.25 ± 3% interrupts.CPU99.PMI:Performance_monitoring_interrupts
91.50 ± 17% +554.4% 598.75 ± 11% interrupts.CPU99.RES:Rescheduling_interrupts
138218 ± 11% -59.5% 55977 ± 5% interrupts.NMI:Non-maskable_interrupts
138218 ± 11% -59.5% 55977 ± 5% interrupts.PMI:Performance_monitoring_interrupts
18907 ± 8% +469.8% 107742 ± 3% interrupts.RES:Rescheduling_interrupts
19435 ± 27% +51.0% 29341 ± 9% interrupts.TLB:TLB_shootdowns
vm-scalability.time.user_time
350 +---------------------------------------------------------------------+
| O |
300 |-+ O |
| O O O |
250 |-+ O O O O O O O O O O O O O O |
| O O O O O |
200 |-+ |
| |
150 |-+ |
| |
100 |-+ |
| |
50 |-+ |
|..+.+..+.+..+..+.+..+.+..+..+.+..+.+..+.+..+..+.+..+.+..+..+.+..+.+..|
0 +---------------------------------------------------------------------+
vm-scalability.time.system_time
3500 +--------------------------------------------------------------------+
| +. .+.. .. + .. +..+.+.. .+..|
3000 |-+ .. +.. .+..+ .+.. +.. .+.. .+..+ + + |
| .+.+ + +..+ + + + |
|. + |
2500 |-+ |
| |
2000 |-+ |
| |
1500 |-+ |
| |
| O |
1000 |-+ O O O O O O |
| O O O O O O O O O O O O O O O O O O O |
500 +--------------------------------------------------------------------+
vm-scalability.time.percent_of_cpu_this_job_got
1200 +--------------------------------------------------------------------+
| + +. +..|
1100 |-+ +. .+.+.. .. + .. +..+.+.. + |
1000 |-+ .. +.. .+. .+.. .+.. .+..+.+..+ + + |
| .+.+ + +..+ + + |
900 |.+ |
800 |-+ |
| |
700 |-+ |
600 |-+ |
| |
500 |-+ O |
400 |-+ O O O |
| O O O O O O O O O O O O O O O O O |
300 +--------------------------------------------------------------------+
vm-scalability.time.minor_page_faults
7e+07 +-------------------------------------------------------------------+
| O O O O O O |
6e+07 |-+ O O O O |
| O O O O O O O O |
| O O O O |
5e+07 |-+O O |
| |
4e+07 |-+ |
| |
3e+07 |-+ |
| |
| |
2e+07 |-+ |
|..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
1e+07 +-------------------------------------------------------------------+
vm-scalability.time.voluntary_context_switches
8e+07 +-------------------------------------------------------------------+
| O O |
7e+07 |-+ O O O O O O O |
6e+07 |-+ O O O O O O O O O O O |
| O O O O |
5e+07 |-+O |
| O |
4e+07 |-+ |
| |
3e+07 |-+ |
2e+07 |-+ |
| |
1e+07 |-+ |
|..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
0 +-------------------------------------------------------------------+
vm-scalability.throughput
1.1e+06 +-----------------------------------------------------------------+
1e+06 |-+ O O O O O |
| O O O O O |
900000 |-+ O O O O O O |
800000 |-+ O O O O O O O O |
| O O |
700000 |-+ |
600000 |-+ |
500000 |-+ |
| |
400000 |-+ |
300000 |-+ |
| .+.+..+. .+.+..+. .+.. .+..+.+.+..+.+..+.+..+.+..+.|
200000 |.+. +. + +.+..+.+..+ |
100000 +-----------------------------------------------------------------+
vm-scalability.median
5500 +--------------------------------------------------------------------+
5000 |-+ O O O O O O O |
| O O O O |
4500 |-+ O O O O O O O O O |
4000 |-+ O O O O |
| O |
3500 |-+ |
3000 |-+ |
2500 |-+ |
| |
2000 |-+ |
1500 |-+ |
| .+.+..+.+..+.+..+.+.. .+. .+. .+.+..+..+.+..+.+..+.+..+.+..|
1000 |.+ +. +. +..+.+. |
500 +--------------------------------------------------------------------+
vm-scalability.workload
3.5e+08 +-----------------------------------------------------------------+
| |
3e+08 |-+ O O O O O |
| O O O O O |
| O O O O O O O |
2.5e+08 |-+ O O O O O O O |
| O O |
2e+08 |-+ |
| |
1.5e+08 |-+ |
| |
| |
1e+08 |-+ |
|.+..+.+..+.+..+.+..+. .+.. .+.. .+..+.+.+..+.+..+.+..+.+..+.|
5e+07 +-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 7 months
Re: [Intel-gfx] [drm/i915/gem] 59dd13ad31: phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second -54.0% regression
by Xing Zhengjun
On 11/25/2020 4:47 AM, Chris Wilson wrote:
> Quoting Oliver Sang (2020-11-19 07:20:18)
>> On Fri, Nov 13, 2020 at 04:27:13PM +0200, Joonas Lahtinen wrote:
>>> Hi,
>>>
>>> Could you add intel-gfx(a)lists.freedesktop.org into reports going
>>> forward.
>>>
>>> Quoting kernel test robot (2020-11-11 17:58:11)
>>>>
>>>> Greeting,
>>>>
>>>> FYI, we noticed a -54.0% regression of phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second due to commit:
>>>
>>> How many runs are there on the bad version to ensure the bisect is
>>> repeatable?
>>
>> test 4 times.
>> zxing@inn:/result/phoronix-test-suite/performance-true-Radial_Gradient_Paint-1024x1024-jxrendermark-1.2.4-ucode=0xd6-monitor=da39a3ee/lkp-cfl-d1/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/59dd13ad310793757e34afa489dd6fc8544fc3da$ grep -r "operations_per_second" */stats.json
>> 0/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4133.487932,
>> 1/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4120.421503,
>> 2/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4188.414835,
>> 3/stats.json: "phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second": 4068.549514,
>
> a w/o revert (drm-tip)
> b w/ revert
> +mB----------------------------------------------------------------------------+
> | ..b |
> | ..b.aa |
> | ....a.a |
> | ....a.a |
> | b b ........a |
> | b b b b......... a |
> | b bb bbb........... |
> |b ab bbab.bb.b............ba b a a ab a|
> | |__A__| |
> | |MA_| |
> +------------------------------------------------------------------------------+
> N Min Max Median Avg Stddev
> a 120 3621.8761 7356.4442 4606.7895 4607.9132 156.17693
> b 120 2664.0563 6359.9686 4519.5036 4534.4463 95.471121
>
> The patch is not expected to have any impact on the machine you are testing on.
> -Chris
>
What's your code base?
For my side:
1) sync the code to the head of Linux mainline
2) git reset --hard 59dd13ad31
3) git revert 59dd13ad3107
We compare the test result of commit 59dd13ad3107 (step 2) and
2052847b06f8 (step 3, revert 59dd13ad3107), the regression should
related with 59dd13ad3107. Each test case we run 5 times.
=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/need_x/test/option_a/option_b/cpufreq_governor/ucode/debug-setup:
lkp-cfl-d1/phoronix-test-suite/debian-x86_64-phoronix/x86_64-rhel-8.3/gcc-9/true/jxrendermark-1.2.4/Radial
Gradient Paint/1024x1024/performance/0xde/regression_test
commit:
0dccdba51e852271a3dbc9358375f4c882b863f2
59dd13ad310793757e34afa489dd6fc8544fc3da
2052847b06f863a028f7f3bbc62401e043b34301 (revert 59dd13ad3107)
0dccdba51e852271 59dd13ad310793757e34afa489d 2052847b06f863a028f7f3bbc62
---------------- --------------------------- ---------------------------
%stddev %change %stddev %change %stddev
\ | \ | \
8145 ± 2% -53.1% 3817 ± 3% -1.8% 7995
phoronix-test-suite.jxrendermark.RadialGradientPaint.1024x1024.operations_per_second
--
Zhengjun Xing
1 year, 7 months
[SUNRPC] 3bc6a407d1: fsmark.files_per_sec -12.9% regression
by kernel test robot
Greeting,
FYI, we noticed a -12.9% regression of fsmark.files_per_sec due to commit:
commit: 3bc6a407d1a090417218ecdb0dd4a92a5d75704b ("[PATCH RFC] SUNRPC: Use zero-copy to perform socket send operations")
url: https://github.com/0day-ci/linux/commits/Chuck-Lever/SUNRPC-Use-zero-copy...
base: git://git.linux-nfs.org/projects/trondmy/linux-nfs.git linux-next
in testcase: fsmark
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
iterations: 1x
nr_threads: 64t
disk: 1BRD_48G
fs: xfs
fs2: nfsv4
filesize: 4M
test_size: 40G
sync_method: fsyncBeforeClose
cpufreq_governor: performance
ucode: 0x5003003
test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -13.3% regression |
| test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters | cpufreq_governor=performance |
| | disk=1BRD_48G |
| | filesize=4M |
| | fs2=nfsv4 |
| | fs=xfs |
| | iterations=1x |
| | nr_threads=64t |
| | sync_method=NoSync |
| | test_size=40G |
| | ucode=0x5003003 |
+------------------+---------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs2/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1BRD_48G/4M/nfsv4/xfs/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap2/40G/fsmark/0x5003003
commit:
v5.10-rc2
3bc6a407d1 ("SUNRPC: Use zero-copy to perform socket send operations")
v5.10-rc2 3bc6a407d1a090417218ecdb0dd
---------------- ---------------------------
%stddev %change %stddev
\ | \
13020954 +12.4% 14633883 ± 3% fsmark.app_overhead
558.15 -12.9% 485.88 fsmark.files_per_sec
21.42 +12.5% 24.10 fsmark.time.elapsed_time
21.42 +12.5% 24.10 fsmark.time.elapsed_time.max
1788 ± 5% -13.3% 1551 ± 4% fsmark.time.involuntary_context_switches
245.25 -12.4% 214.75 fsmark.time.percent_of_cpu_this_job_got
1495010 -3.3% 1446006 fsmark.time.voluntary_context_switches
2.54 ± 3% +16.7% 2.97 iostat.cpu.iowait
3965 ± 7% +63.2% 6471 ± 44% softirqs.CPU45.RCU
12441 ± 3% +8.1% 13448 ± 4% meminfo.Active
12332 ± 3% +8.2% 13339 ± 4% meminfo.Active(anon)
27337 ± 7% +41.3% 38640 ± 18% sched_debug.cfs_rq:/.min_vruntime.avg
14415 ± 19% +52.1% 21925 ± 14% sched_debug.cfs_rq:/.min_vruntime.min
1637052 -8.0% 1505871 ± 2% vmstat.io.bo
195349 ± 2% -12.7% 170450 ± 2% vmstat.system.cs
2.74 ± 4% +0.4 3.18 mpstat.cpu.all.iowait%
1.09 ± 7% -0.1 0.94 ± 2% mpstat.cpu.all.irq%
0.14 ± 5% +0.3 0.41 ± 2% mpstat.cpu.all.soft%
3.45 ± 2% -0.5 2.99 ± 2% mpstat.cpu.all.sys%
6813 ± 40% -55.1% 3059 ± 57% numa-meminfo.node0.PageTables
119106 ± 4% -11.5% 105394 ± 11% numa-meminfo.node0.SUnreclaim
12837 ± 28% +30.5% 16748 ± 22% numa-meminfo.node3.Shmem
248191 +8.2% 268539 ± 4% numa-meminfo.node3.Unevictable
26140871 ± 2% -13.6% 22585817 ± 4% cpuidle.C1.time
432703 -24.4% 327005 ± 2% cpuidle.C1.usage
2.216e+09 ± 53% +108.7% 4.624e+09 ± 3% cpuidle.C1E.time
6704163 ± 23% +53.8% 10312626 ± 3% cpuidle.C1E.usage
2.113e+09 ± 57% -94.9% 1.081e+08 ± 94% cpuidle.C6.time
1700 ± 40% -55.1% 764.25 ± 57% numa-vmstat.node0.nr_page_table_pages
29779 ± 4% -11.5% 26356 ± 11% numa-vmstat.node0.nr_slab_unreclaimable
3176 ± 29% +32.8% 4219 ± 22% numa-vmstat.node3.nr_shmem
62047 +8.2% 67134 ± 4% numa-vmstat.node3.nr_unevictable
62047 +8.2% 67134 ± 4% numa-vmstat.node3.nr_zone_unevictable
3082 ± 3% +8.2% 3335 ± 4% proc-vmstat.nr_active_anon
3082 ± 3% +8.2% 3335 ± 4% proc-vmstat.nr_zone_active_anon
33095 ± 20% -30.7% 22929 ± 25% proc-vmstat.numa_pte_updates
76453330 -12.6% 66854033 proc-vmstat.pgalloc_normal
55754409 -17.7% 45900156 proc-vmstat.pgfree
10550 +7.1% 11301 ± 2% proc-vmstat.pgreuse
21843 -16.2% 18302 slabinfo.kmalloc-1k.active_objs
689.50 -15.6% 582.00 slabinfo.kmalloc-1k.active_slabs
22080 -15.6% 18635 slabinfo.kmalloc-1k.num_objs
689.50 -15.6% 582.00 slabinfo.kmalloc-1k.num_slabs
12057 ± 7% -12.6% 10544 ± 4% slabinfo.nfsd_file.active_objs
12250 ± 6% -12.0% 10779 ± 4% slabinfo.nfsd_file.num_objs
3.726e+09 -6.0% 3.502e+09 perf-stat.i.branch-instructions
3.236e+08 ± 2% -8.1% 2.974e+08 perf-stat.i.cache-references
223562 ± 3% -13.9% 192428 ± 2% perf-stat.i.context-switches
4.738e+09 -6.5% 4.428e+09 perf-stat.i.dTLB-loads
2.344e+09 ± 2% -6.8% 2.185e+09 perf-stat.i.dTLB-stores
1.885e+10 -5.8% 1.776e+10 perf-stat.i.instructions
58.38 -6.5% 54.61 perf-stat.i.metric.M/sec
9172 ± 3% -7.8% 8458 perf-stat.i.minor-faults
37419450 ± 3% -9.0% 34056149 ± 2% perf-stat.i.node-load-misses
10313099 ± 2% -11.4% 9134750 ± 5% perf-stat.i.node-loads
9181 ± 3% -7.8% 8467 perf-stat.i.page-faults
3.565e+09 -5.6% 3.365e+09 perf-stat.ps.branch-instructions
3.098e+08 ± 2% -7.7% 2.858e+08 perf-stat.ps.cache-references
214060 ± 3% -13.6% 184935 ± 2% perf-stat.ps.context-switches
4.534e+09 -6.2% 4.255e+09 perf-stat.ps.dTLB-loads
2.243e+09 -6.4% 2.099e+09 perf-stat.ps.dTLB-stores
1.803e+10 -5.4% 1.706e+10 perf-stat.ps.instructions
8793 ± 3% -7.2% 8164 ± 2% perf-stat.ps.minor-faults
35826191 ± 3% -8.7% 32716417 ± 2% perf-stat.ps.node-load-misses
9874765 ± 2% -11.0% 8786772 ± 5% perf-stat.ps.node-loads
8802 ± 3% -7.2% 8172 ± 2% perf-stat.ps.page-faults
4.219e+11 +3.9% 4.384e+11 perf-stat.total.instructions
1283 ± 44% -41.5% 750.50 ± 16% interrupts.CPU100.NMI:Non-maskable_interrupts
1283 ± 44% -41.5% 750.50 ± 16% interrupts.CPU100.PMI:Performance_monitoring_interrupts
603.75 ± 19% +82.7% 1103 ± 33% interrupts.CPU105.NMI:Non-maskable_interrupts
603.75 ± 19% +82.7% 1103 ± 33% interrupts.CPU105.PMI:Performance_monitoring_interrupts
83.00 ± 15% -43.1% 47.25 ± 29% interrupts.CPU115.RES:Rescheduling_interrupts
2540 ± 11% -24.4% 1919 ± 24% interrupts.CPU144.CAL:Function_call_interrupts
2703 ± 14% -40.1% 1619 ± 29% interrupts.CPU152.CAL:Function_call_interrupts
2791 ± 10% -31.7% 1905 ± 28% interrupts.CPU156.CAL:Function_call_interrupts
2660 ± 6% -37.7% 1657 ± 32% interrupts.CPU163.CAL:Function_call_interrupts
2.50 ± 72% +4810.0% 122.75 ±164% interrupts.CPU163.TLB:TLB_shootdowns
2499 ± 11% -34.5% 1636 ± 35% interrupts.CPU167.CAL:Function_call_interrupts
980.75 ± 18% -36.3% 624.50 ± 17% interrupts.CPU172.NMI:Non-maskable_interrupts
980.75 ± 18% -36.3% 624.50 ± 17% interrupts.CPU172.PMI:Performance_monitoring_interrupts
2671 ± 14% -24.8% 2009 ± 19% interrupts.CPU173.CAL:Function_call_interrupts
2.25 ± 57% +5244.4% 120.25 ±164% interrupts.CPU173.TLB:TLB_shootdowns
1048 ± 17% -40.2% 627.25 ± 35% interrupts.CPU175.NMI:Non-maskable_interrupts
1048 ± 17% -40.2% 627.25 ± 35% interrupts.CPU175.PMI:Performance_monitoring_interrupts
848.25 ± 24% -39.9% 509.75 ± 20% interrupts.CPU176.NMI:Non-maskable_interrupts
848.25 ± 24% -39.9% 509.75 ± 20% interrupts.CPU176.PMI:Performance_monitoring_interrupts
3.50 ± 58% +3421.4% 123.25 ±157% interrupts.CPU178.TLB:TLB_shootdowns
2913 ± 4% -29.5% 2055 ± 19% interrupts.CPU184.CAL:Function_call_interrupts
862.00 ± 20% -34.3% 566.75 ± 14% interrupts.CPU184.NMI:Non-maskable_interrupts
862.00 ± 20% -34.3% 566.75 ± 14% interrupts.CPU184.PMI:Performance_monitoring_interrupts
931.25 ± 34% -45.2% 510.25 ± 20% interrupts.CPU186.NMI:Non-maskable_interrupts
931.25 ± 34% -45.2% 510.25 ± 20% interrupts.CPU186.PMI:Performance_monitoring_interrupts
840.25 ± 17% -27.8% 606.75 ± 20% interrupts.CPU21.NMI:Non-maskable_interrupts
840.25 ± 17% -27.8% 606.75 ± 20% interrupts.CPU21.PMI:Performance_monitoring_interrupts
2851 ± 16% -25.1% 2135 ± 14% interrupts.CPU29.CAL:Function_call_interrupts
560.75 ± 13% +67.8% 941.00 ± 17% interrupts.CPU30.NMI:Non-maskable_interrupts
560.75 ± 13% +67.8% 941.00 ± 17% interrupts.CPU30.PMI:Performance_monitoring_interrupts
615.25 ± 16% +44.9% 891.75 ± 16% interrupts.CPU31.NMI:Non-maskable_interrupts
615.25 ± 16% +44.9% 891.75 ± 16% interrupts.CPU31.PMI:Performance_monitoring_interrupts
34.25 ± 28% +156.2% 87.75 ± 26% interrupts.CPU34.RES:Rescheduling_interrupts
1.50 ±137% +7700.0% 117.00 ±166% interrupts.CPU39.TLB:TLB_shootdowns
2394 ± 4% +18.6% 2840 ± 9% interrupts.CPU41.CAL:Function_call_interrupts
610.75 ± 21% -41.3% 358.75 ± 33% interrupts.CPU44.NMI:Non-maskable_interrupts
610.75 ± 21% -41.3% 358.75 ± 33% interrupts.CPU44.PMI:Performance_monitoring_interrupts
2608 ± 4% -36.5% 1655 ± 35% interrupts.CPU48.CAL:Function_call_interrupts
2820 ± 8% -34.7% 1841 ± 32% interrupts.CPU55.CAL:Function_call_interrupts
1249 ± 47% -49.6% 630.00 ± 44% interrupts.CPU56.NMI:Non-maskable_interrupts
1249 ± 47% -49.6% 630.00 ± 44% interrupts.CPU56.PMI:Performance_monitoring_interrupts
609.50 ± 29% +167.1% 1628 ± 78% interrupts.CPU67.NMI:Non-maskable_interrupts
609.50 ± 29% +167.1% 1628 ± 78% interrupts.CPU67.PMI:Performance_monitoring_interrupts
3176 ± 31% -35.7% 2043 ± 31% interrupts.CPU72.CAL:Function_call_interrupts
2671 ± 7% -40.8% 1582 ± 31% interrupts.CPU73.CAL:Function_call_interrupts
2626 ± 5% -32.6% 1770 ± 22% interrupts.CPU74.CAL:Function_call_interrupts
2674 ± 6% -35.1% 1735 ± 22% interrupts.CPU77.CAL:Function_call_interrupts
966.50 ± 17% -49.0% 492.75 ± 18% interrupts.CPU80.NMI:Non-maskable_interrupts
966.50 ± 17% -49.0% 492.75 ± 18% interrupts.CPU80.PMI:Performance_monitoring_interrupts
2659 ± 19% -29.4% 1878 ± 26% interrupts.CPU84.CAL:Function_call_interrupts
824.00 ± 11% -33.1% 551.25 ± 21% interrupts.CPU88.NMI:Non-maskable_interrupts
824.00 ± 11% -33.1% 551.25 ± 21% interrupts.CPU88.PMI:Performance_monitoring_interrupts
1012 ± 39% -41.9% 588.00 ± 37% interrupts.CPU98.NMI:Non-maskable_interrupts
1012 ± 39% -41.9% 588.00 ± 37% interrupts.CPU98.PMI:Performance_monitoring_interrupts
32.98 ± 3% -3.4 29.60 perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
32.98 ± 3% -3.4 29.61 perf-profile.calltrace.cycles-pp.ret_from_fork
21.71 ± 3% -2.5 19.25 ± 2% perf-profile.calltrace.cycles-pp.nfsd.kthread.ret_from_fork
16.07 ± 3% -2.2 13.84 perf-profile.calltrace.cycles-pp.svc_process.nfsd.kthread.ret_from_fork
16.07 ± 3% -2.2 13.84 perf-profile.calltrace.cycles-pp.svc_process_common.svc_process.nfsd.kthread.ret_from_fork
16.01 ± 3% -2.2 13.78 perf-profile.calltrace.cycles-pp.nfsd_dispatch.svc_process_common.svc_process.nfsd.kthread
15.96 ± 3% -2.2 13.74 perf-profile.calltrace.cycles-pp.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process.nfsd
16.78 ± 4% -1.6 15.17 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
16.68 ± 4% -1.6 15.08 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.34 ± 3% -1.3 8.09 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.41 ± 3% -1.2 8.16 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.39 ± 3% -1.2 8.14 ± 2% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.33 ± 3% -1.2 8.09 ± 2% perf-profile.calltrace.cycles-pp.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
9.01 ± 3% -1.2 7.80 ± 2% perf-profile.calltrace.cycles-pp.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write
9.75 ± 3% -1.1 8.66 perf-profile.calltrace.cycles-pp.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process
9.73 ± 3% -1.1 8.64 perf-profile.calltrace.cycles-pp.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch.svc_process_common
9.68 ± 3% -1.1 8.59 perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound
9.68 ± 3% -1.1 8.59 perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.nfsd_commit
9.68 ± 3% -1.1 8.59 perf-profile.calltrace.cycles-pp.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync
9.69 ± 3% -1.1 8.61 perf-profile.calltrace.cycles-pp.file_write_and_wait_range.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch
5.84 ± 4% -1.1 4.78 ± 2% perf-profile.calltrace.cycles-pp.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process
5.81 ± 4% -1.1 4.75 ± 2% perf-profile.calltrace.cycles-pp.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch.svc_process_common
5.80 ± 4% -1.1 4.75 ± 2% perf-profile.calltrace.cycles-pp.do_iter_write.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch
5.79 ± 4% -1.0 4.74 ± 2% perf-profile.calltrace.cycles-pp.do_iter_readv_writev.do_iter_write.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound
5.79 ± 4% -1.0 4.74 ± 2% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write.nfsd_vfs_write.nfsd4_write
5.54 ± 4% -0.9 4.59 ± 2% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write.nfsd_vfs_write
5.54 ± 4% -0.9 4.59 ± 2% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write
5.51 ± 4% -0.9 4.57 ± 2% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev
11.19 ± 3% -0.9 10.29 ± 2% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
10.69 ± 3% -0.8 9.86 ± 2% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
1.78 ± 6% -0.7 1.09 ± 3% perf-profile.calltrace.cycles-pp.iomap_writepages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
1.77 ± 6% -0.7 1.08 ± 3% perf-profile.calltrace.cycles-pp.write_cache_pages.iomap_writepages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.calltrace.cycles-pp.nfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.23 ± 7% -0.6 0.62 ± 4% perf-profile.calltrace.cycles-pp.iomap_writepage_map.write_cache_pages.iomap_writepages.xfs_vm_writepages.do_writepages
4.30 ± 4% -0.6 3.69 ± 3% perf-profile.calltrace.cycles-pp.rpc_free_task.rpc_async_release.process_one_work.worker_thread.kthread
4.30 ± 4% -0.6 3.69 ± 3% perf-profile.calltrace.cycles-pp.rpc_async_release.process_one_work.worker_thread.kthread.ret_from_fork
4.37 ± 4% -0.6 3.75 ± 5% perf-profile.calltrace.cycles-pp.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write
4.75 ± 3% -0.6 4.19 ± 2% perf-profile.calltrace.cycles-pp.file_write_and_wait_range.nfs_file_fsync.do_fsync.__x64_sys_fsync.do_syscall_64
3.42 ± 5% -0.6 2.86 ± 3% perf-profile.calltrace.cycles-pp.nfs_write_completion.rpc_free_task.rpc_async_release.process_one_work.worker_thread
2.69 -0.5 2.21 ± 3% perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
2.65 -0.5 2.18 ± 3% perf-profile.calltrace.cycles-pp.memcpy_erms.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write
3.16 ± 5% -0.4 2.73 ± 7% perf-profile.calltrace.cycles-pp.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write
2.34 ± 5% -0.4 1.92 ± 4% perf-profile.calltrace.cycles-pp.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release.process_one_work
3.59 ± 3% -0.4 3.19 ± 2% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.file_write_and_wait_range.nfs_file_fsync.do_fsync.__x64_sys_fsync
3.59 ± 3% -0.4 3.19 ± 2% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.nfs_file_fsync.do_fsync
3.59 ± 3% -0.4 3.19 ± 2% perf-profile.calltrace.cycles-pp.nfs_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.nfs_file_fsync
3.56 ± 3% -0.4 3.16 ± 2% perf-profile.calltrace.cycles-pp.write_cache_pages.nfs_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
7.90 ± 4% -0.4 7.51 perf-profile.calltrace.cycles-pp.submit_bio.iomap_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range
7.90 ± 4% -0.4 7.51 perf-profile.calltrace.cycles-pp.iomap_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
2.96 ± 4% -0.3 2.63 ± 2% perf-profile.calltrace.cycles-pp.nfs_writepages_callback.write_cache_pages.nfs_writepages.do_writepages.__filemap_fdatawrite_range
2.23 ± 3% -0.3 1.91 ± 2% perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.generic_perform_write.nfs_file_write.new_sync_write.vfs_write
0.58 ± 3% -0.3 0.27 ±100% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin
2.53 -0.3 2.21 ± 4% perf-profile.calltrace.cycles-pp.memcpy_to_page._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg
2.52 ± 2% -0.3 2.20 ± 4% perf-profile.calltrace.cycles-pp.memcpy_erms.memcpy_to_page._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
2.92 ± 4% -0.3 2.61 ± 2% perf-profile.calltrace.cycles-pp.nfs_do_writepage.nfs_writepages_callback.write_cache_pages.nfs_writepages.do_writepages
2.18 ± 3% -0.3 1.88 ± 2% perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.nfs_file_write.new_sync_write
2.17 ± 3% -0.3 1.86 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.generic_perform_write.nfs_file_write
0.55 ± 4% -0.3 0.25 ±100% perf-profile.calltrace.cycles-pp.__test_set_page_writeback.nfs_do_writepage.nfs_writepages_callback.write_cache_pages.nfs_writepages
2.55 ± 2% -0.3 2.25 ± 3% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet6_recvmsg
2.23 ± 4% -0.3 1.95 ± 7% perf-profile.calltrace.cycles-pp.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write
2.07 ± 3% -0.3 1.82 ± 2% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write.nfs_file_write.new_sync_write
2.13 ± 3% -0.2 1.88 ± 2% perf-profile.calltrace.cycles-pp.nfs_write_begin.generic_perform_write.nfs_file_write.new_sync_write.vfs_write
2.05 ± 3% -0.2 1.80 ± 2% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write.nfs_file_write
0.66 ± 3% -0.2 0.42 ± 57% perf-profile.calltrace.cycles-pp.io_schedule.wait_on_page_bit.__filemap_fdatawait_range.file_write_and_wait_range.nfs_file_fsync
0.62 ± 4% -0.2 0.39 ± 57% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback
1.25 ± 7% -0.2 1.02 ± 2% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
0.64 ± 3% -0.2 0.41 ± 57% perf-profile.calltrace.cycles-pp.schedule.io_schedule.wait_on_page_bit.__filemap_fdatawait_range.file_write_and_wait_range
0.62 ± 3% -0.2 0.40 ± 57% perf-profile.calltrace.cycles-pp.__schedule.schedule.io_schedule.wait_on_page_bit.__filemap_fdatawait_range
1.40 ± 6% -0.2 1.20 ± 3% perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
1.33 ± 6% -0.2 1.13 ± 3% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.32 ± 6% -0.2 1.12 ± 3% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
1.17 ± 5% -0.2 1.00 perf-profile.calltrace.cycles-pp.__filemap_fdatawait_range.file_write_and_wait_range.nfs_file_fsync.do_fsync.__x64_sys_fsync
1.48 ± 3% -0.2 1.31 ± 2% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write
0.80 ± 4% -0.1 0.66 ± 3% perf-profile.calltrace.cycles-pp.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release
0.72 ± 5% -0.1 0.58 ± 4% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.89 ± 7% -0.1 0.76 ± 6% perf-profile.calltrace.cycles-pp.end_page_writeback.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release
1.04 ± 3% -0.1 0.91 ± 3% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin
0.80 ± 7% -0.1 0.67 ± 3% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor
0.85 ± 8% -0.1 0.73 ± 6% perf-profile.calltrace.cycles-pp.test_clear_page_writeback.end_page_writeback.nfs_end_page_writeback.nfs_write_completion.rpc_free_task
0.74 ± 4% -0.1 0.62 ± 4% perf-profile.calltrace.cycles-pp.wait_on_page_bit.__filemap_fdatawait_range.file_write_and_wait_range.nfs_file_fsync.do_fsync
0.67 ± 4% -0.1 0.55 ± 4% perf-profile.calltrace.cycles-pp.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion.rpc_free_task
0.86 ± 4% -0.1 0.75 ± 5% perf-profile.calltrace.cycles-pp.__set_page_dirty_nobuffers.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write
0.63 ± 4% -0.1 0.52 ± 3% perf-profile.calltrace.cycles-pp.wake_page_function.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion
0.66 ± 3% -0.1 0.56 ± 7% perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write
0.61 ± 5% -0.1 0.56 ± 5% perf-profile.calltrace.cycles-pp.xfs_end_io.process_one_work.worker_thread.kthread.ret_from_fork
0.61 ± 5% -0.1 0.56 ± 5% perf-profile.calltrace.cycles-pp.xfs_end_ioend.xfs_end_io.process_one_work.worker_thread.kthread
0.59 ± 6% -0.1 0.54 ± 5% perf-profile.calltrace.cycles-pp.iomap_finish_ioends.xfs_end_ioend.xfs_end_io.process_one_work.worker_thread
0.83 ± 2% -0.1 0.77 perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.brd_insert_page.brd_do_bvec.brd_submit_bio.submit_bio_noacct
0.77 ± 2% -0.0 0.72 perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.brd_insert_page.brd_do_bvec.brd_submit_bio
3.13 ± 2% +0.4 3.50 ± 4% perf-profile.calltrace.cycles-pp.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt.svc_recv.nfsd
3.12 ± 2% +0.4 3.50 ± 4% perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt.svc_recv
0.00 +0.6 0.61 ± 6% perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_recvmsg.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt
0.00 +3.0 2.98 perf-profile.calltrace.cycles-pp.memcpy_erms.skb_copy_ubufs.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog
0.00 +3.7 3.71 perf-profile.calltrace.cycles-pp.skb_copy_ubufs.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog.net_rx_action
0.00 +3.7 3.72 perf-profile.calltrace.cycles-pp.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
0.00 +3.9 3.88 ± 2% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack
0.00 +3.9 3.89 ± 2% perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
0.00 +3.9 3.89 ± 2% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq
0.00 +3.9 3.90 ± 2% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip6_finish_output2
0.00 +3.9 3.90 ± 2% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_output
0.00 +3.9 3.90 ± 2% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
0.00 +3.9 3.90 ± 2% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip6_finish_output2.ip6_output.ip6_xmit.inet6_csk_xmit
0.00 +3.9 3.90 ± 2% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_output.ip6_xmit
0.00 +3.9 3.94 ± 2% perf-profile.calltrace.cycles-pp.ip6_finish_output2.ip6_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb
0.00 +4.0 3.96 perf-profile.calltrace.cycles-pp.ip6_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit
0.00 +4.0 3.96 perf-profile.calltrace.cycles-pp.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked
0.00 +4.0 3.99 perf-profile.calltrace.cycles-pp.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg
0.00 +4.0 4.03 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
0.00 +4.1 4.09 perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.xprt_sock_sendmsg
42.90 ± 5% +4.1 47.02 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
43.95 ± 4% +4.2 48.13 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
49.22 ± 2% +4.9 54.12 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
49.23 ± 2% +4.9 54.14 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
49.22 ± 2% +4.9 54.13 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
49.50 ± 2% +5.0 54.45 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
32.98 ± 3% -3.4 29.60 perf-profile.children.cycles-pp.kthread
32.98 ± 3% -3.4 29.61 perf-profile.children.cycles-pp.ret_from_fork
21.71 ± 3% -2.5 19.25 ± 2% perf-profile.children.cycles-pp.nfsd
16.07 ± 3% -2.2 13.84 perf-profile.children.cycles-pp.svc_process
16.07 ± 3% -2.2 13.84 perf-profile.children.cycles-pp.svc_process_common
16.01 ± 3% -2.2 13.78 perf-profile.children.cycles-pp.nfsd_dispatch
15.96 ± 3% -2.2 13.74 perf-profile.children.cycles-pp.nfsd4_proc_compound
14.45 ± 2% -1.7 12.79 perf-profile.children.cycles-pp.file_write_and_wait_range
17.18 ± 4% -1.6 15.62 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
17.07 ± 4% -1.5 15.53 ± 2% perf-profile.children.cycles-pp.do_syscall_64
13.26 ± 2% -1.5 11.78 perf-profile.children.cycles-pp.__filemap_fdatawrite_range
13.26 ± 2% -1.5 11.78 perf-profile.children.cycles-pp.do_writepages
9.34 ± 3% -1.3 8.09 ± 2% perf-profile.children.cycles-pp.nfs_file_write
9.60 ± 3% -1.2 8.37 ± 2% perf-profile.children.cycles-pp.new_sync_write
9.66 ± 3% -1.2 8.44 ± 2% perf-profile.children.cycles-pp.ksys_write
9.64 ± 3% -1.2 8.43 ± 2% perf-profile.children.cycles-pp.vfs_write
9.01 ± 3% -1.2 7.81 ± 2% perf-profile.children.cycles-pp.generic_perform_write
9.75 ± 3% -1.1 8.66 perf-profile.children.cycles-pp.nfsd_commit
9.73 ± 3% -1.1 8.64 perf-profile.children.cycles-pp.xfs_file_fsync
5.34 ± 2% -1.1 4.25 ± 2% perf-profile.children.cycles-pp.write_cache_pages
9.68 ± 3% -1.1 8.59 perf-profile.children.cycles-pp.xfs_vm_writepages
5.84 ± 4% -1.1 4.78 ± 2% perf-profile.children.cycles-pp.nfsd4_write
5.81 ± 4% -1.1 4.75 ± 2% perf-profile.children.cycles-pp.nfsd_vfs_write
5.80 ± 4% -1.1 4.75 ± 2% perf-profile.children.cycles-pp.do_iter_write
5.79 ± 4% -1.0 4.74 ± 2% perf-profile.children.cycles-pp.do_iter_readv_writev
5.79 ± 4% -1.0 4.74 ± 2% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write
5.54 ± 4% -0.9 4.59 ± 2% perf-profile.children.cycles-pp.iomap_file_buffered_write
5.54 ± 4% -0.9 4.59 ± 2% perf-profile.children.cycles-pp.iomap_apply
5.52 ± 3% -0.9 4.57 ± 2% perf-profile.children.cycles-pp.iomap_write_actor
8.46 ± 3% -0.9 7.56 perf-profile.children.cycles-pp.submit_bio_noacct
8.46 ± 3% -0.9 7.56 perf-profile.children.cycles-pp.brd_submit_bio
11.19 ± 3% -0.9 10.29 ± 2% perf-profile.children.cycles-pp.worker_thread
8.46 ± 3% -0.9 7.56 perf-profile.children.cycles-pp.submit_bio
8.42 ± 3% -0.9 7.53 perf-profile.children.cycles-pp.brd_do_bvec
8.40 ± 3% -0.9 7.51 perf-profile.children.cycles-pp.iomap_submit_ioend
10.69 ± 3% -0.8 9.86 ± 2% perf-profile.children.cycles-pp.process_one_work
4.91 ± 2% -0.8 4.12 ± 2% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
1.78 ± 6% -0.7 1.09 ± 3% perf-profile.children.cycles-pp.iomap_writepages
4.50 ± 4% -0.6 3.85 ± 3% perf-profile.children.cycles-pp.rpc_free_task
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.children.cycles-pp.__x64_sys_fsync
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.children.cycles-pp.do_fsync
5.28 ± 3% -0.6 4.64 ± 2% perf-profile.children.cycles-pp.nfs_file_fsync
1.23 ± 7% -0.6 0.62 ± 4% perf-profile.children.cycles-pp.iomap_writepage_map
4.30 ± 4% -0.6 3.69 ± 3% perf-profile.children.cycles-pp.rpc_async_release
4.37 ± 4% -0.6 3.76 ± 5% perf-profile.children.cycles-pp.nfs_write_end
3.42 ± 5% -0.6 2.87 ± 3% perf-profile.children.cycles-pp.nfs_write_completion
5.67 ± 4% -0.6 5.12 ± 2% perf-profile.children.cycles-pp.brd_insert_page
5.11 ± 4% -0.5 4.66 ± 3% perf-profile.children.cycles-pp._raw_spin_lock
3.40 ± 4% -0.5 2.94 perf-profile.children.cycles-pp.grab_cache_page_write_begin
3.37 ± 4% -0.4 2.92 perf-profile.children.cycles-pp.pagecache_get_page
3.16 ± 4% -0.4 2.73 ± 7% perf-profile.children.cycles-pp.nfs_updatepage
2.34 ± 6% -0.4 1.92 ± 4% perf-profile.children.cycles-pp.nfs_end_page_writeback
3.59 ± 3% -0.4 3.19 ± 2% perf-profile.children.cycles-pp.nfs_writepages
1.84 ± 2% -0.3 1.52 ± 4% perf-profile.children.cycles-pp.__schedule
2.96 ± 4% -0.3 2.63 ± 2% perf-profile.children.cycles-pp.nfs_writepages_callback
2.53 -0.3 2.21 ± 4% perf-profile.children.cycles-pp.memcpy_to_page
2.93 ± 4% -0.3 2.62 ± 2% perf-profile.children.cycles-pp.nfs_do_writepage
2.18 ± 3% -0.3 1.88 ± 2% perf-profile.children.cycles-pp.copyin
2.29 ± 4% -0.3 1.98 perf-profile.children.cycles-pp.add_to_page_cache_lru
2.18 ± 3% -0.3 1.88 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
2.56 ± 2% -0.3 2.26 ± 3% perf-profile.children.cycles-pp._copy_to_iter
2.24 ± 4% -0.3 1.95 ± 6% perf-profile.children.cycles-pp.nfs_writepage_setup
2.14 ± 3% -0.3 1.89 ± 2% perf-profile.children.cycles-pp.nfs_write_begin
1.49 ± 2% -0.2 1.24 ± 5% perf-profile.children.cycles-pp.schedule
1.25 ± 7% -0.2 1.03 ± 2% perf-profile.children.cycles-pp.iomap_write_end
1.53 ± 5% -0.2 1.31 ± 2% perf-profile.children.cycles-pp.__add_to_page_cache_locked
1.41 ± 5% -0.2 1.20 ± 3% perf-profile.children.cycles-pp.iomap_write_begin
1.17 ± 3% -0.2 0.97 ± 2% perf-profile.children.cycles-pp.try_to_wake_up
1.07 -0.2 0.88 ± 5% perf-profile.children.cycles-pp.pick_next_task_fair
1.19 ± 5% -0.2 1.01 perf-profile.children.cycles-pp.__filemap_fdatawait_range
0.97 ± 4% -0.2 0.80 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair
0.98 ± 4% -0.2 0.81 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate
1.43 ± 6% -0.2 1.26 ± 5% perf-profile.children.cycles-pp.end_page_writeback
1.41 ± 6% -0.2 1.24 ± 4% perf-profile.children.cycles-pp.test_clear_page_writeback
0.91 ± 3% -0.2 0.74 ± 3% perf-profile.children.cycles-pp.enqueue_entity
0.94 -0.2 0.78 ± 5% perf-profile.children.cycles-pp.newidle_balance
0.57 ± 3% -0.2 0.42 ± 6% perf-profile.children.cycles-pp.tcp_rcv_established
0.82 ± 4% -0.2 0.67 ± 3% perf-profile.children.cycles-pp.wake_up_page_bit
1.04 ± 5% -0.2 0.89 ± 3% perf-profile.children.cycles-pp.percpu_counter_add_batch
0.58 ± 3% -0.1 0.43 ± 6% perf-profile.children.cycles-pp.tcp_v6_do_rcv
0.86 ± 3% -0.1 0.72 ± 3% perf-profile.children.cycles-pp.__wake_up_common
0.73 ± 8% -0.1 0.59 ± 6% perf-profile.children.cycles-pp.account_page_dirtied
1.05 ± 2% -0.1 0.91 ± 4% perf-profile.children.cycles-pp.load_balance
0.72 ± 5% -0.1 0.59 ± 3% perf-profile.children.cycles-pp.poll_idle
0.78 ± 6% -0.1 0.65 ± 6% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.61 ± 4% -0.1 0.47 ± 4% perf-profile.children.cycles-pp.sched_ttwu_pending
0.69 ± 3% -0.1 0.56 ± 3% perf-profile.children.cycles-pp.__account_scheduler_latency
0.44 ± 3% -0.1 0.31 ± 4% perf-profile.children.cycles-pp.__release_sock
0.55 ± 4% -0.1 0.42 ± 5% perf-profile.children.cycles-pp.release_sock
0.29 ± 3% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.tcp_ack
0.27 ± 3% -0.1 0.15 ± 4% perf-profile.children.cycles-pp.tcp_clean_rtx_queue
0.56 ± 4% -0.1 0.43 ± 6% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.97 ± 4% -0.1 0.85 ± 2% perf-profile.children.cycles-pp.__test_set_page_writeback
0.92 ± 4% -0.1 0.80 ± 5% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.75 ± 4% -0.1 0.64 ± 5% perf-profile.children.cycles-pp.wait_on_page_bit
0.94 ± 2% -0.1 0.83 ± 5% perf-profile.children.cycles-pp.find_busiest_group
0.65 ± 3% -0.1 0.53 ± 2% perf-profile.children.cycles-pp.wake_page_function
0.73 ± 4% -0.1 0.62 ± 5% perf-profile.children.cycles-pp.mem_cgroup_charge
0.54 ± 7% -0.1 0.42 ± 6% perf-profile.children.cycles-pp.__mod_memcg_state
0.93 ± 2% -0.1 0.82 ± 5% perf-profile.children.cycles-pp.update_sd_lb_stats
0.66 ± 3% -0.1 0.55 ± 5% perf-profile.children.cycles-pp.io_schedule
0.89 ± 4% -0.1 0.79 ± 3% perf-profile.children.cycles-pp.__nfs_commit_inode
0.66 ± 3% -0.1 0.57 ± 7% perf-profile.children.cycles-pp.iomap_set_range_uptodate
0.50 ± 8% -0.1 0.40 ± 4% perf-profile.children.cycles-pp.nfs_ctx_key_to_expire
0.38 ± 15% -0.1 0.28 ± 13% perf-profile.children.cycles-pp.__set_page_dirty
0.28 ± 5% -0.1 0.18 ± 13% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
0.27 ± 17% -0.1 0.17 ± 13% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.20 ± 9% -0.1 0.11 ± 24% perf-profile.children.cycles-pp.xfs_ilock
0.27 ± 5% -0.1 0.17 ± 14% perf-profile.children.cycles-pp.rwsem_optimistic_spin
0.22 ± 7% -0.1 0.13 ± 19% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.53 ± 2% -0.1 0.44 ± 2% perf-profile.children.cycles-pp.stack_trace_save_tsk
1.06 ± 3% -0.1 0.98 perf-profile.children.cycles-pp.nfs_commit_release
1.06 ± 3% -0.1 0.98 perf-profile.children.cycles-pp.nfs_commit_release_pages
0.60 ± 3% -0.1 0.52 ± 3% perf-profile.children.cycles-pp.prep_new_page
0.72 ± 3% -0.1 0.64 perf-profile.children.cycles-pp.lru_cache_add
0.55 ± 5% -0.1 0.47 ± 2% perf-profile.children.cycles-pp.__radix_tree_lookup
0.41 ± 4% -0.1 0.33 ± 2% perf-profile.children.cycles-pp.schedule_idle
0.67 ± 3% -0.1 0.60 ± 2% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.39 ± 4% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.ip6_protocol_deliver_rcu
0.39 ± 3% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.ip6_input
0.38 ± 4% -0.1 0.31 ± 7% perf-profile.children.cycles-pp.tcp_v6_rcv
0.55 ± 3% -0.1 0.48 ± 2% perf-profile.children.cycles-pp.brd_lookup_page
0.51 ± 3% -0.1 0.44 ± 5% perf-profile.children.cycles-pp.clear_page_erms
0.46 ± 4% -0.1 0.39 ± 3% perf-profile.children.cycles-pp.arch_stack_walk
0.39 ± 4% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.ip6_input_finish
0.40 ± 3% -0.1 0.34 ± 6% perf-profile.children.cycles-pp.ipv6_rcv
0.22 ± 5% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.svc_xprt_do_enqueue
0.49 ± 3% -0.1 0.43 ± 2% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.61 ± 5% -0.1 0.56 ± 5% perf-profile.children.cycles-pp.xfs_end_io
0.61 ± 5% -0.1 0.56 ± 5% perf-profile.children.cycles-pp.xfs_end_ioend
0.59 ± 6% -0.1 0.54 ± 5% perf-profile.children.cycles-pp.iomap_finish_ioends
0.59 ± 6% -0.1 0.54 ± 5% perf-profile.children.cycles-pp.iomap_finish_ioend
0.47 ± 4% -0.1 0.42 ± 4% perf-profile.children.cycles-pp.nfs_page_group_sync_on_bit
0.33 ± 4% -0.0 0.28 ± 3% perf-profile.children.cycles-pp.unwind_next_frame
0.18 ± 3% -0.0 0.13 ± 3% perf-profile.children.cycles-pp.svc_xprt_received
0.18 ± 5% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.do_nfsd_create
0.39 ± 3% -0.0 0.35 ± 8% perf-profile.children.cycles-pp.nfs_request_add_commit_list
0.37 ± 3% -0.0 0.32 ± 3% perf-profile.children.cycles-pp.xas_load
0.21 ± 4% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.nfsd4_open
0.15 ± 5% -0.0 0.11 ± 10% perf-profile.children.cycles-pp.schedule_timeout
0.21 ± 5% -0.0 0.17 ± 6% perf-profile.children.cycles-pp.nfs_page_group_lock
0.21 ± 3% -0.0 0.17 ± 11% perf-profile.children.cycles-pp.dec_zone_page_state
0.14 ± 6% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.clear_bdi_congested
0.32 ± 5% -0.0 0.28 ± 4% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
0.32 ± 5% -0.0 0.28 ± 4% perf-profile.children.cycles-pp.find_get_pages_range_tag
0.17 ± 7% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.34 ± 3% -0.0 0.30 ± 3% perf-profile.children.cycles-pp.__mod_lruvec_state
0.21 -0.0 0.17 ± 8% perf-profile.children.cycles-pp.try_charge
0.11 ± 9% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.xfs_generic_create
0.11 ± 9% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.vfs_create
0.27 ± 3% -0.0 0.24 ± 3% perf-profile.children.cycles-pp.__mod_node_page_state
0.18 ± 5% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.alloc_pages_current
0.22 ± 5% -0.0 0.18 ± 8% perf-profile.children.cycles-pp.___might_sleep
0.15 ± 5% -0.0 0.12 ± 9% perf-profile.children.cycles-pp.sysvec_call_function_single
0.14 ± 6% -0.0 0.10 ± 10% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.20 ± 3% -0.0 0.17 ± 6% perf-profile.children.cycles-pp.nfs_initiate_commit
0.20 ± 5% -0.0 0.17 ± 6% perf-profile.children.cycles-pp.nfs_page_set_headlock
0.11 ± 7% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.xfs_create
0.37 ± 5% -0.0 0.34 ± 4% perf-profile.children.cycles-pp.update_rq_clock
0.14 ± 9% -0.0 0.11 ± 3% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.18 ± 8% -0.0 0.15 ± 12% perf-profile.children.cycles-pp.dequeue_entity
0.14 ± 6% -0.0 0.11 ± 10% perf-profile.children.cycles-pp.find_get_entry
0.15 ± 2% -0.0 0.12 ± 8% perf-profile.children.cycles-pp.finish_task_switch
0.16 ± 5% -0.0 0.13 ± 10% perf-profile.children.cycles-pp.node_dirty_ok
0.14 ± 8% -0.0 0.11 ± 8% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.33 ± 3% -0.0 0.30 ± 3% perf-profile.children.cycles-pp.nfs_page_group_destroy
0.15 ± 10% -0.0 0.12 ± 4% perf-profile.children.cycles-pp.lock_sock_nested
0.10 ± 4% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.rpc_wait_bit_killable
0.11 ± 7% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.xfs_map_blocks
0.12 ± 8% -0.0 0.09 ± 8% perf-profile.children.cycles-pp.update_curr
0.19 ± 8% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.do_mkdirat
0.19 ± 8% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.filename_create
0.18 ± 4% -0.0 0.15 ± 6% perf-profile.children.cycles-pp.xs_stream_data_receive_workfn
0.18 ± 4% -0.0 0.15 ± 6% perf-profile.children.cycles-pp.xs_stream_data_receive
0.15 ± 4% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.lookup_dcache
0.18 ± 2% -0.0 0.15 ± 10% perf-profile.children.cycles-pp.mutex_lock
0.08 ± 5% -0.0 0.06 ± 11% perf-profile.children.cycles-pp._raw_spin_lock_bh
0.11 ± 6% -0.0 0.09 ± 10% perf-profile.children.cycles-pp.unlock_page
0.15 ± 5% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function
0.11 ± 7% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.xas_start
0.10 ± 7% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__orc_find
0.11 ± 4% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.out_of_line_wait_on_bit
0.11 ± 4% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__wait_on_bit
0.08 ± 11% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__switch_to_asm
0.10 ± 10% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.nfs_key_timeout_notify
0.10 ± 9% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.set_next_entity
0.11 ± 14% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.__lock_sock
0.21 ± 3% -0.0 0.19 ± 4% perf-profile.children.cycles-pp.__queue_work
0.12 ± 4% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.nfs_unlock_and_release_request
0.10 -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__pagevec_release
0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.19 ± 4% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.queue_work_on
0.16 ± 2% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.__wake_up_common_lock
0.09 ± 7% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.__switch_to
0.11 ± 7% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.iov_iter_advance
0.08 ± 5% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.xas_set_mark
0.08 -0.0 0.07 ± 6% perf-profile.children.cycles-pp.nfs_request_add_commit_list_locked
0.01 ±173% +0.0 0.06 ± 11% perf-profile.children.cycles-pp.osq_lock
0.27 ± 4% +0.0 0.32 ± 5% perf-profile.children.cycles-pp.__tcp_push_pending_frames
0.01 ±173% +0.1 0.06 ± 6% perf-profile.children.cycles-pp.kfree
0.28 ± 7% +0.1 0.35 ± 4% perf-profile.children.cycles-pp.svc_tcp_sendto
0.30 ± 7% +0.1 0.38 ± 3% perf-profile.children.cycles-pp.svc_send
0.42 ± 10% +0.1 0.51 ± 4% perf-profile.children.cycles-pp.rebalance_domains
0.00 +0.1 0.11 ± 13% perf-profile.children.cycles-pp.pskb_expand_head
0.00 +0.1 0.13 perf-profile.children.cycles-pp.iov_iter_get_pages
1.22 ± 5% +0.2 1.37 ± 2% perf-profile.children.cycles-pp.rmqueue
0.09 ± 4% +0.2 0.24 ± 10% perf-profile.children.cycles-pp.__check_object_size
0.07 +0.2 0.24 ± 7% perf-profile.children.cycles-pp.simple_copy_to_iter
0.00 +0.2 0.18 ± 2% perf-profile.children.cycles-pp.__zerocopy_sg_from_iter
0.00 +0.2 0.18 ± 2% perf-profile.children.cycles-pp.skb_zerocopy_iter_stream
0.50 ± 4% +0.3 0.76 ± 3% perf-profile.children.cycles-pp.rmqueue_bulk
0.43 ± 5% +0.3 0.72 ± 4% perf-profile.children.cycles-pp.free_unref_page
0.24 ± 8% +0.3 0.53 ± 7% perf-profile.children.cycles-pp.free_pcppages_bulk
0.78 ± 5% +0.3 1.11 ± 4% perf-profile.children.cycles-pp.__list_del_entry_valid
0.23 ± 6% +0.4 0.59 ± 5% perf-profile.children.cycles-pp.skb_release_data
3.28 ± 2% +0.4 3.65 ± 4% perf-profile.children.cycles-pp.inet6_recvmsg
3.27 ± 2% +0.4 3.64 ± 4% perf-profile.children.cycles-pp.tcp_recvmsg
0.31 ± 4% +0.4 0.71 ± 7% perf-profile.children.cycles-pp.__kfree_skb
5.52 +2.3 7.82 perf-profile.children.cycles-pp.memcpy_erms
5.13 ± 10% +3.3 8.47 ± 3% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
0.73 ± 5% +3.7 4.43 perf-profile.children.cycles-pp.tcp_write_xmit
0.79 ± 4% +3.7 4.51 perf-profile.children.cycles-pp.__tcp_transmit_skb
0.69 ± 5% +3.7 4.44 perf-profile.children.cycles-pp.inet6_csk_xmit
0.62 ± 5% +3.8 4.40 perf-profile.children.cycles-pp.ip6_xmit
0.60 ± 4% +3.8 4.38 perf-profile.children.cycles-pp.ip6_output
0.56 ± 3% +3.8 4.34 ± 2% perf-profile.children.cycles-pp.ip6_finish_output2
0.48 ± 4% +3.8 4.26 ± 2% perf-profile.children.cycles-pp.__local_bh_enable_ip
0.47 ± 4% +3.8 4.26 ± 2% perf-profile.children.cycles-pp.do_softirq
0.42 ± 3% +3.8 4.21 ± 2% perf-profile.children.cycles-pp.__netif_receive_skb_one_core
0.44 ± 4% +3.8 4.23 ± 2% perf-profile.children.cycles-pp.net_rx_action
0.43 ± 4% +3.8 4.22 ± 2% perf-profile.children.cycles-pp.process_backlog
1.38 ± 8% +3.8 5.20 perf-profile.children.cycles-pp.do_softirq_own_stack
1.38 ± 8% +3.8 5.20 perf-profile.children.cycles-pp.__softirqentry_text_start
0.00 +3.9 3.86 ± 2% perf-profile.children.cycles-pp.skb_copy_ubufs
0.00 +3.9 3.87 ± 2% perf-profile.children.cycles-pp.__netif_receive_skb_core
44.19 ± 4% +4.2 48.41 perf-profile.children.cycles-pp.cpuidle_enter
44.18 ± 4% +4.2 48.40 perf-profile.children.cycles-pp.cpuidle_enter_state
49.23 ± 2% +4.9 54.14 perf-profile.children.cycles-pp.start_secondary
49.50 ± 2% +5.0 54.45 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
49.50 ± 2% +5.0 54.45 perf-profile.children.cycles-pp.cpu_startup_entry
49.49 ± 2% +5.0 54.44 perf-profile.children.cycles-pp.do_idle
2.92 ± 3% -0.4 2.54 ± 3% perf-profile.self.cycles-pp._raw_spin_lock
2.16 ± 3% -0.3 1.86 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
2.19 ± 3% -0.3 1.92 ± 2% perf-profile.self.cycles-pp.brd_do_bvec
1.85 ± 6% -0.2 1.66 ± 4% perf-profile.self.cycles-pp.nfs_do_writepage
0.92 ± 5% -0.2 0.75 ± 5% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.92 ± 6% -0.1 0.79 ± 5% perf-profile.self.cycles-pp.percpu_counter_add_batch
0.69 ± 5% -0.1 0.56 ± 4% perf-profile.self.cycles-pp.poll_idle
0.53 ± 8% -0.1 0.41 ± 6% perf-profile.self.cycles-pp.__mod_memcg_state
0.46 ± 10% -0.1 0.35 ± 9% perf-profile.self.cycles-pp.nfs_end_page_writeback
0.64 ± 2% -0.1 0.53 ± 4% perf-profile.self.cycles-pp.update_sd_lb_stats
0.82 ± 2% -0.1 0.72 ± 3% perf-profile.self.cycles-pp.nfs_write_end
0.24 ± 18% -0.1 0.14 ± 13% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.36 ± 6% -0.1 0.26 ± 4% perf-profile.self.cycles-pp.svc_tcp_recvfrom
0.22 ± 7% -0.1 0.12 ± 15% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.48 ± 8% -0.1 0.39 ± 4% perf-profile.self.cycles-pp.nfs_ctx_key_to_expire
0.46 ± 6% -0.1 0.37 ± 2% perf-profile.self.cycles-pp.rmqueue
0.65 ± 3% -0.1 0.56 ± 7% perf-profile.self.cycles-pp.iomap_set_range_uptodate
0.54 ± 4% -0.1 0.47 ± 2% perf-profile.self.cycles-pp.__radix_tree_lookup
0.50 ± 2% -0.1 0.44 ± 5% perf-profile.self.cycles-pp.clear_page_erms
0.30 ± 11% -0.1 0.24 ± 9% perf-profile.self.cycles-pp.clear_page_dirty_for_io
0.16 ± 5% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.try_to_wake_up
0.26 ± 5% -0.0 0.22 ± 5% perf-profile.self.cycles-pp.find_get_pages_range_tag
0.14 ± 6% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.clear_bdi_congested
0.19 ± 5% -0.0 0.15 ± 12% perf-profile.self.cycles-pp.dec_zone_page_state
0.20 ± 5% -0.0 0.16 ± 5% perf-profile.self.cycles-pp.nfs_page_set_headlock
0.28 ± 4% -0.0 0.24 ± 2% perf-profile.self.cycles-pp.xas_load
0.26 ± 4% -0.0 0.23 ± 3% perf-profile.self.cycles-pp.__mod_node_page_state
0.21 ± 5% -0.0 0.18 ± 7% perf-profile.self.cycles-pp.___might_sleep
0.21 ± 6% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.__nfs_create_request
0.22 -0.0 0.19 ± 5% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.07 ± 12% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.svc_recv
0.14 ± 9% -0.0 0.11 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.07 ± 7% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.iomap_writepage_map
0.11 ± 6% -0.0 0.09 ± 10% perf-profile.self.cycles-pp.unlock_page
0.10 ± 7% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.__orc_find
0.08 ± 11% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__switch_to_asm
0.15 ± 4% -0.0 0.13 ± 5% perf-profile.self.cycles-pp.do_idle
0.11 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.iov_iter_advance
0.10 ± 10% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.alloc_pages_current
0.17 ± 2% -0.0 0.15 ± 5% perf-profile.self.cycles-pp.unwind_next_frame
0.15 ± 2% -0.0 0.13 ± 5% perf-profile.self.cycles-pp.release_pages
0.10 ± 5% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.xas_start
0.07 ± 12% -0.0 0.05 perf-profile.self.cycles-pp.set_next_entity
0.08 -0.0 0.07 ± 7% perf-profile.self.cycles-pp.xas_set_mark
0.08 ± 6% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.enqueue_entity
0.14 ± 6% +0.0 0.16 ± 6% perf-profile.self.cycles-pp.skb_release_data
0.01 ±173% +0.0 0.06 ± 11% perf-profile.self.cycles-pp.osq_lock
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.kfree
0.00 +0.1 0.09 ± 13% perf-profile.self.cycles-pp.pskb_expand_head
0.00 +0.1 0.12 ± 6% perf-profile.self.cycles-pp.skb_copy_ubufs
0.10 ± 12% +0.1 0.23 ± 8% perf-profile.self.cycles-pp.free_pcppages_bulk
0.00 +0.1 0.13 perf-profile.self.cycles-pp.iov_iter_get_pages
0.07 ± 7% +0.1 0.21 ± 10% perf-profile.self.cycles-pp.__check_object_size
0.77 ± 4% +0.3 1.10 ± 4% perf-profile.self.cycles-pp.__list_del_entry_valid
5.46 +2.3 7.73 perf-profile.self.cycles-pp.memcpy_erms
fsmark.files_per_sec
580 +---------------------------------------------------------------------+
| .+ |
560 |..+. .+. + .+..+.. .+..+ |
| +. +.. + + .+..+ +.+. |
| +.. .. + .. + +. |
540 |-+ + + + + |
| + |
520 |-+ |
| |
500 |-+ |
| O O O |
| O O O O O O O O O O O O O O O |
480 |-+ O O O O O O |
| O |
460 +---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2ap2: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs2/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1BRD_48G/4M/nfsv4/xfs/1x/x86_64-rhel-8.3/64t/debian-10.4-x86_64-20200603.cgz/NoSync/lkp-csl-2ap2/40G/fsmark/0x5003003
commit:
v5.10-rc2
3bc6a407d1 ("SUNRPC: Use zero-copy to perform socket send operations")
v5.10-rc2 3bc6a407d1a090417218ecdb0dd
---------------- ---------------------------
%stddev %change %stddev
\ | \
12868393 +17.9% 15177801 ± 2% fsmark.app_overhead
559.38 -13.3% 485.20 fsmark.files_per_sec
21.35 +13.1% 24.16 fsmark.time.elapsed_time
21.35 +13.1% 24.16 fsmark.time.elapsed_time.max
1664 ± 4% -13.9% 1433 ± 3% fsmark.time.involuntary_context_switches
251.75 ± 2% -13.1% 218.75 fsmark.time.percent_of_cpu_this_job_got
25.96 -2.0% 25.44 boot-time.dhcp
2.47 ± 2% +19.0% 2.95 ± 2% iostat.cpu.iowait
671458 ± 2% +8.6% 728893 ± 3% softirqs.RCU
1669499 -8.2% 1532757 vmstat.io.bo
202132 -13.7% 174380 ± 2% vmstat.system.cs
937363 ± 62% -61.6% 359933 ± 9% cpuidle.C1.usage
2.258e+09 ± 51% +86.4% 4.209e+09 ± 9% cpuidle.C1E.time
6449059 ± 20% +51.7% 9781611 ± 5% cpuidle.C1E.usage
2.67 ± 2% +0.5 3.16 ± 2% mpstat.cpu.all.iowait%
0.14 ± 3% +0.3 0.42 mpstat.cpu.all.soft%
3.55 ± 4% -0.5 3.05 ± 2% mpstat.cpu.all.sys%
10140 ± 26% -31.3% 6970 ± 3% numa-meminfo.node2.Mapped
16956 ± 7% -17.1% 14052 ± 3% numa-meminfo.node2.Writeback
196488 ± 12% -17.5% 162160 ± 11% numa-meminfo.node3.Slab
3006 ± 4% +7.2% 3223 ± 4% proc-vmstat.nr_active_anon
3006 ± 4% +7.2% 3223 ± 4% proc-vmstat.nr_zone_active_anon
77623491 ± 3% -13.4% 67184071 proc-vmstat.pgalloc_normal
56668889 ± 4% -18.7% 46043533 proc-vmstat.pgfree
10476 +4.4% 10935 proc-vmstat.pgreuse
4779 ± 13% -27.6% 3460 ± 6% sched_debug.cfs_rq:/.min_vruntime.stddev
27500 ± 37% -78.2% 5982 ± 93% sched_debug.cfs_rq:/.spread0.max
4780 ± 13% -25.8% 3546 ± 7% sched_debug.cfs_rq:/.spread0.stddev
1730403 ± 10% +41.9% 2456125 ± 26% sched_debug.cpu.avg_idle.max
13907 ± 18% -28.8% 9897 ± 21% sched_debug.cpu.nr_switches.max
1151 ± 9% -15.7% 970.60 ± 8% sched_debug.cpu.nr_switches.stddev
21696 -15.9% 18236 ± 2% slabinfo.kmalloc-1k.active_objs
684.25 -15.1% 580.75 ± 2% slabinfo.kmalloc-1k.active_slabs
21907 -15.1% 18591 ± 2% slabinfo.kmalloc-1k.num_objs
684.25 -15.1% 580.75 ± 2% slabinfo.kmalloc-1k.num_slabs
11971 ± 3% -11.5% 10592 ± 7% slabinfo.nfsd_file.active_objs
3314 ± 5% -20.9% 2621 ± 13% slabinfo.xfs_efd_item.active_objs
3355 ± 4% -20.1% 2680 ± 12% slabinfo.xfs_efd_item.num_objs
3275 ± 5% -20.4% 2607 ± 13% slabinfo.xfs_efi_item.active_objs
3318 ± 5% -19.7% 2663 ± 13% slabinfo.xfs_efi_item.num_objs
3.817e+09 -7.6% 3.526e+09 perf-stat.i.branch-instructions
3.316e+08 ± 2% -9.4% 3.003e+08 ± 2% perf-stat.i.cache-references
234663 ± 2% -16.7% 195399 perf-stat.i.context-switches
3.805e+10 ± 2% -6.6% 3.552e+10 ± 2% perf-stat.i.cpu-cycles
1382 ± 3% -7.2% 1283 ± 3% perf-stat.i.cpu-migrations
4.805e+09 -7.6% 4.438e+09 perf-stat.i.dTLB-loads
2.407e+09 -8.7% 2.198e+09 perf-stat.i.dTLB-stores
7989114 ± 2% -4.2% 7652291 perf-stat.i.iTLB-load-misses
1.929e+10 -7.4% 1.787e+10 perf-stat.i.instructions
2469 ± 2% -4.9% 2348 perf-stat.i.instructions-per-iTLB-miss
0.20 ± 2% -6.6% 0.19 ± 2% perf-stat.i.metric.GHz
59.57 -7.9% 54.88 perf-stat.i.metric.M/sec
38311030 ± 5% -10.6% 34257932 ± 2% perf-stat.i.node-load-misses
10676843 ± 7% -13.7% 9213801 perf-stat.i.node-loads
10297341 ± 21% -21.5% 8080955 ± 3% perf-stat.i.node-stores
3.647e+09 -7.2% 3.386e+09 perf-stat.ps.branch-instructions
3.169e+08 ± 2% -9.0% 2.884e+08 perf-stat.ps.cache-references
224244 -16.3% 187638 perf-stat.ps.context-switches
3.636e+10 ± 2% -6.2% 3.411e+10 ± 2% perf-stat.ps.cpu-cycles
4.59e+09 -7.1% 4.262e+09 perf-stat.ps.dTLB-loads
2.299e+09 -8.2% 2.11e+09 perf-stat.ps.dTLB-stores
7634292 ± 2% -3.7% 7349222 perf-stat.ps.iTLB-load-misses
1.843e+10 -6.9% 1.716e+10 perf-stat.ps.instructions
36618483 ± 5% -10.1% 32904334 ± 2% perf-stat.ps.node-load-misses
10197765 ± 7% -13.3% 8839824 perf-stat.ps.node-loads
9840509 ± 21% -21.1% 7760538 ± 3% perf-stat.ps.node-stores
4.173e+11 +4.7% 4.368e+11 ± 2% perf-stat.total.instructions
27.50 ± 35% +1444.5% 424.75 ± 95% interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2
46517 ± 2% +12.0% 52079 interrupts.CPU0.LOC:Local_timer_interrupts
2.00 ± 35% +2775.0% 57.50 ±157% interrupts.CPU0.TLB:TLB_shootdowns
46340 ± 3% +12.3% 52034 ± 2% interrupts.CPU1.LOC:Local_timer_interrupts
46533 ± 3% +11.7% 51972 interrupts.CPU10.LOC:Local_timer_interrupts
46371 ± 3% +11.9% 51871 ± 2% interrupts.CPU100.LOC:Local_timer_interrupts
46334 ± 3% +12.1% 51963 interrupts.CPU101.LOC:Local_timer_interrupts
46349 ± 3% +11.7% 51764 interrupts.CPU102.LOC:Local_timer_interrupts
46306 ± 3% +12.0% 51860 interrupts.CPU103.LOC:Local_timer_interrupts
46351 ± 3% +11.7% 51795 ± 2% interrupts.CPU104.LOC:Local_timer_interrupts
46348 ± 3% +11.9% 51847 ± 2% interrupts.CPU105.LOC:Local_timer_interrupts
46414 ± 2% +11.8% 51900 interrupts.CPU106.LOC:Local_timer_interrupts
46379 ± 3% +11.9% 51902 interrupts.CPU107.LOC:Local_timer_interrupts
46358 ± 3% +11.9% 51883 ± 2% interrupts.CPU108.LOC:Local_timer_interrupts
46420 ± 2% +11.5% 51766 interrupts.CPU109.LOC:Local_timer_interrupts
46404 ± 3% +12.0% 51974 interrupts.CPU11.LOC:Local_timer_interrupts
46349 ± 3% +11.9% 51882 ± 2% interrupts.CPU110.LOC:Local_timer_interrupts
46346 ± 3% +11.9% 51882 ± 2% interrupts.CPU111.LOC:Local_timer_interrupts
46377 ± 3% +11.9% 51878 ± 2% interrupts.CPU112.LOC:Local_timer_interrupts
46357 ± 3% +11.8% 51827 interrupts.CPU113.LOC:Local_timer_interrupts
46221 ± 3% +12.2% 51862 interrupts.CPU114.LOC:Local_timer_interrupts
46360 ± 3% +11.9% 51876 ± 2% interrupts.CPU115.LOC:Local_timer_interrupts
46382 ± 3% +11.9% 51881 ± 2% interrupts.CPU116.LOC:Local_timer_interrupts
46363 ± 3% +12.0% 51921 ± 2% interrupts.CPU117.LOC:Local_timer_interrupts
46362 ± 3% +12.1% 51961 interrupts.CPU118.LOC:Local_timer_interrupts
46375 ± 3% +11.9% 51882 ± 2% interrupts.CPU119.LOC:Local_timer_interrupts
27.50 ± 35% +1444.5% 424.75 ± 95% interrupts.CPU12.33:PCI-MSI.524291-edge.eth0-TxRx-2
46330 ± 2% +12.4% 52054 interrupts.CPU12.LOC:Local_timer_interrupts
46146 ± 3% +12.5% 51905 ± 2% interrupts.CPU120.LOC:Local_timer_interrupts
46155 ± 3% +12.5% 51904 ± 2% interrupts.CPU121.LOC:Local_timer_interrupts
46153 ± 3% +12.5% 51922 ± 2% interrupts.CPU122.LOC:Local_timer_interrupts
46147 ± 3% +12.5% 51908 ± 2% interrupts.CPU123.LOC:Local_timer_interrupts
46163 ± 3% +12.5% 51942 interrupts.CPU124.LOC:Local_timer_interrupts
46238 ± 3% +12.3% 51921 interrupts.CPU125.LOC:Local_timer_interrupts
46340 ± 3% +12.0% 51886 ± 2% interrupts.CPU126.LOC:Local_timer_interrupts
46208 ± 3% +12.1% 51822 ± 2% interrupts.CPU127.LOC:Local_timer_interrupts
46153 ± 3% +12.5% 51910 ± 2% interrupts.CPU128.LOC:Local_timer_interrupts
46179 ± 3% +12.4% 51916 ± 2% interrupts.CPU129.LOC:Local_timer_interrupts
46554 ± 3% +11.4% 51855 interrupts.CPU13.LOC:Local_timer_interrupts
46246 ± 3% +12.3% 51947 ± 2% interrupts.CPU130.LOC:Local_timer_interrupts
45950 ± 3% +13.0% 51904 ± 2% interrupts.CPU131.LOC:Local_timer_interrupts
46146 ± 3% +12.4% 51845 ± 2% interrupts.CPU132.LOC:Local_timer_interrupts
46125 ± 3% +12.6% 51920 ± 2% interrupts.CPU133.LOC:Local_timer_interrupts
46236 ± 3% +12.3% 51912 ± 2% interrupts.CPU134.LOC:Local_timer_interrupts
46232 ± 3% +12.3% 51902 ± 2% interrupts.CPU135.LOC:Local_timer_interrupts
46196 ± 3% +12.5% 51954 interrupts.CPU136.LOC:Local_timer_interrupts
46239 ± 3% +11.9% 51745 ± 2% interrupts.CPU137.LOC:Local_timer_interrupts
46415 ± 3% +11.8% 51892 interrupts.CPU138.LOC:Local_timer_interrupts
46236 ± 3% +12.2% 51895 ± 2% interrupts.CPU139.LOC:Local_timer_interrupts
46508 ± 3% +11.7% 51938 interrupts.CPU14.LOC:Local_timer_interrupts
46279 ± 3% +12.1% 51896 interrupts.CPU140.LOC:Local_timer_interrupts
46142 ± 3% +12.5% 51917 ± 2% interrupts.CPU141.LOC:Local_timer_interrupts
482.50 ± 18% +28.0% 617.50 ± 13% interrupts.CPU141.NMI:Non-maskable_interrupts
482.50 ± 18% +28.0% 617.50 ± 13% interrupts.CPU141.PMI:Performance_monitoring_interrupts
46295 ± 3% +11.6% 51670 ± 2% interrupts.CPU142.LOC:Local_timer_interrupts
617.75 ± 8% +29.8% 801.75 ± 15% interrupts.CPU142.NMI:Non-maskable_interrupts
617.75 ± 8% +29.8% 801.75 ± 15% interrupts.CPU142.PMI:Performance_monitoring_interrupts
1.00 ± 70% +20750.0% 208.50 ±169% interrupts.CPU142.TLB:TLB_shootdowns
46152 ± 3% +12.4% 51862 ± 2% interrupts.CPU143.LOC:Local_timer_interrupts
46417 ± 3% +12.1% 52022 interrupts.CPU144.LOC:Local_timer_interrupts
46496 ± 3% +11.8% 51987 interrupts.CPU145.LOC:Local_timer_interrupts
46498 ± 2% +11.9% 52022 interrupts.CPU146.LOC:Local_timer_interrupts
46507 ± 2% +11.8% 51978 interrupts.CPU147.LOC:Local_timer_interrupts
46499 ± 2% +11.8% 51994 interrupts.CPU148.LOC:Local_timer_interrupts
46515 ± 2% +11.7% 51971 interrupts.CPU149.LOC:Local_timer_interrupts
46469 ± 2% +11.8% 51941 interrupts.CPU15.LOC:Local_timer_interrupts
46568 ± 3% +11.7% 52007 interrupts.CPU150.LOC:Local_timer_interrupts
46562 ± 3% +11.7% 52002 interrupts.CPU151.LOC:Local_timer_interrupts
46510 ± 2% +11.8% 51979 interrupts.CPU152.LOC:Local_timer_interrupts
46661 ± 2% +11.4% 51971 interrupts.CPU153.LOC:Local_timer_interrupts
46532 ± 2% +11.7% 51986 interrupts.CPU154.LOC:Local_timer_interrupts
46514 ± 2% +11.9% 52042 interrupts.CPU155.LOC:Local_timer_interrupts
46415 ± 2% +12.2% 52069 interrupts.CPU156.LOC:Local_timer_interrupts
2565 ± 12% -24.0% 1949 ± 17% interrupts.CPU157.CAL:Function_call_interrupts
46532 ± 2% +11.7% 51958 interrupts.CPU157.LOC:Local_timer_interrupts
46494 ± 2% +11.8% 51999 interrupts.CPU158.LOC:Local_timer_interrupts
46949 ± 3% +10.8% 52016 interrupts.CPU159.LOC:Local_timer_interrupts
46480 ± 2% +11.8% 51958 interrupts.CPU16.LOC:Local_timer_interrupts
46492 ± 2% +11.8% 51997 interrupts.CPU160.LOC:Local_timer_interrupts
46601 ± 3% +11.6% 51984 interrupts.CPU161.LOC:Local_timer_interrupts
524.75 ± 52% +105.4% 1078 ± 23% interrupts.CPU161.NMI:Non-maskable_interrupts
524.75 ± 52% +105.4% 1078 ± 23% interrupts.CPU161.PMI:Performance_monitoring_interrupts
46573 ± 3% +11.6% 51992 interrupts.CPU162.LOC:Local_timer_interrupts
46516 ± 3% +11.8% 51994 interrupts.CPU163.LOC:Local_timer_interrupts
46552 ± 3% +11.7% 52016 interrupts.CPU164.LOC:Local_timer_interrupts
46556 ± 2% +11.6% 51968 interrupts.CPU165.LOC:Local_timer_interrupts
46509 ± 2% +11.9% 52023 interrupts.CPU166.LOC:Local_timer_interrupts
46486 ± 2% +11.8% 51954 interrupts.CPU167.LOC:Local_timer_interrupts
2735 ± 17% -22.1% 2131 ± 7% interrupts.CPU168.CAL:Function_call_interrupts
46657 ± 3% +11.2% 51869 ± 2% interrupts.CPU168.LOC:Local_timer_interrupts
2577 ± 10% -31.5% 1765 ± 11% interrupts.CPU169.CAL:Function_call_interrupts
46474 ± 2% +11.8% 51975 interrupts.CPU169.LOC:Local_timer_interrupts
1882 ± 13% +29.5% 2438 ± 11% interrupts.CPU17.CAL:Function_call_interrupts
46241 ± 3% +12.3% 51932 interrupts.CPU17.LOC:Local_timer_interrupts
46536 ± 3% +11.6% 51918 interrupts.CPU170.LOC:Local_timer_interrupts
46614 ± 3% +11.4% 51912 interrupts.CPU171.LOC:Local_timer_interrupts
46464 ± 3% +11.8% 51967 interrupts.CPU172.LOC:Local_timer_interrupts
46584 ± 3% +11.5% 51924 interrupts.CPU173.LOC:Local_timer_interrupts
46526 ± 3% +11.5% 51868 ± 2% interrupts.CPU174.LOC:Local_timer_interrupts
46603 ± 3% +11.4% 51905 interrupts.CPU175.LOC:Local_timer_interrupts
46588 ± 3% +11.4% 51878 ± 2% interrupts.CPU176.LOC:Local_timer_interrupts
46476 ± 2% +11.7% 51930 ± 2% interrupts.CPU177.LOC:Local_timer_interrupts
46529 ± 2% +11.4% 51821 interrupts.CPU178.LOC:Local_timer_interrupts
46519 ± 3% +11.6% 51902 ± 2% interrupts.CPU179.LOC:Local_timer_interrupts
1137 ± 12% -41.7% 662.50 ± 40% interrupts.CPU179.NMI:Non-maskable_interrupts
1137 ± 12% -41.7% 662.50 ± 40% interrupts.CPU179.PMI:Performance_monitoring_interrupts
46228 ± 3% +12.3% 51928 interrupts.CPU18.LOC:Local_timer_interrupts
2552 ± 15% -19.6% 2052 ± 8% interrupts.CPU180.CAL:Function_call_interrupts
46592 ± 3% +11.4% 51889 interrupts.CPU180.LOC:Local_timer_interrupts
46437 ± 3% +11.4% 51749 ± 2% interrupts.CPU181.LOC:Local_timer_interrupts
46574 ± 2% +11.4% 51877 interrupts.CPU182.LOC:Local_timer_interrupts
877.50 ± 21% -52.0% 421.50 ± 28% interrupts.CPU182.NMI:Non-maskable_interrupts
877.50 ± 21% -52.0% 421.50 ± 28% interrupts.CPU182.PMI:Performance_monitoring_interrupts
46513 ± 3% +11.5% 51881 interrupts.CPU183.LOC:Local_timer_interrupts
803.00 ± 17% -35.1% 521.25 ± 11% interrupts.CPU183.NMI:Non-maskable_interrupts
803.00 ± 17% -35.1% 521.25 ± 11% interrupts.CPU183.PMI:Performance_monitoring_interrupts
46487 ± 3% +11.6% 51868 ± 2% interrupts.CPU184.LOC:Local_timer_interrupts
748.50 ± 16% -36.4% 476.00 ± 24% interrupts.CPU184.NMI:Non-maskable_interrupts
748.50 ± 16% -36.4% 476.00 ± 24% interrupts.CPU184.PMI:Performance_monitoring_interrupts
46583 ± 3% +11.3% 51870 ± 2% interrupts.CPU185.LOC:Local_timer_interrupts
46465 ± 3% +11.6% 51870 ± 2% interrupts.CPU186.LOC:Local_timer_interrupts
46465 ± 3% +11.8% 51937 ± 2% interrupts.CPU187.LOC:Local_timer_interrupts
46555 ± 3% +11.4% 51878 ± 2% interrupts.CPU188.LOC:Local_timer_interrupts
2884 ± 25% -29.4% 2037 ± 10% interrupts.CPU189.CAL:Function_call_interrupts
46581 ± 3% +11.4% 51886 interrupts.CPU189.LOC:Local_timer_interrupts
46447 ± 3% +11.8% 51919 interrupts.CPU19.LOC:Local_timer_interrupts
46576 ± 3% +11.4% 51870 ± 2% interrupts.CPU190.LOC:Local_timer_interrupts
46478 ± 2% +11.6% 51889 interrupts.CPU191.LOC:Local_timer_interrupts
46453 ± 3% +11.9% 51986 interrupts.CPU2.LOC:Local_timer_interrupts
46377 ± 3% +12.2% 52015 interrupts.CPU20.LOC:Local_timer_interrupts
1365 ± 85% -67.8% 439.50 ± 41% interrupts.CPU20.NMI:Non-maskable_interrupts
1365 ± 85% -67.8% 439.50 ± 41% interrupts.CPU20.PMI:Performance_monitoring_interrupts
46389 ± 3% +12.1% 52019 interrupts.CPU21.LOC:Local_timer_interrupts
46439 ± 3% +11.9% 51967 interrupts.CPU22.LOC:Local_timer_interrupts
750.00 ± 6% -43.7% 422.25 ± 27% interrupts.CPU22.NMI:Non-maskable_interrupts
750.00 ± 6% -43.7% 422.25 ± 27% interrupts.CPU22.PMI:Performance_monitoring_interrupts
46396 ± 3% +12.1% 52020 interrupts.CPU23.LOC:Local_timer_interrupts
46080 ± 3% +12.8% 51965 interrupts.CPU24.LOC:Local_timer_interrupts
46183 ± 3% +12.6% 51990 ± 2% interrupts.CPU25.LOC:Local_timer_interrupts
46226 ± 3% +12.4% 51979 ± 2% interrupts.CPU26.LOC:Local_timer_interrupts
46238 ± 3% +12.4% 51984 ± 2% interrupts.CPU27.LOC:Local_timer_interrupts
46288 ± 3% +12.3% 51999 interrupts.CPU28.LOC:Local_timer_interrupts
46173 ± 3% +12.5% 51962 interrupts.CPU29.LOC:Local_timer_interrupts
46412 ± 3% +11.9% 51944 interrupts.CPU3.LOC:Local_timer_interrupts
46318 ± 3% +12.2% 51967 ± 2% interrupts.CPU30.LOC:Local_timer_interrupts
46311 ± 3% +12.2% 51981 interrupts.CPU31.LOC:Local_timer_interrupts
46262 ± 3% +12.4% 51981 ± 2% interrupts.CPU32.LOC:Local_timer_interrupts
46201 ± 3% +12.1% 51800 ± 2% interrupts.CPU33.LOC:Local_timer_interrupts
46263 ± 3% +12.3% 51957 interrupts.CPU34.LOC:Local_timer_interrupts
46287 ± 3% +12.1% 51870 ± 2% interrupts.CPU35.LOC:Local_timer_interrupts
46200 ± 3% +11.8% 51638 ± 2% interrupts.CPU36.LOC:Local_timer_interrupts
46224 ± 3% +12.5% 52006 interrupts.CPU37.LOC:Local_timer_interrupts
46163 ± 3% +12.5% 51950 ± 2% interrupts.CPU38.LOC:Local_timer_interrupts
46328 ± 3% +12.2% 51993 interrupts.CPU39.LOC:Local_timer_interrupts
46435 ± 3% +12.1% 52052 interrupts.CPU4.LOC:Local_timer_interrupts
46343 ± 3% +12.2% 52012 interrupts.CPU40.LOC:Local_timer_interrupts
484.00 ± 25% +52.1% 736.00 ± 23% interrupts.CPU40.NMI:Non-maskable_interrupts
484.00 ± 25% +52.1% 736.00 ± 23% interrupts.CPU40.PMI:Performance_monitoring_interrupts
46267 ± 3% +12.3% 51973 interrupts.CPU41.LOC:Local_timer_interrupts
46223 ± 3% +12.5% 51997 ± 2% interrupts.CPU42.LOC:Local_timer_interrupts
46251 ± 3% +12.5% 52055 interrupts.CPU43.LOC:Local_timer_interrupts
46293 ± 3% +12.2% 51951 interrupts.CPU44.LOC:Local_timer_interrupts
0.50 ±100% +22800.0% 114.50 ±169% interrupts.CPU44.TLB:TLB_shootdowns
46318 ± 3% +12.2% 51951 interrupts.CPU45.LOC:Local_timer_interrupts
46190 ± 3% +12.5% 51954 ± 2% interrupts.CPU46.LOC:Local_timer_interrupts
46195 ± 3% +12.4% 51912 ± 2% interrupts.CPU47.LOC:Local_timer_interrupts
46573 ± 3% +11.6% 51993 interrupts.CPU48.LOC:Local_timer_interrupts
46525 ± 2% +11.9% 52043 interrupts.CPU49.LOC:Local_timer_interrupts
46481 ± 2% +11.8% 51970 interrupts.CPU5.LOC:Local_timer_interrupts
46676 ± 2% +11.5% 52021 interrupts.CPU50.LOC:Local_timer_interrupts
46614 ± 3% +11.6% 52002 interrupts.CPU51.LOC:Local_timer_interrupts
46510 ± 3% +11.8% 52005 interrupts.CPU52.LOC:Local_timer_interrupts
46599 ± 3% +11.6% 52027 interrupts.CPU53.LOC:Local_timer_interrupts
46678 ± 2% +11.5% 52032 interrupts.CPU54.LOC:Local_timer_interrupts
46576 ± 3% +11.6% 51997 interrupts.CPU55.LOC:Local_timer_interrupts
46546 ± 3% +11.6% 51960 ± 2% interrupts.CPU56.LOC:Local_timer_interrupts
46574 ± 3% +11.7% 52019 interrupts.CPU57.LOC:Local_timer_interrupts
46620 ± 3% +11.6% 52046 interrupts.CPU58.LOC:Local_timer_interrupts
46589 ± 3% +11.6% 51978 interrupts.CPU59.LOC:Local_timer_interrupts
46399 ± 3% +12.1% 52033 interrupts.CPU6.LOC:Local_timer_interrupts
46580 ± 3% +11.6% 52004 interrupts.CPU60.LOC:Local_timer_interrupts
46567 ± 3% +11.8% 52042 interrupts.CPU61.LOC:Local_timer_interrupts
46574 ± 3% +11.7% 52011 interrupts.CPU62.LOC:Local_timer_interrupts
46504 ± 2% +11.9% 52021 interrupts.CPU63.LOC:Local_timer_interrupts
88.75 ± 20% -39.2% 54.00 ± 23% interrupts.CPU63.RES:Rescheduling_interrupts
46584 ± 3% +11.7% 52012 interrupts.CPU64.LOC:Local_timer_interrupts
46539 ± 2% +11.8% 52026 interrupts.CPU65.LOC:Local_timer_interrupts
492.00 ± 45% +123.2% 1098 ± 15% interrupts.CPU65.NMI:Non-maskable_interrupts
492.00 ± 45% +123.2% 1098 ± 15% interrupts.CPU65.PMI:Performance_monitoring_interrupts
46516 ± 2% +12.0% 52087 interrupts.CPU66.LOC:Local_timer_interrupts
46574 ± 2% +11.8% 52048 interrupts.CPU67.LOC:Local_timer_interrupts
46532 ± 2% +11.8% 52025 interrupts.CPU68.LOC:Local_timer_interrupts
46544 ± 3% +11.8% 52025 interrupts.CPU69.LOC:Local_timer_interrupts
46360 ± 3% +12.2% 52031 interrupts.CPU7.LOC:Local_timer_interrupts
46617 ± 3% +11.5% 51988 interrupts.CPU70.LOC:Local_timer_interrupts
46629 ± 3% +11.5% 52000 interrupts.CPU71.LOC:Local_timer_interrupts
46559 ± 2% +11.5% 51891 interrupts.CPU72.LOC:Local_timer_interrupts
46387 ± 3% +12.1% 51993 interrupts.CPU73.LOC:Local_timer_interrupts
46619 ± 3% +11.6% 52046 interrupts.CPU74.LOC:Local_timer_interrupts
46617 ± 3% +11.3% 51907 ± 2% interrupts.CPU75.LOC:Local_timer_interrupts
46621 ± 3% +11.3% 51904 ± 2% interrupts.CPU76.LOC:Local_timer_interrupts
942.75 ± 22% -47.9% 491.00 ± 27% interrupts.CPU76.NMI:Non-maskable_interrupts
942.75 ± 22% -47.9% 491.00 ± 27% interrupts.CPU76.PMI:Performance_monitoring_interrupts
46584 ± 3% +11.6% 51993 interrupts.CPU77.LOC:Local_timer_interrupts
85.75 ± 15% -28.3% 61.50 ± 20% interrupts.CPU77.RES:Rescheduling_interrupts
3195 ± 11% -38.2% 1974 ± 16% interrupts.CPU78.CAL:Function_call_interrupts
46556 ± 3% +11.5% 51905 ± 2% interrupts.CPU78.LOC:Local_timer_interrupts
1102 ± 51% -58.9% 453.00 ± 34% interrupts.CPU78.NMI:Non-maskable_interrupts
1102 ± 51% -58.9% 453.00 ± 34% interrupts.CPU78.PMI:Performance_monitoring_interrupts
130.75 ± 51% -62.1% 49.50 ± 22% interrupts.CPU78.RES:Rescheduling_interrupts
3086 ± 16% -28.7% 2202 ± 15% interrupts.CPU79.CAL:Function_call_interrupts
46568 ± 3% +11.4% 51897 ± 2% interrupts.CPU79.LOC:Local_timer_interrupts
934.25 ± 34% -40.8% 552.75 ± 33% interrupts.CPU79.NMI:Non-maskable_interrupts
934.25 ± 34% -40.8% 552.75 ± 33% interrupts.CPU79.PMI:Performance_monitoring_interrupts
95.75 ± 15% -47.8% 50.00 ± 18% interrupts.CPU79.RES:Rescheduling_interrupts
46388 ± 3% +12.1% 52009 interrupts.CPU8.LOC:Local_timer_interrupts
46580 ± 3% +11.4% 51896 interrupts.CPU80.LOC:Local_timer_interrupts
854.75 ± 29% -39.9% 513.50 ± 38% interrupts.CPU80.NMI:Non-maskable_interrupts
854.75 ± 29% -39.9% 513.50 ± 38% interrupts.CPU80.PMI:Performance_monitoring_interrupts
46569 ± 3% +11.5% 51906 ± 2% interrupts.CPU81.LOC:Local_timer_interrupts
947.75 ± 16% -37.4% 593.25 ± 34% interrupts.CPU81.NMI:Non-maskable_interrupts
947.75 ± 16% -37.4% 593.25 ± 34% interrupts.CPU81.PMI:Performance_monitoring_interrupts
80.75 ± 26% -36.8% 51.00 ± 24% interrupts.CPU81.RES:Rescheduling_interrupts
46580 ± 3% +11.7% 52016 interrupts.CPU82.LOC:Local_timer_interrupts
99.50 ± 49% -50.5% 49.25 ± 51% interrupts.CPU82.RES:Rescheduling_interrupts
46554 ± 3% +11.7% 51996 interrupts.CPU83.LOC:Local_timer_interrupts
1112 ± 16% -50.6% 549.50 ± 46% interrupts.CPU83.NMI:Non-maskable_interrupts
1112 ± 16% -50.6% 549.50 ± 46% interrupts.CPU83.PMI:Performance_monitoring_interrupts
46552 ± 3% +11.7% 51995 interrupts.CPU84.LOC:Local_timer_interrupts
46559 ± 3% +11.8% 52052 interrupts.CPU85.LOC:Local_timer_interrupts
985.00 ± 31% -48.5% 507.25 ± 5% interrupts.CPU85.NMI:Non-maskable_interrupts
985.00 ± 31% -48.5% 507.25 ± 5% interrupts.CPU85.PMI:Performance_monitoring_interrupts
46561 ± 3% +11.7% 51995 interrupts.CPU86.LOC:Local_timer_interrupts
807.25 ± 6% -45.9% 436.50 ± 28% interrupts.CPU86.NMI:Non-maskable_interrupts
807.25 ± 6% -45.9% 436.50 ± 28% interrupts.CPU86.PMI:Performance_monitoring_interrupts
46540 ± 3% +11.7% 51995 interrupts.CPU87.LOC:Local_timer_interrupts
834.50 ± 20% -45.2% 457.50 ± 57% interrupts.CPU87.NMI:Non-maskable_interrupts
834.50 ± 20% -45.2% 457.50 ± 57% interrupts.CPU87.PMI:Performance_monitoring_interrupts
46604 ± 3% +11.5% 51950 ± 2% interrupts.CPU88.LOC:Local_timer_interrupts
814.50 ± 15% -52.0% 391.25 ± 30% interrupts.CPU88.NMI:Non-maskable_interrupts
814.50 ± 15% -52.0% 391.25 ± 30% interrupts.CPU88.PMI:Performance_monitoring_interrupts
46563 ± 3% +11.5% 51929 ± 2% interrupts.CPU89.LOC:Local_timer_interrupts
881.75 ± 39% -51.2% 430.50 ± 22% interrupts.CPU89.NMI:Non-maskable_interrupts
881.75 ± 39% -51.2% 430.50 ± 22% interrupts.CPU89.PMI:Performance_monitoring_interrupts
46354 ± 3% +12.0% 51935 interrupts.CPU9.LOC:Local_timer_interrupts
46561 ± 3% +11.4% 51891 interrupts.CPU90.LOC:Local_timer_interrupts
1047 ± 41% -56.5% 455.75 ± 25% interrupts.CPU90.NMI:Non-maskable_interrupts
1047 ± 41% -56.5% 455.75 ± 25% interrupts.CPU90.PMI:Performance_monitoring_interrupts
46529 ± 3% +11.5% 51896 interrupts.CPU91.LOC:Local_timer_interrupts
856.00 ± 23% -47.2% 452.25 ± 42% interrupts.CPU91.NMI:Non-maskable_interrupts
856.00 ± 23% -47.2% 452.25 ± 42% interrupts.CPU91.PMI:Performance_monitoring_interrupts
46565 ± 3% +11.7% 51995 interrupts.CPU92.LOC:Local_timer_interrupts
889.75 ± 34% -45.3% 486.50 ± 50% interrupts.CPU92.NMI:Non-maskable_interrupts
889.75 ± 34% -45.3% 486.50 ± 50% interrupts.CPU92.PMI:Performance_monitoring_interrupts
46577 ± 3% +11.4% 51892 ± 2% interrupts.CPU93.LOC:Local_timer_interrupts
797.50 ± 8% -38.2% 492.75 ± 35% interrupts.CPU93.NMI:Non-maskable_interrupts
797.50 ± 8% -38.2% 492.75 ± 35% interrupts.CPU93.PMI:Performance_monitoring_interrupts
46564 ± 3% +11.5% 51903 interrupts.CPU94.LOC:Local_timer_interrupts
749.75 ± 23% -34.6% 490.00 ± 22% interrupts.CPU94.NMI:Non-maskable_interrupts
749.75 ± 23% -34.6% 490.00 ± 22% interrupts.CPU94.PMI:Performance_monitoring_interrupts
2895 ± 17% -25.5% 2158 ± 18% interrupts.CPU95.CAL:Function_call_interrupts
46572 ± 3% +11.4% 51890 interrupts.CPU95.LOC:Local_timer_interrupts
46376 ± 3% +11.9% 51882 ± 2% interrupts.CPU96.LOC:Local_timer_interrupts
46357 ± 3% +12.0% 51916 interrupts.CPU97.LOC:Local_timer_interrupts
46397 ± 3% +12.1% 51999 interrupts.CPU98.LOC:Local_timer_interrupts
46448 ± 2% +11.8% 51930 ± 2% interrupts.CPU99.LOC:Local_timer_interrupts
8914517 ± 3% +11.9% 9973298 interrupts.LOC:Local_timer_interrupts
33.74 -2.4 31.38 ± 4% perf-profile.calltrace.cycles-pp.ret_from_fork
33.74 -2.4 31.38 ± 4% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
17.77 ± 2% -2.2 15.55 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
17.53 ± 2% -2.1 15.47 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.36 -2.0 20.38 ± 4% perf-profile.calltrace.cycles-pp.nfsd.kthread.ret_from_fork
16.52 ± 2% -1.9 14.63 ± 4% perf-profile.calltrace.cycles-pp.svc_process.nfsd.kthread.ret_from_fork
16.52 ± 2% -1.9 14.63 ± 4% perf-profile.calltrace.cycles-pp.svc_process_common.svc_process.nfsd.kthread.ret_from_fork
16.44 ± 2% -1.9 14.57 ± 3% perf-profile.calltrace.cycles-pp.nfsd_dispatch.svc_process_common.svc_process.nfsd.kthread
16.38 ± 3% -1.8 14.54 ± 4% perf-profile.calltrace.cycles-pp.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process.nfsd
9.78 ± 2% -1.2 8.60 ± 5% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.76 ± 2% -1.2 8.58 ± 5% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.69 ± 2% -1.2 8.53 ± 5% perf-profile.calltrace.cycles-pp.nfs_file_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
9.70 ± 2% -1.2 8.54 ± 5% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.34 ± 2% -1.1 8.23 ± 5% perf-profile.calltrace.cycles-pp.generic_perform_write.nfs_file_write.new_sync_write.vfs_write.ksys_write
10.04 ± 3% -1.0 9.04 ± 3% perf-profile.calltrace.cycles-pp.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process
10.02 ± 3% -1.0 9.03 ± 3% perf-profile.calltrace.cycles-pp.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch.svc_process_common
9.98 ± 3% -1.0 9.00 ± 3% perf-profile.calltrace.cycles-pp.file_write_and_wait_range.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound.nfsd_dispatch
9.97 ± 3% -1.0 8.98 ± 3% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.nfsd_commit.nfsd4_proc_compound
9.96 ± 3% -1.0 8.98 ± 3% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync.nfsd_commit
9.96 ± 3% -1.0 8.98 ± 3% perf-profile.calltrace.cycles-pp.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range.xfs_file_fsync
5.98 ± 2% -0.8 5.17 ± 5% perf-profile.calltrace.cycles-pp.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch.svc_process_common.svc_process
5.95 ± 2% -0.8 5.14 ± 5% perf-profile.calltrace.cycles-pp.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch.svc_process_common
5.94 ± 2% -0.8 5.13 ± 5% perf-profile.calltrace.cycles-pp.do_iter_write.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound.nfsd_dispatch
5.92 ± 2% -0.8 5.12 ± 5% perf-profile.calltrace.cycles-pp.do_iter_readv_writev.do_iter_write.nfsd_vfs_write.nfsd4_write.nfsd4_proc_compound
5.92 ± 2% -0.8 5.12 ± 5% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write.nfsd_vfs_write.nfsd4_write
8.55 ± 3% -0.8 7.76 ± 3% perf-profile.calltrace.cycles-pp.brd_do_bvec.brd_submit_bio.submit_bio_noacct.submit_bio.iomap_submit_ioend
5.67 ± 2% -0.7 4.96 ± 5% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write.nfsd_vfs_write
5.67 ± 2% -0.7 4.96 ± 5% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev.do_iter_write
5.63 ± 2% -0.7 4.93 ± 5% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.do_iter_readv_writev
1.86 ± 4% -0.7 1.19 ± 4% perf-profile.calltrace.cycles-pp.iomap_writepages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.file_write_and_wait_range
1.85 ± 4% -0.7 1.19 ± 4% perf-profile.calltrace.cycles-pp.write_cache_pages.iomap_writepages.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range
1.30 ± 7% -0.6 0.66 ± 5% perf-profile.calltrace.cycles-pp.iomap_writepage_map.write_cache_pages.iomap_writepages.xfs_vm_writepages.do_writepages
4.55 ± 3% -0.6 3.99 ± 4% perf-profile.calltrace.cycles-pp.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write.vfs_write
5.47 ± 3% -0.5 4.93 ± 4% perf-profile.calltrace.cycles-pp.nfs4_file_flush.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.47 ± 3% -0.5 4.94 ± 4% perf-profile.calltrace.cycles-pp.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.47 ± 3% -0.5 4.94 ± 4% perf-profile.calltrace.cycles-pp.filp_close.__x64_sys_close.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.47 ± 3% -0.5 4.93 ± 4% perf-profile.calltrace.cycles-pp.nfs_wb_all.nfs4_file_flush.filp_close.__x64_sys_close.do_syscall_64
4.44 ± 2% -0.5 3.95 ± 3% perf-profile.calltrace.cycles-pp.rpc_free_task.rpc_async_release.process_one_work.worker_thread.kthread
4.44 ± 2% -0.5 3.95 ± 3% perf-profile.calltrace.cycles-pp.rpc_async_release.process_one_work.worker_thread.kthread.ret_from_fork
3.58 ± 2% -0.4 3.13 ± 3% perf-profile.calltrace.cycles-pp.nfs_write_completion.rpc_free_task.rpc_async_release.process_one_work.worker_thread
3.35 ± 4% -0.4 2.90 ± 5% perf-profile.calltrace.cycles-pp.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write.new_sync_write
2.43 ± 3% -0.3 2.09 ± 3% perf-profile.calltrace.cycles-pp.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release.process_one_work
2.37 ± 3% -0.3 2.05 ± 4% perf-profile.calltrace.cycles-pp.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write.nfs_file_write
0.57 ± 5% -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.__test_set_page_writeback.nfs_do_writepage.nfs_writepages_callback.write_cache_pages.nfs_writepages
2.73 ± 4% -0.3 2.43 ± 5% perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
2.69 ± 4% -0.3 2.39 ± 5% perf-profile.calltrace.cycles-pp.memcpy_erms.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write
2.20 -0.3 1.93 ± 4% perf-profile.calltrace.cycles-pp.nfs_write_begin.generic_perform_write.nfs_file_write.new_sync_write.vfs_write
2.10 -0.2 1.85 ± 4% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write.nfs_file_write
2.11 -0.2 1.86 ± 4% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write.nfs_file_write.new_sync_write
0.66 ± 4% -0.2 0.42 ± 57% perf-profile.calltrace.cycles-pp.schedule.io_schedule.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range
0.65 ± 4% -0.2 0.41 ± 57% perf-profile.calltrace.cycles-pp.__schedule.schedule.io_schedule.wait_on_page_bit.__filemap_fdatawait_range
1.48 -0.2 1.28 ± 5% perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write
0.60 ± 5% -0.2 0.40 ± 57% perf-profile.calltrace.cycles-pp.__nfs_commit_inode.nfs_wb_all.nfs4_file_flush.filp_close.__x64_sys_close
0.83 ± 13% -0.2 0.64 ± 2% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
1.40 -0.2 1.21 ± 5% perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write
1.38 -0.2 1.20 ± 4% perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply
1.19 ± 3% -0.2 1.02 ± 4% perf-profile.calltrace.cycles-pp.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs4_file_flush.filp_close
1.52 -0.2 1.35 ± 5% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin.generic_perform_write
0.78 ± 3% -0.1 0.65 ± 4% perf-profile.calltrace.cycles-pp.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all.nfs4_file_flush
0.85 ± 2% -0.1 0.72 ± 5% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor
0.67 ± 4% -0.1 0.54 ± 5% perf-profile.calltrace.cycles-pp.io_schedule.wait_on_page_bit.__filemap_fdatawait_range.filemap_write_and_wait_range.nfs_wb_all
0.91 ± 5% -0.1 0.79 ± 4% perf-profile.calltrace.cycles-pp.__set_page_dirty_nobuffers.nfs_writepage_setup.nfs_updatepage.nfs_write_end.generic_perform_write
0.83 ± 5% -0.1 0.71 ± 4% perf-profile.calltrace.cycles-pp.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release
1.05 ± 2% -0.1 0.94 ± 6% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.nfs_write_begin
0.90 ± 4% -0.1 0.80 ± 3% perf-profile.calltrace.cycles-pp.end_page_writeback.nfs_end_page_writeback.nfs_write_completion.rpc_free_task.rpc_async_release
0.88 ± 4% -0.1 0.78 ± 3% perf-profile.calltrace.cycles-pp.test_clear_page_writeback.end_page_writeback.nfs_end_page_writeback.nfs_write_completion.rpc_free_task
0.70 ± 5% -0.1 0.61 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion.rpc_free_task
0.66 ± 4% -0.1 0.58 ± 4% perf-profile.calltrace.cycles-pp.wake_page_function.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback.nfs_write_completion
0.66 ± 4% -0.1 0.57 ± 5% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit.nfs_end_page_writeback
0.87 ± 5% +0.1 0.97 ± 8% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.96 ± 5% +0.1 1.06 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.83 ± 5% +0.1 0.94 ± 5% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.83 ± 5% +0.1 0.94 ± 5% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.83 ± 5% +0.1 0.94 ± 5% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
1.02 ± 6% +0.1 1.15 ± 6% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
4.18 ± 2% +0.3 4.50 ± 5% perf-profile.calltrace.cycles-pp.svc_tcp_recvfrom.svc_handle_xprt.svc_recv.nfsd.kthread
0.00 +0.6 0.55 ± 6% perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_recvmsg.inet6_recvmsg.svc_tcp_recvfrom
3.21 +0.6 3.80 ± 4% perf-profile.calltrace.cycles-pp.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt.svc_recv.nfsd
3.20 ± 2% +0.6 3.79 ± 4% perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt.svc_recv
0.00 +0.7 0.66 ± 5% perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_recvmsg.inet6_recvmsg.svc_tcp_recvfrom.svc_handle_xprt
4.16 ± 5% +1.7 5.85 ± 12% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +3.1 3.13 ± 6% perf-profile.calltrace.cycles-pp.memcpy_erms.skb_copy_ubufs.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog
41.73 +3.3 44.98 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +3.9 3.94 ± 6% perf-profile.calltrace.cycles-pp.skb_copy_ubufs.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog.net_rx_action
0.00 +4.0 3.95 ± 6% perf-profile.calltrace.cycles-pp.__netif_receive_skb_core.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
0.00 +4.1 4.13 ± 6% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack
0.00 +4.1 4.14 ± 6% perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack
0.00 +4.1 4.14 ± 6% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq
0.00 +4.2 4.16 ± 6% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip6_finish_output2
0.00 +4.2 4.16 ± 6% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_output
0.00 +4.2 4.16 ± 6% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
0.00 +4.2 4.16 ± 6% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip6_finish_output2.ip6_output.ip6_xmit.inet6_csk_xmit
0.00 +4.2 4.16 ± 6% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip6_finish_output2.ip6_output.ip6_xmit
0.00 +4.2 4.20 ± 6% perf-profile.calltrace.cycles-pp.ip6_finish_output2.ip6_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb
0.00 +4.2 4.22 ± 6% perf-profile.calltrace.cycles-pp.ip6_output.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit
0.00 +4.2 4.22 ± 6% perf-profile.calltrace.cycles-pp.ip6_xmit.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked
0.00 +4.2 4.25 ± 6% perf-profile.calltrace.cycles-pp.inet6_csk_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg
0.00 +4.3 4.30 ± 6% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
0.00 +4.4 4.36 ± 6% perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.xprt_sock_sendmsg
47.71 +4.6 52.32 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
47.45 +4.7 52.16 ± 4% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
47.43 +4.7 52.15 ± 4% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
47.44 +4.7 52.16 ± 4% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
33.74 -2.4 31.38 ± 4% perf-profile.children.cycles-pp.ret_from_fork
33.74 -2.4 31.38 ± 4% perf-profile.children.cycles-pp.kthread
18.18 ± 2% -2.2 15.97 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
17.93 ± 2% -2.0 15.89 ± 5% perf-profile.children.cycles-pp.do_syscall_64
22.36 -2.0 20.38 ± 4% perf-profile.children.cycles-pp.nfsd
16.52 ± 2% -1.9 14.63 ± 4% perf-profile.children.cycles-pp.svc_process
16.52 ± 2% -1.9 14.63 ± 4% perf-profile.children.cycles-pp.svc_process_common
16.44 ± 2% -1.9 14.57 ± 3% perf-profile.children.cycles-pp.nfsd_dispatch
16.38 ± 3% -1.8 14.54 ± 4% perf-profile.children.cycles-pp.nfsd4_proc_compound
13.64 ± 3% -1.3 12.38 ± 3% perf-profile.children.cycles-pp.__filemap_fdatawrite_range
13.64 ± 3% -1.3 12.38 ± 3% perf-profile.children.cycles-pp.do_writepages
10.04 ± 2% -1.2 8.87 ± 5% perf-profile.children.cycles-pp.ksys_write
10.02 ± 2% -1.2 8.85 ± 5% perf-profile.children.cycles-pp.vfs_write
9.70 ± 2% -1.2 8.53 ± 5% perf-profile.children.cycles-pp.nfs_file_write
9.96 ± 2% -1.2 8.81 ± 5% perf-profile.children.cycles-pp.new_sync_write
9.35 ± 2% -1.1 8.23 ± 5% perf-profile.children.cycles-pp.generic_perform_write
10.04 ± 3% -1.0 9.04 ± 3% perf-profile.children.cycles-pp.nfsd_commit
10.02 ± 3% -1.0 9.03 ± 3% perf-profile.children.cycles-pp.xfs_file_fsync
9.98 ± 3% -1.0 9.00 ± 3% perf-profile.children.cycles-pp.file_write_and_wait_range
9.96 ± 3% -1.0 8.98 ± 3% perf-profile.children.cycles-pp.xfs_vm_writepages
5.51 ± 3% -0.9 4.56 ± 4% perf-profile.children.cycles-pp.write_cache_pages
8.74 ± 3% -0.9 7.84 ± 3% perf-profile.children.cycles-pp.submit_bio
8.74 ± 3% -0.9 7.84 ± 3% perf-profile.children.cycles-pp.submit_bio_noacct
8.68 ± 3% -0.9 7.79 ± 3% perf-profile.children.cycles-pp.iomap_submit_ioend
8.73 ± 3% -0.9 7.84 ± 3% perf-profile.children.cycles-pp.brd_submit_bio
8.70 ± 3% -0.9 7.81 ± 3% perf-profile.children.cycles-pp.brd_do_bvec
5.98 ± 2% -0.8 5.17 ± 5% perf-profile.children.cycles-pp.nfsd4_write
5.95 ± 2% -0.8 5.14 ± 5% perf-profile.children.cycles-pp.nfsd_vfs_write
5.94 ± 2% -0.8 5.13 ± 5% perf-profile.children.cycles-pp.do_iter_write
5.92 ± 2% -0.8 5.12 ± 5% perf-profile.children.cycles-pp.do_iter_readv_writev
5.92 ± 2% -0.8 5.12 ± 5% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write
5.67 ± 2% -0.7 4.96 ± 5% perf-profile.children.cycles-pp.iomap_file_buffered_write
5.67 ± 2% -0.7 4.96 ± 5% perf-profile.children.cycles-pp.iomap_apply
5.63 ± 2% -0.7 4.94 ± 5% perf-profile.children.cycles-pp.iomap_write_actor
1.86 ± 4% -0.7 1.19 ± 4% perf-profile.children.cycles-pp.iomap_writepages
1.31 ± 7% -0.6 0.67 ± 5% perf-profile.children.cycles-pp.iomap_writepage_map
5.90 ± 4% -0.6 5.30 ± 3% perf-profile.children.cycles-pp.brd_insert_page
5.00 ± 3% -0.6 4.44 ± 6% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
4.56 ± 3% -0.6 4.00 ± 4% perf-profile.children.cycles-pp.nfs_write_end
5.47 ± 3% -0.5 4.94 ± 4% perf-profile.children.cycles-pp.filp_close
5.47 ± 3% -0.5 4.94 ± 4% perf-profile.children.cycles-pp.__x64_sys_close
5.47 ± 3% -0.5 4.93 ± 4% perf-profile.children.cycles-pp.nfs4_file_flush
5.47 ± 3% -0.5 4.93 ± 4% perf-profile.children.cycles-pp.nfs_wb_all
4.69 ± 2% -0.5 4.16 ± 3% perf-profile.children.cycles-pp.rpc_free_task
5.35 ± 5% -0.5 4.83 ± 2% perf-profile.children.cycles-pp._raw_spin_lock
4.44 ± 2% -0.5 3.95 ± 3% perf-profile.children.cycles-pp.rpc_async_release
3.58 ± 2% -0.4 3.13 ± 3% perf-profile.children.cycles-pp.nfs_write_completion
3.35 ± 4% -0.4 2.91 ± 5% perf-profile.children.cycles-pp.nfs_updatepage
3.51 -0.4 3.08 ± 4% perf-profile.children.cycles-pp.grab_cache_page_write_begin
3.48 -0.4 3.06 ± 4% perf-profile.children.cycles-pp.pagecache_get_page
2.43 ± 3% -0.3 2.09 ± 3% perf-profile.children.cycles-pp.nfs_end_page_writeback
1.91 ± 2% -0.3 1.58 ± 3% perf-profile.children.cycles-pp.__schedule
2.38 ± 3% -0.3 2.06 ± 4% perf-profile.children.cycles-pp.nfs_writepage_setup
2.37 -0.3 2.07 ± 5% perf-profile.children.cycles-pp.add_to_page_cache_lru
1.54 -0.3 1.27 ± 3% perf-profile.children.cycles-pp.schedule
2.20 -0.3 1.93 ± 4% perf-profile.children.cycles-pp.nfs_write_begin
1.49 -0.2 1.29 ± 5% perf-profile.children.cycles-pp.iomap_write_begin
0.84 ± 13% -0.2 0.64 ± 2% perf-profile.children.cycles-pp.poll_idle
1.11 ± 2% -0.2 0.92 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair
1.56 ± 2% -0.2 1.38 ± 6% perf-profile.children.cycles-pp.__add_to_page_cache_locked
1.21 ± 2% -0.2 1.04 ± 5% perf-profile.children.cycles-pp.__filemap_fdatawait_range
0.98 ± 2% -0.2 0.81 ± 3% perf-profile.children.cycles-pp.newidle_balance
1.05 -0.2 0.88 ± 4% perf-profile.children.cycles-pp.ttwu_do_activate
0.23 ±102% -0.2 0.06 ± 6% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
1.04 ± 2% -0.2 0.88 ± 5% perf-profile.children.cycles-pp.enqueue_task_fair
1.08 ± 7% -0.2 0.93 ± 3% perf-profile.children.cycles-pp.percpu_counter_add_batch
1.21 ± 2% -0.2 1.05 ± 5% perf-profile.children.cycles-pp.try_to_wake_up
1.10 -0.2 0.94 ± 3% perf-profile.children.cycles-pp.load_balance
0.60 ± 6% -0.2 0.45 ± 7% perf-profile.children.cycles-pp.tcp_rcv_established
0.61 ± 6% -0.1 0.46 ± 7% perf-profile.children.cycles-pp.tcp_v6_do_rcv
1.00 -0.1 0.86 ± 3% perf-profile.children.cycles-pp.find_busiest_group
0.96 -0.1 0.82 ± 6% perf-profile.children.cycles-pp.enqueue_entity
0.79 ± 3% -0.1 0.65 ± 5% perf-profile.children.cycles-pp.wait_on_page_bit
0.99 -0.1 0.85 ± 2% perf-profile.children.cycles-pp.update_sd_lb_stats
0.30 ± 5% -0.1 0.16 ± 10% perf-profile.children.cycles-pp.tcp_ack
0.61 ± 3% -0.1 0.48 ± 3% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.28 ± 5% -0.1 0.15 ± 12% perf-profile.children.cycles-pp.tcp_clean_rtx_queue
1.45 ± 3% -0.1 1.32 ± 3% perf-profile.children.cycles-pp.end_page_writeback
0.65 ± 2% -0.1 0.52 ± 3% perf-profile.children.cycles-pp.sched_ttwu_pending
0.76 ± 7% -0.1 0.64 ± 4% perf-profile.children.cycles-pp.account_page_dirtied
1.43 ± 3% -0.1 1.31 ± 3% perf-profile.children.cycles-pp.test_clear_page_writeback
0.97 ± 5% -0.1 0.84 ± 4% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.68 ± 3% -0.1 0.55 ± 5% perf-profile.children.cycles-pp.io_schedule
0.74 -0.1 0.62 ± 6% perf-profile.children.cycles-pp.__account_scheduler_latency
0.45 ± 5% -0.1 0.33 ± 7% perf-profile.children.cycles-pp.__release_sock
0.85 ± 5% -0.1 0.73 ± 4% perf-profile.children.cycles-pp.wake_up_page_bit
0.56 ± 3% -0.1 0.44 ± 7% perf-profile.children.cycles-pp.release_sock
0.89 ± 3% -0.1 0.78 ± 4% perf-profile.children.cycles-pp.__wake_up_common
0.98 ± 2% -0.1 0.87 ± 4% perf-profile.children.cycles-pp.__test_set_page_writeback
0.77 -0.1 0.66 ± 5% perf-profile.children.cycles-pp.lru_cache_add
0.55 ± 8% -0.1 0.44 ± 4% perf-profile.children.cycles-pp.iomap_set_page_dirty
0.99 ± 4% -0.1 0.88 ± 5% perf-profile.children.cycles-pp.__nfs_commit_inode
0.23 ± 8% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.21 ± 9% -0.1 0.12 ± 17% perf-profile.children.cycles-pp.xfs_ilock
0.80 ± 3% -0.1 0.71 ± 5% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.71 ± 2% -0.1 0.62 ± 5% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.68 ± 5% -0.1 0.59 ± 4% perf-profile.children.cycles-pp.wake_page_function
0.58 -0.1 0.48 ± 6% perf-profile.children.cycles-pp.stack_trace_save_tsk
0.29 ± 11% -0.1 0.20 ± 13% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
0.52 ± 4% -0.1 0.43 ± 6% perf-profile.children.cycles-pp.arch_stack_walk
0.28 ± 11% -0.1 0.20 ± 15% perf-profile.children.cycles-pp.rwsem_optimistic_spin
0.54 ± 2% -0.1 0.46 ± 4% perf-profile.children.cycles-pp.__pagevec_lru_add_fn
0.55 ± 7% -0.1 0.48 ± 7% perf-profile.children.cycles-pp.__mod_memcg_state
0.72 ± 3% -0.1 0.65 ± 5% perf-profile.children.cycles-pp.nfs_scan_commit
0.75 -0.1 0.68 ± 5% perf-profile.children.cycles-pp.mem_cgroup_charge
0.38 ± 13% -0.1 0.31 ± 6% perf-profile.children.cycles-pp.__set_page_dirty
0.37 ± 2% -0.1 0.30 ± 3% perf-profile.children.cycles-pp.unwind_next_frame
0.21 ± 10% -0.1 0.15 ± 18% perf-profile.children.cycles-pp.svc_xprt_do_enqueue
0.41 ± 5% -0.1 0.35 ± 4% perf-profile.children.cycles-pp.schedule_idle
0.51 ± 2% -0.1 0.45 ± 9% perf-profile.children.cycles-pp.nfs_ctx_key_to_expire
0.49 ± 5% -0.1 0.43 ± 7% perf-profile.children.cycles-pp.nfs_create_request
0.18 ± 5% -0.1 0.12 ± 16% perf-profile.children.cycles-pp.svc_xprt_received
0.39 ± 4% -0.1 0.34 ± 6% perf-profile.children.cycles-pp.xas_load
0.23 ± 6% -0.1 0.18 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair
0.75 -0.1 0.70 perf-profile.children.cycles-pp.clear_page_dirty_for_io
0.21 ± 7% -0.0 0.16 ± 4% perf-profile.children.cycles-pp.dequeue_entity
0.33 -0.0 0.28 ± 2% perf-profile.children.cycles-pp.nfs_lock_and_join_requests
0.15 ± 3% -0.0 0.11 ± 3% perf-profile.children.cycles-pp.clear_bdi_congested
0.16 ± 12% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.schedule_timeout
0.12 ± 11% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.iov_iter_advance
0.35 ± 3% -0.0 0.32 ± 2% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.16 ± 5% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.lock_sock_nested
0.06 -0.0 0.03 ±100% perf-profile.children.cycles-pp.__inc_numa_state
0.38 -0.0 0.35 ± 4% perf-profile.children.cycles-pp.nfs_scan_commit_list
0.25 ± 7% -0.0 0.22 ± 8% perf-profile.children.cycles-pp.nfs_initiate_commit
0.25 ± 3% -0.0 0.22 ± 8% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
0.11 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.__wait_on_bit
0.39 ± 2% -0.0 0.36 ± 3% perf-profile.children.cycles-pp.nfs_io_completion_release
0.33 ± 3% -0.0 0.30 ± 4% perf-profile.children.cycles-pp.find_get_pages_range_tag
0.13 ± 10% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.update_curr
0.11 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.out_of_line_wait_on_bit
0.33 ± 3% -0.0 0.30 ± 2% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
0.18 ± 3% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.xs_stream_data_receive_workfn
0.18 ± 3% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.xs_stream_data_receive
0.13 ± 8% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.__x64_sys_gettimeofday
0.28 ± 2% -0.0 0.25 ± 5% perf-profile.children.cycles-pp.kmem_cache_alloc
0.15 ± 6% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.nfs_page_find_private_request
0.10 -0.0 0.08 ± 6% perf-profile.children.cycles-pp.rpc_wait_bit_killable
0.08 ± 5% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.14 -0.0 0.12 ± 9% perf-profile.children.cycles-pp.sysvec_call_function_single
0.16 ± 2% -0.0 0.14 ± 8% perf-profile.children.cycles-pp.xas_store
0.15 ± 7% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.find_get_entry
0.11 ± 4% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.xs_sock_recvmsg
0.11 ± 7% -0.0 0.09 ± 9% perf-profile.children.cycles-pp.__xa_set_mark
0.10 ± 7% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.set_next_entity
0.10 ± 7% -0.0 0.08 perf-profile.children.cycles-pp.__fput
0.08 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_bh
0.07 ± 11% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.task_work_run
0.09 ± 4% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.09 ± 9% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.xas_set_mark
0.08 ± 5% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.__switch_to
0.10 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.xa_get_order
0.08 ± 10% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.refcount_dec_and_lock
0.11 ± 4% -0.0 0.10 ± 7% perf-profile.children.cycles-pp._cond_resched
0.07 -0.0 0.06 ± 7% perf-profile.children.cycles-pp.nfsd_set_fh_dentry
0.06 ± 11% +0.0 0.08 ± 5% perf-profile.children.cycles-pp.sk_stream_alloc_skb
0.11 ± 8% +0.0 0.14 ± 7% perf-profile.children.cycles-pp.__slab_free
0.29 ± 5% +0.0 0.34 ± 6% perf-profile.children.cycles-pp.__tcp_push_pending_frames
0.44 ± 5% +0.1 0.49 ± 5% perf-profile.children.cycles-pp.rebalance_domains
0.26 ± 4% +0.1 0.31 ± 7% perf-profile.children.cycles-pp.native_irq_return_iret
0.01 ±173% +0.1 0.07 ± 7% perf-profile.children.cycles-pp.kfree
0.47 ± 5% +0.1 0.54 ± 7% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.30 ± 6% +0.1 0.38 ± 10% perf-profile.children.cycles-pp.svc_tcp_sendto
0.33 ± 6% +0.1 0.41 ± 10% perf-profile.children.cycles-pp.svc_send
0.97 ± 5% +0.1 1.07 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.pskb_expand_head
0.00 +0.1 0.14 ± 16% perf-profile.children.cycles-pp.iov_iter_get_pages
0.10 ± 15% +0.2 0.26 ± 9% perf-profile.children.cycles-pp.__check_object_size
0.08 ± 13% +0.2 0.26 ± 10% perf-profile.children.cycles-pp.simple_copy_to_iter
0.00 +0.2 0.18 ± 12% perf-profile.children.cycles-pp.__zerocopy_sg_from_iter
0.00 +0.2 0.19 ± 12% perf-profile.children.cycles-pp.skb_zerocopy_iter_stream
0.28 ± 17% +0.3 0.55 ± 7% perf-profile.children.cycles-pp.free_pcppages_bulk
0.50 ± 6% +0.3 0.79 ± 9% perf-profile.children.cycles-pp.rmqueue_bulk
0.46 ± 5% +0.3 0.77 ± 7% perf-profile.children.cycles-pp.free_unref_page
4.19 ± 2% +0.3 4.50 ± 5% perf-profile.children.cycles-pp.svc_tcp_recvfrom
0.79 ± 2% +0.4 1.18 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid
0.24 ± 6% +0.4 0.63 ± 6% perf-profile.children.cycles-pp.skb_release_data
0.33 ± 6% +0.4 0.76 ± 5% perf-profile.children.cycles-pp.__kfree_skb
3.37 +0.6 3.95 ± 4% perf-profile.children.cycles-pp.inet6_recvmsg
3.36 ± 2% +0.6 3.94 ± 4% perf-profile.children.cycles-pp.tcp_recvmsg
4.19 ± 5% +1.7 5.87 ± 12% perf-profile.children.cycles-pp.menu_select
5.57 ± 2% +2.8 8.38 ± 5% perf-profile.children.cycles-pp.memcpy_erms
41.96 +3.1 45.11 ± 5% perf-profile.children.cycles-pp.cpuidle_enter
41.96 +3.1 45.11 ± 5% perf-profile.children.cycles-pp.cpuidle_enter_state
0.74 ± 5% +4.0 4.72 ± 5% perf-profile.children.cycles-pp.tcp_write_xmit
0.80 ± 6% +4.0 4.83 ± 5% perf-profile.children.cycles-pp.__tcp_transmit_skb
0.71 ± 6% +4.0 4.74 ± 5% perf-profile.children.cycles-pp.inet6_csk_xmit
0.63 ± 5% +4.0 4.68 ± 5% perf-profile.children.cycles-pp.ip6_output
0.59 ± 7% +4.0 4.64 ± 6% perf-profile.children.cycles-pp.ip6_finish_output2
0.65 ± 6% +4.1 4.70 ± 5% perf-profile.children.cycles-pp.ip6_xmit
0.43 ± 8% +4.1 4.49 ± 6% perf-profile.children.cycles-pp.__netif_receive_skb_one_core
0.50 ± 8% +4.1 4.56 ± 6% perf-profile.children.cycles-pp.__local_bh_enable_ip
0.45 ± 9% +4.1 4.51 ± 6% perf-profile.children.cycles-pp.process_backlog
0.46 ± 8% +4.1 4.53 ± 6% perf-profile.children.cycles-pp.net_rx_action
0.49 ± 8% +4.1 4.56 ± 6% perf-profile.children.cycles-pp.do_softirq
0.00 +4.1 4.10 ± 6% perf-profile.children.cycles-pp.skb_copy_ubufs
0.00 +4.1 4.12 ± 5% perf-profile.children.cycles-pp.__netif_receive_skb_core
1.40 ± 6% +4.2 5.56 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start
1.40 ± 6% +4.2 5.56 ± 4% perf-profile.children.cycles-pp.do_softirq_own_stack
5.04 ± 5% +4.2 9.28 ± 7% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
47.71 +4.6 52.32 ± 4% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
47.71 +4.6 52.32 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
47.71 +4.6 52.31 ± 4% perf-profile.children.cycles-pp.do_idle
47.45 +4.7 52.16 ± 4% perf-profile.children.cycles-pp.start_secondary
1.83 ± 6% -0.3 1.53 ± 13% perf-profile.self.cycles-pp.ktime_get
2.21 ± 2% -0.2 1.97 ± 2% perf-profile.self.cycles-pp.brd_do_bvec
2.93 ± 2% -0.2 2.70 ± 3% perf-profile.self.cycles-pp._raw_spin_lock
0.81 ± 12% -0.2 0.62 ± 2% perf-profile.self.cycles-pp.poll_idle
0.97 ± 7% -0.1 0.82 ± 3% perf-profile.self.cycles-pp.percpu_counter_add_batch
0.80 ± 7% -0.1 0.69 ± 7% perf-profile.self.cycles-pp.nfs_writepage_setup
0.67 -0.1 0.56 ± 2% perf-profile.self.cycles-pp.update_sd_lb_stats
0.50 ± 6% -0.1 0.39 ± 4% perf-profile.self.cycles-pp.nfs_end_page_writeback
0.92 ± 3% -0.1 0.81 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.47 ± 6% -0.1 0.37 ± 9% perf-profile.self.cycles-pp.rmqueue
0.36 ± 7% -0.1 0.27 ± 10% perf-profile.self.cycles-pp.svc_tcp_recvfrom
0.23 ± 8% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.83 ± 3% -0.1 0.75 ± 4% perf-profile.self.cycles-pp.nfs_write_end
0.54 ± 6% -0.1 0.46 ± 7% perf-profile.self.cycles-pp.__mod_memcg_state
0.25 ± 6% -0.1 0.18 ± 22% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.08 ± 5% -0.1 0.03 ±102% perf-profile.self.cycles-pp.svc_recv
0.30 ± 4% -0.0 0.26 ± 8% perf-profile.self.cycles-pp.xas_load
0.15 ± 5% -0.0 0.11 ± 3% perf-profile.self.cycles-pp.clear_bdi_congested
0.19 ± 2% -0.0 0.15 ± 5% perf-profile.self.cycles-pp.unwind_next_frame
0.11 ± 14% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.iov_iter_advance
0.25 ± 4% -0.0 0.22 ± 8% perf-profile.self.cycles-pp.__pagevec_lru_add_fn
0.08 ± 5% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.enqueue_task_fair
0.29 ± 2% -0.0 0.26 ± 4% perf-profile.self.cycles-pp.clear_page_dirty_for_io
0.24 ± 2% -0.0 0.22 ± 6% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
0.21 ± 3% -0.0 0.18 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist
0.19 ± 6% -0.0 0.17 ± 3% perf-profile.self.cycles-pp.__schedule
0.16 ± 4% -0.0 0.13 ± 8% perf-profile.self.cycles-pp.try_to_wake_up
0.11 ± 11% -0.0 0.09 ± 13% perf-profile.self.cycles-pp.alloc_pages_current
0.10 ± 8% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.brd_insert_page
0.26 ± 2% -0.0 0.24 ± 2% perf-profile.self.cycles-pp.find_get_pages_range_tag
0.08 ± 6% -0.0 0.05 ± 9% perf-profile.self.cycles-pp.select_task_rq_fair
0.07 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.iomap_writepage_map
0.08 ± 5% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.__switch_to
0.15 ± 5% -0.0 0.13 ± 3% perf-profile.self.cycles-pp.release_pages
0.09 ± 4% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.nfs_scan_commit_list
0.08 ± 5% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.xas_set_mark
0.14 ± 7% +0.0 0.17 ± 9% perf-profile.self.cycles-pp.skb_release_data
0.11 ± 8% +0.0 0.14 ± 7% perf-profile.self.cycles-pp.__slab_free
0.26 ± 4% +0.1 0.31 ± 7% perf-profile.self.cycles-pp.native_irq_return_iret
0.01 ±173% +0.1 0.07 ± 7% perf-profile.self.cycles-pp.kfree
0.47 ± 5% +0.1 0.54 ± 7% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.00 +0.1 0.10 ± 5% perf-profile.self.cycles-pp.pskb_expand_head
0.12 ± 5% +0.1 0.24 ± 5% perf-profile.self.cycles-pp.free_pcppages_bulk
0.00 +0.1 0.14 ± 16% perf-profile.self.cycles-pp.iov_iter_get_pages
0.00 +0.1 0.14 ± 5% perf-profile.self.cycles-pp.skb_copy_ubufs
0.07 ± 15% +0.2 0.23 ± 6% perf-profile.self.cycles-pp.__check_object_size
0.78 ± 2% +0.4 1.16 ± 6% perf-profile.self.cycles-pp.__list_del_entry_valid
2.82 ± 7% +1.1 3.88 ± 18% perf-profile.self.cycles-pp.cpuidle_enter_state
3.14 ± 7% +1.6 4.71 ± 15% perf-profile.self.cycles-pp.menu_select
5.50 ± 2% +2.8 8.30 ± 5% perf-profile.self.cycles-pp.memcpy_erms
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 7 months
Re: [locking/qspinlock] 6f9a39a437: unixbench.score -17.3% regression
by Alex Kogan
Oliver, thank you for this report.
All, with nr_task=30%, the benchmark hits the sweet spot on the contention curve
amplifying the overhead of shuffling threads between waiting queues without
reaping the locality overhead. I was able to reproduce the regression on our
machine, though to a lesser extent of about 10% of the performance drop for
the given test.
Luckily, we have a solution for this exact scenario, which we call the
shuffle reduction optimization, or SRO. It was a part of the series until v9,
but since it did not provide much benefit in my benchmarks in v10, it was
dropped. Now, with SRO, the regression on unixbench shrinks to about 1%,
while other performance numbers do not change much.
I attach the SRO patch here. IMHO, it is pretty straight-forward.
It uses randomization, but only to throttle the creation of a secondary queue.
In particular, it does not introduce any extra delays for threads waiting
in that queue once it is created.
Anyway, any feedback is welcome!
Unless I hear any objections, I will plan to post another version of the series
with SRO included.
Thanks,
-- Alex
----- Original Message -----
From: oliver.sang(a)intel.com
To: alex.kogan(a)oracle.com
Cc: linux(a)armlinux.org.uk, peterz(a)infradead.org, mingo(a)redhat.com, will.deacon(a)arm.com, arnd(a)arndb.de, longman(a)redhat.com, linux-arch(a)vger.kernel.org, linux-arm-kernel(a)lists.infradead.org, linux-kernel(a)vger.kernel.org, tglx(a)linutronix.de, bp(a)alien8.de, hpa(a)zytor.com, x86(a)kernel.org, guohanjun(a)huawei.com, jglauber(a)marvell.com, steven.sistare(a)oracle.com, daniel.m.jordan(a)oracle.com, alex.kogan(a)oracle.com, dave.dice(a)oracle.com, lkp(a)intel.com, lkp(a)lists.01.org, ying.huang(a)intel.com, feng.tang(a)intel.com, zhengjun.xing(a)intel.com
Sent: Sunday, November 22, 2020 4:33:52 AM GMT -05:00 US/Canada Eastern
Subject: [locking/qspinlock] 6f9a39a437: unixbench.score -17.3% regression
Greeting,
FYI, we noticed a -17.3% regression of unixbench.score due to commit:
commit: 6f9a39a4372e37907ac1fc7ede6c90932a88d174 ("[PATCH v12 5/5] locking/qspinlock: Avoid moving certain threads between waiting queues in CNA")
url: https://urldefense.com/v3/__https://github.com/0day-ci/linux/commits/Alex...
base: https://urldefense.com/v3/__https://git.kernel.org/cgit/linux/kernel/git/... 932f8c64d38bb08f69c8c26a2216ba0c36c6daa8
in testcase: unixbench
on test machine: 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory
with following parameters:
runtime: 300s
nr_task: 30%
test: context1
cpufreq_governor: performance
ucode: 0x4003003
test-description: UnixBench is the original BYTE UNIX benchmark suite aims to test performance of Unix-like system.
test-url: https://urldefense.com/v3/__https://github.com/kdlucas/byte-unixbench__;!...
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://urldefense.com/v3/__https://github.com/intel/lkp-tests.git__;!!Gq...
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/30%/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2sp4/context1/unixbench/0x4003003
commit:
eaf522d564 ("locking/qspinlock: Introduce starvation avoidance into CNA")
6f9a39a437 ("locking/qspinlock: Avoid moving certain threads between waiting queues in CNA")
eaf522d56432e0e5 6f9a39a4372e37907ac1fc7ede6
---------------- ---------------------------
%stddev %change %stddev
\ | \
3715 -17.3% 3070 unixbench.score
11584 +13.2% 13118 unixbench.time.involuntary_context_switches
1830 +4.7% 1916 unixbench.time.percent_of_cpu_this_job_got
7012 +5.1% 7373 unixbench.time.system_time
141.44 -15.6% 119.37 unixbench.time.user_time
4.338e+08 -16.4% 3.627e+08 unixbench.time.voluntary_context_switches
5.807e+08 -17.5% 4.793e+08 unixbench.workload
139.00 ± 67% -71.0% 40.25 numa-vmstat.node1.nr_mlock
1.08 -0.1 0.94 mpstat.cpu.all.irq%
0.48 ± 2% -0.1 0.40 mpstat.cpu.all.usr%
956143 ± 7% +11.0% 1060959 ± 3% numa-meminfo.node0.MemUsed
1185909 ± 5% -8.8% 1081277 ± 3% numa-meminfo.node1.MemUsed
4402315 -16.3% 3682692 vmstat.system.cs
235535 -4.6% 224625 vmstat.system.in
6.42e+09 +16.4% 7.471e+09 cpuidle.C1.time
1.941e+10 ± 7% -20.0% 1.553e+10 ± 21% cpuidle.C1E.time
94497227 ± 5% -63.8% 34185071 ± 15% cpuidle.C1E.usage
2.62e+08 ± 8% -90.1% 26020649 cpuidle.POLL.time
81581001 ± 9% -96.1% 3221876 cpuidle.POLL.usage
84602 ± 3% +12.7% 95329 ± 5% softirqs.CPU65.SCHED
86631 ± 5% +10.9% 96057 ± 6% softirqs.CPU67.SCHED
81448 ± 3% +12.6% 91708 softirqs.CPU70.SCHED
99715 +8.1% 107808 ± 2% softirqs.CPU75.SCHED
91997 ± 4% +15.5% 106236 ± 2% softirqs.CPU81.SCHED
417904 ± 6% +43.6% 600289 ± 16% sched_debug.cfs_rq:/.MIN_vruntime.avg
3142033 +9.7% 3446986 ± 4% sched_debug.cfs_rq:/.MIN_vruntime.max
969106 +20.4% 1166681 ± 8% sched_debug.cfs_rq:/.MIN_vruntime.stddev
44659 ± 12% +21.1% 54091 ± 3% sched_debug.cfs_rq:/.exec_clock.min
12198 ± 12% +24.5% 15181 ± 9% sched_debug.cfs_rq:/.load.avg
417904 ± 6% +43.6% 600289 ± 16% sched_debug.cfs_rq:/.max_vruntime.avg
3142033 +9.7% 3446986 ± 4% sched_debug.cfs_rq:/.max_vruntime.max
969106 +20.4% 1166681 ± 8% sched_debug.cfs_rq:/.max_vruntime.stddev
1926443 ± 12% +25.6% 2419565 ± 3% sched_debug.cfs_rq:/.min_vruntime.min
0.41 ± 2% +16.3% 0.47 ± 3% sched_debug.cfs_rq:/.nr_running.avg
322.15 ± 2% +13.5% 365.49 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.avg
58399 ± 49% -62.5% 21882 ± 74% sched_debug.cpu.avg_idle.min
3.74 ± 14% -20.1% 2.99 ± 3% sched_debug.cpu.clock.stddev
20770 ± 50% -65.0% 7271 ± 39% sched_debug.cpu.max_idle_balance_cost.stddev
8250432 -16.5% 6887763 sched_debug.cpu.nr_switches.avg
11243220 ± 4% -21.5% 8826971 sched_debug.cpu.nr_switches.max
1603956 ± 26% -52.5% 761566 ± 4% sched_debug.cpu.nr_switches.stddev
8248654 -16.5% 6885987 sched_debug.cpu.sched_count.avg
11240496 ± 4% -21.5% 8823964 sched_debug.cpu.sched_count.max
1603802 ± 26% -52.5% 761522 ± 4% sched_debug.cpu.sched_count.stddev
4123397 -16.5% 3441927 sched_debug.cpu.sched_goidle.avg
5619132 ± 4% -21.5% 4410755 sched_debug.cpu.sched_goidle.max
801761 ± 26% -52.5% 380727 ± 4% sched_debug.cpu.sched_goidle.stddev
4124921 -16.5% 3443709 sched_debug.cpu.ttwu_count.avg
5620396 ± 4% -21.5% 4412427 sched_debug.cpu.ttwu_count.max
801796 ± 26% -52.5% 380615 ± 4% sched_debug.cpu.ttwu_count.stddev
7.45e+09 -14.3% 6.382e+09 perf-stat.i.branch-instructions
1.33 -0.1 1.24 perf-stat.i.branch-miss-rate%
91615750 -22.0% 71469356 perf-stat.i.branch-misses
3.80 +2.5 6.31 ± 13% perf-stat.i.cache-miss-rate%
8753636 ± 4% +109.7% 18358392 perf-stat.i.cache-misses
7.691e+08 -14.2% 6.597e+08 perf-stat.i.cache-references
4428060 -16.4% 3704052 perf-stat.i.context-switches
2.87 +11.2% 3.20 perf-stat.i.cpi
8.789e+10 -5.6% 8.294e+10 perf-stat.i.cpu-cycles
16303 ± 7% -74.2% 4204 ± 2% perf-stat.i.cycles-between-cache-misses
8.94e+09 -14.0% 7.685e+09 perf-stat.i.dTLB-loads
4.951e+09 -16.2% 4.149e+09 perf-stat.i.dTLB-stores
57458394 -17.3% 47543962 perf-stat.i.iTLB-load-misses
30827890 -15.9% 25930501 perf-stat.i.iTLB-loads
3.327e+10 -14.6% 2.842e+10 perf-stat.i.instructions
581.15 +3.3% 600.28 perf-stat.i.instructions-per-iTLB-miss
0.36 -9.4% 0.33 perf-stat.i.ipc
0.92 -5.6% 0.86 perf-stat.i.metric.GHz
1.01 ± 4% +17.6% 1.18 ± 4% perf-stat.i.metric.K/sec
230.75 -14.6% 197.02 perf-stat.i.metric.M/sec
87.41 +8.0 95.42 perf-stat.i.node-load-miss-rate%
1718045 ± 3% +125.3% 3871440 perf-stat.i.node-load-misses
227252 ± 3% -71.5% 64814 ± 10% perf-stat.i.node-loads
1686277 ± 4% +120.6% 3720452 perf-stat.i.node-store-misses
1.23 -0.1 1.12 perf-stat.overall.branch-miss-rate%
1.14 ± 5% +1.6 2.78 perf-stat.overall.cache-miss-rate%
2.64 +10.5% 2.92 perf-stat.overall.cpi
10070 ± 4% -55.1% 4519 perf-stat.overall.cycles-between-cache-misses
579.14 +3.2% 597.84 perf-stat.overall.instructions-per-iTLB-miss
0.38 -9.5% 0.34 perf-stat.overall.ipc
88.31 +10.0 98.35 perf-stat.overall.node-load-miss-rate%
97.96 +1.3 99.24 perf-stat.overall.node-store-miss-rate%
22430 +3.3% 23175 perf-stat.overall.path-length
7.434e+09 -14.4% 6.365e+09 perf-stat.ps.branch-instructions
91428244 -22.0% 71275228 perf-stat.ps.branch-misses
8723893 ± 4% +109.8% 18304568 perf-stat.ps.cache-misses
7.674e+08 -14.3% 6.578e+08 perf-stat.ps.cache-references
4418679 -16.4% 3693530 perf-stat.ps.context-switches
8.77e+10 -5.7% 8.271e+10 perf-stat.ps.cpu-cycles
8.921e+09 -14.1% 7.664e+09 perf-stat.ps.dTLB-loads
4.94e+09 -16.3% 4.137e+09 perf-stat.ps.dTLB-stores
57330404 -17.3% 47408036 perf-stat.ps.iTLB-load-misses
30765981 -15.9% 25859786 perf-stat.ps.iTLB-loads
3.32e+10 -14.6% 2.834e+10 perf-stat.ps.instructions
1712299 ± 3% +125.4% 3860240 perf-stat.ps.node-load-misses
226568 ± 3% -71.4% 64722 ± 10% perf-stat.ps.node-loads
1680387 ± 4% +120.8% 3709583 perf-stat.ps.node-store-misses
1.302e+13 -14.7% 1.111e+13 perf-stat.total.instructions
3591158 ± 5% -25.1% 2688593 interrupts.CAL:Function_call_interrupts
2328 ± 19% +42.8% 3323 ± 3% interrupts.CPU0.NMI:Non-maskable_interrupts
2328 ± 19% +42.8% 3323 ± 3% interrupts.CPU0.PMI:Performance_monitoring_interrupts
110354 ± 9% -20.0% 88244 ± 4% interrupts.CPU0.RES:Rescheduling_interrupts
128508 ± 14% -27.1% 93721 ± 3% interrupts.CPU1.RES:Rescheduling_interrupts
2180 ± 30% +47.0% 3205 ± 15% interrupts.CPU10.NMI:Non-maskable_interrupts
2180 ± 30% +47.0% 3205 ± 15% interrupts.CPU10.PMI:Performance_monitoring_interrupts
133107 ± 8% -25.7% 98924 ± 2% interrupts.CPU10.RES:Rescheduling_interrupts
133955 ± 13% -28.9% 95305 ± 6% interrupts.CPU11.RES:Rescheduling_interrupts
129709 ± 10% -24.9% 97452 ± 8% interrupts.CPU12.RES:Rescheduling_interrupts
130073 ± 10% -21.2% 102507 ± 2% interrupts.CPU13.RES:Rescheduling_interrupts
136313 ± 10% -27.4% 99010 ± 3% interrupts.CPU14.RES:Rescheduling_interrupts
139937 ± 7% -29.9% 98077 ± 7% interrupts.CPU15.RES:Rescheduling_interrupts
143424 ± 11% -28.4% 102678 ± 7% interrupts.CPU16.RES:Rescheduling_interrupts
138084 ± 10% -25.7% 102625 ± 5% interrupts.CPU17.RES:Rescheduling_interrupts
136238 ± 6% -26.3% 100366 ± 7% interrupts.CPU18.RES:Rescheduling_interrupts
140011 ± 10% -28.4% 100232 ± 4% interrupts.CPU19.RES:Rescheduling_interrupts
129720 ± 7% -28.8% 92405 ± 7% interrupts.CPU2.RES:Rescheduling_interrupts
43177 ± 33% -34.6% 28234 ± 5% interrupts.CPU20.CAL:Function_call_interrupts
143060 ± 6% -28.5% 102289 ± 7% interrupts.CPU20.RES:Rescheduling_interrupts
39911 ± 20% -30.4% 27788 ± 4% interrupts.CPU21.CAL:Function_call_interrupts
144644 ± 9% -27.6% 104676 ± 6% interrupts.CPU21.RES:Rescheduling_interrupts
38543 ± 21% -35.1% 25019 ± 14% interrupts.CPU22.CAL:Function_call_interrupts
144984 ± 7% -29.9% 101700 ± 2% interrupts.CPU22.RES:Rescheduling_interrupts
37835 ± 15% -22.9% 29155 ± 5% interrupts.CPU23.CAL:Function_call_interrupts
2089 ± 19% +70.6% 3565 ± 20% interrupts.CPU23.NMI:Non-maskable_interrupts
2089 ± 19% +70.6% 3565 ± 20% interrupts.CPU23.PMI:Performance_monitoring_interrupts
130192 ± 7% -22.1% 101416 ± 5% interrupts.CPU23.RES:Rescheduling_interrupts
37142 ± 6% -32.8% 24974 ± 6% interrupts.CPU24.CAL:Function_call_interrupts
142384 ± 5% -31.7% 97277 ± 6% interrupts.CPU24.RES:Rescheduling_interrupts
32664 ± 9% -22.2% 25422 ± 6% interrupts.CPU25.CAL:Function_call_interrupts
141175 ± 5% -31.2% 97084 ± 2% interrupts.CPU25.RES:Rescheduling_interrupts
31023 ± 21% -24.8% 23330 ± 7% interrupts.CPU26.CAL:Function_call_interrupts
131921 ± 4% -28.9% 93831 ± 3% interrupts.CPU26.RES:Rescheduling_interrupts
32946 ± 19% -26.2% 24303 ± 5% interrupts.CPU27.CAL:Function_call_interrupts
144853 ± 4% -35.7% 93190 ± 2% interrupts.CPU27.RES:Rescheduling_interrupts
136419 ± 4% -31.3% 93690 interrupts.CPU28.RES:Rescheduling_interrupts
36609 ± 20% -35.3% 23696 ± 5% interrupts.CPU29.CAL:Function_call_interrupts
145284 ± 10% -36.1% 92871 interrupts.CPU29.RES:Rescheduling_interrupts
122699 ± 7% -23.8% 93459 ± 10% interrupts.CPU3.RES:Rescheduling_interrupts
250.50 ± 40% -79.9% 50.25 ± 99% interrupts.CPU3.TLB:TLB_shootdowns
35689 ± 19% -36.1% 22793 ± 11% interrupts.CPU30.CAL:Function_call_interrupts
152345 ± 4% -40.3% 90991 ± 3% interrupts.CPU30.RES:Rescheduling_interrupts
33895 ± 10% -15.1% 28774 ± 8% interrupts.CPU31.CAL:Function_call_interrupts
150590 ± 5% -35.5% 97092 ± 7% interrupts.CPU31.RES:Rescheduling_interrupts
50156 ± 28% -45.8% 27170 ± 7% interrupts.CPU32.CAL:Function_call_interrupts
3757 ± 7% -43.6% 2120 ± 32% interrupts.CPU32.NMI:Non-maskable_interrupts
3757 ± 7% -43.6% 2120 ± 32% interrupts.CPU32.PMI:Performance_monitoring_interrupts
150142 ± 3% -36.3% 95673 interrupts.CPU32.RES:Rescheduling_interrupts
39957 ± 25% -34.5% 26158 ± 4% interrupts.CPU33.CAL:Function_call_interrupts
147066 ± 8% -34.4% 96521 ± 2% interrupts.CPU33.RES:Rescheduling_interrupts
168.25 ±137% -86.9% 22.00 ± 59% interrupts.CPU33.TLB:TLB_shootdowns
38357 ± 13% -29.9% 26881 ± 5% interrupts.CPU34.CAL:Function_call_interrupts
3757 ± 5% -28.5% 2686 ± 19% interrupts.CPU34.NMI:Non-maskable_interrupts
3757 ± 5% -28.5% 2686 ± 19% interrupts.CPU34.PMI:Performance_monitoring_interrupts
140734 ± 2% -33.3% 93841 ± 3% interrupts.CPU34.RES:Rescheduling_interrupts
37965 ± 17% -25.8% 28175 ± 4% interrupts.CPU35.CAL:Function_call_interrupts
3934 ± 8% -39.3% 2389 ± 13% interrupts.CPU35.NMI:Non-maskable_interrupts
3934 ± 8% -39.3% 2389 ± 13% interrupts.CPU35.PMI:Performance_monitoring_interrupts
146074 ± 10% -33.2% 97630 ± 2% interrupts.CPU35.RES:Rescheduling_interrupts
34131 ± 8% -18.8% 27704 ± 9% interrupts.CPU36.CAL:Function_call_interrupts
149093 ± 3% -35.0% 96945 ± 4% interrupts.CPU36.RES:Rescheduling_interrupts
44333 ± 47% -39.7% 26745 ± 7% interrupts.CPU37.CAL:Function_call_interrupts
149936 ± 4% -34.3% 98542 ± 3% interrupts.CPU37.RES:Rescheduling_interrupts
41199 ± 28% -30.2% 28741 ± 6% interrupts.CPU38.CAL:Function_call_interrupts
154224 ± 3% -31.6% 105443 ± 7% interrupts.CPU38.RES:Rescheduling_interrupts
36925 ± 8% -24.3% 27942 ± 5% interrupts.CPU39.CAL:Function_call_interrupts
150490 ± 2% -32.5% 101625 ± 4% interrupts.CPU39.RES:Rescheduling_interrupts
122742 ± 15% -25.4% 91596 ± 5% interrupts.CPU4.RES:Rescheduling_interrupts
143639 ± 9% -29.4% 101407 ± 2% interrupts.CPU40.RES:Rescheduling_interrupts
43235 ± 10% -30.9% 29877 ± 4% interrupts.CPU41.CAL:Function_call_interrupts
158981 ± 5% -32.8% 106760 ± 4% interrupts.CPU41.RES:Rescheduling_interrupts
47792 ± 33% -37.7% 29769 ± 5% interrupts.CPU42.CAL:Function_call_interrupts
3455 ± 11% -32.2% 2343 ± 36% interrupts.CPU42.NMI:Non-maskable_interrupts
3455 ± 11% -32.2% 2343 ± 36% interrupts.CPU42.PMI:Performance_monitoring_interrupts
160241 ± 5% -34.0% 105793 ± 4% interrupts.CPU42.RES:Rescheduling_interrupts
54419 ± 52% -44.1% 30408 ± 2% interrupts.CPU43.CAL:Function_call_interrupts
3726 ± 11% -38.7% 2285 ± 39% interrupts.CPU43.NMI:Non-maskable_interrupts
3726 ± 11% -38.7% 2285 ± 39% interrupts.CPU43.PMI:Performance_monitoring_interrupts
156010 -32.4% 105516 ± 2% interrupts.CPU43.RES:Rescheduling_interrupts
69033 ± 79% -56.0% 30393 ± 7% interrupts.CPU44.CAL:Function_call_interrupts
152478 ± 6% -30.4% 106187 ± 4% interrupts.CPU44.RES:Rescheduling_interrupts
49434 ± 49% -38.5% 30404 ± 9% interrupts.CPU45.CAL:Function_call_interrupts
153770 ± 7% -32.2% 104200 ± 3% interrupts.CPU45.RES:Rescheduling_interrupts
56303 ± 52% -50.4% 27914 ± 4% interrupts.CPU46.CAL:Function_call_interrupts
3924 ± 20% -48.7% 2012 ± 50% interrupts.CPU46.NMI:Non-maskable_interrupts
3924 ± 20% -48.7% 2012 ± 50% interrupts.CPU46.PMI:Performance_monitoring_interrupts
152891 ± 11% -31.7% 104494 ± 5% interrupts.CPU46.RES:Rescheduling_interrupts
42970 ± 30% -29.9% 30107 ± 9% interrupts.CPU47.CAL:Function_call_interrupts
3940 ± 8% -40.8% 2332 ± 38% interrupts.CPU47.NMI:Non-maskable_interrupts
3940 ± 8% -40.8% 2332 ± 38% interrupts.CPU47.PMI:Performance_monitoring_interrupts
146615 ± 5% -27.7% 106013 ± 4% interrupts.CPU47.RES:Rescheduling_interrupts
146863 ± 5% -18.4% 119774 ± 3% interrupts.CPU48.RES:Rescheduling_interrupts
136692 ± 8% -16.3% 114405 ± 7% interrupts.CPU49.RES:Rescheduling_interrupts
29311 ± 6% -12.4% 25673 ± 4% interrupts.CPU5.CAL:Function_call_interrupts
129497 ± 7% -27.1% 94375 ± 6% interrupts.CPU5.RES:Rescheduling_interrupts
143797 ± 11% -21.0% 113564 ± 4% interrupts.CPU50.RES:Rescheduling_interrupts
2891 ± 16% +31.3% 3797 ± 12% interrupts.CPU51.NMI:Non-maskable_interrupts
2891 ± 16% +31.3% 3797 ± 12% interrupts.CPU51.PMI:Performance_monitoring_interrupts
139766 ± 2% -19.6% 112352 ± 8% interrupts.CPU51.RES:Rescheduling_interrupts
137319 ± 4% -20.3% 109422 ± 5% interrupts.CPU52.RES:Rescheduling_interrupts
138705 ± 5% -21.3% 109158 ± 8% interrupts.CPU53.RES:Rescheduling_interrupts
2426 ± 28% +42.8% 3464 ± 19% interrupts.CPU54.NMI:Non-maskable_interrupts
2426 ± 28% +42.8% 3464 ± 19% interrupts.CPU54.PMI:Performance_monitoring_interrupts
140683 ± 11% -24.0% 106919 ± 4% interrupts.CPU54.RES:Rescheduling_interrupts
38238 ± 13% -22.9% 29493 ± 6% interrupts.CPU55.CAL:Function_call_interrupts
3043 ± 8% +18.7% 3612 ± 7% interrupts.CPU55.NMI:Non-maskable_interrupts
3043 ± 8% +18.7% 3612 ± 7% interrupts.CPU55.PMI:Performance_monitoring_interrupts
143657 ± 10% -25.0% 107806 ± 6% interrupts.CPU55.RES:Rescheduling_interrupts
131036 ± 8% -21.3% 103177 ± 4% interrupts.CPU56.RES:Rescheduling_interrupts
131204 ± 12% -21.2% 103444 ± 10% interrupts.CPU57.RES:Rescheduling_interrupts
122041 ± 12% -15.9% 102674 ± 7% interrupts.CPU58.RES:Rescheduling_interrupts
167.25 ± 65% -64.7% 59.00 ±157% interrupts.CPU58.TLB:TLB_shootdowns
1883 ± 33% +61.6% 3042 ± 3% interrupts.CPU6.NMI:Non-maskable_interrupts
1883 ± 33% +61.6% 3042 ± 3% interrupts.CPU6.PMI:Performance_monitoring_interrupts
132101 ± 12% -27.0% 96457 ± 8% interrupts.CPU6.RES:Rescheduling_interrupts
1832 ± 24% +69.3% 3102 ± 32% interrupts.CPU64.NMI:Non-maskable_interrupts
1832 ± 24% +69.3% 3102 ± 32% interrupts.CPU64.PMI:Performance_monitoring_interrupts
107979 ± 8% -11.6% 95452 interrupts.CPU66.RES:Rescheduling_interrupts
97965 ± 3% -15.1% 83199 ± 2% interrupts.CPU69.RES:Rescheduling_interrupts
126380 ± 11% -24.6% 95257 ± 5% interrupts.CPU7.RES:Rescheduling_interrupts
1820 ± 40% +60.9% 2929 ± 35% interrupts.CPU70.NMI:Non-maskable_interrupts
1820 ± 40% +60.9% 2929 ± 35% interrupts.CPU70.PMI:Performance_monitoring_interrupts
171279 ± 5% -29.4% 120994 ± 5% interrupts.CPU72.RES:Rescheduling_interrupts
50761 ± 40% -35.0% 32979 ± 7% interrupts.CPU73.CAL:Function_call_interrupts
173132 ± 7% -31.5% 118555 ± 5% interrupts.CPU73.RES:Rescheduling_interrupts
43479 ± 17% -25.8% 32276 ± 3% interrupts.CPU74.CAL:Function_call_interrupts
3755 ± 9% -31.7% 2564 ± 31% interrupts.CPU74.NMI:Non-maskable_interrupts
3755 ± 9% -31.7% 2564 ± 31% interrupts.CPU74.PMI:Performance_monitoring_interrupts
167124 ± 7% -28.8% 119063 ± 4% interrupts.CPU74.RES:Rescheduling_interrupts
164069 ± 7% -26.6% 120499 ± 4% interrupts.CPU75.RES:Rescheduling_interrupts
166858 ± 6% -28.4% 119453 ± 4% interrupts.CPU76.RES:Rescheduling_interrupts
157535 ± 6% -25.5% 117419 ± 4% interrupts.CPU77.RES:Rescheduling_interrupts
165642 ± 8% -25.9% 122719 ± 8% interrupts.CPU78.RES:Rescheduling_interrupts
162781 ± 5% -29.0% 115600 ± 3% interrupts.CPU79.RES:Rescheduling_interrupts
132224 ± 11% -26.6% 97010 interrupts.CPU8.RES:Rescheduling_interrupts
167082 ± 9% -30.7% 115794 ± 4% interrupts.CPU80.RES:Rescheduling_interrupts
49639 ± 37% -35.1% 32228 ± 2% interrupts.CPU81.CAL:Function_call_interrupts
144305 ± 5% -18.3% 117926 ± 4% interrupts.CPU81.RES:Rescheduling_interrupts
151333 ± 7% -23.2% 116159 ± 3% interrupts.CPU82.RES:Rescheduling_interrupts
142398 ± 8% -21.1% 112399 ± 7% interrupts.CPU83.RES:Rescheduling_interrupts
144455 ± 2% -20.5% 114911 interrupts.CPU84.RES:Rescheduling_interrupts
149850 ± 9% -24.3% 113396 ± 5% interrupts.CPU85.RES:Rescheduling_interrupts
34458 ± 4% -14.4% 29487 ± 8% interrupts.CPU86.CAL:Function_call_interrupts
138603 ± 6% -22.7% 107133 ± 2% interrupts.CPU86.RES:Rescheduling_interrupts
39228 ± 7% -25.5% 29231 ± 4% interrupts.CPU87.CAL:Function_call_interrupts
151814 ± 8% -31.1% 104629 ± 5% interrupts.CPU87.RES:Rescheduling_interrupts
137356 ± 8% -20.2% 109634 ± 3% interrupts.CPU88.RES:Rescheduling_interrupts
143613 ± 10% -28.9% 102166 ± 10% interrupts.CPU89.RES:Rescheduling_interrupts
122375 ± 8% -19.2% 98901 ± 3% interrupts.CPU9.RES:Rescheduling_interrupts
140781 ± 6% -25.0% 105531 ± 3% interrupts.CPU90.RES:Rescheduling_interrupts
138917 ± 12% -24.9% 104264 ± 5% interrupts.CPU91.RES:Rescheduling_interrupts
146814 ± 14% -29.2% 103902 ± 4% interrupts.CPU92.RES:Rescheduling_interrupts
132220 ± 15% -21.3% 104095 ± 2% interrupts.CPU93.RES:Rescheduling_interrupts
133.00 ± 88% -87.6% 16.50 ± 72% interrupts.CPU93.TLB:TLB_shootdowns
125991 ± 5% -19.0% 101995 ± 2% interrupts.CPU94.RES:Rescheduling_interrupts
115838 ± 9% -17.2% 95959 ± 3% interrupts.CPU95.RES:Rescheduling_interrupts
13255498 ± 2% -25.6% 9859155 interrupts.RES:Rescheduling_interrupts
7.59 ± 2% -1.5 6.04 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.43 ± 2% -1.5 5.91 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
6.03 ± 4% -1.0 5.06 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.90 ± 4% -1.0 4.95 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.44 ± 3% -0.9 3.51 perf-profile.calltrace.cycles-pp.schedule.pipe_read.new_sync_read.vfs_read.ksys_read
2.29 ± 4% -0.9 1.38 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_read.new_sync_read
4.07 ± 3% -0.9 3.21 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_read.new_sync_read.vfs_read
2.62 ± 3% -0.9 1.76 ± 4% perf-profile.calltrace.cycles-pp.read
3.68 ± 2% -0.8 2.83 perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
2.06 ± 4% -0.8 1.22 perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.pipe_read
3.58 ± 2% -0.8 2.76 perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
2.37 ± 3% -0.8 1.58 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
2.29 ± 3% -0.8 1.53 ± 4% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
2.26 ± 3% -0.8 1.50 ± 4% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
2.21 ± 3% -0.7 1.47 ± 4% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
4.25 ± 3% -0.7 3.51 perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate
2.14 ± 4% -0.6 1.52 perf-profile.calltrace.cycles-pp.unwind_next_frame.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity
3.48 ± 4% -0.6 2.90 ± 2% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
1.93 ± 3% -0.5 1.48 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry
1.54 ± 4% -0.4 1.18 perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.38 ± 3% -0.3 1.04 ± 2% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle
0.72 ± 4% -0.1 0.58 ± 3% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.66 ± 4% -0.1 0.54 ± 2% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read.ksys_read
46.28 +0.5 46.74 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
0.14 ±173% +0.5 0.66 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
0.14 ±173% +0.5 0.66 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
0.15 ±173% +0.6 0.71 ± 8% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
0.15 ±173% +0.6 0.71 ± 8% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64_no_verify
0.15 ±173% +0.6 0.71 ± 8% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64_no_verify
7.85 ± 2% +0.8 8.64 ± 3% perf-profile.calltrace.cycles-pp.write
7.77 ± 2% +0.8 8.58 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
7.73 ± 2% +0.8 8.55 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
7.69 ± 3% +0.8 8.53 ± 3% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
7.64 ± 3% +0.9 8.49 ± 3% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
35.29 +0.9 36.15 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
35.15 +0.9 36.02 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
42.35 +1.8 44.15 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
42.22 +1.8 44.06 perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
38.77 +1.9 40.67 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
38.65 +1.9 40.56 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
40.84 +2.1 42.96 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write
40.50 +2.1 42.65 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
40.15 +2.2 42.36 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write
40.07 +2.2 42.29 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
37.50 +2.7 40.20 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
37.47 +2.7 40.18 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
36.96 +2.9 39.84 perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
36.62 ± 2% +3.2 39.86 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
34.50 +3.3 37.80 perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
29.96 ± 2% +4.1 34.04 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate
29.13 ± 2% +4.1 33.22 perf-profile.calltrace.cycles-pp.__cna_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
8.30 ± 2% -1.7 6.58 perf-profile.children.cycles-pp.ksys_read
8.12 ± 2% -1.7 6.42 perf-profile.children.cycles-pp.vfs_read
7.75 ± 2% -1.7 6.06 perf-profile.children.cycles-pp.__schedule
7.59 ± 2% -1.5 6.05 perf-profile.children.cycles-pp.new_sync_read
7.45 ± 2% -1.5 5.94 perf-profile.children.cycles-pp.pipe_read
4.44 ± 3% -0.9 3.52 perf-profile.children.cycles-pp.schedule
2.65 ± 3% -0.9 1.78 ± 4% perf-profile.children.cycles-pp.read
3.70 ± 2% -0.8 2.87 perf-profile.children.cycles-pp.schedule_idle
4.28 ± 3% -0.7 3.54 perf-profile.children.cycles-pp.stack_trace_save_tsk
0.80 ± 35% -0.7 0.13 ± 5% perf-profile.children.cycles-pp.poll_idle
3.54 ± 3% -0.6 2.94 ± 2% perf-profile.children.cycles-pp.arch_stack_walk
2.02 ± 3% -0.6 1.43 ± 2% perf-profile.children.cycles-pp.update_load_avg
2.15 ± 3% -0.5 1.67 perf-profile.children.cycles-pp.pick_next_task_fair
2.30 ± 4% -0.5 1.82 perf-profile.children.cycles-pp.dequeue_task_fair
2.10 ± 4% -0.5 1.63 ± 2% perf-profile.children.cycles-pp.dequeue_entity
1.56 ± 4% -0.4 1.20 perf-profile.children.cycles-pp.menu_select
1.39 ± 3% -0.3 1.06 ± 2% perf-profile.children.cycles-pp.set_next_entity
0.46 ± 13% -0.3 0.15 ± 3% perf-profile.children.cycles-pp.sched_ttwu_pending
0.92 ± 3% -0.2 0.70 ± 2% perf-profile.children.cycles-pp.prepare_to_wait_event
1.13 -0.2 0.92 ± 3% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
0.33 ± 9% -0.2 0.12 ± 3% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.32 ± 10% -0.2 0.11 ± 3% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.61 ± 3% -0.2 0.41 ± 4% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.32 ± 10% -0.2 0.11 ± 4% perf-profile.children.cycles-pp.sysvec_call_function_single
0.47 ± 6% -0.2 0.28 perf-profile.children.cycles-pp.finish_task_switch
0.56 ± 5% -0.2 0.36 ± 3% perf-profile.children.cycles-pp.unwind_get_return_address
0.50 ± 6% -0.2 0.32 ± 4% perf-profile.children.cycles-pp.__kernel_text_address
0.96 ± 5% -0.2 0.78 perf-profile.children.cycles-pp.update_curr
0.44 ± 6% -0.2 0.27 ± 4% perf-profile.children.cycles-pp.kernel_text_address
2.17 ± 4% -0.2 2.00 perf-profile.children.cycles-pp.unwind_next_frame
0.73 ± 3% -0.2 0.56 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair
0.95 -0.2 0.79 ± 2% perf-profile.children.cycles-pp.update_rq_clock
0.74 ± 4% -0.1 0.59 ± 4% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.53 ± 3% -0.1 0.40 ± 5% perf-profile.children.cycles-pp.ktime_get
0.41 ± 4% -0.1 0.28 ± 3% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched
0.71 -0.1 0.59 ± 3% perf-profile.children.cycles-pp.mutex_lock
0.50 ± 2% -0.1 0.38 ± 3% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.44 -0.1 0.33 perf-profile.children.cycles-pp.__orc_find
0.52 ± 2% -0.1 0.41 ± 3% perf-profile.children.cycles-pp.copy_page_to_iter
0.15 ± 19% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
0.44 ± 4% -0.1 0.34 ± 2% perf-profile.children.cycles-pp.security_file_permission
0.53 ± 2% -0.1 0.43 perf-profile.children.cycles-pp.__switch_to
0.48 ± 3% -0.1 0.38 ± 3% perf-profile.children.cycles-pp.__switch_to_asm
0.37 ± 3% -0.1 0.27 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se
0.67 ± 2% -0.1 0.57 ± 2% perf-profile.children.cycles-pp._raw_spin_lock
0.32 ± 4% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.copy_page_from_iter
0.38 ± 4% -0.1 0.29 ± 5% perf-profile.children.cycles-pp.select_idle_sibling
0.45 ± 5% -0.1 0.37 ± 4% perf-profile.children.cycles-pp.tick_nohz_next_event
0.29 ± 4% -0.1 0.21 ± 3% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.64 ± 2% -0.1 0.57 ± 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.38 ± 3% -0.1 0.31 ± 4% perf-profile.children.cycles-pp.copyout
0.27 ± 6% -0.1 0.19 ± 6% perf-profile.children.cycles-pp.orc_find
0.40 ± 2% -0.1 0.33 ± 5% perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.35 ± 4% -0.1 0.28 perf-profile.children.cycles-pp.pick_next_entity
0.38 ± 4% -0.1 0.31 perf-profile.children.cycles-pp.update_cfs_group
0.22 ± 4% -0.1 0.16 ± 5% perf-profile.children.cycles-pp.___perf_sw_event
0.30 ± 5% -0.1 0.23 ± 3% perf-profile.children.cycles-pp.__unwind_start
0.32 ± 4% -0.1 0.26 perf-profile.children.cycles-pp.ttwu_do_wakeup
0.20 ± 4% -0.1 0.14 ± 9% perf-profile.children.cycles-pp.__might_sleep
0.28 ± 6% -0.1 0.22 ± 5% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.27 ± 4% -0.1 0.21 ± 3% perf-profile.children.cycles-pp.common_file_perm
0.18 ± 3% -0.1 0.12 ± 3% perf-profile.children.cycles-pp.in_sched_functions
0.30 ± 4% -0.1 0.24 perf-profile.children.cycles-pp.check_preempt_curr
0.22 ± 4% -0.1 0.17 ± 4% perf-profile.children.cycles-pp.rcu_idle_exit
0.34 ± 3% -0.1 0.28 ± 2% perf-profile.children.cycles-pp.sched_clock_cpu
0.30 ± 4% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.update_ts_time_stats
0.31 ± 5% -0.1 0.25 ± 4% perf-profile.children.cycles-pp.nr_iowait_cpu
0.31 ± 3% -0.1 0.26 ± 3% perf-profile.children.cycles-pp.sched_clock
0.21 ± 5% -0.1 0.16 ± 7% perf-profile.children.cycles-pp.cpus_share_cache
0.17 ± 10% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.place_entity
0.28 ± 3% -0.1 0.23 ± 2% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.18 ± 4% -0.1 0.13 ± 3% perf-profile.children.cycles-pp.resched_curr
0.33 ± 2% -0.0 0.28 ± 2% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.29 ± 3% -0.0 0.24 ± 2% perf-profile.children.cycles-pp.mutex_unlock
0.23 ± 3% -0.0 0.18 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.26 ± 3% -0.0 0.21 perf-profile.children.cycles-pp.___might_sleep
0.20 ± 6% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid
0.29 ± 5% -0.0 0.25 ± 3% perf-profile.children.cycles-pp.native_sched_clock
0.24 ± 5% -0.0 0.19 ± 5% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.12 ± 5% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.23 ± 8% -0.0 0.19 ± 2% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.21 ± 3% -0.0 0.17 ± 2% perf-profile.children.cycles-pp.read_tsc
0.14 ± 3% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.rcu_eqs_exit
0.12 ± 4% -0.0 0.09 ± 7% perf-profile.children.cycles-pp.__entry_text_start
0.19 ± 2% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.__fdget_pos
0.08 ± 6% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.07 ± 10% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.put_prev_entity
0.11 ± 13% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.put_prev_task_fair
0.17 ± 4% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.15 ± 7% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.16 ± 2% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.__fget_light
0.13 ± 10% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.is_bpf_text_address
0.11 ± 6% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.file_update_time
0.14 ± 6% -0.0 0.11 ± 11% perf-profile.children.cycles-pp.__wrgsbase_inactive
0.14 ± 8% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.available_idle_cpu
0.09 ± 4% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.menu_reflect
0.13 ± 9% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.stack_access_ok
0.14 ± 5% -0.0 0.12 ± 7% perf-profile.children.cycles-pp.switch_fpu_return
0.10 ± 8% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.current_time
0.09 ± 9% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__rdgsbase_inactive
0.10 -0.0 0.08 perf-profile.children.cycles-pp.__calc_delta
0.09 ± 10% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.bpf_ksym_find
0.07 ± 10% -0.0 0.05 perf-profile.children.cycles-pp.pick_next_task_idle
0.18 ± 3% -0.0 0.16 ± 2% perf-profile.children.cycles-pp.fsnotify
0.17 ± 5% -0.0 0.15 ± 2% perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
0.07 ± 6% -0.0 0.05 perf-profile.children.cycles-pp.put_task_stack
0.07 ± 6% -0.0 0.05 perf-profile.children.cycles-pp.apparmor_file_permission
0.07 ± 12% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.07 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.update_min_vruntime
0.17 ± 2% -0.0 0.16 perf-profile.children.cycles-pp.anon_pipe_buf_release
0.07 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.atime_needs_update
0.08 ± 5% -0.0 0.07 perf-profile.children.cycles-pp.finish_wait
0.48 ± 14% +0.2 0.71 ± 8% perf-profile.children.cycles-pp.start_kernel
46.28 +0.5 46.74 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
46.28 +0.5 46.74 perf-profile.children.cycles-pp.cpu_startup_entry
46.25 +0.5 46.71 perf-profile.children.cycles-pp.do_idle
7.88 ± 2% +0.8 8.65 ± 3% perf-profile.children.cycles-pp.write
42.99 +1.7 44.69 perf-profile.children.cycles-pp.ksys_write
42.80 +1.7 44.53 perf-profile.children.cycles-pp.vfs_write
42.37 +1.8 44.16 perf-profile.children.cycles-pp.new_sync_write
42.23 +1.8 44.06 perf-profile.children.cycles-pp.pipe_write
39.21 +2.1 41.33 perf-profile.children.cycles-pp.cpuidle_enter
40.84 +2.1 42.96 perf-profile.children.cycles-pp.__wake_up_common_lock
39.20 +2.1 41.32 perf-profile.children.cycles-pp.cpuidle_enter_state
40.50 +2.2 42.65 perf-profile.children.cycles-pp.__wake_up_common
40.15 +2.2 42.36 perf-profile.children.cycles-pp.autoremove_wake_function
40.09 +2.2 42.30 perf-profile.children.cycles-pp.try_to_wake_up
37.97 +2.4 40.36 perf-profile.children.cycles-pp.ttwu_do_activate
37.94 +2.4 40.33 perf-profile.children.cycles-pp.enqueue_task_fair
37.50 +2.5 40.05 perf-profile.children.cycles-pp.enqueue_entity
36.91 +2.9 39.86 perf-profile.children.cycles-pp.intel_idle
34.95 +3.0 37.95 perf-profile.children.cycles-pp.__account_scheduler_latency
31.46 +3.5 35.00 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
29.71 ± 2% +3.8 33.52 perf-profile.children.cycles-pp.__cna_queued_spin_lock_slowpath
0.71 ± 39% -0.7 0.05 ± 8% perf-profile.self.cycles-pp.poll_idle
1.08 ± 3% -0.3 0.78 perf-profile.self.cycles-pp.update_load_avg
1.24 ± 2% -0.2 1.02 ± 2% perf-profile.self.cycles-pp.__schedule
1.86 -0.2 1.65 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.59 ± 3% -0.2 0.40 ± 4% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.95 ± 3% -0.2 0.75 ± 2% perf-profile.self.cycles-pp.set_next_entity
0.66 ± 4% -0.2 0.51 ± 6% perf-profile.self.cycles-pp.menu_select
0.43 ± 5% -0.1 0.28 ± 3% perf-profile.self.cycles-pp.enqueue_task_fair
0.53 ± 3% -0.1 0.40 ± 2% perf-profile.self.cycles-pp._raw_spin_lock
0.67 ± 2% -0.1 0.54 ± 2% perf-profile.self.cycles-pp.stack_trace_save_tsk
0.77 ± 2% -0.1 0.64 ± 2% perf-profile.self.cycles-pp.update_rq_clock
0.72 ± 8% -0.1 0.60 perf-profile.self.cycles-pp.update_curr
0.44 -0.1 0.33 perf-profile.self.cycles-pp.__orc_find
0.56 ± 2% -0.1 0.45 ± 3% perf-profile.self.cycles-pp.pipe_read
0.33 ± 4% -0.1 0.22 perf-profile.self.cycles-pp.prepare_to_wait_event
0.48 ± 3% -0.1 0.38 ± 3% perf-profile.self.cycles-pp.__switch_to_asm
0.32 ± 2% -0.1 0.22 ± 7% perf-profile.self.cycles-pp.ktime_get
0.47 -0.1 0.38 ± 2% perf-profile.self.cycles-pp.__switch_to
0.35 ± 2% -0.1 0.26 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair
0.28 ± 5% -0.1 0.20 ± 3% perf-profile.self.cycles-pp.dequeue_entity
0.23 ± 6% -0.1 0.15 ± 3% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched
0.46 ± 3% -0.1 0.39 ± 5% perf-profile.self.cycles-pp.mutex_lock
0.32 ± 4% -0.1 0.25 ± 4% perf-profile.self.cycles-pp.__update_load_avg_se
0.39 ± 3% -0.1 0.32 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.45 ± 3% -0.1 0.38 perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.19 ± 6% -0.1 0.12 ± 8% perf-profile.self.cycles-pp.vfs_read
0.34 ± 4% -0.1 0.27 ± 2% perf-profile.self.cycles-pp.pick_next_entity
0.84 ± 2% -0.1 0.77 perf-profile.self.cycles-pp.enqueue_entity
0.28 ± 5% -0.1 0.21 ± 5% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.19 ± 4% -0.1 0.12 ± 10% perf-profile.self.cycles-pp.__might_sleep
0.35 ± 3% -0.1 0.29 perf-profile.self.cycles-pp.__wake_up_common
0.19 ± 4% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.___perf_sw_event
0.47 ± 2% -0.1 0.41 ± 2% perf-profile.self.cycles-pp.do_idle
0.27 ± 4% -0.1 0.21 ± 3% perf-profile.self.cycles-pp.__unwind_start
0.22 ± 6% -0.1 0.16 ± 2% perf-profile.self.cycles-pp.finish_task_switch
0.34 ± 3% -0.1 0.29 perf-profile.self.cycles-pp.schedule
0.35 ± 6% -0.1 0.29 ± 2% perf-profile.self.cycles-pp.update_cfs_group
0.24 ± 6% -0.1 0.19 ± 4% perf-profile.self.cycles-pp.orc_find
0.21 ± 5% -0.1 0.16 ± 7% perf-profile.self.cycles-pp.cpus_share_cache
0.30 ± 7% -0.1 0.25 ± 5% perf-profile.self.cycles-pp.nr_iowait_cpu
0.18 ± 4% -0.1 0.13 perf-profile.self.cycles-pp.resched_curr
0.29 ± 3% -0.1 0.24 ± 2% perf-profile.self.cycles-pp.mutex_unlock
0.16 ± 9% -0.1 0.11 ± 6% perf-profile.self.cycles-pp.place_entity
0.32 ± 5% -0.0 0.27 perf-profile.self.cycles-pp.cpuidle_enter_state
0.23 ± 3% -0.0 0.18 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.22 ± 4% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.common_file_perm
0.12 ± 3% -0.0 0.08 ± 11% perf-profile.self.cycles-pp.in_sched_functions
0.28 ± 3% -0.0 0.24 ± 3% perf-profile.self.cycles-pp.native_sched_clock
0.20 ± 4% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid
0.12 ± 5% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.new_sync_write
0.25 -0.0 0.21 perf-profile.self.cycles-pp.___might_sleep
0.20 ± 4% -0.0 0.16 ± 5% perf-profile.self.cycles-pp.vfs_write
0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.main
0.29 ± 2% -0.0 0.25 ± 4% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.21 ± 2% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.read_tsc
0.07 ± 5% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.12 ± 6% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.new_sync_read
0.21 ± 2% -0.0 0.18 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.12 ± 6% -0.0 0.10 ± 9% perf-profile.self.cycles-pp.arch_stack_walk
0.07 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.update_min_vruntime
0.11 ± 4% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.kernel_text_address
0.23 ± 7% -0.0 0.21 ± 5% perf-profile.self.cycles-pp.__account_scheduler_latency
0.14 ± 6% -0.0 0.11 ± 11% perf-profile.self.cycles-pp.__wrgsbase_inactive
0.09 ± 9% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__entry_text_start
0.08 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.copy_page_to_iter
0.19 ± 6% -0.0 0.17 ± 5% perf-profile.self.cycles-pp.pipe_write
0.15 ± 3% -0.0 0.13 ± 5% perf-profile.self.cycles-pp.__fget_light
0.06 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.unwind_get_return_address
0.14 ± 7% -0.0 0.12 ± 7% perf-profile.self.cycles-pp.switch_fpu_return
0.09 ± 9% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.tick_nohz_next_event
0.08 ± 11% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.16 -0.0 0.14 ± 6% perf-profile.self.cycles-pp.pick_next_task_fair
0.09 ± 9% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.__rdgsbase_inactive
0.06 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.copy_page_from_iter
0.14 ± 6% -0.0 0.11 ± 7% perf-profile.self.cycles-pp.available_idle_cpu
0.08 ± 16% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.call_cpuidle
0.10 ± 8% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.09 ± 5% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.rcu_idle_exit
0.19 ± 3% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.dequeue_task_fair
0.10 ± 4% -0.0 0.08 perf-profile.self.cycles-pp.__calc_delta
0.17 ± 2% -0.0 0.16 ± 2% perf-profile.self.cycles-pp.anon_pipe_buf_release
0.17 ± 4% -0.0 0.15 ± 2% perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
0.06 ± 6% -0.0 0.05 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.06 ± 6% -0.0 0.05 perf-profile.self.cycles-pp.put_task_stack
36.91 +2.9 39.86 perf-profile.self.cycles-pp.intel_idle
29.30 ± 2% +3.9 33.15 perf-profile.self.cycles-pp.__cna_queued_spin_lock_slowpath
unixbench.time.voluntary_context_switches
4.4e+08 +-----------------------------------------------------------------+
| +.. +..+. ..|
4.3e+08 |-+ : + + |
4.2e+08 |-+ : + |
| : |
4.1e+08 |-+ : |
4e+08 |-+ +. .+.. .+..+.+..+. : |
| .. +..+.+..+.+. + +..+ |
3.9e+08 |..+.+..+.+..+.+ |
3.8e+08 |-+ |
| |
3.7e+08 |-+ O O O O O |
3.6e+08 |-+ O O O O O O O O O O O |
| O O O O O O |
3.5e+08 +-----------------------------------------------------------------+
unixbench.score
3800 +--------------------------------------------------------------------+
| .+. .|
3700 |-+ +. .+. +. |
3600 |-+ : +. |
| : |
3500 |-+ : |
3400 |-+ .+.+..+..+. : |
| .+.+..+..+.+..+..+.+. +..+ |
3300 |..+.+..+..+.+..+. |
3200 |-+ |
| |
3100 |-+ O O O O O O O O O O O O O O |
3000 |-+O O O O O O |
| O O O O O |
2900 +--------------------------------------------------------------------+
unixbench.workload
6e+08 +-----------------------------------------------------------------+
| |
5.8e+08 |-+ +.. +..+. ..|
| : + + |
5.6e+08 |-+ : + |
| : |
5.4e+08 |-+ : |
| .+. .+.. .+..+.+..+.+..+. : |
5.2e+08 |.. .+.. .+.+. +..+ +.+. +..+ |
| + +.+. |
5e+08 |-+ |
| O O O O O |
4.8e+08 |-+ O O O O O O O O O O O |
| O O O O O O O O |
4.6e+08 +-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 7 months
[x86/paravirt] fd8d46a7a2: kernel-selftests.livepatch.test-callbacks.sh.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: fd8d46a7a2c51313ee14c43af60ff337279384ef ("x86/paravirt: switch functions with custom code to ALTERNATIVE")
url: https://github.com/0day-ci/linux/commits/Juergen-Gross/x86-major-paravirt...
in testcase: kernel-selftests
version: kernel-selftests-x86_64-b5a583fb-1_20201015
with following parameters:
group: livepatch
ucode: 0xe2
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: 8 threads Intel(R) Core(TM) i7-6770HQ CPU @ 2.60GHz with 32G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
KERNEL SELFTESTS: linux_headers_dir is /usr/src/linux-headers-x86_64-rhel-7.6-kselftests-fd8d46a7a2c51313ee14c43af60ff337279384ef
2020-11-25 12:01:24 ln -sf /usr/bin/clang
2020-11-25 12:01:24 ln -sf /usr/bin/llc
2020-11-25 12:01:25 sed -i s/default_timeout=45/default_timeout=300/ kselftest/runner.sh
2020-11-25 12:01:25 make run_tests -C livepatch
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-7.6-kselftests-fd8d46a7a2c51313ee14c43af60ff337279384ef/tools/testing/selftests/livepatch'
TAP version 13
1..5
# selftests: livepatch: test-livepatch.sh
# TEST: basic function patching ... ERROR: failed to complete transition
not ok 1 selftests: livepatch: test-livepatch.sh # exit=1
# selftests: livepatch: test-callbacks.sh
# TEST: target module before livepatch ... ERROR: modprobe: ERROR: could not insert 'test_klp_callbacks_demo': Device or resource busy
not ok 2 selftests: livepatch: test-callbacks.sh # exit=1
# selftests: livepatch: test-shadow-vars.sh
# TEST: basic shadow variable API ... ok
ok 3 selftests: livepatch: test-shadow-vars.sh
# selftests: livepatch: test-state.sh
# TEST: system state modification ... ERROR: modprobe: ERROR: could not insert 'test_klp_state': Device or resource busy
not ok 4 selftests: livepatch: test-state.sh # exit=1
# selftests: livepatch: test-ftrace.sh
# TEST: livepatch interaction with ftrace_enabled sysctl ... ERROR: test_klp_livepatch unexpectedly loaded
not ok 5 selftests: livepatch: test-ftrace.sh # exit=1
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-kselftests-fd8d46a7a2c51313ee14c43af60ff337279384ef/tools/testing/selftests/livepatch'
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Oliver Sang
1 year, 7 months
[sched/numa] 77cbe725cf: fsmark.files_per_sec 29.6% improvement
by kernel test robot
Greeting,
FYI, we noticed a 29.6% improvement of fsmark.files_per_sec due to commit:
commit: 77cbe725cfa703cd571d605fc09b52ab1fb5a7eb ("sched/numa: Allow a floating imbalance between NUMA nodes")
https://git.kernel.org/cgit/linux/kernel/git/mel/linux.git sched-imbalancespread-v3r2
in testcase: fsmark
on test machine: 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory
with following parameters:
iterations: 8
disk: 1SSD
nr_threads: 4
fs: f2fs
filesize: 8K
test_size: 72G
sync_method: fsyncBeforeClose
nr_directories: 16d
nr_files_per_directory: 256fpd
cpufreq_governor: performance
ucode: 0x4003003
test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1SSD/8K/f2fs/8/x86_64-rhel-8.3/16d/256fpd/4/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap1/72G/fsmark/0x4003003
commit:
820a2eaf22 ("sched: Avoid unnecessary calculation of load imbalance at clone time")
77cbe725cf ("sched/numa: Allow a floating imbalance between NUMA nodes")
820a2eaf226559cc 77cbe725cfa703cd571d605fc09
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 kmsg.ACPI_Error
0:4 -1% 0:4 perf-profile.children.cycles-pp.error_entry
0:4 0% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
5528849 -3.3% 5345856 fsmark.app_overhead
24887 +29.6% 32260 ± 8% fsmark.files_per_sec
455.44 -19.3% 367.40 ± 9% fsmark.time.elapsed_time
455.44 -19.3% 367.40 ± 9% fsmark.time.elapsed_time.max
171790 +2.6% 176298 fsmark.time.file_system_inputs
60644 ± 12% +141.3% 146330 ± 42% fsmark.time.minor_page_faults
288.75 -3.5% 278.75 fsmark.time.percent_of_cpu_this_job_got
1285 -22.6% 994.45 ± 10% fsmark.time.system_time
285635 ± 3% +15.0% 328530 ± 6% meminfo.max_used_kB
41161404 ± 11% +30.4% 53672857 ± 15% cpuidle.C1.time
6258285 ± 13% +47.2% 9211551 ± 2% cpuidle.C1.usage
0.10 ± 2% +0.0 0.14 ± 14% mpstat.cpu.all.iowait%
0.05 ± 3% +0.0 0.06 ± 9% mpstat.cpu.all.usr%
8848121 ± 45% -75.1% 2202308 ± 76% numa-numastat.node1.local_node
8864046 ± 45% -74.8% 2230154 ± 75% numa-numastat.node1.numa_hit
497.44 -17.9% 408.17 ± 8% uptime.boot
91916 -18.3% 75137 ± 8% uptime.idle
187.25 ± 2% +28.2% 240.00 ± 10% vmstat.io.bi
252055 +24.7% 314439 ± 9% vmstat.io.bo
95186 +22.8% 116915 ± 6% vmstat.system.cs
2622 ± 4% -9.6% 2371 ± 8% slabinfo.PING.active_objs
2622 ± 4% -9.6% 2371 ± 8% slabinfo.PING.num_objs
8755 ± 2% -15.6% 7391 ± 9% slabinfo.dmaengine-unmap-16.active_objs
8757 ± 2% -15.5% 7399 ± 9% slabinfo.dmaengine-unmap-16.num_objs
14936 ± 4% -20.3% 11904 ± 17% slabinfo.ext4_extent_status.active_objs
14936 ± 4% -19.9% 11959 ± 17% slabinfo.ext4_extent_status.num_objs
939.50 ± 5% -15.8% 791.50 ± 3% slabinfo.f2fs_discard_entry.active_objs
939.50 ± 5% -15.8% 791.50 ± 3% slabinfo.f2fs_discard_entry.num_objs
7084057 ± 49% -58.7% 2927225 ± 94% numa-meminfo.node1.Active
7081527 ± 49% -58.7% 2925997 ± 94% numa-meminfo.node1.Active(file)
20742147 ± 47% -57.4% 8829838 ± 90% numa-meminfo.node1.FilePages
13495557 ± 47% -57.1% 5786996 ± 90% numa-meminfo.node1.Inactive
13399951 ± 47% -57.8% 5654060 ± 93% numa-meminfo.node1.Inactive(file)
3638577 ± 48% -57.6% 1542764 ± 92% numa-meminfo.node1.KReclaimable
24817566 ± 46% -56.5% 10793406 ± 87% numa-meminfo.node1.MemUsed
3638577 ± 48% -57.6% 1542764 ± 92% numa-meminfo.node1.SReclaimable
119209 ± 27% -29.4% 84153 ± 38% numa-meminfo.node1.SUnreclaim
3757787 ± 47% -56.7% 1626918 ± 90% numa-meminfo.node1.Slab
10896 ± 27% -49.5% 5503 ± 61% numa-meminfo.node3.Shmem
1770057 ± 49% -58.7% 731066 ± 94% numa-vmstat.node1.nr_active_file
5631414 ± 47% -55.3% 2518543 ± 90% numa-vmstat.node1.nr_dirtied
5184581 ± 47% -57.4% 2206356 ± 90% numa-vmstat.node1.nr_file_pages
3349367 ± 47% -57.8% 1412848 ± 93% numa-vmstat.node1.nr_inactive_file
909495 ± 48% -57.6% 385473 ± 92% numa-vmstat.node1.nr_slab_reclaimable
29803 ± 27% -29.4% 21037 ± 38% numa-vmstat.node1.nr_slab_unreclaimable
5614011 ± 47% -55.3% 2512114 ± 90% numa-vmstat.node1.nr_written
1770057 ± 49% -58.7% 731066 ± 94% numa-vmstat.node1.nr_zone_active_file
3349368 ± 47% -57.8% 1412849 ± 93% numa-vmstat.node1.nr_zone_inactive_file
6291933 ± 50% -77.7% 1406031 ± 48% numa-vmstat.node1.numa_hit
6191397 ± 51% -79.1% 1293728 ± 52% numa-vmstat.node1.numa_local
2724 ± 27% -49.5% 1375 ± 61% numa-vmstat.node3.nr_shmem
242926 ± 5% -19.0% 196734 ± 12% sched_debug.cpu.clock.avg
242936 ± 5% -19.0% 196746 ± 12% sched_debug.cpu.clock.max
242914 ± 5% -19.0% 196722 ± 12% sched_debug.cpu.clock.min
239904 ± 5% -19.2% 193851 ± 12% sched_debug.cpu.clock_task.avg
241391 ± 5% -19.1% 195340 ± 12% sched_debug.cpu.clock_task.max
231719 ± 5% -19.7% 186163 ± 13% sched_debug.cpu.clock_task.min
204.75 ± 2% -14.1% 175.90 ± 6% sched_debug.cpu.curr->pid.avg
9699 ± 3% -14.4% 8306 ± 9% sched_debug.cpu.curr->pid.max
1317 -15.5% 1112 ± 6% sched_debug.cpu.curr->pid.stddev
34613 ± 5% +16.8% 40439 ± 8% sched_debug.cpu.ttwu_local.avg
594429 ± 8% +19.9% 712509 ± 12% sched_debug.cpu.ttwu_local.max
85464 ± 7% +33.8% 114328 ± 11% sched_debug.cpu.ttwu_local.stddev
242915 ± 5% -19.0% 196724 ± 12% sched_debug.cpu_clk
242041 ± 5% -19.1% 195850 ± 12% sched_debug.ktime
243283 ± 5% -19.0% 197090 ± 12% sched_debug.sched_clk
342323 ± 18% +235.9% 1149797 ± 46% proc-vmstat.compact_free_scanned
29650 ± 87% +239.8% 100755 ± 27% proc-vmstat.compact_isolated
119027 ± 41% +310.7% 488897 ± 44% proc-vmstat.compact_migrate_scanned
1639 ±120% +340.2% 7218 ± 43% proc-vmstat.kswapd_inodesteal
130.75 -8.8% 119.25 ± 5% proc-vmstat.nr_anon_transparent_hugepages
224.50 ± 13% -42.4% 129.25 ± 8% proc-vmstat.nr_writeback
3475581 ± 24% +171.5% 9437440 ± 39% proc-vmstat.numa_foreign
28192996 ± 2% -21.7% 22063725 ± 17% proc-vmstat.numa_hit
28097886 ± 3% -21.8% 21966090 ± 17% proc-vmstat.numa_local
3475581 ± 24% +171.5% 9437440 ± 39% proc-vmstat.numa_miss
3570691 ± 23% +167.0% 9535075 ± 39% proc-vmstat.numa_other
546724 ± 5% -12.3% 479396 ± 2% proc-vmstat.numa_pte_updates
35946876 -1.5% 35422171 proc-vmstat.pgalloc_normal
1785245 -13.6% 1541741 ± 4% proc-vmstat.pgfault
137.50 ±166% +1679.6% 2447 ± 89% proc-vmstat.pgmigrate_fail
33368 ± 34% +82.4% 60859 ± 17% proc-vmstat.pgmigrate_success
99974 ± 2% -20.0% 79942 ± 8% proc-vmstat.pgreuse
1397311 ± 67% +112.2% 2965233 ± 26% proc-vmstat.pgscan_file
1396931 ± 67% +112.0% 2961155 ± 27% proc-vmstat.pgscan_kswapd
1397297 ± 67% +112.2% 2965227 ± 26% proc-vmstat.pgsteal_file
1396917 ± 67% +112.0% 2961149 ± 27% proc-vmstat.pgsteal_kswapd
3792384 ± 70% +127.0% 8608688 ± 30% proc-vmstat.slabs_scanned
76064 ± 67% +164.3% 201029 ± 35% proc-vmstat.workingset_nodes
1.519e+09 +19.3% 1.813e+09 ± 6% perf-stat.i.branch-instructions
30195444 ± 2% -17.5% 24900954 ± 4% perf-stat.i.cache-misses
95858 +23.1% 118007 ± 6% perf-stat.i.context-switches
2.74 ± 3% -16.9% 2.28 ± 7% perf-stat.i.cpi
1.912e+10 ± 3% -5.1% 1.814e+10 ± 2% perf-stat.i.cpu-cycles
654.55 +16.5% 762.37 ± 2% perf-stat.i.cycles-between-cache-misses
1.776e+09 ± 2% +18.0% 2.096e+09 ± 5% perf-stat.i.dTLB-loads
8.285e+08 +18.1% 9.788e+08 ± 5% perf-stat.i.dTLB-stores
7.068e+09 +19.2% 8.424e+09 ± 6% perf-stat.i.instructions
0.37 ± 2% +23.8% 0.46 ± 7% perf-stat.i.ipc
0.45 +29.0% 0.58 ± 15% perf-stat.i.major-faults
0.10 ± 3% -5.1% 0.09 ± 2% perf-stat.i.metric.GHz
22.17 +18.4% 26.25 ± 6% perf-stat.i.metric.M/sec
3807 +7.5% 4094 ± 5% perf-stat.i.minor-faults
89.38 -15.6 73.77 ± 15% perf-stat.i.node-load-miss-rate%
8501710 ± 8% -54.5% 3869541 ± 26% perf-stat.i.node-load-misses
2474393 ± 5% -46.2% 1331771 ± 17% perf-stat.i.node-store-misses
3808 +7.5% 4094 ± 5% perf-stat.i.page-faults
2.71 ± 3% -20.0% 2.16 ± 8% perf-stat.overall.cpi
633.26 +15.1% 729.08 perf-stat.overall.cycles-between-cache-misses
0.37 ± 3% +25.8% 0.47 ± 8% perf-stat.overall.ipc
90.82 -9.7 81.07 ± 9% perf-stat.overall.node-load-miss-rate%
1.516e+09 +19.3% 1.807e+09 ± 6% perf-stat.ps.branch-instructions
30121186 ± 2% -17.6% 24828260 ± 4% perf-stat.ps.cache-misses
95610 +23.0% 117643 ± 6% perf-stat.ps.context-switches
1.908e+10 ± 3% -5.2% 1.809e+10 ± 3% perf-stat.ps.cpu-cycles
1.771e+09 ± 2% +18.0% 2.09e+09 ± 5% perf-stat.ps.dTLB-loads
8.266e+08 +18.1% 9.76e+08 ± 5% perf-stat.ps.dTLB-stores
7.051e+09 +19.1% 8.4e+09 ± 6% perf-stat.ps.instructions
0.45 +28.9% 0.58 ± 15% perf-stat.ps.major-faults
3799 +7.5% 4084 ± 5% perf-stat.ps.minor-faults
8480209 ± 8% -54.5% 3858125 ± 26% perf-stat.ps.node-load-misses
2468407 ± 5% -46.2% 1328238 ± 18% perf-stat.ps.node-store-misses
3800 +7.5% 4084 ± 5% perf-stat.ps.page-faults
916.00 -19.2% 740.50 ± 9% interrupts.9:IO-APIC.9-fasteoi.acpi
491897 ± 7% -45.8% 266676 ± 35% interrupts.CAL:Function_call_interrupts
916.00 -19.2% 740.50 ± 9% interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
946.75 ± 7% +49.0% 1410 ± 29% interrupts.CPU116.CAL:Function_call_interrupts
142.75 ± 45% -53.8% 66.00 ± 31% interrupts.CPU118.NMI:Non-maskable_interrupts
142.75 ± 45% -53.8% 66.00 ± 31% interrupts.CPU118.PMI:Performance_monitoring_interrupts
126.00 ± 26% -46.6% 67.25 ± 33% interrupts.CPU119.NMI:Non-maskable_interrupts
126.00 ± 26% -46.6% 67.25 ± 33% interrupts.CPU119.PMI:Performance_monitoring_interrupts
9917 ± 60% -70.4% 2930 ± 97% interrupts.CPU122.CAL:Function_call_interrupts
8460 ± 31% -76.5% 1986 ± 65% interrupts.CPU123.CAL:Function_call_interrupts
4783 ± 57% -62.7% 1786 ± 57% interrupts.CPU124.CAL:Function_call_interrupts
7250 ± 69% -78.9% 1529 ± 77% interrupts.CPU125.CAL:Function_call_interrupts
2968 ± 33% -67.0% 979.00 ± 42% interrupts.CPU126.CAL:Function_call_interrupts
86.00 ± 44% +59.3% 137.00 ± 20% interrupts.CPU126.NMI:Non-maskable_interrupts
86.00 ± 44% +59.3% 137.00 ± 20% interrupts.CPU126.PMI:Performance_monitoring_interrupts
2172 ± 92% -98.4% 34.25 ±133% interrupts.CPU126.RES:Rescheduling_interrupts
2713 ± 96% -86.2% 375.00 ±170% interrupts.CPU130.RES:Rescheduling_interrupts
274.50 ±138% -99.0% 2.75 ± 94% interrupts.CPU143.RES:Rescheduling_interrupts
906616 -26.5% 665918 ± 26% interrupts.CPU144.LOC:Local_timer_interrupts
81.50 ± 22% +59.2% 129.75 ± 2% interrupts.CPU144.NMI:Non-maskable_interrupts
81.50 ± 22% +59.2% 129.75 ± 2% interrupts.CPU144.PMI:Performance_monitoring_interrupts
906602 -26.4% 667518 ± 25% interrupts.CPU145.LOC:Local_timer_interrupts
906657 -26.3% 667847 ± 25% interrupts.CPU146.LOC:Local_timer_interrupts
906634 -26.3% 668158 ± 25% interrupts.CPU147.LOC:Local_timer_interrupts
906691 -26.3% 667921 ± 25% interrupts.CPU148.LOC:Local_timer_interrupts
906626 -26.3% 668245 ± 25% interrupts.CPU149.LOC:Local_timer_interrupts
906776 -26.3% 668045 ± 25% interrupts.CPU150.LOC:Local_timer_interrupts
906501 -26.3% 668195 ± 25% interrupts.CPU151.LOC:Local_timer_interrupts
906608 -26.3% 668216 ± 25% interrupts.CPU152.LOC:Local_timer_interrupts
906637 -26.3% 668322 ± 25% interrupts.CPU153.LOC:Local_timer_interrupts
906653 -26.3% 668040 ± 25% interrupts.CPU154.LOC:Local_timer_interrupts
906744 -26.3% 668095 ± 25% interrupts.CPU155.LOC:Local_timer_interrupts
906618 -26.3% 668090 ± 25% interrupts.CPU156.LOC:Local_timer_interrupts
906620 -26.3% 668270 ± 25% interrupts.CPU157.LOC:Local_timer_interrupts
906630 -26.3% 668248 ± 25% interrupts.CPU158.LOC:Local_timer_interrupts
906688 -26.3% 668089 ± 25% interrupts.CPU159.LOC:Local_timer_interrupts
906655 -26.3% 667887 ± 25% interrupts.CPU160.LOC:Local_timer_interrupts
906593 -26.3% 667780 ± 25% interrupts.CPU161.LOC:Local_timer_interrupts
906642 -26.3% 667974 ± 25% interrupts.CPU162.LOC:Local_timer_interrupts
906631 -26.3% 668362 ± 25% interrupts.CPU163.LOC:Local_timer_interrupts
906582 -26.4% 667643 ± 25% interrupts.CPU164.LOC:Local_timer_interrupts
906629 -26.3% 668077 ± 25% interrupts.CPU165.LOC:Local_timer_interrupts
906618 -26.3% 668040 ± 25% interrupts.CPU166.LOC:Local_timer_interrupts
906583 -26.3% 668040 ± 25% interrupts.CPU167.LOC:Local_timer_interrupts
20729 ± 17% -75.7% 5046 ± 80% interrupts.CPU168.CAL:Function_call_interrupts
11869 ± 65% -79.6% 2425 ± 49% interrupts.CPU170.CAL:Function_call_interrupts
5916 ± 52% -76.9% 1366 ± 50% interrupts.CPU171.CAL:Function_call_interrupts
7168 ± 48% -78.6% 1537 ± 61% interrupts.CPU172.CAL:Function_call_interrupts
4146 ± 33% -67.2% 1359 ± 42% interrupts.CPU174.CAL:Function_call_interrupts
25.25 ±154% +21897.0% 5554 ±108% interrupts.CPU185.RES:Rescheduling_interrupts
34.00 ±157% +22105.9% 7550 ±142% interrupts.CPU187.RES:Rescheduling_interrupts
183.00 ±136% -93.4% 12.00 ± 75% interrupts.CPU24.TLB:TLB_shootdowns
382.25 ± 87% -73.1% 103.00 ± 74% interrupts.CPU25.RES:Rescheduling_interrupts
172.50 ± 79% -94.1% 10.25 ± 90% interrupts.CPU27.RES:Rescheduling_interrupts
129.00 ± 59% -90.5% 12.25 ±109% interrupts.CPU30.RES:Rescheduling_interrupts
61.75 ± 87% -83.0% 10.50 ± 54% interrupts.CPU32.RES:Rescheduling_interrupts
2198 ±135% -99.9% 1.75 ± 47% interrupts.CPU41.RES:Rescheduling_interrupts
181.00 ±118% -98.2% 3.25 ± 88% interrupts.CPU47.RES:Rescheduling_interrupts
906602 -26.7% 664582 ± 26% interrupts.CPU48.LOC:Local_timer_interrupts
906665 -26.5% 666772 ± 26% interrupts.CPU49.LOC:Local_timer_interrupts
906689 -26.3% 668243 ± 25% interrupts.CPU50.LOC:Local_timer_interrupts
906510 -26.3% 668177 ± 25% interrupts.CPU51.LOC:Local_timer_interrupts
906686 -26.3% 668294 ± 25% interrupts.CPU52.LOC:Local_timer_interrupts
906725 -26.3% 668358 ± 25% interrupts.CPU53.LOC:Local_timer_interrupts
906664 -26.3% 668236 ± 25% interrupts.CPU54.LOC:Local_timer_interrupts
906486 -26.3% 668417 ± 25% interrupts.CPU55.LOC:Local_timer_interrupts
906727 -26.3% 668472 ± 25% interrupts.CPU56.LOC:Local_timer_interrupts
906664 -26.3% 668540 ± 25% interrupts.CPU57.LOC:Local_timer_interrupts
906681 -26.3% 668347 ± 25% interrupts.CPU58.LOC:Local_timer_interrupts
906653 -26.3% 668405 ± 25% interrupts.CPU59.LOC:Local_timer_interrupts
906691 -26.3% 668400 ± 25% interrupts.CPU60.LOC:Local_timer_interrupts
906666 -26.3% 668469 ± 25% interrupts.CPU61.LOC:Local_timer_interrupts
906751 -26.3% 668431 ± 25% interrupts.CPU62.LOC:Local_timer_interrupts
906675 -26.3% 668413 ± 25% interrupts.CPU63.LOC:Local_timer_interrupts
906740 -26.3% 668101 ± 25% interrupts.CPU64.LOC:Local_timer_interrupts
906595 -26.3% 668196 ± 25% interrupts.CPU65.LOC:Local_timer_interrupts
906709 -26.3% 668223 ± 25% interrupts.CPU66.LOC:Local_timer_interrupts
906695 -26.3% 668310 ± 25% interrupts.CPU67.LOC:Local_timer_interrupts
906441 -26.3% 668071 ± 25% interrupts.CPU68.LOC:Local_timer_interrupts
906707 -26.3% 668169 ± 25% interrupts.CPU69.LOC:Local_timer_interrupts
906728 -26.3% 668210 ± 25% interrupts.CPU70.LOC:Local_timer_interrupts
906651 -26.3% 668195 ± 25% interrupts.CPU71.LOC:Local_timer_interrupts
70.25 ± 43% -85.1% 10.50 ± 81% interrupts.CPU72.TLB:TLB_shootdowns
95.00 ± 75% +226.3% 310.00 ± 75% interrupts.CPU74.RES:Rescheduling_interrupts
181.50 ± 8% -36.5% 115.25 ± 35% interrupts.CPU80.NMI:Non-maskable_interrupts
181.50 ± 8% -36.5% 115.25 ± 35% interrupts.CPU80.PMI:Performance_monitoring_interrupts
546.00 ±117% -76.4% 128.75 ± 14% interrupts.CPU81.NMI:Non-maskable_interrupts
546.00 ±117% -76.4% 128.75 ± 14% interrupts.CPU81.PMI:Performance_monitoring_interrupts
2.25 ± 79% +2.1e+05% 4797 ± 96% interrupts.CPU89.RES:Rescheduling_interrupts
1.25 ± 87% +2e+05% 2540 ±167% interrupts.CPU91.RES:Rescheduling_interrupts
2.50 ± 82% +1.1e+05% 2666 ±167% interrupts.CPU92.RES:Rescheduling_interrupts
1.00 ± 70% +69275.0% 693.75 ± 75% interrupts.CPU93.RES:Rescheduling_interrupts
77.25 ±166% +8213.3% 6422 ±165% interrupts.CPU94.RES:Rescheduling_interrupts
9361 ± 51% -86.8% 1238 ± 13% interrupts.CPU96.CAL:Function_call_interrupts
7737 ± 27% -79.5% 1587 ± 39% interrupts.CPU97.CAL:Function_call_interrupts
12529 ± 67% -78.7% 2673 ± 69% interrupts.CPU98.CAL:Function_call_interrupts
209372 ± 8% +109.9% 439485 ± 16% interrupts.RES:Rescheduling_interrupts
57905 ± 2% -16.4% 48409 ± 9% softirqs.CPU10.SCHED
65231 ± 6% -18.6% 53101 ± 12% softirqs.CPU100.SCHED
62939 ± 7% -17.7% 51824 ± 9% softirqs.CPU102.SCHED
61002 ± 6% -17.7% 50216 ± 10% softirqs.CPU104.SCHED
61652 ± 5% -20.8% 48810 ± 12% softirqs.CPU105.SCHED
62067 ± 6% -19.5% 49962 ± 13% softirqs.CPU106.SCHED
60918 ± 4% -20.6% 48374 ± 10% softirqs.CPU107.SCHED
59701 ± 4% -16.6% 49783 ± 14% softirqs.CPU108.SCHED
60750 ± 7% -28.1% 43698 ± 18% softirqs.CPU109.SCHED
58069 ± 2% -17.6% 47833 ± 10% softirqs.CPU11.SCHED
60726 ± 5% -17.3% 50196 ± 8% softirqs.CPU110.SCHED
62718 ± 7% -14.1% 53854 ± 12% softirqs.CPU111.SCHED
59456 ± 2% -13.0% 51719 ± 9% softirqs.CPU112.SCHED
59348 ± 2% -10.8% 52957 ± 10% softirqs.CPU113.SCHED
58754 ± 2% -14.7% 50112 ± 7% softirqs.CPU117.SCHED
66241 ± 5% -28.8% 47179 ± 13% softirqs.CPU120.SCHED
71102 ± 9% -24.8% 53443 ± 14% softirqs.CPU121.SCHED
66315 ± 6% -21.6% 51977 ± 15% softirqs.CPU122.SCHED
61957 ± 8% -19.7% 49747 ± 15% softirqs.CPU123.RCU
67166 ± 6% -25.8% 49868 ± 10% softirqs.CPU123.SCHED
63309 ± 5% -21.5% 49717 ± 11% softirqs.CPU124.SCHED
61728 ± 7% -24.7% 46471 ± 8% softirqs.CPU125.RCU
66772 ± 10% -25.6% 49710 ± 7% softirqs.CPU125.SCHED
55517 ± 8% -18.5% 45264 ± 12% softirqs.CPU126.RCU
55024 ± 5% -14.0% 47300 ± 7% softirqs.CPU127.RCU
61782 ± 6% -20.0% 49437 ± 11% softirqs.CPU128.SCHED
63828 ± 9% -22.3% 49621 ± 11% softirqs.CPU130.SCHED
60309 ± 3% -18.0% 49431 ± 10% softirqs.CPU131.SCHED
61999 ± 6% -20.9% 49060 ± 9% softirqs.CPU132.SCHED
63202 ± 7% -28.5% 45219 ± 25% softirqs.CPU133.SCHED
63973 ± 5% -21.4% 50286 ± 12% softirqs.CPU134.SCHED
70384 ± 17% -41.0% 41529 ± 37% softirqs.CPU135.SCHED
61360 ± 8% -20.5% 48766 ± 9% softirqs.CPU136.SCHED
60853 ± 3% -20.0% 48675 ± 9% softirqs.CPU137.SCHED
60981 ± 3% -19.9% 48870 ± 9% softirqs.CPU138.SCHED
59854 ± 2% -19.1% 48422 ± 11% softirqs.CPU139.SCHED
57774 ± 2% -26.1% 42721 ± 17% softirqs.CPU14.SCHED
58735 -17.2% 48632 ± 9% softirqs.CPU141.SCHED
59851 ± 4% -18.5% 48759 ± 9% softirqs.CPU142.SCHED
66126 ± 7% -23.1% 50866 ± 13% softirqs.CPU146.SCHED
62345 ± 8% -19.2% 50372 ± 12% softirqs.CPU151.SCHED
62501 ± 9% -20.2% 49899 ± 11% softirqs.CPU152.SCHED
60570 ± 5% -16.2% 50745 ± 14% softirqs.CPU153.SCHED
59537 ± 2% -18.5% 48499 ± 8% softirqs.CPU154.SCHED
59666 ± 2% -16.2% 50028 ± 12% softirqs.CPU155.SCHED
60545 ± 5% -19.1% 48961 ± 13% softirqs.CPU156.SCHED
58663 ± 3% -18.1% 48070 ± 8% softirqs.CPU157.SCHED
59893 ± 3% -17.9% 49144 ± 10% softirqs.CPU158.SCHED
59929 ± 4% -17.5% 49446 ± 11% softirqs.CPU159.SCHED
59155 -18.4% 48256 ± 7% softirqs.CPU160.SCHED
60727 ± 5% -20.6% 48188 ± 8% softirqs.CPU161.SCHED
57790 ± 2% -16.4% 48335 ± 8% softirqs.CPU162.SCHED
59286 ± 3% -18.6% 48232 ± 8% softirqs.CPU163.SCHED
58797 -17.6% 48428 ± 8% softirqs.CPU164.SCHED
59930 ± 4% -19.0% 48559 ± 8% softirqs.CPU165.SCHED
58888 -17.3% 48700 ± 8% softirqs.CPU167.SCHED
77027 ± 5% -19.5% 62023 ± 16% softirqs.CPU168.SCHED
69417 ± 6% -18.9% 56276 ± 12% softirqs.CPU169.SCHED
70139 ± 11% -21.8% 54872 ± 5% softirqs.CPU170.SCHED
64570 ± 3% -20.9% 51073 ± 11% softirqs.CPU171.SCHED
65591 ± 4% -19.0% 53097 ± 10% softirqs.CPU172.SCHED
63484 ± 4% -12.8% 55385 ± 12% softirqs.CPU173.SCHED
60629 ± 3% -15.0% 51525 ± 12% softirqs.CPU177.SCHED
60405 -17.1% 50063 ± 9% softirqs.CPU178.SCHED
59113 ± 2% -15.1% 50186 ± 8% softirqs.CPU18.SCHED
58846 ± 2% -15.8% 49557 ± 8% softirqs.CPU181.SCHED
58867 ± 2% -13.9% 50698 ± 10% softirqs.CPU182.SCHED
60066 ± 3% -13.5% 51971 ± 8% softirqs.CPU184.SCHED
58973 ± 2% -22.6% 45644 ± 24% softirqs.CPU185.SCHED
58762 ± 2% -12.8% 51248 ± 7% softirqs.CPU188.SCHED
59175 ± 2% -15.8% 49823 ± 6% softirqs.CPU189.SCHED
59336 ± 2% -22.9% 45743 ± 24% softirqs.CPU190.SCHED
58917 ± 2% -13.6% 50883 ± 7% softirqs.CPU191.SCHED
59114 ± 2% -14.9% 50303 ± 8% softirqs.CPU20.SCHED
58712 ± 2% -15.3% 49754 ± 7% softirqs.CPU22.SCHED
59999 ± 4% -18.7% 48799 ± 9% softirqs.CPU24.SCHED
58032 ± 2% -22.0% 45244 ± 10% softirqs.CPU25.SCHED
57825 ± 2% -17.0% 47989 ± 10% softirqs.CPU26.SCHED
58219 -17.1% 48255 ± 9% softirqs.CPU27.SCHED
57958 ± 2% -16.5% 48367 ± 9% softirqs.CPU28.SCHED
58768 ± 3% -16.7% 48976 ± 8% softirqs.CPU3.SCHED
58040 -24.0% 44129 ± 24% softirqs.CPU30.SCHED
57645 ± 2% -16.8% 47981 ± 9% softirqs.CPU32.SCHED
57836 -16.3% 48389 ± 9% softirqs.CPU33.SCHED
57975 -16.5% 48382 ± 9% softirqs.CPU34.SCHED
57908 -16.3% 48442 ± 9% softirqs.CPU36.SCHED
60078 ± 6% -19.6% 48316 ± 9% softirqs.CPU39.SCHED
58984 -18.0% 48390 ± 9% softirqs.CPU40.SCHED
56996 ± 3% -25.4% 42542 ± 19% softirqs.CPU41.SCHED
60432 ± 7% -19.7% 48538 ± 9% softirqs.CPU42.SCHED
61060 ± 8% -18.4% 49836 ± 9% softirqs.CPU43.SCHED
57492 ± 3% -23.2% 44144 ± 25% softirqs.CPU44.SCHED
58400 ± 2% -17.2% 48333 ± 9% softirqs.CPU45.SCHED
58957 ± 3% -18.0% 48344 ± 9% softirqs.CPU46.SCHED
59463 -17.7% 48964 ± 9% softirqs.CPU48.SCHED
58176 ± 2% -17.7% 47885 ± 8% softirqs.CPU49.SCHED
60767 ± 7% -20.7% 48202 ± 10% softirqs.CPU5.SCHED
57839 -17.4% 47783 ± 8% softirqs.CPU50.SCHED
58706 ± 3% -18.2% 47997 ± 8% softirqs.CPU51.SCHED
57929 -17.6% 47759 ± 8% softirqs.CPU52.SCHED
57909 -17.3% 47916 ± 8% softirqs.CPU53.SCHED
57674 -16.7% 48070 ± 8% softirqs.CPU54.SCHED
57959 -14.8% 49383 ± 11% softirqs.CPU56.SCHED
57568 -16.9% 47826 ± 8% softirqs.CPU57.SCHED
57761 -17.2% 47807 ± 8% softirqs.CPU58.SCHED
57814 -17.7% 47557 ± 8% softirqs.CPU59.SCHED
57170 ± 2% -16.7% 47604 ± 8% softirqs.CPU60.SCHED
57451 -17.8% 47196 ± 7% softirqs.CPU61.SCHED
57542 -16.9% 47805 ± 8% softirqs.CPU62.SCHED
57648 -17.3% 47690 ± 8% softirqs.CPU63.SCHED
57940 -17.6% 47767 ± 8% softirqs.CPU64.SCHED
57925 -32.6% 39047 ± 44% softirqs.CPU66.SCHED
57610 -17.1% 47786 ± 8% softirqs.CPU67.SCHED
58526 -18.6% 47611 ± 8% softirqs.CPU68.SCHED
57903 -15.7% 48807 ± 10% softirqs.CPU69.SCHED
57141 ± 2% -18.7% 46443 ± 13% softirqs.CPU7.SCHED
57837 -15.9% 48620 ± 7% softirqs.CPU70.SCHED
57901 -17.9% 47553 ± 7% softirqs.CPU71.SCHED
58621 -18.3% 47888 ± 8% softirqs.CPU73.SCHED
58495 ± 2% -17.6% 48172 ± 8% softirqs.CPU74.SCHED
59006 -21.5% 46310 ± 7% softirqs.CPU75.SCHED
58563 ± 2% -18.5% 47757 ± 8% softirqs.CPU76.SCHED
58260 -17.5% 48091 ± 8% softirqs.CPU77.SCHED
58714 ± 2% -18.2% 48055 ± 8% softirqs.CPU78.SCHED
58140 ± 3% -15.1% 49367 ± 11% softirqs.CPU79.SCHED
58711 ± 2% -18.6% 47795 ± 8% softirqs.CPU80.SCHED
58511 -18.4% 47722 ± 8% softirqs.CPU81.SCHED
58419 -18.1% 47863 ± 8% softirqs.CPU82.SCHED
58668 -18.4% 47885 ± 8% softirqs.CPU83.SCHED
58243 -18.2% 47645 ± 7% softirqs.CPU84.SCHED
58203 -21.7% 45555 ± 9% softirqs.CPU85.SCHED
58406 -19.0% 47295 ± 9% softirqs.CPU86.SCHED
58205 ± 2% -17.9% 47766 ± 8% softirqs.CPU87.SCHED
58660 ± 3% -16.3% 49087 ± 6% softirqs.CPU88.SCHED
58138 -14.8% 49549 ± 7% softirqs.CPU90.SCHED
58215 ± 3% -15.6% 49150 ± 6% softirqs.CPU92.SCHED
58466 -17.4% 48299 ± 9% softirqs.CPU93.SCHED
59309 ± 2% -13.9% 51059 ± 7% softirqs.CPU94.SCHED
68316 ± 8% -33.7% 45277 ± 38% softirqs.CPU96.SCHED
65343 ± 5% -15.7% 55057 ± 11% softirqs.CPU97.SCHED
72275 ± 11% -24.3% 54696 ± 4% softirqs.CPU98.SCHED
64571 ± 4% -15.5% 54546 ± 13% softirqs.CPU99.SCHED
42872 ± 52% -65.1% 14946 ± 23% softirqs.NET_RX
11462487 -17.7% 9432298 ± 9% softirqs.SCHED
2.69 ± 8% -1.5 1.15 ± 50% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.f2fs_fsync_node_pages.f2fs_do_sync_file.do_fsync
2.70 ± 8% -1.5 1.16 ± 49% perf-profile.calltrace.cycles-pp.__pagevec_release.f2fs_fsync_node_pages.f2fs_do_sync_file.do_fsync.__x64_sys_fsync
2.27 ± 4% -0.6 1.70 ± 12% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
1.78 ± 2% -0.4 1.37 ± 13% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
1.79 ± 2% -0.4 1.39 ± 13% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.78 ± 2% -0.4 1.37 ± 14% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
1.82 ± 3% -0.4 1.45 ± 7% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
1.89 ± 6% -0.3 1.55 ± 4% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
2.29 ± 4% -0.3 2.01 ± 7% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.83 ± 5% -0.1 0.73 ± 8% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.87 ± 3% +0.4 1.22 ± 14% perf-profile.calltrace.cycles-pp.f2fs_new_inode.f2fs_create.path_openat.do_filp_open.do_sys_openat2
0.46 ± 58% +0.4 0.82 ± 12% perf-profile.calltrace.cycles-pp.__percpu_counter_sum.f2fs_space_for_roll_forward.f2fs_do_sync_file.do_fsync.__x64_sys_fsync
0.49 ± 58% +0.4 0.85 ± 11% perf-profile.calltrace.cycles-pp.f2fs_space_for_roll_forward.f2fs_do_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
2.09 ± 11% +0.6 2.67 ± 16% perf-profile.calltrace.cycles-pp.f2fs_add_dentry.f2fs_do_add_link.f2fs_create.path_openat.do_filp_open
2.09 ± 11% +0.6 2.67 ± 16% perf-profile.calltrace.cycles-pp.f2fs_add_regular_entry.f2fs_add_dentry.f2fs_do_add_link.f2fs_create.path_openat
0.13 ±173% +0.6 0.72 ± 19% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
0.69 ± 20% +0.6 1.31 ± 26% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit.f2fs_write_end_io
0.70 ± 20% +0.6 1.33 ± 26% perf-profile.calltrace.cycles-pp.wake_page_function.__wake_up_common.wake_up_page_bit.f2fs_write_end_io.blk_update_request
0.72 ± 20% +0.6 1.36 ± 26% perf-profile.calltrace.cycles-pp.__wake_up_common.wake_up_page_bit.f2fs_write_end_io.blk_update_request.blk_mq_end_request
2.16 ± 12% +0.6 2.79 ± 17% perf-profile.calltrace.cycles-pp.f2fs_do_add_link.f2fs_create.path_openat.do_filp_open.do_sys_openat2
0.76 ± 20% +0.6 1.40 ± 26% perf-profile.calltrace.cycles-pp.wake_up_page_bit.f2fs_write_end_io.blk_update_request.blk_mq_end_request.nvme_irq
0.16 ±173% +0.7 0.87 ± 20% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_page_function
0.17 ±173% +0.7 0.91 ± 19% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.wake_page_function.__wake_up_common.wake_up_page_bit
0.17 ±173% +0.7 0.91 ± 19% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.wake_page_function.__wake_up_common
1.40 ± 17% +0.9 2.25 ± 16% perf-profile.calltrace.cycles-pp.handle_edge_irq.asm_call_sysvec_on_stack.common_interrupt.asm_common_interrupt.cpuidle_enter_state
1.40 ± 17% +0.9 2.25 ± 17% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter
1.45 ± 16% +0.9 2.33 ± 16% perf-profile.calltrace.cycles-pp.common_interrupt.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
1.46 ± 16% +0.9 2.34 ± 16% perf-profile.calltrace.cycles-pp.asm_common_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
1.93 ± 9% +0.9 2.88 ± 15% perf-profile.calltrace.cycles-pp.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.asm_call_sysvec_on_stack.common_interrupt
1.00 ± 14% +1.0 2.00 ± 24% perf-profile.calltrace.cycles-pp.generic_perform_write.__generic_file_write_iter.f2fs_file_write_iter.new_sync_write.vfs_write
1.96 ± 9% +1.0 2.96 ± 15% perf-profile.calltrace.cycles-pp.handle_irq_event.handle_edge_irq.asm_call_sysvec_on_stack.common_interrupt.asm_common_interrupt
1.77 ± 6% +1.1 2.82 ± 15% perf-profile.calltrace.cycles-pp.nvme_irq.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq
1.78 ± 6% +1.1 2.84 ± 15% perf-profile.calltrace.cycles-pp.__handle_irq_event_percpu.handle_irq_event_percpu.handle_irq_event.handle_edge_irq.asm_call_sysvec_on_stack
1.15 ± 12% +1.1 2.21 ± 23% perf-profile.calltrace.cycles-pp.__generic_file_write_iter.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
3.99 ± 9% +1.2 5.15 ± 14% perf-profile.calltrace.cycles-pp.f2fs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.91 ± 10% +1.2 3.08 ± 19% perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
1.91 ± 10% +1.2 3.10 ± 19% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.56 ± 9% +1.2 3.77 ± 13% perf-profile.calltrace.cycles-pp.f2fs_find_target_dentry.__f2fs_find_entry.f2fs_lookup.path_openat.do_filp_open
1.95 ± 10% +1.2 3.16 ± 19% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.96 ± 10% +1.2 3.19 ± 19% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.52 ± 8% +1.4 4.89 ± 12% perf-profile.calltrace.cycles-pp.__f2fs_find_entry.f2fs_lookup.path_openat.do_filp_open.do_sys_openat2
3.64 ± 8% +1.5 5.12 ± 12% perf-profile.calltrace.cycles-pp.f2fs_lookup.path_openat.do_filp_open.do_sys_openat2.do_sys_open
2.17 ± 8% +1.8 4.00 ± 36% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
8.40 ± 7% +3.1 11.46 ± 13% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
8.41 ± 7% +3.1 11.48 ± 13% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.48 ± 7% +3.1 11.59 ± 13% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.49 ± 7% +3.1 11.60 ± 13% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.72 ± 8% -1.5 1.22 ± 46% perf-profile.children.cycles-pp.release_pages
2.87 ± 8% -1.3 1.54 ± 31% perf-profile.children.cycles-pp.__pagevec_release
2.54 ± 3% -0.5 2.00 ± 7% perf-profile.children.cycles-pp.irq_exit_rcu
2.03 ± 2% -0.4 1.63 ± 8% perf-profile.children.cycles-pp.do_softirq_own_stack
2.02 ± 2% -0.4 1.65 ± 8% perf-profile.children.cycles-pp.__softirqentry_text_start
2.40 ± 4% -0.3 2.11 ± 6% perf-profile.children.cycles-pp.tick_sched_timer
1.92 ± 3% -0.3 1.66 ± 7% perf-profile.children.cycles-pp.update_process_times
0.40 -0.2 0.18 ± 49% perf-profile.children.cycles-pp.rwsem_optimistic_spin
0.40 ± 13% -0.2 0.24 ± 37% perf-profile.children.cycles-pp.__mutex_lock
0.26 ± 19% -0.2 0.11 ± 54% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.24 ± 4% -0.1 0.11 ± 39% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
0.26 ± 6% -0.1 0.15 ± 31% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.21 ± 6% -0.1 0.10 ± 55% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
0.28 ± 15% -0.1 0.17 ± 14% perf-profile.children.cycles-pp.start_kernel
0.31 ± 9% -0.1 0.22 ± 21% perf-profile.children.cycles-pp.f2fs_get_read_data_page
0.24 ± 10% -0.1 0.18 ± 17% perf-profile.children.cycles-pp.f2fs_get_node_info
0.10 ± 28% -0.0 0.07 ± 39% perf-profile.children.cycles-pp.f2fs_inode_chksum_verify
0.07 ± 10% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.f2fs_lookup_extent_cache
0.10 ± 15% +0.0 0.12 ± 10% perf-profile.children.cycles-pp.rq_qos_wait
0.11 ± 17% +0.0 0.14 ± 12% perf-profile.children.cycles-pp.wbt_wait
0.04 ± 63% +0.0 0.08 ± 10% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.11 ± 17% +0.0 0.15 ± 15% perf-profile.children.cycles-pp.__rq_qos_throttle
0.06 ± 14% +0.0 0.10 ± 23% perf-profile.children.cycles-pp.free_unref_page_list
0.09 ± 7% +0.0 0.13 ± 16% perf-profile.children.cycles-pp.__might_sleep
0.14 ± 13% +0.0 0.18 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid
0.06 ± 11% +0.0 0.10 ± 17% perf-profile.children.cycles-pp.__switch_to
0.18 ± 11% +0.0 0.23 ± 9% perf-profile.children.cycles-pp.dequeue_entity
0.28 ± 8% +0.0 0.33 ± 9% perf-profile.children.cycles-pp.test_clear_page_writeback
0.05 ± 57% +0.0 0.10 ± 17% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.08 ± 19% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.mark_page_accessed
0.23 ± 5% +0.1 0.28 ± 7% perf-profile.children.cycles-pp.f2fs_getxattr
0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.try_charge
0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__might_fault
0.11 ± 22% +0.1 0.16 ± 18% perf-profile.children.cycles-pp.update_load_avg
0.28 ± 8% +0.1 0.34 ± 9% perf-profile.children.cycles-pp.end_page_writeback
0.07 ± 28% +0.1 0.13 ± 21% perf-profile.children.cycles-pp.set_next_entity
0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.__get_user_nocheck_1
0.08 ± 15% +0.1 0.14 ± 21% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.13 ± 3% +0.1 0.19 ± 16% perf-profile.children.cycles-pp.security_inode_need_killpriv
0.07 ± 22% +0.1 0.14 ± 24% perf-profile.children.cycles-pp.__irqentry_text_start
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.inode_permission
0.13 ± 3% +0.1 0.19 ± 16% perf-profile.children.cycles-pp.dentry_needs_remove_privs
0.03 ±100% +0.1 0.09 ± 19% perf-profile.children.cycles-pp.__switch_to_asm
0.01 ±173% +0.1 0.08 ± 19% perf-profile.children.cycles-pp.iov_iter_fault_in_readable
0.05 ± 9% +0.1 0.12 ± 28% perf-profile.children.cycles-pp.ktime_get_real_ts64
0.20 ± 11% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.dequeue_task_fair
0.05 ± 8% +0.1 0.12 ± 21% perf-profile.children.cycles-pp.memset_erms
0.06 ± 60% +0.1 0.12 ± 12% perf-profile.children.cycles-pp.f2fs_prepare_lookup
0.08 ± 13% +0.1 0.15 ± 25% perf-profile.children.cycles-pp.insert_inode_locked
0.13 ± 6% +0.1 0.20 ± 16% perf-profile.children.cycles-pp.file_remove_privs
0.06 ± 15% +0.1 0.13 ± 24% perf-profile.children.cycles-pp.blk_mq_try_issue_directly
0.15 ± 21% +0.1 0.23 ± 15% perf-profile.children.cycles-pp.dput
0.03 ±100% +0.1 0.10 ± 27% perf-profile.children.cycles-pp.list_lru_add
0.00 +0.1 0.07 ± 38% perf-profile.children.cycles-pp.grab_cache_page_write_begin
0.09 ± 13% +0.1 0.17 ± 19% perf-profile.children.cycles-pp.d_lookup
0.09 ± 13% +0.1 0.17 ± 20% perf-profile.children.cycles-pp.__d_lookup
0.17 ± 11% +0.1 0.26 ± 16% perf-profile.children.cycles-pp.__fput
0.07 ± 14% +0.1 0.16 ± 22% perf-profile.children.cycles-pp.submit_bio_checks
0.13 ± 14% +0.1 0.22 ± 18% perf-profile.children.cycles-pp.link_path_walk
0.46 ± 10% +0.1 0.55 ± 7% perf-profile.children.cycles-pp.read_tsc
0.10 ± 17% +0.1 0.19 ± 19% perf-profile.children.cycles-pp.xas_alloc
0.00 +0.1 0.10 ± 16% perf-profile.children.cycles-pp.f2fs_lookup_rb_tree
0.20 ± 9% +0.1 0.30 ± 16% perf-profile.children.cycles-pp.task_work_run
0.16 ± 23% +0.1 0.26 ± 20% perf-profile.children.cycles-pp.pick_next_task_fair
0.11 ± 23% +0.1 0.22 ± 20% perf-profile.children.cycles-pp.f2fs_hash_filename
0.12 ± 23% +0.1 0.23 ± 21% perf-profile.children.cycles-pp.__f2fs_setup_filename
0.24 ± 7% +0.1 0.36 ± 14% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.18 ± 16% +0.1 0.30 ± 22% perf-profile.children.cycles-pp.up_write
0.12 ± 13% +0.1 0.25 ± 22% perf-profile.children.cycles-pp.xas_create
0.17 ± 10% +0.1 0.29 ± 20% perf-profile.children.cycles-pp.xas_store
0.46 ± 5% +0.1 0.59 ± 13% perf-profile.children.cycles-pp.xas_load
0.26 ± 7% +0.1 0.40 ± 16% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.14 ± 8% +0.1 0.28 ± 26% perf-profile.children.cycles-pp.f2fs_reserve_block
0.17 ± 12% +0.1 0.31 ± 21% perf-profile.children.cycles-pp.__x64_sys_gettimeofday
0.37 ± 14% +0.2 0.52 ± 10% perf-profile.children.cycles-pp.__filemap_fdatawait_range
0.14 ± 20% +0.2 0.29 ± 23% perf-profile.children.cycles-pp.d_alloc
0.15 ± 16% +0.2 0.31 ± 24% perf-profile.children.cycles-pp.d_alloc_parallel
0.15 ± 16% +0.2 0.31 ± 32% perf-profile.children.cycles-pp.pagevec_lru_move_fn
0.10 ± 17% +0.2 0.26 ± 28% perf-profile.children.cycles-pp.allocate_slab
0.16 ± 16% +0.2 0.32 ± 31% perf-profile.children.cycles-pp.lru_add_drain_cpu
0.11 ± 17% +0.2 0.27 ± 29% perf-profile.children.cycles-pp.__slab_alloc
0.11 ± 17% +0.2 0.27 ± 28% perf-profile.children.cycles-pp.___slab_alloc
0.17 ± 17% +0.2 0.34 ± 32% perf-profile.children.cycles-pp.lru_add_drain
1.13 ± 9% +0.2 1.31 ± 6% perf-profile.children.cycles-pp.__submit_merged_write_cond
0.48 ± 12% +0.2 0.67 ± 13% perf-profile.children.cycles-pp.schedule
0.17 ± 13% +0.2 0.37 ± 28% perf-profile.children.cycles-pp.f2fs_get_new_data_page
0.55 ± 8% +0.2 0.75 ± 9% perf-profile.children.cycles-pp.wait_on_page_bit
0.41 ± 12% +0.2 0.60 ± 12% perf-profile.children.cycles-pp.io_schedule
0.13 ± 9% +0.2 0.33 ± 43% perf-profile.children.cycles-pp.get_page_from_freelist
0.44 ± 9% +0.2 0.64 ± 17% perf-profile.children.cycles-pp.add_to_page_cache_lru
0.24 ± 9% +0.2 0.45 ± 22% perf-profile.children.cycles-pp.f2fs_alloc_inode
0.40 ± 8% +0.2 0.61 ± 17% perf-profile.children.cycles-pp.__add_to_page_cache_locked
0.28 ± 8% +0.2 0.49 ± 22% perf-profile.children.cycles-pp.new_inode_pseudo
0.27 ± 8% +0.2 0.48 ± 23% perf-profile.children.cycles-pp.alloc_inode
0.29 ± 11% +0.2 0.52 ± 18% perf-profile.children.cycles-pp.blk_mq_submit_bio
0.31 ± 5% +0.2 0.53 ± 20% perf-profile.children.cycles-pp.new_inode
0.16 ± 9% +0.2 0.39 ± 43% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.59 ± 14% +0.2 0.83 ± 12% perf-profile.children.cycles-pp.__percpu_counter_sum
0.61 ± 13% +0.2 0.85 ± 11% perf-profile.children.cycles-pp.f2fs_space_for_roll_forward
0.27 ± 10% +0.3 0.52 ± 24% perf-profile.children.cycles-pp.f2fs_write_begin
0.36 ± 17% +0.3 0.61 ± 21% perf-profile.children.cycles-pp.f2fs_write_end
0.72 ± 13% +0.3 1.01 ± 14% perf-profile.children.cycles-pp.__schedule
0.39 ± 7% +0.3 0.72 ± 18% perf-profile.children.cycles-pp.__submit_merged_bio
0.40 ± 10% +0.3 0.73 ± 18% perf-profile.children.cycles-pp.submit_bio
0.39 ± 10% +0.3 0.72 ± 19% perf-profile.children.cycles-pp.submit_bio_noacct
0.87 ± 3% +0.4 1.22 ± 14% perf-profile.children.cycles-pp.f2fs_new_inode
0.56 ± 6% +0.4 0.99 ± 21% perf-profile.children.cycles-pp.kmem_cache_alloc
0.31 ± 17% +0.4 0.75 ± 28% perf-profile.children.cycles-pp.copyin
0.31 ± 17% +0.4 0.75 ± 28% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.32 ± 17% +0.4 0.76 ± 28% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic
2.09 ± 11% +0.6 2.67 ± 16% perf-profile.children.cycles-pp.f2fs_add_dentry
2.09 ± 11% +0.6 2.67 ± 16% perf-profile.children.cycles-pp.f2fs_add_regular_entry
1.12 ± 11% +0.6 1.71 ± 18% perf-profile.children.cycles-pp.try_to_wake_up
1.05 ± 11% +0.6 1.65 ± 17% perf-profile.children.cycles-pp.wake_page_function
1.12 ± 10% +0.6 1.72 ± 17% perf-profile.children.cycles-pp.__wake_up_common
1.13 ± 10% +0.6 1.73 ± 17% perf-profile.children.cycles-pp.wake_up_page_bit
2.16 ± 12% +0.6 2.79 ± 17% perf-profile.children.cycles-pp.f2fs_do_add_link
1.69 ± 7% +0.7 2.37 ± 14% perf-profile.children.cycles-pp.f2fs_write_end_io
1.76 ± 8% +0.7 2.48 ± 15% perf-profile.children.cycles-pp.blk_update_request
1.79 ± 8% +0.8 2.58 ± 15% perf-profile.children.cycles-pp.blk_mq_end_request
1.69 ± 6% +0.8 2.50 ± 18% perf-profile.children.cycles-pp.pagecache_get_page
1.98 ± 9% +0.9 2.88 ± 15% perf-profile.children.cycles-pp.nvme_irq
1.99 ± 9% +0.9 2.90 ± 15% perf-profile.children.cycles-pp.__handle_irq_event_percpu
2.03 ± 9% +0.9 2.95 ± 15% perf-profile.children.cycles-pp.handle_irq_event_percpu
2.06 ± 9% +1.0 3.03 ± 16% perf-profile.children.cycles-pp.handle_irq_event
1.00 ± 13% +1.0 2.01 ± 24% perf-profile.children.cycles-pp.generic_perform_write
2.10 ± 9% +1.0 3.11 ± 16% perf-profile.children.cycles-pp.handle_edge_irq
2.18 ± 8% +1.1 3.24 ± 16% perf-profile.children.cycles-pp.common_interrupt
1.16 ± 12% +1.1 2.23 ± 23% perf-profile.children.cycles-pp.__generic_file_write_iter
2.19 ± 8% +1.1 3.26 ± 16% perf-profile.children.cycles-pp.asm_common_interrupt
3.99 ± 9% +1.2 5.16 ± 14% perf-profile.children.cycles-pp.f2fs_create
1.91 ± 10% +1.2 3.08 ± 19% perf-profile.children.cycles-pp.f2fs_file_write_iter
1.93 ± 10% +1.2 3.12 ± 19% perf-profile.children.cycles-pp.new_sync_write
2.57 ± 9% +1.2 3.77 ± 13% perf-profile.children.cycles-pp.f2fs_find_target_dentry
1.97 ± 10% +1.2 3.19 ± 19% perf-profile.children.cycles-pp.vfs_write
1.97 ± 10% +1.2 3.22 ± 19% perf-profile.children.cycles-pp.ksys_write
3.53 ± 8% +1.4 4.90 ± 12% perf-profile.children.cycles-pp.__f2fs_find_entry
3.64 ± 8% +1.5 5.12 ± 12% perf-profile.children.cycles-pp.f2fs_lookup
2.19 ± 9% +1.9 4.08 ± 37% perf-profile.children.cycles-pp.poll_idle
8.41 ± 7% +3.1 11.48 ± 12% perf-profile.children.cycles-pp.do_filp_open
8.41 ± 7% +3.1 11.48 ± 13% perf-profile.children.cycles-pp.path_openat
8.49 ± 7% +3.1 11.59 ± 13% perf-profile.children.cycles-pp.do_sys_openat2
8.50 ± 7% +3.1 11.61 ± 13% perf-profile.children.cycles-pp.do_sys_open
2.63 ± 8% -1.5 1.10 ± 51% perf-profile.self.cycles-pp.release_pages
0.67 ± 11% -0.1 0.53 ± 14% perf-profile.self.cycles-pp.down_read
0.24 ± 10% -0.1 0.11 ± 51% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.26 ± 7% -0.1 0.15 ± 31% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.09 ± 20% -0.1 0.03 ±102% perf-profile.self.cycles-pp.f2fs_balance_fs_bg
0.13 ± 15% -0.0 0.09 ± 29% perf-profile.self.cycles-pp.f2fs_allocate_data_block
0.13 ± 21% -0.0 0.09 ± 24% perf-profile.self.cycles-pp.f2fs_balance_fs
0.06 ± 22% +0.0 0.08 ± 12% perf-profile.self.cycles-pp.wait_on_page_bit
0.04 ± 59% +0.0 0.08 ± 10% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.14 ± 13% +0.0 0.18 ± 9% perf-profile.self.cycles-pp.__list_del_entry_valid
0.06 ± 7% +0.0 0.10 ± 15% perf-profile.self.cycles-pp.__switch_to
0.06 ± 15% +0.0 0.10 ± 23% perf-profile.self.cycles-pp.free_unref_page_list
0.16 ± 11% +0.1 0.21 ± 11% perf-profile.self.cycles-pp.unwind_next_frame
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.path_openat
0.01 ±173% +0.1 0.07 ± 21% perf-profile.self.cycles-pp.update_load_avg
0.01 ±173% +0.1 0.07 ± 21% perf-profile.self.cycles-pp.read_node_page
0.07 ± 28% +0.1 0.12 ± 40% perf-profile.self.cycles-pp.nvme_irq
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.enqueue_task_fair
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.mark_page_accessed
0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.__get_user_nocheck_1
0.08 ± 15% +0.1 0.14 ± 21% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.05 ± 8% +0.1 0.12 ± 18% perf-profile.self.cycles-pp.memset_erms
0.03 ±100% +0.1 0.09 ± 19% perf-profile.self.cycles-pp.__switch_to_asm
0.14 ± 8% +0.1 0.21 ± 24% perf-profile.self.cycles-pp.___might_sleep
0.08 ± 15% +0.1 0.16 ± 22% perf-profile.self.cycles-pp.__d_lookup
0.45 ± 10% +0.1 0.54 ± 8% perf-profile.self.cycles-pp.read_tsc
0.04 ± 57% +0.1 0.14 ± 26% perf-profile.self.cycles-pp.allocate_slab
0.00 +0.1 0.10 ± 16% perf-profile.self.cycles-pp.f2fs_lookup_rb_tree
0.11 ± 23% +0.1 0.22 ± 20% perf-profile.self.cycles-pp.f2fs_hash_filename
0.01 ±173% +0.1 0.12 ± 31% perf-profile.self.cycles-pp.insert_inode_locked
0.39 ± 6% +0.1 0.51 ± 13% perf-profile.self.cycles-pp.xas_load
0.18 ± 16% +0.1 0.29 ± 22% perf-profile.self.cycles-pp.up_write
0.23 ± 6% +0.1 0.36 ± 21% perf-profile.self.cycles-pp.kmem_cache_alloc
0.33 ± 15% +0.2 0.49 ± 12% perf-profile.self.cycles-pp.__percpu_counter_sum
0.31 ± 14% +0.2 0.49 ± 17% perf-profile.self.cycles-pp.f2fs_create
0.11 ± 11% +0.2 0.35 ± 28% perf-profile.self.cycles-pp.f2fs_write_end
0.21 ± 9% +0.3 0.52 ± 31% perf-profile.self.cycles-pp.f2fs_new_node_page
0.29 ± 10% +0.5 0.74 ± 28% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
2.54 ± 9% +1.2 3.74 ± 13% perf-profile.self.cycles-pp.f2fs_find_target_dentry
1.43 ± 15% +1.3 2.73 ± 32% perf-profile.self.cycles-pp.poll_idle
fsmark.files_per_sec
40000 +-------------------------------------------------------------------+
| O |
35000 |-+ O O OO O O O OO O O O O O |
30000 |-O O O O OO O O O |
| O O |
25000 |.++.++.++.+.++.+ +. +. +.++.+.++. +.+.+ +.++.+. .++.+.++.++.++.|
| : : + + + +.+ ++ |
20000 |-+ : : |
| : : |
15000 |-+ : : |
10000 |-+ :: |
| :: |
5000 |-+ : |
| : |
0 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 7 months
[block] c9ede9e8fd: BUG:sleeping_function_called_from_invalid_context_at_include/linux/writeback.h
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: c9ede9e8fd530a6ce7abb581241d6f5fb08632b6 ("block: reference struct block_device from struct hd_struct")
git://git.infradead.org/users/hch/block.git bdev-lookup
in testcase: trinity
version: trinity-x86_64-af355e9-1_2019-12-03
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+--------------------------------------------------------------------------------+------------+------------+
| | c9ff0b66a3 | c9ede9e8fd |
+--------------------------------------------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 0 | 4 |
| BUG:sleeping_function_called_from_invalid_context_at_include/linux/writeback.h | 0 | 4 |
+--------------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 12.738911] BUG: sleeping function called from invalid context at include/linux/writeback.h:205
[ 12.740898] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 129, name: systemd-udevd
[ 12.742714] CPU: 1 PID: 129 Comm: systemd-udevd Not tainted 5.10.0-rc4-00077-gc9ede9e8fd53 #1
[ 12.744600] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 12.746435] Call Trace:
[ 12.747098] dump_stack+0x57/0x6a
[ 12.747895] ___might_sleep.cold+0x87/0x95
[ 12.748902] ilookup+0x93/0x110
[ 12.749711] blkdev_get_by_dev+0x3b/0x380
[ 12.750764] ? blkdev_get_by_dev+0x380/0x380
[ 12.751729] blkdev_open+0x47/0x80
[ 12.752523] do_dentry_open+0x146/0x350
[ 12.755750] path_openat+0xc07/0x1000
[ 12.756674] do_filp_open+0x8c/0x100
[ 12.757556] ? handle_mm_fault+0x62b/0x8a0
[ 12.758540] do_sys_openat2+0x208/0x2d0
[ 12.759430] do_sys_open+0x3f/0x80
[ 12.760259] do_syscall_64+0x33/0x40
[ 12.761126] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 12.762226] RIP: 0033:0x7fb80f575e80
[ 12.763092] Code: 73 01 c3 48 8b 0d 28 81 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 69 c5 20 00 00 75 10 b8 02 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 4e f5 ff ff 48 89 04 24
[ 12.766715] RSP: 002b:00007fff253c1628 EFLAGS: 00000246 ORIG_RAX: 0000000000000002
[ 12.768398] RAX: ffffffffffffffda RBX: 000055bd58b408a0 RCX: 00007fb80f575e80
[ 12.770000] RDX: 000055bd58b407d0 RSI: 00000000000a0800 RDI: 000055bd58b407d0
[ 12.771606] RBP: 0000000000000000 R08: 000000000000553e R09: 000000000000000c
[ 12.773049] R10: 00007fff253f4000 R11: 0000000000000246 R12: 000055bd58b47ec0
[ 12.774537] R13: 000055bd58b3a010 R14: 000055bd58b41620 R15: 000000000000000c
[ 12.936484] Kernel tests: Boot OK!
[ 12.936490]
[ 12.945301] /lkp/lkp/src/bin/run-lkp
[ 12.945306]
[ 13.044952]
[ 13.060677] job=/lkp/jobs/scheduled/vm-snb-99/trinity-300s-aliyun-x86_64-20190626.cgz-c9ede9e8fd530a6ce7abb581241d6f5fb08632b6-20201125-3191-nf9vpp-3.yaml
[ 13.060683]
[ 13.141624] result_service: raw_upload, RESULT_MNT: /internal-lkp-server/result, RESULT_ROOT: /internal-lkp-server/result/trinity/300s/vm-snb/aliyun-x86_64-20190626.cgz/x86_64-defconfig/gcc-9/c9ede9e8fd530a6ce7abb581241d6f5fb08632b6/3, TMP_RESULT_ROOT: /tmp/lkp/result
[ 13.141631]
[ 13.164251] run-job /lkp/jobs/scheduled/vm-snb-99/trinity-300s-aliyun-x86_64-20190626.cgz-c9ede9e8fd530a6ce7abb581241d6f5fb08632b6-20201125-3191-nf9vpp-3.yaml
[ 13.164256]
[ 13.219289] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/cgi-bin/lkp-jobfile-append-var?job_fil... -O /dev/null
[ 13.219295]
[ 13.541983] random: crng init done
[ 13.543285] random: 7 urandom warning(s) missed due to ratelimiting
[ 13.576180] process 'local/aegis/aegis_update/AliYunDunUpdate' started with executable stack
[ 14.418353] target ucode:
[ 14.418358]
[ 15.528412] Seeding trinity based on x86_64-defconfig
[ 15.528418]
[ 15.554222] 2020-11-24 20:36:25 chroot --userspec nobody:nogroup / trinity -q -q -l off -s 4288083551 -x get_robust_list -x remap_file_pages -N 999999999
[ 15.554228]
[ 15.580979] Trinity 2019.06 Dave Jones <davej(a)codemonkey.org.uk>
[ 15.580985]
[ 15.586267] shm:0x7f3952007000-0x7f395ec03d00 (4 pages)
[ 15.586271]
[ 15.592377] [main] Marking syscall get_robust_list (64bit:274 32bit:312) as to be disabled.
[ 15.592382]
[ 15.599700] [main] Marking syscall remap_file_pages (64bit:216 32bit:257) as to be disabled.
[ 15.599705]
[ 15.605076] [main] Couldn't chmod tmp/ to 0777.
[ 15.605080]
[ 15.611861] [main] Using user passed random seed: 4288083551.
[ 15.611878]
[ 15.618219] [main] Kernel was tainted on startup. Will ignore flags that are already set.
[ 15.618224]
[ 15.623728] Marking all syscalls as enabled.
[ 15.623733]
[ 15.629315] [main] Disabling syscalls marked as disabled by command line options
[ 15.629320]
[ 15.636071] [main] Marked 64-bit syscall remap_file_pages (216) as deactivated.
[ 15.636075]
[ 15.644456] [main] Marked 64-bit syscall get_robust_list (274) as deactivated.
[ 15.644462]
[ 15.651169] [main] Marked 32-bit syscall remap_file_pages (257) as deactivated.
[ 15.651174]
[ 15.657823] [main] Marked 32-bit syscall get_robust_list (312) as deactivated.
[ 15.657829]
[ 15.667103] [main] 32-bit syscalls: 426 enabled, 3 disabled. 64-bit syscalls: 345 enabled, 91 disabled.
[ 15.667107]
[ 15.672843] [main] Using pid_max = 32768
[ 15.672848]
[ 15.676459] [main] futex: 0 owner:0
[ 15.676463]
[ 15.679892] [main] futex: 0 owner:0
[ 15.679895]
[ 15.683297] [main] futex: 0 owner:0
[ 15.683301]
[ 15.686715] [main] futex: 0 owner:0
[ 15.686719]
[ 15.690132] [main] futex: 0 owner:0
[ 15.690136]
[ 15.693552] [main] futex: 0 owner:0
[ 15.693555]
[ 15.696954] [main] futex: 0 owner:0
[ 15.696957]
[ 15.700290] [main] futex: 0 owner:0
[ 15.700293]
[ 15.703697] [main] futex: 0 owner:0
[ 15.703701]
[ 15.707181] [main] futex: 0 owner:0
[ 15.707184]
[ 15.711416] [main] Reserved/initialized 10 futexes.
[ 15.711421]
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc4-00077-gc9ede9e8fd53 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 7 months