[btrfs] 77f797eb85: WARNING:at_fs/btrfs/extent-tree.c:#btrfs_free_reserved_data_space_noquota[btrfs]
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 77f797eb8584e667eb32b5b7fbd39d8788938612 ("btrfs: Add a simple buffered iomap write")
https://github.com/goldwynr/linux btrfs-iomap
in testcase: xfstests
with following parameters:
disk: 4HDD
fs: btrfs
test: generic-group8
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 2G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------------------------------+------------+------------+
| | bf4c71f78d | 77f797eb85 |
+----------------------------------------------------------------------------------+------------+------------+
| boot_successes | 33 | 3 |
| boot_failures | 82 | 110 |
| invoked_oom-killer:gfp_mask=0x | 2 | |
| Mem-Info | 2 | |
| BUG:kernel_reboot-without-warning_in_test_stage | 76 | 12 |
| BUG:kernel_hang_in_boot_stage | 4 | 10 |
| WARNING:at_fs/btrfs/extent-tree.c:#btrfs_free_reserved_data_space_noquota[btrfs] | 0 | 38 |
| RIP:btrfs_free_reserved_data_space_noquota[btrfs] | 0 | 38 |
| WARNING:at_fs/btrfs/inode.c:#btrfs_destroy_inode[btrfs] | 0 | 64 |
| RIP:btrfs_destroy_inode[btrfs] | 0 | 64 |
| WARNING:at_fs/btrfs/extent-tree.c:#btrfs_free_block_groups[btrfs] | 0 | 53 |
| RIP:btrfs_free_block_groups[btrfs] | 0 | 53 |
| kernel_BUG_at_fs/iomap.c | 0 | 44 |
| invalid_opcode:#[##] | 0 | 44 |
| RIP:iomap_write_begin | 0 | 44 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 44 |
| WARNING:at_fs/btrfs/extent-tree.c:#update_bytes_may_use[btrfs] | 0 | 36 |
| RIP:update_bytes_may_use[btrfs] | 0 | 36 |
| BUG:kernel_hang_in_test_stage | 0 | 2 |
| BUG:soft_lockup-CPU##stuck_for#s | 0 | 1 |
| RIP:__memcpy | 0 | 1 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 1 |
+----------------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 36.938978] WARNING: CPU: 0 PID: 1946 at fs/btrfs/extent-tree.c:69 btrfs_free_reserved_data_space_noquota+0xf7/0x110 [btrfs]
[ 36.944910] Modules linked in: btrfs xor zstd_decompress zstd_compress raid6_pq libcrc32c dm_mod crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sr_mod cdrom sg ata_generic pata_acpi ppdev bochs_drm ttm snd_pcm aesni_intel snd_timer snd drm_kms_helper crypto_simd cryptd glue_helper joydev soundcore ata_piix pcspkr syscopyarea serio_raw sysfillrect libata sysimgblt fb_sys_fops i2c_piix4 drm parport_pc floppy parport ip_tables
[ 36.960760] CPU: 0 PID: 1946 Comm: rm Not tainted 5.2.0-rc4-00004-g77f797e #1
[ 36.964087] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 36.967740] RIP: 0010:btrfs_free_reserved_data_space_noquota+0xf7/0x110 [btrfs]
[ 36.971102] Code: ee e8 9d da bb c4 49 8b 04 24 48 85 c0 75 da 65 ff 0d a5 39 9d 3f e9 79 ff ff ff 48 89 c1 48 f7 d9 48 39 ca 0f 83 5e ff ff ff <0f> 0b 48 c7 43 28 00 00 00 00 e9 56 ff ff ff 66 2e 0f 1f 84 00 00
[ 36.978983] RSP: 0018:ffffb0f10316bcd8 EFLAGS: 00010287
[ 36.981856] RAX: fffffffffffff000 RBX: ffff8ff0cf4f7400 RCX: 0000000000001000
[ 36.985231] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8ff0cf4f7400
[ 36.988659] RBP: 0000000000000fff R08: 0000000000004000 R09: ffff8ff0fc6a0000
[ 36.994422] R10: ffff8ff0d04a9000 R11: 0000000000000001 R12: ffff8ff0eb0f9e60
[ 36.997846] R13: ffff8ff0fc6a0000 R14: ffff8ff0d04a9000 R15: ffffb0f10316bdd4
[ 37.001278] FS: 00007faf9844c480(0000) GS:ffff8ff0eb000000(0000) knlGS:0000000000000000
[ 37.004933] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.007912] CR2: 0000555b176921f8 CR3: 000000005b266000 CR4: 00000000000406f0
[ 37.011332] Call Trace:
[ 37.013405] btrfs_clear_delalloc_extent+0x1a1/0x420 [btrfs]
[ 37.016327] ? _cond_resched+0x19/0x30
[ 37.018764] clear_state_bit+0x75/0x1b0 [btrfs]
[ 37.021409] __clear_extent_bit+0x222/0x440 [btrfs]
[ 37.024117] ? _cond_resched+0x19/0x30
[ 37.026529] clear_extent_bit+0x15/0x20 [btrfs]
[ 37.029122] btrfs_evict_inode+0x152/0x4c0 [btrfs]
[ 37.031692] evict+0xd9/0x1b0
[ 37.033758] do_unlinkat+0x1ab/0x320
[ 37.035979] do_syscall_64+0x5b/0x1e0
[ 37.038263] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 37.040914] RIP: 0033:0x7faf97f6e117
[ 37.043118] Code: 73 01 c3 48 8b 0d 81 bd 2b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 07 01 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 51 bd 2b 00 f7 d8 64 89 01 48
[ 37.051009] RSP: 002b:00007ffd09883228 EFLAGS: 00000206 ORIG_RAX: 0000000000000107
[ 37.054494] RAX: ffffffffffffffda RBX: 0000555b17692320 RCX: 00007faf97f6e117
[ 37.057846] RDX: 0000000000000000 RSI: 0000555b176910f0 RDI: 00000000ffffff9c
[ 37.061279] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[ 37.064611] R10: 000000000000015d R11: 0000000000000206 R12: 0000555b17691060
[ 37.068040] R13: 00007ffd09883360 R14: 0000555b17692320 R15: 0000000000000000
[ 37.071513] ---[ end trace 35d42372724e81c8 ]---
To reproduce:
# build kernel
cd linux
cp config-5.2.0-rc4-00004-g77f797e .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 modules_prepare
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 SHELL=/bin/bash
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
11 months, 3 weeks
- 1
- 0
890dec2e16 [ 63.809244] BUG: unable to handle page fault for address: ffff4155
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/brauner/linux.git pidfd_wait
commit 890dec2e168dd245f4940d59610643aeda296089
Author: Christian Brauner <christian(a)brauner.io>
AuthorDate: Thu Jun 6 15:40:14 2019 +0200
Commit: Christian Brauner <christian(a)brauner.io>
CommitDate: Fri Jun 14 16:37:08 2019 +0200
pidfd: support waiting on processes through pidfds
Make it possible to wait on processes through pidfds.
The pidfd api already allows to retrieve pidfds at process creation
time, sending signals via pidfds, and retrieving pidfds for processes
that were created through pid-based syscalls.
One of the remaining bits is to make it possible to wait on processes
through pidfds. This allows users to only keep track of processes via
pidfds without resorting to pids at all.
To this end, a new flag WPIDFD is introduced. When this flag is
specified in the options argument of the waitpid(), wait4(), or waitid()
syscalls the argument used to identify the process will be interpreted
as a pidfd instead of a pid.
Signed-off-by: Christian Brauner <christian(a)brauner.io>
Cc: Arnd Bergmann <arnd(a)arndb.de>
Cc: "Eric W. Biederman" <ebiederm(a)xmission.com>
Cc: Kees Cook <keescook(a)chromium.org>
Cc: Joel Fernandes (Google) <joel(a)joelfernandes.org>
Cc: Thomas Gleixner <tglx(a)linutronix.de>
Cc: Jann Horn <jannh(a)google.com>
Cc: David Howells <dhowells(a)redhat.com>
Cc: Andy Lutomirsky <luto(a)kernel.org>
Cc: Andrew Morton <akpm(a)linux-foundation.org>
Cc: Oleg Nesterov <oleg(a)redhat.com>
Cc: Aleksa Sarai <cyphar(a)cyphar.com>
Cc: Linus Torvalds <torvalds(a)linux-foundation.org>
Cc: Al Viro <viro(a)zeniv.linux.org.uk>
Cc: linux-api(a)vger.kernel.org
f2c7c76c5d Linux 5.2-rc3
890dec2e16 pidfd: support waiting on processes through pidfds
+----------------------------------------------------------------------------------+----------+------------+
| | v5.2-rc3 | 890dec2e16 |
+----------------------------------------------------------------------------------+----------+------------+
| boot_successes | 344 | 97 |
| boot_failures | 16 | 24 |
| BUG:soft_lockup-CPU##stuck_for#s | 7 | 6 |
| EIP:__do_softirq | 5 | 5 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 7 | 6 |
| EIP:_raw_spin_unlock_irq | 1 | |
| EIP:swake_up_one | 1 | |
| page_allocation_failure:order:#,mode:#(GFP_KERNEL|__GFP_NORETRY),nodemask=(null) | 1 | |
| Mem-Info | 5 | 3 |
| invoked_oom-killer:gfp_mask=0x | 2 | |
| BUG:kernel_reboot-without-warning_in_test_stage | 4 | 1 |
| BUG:unable_to_handle_page_fault_for_address | 0 | 10 |
| Oops:#[##] | 0 | 12 |
| EIP:fput_many | 0 | 14 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 14 |
| EIP:smp_call_function_single | 0 | 1 |
+----------------------------------------------------------------------------------+----------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[child5:501] migrate_pages (294) returned ENOSYS, marking as inactive.
[child3:499] mq_open (277) returned ENOSYS, marking as inactive.
[child0:496] lookup_dcookie (253) returned ENOSYS, marking as inactive.
[child6:502] init_module (128) returned ENOSYS, marking as inactive.
[child0:496] bpf (357) returned ENOSYS, marking as inactive.
[ 63.809244] BUG: unable to handle page fault for address: ffff4155
[ 63.823985] #PF: supervisor write access in kernel mode
[ 63.836460] #PF: error_code(0x0002) - not-present page
[ 63.848806] *pde = 03290067 *pte = 00000000
01
[ 63.897695] Code: b4 26 00 00 00 00 8b 18 e8 39 f8 ff ff 85 db 89 d8 75 f3 5b c3 90 3e 8d 74 26 00 83 ec 0c 89 5c 24 04 89 c3 89 74 24 08 89 d6 <f0> 29 73 44 75 44 64 a1 d4 67 b1 82 64 8b 15 cc 67 b1 82 81 e2 00
[ 63.957903] ESI: 00000001 EDI: 77466000 EBP: 02000000 ESP: 9e7fbed8
[ 63.972866] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 EFLAGS: 00010296
[ 63.991447] CR0: 80050033 CR2: ffff4155 CR3: 1e7c5000 CR4: 000006d0
[ 64.007220] Call Trace:
[ 64.013478] ? kernel_wait4+0x134/0x1d0
[ 6400 .022080 73] 00? __li00s t_de00l _entr00y+0x20/ 0x20
[ 64.034214] ? sys_wait4+0x3e/0xa0
[ 64.039847] ? do_fast_syscall_32+0xa7/0x230
[ 64.040876] init: tty5 main process (454) terminated with status 1
[ 64.046779] ? entry_SYSENTER_32+0x69/0xc2
[ 64.046785] CR2: 00000000ffff4155
[ 64.046810] ---[ end trace 4a93eb27c845069c ]---
[ 64.046816] EIP: fput_many+0x14/0xa0
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start 535bd8f046338a136e8f51ece74c5600a10af1d9 d1fdb6d8f6a4109a4263176c84b899076a5f8008 --
git bisect bad 63411690fd3d9602662d93ddeae63bd5f49fb163 # 10:10 B 1 1 0 0 Merge 'tip/timers/core' into devel-hourly-2019061605
git bisect bad b60b3bded74920c4d53eabda0b2e35232e581569 # 10:26 B 12 3 1 2 Merge 'monstr-microblaze/xnext/tap' into devel-hourly-2019061605
git bisect bad 5f3f85387602e71cbd051a45b71aae47f28cad92 # 10:39 B 14 1 2 3 Merge 'linux-review/Nathan-Huckleberry/usb-host-xhci-tegra-Fix-Wunused-const-variable/20190614-141018' into devel-hourly-2019061605
git bisect bad 357692c7c8c1b658db981153bc072e619ffccd00 # 10:58 B 0 1 18 2 Merge 'linux-review/Shobhit-Kukreti/staging-fbtft-Fix-checkpatch-ERROR-space-prohibited-before-that-close-parenthesis/20190616-013220' into devel-hourly-2019061605
git bisect bad e4808c3acd1c2b213d0e341e7e486353cdfeaabe # 11:49 B 10 1 2 3 Merge 'ipmi/for-next' into devel-hourly-2019061605
git bisect bad f938d0c2588a44d5c8198c58c9d2fb426eb4dc38 # 12:09 B 21 3 3 3 Merge 'nsekhar-davinci/fixes' into devel-hourly-2019061605
git bisect good fe9369eacfa6809a1655beb52a26598cc968b731 # 12:36 G 119 0 2 2 Merge 'matthias-bgg/v5.2-next/dts64' into devel-hourly-2019061605
git bisect good 920f2382a27afac20b92511d6e6a5d69bfec3bc1 # 13:01 G 117 0 7 7 Merge 'linux-review/Lijun-Ou/RDMA-hns-reset-function-when-removing-module/20190615-162311' into devel-hourly-2019061605
git bisect bad 4f9568c6d3003edea6093b3ec718d668194caa32 # 13:14 B 2 3 0 0 Merge 'brauner/pidfd_wait' into devel-hourly-2019061605
git bisect bad 890dec2e168dd245f4940d59610643aeda296089 # 13:26 B 2 1 0 0 pidfd: support waiting on processes through pidfds
# first bad commit: [890dec2e168dd245f4940d59610643aeda296089] pidfd: support waiting on processes through pidfds
git bisect good f2c7c76c5d0a443053e94adb9f0918fa2fb85c3a # 13:56 G 351 0 16 20 Linux 5.2-rc3
# extra tests with debug options
git bisect bad 890dec2e168dd245f4940d59610643aeda296089 # 14:11 B 17 1 1 6 pidfd: support waiting on processes through pidfds
# extra tests on HEAD of linux-devel/devel-hourly-2019061605
git bisect bad 535bd8f046338a136e8f51ece74c5600a10af1d9 # 14:11 B 7 7 0 0 0day head guard for 'devel-hourly-2019061605'
# extra tests on tree/branch brauner/pidfd_wait
git bisect bad 890dec2e168dd245f4940d59610643aeda296089 # 14:14 B 92 12 0 17 pidfd: support waiting on processes through pidfds
# extra tests with first bad commit reverted
git bisect good cba64822fa711f73caef03ef615e05f2ddf5c888 # 14:39 G 118 0 6 6 Revert "pidfd: support waiting on processes through pidfds"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
11 months, 3 weeks
- 1
- 0
73589972b9 ("IMA: support for per policy rule template formats"): WARNING: suspicious RCU usage
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/zohar/linux-integrity.git next-queued-testing
commit 73589972b987abcb36813a01ef6cc36f47e16d2b
Author: Matthew Garrett <matthewgarrett(a)google.com>
AuthorDate: Tue Jun 4 13:38:59 2019 -0700
Commit: Mimi Zohar <zohar(a)linux.ibm.com>
CommitDate: Fri Jun 14 09:04:56 2019 -0400
IMA: support for per policy rule template formats
Admins may wish to log different measurements using different IMA
templates. Add support for overriding the default template on a per-rule
basis.
Inspired-by: Roberto Sassu <roberto.sassu(a)huawei.com>
Signed-off-by: Matthew Garrett <mjg59(a)google.com>
Signed-off-by: Mimi Zohar <zohar(a)linux.ibm.com>
e038f5f691 ima: Use designated initializers for struct ima_event_data
73589972b9 IMA: support for per policy rule template formats
+------------------------------------------------------------------------------------+------------+------------+
| | e038f5f691 | 73589972b9 |
+------------------------------------------------------------------------------------+------------+------------+
| boot_successes | 35 | 0 |
| boot_failures | 0 | 14 |
| WARNING:suspicious_RCU_usage | 0 | 14 |
| include/linux/rcupdate.h:#Illegal_context_switch_in_RCU_read-side_critical_section | 0 | 14 |
| BUG:sleeping_function_called_from_invalid_context_at_mm/slab.h | 0 | 14 |
+------------------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 4.995738] Loading compiled-in X.509 certificates
[ 4.997042] Key type big_key registered
[ 4.997726] Key type encrypted registered
[ 4.998298]
[ 4.998485] =============================
[ 4.998929] WARNING: suspicious RCU usage
[ 4.999441] 5.2.0-rc1-00012-g7358997 #1 Tainted: G T
[ 5.000117] -----------------------------
[ 5.000635] include/linux/rcupdate.h:268 Illegal context switch in RCU read-side critical section!
[ 5.001865]
[ 5.001865] other info that might help us debug this:
[ 5.001865]
[ 5.009792]
[ 5.009792] rcu_scheduler_active = 2, debug_locks = 1
[ 5.010610] 1 lock held by swapper/1:
[ 5.011014] #0: abbdf1ec (rcu_read_lock){....}, at: lookup_template_desc+0x5/0x100
[ 5.011931]
[ 5.011931] stack backtrace:
[ 5.012477] CPU: 0 PID: 1 Comm: swapper Tainted: G T 5.2.0-rc1-00012-g7358997 #1
[ 5.013483] Call Trace:
[ 5.013768] ? ___might_sleep+0x148/0x2b0
[ 5.014278] ? __need_fs_reclaim+0x40/0x140
[ 5.014748] ? __kmalloc+0x287/0x480
[ 5.015144] ? __lock_acquire+0xa81/0x1470
[ 5.015674] ? template_desc_init_fields+0x1b4/0x330
[ 5.028826] ? template_desc_init_fields+0x1b4/0x330
[ 5.029509] ? lookup_template_desc+0x5/0x100
[ 5.029995] ? lookup_template_desc+0xa0/0x100
[ 5.030550] ? lookup_template_desc+0x5/0x100
[ 5.031040] ? ima_template_desc_current+0x3a/0x50
[ 5.031642] ? hash_setup+0x18/0x181
[ 5.032040] ? init_ima+0x29/0x15c
[ 5.032487] ? do_one_initcall+0x1c7/0x477
[ 5.032945] ? hash_setup+0x181/0x181
[ 5.033423] ? rcu_read_lock_sched_held+0x51/0x80
[ 5.033945] ? trace_initcall_level+0xc3/0xfb
[ 5.034496] ? kernel_init_freeable+0x132/0x274
[ 5.035000] ? kernel_init_freeable+0x163/0x274
[ 5.035565] ? rest_init+0x160/0x160
[ 5.035967] ? kernel_init+0xd/0x160
[ 5.036430] ? rest_init+0x160/0x160
[ 5.036832] ? schedule_tail_wrapper+0x6/0x8
[ 5.037372] ? rest_init+0x160/0x160
[ 5.037775] ? ret_from_fork+0x2e/0x38
[ 5.038260] BUG: sleeping function called from invalid context at mm/slab.h:418
[ 5.039339] in_atomic(): 1, irqs_disabled(): 0, pid: 1, name: swapper
[ 5.040078] 1 lock held by swapper/1:
[ 5.040549] #0: abbdf1ec (rcu_read_lock){....}, at: lookup_template_desc+0x5/0x100
[ 5.053930] CPU: 0 PID: 1 Comm: swapper Tainted: G T 5.2.0-rc1-00012-g7358997 #1
[ 5.054937] Call Trace:
[ 5.055290] ? ___might_sleep+0x26f/0x2b0
[ 5.055737] ? __kmalloc+0x287/0x480
[ 5.056127] ? __lock_acquire+0xa81/0x1470
[ 5.056682] ? template_desc_init_fields+0x1b4/0x330
[ 5.057374] ? template_desc_init_fields+0x1b4/0x330
[ 5.057980] ? lookup_template_desc+0x5/0x100
[ 5.058525] ? lookup_template_desc+0xa0/0x100
[ 5.059013] ? lookup_template_desc+0x5/0x100
[ 5.059555] ? ima_template_desc_current+0x3a/0x50
[ 5.060088] ? hash_setup+0x18/0x181
[ 5.060554] ? init_ima+0x29/0x15c
[ 5.060934] ? do_one_initcall+0x1c7/0x477
[ 5.061475] ? hash_setup+0x181/0x181
[ 5.061903] ? rcu_read_lock_sched_held+0x51/0x80
[ 5.062497] ? trace_initcall_level+0xc3/0xfb
[ 5.062978] ? kernel_init_freeable+0x132/0x274
[ 5.064310] ? kernel_init_freeable+0x163/0x274
[ 5.064814] ? rest_init+0x160/0x160
[ 5.065281] ? kernel_init+0xd/0x160
[ 5.065720] ? rest_init+0x160/0x160
[ 5.066112] ? schedule_tail_wrapper+0x6/0x8
[ 5.066660] ? rest_init+0x160/0x160
[ 5.067053] ? ret_from_fork+0x2e/0x38
[ 5.080761] ima: No TPM chip found, activating TPM-bypass!
[ 5.081464] ima: Allocated hash algorithm: sha512
[ 5.082048] No architecture policies found
[ 5.082687] evm: Initialising EVM extended attributes:
[ 5.083328] evm: security.capability
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start fa1b32aac2e29b2ef314ac547d81147cb707a6ea d1fdb6d8f6a4109a4263176c84b899076a5f8008 --
git bisect good 58a485c7c31bf0828bcd5fdd280b6e52368fdce3 # 15:16 G 11 0 0 1 Merge 'bpf/master' into devel-hourly-2019061610
git bisect good 65999b9750fdd5c133281a1655989470284a9fe4 # 15:37 G 10 0 0 1 Merge 'selinuxproject-selinux-kernel/next' into devel-hourly-2019061610
git bisect good 8402c97afc2d98a0db1df6bdd6d9d61ab6110114 # 15:52 G 11 0 2 3 Merge 'renesas/arm64-dt-for-v5.3' into devel-hourly-2019061610
git bisect good 52fd33ccad3f8e8cd8f95fc89f4f377e48d35481 # 18:28 G 10 0 5 5 Merge 'ast/sample_data' into devel-hourly-2019061610
git bisect bad c80b4b08f68ffcd81302a912543f4068cea382ed # 18:54 B 0 8 28 6 Merge 'cgroup/blkcg-fixes' into devel-hourly-2019061610
git bisect bad 5bb9441a375754c4a3fb2ce987d3f588e8a3efef # 18:54 B 0 13 27 0 Merge 'integrity/next-queued-testing' into devel-hourly-2019061610
git bisect good 3c2417a0d3d85bc2fd739fd349610ce6f30f17a4 # 18:54 G 10 0 0 1 Merge 'linux-review/Greg-Kroah-Hartman/drm-no-need-to-check-return-value-of-debugfs_create-functions/20190616-030906' into devel-hourly-2019061610
git bisect good 9e1e5d4372d641d3cd6d6cb8dc0b488a7850d222 # 18:56 G 10 0 0 1 x86/ima: fix the Kconfig dependency for IMA_ARCH_POLICY
git bisect good b169424551930a9325f700f502802f4d515194e5 # 19:15 G 10 0 0 1 ima: use the lsm policy update notifier
git bisect bad 73589972b987abcb36813a01ef6cc36f47e16d2b # 19:49 B 0 10 28 4 IMA: support for per policy rule template formats
git bisect good e038f5f691e003af25cda0f1593d2cc0a4d1c866 # 20:23 G 10 0 1 2 ima: Use designated initializers for struct ima_event_data
# first bad commit: [73589972b987abcb36813a01ef6cc36f47e16d2b] IMA: support for per policy rule template formats
git bisect good e038f5f691e003af25cda0f1593d2cc0a4d1c866 # 20:25 G 32 0 2 4 ima: Use designated initializers for struct ima_event_data
# extra tests with debug options
git bisect bad 73589972b987abcb36813a01ef6cc36f47e16d2b # 21:01 B 0 11 25 0 IMA: support for per policy rule template formats
# extra tests on HEAD of linux-devel/devel-hourly-2019061610
git bisect bad 86244c3541b45ce9bdebcfbd04c6d4718ab240e5 # 21:01 B 0 21 38 0 0day head guard for 'devel-hourly-2019061610'
# extra tests on tree/branch integrity/next-queued-testing
git bisect bad 73589972b987abcb36813a01ef6cc36f47e16d2b # 21:08 B 0 14 28 0 IMA: support for per policy rule template formats
# extra tests with first bad commit reverted
git bisect good 010ba19446d1b5d1cf0c1aebbba8cc171cacc35f # 21:47 G 10 0 0 0 Revert "IMA: support for per policy rule template formats"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
11 months, 3 weeks
- 1
- 0
b215eb0a1d ("spi: Guarantee cacheline alignment of .."): kernel BUG at mm/slab.c:2743!
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://github.com/l1k/linux revpi_staging
commit b215eb0a1dbd1c683ee151371b9626e5c923610c
Author: Lukas Wunner <lukas(a)wunner.de>
AuthorDate: Mon Nov 26 11:11:34 2018 +0100
Commit: Lukas Wunner <lukas(a)wunner.de>
CommitDate: Wed Jun 12 20:35:30 2019 +0200
spi: Guarantee cacheline alignment of driver-private data
__spi_alloc_controller() uses a single allocation to accommodate struct
spi_controller and the driver-private data, but places the latter behind
the former. This order does not guarantee cacheline alignment of the
driver-private data. It does guarantee cacheline alignment of struct
spi_controller but the structure doesn't make any use of that property.
Reverse the order. A forthcoming commit leverages this to grant DMA
access to driver-private data of the BCM2835 SPI master.
Signed-off-by: Lukas Wunner <lukas(a)wunner.de>
a57c4dae11 dmaengine: bcm2835: Allow cyclic transactions without interrupt
b215eb0a1d spi: Guarantee cacheline alignment of driver-private data
28c6177476 spi: bcm2835: Speed up RX-only DMA transfers by zero-filling TX FIFO
+-------------------------------------------------+------------+------------+------------+
| | a57c4dae11 | b215eb0a1d | 28c6177476 |
+-------------------------------------------------+------------+------------+------------+
| boot_successes | 28 | 0 | 0 |
| boot_failures | 1 | 14 | 11 |
| BUG:kernel_reboot-without-warning_in_test_stage | 1 | | |
| kernel_BUG_at_mm/slab.c | 0 | 14 | 11 |
| invalid_opcode:#[##] | 0 | 14 | 11 |
| RIP:___cache_free | 0 | 14 | 11 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 14 | 11 |
+-------------------------------------------------+------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 14.548037] Creating 1 MTD partitions on "NAND 128MiB 1,8V 8-bit":
[ 14.550120] 0x000000000000-0x000008000000 : "NAND simulator partition 0"
[ 14.560934] ftl_cs: FTL header not found.
[ 14.563402] parport0: cannot grant exclusive access for device spi-lm70llp
[ 14.564666] ------------[ cut here ]------------
[ 14.565591] kernel BUG at mm/slab.c:2743!
[ 14.566685] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[ 14.567611] CPU: 1 PID: 1 Comm: swapper/0 Not tainted 5.2.0-rc4-00054-gb215eb0 #1
[ 14.569330] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 14.570919] RIP: 0010:___cache_free+0x247/0x590
[ 14.571758] Code: 0f b6 4e 1c 48 c1 ee 20 29 f0 d3 e8 41 0f b6 4e 1d 01 f0 d3 e8 41 3b 46 24 72 02 0f 0b 41 0f af 46 14 48 01 d0 48 39 c3 74 02 <0f> 0b 41 f6 46 21 08 74 24 49 63 8e e0 00 00 00 4d 63 7e 74 be 6b
[ 14.571758] RSP: 0000:ffff88801e5b3c40 EFLAGS: 00010006
[ 14.571758] RAX: ffff88801a39d000 RBX: ffff88801a39d150 RCX: 000000000000000b
[ 14.571758] RDX: ffff88801a39d000 RSI: 0000000000000000 RDI: 0000000080000000
[ 14.571758] RBP: ffff88801e5b3ca8 R08: ffffea00005bca58 R09: 0000000000000000
[ 14.571758] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88801ec00000
[ 14.571758] R13: 00000000001f21a0 R14: ffff88801e400900 R15: ffffffff81d127e5
[ 14.571758] FS: 0000000000000000(0000) GS:ffff88801ec00000(0000) knlGS:0000000000000000
[ 14.571758] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 14.571758] CR2: 00000000ffffffff CR3: 0000000003212001 CR4: 00000000001606e0
[ 14.571758] Call Trace:
[ 14.571758] ? __virt_addr_valid+0xf6/0x110
[ 14.571758] kfree+0x165/0x190
[ 14.601265] ? spi_controller_messages_show+0x30/0x30
[ 14.601265] spi_controller_release+0x15/0x20
[ 14.601265] device_release+0x77/0xc0
[ 14.601265] ? dev_attr_show+0x70/0x70
[ 14.601265] kobject_put+0x1c6/0x220
[ 14.601265] put_device+0x1f/0x30
[ 14.601265] spi_lm70llp_attach+0x2e6/0x330
[ 14.601265] ? driver_detach+0x40/0x40
[ 14.601265] port_check+0x2f/0x40
[ 14.601265] bus_for_each_dev+0x99/0x100
[ 14.601265] __parport_register_driver+0x8f/0x170
[ 14.601265] init_spi_lm70llp+0x26/0x4a
[ 14.601265] ? fsl_spi_init+0x43/0x43
[ 14.601265] do_one_initcall+0x2bc/0x67c
[ 14.601265] ? debug_smp_processor_id+0x114/0x120
[ 14.601265] kernel_init_freeable+0x608/0x767
[ 14.601265] ? rest_init+0x290/0x290
[ 14.601265] kernel_init+0x13/0x170
[ 14.601265] ? schedule_tail+0x7d/0x80
[ 14.601265] ? rest_init+0x290/0x290
[ 14.601265] ret_from_fork+0x3a/0x50
[ 14.601265] ---[ end trace f117052f33543e25 ]---
[ 14.601265] RIP: 0010:___cache_free+0x247/0x590
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start f76b6a20b72a0691b6885fada0fe7799db107640 d1fdb6d8f6a4109a4263176c84b899076a5f8008 --
git bisect bad e43340ab362c58bd222a9bd157be61a2defea681 # 00:38 B 0 2 21 5 Merge 'kbuild/build-test' into devel-hourly-2019061511
git bisect good cdb414a8ee60171ec718409c3bf1b3aee59ed73c # 01:02 G 10 0 9 9 Merge 'spi/for-5.2' into devel-hourly-2019061511
git bisect good 43ffc71121f53e4e7b75acb2ef168135007b365c # 01:24 G 11 0 4 4 Merge 'tip/x86/cache' into devel-hourly-2019061511
git bisect good caf1ce79d489161b53f242d613e602594e613663 # 01:40 G 11 0 8 8 Merge 'ntb/ntb' into devel-hourly-2019061511
git bisect good def2269fa02d436cb604ce1fc8d94c0d38b6036c # 02:10 G 11 0 3 3 Merge 'yhuang/autonuma6' into devel-hourly-2019061511
git bisect good 64db7d9b2c09db68c5b1be808e87cfc01d9c2aba # 03:10 G 10 0 7 8 Merge 'stblinux/maintainers/next' into devel-hourly-2019061511
git bisect good c7084246d84aef0c6ce01e4751a7f724c5d01c62 # 03:20 G 10 0 7 7 Merge 'pza/hantro/imx8m-v5' into devel-hourly-2019061511
git bisect bad 7b9a56fe350068075ffda973f1c4a4405fc3ba34 # 03:30 B 0 9 25 2 Merge 'char-misc/char-misc-next' into devel-hourly-2019061511
git bisect bad 39bd443109587775bcd872686caed5b4c0f10dfe # 04:20 B 0 11 27 1 Merge 'l1k/revpi_staging' into devel-hourly-2019061511
git bisect bad b215eb0a1dbd1c683ee151371b9626e5c923610c # 04:48 B 0 2 22 6 spi: Guarantee cacheline alignment of driver-private data
git bisect good c21fc68c5c6b45a2d0b4e7d4645b4af6c810abf6 # 05:17 G 10 0 1 1 Merge remote-tracking branch 'spi/topic/pump-rt' into spi-next
git bisect good a57c4dae1179bbba2be84c2a4a3fc8cf4301eed8 # 05:32 G 11 0 2 3 dmaengine: bcm2835: Allow cyclic transactions without interrupt
# first bad commit: [b215eb0a1dbd1c683ee151371b9626e5c923610c] spi: Guarantee cacheline alignment of driver-private data
git bisect good a57c4dae1179bbba2be84c2a4a3fc8cf4301eed8 # 05:37 G 30 0 6 9 dmaengine: bcm2835: Allow cyclic transactions without interrupt
# extra tests with debug options
git bisect bad b215eb0a1dbd1c683ee151371b9626e5c923610c # 05:50 B 0 7 25 4 spi: Guarantee cacheline alignment of driver-private data
# extra tests on HEAD of linux-devel/devel-hourly-2019061511
git bisect bad f76b6a20b72a0691b6885fada0fe7799db107640 # 05:50 B 0 328 345 0 0day head guard for 'devel-hourly-2019061511'
# extra tests on tree/branch l1k/revpi_staging
git bisect bad 28c61774769c4652df0bb21072a7bb3610321049 # 06:01 B 0 5 19 0 spi: bcm2835: Speed up RX-only DMA transfers by zero-filling TX FIFO
# extra tests with first bad commit reverted
git bisect good 99cd9b0bc5407567194122871747e0d946f05562 # 06:29 G 10 0 2 2 Revert "spi: Guarantee cacheline alignment of driver-private data"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
11 months, 3 weeks
- 1
- 0
41c3b82ce7 ("block: return from __bio_try_merge_page if .."): BUG: KASAN: null-ptr-deref in __bio_add_pc_page
by kernel test robot
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
https://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup.git block/for-linus
commit 41c3b82ce7980f8e7b51cf2cf6c3f55fd8bc07c0
Author: Christoph Hellwig <hch(a)lst.de>
AuthorDate: Thu Jun 13 11:55:28 2019 +0200
Commit: Jens Axboe <axboe(a)kernel.dk>
CommitDate: Thu Jun 13 04:02:35 2019 -0600
block: return from __bio_try_merge_page if merging occured in the same page
We currently have an input same_page parameter to __bio_try_merge_page
to prohibit merging in the same page. The rationale for that is that
some callers need to account for every page added to a bio. Instead of
letting these callers call twice into the merge code to account for the
new vs existing page cases, just turn the paramter into an output one that
returns if a merge in the same page occured and let them act accordingly.
Signed-off-by: Christoph Hellwig <hch(a)lst.de>
Reviewed-by: Ming Lei <ming.lei(a)redhat.com>
Signed-off-by: Jens Axboe <axboe(a)kernel.dk>
1d0c06513b block/ps3vram: Use %llu to format sector_t after LBDAF removal
41c3b82ce7 block: return from __bio_try_merge_page if merging occured in the same page
9c9b3e34fa block: fix page leak when merging to same page
+------------------------------------------------+------------+------------+------------+
| | 1d0c06513b | 41c3b82ce7 | 9c9b3e34fa |
+------------------------------------------------+------------+------------+------------+
| boot_successes | 9 | 1 | 0 |
| boot_failures | 3 | 14 | 12 |
| BUG:soft_lockup-CPU##stuck_for#s | 2 | | |
| RIP:memset_erms | 1 | | |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 2 | | |
| RIP:__asan_load8 | 1 | | |
| BUG:kernel_timeout_in_torture_test_stage | 1 | | |
| BUG:KASAN:null-ptr-deref_in__bio_add_pc_page | 0 | 14 | 12 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 14 | 12 |
| Oops:#[##] | 0 | 14 | 12 |
| RIP:__bio_add_pc_page | 0 | 14 | 12 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 14 | 12 |
+------------------------------------------------+------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 212.664343] osst :I: $Id: osst.c,v 1.73 2005/01/01 21:13:34 wriede Exp $
[ 212.673694] scsi host0: scsi_debug: version 0188 [20190125]
[ 212.673694] dev_size_mb=8, opts=0x0, submit_queues=1, statistics=0
[ 212.682114] scsi 0:0:0:0: Direct-Access Linux scsi_debug 0188 PQ: 0 ANSI: 7
[ 212.685451] ==================================================================
[ 212.687542] BUG: KASAN: null-ptr-deref in __bio_add_pc_page+0x223/0x510
[ 212.689077] Write of size 1 at addr 0000000000000000 by task kworker/u2:1/108
[ 212.690676]
[ 212.691445] CPU: 0 PID: 108 Comm: kworker/u2:1 Not tainted 5.2.0-rc4-00013-g41c3b82 #1
[ 212.693624] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 212.694987] Workqueue: events_unbound async_run_entry_fn
[ 212.694987] Call Trace:
[ 212.694987] ? __bio_add_pc_page+0x223/0x510
[ 212.694987] __kasan_report+0x1d2/0x207
[ 212.694987] ? __bio_add_pc_page+0x223/0x510
[ 212.694987] kasan_report+0x29/0x40
[ 212.694987] __bio_add_pc_page+0x223/0x510
[ 212.694987] bio_map_kern+0x118/0x190
[ 212.694987] blk_rq_map_kern+0x235/0x270
[ 212.694987] ? blk_rq_unmap_user+0x90/0x90
[ 212.694987] ? ftrace_likely_update+0x45/0x2a0
[ 212.694987] ? scsi_initialize_rq+0x54/0x70
[ 212.694987] __scsi_execute+0xa6/0x2d0
[ 212.694987] __scsi_scan_target+0x4d8/0x890
[ 212.694987] ? scsi_target_reap+0x60/0x60
[ 212.694987] ? find_held_lock+0x74/0xd0
[ 212.694987] ? __pm_runtime_resume+0x71/0xb0
[ 212.694987] ? ftrace_likely_update+0x45/0x2a0
[ 212.694987] ? _raw_spin_unlock_irqrestore+0x32/0x50
[ 212.694987] scsi_scan_channel+0x94/0xe0
[ 212.694987] scsi_scan_host_selected+0x158/0x1d0
[ 212.694987] ? do_scsi_scan_host+0x110/0x110
[ 212.694987] do_scan_async+0x29/0x250
[ 212.694987] ? do_scsi_scan_host+0x110/0x110
[ 212.694987] async_run_entry_fn+0x66/0x2e0
[ 212.694987] process_one_work+0x575/0xb10
[ 212.694987] ? pwq_dec_nr_in_flight+0x140/0x140
[ 212.694987] ? worker_thread+0x1cf/0x790
[ 212.694987] worker_thread+0x68/0x790
[ 212.694987] ? process_one_work+0xb10/0xb10
[ 212.694987] kthread+0x20c/0x230
[ 212.694987] ? kthread_delayed_work_timer_fn+0x1c0/0x1c0
[ 212.694987] ret_from_fork+0x24/0x30
[ 212.694987] ==================================================================
[ 212.694987] Disabling lock debugging due to kernel taint
[ 212.738776] BUG: kernel NULL pointer dereference, address: 0000000000000000
[ 212.740355] #PF: supervisor write access in kernel mode
[ 212.741675] #PF: error_code(0x0002) - not-present page
[ 212.742998] PGD 0 P4D 0
[ 212.743930] Oops: 0002 [#1] KASAN PTI
[ 212.745024] CPU: 0 PID: 108 Comm: kworker/u2:1 Tainted: G B 5.2.0-rc4-00013-g41c3b82 #1
[ 212.747388] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 212.748734] Workqueue: events_unbound async_run_entry_fn
[ 212.748734] RIP: 0010:__bio_add_pc_page+0x22b/0x510
[ 212.748734] Code: 06 85 c0 0f 85 b4 01 00 00 49 83 ed 01 31 ff 4c 89 e8 48 25 00 f0 ff ff 48 89 44 24 08 e8 bd 1e 8e ff 48 8b 44 24 08 49 39 c6 <0f> 94 04 25 00 00 00 00 0f 84 a0 01 00 00 4c 8b 35 98 db eb 03 49
[ 212.748734] RSP: 0000:ffff8880192f7948 EFLAGS: 00010206
[ 212.748734] RAX: 0000000013621000 RBX: ffff888015fce200 RCX: fffffbfff0d785d9
[ 212.748734] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff83ba6482
[ 212.748734] RBP: 0000000000000100 R08: fffffbfff0d785da R09: fffffbfff0d785da
[ 212.748734] R10: ffffffff86bc2ecb R11: fffffbfff0d785da R12: ffff888013c496d0
[ 212.748734] R13: 0000000013621fff R14: 0000000013622000 R15: ffff888015fce214
[ 212.748734] FS: 0000000000000000(0000) GS:ffffffff85a9e000(0000) knlGS:0000000000000000
[ 212.748734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 212.748734] CR2: 0000000000000000 CR3: 0000000005a32001 CR4: 00000000001606f0
[ 212.748734] Call Trace:
[ 212.748734] bio_map_kern+0x118/0x190
[ 212.748734] blk_rq_map_kern+0x235/0x270
[ 212.748734] ? blk_rq_unmap_user+0x90/0x90
[ 212.748734] ? ftrace_likely_update+0x45/0x2a0
[ 212.748734] ? scsi_initialize_rq+0x54/0x70
[ 212.748734] __scsi_execute+0xa6/0x2d0
[ 212.748734] __scsi_scan_target+0x4d8/0x890
[ 212.748734] ? scsi_target_reap+0x60/0x60
[ 212.748734] ? find_held_lock+0x74/0xd0
[ 212.748734] ? __pm_runtime_resume+0x71/0xb0
[ 212.748734] ? ftrace_likely_update+0x45/0x2a0
[ 212.748734] ? _raw_spin_unlock_irqrestore+0x32/0x50
[ 212.748734] scsi_scan_channel+0x94/0xe0
[ 212.748734] scsi_scan_host_selected+0x158/0x1d0
[ 212.748734] ? do_scsi_scan_host+0x110/0x110
[ 212.748734] do_scan_async+0x29/0x250
[ 212.748734] ? do_scsi_scan_host+0x110/0x110
[ 212.748734] async_run_entry_fn+0x66/0x2e0
[ 212.748734] process_one_work+0x575/0xb10
[ 212.748734] ? pwq_dec_nr_in_flight+0x140/0x140
[ 212.748734] ? worker_thread+0x1cf/0x790
[ 212.748734] worker_thread+0x68/0x790
[ 212.748734] ? process_one_work+0xb10/0xb10
[ 212.748734] kthread+0x20c/0x230
[ 212.748734] ? kthread_delayed_work_timer_fn+0x1c0/0x1c0
[ 212.748734] ret_from_fork+0x24/0x30
[ 212.748734] CR2: 0000000000000000
[ 212.748734] ---[ end trace b9d0d98398fe5790 ]---
[ 212.748734] RIP: 0010:__bio_add_pc_page+0x22b/0x510
# HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD
git bisect start b03773ed7363554492ff274f4a9364a4c30b3637 d1fdb6d8f6a4109a4263176c84b899076a5f8008 --
git bisect bad a77e549e7925f1a071787a77d36e28d0f290e722 # 20:13 B 0 2 17 1 Merge 'jpoimboe/bpf-orc-fix-3' into devel-hourly-2019061516
git bisect bad fec395990abb566155bfd809696168b65df8cde3 # 20:35 B 0 6 20 0 Merge 'pm/linux-next' into devel-hourly-2019061516
git bisect good 60c912e9d5d16b2e39194e51aa4e9196cda3df08 # 21:30 G 10 0 8 9 Merge 'sunxi/sunxi/dt64-for-5.3' into devel-hourly-2019061516
git bisect bad cf1a70094c0b31e849ea1461e6da3da63cac85cb # 21:53 B 0 1 15 0 Merge 'tip/x86/cpu' into devel-hourly-2019061516
git bisect bad 4baf710ddb5fb2b90abefdd5cfa11660cdae67f6 # 23:01 B 0 1 20 5 Merge 'cgroup/block/for-linus' into devel-hourly-2019061516
git bisect good d4d2c24ea2a5346d75f21d3a44868f9021650115 # 23:35 G 10 0 8 8 Merge 'arm-tegra/for-5.3/firmware' into devel-hourly-2019061516
git bisect good e4fde4a63896f617c1d9b131ca973be1c791fbbf # 00:24 G 10 0 6 6 Merge 'gpio/devel' into devel-hourly-2019061516
git bisect good 7448723a0b6ac76fe0766c37fc7aaa123613de0b # 01:14 G 10 0 10 10 Merge 'linux-review/fei-yang-intel-com/usb-gadget-f_fs-data_len-used-before-properly-set/20190614-094348' into devel-hourly-2019061516
git bisect good 3a54fca087b6a92c1bcf9c2b72bb2e70131d378e # 01:56 G 10 0 10 10 Merge 'm68knommu/for-next' into devel-hourly-2019061516
git bisect bad 9c9b3e34faeaeee28fce5b613c7f0e5930f8da5c # 02:12 B 0 7 21 0 block: fix page leak when merging to same page
git bisect bad 41c3b82ce7980f8e7b51cf2cf6c3f55fd8bc07c0 # 02:50 B 0 9 24 1 block: return from __bio_try_merge_page if merging occured in the same page
# first bad commit: [41c3b82ce7980f8e7b51cf2cf6c3f55fd8bc07c0] block: return from __bio_try_merge_page if merging occured in the same page
git bisect good 1d0c06513bd44e724f572ef9c932d0c889d183c6 # 03:45 G 30 0 25 25 block/ps3vram: Use %llu to format sector_t after LBDAF removal
# extra tests with debug options
git bisect bad 41c3b82ce7980f8e7b51cf2cf6c3f55fd8bc07c0 # 04:16 B 0 3 22 4 block: return from __bio_try_merge_page if merging occured in the same page
# extra tests on HEAD of linux-devel/devel-hourly-2019061516
git bisect bad b03773ed7363554492ff274f4a9364a4c30b3637 # 04:21 B 0 14 36 4 0day head guard for 'devel-hourly-2019061516'
# extra tests on tree/branch cgroup/block/for-linus
git bisect bad 9c9b3e34faeaeee28fce5b613c7f0e5930f8da5c # 04:27 B 0 12 26 0 block: fix page leak when merging to same page
# extra tests with first bad commit reverted
git bisect good 5333d4fc3975d26a16540fc2e959060a27500329 # 04:55 G 12 0 7 7 Revert "block: return from __bio_try_merge_page if merging occured in the same page"
---
0-DAY kernel test infrastructure Open Source Technology Center
https://lists.01.org/pipermail/lkp Intel Corporation
11 months, 3 weeks
- 1
- 0
Re: [LKP] livepatching selftests failure on current master branch
by Joe Lawrence
On 5/17/19 10:17 AM, Miroslav Benes wrote:
> Hi,
>
> I noticed that livepatching selftests fail on our master branch
> (https://git.kernel.org/pub/scm/linux/kernel/git/livepatching/livepatching...).
>
> ...
[ adding lkp(a)01.org to this email ]
lkp folks, I was wondering if the kernel selftests were included as part
of the test-bot and if so, do we need to do anything specific to include
the livepatching selftests?
Thanks,
-- Joe
11 months, 3 weeks
- 3
- 7
[x86/topology] 212bf4fdb7: reaim.jobs_per_min 36.4% improvement
by kernel test robot
Greeting,
FYI, we noticed a 36.4% improvement of reaim.jobs_per_min due to commit:
commit: 212bf4fdb7f9eeeb99afd97ebad677d43e7b55ac ("x86/topology: Define topology_logical_die_id()")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: reaim
on test machine: 192 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 496G memory
with following parameters:
runtime: 300s
nr_task: 100%
test: custom
cpufreq_governor: performance
ucode: 0xb000036
test-description: REAIM is an updated and improved version of AIM 7 benchmark.
test-url: https://sourceforge.net/projects/re-aim-7/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-2019-05-14.cgz/300s/lkp-bdw-ex1/custom/reaim/0xb000036
commit:
306a0de329 ("x86/topology: Define topology_die_id()")
212bf4fdb7 ("x86/topology: Define topology_logical_die_id()")
306a0de329f77537 212bf4fdb7f9eeeb99afd97ebad
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 dmesg.WARNING:at_ip___perf_sw_event/0x
:4 25% 1:4 dmesg.WARNING:at_ip_perf_event_mmap_output/0x
0:4 9% 1:4 perf-profile.children.cycles.error_entry
0:4 7% 0:4 perf-profile.self.cycles.error_entry
%stddev %change %stddev
\ | \
215.03 -52.5% 102.25 ± 2% reaim.child_systime
67.32 +14.7% 77.23 reaim.child_utime
603010 +36.4% 822275 reaim.jobs_per_min
3140 +36.4% 4282 reaim.jobs_per_min_child
96.46 -3.7% 92.90 reaim.jti
629884 +37.4% 865178 reaim.max_jobs_per_min
1.82 -26.7% 1.33 reaim.parent_time
3.04 ± 2% +116.5% 6.58 reaim.std_dev_percent
0.05 ± 2% +50.0% 0.08 reaim.std_dev_time
3046456 -12.1% 2678999 ± 2% reaim.time.involuntary_context_switches
3.212e+08 +14.3% 3.67e+08 reaim.time.minor_page_faults
7316 -27.3% 5319 reaim.time.percent_of_cpu_this_job_got
16898 -45.7% 9171 ± 2% reaim.time.system_time
5294 +30.8% 6922 reaim.time.user_time
12899416 +15.1% 14849357 reaim.time.voluntary_context_switches
1507200 +14.0% 1718400 reaim.workload
365332 ± 4% +22.6% 447764 ± 7% meminfo.DirectMap4k
4207140 -13.8% 3626181 ± 7% cpuidle.POLL.time
1628687 -22.8% 1256591 ± 9% cpuidle.POLL.usage
61.39 +10.4 71.76 mpstat.cpu.all.idle%
29.58 -12.1 17.47 ± 2% mpstat.cpu.all.sys%
9.01 +1.7 10.75 mpstat.cpu.all.usr%
34.01 +11.1% 37.79 boot-time.boot
27.47 +13.3% 31.13 boot-time.dhcp
5382 +13.7% 6118 boot-time.idle
1.91 +1.1% 1.93 boot-time.smp_boot
1055 -24.7% 795.00 turbostat.Avg_MHz
42.29 -10.0 32.28 turbostat.Busy%
25.15 ± 6% +17.6% 29.57 ± 6% turbostat.Pkg%pc2
380.72 -7.8% 351.21 turbostat.PkgWatt
61.00 +16.8% 71.25 vmstat.cpu.id
8.25 ± 5% +21.2% 10.00 vmstat.cpu.us
78.00 -25.3% 58.25 ± 3% vmstat.procs.r
108166 +13.2% 122445 vmstat.system.cs
57313 ± 8% +25.5% 71901 ± 7% slabinfo.cred_jar.active_objs
1368 ± 8% +25.4% 1715 ± 7% slabinfo.cred_jar.active_slabs
57471 ± 8% +25.4% 72064 ± 7% slabinfo.cred_jar.num_objs
1368 ± 8% +25.4% 1715 ± 7% slabinfo.cred_jar.num_slabs
16859 ± 4% +9.7% 18502 ± 3% slabinfo.signal_cache.active_objs
17067 ± 4% +9.3% 18655 ± 3% slabinfo.signal_cache.num_objs
74083595 +16.3% 86133430 ± 2% numa-numastat.node0.local_node
74102308 +16.3% 86152109 ± 2% numa-numastat.node0.numa_hit
76379990 ± 2% +13.3% 86517645 numa-numastat.node1.local_node
76394133 ± 2% +13.3% 86522405 numa-numastat.node1.numa_hit
75008698 +13.2% 84885887 numa-numastat.node2.local_node
75018144 +13.2% 84899959 numa-numastat.node2.numa_hit
74032214 +14.6% 84849646 numa-numastat.node3.local_node
74046328 +14.6% 84868394 numa-numastat.node3.numa_hit
33654 ± 4% +13.6% 38241 ± 5% numa-meminfo.node0.KReclaimable
33654 ± 4% +13.6% 38241 ± 5% numa-meminfo.node0.SReclaimable
93769 +26.3% 118445 ± 17% numa-meminfo.node0.SUnreclaim
127424 +23.0% 156686 ± 14% numa-meminfo.node0.Slab
2971 ± 80% -61.7% 1139 ±130% numa-meminfo.node2.Inactive
2931 ± 82% -61.1% 1139 ±130% numa-meminfo.node2.Inactive(anon)
30886 ± 16% -23.2% 23712 ± 26% numa-meminfo.node2.KReclaimable
14424 ± 24% -25.5% 10741 ± 4% numa-meminfo.node2.PageTables
30886 ± 16% -23.2% 23712 ± 26% numa-meminfo.node2.SReclaimable
131088 ± 8% -14.7% 111860 ± 6% numa-meminfo.node2.Slab
106323 ± 3% -5.4% 100606 proc-vmstat.nr_active_anon
89344 -3.0% 86664 proc-vmstat.nr_anon_pages
13930 -3.0% 13509 proc-vmstat.nr_page_table_pages
97921 +2.9% 100717 proc-vmstat.nr_slab_unreclaimable
106323 ± 3% -5.4% 100606 proc-vmstat.nr_zone_active_anon
2.996e+08 +14.3% 3.425e+08 proc-vmstat.numa_hit
2.995e+08 +14.3% 3.424e+08 proc-vmstat.numa_local
3.091e+08 +14.3% 3.532e+08 proc-vmstat.pgalloc_normal
3.224e+08 +14.2% 3.683e+08 proc-vmstat.pgfault
3.09e+08 +14.3% 3.531e+08 proc-vmstat.pgfree
8413 ± 4% +13.6% 9560 ± 5% numa-vmstat.node0.nr_slab_reclaimable
23448 +26.3% 29605 ± 17% numa-vmstat.node0.nr_slab_unreclaimable
37397845 +16.1% 43402351 ± 2% numa-vmstat.node0.numa_hit
37377613 +16.1% 43382560 ± 2% numa-vmstat.node0.numa_local
38408200 ± 2% +13.0% 43409880 numa-vmstat.node1.numa_hit
38311093 ± 2% +13.1% 43322207 ± 2% numa-vmstat.node1.numa_local
97121 ± 8% -9.7% 87690 ± 9% numa-vmstat.node1.numa_other
746.75 ± 83% -61.9% 284.50 ±130% numa-vmstat.node2.nr_inactive_anon
3601 ± 23% -25.2% 2694 ± 3% numa-vmstat.node2.nr_page_table_pages
7726 ± 16% -23.3% 5929 ± 26% numa-vmstat.node2.nr_slab_reclaimable
746.75 ± 83% -61.9% 284.50 ±130% numa-vmstat.node2.nr_zone_inactive_anon
37668893 +13.2% 42623807 numa-vmstat.node2.numa_hit
37576756 +13.2% 42526833 numa-vmstat.node2.numa_local
37193813 +14.5% 42596067 numa-vmstat.node3.numa_hit
37097042 +14.6% 42494787 numa-vmstat.node3.numa_local
51754 ± 10% -27.3% 37632 ± 10% sched_debug.cfs_rq:/.exec_clock.avg
54046 ± 10% -25.1% 40498 ± 10% sched_debug.cfs_rq:/.exec_clock.max
50290 ± 10% -27.9% 36275 ± 11% sched_debug.cfs_rq:/.exec_clock.min
26.38 ± 31% +61.0% 42.46 ± 9% sched_debug.cfs_rq:/.load_avg.avg
9788439 ± 10% -38.0% 6066605 ± 10% sched_debug.cfs_rq:/.min_vruntime.avg
9959285 ± 10% -37.0% 6274108 ± 10% sched_debug.cfs_rq:/.min_vruntime.max
9513788 ± 9% -38.7% 5827782 ± 11% sched_debug.cfs_rq:/.min_vruntime.min
2.35 ± 9% +72.5% 4.06 ± 10% sched_debug.cfs_rq:/.nr_spread_over.avg
7.73 +43.0% 11.05 sched_debug.cfs_rq:/.nr_spread_over.max
1.71 ± 2% +30.6% 2.23 ± 2% sched_debug.cfs_rq:/.nr_spread_over.stddev
3.64 ± 16% +200.5% 10.94 ± 19% sched_debug.cpu.cpu_load[0].avg
410.57 ± 22% +41.2% 579.84 ± 6% sched_debug.cpu.cpu_load[0].max
30.32 ± 20% +115.9% 65.46 ± 10% sched_debug.cpu.cpu_load[0].stddev
3.93 ± 21% +154.9% 10.03 ± 27% sched_debug.cpu.cpu_load[1].avg
28.35 ± 15% +56.6% 44.40 ± 8% sched_debug.cpu.cpu_load[1].stddev
4.11 ± 22% +134.5% 9.65 ± 30% sched_debug.cpu.cpu_load[2].avg
27.22 ± 19% +27.5% 34.70 ± 8% sched_debug.cpu.cpu_load[2].stddev
3.99 ± 21% +133.8% 9.34 ± 33% sched_debug.cpu.cpu_load[3].avg
3.60 ± 22% +145.4% 8.82 ± 36% sched_debug.cpu.cpu_load[4].avg
-132.32 -24.2% -100.24 sched_debug.cpu.nr_uninterruptible.min
53.93 ± 9% -18.9% 43.73 ± 6% sched_debug.cpu.nr_uninterruptible.stddev
24140 ± 12% +29.6% 31277 ± 12% sched_debug.cpu.sched_goidle.min
1126 ± 8% +17.4% 1322 ± 6% sched_debug.cpu.ttwu_count.stddev
38.20 ± 11% +37.0% 52.35 ± 11% perf-stat.i.MPKI
2.423e+10 -24.2% 1.837e+10 perf-stat.i.branch-instructions
2.697e+08 ± 3% +15.4% 3.113e+08 perf-stat.i.branch-misses
2.16 ± 2% -0.2 2.00 ± 2% perf-stat.i.cache-miss-rate%
80338997 +13.1% 90889840 perf-stat.i.cache-misses
3.069e+09 +15.0% 3.528e+09 perf-stat.i.cache-references
109998 +13.2% 124541 perf-stat.i.context-switches
4.16 ± 6% +9.5% 4.56 ± 5% perf-stat.i.cpi
2.046e+11 -24.7% 1.54e+11 perf-stat.i.cpu-cycles
30979 -5.8% 29179 perf-stat.i.cpu-migrations
0.37 ± 13% +0.1 0.51 ± 13% perf-stat.i.dTLB-load-miss-rate%
30501109 ± 2% +15.3% 35155534 ± 4% perf-stat.i.dTLB-load-misses
2.637e+10 -46.6% 1.407e+10 perf-stat.i.dTLB-loads
9303233 ± 2% +16.5% 10838962 ± 2% perf-stat.i.dTLB-store-misses
8.471e+09 +14.1% 9.663e+09 perf-stat.i.dTLB-stores
10013679 ± 3% +10.6% 11075881 perf-stat.i.iTLB-load-misses
7013895 ± 6% +10.9% 7780064 ± 3% perf-stat.i.iTLB-loads
1.21e+11 -27.7% 8.747e+10 perf-stat.i.instructions
9073 ± 3% -35.2% 5876 ± 2% perf-stat.i.instructions-per-iTLB-miss
0.45 -7.8% 0.41 perf-stat.i.ipc
1060637 +14.4% 1212875 perf-stat.i.minor-faults
32053983 +14.4% 36682422 perf-stat.i.node-load-misses
1426203 +18.6% 1691319 perf-stat.i.node-loads
11129655 +20.5% 13411688 perf-stat.i.node-store-misses
5317191 +12.8% 6000271 perf-stat.i.node-stores
1060593 +14.4% 1212811 perf-stat.i.page-faults
25.41 +58.9% 40.37 perf-stat.overall.MPKI
1.12 ± 3% +0.6 1.70 ± 2% perf-stat.overall.branch-miss-rate%
2.61 -0.0 2.57 perf-stat.overall.cache-miss-rate%
1.69 +4.2% 1.76 perf-stat.overall.cpi
2550 -33.4% 1698 perf-stat.overall.cycles-between-cache-misses
0.12 ± 2% +0.1 0.25 ± 3% perf-stat.overall.dTLB-load-miss-rate%
12099 ± 3% -34.7% 7905 perf-stat.overall.instructions-per-iTLB-miss
0.59 -4.0% 0.57 perf-stat.overall.ipc
67.67 +1.4 69.08 perf-stat.overall.node-store-miss-rate%
24144694 -36.7% 15293677 perf-stat.overall.path-length
2.402e+10 -24.1% 1.822e+10 perf-stat.ps.branch-instructions
2.678e+08 ± 3% +15.4% 3.09e+08 perf-stat.ps.branch-misses
79501529 +13.2% 89961991 perf-stat.ps.cache-misses
3.048e+09 +14.9% 3.502e+09 perf-stat.ps.cache-references
108833 +13.2% 123205 perf-stat.ps.context-switches
2.027e+11 -24.6% 1.528e+11 perf-stat.ps.cpu-cycles
30645 -5.7% 28883 perf-stat.ps.cpu-migrations
30219886 ± 2% +15.3% 34840715 ± 4% perf-stat.ps.dTLB-load-misses
2.611e+10 -46.6% 1.394e+10 perf-stat.ps.dTLB-loads
9227229 ± 2% +16.5% 10750151 ± 2% perf-stat.ps.dTLB-store-misses
8.41e+09 +14.0% 9.589e+09 perf-stat.ps.dTLB-stores
9924900 ± 3% +10.6% 10979169 perf-stat.ps.iTLB-load-misses
6942519 ± 6% +11.0% 7703456 ± 3% perf-stat.ps.iTLB-loads
1.199e+11 -27.7% 8.677e+10 perf-stat.ps.instructions
1049500 +14.4% 1200625 perf-stat.ps.minor-faults
31720844 +14.5% 36309072 perf-stat.ps.node-load-misses
1412728 +18.6% 1675767 perf-stat.ps.node-loads
11012648 +20.5% 13272663 perf-stat.ps.node-store-misses
5262509 +12.9% 5939677 perf-stat.ps.node-stores
1049482 +14.4% 1200592 perf-stat.ps.page-faults
3.639e+13 -27.8% 2.628e+13 perf-stat.total.instructions
20170 ± 8% +25.1% 25230 ± 9% softirqs.CPU10.NET_RX
20686 ± 3% +17.3% 24261 ± 7% softirqs.CPU100.NET_RX
20272 ± 8% +16.8% 23675 ± 6% softirqs.CPU101.NET_RX
20325 ± 8% +14.7% 23319 ± 4% softirqs.CPU102.NET_RX
20217 ± 7% +10.7% 22388 ± 3% softirqs.CPU103.NET_RX
18997 ± 10% +22.9% 23346 ± 6% softirqs.CPU104.NET_RX
19116 ± 6% +21.2% 23173 ± 10% softirqs.CPU105.NET_RX
19420 ± 6% +21.8% 23650 ± 5% softirqs.CPU108.NET_RX
19159 ± 4% +25.6% 24060 ± 9% softirqs.CPU109.NET_RX
18873 ± 2% +23.9% 23386 ± 8% softirqs.CPU111.NET_RX
18960 ± 6% +22.5% 23228 ± 10% softirqs.CPU112.NET_RX
19454 ± 4% +26.2% 24557 ± 13% softirqs.CPU113.NET_RX
19749 ± 8% +19.9% 23687 ± 5% softirqs.CPU114.NET_RX
19345 ± 6% +21.0% 23404 ± 10% softirqs.CPU115.NET_RX
18368 ± 3% +23.6% 22712 ± 6% softirqs.CPU116.NET_RX
18958 ± 7% +16.9% 22157 ± 5% softirqs.CPU117.NET_RX
18466 ± 3% +22.6% 22641 ± 15% softirqs.CPU118.NET_RX
19569 ± 5% +20.9% 23663 ± 6% softirqs.CPU119.NET_RX
19691 ± 5% +22.5% 24128 ± 12% softirqs.CPU14.NET_RX
18950 ± 8% +23.0% 23301 ± 2% softirqs.CPU145.NET_RX
20085 ± 4% +11.9% 22475 ± 4% softirqs.CPU147.NET_RX
20144 ± 6% +10.9% 22341 softirqs.CPU150.NET_RX
20179 ± 6% +9.5% 22098 ± 6% softirqs.CPU151.NET_RX
19813 ± 7% +13.6% 22512 ± 4% softirqs.CPU154.NET_RX
18831 ± 10% +23.5% 23250 ± 9% softirqs.CPU155.NET_RX
20132 ± 8% +12.4% 22621 ± 4% softirqs.CPU158.NET_RX
19425 ± 8% +17.7% 22864 ± 4% softirqs.CPU162.NET_RX
20083 ± 4% +11.4% 22376 ± 6% softirqs.CPU163.NET_RX
19186 ± 2% +16.1% 22270 ± 6% softirqs.CPU164.NET_RX
19970 ± 2% +13.0% 22572 ± 5% softirqs.CPU165.NET_RX
19481 ± 7% +17.0% 22788 ± 2% softirqs.CPU166.NET_RX
18401 ± 3% +18.4% 21777 softirqs.CPU168.NET_RX
96164 ± 3% +24.9% 120061 ± 18% softirqs.CPU168.TIMER
19665 ± 5% +19.9% 23572 ± 8% softirqs.CPU17.NET_RX
19340 ± 5% +17.2% 22672 ± 6% softirqs.CPU170.NET_RX
19774 +13.8% 22496 ± 10% softirqs.CPU171.NET_RX
19537 ± 4% +12.9% 22065 ± 5% softirqs.CPU173.NET_RX
18996 ± 2% +17.2% 22270 ± 3% softirqs.CPU175.NET_RX
19428 ± 4% +14.2% 22190 ± 6% softirqs.CPU176.NET_RX
19516 ± 4% +18.6% 23153 ± 4% softirqs.CPU178.NET_RX
19362 +19.6% 23166 ± 4% softirqs.CPU179.NET_RX
19521 ± 4% +19.3% 23291 ± 5% softirqs.CPU18.NET_RX
18831 ± 5% +20.2% 22632 ± 6% softirqs.CPU181.NET_RX
20128 ± 4% +9.7% 22083 ± 6% softirqs.CPU182.NET_RX
18611 ± 5% +20.1% 22352 ± 6% softirqs.CPU183.NET_RX
19180 ± 2% +14.2% 21901 ± 3% softirqs.CPU185.NET_RX
19131 ± 9% +17.3% 22435 ± 4% softirqs.CPU187.NET_RX
19607 ± 8% +15.7% 22694 ± 5% softirqs.CPU188.NET_RX
17623 ± 6% +28.5% 22652 ± 4% softirqs.CPU189.NET_RX
19299 ± 2% +20.6% 23282 ± 10% softirqs.CPU19.NET_RX
17793 +21.4% 21595 ± 8% softirqs.CPU190.NET_RX
18271 ± 8% +21.5% 22191 ± 3% softirqs.CPU191.NET_RX
19529 ± 6% +22.6% 23942 ± 4% softirqs.CPU2.NET_RX
19642 ± 8% +24.2% 24388 ± 6% softirqs.CPU20.NET_RX
19714 ± 8% +23.9% 24419 ± 7% softirqs.CPU22.NET_RX
19471 ± 5% +22.0% 23760 ± 9% softirqs.CPU23.NET_RX
19847 ± 6% +17.9% 23397 ± 8% softirqs.CPU3.NET_RX
21699 ± 6% +18.7% 25766 ± 4% softirqs.CPU33.NET_RX
21333 ± 8% +16.9% 24932 ± 3% softirqs.CPU36.NET_RX
20701 ± 8% +17.9% 24417 ± 6% softirqs.CPU40.NET_RX
20096 ± 3% +22.8% 24684 ± 5% softirqs.CPU5.NET_RX
20062 ± 7% +16.4% 23347 ± 2% softirqs.CPU53.NET_RX
20095 ± 4% +13.5% 22801 ± 2% softirqs.CPU54.NET_RX
19655 ± 6% +16.6% 22919 ± 8% softirqs.CPU6.NET_RX
20156 ± 10% +12.1% 22596 ± 5% softirqs.CPU61.NET_RX
20324 ± 4% +9.6% 22267 ± 4% softirqs.CPU62.NET_RX
20024 ± 3% +12.3% 22483 ± 4% softirqs.CPU66.NET_RX
19892 ± 9% +15.8% 23037 ± 6% softirqs.CPU67.NET_RX
19055 ± 4% +12.9% 21505 ± 5% softirqs.CPU69.NET_RX
20122 ± 4% +16.4% 23432 ± 4% softirqs.CPU7.NET_RX
19236 ± 3% +18.0% 22703 ± 5% softirqs.CPU72.NET_RX
19434 ± 7% +17.5% 22830 ± 6% softirqs.CPU73.NET_RX
19804 ± 9% +21.2% 24009 ± 6% softirqs.CPU76.NET_RX
19495 ± 2% +15.8% 22569 ± 14% softirqs.CPU77.NET_RX
19944 ± 4% +14.3% 22806 ± 5% softirqs.CPU78.NET_RX
18365 ± 2% +26.8% 23292 ± 7% softirqs.CPU79.NET_RX
18194 ± 4% +34.1% 24390 ± 3% softirqs.CPU80.NET_RX
18445 ± 5% +28.7% 23743 ± 6% softirqs.CPU85.NET_RX
19844 ± 5% +11.1% 22055 ± 2% softirqs.CPU86.NET_RX
18291 +19.9% 21937 ± 4% softirqs.CPU87.NET_RX
20581 ± 5% +11.9% 23024 ± 5% softirqs.CPU88.NET_RX
19658 ± 4% +13.0% 22213 ± 7% softirqs.CPU89.NET_RX
19435 ± 7% +26.7% 24630 ± 9% softirqs.CPU9.NET_RX
18791 ± 9% +20.9% 22720 ± 7% softirqs.CPU90.NET_RX
20075 ± 5% +13.9% 22866 ± 8% softirqs.CPU91.NET_RX
18815 ± 7% +17.0% 22010 ± 3% softirqs.CPU92.NET_RX
19062 ± 4% +12.6% 21458 ± 6% softirqs.CPU94.NET_RX
18849 +14.9% 21652 ± 6% softirqs.CPU95.NET_RX
19355 ± 7% +22.8% 23777 ± 6% softirqs.CPU96.NET_RX
68653 ± 13% -16.0% 57672 ± 2% softirqs.CPU96.RCU
20213 ± 4% +21.3% 24512 ± 7% softirqs.CPU98.NET_RX
19933 ± 6% +26.1% 25141 ± 5% softirqs.CPU99.NET_RX
3895703 +13.8% 4432340 softirqs.NET_RX
350.50 ± 91% -56.9% 151.00 interrupts.132:PCI-MSI.1574914-edge.eth3-TxRx-2
159.50 ± 5% -5.0% 151.50 ± 3% interrupts.185:PCI-MSI.1574967-edge.eth3-TxRx-55
821755 +9.5% 900223 ± 8% interrupts.CAL:Function_call_interrupts
679.75 ± 7% +23.2% 837.50 ± 5% interrupts.CPU0.TLB:TLB_shootdowns
675.50 ± 2% +13.8% 768.75 ± 7% interrupts.CPU1.TLB:TLB_shootdowns
673.25 ± 7% +30.9% 881.25 ± 8% interrupts.CPU10.TLB:TLB_shootdowns
726.25 ± 9% +20.6% 875.50 ± 6% interrupts.CPU100.TLB:TLB_shootdowns
3050 -9.9% 2749 ± 6% interrupts.CPU102.RES:Rescheduling_interrupts
2997 -9.0% 2728 ± 5% interrupts.CPU103.RES:Rescheduling_interrupts
3112 ± 2% -15.1% 2644 ± 6% interrupts.CPU104.RES:Rescheduling_interrupts
701.75 ± 7% +21.9% 855.50 ± 8% interrupts.CPU104.TLB:TLB_shootdowns
654.75 ± 5% +20.2% 786.75 ± 8% interrupts.CPU105.TLB:TLB_shootdowns
4044 ± 20% -53.3% 1890 ± 47% interrupts.CPU106.NMI:Non-maskable_interrupts
4044 ± 20% -53.3% 1890 ± 47% interrupts.CPU106.PMI:Performance_monitoring_interrupts
3115 ± 4% -15.2% 2641 ± 4% interrupts.CPU106.RES:Rescheduling_interrupts
678.00 ± 4% +28.7% 872.75 ± 9% interrupts.CPU106.TLB:TLB_shootdowns
2980 ± 4% -14.6% 2545 ± 5% interrupts.CPU107.RES:Rescheduling_interrupts
3064 -10.7% 2735 ± 3% interrupts.CPU11.RES:Rescheduling_interrupts
666.25 ± 10% +18.3% 788.50 ± 7% interrupts.CPU11.TLB:TLB_shootdowns
3007 -13.7% 2596 ± 5% interrupts.CPU110.RES:Rescheduling_interrupts
666.25 ± 6% +28.7% 857.75 ± 6% interrupts.CPU110.TLB:TLB_shootdowns
3047 ± 2% -14.1% 2617 ± 5% interrupts.CPU111.RES:Rescheduling_interrupts
2964 ± 3% -11.6% 2621 ± 6% interrupts.CPU112.RES:Rescheduling_interrupts
656.75 ± 4% +32.1% 867.25 ± 7% interrupts.CPU112.TLB:TLB_shootdowns
2950 ± 2% -15.8% 2484 ± 6% interrupts.CPU113.RES:Rescheduling_interrupts
674.75 ± 11% +29.1% 871.00 ± 13% interrupts.CPU114.TLB:TLB_shootdowns
655.50 ± 8% +24.2% 814.00 ± 7% interrupts.CPU115.TLB:TLB_shootdowns
3065 ± 3% -8.7% 2797 ± 6% interrupts.CPU116.RES:Rescheduling_interrupts
680.00 ± 8% +24.0% 843.00 ± 6% interrupts.CPU116.TLB:TLB_shootdowns
727.75 +11.7% 813.00 ± 5% interrupts.CPU118.TLB:TLB_shootdowns
1864 ± 39% +45.0% 2703 ± 18% interrupts.CPU119.NMI:Non-maskable_interrupts
1864 ± 39% +45.0% 2703 ± 18% interrupts.CPU119.PMI:Performance_monitoring_interrupts
2865 ± 4% -12.3% 2514 ± 7% interrupts.CPU119.RES:Rescheduling_interrupts
721.00 ± 10% +12.1% 808.00 ± 6% interrupts.CPU119.TLB:TLB_shootdowns
722.00 ± 5% +15.0% 830.25 ± 10% interrupts.CPU12.TLB:TLB_shootdowns
678.25 ± 11% +23.7% 838.75 ± 12% interrupts.CPU120.TLB:TLB_shootdowns
3067 -13.3% 2658 ± 5% interrupts.CPU121.RES:Rescheduling_interrupts
681.00 ± 14% +25.3% 853.00 ± 6% interrupts.CPU122.TLB:TLB_shootdowns
679.50 ± 3% +23.0% 835.75 ± 6% interrupts.CPU123.TLB:TLB_shootdowns
717.75 ± 9% +27.8% 917.25 ± 7% interrupts.CPU124.TLB:TLB_shootdowns
622.25 ± 7% +33.1% 828.25 ± 8% interrupts.CPU125.TLB:TLB_shootdowns
3043 ± 3% -13.8% 2621 ± 4% interrupts.CPU127.RES:Rescheduling_interrupts
680.25 ± 4% +17.7% 800.50 ± 6% interrupts.CPU127.TLB:TLB_shootdowns
4441 ± 11% -43.6% 2504 ± 39% interrupts.CPU128.NMI:Non-maskable_interrupts
4441 ± 11% -43.6% 2504 ± 39% interrupts.CPU128.PMI:Performance_monitoring_interrupts
689.75 ± 12% +21.7% 839.25 ± 7% interrupts.CPU128.TLB:TLB_shootdowns
3177 ± 6% -10.7% 2838 ± 5% interrupts.CPU129.RES:Rescheduling_interrupts
641.75 ± 13% +32.2% 848.50 ± 10% interrupts.CPU129.TLB:TLB_shootdowns
710.25 ± 8% +22.5% 870.00 ± 5% interrupts.CPU13.TLB:TLB_shootdowns
668.25 ± 9% +32.2% 883.75 ± 13% interrupts.CPU130.TLB:TLB_shootdowns
2979 ± 3% -13.1% 2589 ± 5% interrupts.CPU131.RES:Rescheduling_interrupts
731.00 ± 2% +15.5% 844.50 ± 2% interrupts.CPU131.TLB:TLB_shootdowns
4226 +13.3% 4787 ± 9% interrupts.CPU133.CAL:Function_call_interrupts
3111 -16.0% 2613 ± 3% interrupts.CPU133.RES:Rescheduling_interrupts
652.75 ± 6% +22.6% 800.50 ± 8% interrupts.CPU133.TLB:TLB_shootdowns
630.75 ± 5% +36.1% 858.75 ± 3% interrupts.CPU134.TLB:TLB_shootdowns
3086 ± 3% -16.4% 2581 ± 5% interrupts.CPU135.RES:Rescheduling_interrupts
673.00 ± 8% +28.5% 864.75 ± 2% interrupts.CPU135.TLB:TLB_shootdowns
3009 ± 4% -11.5% 2662 ± 8% interrupts.CPU137.RES:Rescheduling_interrupts
700.50 ± 9% +15.1% 806.00 ± 8% interrupts.CPU137.TLB:TLB_shootdowns
2987 ± 2% -15.1% 2535 ± 4% interrupts.CPU138.RES:Rescheduling_interrupts
685.75 ± 10% +19.3% 818.00 ± 11% interrupts.CPU138.TLB:TLB_shootdowns
669.00 ± 4% +22.6% 820.25 ± 5% interrupts.CPU139.TLB:TLB_shootdowns
3150 ± 2% -12.0% 2771 ± 5% interrupts.CPU14.RES:Rescheduling_interrupts
4133 ± 24% -59.3% 1682 ± 63% interrupts.CPU141.NMI:Non-maskable_interrupts
4133 ± 24% -59.3% 1682 ± 63% interrupts.CPU141.PMI:Performance_monitoring_interrupts
3008 ± 4% -15.6% 2540 ± 5% interrupts.CPU141.RES:Rescheduling_interrupts
658.50 ± 3% +25.4% 825.75 ± 13% interrupts.CPU141.TLB:TLB_shootdowns
3002 ± 3% -15.0% 2551 ± 6% interrupts.CPU142.RES:Rescheduling_interrupts
4119 ± 24% -52.4% 1962 ± 47% interrupts.CPU143.NMI:Non-maskable_interrupts
4119 ± 24% -52.4% 1962 ± 47% interrupts.CPU143.PMI:Performance_monitoring_interrupts
2990 ± 2% -16.4% 2498 ± 4% interrupts.CPU143.RES:Rescheduling_interrupts
719.25 ± 5% +16.6% 838.50 ± 6% interrupts.CPU143.TLB:TLB_shootdowns
4573 ± 8% -40.0% 2742 ± 34% interrupts.CPU144.NMI:Non-maskable_interrupts
4573 ± 8% -40.0% 2742 ± 34% interrupts.CPU144.PMI:Performance_monitoring_interrupts
3116 -12.4% 2728 ± 4% interrupts.CPU144.RES:Rescheduling_interrupts
3035 ± 4% -13.5% 2626 interrupts.CPU145.RES:Rescheduling_interrupts
675.25 +30.0% 878.00 ± 3% interrupts.CPU145.TLB:TLB_shootdowns
683.25 +21.0% 826.75 ± 8% interrupts.CPU146.TLB:TLB_shootdowns
664.50 ± 8% +31.9% 876.25 ± 8% interrupts.CPU147.TLB:TLB_shootdowns
744.00 ± 10% +15.9% 862.00 ± 4% interrupts.CPU148.TLB:TLB_shootdowns
2970 ± 3% -11.4% 2630 ± 5% interrupts.CPU149.RES:Rescheduling_interrupts
649.25 ± 3% +43.4% 931.00 ± 15% interrupts.CPU149.TLB:TLB_shootdowns
3128 ± 4% -10.5% 2799 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts
3023 ± 4% -14.4% 2588 ± 4% interrupts.CPU150.RES:Rescheduling_interrupts
2960 ± 3% -12.6% 2587 ± 4% interrupts.CPU151.RES:Rescheduling_interrupts
3110 ± 4% -14.4% 2662 ± 3% interrupts.CPU152.RES:Rescheduling_interrupts
691.00 ± 5% +25.9% 870.25 ± 8% interrupts.CPU152.TLB:TLB_shootdowns
4489 ± 9% -64.1% 1610 ± 57% interrupts.CPU153.NMI:Non-maskable_interrupts
4489 ± 9% -64.1% 1610 ± 57% interrupts.CPU153.PMI:Performance_monitoring_interrupts
3102 ± 2% -17.3% 2564 ± 5% interrupts.CPU153.RES:Rescheduling_interrupts
676.00 ± 3% +25.6% 849.25 ± 10% interrupts.CPU153.TLB:TLB_shootdowns
3754 ± 37% -56.8% 1623 ± 55% interrupts.CPU154.NMI:Non-maskable_interrupts
3754 ± 37% -56.8% 1623 ± 55% interrupts.CPU154.PMI:Performance_monitoring_interrupts
2973 ± 2% -13.7% 2567 interrupts.CPU154.RES:Rescheduling_interrupts
695.75 ± 4% +16.5% 810.50 ± 4% interrupts.CPU154.TLB:TLB_shootdowns
2971 ± 2% -13.0% 2585 ± 3% interrupts.CPU155.RES:Rescheduling_interrupts
666.25 ± 7% +19.6% 796.75 ± 9% interrupts.CPU155.TLB:TLB_shootdowns
3029 -11.7% 2674 ± 6% interrupts.CPU156.RES:Rescheduling_interrupts
676.25 ± 6% +28.5% 869.00 ± 11% interrupts.CPU156.TLB:TLB_shootdowns
3180 ± 5% -16.6% 2653 ± 5% interrupts.CPU157.RES:Rescheduling_interrupts
668.25 ± 17% +30.1% 869.25 ± 11% interrupts.CPU157.TLB:TLB_shootdowns
3009 ± 2% -12.9% 2622 ± 4% interrupts.CPU158.RES:Rescheduling_interrupts
651.75 ± 4% +27.0% 827.50 ± 9% interrupts.CPU158.TLB:TLB_shootdowns
3045 ± 3% -15.3% 2580 ± 3% interrupts.CPU159.RES:Rescheduling_interrupts
681.75 ± 9% +25.2% 853.25 ± 6% interrupts.CPU16.TLB:TLB_shootdowns
3108 ± 2% -21.0% 2454 ± 6% interrupts.CPU160.RES:Rescheduling_interrupts
632.50 ± 5% +35.0% 853.75 ± 13% interrupts.CPU160.TLB:TLB_shootdowns
2917 ± 4% -16.4% 2438 ± 3% interrupts.CPU161.RES:Rescheduling_interrupts
3012 -15.8% 2536 ± 5% interrupts.CPU162.RES:Rescheduling_interrupts
662.50 ± 2% +27.8% 847.00 ± 13% interrupts.CPU163.TLB:TLB_shootdowns
3061 ± 2% -16.6% 2552 ± 2% interrupts.CPU164.RES:Rescheduling_interrupts
692.50 ± 7% +19.8% 829.75 ± 9% interrupts.CPU164.TLB:TLB_shootdowns
3009 -17.0% 2498 ± 6% interrupts.CPU165.RES:Rescheduling_interrupts
657.50 ± 10% +22.3% 804.25 ± 5% interrupts.CPU165.TLB:TLB_shootdowns
3033 ± 5% -20.7% 2406 ± 4% interrupts.CPU166.RES:Rescheduling_interrupts
2998 ± 5% -19.9% 2400 ± 5% interrupts.CPU167.RES:Rescheduling_interrupts
695.00 ± 18% +22.2% 849.25 ± 3% interrupts.CPU167.TLB:TLB_shootdowns
3016 -15.9% 2536 ± 6% interrupts.CPU169.RES:Rescheduling_interrupts
723.00 ± 2% +8.0% 780.75 ± 8% interrupts.CPU169.TLB:TLB_shootdowns
712.00 ± 7% +17.8% 839.00 ± 6% interrupts.CPU170.TLB:TLB_shootdowns
3000 -12.9% 2614 ± 6% interrupts.CPU171.RES:Rescheduling_interrupts
3006 ± 2% -12.3% 2635 ± 3% interrupts.CPU172.RES:Rescheduling_interrupts
691.50 ± 11% +30.4% 901.50 ± 8% interrupts.CPU172.TLB:TLB_shootdowns
3084 ± 3% -16.1% 2587 ± 4% interrupts.CPU173.RES:Rescheduling_interrupts
732.00 ± 4% +19.7% 876.50 ± 7% interrupts.CPU173.TLB:TLB_shootdowns
3090 ± 4% -16.8% 2572 ± 2% interrupts.CPU174.RES:Rescheduling_interrupts
753.75 ± 3% +14.6% 863.50 ± 7% interrupts.CPU174.TLB:TLB_shootdowns
3010 ± 3% -14.7% 2567 ± 3% interrupts.CPU175.RES:Rescheduling_interrupts
682.00 ± 5% +18.2% 806.00 ± 8% interrupts.CPU175.TLB:TLB_shootdowns
3009 ± 3% -11.7% 2658 ± 6% interrupts.CPU176.RES:Rescheduling_interrupts
3069 -12.2% 2693 ± 4% interrupts.CPU177.RES:Rescheduling_interrupts
710.75 ± 5% +23.8% 879.75 ± 9% interrupts.CPU177.TLB:TLB_shootdowns
3044 ± 4% -13.8% 2625 ± 2% interrupts.CPU178.RES:Rescheduling_interrupts
2973 ± 2% -12.5% 2600 ± 3% interrupts.CPU179.RES:Rescheduling_interrupts
634.75 ± 13% +30.8% 830.00 ± 8% interrupts.CPU179.TLB:TLB_shootdowns
623.50 ± 5% +32.4% 825.75 ± 9% interrupts.CPU18.TLB:TLB_shootdowns
2858 ± 3% -9.6% 2584 ± 5% interrupts.CPU181.RES:Rescheduling_interrupts
678.50 ± 3% +18.2% 801.75 ± 5% interrupts.CPU181.TLB:TLB_shootdowns
3091 ± 2% -8.1% 2842 ± 4% interrupts.CPU182.RES:Rescheduling_interrupts
695.75 ± 6% +18.4% 823.75 ± 10% interrupts.CPU182.TLB:TLB_shootdowns
669.50 ± 5% +22.8% 822.25 ± 7% interrupts.CPU183.TLB:TLB_shootdowns
2969 ± 3% -13.1% 2580 ± 6% interrupts.CPU184.RES:Rescheduling_interrupts
698.00 ± 13% +21.7% 849.75 ± 3% interrupts.CPU184.TLB:TLB_shootdowns
2904 -11.7% 2563 interrupts.CPU185.RES:Rescheduling_interrupts
686.00 ± 6% +24.7% 855.75 ± 4% interrupts.CPU185.TLB:TLB_shootdowns
2984 ± 2% -14.0% 2565 ± 4% interrupts.CPU186.RES:Rescheduling_interrupts
670.25 ± 5% +31.7% 882.50 ± 4% interrupts.CPU186.TLB:TLB_shootdowns
2929 -9.9% 2639 ± 5% interrupts.CPU187.RES:Rescheduling_interrupts
683.00 ± 7% +26.4% 863.25 ± 13% interrupts.CPU187.TLB:TLB_shootdowns
3132 -11.9% 2761 ± 5% interrupts.CPU188.RES:Rescheduling_interrupts
723.25 ± 3% +13.7% 822.00 ± 3% interrupts.CPU188.TLB:TLB_shootdowns
2950 ± 4% -10.6% 2638 ± 4% interrupts.CPU189.RES:Rescheduling_interrupts
2969 ± 5% -13.8% 2559 ± 5% interrupts.CPU190.RES:Rescheduling_interrupts
2956 ± 4% -15.2% 2505 ± 4% interrupts.CPU191.RES:Rescheduling_interrupts
714.00 ± 8% +13.4% 810.00 ± 8% interrupts.CPU191.TLB:TLB_shootdowns
350.50 ± 91% -56.9% 151.00 interrupts.CPU2.132:PCI-MSI.1574914-edge.eth3-TxRx-2
646.00 ± 14% +22.9% 794.25 ± 11% interrupts.CPU21.TLB:TLB_shootdowns
686.25 ± 4% +18.8% 815.50 ± 5% interrupts.CPU23.TLB:TLB_shootdowns
657.00 ± 13% +29.8% 852.50 ± 6% interrupts.CPU25.TLB:TLB_shootdowns
678.00 ± 13% +22.6% 831.00 ± 11% interrupts.CPU26.TLB:TLB_shootdowns
4186 ± 21% -39.7% 2522 ± 18% interrupts.CPU27.NMI:Non-maskable_interrupts
4186 ± 21% -39.7% 2522 ± 18% interrupts.CPU27.PMI:Performance_monitoring_interrupts
642.00 ± 12% +30.6% 838.50 ± 14% interrupts.CPU27.TLB:TLB_shootdowns
697.50 ± 3% +22.7% 855.75 ± 11% interrupts.CPU28.TLB:TLB_shootdowns
4068 ± 17% -36.8% 2572 ± 19% interrupts.CPU29.NMI:Non-maskable_interrupts
4068 ± 17% -36.8% 2572 ± 19% interrupts.CPU29.PMI:Performance_monitoring_interrupts
681.25 ± 3% +20.8% 822.75 ± 8% interrupts.CPU30.TLB:TLB_shootdowns
3706 ± 19% -31.5% 2537 ± 16% interrupts.CPU31.NMI:Non-maskable_interrupts
3706 ± 19% -31.5% 2537 ± 16% interrupts.CPU31.PMI:Performance_monitoring_interrupts
3101 ± 2% -10.9% 2761 ± 6% interrupts.CPU31.RES:Rescheduling_interrupts
645.75 ± 8% +25.3% 809.25 ± 9% interrupts.CPU32.TLB:TLB_shootdowns
676.25 ± 12% +20.5% 815.00 ± 8% interrupts.CPU34.TLB:TLB_shootdowns
3091 ± 4% -12.4% 2707 ± 3% interrupts.CPU35.RES:Rescheduling_interrupts
717.75 ± 8% +15.4% 828.00 ± 7% interrupts.CPU35.TLB:TLB_shootdowns
4065 ± 12% -29.5% 2866 ± 22% interrupts.CPU36.NMI:Non-maskable_interrupts
4065 ± 12% -29.5% 2866 ± 22% interrupts.CPU36.PMI:Performance_monitoring_interrupts
4035 ± 12% -31.4% 2768 ± 19% interrupts.CPU37.NMI:Non-maskable_interrupts
4035 ± 12% -31.4% 2768 ± 19% interrupts.CPU37.PMI:Performance_monitoring_interrupts
3038 ± 2% -7.1% 2822 ± 3% interrupts.CPU37.RES:Rescheduling_interrupts
686.75 ± 8% +26.0% 865.25 ± 6% interrupts.CPU37.TLB:TLB_shootdowns
704.50 ± 2% +15.0% 810.50 ± 7% interrupts.CPU38.TLB:TLB_shootdowns
656.50 ± 7% +25.9% 826.50 ± 8% interrupts.CPU39.TLB:TLB_shootdowns
707.75 ± 7% +19.6% 846.25 ± 6% interrupts.CPU4.TLB:TLB_shootdowns
4486 ± 11% -38.8% 2747 ± 18% interrupts.CPU40.NMI:Non-maskable_interrupts
4486 ± 11% -38.8% 2747 ± 18% interrupts.CPU40.PMI:Performance_monitoring_interrupts
4169 ± 18% -37.9% 2590 ± 23% interrupts.CPU41.NMI:Non-maskable_interrupts
4169 ± 18% -37.9% 2590 ± 23% interrupts.CPU41.PMI:Performance_monitoring_interrupts
3072 -11.0% 2733 ± 5% interrupts.CPU41.RES:Rescheduling_interrupts
655.50 ± 5% +27.6% 836.25 ± 8% interrupts.CPU41.TLB:TLB_shootdowns
673.75 ± 8% +26.2% 850.00 ± 16% interrupts.CPU42.TLB:TLB_shootdowns
651.50 ± 7% +25.0% 814.25 ± 8% interrupts.CPU43.TLB:TLB_shootdowns
697.75 ± 12% +18.7% 828.50 ± 4% interrupts.CPU44.TLB:TLB_shootdowns
646.50 ± 9% +39.5% 902.00 ± 6% interrupts.CPU45.TLB:TLB_shootdowns
4254 ± 2% +11.7% 4753 ± 7% interrupts.CPU46.CAL:Function_call_interrupts
683.25 +18.2% 807.75 ± 8% interrupts.CPU46.TLB:TLB_shootdowns
701.50 ± 7% +21.2% 850.00 ± 4% interrupts.CPU47.TLB:TLB_shootdowns
717.25 ± 9% +13.2% 811.75 ± 5% interrupts.CPU49.TLB:TLB_shootdowns
715.50 ± 5% +12.4% 804.00 ± 4% interrupts.CPU5.TLB:TLB_shootdowns
671.50 ± 2% +21.3% 814.25 ± 9% interrupts.CPU50.TLB:TLB_shootdowns
671.50 ± 6% +30.8% 878.50 ± 10% interrupts.CPU52.TLB:TLB_shootdowns
3731 ± 19% -41.7% 2176 ± 3% interrupts.CPU53.NMI:Non-maskable_interrupts
3731 ± 19% -41.7% 2176 ± 3% interrupts.CPU53.PMI:Performance_monitoring_interrupts
681.00 ± 8% +27.7% 869.50 ± 6% interrupts.CPU54.TLB:TLB_shootdowns
159.50 ± 5% -5.0% 151.50 ± 3% interrupts.CPU55.185:PCI-MSI.1574967-edge.eth3-TxRx-55
4032 ± 13% -31.9% 2745 ± 21% interrupts.CPU56.NMI:Non-maskable_interrupts
4032 ± 13% -31.9% 2745 ± 21% interrupts.CPU56.PMI:Performance_monitoring_interrupts
611.50 ± 5% +40.4% 858.75 ± 8% interrupts.CPU56.TLB:TLB_shootdowns
668.25 ± 12% +26.7% 846.50 ± 5% interrupts.CPU57.TLB:TLB_shootdowns
3098 -8.9% 2822 ± 4% interrupts.CPU58.RES:Rescheduling_interrupts
660.50 ± 5% +29.4% 854.75 ± 5% interrupts.CPU58.TLB:TLB_shootdowns
3042 ± 2% -9.3% 2759 ± 5% interrupts.CPU59.RES:Rescheduling_interrupts
683.50 ± 12% +27.8% 873.25 ± 6% interrupts.CPU6.TLB:TLB_shootdowns
3773 ± 23% -35.5% 2435 ± 20% interrupts.CPU61.NMI:Non-maskable_interrupts
3773 ± 23% -35.5% 2435 ± 20% interrupts.CPU61.PMI:Performance_monitoring_interrupts
660.75 ± 8% +25.8% 831.00 ± 9% interrupts.CPU61.TLB:TLB_shootdowns
3791 ± 22% -33.9% 2505 ± 19% interrupts.CPU62.NMI:Non-maskable_interrupts
3791 ± 22% -33.9% 2505 ± 19% interrupts.CPU62.PMI:Performance_monitoring_interrupts
3151 ± 3% -9.5% 2851 ± 4% interrupts.CPU62.RES:Rescheduling_interrupts
682.25 ± 6% +23.7% 844.00 interrupts.CPU62.TLB:TLB_shootdowns
690.50 ± 8% +21.1% 836.00 ± 6% interrupts.CPU63.TLB:TLB_shootdowns
3738 ± 23% -34.1% 2464 ± 18% interrupts.CPU64.NMI:Non-maskable_interrupts
3738 ± 23% -34.1% 2464 ± 18% interrupts.CPU64.PMI:Performance_monitoring_interrupts
2999 ± 5% -9.7% 2707 ± 5% interrupts.CPU64.RES:Rescheduling_interrupts
651.50 ± 4% +28.8% 839.00 ± 13% interrupts.CPU64.TLB:TLB_shootdowns
3722 ± 22% -47.9% 1941 ± 25% interrupts.CPU65.NMI:Non-maskable_interrupts
3722 ± 22% -47.9% 1941 ± 25% interrupts.CPU65.PMI:Performance_monitoring_interrupts
3051 ± 2% -10.2% 2739 ± 2% interrupts.CPU65.RES:Rescheduling_interrupts
624.50 ± 2% +32.9% 829.75 ± 12% interrupts.CPU65.TLB:TLB_shootdowns
4125 ± 3% +14.5% 4722 ± 8% interrupts.CPU66.CAL:Function_call_interrupts
3696 ± 21% -49.6% 1862 ± 24% interrupts.CPU66.NMI:Non-maskable_interrupts
3696 ± 21% -49.6% 1862 ± 24% interrupts.CPU66.PMI:Performance_monitoring_interrupts
718.00 ± 4% +15.8% 831.50 ± 9% interrupts.CPU66.TLB:TLB_shootdowns
623.50 ± 8% +35.9% 847.50 ± 7% interrupts.CPU68.TLB:TLB_shootdowns
3097 ± 2% -9.0% 2817 ± 5% interrupts.CPU7.RES:Rescheduling_interrupts
3125 ± 2% -12.1% 2748 ± 2% interrupts.CPU70.RES:Rescheduling_interrupts
3020 -13.7% 2606 ± 9% interrupts.CPU71.RES:Rescheduling_interrupts
731.00 ± 3% +13.7% 831.00 ± 8% interrupts.CPU71.TLB:TLB_shootdowns
697.75 ± 5% +18.2% 825.00 ± 3% interrupts.CPU72.TLB:TLB_shootdowns
675.50 ± 9% +23.9% 837.25 ± 4% interrupts.CPU73.TLB:TLB_shootdowns
673.25 ± 3% +39.1% 936.50 ± 9% interrupts.CPU75.TLB:TLB_shootdowns
702.75 ± 6% +17.1% 822.75 ± 9% interrupts.CPU76.TLB:TLB_shootdowns
763.00 ± 4% +18.0% 900.25 ± 3% interrupts.CPU79.TLB:TLB_shootdowns
633.75 ± 9% +28.2% 812.25 ± 10% interrupts.CPU8.TLB:TLB_shootdowns
694.75 ± 14% +24.4% 864.50 ± 9% interrupts.CPU80.TLB:TLB_shootdowns
3260 ± 3% -10.3% 2925 ± 2% interrupts.CPU81.RES:Rescheduling_interrupts
681.50 ± 11% +18.5% 807.50 ± 7% interrupts.CPU81.TLB:TLB_shootdowns
3109 -13.4% 2692 ± 6% interrupts.CPU83.RES:Rescheduling_interrupts
687.25 ± 3% +15.8% 796.00 ± 3% interrupts.CPU83.TLB:TLB_shootdowns
657.25 ± 12% +28.1% 841.75 ± 10% interrupts.CPU84.TLB:TLB_shootdowns
703.00 ± 9% +18.1% 830.50 ± 4% interrupts.CPU85.TLB:TLB_shootdowns
652.25 ± 3% +32.2% 862.25 ± 7% interrupts.CPU87.TLB:TLB_shootdowns
3356 ± 12% -20.1% 2681 ± 7% interrupts.CPU88.RES:Rescheduling_interrupts
720.50 ± 6% +19.4% 860.00 ± 5% interrupts.CPU88.TLB:TLB_shootdowns
2987 ± 2% -12.4% 2618 ± 3% interrupts.CPU89.RES:Rescheduling_interrupts
680.75 ± 13% +24.8% 849.50 ± 9% interrupts.CPU89.TLB:TLB_shootdowns
685.25 ± 18% +27.8% 876.00 ± 9% interrupts.CPU9.TLB:TLB_shootdowns
3040 -10.5% 2721 ± 5% interrupts.CPU90.RES:Rescheduling_interrupts
683.25 ± 10% +19.6% 817.50 ± 6% interrupts.CPU93.TLB:TLB_shootdowns
606.75 +34.8% 817.75 ± 11% interrupts.CPU94.TLB:TLB_shootdowns
3088 ± 2% -12.7% 2696 ± 7% interrupts.CPU97.RES:Rescheduling_interrupts
665.25 ± 5% +26.3% 840.00 ± 2% interrupts.CPU97.TLB:TLB_shootdowns
659.50 ± 8% +37.8% 909.00 ± 10% interrupts.CPU98.TLB:TLB_shootdowns
651.75 ± 5% +26.9% 826.75 ± 10% interrupts.CPU99.TLB:TLB_shootdowns
132589 ± 3% +20.8% 160160 ± 6% interrupts.TLB:TLB_shootdowns
24.75 ± 2% -17.4 7.35 ± 7% perf-profile.calltrace.cycles.osq_lock.rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables
22.04 ± 2% -15.5 6.50 ± 6% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.exit_mmap
22.15 ± 2% -15.5 6.63 ± 6% perf-profile.calltrace.cycles.down_write.unlink_file_vma.free_pgtables.exit_mmap.mmput
40.37 ± 11% -15.0 25.41 ± 12% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe
40.38 ± 11% -15.0 25.42 ± 12% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe
17.99 ± 2% -13.0 4.96 ± 7% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.dup_mm.copy_process._do_fork
18.07 ± 2% -13.0 5.08 ± 7% perf-profile.calltrace.cycles.down_write.dup_mm.copy_process._do_fork.do_syscall_64
17.76 ± 2% -13.0 4.78 ± 7% perf-profile.calltrace.cycles.osq_lock.rwsem_down_write_failed.down_write.dup_mm.copy_process
16.51 ± 2% -11.7 4.76 ± 7% perf-profile.calltrace.cycles.unlink_file_vma.free_pgtables.exit_mmap.mmput.do_exit
20.80 ± 3% -11.2 9.63 ± 4% perf-profile.calltrace.cycles.dup_mm.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.40 ± 2% -11.1 6.33 ± 5% perf-profile.calltrace.cycles.free_pgtables.exit_mmap.mmput.do_exit.do_group_exit
20.12 ± 3% -9.1 11.02 ± 3% perf-profile.calltrace.cycles.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group
20.13 ± 3% -9.1 11.03 ± 3% perf-profile.calltrace.cycles.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
16.84 ± 10% -7.5 9.29 ± 5% perf-profile.calltrace.cycles.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
20.95 ± 3% -7.3 13.67 ± 3% perf-profile.calltrace.cycles.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.95 ± 3% -7.3 13.67 ± 3% perf-profile.calltrace.cycles.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.95 ± 3% -7.3 13.67 ± 3% perf-profile.calltrace.cycles.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.64 ± 14% -5.9 7.75 ± 9% perf-profile.calltrace.cycles._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test
13.65 ± 14% -5.9 7.76 ± 9% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test
13.65 ± 14% -5.9 7.76 ± 9% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork.fork_test
14.00 ± 14% -5.8 8.21 ± 9% perf-profile.calltrace.cycles.__libc_fork.fork_test
14.16 ± 14% -5.7 8.47 ± 9% perf-profile.calltrace.cycles.fork_test
7.88 ± 4% -4.7 3.21 ± 9% perf-profile.calltrace.cycles.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
7.90 ± 4% -4.7 3.25 ± 9% perf-profile.calltrace.cycles.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.92 ± 4% -4.6 3.27 ± 9% perf-profile.calltrace.cycles.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.92 ± 4% -4.6 3.27 ± 9% perf-profile.calltrace.cycles.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
6.00 ± 4% -3.7 2.27 ± 10% perf-profile.calltrace.cycles.osq_lock.rwsem_down_write_failed.down_write.__vma_adjust.__split_vma
5.78 ± 4% -3.7 2.06 ± 3% perf-profile.calltrace.cycles.unlink_file_vma.free_pgtables.exit_mmap.mmput.flush_old_exec
6.04 ± 4% -3.6 2.43 ± 2% perf-profile.calltrace.cycles.free_pgtables.exit_mmap.mmput.flush_old_exec.load_elf_binary
6.59 ± 4% -3.1 3.52 ± 7% perf-profile.calltrace.cycles.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler
6.59 ± 4% -3.1 3.54 ± 7% perf-profile.calltrace.cycles.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file
6.62 ± 5% -3.0 3.57 ± 7% perf-profile.calltrace.cycles.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve
4.69 ± 4% -2.8 1.88 ± 9% perf-profile.calltrace.cycles.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
4.55 ± 4% -2.8 1.75 ± 10% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.mprotect_fixup
4.56 ± 4% -2.8 1.77 ± 9% perf-profile.calltrace.cycles.down_write.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey
4.75 ± 4% -2.8 2.00 ± 9% perf-profile.calltrace.cycles.__vma_adjust.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect
4.77 ± 4% -2.7 2.02 ± 8% perf-profile.calltrace.cycles.__split_vma.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64
4.82 ± 4% -2.7 2.12 ± 8% perf-profile.calltrace.cycles.mprotect_fixup.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.84 ± 4% -2.7 2.14 ± 8% perf-profile.calltrace.cycles.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.84 ± 4% -2.7 2.14 ± 8% perf-profile.calltrace.cycles.do_mprotect_pkey.__x64_sys_mprotect.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.20 ± 5% -2.5 4.71 ± 6% perf-profile.calltrace.cycles.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64
7.20 ± 5% -2.5 4.72 ± 6% perf-profile.calltrace.cycles.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.37 ± 3% -2.3 5.11 ± 2% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.execve
7.37 ± 3% -2.3 5.11 ± 2% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
7.37 ± 3% -2.3 5.11 ± 2% perf-profile.calltrace.cycles.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
7.33 ± 3% -2.3 5.07 ± 2% perf-profile.calltrace.cycles.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve
7.39 ± 3% -2.3 5.14 ± 2% perf-profile.calltrace.cycles.execve
3.04 ± 4% -1.9 1.14 ± 9% perf-profile.calltrace.cycles.down_write.vma_link.mmap_region.do_mmap.vm_mmap_pgoff
3.08 ± 4% -1.9 1.18 ± 9% perf-profile.calltrace.cycles.free_pgtables.unmap_region.__do_munmap.mmap_region.do_mmap
3.03 ± 4% -1.9 1.14 ± 10% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.vma_link.mmap_region.do_mmap
3.13 ± 4% -1.9 1.23 ± 9% perf-profile.calltrace.cycles.vma_link.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff
3.00 ± 4% -1.9 1.11 ± 10% perf-profile.calltrace.cycles.osq_lock.rwsem_down_write_failed.down_write.vma_link.mmap_region
3.03 ± 4% -1.9 1.15 ± 10% perf-profile.calltrace.cycles.down_write.unlink_file_vma.free_pgtables.unmap_region.__do_munmap
3.04 ± 4% -1.9 1.16 ± 9% perf-profile.calltrace.cycles.unlink_file_vma.free_pgtables.unmap_region.__do_munmap.mmap_region
3.03 ± 4% -1.9 1.15 ± 10% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.unlink_file_vma.free_pgtables.unmap_region
3.11 ± 4% -1.9 1.24 ± 9% perf-profile.calltrace.cycles.unmap_region.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
3.44 ± 4% -1.5 1.91 ± 7% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
3.44 ± 4% -1.5 1.91 ± 7% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.__libc_fork
3.43 ± 4% -1.5 1.91 ± 7% perf-profile.calltrace.cycles._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fork
3.54 ± 4% -1.5 2.05 ± 7% perf-profile.calltrace.cycles.__libc_fork
1.53 ± 3% -0.9 0.59 ± 9% perf-profile.calltrace.cycles.down_write.__vma_adjust.__split_vma.__do_munmap.mmap_region
1.56 ± 3% -0.9 0.62 ± 8% perf-profile.calltrace.cycles.__split_vma.__do_munmap.mmap_region.do_mmap.vm_mmap_pgoff
1.56 ± 3% -0.9 0.62 ± 8% perf-profile.calltrace.cycles.__vma_adjust.__split_vma.__do_munmap.mmap_region.do_mmap
1.52 ± 3% -0.9 0.59 ± 9% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.__vma_adjust.__split_vma.__do_munmap
0.41 ± 58% +0.3 0.68 ± 6% perf-profile.calltrace.cycles.__vunmap.free_work.process_one_work.worker_thread.kthread
0.41 ± 58% +0.3 0.68 ± 6% perf-profile.calltrace.cycles.free_work.process_one_work.worker_thread.kthread.ret_from_fork
0.68 ± 11% +0.3 0.97 ± 6% perf-profile.calltrace.cycles.kthread.ret_from_fork
0.70 ± 12% +0.3 1.01 ± 7% perf-profile.calltrace.cycles.ret_from_fork
0.42 ± 58% +0.3 0.73 ± 7% perf-profile.calltrace.cycles.process_one_work.worker_thread.kthread.ret_from_fork
0.45 ± 58% +0.3 0.78 ± 6% perf-profile.calltrace.cycles.worker_thread.kthread.ret_from_fork
1.49 ± 9% +0.4 1.85 ± 2% perf-profile.calltrace.cycles.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.27 ±100% +0.4 0.66 ± 11% perf-profile.calltrace.cycles.write
0.13 ±173% +0.4 0.56 ± 6% perf-profile.calltrace.cycles.find_vmap_area.__vunmap.free_work.process_one_work.worker_thread
0.27 ±100% +0.5 0.78 ± 10% perf-profile.calltrace.cycles.brk
0.00 +0.5 0.54 ± 2% perf-profile.calltrace.cycles.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.59 ± 11% +0.5 1.14 ± 7% perf-profile.calltrace.cycles.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.6 0.56 ± 4% perf-profile.calltrace.cycles.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
0.00 +0.6 0.56 ± 4% perf-profile.calltrace.cycles.ksys_sync.__x64_sys_sync.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
0.00 +0.6 0.56 ± 5% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.sync
0.00 +0.6 0.56 ± 5% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.sync
0.00 +0.6 0.56 ± 5% perf-profile.calltrace.cycles.sync
0.00 +0.6 0.57 ± 12% perf-profile.calltrace.cycles.down_write.anon_vma_fork.dup_mm.copy_process._do_fork
0.00 +0.6 0.58 ± 7% perf-profile.calltrace.cycles.swapgs_restore_regs_and_return_to_usermode
0.13 ±173% +0.6 0.72 ± 3% perf-profile.calltrace.cycles.setlocale
0.00 +0.6 0.60 ± 5% perf-profile.calltrace.cycles.down_write.unlink_anon_vmas.free_pgtables.exit_mmap.mmput
0.00 +0.6 0.60 ± 10% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk
0.00 +0.6 0.61 ± 11% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.brk
0.00 +0.6 0.63 ± 11% perf-profile.calltrace.cycles.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.__waitpid
0.00 +0.6 0.63 ± 11% perf-profile.calltrace.cycles.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.__waitpid
0.00 +0.6 0.63 ± 11% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.__waitpid
0.00 +0.6 0.63 ± 11% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.__waitpid
0.00 +0.6 0.64 ± 11% perf-profile.calltrace.cycles.__waitpid
0.14 ±173% +0.6 0.78 ± 5% perf-profile.calltrace.cycles.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
0.00 +0.7 0.66 ± 4% perf-profile.calltrace.cycles.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +0.7 0.68 ± 4% perf-profile.calltrace.cycles.wp_page_copy.do_wp_page.__handle_mm_fault.handle_mm_fault.__do_page_fault
0.00 +0.7 0.69 ± 12% perf-profile.calltrace.cycles.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.13 ±173% +0.7 0.84 ± 2% perf-profile.calltrace.cycles.page_remove_rmap.unmap_page_range.unmap_vmas.exit_mmap.mmput
0.68 ± 6% +0.7 1.40 ± 2% perf-profile.calltrace.cycles.unlink_anon_vmas.free_pgtables.exit_mmap.mmput.do_exit
0.00 +0.7 0.73 ± 6% perf-profile.calltrace.cycles.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.7 0.73 ± 6% perf-profile.calltrace.cycles.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.8 0.76 ± 6% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.8 0.76 ± 6% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait4
0.00 +0.8 0.76 ± 6% perf-profile.calltrace.cycles.wait4
0.00 +0.8 0.76 ± 9% perf-profile.calltrace.cycles.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state
0.85 ± 6% +0.8 1.62 ± 2% perf-profile.calltrace.cycles.release_pages.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput
0.12 ±173% +0.8 0.91 ± 19% perf-profile.calltrace.cycles.copy_p4d_range.copy_page_range.dup_mm.copy_process._do_fork
0.65 ± 14% +0.8 1.44 ± 10% perf-profile.calltrace.cycles.anon_vma_clone.anon_vma_fork.dup_mm.copy_process._do_fork
0.13 ±173% +0.8 0.93 ± 18% perf-profile.calltrace.cycles.copy_page_range.dup_mm.copy_process._do_fork.do_syscall_64
2.39 ± 9% +0.8 3.22 ± 4% perf-profile.calltrace.cycles.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
0.00 +0.9 0.85 ± 24% perf-profile.calltrace.cycles.osq_lock.rwsem_down_write_failed.down_write.path_openat.do_filp_open
2.44 ± 9% +0.9 3.30 ± 4% perf-profile.calltrace.cycles.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1.07 ± 6% +0.9 1.96 ± 2% perf-profile.calltrace.cycles.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit
1.06 ± 6% +0.9 1.95 ± 2% perf-profile.calltrace.cycles.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit
1.43 ± 6% +0.9 2.35 ± 2% perf-profile.calltrace.cycles.unmap_page_range.unmap_vmas.exit_mmap.mmput.do_exit
1.47 ± 6% +0.9 2.40 ± 2% perf-profile.calltrace.cycles.unmap_vmas.exit_mmap.mmput.do_exit.do_group_exit
1.10 ± 4% +1.0 2.09 ± 5% perf-profile.calltrace.cycles.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
2.65 ± 10% +1.0 3.65 ± 4% perf-profile.calltrace.cycles.__do_page_fault.do_page_fault.page_fault
2.69 ± 10% +1.0 3.71 ± 4% perf-profile.calltrace.cycles.do_page_fault.page_fault
0.00 +1.0 1.04 ± 23% perf-profile.calltrace.cycles.rwsem_down_write_failed.down_write.path_openat.do_filp_open.do_sys_open
1.22 ± 3% +1.1 2.29 ± 5% perf-profile.calltrace.cycles.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.00 +1.1 1.08 ± 23% perf-profile.calltrace.cycles.down_write.path_openat.do_filp_open.do_sys_open.do_syscall_64
0.00 +1.2 1.17 ± 12% perf-profile.calltrace.cycles.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.copy_process._do_fork.do_syscall_64
1.14 ± 15% +1.2 2.32 ± 9% perf-profile.calltrace.cycles.anon_vma_fork.dup_mm.copy_process._do_fork.do_syscall_64
0.00 +1.2 1.19 ± 10% perf-profile.calltrace.cycles.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.release_task.wait_consider_task.do_wait
2.96 ± 10% +1.2 4.15 ± 5% perf-profile.calltrace.cycles.page_fault
0.00 +1.2 1.21 ± 11% perf-profile.calltrace.cycles.queued_write_lock_slowpath.copy_process._do_fork.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.2 1.23 ± 10% perf-profile.calltrace.cycles.queued_write_lock_slowpath.release_task.wait_consider_task.do_wait.kernel_wait4
0.80 ± 15% +1.3 2.08 ± 20% perf-profile.calltrace.cycles.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
0.84 ± 16% +1.3 2.15 ± 20% perf-profile.calltrace.cycles.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
0.90 ± 15% +1.3 2.22 ± 20% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.creat
0.89 ± 15% +1.3 2.22 ± 20% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat
0.00 +1.3 1.34 ± 9% perf-profile.calltrace.cycles.release_task.wait_consider_task.do_wait.kernel_wait4.__do_sys_wait4
0.93 ± 15% +1.3 2.28 ± 20% perf-profile.calltrace.cycles.creat
0.00 +1.4 1.36 ± 9% perf-profile.calltrace.cycles.wait_consider_task.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.00 +1.6 1.60 ± 10% perf-profile.calltrace.cycles.native_queued_spin_lock_slowpath.queued_write_lock_slowpath.do_exit.do_group_exit.__x64_sys_exit_group
0.80 ± 15% +1.6 2.44 ± 4% perf-profile.calltrace.cycles.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.7 1.67 ± 10% perf-profile.calltrace.cycles.queued_write_lock_slowpath.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
4.77 ± 28% +2.2 6.95 ± 6% perf-profile.calltrace.cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.12 ±173% +3.3 3.42 ± 10% perf-profile.calltrace.cycles.queued_read_lock_slowpath.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.00 +3.3 3.30 ± 10% perf-profile.calltrace.cycles.native_queued_spin_lock_slowpath.queued_read_lock_slowpath.do_wait.kernel_wait4.__do_sys_wait4
6.16 ± 22% +3.4 9.53 ± 5% perf-profile.calltrace.cycles.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
6.16 ± 22% +3.4 9.54 ± 5% perf-profile.calltrace.cycles.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
6.81 ± 20% +4.0 10.77 ± 4% perf-profile.calltrace.cycles.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
6.81 ± 20% +4.0 10.77 ± 4% perf-profile.calltrace.cycles.cpu_startup_entry.start_secondary.secondary_startup_64
6.81 ± 20% +4.0 10.77 ± 4% perf-profile.calltrace.cycles.start_secondary.secondary_startup_64
6.84 ± 20% +4.0 10.83 ± 4% perf-profile.calltrace.cycles.secondary_startup_64
0.72 ± 18% +4.2 4.90 ± 9% perf-profile.calltrace.cycles.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.72 ± 18% +4.2 4.91 ± 9% perf-profile.calltrace.cycles.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.73 ± 19% +4.2 4.92 ± 9% perf-profile.calltrace.cycles.entry_SYSCALL_64_after_hwframe.wait
0.72 ± 18% +4.2 4.92 ± 9% perf-profile.calltrace.cycles.do_syscall_64.entry_SYSCALL_64_after_hwframe.wait
0.78 ± 18% +4.2 5.00 ± 9% perf-profile.calltrace.cycles.wait
0.71 ± 18% +5.7 6.40 ± 5% perf-profile.calltrace.cycles.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64.entry_SYSCALL_64_after_hwframe
16.44 ± 10% +9.1 25.52 ± 9% perf-profile.calltrace.cycles.sieve
52.26 ± 2% -33.9 18.38 ± 7% perf-profile.children.cycles.osq_lock
53.36 ± 3% -33.4 19.97 ± 6% perf-profile.children.cycles.rwsem_down_write_failed
53.75 ± 3% -33.2 20.54 ± 6% perf-profile.children.cycles.down_write
25.36 ± 2% -17.1 8.23 ± 8% perf-profile.children.cycles.unlink_file_vma
26.54 ± 3% -16.3 10.23 ± 6% perf-profile.children.cycles.free_pgtables
69.31 ± 3% -16.2 53.12 ± 3% perf-profile.children.cycles.do_syscall_64
69.34 ± 3% -16.2 53.17 ± 3% perf-profile.children.cycles.entry_SYSCALL_64_after_hwframe
26.71 ± 3% -12.2 14.55 ± 4% perf-profile.children.cycles.exit_mmap
26.72 ± 3% -12.1 14.57 ± 4% perf-profile.children.cycles.mmput
20.81 ± 3% -11.2 9.64 ± 4% perf-profile.children.cycles.dup_mm
21.97 ± 3% -9.1 12.85 ± 3% perf-profile.children.cycles.copy_process
22.30 ± 3% -8.9 13.37 ± 3% perf-profile.children.cycles._do_fork
21.00 ± 3% -7.3 13.73 ± 3% perf-profile.children.cycles.do_exit
21.00 ± 3% -7.3 13.74 ± 3% perf-profile.children.cycles.__x64_sys_exit_group
21.00 ± 3% -7.3 13.74 ± 3% perf-profile.children.cycles.do_group_exit
17.54 ± 10% -7.3 10.28 ± 6% perf-profile.children.cycles.__libc_fork
14.16 ± 14% -5.7 8.47 ± 9% perf-profile.children.cycles.fork_test
8.06 ± 4% -4.6 3.50 ± 8% perf-profile.children.cycles.ksys_mmap_pgoff
8.10 ± 4% -4.5 3.65 ± 8% perf-profile.children.cycles.mmap_region
8.15 ± 4% -4.4 3.74 ± 8% perf-profile.children.cycles.do_mmap
8.19 ± 4% -4.4 3.81 ± 8% perf-profile.children.cycles.vm_mmap_pgoff
6.38 ± 4% -3.6 2.78 ± 8% perf-profile.children.cycles.__split_vma
6.40 ± 4% -3.6 2.80 ± 8% perf-profile.children.cycles.__vma_adjust
6.62 ± 5% -3.0 3.58 ± 6% perf-profile.children.cycles.flush_old_exec
4.84 ± 4% -2.7 2.14 ± 8% perf-profile.children.cycles.__x64_sys_mprotect
4.84 ± 4% -2.7 2.14 ± 8% perf-profile.children.cycles.mprotect_fixup
4.84 ± 4% -2.7 2.14 ± 8% perf-profile.children.cycles.do_mprotect_pkey
5.00 ± 4% -2.5 2.50 ± 6% perf-profile.children.cycles.__do_munmap
7.20 ± 5% -2.5 4.73 ± 5% perf-profile.children.cycles.load_elf_binary
7.20 ± 5% -2.5 4.74 ± 5% perf-profile.children.cycles.search_binary_handler
7.39 ± 3% -2.3 5.14 ± 2% perf-profile.children.cycles.execve
7.69 ± 5% -2.2 5.54 ± 5% perf-profile.children.cycles.__do_execve_file
7.72 ± 5% -2.1 5.58 ± 5% perf-profile.children.cycles.__x64_sys_execve
3.27 ± 4% -1.7 1.53 ± 7% perf-profile.children.cycles.vma_link
3.34 ± 4% -1.6 1.69 ± 6% perf-profile.children.cycles.unmap_region
0.57 ± 5% -0.1 0.52 ± 5% perf-profile.children.cycles.task_tick_fair
0.05 +0.0 0.06 perf-profile.children.cycles.vfprintf
0.05 ± 8% +0.0 0.07 ± 5% perf-profile.children.cycles.__local_bh_enable_ip
0.05 +0.0 0.07 perf-profile.children.cycles.__slab_alloc
0.05 ± 9% +0.0 0.08 ± 6% perf-profile.children.cycles.__update_load_avg_cfs_rq
0.05 +0.0 0.07 ± 5% perf-profile.children.cycles.pipe_read
0.07 ± 10% +0.0 0.10 ± 9% perf-profile.children.cycles.lapic_next_deadline
0.06 ± 11% +0.0 0.08 ± 5% perf-profile.children.cycles.free_pgd_range
0.04 ± 58% +0.0 0.07 ± 7% perf-profile.children.cycles.semop
0.16 ± 5% +0.0 0.18 ± 6% perf-profile.children.cycles.update_curr
0.08 ± 8% +0.0 0.11 ± 4% perf-profile.children.cycles.__rb_erase_color
0.06 +0.0 0.09 ± 9% perf-profile.children.cycles.__vma_link_rb
0.06 +0.0 0.09 ± 4% perf-profile.children.cycles.ip_finish_output2
0.06 ± 7% +0.0 0.08 ± 5% perf-profile.children.cycles.__tcp_transmit_skb
0.04 ± 57% +0.0 0.07 ± 7% perf-profile.children.cycles.strlen
0.05 ± 8% +0.0 0.08 ± 8% perf-profile.children.cycles.sock_read_iter
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.children.cycles.vma_compute_subtree_gap
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.children.cycles.mem_cgroup_try_charge
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles.native_write_msr
0.07 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles.ip_output
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.children.cycles._vm_normal_page
0.06 ± 6% +0.0 0.09 ± 4% perf-profile.children.cycles.switch_mm_irqs_off
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.children.cycles.sched_ttwu_pending
0.05 ± 9% +0.0 0.08 ± 5% perf-profile.children.cycles.copy_user_enhanced_fast_string
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.children.cycles.fput_many
0.08 ± 8% +0.0 0.11 ± 11% perf-profile.children.cycles.generic_perform_write
0.06 ± 7% +0.0 0.09 ± 4% perf-profile.children.cycles.rcu_sched_clock_irq
0.09 ± 5% +0.0 0.12 ± 12% perf-profile.children.cycles.__generic_file_write_iter
0.07 ± 14% +0.0 0.10 ± 4% perf-profile.children.cycles.autoremove_wake_function
0.06 ± 7% +0.0 0.09 perf-profile.children.cycles.selinux_vm_enough_memory
0.06 ± 7% +0.0 0.09 perf-profile.children.cycles.__x64_sys_rt_sigreturn
0.04 ± 57% +0.0 0.07 perf-profile.children.cycles.cred_has_capability
0.04 ± 57% +0.0 0.07 perf-profile.children.cycles.tcp_sendmsg
0.08 ± 5% +0.0 0.12 ± 7% perf-profile.children.cycles.strncpy_from_user
0.09 ± 7% +0.0 0.12 ± 11% perf-profile.children.cycles.generic_file_write_iter
0.06 ± 15% +0.0 0.09 ± 7% perf-profile.children.cycles.kill_pid_info
0.05 ± 8% +0.0 0.09 ± 4% perf-profile.children.cycles.setup_arg_pages
0.07 ± 6% +0.0 0.10 ± 8% perf-profile.children.cycles.read_tsc
0.06 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles.avc_has_perm_noaudit
0.06 ± 7% +0.0 0.09 ± 4% perf-profile.children.cycles.memcpy_erms
0.04 ± 57% +0.0 0.07 ± 15% perf-profile.children.cycles.vma_merge
0.04 ± 58% +0.0 0.08 ± 6% perf-profile.children.cycles.free_p4d_range
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.children.cycles.copy_user_generic_unrolled
0.06 ± 9% +0.0 0.09 ± 15% perf-profile.children.cycles.__pud_alloc
0.04 ± 58% +0.0 0.08 ± 16% perf-profile.children.cycles.interrupt_entry
0.03 ±100% +0.0 0.06 ± 6% perf-profile.children.cycles.___slab_alloc
0.07 ± 7% +0.0 0.10 ± 4% perf-profile.children.cycles.pgd_alloc
0.07 ± 7% +0.0 0.10 ± 4% perf-profile.children.cycles.__pmd_alloc
0.06 ± 7% +0.0 0.10 ± 5% perf-profile.children.cycles.__might_fault
0.04 ± 57% +0.0 0.08 ± 6% perf-profile.children.cycles.__ip_queue_xmit
0.04 ± 58% +0.0 0.08 ± 5% perf-profile.children.cycles.unwind_next_frame
0.07 ± 5% +0.0 0.11 ± 7% perf-profile.children.cycles._copy_to_user
0.08 ± 8% +0.0 0.12 ± 5% perf-profile.children.cycles.sched_move_task
0.06 ± 9% +0.0 0.10 ± 5% perf-profile.children.cycles.lookup_slow
0.07 ± 7% +0.0 0.11 ± 4% perf-profile.children.cycles.__send_signal
0.07 ± 7% +0.0 0.11 ± 4% perf-profile.children.cycles.vmacache_find
0.06 ± 6% +0.0 0.10 ± 8% perf-profile.children.cycles.kill_something_info
0.14 ± 8% +0.0 0.18 ± 4% perf-profile.children.cycles.vma_interval_tree_remove
0.07 ± 10% +0.0 0.11 ± 7% perf-profile.children.cycles.find_next_bit
0.08 ± 8% +0.0 0.12 ± 3% perf-profile.children.cycles.arch_stack_walk
0.05 ± 8% +0.0 0.10 ± 11% perf-profile.children.cycles.__next_timer_interrupt
0.04 ± 57% +0.0 0.08 perf-profile.children.cycles.lock_page_memcg
0.01 ±173% +0.0 0.05 ± 9% perf-profile.children.cycles.__do_fault
0.04 ± 58% +0.0 0.08 ± 5% perf-profile.children.cycles._copy_from_user
0.03 ±100% +0.0 0.07 ± 6% perf-profile.children.cycles.__tlb_remove_page_size
0.12 ± 8% +0.0 0.17 ± 5% perf-profile.children.cycles.osq_unlock
0.10 ± 5% +0.0 0.14 ± 3% perf-profile.children.cycles.vm_area_dup
0.06 ± 6% +0.0 0.11 ± 4% perf-profile.children.cycles.get_unmapped_area
0.03 ±100% +0.0 0.07 ± 10% perf-profile.children.cycles._exit
0.07 ± 6% +0.0 0.11 ± 3% perf-profile.children.cycles.do_truncate
0.09 ± 12% +0.0 0.13 ± 3% perf-profile.children.cycles.update_rq_clock
0.08 +0.0 0.12 ± 4% perf-profile.children.cycles.run_rebalance_domains
0.07 ± 13% +0.0 0.11 perf-profile.children.cycles.get_user_pages_remote
0.06 ± 9% +0.0 0.10 ± 14% perf-profile.children.cycles.sched_clock_cpu
0.03 ±100% +0.0 0.07 ± 10% perf-profile.children.cycles.perf_event_task
0.11 ± 3% +0.0 0.16 ± 2% perf-profile.children.cycles.__rb_insert_augmented
0.09 +0.0 0.14 ± 3% perf-profile.children.cycles.update_blocked_averages
0.06 ± 11% +0.0 0.11 ± 8% perf-profile.children.cycles.__fxstat64
0.06 ± 6% +0.0 0.11 ± 4% perf-profile.children.cycles.__d_lookup_rcu
0.07 ± 5% +0.0 0.12 ± 8% perf-profile.children.cycles.create_elf_tables
0.08 ± 6% +0.0 0.12 ± 3% perf-profile.children.cycles.mm_init
0.08 ± 5% +0.0 0.12 ± 4% perf-profile.children.cycles.mem_cgroup_try_charge_delay
0.08 ± 5% +0.0 0.13 ± 5% perf-profile.children.cycles._raw_spin_lock_irq
0.08 ± 5% +0.0 0.12 ± 4% perf-profile.children.cycles._raw_spin_unlock_irqrestore
0.09 ± 5% +0.0 0.13 ± 3% perf-profile.children.cycles.stack_trace_save_tsk
0.04 ± 58% +0.0 0.09 ± 34% perf-profile.children.cycles.remove_vm_area
0.03 ±100% +0.0 0.07 ± 5% perf-profile.children.cycles.run_timer_softirq
0.03 ±100% +0.0 0.07 ± 5% perf-profile.children.cycles.notify_change
0.09 ± 4% +0.0 0.14 ± 7% perf-profile.children.cycles.free_pcppages_bulk
0.11 ± 4% +0.0 0.16 ± 2% perf-profile.children.cycles._cond_resched
0.10 ± 8% +0.0 0.15 ± 2% perf-profile.children.cycles.sock_write_iter
0.10 ± 7% +0.0 0.15 perf-profile.children.cycles.sock_sendmsg
0.07 ± 10% +0.0 0.12 ± 10% perf-profile.children.cycles.do_open_execat
0.07 ± 5% +0.0 0.12 ± 3% perf-profile.children.cycles.__x64_sys_kill
0.07 +0.0 0.12 ± 5% perf-profile.children.cycles.__x64_sys_munmap
0.07 ± 13% +0.0 0.11 ± 4% perf-profile.children.cycles.__get_user_pages
0.09 ± 8% +0.1 0.14 ± 3% perf-profile.children.cycles.__pagevec_lru_add_fn
0.01 ±173% +0.1 0.06 ± 6% perf-profile.children.cycles.do_softirq
0.01 ±173% +0.1 0.06 ± 6% perf-profile.children.cycles.perf_event_mmap_output
0.01 ±173% +0.1 0.06 ± 6% perf-profile.children.cycles.do_softirq_own_stack
0.00 +0.1 0.05 perf-profile.children.cycles.__tcp_push_pending_frames
0.00 +0.1 0.05 perf-profile.children.cycles.tcp_write_xmit
0.00 +0.1 0.05 perf-profile.children.cycles.avc_has_perm
0.00 +0.1 0.05 perf-profile.children.cycles.count
0.00 +0.1 0.05 perf-profile.children.cycles.fsnotify
0.00 +0.1 0.05 perf-profile.children.cycles.may_open
0.00 +0.1 0.05 perf-profile.children.cycles.sync_regs
0.00 +0.1 0.05 perf-profile.children.cycles.inet_recvmsg
0.00 +0.1 0.05 perf-profile.children.cycles.available_idle_cpu
0.00 +0.1 0.05 perf-profile.children.cycles.shmem_get_inode
0.00 +0.1 0.05 perf-profile.children.cycles.ip_rcv
0.00 +0.1 0.05 perf-profile.children.cycles.udp_sendmsg
0.00 +0.1 0.05 perf-profile.children.cycles.find_get_entry
0.00 +0.1 0.05 perf-profile.children.cycles.__check_heap_object
0.00 +0.1 0.05 perf-profile.children.cycles.vfs_unlink
0.00 +0.1 0.05 perf-profile.children.cycles.copy_fpstate_to_sigframe
0.00 +0.1 0.05 perf-profile.children.cycles.__x64_sys_rt_sigaction
0.03 ±100% +0.1 0.08 ± 6% perf-profile.children.cycles.change_protection
0.11 ± 7% +0.1 0.16 ± 4% perf-profile.children.cycles.getname_flags
0.09 ± 4% +0.1 0.14 ± 5% perf-profile.children.cycles.security_vm_enough_memory_mm
0.04 ± 57% +0.1 0.09 perf-profile.children.cycles.mark_page_accessed
0.05 ± 8% +0.1 0.11 ± 4% perf-profile.children.cycles.down_read
0.01 ±173% +0.1 0.07 ± 7% perf-profile.children.cycles.__dentry_kill
0.01 ±173% +0.1 0.07 ± 7% perf-profile.children.cycles.select_idle_sibling
0.01 ±173% +0.1 0.07 ± 7% perf-profile.children.cycles.tcp_sendmsg_locked
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.shift_arg_pages
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.perf_event_task_output
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.malloc
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.__mmdrop
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.__x86_indirect_thunk_rax
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles.__netif_receive_skb_one_core
0.06 ± 7% +0.1 0.11 ± 3% perf-profile.children.cycles.unlazy_walk
0.04 ± 57% +0.1 0.09 ± 20% perf-profile.children.cycles.cpuidle_governor_latency_req
0.04 ± 57% +0.1 0.09 ± 4% perf-profile.children.cycles.PageHuge
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles.__inode_security_revalidate
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles.filp_close
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles.unmap_single_vma
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles.__rwsem_mark_wake
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.alloc_pid
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.process_backlog
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.__count_memcg_events
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.mem_cgroup_commit_charge
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.prepare_creds
0.00 +0.1 0.06 ± 9% perf-profile.children.cycles.shmem_write_begin
0.09 ± 7% +0.1 0.15 ± 3% perf-profile.children.cycles.__might_sleep
0.05 +0.1 0.11 ± 4% perf-profile.children.cycles.legitimize_path
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles.__do_sys_newfstat
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.arch_get_unmapped_area_topdown
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.dup_fd
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.cpumask_next
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.get_signal
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.kernel_read
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.rcu_all_qs
0.00 +0.1 0.06 ± 7% perf-profile.children.cycles.arch_dup_task_struct
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles.shmem_getpage_gfp
0.01 ±173% +0.1 0.07 perf-profile.children.cycles.get_user_arg_ptr
0.01 ±173% +0.1 0.07 perf-profile.children.cycles.__list_add_valid
0.01 ±173% +0.1 0.07 perf-profile.children.cycles.shmem_mknod
0.09 ± 4% +0.1 0.15 ± 3% perf-profile.children.cycles.__clear_user
0.09 ± 7% +0.1 0.15 ± 4% perf-profile.children.cycles.update_load_avg
0.28 ± 5% +0.1 0.34 ± 5% perf-profile.children.cycles.refcount_dec_not_one
0.12 ± 6% +0.1 0.18 ± 10% perf-profile.children.cycles.smpboot_thread_fn
0.13 ± 5% +0.1 0.19 ± 3% perf-profile.children.cycles.schedule_tail
0.12 ± 7% +0.1 0.18 ± 6% perf-profile.children.cycles.ptep_clear_flush
0.10 ± 10% +0.1 0.16 ± 2% perf-profile.children.cycles.__fput
0.10 ± 8% +0.1 0.16 ± 2% perf-profile.children.cycles.pipe_write
0.10 ± 4% +0.1 0.16 ± 2% perf-profile.children.cycles.__put_user_4
0.10 ± 7% +0.1 0.16 ± 4% perf-profile.children.cycles.__account_scheduler_latency
0.10 ± 5% +0.1 0.15 ± 3% perf-profile.children.cycles.__alloc_file
0.07 ± 5% +0.1 0.13 ± 6% perf-profile.children.cycles.do_dentry_open
0.00 +0.1 0.06 perf-profile.children.cycles.d_alloc
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles.evict
0.00 +0.1 0.06 perf-profile.children.cycles.memset_erms
0.00 +0.1 0.06 perf-profile.children.cycles.net_rx_action
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles.lockref_put_return
0.00 +0.1 0.06 perf-profile.children.cycles.__anon_vma_interval_tree_augment_rotate
0.11 ± 3% +0.1 0.17 ± 6% perf-profile.children.cycles.perf_mux_hrtimer_handler
0.10 ± 18% +0.1 0.16 ± 10% perf-profile.children.cycles.sighandler
0.01 ±173% +0.1 0.07 ± 5% perf-profile.children.cycles.d_alloc_parallel
0.01 ±173% +0.1 0.07 ± 11% perf-profile.children.cycles.inode_permission
0.09 ± 4% +0.1 0.15 ± 5% perf-profile.children.cycles.do_faccessat
0.10 ± 4% +0.1 0.17 ± 6% perf-profile.children.cycles.__get_free_pages
0.10 ± 7% +0.1 0.16 ± 5% perf-profile.children.cycles.finish_task_switch
0.10 ± 7% +0.1 0.16 ± 5% perf-profile.children.cycles.strnlen_user
0.01 ±173% +0.1 0.07 ± 11% perf-profile.children.cycles.sched_clock
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles.put_task_stack
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles.__d_lookup
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles.security_file_permission
0.00 +0.1 0.06 ± 6% perf-profile.children.cycles.__virt_addr_valid
0.01 ±173% +0.1 0.08 ± 6% perf-profile.children.cycles.dentry_kill
0.01 ±173% +0.1 0.08 ± 5% perf-profile.children.cycles.copy_strings_kernel
0.01 ±173% +0.1 0.08 ± 6% perf-profile.children.cycles.do_send_sig_info
0.08 +0.1 0.14 ± 10% perf-profile.children.cycles.get_next_timer_interrupt
0.11 ± 7% +0.1 0.18 ± 6% perf-profile.children.cycles.selinux_inode_permission
0.12 ± 10% +0.1 0.19 ± 2% perf-profile.children.cycles.__check_object_size
0.01 ±173% +0.1 0.08 ± 5% perf-profile.children.cycles.terminate_walk
0.00 +0.1 0.07 ± 7% perf-profile.children.cycles.d_lookup
0.11 ± 6% +0.1 0.18 ± 2% perf-profile.children.cycles.do_signal
0.24 ± 6% +0.1 0.30 ± 4% perf-profile.children.cycles.free_uid
0.24 ± 6% +0.1 0.30 ± 4% perf-profile.children.cycles.refcount_dec_and_lock_irqsave
0.13 ± 9% +0.1 0.20 ± 5% perf-profile.children.cycles.security_inode_permission
0.10 ± 8% +0.1 0.17 ± 3% perf-profile.children.cycles.alloc_empty_file
0.00 +0.1 0.07 ± 12% perf-profile.children.cycles.__lookup_slow
0.11 ± 6% +0.1 0.18 ± 6% perf-profile.children.cycles.dequeue_entity
0.10 ± 7% +0.1 0.17 ± 4% perf-profile.children.cycles.__do_sys_newstat
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles.native_sched_clock
0.00 +0.1 0.07 ± 10% perf-profile.children.cycles.open_exec
0.14 ± 7% +0.1 0.21 ± 6% perf-profile.children.cycles.__list_del_entry_valid
0.15 ± 4% +0.1 0.22 perf-profile.children.cycles.anon_vma_interval_tree_remove
0.13 ± 8% +0.1 0.21 ± 4% perf-profile.children.cycles.task_work_run
0.14 ± 7% +0.1 0.21 ± 6% perf-profile.children.cycles.free_unref_page_list
0.12 ± 8% +0.1 0.20 ± 2% perf-profile.children.cycles.sched_exec
0.01 ±173% +0.1 0.09 ± 5% perf-profile.children.cycles.complete_walk
0.14 ± 3% +0.1 0.22 ± 6% perf-profile.children.cycles.rebalance_domains
0.14 ± 5% +0.1 0.21 ± 4% perf-profile.children.cycles.__xstat64
0.12 ± 5% +0.1 0.20 ± 4% perf-profile.children.cycles.perf_iterate_sb
0.13 ± 6% +0.1 0.20 ± 4% perf-profile.children.cycles.__perf_sw_event
0.11 ± 6% +0.1 0.18 ± 2% perf-profile.children.cycles.lookup_fast
0.00 +0.1 0.08 ± 6% perf-profile.children.cycles.lockref_get_not_dead
0.11 ± 8% +0.1 0.18 ± 23% perf-profile.children.cycles.tick_irq_enter
0.12 ± 3% +0.1 0.20 ± 3% perf-profile.children.cycles.___perf_sw_event
0.07 ± 17% +0.1 0.15 ± 15% perf-profile.children.cycles.link
0.09 ± 11% +0.1 0.17 ± 2% perf-profile.children.cycles.__lru_cache_add
0.15 ± 5% +0.1 0.23 ± 3% perf-profile.children.cycles.do_notify_parent
0.11 ± 6% +0.1 0.19 ± 3% perf-profile.children.cycles.vfs_statx
0.17 ± 12% +0.1 0.25 ± 12% perf-profile.children.cycles.close
0.11 ± 4% +0.1 0.19 ± 6% perf-profile.children.cycles.schedule_idle
0.00 +0.1 0.08 ± 5% perf-profile.children.cycles.idle_cpu
0.15 ± 3% +0.1 0.24 ± 2% perf-profile.children.cycles.new_sync_read
0.07 +0.1 0.15 ± 5% perf-profile.children.cycles.__x64_sys_link
0.13 ± 8% +0.1 0.22 ± 5% perf-profile.children.cycles.dequeue_task_fair
0.15 ± 4% +0.1 0.24 ± 4% perf-profile.children.cycles.___might_sleep
0.07 ± 6% +0.1 0.15 ± 5% perf-profile.children.cycles.do_linkat
0.17 ± 6% +0.1 0.26 perf-profile.children.cycles.perf_event_mmap
0.17 ± 6% +0.1 0.26 ± 4% perf-profile.children.cycles.native_flush_tlb_one_user
0.20 ± 5% +0.1 0.29 ± 3% perf-profile.children.cycles.vma_interval_tree_insert
0.18 ± 7% +0.1 0.28 ± 4% perf-profile.children.cycles.__wake_up_common
0.18 ± 6% +0.1 0.27 perf-profile.children.cycles.ttwu_do_activate
0.15 ± 8% +0.1 0.24 ± 4% perf-profile.children.cycles.do_brk_flags
0.16 ± 9% +0.1 0.25 ± 19% perf-profile.children.cycles.clockevents_program_event
0.00 +0.1 0.09 ± 14% perf-profile.children.cycles.filename_create
0.18 ± 6% +0.1 0.27 ± 5% perf-profile.children.cycles.mmap64
0.18 ± 9% +0.1 0.28 ± 4% perf-profile.children.cycles.__pte_alloc
0.13 ± 3% +0.1 0.23 ± 23% perf-profile.children.cycles.irq_enter
0.17 ± 6% +0.1 0.26 ± 4% perf-profile.children.cycles.page_add_file_rmap
0.19 ± 5% +0.1 0.29 ± 3% perf-profile.children.cycles.syscall_return_via_sysret
0.18 ± 7% +0.1 0.28 ± 2% perf-profile.children.cycles.flush_tlb_func_common
0.21 ± 12% +0.1 0.31 ± 9% perf-profile.children.cycles.read
0.16 ± 4% +0.1 0.26 ± 3% perf-profile.children.cycles.remove_vma
0.30 ± 4% +0.1 0.40 perf-profile.children.cycles.up_write
0.18 ± 3% +0.1 0.28 ± 5% perf-profile.children.cycles.copy_page
0.12 ± 6% +0.1 0.22 ± 3% perf-profile.children.cycles.unlock_page
0.21 ± 8% +0.1 0.32 ± 4% perf-profile.children.cycles.pte_alloc_one
0.23 ± 4% +0.1 0.33 ± 4% perf-profile.children.cycles.do_task_dead
0.18 ± 6% +0.1 0.29 ± 4% perf-profile.children.cycles.copy_user_highpage
0.19 ± 7% +0.1 0.30 ± 2% perf-profile.children.cycles.ksys_read
0.32 ± 5% +0.1 0.43 ± 3% perf-profile.children.cycles.put_cred_rcu
0.13 ± 9% +0.1 0.24 ± 3% perf-profile.children.cycles.dput
0.17 ± 6% +0.1 0.27 ± 3% perf-profile.children.cycles.find_vma
0.16 ± 5% +0.1 0.27 perf-profile.children.cycles.walk_component
0.20 ± 7% +0.1 0.31 perf-profile.children.cycles.enqueue_entity
0.20 ± 7% +0.1 0.30 ± 3% perf-profile.children.cycles.__wake_up_common_lock
0.16 ± 6% +0.1 0.27 perf-profile.children.cycles.path_lookupat
0.22 ± 6% +0.1 0.33 ± 2% perf-profile.children.cycles.activate_task
0.17 ± 4% +0.1 0.28 perf-profile.children.cycles.filename_lookup
0.12 ± 5% +0.1 0.24 perf-profile.children.cycles.lru_add_drain
0.23 ± 7% +0.1 0.35 perf-profile.children.cycles.enqueue_task_fair
0.22 ± 3% +0.1 0.35 perf-profile.children.cycles.exit_to_usermode_loop
0.24 ± 7% +0.1 0.37 perf-profile.children.cycles.filldir
0.12 ± 6% +0.1 0.25 perf-profile.children.cycles.lru_add_drain_cpu
0.22 ± 5% +0.1 0.35 ± 3% perf-profile.children.cycles.vfs_read
0.19 ± 5% +0.1 0.32 ± 5% perf-profile.children.cycles._dl_addr
0.24 ± 6% +0.1 0.37 ± 3% perf-profile.children.cycles.kmem_cache_alloc
0.20 ± 9% +0.1 0.33 ± 21% perf-profile.children.cycles.ktime_get
0.23 ± 5% +0.1 0.37 ± 2% perf-profile.children.cycles.flush_tlb_mm_range
0.25 ± 14% +0.1 0.39 ± 9% perf-profile.children.cycles.kill
0.22 ± 8% +0.1 0.36 ± 3% perf-profile.children.cycles.copy_strings
0.93 ± 6% +0.1 1.07 ± 3% perf-profile.children.cycles.update_process_times
0.25 ± 7% +0.1 0.39 ± 5% perf-profile.children.cycles.link_path_walk
0.25 ± 4% +0.1 0.40 ± 4% perf-profile.children.cycles.entry_SYSCALL_64
0.25 ± 7% +0.1 0.40 ± 2% perf-profile.children.cycles.free_pages_and_swap_cache
0.35 ± 3% +0.1 0.50 ± 3% perf-profile.children.cycles.new_sync_write
0.41 ± 3% +0.1 0.55 ± 7% perf-profile.children.cycles.wake_up_q
0.50 ± 4% +0.1 0.65 ± 7% perf-profile.children.cycles.rwsem_wake
0.29 ± 6% +0.2 0.45 perf-profile.children.cycles.dcache_readdir
0.29 ± 2% +0.2 0.45 ± 6% perf-profile.children.cycles.update_sd_lb_stats
0.30 ± 5% +0.2 0.46 perf-profile.children.cycles.__x64_sys_getdents
0.30 ± 6% +0.2 0.46 perf-profile.children.cycles.iterate_dir
0.30 ± 2% +0.2 0.46 ± 6% perf-profile.children.cycles.find_busiest_group
0.29 ± 7% +0.2 0.45 ± 3% perf-profile.children.cycles.clear_page_erms
0.26 ± 5% +0.2 0.42 ± 2% perf-profile.children.cycles.alloc_pages_vma
0.15 ± 14% +0.2 0.30 ± 15% perf-profile.children.cycles.unlink
0.16 ± 7% +0.2 0.32 ± 28% perf-profile.children.cycles.tick_nohz_next_event
0.96 ± 6% +0.2 1.12 ± 3% perf-profile.children.cycles.tick_sched_handle
0.35 ± 4% +0.2 0.51 ± 4% perf-profile.children.cycles.schedule
0.48 ± 15% +0.2 0.65 ± 7% perf-profile.children.cycles.find_vmap_area
0.38 ± 3% +0.2 0.55 ± 3% perf-profile.children.cycles.vfs_write
0.51 ± 15% +0.2 0.68 ± 6% perf-profile.children.cycles.__vunmap
0.31 ± 7% +0.2 0.48 ± 3% perf-profile.children.cycles.prep_new_page
0.51 ± 15% +0.2 0.68 ± 6% perf-profile.children.cycles.free_work
0.39 ± 2% +0.2 0.57 ± 3% perf-profile.children.cycles.ksys_write
0.14 ± 6% +0.2 0.31 perf-profile.children.cycles.do_unlinkat
0.29 ± 5% +0.2 0.47 perf-profile.children.cycles.__slab_free
0.53 ± 4% +0.2 0.71 ± 2% perf-profile.children.cycles.rcu_core
0.53 ± 17% +0.2 0.71 ± 9% perf-profile.children.cycles.write
0.30 ± 5% +0.2 0.48 ± 4% perf-profile.children.cycles.wake_up_new_task
1.02 ± 6% +0.2 1.20 ± 2% perf-profile.children.cycles.tick_sched_timer
0.12 ± 6% +0.2 0.31 ± 3% perf-profile.children.cycles.__put_anon_vma
0.42 ± 2% +0.2 0.60 ± 6% perf-profile.children.cycles.pick_next_task_fair
0.44 ± 6% +0.2 0.62 perf-profile.children.cycles.anon_vma_interval_tree_insert
0.31 ± 5% +0.2 0.50 ± 2% perf-profile.children.cycles.alloc_set_pte
0.18 ± 6% +0.2 0.38 ± 22% perf-profile.children.cycles.tick_nohz_get_sleep_length
0.20 ± 7% +0.2 0.39 perf-profile.children.cycles.pagevec_lru_move_fn
0.16 ± 6% +0.2 0.36 perf-profile.children.cycles.__vm_munmap
0.35 ± 15% +0.2 0.55 ± 8% perf-profile.children.cycles.page_test
0.42 ± 2% +0.2 0.62 ± 5% perf-profile.children.cycles.load_balance
0.53 ± 13% +0.2 0.73 ± 7% perf-profile.children.cycles.process_one_work
0.32 ± 6% +0.2 0.54 ± 3% perf-profile.children.cycles.__x64_sys_brk
0.36 ± 3% +0.2 0.57 perf-profile.children.cycles.kmem_cache_free
0.33 ± 4% +0.2 0.55 ± 3% perf-profile.children.cycles.do_anonymous_page
0.56 ± 13% +0.2 0.78 ± 6% perf-profile.children.cycles.worker_thread
0.41 ± 5% +0.2 0.64 ± 5% perf-profile.children.cycles.select_task_rq_fair
0.47 ± 13% +0.2 0.71 ± 5% perf-profile.children.cycles.alloc_vmap_area
0.43 ± 5% +0.3 0.69 ± 2% perf-profile.children.cycles.prepare_exit_to_usermode
0.62 ± 3% +0.3 0.88 ± 4% perf-profile.children.cycles.try_to_wake_up
0.45 ± 9% +0.3 0.72 ± 3% perf-profile.children.cycles.setlocale
0.68 ± 11% +0.3 0.97 ± 6% perf-profile.children.cycles.kthread
0.49 ± 13% +0.3 0.78 ± 10% perf-profile.children.cycles.brk
0.51 ± 13% +0.3 0.80 ± 3% perf-profile.children.cycles.__get_vm_area_node
0.53 ± 6% +0.3 0.82 ± 3% perf-profile.children.cycles.get_page_from_freelist
0.55 ± 12% +0.3 0.87 ± 2% perf-profile.children.cycles.__vmalloc_node_range
0.53 ± 5% +0.3 0.86 ± 3% perf-profile.children.cycles.wp_page_copy
0.37 ± 6% +0.3 0.70 ± 12% perf-profile.children.cycles.menu_select
0.24 ± 8% +0.3 0.57 ± 3% perf-profile.children.cycles.elf_map
1.27 ± 6% +0.3 1.61 ± 4% perf-profile.children.cycles.__hrtimer_run_queues
0.59 ± 6% +0.3 0.93 ± 3% perf-profile.children.cycles.__alloc_pages_nodemask
0.59 ± 4% +0.3 0.94 ± 2% perf-profile.children.cycles.swapgs_restore_regs_and_return_to_usermode
0.83 ± 10% +0.4 1.19 ± 5% perf-profile.children.cycles.ret_from_fork
0.18 ± 11% +0.4 0.54 ± 4% perf-profile.children.cycles.iterate_supers
0.70 ± 3% +0.4 1.06 ± 3% perf-profile.children.cycles.__schedule
0.86 ± 2% +0.4 1.23 perf-profile.children.cycles.__softirqentry_text_start
0.19 ± 8% +0.4 0.56 ± 5% perf-profile.children.cycles.sync
0.62 ± 4% +0.4 0.99 ± 3% perf-profile.children.cycles.do_wp_page
0.19 ± 10% +0.4 0.56 ± 4% perf-profile.children.cycles.__x64_sys_sync
0.19 ± 10% +0.4 0.56 ± 4% perf-profile.children.cycles.ksys_sync
0.64 ± 5% +0.4 1.02 ± 2% perf-profile.children.cycles.rwsem_spin_on_owner
0.88 ± 2% +0.4 1.26 ± 2% perf-profile.children.cycles.irq_exit
0.74 ± 5% +0.4 1.14 ± 2% perf-profile.children.cycles.copy_p4d_range
0.77 ± 5% +0.4 1.17 ± 2% perf-profile.children.cycles.copy_page_range
0.60 ± 4% +0.4 1.01 perf-profile.children.cycles.page_remove_rmap
2.52 ± 5% +0.4 2.95 perf-profile.children.cycles.filemap_map_pages
1.60 ± 7% +0.5 2.08 ± 3% perf-profile.children.cycles.hrtimer_interrupt
0.57 ± 4% +0.5 1.06 ± 3% perf-profile.children.cycles._raw_spin_lock_irqsave
0.12 ± 19% +0.5 0.64 ± 11% perf-profile.children.cycles.__waitpid
0.17 ± 11% +0.6 0.76 ± 6% perf-profile.children.cycles.wait4
0.90 ± 6% +0.7 1.63 perf-profile.children.cycles.anon_vma_clone
0.86 ± 6% +0.9 1.75 ± 2% perf-profile.children.cycles.unlink_anon_vmas
1.06 ± 6% +0.9 1.99 perf-profile.children.cycles.release_pages
1.40 ± 10% +1.0 2.35 ± 3% perf-profile.children.cycles._raw_spin_lock
2.67 ± 4% +1.0 3.67 ± 3% perf-profile.children.cycles.smp_apic_timer_interrupt
1.38 ± 6% +1.1 2.48 perf-profile.children.cycles.tlb_flush_mmu
2.85 ± 3% +1.1 3.95 ± 3% perf-profile.children.cycles.apic_timer_interrupt
1.39 ± 6% +1.1 2.50 perf-profile.children.cycles.tlb_finish_mmu
1.78 ± 6% +1.1 2.92 perf-profile.children.cycles.unmap_page_range
1.83 ± 6% +1.2 3.00 perf-profile.children.cycles.unmap_vmas
3.94 ± 5% +1.2 5.11 perf-profile.children.cycles.__handle_mm_fault
4.04 ± 5% +1.2 5.27 perf-profile.children.cycles.handle_mm_fault
1.35 ± 7% +1.2 2.60 ± 2% perf-profile.children.cycles.anon_vma_fork
0.95 ± 15% +1.4 2.30 ± 20% perf-profile.children.cycles.creat
4.34 ± 5% +1.4 5.78 perf-profile.children.cycles.__do_page_fault
4.41 ± 5% +1.5 5.88 perf-profile.children.cycles.do_page_fault
0.31 ± 11% +1.5 1.86 ± 8% perf-profile.children.cycles.release_task
0.33 ± 10% +1.6 1.90 ± 8% perf-profile.children.cycles.wait_consider_task
4.86 ± 4% +1.7 6.59 ± 2% perf-profile.children.cycles.page_fault
1.17 ± 3% +1.7 2.92 ± 4% perf-profile.children.cycles.path_openat
1.18 ± 3% +1.7 2.92 ± 4% perf-profile.children.cycles.do_filp_open
1.21 ± 4% +1.8 2.96 ± 4% perf-profile.children.cycles.do_sys_open
4.80 ± 28% +2.2 6.99 ± 6% perf-profile.children.cycles.intel_idle
6.19 ± 22% +3.4 9.59 ± 5% perf-profile.children.cycles.cpuidle_enter_state
6.20 ± 22% +3.4 9.59 ± 5% perf-profile.children.cycles.cpuidle_enter
0.55 ± 12% +3.8 4.36 ± 9% perf-profile.children.cycles.queued_read_lock_slowpath
6.81 ± 20% +4.0 10.77 ± 4% perf-profile.children.cycles.start_secondary
6.84 ± 20% +4.0 10.83 ± 4% perf-profile.children.cycles.secondary_startup_64
6.84 ± 20% +4.0 10.83 ± 4% perf-profile.children.cycles.cpu_startup_entry
6.84 ± 20% +4.0 10.83 ± 4% perf-profile.children.cycles.do_idle
0.78 ± 18% +4.2 5.00 ± 9% perf-profile.children.cycles.wait
0.62 ± 12% +4.4 5.03 ± 9% perf-profile.children.cycles.queued_write_lock_slowpath
1.06 ± 10% +5.5 6.52 ± 8% perf-profile.children.cycles.do_wait
1.07 ± 10% +5.5 6.54 ± 8% perf-profile.children.cycles.__do_sys_wait4
1.06 ± 10% +5.5 6.54 ± 8% perf-profile.children.cycles.kernel_wait4
16.44 ± 10% +9.1 25.52 ± 9% perf-profile.children.cycles.sieve
2.44 ± 12% +9.2 11.61 ± 7% perf-profile.children.cycles.native_queued_spin_lock_slowpath
51.32 ± 2% -33.3 18.01 ± 7% perf-profile.self.cycles.osq_lock
0.06 ± 7% +0.0 0.08 ± 6% perf-profile.self.cycles.try_to_wake_up
0.05 ± 9% +0.0 0.08 ± 6% perf-profile.self.cycles.free_pcppages_bulk
0.05 ± 9% +0.0 0.08 ± 6% perf-profile.self.cycles.copy_user_enhanced_fast_string
0.10 ± 7% +0.0 0.13 ± 6% perf-profile.self.cycles.update_curr
0.06 ± 11% +0.0 0.09 ± 9% perf-profile.self.cycles.do_wp_page
0.07 ± 7% +0.0 0.09 ± 4% perf-profile.self.cycles.__rb_erase_color
0.05 ± 8% +0.0 0.08 perf-profile.self.cycles._raw_spin_unlock_irqrestore
0.08 ± 5% +0.0 0.11 ± 4% perf-profile.self.cycles.native_write_msr
0.06 ± 7% +0.0 0.09 ± 4% perf-profile.self.cycles.handle_mm_fault
0.06 ± 11% +0.0 0.09 perf-profile.self.cycles.__pagevec_lru_add_fn
0.05 ± 8% +0.0 0.08 ± 5% perf-profile.self.cycles._vm_normal_page
0.05 +0.0 0.08 perf-profile.self.cycles.vma_compute_subtree_gap
0.04 ± 58% +0.0 0.07 perf-profile.self.cycles.__update_load_avg_cfs_rq
0.06 ± 6% +0.0 0.10 ± 5% perf-profile.self.cycles.copy_user_generic_unrolled
0.04 ± 57% +0.0 0.07 perf-profile.self.cycles.rcu_sched_clock_irq
0.07 ± 5% +0.0 0.11 ± 4% perf-profile.self.cycles._raw_spin_lock_irq
0.07 +0.0 0.10 ± 4% perf-profile.self.cycles.kmem_cache_free
0.08 ± 5% +0.0 0.11 ± 3% perf-profile.self.cycles.put_cred_rcu
0.07 ± 6% +0.0 0.10 ± 8% perf-profile.self.cycles.read_tsc
0.07 ± 7% +0.0 0.10 perf-profile.self.cycles.vmacache_find
0.06 ± 6% +0.0 0.10 ± 4% perf-profile.self.cycles.avc_has_perm_noaudit
0.06 ± 6% +0.0 0.10 ± 8% perf-profile.self.cycles.selinux_inode_permission
0.05 ± 9% +0.0 0.09 ± 7% perf-profile.self.cycles.memcpy_erms
0.04 ± 58% +0.0 0.08 ± 16% perf-profile.self.cycles.interrupt_entry
0.07 ± 6% +0.0 0.11 ± 4% perf-profile.self.cycles.anon_vma_fork
0.07 ± 5% +0.0 0.11 ± 4% perf-profile.self.cycles.unlink_anon_vmas
0.07 ± 10% +0.0 0.11 ± 7% perf-profile.self.cycles.find_next_bit
0.08 ± 6% +0.0 0.12 ± 3% perf-profile.self.cycles.__do_page_fault
0.07 ± 10% +0.0 0.11 ± 3% perf-profile.self.cycles.update_rq_clock
0.04 ± 57% +0.0 0.08 perf-profile.self.cycles.lock_page_memcg
0.03 ±100% +0.0 0.07 ± 6% perf-profile.self.cycles.__schedule
0.12 ± 5% +0.0 0.16 ± 5% perf-profile.self.cycles.osq_unlock
0.10 ± 4% +0.0 0.15 ± 3% perf-profile.self.cycles.__rb_insert_augmented
0.04 ± 57% +0.0 0.08 ± 5% perf-profile.self.cycles.__alloc_pages_nodemask
0.13 ± 9% +0.0 0.18 ± 4% perf-profile.self.cycles.vma_interval_tree_remove
0.06 ± 6% +0.0 0.11 ± 4% perf-profile.self.cycles.__d_lookup_rcu
0.08 ± 5% +0.0 0.12 ± 4% perf-profile.self.cycles.anon_vma_clone
0.01 ±173% +0.0 0.06 perf-profile.self.cycles.copy_process
0.03 ±100% +0.0 0.07 ± 5% perf-profile.self.cycles.update_load_avg
0.08 ± 6% +0.0 0.12 ± 4% perf-profile.self.cycles.strnlen_user
0.01 ±173% +0.1 0.06 ± 6% perf-profile.self.cycles.__check_object_size
0.00 +0.1 0.05 perf-profile.self.cycles.perf_event_mmap
0.00 +0.1 0.05 perf-profile.self.cycles.perf_mux_hrtimer_handler
0.00 +0.1 0.05 perf-profile.self.cycles.avc_has_perm
0.00 +0.1 0.05 perf-profile.self.cycles.fsnotify
0.00 +0.1 0.05 perf-profile.self.cycles.sync_regs
0.00 +0.1 0.05 perf-profile.self.cycles.available_idle_cpu
0.00 +0.1 0.05 perf-profile.self.cycles.__check_heap_object
0.25 ± 7% +0.1 0.30 ± 3% perf-profile.self.cycles.__handle_mm_fault
0.09 ± 4% +0.1 0.14 perf-profile.self.cycles.__might_sleep
0.01 ±173% +0.1 0.07 ± 7% perf-profile.self.cycles.switch_mm_irqs_off
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles.run_timer_softirq
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles.__libc_fork
0.00 +0.1 0.05 ± 8% perf-profile.self.cycles.__d_lookup
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles.page_test
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles._cond_resched
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles.__count_memcg_events
0.01 ±173% +0.1 0.07 ± 6% perf-profile.self.cycles.vm_area_dup
0.01 ±173% +0.1 0.07 ± 6% perf-profile.self.cycles.fput_many
0.10 ± 9% +0.1 0.15 ± 2% perf-profile.self.cycles.find_vma
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles.update_blocked_averages
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles.rcu_all_qs
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles.lockref_put_return
0.01 ±173% +0.1 0.07 perf-profile.self.cycles.__list_add_valid
0.28 ± 5% +0.1 0.34 ± 5% perf-profile.self.cycles.refcount_dec_not_one
0.14 ± 3% +0.1 0.20 ± 4% perf-profile.self.cycles._raw_spin_lock_irqsave
0.11 ± 3% +0.1 0.17 ± 4% perf-profile.self.cycles.get_page_from_freelist
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles.lockref_get_not_dead
0.00 +0.1 0.06 perf-profile.self.cycles.memset_erms
0.00 +0.1 0.06 perf-profile.self.cycles.__anon_vma_interval_tree_augment_rotate
0.12 ± 9% +0.1 0.18 perf-profile.self.cycles.filldir
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles.__virt_addr_valid
0.09 ± 7% +0.1 0.15 ± 3% perf-profile.self.cycles.alloc_set_pte
0.11 ± 4% +0.1 0.17 ± 4% perf-profile.self.cycles.___perf_sw_event
0.08 ± 8% +0.1 0.15 ± 10% perf-profile.self.cycles.cpuidle_enter_state
0.00 +0.1 0.07 ± 13% perf-profile.self.cycles.do_idle
0.03 ±100% +0.1 0.09 ± 4% perf-profile.self.cycles.PageHuge
0.01 ±173% +0.1 0.08 perf-profile.self.cycles.__alloc_file
0.01 ±173% +0.1 0.08 ± 50% perf-profile.self.cycles.tick_nohz_next_event
0.03 ±100% +0.1 0.10 ± 5% perf-profile.self.cycles.down_read
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles.perf_iterate_sb
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles.native_sched_clock
0.14 ± 5% +0.1 0.21 ± 6% perf-profile.self.cycles.__list_del_entry_valid
0.15 ± 3% +0.1 0.22 ± 3% perf-profile.self.cycles.anon_vma_interval_tree_remove
0.10 ± 4% +0.1 0.18 ± 2% perf-profile.self.cycles.dup_mm
0.01 ±173% +0.1 0.09 ± 4% perf-profile.self.cycles.mark_page_accessed
0.14 ± 8% +0.1 0.21 ± 3% perf-profile.self.cycles.page_add_file_rmap
0.13 ± 8% +0.1 0.21 ± 3% perf-profile.self.cycles.kmem_cache_alloc
0.00 +0.1 0.08 ± 5% perf-profile.self.cycles.idle_cpu
0.17 ± 11% +0.1 0.26 ± 10% perf-profile.self.cycles.apic_timer_interrupt
0.15 ± 7% +0.1 0.23 ± 3% perf-profile.self.cycles.___might_sleep
0.09 ± 5% +0.1 0.17 ± 4% perf-profile.self.cycles.queued_read_lock_slowpath
0.13 ± 9% +0.1 0.22 ± 13% perf-profile.self.cycles.menu_select
0.17 ± 6% +0.1 0.26 ± 4% perf-profile.self.cycles.native_flush_tlb_one_user
0.19 ± 6% +0.1 0.28 ± 2% perf-profile.self.cycles.vma_interval_tree_insert
0.16 ± 4% +0.1 0.26 ± 4% perf-profile.self.cycles.swapgs_restore_regs_and_return_to_usermode
0.29 ± 2% +0.1 0.39 ± 2% perf-profile.self.cycles.up_write
0.19 ± 5% +0.1 0.29 ± 3% perf-profile.self.cycles.syscall_return_via_sysret
0.18 ± 4% +0.1 0.28 ± 3% perf-profile.self.cycles.copy_page
0.15 ± 11% +0.1 0.25 ± 29% perf-profile.self.cycles.ktime_get
1.95 ± 5% +0.1 2.05 perf-profile.self.cycles.filemap_map_pages
0.12 ± 11% +0.1 0.22 perf-profile.self.cycles.unlock_page
0.24 ± 2% +0.1 0.35 ± 7% perf-profile.self.cycles.update_sd_lb_stats
0.10 ± 8% +0.1 0.21 ± 3% perf-profile.self.cycles.queued_write_lock_slowpath
0.18 ± 5% +0.1 0.31 ± 5% perf-profile.self.cycles._dl_addr
0.24 ± 7% +0.1 0.38 ± 2% perf-profile.self.cycles.free_pages_and_swap_cache
0.25 ± 4% +0.1 0.40 ± 4% perf-profile.self.cycles.entry_SYSCALL_64
0.34 ± 5% +0.2 0.49 ± 2% perf-profile.self.cycles.down_write
0.29 ± 8% +0.2 0.45 ± 2% perf-profile.self.cycles.clear_page_erms
0.30 ± 5% +0.2 0.48 ± 5% perf-profile.self.cycles.select_task_rq_fair
0.28 ± 5% +0.2 0.46 perf-profile.self.cycles.__slab_free
0.43 ± 5% +0.2 0.61 perf-profile.self.cycles.anon_vma_interval_tree_insert
0.44 ± 5% +0.2 0.67 perf-profile.self.cycles.copy_p4d_range
0.38 ± 2% +0.2 0.61 ± 2% perf-profile.self.cycles._raw_spin_lock
0.42 ± 5% +0.2 0.67 ± 2% perf-profile.self.cycles.prepare_exit_to_usermode
0.44 ± 4% +0.3 0.70 ± 3% perf-profile.self.cycles.page_fault
0.55 ± 4% +0.4 0.92 perf-profile.self.cycles.page_remove_rmap
0.62 ± 5% +0.4 1.00 ± 2% perf-profile.self.cycles.rwsem_spin_on_owner
0.68 ± 4% +0.4 1.06 ± 3% perf-profile.self.cycles.do_syscall_64
0.98 ± 6% +0.6 1.57 perf-profile.self.cycles.unmap_page_range
0.73 ± 6% +0.6 1.34 ± 2% perf-profile.self.cycles.release_pages
4.79 ± 28% +2.2 6.96 ± 6% perf-profile.self.cycles.intel_idle
16.16 ± 9% +8.9 25.09 ± 9% perf-profile.self.cycles.sieve
2.43 ± 12% +9.1 11.51 ± 7% perf-profile.self.cycles.native_queued_spin_lock_slowpath
reaim.time.user_time
7200 +-+------------------------------------------------------------------+
7000 O-+ O O O O O O O O O O O O O O |
| O O O
6800 +-+O O |
6600 +-+ O |
6400 +-+ |
6200 +-+ |
| |
6000 +-+ |
5800 +-+ |
5600 +-+ |
5400 +-+ .+... |
|.. ..+..+...+. +..+...+..+...+.. .+...+..+...+..+ |
5200 +-++. +. |
5000 +-+------------------------------------------------------------------+
reaim.time.system_time
18000 +-+-----------------------------------------------------------------+
17000 +-++... ..+.. ..+.. .+... .+ |
| +..+...+.. .+. +. +. +..+...+..+. |
16000 +-+ +. |
15000 +-+ |
| |
14000 +-+ |
13000 +-+ |
12000 +-+ |
| |
11000 +-+ |
10000 +-+O O O |
| O O O O O O O O O
9000 O-+ O O O O O O O O |
8000 +-+-----------------------------------------------------------------+
reaim.time.percent_of_cpu_this_job_got
7500 +-+------------------------------------------------------------------+
|. +..+...+.. .+. . .. . .. +...+..+...+..+ |
| .. + + |
7000 +-+ + |
| |
| |
6500 +-+ |
| |
6000 +-+ |
| |
| O O |
5500 +-+O |
| O O O O O O O O O
O O O O O O O O O |
5000 +-+------------------------------------------------------------------+
reaim.time.minor_page_faults
3.7e+08 O-+----O--O--O---O--O--O--O---O--O--O---O--O------O--------O---O--+
| O O
3.6e+08 +-+O O O |
| |
| |
3.5e+08 +-+ |
| |
3.4e+08 +-+ |
| |
3.3e+08 +-+ |
| .+.. |
| .+.. .. .+... .+.. .+.. ..+.. |
3.2e+08 +-+ ..+. + +..+. +. ..+. +. + |
| +. +. |
3.1e+08 +-+---------------------------------------------------------------+
reaim.time.voluntary_context_switches
1.55e+07 +-+--------------------------------------------------------------+
| O |
1.5e+07 O-+ O O O O O |
| O O O O
| O O O O O O O O |
1.45e+07 +-+ O |
| O |
1.4e+07 +-+ |
| |
1.35e+07 +-+ |
| |
| .+... +.. .+.. |
1.3e+07 +-+ ..+..+..+. +.. .. .. .+..+...+..+.. |
|..+. + + +. + |
1.25e+07 +-+--------------------------------------------------------------+
reaim.time.involuntary_context_switches
3.1e+06 +-+--------------------------------------------------------------+
3.05e+06 +-+ .+.. .+.. .+... .+... .+..+ |
| +...+. +..+...+. +. +..+..+. +. |
3e+06 +-+ |
2.95e+06 +-+ |
2.9e+06 +-+ |
2.85e+06 +-+ |
| |
2.8e+06 +-+ O |
2.75e+06 +-+ O O O O O O O O |
2.7e+06 +-+O O |
2.65e+06 +-+ O O O O
| O O O O |
2.6e+06 O-+ O |
2.55e+06 +-+--------------------------------------------------------------+
reaim.parent_time
1.9 +-+-------------------------------------------------------------------+
| ..+.. .+.. |
1.8 +-+ +...+..+.. +...+.. ..+.. .. +...+..+...+..+ |
| . .. +. + |
| + |
1.7 +-+ |
| |
1.6 +-+ |
| |
1.5 +-+ |
| |
| |
1.4 +-+ O O O |
| O O O O O O O O O O O O O
1.3 O-+-------------------------O------O------O----------O----------------+
reaim.child_systime
240 +-+-------------------------------------------------------------------+
| ..+.. .+.. |
220 +-+ +...+..+.. +...+.. ..+.. .. +...+..+...+..+ |
200 +-+ . .. +. + |
| + |
180 +-+ |
| |
160 +-+ |
| |
140 +-+ |
120 +-+ |
| O O O |
100 +-+ O O O O O O O O O O O O O O O O
O O |
80 +-+-------------------------------------------------------------------+
reaim.child_utime
80 +-+--------------------------------------------------------------------+
| |
78 O-+ O O O O O O O O |
| O O O O O O O O O
76 +-+ O O |
| O |
74 +-+ |
| |
72 +-+ |
| |
70 +-+ |
| |
68 +-+ ..+.. ..+.. .+... ..+.. ..+.. |
|...+..+. +. +...+. +. +. +...+..+...+ |
66 +-+--------------------------------------------------------------------+
reaim.jobs_per_min
850000 +-+----------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O
800000 +-+ |
| O O O |
| |
750000 +-+ |
| |
700000 +-+ |
| |
650000 +-+ |
| .+.. |
| ..+..+.. .. ..+.. ..+.. .+...+.. .+... |
600000 +-++. + +..+. +. +. +. + |
| |
550000 +-+----------------------------------------------------------------+
reaim.jobs_per_min_child
4400 O-+------------------------------------------------------------------+
| O O O O O O O O O O O O O O O O O
4200 +-+ |
| O O O |
4000 +-+ |
| |
3800 +-+ |
| |
3600 +-+ |
| |
3400 +-+ |
| +.. |
3200 +-+ ..+..+... .. . ..+.. ..+.. +...+.. ..+.. |
|..+. + +..+. +. .. +. + |
3000 +-+------------------------------------------------------------------+
reaim.std_dev_time
0.08 +-+-----------------------------------------------------------------+
O O O O O O O O O
0.075 +-+ O O O O O O O O O O |
| O O |
0.07 +-+ |
| |
0.065 +-+ |
| |
0.06 +-+ |
| |
0.055 +-+ .+.. +. + |
| .+.. ..+. + .. + + .+.. ..+..+.. |
0.05 +-+ .. +. +... + + + .. +. |
|..+ + + + + |
0.045 +-+-----------------------------------------------------------------+
reaim.std_dev_percent
7 +-+-------------------------------------------------------------------+
O O O O O O O O O O O
6.5 +-+ O O O O O O O O O O |
6 +-+ |
| |
5.5 +-+ |
5 +-+ |
| |
4.5 +-+ |
4 +-+ |
| |
3.5 +-+ ..+.. +.. +.. |
3 +-+ .+...+..+. +... .. . .. . .+...+..+...+.. |
|...+. + + +. + |
2.5 +-+-------------------------------------------------------------------+
reaim.jti
97 +-+------------------------------------------------------------------+
|..+... .+.. +.. +.. .+ |
96.5 +-+ +..+...+.. ..+. . .. . .. +...+..+...+. |
96 +-+ +. + + |
| |
95.5 +-+ |
95 +-+ |
| |
94.5 +-+ |
94 +-+ |
| |
93.5 +-+ |
93 +-+O O O O O O O O O O |
O O O O O O O O O O O
92.5 +-+------------------------------------------------------------------+
reaim.max_jobs_per_min
900000 +-+----------------------------------------------------------------+
O O O O O O O O O O O O O O O |
850000 +-+ O O O
| O |
| O O |
800000 +-+ |
| |
750000 +-+ |
| |
700000 +-+ |
| |
| .+.. |
650000 +-+ ..+..+.. .. ..+.. ..+.. +...+.. .+... |
|..+. + +..+. +. .. +. + |
600000 +-+----------------------------------------------------------------+
reaim.workload
1.75e+06 +-+--------------------------------------------------------------+
O O O O O O O O O O O O O O O O |
1.7e+06 +-+ O O
| O O O |
| |
1.65e+06 +-+ |
| |
1.6e+06 +-+ |
| |
1.55e+06 +-+ |
| +.. |
| .+.. .. . .+.. ..+.. .+... .+.. |
1.5e+06 +-+ ..+. + +..+. +. .+. +. + |
| +. +. |
1.45e+06 +-+--------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
11 months, 3 weeks
- 1
- 0
[tcp] 8b27dae5a2: netperf.Throughput_Mbps -25.7% regression
by kernel test robot
Greeting,
FYI, we noticed a -25.7% regression of netperf.Throughput_Mbps due to commit:
commit: 8b27dae5a2e89a61c46c6dbc76c040c0e6d0ed4c ("tcp: add one skb cache for rx")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: netperf
on test machine: 104 threads Skylake with 192G memory
with following parameters:
ip: ipv4
runtime: 900s
nr_threads: 200%
cluster: cs-localhost
test: TCP_STREAM
cpufreq_governor: performance
test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------------+
| testcase: change | netperf: netperf.Throughput_Mbps -25.6% regression |
| test machine | 104 threads Skylake with 192G memory |
| test parameters | cluster=cs-localhost |
| | cpufreq_governor=performance |
| | ip=ipv4 |
| | nr_threads=200% |
| | runtime=900s |
| | test=TCP_MAERTS |
+------------------+----------------------------------------------------+
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/200%/debian-x86_64-2018-04-03.cgz/900s/lkp-skl-fpga01/TCP_STREAM/netperf
commit:
472c2e07ee ("tcp: add one skb cache for tx")
8b27dae5a2 ("tcp: add one skb cache for rx")
472c2e07eef04514 8b27dae5a2e89a61c46c6dbc76c
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:4 25% 1:4 dmesg.WARNING:at_ip_ip_finish_output2/0x
%stddev %change %stddev
\ | \
3939 -25.7% 2925 netperf.Throughput_Mbps
819330 -25.7% 608425 netperf.Throughput_total_Mbps
3.725e+09 -25.8% 2.764e+09 netperf.time.involuntary_context_switches
7399 -1.8% 7266 netperf.time.percent_of_cpu_this_job_got
65271 -1.0% 64597 netperf.time.system_time
1529 -34.0% 1009 netperf.time.user_time
5.626e+09 -25.7% 4.178e+09 netperf.workload
12.36 ± 4% +6.5 18.84 mpstat.cpu.all.soft%
2.95 ± 2% -0.8 2.15 mpstat.cpu.all.usr%
9.557e+08 +13.2% 1.082e+09 numa-numastat.node0.local_node
9.557e+08 +13.2% 1.082e+09 numa-numastat.node0.numa_hit
4.845e+08 ± 2% +11.6% 5.407e+08 numa-vmstat.node0.numa_hit
4.845e+08 ± 2% +11.6% 5.406e+08 numa-vmstat.node0.numa_local
2662 ± 2% +4.2% 2774 turbostat.Avg_MHz
1.87 ± 86% -66.1% 0.63 ± 9% turbostat.CPU%c1
94.75 ± 2% +2.4% 97.00 vmstat.cpu.sy
8145843 ± 2% -24.7% 6134835 vmstat.system.cs
224329 -0.8% 222470 vmstat.system.in
1.884e+09 +10.9% 2.09e+09 proc-vmstat.numa_hit
1.884e+09 +10.9% 2.089e+09 proc-vmstat.numa_local
1.506e+10 +10.9% 1.671e+10 proc-vmstat.pgalloc_normal
1.506e+10 +10.9% 1.671e+10 proc-vmstat.pgfree
2104 ± 8% +86.4% 3922 ± 58% sched_debug.cpu.avg_idle.min
35810547 -25.7% 26600377 sched_debug.cpu.nr_switches.avg
37423347 -25.1% 28047296 sched_debug.cpu.nr_switches.max
32860210 -25.5% 24491190 sched_debug.cpu.nr_switches.min
968.00 ± 4% -18.2% 792.00 ± 7% slabinfo.kmalloc-rcl-128.active_objs
968.00 ± 4% -18.2% 792.00 ± 7% slabinfo.kmalloc-rcl-128.num_objs
16611 ± 2% +6.1% 17628 ± 4% slabinfo.skbuff_fclone_cache.active_objs
16827 ± 2% +5.7% 17794 ± 4% slabinfo.skbuff_fclone_cache.num_objs
18.78 ± 5% +28.9% 24.21 perf-stat.i.MPKI
1.942e+10 ± 2% -21.1% 1.531e+10 perf-stat.i.branch-instructions
2.08 ± 6% -0.1 1.97 perf-stat.i.branch-miss-rate%
3.892e+08 ± 2% -22.6% 3.014e+08 perf-stat.i.branch-misses
1.767e+09 ± 2% +4.3% 1.842e+09 perf-stat.i.cache-references
8171306 ± 2% -24.7% 6151961 perf-stat.i.context-switches
2.88 ± 2% +31.0% 3.78 perf-stat.i.cpi
2.761e+11 ± 2% +4.2% 2.876e+11 perf-stat.i.cpu-cycles
1.10 ± 3% -0.1 0.97 perf-stat.i.dTLB-load-miss-rate%
3.254e+08 ± 4% -32.1% 2.208e+08 perf-stat.i.dTLB-load-misses
2.893e+10 ± 2% -21.9% 2.26e+10 perf-stat.i.dTLB-loads
58990104 ± 5% -25.8% 43766302 perf-stat.i.dTLB-store-misses
1.658e+10 ± 2% -23.6% 1.266e+10 perf-stat.i.dTLB-stores
55.76 -3.4 52.34 perf-stat.i.iTLB-load-miss-rate%
63191122 ± 2% -29.1% 44815478 perf-stat.i.iTLB-load-misses
49413835 ± 2% -17.7% 40661018 perf-stat.i.iTLB-loads
9.688e+10 ± 2% -21.5% 7.605e+10 perf-stat.i.instructions
1607 ± 3% +8.1% 1737 perf-stat.i.instructions-per-iTLB-miss
0.35 -24.3% 0.27 perf-stat.i.ipc
86243 ± 29% +52.4% 131400 ± 18% perf-stat.i.node-stores
18.24 +32.8% 24.23 perf-stat.overall.MPKI
2.00 -0.0 1.97 perf-stat.overall.branch-miss-rate%
2.85 +32.7% 3.78 perf-stat.overall.cpi
1.11 ± 3% -0.1 0.97 perf-stat.overall.dTLB-load-miss-rate%
56.12 -3.7 52.43 perf-stat.overall.iTLB-load-miss-rate%
1533 ± 2% +10.7% 1697 perf-stat.overall.instructions-per-iTLB-miss
0.35 -24.6% 0.26 perf-stat.overall.ipc
15748 +4.3% 16430 perf-stat.overall.path-length
1.939e+10 ± 2% -21.1% 1.53e+10 perf-stat.ps.branch-instructions
3.887e+08 ± 2% -22.5% 3.011e+08 perf-stat.ps.branch-misses
1.764e+09 ± 2% +4.3% 1.84e+09 perf-stat.ps.cache-references
8161286 ± 2% -24.7% 6144845 perf-stat.ps.context-switches
2.757e+11 ± 2% +4.2% 2.872e+11 perf-stat.ps.cpu-cycles
3.25e+08 ± 4% -32.1% 2.206e+08 perf-stat.ps.dTLB-load-misses
2.889e+10 ± 2% -21.8% 2.258e+10 perf-stat.ps.dTLB-loads
58916703 ± 5% -25.8% 43714633 perf-stat.ps.dTLB-store-misses
1.656e+10 ± 2% -23.6% 1.265e+10 perf-stat.ps.dTLB-stores
63112575 ± 2% -29.1% 44762927 perf-stat.ps.iTLB-load-misses
49353553 ± 2% -17.7% 40614004 perf-stat.ps.iTLB-loads
9.676e+10 ± 2% -21.5% 7.596e+10 perf-stat.ps.instructions
86182 ± 29% +52.3% 131291 ± 18% perf-stat.ps.node-stores
8.86e+13 -22.5% 6.864e+13 perf-stat.total.instructions
136251 ± 8% -18.5% 110991 ± 10% interrupts.CPU1.RES:Rescheduling_interrupts
128756 ± 3% -18.6% 104869 ± 6% interrupts.CPU10.RES:Rescheduling_interrupts
119826 ± 6% -12.1% 105329 ± 4% interrupts.CPU100.RES:Rescheduling_interrupts
121133 ± 10% -17.9% 99457 interrupts.CPU101.RES:Rescheduling_interrupts
9051 ± 3% +14.1% 10328 interrupts.CPU102.CAL:Function_call_interrupts
131446 ± 7% -17.8% 108104 ± 9% interrupts.CPU102.RES:Rescheduling_interrupts
124627 ± 2% -16.6% 103971 ± 9% interrupts.CPU12.RES:Rescheduling_interrupts
131072 ± 11% -19.9% 105033 ± 4% interrupts.CPU13.RES:Rescheduling_interrupts
127845 ± 8% -17.0% 106112 ± 9% interrupts.CPU14.RES:Rescheduling_interrupts
126159 ± 10% -20.6% 100111 ± 11% interrupts.CPU15.RES:Rescheduling_interrupts
132232 ± 5% -17.9% 108535 ± 7% interrupts.CPU17.RES:Rescheduling_interrupts
127157 ± 4% -17.3% 105165 ± 11% interrupts.CPU18.RES:Rescheduling_interrupts
127948 ± 2% -15.5% 108165 ± 11% interrupts.CPU19.RES:Rescheduling_interrupts
122716 ± 6% -14.0% 105519 ± 11% interrupts.CPU23.RES:Rescheduling_interrupts
130754 ± 5% -20.3% 104222 ± 9% interrupts.CPU24.RES:Rescheduling_interrupts
126283 ± 4% -16.6% 105320 ± 6% interrupts.CPU27.RES:Rescheduling_interrupts
8997 ± 3% -12.4% 7883 ± 9% interrupts.CPU28.CAL:Function_call_interrupts
128467 ± 5% -20.9% 101674 ± 11% interrupts.CPU29.RES:Rescheduling_interrupts
133914 ± 6% -26.0% 99089 ± 10% interrupts.CPU3.RES:Rescheduling_interrupts
8987 ± 3% -11.9% 7922 ± 7% interrupts.CPU31.CAL:Function_call_interrupts
115389 ± 9% -17.7% 94962 ± 5% interrupts.CPU31.RES:Rescheduling_interrupts
8830 ± 5% -12.1% 7759 ± 4% interrupts.CPU32.CAL:Function_call_interrupts
134198 ± 6% -19.6% 107954 ± 6% interrupts.CPU33.RES:Rescheduling_interrupts
8940 ± 3% -8.8% 8154 ± 4% interrupts.CPU34.CAL:Function_call_interrupts
123678 ± 12% -17.1% 102582 ± 2% interrupts.CPU34.RES:Rescheduling_interrupts
8969 ± 3% -9.2% 8143 ± 4% interrupts.CPU35.CAL:Function_call_interrupts
118372 ± 8% -10.9% 105507 ± 9% interrupts.CPU35.RES:Rescheduling_interrupts
8958 ± 3% -9.2% 8131 ± 4% interrupts.CPU36.CAL:Function_call_interrupts
132196 ± 3% -16.2% 110761 ± 7% interrupts.CPU4.RES:Rescheduling_interrupts
123005 ± 6% -17.2% 101838 ± 3% interrupts.CPU40.RES:Rescheduling_interrupts
132802 ± 15% -23.6% 101521 ± 11% interrupts.CPU43.RES:Rescheduling_interrupts
131107 ± 4% -25.6% 97566 ± 3% interrupts.CPU44.RES:Rescheduling_interrupts
127673 ± 8% -24.0% 97028 ± 6% interrupts.CPU47.RES:Rescheduling_interrupts
123709 ± 6% -14.3% 106030 ± 12% interrupts.CPU48.RES:Rescheduling_interrupts
123709 ± 7% -12.4% 108355 ± 6% interrupts.CPU49.RES:Rescheduling_interrupts
135382 ± 5% -20.7% 107334 ± 3% interrupts.CPU51.RES:Rescheduling_interrupts
130424 ± 4% -17.4% 107704 ± 6% interrupts.CPU52.RES:Rescheduling_interrupts
129234 ± 8% -18.6% 105171 ± 10% interrupts.CPU53.RES:Rescheduling_interrupts
131374 ± 6% -18.8% 106699 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts
126141 ± 10% -14.7% 107626 ± 11% interrupts.CPU57.RES:Rescheduling_interrupts
133750 ± 9% -19.9% 107102 interrupts.CPU6.RES:Rescheduling_interrupts
119663 ± 5% -16.7% 99633 ± 3% interrupts.CPU60.RES:Rescheduling_interrupts
121078 ± 7% -13.6% 104670 ± 9% interrupts.CPU61.RES:Rescheduling_interrupts
121662 ± 5% -15.3% 102992 ± 10% interrupts.CPU63.RES:Rescheduling_interrupts
118130 ± 2% -15.1% 100310 ± 5% interrupts.CPU65.RES:Rescheduling_interrupts
128075 ± 6% -18.4% 104495 ± 8% interrupts.CPU67.RES:Rescheduling_interrupts
124700 ± 6% -15.7% 105149 ± 4% interrupts.CPU68.RES:Rescheduling_interrupts
119607 ± 9% -12.7% 104432 ± 6% interrupts.CPU7.RES:Rescheduling_interrupts
119288 ± 4% -11.8% 105251 ± 6% interrupts.CPU71.RES:Rescheduling_interrupts
125678 ± 7% -18.7% 102141 ± 8% interrupts.CPU72.RES:Rescheduling_interrupts
130174 ± 5% -19.8% 104394 ± 3% interrupts.CPU74.RES:Rescheduling_interrupts
9215 ± 2% +9.8% 10119 ± 4% interrupts.CPU76.CAL:Function_call_interrupts
113784 ± 8% -10.6% 101686 ± 7% interrupts.CPU78.RES:Rescheduling_interrupts
122103 ± 5% -16.2% 102305 ± 5% interrupts.CPU79.RES:Rescheduling_interrupts
122242 ± 3% -23.8% 93153 ± 8% interrupts.CPU81.RES:Rescheduling_interrupts
9154 ± 3% +10.3% 10092 ± 4% interrupts.CPU82.CAL:Function_call_interrupts
116414 ± 3% -18.8% 94476 ± 9% interrupts.CPU82.RES:Rescheduling_interrupts
128558 ± 12% -24.5% 97067 ± 2% interrupts.CPU83.RES:Rescheduling_interrupts
9147 ± 3% +10.2% 10078 ± 4% interrupts.CPU84.CAL:Function_call_interrupts
122842 ± 9% -19.8% 98521 ± 2% interrupts.CPU84.RES:Rescheduling_interrupts
9081 ± 3% +10.9% 10071 ± 4% interrupts.CPU85.CAL:Function_call_interrupts
9130 ± 2% +10.2% 10065 ± 4% interrupts.CPU86.CAL:Function_call_interrupts
9068 ± 3% +10.9% 10057 ± 5% interrupts.CPU87.CAL:Function_call_interrupts
9068 ± 3% +10.8% 10050 ± 5% interrupts.CPU88.CAL:Function_call_interrupts
122119 ± 5% -20.1% 97576 ± 3% interrupts.CPU88.RES:Rescheduling_interrupts
9065 ± 3% +12.8% 10223 ± 2% interrupts.CPU89.CAL:Function_call_interrupts
124799 ± 6% -20.4% 99390 ± 8% interrupts.CPU89.RES:Rescheduling_interrupts
130362 ± 2% -12.6% 113981 ± 5% interrupts.CPU9.RES:Rescheduling_interrupts
8902 +12.7% 10035 ± 5% interrupts.CPU90.CAL:Function_call_interrupts
9062 ± 3% +10.7% 10028 ± 5% interrupts.CPU91.CAL:Function_call_interrupts
119442 ± 8% -24.1% 90611 ± 2% interrupts.CPU91.RES:Rescheduling_interrupts
9058 ± 3% +10.7% 10023 ± 5% interrupts.CPU92.CAL:Function_call_interrupts
117081 ± 10% -21.2% 92294 ± 12% interrupts.CPU92.RES:Rescheduling_interrupts
9058 ± 3% +10.6% 10017 ± 5% interrupts.CPU93.CAL:Function_call_interrupts
130977 ± 17% -27.7% 94702 ± 6% interrupts.CPU94.RES:Rescheduling_interrupts
9055 ± 3% +10.5% 10003 ± 5% interrupts.CPU95.CAL:Function_call_interrupts
116952 ± 4% -12.4% 102488 ± 10% interrupts.CPU95.RES:Rescheduling_interrupts
9054 ± 3% +10.4% 9995 ± 5% interrupts.CPU96.CAL:Function_call_interrupts
9054 ± 3% +10.3% 9990 ± 5% interrupts.CPU97.CAL:Function_call_interrupts
118634 ± 5% -12.7% 103578 ± 9% interrupts.CPU98.RES:Rescheduling_interrupts
116356 ± 10% -16.5% 97115 ± 7% interrupts.CPU99.RES:Rescheduling_interrupts
12787758 ± 2% -14.8% 10896246 interrupts.RES:Rescheduling_interrupts
10.84 -10.8 0.00 perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
10.56 -10.6 0.00 perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
10.16 -10.2 0.00 perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv
10.07 -10.1 0.00 perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established
9.71 -9.7 0.00 perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack
9.57 -9.6 0.00 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue
21.28 -6.8 14.49 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.19 -6.8 14.43 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.57 -6.6 14.00 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.46 -6.5 13.93 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
16.37 -3.0 13.34 perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
16.18 -3.0 13.21 perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto
7.01 ± 4% -2.4 4.61 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
6.90 ± 5% -2.4 4.54 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
7.71 ± 2% -2.2 5.51 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
7.69 ± 2% -2.2 5.49 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
6.19 ± 5% -2.1 4.10 perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
6.04 ± 5% -2.0 4.00 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
5.89 ± 6% -2.0 3.90 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv
7.03 ± 2% -2.0 5.04 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg
5.71 ± 6% -1.9 3.78 perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established
13.46 -1.9 11.54 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
6.86 ± 2% -1.9 4.93 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg
6.72 ± 2% -1.9 4.83 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
13.26 -1.8 11.41 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg
5.49 -1.8 3.67 perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
2.62 ± 14% -1.8 0.82 ± 5% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable
5.29 -1.7 3.61 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
4.80 -1.6 3.17 perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
4.59 -1.6 3.02 perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg
4.50 -1.5 2.96 perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg
4.41 -1.5 2.90 perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.wait_woken.sk_wait_data
4.81 -1.5 3.31 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
10.13 -1.5 8.63 perf-profile.calltrace.cycles-pp._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
9.79 -1.4 8.36 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
2.14 -1.4 0.73 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable
4.34 -1.4 2.96 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg
9.60 -1.4 8.23 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg
2.10 ± 34% -1.4 0.73 ± 6% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock
2.08 -1.4 0.71 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock
3.88 ± 2% -1.2 2.71 perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
3.71 -1.2 2.55 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg
3.56 ± 2% -1.1 2.49 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
3.32 ± 2% -1.0 2.34 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg
1.56 -0.9 0.61 ± 2% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
3.14 ± 2% -0.9 2.22 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked
1.77 -0.6 1.16 perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout.wait_woken
7.43 ± 2% -0.6 6.87 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
7.41 ± 2% -0.6 6.85 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.39 -0.5 0.87 perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.34 -0.5 0.84 perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.30 -0.5 0.81 perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.09 -0.4 0.72 perf-profile.calltrace.cycles-pp.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.20 -0.4 0.84 perf-profile.calltrace.cycles-pp.__switch_to
1.09 -0.3 0.76 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
6.67 ± 2% -0.3 6.38 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg
0.83 -0.3 0.56 perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg
0.84 -0.3 0.57 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__sched_text_start.schedule.schedule_timeout.wait_woken
0.95 -0.3 0.69 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.75 ± 2% -0.2 0.52 perf-profile.calltrace.cycles-pp._cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
0.73 ± 2% -0.2 0.51 perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.__release_sock.release_sock.tcp_sendmsg
9.41 +1.1 10.47 perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb
9.29 +1.1 10.39 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.skb_release_data
95.31 +1.4 96.67 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
95.15 +1.4 96.56 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.02 +7.2 18.20 perf-profile.calltrace.cycles-pp.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
12.28 ± 2% +7.2 19.51 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
12.21 ± 2% +7.3 19.47 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit
12.00 ± 2% +7.3 19.34 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
11.98 ± 2% +7.3 19.32 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
11.74 ± 2% +7.4 19.14 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
11.43 ± 2% +7.4 18.87 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq
11.37 ± 2% +7.5 18.83 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
9.15 +7.5 16.67 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.___pskb_trim
9.26 +7.5 16.80 perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb
9.43 +7.6 17.01 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked
9.79 +7.6 17.37 perf-profile.calltrace.cycles-pp.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
10.97 ± 2% +7.6 18.56 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack
9.59 +7.6 17.22 perf-profile.calltrace.cycles-pp.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg
10.64 ± 3% +7.7 18.30 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
10.11 ± 3% +7.8 17.94 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
9.96 ± 3% +7.9 17.82 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
3.91 ± 2% +7.9 11.79 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
3.91 ± 2% +7.9 11.79 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
9.90 ± 3% +7.9 17.79 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
9.71 ± 3% +8.0 17.67 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
3.58 ± 2% +8.0 11.60 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv
3.34 ± 2% +8.1 11.45 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established
9.05 ± 2% +8.1 17.17 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
18.39 +8.7 27.12 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill
18.58 +8.7 27.31 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill
19.93 +8.7 28.67 perf-profile.calltrace.cycles-pp.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
19.92 +8.7 28.66 perf-profile.calltrace.cycles-pp.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
19.70 +8.7 28.45 perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked
19.77 +8.8 28.54 perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg
72.20 +8.8 81.00 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
72.09 +8.8 80.92 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
71.49 +9.0 80.48 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
71.15 +9.1 80.24 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64
0.00 +10.6 10.61 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb.tcp_v4_rcv
0.00 +10.7 10.72 perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu
0.00 +11.0 10.98 perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
0.00 +11.1 11.11 perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
54.40 +12.2 66.63 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
32407497 -26.7% 23748191 softirqs.CPU0.NET_RX
31936171 ± 3% -23.8% 24347695 softirqs.CPU1.NET_RX
31995720 ± 3% -23.5% 24474810 softirqs.CPU10.NET_RX
31851135 -28.4% 22807522 softirqs.CPU100.NET_RX
31165470 ± 2% -27.9% 22460444 ± 2% softirqs.CPU101.NET_RX
30427682 ± 3% -27.8% 21964060 ± 2% softirqs.CPU102.NET_RX
31822429 -30.3% 22190016 ± 2% softirqs.CPU103.NET_RX
31794681 ± 3% -24.0% 24170873 ± 2% softirqs.CPU11.NET_RX
31337588 ± 3% -25.0% 23487789 ± 2% softirqs.CPU12.NET_RX
30982384 ± 3% -21.6% 24285912 softirqs.CPU13.NET_RX
31985249 ± 2% -24.5% 24135878 ± 2% softirqs.CPU14.NET_RX
31569639 ± 3% -23.4% 24173977 ± 2% softirqs.CPU15.NET_RX
31672651 ± 2% -23.7% 24152941 ± 2% softirqs.CPU16.NET_RX
31845476 ± 2% -23.4% 24406051 softirqs.CPU17.NET_RX
32237888 -24.4% 24378972 softirqs.CPU18.NET_RX
32390163 -25.7% 24060765 softirqs.CPU19.NET_RX
32518154 -26.3% 23981309 ± 2% softirqs.CPU2.NET_RX
31625849 ± 2% -26.0% 23391632 ± 2% softirqs.CPU20.NET_RX
31800991 ± 2% -24.2% 24096267 ± 2% softirqs.CPU21.NET_RX
32165283 ± 2% -23.9% 24484882 softirqs.CPU22.NET_RX
32096347 ± 3% -24.6% 24198018 ± 2% softirqs.CPU23.NET_RX
32606868 -24.9% 24498919 softirqs.CPU24.NET_RX
31333059 ± 2% -23.5% 23972392 ± 2% softirqs.CPU25.NET_RX
29740104 ± 3% -23.9% 22620846 softirqs.CPU26.NET_RX
8933 ± 31% -24.6% 6736 ± 7% softirqs.CPU26.SCHED
31426927 -28.2% 22574373 ± 2% softirqs.CPU27.NET_RX
31494409 -27.6% 22811958 softirqs.CPU28.NET_RX
31749609 -29.8% 22274240 ± 2% softirqs.CPU29.NET_RX
31359195 ± 3% -23.3% 24058233 softirqs.CPU3.NET_RX
31891532 -28.5% 22801967 softirqs.CPU30.NET_RX
31022930 ± 3% -26.6% 22780850 softirqs.CPU31.NET_RX
31633941 -28.0% 22773366 softirqs.CPU32.NET_RX
31064582 ± 3% -28.2% 22291648 ± 2% softirqs.CPU33.NET_RX
30670424 ± 2% -26.0% 22706259 softirqs.CPU34.NET_RX
31155193 ± 3% -28.3% 22336447 ± 2% softirqs.CPU35.NET_RX
31767721 -29.3% 22462506 ± 2% softirqs.CPU36.NET_RX
31702765 -27.9% 22848963 softirqs.CPU37.NET_RX
31618979 -28.8% 22498908 ± 2% softirqs.CPU38.NET_RX
8157 ± 30% -22.3% 6342 softirqs.CPU38.SCHED
31178503 ± 2% -28.8% 22206116 ± 2% softirqs.CPU39.NET_RX
31543118 ± 3% -22.7% 24378208 softirqs.CPU4.NET_RX
29993167 ± 3% -26.6% 22006508 softirqs.CPU40.NET_RX
31389405 ± 2% -27.4% 22777491 softirqs.CPU41.NET_RX
31225889 ± 3% -28.1% 22466787 ± 2% softirqs.CPU42.NET_RX
31122849 ± 3% -27.5% 22548782 softirqs.CPU43.NET_RX
30449949 ± 3% -26.7% 22314973 ± 2% softirqs.CPU44.NET_RX
30708016 ± 3% -26.5% 22575709 softirqs.CPU45.NET_RX
30869514 ± 2% -27.1% 22517203 softirqs.CPU46.NET_RX
30349340 ± 3% -26.7% 22238899 ± 2% softirqs.CPU47.NET_RX
31690538 -27.9% 22844885 softirqs.CPU48.NET_RX
31442996 -27.6% 22774395 softirqs.CPU49.NET_RX
32539333 -24.8% 24475876 softirqs.CPU5.NET_RX
31777443 -28.1% 22839894 softirqs.CPU50.NET_RX
30319039 ± 4% -25.8% 22488386 softirqs.CPU51.NET_RX
32358234 -24.7% 24364666 softirqs.CPU52.NET_RX
31051127 ± 3% -23.5% 23764585 ± 2% softirqs.CPU53.NET_RX
31368731 ± 3% -22.3% 24384593 softirqs.CPU54.NET_RX
32739188 -26.5% 24063678 ± 2% softirqs.CPU55.NET_RX
32587893 -25.0% 24425586 softirqs.CPU56.NET_RX
31762403 ± 3% -24.6% 23947521 softirqs.CPU57.NET_RX
32342624 -25.5% 24095598 softirqs.CPU58.NET_RX
31850813 ± 3% -23.7% 24310413 softirqs.CPU59.NET_RX
32296552 -26.1% 23882250 ± 2% softirqs.CPU6.NET_RX
31208970 ± 3% -23.9% 23735529 ± 2% softirqs.CPU60.NET_RX
32655061 -25.7% 24259328 softirqs.CPU61.NET_RX
31834306 ± 3% -23.2% 24436288 softirqs.CPU62.NET_RX
32492263 -25.7% 24146807 ± 2% softirqs.CPU63.NET_RX
32160041 -24.6% 24237812 softirqs.CPU64.NET_RX
32146792 -25.1% 24083142 softirqs.CPU65.NET_RX
31886509 ± 3% -24.3% 24153287 ± 2% softirqs.CPU66.NET_RX
31124000 ± 2% -21.2% 24534615 softirqs.CPU67.NET_RX
31606731 ± 3% -23.7% 24115056 ± 2% softirqs.CPU68.NET_RX
31809649 ± 4% -27.3% 23140437 softirqs.CPU69.NET_RX
31832502 ± 3% -23.8% 24256886 softirqs.CPU7.NET_RX
31934664 ± 2% -23.5% 24445503 softirqs.CPU70.NET_RX
32283512 -24.5% 24374573 softirqs.CPU71.NET_RX
31559429 ± 3% -23.0% 24304361 softirqs.CPU72.NET_RX
32519181 -26.5% 23915099 ± 2% softirqs.CPU73.NET_RX
32064639 ± 3% -23.5% 24531236 softirqs.CPU74.NET_RX
32552635 -25.2% 24358616 softirqs.CPU75.NET_RX
32574031 -25.1% 24391309 softirqs.CPU76.NET_RX
29891561 -18.3% 24435768 softirqs.CPU77.NET_RX
30558797 ± 3% -27.1% 22290753 ± 2% softirqs.CPU78.NET_RX
30913524 ± 3% -27.1% 22542484 softirqs.CPU79.NET_RX
32338939 -25.2% 24184482 softirqs.CPU8.NET_RX
29930689 ± 3% -24.3% 22649621 softirqs.CPU80.NET_RX
31789053 -29.3% 22471154 ± 2% softirqs.CPU81.NET_RX
31080841 ± 3% -28.0% 22371709 ± 2% softirqs.CPU82.NET_RX
31004904 ± 3% -28.0% 22335427 softirqs.CPU83.NET_RX
30902184 ± 2% -26.4% 22746371 softirqs.CPU84.NET_RX
31508332 -28.4% 22567097 softirqs.CPU85.NET_RX
31437975 -29.0% 22331821 ± 2% softirqs.CPU86.NET_RX
31025912 ± 3% -26.1% 22913093 softirqs.CPU87.NET_RX
30270422 ± 2% -25.2% 22636977 ± 2% softirqs.CPU88.NET_RX
30385565 ± 4% -26.0% 22499521 ± 2% softirqs.CPU89.NET_RX
31577940 ± 3% -22.4% 24489124 softirqs.CPU9.NET_RX
30152844 ± 3% -24.7% 22717462 softirqs.CPU90.NET_RX
29900183 ± 2% -24.9% 22460973 softirqs.CPU91.NET_RX
31952707 -28.9% 22715130 softirqs.CPU92.NET_RX
30820437 ± 3% -26.6% 22619907 ± 2% softirqs.CPU93.NET_RX
30627580 ± 3% -25.6% 22790846 softirqs.CPU94.NET_RX
31367872 -27.7% 22670545 softirqs.CPU95.NET_RX
31045007 ± 3% -26.5% 22818368 softirqs.CPU96.NET_RX
30842779 ± 3% -28.2% 22143073 ± 2% softirqs.CPU97.NET_RX
30173663 ± 3% -24.8% 22686608 softirqs.CPU98.NET_RX
30750855 ± 3% -25.6% 22870339 softirqs.CPU99.NET_RX
3.273e+09 -25.8% 2.43e+09 softirqs.NET_RX
netperf.Throughput_Mbps
4000 +-+------------------------------------------------------------------+
| |
3500 +-+ |
3000 +-+ |
O O O OO OOO OO OO OOO OO OO OO OOO OO OO OO |
2500 +-+ |
| |
2000 +-+ |
| |
1500 +-+ |
1000 +-+ |
| |
500 +-+ |
| |
0 +O+O---O-------------------------------------------------------------+
netperf.Throughput_total_Mbps
900000 +-+----------------------------------------------------------------+
|+.++.+++.++.+++.++.+++.++.+++.++.+++.+++.++.+++.++.+++.++.+++.++.+|
800000 +-+ |
700000 +-+ |
| O |
600000 O-+ O O O OO OOO OO OOO OO OOO O OOO OOO OO O |
500000 +-+ |
| |
400000 +-+ |
300000 +-+ |
| |
200000 +-+ |
100000 +-+ |
| |
0 +O+O---O-----------------------------------------------------------+
netperf.workload
6e+09 +-+-----------------------------------------------------------------+
|+.++.++.+++.++.+++.++.++.+++.++.+++.++.++.+++.++.+++.++.++.+++.++.+|
5e+09 +-+ |
| |
O O O OOO OO OOO OO OO OOO OO OOO OO OO OOO |
4e+09 +-+ |
| |
3e+09 +-+ |
| |
2e+09 +-+ |
| |
| |
1e+09 +-+ |
| |
0 +O+O---O------------------------------------------------------------+
netperf.time.user_time
2000 +-+------------------------------------------------------------------+
1800 +-+ + + |
| : : + : |
1600 +-+ +. + .++.++. + : +.+ .++. .++.++. + .++ + .++.+|
1400 +-+++.++.+ + + + + + +++ + +.++.++ +.++ |
| |
1200 +-+ |
1000 O-+ O OO OOO OO OO OOO OO OO OO OOO OO OO OO |
800 +-+ |
| |
600 +-+ |
400 +-+ |
| |
200 +-+ |
0 +O+O--OO-------------------------------------------------------------+
netperf.time.percent_of_cpu_this_job_got
8000 +-+------------------------------------------------------------------+
O+.+O.++.OO.OOO.OO.OO.OOO.OO.OO.OO.OOO.OO.OO.OO+.++.++.++.+++.++.++.+|
7000 +-+ |
6000 +-+ |
| |
5000 +-+ |
| |
4000 +-+ |
| |
3000 +-+ |
2000 +-+ |
| |
1000 +-+ |
| |
0 +O+O--OO-------------------------------------------------------------+
netperf.time.involuntary_context_switches
4e+09 +-+---------------------------------------------------------------+
|+.++.+++.+++.++.+++.+++.++.+++.+++.++.+++.+++.++.+++.+++.++.+++.+|
3.5e+09 +-+ |
3e+09 +-+ |
O O O OOO OO OOO OOO OO OOO OOO OO OOO OO |
2.5e+09 +-+ |
| |
2e+09 +-+ |
| |
1.5e+09 +-+ |
1e+09 +-+ |
| |
5e+08 +-+ |
| |
0 +O+O--OO----------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-skl-fpga01: 104 threads Skylake with 192G memory
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/200%/debian-x86_64-2018-04-03.cgz/900s/lkp-skl-fpga01/TCP_MAERTS/netperf
commit:
472c2e07ee ("tcp: add one skb cache for tx")
8b27dae5a2 ("tcp: add one skb cache for rx")
472c2e07eef04514 8b27dae5a2e89a61c46c6dbc76c
---------------- ---------------------------
%stddev %change %stddev
\ | \
3933 -25.6% 2926 netperf.Throughput_Mbps
818124 -25.6% 608758 netperf.Throughput_total_Mbps
57423 ± 19% -41.1% 33817 netperf.time.involuntary_context_switches
3010 +3.7% 3122 netperf.time.percent_of_cpu_this_job_got
25432 +3.9% 26424 netperf.time.system_time
3.735e+09 -25.6% 2.778e+09 netperf.time.voluntary_context_switches
5.618e+09 -25.6% 4.18e+09 netperf.workload
194721 ± 22% +41.3% 275069 ± 2% cpuidle.C6.usage
13.00 ± 7% +5.9 18.86 mpstat.cpu.all.soft%
3.39 ± 5% -1.2 2.23 mpstat.cpu.all.usr%
9.539e+08 +13.2% 1.08e+09 numa-numastat.node0.local_node
9.539e+08 +13.2% 1.08e+09 numa-numastat.node0.numa_hit
4.767e+08 +13.1% 5.389e+08 numa-vmstat.node0.numa_hit
4.767e+08 +13.1% 5.389e+08 numa-vmstat.node0.numa_local
95.75 +1.3% 97.00 vmstat.cpu.sy
8245666 -25.5% 6142829 vmstat.system.cs
2696 +2.9% 2775 turbostat.Avg_MHz
0.89 ± 5% -32.4% 0.60 turbostat.CPU%c1
108.00 -1.6% 106.23 turbostat.RAMWatt
1.881e+09 +11.2% 2.091e+09 proc-vmstat.numa_hit
1.881e+09 +11.2% 2.091e+09 proc-vmstat.numa_local
1.504e+10 +11.2% 1.672e+10 proc-vmstat.pgalloc_normal
1.504e+10 +11.2% 1.672e+10 proc-vmstat.pgfree
4053 ± 15% +19.6% 4848 ± 13% slabinfo.eventpoll_pwq.active_objs
4053 ± 15% +19.6% 4848 ± 13% slabinfo.eventpoll_pwq.num_objs
545.50 ± 11% -17.1% 452.00 ± 11% slabinfo.kernfs_iattrs_cache.active_objs
545.50 ± 11% -17.1% 452.00 ± 11% slabinfo.kernfs_iattrs_cache.num_objs
12.31 ± 12% +25.1% 15.40 sched_debug.cfs_rq:/.load_avg.stddev
1449447 ± 23% -29.2% 1026327 ± 22% sched_debug.cfs_rq:/.min_vruntime.stddev
0.78 ± 66% +155.6% 2.00 ± 11% sched_debug.cfs_rq:/.removed.load_avg.avg
5.98 ± 60% +84.9% 11.05 ± 4% sched_debug.cfs_rq:/.removed.load_avg.stddev
35.94 ± 66% +156.2% 92.09 ± 11% sched_debug.cfs_rq:/.removed.runnable_sum.avg
274.98 ± 60% +85.4% 509.82 ± 4% sched_debug.cfs_rq:/.removed.runnable_sum.stddev
0.39 ± 66% +115.0% 0.84 ± 11% sched_debug.cfs_rq:/.removed.util_avg.avg
1.75 ± 14% +32.1% 2.31 ± 12% sched_debug.cfs_rq:/.runnable_load_avg.min
98724 ± 85% -66.3% 33282 ± 85% sched_debug.cfs_rq:/.runnable_weight.max
-3346961 -44.2% -1868641 sched_debug.cfs_rq:/.spread0.min
1449347 ± 23% -29.2% 1026220 ± 22% sched_debug.cfs_rq:/.spread0.stddev
156728 ± 15% +49.0% 233530 ± 14% sched_debug.cpu.avg_idle.avg
260031 ± 9% +33.3% 346707 ± 10% sched_debug.cpu.avg_idle.stddev
20.54 ± 5% -10.2% 18.44 ± 2% sched_debug.cpu.clock.stddev
20.54 ± 5% -10.2% 18.44 ± 2% sched_debug.cpu.clock_task.stddev
35742943 -25.6% 26602562 sched_debug.cpu.nr_switches.avg
37162589 -24.6% 28014480 sched_debug.cpu.nr_switches.max
32371186 -24.3% 24512619 sched_debug.cpu.nr_switches.min
18.74 +29.7% 24.31 perf-stat.i.MPKI
1.938e+10 -20.9% 1.534e+10 perf-stat.i.branch-instructions
2.05 -0.1 1.98 perf-stat.i.branch-miss-rate%
3.961e+08 -23.4% 3.033e+08 perf-stat.i.branch-misses
0.74 ± 31% -0.4 0.38 ± 18% perf-stat.i.cache-miss-rate%
12929011 ± 32% -49.1% 6575616 ± 19% perf-stat.i.cache-misses
1.813e+09 +2.3% 1.854e+09 perf-stat.i.cache-references
8267879 -25.5% 6157361 perf-stat.i.context-switches
2.89 +30.6% 3.77 perf-stat.i.cpi
2.794e+11 +2.9% 2.876e+11 perf-stat.i.cpu-cycles
23942 ± 24% +97.5% 47291 ± 21% perf-stat.i.cycles-between-cache-misses
1.13 -0.1 0.99 perf-stat.i.dTLB-load-miss-rate%
3.331e+08 -31.8% 2.274e+08 perf-stat.i.dTLB-load-misses
2.9e+10 -22.0% 2.263e+10 perf-stat.i.dTLB-loads
60002134 ± 2% -26.3% 44193691 ± 2% perf-stat.i.dTLB-store-misses
1.664e+10 -23.6% 1.271e+10 perf-stat.i.dTLB-stores
58.26 -4.7 53.57 perf-stat.i.iTLB-load-miss-rate%
70291090 -31.0% 48469793 perf-stat.i.iTLB-load-misses
50169394 -16.5% 41890643 perf-stat.i.iTLB-loads
9.677e+10 -21.2% 7.624e+10 perf-stat.i.instructions
1410 +13.6% 1602 perf-stat.i.instructions-per-iTLB-miss
0.35 -23.4% 0.27 perf-stat.i.ipc
2150902 ± 41% -42.7% 1233268 ± 27% perf-stat.i.node-load-misses
652857 ± 24% -39.8% 393122 ± 15% perf-stat.i.node-loads
77.08 ± 11% -20.6 56.48 ± 14% perf-stat.i.node-store-miss-rate%
386848 ± 40% -64.7% 136565 ± 27% perf-stat.i.node-store-misses
18.74 +29.8% 24.32 perf-stat.overall.MPKI
2.04 -0.1 1.98 perf-stat.overall.branch-miss-rate%
0.71 ± 32% -0.4 0.35 ± 20% perf-stat.overall.cache-miss-rate%
2.89 +30.6% 3.77 perf-stat.overall.cpi
23413 ± 23% +95.0% 45644 ± 21% perf-stat.overall.cycles-between-cache-misses
1.14 -0.1 0.99 perf-stat.overall.dTLB-load-miss-rate%
58.35 -4.7 53.64 perf-stat.overall.iTLB-load-miss-rate%
1376 +14.3% 1573 perf-stat.overall.instructions-per-iTLB-miss
0.35 -23.4% 0.27 perf-stat.overall.ipc
75.96 ± 13% -20.1 55.89 ± 14% perf-stat.overall.node-store-miss-rate%
15545 +5.9% 16457 perf-stat.overall.path-length
1.936e+10 -20.9% 1.532e+10 perf-stat.ps.branch-instructions
3.956e+08 -23.4% 3.03e+08 perf-stat.ps.branch-misses
12917167 ± 32% -49.1% 6568704 ± 19% perf-stat.ps.cache-misses
1.811e+09 +2.3% 1.852e+09 perf-stat.ps.cache-references
8258274 -25.5% 6150289 perf-stat.ps.context-switches
2.791e+11 +2.9% 2.872e+11 perf-stat.ps.cpu-cycles
3.328e+08 -31.8% 2.271e+08 perf-stat.ps.dTLB-load-misses
2.897e+10 -22.0% 2.26e+10 perf-stat.ps.dTLB-loads
59931265 ± 2% -26.3% 44142618 ± 2% perf-stat.ps.dTLB-store-misses
1.662e+10 -23.6% 1.269e+10 perf-stat.ps.dTLB-stores
70208114 -31.0% 48413951 perf-stat.ps.iTLB-load-misses
50111323 -16.5% 41842519 perf-stat.ps.iTLB-loads
9.666e+10 -21.2% 7.616e+10 perf-stat.ps.instructions
2148559 ± 41% -42.7% 1231893 ± 27% perf-stat.ps.node-load-misses
653248 ± 24% -39.9% 392846 ± 15% perf-stat.ps.node-loads
386418 ± 40% -64.7% 136417 ± 27% perf-stat.ps.node-store-misses
8.733e+13 -21.2% 6.879e+13 perf-stat.total.instructions
887.50 ± 21% +961.1% 9417 ±122% interrupts.39:PCI-MSI.67633154-edge.eth0-TxRx-1
906772 +4.4% 946334 interrupts.CAL:Function_call_interrupts
128451 ± 3% -20.1% 102684 ± 11% interrupts.CPU1.RES:Rescheduling_interrupts
122297 ± 12% -20.1% 97767 ± 5% interrupts.CPU100.RES:Rescheduling_interrupts
114996 ± 8% -12.8% 100315 ± 5% interrupts.CPU101.RES:Rescheduling_interrupts
8676 ± 2% +14.9% 9972 ± 3% interrupts.CPU102.CAL:Function_call_interrupts
145573 ± 15% -30.4% 101298 ± 9% interrupts.CPU102.RES:Rescheduling_interrupts
8795 +13.2% 9956 ± 3% interrupts.CPU103.CAL:Function_call_interrupts
129834 ± 7% -15.4% 109820 ± 9% interrupts.CPU11.RES:Rescheduling_interrupts
122266 ± 5% -18.3% 99893 ± 4% interrupts.CPU13.RES:Rescheduling_interrupts
133695 ± 4% -23.7% 101984 ± 5% interrupts.CPU14.RES:Rescheduling_interrupts
115773 ± 7% -18.6% 94202 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts
120005 ± 3% -15.7% 101149 ± 8% interrupts.CPU27.RES:Rescheduling_interrupts
119584 ± 3% -19.5% 96286 ± 6% interrupts.CPU29.RES:Rescheduling_interrupts
127064 ± 7% -15.1% 107858 ± 5% interrupts.CPU30.RES:Rescheduling_interrupts
887.50 ± 21% +961.1% 9417 ±122% interrupts.CPU31.39:PCI-MSI.67633154-edge.eth0-TxRx-1
118974 ± 11% -17.1% 98609 ± 7% interrupts.CPU33.RES:Rescheduling_interrupts
125463 ± 13% -23.9% 95477 ± 5% interrupts.CPU34.RES:Rescheduling_interrupts
125126 ± 16% -21.7% 97997 ± 7% interrupts.CPU35.RES:Rescheduling_interrupts
133035 ± 12% -28.2% 95517 ± 10% interrupts.CPU37.RES:Rescheduling_interrupts
120167 ± 11% -24.5% 90782 ± 8% interrupts.CPU38.RES:Rescheduling_interrupts
125040 ± 3% -19.8% 100223 ± 7% interrupts.CPU42.RES:Rescheduling_interrupts
119768 ± 15% -16.6% 99882 interrupts.CPU43.RES:Rescheduling_interrupts
125986 ± 7% -18.9% 102226 ± 8% interrupts.CPU45.RES:Rescheduling_interrupts
124516 ± 10% -15.7% 104961 ± 5% interrupts.CPU48.RES:Rescheduling_interrupts
125647 ± 5% -22.8% 96970 ± 3% interrupts.CPU49.RES:Rescheduling_interrupts
131345 ± 5% -17.2% 108796 ± 3% interrupts.CPU51.RES:Rescheduling_interrupts
127858 ± 3% -18.9% 103683 ± 5% interrupts.CPU53.RES:Rescheduling_interrupts
125241 ± 15% -18.7% 101797 ± 5% interrupts.CPU54.RES:Rescheduling_interrupts
133398 ± 7% -22.1% 103961 ± 3% interrupts.CPU56.RES:Rescheduling_interrupts
129732 ± 10% -24.2% 98324 ± 4% interrupts.CPU6.RES:Rescheduling_interrupts
132858 ± 12% -20.5% 105623 ± 9% interrupts.CPU60.RES:Rescheduling_interrupts
123442 ± 5% -20.7% 97934 ± 4% interrupts.CPU64.RES:Rescheduling_interrupts
132863 ± 3% -20.2% 106040 ± 4% interrupts.CPU65.RES:Rescheduling_interrupts
9002 +10.7% 9967 ± 2% interrupts.CPU66.CAL:Function_call_interrupts
8999 +10.7% 9958 ± 2% interrupts.CPU67.CAL:Function_call_interrupts
8774 ± 5% +13.4% 9951 ± 2% interrupts.CPU68.CAL:Function_call_interrupts
8991 +10.6% 9945 ± 2% interrupts.CPU69.CAL:Function_call_interrupts
125949 ± 9% -15.0% 107048 ± 4% interrupts.CPU69.RES:Rescheduling_interrupts
123443 ± 8% -15.7% 104008 ± 8% interrupts.CPU7.RES:Rescheduling_interrupts
8987 +10.6% 9938 ± 2% interrupts.CPU70.CAL:Function_call_interrupts
8983 +10.5% 9927 ± 2% interrupts.CPU71.CAL:Function_call_interrupts
122925 ± 12% -18.0% 100786 ± 8% interrupts.CPU71.RES:Rescheduling_interrupts
8925 +11.0% 9910 ± 2% interrupts.CPU73.CAL:Function_call_interrupts
126258 ± 7% -19.4% 101773 ± 7% interrupts.CPU73.RES:Rescheduling_interrupts
129281 ± 6% -18.1% 105945 ± 5% interrupts.CPU74.RES:Rescheduling_interrupts
8969 +10.3% 9893 ± 2% interrupts.CPU75.CAL:Function_call_interrupts
8966 +10.3% 9887 ± 2% interrupts.CPU76.CAL:Function_call_interrupts
8965 +10.1% 9870 ± 2% interrupts.CPU77.CAL:Function_call_interrupts
129057 ± 9% -24.7% 97240 ± 3% interrupts.CPU77.RES:Rescheduling_interrupts
8683 ± 5% +13.7% 9874 ± 2% interrupts.CPU78.CAL:Function_call_interrupts
129114 ± 9% -27.6% 93483 ± 4% interrupts.CPU78.RES:Rescheduling_interrupts
8685 ± 4% +13.6% 9865 ± 2% interrupts.CPU79.CAL:Function_call_interrupts
121386 ± 7% -18.7% 98627 ± 5% interrupts.CPU8.RES:Rescheduling_interrupts
8956 +10.1% 9864 ± 2% interrupts.CPU80.CAL:Function_call_interrupts
125015 ± 11% -24.1% 94918 ± 5% interrupts.CPU80.RES:Rescheduling_interrupts
8633 ± 7% +14.2% 9856 ± 2% interrupts.CPU81.CAL:Function_call_interrupts
132492 ± 4% -20.7% 105014 ± 4% interrupts.CPU81.RES:Rescheduling_interrupts
8857 ± 2% +11.2% 9848 ± 2% interrupts.CPU82.CAL:Function_call_interrupts
111387 ± 6% -13.8% 96026 ± 8% interrupts.CPU82.RES:Rescheduling_interrupts
112445 ± 6% -9.6% 101699 ± 7% interrupts.CPU83.RES:Rescheduling_interrupts
121973 ± 7% -21.1% 96217 ± 6% interrupts.CPU84.RES:Rescheduling_interrupts
8883 +10.6% 9822 ± 2% interrupts.CPU85.CAL:Function_call_interrupts
115045 ± 6% -16.3% 96249 ± 4% interrupts.CPU85.RES:Rescheduling_interrupts
8668 ± 3% +12.6% 9762 interrupts.CPU86.CAL:Function_call_interrupts
8579 ± 3% +14.3% 9806 ± 2% interrupts.CPU87.CAL:Function_call_interrupts
8719 ± 2% +12.4% 9797 ± 2% interrupts.CPU88.CAL:Function_call_interrupts
8769 +11.6% 9788 ± 2% interrupts.CPU89.CAL:Function_call_interrupts
131248 ± 9% -27.5% 95130 ± 9% interrupts.CPU9.RES:Rescheduling_interrupts
8766 +11.6% 9780 ± 2% interrupts.CPU90.CAL:Function_call_interrupts
121573 ± 6% -14.4% 104044 ± 8% interrupts.CPU90.RES:Rescheduling_interrupts
8762 +11.5% 9768 ± 2% interrupts.CPU91.CAL:Function_call_interrupts
125741 ± 6% -21.2% 99116 ± 10% interrupts.CPU91.RES:Rescheduling_interrupts
8764 +11.3% 9754 ± 2% interrupts.CPU92.CAL:Function_call_interrupts
125340 ± 7% -21.1% 98921 ± 6% interrupts.CPU92.RES:Rescheduling_interrupts
8620 ± 4% +13.0% 9743 ± 2% interrupts.CPU93.CAL:Function_call_interrupts
129358 ± 10% -25.0% 97082 ± 6% interrupts.CPU93.RES:Rescheduling_interrupts
8753 +11.2% 9730 ± 2% interrupts.CPU94.CAL:Function_call_interrupts
8750 +11.1% 9719 ± 2% interrupts.CPU95.CAL:Function_call_interrupts
115441 ± 6% -15.6% 97484 ± 8% interrupts.CPU95.RES:Rescheduling_interrupts
121213 ± 5% -17.0% 100662 ± 12% interrupts.CPU99.RES:Rescheduling_interrupts
12650754 ± 3% -14.8% 10783909 interrupts.RES:Rescheduling_interrupts
176.50 ± 59% -79.7% 35.75 ± 47% interrupts.TLB:TLB_shootdowns
10.98 -11.0 0.00 perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
10.70 -10.7 0.00 perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
10.29 -10.3 0.00 perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv
10.20 -10.2 0.00 perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established
9.82 -9.8 0.00 perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack
9.68 -9.7 0.00 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb.tcp_clean_rtx_queue
21.27 -6.8 14.52 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.18 -6.7 14.46 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.54 -6.5 14.04 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.43 -6.5 13.96 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64
16.41 -3.1 13.34 perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
16.22 -3.0 13.21 perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto
7.69 -2.2 5.51 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
7.67 -2.2 5.50 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
6.75 ± 6% -2.2 4.60 ± 2% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
13.64 -2.1 11.53 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
13.43 -2.0 11.40 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg
7.00 -2.0 5.04 perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg.inet_recvmsg
6.83 -1.9 4.93 perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg
6.70 -1.9 4.83 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
6.39 ± 3% -1.9 4.53 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
5.43 -1.7 3.69 perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
5.31 -1.7 3.59 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
5.68 ± 3% -1.6 4.11 ± 2% perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu
4.76 -1.6 3.19 perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
4.84 -1.5 3.30 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg.__sys_recvfrom
4.56 -1.5 3.04 perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg
5.51 ± 3% -1.5 4.01 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv
4.48 -1.5 2.99 perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg
4.39 -1.5 2.92 perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.wait_woken.sk_wait_data
5.36 ± 3% -1.5 3.90 ± 2% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv
5.19 ± 3% -1.4 3.78 ± 2% perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established
4.37 -1.4 2.96 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg.inet_recvmsg
2.14 -1.4 0.73 perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable
10.04 -1.4 8.65 perf-profile.calltrace.cycles-pp._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
2.08 -1.4 0.70 perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock
9.73 -1.3 8.42 perf-profile.calltrace.cycles-pp.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
9.56 -1.3 8.29 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin._copy_from_iter_full.tcp_sendmsg_locked.tcp_sendmsg
3.73 -1.2 2.55 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_recvmsg
3.78 ± 2% -1.1 2.68 perf-profile.calltrace.cycles-pp.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
1.86 ± 30% -1.0 0.84 ± 4% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable
3.46 ± 2% -1.0 2.46 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.51 ± 6% -0.9 0.61 perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
3.22 ± 2% -0.9 2.33 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked.tcp_sendmsg
3.02 ± 2% -0.8 2.21 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.tcp_sendmsg_locked
1.78 -0.6 1.16 perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout.wait_woken
7.18 ± 2% -0.6 6.58 ± 2% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
7.16 ± 2% -0.6 6.56 ± 2% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.37 -0.5 0.88 perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.33 -0.5 0.84 perf-profile.calltrace.cycles-pp.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.29 -0.5 0.82 perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.71 -0.5 0.25 ±100% perf-profile.calltrace.cycles-pp.__sched_text_start.preempt_schedule_common._cond_resched.__release_sock.release_sock
1.20 -0.4 0.82 perf-profile.calltrace.cycles-pp.__switch_to
1.09 -0.4 0.72 perf-profile.calltrace.cycles-pp.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
1.09 -0.3 0.77 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64
6.42 ± 2% -0.3 6.09 ± 2% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg
0.83 -0.3 0.56 perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg
0.84 -0.3 0.58 ± 3% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__sched_text_start.schedule.schedule_timeout.wait_woken
0.94 -0.3 0.68 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret
0.74 -0.2 0.53 perf-profile.calltrace.cycles-pp._cond_resched.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg
0.73 -0.2 0.52 perf-profile.calltrace.cycles-pp.preempt_schedule_common._cond_resched.__release_sock.release_sock.tcp_sendmsg
9.51 +0.7 10.17 perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb
9.38 +0.7 10.08 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.skb_release_data
95.32 +1.4 96.69 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
95.16 +1.4 96.58 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.17 +7.3 18.47 perf-profile.calltrace.cycles-pp.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
11.81 ± 2% +7.4 19.18 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
11.74 ± 2% +7.4 19.15 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit
11.52 ± 2% +7.5 18.98 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
11.55 ± 2% +7.5 19.01 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
11.27 ± 2% +7.5 18.81 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
10.95 ± 2% +7.6 18.55 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq
9.28 +7.6 16.91 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_one_page.__free_pages_ok.___pskb_trim
9.39 +7.7 17.05 perf-profile.calltrace.cycles-pp._raw_spin_lock.free_one_page.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb
10.83 ± 2% +7.7 18.52 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
9.57 +7.7 17.27 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked
9.94 +7.7 17.64 perf-profile.calltrace.cycles-pp.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
10.49 ± 2% +7.7 18.23 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack
9.73 +7.8 17.49 perf-profile.calltrace.cycles-pp.__free_pages_ok.___pskb_trim.sk_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg
10.16 ± 2% +7.8 17.98 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
3.79 +8.0 11.77 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock
3.78 +8.0 11.77 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv.__release_sock
9.61 ± 2% +8.0 17.61 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
9.45 ± 2% +8.1 17.50 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
9.40 ± 2% +8.1 17.47 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
9.21 ± 2% +8.1 17.35 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv
3.44 +8.1 11.58 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established.tcp_v4_do_rcv
8.65 ± 2% +8.2 16.88 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
3.21 +8.2 11.44 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_rcv_established
18.55 ± 2% +8.6 27.14 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill
20.09 ± 2% +8.6 28.68 perf-profile.calltrace.cycles-pp.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
19.87 ± 2% +8.6 28.45 perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked
20.08 ± 2% +8.6 28.67 perf-profile.calltrace.cycles-pp.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
18.74 ± 2% +8.6 27.34 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.get_page_from_freelist.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill
19.94 ± 2% +8.6 28.53 perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.skb_page_frag_refill.sk_page_frag_refill.tcp_sendmsg_locked.tcp_sendmsg
72.24 +8.7 80.98 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
72.13 +8.8 80.91 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
71.52 +9.0 80.48 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
71.18 +9.1 80.25 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64
0.00 +10.3 10.29 perf-profile.calltrace.cycles-pp.free_one_page.__free_pages_ok.skb_release_data.__kfree_skb.tcp_v4_rcv
0.00 +10.4 10.41 perf-profile.calltrace.cycles-pp.__free_pages_ok.skb_release_data.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu
0.00 +10.7 10.66 perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish
0.00 +10.8 10.81 perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver
54.39 +12.2 66.64 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
31487988 ± 3% -23.2% 24183132 softirqs.CPU0.NET_RX
32151929 -26.1% 23765617 ± 2% softirqs.CPU1.NET_RX
31962684 ± 3% -23.5% 24458409 softirqs.CPU10.NET_RX
31110228 ± 3% -26.2% 22964939 softirqs.CPU100.NET_RX
31626866 -27.6% 22906397 softirqs.CPU101.NET_RX
29779153 ± 3% -22.9% 22969929 softirqs.CPU102.NET_RX
31513116 -27.3% 22920216 softirqs.CPU103.NET_RX
31713243 ± 2% -24.9% 23826688 ± 2% softirqs.CPU11.NET_RX
32072474 -26.1% 23696606 ± 2% softirqs.CPU12.NET_RX
32279430 -24.8% 24260634 softirqs.CPU13.NET_RX
31697375 ± 3% -23.0% 24406003 softirqs.CPU14.NET_RX
32278026 -24.7% 24317293 softirqs.CPU15.NET_RX
31162122 ± 3% -21.7% 24396540 softirqs.CPU16.NET_RX
32209863 -24.2% 24418327 softirqs.CPU17.NET_RX
32329002 -25.6% 24054387 ± 2% softirqs.CPU18.NET_RX
32127509 -24.5% 24258223 softirqs.CPU19.NET_RX
32217120 -25.2% 24089001 softirqs.CPU2.NET_RX
31415502 ± 3% -22.5% 24349881 softirqs.CPU20.NET_RX
32186243 -25.0% 24137967 softirqs.CPU21.NET_RX
32271735 -26.9% 23586468 ± 2% softirqs.CPU22.NET_RX
31871656 ± 3% -23.8% 24292511 softirqs.CPU23.NET_RX
32321894 -25.2% 24177260 softirqs.CPU24.NET_RX
31969188 -24.7% 24057006 softirqs.CPU25.NET_RX
30938777 -27.7% 22360933 ± 2% softirqs.CPU26.NET_RX
30118051 ± 3% -25.9% 22321500 ± 2% softirqs.CPU27.NET_RX
31079253 -28.1% 22337317 ± 2% softirqs.CPU28.NET_RX
31429166 -27.6% 22746093 ± 2% softirqs.CPU29.NET_RX
30485045 ± 3% -20.5% 24221128 ± 2% softirqs.CPU3.NET_RX
30912223 ± 2% -26.8% 22622183 ± 2% softirqs.CPU30.NET_RX
31357027 -27.6% 22717601 softirqs.CPU31.NET_RX
31052178 -27.3% 22565776 ± 2% softirqs.CPU32.NET_RX
31101262 -28.2% 22323348 ± 2% softirqs.CPU33.NET_RX
31331660 -27.7% 22656208 softirqs.CPU34.NET_RX
30833278 ± 3% -25.4% 22998777 softirqs.CPU35.NET_RX
30738161 ± 3% -25.2% 22998898 softirqs.CPU36.NET_RX
30881460 ± 4% -26.6% 22671426 softirqs.CPU37.NET_RX
31140748 -27.4% 22621903 softirqs.CPU38.NET_RX
31218654 -27.3% 22684067 softirqs.CPU39.NET_RX
32583070 -24.8% 24513384 softirqs.CPU4.NET_RX
31462139 -28.4% 22517351 softirqs.CPU40.NET_RX
31566697 -27.9% 22768461 softirqs.CPU41.NET_RX
30975279 ± 2% -27.2% 22555119 softirqs.CPU42.NET_RX
30718280 ± 3% -26.2% 22661320 ± 2% softirqs.CPU43.NET_RX
31283332 -27.3% 22740697 softirqs.CPU44.NET_RX
30983467 -26.4% 22794814 softirqs.CPU45.NET_RX
30658730 ± 4% -28.4% 21946934 ± 2% softirqs.CPU46.NET_RX
31181856 -26.5% 22929226 softirqs.CPU47.NET_RX
31037938 ± 2% -26.9% 22691892 ± 2% softirqs.CPU48.NET_RX
30911500 ± 2% -26.3% 22777693 softirqs.CPU49.NET_RX
31802923 ± 3% -23.9% 24204592 softirqs.CPU5.NET_RX
31517206 -28.1% 22648510 softirqs.CPU50.NET_RX
30660453 ± 3% -27.2% 22327925 ± 2% softirqs.CPU51.NET_RX
31819962 ± 2% -23.9% 24206194 softirqs.CPU52.NET_RX
32142649 -26.4% 23668373 ± 2% softirqs.CPU53.NET_RX
32149559 -24.2% 24360340 softirqs.CPU54.NET_RX
32425853 -26.4% 23854082 ± 2% softirqs.CPU55.NET_RX
31817157 ± 2% -24.3% 24096785 softirqs.CPU56.NET_RX
31640490 ± 3% -24.4% 23920278 ± 2% softirqs.CPU57.NET_RX
31650729 ± 3% -23.1% 24327421 softirqs.CPU58.NET_RX
31269148 ± 3% -22.3% 24307789 softirqs.CPU59.NET_RX
31030416 ± 4% -22.0% 24203694 softirqs.CPU6.NET_RX
32255424 -25.2% 24141973 ± 2% softirqs.CPU60.NET_RX
32245715 -25.1% 24167151 ± 2% softirqs.CPU61.NET_RX
31763163 ± 2% -23.1% 24415760 softirqs.CPU62.NET_RX
31632095 ± 3% -22.7% 24451397 softirqs.CPU63.NET_RX
31490930 ± 2% -24.2% 23879322 softirqs.CPU64.NET_RX
31516754 ± 3% -23.5% 24108737 softirqs.CPU65.NET_RX
32359236 -24.5% 24440756 softirqs.CPU66.NET_RX
31784935 ± 3% -23.9% 24195033 ± 2% softirqs.CPU67.NET_RX
30967426 ± 4% -21.8% 24208434 softirqs.CPU68.NET_RX
32208978 -27.9% 23223363 softirqs.CPU69.NET_RX
31534273 ± 3% -23.6% 24083955 softirqs.CPU7.NET_RX
31800791 ± 2% -23.3% 24375677 softirqs.CPU70.NET_RX
31511220 ± 3% -23.1% 24225232 softirqs.CPU71.NET_RX
32055308 -25.2% 23985501 ± 2% softirqs.CPU72.NET_RX
32255683 -24.3% 24425926 softirqs.CPU73.NET_RX
31808226 ± 2% -23.7% 24280351 ± 2% softirqs.CPU74.NET_RX
31994746 ± 3% -25.5% 23828432 ± 2% softirqs.CPU75.NET_RX
31732779 ± 3% -24.0% 24121773 ± 2% softirqs.CPU76.NET_RX
31249558 ± 2% -23.8% 23816726 ± 2% softirqs.CPU77.NET_RX
29102709 ± 3% -24.1% 22087804 ± 2% softirqs.CPU78.NET_RX
31050911 -26.3% 22879670 softirqs.CPU79.NET_RX
32385972 -25.5% 24114907 softirqs.CPU8.NET_RX
31250746 -26.8% 22865137 softirqs.CPU80.NET_RX
30970512 ± 3% -27.5% 22460428 ± 2% softirqs.CPU81.NET_RX
30769035 ± 3% -26.4% 22640114 softirqs.CPU82.NET_RX
31163906 -28.0% 22426881 ± 2% softirqs.CPU83.NET_RX
30833151 ± 2% -26.9% 22535706 softirqs.CPU84.NET_RX
31213448 -27.8% 22530613 ± 2% softirqs.CPU85.NET_RX
31299014 -27.8% 22598945 ± 2% softirqs.CPU86.NET_RX
31380574 -26.8% 22966556 softirqs.CPU87.NET_RX
31419156 -26.9% 22966072 softirqs.CPU88.NET_RX
31485946 -29.0% 22360125 ± 2% softirqs.CPU89.NET_RX
32266157 -25.9% 23914440 ± 2% softirqs.CPU9.NET_RX
30336933 ± 3% -25.9% 22489963 softirqs.CPU90.NET_RX
30595348 ± 3% -26.1% 22614928 softirqs.CPU91.NET_RX
30924249 ± 2% -26.0% 22894665 softirqs.CPU92.NET_RX
30593902 ± 2% -24.8% 23001426 softirqs.CPU93.NET_RX
31556110 -29.2% 22330354 ± 2% softirqs.CPU94.NET_RX
30668287 ± 3% -29.0% 21759470 softirqs.CPU95.NET_RX
31245897 -26.9% 22847267 softirqs.CPU96.NET_RX
31136421 -28.7% 22213048 ± 2% softirqs.CPU97.NET_RX
30013471 ± 4% -23.9% 22844117 softirqs.CPU98.NET_RX
31291344 -28.5% 22378868 ± 2% softirqs.CPU99.NET_RX
3.269e+09 -25.6% 2.431e+09 softirqs.NET_RX
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
11 months, 3 weeks
- 3
- 5
Re: [LKP] inet: frags: Turn fqdir->dead into an int for old Alphas
by Linus Torvalds
On Sat, Jun 8, 2019 at 8:32 AM Paul E. McKenney <paulmck(a)linux.ibm.com> wrote:
>
> On Fri, Jun 07, 2019 at 09:19:42AM -0700, Linus Torvalds wrote:
> >
> > - bitfields obviously do need locks. 'char' does not.
> >
> > If there's somebody who really notices the alpha issue in PRACTICE, we
> > can then bother to fix it. But there is approximately one user, and
> > it's not a heavy-duty one.
>
> C11 and later compilers are supposed to use read-modify-write atomic
> operations in this sort of situation anyway because they are not supposed
> to introduce data races.
I don't think that's possible on any common architecture. The
bitfields themselves will need locking, to serialize writes of
different fields against each other.
There are no atomic rmw sequences that have reasonable performance for
the bitfield updates themselves.
The fields *around* the bitfields had better be safe, but that's
something we already depend on, and which falls under the heading of
"we don't accept garbage compilers".
Linus
12 months
- 1
- 1
Re: [LKP] rcu_read_lock lost its compiler barrier
by Alan Stern
On Sat, 8 Jun 2019, Paul E. McKenney wrote:
> On Thu, Jun 06, 2019 at 10:19:43AM -0400, Alan Stern wrote:
> > On Thu, 6 Jun 2019, Andrea Parri wrote:
> >
> > > This seems a sensible change to me: looking forward to seeing a patch,
> > > on top of -rcu/dev, for further review and testing!
> > >
> > > We could also add (to LKMM) the barrier() for rcu_read_{lock,unlock}()
> > > discussed in this thread (maybe once the RCU code and the informal doc
> > > will have settled in such direction).
> >
> > Yes. Also for SRCU. That point had not escaped me.
>
> And it does seem pretty settled. There are quite a few examples where
> there are normal accesses at either end of the RCU read-side critical
> sections, for example, the one in the requirements diffs below.
>
> For SRCU, srcu_read_lock() and srcu_read_unlock() have implied compiler
> barriers since 2006. ;-)
>
> Thanx, Paul
>
> ------------------------------------------------------------------------
>
> diff --git a/Documentation/RCU/Design/Requirements/Requirements.html b/Documentation/RCU/Design/Requirements/Requirements.html
> index 5a9238a2883c..080b39cc1dbb 100644
> --- a/Documentation/RCU/Design/Requirements/Requirements.html
> +++ b/Documentation/RCU/Design/Requirements/Requirements.html
> @@ -2129,6 +2129,8 @@ Some of the relevant points of interest are as follows:
> <li> <a href="#Hotplug CPU">Hotplug CPU</a>.
> <li> <a href="#Scheduler and RCU">Scheduler and RCU</a>.
> <li> <a href="#Tracing and RCU">Tracing and RCU</a>.
> +<li> <a href="#Accesses to User Mamory and RCU">
------------------------------------^
> +Accesses to User Mamory and RCU</a>.
---------------------^
> <li> <a href="#Energy Efficiency">Energy Efficiency</a>.
> <li> <a href="#Scheduling-Clock Interrupts and RCU">
> Scheduling-Clock Interrupts and RCU</a>.
> @@ -2521,6 +2523,75 @@ cannot be used.
> The tracing folks both located the requirement and provided the
> needed fix, so this surprise requirement was relatively painless.
>
> +<h3><a name="Accesses to User Mamory and RCU">
----------------------------------^
> +Accesses to User Mamory and RCU</a></h3>
---------------------^
Are these issues especially notable for female programmers? :-)
Alan
12 months
- 1
- 0