December 2019 - LKP - Ml01.01.Org

[refcount] d2d337b185: WARNING:at_lib/refcount.c:#refcount_warn_saturate

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: d2d337b185bd2abff262f3cf7de0080b3888e41c ("[RESEND PATCH v4 08/10] refcount: Consolidate implementations of refcount_t") url: https://github.com/0day-ci/linux/commits/Will-Deacon/Rework-REFCOUNT_FULL... in testcase: ocfs2test with following parameters: disk: 1SSD test: test-mkfs on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+------------+------------+ | | 2ab80bd4ae | d2d337b185 | +-----------------------------------------------------------------------------+------------+------------+ | boot_successes | 0 | 0 | | boot_failures | 24 | 24 | | BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/rwsem.c | 24 | 24 | | stack_segment:#[##] | 6 | 6 | | RIP:__kmalloc | 8 | 6 | | Kernel_panic-not_syncing:Fatal_exception | 14 | 11 | | kernel_BUG_at_mm/slub.c | 9 | 4 | | invalid_opcode:#[##] | 9 | 4 | | RIP:kfree | 9 | 4 | | RIP:native_safe_halt | 4 | 1 | | Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 6 | 2 | | BUG:unable_to_handle_page_fault_for_address | 5 | 1 | | Oops:#[##] | 5 | 1 | | RIP:kmem_cache_alloc_trace | 3 | 3 | | RIP:idr_get_free | 1 | | | RIP:console_unlock | 1 | | | WARNING:at_lib/refcount.c:#refcount_warn_saturate | 0 | 9 | | RIP:refcount_warn_saturate | 0 | 9 | | general_protection_fault:#[##] | 0 | 2 | | RIP:lru_cache_add_active_or_unevictable | 0 | 1 | +-----------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 93.421220] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1533 [ 93.423478] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2464, name: mount.ocfs2 [ 93.425258] CPU: 1 PID: 2464 Comm: mount.ocfs2 Not tainted 5.4.0-rc3-00012-gd2d337b185bd2 #1 [ 93.428185] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 93.430982] Call Trace: [ 93.432691] dump_stack+0x5c/0x7b [ 93.434089] ___might_sleep+0x102/0x120 [ 93.435629] down_write+0x1c/0x50 [ 93.436962] configfs_depend_item+0x3a/0xb0 [ 93.438580] o2hb_region_pin+0xf9/0x180 [ocfs2_nodemanager] [ 93.440630] ? inode_doinit_with_dentry+0x250/0x4e0 [ 93.441860] o2hb_register_callback+0xc6/0x2a0 [ocfs2_nodemanager] [ 93.443298] dlm_join_domain+0xbd/0x790 [ocfs2_dlm] [ 93.444491] ? debugfs_create_dir+0xc4/0x100 [ 93.445635] ? dlm_alloc_ctxt+0x42f/0x560 [ocfs2_dlm] [ 93.446905] dlm_register_domain+0x31f/0x440 [ocfs2_dlm] [ 93.448188] ? _cond_resched+0x19/0x30 [ 93.449248] o2cb_cluster_connect+0x132/0x2c0 [ocfs2_stack_o2cb] [ 93.450701] ocfs2_cluster_connect+0x14b/0x220 [ocfs2_stackglue] [ 93.452151] ocfs2_dlm_init+0x2e9/0x4b0 [ocfs2] [ 93.453379] ? ocfs2_init_node_maps+0x50/0x50 [ocfs2] [ 93.454700] ocfs2_fill_super+0xcf4/0x12a0 [ocfs2] [ 93.455952] ? ocfs2_initialize_super+0x1030/0x1030 [ocfs2] [ 93.457484] mount_bdev+0x173/0x1b0 [ 93.458543] legacy_get_tree+0x27/0x40 [ 93.459615] vfs_get_tree+0x25/0xc0 [ 93.460650] do_mount+0x715/0x9a0 [ 93.461697] ksys_mount+0x80/0xd0 [ 93.462728] __x64_sys_mount+0x21/0x30 [ 93.463802] do_syscall_64+0x5b/0x1d0 [ 93.464867] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 93.466224] RIP: 0033:0x7feaa42ee48a [ 93.467282] Code: 48 8b 0d 11 fa 2a 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d de f9 2a 00 f7 d8 64 89 01 48 [ 93.472861] RSP: 002b:00007ffec903d4e8 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5 [ 93.475973] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007feaa42ee48a [ 93.479041] RDX: 0000562b43aae3ee RSI: 0000562b444af0b0 RDI: 0000562b444af310 [ 93.481956] RBP: 00007ffec903d690 R08: 0000562b444af2b0 R09: 0000000000000020 [ 93.485084] R10: 0000000000000000 R11: 0000000000000206 R12: 00007ffec903d580 [ 93.488128] R13: 0000000000000000 R14: 0000562b444b0000 R15: 00007ffec903d500 [ 93.494821] o2dlm: Joining domain 58A89FF3B793441A83C86B6A7816B4AF [ 93.494822] ( [ 93.499229] 1 [ 93.501238] ) 1 nodes [ 93.509977] JBD2: Ignoring recovery information on journal [ 93.518913] ocfs2: Mounting device (8,0) on (node 1, slot 0) with ordered data mode. [ 94.541086] mount /dev/sda /mnt/ocfs2 /dev/sda 16515072 243712 16271360 2% /mnt/ocfs2 [ 94.541090] [ 94.546474] OK [ 94.546476] [ 94.550726] create testdir /mnt/ocfs2/20191130_125727 [ 94.550729] [ 94.713069] create 15890 files . [ 94.713072] [ 94.717547] [ 98.760820] o2dlm: Leaving domain 58A89FF3B793441A83C86B6A7816B4AF [ 98.828610] blk_update_request: I/O error, dev fd0, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [ 98.830929] floppy: error 10 while reading block 0 [ 99.561301] ocfs2: Unmounting device (8,0) on (node 1) [ 99.563700] ------------[ cut here ]------------ [ 99.566425] refcount_t: underflow; use-after-free. [ 99.569213] WARNING: CPU: 1 PID: 2531 at lib/refcount.c:28 refcount_warn_saturate+0x8d/0xf0 [ 99.574231] Modules linked in: ocfs2_stack_o2cb ocfs2_dlm ocfs2 ocfs2_nodemanager ocfs2_stackglue jbd2 sr_mod intel_rapl_msr cdrom ata_generic pata_acpi intel_rapl_common crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sd_mod sg bochs_drm ppdev drm_vram_helper ttm drm_kms_helper snd_pcm syscopyarea ata_piix sysfillrect aesni_intel sysimgblt snd_timer fb_sys_fops crypto_simd libata drm cryptd glue_helper snd soundcore pcspkr joydev serio_raw virtio_scsi i2c_piix4 floppy parport_pc parport ip_tables [ 99.593419] CPU: 1 PID: 2531 Comm: umount Tainted: G W 5.4.0-rc3-00012-gd2d337b185bd2 #1 [ 99.597311] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 99.604305] RIP: 0010:refcount_warn_saturate+0x8d/0xf0 [ 99.607073] Code: 05 ce 6f 37 01 01 e8 32 a0 c1 ff 0f 0b c3 80 3d c1 6f 37 01 00 75 ad 48 c7 c7 e0 9f 73 a5 c6 05 b1 6f 37 01 01 e8 13 a0 c1 ff <0f> 0b c3 80 3d a5 6f 37 01 00 75 8e 48 c7 c7 60 9f 73 a5 c6 05 95 [ 99.612363] RSP: 0018:ffffa895c0457e20 EFLAGS: 00010282 [ 99.613931] RAX: 0000000000000000 RBX: ffff8d07e654e000 RCX: 0000000000000000 [ 99.615800] RDX: ffff8d083fd27640 RSI: ffff8d083fd17778 RDI: ffff8d083fd17778 [ 99.617687] RBP: ffff8d07db479000 R08: 000000000000050a R09: 0000000000aaaaaa [ 99.619574] R10: ffffa895c0457c48 R11: ffff8d0817a4cf20 R12: ffffa895c0457e34 [ 99.621486] R13: ffff8d07e654e240 R14: ffff8d07e654e0c8 R15: 0000000000000000 [ 99.623382] FS: 00007f39e9509e40(0000) GS:ffff8d083fd00000(0000) knlGS:0000000000000000 [ 99.625452] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 99.627106] CR2: 00000000004216d0 CR3: 00000001d2bfe000 CR4: 00000000000406e0 [ 99.628995] Call Trace: [ 99.630127] ocfs2_dismount_volume+0x32a/0x3e0 [ocfs2] [ 99.631667] generic_shutdown_super+0x6c/0x120 [ 99.633102] kill_block_super+0x21/0x50 [ 99.634424] deactivate_locked_super+0x3f/0x70 [ 99.635843] cleanup_mnt+0xb8/0x150 [ 99.637130] task_work_run+0xa3/0xe0 [ 99.638407] exit_to_usermode_loop+0xeb/0xf0 [ 99.639827] do_syscall_64+0x1a7/0x1d0 [ 99.641185] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 99.643068] RIP: 0033:0x7f39e8dedd77 [ 99.644352] Code: 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 31 f6 e9 09 00 00 00 66 0f 1f 84 00 00 00 00 00 b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 00 2b 00 f7 d8 64 89 01 48 [ 99.649122] RSP: 002b:00007fffc63b9bf8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 [ 99.651318] RAX: 0000000000000000 RBX: 0000557e0db2e080 RCX: 00007f39e8dedd77 [ 99.653282] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000557e0db2e260 [ 99.655401] RBP: 0000557e0db2e260 R08: 0000557e0db2f600 R09: 0000000000000015 [ 99.657366] R10: 00000000000006b4 R11: 0000000000000246 R12: 00007f39e92efe64 [ 99.659581] R13: 0000000000000000 R14: 0000000000000000 R15: 00007fffc63b9e80 [ 99.661503] ---[ end trace eed33931ffa30ed0 ]--- To reproduce: # build kernel cd linux cp config-5.4.0-rc3-00012-gd2d337b185bd2 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

2 years, 5 months

4
4
0 / 0

[efi] 1c5fecb612: WARNING:at_kernel/iomem.c:#memremap

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 1c5fecb61255aa12a16c4c06335ab68979865914 ("efi: Export Runtime Configuration Interface table to sysfs") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: rcutorture with following parameters: runtime: 300s test: default torture_type: tasks test-description: rcutorture is rcutorture kernel module load/unload test. test-url: https://www.kernel.org/doc/Documentation/RCU/torture.txt on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +------------------------------------------------+------------+------------+ | | 5828efb95b | 1c5fecb612 | +------------------------------------------------+------------+------------+ | boot_successes | 0 | 0 | | boot_failures | 4 | 4 | | Kernel_panic-not_syncing:No_working_init_found | 4 | 4 | | WARNING:at_kernel/iomem.c:#memremap | 0 | 4 | | EIP:memremap | 0 | 4 | +------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 27.829857] WARNING: CPU: 0 PID: 1 at kernel/iomem.c:82 memremap+0x62/0x148 [ 27.832571] Modules linked in: [ 27.833528] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G T 5.3.0-rc1-00004-g1c5fecb61255a #2 [ 27.836364] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 27.838876] EIP: memremap+0x62/0x148 [ 27.840028] Code: 89 c7 83 f8 02 75 2a 80 3d bb 47 c8 c1 00 0f 85 bd 00 00 00 c6 05 bb 47 c8 c1 01 53 8d 45 ec 50 68 78 3c a5 c1 e8 f2 ff f1 ff <0f> 0b e9 9d 00 00 00 31 c0 f7 c6 01 00 00 00 74 65 85 ff 74 0f 89 [ 27.845798] EAX: 0000003f EBX: 0000001e ECX: 00000000 EDX: 30706000 [ 27.847665] ESI: 00000001 EDI: 00000002 EBP: e9e03f0c ESP: e9e03ee4 [ 27.849523] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 EFLAGS: 00010282 [ 27.851616] CR0: 80050033 CR2: 08056130 CR3: 01db5000 CR4: 000406b0 [ 27.853465] Call Trace: [ 27.853896] ? kobject_add+0x5b/0x66 [ 27.854502] ? map_properties+0x425/0x425 [ 27.855171] efi_rci2_sysfs_init+0x1f/0x1e2 [ 27.855873] ? map_properties+0x425/0x425 [ 27.856545] do_one_initcall+0xa0/0x1cb [ 27.857187] ? parse_args+0xa3/0x28b [ 27.857823] ? trace_initcall_level+0x53/0x6e [ 27.858548] kernel_init_freeable+0x102/0x190 [ 27.859300] ? rest_init+0xee/0xee [ 27.859887] kernel_init+0xd/0xdf [ 27.860443] ret_from_fork+0x1e/0x28 [ 27.861144] ---[ end trace c5c6f0b028e1905c ]--- To reproduce: # build kernel cd linux cp config-5.3.0-rc1-00004-g1c5fecb61255a .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=i386 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

2 years, 5 months

3
2
0 / 0

5e6669387e ("of/platform: Pause/resume sync state during init .."): [ 3.192726] WARNING: CPU: 1 PID: 1 at drivers/base/core.c:688 device_links_supplier_sync_state_resume

by kernel test robot

Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master commit 5e6669387e2287f25f09fd0abd279dae104cfa7e Author: Saravana Kannan <saravanak(a)google.com> AuthorDate: Wed Sep 4 14:11:24 2019 -0700 Commit: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> CommitDate: Fri Oct 4 17:30:19 2019 +0200 of/platform: Pause/resume sync state during init and of_platform_populate() When all the top level devices are populated from DT during kernel init, the supplier devices could be added and probed before the consumer devices are added and linked to the suppliers. To avoid the sync_state() callback from being called prematurely, pause the sync_state() callbacks before populating the devices and resume them at late_initcall_sync(). Similarly, when children devices are populated from a module using of_platform_populate(), there could be supplier-consumer dependencies between the children devices that are populated. To avoid the same problem with sync_state() being called prematurely, pause and resume sync_state() callbacks across of_platform_populate(). Signed-off-by: Saravana Kannan <saravanak(a)google.com> Link: https://lore.kernel.org/r/20190904211126.47518-6-saravanak@google.com Signed-off-by: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> fc5a251d0f driver core: Add sync_state driver/bus callback 5e6669387e of/platform: Pause/resume sync state during init and of_platform_populate() 81b6b96475 Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux; tag 'dma-mapping-5.5' of git://git.infradead.org/users/hch/dma-mapping +-------------------------------------------------------------------------+------------+------------+------------+ | | fc5a251d0f | 5e6669387e | 81b6b96475 | +-------------------------------------------------------------------------+------------+------------+------------+ | boot_successes | 30 | 0 | 0 | | boot_failures | 1 | 11 | 22 | | Oops:#[##] | 1 | | | | EIP:unmap_vmas | 1 | | | | PANIC:double_fault | 1 | | | | Kernel_panic-not_syncing:Fatal_exception | 1 | | | | WARNING:at_drivers/base/core.c:#device_links_supplier_sync_state_resume | 0 | 11 | 22 | | EIP:device_links_supplier_sync_state_resume | 0 | 11 | 22 | +-------------------------------------------------------------------------+------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 3.186107] OF: /testcase-data/phandle-tests/consumer-b: #phandle-cells = 2 found -1 [ 3.188595] platform testcase-data:testcase-device2: IRQ index 0 not found [ 3.191047] ### dt-test ### end of unittest - 199 passed, 0 failed [ 3.191932] ------------[ cut here ]------------ [ 3.192571] Unmatched sync_state pause/resume! [ 3.192726] WARNING: CPU: 1 PID: 1 at drivers/base/core.c:688 device_links_supplier_sync_state_resume+0x27/0xc0 [ 3.195084] Modules linked in: [ 3.195494] CPU: 1 PID: 1 Comm: swapper/0 Tainted: G T 5.4.0-rc1-00005-g5e6669387e228 #1 [ 3.196674] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 3.197693] EIP: device_links_supplier_sync_state_resume+0x27/0xc0 [ 3.198680] Code: 00 00 00 3e 8d 74 26 00 57 56 31 d2 53 b8 a0 d0 d9 c1 e8 6c b6 38 00 a1 e4 d0 d9 c1 85 c0 75 13 68 84 ba c4 c1 e8 29 30 b1 ff <0f> 0b 58 eb 7f 8d 74 26 00 83 e8 01 85 c0 a3 e4 d0 d9 c1 75 6f 8b [ 3.201560] EAX: 00000022 EBX: 00000000 ECX: 00000000 EDX: 00000000 [ 3.202466] ESI: 000001ab EDI: c02c7f80 EBP: c1e87d27 ESP: c02c7f20 [ 3.203301] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010282 [ 3.204258] CR0: 80050033 CR2: bfa1bf98 CR3: 01f28000 CR4: 00140690 [ 3.205022] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [ 3.205919] DR6: fffe0ff0 DR7: 00000400 [ 3.206529] Call Trace: [ 3.207011] ? of_platform_sync_state_init+0x13/0x16 [ 3.207719] ? do_one_initcall+0xda/0x260 [ 3.208247] ? kernel_init_freeable+0x110/0x197 [ 3.208906] ? rest_init+0x120/0x120 [ 3.209369] ? kernel_init+0xa/0x100 [ 3.209775] ? ret_from_fork+0x19/0x24 [ 3.210283] ---[ end trace 81d0f2d2ee65199b ]--- [ 3.210955] ALSA device list: # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start 1251b72273bfd2d17832055d93713797f027bd7e 219d54332a09e8d8741c1e1982f5eae56099de85 -- git bisect bad 5850da4ca99731a66a1b54fcd4e937f2ce09d422 # 07:14 B 0 3 19 0 Merge 'frank-w-bpi-r2-4.14/5.4-r64-pcie' into devel-catchup-201911300217 git bisect bad a9ff9d736bfbcad09085e7b370eff28200691aae # 07:38 B 0 3 19 0 Merge 'linux-review/Jaroslav-Kysela/ALSA-hda-fixup-for-the-bass-speaker-on-Lenovo-Carbon-X1-7th-gen/20191130-013305' into devel-catchup-201911300217 git bisect good ff7d78108fd9afb5e90dcdbf84c1857702452473 # 08:37 G 10 0 0 0 0day base guard for 'devel-catchup-201911300217' git bisect bad 95a324fbf220358a41e082098d16489e7efabb05 # 08:59 B 0 2 18 0 Merge 'linux-review/Vincenzo-Frascino/mips-Fix-gettimeofday-in-the-vdso-library/20191130-011805' into devel-catchup-201911300217 git bisect good 361b0d286afea0d867537536977a695b5557d133 # 09:55 G 11 0 0 0 Merge tag 'devprop-5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm git bisect good 0dd09bc02c1bad55e92306ca83b38b3cf48b9f40 # 11:06 G 11 0 1 1 Merge tag 'staging-5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/staging git bisect good 3275a71e76fac5bc276f0d60e027b18c2e8d7a5b # 12:07 G 11 0 0 0 Merge tag 'drm-next-5.5-2019-10-09' of git://people.freedesktop.org/~agd5f/linux into drm-next git bisect good 2ef4144d1ea8b181d377d0783c43032cb44889f7 # 15:08 G 11 0 0 0 Merge tag 'drm-intel-next-2019-11-01-1' of git://anongit.freedesktop.org/drm/drm-intel into drm-next git bisect good acc61b8929365e63a3e8c8c8913177795aa45594 # 15:34 G 11 0 0 1 Merge tag 'drm-next-5.5-2019-11-22' of git://people.freedesktop.org/~agd5f/linux into drm-next git bisect bad 95f1fa9e3418d50ce099e67280b5497b9c93843b # 16:06 B 0 2 19 1 Merge tag 'trace-v5.5' of git://git.kernel.org/pub/scm/linux/kernel/git/rostedt/linux-trace git bisect bad 80eb5fea3c14fb171facb5242a1555b3aafea4d0 # 16:31 B 0 1 17 0 Merge tag 'powerpc-spectre-rsb' of powerpc-CVE-2019-18660.bundle git bisect bad 0c40c1be2512abc99ea27df83f882dd61b5437bc # 17:30 B 0 11 27 0 mmc: dw_mmc: Fix debugfs on 64-bit platforms git bisect bad f5cb0a7e64f41b6f1c5cacc64a476962f5e97f91 # 18:00 B 0 2 18 0 debugfs: remove return value of debugfs_create_x32() git bisect bad c31e73121f4c1ec45a3e523ac6ce3ce6dafdcec1 # 18:35 B 0 1 17 0 base: soc: Handle custom soc information sysfs entries git bisect good fc5a251d0fd7ca9038bab78a8c97932c8c6ca23b # 19:07 G 11 0 0 0 driver core: Add sync_state driver/bus callback git bisect bad d4387cd117414ba80230f27a514be5ca4a09cfcc # 19:34 B 0 9 25 0 of: property: Create device links for all child-supplier depencencies git bisect bad 5e6669387e2287f25f09fd0abd279dae104cfa7e # 19:53 B 0 11 27 0 of/platform: Pause/resume sync state during init and of_platform_populate() # first bad commit: [5e6669387e2287f25f09fd0abd279dae104cfa7e] of/platform: Pause/resume sync state during init and of_platform_populate() git bisect good fc5a251d0fd7ca9038bab78a8c97932c8c6ca23b # 20:17 G 31 0 1 1 driver core: Add sync_state driver/bus callback # extra tests with debug options git bisect good 5e6669387e2287f25f09fd0abd279dae104cfa7e # 20:29 G 10 0 0 0 of/platform: Pause/resume sync state during init and of_platform_populate() # extra tests on head commit of linus/master git bisect bad 81b6b96475ac7a4ebfceae9f16fb3758327adbfe # 20:47 B 0 22 61 0 Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux; tag 'dma-mapping-5.5' of git://git.infradead.org/users/hch/dma-mapping # bad: [81b6b96475ac7a4ebfceae9f16fb3758327adbfe] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux; tag 'dma-mapping-5.5' of git://git.infradead.org/users/hch/dma-mapping # extra tests on revert first bad commit git bisect good c1a48460693b4421be494a524e06e57bdb9fc9bf # 21:19 G 10 0 0 0 Revert "of/platform: Pause/resume sync state during init and of_platform_populate()" # good: [c1a48460693b4421be494a524e06e57bdb9fc9bf] Revert "of/platform: Pause/resume sync state during init and of_platform_populate()" # extra tests on linus/master # duplicated: [81b6b96475ac7a4ebfceae9f16fb3758327adbfe] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux; tag 'dma-mapping-5.5' of git://git.infradead.org/users/hch/dma-mapping # extra tests on linux-next/master # 119: [419593dad8439007452bb6f267861863b572c520] Add linux-next specific files for 20191129 --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation

2 years, 5 months

2
1
0 / 0

[blk] 017e1adde9: BUG:kernel_NULL_pointer_dereference,address

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 017e1adde9cfd7e488e6e8328d98f9d84e5f8fb8 ("[PATCH 4/8] blk-mq: Facilitate a shared sbitmap per tagset") url: https://github.com/0day-ci/linux/commits/Hannes-Reinecke/blk-mq-scsi-Prov... base: https://git.kernel.org/cgit/linux/kernel/git/mkp/scsi.git for-next in testcase: boot on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +---------------------------------------------+------------+------------+ | | 240a6aa94a | 017e1adde9 | +---------------------------------------------+------------+------------+ | boot_successes | 4 | 0 | | boot_failures | 0 | 4 | | BUG:kernel_NULL_pointer_dereference,address | 0 | 4 | | Oops:#[##] | 0 | 4 | | RIP:__sbitmap_queue_get | 0 | 4 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 4 | +---------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 8.258248] BUG: kernel NULL pointer dereference, address: 0000000000000018 [ 8.259858] #PF: supervisor read access in kernel mode [ 8.261077] #PF: error_code(0x0000) - not-present page [ 8.262296] PGD 0 P4D 0 [ 8.263028] Oops: 0000 [#1] SMP PTI [ 8.263943] CPU: 1 PID: 189 Comm: kworker/u4:2 Not tainted 5.4.0-rc1-00274-g017e1adde9cfd #1 [ 8.265919] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 8.267892] Workqueue: events_unbound async_run_entry_fn [ 8.269148] RIP: 0010:__sbitmap_queue_get+0x7/0x90 [ 8.270303] Code: 41 5e 41 5f c3 41 8b 4f 04 d3 e3 01 d8 5b 5d 41 5c 41 5d 41 5e 41 5f c3 66 66 2e 0f 1f 84 00 00 00 00 00 41 54 55 53 48 89 fb <48> 8b 47 18 65 8b 28 44 8b 27 41 39 ec 76 50 0f b6 53 34 89 ee 48 [ 8.274368] RSP: 0018:ffffc90000107b38 EFLAGS: 00010246 [ 8.275608] RAX: ffff8881f1ec2800 RBX: 0000000000000000 RCX: 0000000000000000 [ 8.277193] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 [ 8.278781] RBP: 0000000000000000 R08: 0000000000000024 R09: 0000000000000000 [ 8.280372] R10: ffffc90000107b50 R11: ffff8881ef073047 R12: 0000000000000000 [ 8.281966] R13: 0000000000000000 R14: 0000000000000001 R15: ffffc90000107d0f [ 8.283557] FS: 0000000000000000(0000) GS:ffff88823fd00000(0000) knlGS:0000000000000000 [ 8.285471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8.286794] CR2: 0000000000000018 CR3: 00000001f319c000 CR4: 00000000000406e0 [ 8.288397] Call Trace: [ 8.289707] blk_mq_get_tag+0xf1/0x250 [ 8.290721] ? finish_wait+0x80/0x80 [ 8.291666] blk_mq_get_request+0xda/0x380 [ 8.292692] blk_mq_alloc_request+0x84/0xd0 [ 8.293729] blk_get_request+0x22/0x60 [ 8.294687] __scsi_execute+0x38/0x250 [ 8.295650] scsi_probe_and_add_lun+0x22d/0xda0 [ 8.296827] __scsi_scan_target+0xf9/0x620 [ 8.297916] ? __switch_to_asm+0x34/0x70 [ 8.298903] ? __switch_to_asm+0x40/0x70 [ 8.299895] ? __switch_to_asm+0x34/0x70 [ 8.300882] ? __switch_to_asm+0x34/0x70 [ 8.301866] ? __switch_to_asm+0x40/0x70 [ 8.302853] scsi_scan_channel+0x5a/0x80 [ 8.303844] scsi_scan_host_selected+0xe3/0x150 [ 8.304944] do_scan_async+0x17/0x1a0 [ 8.305881] async_run_entry_fn+0x39/0x160 [ 8.306901] process_one_work+0x1ae/0x3d0 [ 8.307911] worker_thread+0x3c/0x3b0 [ 8.308850] ? process_one_work+0x3d0/0x3d0 [ 8.309884] kthread+0x11e/0x140 [ 8.310740] ? kthread_park+0x90/0x90 [ 8.311686] ret_from_fork+0x35/0x40 [ 8.312609] Modules linked in: serio_raw libata(+) virtio_scsi i2c_piix4 parport_pc(+) parport floppy ip_tables [ 8.315085] CR2: 0000000000000018 [ 8.315978] ---[ end trace 808f3f155f356740 ]--- To reproduce: # build kernel cd linux cp config-5.4.0-rc1-00274-g017e1adde9cfd .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, lkp

2 years, 5 months

2
1
0 / 0

[ext4] 3d487697d2: BUG:unable_to_handle_page_fault_for_address

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 3d487697d219f01d70ac7fc3b9aab59eb98186f0 ("[PATCH] ext4: Fix ext4_empty_dir() for directories with holes") url: https://github.com/0day-ci/linux/commits/Jan-Kara/ext4-Fix-ext4_empty_dir... base: https://git.kernel.org/cgit/linux/kernel/git/tytso/ext4.git dev in testcase: ltp with following parameters: disk: 1HDD fs: ext4 test: fs_readonly-02 test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features. test-url: http://linux-test-project.github.io/ on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +--------------------------------------------------+------------+------------+ | | dfdeeb41fb | 3d487697d2 | +--------------------------------------------------+------------+------------+ | boot_successes | 23 | 2 | | boot_failures | 0 | 14 | | BUG:unable_to_handle_page_fault_for_address | 0 | 14 | | Oops:#[##] | 0 | 14 | | RIP:__ext4_check_dir_entry[ext4] | 0 | 14 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 14 | | WARNING:at_net/sched/sch_generic.c:#dev_watchdog | 0 | 1 | | RIP:dev_watchdog | 0 | 1 | | RIP:native_safe_halt | 0 | 1 | +--------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 1009.326345] BUG: unable to handle page fault for address: ffff8cf8400293a4 [ 1009.331177] #PF: supervisor read access in kernel mode [ 1009.335278] #PF: error_code(0x0000) - not-present page [ 1009.339133] PGD 133601067 P4D 133601067 PUD 0 [ 1009.343023] Oops: 0000 [#1] SMP PTI [ 1009.346578] CPU: 1 PID: 6517 Comm: rm Not tainted 5.4.0-rc3-00091-g3d487697d219f #1 [ 1009.351176] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 1009.356479] RIP: 0010:__ext4_check_dir_entry+0x9/0x110 [ext4] [ 1009.360632] Code: 85 c0 75 b9 44 89 ea 4c 89 e6 48 89 df e8 9f d0 00 00 eb ba 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 66 66 66 66 90 41 54 55 53 <45> 0f b7 58 04 41 0f b6 58 06 41 8b 28 41 83 fb 0b 7e 51 4c 89 d8 [ 1009.369912] RSP: 0018:ffffb745803a3dc8 EFLAGS: 00010246 [ 1009.373596] RAX: 0000000000001000 RBX: ffff8cf78d981a38 RCX: 0000000000000000 [ 1009.377676] RDX: ffff8cf78d981a38 RSI: 0000000000000b43 RDI: ffffffffc0504bc0 [ 1009.381819] RBP: ffff8cf78db82680 R08: ffff8cf8400293a0 R09: ffff8cf78db82680 [ 1009.386099] R10: 000000000000000c R11: 0000000000000fe8 R12: 0000000000000ff4 [ 1009.390307] R13: ffff8cf755977800 R14: ffffffffc0504bc0 R15: ffff8cf8400293a0 [ 1009.394447] FS: 00007fab7790c480(0000) GS:ffff8cf83fd00000(0000) knlGS:0000000000000000 [ 1009.399046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1009.402896] CR2: ffff8cf8400293a4 CR3: 0000000132e88000 CR4: 00000000000006e0 [ 1009.406953] Call Trace: [ 1009.409781] ext4_empty_dir+0x27b/0x300 [ext4] [ 1009.413102] ext4_rmdir+0xd8/0x310 [ext4] [ 1009.416280] vfs_rmdir+0x7c/0x180 [ 1009.419834] do_rmdir+0x1ee/0x220 [ 1009.423076] do_syscall_64+0x5b/0x1d0 [ 1009.426122] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 1009.429561] RIP: 0033:0x7fab7742f117 [ 1009.432732] Code: 73 01 c3 48 8b 0d 81 bd 2b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 07 01 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 51 bd 2b 00 f7 d8 64 89 01 48 [ 1009.441279] RSP: 002b:00007ffea198fc28 EFLAGS: 00000206 ORIG_RAX: 0000000000000107 [ 1009.444991] RAX: ffffffffffffffda RBX: 00005633dbfd5b50 RCX: 00007fab7742f117 [ 1009.448629] RDX: 0000000000000200 RSI: 00005633dbfd5c58 RDI: 000000000000000b [ 1009.452185] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000000 [ 1009.455795] R10: 0000000000000006 R11: 0000000000000206 R12: 00005633dbfcb740 [ 1009.459352] R13: 00007ffea198fd60 R14: 00005633dbfd5b50 R15: 0000000000000001 [ 1009.463153] Modules linked in: loop ext4 mbcache jbd2 dm_mod sr_mod cdrom sg intel_rapl_msr ppdev intel_rapl_common bochs_drm drm_vram_helper crct10dif_pclmul crc32_pclmul ttm crc32c_intel ghash_clmulni_intel snd_pcm drm_kms_helper snd_timer ata_generic pata_acpi aesni_intel crypto_simd cryptd snd glue_helper syscopyarea sysfillrect soundcore joydev sysimgblt fb_sys_fops ata_piix pcspkr serio_raw libata drm i2c_piix4 floppy parport_pc parport ip_tables [ 1009.480345] CR2: ffff8cf8400293a4 [ 1009.482872] ---[ end trace 8135e2d118130929 ]--- To reproduce: # build kernel cd linux cp config-5.4.0-rc3-00091-g3d487697d219f .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, lkp

2 years, 5 months

2
1
0 / 0

Re: [x86/mm/pat] 8d04a5f97a: phoronix-test-suite.glmark2.0.score -23.7% regression

by Linus Torvalds

On Sat, Nov 30, 2019 at 2:09 PM Mariusz Ceier <mceier(a)gmail.com> wrote: > > Contents of /sys/kernel/debug/x86/pat_memtype_list on master > (32ef9553635ab1236c33951a8bd9b5af1c3b1646) where performance is > degraded: Diff between good and bad case: @@ -1,8 +1,8 @@ PAT memtype list: write-back @ 0x55ba4000-0x55ba5000 write-back @ 0x5e88c000-0x5e8b5000 -write-back @ 0x5e8b4000-0x5e8b8000 write-back @ 0x5e8b4000-0x5e8b5000 +write-back @ 0x5e8b4000-0x5e8b8000 write-back @ 0x5e8b7000-0x5e8bb000 write-back @ 0x5e8ba000-0x5e8bc000 write-back @ 0x5e8bb000-0x5e8be000 @@ -21,15 +21,15 @@ uncached-minus @ 0xec260000-0xec264000 uncached-minus @ 0xec300000-0xec320000 uncached-minus @ 0xec326000-0xec327000 -uncached-minus @ 0xf0000000-0xf0001000 uncached-minus @ 0xf0000000-0xf8000000 +uncached-minus @ 0xf0000000-0xf0001000 uncached-minus @ 0xfdc43000-0xfdc44000 uncached-minus @ 0xfe000000-0xfe001000 uncached-minus @ 0xfed00000-0xfed01000 uncached-minus @ 0xfed10000-0xfed16000 uncached-minus @ 0xfed90000-0xfed91000 -write-combining @ 0x2000000000-0x2100000000 -write-combining @ 0x2000000000-0x2100000000 +uncached-minus @ 0x2000000000-0x2100000000 +uncached-minus @ 0x2000000000-0x2100000000 uncached-minus @ 0x2100000000-0x2100001000 uncached-minus @ 0x2100001000-0x2100002000 uncached-minus @ 0x2ffff10000-0x2ffff20000 the first two differences are just trivial ordering differences for overlapping ranges (starting at 0x5e8b4000 and 0xf0000000) respectively. But the final difference is a real difference where it used to be WC, and is now UC-: -write-combining @ 0x2000000000-0x2100000000 -write-combining @ 0x2000000000-0x2100000000 +uncached-minus @ 0x2000000000-0x2100000000 +uncached-minus @ 0x2000000000-0x2100000000 which certainly could easily explain the huge performance degradation. Linus

2 years, 5 months

4
4
0 / 0

5e6669387e ("of/platform: Pause/resume sync state during init .."): WARNING: CPU: 1 PID: 1 at drivers/base/core.c:688 device_links_supplier_sync_state_resume

by kernel test robot

Greetings, 0day kernel testing robot got the below dmesg and the first bad commit is https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master commit 5e6669387e2287f25f09fd0abd279dae104cfa7e Author: Saravana Kannan <saravanak(a)google.com> AuthorDate: Wed Sep 4 14:11:24 2019 -0700 Commit: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> CommitDate: Fri Oct 4 17:30:19 2019 +0200 of/platform: Pause/resume sync state during init and of_platform_populate() When all the top level devices are populated from DT during kernel init, the supplier devices could be added and probed before the consumer devices are added and linked to the suppliers. To avoid the sync_state() callback from being called prematurely, pause the sync_state() callbacks before populating the devices and resume them at late_initcall_sync(). Similarly, when children devices are populated from a module using of_platform_populate(), there could be supplier-consumer dependencies between the children devices that are populated. To avoid the same problem with sync_state() being called prematurely, pause and resume sync_state() callbacks across of_platform_populate(). Signed-off-by: Saravana Kannan <saravanak(a)google.com> Link: https://lore.kernel.org/r/20190904211126.47518-6-saravanak@google.com Signed-off-by: Greg Kroah-Hartman <gregkh(a)linuxfoundation.org> fc5a251d0f driver core: Add sync_state driver/bus callback 5e6669387e of/platform: Pause/resume sync state during init and of_platform_populate() b94ae8ad9f Merge tag 'seccomp-v5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/kees/linux +-------------------------------------------------------------------------+------------+------------+------------+ | | fc5a251d0f | 5e6669387e | b94ae8ad9f | +-------------------------------------------------------------------------+------------+------------+------------+ | boot_successes | 35 | 0 | 0 | | boot_failures | 0 | 11 | 11 | | WARNING:at_drivers/base/core.c:#device_links_supplier_sync_state_resume | 0 | 11 | 11 | | EIP:device_links_supplier_sync_state_resume | 0 | 11 | 11 | +-------------------------------------------------------------------------+------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <lkp(a)intel.com> [ 5.695288] ### dt-test ### end of unittest - 219 passed, 1 failed [ 5.698253] Unregister pv shared memory for cpu 0 [ 5.702549] DEBUG_HOTPLUG_CPU0: CPU 0 is now offline [ 5.703456] ------------[ cut here ]------------ [ 5.704233] Unmatched sync_state pause/resume! [ 5.704260] WARNING: CPU: 1 PID: 1 at drivers/base/core.c:688 device_links_supplier_sync_state_resume+0x4f/0x180 [ 5.706900] Modules linked in: [ 5.707376] CPU: 1 PID: 1 Comm: swapper/0 Tainted: G T 5.4.0-rc1-00005-g5e6669387e228 #1 [ 5.708730] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 5.710111] EIP: device_links_supplier_sync_state_resume+0x4f/0x180 [ 5.711174] Code: 85 c0 75 47 83 05 c8 ec f8 42 01 83 15 cc ec f8 42 00 68 78 cf 40 42 e8 df 75 8e ff 83 05 d0 ec f8 42 01 83 15 d4 ec f8 42 00 <0f> 0b 83 05 d8 ec f8 42 01 83 15 dc ec f8 42 00 58 e9 fb 00 00 00 [ 5.714313] EAX: 00000022 EBX: 2e3be8ad ECX: 91fc3059 EDX: 00000001 [ 5.715302] ESI: 42769f73 EDI: 000016f8 EBP: 40115f24 ESP: 40115f14 [ 5.716316] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010246 [ 5.717378] CR0: 80050033 CR2: ffffffff CR3: 0296c000 CR4: 001406d0 [ 5.718332] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [ 5.719325] DR6: fffe0ff0 DR7: 00000400 [ 5.719943] Call Trace: [ 5.720376] ? of_core_init+0x1f2/0x1f2 [ 5.720976] ? of_platform_sync_state_init+0x47/0x6d [ 5.721694] ? do_one_initcall+0x210/0x5ab [ 5.722338] ? parse_args+0x380/0x760 [ 5.722927] ? kernel_init_freeable+0x2a1/0x484 [ 5.723663] ? kernel_init_freeable+0x2cd/0x484 [ 5.724407] ? rest_init+0x220/0x220 [ 5.725001] ? kernel_init+0x16/0x270 [ 5.725608] ? ret_from_fork+0x2e/0x40 [ 5.726342] ---[ end trace e07e47ab6a227b84 ]--- [ 5.746163] Freeing unused kernel image memory: 2620K # HH:MM RESULT GOOD BAD GOOD_BUT_DIRTY DIRTY_NOT_BAD git bisect start 32ef9553635ab1236c33951a8bd9b5af1c3b1646 v5.4 -- git bisect good 1c134b198daa81cb689f881dcf2900061914085a # 02:59 G 10 0 0 0 Merge branch 'x86-mm-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good d76886972823ce456c0c61cd2284e85668e2131e # 03:20 G 10 0 0 0 Merge tag 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/rdma/rdma git bisect bad a308a7102215a582fc474375648965bc5692894b # 04:24 B 0 11 27 0 Merge tag 'ioremap-5.5' of git://git.infradead.org/users/hch/ioremap git bisect bad 6a0e20cd8cddd70ae5c1211ebe102d738ff2069b # 04:41 B 0 1 17 0 Merge tag 'riscv/for-v5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/riscv/linux git bisect good 0dd09bc02c1bad55e92306ca83b38b3cf48b9f40 # 05:04 G 10 0 0 0 Merge tag 'staging-5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/staging git bisect bad 9a3d7fd275be4559277667228902824165153c80 # 05:47 B 0 3 19 0 Merge tag 'driver-core-5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core git bisect bad f1dfe70b7ff73e1469fd6ea25e89d8a4d2dd1c39 # 07:31 B 0 11 27 0 mmc: atmel-mci: Remove superfluous cast in debugfs_create_u32() call git bisect bad e40d38f28c10e3010b2828f2c737b50fb81bda8f # 07:31 B 0 11 27 0 debugfs: remove return value of debugfs_create_x16() git bisect bad 201e91091b1d47047f55580b5474e1239f4d17aa # 07:31 B 0 11 27 0 sh: add the sh_ prefix to early platform symbols git bisect good fc5a251d0fd7ca9038bab78a8c97932c8c6ca23b # 07:31 G 11 0 0 0 driver core: Add sync_state driver/bus callback git bisect bad d4387cd117414ba80230f27a514be5ca4a09cfcc # 07:32 B 0 22 61 0 of: property: Create device links for all child-supplier depencencies git bisect bad 5e6669387e2287f25f09fd0abd279dae104cfa7e # 07:32 B 0 10 26 0 of/platform: Pause/resume sync state during init and of_platform_populate() # first bad commit: [5e6669387e2287f25f09fd0abd279dae104cfa7e] of/platform: Pause/resume sync state during init and of_platform_populate() git bisect good fc5a251d0fd7ca9038bab78a8c97932c8c6ca23b # 07:43 G 31 0 0 0 driver core: Add sync_state driver/bus callback # extra tests with debug options # extra tests on head commit of linus/master git bisect bad b94ae8ad9fe79da61231999f347f79645b909bda # 08:53 B 0 1 17 0 Merge tag 'seccomp-v5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/kees/linux # bad: [b94ae8ad9fe79da61231999f347f79645b909bda] Merge tag 'seccomp-v5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/kees/linux # extra tests on revert first bad commit git bisect good fd231e31e9be1a388ad6c2ce5f601aae8d859510 # 09:25 G 11 0 0 0 Revert "of/platform: Pause/resume sync state during init and of_platform_populate()" # good: [fd231e31e9be1a388ad6c2ce5f601aae8d859510] Revert "of/platform: Pause/resume sync state during init and of_platform_populate()" # extra tests on linus/master # duplicated: [b94ae8ad9fe79da61231999f347f79645b909bda] Merge tag 'seccomp-v5.5-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/kees/linux # extra tests on linux-next/master # 119: [419593dad8439007452bb6f267861863b572c520] Add linux-next specific files for 20191129 --- 0-DAY kernel test infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/lkp@lists.01.org Intel Corporation

2 years, 5 months

1
0
0 / 0

[btrfs] c6bbf24815: aim7.jobs-per-min -80.1% regression

by kernel test robot

Greeting, FYI, we noticed a -80.1% regression of aim7.jobs-per-min due to commit: commit: c6bbf24815f95a4928984ff16a9a01c9c3670eb1 ("[PATCH RFC] btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") url: https://github.com/0day-ci/linux/commits/Qu-Wenruo/btrfs-space-info-Make-... in testcase: aim7 on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory with following parameters: disk: 4BRD_12G md: RAID0 fs: btrfs test: disk_wrt load: 1500 cpufreq_governor: performance ucode: 0x500002c test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ In addition to that, the commit also has significant impact on the following tests: +------------------+------------------------------------------------------------------------+ | testcase: change | fio-basic: fio.write_bw_MBps -79.2% regression | | test machine | 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory | | test parameters | bs=4k | | | cpufreq_governor=performance | | | disk=1SSD | | | fs=btrfs | | | ioengine=sync | | | nr_task=1 | | | runtime=300s | | | rw=randwrite | | | test_size=128G | | | ucode=0xb000038 | +------------------+------------------------------------------------------------------------+ | testcase: change | blogbench: blogbench.write_score -19.9% regression | | test machine | 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory | | test parameters | cpufreq_governor=performance | | | disk=1SSD | | | fs=btrfs | | | ucode=0x7000019 | +------------------+------------------------------------------------------------------------+ | testcase: change | fio-basic: fio.write_bw_MBps -19.8% regression | | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory | | test parameters | bs=4M | | | cpufreq_governor=performance | | | disk=1HDD | | | fs=btrfs | | | ioengine=sync | | | nr_task=100% | | | runtime=300s | | | rw=randwrite | | | test_size=128G | | | ucode=0x500002c | +------------------+------------------------------------------------------------------------+ | testcase: change | fio-basic: boot-time.boot 2.6% regression | | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory | | test parameters | bs=4k | | | cpufreq_governor=performance | | | direct=direct | | | disk=1HDD | | | fs=btrfs | | | ioengine=sync | | | nr_task=1 | | | runtime=300s | | | rw=write | | | test_size=128G | | | ucode=0x500002c | +------------------+------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode: gcc-7/performance/4BRD_12G/btrfs/x86_64-rhel-7.6/1500/RAID0/debian-x86_64-2019-11-14.cgz/lkp-csl-2ap2/disk_wrt/aim7/0x500002c commit: v5.4 c6bbf24815 ("btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") v5.4 c6bbf24815f95a4928984ff16a9 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 2:5 -40% :4 stderr.libkmod:ERROR../libkmod/libkmod-module.c:#kmod_module_get_holders:could_not_open'/sys/module/pcc_cpufreq/holders':No_such_file_or_directory %stddev %change %stddev \ | \ 32070 -80.1% 6372 aim7.jobs-per-min 280.80 +403.0% 1412 aim7.time.elapsed_time 280.80 +403.0% 1412 aim7.time.elapsed_time.max 3.097e+08 +6.6% 3.301e+08 aim7.time.file_system_outputs 3945212 ± 4% -50.7% 1943551 aim7.time.involuntary_context_switches 278698 ± 3% +301.7% 1119432 ± 4% aim7.time.minor_page_faults 51621 +279.0% 195633 aim7.time.system_time 13.15 ± 10% +409.2% 66.95 aim7.time.user_time 2515400 +6218.6% 1.589e+08 aim7.time.voluntary_context_switches 5.07 ± 3% +425.6% 26.63 ± 2% iostat.cpu.idle 94.88 -23.2% 72.88 iostat.cpu.system 28.12 ± 9% +8105.6% 2307 ± 6% iostat.md0.w/s 4733 ± 9% +714.4% 38551 iostat.md0.wkB/s 4.42 ± 3% +22.1 26.55 ± 2% mpstat.cpu.all.idle% 0.00 ±126% +0.5 0.45 ± 2% mpstat.cpu.all.iowait% 0.00 ± 83% -0.0 0.00 ± 54% mpstat.cpu.all.soft% 95.53 -22.6 72.97 mpstat.cpu.all.sys% 0.05 ± 5% -0.0 0.03 mpstat.cpu.all.usr% 10317394 ± 41% +8698.3% 9.078e+08 ± 11% cpuidle.C1.time 171768 ± 89% +15857.4% 27409795 ± 7% cpuidle.C1.usage 7.734e+08 ± 85% +6332.0% 4.974e+10 ± 31% cpuidle.C1E.time 2516186 ± 44% +8114.6% 2.067e+08 ± 12% cpuidle.C1E.usage 4435070 ±141% +4626.3% 2.096e+08 ± 4% cpuidle.POLL.time 17288 ± 58% +11772.9% 2052654 ± 4% cpuidle.POLL.usage 9930111 +10.6% 10979883 numa-numastat.node0.local_node 9955641 +10.5% 11004822 numa-numastat.node0.numa_hit 9870230 +11.2% 10977774 numa-numastat.node1.local_node 9895773 +11.3% 11014041 numa-numastat.node1.numa_hit 25544 ± 49% +42.0% 36266 numa-numastat.node1.other_node 9872061 +13.4% 11199076 numa-numastat.node2.local_node 9898892 +13.4% 11224375 numa-numastat.node2.numa_hit 4.20 ± 9% +519.0% 26.00 ± 3% vmstat.cpu.id 94.80 -23.7% 72.33 vmstat.cpu.sy 3252 ± 9% +825.9% 30110 ± 2% vmstat.io.bo 0.00 +1e+102% 1.00 vmstat.procs.b 388.60 ± 2% -56.9% 167.67 vmstat.procs.r 26478 +716.5% 216191 vmstat.system.cs 395377 +3.9% 410772 vmstat.system.in 1508 -23.1% 1161 turbostat.Avg_MHz 95.67 -22.0 73.64 turbostat.Busy% 84956 ± 84% +16529.8% 14128081 ± 9% turbostat.C1 0.01 ± 33% +0.2 0.17 ± 12% turbostat.C1% 1278885 ± 44% +8136.5% 1.053e+08 ± 12% turbostat.C1E 0.72 ± 85% +8.6 9.35 ± 32% turbostat.C1E% 2.71 ± 15% +855.5% 25.89 ± 3% turbostat.CPU%c1 1.62 ± 24% -71.3% 0.47 ± 37% turbostat.CPU%c6 57158740 +418.8% 2.965e+08 turbostat.IRQ 1.52 ± 37% -68.4% 0.48 ± 45% turbostat.Pkg%pc2 267.13 -7.9% 246.13 turbostat.PkgWatt 548937 ± 2% -37.4% 343830 meminfo.Active(anon) 197374 ± 2% +132.2% 458217 meminfo.Active(file) 170663 ± 4% +17.8% 201089 meminfo.AnonHugePages 1849215 -12.6% 1615467 meminfo.Committed_AS 193809 ± 2% +16.1% 224969 meminfo.Dirty 37725 ± 5% +209.4% 116738 meminfo.Inactive 33862 ± 5% -19.9% 27131 meminfo.Inactive(anon) 3861 ± 13% +2220.5% 89606 ± 2% meminfo.Inactive(file) 117664 +11.2% 130830 meminfo.KReclaimable 37784 ± 5% -36.2% 24094 meminfo.Mapped 3838612 +111.6% 8121943 ± 2% meminfo.Memused 117664 +11.2% 130830 meminfo.SReclaimable 347303 +32.3% 459515 meminfo.SUnreclaim 268188 ± 8% -77.3% 60946 ± 5% meminfo.Shmem 464967 +27.0% 590346 meminfo.Slab 40.20 ± 33% +3686.9% 1522 ± 11% meminfo.Writeback 15535 -57.4% 6611 ± 6% meminfo.max_used_kB 49533 ± 2% +160.0% 128787 ± 25% numa-meminfo.node0.Active(file) 48479 ± 2% +15.5% 55971 numa-meminfo.node0.Dirty 22506 ± 20% +87.7% 42247 ± 3% numa-meminfo.node0.Inactive 1078 ± 34% +1984.5% 22479 ± 4% numa-meminfo.node0.Inactive(file) 13251 ± 14% -23.2% 10176 numa-meminfo.node0.Mapped 1024479 ± 17% +103.0% 2080012 ± 15% numa-meminfo.node0.MemUsed 48815 ± 2% +74.1% 84996 ± 29% numa-meminfo.node1.Active(file) 48070 ± 2% +17.1% 56311 numa-meminfo.node1.Dirty 322514 ± 2% +16.8% 376661 ± 6% numa-meminfo.node1.FilePages 1965 ± 9% +1196.8% 25492 ± 5% numa-meminfo.node1.Inactive 1216 ± 26% +151.5% 3059 ± 30% numa-meminfo.node1.Inactive(anon) 748.80 ± 27% +2895.9% 22433 ± 2% numa-meminfo.node1.Inactive(file) 6837 ± 7% -32.4% 4624 numa-meminfo.node1.Mapped 851838 ± 16% +104.7% 1743858 ± 16% numa-meminfo.node1.MemUsed 49048 ± 2% +119.2% 107536 ± 13% numa-meminfo.node2.Active(file) 48431 ± 2% +16.4% 56384 numa-meminfo.node2.Dirty 4706 ±108% +418.7% 24416 ± 4% numa-meminfo.node2.Inactive 836.20 ± 46% +2567.8% 22308 ± 2% numa-meminfo.node2.Inactive(file) 8072 ± 34% -42.3% 4659 numa-meminfo.node2.Mapped 856364 ± 11% +157.6% 2206418 ± 7% numa-meminfo.node2.MemUsed 585.00 ± 71% +3494.1% 21025 ±130% numa-meminfo.node2.PageTables 60300 ± 4% +48.7% 89636 ± 26% numa-meminfo.node2.SUnreclaim 80131 ± 8% +49.4% 119735 ± 30% numa-meminfo.node2.Slab 49431 ± 3% +176.8% 136812 ± 9% numa-meminfo.node3.Active(file) 48121 ± 2% +15.6% 55615 numa-meminfo.node3.Dirty 8414 ± 53% +192.2% 24588 ± 6% numa-meminfo.node3.Inactive 1191 ± 24% +1778.9% 22392 ± 3% numa-meminfo.node3.Inactive(file) 9527 ± 24% -51.3% 4636 numa-meminfo.node3.Mapped 1104787 ± 23% +89.3% 2091596 ± 10% numa-meminfo.node3.MemUsed 137251 ± 2% -37.4% 85956 proc-vmstat.nr_active_anon 49361 ± 2% +132.0% 114528 proc-vmstat.nr_active_file 38663432 +8.6% 41974260 proc-vmstat.nr_dirtied 48437 ± 3% +15.8% 56105 proc-vmstat.nr_dirty 4826945 -2.0% 4728671 proc-vmstat.nr_dirty_background_threshold 9665693 -2.0% 9468904 proc-vmstat.nr_dirty_threshold 390609 +8.7% 424645 proc-vmstat.nr_file_pages 48472732 -2.2% 47401946 proc-vmstat.nr_free_pages 8422 ± 4% -19.5% 6782 proc-vmstat.nr_inactive_anon 965.40 ± 13% +2220.4% 22401 ± 2% proc-vmstat.nr_inactive_file 9490 ± 4% -35.2% 6147 proc-vmstat.nr_mapped 317.00 ± 50% +43.7% 455.67 ± 9% proc-vmstat.nr_mlock 13426 ± 5% +10.6% 14850 ± 4% proc-vmstat.nr_page_table_pages 67036 ± 8% -77.3% 15236 ± 5% proc-vmstat.nr_shmem 29417 +11.2% 32707 proc-vmstat.nr_slab_reclaimable 86822 +32.3% 114877 proc-vmstat.nr_slab_unreclaimable 14.00 ± 46% +2926.2% 423.67 ± 19% proc-vmstat.nr_writeback 230567 ± 9% +4520.5% 10653348 ± 2% proc-vmstat.nr_written 137251 ± 2% -37.4% 85956 proc-vmstat.nr_zone_active_anon 49361 ± 2% +132.0% 114528 proc-vmstat.nr_zone_active_file 8422 ± 4% -19.5% 6782 proc-vmstat.nr_zone_inactive_anon 965.40 ± 13% +2220.4% 22401 ± 2% proc-vmstat.nr_zone_inactive_file 48249 ± 3% +17.7% 56801 proc-vmstat.nr_zone_write_pending 204165 ± 5% +411.7% 1044639 ± 5% proc-vmstat.numa_hint_faults 153009 ± 6% +350.7% 689603 ± 7% proc-vmstat.numa_hint_faults_local 39680217 +11.1% 44072979 proc-vmstat.numa_hit 39584298 +11.1% 43962666 proc-vmstat.numa_local 95918 +15.0% 110313 proc-vmstat.numa_other 27527 ± 5% +233.4% 91773 ± 2% proc-vmstat.numa_pages_migrated 217049 ± 7% +390.0% 1063518 ± 4% proc-vmstat.numa_pte_updates 3033120 +85.1% 5615220 proc-vmstat.pgactivate 39865153 +11.8% 44556621 proc-vmstat.pgalloc_normal 1238327 +367.5% 5789500 proc-vmstat.pgfault 39734124 +8.6% 43135750 proc-vmstat.pgfree 27527 ± 5% +233.4% 91773 ± 2% proc-vmstat.pgmigrate_success 922053 ± 9% +4520.0% 42598858 ± 2% proc-vmstat.pgpgout 1007 ± 3% +9.6% 1104 proc-vmstat.unevictable_pgs_culled 12395 ± 2% +159.7% 32191 ± 25% numa-vmstat.node0.nr_active_file 4643034 +14.2% 5301322 numa-vmstat.node0.nr_dirtied 12155 ± 3% +15.3% 14015 numa-vmstat.node0.nr_dirty 269.20 ± 34% +1985.1% 5613 ± 4% numa-vmstat.node0.nr_inactive_file 3354 ± 17% -24.2% 2544 numa-vmstat.node0.nr_mapped 91.40 ± 58% +52.4% 139.33 ± 15% numa-vmstat.node0.nr_mlock 2.00 ± 44% +4983.3% 101.67 ± 13% numa-vmstat.node0.nr_writeback 25980 ± 16% +5855.2% 1547176 ± 6% numa-vmstat.node0.nr_written 12394 ± 2% +159.7% 32191 ± 25% numa-vmstat.node0.nr_zone_active_file 269.20 ± 34% +1985.1% 5613 ± 4% numa-vmstat.node0.nr_zone_inactive_file 12100 ± 2% +17.3% 14193 numa-vmstat.node0.nr_zone_write_pending 5342759 +12.8% 6027732 numa-vmstat.node0.numa_hit 5317823 ± 2% +12.9% 6004957 numa-vmstat.node0.numa_local 12225 ± 2% +73.9% 21265 ± 29% numa-vmstat.node1.nr_active_file 4633020 +12.2% 5197958 numa-vmstat.node1.nr_dirtied 12036 ± 2% +17.2% 14111 numa-vmstat.node1.nr_dirty 80639 ± 2% +16.8% 94187 ± 6% numa-vmstat.node1.nr_file_pages 302.40 ± 27% +152.8% 764.33 ± 30% numa-vmstat.node1.nr_inactive_anon 186.60 ± 27% +2904.1% 5605 ± 2% numa-vmstat.node1.nr_inactive_file 1736 ± 3% -33.4% 1155 numa-vmstat.node1.nr_mapped 2.20 ± 66% +4597.0% 103.33 ± 14% numa-vmstat.node1.nr_writeback 25133 ± 15% +5577.3% 1426891 ± 3% numa-vmstat.node1.nr_written 12225 ± 2% +73.9% 21265 ± 29% numa-vmstat.node1.nr_zone_active_file 302.40 ± 27% +152.8% 764.33 ± 30% numa-vmstat.node1.nr_zone_inactive_anon 186.60 ± 27% +2904.1% 5605 ± 2% numa-vmstat.node1.nr_zone_inactive_file 12000 ± 2% +19.0% 14282 numa-vmstat.node1.nr_zone_write_pending 5065734 +13.9% 5772157 numa-vmstat.node1.numa_hit 4952944 +14.1% 5650441 numa-vmstat.node1.numa_local 12186 ± 2% +120.6% 26888 ± 13% numa-vmstat.node2.nr_active_file 4634627 +14.5% 5308170 numa-vmstat.node2.nr_dirtied 12051 ± 2% +17.0% 14099 numa-vmstat.node2.nr_dirty 209.00 ± 46% +2569.1% 5578 ± 2% numa-vmstat.node2.nr_inactive_file 1973 ± 29% -38.9% 1206 ± 5% numa-vmstat.node2.nr_mapped 146.20 ± 71% +3497.1% 5259 ±130% numa-vmstat.node2.nr_page_table_pages 15073 ± 4% +48.7% 22410 ± 26% numa-vmstat.node2.nr_slab_unreclaimable 2.60 ± 52% +3784.6% 101.00 ± 16% numa-vmstat.node2.nr_writeback 25376 ± 9% +5885.4% 1518868 ± 3% numa-vmstat.node2.nr_written 12185 ± 2% +120.7% 26889 ± 13% numa-vmstat.node2.nr_zone_active_file 209.00 ± 46% +2569.1% 5578 ± 2% numa-vmstat.node2.nr_zone_inactive_file 12035 ± 2% +18.6% 14271 numa-vmstat.node2.nr_zone_write_pending 5055872 +16.1% 5871437 ± 2% numa-vmstat.node2.numa_hit 4941737 +16.6% 5760556 ± 2% numa-vmstat.node2.numa_local 12375 ± 3% +176.3% 34199 ± 9% numa-vmstat.node3.nr_active_file 4641415 +15.1% 5343310 numa-vmstat.node3.nr_dirtied 12067 ± 3% +15.1% 13889 numa-vmstat.node3.nr_dirty 297.60 ± 24% +1781.9% 5600 ± 3% numa-vmstat.node3.nr_inactive_file 2487 ± 25% -50.1% 1242 ± 5% numa-vmstat.node3.nr_mapped 2.40 ± 77% +4066.7% 100.00 ± 15% numa-vmstat.node3.nr_writeback 27048 ± 8% +5825.6% 1602749 numa-vmstat.node3.nr_written 12375 ± 3% +176.4% 34199 ± 9% numa-vmstat.node3.nr_zone_active_file 297.60 ± 24% +1781.9% 5600 ± 3% numa-vmstat.node3.nr_zone_inactive_file 11989 ± 3% +17.3% 14063 numa-vmstat.node3.nr_zone_write_pending 5173752 +11.3% 5760155 ± 3% numa-vmstat.node3.numa_hit 5068067 ± 2% +11.5% 5649478 ± 3% numa-vmstat.node3.numa_local 1.239e+10 -24.8% 9.32e+09 perf-stat.i.branch-instructions 22081791 ± 2% -13.8% 19033846 perf-stat.i.branch-misses 53.35 ± 4% -18.8 34.55 perf-stat.i.cache-miss-rate% 46191736 ± 11% -43.6% 26052198 ± 2% perf-stat.i.cache-misses 26966 +704.7% 216993 perf-stat.i.context-switches 11.05 -1.8% 10.85 perf-stat.i.cpi 5.732e+11 -24.1% 4.353e+11 perf-stat.i.cpu-cycles 4345 +907.9% 43795 perf-stat.i.cpu-migrations 12405 ± 13% +43.0% 17742 ± 3% perf-stat.i.cycles-between-cache-misses 802971 ± 19% +146.9% 1982139 ± 13% perf-stat.i.dTLB-load-misses 1.308e+10 -26.4% 9.625e+09 perf-stat.i.dTLB-loads 0.01 ± 35% +0.0 0.02 ± 5% perf-stat.i.dTLB-store-miss-rate% 55413 ± 12% +122.0% 123010 ± 6% perf-stat.i.dTLB-store-misses 1.189e+09 -39.5% 7.19e+08 perf-stat.i.dTLB-stores 75.66 -36.9 38.79 ± 2% perf-stat.i.iTLB-load-miss-rate% 5545889 ± 7% -16.7% 4618937 ± 4% perf-stat.i.iTLB-load-misses 1776875 +321.9% 7497189 perf-stat.i.iTLB-loads 5.118e+10 -25.4% 3.817e+10 perf-stat.i.instructions 0.09 ± 2% +6.6% 0.10 perf-stat.i.ipc 4188 -4.4% 4002 perf-stat.i.minor-faults 11607086 ± 4% +3.9% 12063996 perf-stat.i.node-load-misses 93.93 +3.1 97.07 perf-stat.i.node-store-miss-rate% 6497150 -31.8% 4428602 perf-stat.i.node-store-misses 393359 -65.1% 137163 ± 2% perf-stat.i.node-stores 4188 -4.4% 4002 perf-stat.i.page-faults 1.70 ± 7% +18.0% 2.00 ± 2% perf-stat.overall.MPKI 0.18 ± 2% +0.0 0.20 perf-stat.overall.branch-miss-rate% 53.03 ± 5% -18.9 34.11 ± 2% perf-stat.overall.cache-miss-rate% 11.20 +1.8% 11.40 perf-stat.overall.cpi 12606 ± 13% +32.6% 16719 ± 3% perf-stat.overall.cycles-between-cache-misses 0.01 ± 19% +0.0 0.02 ± 12% perf-stat.overall.dTLB-load-miss-rate% 0.00 ± 12% +0.0 0.02 ± 5% perf-stat.overall.dTLB-store-miss-rate% 75.68 -37.6 38.11 ± 2% perf-stat.overall.iTLB-load-miss-rate% 0.09 -1.8% 0.09 perf-stat.overall.ipc 94.29 +2.7 97.00 perf-stat.overall.node-store-miss-rate% 1.234e+10 -24.5% 9.312e+09 perf-stat.ps.branch-instructions 22002244 ± 2% -13.5% 19021265 perf-stat.ps.branch-misses 46012188 ± 11% -43.4% 26033755 ± 2% perf-stat.ps.cache-misses 26860 +707.3% 216847 perf-stat.ps.context-switches 5.71e+11 -23.8% 4.349e+11 perf-stat.ps.cpu-cycles 4327 +911.0% 43756 perf-stat.ps.cpu-migrations 800662 ± 19% +147.4% 1980780 ± 13% perf-stat.ps.dTLB-load-misses 1.303e+10 -26.2% 9.617e+09 perf-stat.ps.dTLB-loads 55333 ± 12% +122.2% 122941 ± 6% perf-stat.ps.dTLB-store-misses 1.184e+09 -39.3% 7.186e+08 perf-stat.ps.dTLB-stores 5524896 ± 7% -16.5% 4615635 ± 4% perf-stat.ps.iTLB-load-misses 1770181 +323.2% 7491635 perf-stat.ps.iTLB-loads 5.098e+10 -25.2% 3.814e+10 perf-stat.ps.instructions 4173 -4.1% 4000 perf-stat.ps.minor-faults 11561545 ± 4% +4.3% 12054966 perf-stat.ps.node-load-misses 6471592 -31.6% 4425307 perf-stat.ps.node-store-misses 391827 -65.0% 137085 ± 2% perf-stat.ps.node-stores 4173 -4.1% 4000 perf-stat.ps.page-faults 1.419e+13 +279.1% 5.377e+13 perf-stat.total.instructions 11252 +1012.1% 125128 slabinfo.Acpi-State.active_objs 220.20 +1018.2% 2462 slabinfo.Acpi-State.active_slabs 11252 +1016.2% 125596 slabinfo.Acpi-State.num_objs 220.20 +1018.2% 2462 slabinfo.Acpi-State.num_slabs 21789 +19.9% 26130 slabinfo.avc_xperms_data.active_objs 21789 +19.9% 26130 slabinfo.avc_xperms_data.num_objs 197.40 ± 14% +178.8% 550.33 ± 2% slabinfo.biovec-128.active_objs 197.40 ± 14% +178.8% 550.33 ± 2% slabinfo.biovec-128.num_objs 328.80 ± 13% +957.0% 3475 slabinfo.biovec-max.active_objs 41.60 ± 14% +990.5% 453.67 slabinfo.biovec-max.active_slabs 334.60 ± 13% +986.6% 3635 slabinfo.biovec-max.num_objs 41.60 ± 14% +990.5% 453.67 slabinfo.biovec-max.num_slabs 6898 +656.0% 52147 ± 2% slabinfo.blkdev_ioc.active_objs 176.40 +662.3% 1344 ± 2% slabinfo.blkdev_ioc.active_slabs 6898 +660.4% 52455 ± 2% slabinfo.blkdev_ioc.num_objs 176.40 +662.3% 1344 ± 2% slabinfo.blkdev_ioc.num_slabs 10568 +949.1% 110872 slabinfo.btrfs_extent_map.active_objs 188.20 +960.2% 1995 slabinfo.btrfs_extent_map.active_slabs 10568 +957.6% 111774 slabinfo.btrfs_extent_map.num_objs 188.20 +960.2% 1995 slabinfo.btrfs_extent_map.num_slabs 564.00 ± 30% +8876.4% 50627 slabinfo.btrfs_ordered_extent.active_objs 14.00 ± 30% +9273.8% 1312 slabinfo.btrfs_ordered_extent.active_slabs 564.00 ± 30% +8977.5% 51197 slabinfo.btrfs_ordered_extent.num_objs 14.00 ± 30% +9273.8% 1312 slabinfo.btrfs_ordered_extent.num_slabs 2199 ± 9% +268.2% 8099 slabinfo.dmaengine-unmap-16.active_objs 52.00 ± 10% +269.2% 192.00 slabinfo.dmaengine-unmap-16.active_slabs 2199 ± 9% +268.2% 8099 slabinfo.dmaengine-unmap-16.num_objs 52.00 ± 10% +269.2% 192.00 slabinfo.dmaengine-unmap-16.num_slabs 3790 ± 7% +27.0% 4815 ± 11% slabinfo.eventpoll_pwq.active_objs 3790 ± 7% +27.0% 4815 ± 11% slabinfo.eventpoll_pwq.num_objs 930.40 ± 8% -14.4% 796.00 ± 4% slabinfo.file_lock_cache.active_objs 930.40 ± 8% -14.4% 796.00 ± 4% slabinfo.file_lock_cache.num_objs 6674 +754.3% 57022 ± 2% slabinfo.khugepaged_mm_slot.active_objs 184.80 +762.9% 1594 ± 2% slabinfo.khugepaged_mm_slot.active_slabs 6674 +760.3% 57420 ± 2% slabinfo.khugepaged_mm_slot.num_objs 184.80 +762.9% 1594 ± 2% slabinfo.khugepaged_mm_slot.num_slabs 14047 +220.9% 45078 ± 2% slabinfo.kmalloc-128.active_objs 219.20 +221.2% 704.00 ± 2% slabinfo.kmalloc-128.active_slabs 14047 +221.0% 45096 ± 2% slabinfo.kmalloc-128.num_objs 219.20 +221.2% 704.00 ± 2% slabinfo.kmalloc-128.num_slabs 10835 +35.7% 14701 ± 2% slabinfo.kmalloc-192.active_objs 10892 +35.0% 14704 ± 2% slabinfo.kmalloc-192.num_objs 9063 +51.8% 13762 ± 2% slabinfo.kmalloc-1k.active_objs 285.40 +51.2% 431.67 ± 2% slabinfo.kmalloc-1k.active_slabs 9148 +51.2% 13832 ± 2% slabinfo.kmalloc-1k.num_objs 285.40 +51.2% 431.67 ± 2% slabinfo.kmalloc-1k.num_slabs 24649 ± 2% +13.8% 28057 ± 2% slabinfo.kmalloc-512.active_objs 24864 ± 2% +13.7% 28275 ± 2% slabinfo.kmalloc-512.num_objs 89133 +153.3% 225734 slabinfo.kmalloc-64.active_objs 1395 +153.6% 3537 slabinfo.kmalloc-64.active_slabs 89341 +153.5% 226461 slabinfo.kmalloc-64.num_objs 1395 +153.6% 3537 slabinfo.kmalloc-64.num_slabs 768.00 ± 9% -30.6% 533.33 ± 14% slabinfo.kmalloc-rcl-128.active_objs 768.00 ± 9% -30.6% 533.33 ± 14% slabinfo.kmalloc-rcl-128.num_objs 5492 ± 12% -15.1% 4665 ± 3% slabinfo.kmalloc-rcl-64.active_objs 5492 ± 12% -15.1% 4665 ± 3% slabinfo.kmalloc-rcl-64.num_objs 1741 ± 9% +1508.7% 28013 ± 3% slabinfo.mnt_cache.active_objs 33.60 ± 9% +1554.8% 556.00 ± 3% slabinfo.mnt_cache.active_slabs 1741 ± 9% +1530.2% 28387 ± 3% slabinfo.mnt_cache.num_objs 33.60 ± 9% +1554.8% 556.00 ± 3% slabinfo.mnt_cache.num_slabs 203.60 ± 6% +234.3% 680.67 ± 9% slabinfo.nfs_read_data.active_objs 203.60 ± 6% +234.3% 680.67 ± 9% slabinfo.nfs_read_data.num_objs 10668 +323.9% 45227 ± 3% slabinfo.numa_policy.active_objs 171.40 +325.5% 729.33 ± 3% slabinfo.numa_policy.active_slabs 10668 +323.9% 45227 ± 3% slabinfo.numa_policy.num_objs 171.40 +325.5% 729.33 ± 3% slabinfo.numa_policy.num_slabs 1879 ± 5% +13.8% 2137 ± 2% slabinfo.pool_workqueue.active_objs 1981 ± 6% +11.9% 2217 slabinfo.pool_workqueue.num_objs 25512 ± 2% +82.4% 46538 slabinfo.radix_tree_node.active_objs 455.40 +82.4% 830.67 slabinfo.radix_tree_node.active_slabs 25531 ± 2% +82.3% 46539 slabinfo.radix_tree_node.num_objs 455.40 +82.4% 830.67 slabinfo.radix_tree_node.num_slabs 946.40 ± 9% +139.2% 2263 ± 5% slabinfo.skbuff_fclone_cache.active_objs 946.40 ± 9% +139.2% 2263 ± 5% slabinfo.skbuff_fclone_cache.num_objs 1412 ± 3% +8.2% 1528 ± 3% slabinfo.task_group.active_objs 1412 ± 3% +8.2% 1528 ± 3% slabinfo.task_group.num_objs 221.20 ± 26% +276.0% 831.67 ± 10% slabinfo.xfrm_state.active_objs 221.20 ± 26% +276.0% 831.67 ± 10% slabinfo.xfrm_state.num_objs 21437 ±169% +429.1% 113415 ± 34% sched_debug.cfs_rq:/.MIN_vruntime.avg 111337 +336.0% 485426 sched_debug.cfs_rq:/.exec_clock.avg 114024 +335.9% 496989 sched_debug.cfs_rq:/.exec_clock.max 106338 +353.6% 482362 sched_debug.cfs_rq:/.exec_clock.min 485.08 ± 13% +295.1% 1916 ± 12% sched_debug.cfs_rq:/.exec_clock.stddev 5442 ± 14% +136.4% 12863 ± 10% sched_debug.cfs_rq:/.load.avg 145420 ±113% +591.9% 1006104 sched_debug.cfs_rq:/.load.max 11936 ± 96% +577.6% 80877 ± 5% sched_debug.cfs_rq:/.load.stddev 0.56 ± 26% +58.7% 0.89 ± 9% sched_debug.cfs_rq:/.load_avg.min 21437 ±169% +429.1% 113415 ± 34% sched_debug.cfs_rq:/.max_vruntime.avg 29440037 +193.4% 86379771 sched_debug.cfs_rq:/.min_vruntime.avg 30948401 +181.7% 87183621 sched_debug.cfs_rq:/.min_vruntime.max 27332485 +194.9% 80601349 sched_debug.cfs_rq:/.min_vruntime.min 557893 ± 4% +99.1% 1110644 sched_debug.cfs_rq:/.min_vruntime.stddev 0.81 -9.0% 0.73 sched_debug.cfs_rq:/.nr_running.avg 0.10 ± 14% +151.1% 0.26 ± 11% sched_debug.cfs_rq:/.nr_running.stddev 0.72 ± 18% +3052.8% 22.73 ± 5% sched_debug.cfs_rq:/.nr_spread_over.avg 18.88 ± 10% +825.7% 174.78 ± 15% sched_debug.cfs_rq:/.nr_spread_over.max 1.76 ± 3% +655.1% 13.26 ± 13% sched_debug.cfs_rq:/.nr_spread_over.stddev 4.39 ± 6% +104.6% 8.97 sched_debug.cfs_rq:/.runnable_load_avg.avg 37.56 ± 30% +2401.4% 939.53 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.max 4.87 ± 21% +1314.7% 68.92 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.stddev 5215 ± 16% +138.9% 12459 ± 11% sched_debug.cfs_rq:/.runnable_weight.avg 143546 ±115% +600.7% 1005842 sched_debug.cfs_rq:/.runnable_weight.max 11850 ± 97% +584.7% 81141 ± 5% sched_debug.cfs_rq:/.runnable_weight.stddev -1016222 +405.3% -5135327 sched_debug.cfs_rq:/.spread0.min 556298 ± 4% +99.8% 1111257 sched_debug.cfs_rq:/.spread0.stddev 2228 ± 13% -39.0% 1359 sched_debug.cfs_rq:/.util_avg.max 253.40 ± 7% +48.7% 376.92 ± 6% sched_debug.cfs_rq:/.util_avg.min 302.60 ± 11% -49.6% 152.59 ± 3% sched_debug.cfs_rq:/.util_avg.stddev 861.58 ± 5% -64.8% 303.44 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.avg 2815 ± 14% -64.9% 987.92 sched_debug.cfs_rq:/.util_est_enqueued.max 458.44 ± 7% -66.9% 151.93 ± 4% sched_debug.cfs_rq:/.util_est_enqueued.stddev 501454 ± 2% -18.0% 411239 sched_debug.cpu.avg_idle.avg 1149976 ± 13% -25.9% 852675 ± 3% sched_debug.cpu.avg_idle.max 88583 ± 10% -24.3% 67045 ± 2% sched_debug.cpu.avg_idle.min 238306 ± 2% -33.3% 158953 ± 4% sched_debug.cpu.avg_idle.stddev 164543 +348.1% 737273 sched_debug.cpu.clock.avg 164650 +347.8% 737340 sched_debug.cpu.clock.max 164409 +348.4% 737199 sched_debug.cpu.clock.min 69.02 ± 21% -42.2% 39.92 sched_debug.cpu.clock.stddev 164543 +348.1% 737273 sched_debug.cpu.clock_task.avg 164650 +347.8% 737340 sched_debug.cpu.clock_task.max 164409 +348.4% 737199 sched_debug.cpu.clock_task.min 69.02 ± 21% -42.2% 39.92 sched_debug.cpu.clock_task.stddev 7700 ± 4% +218.9% 24553 ± 3% sched_debug.cpu.curr->pid.max 669.60 ± 3% +215.8% 2114 sched_debug.cpu.curr->pid.stddev 0.00 ± 5% -36.3% 0.00 ± 5% sched_debug.cpu.next_balance.stddev 1.72 ± 11% -47.7% 0.90 ± 4% sched_debug.cpu.nr_running.avg 5.64 ± 21% -64.8% 1.99 ± 6% sched_debug.cpu.nr_running.max 0.92 ± 11% -50.7% 0.45 sched_debug.cpu.nr_running.stddev 18287 +4335.0% 811042 sched_debug.cpu.nr_switches.avg 30879 ± 6% +3343.4% 1063313 ± 6% sched_debug.cpu.nr_switches.max 16348 +4339.5% 725790 sched_debug.cpu.nr_switches.min 1716 ± 7% +2885.6% 51247 ± 3% sched_debug.cpu.nr_switches.stddev 4.53 ± 3% +44.5% 6.55 sched_debug.cpu.nr_uninterruptible.avg 304.28 ± 9% +1266.0% 4156 ± 3% sched_debug.cpu.nr_uninterruptible.max -231.72 +1580.3% -3893 sched_debug.cpu.nr_uninterruptible.min 88.71 ± 3% +1730.0% 1623 ± 2% sched_debug.cpu.nr_uninterruptible.stddev 16905 +4688.5% 809524 sched_debug.cpu.sched_count.avg 22542 ± 4% +4610.3% 1061845 ± 6% sched_debug.cpu.sched_count.max 15528 +4565.3% 724441 sched_debug.cpu.sched_count.min 951.11 ± 7% +5282.8% 51196 ± 3% sched_debug.cpu.sched_count.stddev 1345 ± 9% +24927.1% 336689 sched_debug.cpu.sched_goidle.avg 3786 ± 3% +12139.2% 463382 ± 7% sched_debug.cpu.sched_goidle.max 1085 ± 11% +26980.4% 293854 ± 2% sched_debug.cpu.sched_goidle.min 302.18 ± 7% +8431.2% 25779 ± 3% sched_debug.cpu.sched_goidle.stddev 6306 ± 2% +7319.7% 467943 sched_debug.cpu.ttwu_count.avg 18513 ± 9% +3541.8% 674231 ± 14% sched_debug.cpu.ttwu_count.max 2295 ± 2% +18030.7% 416158 sched_debug.cpu.ttwu_count.min 3005 ± 5% +1018.7% 33624 ± 12% sched_debug.cpu.ttwu_count.stddev 712.53 ± 2% +2987.5% 21999 ± 3% sched_debug.cpu.ttwu_local.avg 2785 ± 18% +799.4% 25055 ± 3% sched_debug.cpu.ttwu_local.max 401.68 ± 2% +4920.5% 20166 ± 2% sched_debug.cpu.ttwu_local.min 311.42 ± 14% +88.0% 585.51 ± 3% sched_debug.cpu.ttwu_local.stddev 164407 +348.4% 737198 sched_debug.cpu_clk 160360 +357.2% 733150 sched_debug.ktime 3.02 -100.0% 0.00 sched_debug.rt_rq:/.rt_runtime.stddev 164924 +347.3% 737715 sched_debug.sched_clk 6948 ± 7% +590.2% 47953 ± 3% softirqs.CPU0.RCU 15616 ± 8% +1391.4% 232912 ± 2% softirqs.CPU0.SCHED 112053 ± 16% +299.2% 447317 softirqs.CPU0.TIMER 9606 ± 25% +422.4% 50188 ± 3% softirqs.CPU1.RCU 7290 ± 13% +2996.0% 225695 softirqs.CPU1.SCHED 99794 ± 3% +316.4% 415549 ± 2% softirqs.CPU1.TIMER 7122 ± 4% +599.8% 49839 ± 3% softirqs.CPU10.RCU 6567 ± 2% +3318.5% 224499 ± 2% softirqs.CPU10.SCHED 100895 ± 3% +321.4% 425178 softirqs.CPU10.TIMER 6615 ± 4% +629.5% 48258 ± 2% softirqs.CPU100.RCU 6444 ± 4% +3330.3% 221062 ± 2% softirqs.CPU100.SCHED 100442 ± 4% +321.3% 423118 softirqs.CPU100.TIMER 6824 ± 6% +608.8% 48371 ± 2% softirqs.CPU101.RCU 6753 ± 7% +3198.2% 222724 ± 2% softirqs.CPU101.SCHED 100450 ± 4% +322.2% 424145 softirqs.CPU101.TIMER 6564 ± 3% +629.7% 47900 ± 2% softirqs.CPU102.RCU 6458 ± 3% +3297.1% 219385 ± 3% softirqs.CPU102.SCHED 100065 ± 3% +323.1% 423371 softirqs.CPU102.TIMER 6716 ± 3% +606.9% 47479 softirqs.CPU103.RCU 6535 ± 2% +3307.1% 222660 softirqs.CPU103.SCHED 99348 ± 3% +422.5% 519120 ± 27% softirqs.CPU103.TIMER 6748 ± 4% +618.7% 48499 ± 2% softirqs.CPU104.RCU 6549 ± 2% +3279.5% 221341 ± 2% softirqs.CPU104.SCHED 99323 ± 3% +322.9% 420049 softirqs.CPU104.TIMER 6690 ± 4% +621.4% 48267 ± 3% softirqs.CPU105.RCU 6529 +3295.7% 221733 softirqs.CPU105.SCHED 99487 ± 3% +323.1% 420911 softirqs.CPU105.TIMER 6595 ± 5% +629.8% 48136 ± 3% softirqs.CPU106.RCU 6447 ± 2% +3332.5% 221318 ± 2% softirqs.CPU106.SCHED 100048 ± 3% +322.2% 422440 softirqs.CPU106.TIMER 6489 ± 6% +637.1% 47828 ± 3% softirqs.CPU107.RCU 6567 ± 7% +3289.8% 222605 softirqs.CPU107.SCHED 101721 ± 5% +315.5% 422698 softirqs.CPU107.TIMER 6703 ± 8% +624.2% 48544 ± 4% softirqs.CPU108.RCU 6501 ± 6% +3329.0% 222936 softirqs.CPU108.SCHED 100442 ± 4% +321.9% 423812 softirqs.CPU108.TIMER 7748 ± 22% +525.2% 48446 ± 2% softirqs.CPU109.RCU 6692 ± 7% +3231.0% 222923 softirqs.CPU109.SCHED 99658 ± 4% +320.2% 418799 softirqs.CPU109.TIMER 7084 ± 5% +598.9% 49512 ± 3% softirqs.CPU11.RCU 6589 ± 4% +3308.5% 224588 ± 2% softirqs.CPU11.SCHED 111261 ± 19% +282.3% 425380 softirqs.CPU11.TIMER 6676 ± 4% +627.2% 48549 ± 3% softirqs.CPU110.RCU 6529 ± 2% +3313.5% 222883 softirqs.CPU110.SCHED 100473 ± 4% +318.0% 420016 softirqs.CPU110.TIMER 6871 ± 10% +598.3% 47982 ± 2% softirqs.CPU111.RCU 6769 ± 9% +3192.2% 222869 softirqs.CPU111.SCHED 100334 ± 4% +320.0% 421361 softirqs.CPU111.TIMER 6591 ± 5% +634.7% 48427 ± 3% softirqs.CPU112.RCU 6484 ± 2% +3325.8% 222130 ± 2% softirqs.CPU112.SCHED 100066 ± 3% +321.8% 422083 softirqs.CPU112.TIMER 6775 ± 8% +617.9% 48644 ± 3% softirqs.CPU113.RCU 6506 ± 3% +3322.0% 222636 softirqs.CPU113.SCHED 101137 ± 4% +318.3% 423010 softirqs.CPU113.TIMER 7112 ± 10% +581.6% 48476 ± 3% softirqs.CPU114.RCU 6700 ± 5% +3238.4% 223676 softirqs.CPU114.SCHED 100962 ± 4% +318.9% 422958 softirqs.CPU114.TIMER 7016 ± 13% +579.1% 47649 ± 4% softirqs.CPU115.RCU 6823 ± 6% +3188.0% 224352 softirqs.CPU115.SCHED 100539 ± 4% +417.2% 519981 ± 25% softirqs.CPU115.TIMER 6566 ± 5% +636.4% 48353 ± 3% softirqs.CPU116.RCU 6505 ± 3% +3333.6% 223365 softirqs.CPU116.SCHED 109750 ± 18% +283.9% 421295 softirqs.CPU116.TIMER 7045 ± 10% +583.1% 48127 ± 4% softirqs.CPU117.RCU 6488 ± 2% +3334.0% 222805 softirqs.CPU117.SCHED 100503 ± 3% +318.7% 420840 softirqs.CPU117.TIMER 6562 ± 4% +639.4% 48518 ± 3% softirqs.CPU118.RCU 6731 ± 3% +3219.5% 223443 softirqs.CPU118.SCHED 100293 ± 3% +320.4% 421588 softirqs.CPU118.TIMER 6450 ± 3% +654.3% 48658 ± 3% softirqs.CPU119.RCU 6437 ± 2% +3373.2% 223592 softirqs.CPU119.SCHED 99973 ± 4% +322.4% 422306 softirqs.CPU119.TIMER 7284 ± 6% +584.2% 49839 ± 4% softirqs.CPU12.RCU 6567 ± 2% +3342.6% 226076 softirqs.CPU12.SCHED 101374 ± 3% +319.8% 425528 softirqs.CPU12.TIMER 6296 ± 8% +692.1% 49871 ± 4% softirqs.CPU120.RCU 6352 ± 4% +3430.1% 224262 softirqs.CPU120.SCHED 97480 ± 6% +344.5% 433272 softirqs.CPU120.TIMER 6370 ± 4% +675.3% 49385 ± 4% softirqs.CPU121.RCU 6385 ± 3% +3413.3% 224323 softirqs.CPU121.SCHED 95827 ± 4% +349.7% 430902 softirqs.CPU121.TIMER 6423 ± 3% +669.6% 49437 ± 4% softirqs.CPU122.RCU 6388 ± 3% +3408.0% 224121 softirqs.CPU122.SCHED 95887 ± 4% +350.4% 431902 softirqs.CPU122.TIMER 6454 ± 5% +672.6% 49868 ± 4% softirqs.CPU123.RCU 6391 ± 3% +3419.8% 224964 softirqs.CPU123.SCHED 96070 ± 4% +350.4% 432731 softirqs.CPU123.TIMER 6506 ± 7% +668.5% 49999 ± 4% softirqs.CPU124.RCU 6515 ± 6% +3336.7% 223920 softirqs.CPU124.SCHED 97095 ± 3% +345.4% 432489 softirqs.CPU124.TIMER 6646 ± 5% +655.6% 50222 ± 4% softirqs.CPU125.RCU 6508 ± 4% +3346.3% 224286 softirqs.CPU125.SCHED 97177 ± 4% +344.3% 431799 softirqs.CPU125.TIMER 6340 ± 4% +685.4% 49799 ± 4% softirqs.CPU126.RCU 6374 ± 2% +3420.2% 224390 softirqs.CPU126.SCHED 96860 ± 4% +346.0% 431964 softirqs.CPU126.TIMER 6428 ± 5% +672.9% 49680 ± 4% softirqs.CPU127.RCU 6431 ± 3% +3389.6% 224427 softirqs.CPU127.SCHED 96044 ± 4% +348.7% 430963 softirqs.CPU127.TIMER 6441 ± 4% +667.8% 49459 ± 4% softirqs.CPU128.RCU 6375 ± 3% +3413.5% 223990 softirqs.CPU128.SCHED 95379 ± 4% +352.3% 431364 softirqs.CPU128.TIMER 6382 ± 5% +680.0% 49782 ± 4% softirqs.CPU129.RCU 6417 ± 3% +3392.9% 224137 softirqs.CPU129.SCHED 95636 ± 4% +350.3% 430691 softirqs.CPU129.TIMER 7674 ± 10% +536.4% 48840 ± 3% softirqs.CPU13.RCU 6467 ± 3% +3389.8% 225710 softirqs.CPU13.SCHED 99553 ± 3% +323.6% 421661 softirqs.CPU13.TIMER 6430 ± 3% +676.3% 49923 ± 4% softirqs.CPU130.RCU 6377 ± 3% +3412.7% 224035 softirqs.CPU130.SCHED 96447 ± 4% +348.4% 432453 softirqs.CPU130.TIMER 6868 ± 11% +630.8% 50196 ± 4% softirqs.CPU131.RCU 6444 ± 2% +3380.0% 224255 softirqs.CPU131.SCHED 96405 ± 4% +348.9% 432742 softirqs.CPU131.TIMER 6456 ± 4% +679.4% 50321 ± 4% softirqs.CPU132.RCU 6373 ± 3% +3419.3% 224298 softirqs.CPU132.SCHED 96916 ± 3% +347.3% 433553 softirqs.CPU132.TIMER 6387 ± 3% +663.2% 48745 ± 4% softirqs.CPU133.RCU 6375 ± 3% +3410.6% 223806 softirqs.CPU133.SCHED 95280 ± 4% +351.6% 430273 softirqs.CPU133.TIMER 6391 ± 4% +675.0% 49530 ± 5% softirqs.CPU134.RCU 6345 ± 3% +3435.7% 224352 softirqs.CPU134.SCHED 95886 ± 4% +348.9% 430430 softirqs.CPU134.TIMER 6401 ± 3% +675.7% 49659 ± 4% softirqs.CPU135.RCU 6366 ± 4% +3428.0% 224599 softirqs.CPU135.SCHED 95857 ± 4% +350.1% 431407 softirqs.CPU135.TIMER 6361 ± 4% +677.5% 49456 ± 4% softirqs.CPU136.RCU 6329 ± 4% +3445.9% 224443 softirqs.CPU136.SCHED 96260 ± 4% +349.2% 432394 softirqs.CPU136.TIMER 6658 ± 3% +653.9% 50194 ± 4% softirqs.CPU137.RCU 6394 ± 2% +3415.8% 224806 softirqs.CPU137.SCHED 96907 ± 4% +346.2% 432390 softirqs.CPU137.TIMER 6568 ± 4% +675.4% 50934 ± 4% softirqs.CPU138.RCU 6468 ± 2% +3380.1% 225112 softirqs.CPU138.SCHED 96747 ± 4% +348.4% 433792 softirqs.CPU138.TIMER 6371 ± 5% +681.4% 49789 ± 4% softirqs.CPU139.RCU 6367 ± 3% +3420.5% 224177 softirqs.CPU139.SCHED 95658 ± 4% +350.7% 431141 softirqs.CPU139.TIMER 7339 ± 9% +565.1% 48812 ± 3% softirqs.CPU14.RCU 6486 ± 3% +3378.0% 225581 softirqs.CPU14.SCHED 100587 ± 3% +320.4% 422882 softirqs.CPU14.TIMER 6413 ± 3% +669.3% 49337 ± 3% softirqs.CPU140.RCU 6338 ± 3% +3440.7% 224433 softirqs.CPU140.SCHED 96029 ± 4% +348.3% 430493 softirqs.CPU140.TIMER 6440 ± 3% +675.8% 49965 ± 4% softirqs.CPU141.RCU 6360 ± 3% +3435.2% 224864 softirqs.CPU141.SCHED 96068 ± 4% +348.5% 430837 softirqs.CPU141.TIMER 6423 ± 3% +686.1% 50497 ± 4% softirqs.CPU142.RCU 6359 ± 3% +3435.3% 224828 softirqs.CPU142.SCHED 96602 ± 5% +347.2% 432006 softirqs.CPU142.TIMER 6433 ± 6% +682.4% 50333 ± 4% softirqs.CPU143.RCU 6447 ± 2% +3395.2% 225337 softirqs.CPU143.SCHED 96533 ± 4% +347.5% 431956 softirqs.CPU143.TIMER 6823 ± 10% +630.2% 49826 ± 3% softirqs.CPU144.RCU 6212 ± 3% +3510.5% 224298 softirqs.CPU144.SCHED 97037 ± 5% +348.7% 435396 softirqs.CPU144.TIMER 6562 ± 4% +656.7% 49652 ± 3% softirqs.CPU145.RCU 6336 ± 4% +3430.4% 223709 softirqs.CPU145.SCHED 96523 ± 4% +347.4% 431880 softirqs.CPU145.TIMER 6641 ± 7% +639.0% 49081 ± 3% softirqs.CPU146.RCU 6454 ± 7% +3364.1% 223600 softirqs.CPU146.SCHED 96693 ± 3% +348.2% 433393 softirqs.CPU146.TIMER 6506 ± 4% +668.5% 50002 ± 4% softirqs.CPU147.RCU 6327 ± 3% +3435.5% 223710 softirqs.CPU147.SCHED 96523 ± 4% +349.1% 433473 softirqs.CPU147.TIMER 6397 ± 3% +679.4% 49861 ± 4% softirqs.CPU148.RCU 6347 ± 3% +3427.2% 223879 softirqs.CPU148.SCHED 97132 ± 3% +346.8% 434002 softirqs.CPU148.TIMER 6461 ± 4% +673.8% 49998 ± 4% softirqs.CPU149.RCU 6433 +3379.9% 223879 softirqs.CPU149.SCHED 97410 ± 4% +345.4% 433895 softirqs.CPU149.TIMER 7389 ± 6% +566.7% 49259 ± 2% softirqs.CPU15.RCU 6553 +3337.7% 225283 ± 2% softirqs.CPU15.SCHED 100550 ± 3% +322.7% 425021 softirqs.CPU15.TIMER 6453 ± 4% +680.1% 50346 ± 4% softirqs.CPU150.RCU 6394 ± 4% +3407.6% 224302 softirqs.CPU150.SCHED 96768 ± 4% +349.9% 435333 softirqs.CPU150.TIMER 6655 ± 3% +659.0% 50519 ± 3% softirqs.CPU151.RCU 6332 ± 4% +3430.7% 223580 softirqs.CPU151.SCHED 96749 ± 4% +347.8% 433255 softirqs.CPU151.TIMER 6411 ± 4% +676.0% 49755 ± 3% softirqs.CPU152.RCU 6292 ± 3% +3460.9% 224051 softirqs.CPU152.SCHED 96017 ± 4% +350.9% 432901 softirqs.CPU152.TIMER 6396 ± 3% +674.9% 49566 ± 4% softirqs.CPU153.RCU 6341 ± 3% +3432.3% 223982 softirqs.CPU153.SCHED 96789 ± 4% +348.5% 434085 softirqs.CPU153.TIMER 6439 ± 3% +674.6% 49883 ± 4% softirqs.CPU154.RCU 6334 ± 4% +3441.9% 224342 softirqs.CPU154.SCHED 96597 ± 4% +349.7% 434437 softirqs.CPU154.TIMER 6408 ± 3% +675.8% 49718 ± 3% softirqs.CPU155.RCU 6385 ± 3% +3410.0% 224113 softirqs.CPU155.SCHED 96637 ± 4% +349.6% 434494 softirqs.CPU155.TIMER 6406 ± 3% +677.4% 49808 ± 3% softirqs.CPU156.RCU 6312 ± 3% +3447.8% 223948 softirqs.CPU156.SCHED 95816 ± 4% +351.3% 432439 softirqs.CPU156.TIMER 6480 ± 4% +670.2% 49908 ± 3% softirqs.CPU157.RCU 6363 ± 3% +3422.9% 224175 softirqs.CPU157.SCHED 95578 ± 4% +352.2% 432243 softirqs.CPU157.TIMER 6337 ± 4% +683.4% 49643 ± 4% softirqs.CPU158.RCU 6303 ± 3% +3468.7% 224934 softirqs.CPU158.SCHED 96174 ± 4% +350.5% 433290 softirqs.CPU158.TIMER 6321 ± 4% +678.0% 49184 ± 3% softirqs.CPU159.RCU 6317 ± 4% +3451.1% 224339 softirqs.CPU159.SCHED 96610 ± 4% +348.9% 433639 softirqs.CPU159.TIMER 6975 ± 5% +603.2% 49054 ± 3% softirqs.CPU16.RCU 6446 ± 3% +3406.1% 226003 softirqs.CPU16.SCHED 100522 ± 3% +322.0% 424202 softirqs.CPU16.TIMER 6281 ± 5% +708.3% 50773 ± 3% softirqs.CPU160.RCU 6315 ± 3% +3458.1% 224719 softirqs.CPU160.SCHED 96502 ± 4% +351.1% 435331 softirqs.CPU160.TIMER 6284 ± 4% +707.8% 50761 ± 2% softirqs.CPU161.RCU 6273 ± 4% +3485.3% 224906 softirqs.CPU161.SCHED 96666 ± 4% +349.8% 434841 softirqs.CPU161.TIMER 6360 ± 4% +679.9% 49601 ± 3% softirqs.CPU162.RCU 6323 ± 3% +3448.0% 224359 softirqs.CPU162.SCHED 95878 ± 4% +350.9% 432282 softirqs.CPU162.TIMER 6189 ± 4% +712.8% 50306 ± 3% softirqs.CPU163.RCU 6325 ± 3% +3448.3% 224436 softirqs.CPU163.SCHED 95704 ± 4% +351.6% 432242 softirqs.CPU163.TIMER 6256 ± 3% +699.8% 50038 ± 3% softirqs.CPU164.RCU 6392 ± 4% +3412.8% 224558 softirqs.CPU164.SCHED 96614 ± 3% +348.3% 433084 softirqs.CPU164.TIMER 6283 ± 4% +694.0% 49889 ± 3% softirqs.CPU165.RCU 6357 ± 3% +3438.9% 224982 softirqs.CPU165.SCHED 96598 ± 4% +347.9% 432624 softirqs.CPU165.TIMER 6399 ± 4% +688.9% 50481 ± 3% softirqs.CPU166.RCU 6379 ± 4% +3420.4% 224597 softirqs.CPU166.SCHED 96634 ± 4% +348.0% 432935 softirqs.CPU166.TIMER 6421 ± 6% +682.6% 50256 ± 3% softirqs.CPU167.RCU 6323 ± 3% +3459.5% 225097 softirqs.CPU167.SCHED 96734 ± 3% +347.3% 432683 softirqs.CPU167.TIMER 6351 ± 14% +644.4% 47276 ± 4% softirqs.CPU168.RCU 6510 ± 8% +3266.8% 219187 softirqs.CPU168.SCHED 105010 ± 5% +324.7% 445958 softirqs.CPU168.TIMER 6035 ± 2% +680.9% 47128 ± 4% softirqs.CPU169.RCU 6390 +3327.9% 219062 ± 2% softirqs.CPU169.SCHED 104329 ± 4% +323.8% 442143 softirqs.CPU169.TIMER 7421 ± 12% +560.9% 49048 ± 3% softirqs.CPU17.RCU 6557 ± 3% +3331.6% 225013 softirqs.CPU17.SCHED 101494 ± 4% +319.0% 425286 softirqs.CPU17.TIMER 6378 ± 12% +640.7% 47249 ± 4% softirqs.CPU170.RCU 6657 ± 7% +3174.0% 217958 softirqs.CPU170.SCHED 105000 ± 5% +321.8% 442861 softirqs.CPU170.TIMER 6241 ± 10% +658.2% 47320 ± 4% softirqs.CPU171.RCU 6578 ± 4% +3203.9% 217350 ± 2% softirqs.CPU171.SCHED 104848 ± 5% +321.9% 442372 softirqs.CPU171.TIMER 6272 ± 10% +660.0% 47669 ± 3% softirqs.CPU172.RCU 6334 ± 2% +3368.2% 219687 ± 2% softirqs.CPU172.SCHED 105809 ± 5% +319.7% 444094 softirqs.CPU172.TIMER 5887 ± 6% +707.9% 47564 ± 3% softirqs.CPU173.RCU 6349 ± 3% +3347.4% 218886 softirqs.CPU173.SCHED 105989 ± 2% +318.6% 443706 softirqs.CPU173.TIMER 6013 ± 6% +692.0% 47623 ± 4% softirqs.CPU174.RCU 6358 ± 3% +3333.0% 218284 ± 2% softirqs.CPU174.SCHED 104940 ± 4% +323.6% 444502 softirqs.CPU174.TIMER 6120 ± 7% +669.2% 47082 ± 4% softirqs.CPU175.RCU 6445 ± 4% +3315.0% 220118 softirqs.CPU175.SCHED 104128 ± 4% +322.9% 440349 softirqs.CPU175.TIMER 6207 ± 5% +665.9% 47546 ± 5% softirqs.CPU176.RCU 6419 ± 4% +3306.7% 218692 softirqs.CPU176.SCHED 103653 ± 4% +326.0% 441529 softirqs.CPU176.TIMER 6302 ± 6% +655.7% 47629 ± 5% softirqs.CPU177.RCU 6500 ± 5% +3250.9% 217824 softirqs.CPU177.SCHED 104027 ± 4% +324.0% 441032 softirqs.CPU177.TIMER 6615 ± 9% +622.3% 47782 ± 4% softirqs.CPU178.RCU 6514 ± 8% +3246.5% 218011 ± 2% softirqs.CPU178.SCHED 106246 ± 5% +317.2% 443232 softirqs.CPU178.TIMER 6190 ± 5% +673.0% 47846 ± 4% softirqs.CPU179.RCU 6481 ± 4% +3290.4% 219730 softirqs.CPU179.SCHED 104903 ± 4% +323.6% 444347 softirqs.CPU179.TIMER 7103 ± 7% +591.0% 49084 ± 4% softirqs.CPU18.RCU 6451 ± 3% +3362.0% 223332 ± 2% softirqs.CPU18.SCHED 100928 ± 3% +321.4% 425321 softirqs.CPU18.TIMER 6697 ± 15% +609.8% 47538 ± 4% softirqs.CPU180.RCU 6677 ± 8% +3132.0% 215827 ± 2% softirqs.CPU180.SCHED 106667 ± 4% +315.5% 443202 softirqs.CPU180.TIMER 6316 ± 6% +657.5% 47852 ± 4% softirqs.CPU181.RCU 6414 ± 6% +3308.0% 218590 ± 2% softirqs.CPU181.SCHED 103954 ± 3% +325.1% 441947 softirqs.CPU181.TIMER 6204 ± 3% +664.2% 47415 ± 4% softirqs.CPU182.RCU 6373 ± 3% +3326.7% 218413 ± 2% softirqs.CPU182.SCHED 103886 ± 4% +326.2% 442806 softirqs.CPU182.TIMER 6535 ± 10% +629.4% 47670 ± 4% softirqs.CPU183.RCU 6582 ± 8% +3238.0% 219705 softirqs.CPU183.SCHED 105135 ± 3% +320.3% 441839 softirqs.CPU183.TIMER 6115 ± 4% +676.4% 47478 ± 4% softirqs.CPU184.RCU 6406 +3306.3% 218227 softirqs.CPU184.SCHED 104866 ± 4% +323.1% 443645 softirqs.CPU184.TIMER 6246 ± 4% +662.9% 47652 ± 4% softirqs.CPU185.RCU 6474 ± 3% +3296.9% 219926 softirqs.CPU185.SCHED 105087 ± 4% +322.8% 444308 softirqs.CPU185.TIMER 6323 ± 4% +656.1% 47810 ± 4% softirqs.CPU186.RCU 6518 ± 3% +3256.5% 218785 softirqs.CPU186.SCHED 105062 ± 4% +322.6% 443982 softirqs.CPU186.TIMER 6173 ± 4% +672.9% 47709 ± 5% softirqs.CPU187.RCU 6385 ± 4% +3321.6% 218468 softirqs.CPU187.SCHED 103774 ± 4% +325.4% 441429 softirqs.CPU187.TIMER 6030 ± 4% +692.4% 47786 ± 4% softirqs.CPU188.RCU 6371 ± 3% +3325.8% 218255 ± 2% softirqs.CPU188.SCHED 103813 ± 4% +325.8% 442046 softirqs.CPU188.TIMER 5979 ± 4% +693.3% 47439 ± 4% softirqs.CPU189.RCU 6288 ± 3% +3366.1% 217960 ± 3% softirqs.CPU189.SCHED 103626 ± 4% +326.7% 442132 softirqs.CPU189.TIMER 7324 ± 6% +558.1% 48203 ± 5% softirqs.CPU19.RCU 6636 ± 4% +3291.8% 225079 softirqs.CPU19.SCHED 100607 ± 3% +313.9% 416431 ± 3% softirqs.CPU19.TIMER 5976 ± 4% +697.9% 47686 ± 4% softirqs.CPU190.RCU 6261 ± 3% +3402.9% 219327 softirqs.CPU190.SCHED 103842 ± 4% +327.6% 444070 softirqs.CPU190.TIMER 6146 ± 4% +673.0% 47514 ± 4% softirqs.CPU191.RCU 6427 +3312.5% 219333 softirqs.CPU191.SCHED 104566 ± 4% +323.9% 443286 softirqs.CPU191.TIMER 7513 ± 6% +551.6% 48955 ± 3% softirqs.CPU2.RCU 6997 ± 4% +3125.1% 225665 softirqs.CPU2.SCHED 100560 ± 3% +320.3% 422698 softirqs.CPU2.TIMER 6802 ± 2% +623.7% 49229 ± 4% softirqs.CPU20.RCU 6472 ± 3% +3367.9% 224461 softirqs.CPU20.SCHED 103134 ± 6% +310.4% 423310 softirqs.CPU20.TIMER 7162 ± 7% +586.1% 49138 ± 3% softirqs.CPU21.RCU 6440 ± 4% +3369.2% 223417 ± 2% softirqs.CPU21.SCHED 101213 ± 2% +317.5% 422612 softirqs.CPU21.TIMER 7286 ± 4% +571.8% 48948 ± 3% softirqs.CPU22.RCU 6684 ± 7% +3260.0% 224604 softirqs.CPU22.SCHED 100987 ± 4% +320.3% 424462 softirqs.CPU22.TIMER 6954 ± 4% +603.3% 48912 ± 3% softirqs.CPU23.RCU 6462 ± 5% +3354.3% 223216 ± 2% softirqs.CPU23.SCHED 100810 ± 4% +321.5% 424953 softirqs.CPU23.TIMER 7270 ± 9% +592.0% 50314 ± 4% softirqs.CPU24.RCU 6476 ± 2% +3417.8% 227840 softirqs.CPU24.SCHED 106950 ± 21% +306.5% 434754 softirqs.CPU24.TIMER 6891 ± 3% +628.4% 50200 ± 4% softirqs.CPU25.RCU 6530 ± 2% +3391.6% 228029 softirqs.CPU25.SCHED 96906 ± 4% +346.6% 432807 softirqs.CPU25.TIMER 6890 ± 4% +625.4% 49982 ± 4% softirqs.CPU26.RCU 6399 ± 2% +3460.5% 227867 softirqs.CPU26.SCHED 96608 ± 4% +348.5% 433286 softirqs.CPU26.TIMER 6929 ± 3% +625.6% 50282 ± 4% softirqs.CPU27.RCU 6440 ± 2% +3441.9% 228117 softirqs.CPU27.SCHED 96717 ± 4% +348.1% 433422 softirqs.CPU27.TIMER 6884 ± 4% +630.6% 50302 ± 4% softirqs.CPU28.RCU 6347 ± 2% +3495.4% 228198 softirqs.CPU28.SCHED 97454 ± 4% +345.6% 434233 softirqs.CPU28.TIMER 6958 ± 6% +621.6% 50212 ± 4% softirqs.CPU29.RCU 6496 ± 4% +3410.9% 228070 softirqs.CPU29.SCHED 97721 ± 4% +343.9% 433820 softirqs.CPU29.TIMER 7137 ± 7% +588.8% 49162 ± 3% softirqs.CPU3.RCU 6657 ± 5% +3304.9% 226681 softirqs.CPU3.SCHED 100488 ± 3% +322.9% 424944 softirqs.CPU3.TIMER 6847 ± 3% +630.0% 49989 ± 4% softirqs.CPU30.RCU 6412 ± 2% +3449.7% 227609 softirqs.CPU30.SCHED 97587 ± 4% +344.8% 434070 softirqs.CPU30.TIMER 7010 ± 4% +616.4% 50222 ± 4% softirqs.CPU31.RCU 6319 ± 3% +3506.9% 227938 softirqs.CPU31.SCHED 96860 ± 3% +347.3% 433255 softirqs.CPU31.TIMER 7005 ± 2% +619.5% 50402 ± 3% softirqs.CPU32.RCU 6377 ± 3% +3470.0% 227690 softirqs.CPU32.SCHED 96190 ± 4% +349.5% 432398 softirqs.CPU32.TIMER 7066 ± 6% +616.9% 50658 ± 4% softirqs.CPU33.RCU 6323 ± 2% +3503.3% 227866 softirqs.CPU33.SCHED 96658 ± 4% +347.6% 432643 softirqs.CPU33.TIMER 6934 ± 3% +625.8% 50333 ± 4% softirqs.CPU34.RCU 6316 ± 3% +3507.4% 227871 softirqs.CPU34.SCHED 97157 ± 4% +347.2% 434447 softirqs.CPU34.TIMER 7171 ± 9% +604.6% 50523 ± 4% softirqs.CPU35.RCU 6351 ± 2% +3484.0% 227635 softirqs.CPU35.SCHED 97288 ± 4% +347.3% 435180 softirqs.CPU35.TIMER 7021 ± 2% +618.4% 50439 ± 4% softirqs.CPU36.RCU 6441 ± 3% +3433.2% 227600 softirqs.CPU36.SCHED 97848 ± 3% +345.1% 435527 softirqs.CPU36.TIMER 6969 ± 3% +616.3% 49918 ± 4% softirqs.CPU37.RCU 6372 ± 3% +3464.8% 227168 softirqs.CPU37.SCHED 96145 ± 4% +349.0% 431702 softirqs.CPU37.TIMER 7021 ± 3% +618.3% 50432 ± 4% softirqs.CPU38.RCU 6403 ± 3% +3451.2% 227405 softirqs.CPU38.SCHED 96764 ± 4% +347.3% 432870 softirqs.CPU38.TIMER 6935 ± 4% +627.5% 50450 ± 4% softirqs.CPU39.RCU 6332 ± 2% +3491.4% 227415 softirqs.CPU39.SCHED 96645 ± 4% +348.1% 433048 softirqs.CPU39.TIMER 9239 ± 26% +435.4% 49467 ± 4% softirqs.CPU4.RCU 6073 ± 12% +3608.0% 225199 ± 2% softirqs.CPU4.SCHED 101795 ± 4% +317.5% 425038 softirqs.CPU4.TIMER 7067 ± 3% +613.5% 50421 ± 4% softirqs.CPU40.RCU 6484 ± 5% +3399.9% 226964 softirqs.CPU40.SCHED 97475 ± 4% +345.0% 433783 softirqs.CPU40.TIMER 6943 ± 3% +630.3% 50703 ± 4% softirqs.CPU41.RCU 6318 ± 3% +3493.1% 227025 softirqs.CPU41.SCHED 97348 ± 4% +346.7% 434903 softirqs.CPU41.TIMER 7012 ± 3% +619.4% 50450 ± 4% softirqs.CPU42.RCU 6471 ± 4% +3408.7% 227050 softirqs.CPU42.SCHED 97799 ± 4% +344.5% 434718 softirqs.CPU42.TIMER 7057 ± 3% +621.1% 50893 ± 3% softirqs.CPU43.RCU 6453 ± 4% +3416.5% 226941 softirqs.CPU43.SCHED 96710 ± 4% +348.9% 434145 softirqs.CPU43.TIMER 7108 ± 6% +611.9% 50601 ± 4% softirqs.CPU44.RCU 6340 ± 2% +3479.8% 226985 softirqs.CPU44.SCHED 97384 ± 5% +344.9% 433227 softirqs.CPU44.TIMER 7071 ± 3% +614.1% 50501 ± 4% softirqs.CPU45.RCU 6417 ± 3% +3434.2% 226820 softirqs.CPU45.SCHED 97285 ± 4% +345.3% 433255 softirqs.CPU45.TIMER 6928 ± 3% +629.9% 50570 ± 4% softirqs.CPU46.RCU 6436 ± 3% +3426.5% 226971 softirqs.CPU46.SCHED 97727 ± 5% +344.3% 434199 softirqs.CPU46.TIMER 6920 ± 3% +626.8% 50293 ± 4% softirqs.CPU47.RCU 6398 ± 3% +3441.2% 226595 softirqs.CPU47.SCHED 97225 ± 4% +346.7% 434299 softirqs.CPU47.TIMER 7631 ± 7% +567.7% 50954 ± 4% softirqs.CPU48.RCU 6172 ± 4% +3593.2% 227964 softirqs.CPU48.SCHED 98008 ± 5% +346.1% 437224 softirqs.CPU48.TIMER 7061 ± 7% +617.0% 50632 ± 4% softirqs.CPU49.RCU 6351 ± 3% +3487.0% 227812 softirqs.CPU49.SCHED 97396 ± 4% +345.5% 433916 softirqs.CPU49.TIMER 7095 ± 3% +627.4% 51611 ± 6% softirqs.CPU5.RCU 6516 ± 3% +3370.0% 226133 softirqs.CPU5.SCHED 100991 ± 3% +323.9% 428138 softirqs.CPU5.TIMER 7063 ± 3% +614.9% 50491 ± 4% softirqs.CPU50.RCU 6374 ± 5% +3476.1% 227945 softirqs.CPU50.SCHED 96983 ± 4% +347.8% 434289 softirqs.CPU50.TIMER 7410 ± 6% +578.5% 50283 ± 4% softirqs.CPU51.RCU 6595 ± 7% +3357.5% 228022 softirqs.CPU51.SCHED 98244 ± 5% +342.9% 435162 softirqs.CPU51.TIMER 7538 ± 9% +565.3% 50148 ± 4% softirqs.CPU52.RCU 6455 +3434.5% 228162 softirqs.CPU52.SCHED 98820 ± 4% +341.3% 436055 softirqs.CPU52.TIMER 7028 ± 4% +619.2% 50546 ± 4% softirqs.CPU53.RCU 6530 ± 5% +3392.8% 228078 softirqs.CPU53.SCHED 97856 ± 5% +346.1% 436499 softirqs.CPU53.TIMER 6929 ± 3% +629.6% 50560 ± 3% softirqs.CPU54.RCU 6406 +3455.7% 227777 softirqs.CPU54.SCHED 97665 ± 4% +346.7% 436228 softirqs.CPU54.TIMER 7104 ± 6% +615.5% 50833 ± 4% softirqs.CPU55.RCU 6379 ± 5% +3464.6% 227383 softirqs.CPU55.SCHED 97278 ± 4% +346.7% 434568 softirqs.CPU55.TIMER 6955 ± 3% +627.2% 50585 ± 4% softirqs.CPU56.RCU 6370 ± 3% +3476.0% 227801 softirqs.CPU56.SCHED 96732 ± 4% +349.4% 434687 softirqs.CPU56.TIMER 6963 ± 3% +631.1% 50905 ± 3% softirqs.CPU57.RCU 6373 ± 4% +3473.0% 227721 softirqs.CPU57.SCHED 97705 ± 4% +347.7% 437407 softirqs.CPU57.TIMER 7079 ± 3% +617.2% 50774 ± 4% softirqs.CPU58.RCU 6424 ± 5% +3445.4% 227761 softirqs.CPU58.SCHED 97781 ± 4% +346.3% 436359 softirqs.CPU58.TIMER 7382 ± 7% +591.5% 51049 ± 3% softirqs.CPU59.RCU 6544 ± 7% +3376.5% 227507 softirqs.CPU59.SCHED 98262 ± 3% +344.8% 437045 softirqs.CPU59.TIMER 7175 ± 5% +584.1% 49086 ± 2% softirqs.CPU6.RCU 6472 ± 3% +3366.1% 224348 ± 2% softirqs.CPU6.SCHED 101051 ± 3% +321.3% 425698 softirqs.CPU6.TIMER 7315 ± 7% +592.3% 50647 ± 3% softirqs.CPU60.RCU 6485 ± 7% +3401.6% 227109 softirqs.CPU60.SCHED 97330 ± 4% +346.0% 434047 softirqs.CPU60.TIMER 7465 ± 12% +576.8% 50527 ± 3% softirqs.CPU61.RCU 6578 ± 9% +3361.6% 227709 softirqs.CPU61.SCHED 97428 ± 4% +344.7% 433258 softirqs.CPU61.TIMER 6926 ± 4% +630.8% 50620 ± 3% softirqs.CPU62.RCU 6312 ± 4% +3493.6% 226839 softirqs.CPU62.SCHED 96940 ± 4% +348.1% 434343 softirqs.CPU62.TIMER 7161 ± 11% +602.8% 50324 ± 3% softirqs.CPU63.RCU 6332 ± 3% +3485.5% 227047 softirqs.CPU63.SCHED 98226 ± 5% +343.4% 435530 softirqs.CPU63.TIMER 6726 ± 5% +652.4% 50607 ± 3% softirqs.CPU64.RCU 6255 ± 3% +3535.2% 227381 softirqs.CPU64.SCHED 97065 ± 4% +349.5% 436345 softirqs.CPU64.TIMER 6865 ± 5% +643.8% 51063 ± 3% softirqs.CPU65.RCU 6325 ± 2% +3494.9% 227409 softirqs.CPU65.SCHED 97492 ± 4% +348.0% 436734 softirqs.CPU65.TIMER 6885 ± 6% +628.1% 50132 ± 3% softirqs.CPU66.RCU 6329 ± 3% +3486.2% 226977 softirqs.CPU66.SCHED 97197 ± 3% +347.6% 435061 softirqs.CPU66.TIMER 6912 ± 5% +634.2% 50753 ± 3% softirqs.CPU67.RCU 6346 ± 3% +3477.9% 227054 softirqs.CPU67.SCHED 96784 ± 4% +349.2% 434753 softirqs.CPU67.TIMER 6798 ± 3% +640.3% 50328 ± 3% softirqs.CPU68.RCU 6381 ± 3% +3452.1% 226657 softirqs.CPU68.SCHED 97515 ± 4% +345.9% 434843 softirqs.CPU68.TIMER 7079 ± 13% +613.2% 50490 ± 3% softirqs.CPU69.RCU 6556 ± 8% +3363.1% 227045 softirqs.CPU69.SCHED 98310 ± 5% +342.2% 434742 softirqs.CPU69.TIMER 7294 ± 6% +548.8% 47325 softirqs.CPU7.RCU 6834 ± 5% +3201.7% 225645 softirqs.CPU7.SCHED 101337 ± 3% +310.5% 415989 softirqs.CPU7.TIMER 6805 ± 3% +645.4% 50724 ± 3% softirqs.CPU70.RCU 6320 ± 3% +3489.4% 226863 softirqs.CPU70.SCHED 97228 ± 4% +347.4% 435042 softirqs.CPU70.TIMER 6642 ± 4% +663.6% 50721 ± 3% softirqs.CPU71.RCU 6293 ± 4% +3495.2% 226251 softirqs.CPU71.SCHED 96904 ± 4% +349.2% 435261 softirqs.CPU71.TIMER 6460 ± 4% +637.1% 47617 ± 4% softirqs.CPU72.RCU 6351 +3381.0% 221097 ± 2% softirqs.CPU72.SCHED 104889 ± 4% +326.1% 446985 softirqs.CPU72.TIMER 6363 ± 3% +643.6% 47323 ± 4% softirqs.CPU73.RCU 6332 ± 2% +3426.3% 223309 softirqs.CPU73.SCHED 104771 ± 4% +323.9% 444113 softirqs.CPU73.TIMER 6428 ± 3% +636.7% 47361 ± 4% softirqs.CPU74.RCU 6336 ± 2% +3417.4% 222890 softirqs.CPU74.SCHED 104563 ± 4% +324.8% 444230 softirqs.CPU74.TIMER 6436 ± 4% +642.9% 47817 ± 4% softirqs.CPU75.RCU 6296 ± 3% +3382.8% 219297 ± 2% softirqs.CPU75.SCHED 104371 ± 4% +325.7% 444327 softirqs.CPU75.TIMER 6386 ± 4% +647.1% 47714 ± 4% softirqs.CPU76.RCU 6392 +3372.9% 222003 softirqs.CPU76.SCHED 105471 ± 4% +322.4% 445519 softirqs.CPU76.TIMER 6428 ± 5% +644.6% 47865 ± 3% softirqs.CPU77.RCU 6425 ± 3% +3371.4% 223048 softirqs.CPU77.SCHED 114990 ± 14% +287.5% 445598 softirqs.CPU77.TIMER 6440 ± 4% +639.6% 47629 ± 4% softirqs.CPU78.RCU 6322 ± 4% +3396.2% 221042 ± 2% softirqs.CPU78.SCHED 105452 ± 4% +322.7% 445722 softirqs.CPU78.TIMER 6359 ± 4% +646.0% 47440 ± 4% softirqs.CPU79.RCU 6368 ± 5% +3381.2% 221696 ± 2% softirqs.CPU79.SCHED 104396 ± 4% +324.5% 443166 softirqs.CPU79.TIMER 7293 ± 3% +569.7% 48844 ± 3% softirqs.CPU8.RCU 6686 +3275.1% 225685 softirqs.CPU8.SCHED 100384 ± 3% +321.2% 422864 softirqs.CPU8.TIMER 6579 ± 4% +630.3% 48054 ± 5% softirqs.CPU80.RCU 6396 ± 3% +3348.0% 220562 ± 2% softirqs.CPU80.SCHED 104171 ± 4% +325.9% 443637 softirqs.CPU80.TIMER 6662 ± 4% +631.1% 48712 ± 4% softirqs.CPU81.RCU 6352 ± 4% +3387.5% 221531 softirqs.CPU81.SCHED 104312 ± 4% +326.0% 444323 softirqs.CPU81.TIMER 6691 ± 4% +635.3% 49203 ± 4% softirqs.CPU82.RCU 6369 ± 2% +3387.2% 222101 softirqs.CPU82.SCHED 105396 ± 4% +323.0% 445831 softirqs.CPU82.TIMER 6753 ± 3% +620.7% 48672 ± 4% softirqs.CPU83.RCU 6489 ± 3% +3337.1% 223055 softirqs.CPU83.SCHED 105729 ± 4% +321.4% 445580 softirqs.CPU83.TIMER 7256 ± 9% +575.1% 48989 ± 5% softirqs.CPU84.RCU 6495 ± 4% +3326.3% 222544 softirqs.CPU84.SCHED 105878 ± 3% +321.4% 446213 softirqs.CPU84.TIMER 6793 ± 4% +610.5% 48266 ± 4% softirqs.CPU85.RCU 6540 ± 5% +3259.7% 219748 ± 2% softirqs.CPU85.SCHED 104868 ± 3% +323.8% 444401 softirqs.CPU85.TIMER 6688 ± 2% +620.2% 48171 ± 4% softirqs.CPU86.RCU 6498 ± 3% +3317.5% 222095 softirqs.CPU86.SCHED 104923 ± 4% +324.1% 444990 softirqs.CPU86.TIMER 6659 ± 3% +626.0% 48352 ± 4% softirqs.CPU87.RCU 6446 ± 3% +3303.3% 219391 ± 2% softirqs.CPU87.SCHED 105520 ± 4% +320.2% 443394 softirqs.CPU87.TIMER 6825 ± 4% +615.1% 48807 ± 4% softirqs.CPU88.RCU 6465 ± 3% +3329.8% 221762 ± 2% softirqs.CPU88.SCHED 105637 ± 4% +323.3% 447206 softirqs.CPU88.TIMER 6859 ± 3% +616.4% 49144 ± 4% softirqs.CPU89.RCU 6487 ± 3% +3307.8% 221080 ± 2% softirqs.CPU89.SCHED 105862 ± 4% +322.1% 446884 softirqs.CPU89.TIMER 7315 ± 3% +564.8% 48630 ± 3% softirqs.CPU9.RCU 6685 ± 3% +3272.1% 225430 softirqs.CPU9.SCHED 100197 ± 3% +322.2% 423026 softirqs.CPU9.TIMER 6876 ± 3% +609.2% 48769 ± 5% softirqs.CPU90.RCU 6688 ± 7% +3210.0% 221385 ± 2% softirqs.CPU90.SCHED 105933 ± 4% +321.2% 446184 softirqs.CPU90.TIMER 6784 ± 3% +605.6% 47873 ± 4% softirqs.CPU91.RCU 6522 ± 3% +3277.9% 220329 softirqs.CPU91.SCHED 105335 ± 4% +320.9% 443395 softirqs.CPU91.TIMER 6664 ± 2% +628.9% 48571 ± 4% softirqs.CPU92.RCU 6491 ± 3% +3313.0% 221537 softirqs.CPU92.SCHED 104859 ± 4% +323.9% 444549 softirqs.CPU92.TIMER 6604 ± 4% +636.0% 48611 ± 4% softirqs.CPU93.RCU 6342 ± 2% +3377.7% 220552 ± 2% softirqs.CPU93.SCHED 104615 ± 4% +325.4% 445058 softirqs.CPU93.TIMER 6848 ± 3% +621.1% 49385 ± 6% softirqs.CPU94.RCU 6498 ± 2% +3285.4% 220008 ± 2% softirqs.CPU94.SCHED 105514 ± 4% +324.6% 448032 softirqs.CPU94.TIMER 6771 ± 3% +623.7% 49004 ± 5% softirqs.CPU95.RCU 6479 ± 3% +3296.6% 220064 ± 3% softirqs.CPU95.SCHED 105599 ± 4% +322.4% 446056 softirqs.CPU95.TIMER 6504 ± 7% +636.1% 47882 ± 2% softirqs.CPU96.RCU 6474 ± 6% +3302.3% 220281 ± 2% softirqs.CPU96.SCHED 100614 ± 4% +316.0% 418582 softirqs.CPU96.TIMER 6817 ± 7% +603.7% 47976 ± 3% softirqs.CPU97.RCU 6566 ± 4% +3272.2% 221420 ± 3% softirqs.CPU97.SCHED 99626 ± 3% +422.2% 520279 ± 26% softirqs.CPU97.TIMER 6749 ± 7% +614.6% 48233 ± 3% softirqs.CPU98.RCU 6537 ± 5% +3313.4% 223164 softirqs.CPU98.SCHED 99274 ± 3% +324.3% 421202 softirqs.CPU98.TIMER 6844 ± 5% +609.4% 48552 ± 2% softirqs.CPU99.RCU 6574 ± 4% +3281.6% 222311 softirqs.CPU99.SCHED 99999 ± 3% +322.3% 422260 softirqs.CPU99.TIMER 1295575 ± 3% +629.9% 9456430 ± 4% softirqs.RCU 1246793 ± 2% +3348.4% 42994311 softirqs.SCHED 19212474 ± 3% +334.8% 83543543 softirqs.TIMER 98.65 -95.6 3.01 ± 2% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 98.72 -95.6 3.08 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.70 -95.6 3.07 ± 2% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.60 -95.6 2.97 ± 2% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write 98.66 -95.6 3.02 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 98.74 -95.6 3.12 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 98.73 -95.6 3.11 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 98.76 -95.6 3.16 ± 2% perf-profile.calltrace.cycles-pp.write 35.16 -35.2 0.00 perf-profile.calltrace.cycles-pp.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 35.15 -35.2 0.00 perf-profile.calltrace.cycles-pp.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 35.13 -35.1 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write.btrfs_file_write_iter 35.04 -35.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_buffered_write 35.08 -34.1 1.00 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write 35.16 -34.1 1.09 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter 35.36 -34.0 1.37 ± 6% perf-profile.calltrace.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 35.47 -34.0 1.49 ± 5% perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 27.40 -27.4 0.00 perf-profile.calltrace.cycles-pp.btrfs_dirty_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write 26.71 -26.7 0.00 perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.btrfs_dirty_pages.btrfs_buffered_write.btrfs_file_write_iter 26.71 -26.7 0.00 perf-profile.calltrace.cycles-pp.clear_extent_bit.btrfs_dirty_pages.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write 26.69 -26.7 0.00 perf-profile.calltrace.cycles-pp.clear_state_bit.__clear_extent_bit.clear_extent_bit.btrfs_dirty_pages.btrfs_buffered_write 26.67 -26.7 0.00 perf-profile.calltrace.cycles-pp.btrfs_clear_delalloc_extent.clear_state_bit.__clear_extent_bit.clear_extent_bit.btrfs_dirty_pages 26.56 -26.6 0.00 perf-profile.calltrace.cycles-pp.btrfs_inode_rsv_release.btrfs_clear_delalloc_extent.clear_state_bit.__clear_extent_bit.clear_extent_bit 26.56 -26.6 0.00 perf-profile.calltrace.cycles-pp.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_clear_delalloc_extent.clear_state_bit.__clear_extent_bit 26.54 -26.5 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_clear_delalloc_extent.clear_state_bit 26.48 -26.5 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__btrfs_block_rsv_release.btrfs_inode_rsv_release.btrfs_clear_delalloc_extent 0.00 +0.6 0.58 ± 6% perf-profile.calltrace.cycles-pp.cow_file_range.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages 0.00 +0.6 0.60 ± 6% perf-profile.calltrace.cycles-pp.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages 0.00 +0.6 0.62 ± 18% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb 0.00 +0.7 0.65 ± 14% perf-profile.calltrace.cycles-pp.ktime_get.tick_nohz_irq_exit.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt 0.00 +0.7 0.66 ± 14% perf-profile.calltrace.cycles-pp.tick_nohz_irq_exit.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.00 +0.7 0.68 ± 8% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 0.00 +0.7 0.70 ± 21% perf-profile.calltrace.cycles-pp.__btrfs_free_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space 0.00 +0.7 0.70 ± 6% perf-profile.calltrace.cycles-pp.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages 0.00 +0.7 0.70 ± 23% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 0.00 +0.7 0.71 perf-profile.calltrace.cycles-pp.brd_make_request.generic_make_request.submit_bio.run_scheduled_bios.normal_work_helper 0.00 +0.7 0.71 ± 7% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task 0.00 +0.7 0.72 ± 18% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages 0.00 +0.7 0.72 ± 18% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages 0.00 +0.7 0.73 ± 18% perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range 0.00 +0.7 0.74 ± 7% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.btrfs_unlock_up_safe 0.00 +0.8 0.76 ± 2% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.run_scheduled_bios.normal_work_helper.process_one_work 0.00 +0.8 0.76 ± 29% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.alloc_reserved_file_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space 0.00 +0.8 0.77 ± 2% perf-profile.calltrace.cycles-pp.submit_bio.run_scheduled_bios.normal_work_helper.process_one_work.worker_thread 0.00 +0.8 0.77 ± 7% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.btrfs_unlock_up_safe.setup_items_for_insert 0.00 +0.8 0.78 ± 25% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.btrfs_unlock_up_safe.setup_items_for_insert 0.00 +0.8 0.78 ± 25% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.btrfs_unlock_up_safe.setup_items_for_insert.__btrfs_drop_extents 0.00 +0.8 0.79 ± 18% perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents 0.00 +0.8 0.79 ± 27% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space 0.00 +0.8 0.79 ± 23% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.00 +0.8 0.79 ± 27% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work 0.00 +0.8 0.80 ± 27% perf-profile.calltrace.cycles-pp.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_csum_file_blocks.add_pending_csums 0.00 +0.8 0.80 ± 27% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io 0.00 +0.8 0.82 ± 2% perf-profile.calltrace.cycles-pp.run_scheduled_bios.normal_work_helper.process_one_work.worker_thread.kthread 0.00 +0.8 0.82 ± 14% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle 0.00 +0.8 0.83 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.btrfs_unlock_up_safe.setup_items_for_insert.__btrfs_drop_extents 0.00 +0.8 0.84 ± 27% perf-profile.calltrace.cycles-pp.alloc_reserved_file_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.priority_reclaim_metadata_space 0.00 +0.9 0.86 ± 5% perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode 0.00 +0.9 0.88 ± 22% perf-profile.calltrace.cycles-pp.irq_enter.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +0.9 0.90 ± 10% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_items.flush_space.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill 0.00 +0.9 0.91 ± 34% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_insert_empty_items.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io 0.00 +0.9 0.94 ± 2% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_insert_empty_items.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 0.00 +0.9 0.94 ± 7% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.00 +1.0 0.96 ± 2% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work 0.00 +1.0 0.98 ± 34% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks 0.00 +1.0 0.99 ± 5% perf-profile.calltrace.cycles-pp.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes 0.00 +1.0 1.00 ± 33% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums 0.00 +1.0 1.00 ± 30% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.normal_work_helper 0.00 +1.0 1.03 ± 25% perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.flush_space.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill 0.00 +1.1 1.11 ± 14% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_inode 0.00 +1.2 1.16 ± 17% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.btrfs_tree_lock.btrfs_lock_root_node 0.00 +1.2 1.16 ± 19% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 0.00 +1.2 1.17 ± 16% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread 0.00 +1.2 1.17 ± 16% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work 0.00 +1.2 1.18 ± 16% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot 0.00 +1.2 1.20 ± 26% perf-profile.calltrace.cycles-pp.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work 0.00 +1.2 1.20 ± 26% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space 0.00 +1.2 1.20 ± 7% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending 0.00 +1.2 1.20 ± 16% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +1.2 1.21 ± 5% perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback 0.00 +1.2 1.21 ± 19% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt 0.00 +1.2 1.21 ± 5% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn 0.00 +1.2 1.22 ± 6% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work 0.00 +1.2 1.25 ± 28% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io 0.00 +1.3 1.25 ± 27% perf-profile.calltrace.cycles-pp.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.normal_work_helper 0.00 +1.3 1.26 ± 7% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle 0.00 +1.3 1.26 ± 6% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work.worker_thread 0.00 +1.3 1.27 ± 7% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary 0.00 +1.3 1.27 ± 7% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry 0.00 +1.3 1.28 ± 6% perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread 0.00 +1.3 1.29 ± 6% perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +1.3 1.33 ± 8% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 0.00 +1.4 1.38 ± 41% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction 0.00 +1.4 1.38 ± 41% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction 0.00 +1.4 1.38 ± 41% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space 0.00 +1.4 1.43 ± 6% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.00 +1.5 1.47 ± 39% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_del_csums.__btrfs_free_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs 0.00 +1.5 1.48 ± 25% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.normal_work_helper 0.00 +1.6 1.57 ± 5% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +1.6 1.62 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.btrfs_unlock_up_safe.setup_items_for_insert.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +1.7 1.65 ± 9% perf-profile.calltrace.cycles-pp.btrfs_unlock_up_safe.setup_items_for_insert.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io 0.00 +1.7 1.66 ± 11% perf-profile.calltrace.cycles-pp.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +1.7 1.68 ± 16% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 0.00 +1.8 1.78 ± 15% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_inode 0.00 +1.8 1.80 ± 9% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.00 +1.9 1.87 ± 9% perf-profile.calltrace.cycles-pp.setup_items_for_insert.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 0.00 +1.9 1.89 ± 12% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry 0.00 +1.9 1.95 ± 24% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +2.2 2.19 ± 11% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.00 +2.3 2.31 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node 0.00 +2.3 2.32 ± 9% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +2.3 2.32 ± 45% perf-profile.calltrace.cycles-pp.btrfs_del_csums.__btrfs_free_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space 0.00 +2.4 2.36 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot 0.00 +2.4 2.37 ± 24% perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread 0.00 +2.5 2.47 ± 14% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +2.6 2.58 ± 18% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 0.00 +2.7 2.69 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node 0.00 +2.7 2.72 ± 12% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot 0.00 +3.0 3.05 ± 33% perf-profile.calltrace.cycles-pp.__btrfs_free_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.priority_reclaim_metadata_space 0.00 +3.2 3.23 ± 13% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_inode.__btrfs_update_delayed_inode 0.00 +3.3 3.26 ± 13% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_inode.__btrfs_update_delayed_inode.btrfs_async_run_delayed_root 0.00 +3.5 3.47 ± 10% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +3.5 3.47 ± 12% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_inode.__btrfs_update_delayed_inode.btrfs_async_run_delayed_root.normal_work_helper 0.00 +3.5 3.47 ± 12% perf-profile.calltrace.cycles-pp.btrfs_lookup_inode.__btrfs_update_delayed_inode.btrfs_async_run_delayed_root.normal_work_helper.process_one_work 0.00 +3.5 3.52 ± 5% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +3.7 3.74 ± 10% perf-profile.calltrace.cycles-pp.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread 0.00 +3.8 3.83 ± 9% perf-profile.calltrace.cycles-pp.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +3.9 3.86 ± 10% perf-profile.calltrace.cycles-pp.__btrfs_update_delayed_inode.btrfs_async_run_delayed_root.normal_work_helper.process_one_work.worker_thread 0.00 +4.2 4.21 ± 10% perf-profile.calltrace.cycles-pp.btrfs_async_run_delayed_root.normal_work_helper.process_one_work.worker_thread.kthread 0.00 +4.2 4.21 ± 24% perf-profile.calltrace.cycles-pp.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.normal_work_helper.process_one_work 0.00 +4.2 4.22 ± 24% perf-profile.calltrace.cycles-pp.add_pending_csums.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread 0.00 +4.4 4.37 ± 14% perf-profile.calltrace.cycles-pp.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 0.00 +4.4 4.38 ± 14% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +4.8 4.84 ± 28% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.flush_space.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill 0.00 +4.8 4.84 ± 28% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes 0.00 +5.1 5.07 ± 15% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +5.2 5.22 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node 0.00 +5.3 5.31 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot 0.00 +5.8 5.77 ± 5% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 0.00 +5.8 5.79 ± 5% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +6.8 6.80 ± 17% perf-profile.calltrace.cycles-pp.flush_space.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill.evict_refill_and_join 0.00 +7.1 7.09 ± 18% perf-profile.calltrace.cycles-pp.priority_reclaim_metadata_space.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill.evict_refill_and_join.btrfs_evict_inode 0.00 +7.2 7.18 ± 18% perf-profile.calltrace.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_block_rsv_refill.evict_refill_and_join.btrfs_evict_inode.evict 0.00 +7.2 7.18 ± 18% perf-profile.calltrace.cycles-pp.btrfs_block_rsv_refill.evict_refill_and_join.btrfs_evict_inode.evict.__dentry_kill 0.00 +7.2 7.19 ± 18% perf-profile.calltrace.cycles-pp.evict_refill_and_join.btrfs_evict_inode.evict.__dentry_kill.dput 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run 0.00 +7.4 7.43 ± 18% perf-profile.calltrace.cycles-pp.btrfs_evict_inode.evict.__dentry_kill.dput.__fput 0.00 +7.5 7.47 ± 18% perf-profile.calltrace.cycles-pp.close 0.00 +8.4 8.40 ± 13% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 0.00 +9.8 9.78 ± 13% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +10.9 10.92 ± 8% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io 0.00 +10.9 10.92 ± 8% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 0.00 +13.4 13.43 ± 6% perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work 0.00 +14.6 14.65 ± 5% perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread 0.00 +19.6 19.62 ± 7% perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread.kthread 0.00 +25.0 24.98 ± 7% perf-profile.calltrace.cycles-pp.normal_work_helper.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +30.3 30.29 ± 5% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +30.6 30.56 ± 5% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +30.6 30.58 ± 5% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +30.6 30.58 ± 5% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 0.00 +38.7 38.68 ± 6% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 0.00 +50.1 50.13 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 0.00 +50.8 50.83 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +57.7 57.68 ± 4% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +57.7 57.70 ± 4% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 0.00 +57.7 57.71 ± 4% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 0.00 +58.0 58.03 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64 98.65 -95.6 3.01 ± 2% perf-profile.children.cycles-pp.btrfs_file_write_iter 98.67 -95.6 3.03 ± 2% perf-profile.children.cycles-pp.new_sync_write 98.73 -95.6 3.09 ± 2% perf-profile.children.cycles-pp.ksys_write 98.60 -95.6 2.97 ± 2% perf-profile.children.cycles-pp.btrfs_buffered_write 98.71 -95.6 3.08 ± 2% perf-profile.children.cycles-pp.vfs_write 98.77 -95.6 3.18 ± 2% perf-profile.children.cycles-pp.write 97.56 -93.5 4.03 ± 5% perf-profile.children.cycles-pp._raw_spin_lock 99.72 -89.0 10.71 ± 12% perf-profile.children.cycles-pp.do_syscall_64 99.72 -89.0 10.71 ± 12% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 97.49 -76.2 21.31 ± 15% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 61.76 -61.6 0.18 ± 16% perf-profile.children.cycles-pp.btrfs_inode_rsv_release 62.00 -60.7 1.29 ± 3% perf-profile.children.cycles-pp.__btrfs_block_rsv_release 35.47 -34.0 1.50 ± 5% perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata 27.40 -26.9 0.46 ± 3% perf-profile.children.cycles-pp.btrfs_dirty_pages 35.50 -26.9 8.64 ± 16% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes 26.72 -26.7 0.02 ±141% perf-profile.children.cycles-pp.btrfs_clear_delalloc_extent 26.74 -26.7 0.09 ± 9% perf-profile.children.cycles-pp.clear_extent_bit 26.75 -26.6 0.13 ± 3% perf-profile.children.cycles-pp.clear_state_bit 26.80 -26.6 0.23 ± 4% perf-profile.children.cycles-pp.__clear_extent_bit 0.58 ± 10% -0.4 0.13 ± 3% perf-profile.children.cycles-pp.btrfs_get_extent 0.14 ± 3% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.can_overcommit 0.14 ± 18% -0.1 0.05 perf-profile.children.cycles-pp.update_cfs_group 0.14 ± 3% -0.1 0.08 ± 14% perf-profile.children.cycles-pp.__btrfs_end_transaction 0.10 -0.0 0.09 ± 5% perf-profile.children.cycles-pp.extent_read_full_page 0.08 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.__do_readpage 0.05 +0.0 0.08 ± 10% perf-profile.children.cycles-pp.lock_and_cleanup_extent_if_need 0.07 ± 7% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.alloc_extent_state 0.00 +0.1 0.05 perf-profile.children.cycles-pp.insert_state 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.mark_extent_buffer_accessed 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.btrfs_write_out_cache 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__btrfs_write_out_cache 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.rcu_irq_exit 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.igrab 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.select_idle_sibling 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.available_idle_cpu 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.run_one_async_start 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.btrfs_submit_bio_start 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.btrfs_csum_one_bio 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.__btrfs_map_block 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.free_extent_map 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.find_delalloc_range 0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.tick_nohz_tick_stopped 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.create_io_em 0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.alloc_extent_buffer 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.account_page_dirtied 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.verify_parent_transid 0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.__push_leaf_right 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.update_cfs_rq_h_load 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.btrfs_set_range_writeback 0.04 ± 50% +0.1 0.11 ± 11% perf-profile.children.cycles-pp.btrfs_set_extent_delalloc 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.rcu_irq_enter 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.btrfs_next_delayed_node 0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.trigger_load_balance 0.00 +0.1 0.07 ± 44% perf-profile.children.cycles-pp.io_serial_in 0.00 +0.1 0.07 ± 35% perf-profile.children.cycles-pp.btrfs_add_delayed_tree_ref 0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.ksys_read 0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.vfs_read 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.menu_reflect 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.mutex_unlock 0.00 +0.1 0.08 ± 16% perf-profile.children.cycles-pp.xas_load 0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.copy_pages 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.__mark_inode_dirty 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.btrfs_buffer_uptodate 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.call_cpuidle 0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.btrfs_comp_cpu_keys 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.__test_set_page_writeback 0.00 +0.1 0.08 perf-profile.children.cycles-pp.__update_load_avg_se 0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.timerqueue_del 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.cpuacct_charge 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.find_get_entry 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.merge_state 0.00 +0.1 0.08 ± 5% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.btrfs_delayed_refs_rsv_refill 0.20 +0.1 0.29 perf-profile.children.cycles-pp.prepare_pages 0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.interrupt_entry 0.00 +0.1 0.09 ± 10% perf-profile.children.cycles-pp.find_lock_delalloc_range 0.00 +0.1 0.09 ± 10% perf-profile.children.cycles-pp.btrfs_add_ordered_extent 0.00 +0.1 0.09 ± 10% perf-profile.children.cycles-pp.__btrfs_add_ordered_extent 0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.rb_next 0.00 +0.1 0.09 ± 18% perf-profile.children.cycles-pp.check_preempt_curr 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.extent_clear_unlock_delalloc 0.00 +0.1 0.09 ± 9% perf-profile.children.cycles-pp.btrfs_leaf_free_space 0.00 +0.1 0.09 ± 43% perf-profile.children.cycles-pp.irq_work_interrupt 0.00 +0.1 0.09 ± 43% perf-profile.children.cycles-pp.smp_irq_work_interrupt 0.00 +0.1 0.09 ± 43% perf-profile.children.cycles-pp.irq_work_run 0.00 +0.1 0.09 ± 43% perf-profile.children.cycles-pp.printk 0.00 +0.1 0.09 ± 43% perf-profile.children.cycles-pp.vprintk_emit 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.idle_cpu 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.get_extent_allocation_hint 0.00 +0.1 0.09 ± 10% perf-profile.children.cycles-pp.leaf_space_used 0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.btrfs_set_delalloc_extent 0.05 ± 7% +0.1 0.15 ± 3% perf-profile.children.cycles-pp.lock_extent_bits 0.00 +0.1 0.10 ± 9% perf-profile.children.cycles-pp.btrfs_tree_read_unlock 0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.btrfs_tree_unlock 0.09 ± 5% +0.1 0.19 ± 4% perf-profile.children.cycles-pp.pagecache_get_page 0.00 +0.1 0.10 ± 42% perf-profile.children.cycles-pp.uart_console_write 0.00 +0.1 0.10 ± 42% perf-profile.children.cycles-pp.wait_for_xmitr 0.00 +0.1 0.10 ± 42% perf-profile.children.cycles-pp.serial8250_console_putchar 0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.__remove_hrtimer 0.00 +0.1 0.10 perf-profile.children.cycles-pp.block_group_cache_tree_search 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.unpin_extent_cache 0.00 +0.1 0.10 ± 16% perf-profile.children.cycles-pp.newidle_balance 0.00 +0.1 0.10 ± 45% perf-profile.children.cycles-pp.serial8250_console_write 0.00 +0.1 0.10 ± 19% perf-profile.children.cycles-pp.rb_insert_color 0.00 +0.1 0.10 ± 4% perf-profile.children.cycles-pp.rcu_eqs_enter 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.__slab_free 0.00 +0.1 0.11 ± 42% perf-profile.children.cycles-pp.console_unlock 0.00 +0.1 0.11 ± 38% perf-profile.children.cycles-pp.timerqueue_add 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.find_ref_head 0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.set_extent_buffer_dirty 0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.btrfs_drop_extent_cache 0.00 +0.1 0.11 ± 12% perf-profile.children.cycles-pp.__radix_tree_lookup 0.00 +0.1 0.11 ± 14% perf-profile.children.cycles-pp.push_leaf_right 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.truncate_one_csum 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.set_state_bits 0.00 +0.1 0.12 ± 17% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.00 +0.1 0.12 ± 4% perf-profile.children.cycles-pp.__module_text_address 0.00 +0.1 0.12 ± 44% perf-profile.children.cycles-pp.irq_work_run_list 0.00 +0.1 0.12 ± 24% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.rb_erase 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.mutex_lock 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit 0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.btrfs_delete_ref_head 0.00 +0.1 0.12 ± 36% perf-profile.children.cycles-pp.enqueue_hrtimer 0.00 +0.1 0.12 ± 3% perf-profile.children.cycles-pp.btrfs_select_ref_head 0.00 +0.1 0.13 ± 9% perf-profile.children.cycles-pp.rcu_eqs_exit 0.00 +0.1 0.13 ± 3% perf-profile.children.cycles-pp.__extent_writepage_io 0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.end_page_writeback 0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.test_clear_page_writeback 0.00 +0.1 0.13 perf-profile.children.cycles-pp.__unwind_start 0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.is_module_text_address 0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.btrfs_start_dirty_block_groups 0.00 +0.1 0.13 ± 3% perf-profile.children.cycles-pp.__switch_to 0.00 +0.1 0.14 ± 12% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.00 +0.1 0.14 ± 17% perf-profile.children.cycles-pp.note_gp_changes 0.00 +0.1 0.14 ± 5% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty 0.06 ± 6% +0.1 0.20 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 0.00 +0.1 0.14 ± 6% perf-profile.children.cycles-pp.__switch_to_asm 0.00 +0.1 0.15 ± 25% perf-profile.children.cycles-pp.calc_global_load_tick 0.00 +0.1 0.15 ± 3% perf-profile.children.cycles-pp.set_next_entity 0.00 +0.1 0.15 ± 6% perf-profile.children.cycles-pp.___might_sleep 0.00 +0.1 0.15 ± 3% perf-profile.children.cycles-pp.__etree_search 0.00 +0.1 0.15 ± 14% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.00 +0.1 0.15 ± 14% perf-profile.children.cycles-pp.split_leaf 0.00 +0.2 0.15 ± 5% perf-profile.children.cycles-pp.btrfs_delayed_update_inode 0.26 ± 12% +0.2 0.41 ± 13% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.2 0.15 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.2 0.16 ± 28% perf-profile.children.cycles-pp.run_timer_softirq 0.00 +0.2 0.16 ± 7% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.00 +0.2 0.16 ± 20% perf-profile.children.cycles-pp.read_extent_buffer 0.00 +0.2 0.16 ± 8% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.2 0.16 ± 10% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.00 +0.2 0.16 ± 11% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.00 +0.2 0.17 ± 9% perf-profile.children.cycles-pp.update_curr 0.00 +0.2 0.17 ± 4% perf-profile.children.cycles-pp.kmem_cache_free 0.00 +0.2 0.17 ± 4% perf-profile.children.cycles-pp.btrfs_update_inode_fallback 0.00 +0.2 0.17 ± 4% perf-profile.children.cycles-pp.btrfs_update_inode 0.00 +0.2 0.17 ± 7% perf-profile.children.cycles-pp.find_next_zero_bit 0.00 +0.2 0.17 ± 10% perf-profile.children.cycles-pp.btrfs_free_extent 0.00 +0.2 0.18 ± 2% perf-profile.children.cycles-pp._raw_write_lock 0.00 +0.2 0.18 ± 7% perf-profile.children.cycles-pp.run_one_async_done 0.00 +0.2 0.18 ± 19% perf-profile.children.cycles-pp.btrfs_remove_ordered_extent 0.00 +0.2 0.18 ± 6% perf-profile.children.cycles-pp.nr_iowait_cpu 0.00 +0.2 0.18 ± 5% perf-profile.children.cycles-pp.btrfs_alloc_reserved_file_extent 0.00 +0.2 0.19 ± 11% perf-profile.children.cycles-pp.update_ts_time_stats 0.00 +0.2 0.19 ± 24% perf-profile.children.cycles-pp.btrfs_get_8 0.00 +0.2 0.19 ± 2% perf-profile.children.cycles-pp.kernel_text_address 0.00 +0.2 0.19 ± 10% perf-profile.children.cycles-pp.btrfs_root_node 0.00 +0.2 0.19 ± 4% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers 0.00 +0.2 0.19 ± 18% perf-profile.children.cycles-pp.btrfs_truncate_inode_items 0.00 +0.2 0.19 ± 6% perf-profile.children.cycles-pp.find_free_extent 0.00 +0.2 0.20 ± 2% perf-profile.children.cycles-pp.__module_address 0.00 +0.2 0.20 perf-profile.children.cycles-pp.__kernel_text_address 0.07 +0.2 0.28 ± 7% perf-profile.children.cycles-pp.set_extent_bit 0.00 +0.2 0.21 ± 9% perf-profile.children.cycles-pp.rcu_idle_exit 0.00 +0.2 0.21 ± 11% perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.2 0.21 ± 3% perf-profile.children.cycles-pp.memcpy_extent_buffer 0.00 +0.2 0.21 ± 6% perf-profile.children.cycles-pp.btrfs_reserve_extent 0.00 +0.2 0.21 ± 8% perf-profile.children.cycles-pp.btrfs_wq_submit_bio 0.00 +0.2 0.22 ± 9% perf-profile.children.cycles-pp.add_delayed_ref_head 0.00 +0.2 0.22 ± 13% perf-profile.children.cycles-pp.update_sd_lb_stats 0.00 +0.2 0.22 ± 2% perf-profile.children.cycles-pp.unwind_get_return_address 0.00 +0.2 0.22 ± 28% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.00 +0.2 0.22 ± 21% perf-profile.children.cycles-pp.alloc_tree_block_no_bg_flush 0.00 +0.2 0.22 ± 21% perf-profile.children.cycles-pp.btrfs_alloc_tree_block 0.00 +0.2 0.22 ± 8% perf-profile.children.cycles-pp.btrfs_submit_bio_hook 0.00 +0.2 0.22 ± 11% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.00 +0.2 0.23 ± 29% perf-profile.children.cycles-pp.copy_extent_buffer_full 0.00 +0.2 0.23 ± 10% perf-profile.children.cycles-pp.free_extent_buffer 0.00 +0.2 0.23 ± 27% perf-profile.children.cycles-pp.copy_page 0.00 +0.2 0.23 ± 12% perf-profile.children.cycles-pp.find_busiest_group 0.00 +0.2 0.24 ± 15% perf-profile.children.cycles-pp._raw_read_lock 0.00 +0.2 0.25 ± 14% perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.3 0.25 ± 15% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.00 +0.3 0.25 ± 9% perf-profile.children.cycles-pp.__list_add_valid 0.00 +0.3 0.26 ± 8% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.00 +0.3 0.26 ± 13% perf-profile.children.cycles-pp.run_local_timers 0.00 +0.3 0.26 ± 12% perf-profile.children.cycles-pp.steal_from_bitmap 0.00 +0.3 0.27 ± 4% perf-profile.children.cycles-pp.end_extent_writepage 0.00 +0.3 0.27 ± 4% perf-profile.children.cycles-pp.btrfs_writepage_endio_finish_ordered 0.00 +0.3 0.27 ± 7% perf-profile.children.cycles-pp.btrfs_truncate_item 0.00 +0.3 0.27 ± 12% perf-profile.children.cycles-pp.__btrfs_add_free_space 0.00 +0.3 0.28 ± 4% perf-profile.children.cycles-pp.dequeue_entity 0.00 +0.3 0.28 ± 5% perf-profile.children.cycles-pp.select_task_rq_fair 0.07 ± 10% +0.3 0.35 ± 21% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.00 +0.3 0.29 ± 13% perf-profile.children.cycles-pp.unpin_extent_range 0.00 +0.3 0.29 ± 11% perf-profile.children.cycles-pp.rcu_core 0.00 +0.3 0.29 ± 12% perf-profile.children.cycles-pp.btrfs_extend_item 0.15 +0.3 0.45 ± 5% perf-profile.children.cycles-pp.__set_extent_bit 0.00 +0.3 0.30 ± 10% perf-profile.children.cycles-pp.update_blocked_averages 0.00 +0.3 0.30 ± 5% perf-profile.children.cycles-pp.find_extent_buffer 0.00 +0.3 0.30 ± 14% perf-profile.children.cycles-pp.native_sched_clock 0.00 +0.3 0.30 ± 8% perf-profile.children.cycles-pp.__lookup_extent_mapping 0.00 +0.3 0.31 ± 12% perf-profile.children.cycles-pp.btrfs_finish_extent_commit 0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.sched_clock 0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.load_balance 0.02 ±122% +0.3 0.33 ± 3% perf-profile.children.cycles-pp.update_load_avg 0.02 ±122% +0.3 0.33 ± 2% perf-profile.children.cycles-pp.btrfs_delayed_inode_release_metadata 0.00 +0.3 0.31 ± 3% perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.3 0.32 ± 7% perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +0.3 0.32 ± 11% perf-profile.children.cycles-pp.run_rebalance_domains 0.00 +0.3 0.32 ± 52% perf-profile.children.cycles-pp.start_kernel 0.00 +0.3 0.33 ± 4% perf-profile.children.cycles-pp.__list_del_entry_valid 0.00 +0.3 0.34 ± 22% perf-profile.children.cycles-pp.btrfs_balance_delayed_items 0.00 +0.4 0.35 ± 26% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.00 +0.4 0.35 ± 6% perf-profile.children.cycles-pp.__btrfs_release_delayed_node 0.00 +0.4 0.35 ± 15% perf-profile.children.cycles-pp.sched_clock_cpu 0.00 +0.4 0.35 ± 7% perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref 0.00 +0.4 0.36 ± 12% perf-profile.children.cycles-pp.find_next_bit 0.00 +0.4 0.37 ± 12% perf-profile.children.cycles-pp.read_tsc 0.00 +0.4 0.38 ± 6% perf-profile.children.cycles-pp.__orc_find 0.00 +0.4 0.39 ± 16% perf-profile.children.cycles-pp.btrfs_map_bio 0.00 +0.4 0.40 ± 19% perf-profile.children.cycles-pp.unlock_up 0.00 +0.4 0.40 ± 4% perf-profile.children.cycles-pp.memmove_extent_buffer 0.00 +0.4 0.41 ± 3% perf-profile.children.cycles-pp.btrfs_set_token_32 0.00 +0.4 0.41 ± 5% perf-profile.children.cycles-pp.btrfs_update_block_group 0.00 +0.4 0.42 ± 9% perf-profile.children.cycles-pp.brd_do_bvec 0.00 +0.4 0.43 ± 4% perf-profile.children.cycles-pp.end_bio_extent_writepage 0.00 +0.4 0.43 ± 12% perf-profile.children.cycles-pp.btrfs_try_tree_write_lock 0.00 +0.4 0.44 ± 3% perf-profile.children.cycles-pp.generic_bin_search 0.00 +0.4 0.44 ± 9% perf-profile.children.cycles-pp.native_irq_return_iret 0.00 +0.4 0.45 perf-profile.children.cycles-pp.btrfs_try_granting_tickets 0.00 +0.5 0.45 perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.00 +0.5 0.45 ± 12% perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.5 0.47 ± 2% perf-profile.children.cycles-pp.orc_find 0.00 +0.5 0.47 ± 6% perf-profile.children.cycles-pp.__btrfs_btree_balance_dirty 0.00 +0.5 0.47 ± 29% perf-profile.children.cycles-pp.btrfs_free_path 0.00 +0.5 0.48 ± 4% perf-profile.children.cycles-pp.schedule_idle 0.00 +0.5 0.48 ± 4% perf-profile.children.cycles-pp.read_block_for_search 0.00 +0.5 0.48 ± 5% perf-profile.children.cycles-pp.__queue_work 0.00 +0.5 0.49 ± 4% perf-profile.children.cycles-pp.btrfs_end_bio 0.00 +0.5 0.49 ± 5% perf-profile.children.cycles-pp.queue_work_on 0.00 +0.5 0.51 ± 3% perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.5 0.51 ± 4% perf-profile.children.cycles-pp.memmove 0.00 +0.5 0.52 ± 20% perf-profile.children.cycles-pp.btrfs_get_64 0.01 ±200% +0.5 0.53 ± 15% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.5 0.54 ± 21% perf-profile.children.cycles-pp.btrfs_get_32 0.00 +0.6 0.56 ± 15% perf-profile.children.cycles-pp.__next_timer_interrupt 0.00 +0.6 0.56 ± 11% perf-profile.children.cycles-pp.native_write_msr 0.00 +0.6 0.56 ± 27% perf-profile.children.cycles-pp.btrfs_cow_block 0.00 +0.6 0.56 ± 27% perf-profile.children.cycles-pp.__btrfs_cow_block 0.00 +0.6 0.58 ± 6% perf-profile.children.cycles-pp.cow_file_range 0.00 +0.6 0.59 ± 12% perf-profile.children.cycles-pp.__mutex_lock 0.00 +0.6 0.61 ± 6% perf-profile.children.cycles-pp.btrfs_run_delalloc_range 0.00 +0.7 0.67 ± 13% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.00 +0.7 0.70 ± 6% perf-profile.children.cycles-pp.writepage_delalloc 0.00 +0.7 0.70 ± 23% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.00 +0.8 0.76 ± 2% perf-profile.children.cycles-pp.btrfs_delayed_refs_rsv_release 0.00 +0.8 0.77 ± 18% perf-profile.children.cycles-pp.map_private_extent_buffer 0.00 +0.8 0.79 ± 4% perf-profile.children.cycles-pp.btrfs_get_token_32 0.00 +0.8 0.80 ± 3% perf-profile.children.cycles-pp.btrfs_del_items 0.00 +0.8 0.80 ± 23% perf-profile.children.cycles-pp.tick_irq_enter 0.00 +0.8 0.81 ± 24% perf-profile.children.cycles-pp.lookup_inline_extent_backref 0.00 +0.8 0.81 ± 5% perf-profile.children.cycles-pp.schedule 0.00 +0.8 0.82 ± 2% perf-profile.children.cycles-pp.run_scheduled_bios 0.00 +0.8 0.82 ± 14% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.00 +0.9 0.86 ± 5% perf-profile.children.cycles-pp.__extent_writepage 0.00 +0.9 0.89 ± 22% perf-profile.children.cycles-pp.irq_enter 0.00 +0.9 0.92 ± 6% perf-profile.children.cycles-pp.brd_make_request 0.30 ± 12% +0.9 1.22 ± 17% perf-profile.children.cycles-pp.update_process_times 0.00 +0.9 0.93 ± 22% perf-profile.children.cycles-pp.btrfs_release_path 0.30 ± 12% +1.0 1.27 ± 18% perf-profile.children.cycles-pp.tick_sched_handle 0.00 +1.0 0.98 ± 20% perf-profile.children.cycles-pp.submit_extent_page 0.00 +1.0 0.98 perf-profile.children.cycles-pp.unwind_next_frame 0.00 +1.0 0.99 ± 7% perf-profile.children.cycles-pp.generic_make_request 0.00 +1.0 0.99 ± 6% perf-profile.children.cycles-pp.submit_bio 0.00 +1.0 1.00 ± 5% perf-profile.children.cycles-pp.extent_write_cache_pages 0.00 +1.0 1.01 ± 21% perf-profile.children.cycles-pp.write_one_eb 0.00 +1.2 1.16 ± 8% perf-profile.children.cycles-pp.__btrfs_run_delayed_items 0.00 +1.2 1.22 ± 6% perf-profile.children.cycles-pp.__writeback_single_inode 0.00 +1.2 1.23 ± 6% perf-profile.children.cycles-pp.extent_writepages 0.00 +1.2 1.23 ± 4% perf-profile.children.cycles-pp.__schedule 0.00 +1.3 1.25 ± 27% perf-profile.children.cycles-pp.btrfs_lookup_csum 0.00 +1.3 1.25 ± 26% perf-profile.children.cycles-pp.check_leaf 0.00 +1.3 1.26 ± 26% perf-profile.children.cycles-pp.btree_csum_one_bio 0.00 +1.3 1.26 ± 6% perf-profile.children.cycles-pp.writeback_sb_inodes 0.00 +1.3 1.28 ± 6% perf-profile.children.cycles-pp.wb_writeback 0.00 +1.3 1.29 ± 6% perf-profile.children.cycles-pp.wb_workfn 0.00 +1.3 1.30 ± 13% perf-profile.children.cycles-pp.alloc_reserved_file_extent 0.41 ± 4% +1.3 1.75 ± 16% perf-profile.children.cycles-pp.tick_sched_timer 0.00 +1.3 1.34 ± 2% perf-profile.children.cycles-pp.arch_stack_walk 0.00 +1.4 1.38 ± 8% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.00 +1.5 1.47 ± 27% perf-profile.children.cycles-pp.btree_submit_bio_hook 0.00 +1.5 1.47 ± 2% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.00 +1.5 1.49 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start 0.00 +1.6 1.58 ± 12% perf-profile.children.cycles-pp.queued_write_lock_slowpath 0.00 +1.6 1.59 ± 26% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction 0.00 +1.6 1.59 ± 26% perf-profile.children.cycles-pp.btrfs_write_marked_extents 0.00 +1.6 1.59 ± 26% perf-profile.children.cycles-pp.btree_write_cache_pages 0.00 +1.6 1.61 ± 26% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 0.00 +1.6 1.61 ± 6% perf-profile.children.cycles-pp.sched_ttwu_pending 0.00 +1.7 1.66 ± 10% perf-profile.children.cycles-pp.btrfs_unlock_up_safe 0.00 +1.7 1.69 ± 23% perf-profile.children.cycles-pp.submit_one_bio 0.00 +1.7 1.72 ± 2% perf-profile.children.cycles-pp.autoremove_wake_function 0.09 ± 15% +1.8 1.86 ± 9% perf-profile.children.cycles-pp.clockevents_program_event 0.00 +1.8 1.83 perf-profile.children.cycles-pp.__wake_up_common 0.00 +1.9 1.86 ± 2% perf-profile.children.cycles-pp.__account_scheduler_latency 0.00 +1.9 1.91 ± 11% perf-profile.children.cycles-pp.tick_nohz_next_event 0.00 +2.0 1.96 ± 24% perf-profile.children.cycles-pp.poll_idle 0.00 +2.1 2.09 ± 2% perf-profile.children.cycles-pp.try_to_wake_up 0.00 +2.2 2.21 ± 10% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.47 ± 5% +2.2 2.69 ± 17% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.00 +2.2 2.25 ± 2% perf-profile.children.cycles-pp.enqueue_entity 0.00 +2.3 2.32 ± 7% perf-profile.children.cycles-pp.setup_items_for_insert 0.00 +2.3 2.33 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair 0.00 +2.3 2.34 ± 2% perf-profile.children.cycles-pp.activate_task 0.00 +2.3 2.35 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate 0.00 +2.4 2.40 ± 8% perf-profile.children.cycles-pp.irq_exit 0.00 +2.8 2.82 ± 16% perf-profile.children.cycles-pp.do_writepages 0.00 +2.8 2.83 ± 29% perf-profile.children.cycles-pp.btrfs_del_csums 0.18 ± 24% +2.8 3.03 ± 10% perf-profile.children.cycles-pp.ktime_get 0.00 +3.1 3.05 ± 9% perf-profile.children.cycles-pp.__wake_up_common_lock 0.00 +3.3 3.33 ± 13% perf-profile.children.cycles-pp.btrfs_insert_empty_items 0.00 +3.4 3.40 ± 24% perf-profile.children.cycles-pp.btrfs_commit_transaction 0.00 +3.5 3.50 ± 10% perf-profile.children.cycles-pp.menu_select 0.00 +3.8 3.75 ± 11% perf-profile.children.cycles-pp.btrfs_lookup_inode 0.00 +3.8 3.83 ± 9% perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space 0.07 ± 6% +4.1 4.21 ± 10% perf-profile.children.cycles-pp.btrfs_async_run_delayed_root 0.04 ± 50% +4.2 4.21 ± 9% perf-profile.children.cycles-pp.__btrfs_update_delayed_inode 0.00 +4.2 4.21 ± 24% perf-profile.children.cycles-pp.btrfs_csum_file_blocks 0.00 +4.2 4.22 ± 24% perf-profile.children.cycles-pp.add_pending_csums 0.00 +4.3 4.34 ± 23% perf-profile.children.cycles-pp.__btrfs_free_extent 0.66 ± 6% +4.6 5.27 ± 14% perf-profile.children.cycles-pp.hrtimer_interrupt 0.19 ± 14% +5.6 5.77 ± 18% perf-profile.children.cycles-pp.finish_wait 0.00 +7.1 7.09 ± 18% perf-profile.children.cycles-pp.priority_reclaim_metadata_space 0.07 +7.1 7.18 ± 18% perf-profile.children.cycles-pp.btrfs_block_rsv_refill 0.00 +7.1 7.11 ± 14% perf-profile.children.cycles-pp.btrfs_lock_root_node 0.07 +7.1 7.19 ± 18% perf-profile.children.cycles-pp.evict_refill_and_join 0.00 +7.1 7.14 ± 14% perf-profile.children.cycles-pp.btrfs_tree_lock 0.27 +7.2 7.43 ± 18% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.27 +7.2 7.43 ± 18% perf-profile.children.cycles-pp.task_work_run 0.27 +7.2 7.43 ± 18% perf-profile.children.cycles-pp.__fput 0.27 +7.2 7.43 ± 18% perf-profile.children.cycles-pp.dput 0.27 ± 2% +7.2 7.43 ± 18% perf-profile.children.cycles-pp.__dentry_kill 0.27 ± 2% +7.2 7.43 ± 18% perf-profile.children.cycles-pp.evict 0.27 ± 2% +7.2 7.43 ± 18% perf-profile.children.cycles-pp.btrfs_evict_inode 0.27 +7.2 7.47 ± 18% perf-profile.children.cycles-pp.close 0.00 +7.4 7.35 ± 16% perf-profile.children.cycles-pp.btrfs_run_delayed_refs 0.00 +7.4 7.35 ± 16% perf-profile.children.cycles-pp.__btrfs_run_delayed_refs 0.69 ± 5% +8.0 8.69 ± 13% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.73 ± 5% +8.7 9.44 ± 12% perf-profile.children.cycles-pp.apic_timer_interrupt 0.53 ± 10% +10.4 10.96 ± 8% perf-profile.children.cycles-pp.btrfs_lookup_file_extent 0.22 ± 12% +10.5 10.70 ± 13% perf-profile.children.cycles-pp.prepare_to_wait_event 0.00 +10.5 10.53 ± 8% perf-profile.children.cycles-pp.flush_space 0.44 ± 13% +12.4 12.87 ± 14% perf-profile.children.cycles-pp.btrfs_tree_read_lock 0.46 ± 12% +12.6 13.03 ± 14% perf-profile.children.cycles-pp.btrfs_read_lock_root_node 0.00 +13.5 13.47 ± 6% perf-profile.children.cycles-pp.__btrfs_drop_extents 0.00 +14.7 14.65 ± 5% perf-profile.children.cycles-pp.insert_reserved_file_extent 0.43 ± 12% +17.6 18.03 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.00 +19.6 19.62 ± 7% perf-profile.children.cycles-pp.btrfs_finish_ordered_io 0.54 ± 10% +22.5 23.09 ± 12% perf-profile.children.cycles-pp.btrfs_search_slot 0.07 ± 6% +24.9 24.98 ± 7% perf-profile.children.cycles-pp.normal_work_helper 0.08 ± 7% +30.2 30.30 ± 5% perf-profile.children.cycles-pp.process_one_work 0.08 ± 7% +30.5 30.56 ± 5% perf-profile.children.cycles-pp.worker_thread 0.08 ± 5% +30.5 30.58 ± 5% perf-profile.children.cycles-pp.ret_from_fork 0.08 ± 5% +30.5 30.58 ± 5% perf-profile.children.cycles-pp.kthread 0.14 ± 14% +38.8 38.92 ± 6% perf-profile.children.cycles-pp.intel_idle 0.15 ± 14% +51.0 51.10 ± 5% perf-profile.children.cycles-pp.cpuidle_enter_state 0.15 ± 14% +51.0 51.13 ± 5% perf-profile.children.cycles-pp.cpuidle_enter 0.15 ± 15% +57.6 57.71 ± 4% perf-profile.children.cycles-pp.start_secondary 0.15 ± 15% +57.9 58.03 ± 4% perf-profile.children.cycles-pp.secondary_startup_64 0.15 ± 15% +57.9 58.03 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry 0.15 ± 15% +57.9 58.06 ± 4% perf-profile.children.cycles-pp.do_idle 96.78 -75.5 21.27 ± 15% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.14 ± 18% -0.1 0.05 perf-profile.self.cycles-pp.update_cfs_group 0.00 +0.1 0.05 perf-profile.self.cycles-pp.rebalance_domains 0.00 +0.1 0.05 perf-profile.self.cycles-pp.orc_find 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__btrfs_release_delayed_node 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.end_bio_extent_writepage 0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.rcu_irq_exit 0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.available_idle_cpu 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.btrfs_del_items 0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.free_extent_map 0.00 +0.1 0.06 perf-profile.self.cycles-pp.__btrfs_run_delayed_refs 0.00 +0.1 0.06 ± 19% perf-profile.self.cycles-pp.check_preempt_curr 0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.xas_load 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.setup_items_for_insert 0.00 +0.1 0.06 ± 19% perf-profile.self.cycles-pp.trigger_load_balance 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.verify_parent_transid 0.00 +0.1 0.07 ± 25% perf-profile.self.cycles-pp.lapic_next_deadline 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.update_cfs_rq_h_load 0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.get_next_timer_interrupt 0.00 +0.1 0.07 perf-profile.self.cycles-pp.__btrfs_block_rsv_release 0.00 +0.1 0.07 ± 44% perf-profile.self.cycles-pp.io_serial_in 0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.update_curr 0.00 +0.1 0.07 ± 25% perf-profile.self.cycles-pp.note_gp_changes 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.btrfs_try_granting_tickets 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.kmem_cache_free 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.set_extent_buffer_dirty 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.copy_pages 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.mutex_unlock 0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.btrfs_async_reclaim_metadata_space 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.percpu_counter_add_batch 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.__update_load_avg_se 0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.rb_next 0.00 +0.1 0.08 ± 17% perf-profile.self.cycles-pp.call_cpuidle 0.00 +0.1 0.08 ± 17% perf-profile.self.cycles-pp.btrfs_comp_cpu_keys 0.00 +0.1 0.08 ± 10% perf-profile.self.cycles-pp.enqueue_task_fair 0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.rcu_idle_exit 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.kmem_cache_alloc 0.00 +0.1 0.08 ± 5% perf-profile.self.cycles-pp.cpuacct_charge 0.00 +0.1 0.09 ± 19% perf-profile.self.cycles-pp.interrupt_entry 0.00 +0.1 0.09 ± 15% perf-profile.self.cycles-pp.idle_cpu 0.00 +0.1 0.09 ± 9% perf-profile.self.cycles-pp.hrtimer_interrupt 0.00 +0.1 0.09 ± 22% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.steal_from_bitmap 0.00 +0.1 0.10 ± 9% perf-profile.self.cycles-pp.btrfs_tree_read_unlock 0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.btrfs_tree_unlock 0.00 +0.1 0.10 ± 17% perf-profile.self.cycles-pp.rb_insert_color 0.00 +0.1 0.10 ± 4% perf-profile.self.cycles-pp.rcu_eqs_enter 0.00 +0.1 0.10 ± 35% perf-profile.self.cycles-pp.run_timer_softirq 0.00 +0.1 0.10 ± 21% perf-profile.self.cycles-pp.btrfs_get_8 0.00 +0.1 0.10 perf-profile.self.cycles-pp.set_next_entity 0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.update_blocked_averages 0.00 +0.1 0.10 ± 12% perf-profile.self.cycles-pp.mutex_lock 0.00 +0.1 0.10 ± 9% perf-profile.self.cycles-pp.__wake_up_common 0.00 +0.1 0.11 ± 11% perf-profile.self.cycles-pp.__slab_free 0.00 +0.1 0.11 ± 8% perf-profile.self.cycles-pp.enqueue_entity 0.00 +0.1 0.11 ± 8% perf-profile.self.cycles-pp.find_ref_head 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.stack_trace_save_tsk 0.00 +0.1 0.11 ± 12% perf-profile.self.cycles-pp.__radix_tree_lookup 0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.rb_erase 0.00 +0.1 0.12 ± 24% perf-profile.self.cycles-pp.tick_check_oneshot_broadcast_this_cpu 0.00 +0.1 0.12 ± 6% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit 0.00 +0.1 0.12 ± 3% perf-profile.self.cycles-pp.sched_ttwu_pending 0.00 +0.1 0.12 ± 3% perf-profile.self.cycles-pp.__switch_to 0.00 +0.1 0.13 ± 13% perf-profile.self.cycles-pp.update_rq_clock 0.00 +0.1 0.13 ± 7% perf-profile.self.cycles-pp.update_load_avg 0.00 +0.1 0.14 ± 6% perf-profile.self.cycles-pp.__etree_search 0.00 +0.1 0.14 ± 11% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust 0.00 +0.1 0.14 ± 6% perf-profile.self.cycles-pp.__switch_to_asm 0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.___might_sleep 0.00 +0.1 0.15 ± 25% perf-profile.self.cycles-pp.calc_global_load_tick 0.00 +0.1 0.15 ± 3% perf-profile.self.cycles-pp.btrfs_search_slot 0.00 +0.1 0.15 ± 3% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.1 0.15 ± 28% perf-profile.self.cycles-pp.check_leaf 0.00 +0.2 0.15 ± 9% perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.2 0.15 ± 10% perf-profile.self.cycles-pp.update_sd_lb_stats 0.00 +0.2 0.15 ± 5% perf-profile.self.cycles-pp.__account_scheduler_latency 0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.read_extent_buffer 0.00 +0.2 0.16 ± 3% perf-profile.self.cycles-pp.find_extent_buffer 0.00 +0.2 0.16 ± 13% perf-profile.self.cycles-pp.btrfs_tree_lock 0.00 +0.2 0.16 ± 15% perf-profile.self.cycles-pp.priority_reclaim_metadata_space 0.00 +0.2 0.17 ± 14% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.2 0.17 ± 12% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.00 +0.2 0.17 ± 9% perf-profile.self.cycles-pp.find_next_zero_bit 0.00 +0.2 0.17 ± 9% perf-profile.self.cycles-pp.add_delayed_ref_head 0.00 +0.2 0.18 ± 2% perf-profile.self.cycles-pp._raw_write_lock 0.00 +0.2 0.18 ± 13% perf-profile.self.cycles-pp.free_extent_buffer 0.00 +0.2 0.18 ± 6% perf-profile.self.cycles-pp.nr_iowait_cpu 0.00 +0.2 0.18 ± 9% perf-profile.self.cycles-pp.btrfs_root_node 0.00 +0.2 0.19 ± 26% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.00 +0.2 0.19 ± 15% perf-profile.self.cycles-pp.tick_sched_timer 0.00 +0.2 0.19 ± 4% perf-profile.self.cycles-pp.__module_address 0.00 +0.2 0.20 ± 12% perf-profile.self.cycles-pp.btrfs_tree_read_lock 0.00 +0.2 0.20 ± 10% perf-profile.self.cycles-pp.__softirqentry_text_start 0.00 +0.2 0.22 ± 11% perf-profile.self.cycles-pp.mutex_spin_on_owner 0.00 +0.2 0.23 ± 5% perf-profile.self.cycles-pp.__schedule 0.00 +0.2 0.23 ± 14% perf-profile.self.cycles-pp._raw_read_lock 0.07 ± 9% +0.2 0.30 ± 22% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.00 +0.2 0.23 ± 27% perf-profile.self.cycles-pp.copy_page 0.00 +0.2 0.24 ± 22% perf-profile.self.cycles-pp.btrfs_get_64 0.00 +0.2 0.25 ± 13% perf-profile.self.cycles-pp.run_local_timers 0.00 +0.2 0.25 ± 9% perf-profile.self.cycles-pp.__list_add_valid 0.00 +0.2 0.25 ± 14% perf-profile.self.cycles-pp._raw_spin_trylock 0.00 +0.3 0.27 ± 16% perf-profile.self.cycles-pp.btrfs_get_32 0.00 +0.3 0.27 perf-profile.self.cycles-pp.prepare_to_wait_event 0.00 +0.3 0.28 ± 15% perf-profile.self.cycles-pp.__next_timer_interrupt 0.00 +0.3 0.28 ± 7% perf-profile.self.cycles-pp.try_to_wake_up 0.00 +0.3 0.29 ± 12% perf-profile.self.cycles-pp.native_sched_clock 0.00 +0.3 0.30 ± 6% perf-profile.self.cycles-pp.__lookup_extent_mapping 0.00 +0.3 0.30 ± 4% perf-profile.self.cycles-pp.generic_bin_search 0.00 +0.3 0.30 ± 25% perf-profile.self.cycles-pp.rcu_sched_clock_irq 0.00 +0.3 0.30 ± 13% perf-profile.self.cycles-pp.find_next_bit 0.00 +0.3 0.31 ± 14% perf-profile.self.cycles-pp.tick_nohz_next_event 0.00 +0.3 0.32 ± 3% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.00 +0.3 0.33 ± 5% perf-profile.self.cycles-pp.__list_del_entry_valid 0.00 +0.3 0.34 ± 13% perf-profile.self.cycles-pp.brd_do_bvec 0.00 +0.3 0.35 ± 15% perf-profile.self.cycles-pp.queued_read_lock_slowpath 0.00 +0.4 0.36 ± 11% perf-profile.self.cycles-pp.read_tsc 0.00 +0.4 0.38 ± 3% perf-profile.self.cycles-pp.btrfs_set_token_32 0.00 +0.4 0.38 ± 6% perf-profile.self.cycles-pp.__orc_find 0.00 +0.4 0.40 ± 6% perf-profile.self.cycles-pp.do_idle 0.00 +0.4 0.42 perf-profile.self.cycles-pp.unwind_next_frame 0.00 +0.4 0.44 ± 9% perf-profile.self.cycles-pp.native_irq_return_iret 0.00 +0.5 0.51 ± 4% perf-profile.self.cycles-pp.memmove 0.00 +0.6 0.56 ± 11% perf-profile.self.cycles-pp.native_write_msr 0.00 +0.7 0.67 ± 6% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.00 +0.7 0.70 ± 24% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.00 +0.7 0.72 ± 19% perf-profile.self.cycles-pp.map_private_extent_buffer 0.00 +0.7 0.73 ± 4% perf-profile.self.cycles-pp.btrfs_get_token_32 0.00 +0.9 0.93 ± 12% perf-profile.self.cycles-pp.cpuidle_enter_state 0.49 +1.0 1.50 ± 3% perf-profile.self.cycles-pp._raw_spin_lock 0.00 +1.1 1.07 ± 19% perf-profile.self.cycles-pp.menu_select 0.00 +1.3 1.26 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.00 +1.9 1.92 ± 24% perf-profile.self.cycles-pp.poll_idle 0.17 ± 26% +2.5 2.70 ± 10% perf-profile.self.cycles-pp.ktime_get 0.14 ± 14% +38.7 38.87 ± 6% perf-profile.self.cycles-pp.intel_idle 1326 ± 43% +308.5% 5419 ± 31% interrupts.31:PCI-MSI.524289-edge.eth0-TxRx-0 411.40 ± 50% +1548.0% 6780 ± 52% interrupts.32:PCI-MSI.524290-edge.eth0-TxRx-1 309.40 ± 18% +384.8% 1500 ± 33% interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2 461.40 ± 63% +533.1% 2921 ± 67% interrupts.34:PCI-MSI.524292-edge.eth0-TxRx-3 564.40 +401.1% 2828 interrupts.9:IO-APIC.9-fasteoi.acpi 866975 ± 14% +207.9% 2669536 ± 4% interrupts.CAL:Function_call_interrupts 4345 ± 14% +214.9% 13684 interrupts.CPU0.CAL:Function_call_interrupts 556431 +406.9% 2820652 interrupts.CPU0.LOC:Local_timer_interrupts 6998 ± 30% -89.2% 756.00 ± 58% interrupts.CPU0.NMI:Non-maskable_interrupts 6998 ± 30% -89.2% 756.00 ± 58% interrupts.CPU0.PMI:Performance_monitoring_interrupts 10063 ± 7% +1807.2% 191922 interrupts.CPU0.RES:Rescheduling_interrupts 564.40 +401.1% 2828 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 4479 ± 13% +206.9% 13747 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 555195 +408.0% 2820211 interrupts.CPU1.LOC:Local_timer_interrupts 7880 ± 22% -89.8% 800.33 ± 38% interrupts.CPU1.NMI:Non-maskable_interrupts 7880 ± 22% -89.8% 800.33 ± 38% interrupts.CPU1.PMI:Performance_monitoring_interrupts 9088 ± 8% +1993.8% 190285 interrupts.CPU1.RES:Rescheduling_interrupts 411.40 ± 50% +1548.0% 6780 ± 52% interrupts.CPU10.32:PCI-MSI.524290-edge.eth0-TxRx-1 4454 ± 13% +209.1% 13766 ± 4% interrupts.CPU10.CAL:Function_call_interrupts 554990 +408.3% 2821064 interrupts.CPU10.LOC:Local_timer_interrupts 7858 ± 22% -88.5% 903.67 ± 43% interrupts.CPU10.NMI:Non-maskable_interrupts 7858 ± 22% -88.5% 903.67 ± 43% interrupts.CPU10.PMI:Performance_monitoring_interrupts 8045 ± 6% +2246.7% 188799 interrupts.CPU10.RES:Rescheduling_interrupts 1.20 ± 81% +7788.9% 94.67 ± 27% interrupts.CPU10.TLB:TLB_shootdowns 4510 ± 14% +207.1% 13853 ± 4% interrupts.CPU100.CAL:Function_call_interrupts 555074 +408.1% 2820157 interrupts.CPU100.LOC:Local_timer_interrupts 7887 ± 22% -83.0% 1341 ± 36% interrupts.CPU100.NMI:Non-maskable_interrupts 7887 ± 22% -83.0% 1341 ± 36% interrupts.CPU100.PMI:Performance_monitoring_interrupts 7986 ± 4% +2266.0% 188958 ± 2% interrupts.CPU100.RES:Rescheduling_interrupts 4509 ± 14% +207.3% 13858 ± 4% interrupts.CPU101.CAL:Function_call_interrupts 555025 +408.1% 2820107 interrupts.CPU101.LOC:Local_timer_interrupts 7870 ± 22% -90.3% 765.33 ± 54% interrupts.CPU101.NMI:Non-maskable_interrupts 7870 ± 22% -90.3% 765.33 ± 54% interrupts.CPU101.PMI:Performance_monitoring_interrupts 7910 ± 4% +2285.4% 188686 ± 2% interrupts.CPU101.RES:Rescheduling_interrupts 1.00 ±109% +9766.7% 98.67 ± 26% interrupts.CPU101.TLB:TLB_shootdowns 4507 ± 14% +207.0% 13837 ± 4% interrupts.CPU102.CAL:Function_call_interrupts 554939 +408.2% 2820153 interrupts.CPU102.LOC:Local_timer_interrupts 7871 ± 22% -88.1% 933.67 ± 46% interrupts.CPU102.NMI:Non-maskable_interrupts 7871 ± 22% -88.1% 933.67 ± 46% interrupts.CPU102.PMI:Performance_monitoring_interrupts 7902 ± 2% +2282.8% 188291 ± 2% interrupts.CPU102.RES:Rescheduling_interrupts 4500 ± 15% +207.1% 13822 ± 4% interrupts.CPU103.CAL:Function_call_interrupts 554993 +408.4% 2821446 interrupts.CPU103.LOC:Local_timer_interrupts 7871 ± 22% -89.8% 800.33 ± 31% interrupts.CPU103.NMI:Non-maskable_interrupts 7871 ± 22% -89.8% 800.33 ± 31% interrupts.CPU103.PMI:Performance_monitoring_interrupts 7872 ± 4% +2308.4% 189605 interrupts.CPU103.RES:Rescheduling_interrupts 2.00 ± 54% +4533.3% 92.67 ± 28% interrupts.CPU103.TLB:TLB_shootdowns 4513 ± 14% +208.1% 13906 ± 4% interrupts.CPU104.CAL:Function_call_interrupts 555523 +407.7% 2820424 interrupts.CPU104.LOC:Local_timer_interrupts 7870 ± 22% -88.6% 896.33 ± 22% interrupts.CPU104.NMI:Non-maskable_interrupts 7870 ± 22% -88.6% 896.33 ± 22% interrupts.CPU104.PMI:Performance_monitoring_interrupts 7894 ± 3% +2303.6% 189750 interrupts.CPU104.RES:Rescheduling_interrupts 1.60 ± 30% +5545.8% 90.33 ± 10% interrupts.CPU104.TLB:TLB_shootdowns 4512 ± 14% +206.9% 13848 ± 4% interrupts.CPU105.CAL:Function_call_interrupts 555065 +408.1% 2820283 interrupts.CPU105.LOC:Local_timer_interrupts 7862 ± 22% -85.4% 1144 ± 22% interrupts.CPU105.NMI:Non-maskable_interrupts 7862 ± 22% -85.4% 1144 ± 22% interrupts.CPU105.PMI:Performance_monitoring_interrupts 7933 ± 4% +2274.1% 188348 ± 2% interrupts.CPU105.RES:Rescheduling_interrupts 1.20 ±122% +7455.6% 90.67 ± 19% interrupts.CPU105.TLB:TLB_shootdowns 4259 ± 14% +224.4% 13818 ± 4% interrupts.CPU106.CAL:Function_call_interrupts 554923 +408.2% 2820152 interrupts.CPU106.LOC:Local_timer_interrupts 7858 ± 22% -88.6% 894.00 ± 33% interrupts.CPU106.NMI:Non-maskable_interrupts 7858 ± 22% -88.6% 894.00 ± 33% interrupts.CPU106.PMI:Performance_monitoring_interrupts 7920 ± 3% +2290.7% 189340 interrupts.CPU106.RES:Rescheduling_interrupts 4511 ± 14% +205.6% 13785 ± 4% interrupts.CPU107.CAL:Function_call_interrupts 554916 +408.2% 2820137 interrupts.CPU107.LOC:Local_timer_interrupts 7864 ± 22% -88.4% 912.33 ± 20% interrupts.CPU107.NMI:Non-maskable_interrupts 7864 ± 22% -88.4% 912.33 ± 20% interrupts.CPU107.PMI:Performance_monitoring_interrupts 7936 ± 3% +2281.7% 189022 interrupts.CPU107.RES:Rescheduling_interrupts 4520 ± 14% +205.9% 13829 ± 4% interrupts.CPU108.CAL:Function_call_interrupts 555116 +408.0% 2820151 interrupts.CPU108.LOC:Local_timer_interrupts 7875 ± 22% -84.2% 1243 ± 20% interrupts.CPU108.NMI:Non-maskable_interrupts 7875 ± 22% -84.2% 1243 ± 20% interrupts.CPU108.PMI:Performance_monitoring_interrupts 7900 ± 5% +2303.0% 189843 interrupts.CPU108.RES:Rescheduling_interrupts 2.00 ±104% +4266.7% 87.33 ± 22% interrupts.CPU108.TLB:TLB_shootdowns 4520 ± 14% +205.3% 13803 ± 4% interrupts.CPU109.CAL:Function_call_interrupts 555175 +408.0% 2820169 interrupts.CPU109.LOC:Local_timer_interrupts 7855 ± 22% -86.7% 1048 ± 12% interrupts.CPU109.NMI:Non-maskable_interrupts 7855 ± 22% -86.7% 1048 ± 12% interrupts.CPU109.PMI:Performance_monitoring_interrupts 7944 ± 3% +2296.5% 190383 interrupts.CPU109.RES:Rescheduling_interrupts 309.40 ± 18% +384.8% 1500 ± 33% interrupts.CPU11.33:PCI-MSI.524291-edge.eth0-TxRx-2 4469 ± 14% +207.8% 13756 ± 4% interrupts.CPU11.CAL:Function_call_interrupts 555914 +407.4% 2820442 interrupts.CPU11.LOC:Local_timer_interrupts 7878 ± 21% -87.2% 1012 ± 24% interrupts.CPU11.NMI:Non-maskable_interrupts 7878 ± 21% -87.2% 1012 ± 24% interrupts.CPU11.PMI:Performance_monitoring_interrupts 7901 ± 4% +2294.1% 189164 interrupts.CPU11.RES:Rescheduling_interrupts 4.00 ±100% +2325.0% 97.00 ± 27% interrupts.CPU11.TLB:TLB_shootdowns 4520 ± 14% +204.8% 13778 ± 4% interrupts.CPU110.CAL:Function_call_interrupts 555396 +407.8% 2820175 interrupts.CPU110.LOC:Local_timer_interrupts 7858 ± 22% -87.5% 986.00 ± 30% interrupts.CPU110.NMI:Non-maskable_interrupts 7858 ± 22% -87.5% 986.00 ± 30% interrupts.CPU110.PMI:Performance_monitoring_interrupts 8034 ± 3% +2264.6% 189976 interrupts.CPU110.RES:Rescheduling_interrupts 4520 ± 14% +206.4% 13852 ± 4% interrupts.CPU111.CAL:Function_call_interrupts 555531 +407.7% 2820198 interrupts.CPU111.LOC:Local_timer_interrupts 7861 ± 22% -91.1% 696.00 ± 9% interrupts.CPU111.NMI:Non-maskable_interrupts 7861 ± 22% -91.1% 696.00 ± 9% interrupts.CPU111.PMI:Performance_monitoring_interrupts 7915 ± 3% +2294.9% 189568 interrupts.CPU111.RES:Rescheduling_interrupts 4524 ± 14% +205.3% 13810 ± 4% interrupts.CPU112.CAL:Function_call_interrupts 555282 +407.9% 2820233 interrupts.CPU112.LOC:Local_timer_interrupts 7864 ± 22% -86.2% 1089 ± 47% interrupts.CPU112.NMI:Non-maskable_interrupts 7864 ± 22% -86.2% 1089 ± 47% interrupts.CPU112.PMI:Performance_monitoring_interrupts 7951 ± 3% +2274.0% 188779 interrupts.CPU112.RES:Rescheduling_interrupts 4518 ± 14% +204.9% 13774 ± 4% interrupts.CPU113.CAL:Function_call_interrupts 555247 +408.0% 2820478 interrupts.CPU113.LOC:Local_timer_interrupts 7865 ± 22% -90.0% 786.00 ± 42% interrupts.CPU113.NMI:Non-maskable_interrupts 7865 ± 22% -90.0% 786.00 ± 42% interrupts.CPU113.PMI:Performance_monitoring_interrupts 7952 ± 5% +2265.9% 188137 ± 2% interrupts.CPU113.RES:Rescheduling_interrupts 0.80 ± 93% +10733.3% 86.67 ± 12% interrupts.CPU113.TLB:TLB_shootdowns 4519 ± 14% +201.2% 13613 ± 5% interrupts.CPU114.CAL:Function_call_interrupts 555281 +407.9% 2820344 interrupts.CPU114.LOC:Local_timer_interrupts 7854 ± 22% -86.3% 1076 ± 13% interrupts.CPU114.NMI:Non-maskable_interrupts 7854 ± 22% -86.3% 1076 ± 13% interrupts.CPU114.PMI:Performance_monitoring_interrupts 7815 ± 4% +2328.8% 189824 interrupts.CPU114.RES:Rescheduling_interrupts 4518 ± 14% +201.0% 13599 ± 5% interrupts.CPU115.CAL:Function_call_interrupts 555273 +408.2% 2821623 interrupts.CPU115.LOC:Local_timer_interrupts 7879 ± 22% -87.1% 1012 ± 47% interrupts.CPU115.NMI:Non-maskable_interrupts 7879 ± 22% -87.1% 1012 ± 47% interrupts.CPU115.PMI:Performance_monitoring_interrupts 7892 ± 3% +2301.6% 189536 interrupts.CPU115.RES:Rescheduling_interrupts 4516 ± 14% +205.4% 13793 ± 4% interrupts.CPU116.CAL:Function_call_interrupts 555582 +407.7% 2820421 interrupts.CPU116.LOC:Local_timer_interrupts 7876 ± 22% -88.4% 915.67 ± 35% interrupts.CPU116.NMI:Non-maskable_interrupts 7876 ± 22% -88.4% 915.67 ± 35% interrupts.CPU116.PMI:Performance_monitoring_interrupts 8089 ± 4% +2234.2% 188825 interrupts.CPU116.RES:Rescheduling_interrupts 4305 ± 24% +219.2% 13744 ± 4% interrupts.CPU117.CAL:Function_call_interrupts 555576 +407.6% 2820258 interrupts.CPU117.LOC:Local_timer_interrupts 7865 ± 22% -90.3% 762.67 ± 30% interrupts.CPU117.NMI:Non-maskable_interrupts 7865 ± 22% -90.3% 762.67 ± 30% interrupts.CPU117.PMI:Performance_monitoring_interrupts 7840 ± 7% +2313.8% 189243 interrupts.CPU117.RES:Rescheduling_interrupts 6.40 ±112% +1176.0% 81.67 ± 18% interrupts.CPU117.TLB:TLB_shootdowns 4515 ± 14% +205.1% 13779 ± 4% interrupts.CPU118.CAL:Function_call_interrupts 555362 +407.8% 2820248 interrupts.CPU118.LOC:Local_timer_interrupts 7879 ± 22% -86.4% 1068 ± 23% interrupts.CPU118.NMI:Non-maskable_interrupts 7879 ± 22% -86.4% 1068 ± 23% interrupts.CPU118.PMI:Performance_monitoring_interrupts 8087 ± 3% +2230.2% 188465 interrupts.CPU118.RES:Rescheduling_interrupts 4.40 ± 84% +2240.9% 103.00 ± 12% interrupts.CPU118.TLB:TLB_shootdowns 4517 ± 14% +204.5% 13755 ± 4% interrupts.CPU119.CAL:Function_call_interrupts 555082 +408.1% 2820283 interrupts.CPU119.LOC:Local_timer_interrupts 7860 ± 22% -90.8% 725.33 interrupts.CPU119.NMI:Non-maskable_interrupts 7860 ± 22% -90.8% 725.33 interrupts.CPU119.PMI:Performance_monitoring_interrupts 8037 ± 3% +2249.6% 188846 interrupts.CPU119.RES:Rescheduling_interrupts 7.40 ± 86% +3877.5% 294.33 ± 51% interrupts.CPU119.TLB:TLB_shootdowns 461.40 ± 63% +533.1% 2921 ± 67% interrupts.CPU12.34:PCI-MSI.524292-edge.eth0-TxRx-3 4515 ± 13% +205.1% 13775 ± 4% interrupts.CPU12.CAL:Function_call_interrupts 555665 +407.5% 2820270 interrupts.CPU12.LOC:Local_timer_interrupts 7865 ± 22% -87.1% 1017 ± 37% interrupts.CPU12.NMI:Non-maskable_interrupts 7865 ± 22% -87.1% 1017 ± 37% interrupts.CPU12.PMI:Performance_monitoring_interrupts 7981 ± 2% +2289.6% 190722 interrupts.CPU12.RES:Rescheduling_interrupts 4563 ± 14% +203.6% 13854 ± 6% interrupts.CPU120.CAL:Function_call_interrupts 554867 +408.2% 2819581 interrupts.CPU120.LOC:Local_timer_interrupts 7857 ± 22% -93.2% 532.67 ± 14% interrupts.CPU120.NMI:Non-maskable_interrupts 7857 ± 22% -93.2% 532.67 ± 14% interrupts.CPU120.PMI:Performance_monitoring_interrupts 8010 ± 4% +2299.4% 192194 interrupts.CPU120.RES:Rescheduling_interrupts 2.60 ± 99% +3425.6% 91.67 ± 34% interrupts.CPU120.TLB:TLB_shootdowns 4546 ± 14% +207.3% 13971 ± 4% interrupts.CPU121.CAL:Function_call_interrupts 554308 +408.7% 2819603 interrupts.CPU121.LOC:Local_timer_interrupts 7873 ± 22% -89.5% 829.33 ± 31% interrupts.CPU121.NMI:Non-maskable_interrupts 7873 ± 22% -89.5% 829.33 ± 31% interrupts.CPU121.PMI:Performance_monitoring_interrupts 8064 ± 2% +2285.8% 192387 interrupts.CPU121.RES:Rescheduling_interrupts 0.80 ± 93% +11983.3% 96.67 ± 22% interrupts.CPU121.TLB:TLB_shootdowns 4547 ± 14% +207.5% 13984 ± 4% interrupts.CPU122.CAL:Function_call_interrupts 554847 +408.2% 2819879 interrupts.CPU122.LOC:Local_timer_interrupts 7874 ± 22% -91.8% 643.00 ± 39% interrupts.CPU122.NMI:Non-maskable_interrupts 7874 ± 22% -91.8% 643.00 ± 39% interrupts.CPU122.PMI:Performance_monitoring_interrupts 8152 ± 5% +2257.2% 192171 interrupts.CPU122.RES:Rescheduling_interrupts 1.40 ± 72% +6638.1% 94.33 ± 9% interrupts.CPU122.TLB:TLB_shootdowns 4557 ± 14% +206.6% 13971 ± 4% interrupts.CPU123.CAL:Function_call_interrupts 554596 +408.4% 2819512 interrupts.CPU123.LOC:Local_timer_interrupts 7859 ± 22% -91.7% 649.67 ± 24% interrupts.CPU123.NMI:Non-maskable_interrupts 7859 ± 22% -91.7% 649.67 ± 24% interrupts.CPU123.PMI:Performance_monitoring_interrupts 8041 ± 5% +2285.0% 191779 interrupts.CPU123.RES:Rescheduling_interrupts 1.80 ± 88% +4585.2% 84.33 ± 14% interrupts.CPU123.TLB:TLB_shootdowns 4561 ± 14% +206.2% 13967 ± 4% interrupts.CPU124.CAL:Function_call_interrupts 554563 +408.4% 2819651 interrupts.CPU124.LOC:Local_timer_interrupts 7864 ± 22% -93.3% 525.00 ± 18% interrupts.CPU124.NMI:Non-maskable_interrupts 7864 ± 22% -93.3% 525.00 ± 18% interrupts.CPU124.PMI:Performance_monitoring_interrupts 8108 ± 2% +2269.9% 192163 interrupts.CPU124.RES:Rescheduling_interrupts 1.20 ± 81% +7538.9% 91.67 ± 24% interrupts.CPU124.TLB:TLB_shootdowns 4560 ± 14% +206.0% 13956 ± 4% interrupts.CPU125.CAL:Function_call_interrupts 554767 +408.2% 2819571 interrupts.CPU125.LOC:Local_timer_interrupts 7869 ± 22% -92.4% 595.33 ± 30% interrupts.CPU125.NMI:Non-maskable_interrupts 7869 ± 22% -92.4% 595.33 ± 30% interrupts.CPU125.PMI:Performance_monitoring_interrupts 8042 ± 4% +2286.9% 191964 interrupts.CPU125.RES:Rescheduling_interrupts 4552 ± 14% +203.5% 13815 ± 4% interrupts.CPU126.CAL:Function_call_interrupts 554530 +408.5% 2819550 interrupts.CPU126.LOC:Local_timer_interrupts 7863 ± 22% -87.4% 991.00 ± 47% interrupts.CPU126.NMI:Non-maskable_interrupts 7863 ± 22% -87.4% 991.00 ± 47% interrupts.CPU126.PMI:Performance_monitoring_interrupts 8192 ± 3% +2245.2% 192117 interrupts.CPU126.RES:Rescheduling_interrupts 1.00 ± 63% +9400.0% 95.00 ± 4% interrupts.CPU126.TLB:TLB_shootdowns 4550 ± 14% +204.2% 13842 ± 4% interrupts.CPU127.CAL:Function_call_interrupts 554567 +408.4% 2819645 interrupts.CPU127.LOC:Local_timer_interrupts 7872 ± 22% -88.6% 900.33 ± 33% interrupts.CPU127.NMI:Non-maskable_interrupts 7872 ± 22% -88.6% 900.33 ± 33% interrupts.CPU127.PMI:Performance_monitoring_interrupts 8110 ± 3% +2267.4% 192008 interrupts.CPU127.RES:Rescheduling_interrupts 4560 ± 13% +203.8% 13852 ± 4% interrupts.CPU128.CAL:Function_call_interrupts 554645 +408.4% 2819781 interrupts.CPU128.LOC:Local_timer_interrupts 7876 ± 22% -93.5% 512.33 ± 21% interrupts.CPU128.NMI:Non-maskable_interrupts 7876 ± 22% -93.5% 512.33 ± 21% interrupts.CPU128.PMI:Performance_monitoring_interrupts 7876 +2330.2% 191401 interrupts.CPU128.RES:Rescheduling_interrupts 4552 ± 14% +204.1% 13844 ± 4% interrupts.CPU129.CAL:Function_call_interrupts 554550 +408.5% 2819633 interrupts.CPU129.LOC:Local_timer_interrupts 6995 ± 30% -86.5% 943.67 ± 54% interrupts.CPU129.NMI:Non-maskable_interrupts 6995 ± 30% -86.5% 943.67 ± 54% interrupts.CPU129.PMI:Performance_monitoring_interrupts 7992 ± 2% +2291.0% 191087 interrupts.CPU129.RES:Rescheduling_interrupts 4462 ± 16% +207.9% 13740 ± 4% interrupts.CPU13.CAL:Function_call_interrupts 555195 +408.0% 2820184 interrupts.CPU13.LOC:Local_timer_interrupts 8731 -89.2% 945.00 ± 21% interrupts.CPU13.NMI:Non-maskable_interrupts 8731 -89.2% 945.00 ± 21% interrupts.CPU13.PMI:Performance_monitoring_interrupts 8176 ± 3% +2238.6% 191208 interrupts.CPU13.RES:Rescheduling_interrupts 4560 ± 14% +204.9% 13906 ± 4% interrupts.CPU130.CAL:Function_call_interrupts 554575 +408.4% 2819550 interrupts.CPU130.LOC:Local_timer_interrupts 7879 ± 22% -93.2% 539.67 ± 21% interrupts.CPU130.NMI:Non-maskable_interrupts 7879 ± 22% -93.2% 539.67 ± 21% interrupts.CPU130.PMI:Performance_monitoring_interrupts 7892 ± 5% +2323.8% 191288 interrupts.CPU130.RES:Rescheduling_interrupts 4564 ± 14% +204.3% 13887 ± 4% interrupts.CPU131.CAL:Function_call_interrupts 554560 +408.4% 2819535 interrupts.CPU131.LOC:Local_timer_interrupts 7004 ± 30% -91.5% 596.67 ± 13% interrupts.CPU131.NMI:Non-maskable_interrupts 7004 ± 30% -91.5% 596.67 ± 13% interrupts.CPU131.PMI:Performance_monitoring_interrupts 7862 +2332.3% 191225 interrupts.CPU131.RES:Rescheduling_interrupts 4564 ± 14% +204.5% 13898 ± 4% interrupts.CPU132.CAL:Function_call_interrupts 554605 +408.4% 2819554 interrupts.CPU132.LOC:Local_timer_interrupts 7002 ± 30% -90.6% 660.67 ± 13% interrupts.CPU132.NMI:Non-maskable_interrupts 7002 ± 30% -90.6% 660.67 ± 13% interrupts.CPU132.PMI:Performance_monitoring_interrupts 8082 ± 4% +2269.3% 191499 interrupts.CPU132.RES:Rescheduling_interrupts 1.40 ± 72% +6281.0% 89.33 ± 20% interrupts.CPU132.TLB:TLB_shootdowns 4565 ± 14% +204.5% 13901 ± 4% interrupts.CPU133.CAL:Function_call_interrupts 554617 +408.4% 2819573 interrupts.CPU133.LOC:Local_timer_interrupts 6996 ± 30% -92.0% 562.33 ± 36% interrupts.CPU133.NMI:Non-maskable_interrupts 6996 ± 30% -92.0% 562.33 ± 36% interrupts.CPU133.PMI:Performance_monitoring_interrupts 7999 +2295.0% 191578 interrupts.CPU133.RES:Rescheduling_interrupts 2.00 ±126% +4083.3% 83.67 ± 15% interrupts.CPU133.TLB:TLB_shootdowns 4417 ± 13% +214.5% 13891 ± 4% interrupts.CPU134.CAL:Function_call_interrupts 554641 +408.4% 2819648 interrupts.CPU134.LOC:Local_timer_interrupts 6988 ± 30% -91.3% 605.33 ± 46% interrupts.CPU134.NMI:Non-maskable_interrupts 6988 ± 30% -91.3% 605.33 ± 46% interrupts.CPU134.PMI:Performance_monitoring_interrupts 7844 ± 4% +2336.5% 191121 interrupts.CPU134.RES:Rescheduling_interrupts 4.40 ± 42% +1900.0% 88.00 ± 10% interrupts.CPU134.TLB:TLB_shootdowns 4564 ± 14% +204.3% 13889 ± 4% interrupts.CPU135.CAL:Function_call_interrupts 554553 +408.4% 2819610 interrupts.CPU135.LOC:Local_timer_interrupts 6987 ± 30% -93.6% 449.67 ± 35% interrupts.CPU135.NMI:Non-maskable_interrupts 6987 ± 30% -93.6% 449.67 ± 35% interrupts.CPU135.PMI:Performance_monitoring_interrupts 8039 ± 2% +2275.5% 190977 interrupts.CPU135.RES:Rescheduling_interrupts 1.80 ±118% +4585.2% 84.33 ± 14% interrupts.CPU135.TLB:TLB_shootdowns 4567 ± 14% +204.6% 13913 ± 5% interrupts.CPU136.CAL:Function_call_interrupts 554716 +408.3% 2819614 interrupts.CPU136.LOC:Local_timer_interrupts 7001 ± 30% -87.8% 855.33 ± 47% interrupts.CPU136.NMI:Non-maskable_interrupts 7001 ± 30% -87.8% 855.33 ± 47% interrupts.CPU136.PMI:Performance_monitoring_interrupts 8003 ± 2% +2279.8% 190463 interrupts.CPU136.RES:Rescheduling_interrupts 2.00 ± 77% +4600.0% 94.00 ± 7% interrupts.CPU136.TLB:TLB_shootdowns 4566 ± 14% +204.4% 13899 ± 5% interrupts.CPU137.CAL:Function_call_interrupts 554572 +408.4% 2819530 interrupts.CPU137.LOC:Local_timer_interrupts 6995 ± 30% -88.1% 834.67 ± 43% interrupts.CPU137.NMI:Non-maskable_interrupts 6995 ± 30% -88.1% 834.67 ± 43% interrupts.CPU137.PMI:Performance_monitoring_interrupts 7684 ± 4% +2382.1% 190728 interrupts.CPU137.RES:Rescheduling_interrupts 4.80 ±128% +1816.7% 92.00 ± 21% interrupts.CPU137.TLB:TLB_shootdowns 4566 ± 14% +205.6% 13954 ± 4% interrupts.CPU138.CAL:Function_call_interrupts 554716 +408.3% 2819569 interrupts.CPU138.LOC:Local_timer_interrupts 7890 ± 22% -91.8% 647.67 ± 28% interrupts.CPU138.NMI:Non-maskable_interrupts 7890 ± 22% -91.8% 647.67 ± 28% interrupts.CPU138.PMI:Performance_monitoring_interrupts 7995 ± 5% +2281.0% 190383 interrupts.CPU138.RES:Rescheduling_interrupts 2.20 ± 78% +5021.2% 112.67 ± 32% interrupts.CPU138.TLB:TLB_shootdowns 4602 ± 14% +202.8% 13936 ± 4% interrupts.CPU139.CAL:Function_call_interrupts 554662 +408.3% 2819580 interrupts.CPU139.LOC:Local_timer_interrupts 7866 ± 22% -93.9% 478.33 ± 9% interrupts.CPU139.NMI:Non-maskable_interrupts 7866 ± 22% -93.9% 478.33 ± 9% interrupts.CPU139.PMI:Performance_monitoring_interrupts 7936 ± 3% +2298.9% 190377 interrupts.CPU139.RES:Rescheduling_interrupts 5.60 ±110% +1513.1% 90.33 ± 8% interrupts.CPU139.TLB:TLB_shootdowns 4436 ± 13% +210.0% 13753 ± 4% interrupts.CPU14.CAL:Function_call_interrupts 555101 +408.0% 2820186 interrupts.CPU14.LOC:Local_timer_interrupts 8724 -87.4% 1102 ± 47% interrupts.CPU14.NMI:Non-maskable_interrupts 8724 -87.4% 1102 ± 47% interrupts.CPU14.PMI:Performance_monitoring_interrupts 7779 ± 4% +2355.6% 191038 interrupts.CPU14.RES:Rescheduling_interrupts 4562 ± 14% +208.5% 14077 ± 6% interrupts.CPU140.CAL:Function_call_interrupts 554560 +408.5% 2819683 interrupts.CPU140.LOC:Local_timer_interrupts 7853 ± 22% -90.4% 750.33 ± 26% interrupts.CPU140.NMI:Non-maskable_interrupts 7853 ± 22% -90.4% 750.33 ± 26% interrupts.CPU140.PMI:Performance_monitoring_interrupts 8046 ± 5% +2264.6% 190257 interrupts.CPU140.RES:Rescheduling_interrupts 4.20 ±140% +2439.7% 106.67 ± 16% interrupts.CPU140.TLB:TLB_shootdowns 4563 ± 14% +208.2% 14065 ± 6% interrupts.CPU141.CAL:Function_call_interrupts 554688 +408.3% 2819558 interrupts.CPU141.LOC:Local_timer_interrupts 7865 ± 22% -90.9% 717.00 ± 37% interrupts.CPU141.NMI:Non-maskable_interrupts 7865 ± 22% -90.9% 717.00 ± 37% interrupts.CPU141.PMI:Performance_monitoring_interrupts 8219 ± 3% +2214.6% 190238 interrupts.CPU141.RES:Rescheduling_interrupts 6.60 ±132% +1248.5% 89.00 ± 27% interrupts.CPU141.TLB:TLB_shootdowns 4561 ± 14% +208.1% 14054 ± 6% interrupts.CPU142.CAL:Function_call_interrupts 554535 +408.5% 2819570 interrupts.CPU142.LOC:Local_timer_interrupts 7861 ± 22% -92.0% 626.00 ± 52% interrupts.CPU142.NMI:Non-maskable_interrupts 7861 ± 22% -92.0% 626.00 ± 52% interrupts.CPU142.PMI:Performance_monitoring_interrupts 8079 ± 2% +2255.0% 190280 interrupts.CPU142.RES:Rescheduling_interrupts 1.40 ± 72% +7042.9% 100.00 ± 21% interrupts.CPU142.TLB:TLB_shootdowns 4571 ± 14% +206.5% 14011 ± 6% interrupts.CPU143.CAL:Function_call_interrupts 554921 +408.1% 2819563 interrupts.CPU143.LOC:Local_timer_interrupts 7870 ± 22% -92.3% 609.33 ± 20% interrupts.CPU143.NMI:Non-maskable_interrupts 7870 ± 22% -92.3% 609.33 ± 20% interrupts.CPU143.PMI:Performance_monitoring_interrupts 7927 ± 4% +2300.2% 190275 interrupts.CPU143.RES:Rescheduling_interrupts 7.40 ±150% +4368.5% 330.67 ± 15% interrupts.CPU143.TLB:TLB_shootdowns 4533 ± 14% +198.5% 13533 ± 6% interrupts.CPU144.CAL:Function_call_interrupts 554661 +408.4% 2820083 interrupts.CPU144.LOC:Local_timer_interrupts 8740 -87.3% 1108 ± 18% interrupts.CPU144.NMI:Non-maskable_interrupts 8740 -87.3% 1108 ± 18% interrupts.CPU144.PMI:Performance_monitoring_interrupts 7795 ± 2% +2379.5% 193293 interrupts.CPU144.RES:Rescheduling_interrupts 3.20 ± 50% +2452.1% 81.67 ± 21% interrupts.CPU144.TLB:TLB_shootdowns 4531 ± 14% +200.4% 13610 ± 6% interrupts.CPU145.CAL:Function_call_interrupts 554512 +408.5% 2819728 interrupts.CPU145.LOC:Local_timer_interrupts 8733 -91.6% 733.00 ± 24% interrupts.CPU145.NMI:Non-maskable_interrupts 8733 -91.6% 733.00 ± 24% interrupts.CPU145.PMI:Performance_monitoring_interrupts 8090 ± 2% +2289.1% 193295 interrupts.CPU145.RES:Rescheduling_interrupts 0.60 ±133% +15400.0% 93.00 ± 19% interrupts.CPU145.TLB:TLB_shootdowns 4529 ± 14% +204.5% 13790 ± 5% interrupts.CPU146.CAL:Function_call_interrupts 554635 +408.4% 2819827 interrupts.CPU146.LOC:Local_timer_interrupts 8734 -92.0% 696.67 ± 9% interrupts.CPU146.NMI:Non-maskable_interrupts 8734 -92.0% 696.67 ± 9% interrupts.CPU146.PMI:Performance_monitoring_interrupts 8130 ± 3% +2272.4% 192888 interrupts.CPU146.RES:Rescheduling_interrupts 1.40 ± 72% +6685.7% 95.00 ± 6% interrupts.CPU146.TLB:TLB_shootdowns 4530 ± 14% +205.4% 13836 ± 5% interrupts.CPU147.CAL:Function_call_interrupts 554645 +408.4% 2819827 interrupts.CPU147.LOC:Local_timer_interrupts 8754 -91.6% 735.00 ± 18% interrupts.CPU147.NMI:Non-maskable_interrupts 8754 -91.6% 735.00 ± 18% interrupts.CPU147.PMI:Performance_monitoring_interrupts 8002 ± 3% +2305.7% 192503 interrupts.CPU147.RES:Rescheduling_interrupts 4529 ± 14% +200.6% 13615 ± 4% interrupts.CPU148.CAL:Function_call_interrupts 554586 +408.4% 2819758 interrupts.CPU148.LOC:Local_timer_interrupts 8743 -91.6% 737.00 ± 8% interrupts.CPU148.NMI:Non-maskable_interrupts 8743 -91.6% 737.00 ± 8% interrupts.CPU148.PMI:Performance_monitoring_interrupts 8225 ± 2% +2236.5% 192196 interrupts.CPU148.RES:Rescheduling_interrupts 4568 ± 14% +200.8% 13740 ± 6% interrupts.CPU149.CAL:Function_call_interrupts 555131 +407.9% 2819760 interrupts.CPU149.LOC:Local_timer_interrupts 8723 -91.3% 757.67 ± 16% interrupts.CPU149.NMI:Non-maskable_interrupts 8723 -91.3% 757.67 ± 16% interrupts.CPU149.PMI:Performance_monitoring_interrupts 8051 ± 2% +2281.3% 191734 interrupts.CPU149.RES:Rescheduling_interrupts 4513 ± 13% +204.6% 13746 ± 4% interrupts.CPU15.CAL:Function_call_interrupts 555347 +407.9% 2820476 interrupts.CPU15.LOC:Local_timer_interrupts 8727 -89.4% 921.67 ± 12% interrupts.CPU15.NMI:Non-maskable_interrupts 8727 -89.4% 921.67 ± 12% interrupts.CPU15.PMI:Performance_monitoring_interrupts 8093 ± 3% +2248.1% 190030 interrupts.CPU15.RES:Rescheduling_interrupts 3.00 ±117% +2988.9% 92.67 ± 12% interrupts.CPU15.TLB:TLB_shootdowns 4519 ± 14% +202.8% 13686 ± 4% interrupts.CPU150.CAL:Function_call_interrupts 554705 +408.3% 2819767 interrupts.CPU150.LOC:Local_timer_interrupts 8738 -91.4% 753.00 ± 17% interrupts.CPU150.NMI:Non-maskable_interrupts 8738 -91.4% 753.00 ± 17% interrupts.CPU150.PMI:Performance_monitoring_interrupts 8140 ± 2% +2264.8% 192506 interrupts.CPU150.RES:Rescheduling_interrupts 0.40 ±122% +24233.3% 97.33 ± 15% interrupts.CPU150.TLB:TLB_shootdowns 4515 ± 14% +202.8% 13674 ± 5% interrupts.CPU151.CAL:Function_call_interrupts 554757 +408.3% 2819717 interrupts.CPU151.LOC:Local_timer_interrupts 8740 -90.4% 842.00 ± 25% interrupts.CPU151.NMI:Non-maskable_interrupts 8740 -90.4% 842.00 ± 25% interrupts.CPU151.PMI:Performance_monitoring_interrupts 8197 ± 2% +2246.9% 192394 interrupts.CPU151.RES:Rescheduling_interrupts 2.20 ± 88% +4203.0% 94.67 ± 20% interrupts.CPU151.TLB:TLB_shootdowns 4516 ± 14% +207.4% 13883 ± 4% interrupts.CPU152.CAL:Function_call_interrupts 554530 +408.5% 2819772 interrupts.CPU152.LOC:Local_timer_interrupts 8752 -90.7% 816.67 ± 31% interrupts.CPU152.NMI:Non-maskable_interrupts 8752 -90.7% 816.67 ± 31% interrupts.CPU152.PMI:Performance_monitoring_interrupts 8141 ± 2% +2261.7% 192267 interrupts.CPU152.RES:Rescheduling_interrupts 4517 ± 14% +206.7% 13853 ± 4% interrupts.CPU153.CAL:Function_call_interrupts 554597 +408.4% 2819772 interrupts.CPU153.LOC:Local_timer_interrupts 8723 -91.5% 744.00 ± 31% interrupts.CPU153.NMI:Non-maskable_interrupts 8723 -91.5% 744.00 ± 31% interrupts.CPU153.PMI:Performance_monitoring_interrupts 8022 ± 4% +2292.1% 191892 interrupts.CPU153.RES:Rescheduling_interrupts 1.80 ±146% +4566.7% 84.00 ± 17% interrupts.CPU153.TLB:TLB_shootdowns 4517 ± 14% +203.0% 13689 ± 4% interrupts.CPU154.CAL:Function_call_interrupts 554584 +408.4% 2819592 interrupts.CPU154.LOC:Local_timer_interrupts 8730 -92.5% 655.00 ± 37% interrupts.CPU154.NMI:Non-maskable_interrupts 8730 -92.5% 655.00 ± 37% interrupts.CPU154.PMI:Performance_monitoring_interrupts 8066 ± 2% +2281.1% 192070 interrupts.CPU154.RES:Rescheduling_interrupts 4516 ± 14% +207.6% 13893 ± 4% interrupts.CPU155.CAL:Function_call_interrupts 554514 +408.5% 2819732 interrupts.CPU155.LOC:Local_timer_interrupts 8737 -88.2% 1031 ± 20% interrupts.CPU155.NMI:Non-maskable_interrupts 8737 -88.2% 1031 ± 20% interrupts.CPU155.PMI:Performance_monitoring_interrupts 8225 ± 2% +2240.5% 192525 interrupts.CPU155.RES:Rescheduling_interrupts 1.00 ± 89% +8200.0% 83.00 ± 14% interrupts.CPU155.TLB:TLB_shootdowns 4520 ± 14% +206.6% 13861 ± 5% interrupts.CPU156.CAL:Function_call_interrupts 554640 +408.4% 2819785 interrupts.CPU156.LOC:Local_timer_interrupts 8739 -91.0% 787.33 ± 23% interrupts.CPU156.NMI:Non-maskable_interrupts 8739 -91.0% 787.33 ± 23% interrupts.CPU156.PMI:Performance_monitoring_interrupts 8043 +2291.8% 192373 interrupts.CPU156.RES:Rescheduling_interrupts 4.20 ± 83% +2114.3% 93.00 ± 31% interrupts.CPU156.TLB:TLB_shootdowns 4524 ± 14% +205.3% 13812 ± 4% interrupts.CPU157.CAL:Function_call_interrupts 554650 +408.4% 2819730 interrupts.CPU157.LOC:Local_timer_interrupts 8739 -90.5% 833.00 ± 7% interrupts.CPU157.NMI:Non-maskable_interrupts 8739 -90.5% 833.00 ± 7% interrupts.CPU157.PMI:Performance_monitoring_interrupts 7808 ± 2% +2360.5% 192136 interrupts.CPU157.RES:Rescheduling_interrupts 1.00 ± 89% +8933.3% 90.33 ± 10% interrupts.CPU157.TLB:TLB_shootdowns 4523 ± 14% +206.0% 13841 ± 4% interrupts.CPU158.CAL:Function_call_interrupts 554587 +408.4% 2819719 interrupts.CPU158.LOC:Local_timer_interrupts 8736 -90.0% 872.00 ± 7% interrupts.CPU158.NMI:Non-maskable_interrupts 8736 -90.0% 872.00 ± 7% interrupts.CPU158.PMI:Performance_monitoring_interrupts 8141 ± 3% +2258.8% 192045 interrupts.CPU158.RES:Rescheduling_interrupts 4519 ± 14% +204.4% 13759 ± 4% interrupts.CPU159.CAL:Function_call_interrupts 554815 +408.2% 2819699 interrupts.CPU159.LOC:Local_timer_interrupts 8743 -91.0% 790.00 ± 26% interrupts.CPU159.NMI:Non-maskable_interrupts 8743 -91.0% 790.00 ± 26% interrupts.CPU159.PMI:Performance_monitoring_interrupts 8163 ± 3% +2244.3% 191375 interrupts.CPU159.RES:Rescheduling_interrupts 1.80 ± 64% +5233.3% 96.00 ± 8% interrupts.CPU159.TLB:TLB_shootdowns 4513 ± 13% +204.9% 13764 ± 4% interrupts.CPU16.CAL:Function_call_interrupts 554864 +408.3% 2820297 interrupts.CPU16.LOC:Local_timer_interrupts 8743 -87.4% 1097 ± 41% interrupts.CPU16.NMI:Non-maskable_interrupts 8743 -87.4% 1097 ± 41% interrupts.CPU16.PMI:Performance_monitoring_interrupts 8131 ± 4% +2237.6% 190067 interrupts.CPU16.RES:Rescheduling_interrupts 1.80 ± 95% +4400.0% 81.00 ± 18% interrupts.CPU16.TLB:TLB_shootdowns 4524 ± 14% +203.2% 13715 ± 4% interrupts.CPU160.CAL:Function_call_interrupts 554578 +408.4% 2819718 interrupts.CPU160.LOC:Local_timer_interrupts 8731 -91.7% 722.00 ± 18% interrupts.CPU160.NMI:Non-maskable_interrupts 8731 -91.7% 722.00 ± 18% interrupts.CPU160.PMI:Performance_monitoring_interrupts 7932 ± 2% +2312.6% 191367 interrupts.CPU160.RES:Rescheduling_interrupts 2.00 ± 70% +5316.7% 108.33 ± 14% interrupts.CPU160.TLB:TLB_shootdowns 4522 ± 14% +205.2% 13802 ± 4% interrupts.CPU161.CAL:Function_call_interrupts 554559 +408.5% 2819704 interrupts.CPU161.LOC:Local_timer_interrupts 8740 -92.0% 697.67 ± 21% interrupts.CPU161.NMI:Non-maskable_interrupts 8740 -92.0% 697.67 ± 21% interrupts.CPU161.PMI:Performance_monitoring_interrupts 8113 ± 2% +2258.0% 191313 interrupts.CPU161.RES:Rescheduling_interrupts 4562 ± 14% +205.8% 13950 ± 4% interrupts.CPU162.CAL:Function_call_interrupts 554735 +408.3% 2819787 interrupts.CPU162.LOC:Local_timer_interrupts 8731 -88.6% 991.33 ± 28% interrupts.CPU162.NMI:Non-maskable_interrupts 8731 -88.6% 991.33 ± 28% interrupts.CPU162.PMI:Performance_monitoring_interrupts 7973 ± 3% +2301.3% 191461 interrupts.CPU162.RES:Rescheduling_interrupts 4537 ± 14% +203.8% 13785 ± 5% interrupts.CPU163.CAL:Function_call_interrupts 554604 +408.4% 2819754 interrupts.CPU163.LOC:Local_timer_interrupts 8729 -91.3% 761.67 ± 12% interrupts.CPU163.NMI:Non-maskable_interrupts 8729 -91.3% 761.67 ± 12% interrupts.CPU163.PMI:Performance_monitoring_interrupts 8007 ± 5% +2283.9% 190883 interrupts.CPU163.RES:Rescheduling_interrupts 5.20 ±152% +1515.4% 84.00 ± 15% interrupts.CPU163.TLB:TLB_shootdowns 4527 ± 14% +203.4% 13736 ± 4% interrupts.CPU164.CAL:Function_call_interrupts 554117 +408.9% 2819880 interrupts.CPU164.LOC:Local_timer_interrupts 8741 -92.0% 703.00 ± 23% interrupts.CPU164.NMI:Non-maskable_interrupts 8741 -92.0% 703.00 ± 23% interrupts.CPU164.PMI:Performance_monitoring_interrupts 8062 ± 3% +2265.2% 190694 interrupts.CPU164.RES:Rescheduling_interrupts 6.00 ±167% +1638.9% 104.33 ± 20% interrupts.CPU164.TLB:TLB_shootdowns 4527 ± 14% +203.3% 13731 ± 3% interrupts.CPU165.CAL:Function_call_interrupts 554683 +408.4% 2819739 interrupts.CPU165.LOC:Local_timer_interrupts 8764 -90.0% 878.67 ± 18% interrupts.CPU165.NMI:Non-maskable_interrupts 8764 -90.0% 878.67 ± 18% interrupts.CPU165.PMI:Performance_monitoring_interrupts 8018 ± 2% +2277.0% 190596 interrupts.CPU165.RES:Rescheduling_interrupts 7.60 ± 45% +1145.6% 94.67 ± 6% interrupts.CPU165.TLB:TLB_shootdowns 4542 ± 13% +201.4% 13691 ± 3% interrupts.CPU166.CAL:Function_call_interrupts 554637 +408.4% 2819722 interrupts.CPU166.LOC:Local_timer_interrupts 8745 -93.3% 585.67 ± 5% interrupts.CPU166.NMI:Non-maskable_interrupts 8745 -93.3% 585.67 ± 5% interrupts.CPU166.PMI:Performance_monitoring_interrupts 7925 ± 3% +2298.9% 190116 interrupts.CPU166.RES:Rescheduling_interrupts 3.40 ± 54% +3007.8% 105.67 ± 7% interrupts.CPU166.TLB:TLB_shootdowns 4526 ± 14% +203.3% 13728 ± 3% interrupts.CPU167.CAL:Function_call_interrupts 554545 +408.5% 2819727 interrupts.CPU167.LOC:Local_timer_interrupts 8743 -90.2% 858.00 ± 46% interrupts.CPU167.NMI:Non-maskable_interrupts 8743 -90.2% 858.00 ± 46% interrupts.CPU167.PMI:Performance_monitoring_interrupts 8190 ± 4% +2232.0% 191004 interrupts.CPU167.RES:Rescheduling_interrupts 7.00 ± 70% +3609.5% 259.67 ± 2% interrupts.CPU167.TLB:TLB_shootdowns 4566 ± 14% +209.4% 14128 ± 3% interrupts.CPU168.CAL:Function_call_interrupts 554848 +408.3% 2820323 interrupts.CPU168.LOC:Local_timer_interrupts 8738 -93.1% 602.33 ± 30% interrupts.CPU168.NMI:Non-maskable_interrupts 8738 -93.1% 602.33 ± 30% interrupts.CPU168.PMI:Performance_monitoring_interrupts 7804 ± 2% +2333.5% 189920 ± 2% interrupts.CPU168.RES:Rescheduling_interrupts 4563 ± 14% +209.5% 14126 ± 3% interrupts.CPU169.CAL:Function_call_interrupts 555373 +407.8% 2820235 interrupts.CPU169.LOC:Local_timer_interrupts 7867 ± 21% -93.9% 482.33 ± 45% interrupts.CPU169.NMI:Non-maskable_interrupts 7867 ± 21% -93.9% 482.33 ± 45% interrupts.CPU169.PMI:Performance_monitoring_interrupts 7907 ± 3% +2312.5% 190755 ± 2% interrupts.CPU169.RES:Rescheduling_interrupts 4516 ± 14% +204.3% 13743 ± 4% interrupts.CPU17.CAL:Function_call_interrupts 555270 +408.0% 2820560 interrupts.CPU17.LOC:Local_timer_interrupts 6976 ± 30% -89.8% 713.67 ± 29% interrupts.CPU17.NMI:Non-maskable_interrupts 6976 ± 30% -89.8% 713.67 ± 29% interrupts.CPU17.PMI:Performance_monitoring_interrupts 8129 ± 4% +2242.0% 190399 interrupts.CPU17.RES:Rescheduling_interrupts 4.20 ± 64% +2154.0% 94.67 ± 6% interrupts.CPU17.TLB:TLB_shootdowns 4563 ± 14% +209.3% 14114 ± 3% interrupts.CPU170.CAL:Function_call_interrupts 555220 +407.9% 2820054 interrupts.CPU170.LOC:Local_timer_interrupts 7857 ± 22% -81.6% 1445 ± 93% interrupts.CPU170.NMI:Non-maskable_interrupts 7857 ± 22% -81.6% 1445 ± 93% interrupts.CPU170.PMI:Performance_monitoring_interrupts 8151 ± 3% +2223.8% 189422 ± 2% interrupts.CPU170.RES:Rescheduling_interrupts 4550 ± 14% +210.3% 14120 ± 3% interrupts.CPU171.CAL:Function_call_interrupts 555144 +408.0% 2820092 interrupts.CPU171.LOC:Local_timer_interrupts 7872 ± 22% -91.9% 636.33 ± 24% interrupts.CPU171.NMI:Non-maskable_interrupts 7872 ± 22% -91.9% 636.33 ± 24% interrupts.CPU171.PMI:Performance_monitoring_interrupts 7994 ± 5% +2256.7% 188410 ± 2% interrupts.CPU171.RES:Rescheduling_interrupts 1.60 ± 63% +4900.0% 80.00 ± 27% interrupts.CPU171.TLB:TLB_shootdowns 4562 ± 14% +209.4% 14117 ± 3% interrupts.CPU172.CAL:Function_call_interrupts 555587 +407.6% 2820050 interrupts.CPU172.LOC:Local_timer_interrupts 7859 ± 22% -93.0% 549.33 ± 17% interrupts.CPU172.NMI:Non-maskable_interrupts 7859 ± 22% -93.0% 549.33 ± 17% interrupts.CPU172.PMI:Performance_monitoring_interrupts 8010 ± 3% +2270.9% 189925 ± 2% interrupts.CPU172.RES:Rescheduling_interrupts 4578 ± 13% +208.0% 14102 ± 3% interrupts.CPU173.CAL:Function_call_interrupts 554737 +408.4% 2820299 interrupts.CPU173.LOC:Local_timer_interrupts 7879 ± 22% -94.4% 443.00 ± 26% interrupts.CPU173.NMI:Non-maskable_interrupts 7879 ± 22% -94.4% 443.00 ± 26% interrupts.CPU173.PMI:Performance_monitoring_interrupts 8011 +2273.3% 190121 ± 2% interrupts.CPU173.RES:Rescheduling_interrupts 3.00 ± 76% +2477.8% 77.33 ± 24% interrupts.CPU173.TLB:TLB_shootdowns 4609 ± 14% +206.1% 14109 ± 3% interrupts.CPU174.CAL:Function_call_interrupts 554936 +408.2% 2820412 interrupts.CPU174.LOC:Local_timer_interrupts 7867 ± 22% -92.5% 588.33 ± 28% interrupts.CPU174.NMI:Non-maskable_interrupts 7867 ± 22% -92.5% 588.33 ± 28% interrupts.CPU174.PMI:Performance_monitoring_interrupts 7901 ± 3% +2288.3% 188709 ± 3% interrupts.CPU174.RES:Rescheduling_interrupts 1.00 ± 63% +8900.0% 90.00 ± 31% interrupts.CPU174.TLB:TLB_shootdowns 4582 ± 13% +207.7% 14101 ± 3% interrupts.CPU175.CAL:Function_call_interrupts 554840 +408.3% 2820172 interrupts.CPU175.LOC:Local_timer_interrupts 6984 ± 30% -93.0% 487.33 ± 15% interrupts.CPU175.NMI:Non-maskable_interrupts 6984 ± 30% -93.0% 487.33 ± 15% interrupts.CPU175.PMI:Performance_monitoring_interrupts 7923 ± 2% +2307.8% 190782 ± 2% interrupts.CPU175.RES:Rescheduling_interrupts 4581 ± 13% +207.2% 14076 ± 3% interrupts.CPU176.CAL:Function_call_interrupts 554926 +408.2% 2820156 interrupts.CPU176.LOC:Local_timer_interrupts 7848 ± 22% -95.4% 361.00 ± 13% interrupts.CPU176.NMI:Non-maskable_interrupts 7848 ± 22% -95.4% 361.00 ± 13% interrupts.CPU176.PMI:Performance_monitoring_interrupts 7924 ± 2% +2290.2% 189412 ± 2% interrupts.CPU176.RES:Rescheduling_interrupts 0.60 ±133% +13344.4% 80.67 ± 26% interrupts.CPU176.TLB:TLB_shootdowns 4581 ± 13% +209.1% 14162 ± 4% interrupts.CPU177.CAL:Function_call_interrupts 554917 +408.2% 2820120 interrupts.CPU177.LOC:Local_timer_interrupts 7864 ± 22% -93.3% 528.00 ± 25% interrupts.CPU177.NMI:Non-maskable_interrupts 7864 ± 22% -93.3% 528.00 ± 25% interrupts.CPU177.PMI:Performance_monitoring_interrupts 7893 ± 3% +2288.2% 188501 ± 2% interrupts.CPU177.RES:Rescheduling_interrupts 4591 ± 13% +208.6% 14167 ± 4% interrupts.CPU178.CAL:Function_call_interrupts 555522 +407.6% 2820050 interrupts.CPU178.LOC:Local_timer_interrupts 7864 ± 22% -95.6% 343.00 ± 14% interrupts.CPU178.NMI:Non-maskable_interrupts 7864 ± 22% -95.6% 343.00 ± 14% interrupts.CPU178.PMI:Performance_monitoring_interrupts 7710 ± 3% +2338.4% 188000 ± 2% interrupts.CPU178.RES:Rescheduling_interrupts 4599 ± 13% +209.2% 14221 ± 3% interrupts.CPU179.CAL:Function_call_interrupts 554984 +408.2% 2820290 interrupts.CPU179.LOC:Local_timer_interrupts 7872 ± 22% -92.6% 584.67 ± 67% interrupts.CPU179.NMI:Non-maskable_interrupts 7872 ± 22% -92.6% 584.67 ± 67% interrupts.CPU179.PMI:Performance_monitoring_interrupts 7791 ± 2% +2347.3% 190675 interrupts.CPU179.RES:Rescheduling_interrupts 4504 ± 14% +207.5% 13851 ± 4% interrupts.CPU18.CAL:Function_call_interrupts 555106 +408.1% 2820372 interrupts.CPU18.LOC:Local_timer_interrupts 6986 ± 30% -79.8% 1411 ± 41% interrupts.CPU18.NMI:Non-maskable_interrupts 6986 ± 30% -79.8% 1411 ± 41% interrupts.CPU18.PMI:Performance_monitoring_interrupts 7900 ± 3% +2294.9% 189207 ± 2% interrupts.CPU18.RES:Rescheduling_interrupts 3.40 ±128% +2625.5% 92.67 ± 25% interrupts.CPU18.TLB:TLB_shootdowns 4598 ± 13% +209.0% 14211 ± 4% interrupts.CPU180.CAL:Function_call_interrupts 554799 +408.4% 2820326 interrupts.CPU180.LOC:Local_timer_interrupts 7863 ± 22% -91.8% 648.67 ± 43% interrupts.CPU180.NMI:Non-maskable_interrupts 7863 ± 22% -91.8% 648.67 ± 43% interrupts.CPU180.PMI:Performance_monitoring_interrupts 7916 ± 4% +2241.7% 185387 ± 4% interrupts.CPU180.RES:Rescheduling_interrupts 2.40 ± 85% +4413.9% 108.33 ± 41% interrupts.CPU180.TLB:TLB_shootdowns 4598 ± 13% +208.9% 14204 ± 4% interrupts.CPU181.CAL:Function_call_interrupts 554943 +408.2% 2820174 interrupts.CPU181.LOC:Local_timer_interrupts 7864 ± 22% -94.2% 454.00 ± 26% interrupts.CPU181.NMI:Non-maskable_interrupts 7864 ± 22% -94.2% 454.00 ± 26% interrupts.CPU181.PMI:Performance_monitoring_interrupts 7969 ± 4% +2268.6% 188764 ± 3% interrupts.CPU181.RES:Rescheduling_interrupts 4610 ± 13% +208.1% 14205 ± 4% interrupts.CPU182.CAL:Function_call_interrupts 554934 +408.2% 2820304 interrupts.CPU182.LOC:Local_timer_interrupts 7859 ± 22% -93.3% 526.00 ± 35% interrupts.CPU182.NMI:Non-maskable_interrupts 7859 ± 22% -93.3% 526.00 ± 35% interrupts.CPU182.PMI:Performance_monitoring_interrupts 7853 ± 5% +2290.5% 187729 ± 2% interrupts.CPU182.RES:Rescheduling_interrupts 2.20 ± 72% +3460.6% 78.33 ± 29% interrupts.CPU182.TLB:TLB_shootdowns 4588 ± 13% +209.1% 14183 ± 4% interrupts.CPU183.CAL:Function_call_interrupts 555162 +408.0% 2820136 interrupts.CPU183.LOC:Local_timer_interrupts 7871 ± 22% -92.4% 597.00 ± 61% interrupts.CPU183.NMI:Non-maskable_interrupts 7871 ± 22% -92.4% 597.00 ± 61% interrupts.CPU183.PMI:Performance_monitoring_interrupts 8175 ± 4% +2215.3% 189276 interrupts.CPU183.RES:Rescheduling_interrupts 4589 ± 13% +209.2% 14193 ± 4% interrupts.CPU184.CAL:Function_call_interrupts 555171 +407.9% 2819964 interrupts.CPU184.LOC:Local_timer_interrupts 7867 ± 22% -92.7% 577.33 ± 47% interrupts.CPU184.NMI:Non-maskable_interrupts 7867 ± 22% -92.7% 577.33 ± 47% interrupts.CPU184.PMI:Performance_monitoring_interrupts 8042 ± 2% +2237.8% 188019 ± 2% interrupts.CPU184.RES:Rescheduling_interrupts 4601 ± 13% +208.3% 14183 ± 4% interrupts.CPU185.CAL:Function_call_interrupts 554893 +408.2% 2820227 interrupts.CPU185.LOC:Local_timer_interrupts 7874 ± 22% -92.2% 614.67 ± 62% interrupts.CPU185.NMI:Non-maskable_interrupts 7874 ± 22% -92.2% 614.67 ± 62% interrupts.CPU185.PMI:Performance_monitoring_interrupts 7868 ± 4% +2297.5% 188656 ± 2% interrupts.CPU185.RES:Rescheduling_interrupts 4594 ± 13% +208.5% 14174 ± 4% interrupts.CPU186.CAL:Function_call_interrupts 555272 +407.9% 2819951 interrupts.CPU186.LOC:Local_timer_interrupts 7865 ± 22% -91.2% 689.33 ± 33% interrupts.CPU186.NMI:Non-maskable_interrupts 7865 ± 22% -91.2% 689.33 ± 33% interrupts.CPU186.PMI:Performance_monitoring_interrupts 7853 ± 3% +2279.3% 186846 ± 2% interrupts.CPU186.RES:Rescheduling_interrupts 1.20 ± 62% +6483.3% 79.00 ± 27% interrupts.CPU186.TLB:TLB_shootdowns 4594 ± 13% +208.6% 14178 ± 4% interrupts.CPU187.CAL:Function_call_interrupts 554810 +408.3% 2820028 interrupts.CPU187.LOC:Local_timer_interrupts 7874 ± 22% -92.0% 627.67 ± 46% interrupts.CPU187.NMI:Non-maskable_interrupts 7874 ± 22% -92.0% 627.67 ± 46% interrupts.CPU187.PMI:Performance_monitoring_interrupts 7985 ± 2% +2247.5% 187458 ± 2% interrupts.CPU187.RES:Rescheduling_interrupts 4593 ± 13% +208.5% 14169 ± 4% interrupts.CPU188.CAL:Function_call_interrupts 554651 +408.4% 2820050 interrupts.CPU188.LOC:Local_timer_interrupts 7886 ± 22% -87.4% 991.67 ± 43% interrupts.CPU188.NMI:Non-maskable_interrupts 7886 ± 22% -87.4% 991.67 ± 43% interrupts.CPU188.PMI:Performance_monitoring_interrupts 8019 ± 6% +2252.3% 188647 ± 2% interrupts.CPU188.RES:Rescheduling_interrupts 2.60 ± 86% +3271.8% 87.67 ± 24% interrupts.CPU188.TLB:TLB_shootdowns 4581 ± 13% +209.4% 14176 ± 4% interrupts.CPU189.CAL:Function_call_interrupts 554811 +408.3% 2820011 interrupts.CPU189.LOC:Local_timer_interrupts 7874 ± 22% -90.2% 768.00 ± 6% interrupts.CPU189.NMI:Non-maskable_interrupts 7874 ± 22% -90.2% 768.00 ± 6% interrupts.CPU189.PMI:Performance_monitoring_interrupts 8102 ± 5% +2204.7% 186730 ± 3% interrupts.CPU189.RES:Rescheduling_interrupts 4434 ± 14% +212.9% 13874 ± 4% interrupts.CPU19.CAL:Function_call_interrupts 555530 +407.7% 2820281 interrupts.CPU19.LOC:Local_timer_interrupts 7010 ± 30% -76.6% 1644 ± 84% interrupts.CPU19.NMI:Non-maskable_interrupts 7010 ± 30% -76.6% 1644 ± 84% interrupts.CPU19.PMI:Performance_monitoring_interrupts 7948 ± 3% +2304.7% 191124 interrupts.CPU19.RES:Rescheduling_interrupts 4581 ± 13% +209.1% 14164 ± 4% interrupts.CPU190.CAL:Function_call_interrupts 554755 +408.4% 2820252 interrupts.CPU190.LOC:Local_timer_interrupts 7870 ± 22% -83.9% 1268 ± 60% interrupts.CPU190.NMI:Non-maskable_interrupts 7870 ± 22% -83.9% 1268 ± 60% interrupts.CPU190.PMI:Performance_monitoring_interrupts 8022 ± 2% +2235.8% 187383 ± 2% interrupts.CPU190.RES:Rescheduling_interrupts 5.20 ±132% +1669.2% 92.00 ± 32% interrupts.CPU190.TLB:TLB_shootdowns 4576 ± 13% +209.5% 14164 ± 4% interrupts.CPU191.CAL:Function_call_interrupts 555236 +407.9% 2820217 interrupts.CPU191.LOC:Local_timer_interrupts 7860 ± 22% -89.7% 806.00 ± 42% interrupts.CPU191.NMI:Non-maskable_interrupts 7860 ± 22% -89.7% 806.00 ± 42% interrupts.CPU191.PMI:Performance_monitoring_interrupts 7947 ± 3% +2263.2% 187824 ± 2% interrupts.CPU191.RES:Rescheduling_interrupts 4.00 ±126% +3850.0% 158.00 ± 47% interrupts.CPU191.TLB:TLB_shootdowns 4476 ± 13% +209.1% 13835 ± 3% interrupts.CPU2.CAL:Function_call_interrupts 555506 +407.7% 2820378 interrupts.CPU2.LOC:Local_timer_interrupts 7857 ± 22% -89.6% 815.67 ± 10% interrupts.CPU2.NMI:Non-maskable_interrupts 7857 ± 22% -89.6% 815.67 ± 10% interrupts.CPU2.PMI:Performance_monitoring_interrupts 8444 ± 10% +2147.3% 189760 interrupts.CPU2.RES:Rescheduling_interrupts 2.20 ±136% +4263.6% 96.00 ± 20% interrupts.CPU2.TLB:TLB_shootdowns 4301 ± 15% +224.6% 13959 ± 3% interrupts.CPU20.CAL:Function_call_interrupts 554811 +408.3% 2820295 interrupts.CPU20.LOC:Local_timer_interrupts 6980 ± 30% -87.4% 881.00 ± 42% interrupts.CPU20.NMI:Non-maskable_interrupts 6980 ± 30% -87.4% 881.00 ± 42% interrupts.CPU20.PMI:Performance_monitoring_interrupts 8005 ± 3% +2273.3% 189988 interrupts.CPU20.RES:Rescheduling_interrupts 2.20 ± 60% +3642.4% 82.33 ± 34% interrupts.CPU20.TLB:TLB_shootdowns 4505 ± 14% +209.7% 13951 ± 3% interrupts.CPU21.CAL:Function_call_interrupts 555030 +408.1% 2820168 interrupts.CPU21.LOC:Local_timer_interrupts 6992 ± 30% -88.2% 828.33 ± 43% interrupts.CPU21.NMI:Non-maskable_interrupts 6992 ± 30% -88.2% 828.33 ± 43% interrupts.CPU21.PMI:Performance_monitoring_interrupts 7958 ± 4% +2297.2% 190790 interrupts.CPU21.RES:Rescheduling_interrupts 4505 ± 14% +209.9% 13960 ± 3% interrupts.CPU22.CAL:Function_call_interrupts 555320 +407.9% 2820275 interrupts.CPU22.LOC:Local_timer_interrupts 6999 ± 30% -91.3% 611.00 ± 32% interrupts.CPU22.NMI:Non-maskable_interrupts 6999 ± 30% -91.3% 611.00 ± 32% interrupts.CPU22.PMI:Performance_monitoring_interrupts 7748 ± 2% +2349.7% 189802 interrupts.CPU22.RES:Rescheduling_interrupts 2.40 ± 62% +3927.8% 96.67 ± 6% interrupts.CPU22.TLB:TLB_shootdowns 4480 ± 12% +211.5% 13957 ± 3% interrupts.CPU23.CAL:Function_call_interrupts 555128 +408.0% 2820283 interrupts.CPU23.LOC:Local_timer_interrupts 6995 ± 30% -86.3% 959.33 ± 20% interrupts.CPU23.NMI:Non-maskable_interrupts 6995 ± 30% -86.3% 959.33 ± 20% interrupts.CPU23.PMI:Performance_monitoring_interrupts 8064 ± 3% +2257.3% 190096 ± 2% interrupts.CPU23.RES:Rescheduling_interrupts 4522 ± 13% +213.2% 14165 ± 3% interrupts.CPU24.CAL:Function_call_interrupts 556066 +407.1% 2819692 interrupts.CPU24.LOC:Local_timer_interrupts 6984 ± 30% -92.1% 548.33 ± 29% interrupts.CPU24.NMI:Non-maskable_interrupts 6984 ± 30% -92.1% 548.33 ± 29% interrupts.CPU24.PMI:Performance_monitoring_interrupts 8412 ± 6% +2174.6% 191350 interrupts.CPU24.RES:Rescheduling_interrupts 11.80 ± 62% +868.9% 114.33 ± 24% interrupts.CPU24.TLB:TLB_shootdowns 4532 ± 14% +208.7% 13991 ± 4% interrupts.CPU25.CAL:Function_call_interrupts 554922 +408.3% 2820895 interrupts.CPU25.LOC:Local_timer_interrupts 6995 ± 30% -89.0% 771.33 ± 27% interrupts.CPU25.NMI:Non-maskable_interrupts 6995 ± 30% -89.0% 771.33 ± 27% interrupts.CPU25.PMI:Performance_monitoring_interrupts 8105 ± 5% +2256.9% 191038 interrupts.CPU25.RES:Rescheduling_interrupts 1.60 ± 63% +6566.7% 106.67 ± 23% interrupts.CPU25.TLB:TLB_shootdowns 4533 ± 14% +212.3% 14155 ± 3% interrupts.CPU26.CAL:Function_call_interrupts 554686 +408.4% 2819812 interrupts.CPU26.LOC:Local_timer_interrupts 7864 ± 22% -90.7% 728.67 ± 42% interrupts.CPU26.NMI:Non-maskable_interrupts 7864 ± 22% -90.7% 728.67 ± 42% interrupts.CPU26.PMI:Performance_monitoring_interrupts 8054 ± 2% +2268.9% 190798 interrupts.CPU26.RES:Rescheduling_interrupts 2.40 ±119% +3997.2% 98.33 ± 9% interrupts.CPU26.TLB:TLB_shootdowns 4542 ± 14% +211.4% 14143 ± 3% interrupts.CPU27.CAL:Function_call_interrupts 554563 +408.4% 2819627 interrupts.CPU27.LOC:Local_timer_interrupts 7864 ± 22% -90.7% 732.00 ± 38% interrupts.CPU27.NMI:Non-maskable_interrupts 7864 ± 22% -90.7% 732.00 ± 38% interrupts.CPU27.PMI:Performance_monitoring_interrupts 7987 ± 4% +2289.0% 190831 interrupts.CPU27.RES:Rescheduling_interrupts 3.00 ±117% +3311.1% 102.33 ± 14% interrupts.CPU27.TLB:TLB_shootdowns 4542 ± 14% +211.9% 14169 ± 3% interrupts.CPU28.CAL:Function_call_interrupts 554558 +408.5% 2819672 interrupts.CPU28.LOC:Local_timer_interrupts 7854 ± 22% -92.5% 593.00 ± 24% interrupts.CPU28.NMI:Non-maskable_interrupts 7854 ± 22% -92.5% 593.00 ± 24% interrupts.CPU28.PMI:Performance_monitoring_interrupts 7990 ± 4% +2290.3% 190990 interrupts.CPU28.RES:Rescheduling_interrupts 1.00 ±109% +9566.7% 96.67 ± 18% interrupts.CPU28.TLB:TLB_shootdowns 4536 ± 14% +211.9% 14151 ± 3% interrupts.CPU29.CAL:Function_call_interrupts 554587 +408.4% 2819587 interrupts.CPU29.LOC:Local_timer_interrupts 7861 ± 22% -92.6% 580.33 ± 25% interrupts.CPU29.NMI:Non-maskable_interrupts 7861 ± 22% -92.6% 580.33 ± 25% interrupts.CPU29.PMI:Performance_monitoring_interrupts 8167 ± 2% +2242.8% 191344 interrupts.CPU29.RES:Rescheduling_interrupts 4520 ± 13% +206.7% 13865 ± 3% interrupts.CPU3.CAL:Function_call_interrupts 555137 +408.0% 2820235 interrupts.CPU3.LOC:Local_timer_interrupts 7869 ± 22% -92.5% 591.67 ± 16% interrupts.CPU3.NMI:Non-maskable_interrupts 7869 ± 22% -92.5% 591.67 ± 16% interrupts.CPU3.PMI:Performance_monitoring_interrupts 8133 +2230.3% 189538 interrupts.CPU3.RES:Rescheduling_interrupts 4548 ± 13% +211.2% 14156 ± 3% interrupts.CPU30.CAL:Function_call_interrupts 554562 +408.4% 2819534 interrupts.CPU30.LOC:Local_timer_interrupts 7877 ± 22% -87.9% 954.33 ± 59% interrupts.CPU30.NMI:Non-maskable_interrupts 7877 ± 22% -87.9% 954.33 ± 59% interrupts.CPU30.PMI:Performance_monitoring_interrupts 7969 ± 2% +2304.2% 191587 interrupts.CPU30.RES:Rescheduling_interrupts 2.20 ± 60% +4187.9% 94.33 ± 12% interrupts.CPU30.TLB:TLB_shootdowns 4540 ± 13% +211.9% 14161 ± 3% interrupts.CPU31.CAL:Function_call_interrupts 554531 +408.5% 2819713 interrupts.CPU31.LOC:Local_timer_interrupts 7866 ± 22% -88.5% 902.00 ± 37% interrupts.CPU31.NMI:Non-maskable_interrupts 7866 ± 22% -88.5% 902.00 ± 37% interrupts.CPU31.PMI:Performance_monitoring_interrupts 7992 ± 2% +2296.9% 191583 interrupts.CPU31.RES:Rescheduling_interrupts 2.20 ± 60% +3930.3% 88.67 ± 14% interrupts.CPU31.TLB:TLB_shootdowns 4537 ± 13% +211.2% 14119 ± 3% interrupts.CPU32.CAL:Function_call_interrupts 554607 +408.4% 2819693 interrupts.CPU32.LOC:Local_timer_interrupts 7862 ± 22% -92.9% 560.67 ± 12% interrupts.CPU32.NMI:Non-maskable_interrupts 7862 ± 22% -92.9% 560.67 ± 12% interrupts.CPU32.PMI:Performance_monitoring_interrupts 7994 ± 2% +2293.5% 191346 interrupts.CPU32.RES:Rescheduling_interrupts 4537 ± 13% +207.7% 13960 ± 2% interrupts.CPU33.CAL:Function_call_interrupts 554566 +408.4% 2819512 interrupts.CPU33.LOC:Local_timer_interrupts 8746 -88.5% 1005 ± 55% interrupts.CPU33.NMI:Non-maskable_interrupts 8746 -88.5% 1005 ± 55% interrupts.CPU33.PMI:Performance_monitoring_interrupts 7743 ± 4% +2371.8% 191406 interrupts.CPU33.RES:Rescheduling_interrupts 4.80 ± 90% +1830.6% 92.67 ± 20% interrupts.CPU33.TLB:TLB_shootdowns 4537 ± 13% +209.0% 14018 ± 3% interrupts.CPU34.CAL:Function_call_interrupts 554577 +408.4% 2819597 interrupts.CPU34.LOC:Local_timer_interrupts 8737 -93.8% 544.33 ± 35% interrupts.CPU34.NMI:Non-maskable_interrupts 8737 -93.8% 544.33 ± 35% interrupts.CPU34.PMI:Performance_monitoring_interrupts 7975 ± 4% +2294.1% 190936 interrupts.CPU34.RES:Rescheduling_interrupts 4541 ± 13% +206.1% 13902 ± 4% interrupts.CPU35.CAL:Function_call_interrupts 554606 +408.4% 2819545 interrupts.CPU35.LOC:Local_timer_interrupts 8741 -91.9% 706.00 ± 8% interrupts.CPU35.NMI:Non-maskable_interrupts 8741 -91.9% 706.00 ± 8% interrupts.CPU35.PMI:Performance_monitoring_interrupts 8000 +2299.4% 191953 interrupts.CPU35.RES:Rescheduling_interrupts 8.40 ± 97% +1324.6% 119.67 ± 11% interrupts.CPU35.TLB:TLB_shootdowns 4545 ± 13% +207.3% 13968 ± 2% interrupts.CPU36.CAL:Function_call_interrupts 554648 +408.4% 2819586 interrupts.CPU36.LOC:Local_timer_interrupts 8736 -89.9% 884.67 ± 48% interrupts.CPU36.NMI:Non-maskable_interrupts 8736 -89.9% 884.67 ± 48% interrupts.CPU36.PMI:Performance_monitoring_interrupts 8144 ± 4% +2258.3% 192060 interrupts.CPU36.RES:Rescheduling_interrupts 4526 ± 13% +208.9% 13983 ± 2% interrupts.CPU37.CAL:Function_call_interrupts 554672 +408.4% 2819684 interrupts.CPU37.LOC:Local_timer_interrupts 8742 -91.6% 738.00 ± 37% interrupts.CPU37.NMI:Non-maskable_interrupts 8742 -91.6% 738.00 ± 37% interrupts.CPU37.PMI:Performance_monitoring_interrupts 7886 ± 4% +2336.0% 192116 interrupts.CPU37.RES:Rescheduling_interrupts 1.60 ± 84% +6462.5% 105.00 ± 20% interrupts.CPU37.TLB:TLB_shootdowns 4490 ± 13% +211.0% 13964 ± 2% interrupts.CPU38.CAL:Function_call_interrupts 554635 +408.4% 2819706 interrupts.CPU38.LOC:Local_timer_interrupts 8731 -88.9% 966.67 ± 33% interrupts.CPU38.NMI:Non-maskable_interrupts 8731 -88.9% 966.67 ± 33% interrupts.CPU38.PMI:Performance_monitoring_interrupts 8072 ± 3% +2283.6% 192419 interrupts.CPU38.RES:Rescheduling_interrupts 4331 ± 14% +222.0% 13947 ± 2% interrupts.CPU39.CAL:Function_call_interrupts 554630 +408.4% 2819528 interrupts.CPU39.LOC:Local_timer_interrupts 8750 -94.3% 496.00 ± 28% interrupts.CPU39.NMI:Non-maskable_interrupts 8750 -94.3% 496.00 ± 28% interrupts.CPU39.PMI:Performance_monitoring_interrupts 8017 ± 3% +2290.7% 191678 interrupts.CPU39.RES:Rescheduling_interrupts 3.20 ±138% +2306.2% 77.00 ± 33% interrupts.CPU39.TLB:TLB_shootdowns 4529 ± 13% +204.1% 13772 ± 4% interrupts.CPU4.CAL:Function_call_interrupts 555418 +407.8% 2820454 interrupts.CPU4.LOC:Local_timer_interrupts 7883 ± 22% -83.6% 1291 ± 25% interrupts.CPU4.NMI:Non-maskable_interrupts 7883 ± 22% -83.6% 1291 ± 25% interrupts.CPU4.PMI:Performance_monitoring_interrupts 8030 ± 4% +2253.4% 188987 interrupts.CPU4.RES:Rescheduling_interrupts 1.40 ±166% +6876.2% 97.67 ± 24% interrupts.CPU4.TLB:TLB_shootdowns 4558 ± 13% +206.2% 13956 ± 2% interrupts.CPU40.CAL:Function_call_interrupts 554788 +408.2% 2819637 interrupts.CPU40.LOC:Local_timer_interrupts 8746 -92.3% 674.67 ± 31% interrupts.CPU40.NMI:Non-maskable_interrupts 8746 -92.3% 674.67 ± 31% interrupts.CPU40.PMI:Performance_monitoring_interrupts 7877 ± 5% +2335.9% 191892 interrupts.CPU40.RES:Rescheduling_interrupts 2.40 ± 81% +3677.8% 90.67 ± 11% interrupts.CPU40.TLB:TLB_shootdowns 4558 ± 13% +206.0% 13950 ± 3% interrupts.CPU41.CAL:Function_call_interrupts 554632 +408.4% 2819566 interrupts.CPU41.LOC:Local_timer_interrupts 8728 -92.6% 644.00 ± 28% interrupts.CPU41.NMI:Non-maskable_interrupts 8728 -92.6% 644.00 ± 28% interrupts.CPU41.PMI:Performance_monitoring_interrupts 8127 +2265.9% 192286 interrupts.CPU41.RES:Rescheduling_interrupts 3.80 ±112% +2154.4% 85.67 ± 14% interrupts.CPU41.TLB:TLB_shootdowns 4170 ± 21% +234.6% 13953 ± 3% interrupts.CPU42.CAL:Function_call_interrupts 555383 +407.7% 2819583 interrupts.CPU42.LOC:Local_timer_interrupts 8736 -92.1% 692.00 ± 6% interrupts.CPU42.NMI:Non-maskable_interrupts 8736 -92.1% 692.00 ± 6% interrupts.CPU42.PMI:Performance_monitoring_interrupts 8021 ± 3% +2299.0% 192442 interrupts.CPU42.RES:Rescheduling_interrupts 2.60 ± 86% +3284.6% 88.00 ± 13% interrupts.CPU42.TLB:TLB_shootdowns 4555 ± 13% +206.7% 13971 ± 3% interrupts.CPU43.CAL:Function_call_interrupts 554712 +408.3% 2819808 interrupts.CPU43.LOC:Local_timer_interrupts 8743 -94.0% 522.67 ± 21% interrupts.CPU43.NMI:Non-maskable_interrupts 8743 -94.0% 522.67 ± 21% interrupts.CPU43.PMI:Performance_monitoring_interrupts 7981 ± 5% +2307.9% 192178 interrupts.CPU43.RES:Rescheduling_interrupts 2.20 ± 66% +4324.2% 97.33 ± 8% interrupts.CPU43.TLB:TLB_shootdowns 4530 ± 13% +208.2% 13962 ± 2% interrupts.CPU44.CAL:Function_call_interrupts 554560 +408.5% 2819700 interrupts.CPU44.LOC:Local_timer_interrupts 8739 -92.1% 688.67 ± 20% interrupts.CPU44.NMI:Non-maskable_interrupts 8739 -92.1% 688.67 ± 20% interrupts.CPU44.PMI:Performance_monitoring_interrupts 8162 ± 3% +2253.0% 192066 interrupts.CPU44.RES:Rescheduling_interrupts 1.40 ± 85% +6257.1% 89.00 ± 18% interrupts.CPU44.TLB:TLB_shootdowns 4558 ± 13% +206.0% 13947 ± 3% interrupts.CPU45.CAL:Function_call_interrupts 554602 +408.4% 2819602 interrupts.CPU45.LOC:Local_timer_interrupts 8719 -91.3% 759.67 ± 64% interrupts.CPU45.NMI:Non-maskable_interrupts 8719 -91.3% 759.67 ± 64% interrupts.CPU45.PMI:Performance_monitoring_interrupts 7944 ± 2% +2327.9% 192891 interrupts.CPU45.RES:Rescheduling_interrupts 4.80 ± 99% +1934.7% 97.67 ± 18% interrupts.CPU45.TLB:TLB_shootdowns 4560 ± 13% +209.6% 14117 ± 3% interrupts.CPU46.CAL:Function_call_interrupts 554776 +408.2% 2819492 interrupts.CPU46.LOC:Local_timer_interrupts 8736 -92.1% 694.00 ± 50% interrupts.CPU46.NMI:Non-maskable_interrupts 8736 -92.1% 694.00 ± 50% interrupts.CPU46.PMI:Performance_monitoring_interrupts 7923 ± 3% +2329.4% 192492 interrupts.CPU46.RES:Rescheduling_interrupts 1.60 ±115% +6795.8% 110.33 ± 5% interrupts.CPU46.TLB:TLB_shootdowns 4552 ± 13% +210.1% 14116 ± 3% interrupts.CPU47.CAL:Function_call_interrupts 554817 +408.2% 2819687 interrupts.CPU47.LOC:Local_timer_interrupts 8744 -92.5% 657.33 ± 30% interrupts.CPU47.NMI:Non-maskable_interrupts 8744 -92.5% 657.33 ± 30% interrupts.CPU47.PMI:Performance_monitoring_interrupts 7939 ± 5% +2330.5% 192965 interrupts.CPU47.RES:Rescheduling_interrupts 5.80 ±140% +1583.9% 97.67 ± 14% interrupts.CPU47.TLB:TLB_shootdowns 4048 ± 22% +237.4% 13660 ± 4% interrupts.CPU48.CAL:Function_call_interrupts 555095 +408.0% 2819875 interrupts.CPU48.LOC:Local_timer_interrupts 8713 -88.4% 1015 ± 21% interrupts.CPU48.NMI:Non-maskable_interrupts 8713 -88.4% 1015 ± 21% interrupts.CPU48.PMI:Performance_monitoring_interrupts 8203 +2241.5% 192072 interrupts.CPU48.RES:Rescheduling_interrupts 3.00 ±101% +2933.3% 91.00 ± 14% interrupts.CPU48.TLB:TLB_shootdowns 4547 ± 14% +202.7% 13763 ± 4% interrupts.CPU49.CAL:Function_call_interrupts 554834 +408.2% 2819735 interrupts.CPU49.LOC:Local_timer_interrupts 7870 ± 22% -91.3% 683.67 ± 21% interrupts.CPU49.NMI:Non-maskable_interrupts 7870 ± 22% -91.3% 683.67 ± 21% interrupts.CPU49.PMI:Performance_monitoring_interrupts 8223 ± 3% +2225.6% 191244 interrupts.CPU49.RES:Rescheduling_interrupts 2.40 ± 81% +3886.1% 95.67 ± 4% interrupts.CPU49.TLB:TLB_shootdowns 4535 ± 13% +201.3% 13666 ± 3% interrupts.CPU5.CAL:Function_call_interrupts 554797 +408.3% 2820210 interrupts.CPU5.LOC:Local_timer_interrupts 7868 ± 22% -90.6% 737.67 ± 9% interrupts.CPU5.NMI:Non-maskable_interrupts 7868 ± 22% -90.6% 737.67 ± 9% interrupts.CPU5.PMI:Performance_monitoring_interrupts 8055 ± 3% +2246.0% 188977 interrupts.CPU5.RES:Rescheduling_interrupts 1.00 ± 63% +8766.7% 88.67 ± 19% interrupts.CPU5.TLB:TLB_shootdowns 4512 ± 13% +202.0% 13625 ± 4% interrupts.CPU50.CAL:Function_call_interrupts 554654 +408.4% 2819802 interrupts.CPU50.LOC:Local_timer_interrupts 7857 ± 22% -90.6% 737.33 ± 5% interrupts.CPU50.NMI:Non-maskable_interrupts 7857 ± 22% -90.6% 737.33 ± 5% interrupts.CPU50.PMI:Performance_monitoring_interrupts 8207 ± 2% +2228.5% 191107 interrupts.CPU50.RES:Rescheduling_interrupts 4.20 ± 80% +2050.8% 90.33 ± 24% interrupts.CPU50.TLB:TLB_shootdowns 4510 ± 13% +204.8% 13747 ± 4% interrupts.CPU51.CAL:Function_call_interrupts 554862 +408.2% 2820068 interrupts.CPU51.LOC:Local_timer_interrupts 7872 ± 22% -90.1% 778.33 ± 11% interrupts.CPU51.NMI:Non-maskable_interrupts 7872 ± 22% -90.1% 778.33 ± 11% interrupts.CPU51.PMI:Performance_monitoring_interrupts 8006 +2291.4% 191455 interrupts.CPU51.RES:Rescheduling_interrupts 2.40 ± 20% +3761.1% 92.67 ± 15% interrupts.CPU51.TLB:TLB_shootdowns 4123 ± 19% +234.1% 13774 ± 4% interrupts.CPU52.CAL:Function_call_interrupts 555786 +407.4% 2820168 interrupts.CPU52.LOC:Local_timer_interrupts 7855 ± 22% -88.0% 943.00 ± 11% interrupts.CPU52.NMI:Non-maskable_interrupts 7855 ± 22% -88.0% 943.00 ± 11% interrupts.CPU52.PMI:Performance_monitoring_interrupts 8118 +2257.2% 191365 interrupts.CPU52.RES:Rescheduling_interrupts 4507 ± 14% +208.6% 13909 ± 4% interrupts.CPU53.CAL:Function_call_interrupts 555503 +407.6% 2819788 interrupts.CPU53.LOC:Local_timer_interrupts 7866 ± 22% -88.5% 904.00 ± 39% interrupts.CPU53.NMI:Non-maskable_interrupts 7866 ± 22% -88.5% 904.00 ± 39% interrupts.CPU53.PMI:Performance_monitoring_interrupts 8189 ± 3% +2238.6% 191524 interrupts.CPU53.RES:Rescheduling_interrupts 3.00 ± 89% +3511.1% 108.33 ± 7% interrupts.CPU53.TLB:TLB_shootdowns 4417 ± 13% +212.6% 13808 ± 3% interrupts.CPU54.CAL:Function_call_interrupts 555144 +407.9% 2819808 interrupts.CPU54.LOC:Local_timer_interrupts 7861 ± 22% -89.9% 793.00 ± 12% interrupts.CPU54.NMI:Non-maskable_interrupts 7861 ± 22% -89.9% 793.00 ± 12% interrupts.CPU54.PMI:Performance_monitoring_interrupts 8315 +2208.1% 191931 interrupts.CPU54.RES:Rescheduling_interrupts 1.60 ± 63% +5962.5% 97.00 ± 13% interrupts.CPU54.TLB:TLB_shootdowns 4497 ± 14% +204.3% 13685 ± 3% interrupts.CPU55.CAL:Function_call_interrupts 554801 +408.2% 2819734 interrupts.CPU55.LOC:Local_timer_interrupts 6988 ± 30% -89.9% 704.00 ± 15% interrupts.CPU55.NMI:Non-maskable_interrupts 6988 ± 30% -89.9% 704.00 ± 15% interrupts.CPU55.PMI:Performance_monitoring_interrupts 8110 +2262.4% 191608 interrupts.CPU55.RES:Rescheduling_interrupts 2.20 ± 72% +4142.4% 93.33 ± 9% interrupts.CPU55.TLB:TLB_shootdowns 4495 ± 13% +207.1% 13806 ± 4% interrupts.CPU56.CAL:Function_call_interrupts 554522 +408.5% 2819753 interrupts.CPU56.LOC:Local_timer_interrupts 6978 ± 30% -87.3% 884.67 ± 37% interrupts.CPU56.NMI:Non-maskable_interrupts 6978 ± 30% -87.3% 884.67 ± 37% interrupts.CPU56.PMI:Performance_monitoring_interrupts 8086 ± 3% +2273.8% 191953 interrupts.CPU56.RES:Rescheduling_interrupts 3.60 ±119% +2446.3% 91.67 ± 11% interrupts.CPU56.TLB:TLB_shootdowns 4495 ± 13% +205.7% 13741 ± 3% interrupts.CPU57.CAL:Function_call_interrupts 554634 +408.4% 2819770 interrupts.CPU57.LOC:Local_timer_interrupts 6991 ± 30% -89.6% 726.00 ± 40% interrupts.CPU57.NMI:Non-maskable_interrupts 6991 ± 30% -89.6% 726.00 ± 40% interrupts.CPU57.PMI:Performance_monitoring_interrupts 8294 +2207.8% 191410 interrupts.CPU57.RES:Rescheduling_interrupts 2.80 ± 69% +3423.8% 98.67 ± 12% interrupts.CPU57.TLB:TLB_shootdowns 4493 ± 13% +206.9% 13790 ± 3% interrupts.CPU58.CAL:Function_call_interrupts 554735 +408.3% 2819726 interrupts.CPU58.LOC:Local_timer_interrupts 7001 ± 30% -89.7% 717.67 ± 31% interrupts.CPU58.NMI:Non-maskable_interrupts 7001 ± 30% -89.7% 717.67 ± 31% interrupts.CPU58.PMI:Performance_monitoring_interrupts 8172 ± 3% +2244.7% 191624 interrupts.CPU58.RES:Rescheduling_interrupts 1.60 ± 30% +6087.5% 99.00 ± 10% interrupts.CPU58.TLB:TLB_shootdowns 4491 ± 13% +206.0% 13743 ± 3% interrupts.CPU59.CAL:Function_call_interrupts 554536 +408.5% 2819752 interrupts.CPU59.LOC:Local_timer_interrupts 7855 ± 22% -89.5% 827.67 ± 24% interrupts.CPU59.NMI:Non-maskable_interrupts 7855 ± 22% -89.5% 827.67 ± 24% interrupts.CPU59.PMI:Performance_monitoring_interrupts 8045 ± 2% +2286.8% 192014 interrupts.CPU59.RES:Rescheduling_interrupts 2.20 ±109% +4400.0% 99.00 ± 13% interrupts.CPU59.TLB:TLB_shootdowns 4531 ± 13% +204.7% 13808 ± 4% interrupts.CPU6.CAL:Function_call_interrupts 555052 +408.1% 2820147 interrupts.CPU6.LOC:Local_timer_interrupts 7853 ± 22% -84.0% 1258 ± 40% interrupts.CPU6.NMI:Non-maskable_interrupts 7853 ± 22% -84.0% 1258 ± 40% interrupts.CPU6.PMI:Performance_monitoring_interrupts 8041 ± 4% +2254.3% 189321 interrupts.CPU6.RES:Rescheduling_interrupts 0.80 ± 50% +10108.3% 81.67 ± 24% interrupts.CPU6.TLB:TLB_shootdowns 4487 ± 13% +206.7% 13765 ± 4% interrupts.CPU60.CAL:Function_call_interrupts 554688 +408.4% 2819770 interrupts.CPU60.LOC:Local_timer_interrupts 7865 ± 22% -90.7% 731.67 ± 6% interrupts.CPU60.NMI:Non-maskable_interrupts 7865 ± 22% -90.7% 731.67 ± 6% interrupts.CPU60.PMI:Performance_monitoring_interrupts 7952 ± 2% +2315.9% 192114 interrupts.CPU60.RES:Rescheduling_interrupts 2.60 ±145% +3733.3% 99.67 ± 16% interrupts.CPU60.TLB:TLB_shootdowns 4488 ± 13% +205.3% 13705 ± 4% interrupts.CPU61.CAL:Function_call_interrupts 554705 +408.3% 2819741 interrupts.CPU61.LOC:Local_timer_interrupts 7873 ± 22% -91.6% 665.00 ± 35% interrupts.CPU61.NMI:Non-maskable_interrupts 7873 ± 22% -91.6% 665.00 ± 35% interrupts.CPU61.PMI:Performance_monitoring_interrupts 7949 ± 2% +2317.7% 192198 interrupts.CPU61.RES:Rescheduling_interrupts 0.60 ± 81% +14011.1% 84.67 ± 15% interrupts.CPU61.TLB:TLB_shootdowns 4496 ± 13% +205.4% 13731 ± 4% interrupts.CPU62.CAL:Function_call_interrupts 554584 +408.4% 2819705 interrupts.CPU62.LOC:Local_timer_interrupts 7892 ± 22% -92.9% 558.00 ± 21% interrupts.CPU62.NMI:Non-maskable_interrupts 7892 ± 22% -92.9% 558.00 ± 21% interrupts.CPU62.PMI:Performance_monitoring_interrupts 8171 ± 3% +2248.1% 191871 interrupts.CPU62.RES:Rescheduling_interrupts 2.00 ± 63% +4666.7% 95.33 ± 9% interrupts.CPU62.TLB:TLB_shootdowns 4490 ± 14% +206.8% 13777 ± 4% interrupts.CPU63.CAL:Function_call_interrupts 554695 +408.4% 2819966 interrupts.CPU63.LOC:Local_timer_interrupts 6991 ± 30% -87.7% 862.67 ± 56% interrupts.CPU63.NMI:Non-maskable_interrupts 6991 ± 30% -87.7% 862.67 ± 56% interrupts.CPU63.PMI:Performance_monitoring_interrupts 8248 ± 2% +2231.5% 192313 interrupts.CPU63.RES:Rescheduling_interrupts 4487 ± 14% +205.6% 13711 ± 4% interrupts.CPU64.CAL:Function_call_interrupts 554582 +408.4% 2819713 interrupts.CPU64.LOC:Local_timer_interrupts 7854 ± 22% -92.5% 591.33 ± 47% interrupts.CPU64.NMI:Non-maskable_interrupts 7854 ± 22% -92.5% 591.33 ± 47% interrupts.CPU64.PMI:Performance_monitoring_interrupts 8121 ± 2% +2266.2% 192177 interrupts.CPU64.RES:Rescheduling_interrupts 4485 ± 14% +206.6% 13750 ± 3% interrupts.CPU65.CAL:Function_call_interrupts 554683 +408.3% 2819693 interrupts.CPU65.LOC:Local_timer_interrupts 7870 ± 22% -92.6% 585.67 ± 11% interrupts.CPU65.NMI:Non-maskable_interrupts 7870 ± 22% -92.6% 585.67 ± 11% interrupts.CPU65.PMI:Performance_monitoring_interrupts 8050 ± 3% +2293.9% 192725 interrupts.CPU65.RES:Rescheduling_interrupts 4525 ± 14% +193.3% 13272 ± 3% interrupts.CPU66.CAL:Function_call_interrupts 554758 +408.5% 2821050 interrupts.CPU66.LOC:Local_timer_interrupts 7858 ± 22% -91.3% 683.00 ± 33% interrupts.CPU66.NMI:Non-maskable_interrupts 7858 ± 22% -91.3% 683.00 ± 33% interrupts.CPU66.PMI:Performance_monitoring_interrupts 8104 +2274.1% 192413 interrupts.CPU66.RES:Rescheduling_interrupts 1.60 ± 30% +7087.5% 115.00 ± 8% interrupts.CPU66.TLB:TLB_shootdowns 4487 ± 14% +205.3% 13701 ± 3% interrupts.CPU67.CAL:Function_call_interrupts 554659 +408.4% 2819835 interrupts.CPU67.LOC:Local_timer_interrupts 7867 ± 22% -93.2% 532.00 ± 30% interrupts.CPU67.NMI:Non-maskable_interrupts 7867 ± 22% -93.2% 532.00 ± 30% interrupts.CPU67.PMI:Performance_monitoring_interrupts 7944 +2322.3% 192434 interrupts.CPU67.RES:Rescheduling_interrupts 2.20 ± 72% +4339.4% 97.67 ± 11% interrupts.CPU67.TLB:TLB_shootdowns 4485 ± 14% +206.4% 13745 ± 3% interrupts.CPU68.CAL:Function_call_interrupts 554454 +408.6% 2819879 interrupts.CPU68.LOC:Local_timer_interrupts 7872 ± 22% -91.7% 653.00 ± 26% interrupts.CPU68.NMI:Non-maskable_interrupts 7872 ± 22% -91.7% 653.00 ± 26% interrupts.CPU68.PMI:Performance_monitoring_interrupts 8437 ± 3% +2196.9% 193794 interrupts.CPU68.RES:Rescheduling_interrupts 4485 ± 14% +203.8% 13626 ± 2% interrupts.CPU69.CAL:Function_call_interrupts 554689 +408.3% 2819756 interrupts.CPU69.LOC:Local_timer_interrupts 7850 ± 22% -90.7% 731.00 ± 37% interrupts.CPU69.NMI:Non-maskable_interrupts 7850 ± 22% -90.7% 731.00 ± 37% interrupts.CPU69.PMI:Performance_monitoring_interrupts 8063 ± 2% +2287.0% 192474 interrupts.CPU69.RES:Rescheduling_interrupts 3.20 ±138% +2691.7% 89.33 ± 12% interrupts.CPU69.TLB:TLB_shootdowns 4070 ± 27% +238.4% 13772 ± 4% interrupts.CPU7.CAL:Function_call_interrupts 556568 +406.7% 2820167 interrupts.CPU7.LOC:Local_timer_interrupts 7861 ± 22% -88.9% 872.67 ± 21% interrupts.CPU7.NMI:Non-maskable_interrupts 7861 ± 22% -88.9% 872.67 ± 21% interrupts.CPU7.PMI:Performance_monitoring_interrupts 8189 ± 2% +2217.7% 189797 interrupts.CPU7.RES:Rescheduling_interrupts 1.80 ± 22% +5381.5% 98.67 ± 9% interrupts.CPU7.TLB:TLB_shootdowns 4483 ± 14% +204.8% 13667 ± 2% interrupts.CPU70.CAL:Function_call_interrupts 554594 +408.4% 2819733 interrupts.CPU70.LOC:Local_timer_interrupts 7877 ± 22% -93.8% 486.67 ± 27% interrupts.CPU70.NMI:Non-maskable_interrupts 7877 ± 22% -93.8% 486.67 ± 27% interrupts.CPU70.PMI:Performance_monitoring_interrupts 8222 ± 2% +2247.0% 192982 interrupts.CPU70.RES:Rescheduling_interrupts 1.20 ± 81% +8288.9% 100.67 ± 10% interrupts.CPU70.TLB:TLB_shootdowns 4483 ± 14% +202.8% 13575 ± 3% interrupts.CPU71.CAL:Function_call_interrupts 554636 +408.4% 2819792 interrupts.CPU71.LOC:Local_timer_interrupts 7848 ± 22% -89.4% 833.00 ± 34% interrupts.CPU71.NMI:Non-maskable_interrupts 7848 ± 22% -89.4% 833.00 ± 34% interrupts.CPU71.PMI:Performance_monitoring_interrupts 8099 ± 2% +2289.9% 193576 interrupts.CPU71.RES:Rescheduling_interrupts 4.40 ±108% +2097.0% 96.67 ± 5% interrupts.CPU71.TLB:TLB_shootdowns 4523 ± 14% +210.0% 14023 ± 2% interrupts.CPU72.CAL:Function_call_interrupts 555208 +408.0% 2820246 interrupts.CPU72.LOC:Local_timer_interrupts 7855 ± 22% -90.9% 714.67 ± 62% interrupts.CPU72.NMI:Non-maskable_interrupts 7855 ± 22% -90.9% 714.67 ± 62% interrupts.CPU72.PMI:Performance_monitoring_interrupts 8219 ± 2% +2175.1% 187002 ± 2% interrupts.CPU72.RES:Rescheduling_interrupts 4.20 ± 34% +2431.7% 106.33 ± 37% interrupts.CPU72.TLB:TLB_shootdowns 4538 ± 14% +208.3% 13992 ± 3% interrupts.CPU73.CAL:Function_call_interrupts 555157 +408.0% 2820275 interrupts.CPU73.LOC:Local_timer_interrupts 6991 ± 30% -91.9% 568.00 ± 58% interrupts.CPU73.NMI:Non-maskable_interrupts 6991 ± 30% -91.9% 568.00 ± 58% interrupts.CPU73.PMI:Performance_monitoring_interrupts 8055 ± 3% +2253.2% 189570 interrupts.CPU73.RES:Rescheduling_interrupts 4552 ± 14% +207.4% 13995 ± 3% interrupts.CPU74.CAL:Function_call_interrupts 555212 +407.9% 2820093 interrupts.CPU74.LOC:Local_timer_interrupts 7005 ± 30% -79.5% 1433 ± 61% interrupts.CPU74.NMI:Non-maskable_interrupts 7005 ± 30% -79.5% 1433 ± 61% interrupts.CPU74.PMI:Performance_monitoring_interrupts 8096 ± 3% +2241.9% 189603 interrupts.CPU74.RES:Rescheduling_interrupts 4547 ± 14% +208.0% 14006 ± 2% interrupts.CPU75.CAL:Function_call_interrupts 554757 +408.3% 2820011 interrupts.CPU75.LOC:Local_timer_interrupts 6990 ± 30% -89.5% 735.67 ± 56% interrupts.CPU75.NMI:Non-maskable_interrupts 6990 ± 30% -89.5% 735.67 ± 56% interrupts.CPU75.PMI:Performance_monitoring_interrupts 7926 ± 3% +2240.0% 185470 ± 3% interrupts.CPU75.RES:Rescheduling_interrupts 2.20 ± 53% +4006.1% 90.33 ± 13% interrupts.CPU75.TLB:TLB_shootdowns 4515 ± 14% +209.4% 13970 ± 2% interrupts.CPU76.CAL:Function_call_interrupts 555350 +407.8% 2820085 interrupts.CPU76.LOC:Local_timer_interrupts 7866 ± 22% -92.2% 614.67 ± 32% interrupts.CPU76.NMI:Non-maskable_interrupts 7866 ± 22% -92.2% 614.67 ± 32% interrupts.CPU76.PMI:Performance_monitoring_interrupts 8055 ± 4% +2228.8% 187596 ± 3% interrupts.CPU76.RES:Rescheduling_interrupts 4179 ± 22% +233.9% 13955 ± 2% interrupts.CPU77.CAL:Function_call_interrupts 555764 +407.4% 2820109 interrupts.CPU77.LOC:Local_timer_interrupts 6981 ± 30% -92.6% 514.33 ± 13% interrupts.CPU77.NMI:Non-maskable_interrupts 6981 ± 30% -92.6% 514.33 ± 13% interrupts.CPU77.PMI:Performance_monitoring_interrupts 7977 ± 2% +2283.0% 190105 interrupts.CPU77.RES:Rescheduling_interrupts 2.80 ±116% +3364.3% 97.00 ± 11% interrupts.CPU77.TLB:TLB_shootdowns 4575 ± 13% +205.9% 13997 ± 3% interrupts.CPU78.CAL:Function_call_interrupts 554901 +408.2% 2820274 interrupts.CPU78.LOC:Local_timer_interrupts 7862 ± 22% -92.2% 611.00 ± 48% interrupts.CPU78.NMI:Non-maskable_interrupts 7862 ± 22% -92.2% 611.00 ± 48% interrupts.CPU78.PMI:Performance_monitoring_interrupts 8040 +2229.2% 187269 ± 2% interrupts.CPU78.RES:Rescheduling_interrupts 4563 ± 13% +206.9% 14006 ± 3% interrupts.CPU79.CAL:Function_call_interrupts 555025 +408.1% 2820096 interrupts.CPU79.LOC:Local_timer_interrupts 7857 ± 22% -89.1% 860.00 ± 55% interrupts.CPU79.NMI:Non-maskable_interrupts 7857 ± 22% -89.1% 860.00 ± 55% interrupts.CPU79.PMI:Performance_monitoring_interrupts 8096 ± 2% +2231.4% 188752 ± 2% interrupts.CPU79.RES:Rescheduling_interrupts 4520 ± 13% +204.6% 13770 ± 4% interrupts.CPU8.CAL:Function_call_interrupts 555357 +407.8% 2820153 interrupts.CPU8.LOC:Local_timer_interrupts 7868 ± 22% -86.5% 1059 ± 27% interrupts.CPU8.NMI:Non-maskable_interrupts 7868 ± 22% -86.5% 1059 ± 27% interrupts.CPU8.PMI:Performance_monitoring_interrupts 7891 ± 3% +2307.1% 189959 interrupts.CPU8.RES:Rescheduling_interrupts 1.20 ± 97% +7927.8% 96.33 ± 8% interrupts.CPU8.TLB:TLB_shootdowns 4475 ± 14% +212.1% 13969 ± 3% interrupts.CPU80.CAL:Function_call_interrupts 555224 +407.9% 2820060 interrupts.CPU80.LOC:Local_timer_interrupts 7853 ± 22% -91.2% 691.33 ± 37% interrupts.CPU80.NMI:Non-maskable_interrupts 7853 ± 22% -91.2% 691.33 ± 37% interrupts.CPU80.PMI:Performance_monitoring_interrupts 8058 ± 4% +2232.3% 187945 ± 2% interrupts.CPU80.RES:Rescheduling_interrupts 4571 ± 13% +208.5% 14099 ± 4% interrupts.CPU81.CAL:Function_call_interrupts 554855 +408.3% 2820088 interrupts.CPU81.LOC:Local_timer_interrupts 7865 ± 22% -83.9% 1269 ± 53% interrupts.CPU81.NMI:Non-maskable_interrupts 7865 ± 22% -83.9% 1269 ± 53% interrupts.CPU81.PMI:Performance_monitoring_interrupts 8001 ± 2% +2275.3% 190058 interrupts.CPU81.RES:Rescheduling_interrupts 4461 ± 14% +210.4% 13847 ± 5% interrupts.CPU82.CAL:Function_call_interrupts 555299 +408.1% 2821283 interrupts.CPU82.LOC:Local_timer_interrupts 7884 ± 22% -91.5% 670.67 ± 39% interrupts.CPU82.NMI:Non-maskable_interrupts 7884 ± 22% -91.5% 670.67 ± 39% interrupts.CPU82.PMI:Performance_monitoring_interrupts 7933 ± 3% +2287.1% 189379 interrupts.CPU82.RES:Rescheduling_interrupts 4574 ± 13% +208.0% 14086 ± 4% interrupts.CPU83.CAL:Function_call_interrupts 555183 +408.0% 2820220 interrupts.CPU83.LOC:Local_timer_interrupts 7867 ± 22% -73.4% 2091 ±105% interrupts.CPU83.NMI:Non-maskable_interrupts 7867 ± 22% -73.4% 2091 ±105% interrupts.CPU83.PMI:Performance_monitoring_interrupts 7974 ± 3% +2292.6% 190784 ± 2% interrupts.CPU83.RES:Rescheduling_interrupts 4570 ± 13% +208.1% 14080 ± 4% interrupts.CPU84.CAL:Function_call_interrupts 555033 +408.1% 2820268 interrupts.CPU84.LOC:Local_timer_interrupts 7863 ± 22% -90.2% 771.67 ± 5% interrupts.CPU84.NMI:Non-maskable_interrupts 7863 ± 22% -90.2% 771.67 ± 5% interrupts.CPU84.PMI:Performance_monitoring_interrupts 7870 ± 4% +2314.4% 190012 ± 2% interrupts.CPU84.RES:Rescheduling_interrupts 6.40 ±139% +1327.1% 91.33 ± 18% interrupts.CPU84.TLB:TLB_shootdowns 4575 ± 13% +208.2% 14099 ± 4% interrupts.CPU85.CAL:Function_call_interrupts 555219 +408.0% 2820366 interrupts.CPU85.LOC:Local_timer_interrupts 7860 ± 22% -91.6% 663.33 ± 29% interrupts.CPU85.NMI:Non-maskable_interrupts 7860 ± 22% -91.6% 663.33 ± 29% interrupts.CPU85.PMI:Performance_monitoring_interrupts 7979 ± 3% +2274.4% 189462 ± 2% interrupts.CPU85.RES:Rescheduling_interrupts 2.20 ± 97% +4672.7% 105.00 ± 24% interrupts.CPU85.TLB:TLB_shootdowns 4573 ± 13% +208.8% 14124 ± 4% interrupts.CPU86.CAL:Function_call_interrupts 555293 +407.9% 2820241 interrupts.CPU86.LOC:Local_timer_interrupts 7875 ± 22% -91.4% 680.67 ± 21% interrupts.CPU86.NMI:Non-maskable_interrupts 7875 ± 22% -91.4% 680.67 ± 21% interrupts.CPU86.PMI:Performance_monitoring_interrupts 8166 ± 2% +2210.4% 188664 ± 2% interrupts.CPU86.RES:Rescheduling_interrupts 4.00 ± 90% +1925.0% 81.00 ± 22% interrupts.CPU86.TLB:TLB_shootdowns 4584 ± 13% +207.3% 14088 ± 4% interrupts.CPU87.CAL:Function_call_interrupts 555193 +408.0% 2820136 interrupts.CPU87.LOC:Local_timer_interrupts 7867 ± 22% -89.3% 842.33 ± 46% interrupts.CPU87.NMI:Non-maskable_interrupts 7867 ± 22% -89.3% 842.33 ± 46% interrupts.CPU87.PMI:Performance_monitoring_interrupts 7979 ± 3% +2269.4% 189072 ± 2% interrupts.CPU87.RES:Rescheduling_interrupts 4570 ± 13% +208.2% 14088 ± 4% interrupts.CPU88.CAL:Function_call_interrupts 555208 +408.0% 2820210 interrupts.CPU88.LOC:Local_timer_interrupts 8741 -92.9% 621.67 ± 25% interrupts.CPU88.NMI:Non-maskable_interrupts 8741 -92.9% 621.67 ± 25% interrupts.CPU88.PMI:Performance_monitoring_interrupts 8182 ± 4% +2226.3% 190335 interrupts.CPU88.RES:Rescheduling_interrupts 2.00 ± 31% +4283.3% 87.67 ± 16% interrupts.CPU88.TLB:TLB_shootdowns 4560 ± 14% +208.8% 14080 ± 4% interrupts.CPU89.CAL:Function_call_interrupts 555183 +408.0% 2820197 interrupts.CPU89.LOC:Local_timer_interrupts 8728 -92.1% 689.67 ± 41% interrupts.CPU89.NMI:Non-maskable_interrupts 8728 -92.1% 689.67 ± 41% interrupts.CPU89.PMI:Performance_monitoring_interrupts 8081 ± 4% +2241.8% 189255 ± 2% interrupts.CPU89.RES:Rescheduling_interrupts 3.80 ±101% +2294.7% 91.00 ± 7% interrupts.CPU89.TLB:TLB_shootdowns 1326 ± 43% +308.5% 5419 ± 31% interrupts.CPU9.31:PCI-MSI.524289-edge.eth0-TxRx-0 4518 ± 13% +204.9% 13778 ± 4% interrupts.CPU9.CAL:Function_call_interrupts 555355 +407.8% 2820271 interrupts.CPU9.LOC:Local_timer_interrupts 7880 ± 22% -88.1% 937.00 ± 34% interrupts.CPU9.NMI:Non-maskable_interrupts 7880 ± 22% -88.1% 937.00 ± 34% interrupts.CPU9.PMI:Performance_monitoring_interrupts 7973 ± 4% +2285.3% 190192 interrupts.CPU9.RES:Rescheduling_interrupts 1.80 ± 64% +5640.7% 103.33 ± 13% interrupts.CPU9.TLB:TLB_shootdowns 4554 ± 14% +209.0% 14075 ± 4% interrupts.CPU90.CAL:Function_call_interrupts 555191 +407.9% 2820096 interrupts.CPU90.LOC:Local_timer_interrupts 8746 -92.0% 695.67 ± 24% interrupts.CPU90.NMI:Non-maskable_interrupts 8746 -92.0% 695.67 ± 24% interrupts.CPU90.PMI:Performance_monitoring_interrupts 8000 +2255.8% 188481 ± 2% interrupts.CPU90.RES:Rescheduling_interrupts 2.80 ± 41% +3233.3% 93.33 ± 15% interrupts.CPU90.TLB:TLB_shootdowns 4555 ± 14% +208.9% 14073 ± 4% interrupts.CPU91.CAL:Function_call_interrupts 555496 +407.7% 2820014 interrupts.CPU91.LOC:Local_timer_interrupts 8734 -94.2% 504.00 ± 23% interrupts.CPU91.NMI:Non-maskable_interrupts 8734 -94.2% 504.00 ± 23% interrupts.CPU91.PMI:Performance_monitoring_interrupts 7976 ± 4% +2267.1% 188809 ± 2% interrupts.CPU91.RES:Rescheduling_interrupts 4544 ± 14% +209.3% 14053 ± 4% interrupts.CPU92.CAL:Function_call_interrupts 554650 +408.4% 2820094 interrupts.CPU92.LOC:Local_timer_interrupts 7874 ± 22% -87.3% 998.33 ± 26% interrupts.CPU92.NMI:Non-maskable_interrupts 7874 ± 22% -87.3% 998.33 ± 26% interrupts.CPU92.PMI:Performance_monitoring_interrupts 7856 +2334.0% 191222 ± 2% interrupts.CPU92.RES:Rescheduling_interrupts 3.00 ± 59% +3011.1% 93.33 ± 13% interrupts.CPU92.TLB:TLB_shootdowns 4543 ± 14% +210.1% 14088 ± 4% interrupts.CPU93.CAL:Function_call_interrupts 554881 +408.3% 2820360 interrupts.CPU93.LOC:Local_timer_interrupts 7858 ± 22% -86.5% 1064 ± 24% interrupts.CPU93.NMI:Non-maskable_interrupts 7858 ± 22% -86.5% 1064 ± 24% interrupts.CPU93.PMI:Performance_monitoring_interrupts 7944 ± 5% +2266.9% 188033 ± 3% interrupts.CPU93.RES:Rescheduling_interrupts 4542 ± 14% +210.1% 14085 ± 4% interrupts.CPU94.CAL:Function_call_interrupts 554790 +408.4% 2820639 interrupts.CPU94.LOC:Local_timer_interrupts 7869 ± 22% -79.5% 1609 ± 72% interrupts.CPU94.NMI:Non-maskable_interrupts 7869 ± 22% -79.5% 1609 ± 72% interrupts.CPU94.PMI:Performance_monitoring_interrupts 8067 ± 4% +2231.4% 188084 ± 3% interrupts.CPU94.RES:Rescheduling_interrupts 2.40 ± 42% +3344.4% 82.67 ± 24% interrupts.CPU94.TLB:TLB_shootdowns 4504 ± 14% +208.3% 13888 ± 4% interrupts.CPU95.CAL:Function_call_interrupts 554772 +408.4% 2820519 interrupts.CPU95.LOC:Local_timer_interrupts 7856 ± 22% -93.2% 537.33 ± 42% interrupts.CPU95.NMI:Non-maskable_interrupts 7856 ± 22% -93.2% 537.33 ± 42% interrupts.CPU95.PMI:Performance_monitoring_interrupts 11248 ± 2% +1587.7% 189840 ± 3% interrupts.CPU95.RES:Rescheduling_interrupts 4335 ± 15% +219.8% 13864 ± 4% interrupts.CPU96.CAL:Function_call_interrupts 555005 +408.1% 2820175 interrupts.CPU96.LOC:Local_timer_interrupts 7868 ± 22% -89.6% 818.33 ± 57% interrupts.CPU96.NMI:Non-maskable_interrupts 7868 ± 22% -89.6% 818.33 ± 57% interrupts.CPU96.PMI:Performance_monitoring_interrupts 7805 ± 4% +2346.8% 190974 interrupts.CPU96.RES:Rescheduling_interrupts 4486 ± 15% +207.0% 13776 ± 4% interrupts.CPU97.CAL:Function_call_interrupts 555859 +407.6% 2821358 interrupts.CPU97.LOC:Local_timer_interrupts 7858 ± 22% -88.9% 868.67 ± 55% interrupts.CPU97.NMI:Non-maskable_interrupts 7858 ± 22% -88.9% 868.67 ± 55% interrupts.CPU97.PMI:Performance_monitoring_interrupts 7753 ± 3% +2357.1% 190502 ± 2% interrupts.CPU97.RES:Rescheduling_interrupts 4434 ± 14% +210.9% 13784 ± 5% interrupts.CPU98.CAL:Function_call_interrupts 555153 +408.0% 2820159 interrupts.CPU98.LOC:Local_timer_interrupts 7843 ± 22% -90.8% 720.33 ± 26% interrupts.CPU98.NMI:Non-maskable_interrupts 7843 ± 22% -90.8% 720.33 ± 26% interrupts.CPU98.PMI:Performance_monitoring_interrupts 7998 ± 4% +2288.1% 191013 interrupts.CPU98.RES:Rescheduling_interrupts 0.80 ± 93% +10650.0% 86.00 ± 16% interrupts.CPU98.TLB:TLB_shootdowns 4501 ± 14% +207.4% 13837 ± 5% interrupts.CPU99.CAL:Function_call_interrupts 554867 +408.3% 2820189 interrupts.CPU99.LOC:Local_timer_interrupts 7883 ± 22% -93.9% 480.33 ± 24% interrupts.CPU99.NMI:Non-maskable_interrupts 7883 ± 22% -93.9% 480.33 ± 24% interrupts.CPU99.PMI:Performance_monitoring_interrupts 8211 ± 4% +2211.1% 189776 interrupts.CPU99.RES:Rescheduling_interrupts 1.40 ± 34% +6828.6% 97.00 ± 5% interrupts.CPU99.TLB:TLB_shootdowns 365.00 ± 10% -98.3% 6.33 ± 7% interrupts.IWI:IRQ_work_interrupts 1.065e+08 +408.2% 5.414e+08 interrupts.LOC:Local_timer_interrupts 0.00 +7.7e+104% 768.00 interrupts.MCP:Machine_check_polls 1528607 ± 9% -90.1% 151045 ± 13% interrupts.NMI:Non-maskable_interrupts 1528607 ± 9% -90.1% 151045 ± 13% interrupts.PMI:Performance_monitoring_interrupts 1546421 +2265.3% 36576995 interrupts.RES:Rescheduling_interrupts 504.40 ± 13% +3396.9% 17638 ± 8% interrupts.TLB:TLB_shootdowns aim7.jobs-per-min 35000 +-+-----------------------------------------------------------------+ |..+..+..+.+..+..+..+..+..+.+..+. +..+..+.+..+..+..+..+..+.+ | 30000 +-+ | | | 25000 +-+ | | | 20000 +-+ | | | 15000 +-+ | | | 10000 +-+ | | O O O O O O O O O O 5000 O-+O O O O O O O | | | 0 +-+------O-O--------O-------------------O----O-----O----------O-----+ aim7.time.user_time 100 +-+-------------------------------------------------------------------+ 90 +-+ O | O O O O O O | 80 +-+ O | 70 +-+ | | O O O O O O O O O O 60 +-+ | 50 +-+ | 40 +-+ | | | 30 +-+ | 20 +-+ | |..+..+..+..+..+..+.+..+..+..+..+..+..+..+..+..+..+..+.+..+..+..+ | 10 +-+ | 0 +-+------O--O-------O--------------------O-----O-----O----------O-----+ aim7.time.system_time 250000 +-+----------------------------------------------------------------+ | | O O O | 200000 +-+ O O O O O O O O O O O O O O O | | | | 150000 +-+ | | | 100000 +-+ | | | | | 50000 +-++..+.+..+..+..+..+.+..+..+..+..+.+..+..+..+.+..+..+..+..+.+ | | | | | 0 +-+-----O--O--------O------------------O-----O----O----------O-----+ aim7.time.elapsed_time 1600 +-+------------------------------------------------------------------+ O O O O O O O O | 1400 +-+ O O O O O O O O O O 1200 +-+ | | | 1000 +-+ | | | 800 +-+ | | | 600 +-+ | 400 +-+ | | .+.. .+.. .+.. | 200 +-+ +..+..+.+..+..+..+..+..+..+..+.+. +..+..+..+. +.+..+ | | | 0 +-+------O--O-------O-------------------O-----O-----O----------O-----+ aim7.time.elapsed_time.max 1600 +-+------------------------------------------------------------------+ O O O O O O O O | 1400 +-+ O O O O O O O O O O 1200 +-+ | | | 1000 +-+ | | | 800 +-+ | | | 600 +-+ | 400 +-+ | | .+.. .+.. .+.. | 200 +-+ +..+..+.+..+..+..+..+..+..+..+.+. +..+..+..+. +.+..+ | | | 0 +-+------O--O-------O-------------------O-----O-----O----------O-----+ aim7.time.minor_page_faults 1.4e+06 +-+---------------------------------------------------------------+ | | 1.2e+06 O-+O O O O O O O | O O O O O O | 1e+06 +-+ O O O O | | | 800000 +-+ | | | 600000 +-+ | | | 400000 +-+ | |..+..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+ | 200000 +-+ | | | 0 +-+-----O--O-------O-------------------O----O-----O----------O----+ aim7.time.voluntary_context_switches 1.8e+08 +-+---------------------------------------------------------------+ | | 1.6e+08 O-+O O O O O O O O O O O O O O O O O 1.4e+08 +-+ | | | 1.2e+08 +-+ | 1e+08 +-+ | | | 8e+07 +-+ | 6e+07 +-+ | | | 4e+07 +-+ | 2e+07 +-+ | | | 0 +-+-----O--O-------O-------------------O----O-----O----------O----+ aim7.time.file_system_outputs 3.5e+08 +-+---------------------------------------------------------------+ O O O O O O O O O O O O O O O O O O 3e+08 +-++..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+ | | | 2.5e+08 +-+ | | | 2e+08 +-+ | | | 1.5e+08 +-+ | | | 1e+08 +-+ | | | 5e+07 +-+ | | | 0 +-+-----O--O-------O-------------------O----O-----O----------O----+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-bdw-ex2: 160 threads Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz with 256G memory ========================================================================================= bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode: 4k/gcc-7/performance/1SSD/btrfs/sync/x86_64-rhel-7.6/1/debian-x86_64-2019-09-23.cgz/300s/randwrite/lkp-bdw-ex2/128G/fio-basic/0xb000038 commit: v5.4 c6bbf24815 ("btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") v5.4 c6bbf24815f95a4928984ff16a9 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 2:5 -40% :4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x %stddev %change %stddev \ | \ 0.01 +0.1 0.13 ± 11% fio.latency_100us% 57.88 ± 11% +32.9 90.74 fio.latency_10us% 1.39 ± 13% +2.5 3.91 ± 20% fio.latency_20us% 39.60 ± 17% -37.4 2.23 ± 31% fio.latency_4us% 0.01 +0.0 0.01 fio.latency_500ms% 0.01 +0.0 0.01 fio.latency_50ms% 1.14 ± 24% +1.8 2.96 ± 21% fio.latency_50us% 0.01 -0.0 0.00 fio.latency_750ms% 2.433e+08 -79.2% 50652326 fio.time.file_system_outputs 72.40 -71.3% 20.75 ± 2% fio.time.percent_of_cpu_this_job_got 178.42 -71.4% 51.00 ± 2% fio.time.system_time 41.80 ± 2% -67.7% 13.51 ± 7% fio.time.user_time 94840 ± 28% +180.2% 265709 fio.time.voluntary_context_switches 30413261 -79.2% 6331029 fio.workload 395.96 -79.2% 82.40 fio.write_bw_MBps 5843 ± 3% +52.2% 8896 ± 3% fio.write_clat_90%_us 6457 ± 6% +96.7% 12704 ± 15% fio.write_clat_95%_us 20198 ± 5% +29.9% 26240 ± 2% fio.write_clat_99%_us 7570 ± 2% +496.0% 45124 fio.write_clat_mean_us 1034942 +209.9% 3207497 fio.write_clat_stddev 101365 -79.2% 21095 fio.write_iops 0.52 ± 24% +176.5% 1.43 ± 8% iostat.cpu.system 0.25 ± 3% -0.3 0.00 ± 20% mpstat.cpu.all.iowait% 0.44 ± 4% +0.9 1.33 mpstat.cpu.all.sys% 0.08 ± 2% -0.0 0.03 ± 3% mpstat.cpu.all.usr% 47776042 ± 51% +1992.1% 9.995e+08 ± 2% cpuidle.C1.time 1537623 ± 56% +2396.4% 38385075 ± 2% cpuidle.C1.usage 8517248 ± 18% +383.9% 41215825 ± 12% cpuidle.POLL.time 178308 ± 27% +545.0% 1150130 ± 11% cpuidle.POLL.usage 398989 -64.4% 142119 vmstat.io.bo 2555198 +22.3% 3125533 vmstat.memory.cache 0.80 ± 50% +150.0% 2.00 vmstat.procs.r 12942 ± 41% +1974.7% 268509 vmstat.system.cs 88.40 ± 7% +28.7% 113.75 ± 4% turbostat.Avg_MHz 1753 ± 3% +13.2% 1984 ± 4% turbostat.Bzy_MHz 1533974 ± 56% +2402.2% 38383224 ± 2% turbostat.C1 0.08 ± 50% +1.6 1.72 ± 2% turbostat.C1% 0.05 ± 27% -94.8% 0.00 ±173% turbostat.Pkg%pc3 114057 ± 55% +207.2% 350333 ± 73% numa-meminfo.node0.Active 3257 ±186% +1555.0% 53912 ± 71% numa-meminfo.node1.AnonHugePages 8319 ±196% +2394.4% 207527 ± 98% numa-meminfo.node2.Active(file) 57390 ± 31% +58.0% 90689 ± 12% numa-meminfo.node2.SUnreclaim 80982 ± 29% +50.0% 121464 ± 4% numa-meminfo.node2.Slab 112031 ± 46% +427.4% 590854 ± 51% numa-meminfo.node3.Active 5124 ±155% +9495.4% 491668 ± 67% numa-meminfo.node3.Active(file) 250016 ± 79% -57.3% 106862 ±164% numa-meminfo.node3.Mapped 20831 ± 82% +6442.6% 1362889 ± 85% numa-vmstat.node0.nr_dirtied 0.00 +6.8e+103% 67.75 ± 70% numa-vmstat.node0.nr_writeback 10194 ±177% +13078.4% 1343488 ± 86% numa-vmstat.node0.nr_written 2080 ±196% +2396.1% 51923 ± 98% numa-vmstat.node2.nr_active_file 14348 ± 31% +58.1% 22688 ± 12% numa-vmstat.node2.nr_slab_unreclaimable 2080 ±196% +2396.1% 51923 ± 98% numa-vmstat.node2.nr_zone_active_file 1280 ±155% +9498.7% 122940 ± 66% numa-vmstat.node3.nr_active_file 1280 ±155% +9498.7% 122940 ± 66% numa-vmstat.node3.nr_zone_active_file 332445 +277.6% 1255337 meminfo.Active 67620 ± 7% +1365.2% 990798 meminfo.Active(file) 2454848 +23.3% 3025840 meminfo.Cached 342301 -93.1% 23673 ± 2% meminfo.Dirty 1296413 -27.2% 943704 meminfo.Inactive 860541 -41.2% 506064 meminfo.Inactive(file) 4055543 +15.1% 4667224 meminfo.Memused 274597 +23.1% 337913 meminfo.SUnreclaim 380301 +18.0% 448877 meminfo.Slab 177641 ± 2% -99.3% 1300 ± 12% meminfo.Writeback 14528 +23.4% 17927 meminfo.max_used_kB 16884 ± 7% +1366.9% 247677 proc-vmstat.nr_active_file 30454821 -64.1% 10918817 proc-vmstat.nr_dirtied 85141 ± 2% -93.1% 5891 ± 2% proc-vmstat.nr_dirty 613418 +23.3% 756437 proc-vmstat.nr_file_pages 214946 -41.1% 126703 proc-vmstat.nr_inactive_file 26425 +5.0% 27741 proc-vmstat.nr_slab_reclaimable 68649 +23.0% 84472 proc-vmstat.nr_slab_unreclaimable 44798 ± 3% -99.3% 305.75 ± 7% proc-vmstat.nr_writeback 30394933 -64.5% 10798666 proc-vmstat.nr_written 16884 ± 7% +1366.9% 247677 proc-vmstat.nr_zone_active_file 214946 -41.1% 126703 proc-vmstat.nr_zone_inactive_file 129947 -95.0% 6493 ± 2% proc-vmstat.nr_zone_write_pending 10412260 ± 3% -20.2% 8313759 proc-vmstat.numa_hit 10318764 ± 3% -20.3% 8220420 proc-vmstat.numa_local 10600 ± 7% +2185.4% 242262 proc-vmstat.pgactivate 10808064 ± 3% -18.8% 8772579 proc-vmstat.pgalloc_normal 10678751 ± 3% -20.4% 8503532 proc-vmstat.pgfree 1.216e+08 -64.5% 43203372 proc-vmstat.pgpgout 22959094 -100.0% 95.75 ± 88% proc-vmstat.pgrotated 72.84 ± 72% +473.4% 417.68 ± 47% sched_debug.cfs_rq:/.MIN_vruntime.avg 637.59 ± 62% +346.8% 2849 ± 49% sched_debug.cfs_rq:/.MIN_vruntime.stddev 1783 ± 18% +93.2% 3445 ± 20% sched_debug.cfs_rq:/.exec_clock.avg 50716 ± 21% -63.8% 18345 ± 23% sched_debug.cfs_rq:/.exec_clock.max 7999 ± 23% -49.2% 4061 ± 12% sched_debug.cfs_rq:/.exec_clock.stddev 39377 ± 11% +69.9% 66904 ± 22% sched_debug.cfs_rq:/.load.avg 168189 ± 8% +33.8% 224961 ± 14% sched_debug.cfs_rq:/.load.stddev 2773 ±135% -73.2% 742.96 ± 7% sched_debug.cfs_rq:/.load_avg.max 322.53 ± 97% -52.9% 151.89 ± 6% sched_debug.cfs_rq:/.load_avg.stddev 72.84 ± 72% +473.5% 417.71 ± 47% sched_debug.cfs_rq:/.max_vruntime.avg 637.59 ± 62% +346.9% 2849 ± 49% sched_debug.cfs_rq:/.max_vruntime.stddev 0.07 ± 11% +29.9% 0.09 ± 12% sched_debug.cfs_rq:/.nr_running.avg 0.26 ± 5% +12.5% 0.29 ± 6% sched_debug.cfs_rq:/.nr_running.stddev 799.87 ± 9% -31.7% 546.00 ± 11% sched_debug.cfs_rq:/.runnable_load_avg.max 133.61 ± 11% -31.2% 91.96 ± 16% sched_debug.cfs_rq:/.runnable_load_avg.stddev 39363 ± 11% +71.7% 67603 ± 21% sched_debug.cfs_rq:/.runnable_weight.avg 168159 ± 8% +34.4% 226034 ± 14% sched_debug.cfs_rq:/.runnable_weight.stddev 75.12 ± 9% +28.6% 96.63 sched_debug.cfs_rq:/.util_avg.avg 952.50 ± 6% -21.2% 750.96 ± 8% sched_debug.cfs_rq:/.util_avg.max 8.03 ± 27% +177.8% 22.30 ± 25% sched_debug.cfs_rq:/.util_est_enqueued.avg 283.40 ± 26% +97.0% 558.17 ± 15% sched_debug.cfs_rq:/.util_est_enqueued.max 41.81 ± 27% +117.2% 90.82 ± 17% sched_debug.cfs_rq:/.util_est_enqueued.stddev 79275 ± 94% -85.8% 11273 ± 53% sched_debug.cpu.avg_idle.min 136153 ± 14% +112.5% 289333 ± 14% sched_debug.cpu.avg_idle.stddev 91.84 ± 7% +32.1% 121.32 ± 4% sched_debug.cpu.curr->pid.avg 723.08 +10.3% 797.44 sched_debug.cpu.curr->pid.stddev 0.00 ± 8% +74.7% 0.00 ± 63% sched_debug.cpu.next_balance.stddev 0.02 ± 13% +47.8% 0.03 sched_debug.cpu.nr_running.avg 0.14 ± 5% +24.9% 0.18 ± 2% sched_debug.cpu.nr_running.stddev 12377 ± 26% +1641.0% 215492 sched_debug.cpu.nr_switches.avg 138711 ± 21% +1158.5% 1745692 ± 2% sched_debug.cpu.nr_switches.max 24327 ± 27% +1279.0% 335462 ± 6% sched_debug.cpu.nr_switches.stddev 0.00 ± 18% +371.6% 0.02 ± 21% sched_debug.cpu.nr_uninterruptible.avg 10202 ± 32% +1991.1% 213351 sched_debug.cpu.sched_count.avg 135159 ± 21% +1188.9% 1742064 ± 3% sched_debug.cpu.sched_count.max 23982 ± 28% +1298.2% 335324 ± 6% sched_debug.cpu.sched_count.stddev 5075 ± 32% +2001.3% 106642 sched_debug.cpu.sched_goidle.avg 66959 ± 22% +1200.7% 870926 ± 3% sched_debug.cpu.sched_goidle.max 11927 ± 28% +1305.5% 167638 ± 6% sched_debug.cpu.sched_goidle.stddev 5098 ± 32% +1992.3% 106673 sched_debug.cpu.ttwu_count.avg 83668 ± 13% +1131.3% 1030207 ± 24% sched_debug.cpu.ttwu_count.max 13198 ± 24% +1235.9% 176317 ± 10% sched_debug.cpu.ttwu_count.stddev 45.43 ± 20% -45.3% 24.84 ± 14% perf-stat.i.MPKI 7.979e+08 ± 3% +112.4% 1.694e+09 ± 2% perf-stat.i.branch-instructions 5.13 ± 18% -2.4 2.78 ± 24% perf-stat.i.cache-miss-rate% 8928732 ± 3% -34.0% 5894104 ± 11% perf-stat.i.cache-misses 12709 ± 39% +2033.3% 271124 perf-stat.i.context-switches 4.64 ± 12% -44.5% 2.58 ± 6% perf-stat.i.cpi 1.783e+10 ± 9% +27.2% 2.268e+10 ± 5% perf-stat.i.cpu-cycles 1.17 ± 6% +117.5% 2.54 ± 8% perf-stat.i.cpu-migrations 7454 ± 13% -43.6% 4202 ± 16% perf-stat.i.cycles-between-cache-misses 0.58 ± 17% -0.3 0.30 ± 14% perf-stat.i.dTLB-load-miss-rate% 1.186e+09 ± 4% +96.6% 2.332e+09 ± 5% perf-stat.i.dTLB-loads 0.17 ± 11% -0.1 0.11 ± 7% perf-stat.i.dTLB-store-miss-rate% 1.395e+09 ± 9% +47.6% 2.059e+09 ± 6% perf-stat.i.dTLB-stores 64.94 ± 18% -29.2 35.76 ± 15% perf-stat.i.iTLB-load-miss-rate% 1491476 ± 30% +168.0% 3997670 ± 8% perf-stat.i.iTLB-loads 3.95e+09 ± 3% +123.4% 8.822e+09 perf-stat.i.instructions 1572 ± 26% +164.6% 4160 ± 16% perf-stat.i.instructions-per-iTLB-miss 0.22 ± 11% +75.9% 0.39 ± 6% perf-stat.i.ipc 38.76 ± 22% +36.0 74.80 ± 6% perf-stat.i.node-load-miss-rate% 705005 ± 38% +142.1% 1706592 ± 16% perf-stat.i.node-load-misses 1896166 ± 19% -74.6% 482109 ± 9% perf-stat.i.node-loads 32.55 ± 21% +22.2 54.74 ± 2% perf-stat.i.node-store-miss-rate% 151649 ± 25% +250.3% 531162 ± 25% perf-stat.i.node-store-misses 258717 ± 13% +53.3% 396653 ± 27% perf-stat.i.node-stores 44.38 ± 20% -44.1% 24.83 ± 14% perf-stat.overall.MPKI 5.29 ± 18% -2.5 2.78 ± 24% perf-stat.overall.cache-miss-rate% 4.53 ± 12% -43.2% 2.57 ± 6% perf-stat.overall.cpi 2000 ± 10% +95.4% 3907 ± 13% perf-stat.overall.cycles-between-cache-misses 0.56 ± 18% -0.3 0.30 ± 14% perf-stat.overall.dTLB-load-miss-rate% 0.17 ± 11% -0.1 0.11 ± 7% perf-stat.overall.dTLB-store-miss-rate% 64.56 ± 18% -29.3 35.28 ± 15% perf-stat.overall.iTLB-load-miss-rate% 1536 ± 27% +170.4% 4156 ± 16% perf-stat.overall.instructions-per-iTLB-miss 0.22 ± 11% +74.3% 0.39 ± 6% perf-stat.overall.ipc 27.54 ± 44% +50.1 77.66 ± 4% perf-stat.overall.node-load-miss-rate% 36.62 ± 18% +20.7 57.35 ± 2% perf-stat.overall.node-store-miss-rate% 39129 ± 3% +970.2% 418778 perf-stat.overall.path-length 7.953e+08 ± 3% +112.3% 1.689e+09 ± 2% perf-stat.ps.branch-instructions 8901858 ± 3% -34.0% 5874250 ± 11% perf-stat.ps.cache-misses 12653 ± 39% +2035.1% 270171 perf-stat.ps.context-switches 1.778e+10 ± 9% +27.2% 2.261e+10 ± 5% perf-stat.ps.cpu-cycles 1.20 ± 7% +114.7% 2.58 ± 7% perf-stat.ps.cpu-migrations 1.183e+09 ± 4% +96.5% 2.324e+09 ± 5% perf-stat.ps.dTLB-loads 1.391e+09 ± 9% +47.5% 2.052e+09 ± 6% perf-stat.ps.dTLB-stores 1486433 ± 30% +168.0% 3984068 ± 8% perf-stat.ps.iTLB-loads 3.937e+09 ± 3% +123.3% 8.792e+09 perf-stat.ps.instructions 703018 ± 38% +142.0% 1701003 ± 16% perf-stat.ps.node-load-misses 1890303 ± 19% -74.6% 480418 ± 9% perf-stat.ps.node-loads 151193 ± 25% +250.2% 529461 ± 25% perf-stat.ps.node-store-misses 257877 ± 13% +53.3% 395431 ± 27% perf-stat.ps.node-stores 1.19e+12 ± 3% +122.8% 2.651e+12 perf-stat.total.instructions 55959 ± 7% +45.0% 81134 ± 4% slabinfo.Acpi-State.active_objs 1286 ± 6% +40.0% 1800 ± 3% slabinfo.Acpi-State.active_slabs 65619 ± 6% +39.9% 91828 ± 3% slabinfo.Acpi-State.num_objs 1286 ± 6% +40.0% 1800 ± 3% slabinfo.Acpi-State.num_slabs 6871 ± 6% +416.0% 35453 ± 13% slabinfo.avc_xperms_data.active_objs 54.40 ± 6% +420.7% 283.25 ± 12% slabinfo.avc_xperms_data.active_slabs 7019 ± 6% +417.9% 36354 ± 12% slabinfo.avc_xperms_data.num_objs 54.40 ± 6% +420.7% 283.25 ± 12% slabinfo.avc_xperms_data.num_slabs 379.20 ± 8% +64.1% 622.25 ± 11% slabinfo.biovec-max.active_objs 449.20 ± 5% +56.8% 704.50 ± 11% slabinfo.biovec-max.num_objs 2562 ± 5% +247.2% 8897 ± 15% slabinfo.blkdev_ioc.active_objs 69.20 ± 5% +241.8% 236.50 ± 15% slabinfo.blkdev_ioc.active_slabs 2708 ± 5% +240.9% 9233 ± 15% slabinfo.blkdev_ioc.num_objs 69.20 ± 5% +241.8% 236.50 ± 15% slabinfo.blkdev_ioc.num_slabs 15743 ± 48% +1506.2% 252868 slabinfo.btrfs_extent_map.active_objs 287.60 ± 48% +1504.6% 4614 slabinfo.btrfs_extent_map.active_slabs 16141 ± 48% +1501.2% 258447 slabinfo.btrfs_extent_map.num_objs 287.60 ± 48% +1504.6% 4614 slabinfo.btrfs_extent_map.num_slabs 5954 ± 25% +297.0% 23641 ± 9% slabinfo.btrfs_ordered_extent.active_objs 156.20 ± 25% +293.9% 615.25 ± 10% slabinfo.btrfs_ordered_extent.active_slabs 6116 ± 25% +292.6% 24014 ± 10% slabinfo.btrfs_ordered_extent.num_objs 156.20 ± 25% +293.9% 615.25 ± 10% slabinfo.btrfs_ordered_extent.num_slabs 2570 ± 3% +85.3% 4762 ± 6% slabinfo.buffer_head.active_objs 2570 ± 3% +85.3% 4762 ± 6% slabinfo.buffer_head.num_objs 5473 ± 15% +19.2% 6524 ± 11% slabinfo.dmaengine-unmap-16.active_objs 5590 ± 15% +16.9% 6534 ± 11% slabinfo.dmaengine-unmap-16.num_objs 5195 ± 32% +201.0% 15638 ± 5% slabinfo.khugepaged_mm_slot.active_objs 149.20 ± 31% +201.6% 450.00 ± 5% slabinfo.khugepaged_mm_slot.active_slabs 5392 ± 31% +200.7% 16213 ± 5% slabinfo.khugepaged_mm_slot.num_objs 149.20 ± 31% +201.6% 450.00 ± 5% slabinfo.khugepaged_mm_slot.num_slabs 17363 ± 5% -14.1% 14914 slabinfo.kmalloc-128.active_objs 17694 ± 5% -15.5% 14950 slabinfo.kmalloc-128.num_objs 11515 ± 4% +45.5% 16760 ± 5% slabinfo.kmalloc-1k.active_objs 370.40 ± 3% +44.0% 533.25 ± 5% slabinfo.kmalloc-1k.active_slabs 11877 ± 3% +43.8% 17084 ± 5% slabinfo.kmalloc-1k.num_objs 370.40 ± 3% +44.0% 533.25 ± 5% slabinfo.kmalloc-1k.num_slabs 29870 ± 5% +22.4% 36571 ± 5% slabinfo.kmalloc-512.active_objs 474.80 ± 5% +21.8% 578.25 ± 5% slabinfo.kmalloc-512.active_slabs 30417 ± 5% +21.8% 37045 ± 5% slabinfo.kmalloc-512.num_objs 474.80 ± 5% +21.8% 578.25 ± 5% slabinfo.kmalloc-512.num_slabs 857.60 ± 12% +23.1% 1056 ± 5% slabinfo.kmalloc-rcl-128.active_objs 857.60 ± 12% +23.1% 1056 ± 5% slabinfo.kmalloc-rcl-128.num_objs 2773 ± 21% +62.2% 4499 ± 11% slabinfo.mnt_cache.active_objs 3119 ± 18% +44.4% 4504 ± 11% slabinfo.mnt_cache.num_objs 2829 ± 7% +800.3% 25472 ± 7% slabinfo.numa_policy.active_objs 48.40 ± 9% +764.7% 418.50 ± 7% slabinfo.numa_policy.active_slabs 3037 ± 8% +755.0% 25972 ± 7% slabinfo.numa_policy.num_objs 48.40 ± 9% +764.7% 418.50 ± 7% slabinfo.numa_policy.num_slabs 15315 ± 5% +8.6% 16637 ± 4% slabinfo.pde_opener.active_objs 15315 ± 5% +8.6% 16637 ± 4% slabinfo.pde_opener.num_objs 28822 +25.4% 36129 slabinfo.radix_tree_node.active_objs 521.60 +24.4% 648.75 slabinfo.radix_tree_node.active_slabs 29229 +24.4% 36364 slabinfo.radix_tree_node.num_objs 521.60 +24.4% 648.75 slabinfo.radix_tree_node.num_slabs 69749 ± 5% -17.4% 57646 ± 9% softirqs.CPU1.RCU 69613 ± 7% -19.5% 56054 ± 8% softirqs.CPU108.RCU 70414 ± 6% -20.6% 55890 ± 9% softirqs.CPU109.RCU 74714 ± 8% -23.2% 57359 ± 7% softirqs.CPU110.RCU 73840 ± 6% -20.7% 58545 ± 8% softirqs.CPU111.RCU 67786 ± 5% -21.9% 52950 ± 10% softirqs.CPU112.RCU 63870 ± 4% -21.2% 50360 ± 13% softirqs.CPU113.RCU 61631 ± 7% -19.8% 49424 ± 9% softirqs.CPU115.RCU 61761 ± 7% -23.9% 47005 ± 14% softirqs.CPU116.RCU 66061 ± 5% -22.3% 51351 ± 10% softirqs.CPU118.RCU 70757 ± 5% -19.6% 56890 ± 10% softirqs.CPU13.RCU 75075 ± 10% -14.4% 64252 ± 7% softirqs.CPU137.RCU 75350 ± 8% -23.0% 57993 ± 7% softirqs.CPU14.RCU 72368 ± 9% -18.9% 58718 ± 8% softirqs.CPU143.RCU 69446 ± 5% -21.1% 54792 ± 10% softirqs.CPU16.RCU 132884 ± 6% -11.9% 117111 ± 5% softirqs.CPU168.TIMER 131281 ± 6% -11.3% 116401 ± 5% softirqs.CPU169.TIMER 65042 ± 4% -20.5% 51704 ± 13% softirqs.CPU17.RCU 132299 ± 8% -13.9% 113975 ± 6% softirqs.CPU171.TIMER 130938 ± 6% -13.2% 113639 ± 6% softirqs.CPU172.TIMER 130353 ± 7% -11.3% 115662 ± 7% softirqs.CPU173.TIMER 131624 ± 6% -13.7% 113598 ± 7% softirqs.CPU174.TIMER 131779 ± 5% -11.6% 116474 ± 6% softirqs.CPU175.TIMER 131178 ± 6% -12.3% 115035 ± 5% softirqs.CPU176.TIMER 130883 ± 6% -12.6% 114392 ± 6% softirqs.CPU177.TIMER 130992 ± 6% -12.1% 115082 ± 6% softirqs.CPU178.TIMER 129359 ± 6% -12.0% 113895 ± 6% softirqs.CPU179.TIMER 131016 ± 6% -13.6% 113237 ± 6% softirqs.CPU180.TIMER 131581 ± 6% -13.4% 113904 ± 5% softirqs.CPU181.TIMER 133339 ± 4% -14.0% 114665 ± 5% softirqs.CPU182.TIMER 135055 ± 2% -15.0% 114777 ± 4% softirqs.CPU183.TIMER 134951 ± 2% -14.9% 114900 ± 4% softirqs.CPU184.TIMER 133328 ± 4% -11.7% 117692 ± 5% softirqs.CPU185.TIMER 137402 ± 4% -15.3% 116338 ± 5% softirqs.CPU187.TIMER 132062 ± 5% -13.3% 114496 ± 6% softirqs.CPU188.TIMER 70556 ± 9% -33.0% 47256 ± 36% softirqs.CPU189.RCU 134578 ± 2% -14.7% 114761 ± 6% softirqs.CPU189.TIMER 62949 ± 6% -19.9% 50421 ± 9% softirqs.CPU19.RCU 138820 ± 6% -17.1% 115097 ± 5% softirqs.CPU190.TIMER 134281 ± 4% -15.0% 114201 ± 5% softirqs.CPU191.TIMER 71300 ± 7% -20.3% 56818 ± 10% softirqs.CPU2.RCU 62736 ± 6% -22.8% 48407 ± 13% softirqs.CPU20.RCU 68849 ± 8% -19.5% 55449 ± 12% softirqs.CPU21.RCU 67408 ± 5% -20.1% 53856 ± 11% softirqs.CPU22.RCU 62986 ± 6% -17.2% 52144 ± 11% softirqs.CPU23.RCU 68774 ± 9% -20.9% 54407 ± 9% softirqs.CPU3.RCU 75690 ± 11% -12.9% 65941 ± 7% softirqs.CPU41.RCU 139020 ± 9% -20.4% 110696 ± 11% softirqs.CPU45.TIMER 67053 ± 4% -16.4% 56048 ± 11% softirqs.CPU5.RCU 133216 ± 6% -11.6% 117708 ± 5% softirqs.CPU72.TIMER 132145 ± 6% -11.3% 117182 ± 5% softirqs.CPU73.TIMER 132757 ± 7% -13.4% 114960 ± 5% softirqs.CPU75.TIMER 131495 ± 6% -11.7% 116103 ± 7% softirqs.CPU77.TIMER 131972 ± 6% -13.8% 113707 ± 6% softirqs.CPU78.TIMER 133041 ± 5% -11.9% 117215 ± 5% softirqs.CPU79.TIMER 132358 ± 6% -12.2% 116195 ± 5% softirqs.CPU80.TIMER 131900 ± 6% -12.2% 115759 ± 5% softirqs.CPU82.TIMER 129868 ± 6% -12.0% 114333 ± 5% softirqs.CPU83.TIMER 132383 ± 6% -13.3% 114800 ± 5% softirqs.CPU84.TIMER 132694 ± 6% -13.2% 115187 ± 5% softirqs.CPU85.TIMER 133890 ± 4% -13.7% 115570 ± 5% softirqs.CPU86.TIMER 136355 ± 2% -15.3% 115550 ± 4% softirqs.CPU87.TIMER 136051 ± 2% -14.7% 116047 ± 4% softirqs.CPU88.TIMER 135749 ± 4% -13.2% 117857 ± 5% softirqs.CPU89.TIMER 145904 ± 6% -26.2% 107728 ± 13% softirqs.CPU90.TIMER 138001 ± 3% -14.8% 117572 ± 5% softirqs.CPU91.TIMER 133596 ± 5% -14.2% 114604 ± 5% softirqs.CPU92.TIMER 135980 ± 2% -14.4% 116448 ± 5% softirqs.CPU93.TIMER 138826 ± 5% -16.5% 115875 ± 5% softirqs.CPU94.TIMER 135092 ± 4% -14.9% 114902 ± 5% softirqs.CPU95.TIMER 69464 ± 4% -17.2% 57487 ± 12% softirqs.CPU97.RCU 66667 ± 9% -18.1% 54607 ± 10% softirqs.CPU99.RCU 1181 ± 49% -66.3% 397.50 ± 21% interrupts.51:PCI-MSI.1572864-edge.eth0-TxRx-0 152.20 ± 4% +180.4% 426.75 ± 38% interrupts.63:PCI-MSI.1572876-edge.eth0-TxRx-12 1181 ± 49% -66.3% 397.50 ± 21% interrupts.CPU0.51:PCI-MSI.1572864-edge.eth0-TxRx-0 1181 ± 47% +136.5% 2793 ± 48% interrupts.CPU0.RES:Rescheduling_interrupts 553.80 ±115% +726.9% 4579 ± 63% interrupts.CPU1.RES:Rescheduling_interrupts 99.00 ±196% +2456.1% 2530 ±133% interrupts.CPU106.RES:Rescheduling_interrupts 19.20 ±170% +9433.9% 1830 ±106% interrupts.CPU113.RES:Rescheduling_interrupts 442.20 ± 32% +111.0% 933.25 ± 34% interrupts.CPU115.NMI:Non-maskable_interrupts 442.20 ± 32% +111.0% 933.25 ± 34% interrupts.CPU115.PMI:Performance_monitoring_interrupts 464.00 ± 28% +46.1% 678.00 ± 16% interrupts.CPU117.NMI:Non-maskable_interrupts 464.00 ± 28% +46.1% 678.00 ± 16% interrupts.CPU117.PMI:Performance_monitoring_interrupts 152.20 ± 4% +180.4% 426.75 ± 38% interrupts.CPU12.63:PCI-MSI.1572876-edge.eth0-TxRx-12 105.00 ± 70% +99.8% 209.75 ± 16% interrupts.CPU124.TLB:TLB_shootdowns 129.40 ± 38% +60.9% 208.25 ± 23% interrupts.CPU125.TLB:TLB_shootdowns 115.60 ± 53% +80.4% 208.50 ± 27% interrupts.CPU126.TLB:TLB_shootdowns 107.20 ± 64% +103.4% 218.00 ± 24% interrupts.CPU127.TLB:TLB_shootdowns 0.20 ±200% +2.5e+05% 492.25 ±172% interrupts.CPU129.RES:Rescheduling_interrupts 119.00 ± 24% +73.9% 207.00 ± 26% interrupts.CPU129.TLB:TLB_shootdowns 111.00 ± 42% +91.0% 212.00 ± 28% interrupts.CPU130.TLB:TLB_shootdowns 109.80 ± 57% +96.3% 215.50 ± 17% interrupts.CPU131.TLB:TLB_shootdowns 125.80 ± 37% +52.8% 192.25 ± 28% interrupts.CPU132.TLB:TLB_shootdowns 124.60 ± 46% +82.0% 226.75 ± 20% interrupts.CPU133.TLB:TLB_shootdowns 104.00 ± 69% +105.5% 213.75 ± 23% interrupts.CPU136.TLB:TLB_shootdowns 127.60 ± 65% +78.7% 228.00 ± 15% interrupts.CPU137.TLB:TLB_shootdowns 141.20 ± 51% +64.8% 232.75 ± 15% interrupts.CPU143.TLB:TLB_shootdowns 255.80 ±197% +1547.5% 4214 ± 52% interrupts.CPU144.RES:Rescheduling_interrupts 474.40 ± 37% +113.6% 1013 ± 43% interrupts.CPU145.NMI:Non-maskable_interrupts 474.40 ± 37% +113.6% 1013 ± 43% interrupts.CPU145.PMI:Performance_monitoring_interrupts 75.60 ±188% +5395.7% 4154 ± 64% interrupts.CPU145.RES:Rescheduling_interrupts 441.80 ± 26% +104.6% 903.75 ± 33% interrupts.CPU146.NMI:Non-maskable_interrupts 441.80 ± 26% +104.6% 903.75 ± 33% interrupts.CPU146.PMI:Performance_monitoring_interrupts 162.80 ±193% +2010.3% 3435 ± 38% interrupts.CPU147.RES:Rescheduling_interrupts 216.00 ±199% +915.3% 2193 ± 59% interrupts.CPU148.RES:Rescheduling_interrupts 23.20 ±195% +13183.4% 3081 ± 41% interrupts.CPU149.RES:Rescheduling_interrupts 112.40 ±197% +1786.6% 2120 ±106% interrupts.CPU15.RES:Rescheduling_interrupts 53.00 ±199% +1787.7% 1000 ± 90% interrupts.CPU150.RES:Rescheduling_interrupts 514.00 ± 26% +172.0% 1398 ± 65% interrupts.CPU151.NMI:Non-maskable_interrupts 514.00 ± 26% +172.0% 1398 ± 65% interrupts.CPU151.PMI:Performance_monitoring_interrupts 0.80 ± 50% +4.8e+05% 3804 ± 87% interrupts.CPU151.RES:Rescheduling_interrupts 29.20 ±196% +6702.2% 1986 ± 82% interrupts.CPU152.RES:Rescheduling_interrupts 15.60 ±177% +28733.3% 4498 ± 76% interrupts.CPU153.RES:Rescheduling_interrupts 10.40 ±185% +30938.5% 3228 ± 67% interrupts.CPU154.RES:Rescheduling_interrupts 227.20 ±199% +1495.8% 3625 ± 95% interrupts.CPU155.RES:Rescheduling_interrupts 4.60 ±168% +62894.6% 2897 ± 72% interrupts.CPU156.RES:Rescheduling_interrupts 1.60 ±145% +2.9e+05% 4564 ±141% interrupts.CPU157.RES:Rescheduling_interrupts 0.40 ±122% +4.8e+05% 1912 ± 70% interrupts.CPU158.RES:Rescheduling_interrupts 4.40 ±125% +1.1e+05% 4798 ± 95% interrupts.CPU159.RES:Rescheduling_interrupts 1.60 ±122% +29212.5% 469.00 ± 99% interrupts.CPU16.RES:Rescheduling_interrupts 588.60 ± 10% +95.0% 1147 ± 68% interrupts.CPU160.NMI:Non-maskable_interrupts 588.60 ± 10% +95.0% 1147 ± 68% interrupts.CPU160.PMI:Performance_monitoring_interrupts 4.40 ±178% +73394.3% 3233 ±105% interrupts.CPU160.RES:Rescheduling_interrupts 18.20 ±200% +30933.0% 5648 ±104% interrupts.CPU161.RES:Rescheduling_interrupts 5.60 ±166% +41708.0% 2341 ±122% interrupts.CPU162.RES:Rescheduling_interrupts 2.80 ±182% +1.1e+05% 3193 ±130% interrupts.CPU165.RES:Rescheduling_interrupts 3.20 ±127% +77173.4% 2472 ±108% interrupts.CPU166.RES:Rescheduling_interrupts 7.40 ±122% +35491.2% 2633 ± 95% interrupts.CPU167.RES:Rescheduling_interrupts 2.60 ±162% +24448.1% 638.25 ± 86% interrupts.CPU168.RES:Rescheduling_interrupts 6.80 ±115% +39719.9% 2707 ± 64% interrupts.CPU169.RES:Rescheduling_interrupts 2.00 ±154% +1.1e+05% 2215 ±146% interrupts.CPU170.RES:Rescheduling_interrupts 95.60 ±147% +6538.9% 6346 ± 99% interrupts.CPU173.RES:Rescheduling_interrupts 42.20 ±162% +6094.9% 2614 ± 92% interrupts.CPU176.RES:Rescheduling_interrupts 6.20 ±123% +32258.9% 2006 ±138% interrupts.CPU177.RES:Rescheduling_interrupts 83.20 ±169% +1625.7% 1435 ± 93% interrupts.CPU178.RES:Rescheduling_interrupts 8.60 ± 78% +16266.3% 1407 ±137% interrupts.CPU179.RES:Rescheduling_interrupts 5.80 ±150% +22417.2% 1306 ±116% interrupts.CPU18.RES:Rescheduling_interrupts 18.00 ±116% +8848.6% 1610 ± 99% interrupts.CPU182.RES:Rescheduling_interrupts 12.80 ±116% +9329.7% 1207 ±115% interrupts.CPU183.RES:Rescheduling_interrupts 11.40 ± 87% +9461.4% 1090 ±115% interrupts.CPU184.RES:Rescheduling_interrupts 3.20 ±127% +72095.3% 2310 ± 53% interrupts.CPU185.RES:Rescheduling_interrupts 14.40 ±142% +4773.3% 701.75 ± 87% interrupts.CPU186.RES:Rescheduling_interrupts 181.80 ±165% +1590.2% 3072 ±116% interrupts.CPU19.RES:Rescheduling_interrupts 72.00 ±193% +1860.4% 1411 ±144% interrupts.CPU190.RES:Rescheduling_interrupts 97.80 ±199% +2190.1% 2239 ± 77% interrupts.CPU191.RES:Rescheduling_interrupts 424.80 ± 85% +749.2% 3607 ± 56% interrupts.CPU2.RES:Rescheduling_interrupts 273.40 ± 38% +756.3% 2341 ± 81% interrupts.CPU3.RES:Rescheduling_interrupts 70.80 ± 62% +95.6% 138.50 ± 20% interrupts.CPU35.TLB:TLB_shootdowns 78.80 ± 52% +66.2% 131.00 ± 14% interrupts.CPU37.TLB:TLB_shootdowns 431.40 ±178% +519.9% 2674 ± 66% interrupts.CPU4.RES:Rescheduling_interrupts 75.60 ± 71% +85.2% 140.00 ± 23% interrupts.CPU41.TLB:TLB_shootdowns 455.20 ± 28% +27.5% 580.25 ± 5% interrupts.CPU43.NMI:Non-maskable_interrupts 455.20 ± 28% +27.5% 580.25 ± 5% interrupts.CPU43.PMI:Performance_monitoring_interrupts 547.60 ± 29% +106.1% 1128 ± 53% interrupts.CPU49.NMI:Non-maskable_interrupts 547.60 ± 29% +106.1% 1128 ± 53% interrupts.CPU49.PMI:Performance_monitoring_interrupts 144.20 ±194% +2109.3% 3185 ± 64% interrupts.CPU49.RES:Rescheduling_interrupts 525.60 ± 26% +93.7% 1018 ± 39% interrupts.CPU50.NMI:Non-maskable_interrupts 525.60 ± 26% +93.7% 1018 ± 39% interrupts.CPU50.PMI:Performance_monitoring_interrupts 105.60 ±196% +2363.5% 2601 ±112% interrupts.CPU50.RES:Rescheduling_interrupts 179.60 ±195% +1592.4% 3039 ± 76% interrupts.CPU51.RES:Rescheduling_interrupts 489.20 ± 41% +111.9% 1036 ± 52% interrupts.CPU52.NMI:Non-maskable_interrupts 489.20 ± 41% +111.9% 1036 ± 52% interrupts.CPU52.PMI:Performance_monitoring_interrupts 98.80 ±188% +4864.1% 4904 ± 31% interrupts.CPU52.RES:Rescheduling_interrupts 306.40 ±199% +1010.6% 3402 ± 80% interrupts.CPU53.RES:Rescheduling_interrupts 119.20 ±199% +4899.0% 5958 ± 59% interrupts.CPU54.RES:Rescheduling_interrupts 257.20 ±191% +1057.5% 2977 ± 68% interrupts.CPU55.RES:Rescheduling_interrupts 279.60 ±183% +1034.1% 3171 ± 67% interrupts.CPU56.RES:Rescheduling_interrupts 131.80 ±198% +2156.1% 2973 ± 61% interrupts.CPU57.RES:Rescheduling_interrupts 63.80 ±166% +2512.9% 1667 ± 81% interrupts.CPU58.RES:Rescheduling_interrupts 4.00 ±145% +69537.5% 2785 ± 72% interrupts.CPU59.RES:Rescheduling_interrupts 47.80 ±194% +4304.3% 2105 ± 87% interrupts.CPU60.RES:Rescheduling_interrupts 30.00 ±191% +13649.2% 4124 ± 73% interrupts.CPU61.RES:Rescheduling_interrupts 8.00 ±164% +27143.8% 2179 ±133% interrupts.CPU63.RES:Rescheduling_interrupts 599.40 ± 12% +93.8% 1161 ± 70% interrupts.CPU64.NMI:Non-maskable_interrupts 599.40 ± 12% +93.8% 1161 ± 70% interrupts.CPU64.PMI:Performance_monitoring_interrupts 2.00 ±176% +1.7e+05% 3456 ±142% interrupts.CPU64.RES:Rescheduling_interrupts 25.60 ±160% +8039.6% 2083 ± 92% interrupts.CPU65.RES:Rescheduling_interrupts 2.40 ±125% +2e+05% 4832 ± 56% interrupts.CPU66.RES:Rescheduling_interrupts 3.60 ±127% +41365.3% 1492 ± 83% interrupts.CPU67.RES:Rescheduling_interrupts 5.00 ±180% +38530.0% 1931 ± 46% interrupts.CPU68.RES:Rescheduling_interrupts 5.00 ±170% +40085.0% 2009 ± 32% interrupts.CPU69.RES:Rescheduling_interrupts 1.00 ±200% +1.1e+05% 1083 ± 38% interrupts.CPU70.RES:Rescheduling_interrupts 16.40 ±122% +4921.3% 823.50 ± 96% interrupts.CPU71.RES:Rescheduling_interrupts 557.40 ± 27% +32.8% 740.50 ± 17% interrupts.CPU72.NMI:Non-maskable_interrupts 557.40 ± 27% +32.8% 740.50 ± 17% interrupts.CPU72.PMI:Performance_monitoring_interrupts 74.80 ±141% +4794.4% 3661 ± 56% interrupts.CPU72.RES:Rescheduling_interrupts 186.40 ±131% +1223.8% 2467 ± 56% interrupts.CPU73.RES:Rescheduling_interrupts 300.80 ± 23% -50.6% 148.50 ± 80% interrupts.CPU73.TLB:TLB_shootdowns 57.20 ±102% +3944.1% 2313 ± 65% interrupts.CPU74.RES:Rescheduling_interrupts 176.60 ±119% +4455.2% 8044 ±111% interrupts.CPU75.RES:Rescheduling_interrupts 62.40 ±141% +5322.7% 3383 ± 76% interrupts.CPU76.RES:Rescheduling_interrupts 295.00 ± 23% -50.3% 146.50 ± 75% interrupts.CPU76.TLB:TLB_shootdowns 353.80 ±178% +14103.6% 50252 ±163% interrupts.CPU77.RES:Rescheduling_interrupts 102.40 ±109% +2070.7% 2222 ± 89% interrupts.CPU78.RES:Rescheduling_interrupts 20.60 ± 96% +16923.1% 3506 ±101% interrupts.CPU79.RES:Rescheduling_interrupts 27.20 ± 88% +14801.7% 4053 ± 71% interrupts.CPU80.RES:Rescheduling_interrupts 290.20 ± 19% -48.6% 149.25 ± 73% interrupts.CPU80.TLB:TLB_shootdowns 14.80 ± 98% +21998.0% 3270 ± 73% interrupts.CPU81.RES:Rescheduling_interrupts 2.60 ±145% +1.7e+05% 4506 ± 52% interrupts.CPU82.RES:Rescheduling_interrupts 310.60 ±198% +928.2% 3193 ± 54% interrupts.CPU83.RES:Rescheduling_interrupts 29.20 ±103% +7471.9% 2211 ± 91% interrupts.CPU87.RES:Rescheduling_interrupts 146.00 ±174% +2033.9% 3115 ± 96% interrupts.CPU90.RES:Rescheduling_interrupts 124.00 ±186% +2279.8% 2951 ± 95% interrupts.CPU93.RES:Rescheduling_interrupts 117885 ± 8% +13.6% 133974 ± 4% interrupts.NMI:Non-maskable_interrupts 117885 ± 8% +13.6% 133974 ± 4% interrupts.PMI:Performance_monitoring_interrupts 70779 ±103% +541.1% 453766 ± 15% interrupts.RES:Rescheduling_interrupts 94.09 -8.1 86.02 perf-profile.calltrace.cycles-pp.secondary_startup_64 93.64 -8.0 85.61 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 93.64 -8.0 85.61 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 93.56 -8.0 85.53 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 85.57 -7.8 77.77 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 86.02 ± 2% -7.8 78.26 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 70.53 ± 4% -5.9 64.64 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 13.96 ± 8% -2.2 11.74 ± 4% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 2.87 ± 14% -2.2 0.67 ± 57% perf-profile.calltrace.cycles-pp.__GI___libc_write 2.73 ± 14% -2.1 0.65 ± 57% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write 2.72 ± 14% -2.1 0.65 ± 57% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 2.53 ± 13% -1.9 0.62 ± 57% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 2.51 ± 13% -1.9 0.62 ± 57% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write 2.46 ± 13% -1.9 0.61 ± 57% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.46 ± 13% -1.8 0.61 ± 57% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 11.76 ± 9% -1.8 9.92 ± 5% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 2.40 ± 13% -1.8 0.60 ± 57% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write 3.12 ± 5% -0.5 2.67 ± 7% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary 0.00 +0.6 0.59 ± 9% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.00 +0.6 0.65 ± 6% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow 0.00 +0.6 0.65 ± 9% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up 0.00 +0.7 0.65 ± 6% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range 0.00 +0.7 0.66 ± 9% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 0.00 +0.7 0.66 ± 9% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 0.00 +0.7 0.67 ± 7% perf-profile.calltrace.cycles-pp.setup_items_for_insert.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 0.00 +0.7 0.67 ± 10% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 0.00 +0.7 0.70 ± 4% perf-profile.calltrace.cycles-pp.__btrfs_free_extent.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space 0.00 +0.8 0.80 ± 4% perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page 0.00 +0.8 0.80 ± 4% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc 0.00 +0.8 0.81 ± 4% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage 0.00 +0.8 0.82 ± 4% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb 0.00 +0.8 0.82 ± 3% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages 0.00 +0.8 0.82 ± 3% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages 0.00 +0.8 0.83 ± 4% perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range 0.00 +0.9 0.87 ± 6% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.unlock_up 0.00 +0.9 0.88 ± 4% perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_write_and_wait_transaction.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space 0.00 +0.9 0.91 ± 4% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_write_and_wait_transaction 0.00 +0.9 0.91 ± 5% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.unlock_up.btrfs_search_slot 0.00 +0.9 0.91 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +0.9 0.91 ± 5% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 0.00 +0.9 0.94 ± 6% perf-profile.calltrace.cycles-pp.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +1.1 1.07 ± 3% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work 0.00 +1.1 1.07 ± 3% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space 0.00 +1.3 1.31 ± 3% perf-profile.calltrace.cycles-pp.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages 0.00 +1.3 1.31 ± 3% perf-profile.calltrace.cycles-pp.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages 0.00 +1.4 1.35 ± 5% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node 0.00 +1.4 1.38 ± 4% perf-profile.calltrace.cycles-pp.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages 0.00 +1.4 1.38 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot 0.00 +1.4 1.44 ± 6% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +1.5 1.47 ± 4% perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work.worker_thread 0.00 +1.5 1.52 ± 4% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work 0.00 +1.8 1.77 ± 8% perf-profile.calltrace.cycles-pp.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 0.00 +1.8 1.78 ± 8% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +2.1 2.06 ± 4% perf-profile.calltrace.cycles-pp.btrfs_commit_transaction.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread 0.00 +2.1 2.10 ± 4% perf-profile.calltrace.cycles-pp.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +2.1 2.10 ± 4% perf-profile.calltrace.cycles-pp.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread 0.00 +2.3 2.32 ± 18% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node 0.00 +2.3 2.32 ± 10% perf-profile.calltrace.cycles-pp.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 0.00 +2.3 2.34 ± 10% perf-profile.calltrace.cycles-pp.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 0.00 +2.5 2.48 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot 0.00 +2.6 2.56 ± 10% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.btrfs_tree_read_lock.btrfs_read_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent 0.00 +6.0 5.98 ± 5% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io 0.00 +6.0 5.99 ± 5% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 0.00 +7.0 7.04 ± 5% perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work 0.00 +7.2 7.22 ± 5% perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread 0.00 +8.1 8.09 ± 4% perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread.kthread 0.00 +8.2 8.23 ± 3% perf-profile.calltrace.cycles-pp.normal_work_helper.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +12.0 12.01 ± 2% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +12.1 12.10 ± 2% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 0.00 +12.1 12.12 ± 2% perf-profile.calltrace.cycles-pp.ret_from_fork 0.00 +12.1 12.12 ± 2% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 94.13 -8.1 86.05 perf-profile.children.cycles-pp.do_idle 94.09 -8.1 86.02 perf-profile.children.cycles-pp.secondary_startup_64 94.09 -8.1 86.02 perf-profile.children.cycles-pp.cpu_startup_entry 93.64 -8.0 85.61 perf-profile.children.cycles-pp.start_secondary 86.44 -7.8 78.64 perf-profile.children.cycles-pp.cpuidle_enter 86.41 -7.8 78.61 perf-profile.children.cycles-pp.cpuidle_enter_state 70.89 ± 4% -5.9 64.96 ± 2% perf-profile.children.cycles-pp.intel_idle 4.07 ± 15% -2.9 1.12 ± 22% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 4.05 ± 15% -2.9 1.11 ± 22% perf-profile.children.cycles-pp.do_syscall_64 2.88 ± 14% -2.1 0.78 ± 25% perf-profile.children.cycles-pp.__GI___libc_write 13.05 ± 8% -2.0 11.04 ± 5% perf-profile.children.cycles-pp.apic_timer_interrupt 2.55 ± 13% -1.8 0.73 ± 24% perf-profile.children.cycles-pp.ksys_write 11.87 ± 9% -1.8 10.07 ± 5% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 2.53 ± 13% -1.8 0.73 ± 24% perf-profile.children.cycles-pp.vfs_write 2.48 ± 13% -1.8 0.72 ± 25% perf-profile.children.cycles-pp.new_sync_write 2.46 ± 13% -1.7 0.71 ± 25% perf-profile.children.cycles-pp.btrfs_file_write_iter 2.40 ± 13% -1.7 0.70 ± 25% perf-profile.children.cycles-pp.btrfs_buffered_write 0.83 ± 19% -0.7 0.12 ± 25% perf-profile.children.cycles-pp.posix_fadvise 0.82 ± 20% -0.7 0.12 ± 25% perf-profile.children.cycles-pp.__x64_sys_fadvise64 0.82 ± 20% -0.7 0.12 ± 25% perf-profile.children.cycles-pp.generic_fadvise 0.82 ± 20% -0.7 0.12 ± 25% perf-profile.children.cycles-pp.ksys_fadvise64_64 3.15 ± 5% -0.4 2.70 ± 7% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.51 ± 10% -0.4 0.10 ± 28% perf-profile.children.cycles-pp.btrfs_copy_from_user 0.48 ± 10% -0.4 0.09 ± 28% perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic 0.47 ± 11% -0.4 0.09 ± 27% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.47 ± 11% -0.4 0.09 ± 28% perf-profile.children.cycles-pp.copyin 0.39 ± 14% -0.3 0.05 ± 58% perf-profile.children.cycles-pp.llseek 0.42 ± 21% -0.3 0.11 ± 35% perf-profile.children.cycles-pp.lock_and_cleanup_extent_if_need 0.49 ± 18% -0.3 0.20 ± 23% perf-profile.children.cycles-pp.btrfs_dirty_pages 0.32 ± 19% -0.3 0.07 ± 57% perf-profile.children.cycles-pp.invalidate_mapping_pages 0.49 ± 9% -0.2 0.25 ± 19% perf-profile.children.cycles-pp.ret_from_intr 0.43 ± 10% -0.2 0.19 ± 20% perf-profile.children.cycles-pp.handle_irq_event 0.43 ± 10% -0.2 0.19 ± 20% perf-profile.children.cycles-pp.handle_irq_event_percpu 0.43 ± 10% -0.2 0.19 ± 20% perf-profile.children.cycles-pp.__handle_irq_event_percpu 0.43 ± 10% -0.2 0.19 ± 20% perf-profile.children.cycles-pp.nvme_irq 0.30 ± 19% -0.2 0.06 ± 59% perf-profile.children.cycles-pp.prepare_pages 0.43 ± 9% -0.2 0.19 ± 22% perf-profile.children.cycles-pp.blk_mq_complete_request 0.44 ± 9% -0.2 0.21 ± 20% perf-profile.children.cycles-pp.do_IRQ 0.43 ± 10% -0.2 0.20 ± 21% perf-profile.children.cycles-pp.handle_edge_irq 0.38 ± 8% -0.2 0.15 ± 23% perf-profile.children.cycles-pp.end_bio_extent_writepage 0.25 ± 9% -0.2 0.03 ±100% perf-profile.children.cycles-pp.end_page_writeback 0.32 ± 19% -0.2 0.10 ± 23% perf-profile.children.cycles-pp.pagecache_get_page 0.39 ± 9% -0.2 0.18 ± 21% perf-profile.children.cycles-pp.blk_mq_end_request 0.39 ± 9% -0.2 0.18 ± 21% perf-profile.children.cycles-pp.blk_update_request 0.38 ± 9% -0.2 0.17 ± 20% perf-profile.children.cycles-pp.btrfs_end_bio 0.38 ± 16% -0.2 0.21 ± 17% perf-profile.children.cycles-pp.__clear_extent_bit 0.18 ± 16% -0.1 0.03 ±100% perf-profile.children.cycles-pp.find_get_entry 0.17 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.test_clear_page_writeback 0.23 ± 22% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.__extent_writepage_io 0.43 ± 10% -0.1 0.32 ± 5% perf-profile.children.cycles-pp.run_timer_softirq 0.21 ± 12% -0.1 0.11 ± 18% perf-profile.children.cycles-pp.clear_extent_bit 0.64 ± 12% -0.1 0.55 ± 4% perf-profile.children.cycles-pp.native_irq_return_iret 0.14 ± 9% -0.1 0.05 ± 60% perf-profile.children.cycles-pp.xas_load 0.11 ± 20% -0.1 0.05 perf-profile.children.cycles-pp.alloc_extent_state 0.14 ± 11% -0.0 0.10 ± 18% perf-profile.children.cycles-pp.account_process_tick 0.09 ± 21% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.__perf_event_read_value 0.05 ± 50% +0.0 0.08 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.02 ±122% +0.0 0.07 ± 7% perf-profile.children.cycles-pp.__slab_alloc 0.01 ±200% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.___slab_alloc 0.00 +0.1 0.05 perf-profile.children.cycles-pp.btrfs_update_inode_fallback 0.00 +0.1 0.05 perf-profile.children.cycles-pp.btrfs_update_inode 0.00 +0.1 0.05 perf-profile.children.cycles-pp.leaf_space_used 0.00 +0.1 0.05 perf-profile.children.cycles-pp.btrfs_update_block_group 0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty 0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.btrfs_remove_ordered_extent 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.check_preempt_curr 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.__switch_to 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.00 +0.1 0.06 ± 6% perf-profile.children.cycles-pp.__radix_tree_lookup 0.10 ± 16% +0.1 0.17 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc 0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.free_extent_buffer 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.find_free_extent 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.get_extent_allocation_hint 0.00 +0.1 0.07 ± 6% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__module_text_address 0.00 +0.1 0.07 ± 10% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.extent_clear_unlock_delalloc 0.00 +0.1 0.07 ± 5% perf-profile.children.cycles-pp.set_next_entity 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.btrfs_reserve_extent 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.btrfs_lookup_csum 0.05 ± 52% +0.1 0.13 ± 22% perf-profile.children.cycles-pp.btrfs_get_extent 0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.__unwind_start 0.00 +0.1 0.08 ± 15% perf-profile.children.cycles-pp.is_module_text_address 0.02 ±122% +0.1 0.11 ± 25% perf-profile.children.cycles-pp.end_extent_writepage 0.00 +0.1 0.09 ± 4% perf-profile.children.cycles-pp.memcpy_extent_buffer 0.01 ±200% +0.1 0.11 ± 25% perf-profile.children.cycles-pp.btrfs_writepage_endio_finish_ordered 0.00 +0.1 0.10 ± 7% perf-profile.children.cycles-pp.read_extent_buffer 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.btrfs_alloc_reserved_file_extent 0.00 +0.1 0.11 ± 14% perf-profile.children.cycles-pp.kernel_text_address 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.alloc_tree_block_no_bg_flush 0.00 +0.1 0.11 ± 8% perf-profile.children.cycles-pp.btrfs_alloc_tree_block 0.00 +0.1 0.11 ± 16% perf-profile.children.cycles-pp.__queue_work 0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.__switch_to_asm 0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.__kernel_text_address 0.00 +0.1 0.11 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair 0.00 +0.1 0.11 ± 14% perf-profile.children.cycles-pp.queue_work_on 0.00 +0.1 0.12 ± 9% perf-profile.children.cycles-pp.update_load_avg 0.00 +0.1 0.12 ± 7% perf-profile.children.cycles-pp.add_delayed_ref_head 0.00 +0.1 0.12 ± 11% perf-profile.children.cycles-pp.btrfs_free_extent 0.00 +0.1 0.12 ± 5% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched 0.00 +0.1 0.12 perf-profile.children.cycles-pp.btrfs_release_path 0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.dequeue_entity 0.00 +0.1 0.12 ± 28% perf-profile.children.cycles-pp.unpin_extent_cache 0.00 +0.1 0.13 ± 11% perf-profile.children.cycles-pp.unwind_get_return_address 0.00 +0.1 0.13 ± 6% perf-profile.children.cycles-pp.lookup_inline_extent_backref 0.00 +0.1 0.14 ± 3% perf-profile.children.cycles-pp.find_extent_buffer 0.00 +0.1 0.15 ± 11% perf-profile.children.cycles-pp.btrfs_extend_item 0.00 +0.1 0.15 ± 22% perf-profile.children.cycles-pp.__module_address 0.00 +0.1 0.15 ± 8% perf-profile.children.cycles-pp.copy_extent_buffer_full 0.00 +0.2 0.15 ± 10% perf-profile.children.cycles-pp.copy_page 0.52 ± 14% +0.2 0.67 ± 6% perf-profile.children.cycles-pp._raw_spin_lock 0.00 +0.2 0.16 ± 6% perf-profile.children.cycles-pp.btrfs_truncate_item 0.00 +0.2 0.16 ± 5% perf-profile.children.cycles-pp.pick_next_task_fair 0.00 +0.2 0.16 ± 9% perf-profile.children.cycles-pp.dequeue_task_fair 0.00 +0.2 0.16 ± 4% perf-profile.children.cycles-pp.btrfs_get_8 0.00 +0.2 0.16 ± 5% perf-profile.children.cycles-pp.truncate_one_csum 0.00 +0.2 0.17 ± 10% perf-profile.children.cycles-pp.btrfs_drop_extent_cache 0.00 +0.2 0.20 ± 2% perf-profile.children.cycles-pp.generic_bin_search 0.00 +0.2 0.20 ± 5% perf-profile.children.cycles-pp.memmove_extent_buffer 0.00 +0.2 0.21 ± 8% perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref 0.00 +0.2 0.22 ± 3% perf-profile.children.cycles-pp.read_block_for_search 0.00 +0.2 0.22 ± 18% perf-profile.children.cycles-pp.finish_wait 0.00 +0.2 0.22 ± 5% perf-profile.children.cycles-pp.alloc_reserved_file_extent 0.00 +0.2 0.24 ± 4% perf-profile.children.cycles-pp.memmove 0.00 +0.3 0.27 ± 4% perf-profile.children.cycles-pp.btrfs_insert_empty_items 0.00 +0.3 0.27 ± 9% perf-profile.children.cycles-pp.__orc_find 0.00 +0.3 0.28 ± 7% perf-profile.children.cycles-pp.schedule_idle 0.00 +0.3 0.30 ± 3% perf-profile.children.cycles-pp.btrfs_set_token_32 0.00 +0.3 0.31 ± 7% perf-profile.children.cycles-pp.btrfs_del_csums 0.00 +0.3 0.31 ± 3% perf-profile.children.cycles-pp.__btrfs_cow_block 0.01 ±200% +0.3 0.33 ± 21% perf-profile.children.cycles-pp.__lookup_extent_mapping 0.00 +0.3 0.32 ± 2% perf-profile.children.cycles-pp.btrfs_cow_block 0.00 +0.3 0.32 ± 6% perf-profile.children.cycles-pp.btrfs_get_32 0.00 +0.3 0.34 ± 3% perf-profile.children.cycles-pp.btrfs_get_token_32 0.00 +0.4 0.35 ± 7% perf-profile.children.cycles-pp.add_pending_csums 0.00 +0.4 0.35 ± 7% perf-profile.children.cycles-pp.btrfs_csum_file_blocks 0.00 +0.4 0.35 ± 11% perf-profile.children.cycles-pp.orc_find 0.00 +0.4 0.38 ± 4% perf-profile.children.cycles-pp.btrfs_get_64 0.00 +0.4 0.39 ± 18% perf-profile.children.cycles-pp.btrfs_try_tree_write_lock 0.01 ±200% +0.4 0.40 ± 9% perf-profile.children.cycles-pp.schedule 0.00 +0.4 0.45 ± 2% perf-profile.children.cycles-pp.map_private_extent_buffer 0.00 +0.5 0.46 ± 14% perf-profile.children.cycles-pp.queued_write_lock_slowpath 0.50 ± 20% +0.5 0.96 ± 3% perf-profile.children.cycles-pp.__filemap_fdatawrite_range 0.00 +0.5 0.47 ± 11% perf-profile.children.cycles-pp.cow_file_range 0.00 +0.5 0.49 perf-profile.children.cycles-pp.btrfs_del_items 0.00 +0.5 0.50 ± 10% perf-profile.children.cycles-pp.btrfs_unlock_up_safe 0.10 ± 22% +0.6 0.67 ± 32% perf-profile.children.cycles-pp.poll_idle 0.04 ± 87% +0.6 0.66 ± 7% perf-profile.children.cycles-pp.__schedule 0.00 +0.6 0.62 ± 9% perf-profile.children.cycles-pp.unwind_next_frame 0.00 +0.7 0.73 ± 3% perf-profile.children.cycles-pp.__btrfs_free_extent 0.00 +0.8 0.82 ± 4% perf-profile.children.cycles-pp.check_leaf 0.05 ± 50% +0.8 0.88 ± 3% perf-profile.children.cycles-pp.submit_extent_page 0.00 +0.8 0.83 ± 6% perf-profile.children.cycles-pp.setup_items_for_insert 0.00 +0.8 0.83 ± 4% perf-profile.children.cycles-pp.btree_csum_one_bio 0.00 +0.8 0.84 ± 3% perf-profile.children.cycles-pp.btree_submit_bio_hook 0.00 +0.9 0.86 ± 3% perf-profile.children.cycles-pp.submit_one_bio 0.00 +0.9 0.88 ± 4% perf-profile.children.cycles-pp.write_one_eb 0.00 +0.9 0.91 ± 4% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction 0.00 +0.9 0.91 ± 4% perf-profile.children.cycles-pp.btrfs_write_marked_extents 0.00 +0.9 0.91 ± 4% perf-profile.children.cycles-pp.btree_write_cache_pages 0.00 +0.9 0.92 ± 9% perf-profile.children.cycles-pp.arch_stack_walk 0.00 +1.0 0.96 ± 5% perf-profile.children.cycles-pp.unlock_up 0.00 +1.0 0.99 ± 7% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.52 ± 21% +1.1 1.57 ± 5% perf-profile.children.cycles-pp.extent_writepages 0.52 ± 21% +1.1 1.57 ± 5% perf-profile.children.cycles-pp.extent_write_cache_pages 0.00 +1.1 1.11 ± 7% perf-profile.children.cycles-pp.__account_scheduler_latency 0.41 ± 23% +1.1 1.53 ± 4% perf-profile.children.cycles-pp.__extent_writepage 0.00 +1.1 1.11 ± 3% perf-profile.children.cycles-pp.btrfs_run_delayed_refs 0.00 +1.1 1.11 ± 3% perf-profile.children.cycles-pp.__btrfs_run_delayed_refs 0.01 ±200% +1.2 1.25 ± 6% perf-profile.children.cycles-pp.enqueue_entity 0.01 ±200% +1.3 1.28 ± 6% perf-profile.children.cycles-pp.enqueue_task_fair 0.01 ±200% +1.3 1.28 ± 6% perf-profile.children.cycles-pp.activate_task 0.01 ±200% +1.3 1.28 ± 6% perf-profile.children.cycles-pp.ttwu_do_activate 0.12 ± 24% +1.3 1.42 ± 4% perf-profile.children.cycles-pp.writepage_delalloc 0.00 +1.3 1.34 ± 4% perf-profile.children.cycles-pp.run_delalloc_nocow 0.00 +1.4 1.35 ± 4% perf-profile.children.cycles-pp.btrfs_run_delalloc_range 0.00 +1.4 1.43 ± 7% perf-profile.children.cycles-pp.autoremove_wake_function 0.00 +1.5 1.45 ± 7% perf-profile.children.cycles-pp.__wake_up_common 0.02 ±125% +1.5 1.51 ± 6% perf-profile.children.cycles-pp.try_to_wake_up 0.01 ±200% +1.5 1.50 ± 7% perf-profile.children.cycles-pp.__wake_up_common_lock 0.01 ±200% +1.5 1.52 ± 4% perf-profile.children.cycles-pp.wb_workfn 0.01 ±200% +1.5 1.52 ± 4% perf-profile.children.cycles-pp.wb_writeback 0.01 ±200% +1.5 1.52 ± 4% perf-profile.children.cycles-pp.writeback_sb_inodes 0.01 ±200% +1.5 1.52 ± 4% perf-profile.children.cycles-pp.__writeback_single_inode 0.00 +1.8 1.80 ± 7% perf-profile.children.cycles-pp.btrfs_lock_root_node 0.00 +1.9 1.86 ± 8% perf-profile.children.cycles-pp.btrfs_tree_lock 0.52 ± 21% +2.0 2.47 ± 2% perf-profile.children.cycles-pp.do_writepages 0.00 +2.1 2.06 ± 4% perf-profile.children.cycles-pp.btrfs_commit_transaction 0.00 +2.1 2.10 ± 4% perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space 0.00 +2.1 2.10 ± 4% perf-profile.children.cycles-pp.flush_space 0.00 +3.0 3.01 ± 8% perf-profile.children.cycles-pp.btrfs_tree_read_lock 0.00 +3.0 3.03 ± 8% perf-profile.children.cycles-pp.btrfs_read_lock_root_node 0.55 ± 4% +4.0 4.58 ± 5% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.00 +4.0 4.04 ± 5% perf-profile.children.cycles-pp.prepare_to_wait_event 0.13 ± 22% +4.1 4.23 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.00 +6.8 6.82 ± 5% perf-profile.children.cycles-pp.btrfs_lookup_file_extent 0.00 +7.0 7.04 ± 5% perf-profile.children.cycles-pp.__btrfs_drop_extents 0.00 +7.2 7.22 ± 5% perf-profile.children.cycles-pp.insert_reserved_file_extent 0.00 +7.2 7.23 ± 4% perf-profile.children.cycles-pp.btrfs_search_slot 0.17 ± 15% +8.1 8.23 ± 3% perf-profile.children.cycles-pp.normal_work_helper 0.00 +8.1 8.09 ± 4% perf-profile.children.cycles-pp.btrfs_finish_ordered_io 0.28 ± 18% +11.7 12.01 ± 2% perf-profile.children.cycles-pp.process_one_work 0.33 ± 15% +11.8 12.12 ± 2% perf-profile.children.cycles-pp.ret_from_fork 0.33 ± 15% +11.8 12.12 ± 2% perf-profile.children.cycles-pp.kthread 0.30 ± 19% +11.8 12.10 ± 2% perf-profile.children.cycles-pp.worker_thread 70.79 ± 4% -5.9 64.88 ± 2% perf-profile.self.cycles-pp.intel_idle 0.46 ± 8% -0.4 0.08 ± 21% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.35 ± 20% -0.3 0.05 ± 60% perf-profile.self.cycles-pp.do_syscall_64 0.64 ± 12% -0.1 0.55 ± 4% perf-profile.self.cycles-pp.native_irq_return_iret 0.12 ± 6% -0.1 0.03 ±100% perf-profile.self.cycles-pp.xas_load 0.34 ± 10% -0.1 0.26 ± 5% perf-profile.self.cycles-pp.run_timer_softirq 0.19 ± 7% -0.0 0.14 ± 15% perf-profile.self.cycles-pp.__softirqentry_text_start 0.27 ± 8% -0.0 0.23 ± 4% perf-profile.self.cycles-pp.interrupt_entry 0.01 ±200% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.kmem_cache_alloc 0.00 +0.1 0.06 ± 15% perf-profile.self.cycles-pp.set_next_entity 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.btrfs_del_items 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.__radix_tree_lookup 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.__switch_to 0.00 +0.1 0.07 ± 13% perf-profile.self.cycles-pp.stack_trace_save_tsk 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.1 0.07 ± 5% perf-profile.self.cycles-pp.btrfs_search_slot 0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.__account_scheduler_latency 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.check_leaf 0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.try_to_wake_up 0.00 +0.1 0.08 ± 8% perf-profile.self.cycles-pp.stack_trace_consume_entry_nosched 0.00 +0.1 0.09 ± 7% perf-profile.self.cycles-pp.btrfs_get_8 0.00 +0.1 0.10 ± 9% perf-profile.self.cycles-pp.read_extent_buffer 0.00 +0.1 0.10 ± 7% perf-profile.self.cycles-pp.prepare_to_wait_event 0.00 +0.1 0.10 ± 10% perf-profile.self.cycles-pp.add_delayed_ref_head 0.00 +0.1 0.11 ± 7% perf-profile.self.cycles-pp.__switch_to_asm 0.49 ± 10% +0.1 0.60 ± 7% perf-profile.self.cycles-pp._raw_spin_lock 0.00 +0.1 0.14 ± 3% perf-profile.self.cycles-pp.generic_bin_search 0.00 +0.1 0.15 ± 19% perf-profile.self.cycles-pp.__module_address 0.00 +0.2 0.15 ± 10% perf-profile.self.cycles-pp.copy_page 0.00 +0.2 0.15 ± 11% perf-profile.self.cycles-pp.__schedule 0.00 +0.2 0.17 ± 6% perf-profile.self.cycles-pp.btrfs_get_32 0.00 +0.2 0.20 ± 7% perf-profile.self.cycles-pp.btrfs_get_64 0.00 +0.2 0.21 ± 8% perf-profile.self.cycles-pp.unwind_next_frame 0.00 +0.2 0.24 ± 3% perf-profile.self.cycles-pp.memmove 0.00 +0.3 0.27 ± 9% perf-profile.self.cycles-pp.__orc_find 0.00 +0.3 0.28 ± 4% perf-profile.self.cycles-pp.btrfs_set_token_32 0.01 ±200% +0.3 0.32 ± 20% perf-profile.self.cycles-pp.__lookup_extent_mapping 0.00 +0.3 0.32 ± 4% perf-profile.self.cycles-pp.btrfs_get_token_32 0.00 +0.4 0.41 ± 16% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.00 +0.4 0.43 ± 3% perf-profile.self.cycles-pp.map_private_extent_buffer 0.09 ± 21% +0.6 0.65 ± 33% perf-profile.self.cycles-pp.poll_idle 0.12 ± 20% +4.1 4.23 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath *************************************************************************************************** lkp-bdw-de1: 16 threads Intel(R) Xeon(R) CPU D-1541 @ 2.10GHz with 48G memory ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/rootfs/tbox_group/testcase/ucode: gcc-7/performance/1SSD/btrfs/x86_64-rhel-7.6/debian-x86_64-2019-11-14.cgz/lkp-bdw-de1/blogbench/0x7000019 commit: v5.4 c6bbf24815 ("btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") v5.4 c6bbf24815f95a4928984ff16a9 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:6 -17% :4 dmesg.WARNING:at_ip__fsnotify_parent/0x %stddev %change %stddev \ | \ 52466434 -14.0% 45137174 blogbench.time.file_system_outputs 7348859 -6.3% 6887063 blogbench.time.involuntary_context_switches 3771 +1.1% 3813 blogbench.time.system_time 551.26 -1.6% 542.25 blogbench.time.user_time 5793 -19.9% 4641 blogbench.write_score 431018 ± 7% -14.3% 369287 ± 4% interrupts.CPU0.RES:Rescheduling_interrupts 395096 ± 8% -12.6% 345321 ± 5% interrupts.CPU1.RES:Rescheduling_interrupts 87918 -2.8% 85476 vmstat.io.bo 13075905 ± 2% -14.3% 11201673 vmstat.memory.cache 70633 -7.7% 65184 vmstat.system.cs 56139 -2.9% 54512 vmstat.system.in 30.44 ±100% -90.9% 2.77 ±173% iostat.sda.avgqu-sz.max 87.40 ±100% -95.0% 4.40 ±173% iostat.sda.await.max 0.94 ±100% -85.9% 0.13 ±173% iostat.sda.svctm.max 87.40 ±100% -95.0% 4.40 ±173% iostat.sda.w_await.max 34.18 ±102% -62.2% 12.91 ± 61% iostat.sdb.avgqu-sz.max 95.65 ±103% -82.3% 16.95 ± 72% iostat.sdb.await.max 95.65 ±103% -82.3% 16.95 ± 72% iostat.sdb.w_await.max 101.24 ± 21% -23.7% 77.23 ± 11% sched_debug.cfs_rq:/.runnable_load_avg.avg 1060738 ± 5% -20.0% 848471 ± 3% sched_debug.cpu.nr_switches.max 128950 ± 9% -37.9% 80027 ± 9% sched_debug.cpu.nr_switches.stddev 628.61 ± 7% -25.6% 467.92 ± 9% sched_debug.cpu.nr_uninterruptible.max 167.30 ± 6% -23.8% 127.46 ± 8% sched_debug.cpu.nr_uninterruptible.stddev 1055839 ± 5% -20.0% 844794 ± 3% sched_debug.cpu.sched_count.max 128343 ± 10% -38.3% 79251 ± 9% sched_debug.cpu.sched_count.stddev 908461 ± 3% -10.5% 812723 ± 2% sched_debug.cpu.ttwu_count.max 136649 ± 5% -17.9% 112237 ± 4% sched_debug.cpu.ttwu_count.stddev 195483 ± 3% -22.0% 152478 ± 3% sched_debug.cpu.ttwu_local.max 48230 ± 4% +23.8% 59704 sched_debug.cpu.ttwu_local.min 33346 ± 5% -37.9% 20704 ± 4% sched_debug.cpu.ttwu_local.stddev 8964644 ± 2% -13.6% 7749001 ± 2% meminfo.Active 8717213 ± 2% -13.9% 7501624 ± 2% meminfo.Active(file) 12106511 ± 2% -14.0% 10414310 meminfo.Cached 1114050 ± 3% -93.4% 73000 ± 2% meminfo.Dirty 2302068 ± 2% -20.7% 1825083 meminfo.Inactive 2286903 ± 2% -20.9% 1809946 meminfo.Inactive(file) 924101 ± 2% -19.8% 740793 meminfo.KReclaimable 13687196 ± 2% -14.2% 11747472 meminfo.Memused 924101 ± 2% -19.8% 740793 meminfo.SReclaimable 350605 -18.3% 286583 meminfo.SUnreclaim 1274707 ± 2% -19.4% 1027376 meminfo.Slab 8857 ± 25% -95.4% 411.50 ± 14% meminfo.Writeback 93330 -17.2% 77231 meminfo.max_used_kB 58.87 +1.2% 59.57 perf-stat.i.MPKI 70768 -7.3% 65634 perf-stat.i.context-switches 3.59 +2.5% 3.68 perf-stat.i.cpi 1009 +12.9% 1139 perf-stat.i.cpu-migrations 3684212 -8.5% 3371879 perf-stat.i.dTLB-load-misses 0.28 -3.0% 0.27 perf-stat.i.ipc 58.68 +1.6% 59.61 perf-stat.overall.MPKI 3.56 +3.3% 3.68 perf-stat.overall.cpi 60.67 +1.7% 61.67 perf-stat.overall.cycles-between-cache-misses 0.11 -0.0 0.10 perf-stat.overall.dTLB-load-miss-rate% 0.28 -3.2% 0.27 perf-stat.overall.ipc 70566 -7.3% 65420 perf-stat.ps.context-switches 1006 +12.9% 1136 perf-stat.ps.cpu-migrations 3671930 -8.5% 3360679 perf-stat.ps.dTLB-load-misses 3.286e+12 -2.6% 3.2e+12 perf-stat.total.instructions 522560 ± 4% +18.6% 619585 ± 3% softirqs.CPU0.RCU 539046 ± 3% +18.4% 638438 ± 4% softirqs.CPU1.RCU 534589 ± 3% +17.6% 628622 ± 2% softirqs.CPU10.RCU 532918 ± 6% +18.2% 629753 ± 3% softirqs.CPU12.RCU 519321 ± 4% +22.7% 637092 ± 3% softirqs.CPU13.RCU 541861 ± 6% +15.3% 624859 ± 2% softirqs.CPU14.RCU 530181 ± 4% +14.5% 607146 ± 4% softirqs.CPU2.RCU 543079 ± 12% +15.9% 629660 ± 5% softirqs.CPU3.RCU 519652 ± 4% +22.6% 637086 ± 3% softirqs.CPU4.RCU 530451 ± 5% +17.2% 621577 ± 2% softirqs.CPU5.RCU 509129 ± 3% +17.1% 596022 ± 3% softirqs.CPU6.RCU 545317 ± 7% +17.2% 639180 softirqs.CPU7.RCU 526627 ± 4% +18.5% 624056 softirqs.CPU8.RCU 538041 ± 4% +20.4% 648040 softirqs.CPU9.RCU 8522946 ± 4% +17.9% 10045477 softirqs.RCU 2182898 ± 2% -13.9% 1878514 ± 2% proc-vmstat.nr_active_file 7097060 -7.5% 6567173 proc-vmstat.nr_dirtied 278481 ± 3% -93.5% 17979 ± 2% proc-vmstat.nr_dirty 3031209 ± 2% -14.0% 2607428 proc-vmstat.nr_file_pages 8883924 +5.5% 9369721 proc-vmstat.nr_free_pages 572690 ± 2% -20.9% 453218 ± 2% proc-vmstat.nr_inactive_file 231380 ± 2% -19.8% 185500 proc-vmstat.nr_slab_reclaimable 87822 ± 2% -18.3% 71721 proc-vmstat.nr_slab_unreclaimable 2296 ± 22% -95.9% 93.25 ± 12% proc-vmstat.nr_writeback 6710614 -2.8% 6523592 proc-vmstat.nr_written 2182898 ± 2% -13.9% 1878514 ± 2% proc-vmstat.nr_zone_active_file 572690 ± 2% -20.9% 453218 ± 2% proc-vmstat.nr_zone_inactive_file 280961 ± 3% -93.5% 18228 ± 2% proc-vmstat.nr_zone_write_pending 8933464 -15.7% 7531853 proc-vmstat.numa_hit 8933464 -15.7% 7531853 proc-vmstat.numa_local 5051630 -20.1% 4036579 proc-vmstat.pgactivate 11442553 -13.4% 9912465 proc-vmstat.pgalloc_normal 5380851 -7.3% 4988976 proc-vmstat.pgfree 26811297 -2.8% 26059319 proc-vmstat.pgpgout 517812 ± 2% -19.0% 419453 slabinfo.Acpi-Parse.active_objs 7093 ± 2% -19.0% 5745 slabinfo.Acpi-Parse.active_slabs 517818 ± 2% -19.0% 419455 slabinfo.Acpi-Parse.num_objs 7093 ± 2% -19.0% 5745 slabinfo.Acpi-Parse.num_slabs 480526 ± 2% -19.8% 385218 ± 2% slabinfo.Acpi-State.active_objs 9454 ± 2% -19.3% 7631 ± 2% slabinfo.Acpi-State.active_slabs 482191 ± 2% -19.3% 389199 ± 2% slabinfo.Acpi-State.num_objs 9454 ± 2% -19.3% 7631 ± 2% slabinfo.Acpi-State.num_slabs 11004 ± 6% -38.9% 6725 ± 6% slabinfo.avc_xperms_data.active_objs 11054 ± 6% -39.2% 6725 ± 6% slabinfo.avc_xperms_data.num_objs 546.67 ± 16% -68.7% 171.00 slabinfo.biovec-max.active_objs 582.50 ± 15% -63.6% 211.75 slabinfo.biovec-max.num_objs 5814 ± 2% +10.7% 6435 ± 2% slabinfo.blkdev_ioc.active_objs 466540 ± 2% -21.3% 367368 ± 2% slabinfo.btrfs_delayed_node.active_objs 17943 ± 2% -21.3% 14129 ± 2% slabinfo.btrfs_delayed_node.active_slabs 466540 ± 2% -21.3% 367368 ± 2% slabinfo.btrfs_delayed_node.num_objs 17943 ± 2% -21.3% 14129 ± 2% slabinfo.btrfs_delayed_node.num_slabs 441404 ± 2% -18.5% 359603 ± 2% slabinfo.btrfs_extent_map.active_objs 16412 ± 3% -21.7% 12854 ± 2% slabinfo.btrfs_extent_map.active_slabs 459562 ± 3% -21.7% 359946 ± 2% slabinfo.btrfs_extent_map.num_objs 16412 ± 3% -21.7% 12854 ± 2% slabinfo.btrfs_extent_map.num_slabs 466633 ± 2% -21.1% 368147 ± 2% slabinfo.btrfs_inode.active_objs 16665 ± 2% -21.1% 13148 ± 2% slabinfo.btrfs_inode.active_slabs 466644 ± 2% -21.1% 368156 ± 2% slabinfo.btrfs_inode.num_objs 16665 ± 2% -21.1% 13148 ± 2% slabinfo.btrfs_inode.num_slabs 6222 ± 3% -32.2% 4221 slabinfo.btrfs_ordered_extent.active_objs 6363 ± 3% -32.4% 4299 slabinfo.btrfs_ordered_extent.num_objs 571807 ± 2% -19.0% 463336 ± 2% slabinfo.dentry.active_objs 13615 ± 2% -19.0% 11032 ± 2% slabinfo.dentry.active_slabs 571849 ± 2% -19.0% 463364 ± 2% slabinfo.dentry.num_objs 13615 ± 2% -19.0% 11032 ± 2% slabinfo.dentry.num_slabs 23428 ± 6% -74.3% 6009 ± 3% slabinfo.khugepaged_mm_slot.active_objs 659.67 ± 6% -74.6% 167.25 ± 3% slabinfo.khugepaged_mm_slot.active_slabs 23758 ± 6% -74.6% 6032 ± 3% slabinfo.khugepaged_mm_slot.num_objs 659.67 ± 6% -74.6% 167.25 ± 3% slabinfo.khugepaged_mm_slot.num_slabs 4023 ± 4% -48.3% 2081 slabinfo.kmalloc-128.active_objs 4103 ± 4% -46.7% 2186 slabinfo.kmalloc-128.num_objs 2949 ± 10% -16.4% 2465 ± 3% slabinfo.kmalloc-512.active_objs 2970 ± 9% -16.9% 2469 ± 3% slabinfo.kmalloc-512.num_objs 20226 -20.0% 16173 ± 2% slabinfo.kmalloc-64.active_objs 20880 -22.2% 16235 ± 2% slabinfo.kmalloc-64.num_objs 8733 ± 6% -53.9% 4024 ± 5% slabinfo.kmalloc-96.active_objs 209.33 ± 6% -54.4% 95.50 ± 5% slabinfo.kmalloc-96.active_slabs 8811 ± 6% -54.3% 4024 ± 5% slabinfo.kmalloc-96.num_objs 209.33 ± 6% -54.4% 95.50 ± 5% slabinfo.kmalloc-96.num_slabs 1084 ± 8% -36.3% 690.25 slabinfo.mnt_cache.active_objs 1247 ± 8% -36.1% 797.00 ± 2% slabinfo.mnt_cache.num_objs 22556 ± 2% -13.7% 19456 ± 2% slabinfo.numa_policy.active_objs 22742 ± 2% -13.8% 19613 ± 2% slabinfo.numa_policy.num_objs 440962 ± 2% -19.7% 353973 ± 2% slabinfo.radix_tree_node.active_objs 15748 ± 2% -19.7% 12641 ± 2% slabinfo.radix_tree_node.active_slabs 440967 ± 2% -19.7% 353976 ± 2% slabinfo.radix_tree_node.num_objs 15748 ± 2% -19.7% 12641 ± 2% slabinfo.radix_tree_node.num_slabs 8.64 ± 20% -5.3 3.38 ± 3% perf-profile.calltrace.cycles-pp.normal_work_helper.process_one_work.worker_thread.kthread.ret_from_fork 10.41 ± 18% -4.8 5.60 ± 3% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 10.24 ± 19% -4.8 5.47 ± 3% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 11.97 ± 16% -4.7 7.24 perf-profile.calltrace.cycles-pp.ret_from_fork 11.97 ± 16% -4.7 7.24 perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 6.81 ± 22% -4.2 2.56 ± 4% perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread.kthread 6.15 ± 23% -3.9 2.24 ± 4% perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work.worker_thread 5.57 ± 23% -3.5 2.03 ± 4% perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper.process_one_work 5.22 ± 24% -3.3 1.88 ± 4% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.normal_work_helper 5.21 ± 24% -3.3 1.88 ± 4% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io 1.46 ± 18% -1.2 0.27 ±100% perf-profile.calltrace.cycles-pp.btrfs_async_run_delayed_root.normal_work_helper.process_one_work.worker_thread.kthread 1.53 ± 24% -1.1 0.40 ± 57% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent 1.53 ± 24% -1.1 0.40 ± 57% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.unlock_up.btrfs_search_slot 1.51 ± 24% -1.1 0.40 ± 57% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.unlock_up 1.61 ± 24% -1.1 0.55 ± 4% perf-profile.calltrace.cycles-pp.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 1.60 ± 24% -1.0 0.55 ± 4% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.unlock_up.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 1.55 ± 25% -0.9 0.65 ± 2% perf-profile.calltrace.cycles-pp.btrfs_tree_lock.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents 1.55 ± 25% -0.9 0.65 ± 3% perf-profile.calltrace.cycles-pp.btrfs_lock_root_node.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent 2.48 ± 6% -0.4 2.04 ± 3% perf-profile.calltrace.cycles-pp.btrfs_rename.vfs_rename.do_renameat2.__x64_sys_rename.do_syscall_64 2.55 ± 6% -0.4 2.11 ± 3% perf-profile.calltrace.cycles-pp.vfs_rename.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.39 ± 12% -0.4 0.98 ± 4% perf-profile.calltrace.cycles-pp.__btrfs_unlink_inode.btrfs_rename.vfs_rename.do_renameat2.__x64_sys_rename 3.91 ± 4% -0.4 3.52 ± 5% perf-profile.calltrace.cycles-pp.rename 3.85 ± 4% -0.4 3.46 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe.rename 3.85 ± 5% -0.4 3.46 ± 5% perf-profile.calltrace.cycles-pp.do_renameat2.__x64_sys_rename.do_syscall_64.entry_SYSCALL_64_after_hwframe.rename 3.87 ± 4% -0.4 3.48 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.rename 3.86 ± 5% -0.4 3.48 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.rename 0.56 ± 6% +0.0 0.61 ± 3% perf-profile.calltrace.cycles-pp.fsnotify.do_dentry_open.path_openat.do_filp_open.do_sys_open 0.77 ± 4% +0.1 0.85 ± 5% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 1.36 ± 4% +0.1 1.48 perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 1.14 ± 5% +0.1 1.26 perf-profile.calltrace.cycles-pp.btrfs_dentry_delete.dput.__fput.task_work_run.exit_to_usermode_loop 1.18 ± 5% +0.1 1.31 ± 2% perf-profile.calltrace.cycles-pp.xas_start.xas_load.find_get_entry.pagecache_get_page.generic_file_read_iter 1.02 ± 3% +0.1 1.15 ± 2% perf-profile.calltrace.cycles-pp.errseq_sample.do_dentry_open.path_openat.do_filp_open.do_sys_open 1.41 +0.1 1.55 ± 3% perf-profile.calltrace.cycles-pp.security_inode_permission.may_open.path_openat.do_filp_open.do_sys_open 1.39 ± 2% +0.1 1.53 ± 3% perf-profile.calltrace.cycles-pp.selinux_inode_permission.security_inode_permission.may_open.path_openat.do_filp_open 1.68 ± 4% +0.2 1.84 perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.generic_file_read_iter.new_sync_read 2.44 ± 2% +0.2 2.67 perf-profile.calltrace.cycles-pp.do_dentry_open.path_openat.do_filp_open.do_sys_open.do_syscall_64 0.36 ± 70% +0.2 0.59 ± 7% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.87 ± 3% +0.2 3.11 perf-profile.calltrace.cycles-pp.may_open.path_openat.do_filp_open.do_sys_open.do_syscall_64 3.00 ± 3% +0.3 3.29 ± 2% perf-profile.calltrace.cycles-pp.lookup_fast.path_openat.do_filp_open.do_sys_open.do_syscall_64 6.79 ± 3% +0.3 7.08 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_close 2.92 ± 3% +0.3 3.21 ± 2% perf-profile.calltrace.cycles-pp.__d_lookup_rcu.lookup_fast.path_openat.do_filp_open.do_sys_open 6.84 ± 3% +0.3 7.14 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_close 7.91 ± 3% +0.3 8.23 perf-profile.calltrace.cycles-pp.__GI___libc_close 4.90 ± 3% +0.5 5.39 perf-profile.calltrace.cycles-pp.pagecache_get_page.generic_file_read_iter.new_sync_read.vfs_read.ksys_read 4.71 ± 3% +0.5 5.19 perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.generic_file_read_iter.new_sync_read.vfs_read 0.00 +0.6 0.55 ± 2% perf-profile.calltrace.cycles-pp.touch_atime.generic_file_read_iter.new_sync_read.vfs_read.ksys_read 0.00 +0.6 0.61 ± 4% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_items.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread 0.40 ± 72% +0.7 1.06 ± 3% perf-profile.calltrace.cycles-pp.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread 0.41 ± 72% +0.7 1.08 ± 3% perf-profile.calltrace.cycles-pp.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork 14.55 ± 2% +0.7 15.28 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 14.65 ± 2% +0.7 15.39 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open 0.00 +0.8 0.79 ± 9% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn 0.00 +0.8 0.80 ± 9% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work 0.00 +0.8 0.81 ± 9% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work.worker_thread 17.37 ± 2% +0.8 18.22 perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open 19.41 ± 2% +0.9 20.35 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_open 19.35 ± 2% +0.9 20.29 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_open 20.78 ± 2% +1.0 21.73 perf-profile.calltrace.cycles-pp.__GI___libc_open 33.00 ± 3% +3.1 36.08 perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.generic_file_read_iter.new_sync_read.vfs_read 34.13 ± 2% +3.1 37.24 perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_read_iter.new_sync_read.vfs_read.ksys_read 32.61 ± 3% +3.1 35.74 perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.generic_file_read_iter.new_sync_read 42.82 ± 2% +3.7 46.57 perf-profile.calltrace.cycles-pp.generic_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 43.74 ± 2% +3.8 47.51 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 45.10 ± 2% +3.8 48.93 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 46.16 ± 2% +3.9 50.08 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 51.59 ± 2% +4.0 55.59 perf-profile.calltrace.cycles-pp.__GI___libc_read 49.42 ± 2% +4.0 53.43 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read 49.31 ± 2% +4.0 53.32 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read 8.64 ± 20% -5.3 3.38 ± 3% perf-profile.children.cycles-pp.normal_work_helper 10.43 ± 18% -5.2 5.28 ± 3% perf-profile.children.cycles-pp.btrfs_search_slot 10.41 ± 18% -4.8 5.60 ± 3% perf-profile.children.cycles-pp.worker_thread 10.24 ± 19% -4.8 5.48 ± 3% perf-profile.children.cycles-pp.process_one_work 11.97 ± 16% -4.7 7.24 perf-profile.children.cycles-pp.ret_from_fork 11.97 ± 16% -4.7 7.24 perf-profile.children.cycles-pp.kthread 6.81 ± 22% -4.2 2.56 ± 4% perf-profile.children.cycles-pp.btrfs_finish_ordered_io 6.15 ± 23% -3.9 2.24 ± 4% perf-profile.children.cycles-pp.insert_reserved_file_extent 5.71 ± 24% -3.7 2.05 ± 4% perf-profile.children.cycles-pp.__btrfs_drop_extents 5.35 ± 24% -3.4 1.91 ± 4% perf-profile.children.cycles-pp.btrfs_lookup_file_extent 5.67 ± 21% -2.8 2.83 ± 3% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 4.59 ± 26% -2.8 1.76 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 4.22 ± 26% -2.6 1.59 ± 6% perf-profile.children.cycles-pp.prepare_to_wait_event 2.57 ± 25% -1.7 0.88 ± 7% perf-profile.children.cycles-pp.btrfs_read_lock_root_node 2.56 ± 25% -1.7 0.88 ± 7% perf-profile.children.cycles-pp.btrfs_tree_read_lock 2.98 ± 23% -1.7 1.33 ± 4% perf-profile.children.cycles-pp.btrfs_tree_lock 2.89 ± 23% -1.6 1.28 ± 4% perf-profile.children.cycles-pp.btrfs_lock_root_node 2.49 ± 18% -1.2 1.31 ± 2% perf-profile.children.cycles-pp.__wake_up_common_lock 2.14 ± 18% -1.1 1.03 perf-profile.children.cycles-pp.unlock_up 2.27 ± 18% -1.1 1.21 ± 2% perf-profile.children.cycles-pp.__wake_up_common 2.59 ± 16% -1.1 1.53 ± 3% perf-profile.children.cycles-pp.try_to_wake_up 2.26 ± 18% -1.1 1.20 ± 2% perf-profile.children.cycles-pp.autoremove_wake_function 1.46 ± 18% -1.0 0.51 ± 5% perf-profile.children.cycles-pp.btrfs_async_run_delayed_root 1.80 ± 16% -0.7 1.05 ± 2% perf-profile.children.cycles-pp.activate_task 1.79 ± 16% -0.7 1.05 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate 1.78 ± 16% -0.7 1.04 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair 1.69 ± 16% -0.7 0.98 ± 2% perf-profile.children.cycles-pp.enqueue_entity 1.21 ± 20% -0.7 0.50 ± 6% perf-profile.children.cycles-pp.queued_write_lock_slowpath 1.45 ± 16% -0.6 0.82 ± 3% perf-profile.children.cycles-pp.__account_scheduler_latency 1.07 ± 20% -0.6 0.45 ± 6% perf-profile.children.cycles-pp.btrfs_try_tree_write_lock 1.24 ± 18% -0.6 0.69 ± 3% perf-profile.children.cycles-pp.stack_trace_save_tsk 1.27 ± 16% -0.6 0.71 ± 3% perf-profile.children.cycles-pp.__btrfs_update_delayed_inode 1.13 ± 19% -0.6 0.58 ± 3% perf-profile.children.cycles-pp.btrfs_lookup_inode 1.19 ± 17% -0.5 0.66 ± 4% perf-profile.children.cycles-pp.arch_stack_walk 1.60 ± 11% -0.5 1.13 ± 3% perf-profile.children.cycles-pp.__btrfs_unlink_inode 1.24 ± 11% -0.5 0.79 ± 2% perf-profile.children.cycles-pp.__schedule 2.48 ± 6% -0.4 2.04 ± 3% perf-profile.children.cycles-pp.btrfs_rename 2.55 ± 6% -0.4 2.11 ± 3% perf-profile.children.cycles-pp.vfs_rename 3.92 ± 4% -0.4 3.52 ± 5% perf-profile.children.cycles-pp.rename 3.85 ± 4% -0.4 3.46 ± 5% perf-profile.children.cycles-pp.__x64_sys_rename 3.85 ± 5% -0.4 3.46 ± 5% perf-profile.children.cycles-pp.do_renameat2 0.90 ± 11% -0.3 0.57 ± 2% perf-profile.children.cycles-pp.schedule 0.78 ± 18% -0.3 0.46 ± 2% perf-profile.children.cycles-pp.unwind_next_frame 1.52 ± 3% -0.3 1.21 ± 3% perf-profile.children.cycles-pp.btrfs_insert_empty_items 1.12 ± 12% -0.3 0.82 ± 5% perf-profile.children.cycles-pp.irq_exit 1.01 ± 11% -0.3 0.73 ± 4% perf-profile.children.cycles-pp.btrfs_lookup_dir_item 0.64 ± 17% -0.3 0.36 ± 7% perf-profile.children.cycles-pp.btrfs_del_inode_ref 0.56 ± 19% -0.2 0.34 ± 13% perf-profile.children.cycles-pp.ret_from_intr 0.56 ± 20% -0.2 0.33 ± 14% perf-profile.children.cycles-pp.do_IRQ 0.33 ± 34% -0.2 0.11 ± 9% perf-profile.children.cycles-pp.finish_wait 0.50 ± 18% -0.2 0.28 ± 14% perf-profile.children.cycles-pp.scsi_end_request 0.52 ± 18% -0.2 0.30 ± 14% perf-profile.children.cycles-pp.blk_done_softirq 0.50 ± 18% -0.2 0.29 ± 14% perf-profile.children.cycles-pp.scsi_io_completion 0.44 ± 18% -0.2 0.25 ± 15% perf-profile.children.cycles-pp.blk_update_request 0.35 ± 22% -0.2 0.16 ± 6% perf-profile.children.cycles-pp.btrfs_csum_file_blocks 0.35 ± 22% -0.2 0.17 ± 6% perf-profile.children.cycles-pp.add_pending_csums 0.41 ± 18% -0.2 0.23 ± 3% perf-profile.children.cycles-pp.orc_find 0.41 ± 17% -0.2 0.23 ± 16% perf-profile.children.cycles-pp.btrfs_end_bio 0.61 ± 4% -0.2 0.43 ± 3% perf-profile.children.cycles-pp.setup_items_for_insert 0.35 ± 19% -0.2 0.18 ± 20% perf-profile.children.cycles-pp.end_bio_extent_writepage 0.39 ± 21% -0.2 0.23 ± 8% perf-profile.children.cycles-pp.select_task_rq_fair 0.28 ± 29% -0.2 0.11 ± 9% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.36 ± 15% -0.2 0.20 ± 7% perf-profile.children.cycles-pp.btrfs_truncate_inode_items 0.42 ± 12% -0.2 0.26 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair 0.82 ± 3% -0.1 0.68 perf-profile.children.cycles-pp._cond_resched 0.38 ± 11% -0.1 0.24 ± 3% perf-profile.children.cycles-pp.preempt_schedule_common 0.29 ± 22% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.select_idle_sibling 0.30 ± 16% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.__orc_find 0.19 ± 19% -0.1 0.10 ± 11% perf-profile.children.cycles-pp.unwind_get_return_address 0.17 ± 15% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.btrfs_unlock_up_safe 0.19 ± 20% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.__module_address 0.21 ± 16% -0.1 0.11 ± 13% perf-profile.children.cycles-pp.queued_read_lock_slowpath 0.17 ± 18% -0.1 0.08 ± 8% perf-profile.children.cycles-pp.kernel_text_address 0.23 ± 11% -0.1 0.14 ± 10% perf-profile.children.cycles-pp.dequeue_task_fair 0.18 ± 19% -0.1 0.09 ± 13% perf-profile.children.cycles-pp.__kernel_text_address 0.26 ± 6% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.update_load_avg 0.30 ± 12% -0.1 0.21 ± 10% perf-profile.children.cycles-pp.btrfs_commit_inode_delayed_inode 0.17 ± 24% -0.1 0.09 ± 9% perf-profile.children.cycles-pp.btrfs_writepage_endio_finish_ordered 0.17 ± 24% -0.1 0.09 ± 9% perf-profile.children.cycles-pp.end_extent_writepage 0.18 ± 18% -0.1 0.10 ± 8% perf-profile.children.cycles-pp.reschedule_interrupt 0.15 ± 23% -0.1 0.07 ± 17% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched 0.18 ± 13% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.btrfs_del_orphan_item 0.10 ± 9% -0.1 0.03 ±100% perf-profile.children.cycles-pp.push_leaf_right 0.18 ± 7% -0.1 0.11 ± 4% perf-profile.children.cycles-pp.split_leaf 0.14 ± 9% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref 0.11 ± 20% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.btrfs_alloc_reserved_file_extent 0.23 ± 10% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.update_curr 0.12 ± 19% -0.1 0.06 ± 14% perf-profile.children.cycles-pp.is_module_text_address 0.29 ± 4% -0.1 0.23 ± 10% perf-profile.children.cycles-pp.btrfs_lookup_dentry 0.16 ± 9% -0.1 0.09 ± 14% perf-profile.children.cycles-pp.dequeue_entity 0.21 ± 9% -0.1 0.15 ± 7% perf-profile.children.cycles-pp.btrfs_unlink_inode 0.15 ± 8% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.set_next_entity 0.29 ± 4% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.btrfs_lookup 0.12 ± 17% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.__module_text_address 0.14 ± 14% -0.1 0.08 ± 13% perf-profile.children.cycles-pp.put_prev_entity 0.12 ± 21% -0.1 0.07 ± 19% perf-profile.children.cycles-pp.end_page_writeback 0.12 ± 20% -0.1 0.07 ± 19% perf-profile.children.cycles-pp.test_clear_page_writeback 0.12 ± 12% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.io_serial_in 0.08 ± 6% -0.1 0.03 ±100% perf-profile.children.cycles-pp.prepare_exit_to_usermode 0.09 ± 15% -0.0 0.05 ± 58% perf-profile.children.cycles-pp.finish_task_switch 0.08 ± 8% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.19 ± 9% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid 0.10 ± 19% -0.0 0.05 ± 9% perf-profile.children.cycles-pp.add_delayed_ref_head 0.10 ± 14% -0.0 0.06 ± 16% perf-profile.children.cycles-pp.__update_load_avg_se 0.15 ± 11% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.memcpy_extent_buffer 0.10 ± 16% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.07 ± 12% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.check_preempt_wakeup 0.12 ± 16% -0.0 0.09 ± 7% perf-profile.children.cycles-pp.btrfs_lookup_xattr 0.09 ± 12% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.check_preempt_curr 0.14 ± 14% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.__vfs_getxattr 0.10 ± 10% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.__legitimize_mnt 0.07 ± 12% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.__blk_mq_delay_run_hw_queue 0.39 ± 4% +0.0 0.42 perf-profile.children.cycles-pp.__might_fault 0.07 ± 14% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.btrfs_dirty_inode 0.07 ± 20% +0.0 0.11 ± 21% perf-profile.children.cycles-pp.__btrfs_end_transaction 0.06 ± 13% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.read_extent_buffer 0.07 ± 19% +0.0 0.11 ± 11% perf-profile.children.cycles-pp.blk_flush_plug_list 0.07 ± 19% +0.0 0.11 ± 11% perf-profile.children.cycles-pp.blk_mq_flush_plug_list 0.06 ± 47% +0.0 0.10 ± 12% perf-profile.children.cycles-pp.blk_finish_plug 0.07 ± 16% +0.0 0.11 ± 11% perf-profile.children.cycles-pp.blk_mq_sched_insert_requests 0.42 ± 3% +0.0 0.46 perf-profile.children.cycles-pp.fput_many 1.89 +0.1 1.95 perf-profile.children.cycles-pp.syscall_return_via_sysret 0.04 ± 73% +0.1 0.10 ± 7% perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata 0.12 ± 15% +0.1 0.18 ± 8% perf-profile.children.cycles-pp.start_transaction 0.04 ± 71% +0.1 0.10 ± 11% perf-profile.children.cycles-pp.set_extent_bit 0.01 ±223% +0.1 0.07 ± 24% perf-profile.children.cycles-pp.btrfs_trans_release_metadata 0.02 ±142% +0.1 0.08 ± 5% perf-profile.children.cycles-pp.copy_page 0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.btrfs_update_block_group 0.01 ±223% +0.1 0.08 ± 11% perf-profile.children.cycles-pp.copy_extent_buffer_full 0.91 ± 5% +0.1 0.98 ± 4% perf-profile.children.cycles-pp.fsnotify 0.05 ± 50% +0.1 0.12 ± 12% perf-profile.children.cycles-pp.btrfs_get_64 0.53 ± 6% +0.1 0.60 ± 7% perf-profile.children.cycles-pp.__fget_light 0.40 ± 5% +0.1 0.47 ± 7% perf-profile.children.cycles-pp.__fget 0.03 ±101% +0.1 0.10 ± 4% perf-profile.children.cycles-pp.mutex_spin_on_owner 0.48 ± 5% +0.1 0.56 ± 2% perf-profile.children.cycles-pp.touch_atime 0.79 ± 4% +0.1 0.87 ± 4% perf-profile.children.cycles-pp.__fdget_pos 0.17 ± 9% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.__btrfs_cow_block 0.17 ± 9% +0.1 0.26 ± 4% perf-profile.children.cycles-pp.btrfs_cow_block 0.01 ±223% +0.1 0.10 ± 11% perf-profile.children.cycles-pp.btrfs_del_csums 0.04 ±102% +0.1 0.14 ± 6% perf-profile.children.cycles-pp.__mutex_lock 0.03 ±100% +0.1 0.13 ± 12% perf-profile.children.cycles-pp.btrfs_block_rsv_add 0.04 ±105% +0.1 0.14 ± 16% perf-profile.children.cycles-pp.btrfs_try_granting_tickets 0.12 ± 17% +0.1 0.23 ± 6% perf-profile.children.cycles-pp.map_private_extent_buffer 1.22 ± 5% +0.1 1.33 ± 2% perf-profile.children.cycles-pp.xas_start 1.03 ± 3% +0.1 1.15 ± 3% perf-profile.children.cycles-pp.errseq_sample 0.09 ± 56% +0.1 0.21 ± 11% perf-profile.children.cycles-pp.__btrfs_block_rsv_release 0.00 +0.1 0.12 ± 14% perf-profile.children.cycles-pp.lookup_inline_extent_backref 1.14 ± 5% +0.1 1.27 perf-profile.children.cycles-pp.btrfs_dentry_delete 2.25 ± 2% +0.1 2.39 perf-profile.children.cycles-pp.security_inode_permission 2.15 ± 2% +0.1 2.29 ± 2% perf-profile.children.cycles-pp.selinux_inode_permission 1.76 ± 4% +0.1 1.90 perf-profile.children.cycles-pp.xas_load 2.65 ± 2% +0.2 2.82 ± 2% perf-profile.children.cycles-pp.dput 0.06 ± 65% +0.2 0.24 ± 10% perf-profile.children.cycles-pp.btrfs_get_32 2.45 ± 2% +0.2 2.67 perf-profile.children.cycles-pp.do_dentry_open 2.88 ± 2% +0.2 3.12 perf-profile.children.cycles-pp.may_open 0.09 ± 71% +0.3 0.36 ± 6% perf-profile.children.cycles-pp.__btrfs_free_extent 3.32 ± 3% +0.3 3.62 ± 2% perf-profile.children.cycles-pp.lookup_fast 3.16 ± 3% +0.3 3.46 ± 2% perf-profile.children.cycles-pp.__d_lookup_rcu 7.98 ± 3% +0.3 8.30 perf-profile.children.cycles-pp.__GI___libc_close 0.03 ±223% +0.4 0.39 ± 11% perf-profile.children.cycles-pp.check_leaf 0.15 ± 39% +0.4 0.51 ± 11% perf-profile.children.cycles-pp.submit_one_bio 0.07 ±102% +0.4 0.44 ± 9% perf-profile.children.cycles-pp.priority_reclaim_metadata_space 0.08 ± 84% +0.4 0.46 ± 8% perf-profile.children.cycles-pp.evict_refill_and_join 0.03 ±223% +0.4 0.41 ± 11% perf-profile.children.cycles-pp.btree_csum_one_bio 0.07 ±101% +0.4 0.46 ± 8% perf-profile.children.cycles-pp.btrfs_block_rsv_refill 0.09 ± 80% +0.4 0.47 ± 10% perf-profile.children.cycles-pp.submit_extent_page 0.03 ±223% +0.4 0.43 ± 11% perf-profile.children.cycles-pp.btree_submit_bio_hook 0.25 ± 67% +0.4 0.67 ± 3% perf-profile.children.cycles-pp.btrfs_run_delayed_refs 0.25 ± 67% +0.4 0.67 ± 3% perf-profile.children.cycles-pp.__btrfs_run_delayed_refs 0.03 ±223% +0.4 0.46 ± 11% perf-profile.children.cycles-pp.write_one_eb 0.03 ±223% +0.5 0.49 ± 11% perf-profile.children.cycles-pp.btree_write_cache_pages 5.14 ± 3% +0.5 5.62 perf-profile.children.cycles-pp.pagecache_get_page 0.17 ± 52% +0.5 0.66 ± 8% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes 4.76 ± 3% +0.5 5.25 perf-profile.children.cycles-pp.find_get_entry 0.25 ± 74% +0.6 0.82 ± 6% perf-profile.children.cycles-pp.__btrfs_run_delayed_items 0.44 ± 59% +0.6 1.08 ± 3% perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space 14.58 ± 2% +0.7 15.30 perf-profile.children.cycles-pp.path_openat 14.66 ± 2% +0.7 15.40 perf-profile.children.cycles-pp.do_filp_open 17.39 ± 2% +0.8 18.24 perf-profile.children.cycles-pp.do_sys_open 20.86 ± 2% +1.0 21.81 perf-profile.children.cycles-pp.__GI___libc_open 0.52 ± 57% +1.0 1.50 ± 4% perf-profile.children.cycles-pp.flush_space 33.03 ± 3% +3.1 36.11 perf-profile.children.cycles-pp.copyout 32.99 ± 3% +3.1 36.07 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 34.17 ± 2% +3.1 37.28 perf-profile.children.cycles-pp.copy_page_to_iter 42.89 ± 2% +3.7 46.63 perf-profile.children.cycles-pp.generic_file_read_iter 43.76 ± 2% +3.8 47.52 perf-profile.children.cycles-pp.new_sync_read 45.14 ± 2% +3.8 48.95 perf-profile.children.cycles-pp.vfs_read 46.20 ± 2% +3.9 50.11 perf-profile.children.cycles-pp.ksys_read 51.73 ± 2% +4.0 55.72 perf-profile.children.cycles-pp.__GI___libc_read 80.55 ± 2% +4.9 85.46 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 80.30 ± 2% +4.9 85.22 perf-profile.children.cycles-pp.do_syscall_64 5.65 ± 21% -2.8 2.81 ± 3% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 1.12 ± 20% -0.7 0.45 ± 6% perf-profile.self.cycles-pp.queued_write_lock_slowpath 0.30 ± 16% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.__orc_find 0.28 ± 17% -0.1 0.17 ± 4% perf-profile.self.cycles-pp.unwind_next_frame 0.18 ± 19% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.__module_address 0.22 ± 10% -0.1 0.15 ± 7% perf-profile.self.cycles-pp.__schedule 0.19 ± 11% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.__account_scheduler_latency 0.16 ± 15% -0.1 0.09 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.12 ± 16% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.select_idle_sibling 0.19 ± 9% -0.0 0.14 ± 5% perf-profile.self.cycles-pp.__list_del_entry_valid 0.15 ± 12% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.update_curr 0.12 ± 15% -0.0 0.08 perf-profile.self.cycles-pp.try_to_wake_up 0.10 ± 17% -0.0 0.06 ± 14% perf-profile.self.cycles-pp.__update_load_avg_se 0.11 ± 6% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.update_load_avg 0.11 ± 10% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.queued_read_lock_slowpath 0.09 ± 14% -0.0 0.07 ± 13% perf-profile.self.cycles-pp.io_serial_in 0.06 ± 11% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.find_extent_buffer 0.14 ± 9% +0.0 0.18 ± 3% perf-profile.self.cycles-pp.vfs_read 0.05 ± 46% +0.0 0.09 ± 13% perf-profile.self.cycles-pp.read_extent_buffer 0.29 ± 6% +0.0 0.34 ± 4% perf-profile.self.cycles-pp.do_dentry_open 1.89 +0.0 1.94 perf-profile.self.cycles-pp.syscall_return_via_sysret 0.02 ±142% +0.1 0.08 ± 5% perf-profile.self.cycles-pp.copy_page 0.89 ± 5% +0.1 0.95 ± 4% perf-profile.self.cycles-pp.fsnotify 0.39 ± 6% +0.1 0.46 ± 7% perf-profile.self.cycles-pp.__fget 0.00 +0.1 0.07 ± 6% perf-profile.self.cycles-pp.btrfs_get_64 0.03 ±101% +0.1 0.10 ± 7% perf-profile.self.cycles-pp.mutex_spin_on_owner 1.15 ± 5% +0.1 1.24 ± 2% perf-profile.self.cycles-pp.btrfs_release_file 1.10 ± 4% +0.1 1.20 perf-profile.self.cycles-pp.may_open 0.11 ± 19% +0.1 0.21 ± 9% perf-profile.self.cycles-pp.map_private_extent_buffer 0.01 ±223% +0.1 0.14 ± 13% perf-profile.self.cycles-pp.btrfs_get_32 1.18 ± 5% +0.1 1.30 perf-profile.self.cycles-pp.xas_start 1.12 ± 5% +0.1 1.24 perf-profile.self.cycles-pp.btrfs_dentry_delete 1.00 ± 3% +0.1 1.13 ± 3% perf-profile.self.cycles-pp.errseq_sample 1.53 ± 2% +0.1 1.68 perf-profile.self.cycles-pp.selinux_inode_permission 6.04 ± 2% +0.3 6.29 perf-profile.self.cycles-pp.do_syscall_64 3.10 ± 3% +0.3 3.40 perf-profile.self.cycles-pp.__d_lookup_rcu 2.94 ± 3% +0.4 3.30 perf-profile.self.cycles-pp.find_get_entry 32.41 ± 3% +3.1 35.55 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string *************************************************************************************************** lkp-csl-2sp5: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory ========================================================================================= bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode: 4M/gcc-7/performance/1HDD/btrfs/sync/x86_64-rhel-7.6/100%/debian-x86_64-2019-11-14.cgz/300s/randwrite/lkp-csl-2sp5/128G/fio-basic/0x500002c commit: v5.4 c6bbf24815 ("btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") v5.4 c6bbf24815f95a4928984ff16a9 ---------------- --------------------------- %stddev %change %stddev \ | \ 32.11 ± 2% +19.2 51.27 ± 3% fio.latency_10ms% 1.65 ± 10% +0.6 2.29 ± 22% fio.latency_20ms% 2.45 ± 4% +1.5 3.95 ± 32% fio.latency_250ms% 1.89 ± 13% +1.1 2.97 ± 25% fio.latency_2ms% 4.91 ± 10% +3.3 8.25 ± 2% fio.latency_4ms% 1.66 ± 12% +1.0 2.65 ± 35% fio.latency_500ms% 0.53 ± 5% +0.9 1.40 ± 60% fio.latency_750ms% 48.58 -28.9 19.64 fio.latency_>=2000ms% 569.45 -10.8% 507.75 fio.time.elapsed_time 569.45 -10.8% 507.75 fio.time.elapsed_time.max 1.396e+08 -11.0% 1.243e+08 fio.time.file_system_outputs 4795 +6.1% 5087 fio.time.involuntary_context_switches 168206 +1.7% 171005 fio.time.minor_page_faults 21.50 ± 4% +14.7% 24.67 fio.time.percent_of_cpu_this_job_got 97.68 ± 3% +5.3% 102.89 ± 2% fio.time.system_time 27.29 ± 4% -9.0% 24.83 ± 2% fio.time.user_time 342822 -51.1% 167531 ± 2% fio.time.voluntary_context_switches 17044 -11.0% 15174 fio.workload 226.00 -19.8% 181.28 fio.write_bw_MBps 3.129e+09 -2.6% 3.048e+09 fio.write_clat_90%_us 3.314e+09 +163.0% 8.713e+09 ± 15% fio.write_clat_95%_us 7.902e+09 ± 5% +116.6% 1.711e+10 fio.write_clat_99%_us 1.695e+09 +23.2% 2.087e+09 fio.write_clat_mean_us 2.302e+09 +208.1% 7.092e+09 fio.write_clat_stddev 56.50 -19.8% 45.32 fio.write_iops 5.26e+10 -33.8% 3.481e+10 ± 50% cpuidle.C1E.time 1.091e+08 -29.8% 76579744 ± 39% cpuidle.C1E.usage 59.55 ± 3% +37.0% 81.61 iostat.cpu.idle 40.17 ± 4% -55.1% 18.03 ± 2% iostat.cpu.iowait 9618445 ± 3% -15.6% 8114128 ± 2% numa-numastat.node1.local_node 9634177 ± 3% -15.6% 8128974 ± 2% numa-numastat.node1.numa_hit 1.091e+08 -29.8% 76579982 ± 39% turbostat.C1E 0.29 ± 3% +2177.2% 6.49 ±134% turbostat.CPU%c6 1.1e+08 -11.6% 97228181 turbostat.IRQ 59.42 ± 3% +22.1 81.54 mpstat.cpu.all.idle% 40.31 ± 4% -22.2 18.10 ± 2% mpstat.cpu.all.iowait% 0.21 +0.1 0.28 mpstat.cpu.all.sys% 0.05 ± 4% +0.0 0.06 mpstat.cpu.all.usr% 59.00 ± 3% +38.4% 81.67 vmstat.cpu.id 39.50 ± 4% -56.1% 17.33 ± 2% vmstat.cpu.wa 60690973 -11.0% 54027738 vmstat.memory.cache 51.00 -58.2% 21.33 ± 2% vmstat.procs.b 3477 -23.0% 2676 ± 2% vmstat.system.cs 32679 -10.6% 29215 softirqs.BLOCK 72905 ± 2% -9.7% 65813 softirqs.CPU18.SCHED 70852 -8.3% 64993 softirqs.CPU2.SCHED 72448 -8.9% 66034 softirqs.CPU24.SCHED 72093 ± 2% -9.5% 65275 softirqs.CPU3.SCHED 71386 -8.3% 65425 softirqs.CPU34.SCHED 72394 ± 3% -9.3% 65673 ± 2% softirqs.CPU4.SCHED 71358 -8.4% 65358 softirqs.CPU47.SCHED 72828 ± 7% -11.4% 64492 softirqs.CPU55.SCHED 179825 ± 2% -4.9% 171024 ± 4% softirqs.CPU55.TIMER 73285 ± 6% -11.6% 64802 softirqs.CPU70.SCHED 6106 ± 59% -58.1% 2559 ± 18% softirqs.NET_RX 6980297 +21.4% 8477121 meminfo.Active 6881534 +21.9% 8391751 meminfo.Active(anon) 98763 -13.6% 85370 meminfo.Active(file) 6722134 +22.1% 8205451 meminfo.AnonHugePages 6874798 +22.0% 8385338 meminfo.AnonPages 60585719 -10.9% 53952323 meminfo.Cached 9189374 +21.6% 11174393 meminfo.Committed_AS 2601593 ± 3% -29.1% 1843844 ± 11% meminfo.Dirty 59396333 -11.1% 52779406 meminfo.Inactive 235578 +22.4% 288269 meminfo.Inactive(anon) 59160754 -11.3% 52491136 meminfo.Inactive(file) 242094 +21.9% 295027 meminfo.Mapped 22318 +19.0% 26565 meminfo.PageTables 242974 +21.5% 295322 meminfo.Shmem 21356479 -10.0% 19216736 meminfo.Writeback 24.23 -9.2 15.05 ± 21% perf-stat.i.cache-miss-rate% 3438 -23.7% 2623 ± 2% perf-stat.i.context-switches 4.84 ± 18% -36.9% 3.05 ± 14% perf-stat.i.cpu-migrations 55.97 ± 2% +15.8 71.82 ± 2% perf-stat.i.node-load-miss-rate% 473818 ± 2% -11.6% 418921 ± 3% perf-stat.i.node-loads 57.36 ± 11% +15.9 73.22 ± 11% perf-stat.i.node-store-miss-rate% 113007 ± 36% +53.3% 173295 ± 6% perf-stat.i.node-store-misses 9.55 +107.3% 19.81 ± 71% perf-stat.overall.MPKI 40.36 -11.2 29.13 ± 44% perf-stat.overall.cache-miss-rate% 697.03 ± 2% +23.6% 861.87 ± 23% perf-stat.overall.cycles-between-cache-misses 3431 -23.7% 2618 ± 2% perf-stat.ps.context-switches 4.83 ± 18% -36.9% 3.05 ± 14% perf-stat.ps.cpu-migrations 473042 ± 2% -11.5% 418533 ± 3% perf-stat.ps.node-loads 112832 ± 36% +53.5% 173186 ± 6% perf-stat.ps.node-store-misses 6.525e+11 ± 2% -8.6% 5.964e+11 ± 6% perf-stat.total.instructions 4351 -9.8% 3923 ± 2% slabinfo.biovec-max.active_objs 4422 -9.8% 3990 ± 2% slabinfo.biovec-max.num_objs 3161 ± 2% +20.4% 3807 ± 3% slabinfo.buffer_head.active_objs 3161 ± 2% +20.4% 3807 ± 3% slabinfo.buffer_head.num_objs 3792 ± 2% -16.7% 3157 ± 10% slabinfo.eventpoll_pwq.active_objs 3792 ± 2% -16.7% 3157 ± 10% slabinfo.eventpoll_pwq.num_objs 10249 ± 11% -13.0% 8918 slabinfo.kmalloc-128.active_objs 10537 ± 10% -13.0% 9166 slabinfo.kmalloc-128.num_objs 12494 ± 14% -7.2% 11599 ± 15% slabinfo.kmalloc-96.active_objs 6957 ± 13% -17.3% 5753 ± 5% slabinfo.mnt_cache.active_objs 7228 ± 12% -16.5% 6038 ± 5% slabinfo.mnt_cache.num_objs 9650 ± 2% -10.1% 8673 ± 6% slabinfo.pde_opener.active_objs 9650 ± 2% -10.1% 8673 ± 6% slabinfo.pde_opener.num_objs 254579 -10.3% 228410 slabinfo.radix_tree_node.active_objs 4550 -10.3% 4082 slabinfo.radix_tree_node.active_slabs 254858 -10.3% 228613 slabinfo.radix_tree_node.num_objs 4550 -10.3% 4082 slabinfo.radix_tree_node.num_slabs 929.75 ± 2% -17.3% 768.67 ± 6% slabinfo.skbuff_fclone_cache.active_objs 929.75 ± 2% -17.3% 768.67 ± 6% slabinfo.skbuff_fclone_cache.num_objs 3358265 ± 17% +62.2% 5447527 ± 3% numa-meminfo.node0.Active 3287465 ± 18% +63.2% 5363594 ± 3% numa-meminfo.node0.Active(anon) 3218136 ± 18% +62.4% 5225885 ± 3% numa-meminfo.node0.AnonHugePages 3284964 ± 18% +63.1% 5359183 ± 3% numa-meminfo.node0.AnonPages 1275121 -27.7% 921832 ± 13% numa-meminfo.node0.Dirty 29880934 ± 2% -12.2% 26227247 numa-meminfo.node0.FilePages 29259129 ± 2% -12.5% 25596312 numa-meminfo.node0.Inactive 29138728 ± 2% -12.8% 25400579 numa-meminfo.node0.Inactive(file) 11461 ± 32% +67.9% 19243 ± 4% numa-meminfo.node0.PageTables 10485663 -9.4% 9498679 ± 3% numa-meminfo.node0.Writeback 1331077 ± 4% -30.4% 926791 ± 9% numa-meminfo.node1.Dirty 30744049 ± 2% -9.7% 27760604 numa-meminfo.node1.FilePages 30176474 ± 2% -9.8% 27218135 numa-meminfo.node1.Inactive 30061010 ± 2% -9.8% 27125509 numa-meminfo.node1.Inactive(file) 104876 -11.5% 92764 ± 2% numa-meminfo.node1.KReclaimable 34790493 -10.3% 31205414 numa-meminfo.node1.MemUsed 950.25 ± 15% -32.7% 639.33 ± 32% numa-meminfo.node1.Mlocked 10867 ± 35% -32.4% 7340 ± 12% numa-meminfo.node1.PageTables 104876 -11.5% 92764 ± 2% numa-meminfo.node1.SReclaimable 10882982 -10.6% 9729197 ± 2% numa-meminfo.node1.Writeback 821564 ± 18% +63.0% 1339090 ± 3% numa-vmstat.node0.nr_active_anon 820937 ± 18% +63.0% 1337961 ± 3% numa-vmstat.node0.nr_anon_pages 1570 ± 18% +62.3% 2548 ± 3% numa-vmstat.node0.nr_anon_transparent_hugepages 7357913 ± 2% -12.5% 6436686 numa-vmstat.node0.nr_dirtied 318312 -27.8% 229843 ± 12% numa-vmstat.node0.nr_dirty 7470736 ± 2% -12.3% 6551235 numa-vmstat.node0.nr_file_pages 7285231 ± 2% -12.9% 6344516 numa-vmstat.node0.nr_inactive_file 2864 ± 32% +67.8% 4805 ± 4% numa-vmstat.node0.nr_page_table_pages 2621950 -9.5% 2372694 ± 3% numa-vmstat.node0.nr_writeback 4417272 ± 5% -13.2% 3833953 ± 2% numa-vmstat.node0.nr_written 821564 ± 18% +63.0% 1339113 ± 3% numa-vmstat.node0.nr_zone_active_anon 7285229 ± 2% -12.9% 6344515 numa-vmstat.node0.nr_zone_inactive_file 2940629 -11.5% 2602714 numa-vmstat.node0.nr_zone_write_pending 7580229 ± 2% -9.7% 6844750 numa-vmstat.node1.nr_dirtied 332415 ± 4% -30.4% 231200 ± 8% numa-vmstat.node1.nr_dirty 7686733 ± 2% -9.8% 6933415 numa-vmstat.node1.nr_file_pages 7515981 ± 2% -9.9% 6774631 numa-vmstat.node1.nr_inactive_file 237.50 ± 15% -32.8% 159.67 ± 33% numa-vmstat.node1.nr_mlock 2715 ± 35% -32.5% 1833 ± 12% numa-vmstat.node1.nr_page_table_pages 26220 -11.6% 23179 ± 2% numa-vmstat.node1.nr_slab_reclaimable 2721165 -10.7% 2430270 ± 2% numa-vmstat.node1.nr_writeback 4526266 ± 5% -7.6% 4183049 ± 2% numa-vmstat.node1.nr_written 7515979 ± 2% -9.9% 6774630 numa-vmstat.node1.nr_zone_inactive_file 3053946 -12.8% 2661697 ± 2% numa-vmstat.node1.nr_zone_write_pending 8503740 -12.8% 7411961 numa-vmstat.node1.numa_hit 8317339 -13.1% 7226488 numa-vmstat.node1.numa_local 1722147 +21.9% 2098533 proc-vmstat.nr_active_anon 24721 -13.9% 21295 proc-vmstat.nr_active_file 1720474 +21.9% 2096933 proc-vmstat.nr_anon_pages 3284 +22.0% 4006 proc-vmstat.nr_anon_transparent_hugepages 17531015 -11.0% 15609677 proc-vmstat.nr_dirtied 651202 ± 3% -29.1% 461586 ± 11% proc-vmstat.nr_dirty 15157215 -11.0% 13493267 proc-vmstat.nr_file_pages 32019703 +4.0% 33309791 proc-vmstat.nr_free_pages 58989 +22.2% 72088 proc-vmstat.nr_inactive_anon 14800882 -11.3% 13127864 proc-vmstat.nr_inactive_file 16112 +2.0% 16433 proc-vmstat.nr_kernel_stack 60743 +21.7% 73904 proc-vmstat.nr_mapped 474.50 -20.5% 377.33 ± 32% proc-vmstat.nr_mlock 5584 +18.9% 6640 proc-vmstat.nr_page_table_pages 60837 +21.4% 73851 proc-vmstat.nr_shmem 53130 -7.4% 49197 proc-vmstat.nr_slab_reclaimable 66018 ± 2% -2.6% 64316 ± 2% proc-vmstat.nr_slab_unreclaimable 5342632 -10.0% 4805762 proc-vmstat.nr_writeback 17530929 -11.0% 15609605 proc-vmstat.nr_written 1722147 +21.9% 2098533 proc-vmstat.nr_zone_active_anon 24721 -13.9% 21295 proc-vmstat.nr_zone_active_file 58989 +22.2% 72088 proc-vmstat.nr_zone_inactive_anon 14800882 -11.3% 13127865 proc-vmstat.nr_zone_inactive_file 5994595 -12.1% 5267669 proc-vmstat.nr_zone_write_pending 77.25 ± 34% +2658.1% 2130 ±118% proc-vmstat.numa_hint_faults_local 18920494 -10.7% 16900243 proc-vmstat.numa_hit 32.25 ±167% +12215.2% 3971 ± 10% proc-vmstat.numa_huge_pte_updates 18888968 -10.7% 16868702 proc-vmstat.numa_local 2333 ± 21% +1071.8% 27337 ± 14% proc-vmstat.numa_pages_migrated 17396 ±160% +11700.1% 2052776 ± 10% proc-vmstat.numa_pte_updates 32469 -13.3% 28161 ± 2% proc-vmstat.pgactivate 22264192 -9.1% 20231175 proc-vmstat.pgalloc_normal 1624865 -8.8% 1482610 proc-vmstat.pgfault 21790575 ± 2% -7.3% 20209315 proc-vmstat.pgfree 2333 ± 21% +1071.8% 27337 ± 14% proc-vmstat.pgmigrate_success 70397986 -11.0% 62684233 proc-vmstat.pgpgout 22749 ± 19% -20.5% 18076 ± 16% sched_debug.cfs_rq:/.load.avg 1.73 ± 21% -35.6% 1.11 ± 8% sched_debug.cfs_rq:/.nr_spread_over.max 0.40 ± 13% -31.6% 0.27 ± 13% sched_debug.cfs_rq:/.nr_spread_over.stddev 76.80 ± 57% +97.5% 151.70 ± 35% sched_debug.cfs_rq:/.removed.load_avg.max 11.27 ± 76% +174.8% 30.98 ± 39% sched_debug.cfs_rq:/.removed.load_avg.stddev 3545 ± 57% +98.3% 7029 ± 35% sched_debug.cfs_rq:/.removed.runnable_sum.max 518.68 ± 76% +176.2% 1432 ± 39% sched_debug.cfs_rq:/.removed.runnable_sum.stddev 0.82 ±115% +277.4% 3.11 ± 44% sched_debug.cfs_rq:/.removed.util_avg.avg 33.52 ± 63% +130.1% 77.15 ± 35% sched_debug.cfs_rq:/.removed.util_avg.max 4.51 ± 78% +218.0% 14.33 ± 38% sched_debug.cfs_rq:/.removed.util_avg.stddev 13.04 ± 17% -19.8% 10.45 ± 7% sched_debug.cfs_rq:/.runnable_load_avg.avg 514.15 ± 15% -24.0% 390.56 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.max 74.55 ± 16% -19.7% 59.88 ± 3% sched_debug.cfs_rq:/.runnable_load_avg.stddev 22738 ± 19% -20.5% 18069 ± 16% sched_debug.cfs_rq:/.runnable_weight.avg 60.00 ± 4% +13.7% 68.23 ± 3% sched_debug.cfs_rq:/.util_avg.avg 304212 -10.4% 272577 sched_debug.cpu.clock.avg 304216 -10.4% 272582 sched_debug.cpu.clock.max 304207 -10.4% 272571 sched_debug.cpu.clock.min 304212 -10.4% 272577 sched_debug.cpu.clock_task.avg 304216 -10.4% 272582 sched_debug.cpu.clock_task.max 304207 -10.4% 272571 sched_debug.cpu.clock_task.min 0.00 ± 5% -7.3% 0.00 sched_debug.cpu.next_balance.stddev 14177 -28.1% 10200 sched_debug.cpu.nr_switches.avg 89339 ± 18% -22.1% 69625 sched_debug.cpu.nr_switches.max 13031 ± 13% -17.6% 10735 ± 4% sched_debug.cpu.nr_switches.stddev 0.52 +16.3% 0.60 ± 2% sched_debug.cpu.nr_uninterruptible.avg -22.45 -36.6% -14.22 sched_debug.cpu.nr_uninterruptible.min 12756 -32.2% 8643 ± 2% sched_debug.cpu.sched_count.avg 87145 ± 19% -23.0% 67130 sched_debug.cpu.sched_count.max 12845 ± 13% -18.8% 10429 ± 3% sched_debug.cpu.sched_count.stddev 6132 -32.0% 4167 ± 2% sched_debug.cpu.sched_goidle.avg 42808 ± 20% -26.0% 31699 sched_debug.cpu.sched_goidle.max 6348 ± 13% -19.6% 5101 ± 3% sched_debug.cpu.sched_goidle.stddev 6212 -31.9% 4231 ± 2% sched_debug.cpu.ttwu_count.avg 3718 -37.1% 2339 sched_debug.cpu.ttwu_local.avg 203.38 ± 19% -45.5% 110.81 ± 12% sched_debug.cpu.ttwu_local.min 304207 -10.4% 272571 sched_debug.cpu_clk 301340 -10.5% 269700 sched_debug.ktime 304551 -10.4% 272919 sched_debug.sched_clk 0.75 -0.4 0.36 ± 70% perf-profile.calltrace.cycles-pp.update_blocked_averages.run_rebalance_domains.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt 0.81 ± 2% -0.2 0.63 ± 7% perf-profile.calltrace.cycles-pp.run_rebalance_domains.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt 0.91 ± 2% +0.1 0.99 ± 5% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt 93.67 +2.3 95.95 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 93.73 +2.3 96.01 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 93.73 +2.3 96.01 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 94.44 +2.7 97.12 perf-profile.calltrace.cycles-pp.secondary_startup_64 81.60 +3.1 84.73 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 80.59 +3.1 83.73 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 4.14 -2.3 1.80 ± 35% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 4.13 -2.3 1.80 ± 35% perf-profile.children.cycles-pp.do_syscall_64 0.47 ± 10% -0.4 0.11 ± 11% perf-profile.children.cycles-pp.try_to_wake_up 0.83 ± 9% -0.3 0.55 ± 23% perf-profile.children.cycles-pp.run_timer_softirq 0.35 ± 10% -0.3 0.08 ± 11% perf-profile.children.cycles-pp.ttwu_do_activate 0.35 ± 10% -0.3 0.08 ± 11% perf-profile.children.cycles-pp.activate_task 0.35 ± 11% -0.3 0.08 ± 11% perf-profile.children.cycles-pp.enqueue_task_fair 0.34 ± 11% -0.3 0.08 ± 6% perf-profile.children.cycles-pp.enqueue_entity 0.76 ± 2% -0.2 0.53 ± 4% perf-profile.children.cycles-pp.update_blocked_averages 0.26 ± 7% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.__account_scheduler_latency 0.82 ± 2% -0.2 0.64 ± 8% perf-profile.children.cycles-pp.run_rebalance_domains 0.62 ± 8% -0.2 0.44 ± 37% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.23 ± 2% -0.2 0.05 ± 70% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.19 ± 11% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.18 ± 10% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.arch_stack_walk 0.20 ± 13% -0.1 0.09 ± 15% perf-profile.children.cycles-pp.__schedule 0.26 ± 20% -0.1 0.16 ± 32% perf-profile.children.cycles-pp.trigger_load_balance 0.15 ± 71% -0.1 0.05 ± 71% perf-profile.children.cycles-pp.call_function_single_interrupt 0.11 ± 22% -0.1 0.04 ± 73% perf-profile.children.cycles-pp.schedule 0.21 ± 7% -0.1 0.15 ± 23% perf-profile.children.cycles-pp.get_cpu_device 0.06 ± 20% +0.0 0.10 ± 21% perf-profile.children.cycles-pp.sched_clock_idle_wakeup_event 0.20 ± 7% +0.0 0.25 ± 5% perf-profile.children.cycles-pp.__hrtimer_get_next_event 0.09 ± 13% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.irq_work_needs_cpu 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.irq_work_tick 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__intel_pmu_disable_all 0.10 ± 22% +0.1 0.16 ± 13% perf-profile.children.cycles-pp.account_process_tick 0.94 +0.1 1.02 ± 5% perf-profile.children.cycles-pp.load_balance 0.13 ± 10% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.nr_iowait_cpu 0.01 ±173% +0.1 0.09 ± 22% perf-profile.children.cycles-pp.intel_pmu_disable_all 0.27 ± 4% +0.1 0.36 ± 18% perf-profile.children.cycles-pp.enqueue_hrtimer 93.73 +2.3 96.01 perf-profile.children.cycles-pp.start_secondary 94.57 +2.7 97.23 perf-profile.children.cycles-pp.do_idle 94.44 +2.7 97.12 perf-profile.children.cycles-pp.secondary_startup_64 94.44 +2.7 97.12 perf-profile.children.cycles-pp.cpu_startup_entry 82.16 +3.5 85.66 perf-profile.children.cycles-pp.cpuidle_enter_state 82.23 +3.5 85.74 perf-profile.children.cycles-pp.cpuidle_enter 1.40 ± 21% -0.6 0.75 ± 51% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.62 ± 8% -0.2 0.44 ± 37% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.20 ± 10% -0.2 0.05 ± 70% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.24 ± 22% -0.1 0.14 ± 30% perf-profile.self.cycles-pp.trigger_load_balance 0.16 ± 17% -0.1 0.08 ± 48% perf-profile.self.cycles-pp.update_blocked_averages 0.20 ± 7% -0.1 0.14 ± 21% perf-profile.self.cycles-pp.get_cpu_device 0.10 ± 10% -0.0 0.07 ± 14% perf-profile.self.cycles-pp.do_wait 0.01 ±173% +0.0 0.06 ± 13% perf-profile.self.cycles-pp.tick_nohz_irq_exit 0.08 ± 25% +0.0 0.13 ± 21% perf-profile.self.cycles-pp.rb_insert_color 0.08 ± 10% +0.0 0.13 ± 14% perf-profile.self.cycles-pp.irq_work_needs_cpu 0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.irq_work_tick 0.12 ± 15% +0.1 0.18 ± 19% perf-profile.self.cycles-pp.rebalance_domains 0.09 ± 23% +0.1 0.16 ± 13% perf-profile.self.cycles-pp.account_process_tick 0.12 ± 12% +0.1 0.20 ± 18% perf-profile.self.cycles-pp.nr_iowait_cpu 0.23 ± 8% +0.1 0.33 ± 16% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.50 ±173% +1.5e+05% 733.67 ±140% interrupts.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69 1.00 ± 70% +73266.7% 733.67 ±140% interrupts.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71 498.25 ± 2% -10.9% 444.00 interrupts.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc 1673 ±169% -99.1% 15.33 ±136% interrupts.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9 149.50 ±167% -98.9% 1.67 ±101% interrupts.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19 0.50 ±173% +17233.3% 86.67 ± 75% interrupts.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24 1143 -10.7% 1021 interrupts.9:IO-APIC.9-fasteoi.acpi 588135 ± 5% -14.5% 502746 ± 5% interrupts.CAL:Function_call_interrupts 6024 ± 7% -12.3% 5281 ± 4% interrupts.CPU0.CAL:Function_call_interrupts 1138250 -10.6% 1017756 interrupts.CPU0.LOC:Local_timer_interrupts 1143 -10.7% 1021 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 6026 ± 7% -12.0% 5303 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 1137668 -10.7% 1015519 interrupts.CPU1.LOC:Local_timer_interrupts 6004 ± 7% -13.4% 5199 ± 6% interrupts.CPU10.CAL:Function_call_interrupts 1137962 -10.6% 1017379 interrupts.CPU10.LOC:Local_timer_interrupts 58.25 ± 68% +2366.4% 1436 ±114% interrupts.CPU10.RES:Rescheduling_interrupts 6001 ± 7% -11.8% 5291 ± 4% interrupts.CPU11.CAL:Function_call_interrupts 1137822 -10.7% 1015837 interrupts.CPU11.LOC:Local_timer_interrupts 6001 ± 7% -12.0% 5280 ± 4% interrupts.CPU12.CAL:Function_call_interrupts 1137767 -10.3% 1020035 interrupts.CPU12.LOC:Local_timer_interrupts 5950 ± 7% -11.2% 5285 ± 4% interrupts.CPU13.CAL:Function_call_interrupts 1138385 -10.7% 1016786 interrupts.CPU13.LOC:Local_timer_interrupts 217.75 ± 95% -74.6% 55.33 ± 47% interrupts.CPU13.RES:Rescheduling_interrupts 5996 ± 7% -11.7% 5297 ± 4% interrupts.CPU14.CAL:Function_call_interrupts 1140203 -10.3% 1023222 interrupts.CPU14.LOC:Local_timer_interrupts 5994 ± 7% -11.9% 5280 ± 4% interrupts.CPU15.CAL:Function_call_interrupts 1140803 -10.8% 1018011 interrupts.CPU15.LOC:Local_timer_interrupts 5994 ± 7% -11.8% 5286 ± 4% interrupts.CPU16.CAL:Function_call_interrupts 1137959 -10.7% 1015838 interrupts.CPU16.LOC:Local_timer_interrupts 5994 ± 7% -14.0% 5155 ± 6% interrupts.CPU17.CAL:Function_call_interrupts 1137757 -10.7% 1015602 interrupts.CPU17.LOC:Local_timer_interrupts 34.25 ± 90% +454.7% 190.00 ± 86% interrupts.CPU17.TLB:TLB_shootdowns 1137983 -10.5% 1018792 interrupts.CPU18.LOC:Local_timer_interrupts 149.00 ±168% -98.9% 1.67 ±101% interrupts.CPU19.55:PCI-MSI.31981588-edge.i40e-eth0-TxRx-19 5991 ± 7% -11.9% 5278 ± 4% interrupts.CPU19.CAL:Function_call_interrupts 1137454 -10.2% 1020953 interrupts.CPU19.LOC:Local_timer_interrupts 168.50 ± 88% -68.2% 53.67 ± 27% interrupts.CPU19.RES:Rescheduling_interrupts 6025 ± 7% -11.9% 5307 ± 4% interrupts.CPU2.CAL:Function_call_interrupts 1138563 -10.8% 1015929 interrupts.CPU2.LOC:Local_timer_interrupts 5991 ± 7% -12.0% 5274 ± 4% interrupts.CPU20.CAL:Function_call_interrupts 1137663 -10.7% 1015674 interrupts.CPU20.LOC:Local_timer_interrupts 5994 ± 7% -12.0% 5274 ± 4% interrupts.CPU21.CAL:Function_call_interrupts 1137722 -10.7% 1015780 interrupts.CPU21.LOC:Local_timer_interrupts 5989 ± 7% -12.0% 5271 ± 4% interrupts.CPU22.CAL:Function_call_interrupts 1137580 -10.7% 1016040 interrupts.CPU22.LOC:Local_timer_interrupts 1137836 -10.5% 1017902 interrupts.CPU23.LOC:Local_timer_interrupts 0.25 ±173% +34433.3% 86.33 ± 75% interrupts.CPU24.60:PCI-MSI.31981593-edge.i40e-eth0-TxRx-24 6648 ± 12% -33.8% 4404 ± 19% interrupts.CPU24.CAL:Function_call_interrupts 1137947 -12.4% 997184 ± 2% interrupts.CPU24.LOC:Local_timer_interrupts 6035 ± 7% -24.9% 4530 ± 14% interrupts.CPU25.CAL:Function_call_interrupts 1139850 -12.5% 996933 ± 2% interrupts.CPU25.LOC:Local_timer_interrupts 311.50 ±136% +757.0% 2669 ± 84% interrupts.CPU25.RES:Rescheduling_interrupts 5992 ± 8% -11.5% 5301 ± 5% interrupts.CPU26.CAL:Function_call_interrupts 1139400 -12.5% 997191 ± 2% interrupts.CPU26.LOC:Local_timer_interrupts 5941 ± 9% -11.3% 5270 ± 4% interrupts.CPU27.CAL:Function_call_interrupts 1139705 -12.9% 992856 ± 3% interrupts.CPU27.LOC:Local_timer_interrupts 5930 ± 8% -11.2% 5266 ± 4% interrupts.CPU28.CAL:Function_call_interrupts 1141424 -12.9% 994051 ± 3% interrupts.CPU28.LOC:Local_timer_interrupts 46.00 ± 53% +297.1% 182.67 ± 70% interrupts.CPU28.RES:Rescheduling_interrupts 5986 ± 7% -11.9% 5274 ± 4% interrupts.CPU29.CAL:Function_call_interrupts 1138137 -12.6% 994602 ± 3% interrupts.CPU29.LOC:Local_timer_interrupts 6026 ± 7% -11.9% 5307 ± 4% interrupts.CPU3.CAL:Function_call_interrupts 1141306 -11.0% 1015838 interrupts.CPU3.LOC:Local_timer_interrupts 3711 ±138% -95.9% 153.67 ± 69% interrupts.CPU3.RES:Rescheduling_interrupts 8396 ± 45% -36.8% 5302 ± 5% interrupts.CPU30.CAL:Function_call_interrupts 1141904 -12.8% 995933 ± 2% interrupts.CPU30.LOC:Local_timer_interrupts 6257 ± 5% -15.2% 5304 ± 5% interrupts.CPU31.CAL:Function_call_interrupts 1139795 -12.6% 995895 ± 2% interrupts.CPU31.LOC:Local_timer_interrupts 6003 ± 8% -11.7% 5299 ± 5% interrupts.CPU32.CAL:Function_call_interrupts 1137916 -12.7% 993919 ± 3% interrupts.CPU32.LOC:Local_timer_interrupts 5986 ± 8% -11.5% 5300 ± 5% interrupts.CPU33.CAL:Function_call_interrupts 1139914 -12.6% 996673 ± 2% interrupts.CPU33.LOC:Local_timer_interrupts 6357 ± 6% -16.7% 5297 ± 5% interrupts.CPU34.CAL:Function_call_interrupts 1138490 -12.6% 994872 ± 2% interrupts.CPU34.LOC:Local_timer_interrupts 5992 ± 8% -16.0% 5034 ± 4% interrupts.CPU35.CAL:Function_call_interrupts 1137884 -12.5% 995226 ± 2% interrupts.CPU35.LOC:Local_timer_interrupts 7658 ± 33% -30.9% 5293 ± 5% interrupts.CPU36.CAL:Function_call_interrupts 1137619 -12.3% 997627 ± 2% interrupts.CPU36.LOC:Local_timer_interrupts 5960 ± 6% -11.2% 5291 ± 5% interrupts.CPU37.CAL:Function_call_interrupts 1138379 -12.5% 995871 ± 2% interrupts.CPU37.LOC:Local_timer_interrupts 7549 ± 34% -29.9% 5290 ± 5% interrupts.CPU38.CAL:Function_call_interrupts 1137796 -12.6% 994483 ± 3% interrupts.CPU38.LOC:Local_timer_interrupts 5953 ± 7% -11.2% 5289 ± 5% interrupts.CPU39.CAL:Function_call_interrupts 1137829 -12.4% 997075 ± 2% interrupts.CPU39.LOC:Local_timer_interrupts 63.00 ± 30% +1197.9% 817.67 ± 77% interrupts.CPU39.RES:Rescheduling_interrupts 6021 ± 7% -12.1% 5295 ± 4% interrupts.CPU4.CAL:Function_call_interrupts 1137810 -10.6% 1017478 interrupts.CPU4.LOC:Local_timer_interrupts 7275 ± 26% -27.4% 5285 ± 5% interrupts.CPU40.CAL:Function_call_interrupts 1137756 -12.6% 994513 ± 3% interrupts.CPU40.LOC:Local_timer_interrupts 5979 ± 8% -10.0% 5380 ± 4% interrupts.CPU41.CAL:Function_call_interrupts 1137888 -12.7% 993206 ± 3% interrupts.CPU41.LOC:Local_timer_interrupts 5967 ± 7% -11.4% 5286 ± 5% interrupts.CPU42.CAL:Function_call_interrupts 1137767 -12.2% 998500 ± 2% interrupts.CPU42.LOC:Local_timer_interrupts 5963 ± 8% -11.2% 5292 ± 5% interrupts.CPU43.CAL:Function_call_interrupts 1137641 -12.5% 995532 ± 2% interrupts.CPU43.LOC:Local_timer_interrupts 5955 ± 8% -11.3% 5285 ± 5% interrupts.CPU44.CAL:Function_call_interrupts 1137594 -12.7% 993238 ± 3% interrupts.CPU44.LOC:Local_timer_interrupts 7160 ± 24% -27.2% 5214 ± 7% interrupts.CPU45.CAL:Function_call_interrupts 1138234 -12.7% 994085 ± 3% interrupts.CPU45.LOC:Local_timer_interrupts 5986 ± 6% -11.8% 5280 ± 5% interrupts.CPU46.CAL:Function_call_interrupts 1139746 -12.8% 993920 ± 3% interrupts.CPU46.LOC:Local_timer_interrupts 7142 ± 28% -28.5% 5107 ± 7% interrupts.CPU47.CAL:Function_call_interrupts 1141307 -12.8% 994894 ± 2% interrupts.CPU47.LOC:Local_timer_interrupts 6040 ± 7% -38.7% 3703 ± 64% interrupts.CPU48.CAL:Function_call_interrupts 1137670 -10.5% 1018124 interrupts.CPU48.LOC:Local_timer_interrupts 6037 ± 7% -13.2% 5238 ± 5% interrupts.CPU49.CAL:Function_call_interrupts 1137656 -10.7% 1015360 interrupts.CPU49.LOC:Local_timer_interrupts 6034 ± 7% -12.2% 5295 ± 4% interrupts.CPU5.CAL:Function_call_interrupts 1137625 -10.6% 1016994 interrupts.CPU5.LOC:Local_timer_interrupts 6033 ± 7% -12.9% 5257 ± 4% interrupts.CPU50.CAL:Function_call_interrupts 1137857 -10.1% 1022699 interrupts.CPU50.LOC:Local_timer_interrupts 6036 ± 7% -12.5% 5281 ± 5% interrupts.CPU51.CAL:Function_call_interrupts 1137606 -10.5% 1017724 interrupts.CPU51.LOC:Local_timer_interrupts 6036 ± 7% -12.7% 5272 ± 5% interrupts.CPU52.CAL:Function_call_interrupts 1137591 -10.7% 1015660 interrupts.CPU52.LOC:Local_timer_interrupts 6034 ± 7% -12.7% 5266 ± 5% interrupts.CPU53.CAL:Function_call_interrupts 1137615 -10.7% 1015635 interrupts.CPU53.LOC:Local_timer_interrupts 1420 ±167% -97.3% 37.67 ± 28% interrupts.CPU53.RES:Rescheduling_interrupts 6032 ± 7% -12.6% 5269 ± 5% interrupts.CPU54.CAL:Function_call_interrupts 1137633 -10.7% 1015923 interrupts.CPU54.LOC:Local_timer_interrupts 6028 ± 7% -12.7% 5264 ± 5% interrupts.CPU55.CAL:Function_call_interrupts 1137542 -10.7% 1015527 interrupts.CPU55.LOC:Local_timer_interrupts 6028 ± 7% -12.2% 5294 ± 6% interrupts.CPU56.CAL:Function_call_interrupts 1137588 -10.7% 1015879 interrupts.CPU56.LOC:Local_timer_interrupts 6026 ± 7% -10.6% 5386 ± 4% interrupts.CPU57.CAL:Function_call_interrupts 1138610 -10.7% 1016655 interrupts.CPU57.LOC:Local_timer_interrupts 157.75 ± 95% -74.9% 39.67 ± 48% interrupts.CPU57.RES:Rescheduling_interrupts 6030 ± 7% -11.0% 5366 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 1143109 -11.1% 1015690 interrupts.CPU58.LOC:Local_timer_interrupts 6023 ± 7% -10.6% 5383 ± 4% interrupts.CPU59.CAL:Function_call_interrupts 1138041 -10.7% 1015709 interrupts.CPU59.LOC:Local_timer_interrupts 6006 ± 7% -13.9% 5168 ± 6% interrupts.CPU6.CAL:Function_call_interrupts 1140328 -10.7% 1018510 interrupts.CPU6.LOC:Local_timer_interrupts 6018 ± 7% -10.8% 5369 ± 4% interrupts.CPU60.CAL:Function_call_interrupts 1137539 -10.7% 1015845 interrupts.CPU60.LOC:Local_timer_interrupts 6017 ± 7% -10.7% 5375 ± 4% interrupts.CPU61.CAL:Function_call_interrupts 1137720 -10.7% 1015686 interrupts.CPU61.LOC:Local_timer_interrupts 6023 ± 7% -10.7% 5376 ± 4% interrupts.CPU62.CAL:Function_call_interrupts 1137739 -10.7% 1015682 interrupts.CPU62.LOC:Local_timer_interrupts 5946 ± 6% -9.9% 5355 ± 4% interrupts.CPU63.CAL:Function_call_interrupts 1137888 -10.7% 1015571 interrupts.CPU63.LOC:Local_timer_interrupts 6041 ± 7% -27.6% 4372 ± 34% interrupts.CPU64.CAL:Function_call_interrupts 1137594 -10.5% 1017629 interrupts.CPU64.LOC:Local_timer_interrupts 6020 ± 7% -21.4% 4729 ± 20% interrupts.CPU65.CAL:Function_call_interrupts 1137738 -10.7% 1015599 interrupts.CPU65.LOC:Local_timer_interrupts 184.50 ± 21% +51.6% 279.67 ± 10% interrupts.CPU65.NMI:Non-maskable_interrupts 184.50 ± 21% +51.6% 279.67 ± 10% interrupts.CPU65.PMI:Performance_monitoring_interrupts 6019 ± 7% -11.3% 5341 ± 4% interrupts.CPU66.CAL:Function_call_interrupts 1137636 -10.6% 1017229 interrupts.CPU66.LOC:Local_timer_interrupts 6017 ± 7% -11.3% 5337 ± 4% interrupts.CPU67.CAL:Function_call_interrupts 1137765 -10.5% 1017790 interrupts.CPU67.LOC:Local_timer_interrupts 168.50 ± 20% +102.8% 341.67 ± 29% interrupts.CPU67.NMI:Non-maskable_interrupts 168.50 ± 20% +102.8% 341.67 ± 29% interrupts.CPU67.PMI:Performance_monitoring_interrupts 6012 ± 7% -11.2% 5337 ± 5% interrupts.CPU68.CAL:Function_call_interrupts 1137641 -10.7% 1015676 interrupts.CPU68.LOC:Local_timer_interrupts 0.25 ±173% +2.9e+05% 733.00 ±141% interrupts.CPU69.105:PCI-MSI.31981638-edge.i40e-eth0-TxRx-69 6016 ± 7% -11.3% 5334 ± 5% interrupts.CPU69.CAL:Function_call_interrupts 1137611 -10.7% 1015774 interrupts.CPU69.LOC:Local_timer_interrupts 498.25 ± 2% -10.9% 444.00 interrupts.CPU7.35:PCI-MSI.31981568-edge.i40e-0000:3d:00.0:misc 1138138 -10.7% 1015885 interrupts.CPU7.LOC:Local_timer_interrupts 6010 ± 7% -11.3% 5329 ± 4% interrupts.CPU70.CAL:Function_call_interrupts 1137598 -10.5% 1018147 interrupts.CPU70.LOC:Local_timer_interrupts 0.25 ±173% +2.9e+05% 733.33 ±140% interrupts.CPU71.107:PCI-MSI.31981640-edge.i40e-eth0-TxRx-71 6004 ± 7% -11.4% 5321 ± 4% interrupts.CPU71.CAL:Function_call_interrupts 1137627 -10.7% 1016150 interrupts.CPU71.LOC:Local_timer_interrupts 6010 ± 8% -12.6% 5254 ± 5% interrupts.CPU72.CAL:Function_call_interrupts 1138107 -12.4% 996826 ± 2% interrupts.CPU72.LOC:Local_timer_interrupts 1137801 -12.4% 997018 ± 2% interrupts.CPU73.LOC:Local_timer_interrupts 7072 ± 22% -24.4% 5346 ± 4% interrupts.CPU74.CAL:Function_call_interrupts 1137764 -12.4% 996847 ± 2% interrupts.CPU74.LOC:Local_timer_interrupts 7727 ± 34% -31.2% 5318 ± 4% interrupts.CPU75.CAL:Function_call_interrupts 1137593 -12.7% 993539 ± 3% interrupts.CPU75.LOC:Local_timer_interrupts 1137894 -12.7% 993146 ± 3% interrupts.CPU76.LOC:Local_timer_interrupts 276.50 ± 76% -83.0% 47.00 ± 62% interrupts.CPU76.RES:Rescheduling_interrupts 6051 ± 7% -12.3% 5308 ± 4% interrupts.CPU77.CAL:Function_call_interrupts 1138121 -12.6% 994804 ± 3% interrupts.CPU77.LOC:Local_timer_interrupts 61.75 ± 58% -75.7% 15.00 ± 87% interrupts.CPU77.TLB:TLB_shootdowns 8453 ± 48% -37.2% 5312 ± 4% interrupts.CPU78.CAL:Function_call_interrupts 1137647 -12.5% 995101 ± 2% interrupts.CPU78.LOC:Local_timer_interrupts 6018 ± 8% -11.8% 5308 ± 4% interrupts.CPU79.CAL:Function_call_interrupts 1137522 -12.5% 995773 ± 2% interrupts.CPU79.LOC:Local_timer_interrupts 5955 ± 7% -11.1% 5295 ± 4% interrupts.CPU8.CAL:Function_call_interrupts 1137722 -10.7% 1016421 interrupts.CPU8.LOC:Local_timer_interrupts 6007 ± 7% -11.7% 5303 ± 4% interrupts.CPU80.CAL:Function_call_interrupts 1138055 -12.7% 993628 ± 3% interrupts.CPU80.LOC:Local_timer_interrupts 6092 ± 9% -13.0% 5302 ± 4% interrupts.CPU81.CAL:Function_call_interrupts 1137644 -12.4% 996710 ± 2% interrupts.CPU81.LOC:Local_timer_interrupts 5946 ± 7% -10.9% 5297 ± 4% interrupts.CPU82.CAL:Function_call_interrupts 1137703 -12.6% 994872 ± 2% interrupts.CPU82.LOC:Local_timer_interrupts 5982 ± 7% -11.5% 5296 ± 4% interrupts.CPU83.CAL:Function_call_interrupts 1138254 -12.6% 994421 ± 3% interrupts.CPU83.LOC:Local_timer_interrupts 50.00 ± 31% +1010.7% 555.33 ± 79% interrupts.CPU83.RES:Rescheduling_interrupts 6002 ± 8% -11.8% 5296 ± 4% interrupts.CPU84.CAL:Function_call_interrupts 1137779 -12.3% 997432 ± 2% interrupts.CPU84.LOC:Local_timer_interrupts 5926 ± 7% -12.5% 5185 ± 6% interrupts.CPU85.CAL:Function_call_interrupts 1137833 -12.4% 996457 ± 2% interrupts.CPU85.LOC:Local_timer_interrupts 5985 ± 7% -11.1% 5318 ± 4% interrupts.CPU86.CAL:Function_call_interrupts 1137602 -12.6% 994471 ± 3% interrupts.CPU86.LOC:Local_timer_interrupts 5982 ± 8% -11.6% 5291 ± 4% interrupts.CPU87.CAL:Function_call_interrupts 1137704 -12.4% 996936 ± 2% interrupts.CPU87.LOC:Local_timer_interrupts 5974 ± 8% -13.3% 5179 ± 6% interrupts.CPU88.CAL:Function_call_interrupts 1138067 -12.6% 994733 ± 3% interrupts.CPU88.LOC:Local_timer_interrupts 5992 ± 8% -11.7% 5291 ± 4% interrupts.CPU89.CAL:Function_call_interrupts 1137896 -12.7% 993477 ± 3% interrupts.CPU89.LOC:Local_timer_interrupts 1672 ±169% -99.1% 15.00 ±141% interrupts.CPU9.45:PCI-MSI.31981578-edge.i40e-eth0-TxRx-9 1137990 -10.6% 1017158 interrupts.CPU9.LOC:Local_timer_interrupts 5969 ± 7% -11.6% 5279 ± 4% interrupts.CPU90.CAL:Function_call_interrupts 1137857 -12.3% 998427 ± 2% interrupts.CPU90.LOC:Local_timer_interrupts 6820 ± 26% -22.7% 5273 ± 5% interrupts.CPU91.CAL:Function_call_interrupts 1141483 -12.8% 995534 ± 2% interrupts.CPU91.LOC:Local_timer_interrupts 5964 ± 7% -11.5% 5278 ± 4% interrupts.CPU92.CAL:Function_call_interrupts 1140985 -12.9% 993543 ± 3% interrupts.CPU92.LOC:Local_timer_interrupts 5967 ± 7% -11.8% 5265 ± 5% interrupts.CPU93.CAL:Function_call_interrupts 1138445 -12.7% 993978 ± 3% interrupts.CPU93.LOC:Local_timer_interrupts 6026 ± 6% -12.6% 5264 ± 5% interrupts.CPU94.CAL:Function_call_interrupts 1137854 -12.7% 993895 ± 3% interrupts.CPU94.LOC:Local_timer_interrupts 6014 ± 6% -13.9% 5177 ± 5% interrupts.CPU95.CAL:Function_call_interrupts 1137645 -12.5% 995297 ± 2% interrupts.CPU95.LOC:Local_timer_interrupts 1.093e+08 -11.6% 96587878 interrupts.LOC:Local_timer_interrupts 49537 ± 12% -38.3% 30559 ± 13% interrupts.RES:Rescheduling_interrupts *************************************************************************************************** lkp-csl-2sp5: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory ========================================================================================= bs/compiler/cpufreq_governor/direct/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode: 4k/gcc-7/performance/direct/1HDD/btrfs/sync/x86_64-rhel-7.6/1/debian-x86_64-2019-11-14.cgz/300s/write/lkp-csl-2sp5/128G/fio-basic/0x500002c commit: v5.4 c6bbf24815 ("btrfs: space-info: Make over-commit threshold to 87.5% of a new chunk") v5.4 c6bbf24815f95a4928984ff16a9 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 1:7 -14% :4 dmesg.WARNING:at_ip__fsnotify_parent/0x 2:7 -29% :4 dmesg.WARNING:stack_recursion %stddev %change %stddev \ | \ 0.71 -0.1 0.65 ± 5% fio.latency_250us% 0.01 +0.0 0.03 fio.latency_4ms% 25.87 +2.6% 26.54 ± 2% boot-time.boot 52.22 ±234% -97.0% 1.59 ±141% iostat.sdb.r_await.max 613.14 ± 42% -96.2% 23.33 ± 2% meminfo.Buffers 126222 ± 14% -27.2% 91885 ± 12% numa-meminfo.node0.SUnreclaim 165285 ± 11% -20.2% 131864 ± 12% numa-meminfo.node0.Slab 702.71 ±105% +286.7% 2717 ± 9% numa-meminfo.node1.Inactive(file) 63.86 ± 3% -7.6% 59.00 ± 3% turbostat.Avg_MHz 3.61 ± 6% -0.5 3.14 ± 4% turbostat.Busy% 0.85 ± 13% -0.1 0.75 ± 2% turbostat.C1% 66077 ± 2% -4.9% 62834 ± 2% vmstat.io.bo 610.71 ± 42% -96.2% 23.00 vmstat.memory.buff 65832 ± 2% -5.0% 62534 ± 2% vmstat.system.cs 31522 ± 14% -27.1% 22969 ± 12% numa-vmstat.node0.nr_slab_unreclaimable 175.43 ±105% +287.6% 680.00 ± 9% numa-vmstat.node1.nr_inactive_file 13780 ±115% +205.8% 42142 ± 5% numa-vmstat.node1.nr_written 175.43 ±105% +287.6% 680.00 ± 9% numa-vmstat.node1.nr_zone_inactive_file 105921 -1.9% 103959 proc-vmstat.nr_inactive_anon 107849 -1.8% 105906 proc-vmstat.nr_mapped 107294 -1.8% 105341 proc-vmstat.nr_shmem 55166 -3.3% 53371 proc-vmstat.nr_slab_unreclaimable 105921 -1.9% 103959 proc-vmstat.nr_zone_inactive_anon 1402438 -3.8% 1349735 proc-vmstat.numa_hit 1371233 -3.8% 1318441 proc-vmstat.numa_local 1630186 -5.0% 1548152 proc-vmstat.pgalloc_normal 892627 +1.6% 906510 proc-vmstat.pgfault 61277 ± 26% -27.5% 44445 softirqs.CPU0.SCHED 40467 ± 5% +63.9% 66317 ± 23% softirqs.CPU1.SCHED 39555 ± 5% -7.4% 36631 ± 2% softirqs.CPU17.SCHED 8013 ±100% +326.6% 34184 ± 56% softirqs.CPU33.BLOCK 39730 ± 3% -12.5% 34771 ± 4% softirqs.CPU63.SCHED 134029 ± 19% -30.2% 93550 ± 3% softirqs.CPU65.TIMER 133366 ± 19% -30.5% 92690 ± 4% softirqs.CPU69.TIMER 5725 ±196% +1558.7% 94961 ± 73% softirqs.CPU86.BLOCK 121838 ± 15% +20.5% 146865 softirqs.CPU92.TIMER 116388 ± 17% +25.8% 146433 softirqs.CPU93.TIMER 160639 ± 20% +18.8% 190856 ± 10% sched_debug.cfs_rq:/.load.stddev 4786 ± 13% -20.7% 3796 sched_debug.cfs_rq:/.min_vruntime.stddev 0.01 ±105% +878.8% 0.09 ± 66% sched_debug.cfs_rq:/.nr_spread_over.avg 0.05 ±100% +300.1% 0.20 ± 54% sched_debug.cfs_rq:/.nr_spread_over.stddev 160570 ± 20% +18.8% 190812 ± 10% sched_debug.cfs_rq:/.runnable_weight.stddev 4786 ± 13% -20.6% 3799 sched_debug.cfs_rq:/.spread0.stddev 181393 +9.8% 199237 ± 6% sched_debug.cpu.clock.avg 181397 +9.8% 199240 ± 6% sched_debug.cpu.clock.max 181389 +9.8% 199233 ± 6% sched_debug.cpu.clock.min 181393 +9.8% 199237 ± 6% sched_debug.cpu.clock_task.avg 181397 +9.8% 199240 ± 6% sched_debug.cpu.clock_task.max 181389 +9.8% 199233 ± 6% sched_debug.cpu.clock_task.min 0.00 ± 14% -20.0% 0.00 ± 14% sched_debug.cpu.next_balance.stddev 607253 ± 27% -46.9% 322592 ± 17% sched_debug.cpu.ttwu_local.max 67736 ± 15% -21.3% 53336 ± 4% sched_debug.cpu.ttwu_local.stddev 181390 +9.8% 199234 ± 6% sched_debug.cpu_clk 178524 +10.0% 196362 ± 6% sched_debug.ktime 181721 +9.8% 199581 ± 6% sched_debug.sched_clk 5632 +9.9% 6191 slabinfo.Acpi-State.active_objs 5632 +9.9% 6191 slabinfo.Acpi-State.num_objs 5534 ± 16% -27.6% 4009 ± 6% slabinfo.avc_xperms_data.active_objs 5534 ± 16% -27.6% 4009 ± 6% slabinfo.avc_xperms_data.num_objs 5132 ± 24% -72.7% 1402 ± 3% slabinfo.blkdev_ioc.active_objs 5133 ± 24% -72.7% 1402 ± 3% slabinfo.blkdev_ioc.num_objs 294321 -10.3% 264046 slabinfo.btrfs_extent_map.active_objs 5287 -10.8% 4717 slabinfo.btrfs_extent_map.active_slabs 296114 -10.8% 264228 slabinfo.btrfs_extent_map.num_objs 5287 -10.8% 4717 slabinfo.btrfs_extent_map.num_slabs 791.00 ± 48% +92.5% 1522 ± 7% slabinfo.dio.active_objs 791.00 ± 48% +92.5% 1522 ± 7% slabinfo.dio.num_objs 37938 -83.3% 6322 ± 12% slabinfo.khugepaged_mm_slot.active_objs 1102 -83.6% 180.67 ± 11% slabinfo.khugepaged_mm_slot.active_slabs 39703 -83.6% 6528 ± 11% slabinfo.khugepaged_mm_slot.num_objs 1102 -83.6% 180.67 ± 11% slabinfo.khugepaged_mm_slot.num_slabs 4110 ± 6% +15.1% 4731 ± 6% slabinfo.kmalloc-rcl-64.active_objs 4110 ± 6% +15.1% 4731 ± 6% slabinfo.kmalloc-rcl-64.num_objs 2179 ± 19% +49.5% 3258 ± 18% slabinfo.mnt_cache.active_objs 2347 ± 17% +41.2% 3314 ± 16% slabinfo.mnt_cache.num_objs 11.74 ± 41% -42.3% 6.78 ± 18% perf-stat.i.MPKI 7818641 ± 25% -30.9% 5404611 ± 9% perf-stat.i.branch-misses 33116824 ± 36% -43.9% 18563518 ± 5% perf-stat.i.cache-references 66775 ± 2% -5.0% 63430 ± 2% perf-stat.i.context-switches 5.239e+09 ± 4% -7.2% 4.861e+09 ± 4% perf-stat.i.cpu-cycles 0.08 ± 45% -0.1 0.01 ±111% perf-stat.i.dTLB-load-miss-rate% 602366 ± 43% -90.5% 57285 ± 84% perf-stat.i.dTLB-load-misses 0.02 ± 43% -0.0 0.00 ± 85% perf-stat.i.dTLB-store-miss-rate% 92649 ± 41% -85.9% 13098 ± 48% perf-stat.i.dTLB-store-misses 0.59 ± 4% +6.0% 0.63 ± 4% perf-stat.i.ipc 48349 ± 14% -33.4% 32207 ± 6% perf-stat.i.node-loads 41360 ± 22% -50.5% 20490 ± 12% perf-stat.i.node-stores 10.73 ± 39% -43.4% 6.08 ± 5% perf-stat.overall.MPKI 0.07 ± 45% -0.1 0.01 ± 85% perf-stat.overall.dTLB-load-miss-rate% 0.02 ± 43% -0.0 0.00 ± 50% perf-stat.overall.dTLB-store-miss-rate% 81.49 ± 13% +11.8 93.29 perf-stat.overall.node-load-miss-rate% 7792742 ± 25% -30.9% 5386905 ± 9% perf-stat.ps.branch-misses 33006764 ± 36% -43.9% 18503075 ± 5% perf-stat.ps.cache-references 66549 ± 2% -5.0% 63217 ± 2% perf-stat.ps.context-switches 5.222e+09 ± 4% -7.2% 4.845e+09 ± 4% perf-stat.ps.cpu-cycles 600392 ± 43% -90.5% 57131 ± 84% perf-stat.ps.dTLB-load-misses 92345 ± 41% -85.9% 13061 ± 48% perf-stat.ps.dTLB-store-misses 48187 ± 14% -33.4% 32102 ± 6% perf-stat.ps.node-loads 41222 ± 22% -50.5% 20424 ± 12% perf-stat.ps.node-stores 49.32 ± 3% -3.8 45.52 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 1.11 ± 6% -0.2 0.95 ± 4% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 0.73 ± 15% +0.2 0.95 ± 14% perf-profile.calltrace.cycles-pp.btrfs_create_dio_extent.btrfs_get_blocks_direct.do_blockdev_direct_IO.btrfs_direct_IO.generic_file_direct_write 0.17 ±158% +0.4 0.61 ± 12% perf-profile.calltrace.cycles-pp.__blk_mq_delay_run_hw_queue.blk_mq_run_hw_queue.blk_mq_sched_insert_requests.blk_mq_flush_plug_list.blk_flush_plug_list 0.18 ±158% +0.5 0.65 ± 9% perf-profile.calltrace.cycles-pp.blk_mq_run_hw_queue.blk_mq_sched_insert_requests.blk_mq_flush_plug_list.blk_flush_plug_list.blk_finish_plug 3.54 ± 17% +2.2 5.72 ± 34% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 49.56 ± 3% -3.8 45.71 ± 2% perf-profile.children.cycles-pp.intel_idle 1.14 ± 7% -0.1 0.99 ± 3% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.33 ± 4% -0.1 0.27 ± 10% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.24 ± 22% -0.0 0.19 ± 2% perf-profile.children.cycles-pp.interrupt_entry 0.19 ± 11% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.nr_iowait_cpu 0.08 ± 23% +0.0 0.10 ± 9% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.04 ± 64% +0.0 0.07 ± 17% perf-profile.children.cycles-pp.alloc_extent_map 0.08 ± 17% +0.0 0.12 perf-profile.children.cycles-pp.btrfs_tree_lock 0.12 ± 14% +0.0 0.16 ± 6% perf-profile.children.cycles-pp.btrfs_lock_root_node 0.06 ± 19% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.start_transaction 0.19 ± 25% +0.0 0.23 ± 10% perf-profile.children.cycles-pp.generic_make_request 0.01 ±244% +0.0 0.06 ± 8% perf-profile.children.cycles-pp.join_transaction 0.14 ± 13% +0.0 0.19 ± 5% perf-profile.children.cycles-pp.leaf_space_used 0.01 ±244% +0.1 0.06 ± 13% perf-profile.children.cycles-pp.fill_stack_inode_item 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.btrfs_dec_block_group_reservations 0.02 ±118% +0.1 0.10 ± 48% perf-profile.children.cycles-pp.blk_mq_get_tag 0.41 ± 13% +0.1 0.53 ± 8% perf-profile.children.cycles-pp.btrfs_lookup_file_extent 0.45 ± 22% +0.2 0.61 ± 12% perf-profile.children.cycles-pp.__blk_mq_delay_run_hw_queue 0.45 ± 22% +0.2 0.61 ± 11% perf-profile.children.cycles-pp.blk_mq_sched_dispatch_requests 0.45 ± 22% +0.2 0.61 ± 12% perf-profile.children.cycles-pp.__blk_mq_run_hw_queue 0.43 ± 20% +0.2 0.60 ± 12% perf-profile.children.cycles-pp.blk_mq_do_dispatch_sched 0.50 ± 21% +0.2 0.69 ± 8% perf-profile.children.cycles-pp.blk_mq_run_hw_queue 0.73 ± 15% +0.2 0.95 ± 14% perf-profile.children.cycles-pp.btrfs_create_dio_extent 3.56 ± 17% +2.2 5.78 ± 34% perf-profile.children.cycles-pp.poll_idle 49.50 ± 3% -3.8 45.70 ± 2% perf-profile.self.cycles-pp.intel_idle 0.23 ± 19% -0.0 0.19 ± 2% perf-profile.self.cycles-pp.interrupt_entry 0.18 ± 12% -0.0 0.15 ± 6% perf-profile.self.cycles-pp.nr_iowait_cpu 0.05 ± 44% +0.0 0.08 ± 16% perf-profile.self.cycles-pp.unlock_up 0.03 ± 87% +0.0 0.07 ± 7% perf-profile.self.cycles-pp.__account_scheduler_latency 0.03 ± 87% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.free_extent_state 3.20 ± 19% +2.1 5.33 ± 35% perf-profile.self.cycles-pp.poll_idle 4.29 ±209% +2785.6% 123.67 ±113% interrupts.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34 173.71 ±158% +256.1% 618.67 interrupts.9:IO-APIC.9-fasteoi.acpi 173.71 ±158% +256.1% 618.67 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi 1485 ±119% +3809.6% 58057 ± 54% interrupts.CPU1.RES:Rescheduling_interrupts 99.57 ±236% +15984.3% 16015 ±122% interrupts.CPU13.RES:Rescheduling_interrupts 166.86 ± 12% +70.0% 283.67 ± 37% interrupts.CPU23.NMI:Non-maskable_interrupts 166.86 ± 12% +70.0% 283.67 ± 37% interrupts.CPU23.PMI:Performance_monitoring_interrupts 484.29 ± 92% -68.1% 154.33 ± 43% interrupts.CPU25.NMI:Non-maskable_interrupts 484.29 ± 92% -68.1% 154.33 ± 43% interrupts.CPU25.PMI:Performance_monitoring_interrupts 19154 ± 83% +275.2% 71861 ± 53% interrupts.CPU33.CAL:Function_call_interrupts 4.14 ±216% +2869.0% 123.00 ±114% interrupts.CPU34.70:PCI-MSI.31981603-edge.i40e-eth0-TxRx-34 42.71 ±203% +877.0% 417.33 ± 66% interrupts.CPU35.RES:Rescheduling_interrupts 221.71 ± 23% -42.9% 126.67 ± 11% interrupts.CPU39.NMI:Non-maskable_interrupts 221.71 ± 23% -42.9% 126.67 ± 11% interrupts.CPU39.PMI:Performance_monitoring_interrupts 339.43 ± 75% -66.8% 112.67 ± 5% interrupts.CPU41.NMI:Non-maskable_interrupts 339.43 ± 75% -66.8% 112.67 ± 5% interrupts.CPU41.PMI:Performance_monitoring_interrupts 458.86 ±133% -73.6% 121.33 ± 8% interrupts.CPU42.NMI:Non-maskable_interrupts 458.86 ±133% -73.6% 121.33 ± 8% interrupts.CPU42.PMI:Performance_monitoring_interrupts 302.43 ± 66% -59.5% 122.33 ± 7% interrupts.CPU43.NMI:Non-maskable_interrupts 302.43 ± 66% -59.5% 122.33 ± 7% interrupts.CPU43.PMI:Performance_monitoring_interrupts 237.57 ± 29% -49.9% 119.00 ± 12% interrupts.CPU44.NMI:Non-maskable_interrupts 237.57 ± 29% -49.9% 119.00 ± 12% interrupts.CPU44.PMI:Performance_monitoring_interrupts 216.29 ± 22% -50.5% 107.00 ± 4% interrupts.CPU45.NMI:Non-maskable_interrupts 216.29 ± 22% -50.5% 107.00 ± 4% interrupts.CPU45.PMI:Performance_monitoring_interrupts 218.29 ± 27% -44.0% 122.33 ± 11% interrupts.CPU46.NMI:Non-maskable_interrupts 218.29 ± 27% -44.0% 122.33 ± 11% interrupts.CPU46.PMI:Performance_monitoring_interrupts 223.14 ± 21% -51.2% 109.00 ± 7% interrupts.CPU47.NMI:Non-maskable_interrupts 223.14 ± 21% -51.2% 109.00 ± 7% interrupts.CPU47.PMI:Performance_monitoring_interrupts 348.71 ±153% -94.2% 20.33 ± 61% interrupts.CPU47.RES:Rescheduling_interrupts 1172 ±122% -88.8% 131.00 ±140% interrupts.CPU48.RES:Rescheduling_interrupts 324.71 ±102% -57.6% 137.67 ± 25% interrupts.CPU53.NMI:Non-maskable_interrupts 324.71 ±102% -57.6% 137.67 ± 25% interrupts.CPU53.PMI:Performance_monitoring_interrupts 705.14 ±241% -100.0% 0.33 ±141% interrupts.CPU64.RES:Rescheduling_interrupts 68.29 ± 46% -57.5% 29.00 ± 30% interrupts.CPU65.TLB:TLB_shootdowns 160.86 ± 25% +91.1% 307.33 ± 28% interrupts.CPU71.NMI:Non-maskable_interrupts 160.86 ± 25% +91.1% 307.33 ± 28% interrupts.CPU71.PMI:Performance_monitoring_interrupts 6.29 ±101% +1411.4% 95.00 ±104% interrupts.CPU71.RES:Rescheduling_interrupts 8200 ± 91% +1836.1% 158759 ± 71% interrupts.CPU85.CAL:Function_call_interrupts 14581 ±154% +1226.5% 193422 ± 72% interrupts.CPU86.CAL:Function_call_interrupts Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

2 years, 5 months

2
1
0 / 0

Re: [PATCH] x86/pat: Fix off-by-one bugs in interval tree search

by Ingo Molnar

* Kenneth R. Crudup <kenny(a)panix.com> wrote: > > > write-combining @ 0x604a800000-0x604b000000 > > > uncached-minus @ 0x604b100000-0x604b110000 > > > This WC region was probably unaffected by the bug. > > For my education, and for completeness' sake, is there a proc/sys entry > that would tell me which device/module has reserved which PAT region? Not that I know of :-/ I suspect you could run the attached patch and run: dmesg | grep -i 'x86/pat' To see all the ioremap() activities, with a symbolic name of the caller printed. I'm quite sure 0x604a800000 will be among them, pointing to somewhere like i915_vma_pin_iomap(), ggtt_init_hw() or ggtt_probe_common() in the i915 GPU driver? Another possibility is that this is the FB framebuffer, mapped by efifb_probe() or so? Patch is untested though. :-) Thanks, Ingo =================> arch/x86/mm/ioremap.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/arch/x86/mm/ioremap.c b/arch/x86/mm/ioremap.c index 1ff9c2030b4f..2f0a4f99471a 100644 --- a/arch/x86/mm/ioremap.c +++ b/arch/x86/mm/ioremap.c @@ -166,6 +166,8 @@ __ioremap_caller(resource_size_t phys_addr, unsigned long size, int retval; void __iomem *ret_addr; + printk("# x86/pat: ioremap(%016Lx, %08lx, pcm: %d), caller: %pS\n", phys_addr, size, pcm, caller); + /* Don't allow wraparound or zero size */ last_addr = phys_addr + size - 1; if (!size || last_addr < phys_addr)

2 years, 5 months

1
0
0 / 0

Re: [PATCH] x86/pat: Fix off-by-one bugs in interval tree search

by Ingo Molnar

* Kenneth R. Crudup <kenny(a)panix.com> wrote: > > On Sun, 1 Dec 2019, Ingo Molnar wrote: > > > So it would be nice if everyone who is seeing this bug could test the > > patch below against Linus's latest tree - does it fix the regression? > > The patch fixes the issue for me. Great, thanks! > > If not then please send the before/after dump of > > /sys/kernel/debug/x86/pat_memtype_list - and even if it works please send > > the dumps so we can double check it all. > > I don't have the "before patch" (but could if it is absolutely needed) but > here's the "after patch": > uncached-minus @ 0xfed91000-0xfed92000 > uncached-minus @ 0xff340000-0xff341000 > write-combining @ 0x4000000000-0x4010000000 > uncached-minus @ 0x4010000000-0x4010001000 I believe this is the region that caused the problem, the 0x4010000000 'end' address of the WC region is the same as the 0x4010000000 'start' address of the UC- region that follows it. > write-combining @ 0x604a800000-0x604b000000 > uncached-minus @ 0x604b100000-0x604b110000 This WC region was probably unaffected by the bug. Thanks, Ingo

2 years, 5 months

1
0
0 / 0