September 2019 - LKP - Ml01.01.Org

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 3878a5a0e442b2e8111d65dee5b29c1ac14bb829 ("xfs: repair damaged symlinks") https://kernel.googlesource.com/pub/scm/linux/kernel/git/djwong/xfs-linux... rough-fixes in testcase: xfstests with following parameters: disk: 4HDD fs: xfs test: xfs-group17 test-description: xfstests is a regression test suite for xfs and other files ystems. test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +------------------------------------------------+------------+------------+ | | d54d20e33a | 3878a5a0e4 | +------------------------------------------------+------------+------------+ | boot_successes | 256 | 357 | | boot_failures | 4 | 15 | | Mem-Info | 1 | | | invoked_oom-killer:gfp_mask=0x | 1 | | | BUG:soft_lockup-CPU##stuck_for#s | 1 | | | RIP:__memcpy | 1 | | | Kernel_panic-not_syncing:softlockup:hung_tasks | 1 | | | BUG:unable_to_handle_page_fault_for_address | 1 | | | Oops:#[##] | 1 | | | Kernel_panic-not_syncing:Fatal_exception | 1 | 13 | | BUG:kernel_hang_in_boot_stage | 1 | 2 | | Assertion_failed | 0 | 13 | | kernel_BUG_at_fs/xfs/xfs_message.c | 0 | 13 | | invalid_opcode:#[##] | 0 | 13 | | RIP:assfail[xfs] | 0 | 13 | +------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 137.972384] XFS (vdd): Corruption not fixed during online repair. Unmount and run xfs_repair. [ 137.975454] XFS (vdd): Injecting error (false) at file fs/xfs/scrub/scrub.c, line 527, on filesystem "vdd" [ 137.981275] XFS (vdd): Corruption not fixed during online repair. Unmount and run xfs_repair. [ 137.986341] XFS (vdd): Corruption not fixed during online repair. Unmount and run xfs_repair. [ 137.989482] XFS (vdd): Corruption not fixed during online repair. Unmount and run xfs_repair. [ 138.170199] XFS: Assertion failed: !(ip->i_df.if_flags & XFS_IFINLINE), file: fs/xfs/xfs_symlink.c, line: 116 [ 138.174302] ------------[ cut here ]------------ [ 138.175994] kernel BUG at fs/xfs/xfs_message.c:102! [ 138.177531] invalid opcode: 0000 [#1] SMP PTI [ 138.179143] CPU: 0 PID: 7162 Comm: fsstress Not tainted 5.3.0-rc7-00062-g3878a5a0e442b #1 [ 138.181642] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 138.183655] RIP: 0010:assfail+0x34/0x40 [xfs] [ 138.185016] Code: d0 48 c7 c6 d0 73 52 c0 48 89 fa 31 ff e8 54 f9 ff ff 80 3d 11 ca 0e 00 00 75 0f 48 c7 c7 00 74 52 c0 e8 bd d5 c4 ec 0f 0b c3 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 63 f6 6a 01 [ 138.188873] RSP: 0018:ffffacbbc0d2fe40 EFLAGS: 00010202 [ 138.190373] RAX: 0000000000000000 RBX: ffff8c80f6185c00 RCX: 0000000000000000 [ 138.192003] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc051980c [ 138.193660] RBP: ffff8c80f5dffd80 R08: 0000000000000000 R09: 0000000000000000 [ 138.195511] R10: ffffacbbc0d2fee0 R11: f000000000000000 R12: ffff8c80facfc000 [ 138.197117] R13: ffff8c80ffc1f000 R14: 0000000000001000 R15: 00007fff24a2ad30 [ 138.198871] FS: 00007fce14a08b40(0000) GS:ffff8c81bfc00000(0000) knlGS:0000000000000000 [ 138.201052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 138.202660] CR2: 00007fce13b1f000 CR3: 0000000073d3a000 CR4: 00000000000406f0 [ 138.204361] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 138.206115] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 138.207791] Call Trace: [ 138.208873] xfs_readlink+0xd3/0x140 [xfs] [ 138.210243] xfs_vn_get_link+0x50/0xa0 [xfs] [ 138.211566] vfs_readlink+0x65/0x120 [ 138.212745] do_readlinkat+0xfd/0x120 [ 138.213998] __x64_sys_readlink+0x1b/0x20 [ 138.215228] do_syscall_64+0x5b/0x1f0 [ 138.216365] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 138.217709] RIP: 0033:0x7fce13f09087 [ 138.218910] Code: 73 01 c3 48 8b 0d 11 be 2b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 59 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e1 bd 2b 00 f7 d8 64 89 01 48 [ 138.222747] RSP: 002b:00007fff24a2abb8 EFLAGS: 00000206 ORIG_RAX: 0000000000000059 [ 138.224366] RAX: ffffffffffffffda RBX: 00007fff24a2ad20 RCX: 00007fce13f09087 [ 138.226053] RDX: 0000000000001000 RSI: 00007fff24a2ad30 RDI: 0000560c276ec1c0 [ 138.227699] RBP: 00000000000000c4 R08: 0000000000000020 R09: 00007fff24a2ad1c [ 138.229221] R10: 0000000000000078 R11: 0000000000000206 R12: 00007fff24a2ad30 [ 138.230860] R13: 0000000000001000 R14: 00007fff24a2bdb0 R15: 0000560c26da0d80 [ 138.232316] Modules linked in: sd_mod xfs libcrc32c dm_mod intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sr_mod cdrom sg ata_generic pata_acpi bochs_drm drm_vram_helper ttm ppdev drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops snd_pcm drm aesni_intel snd_timer snd crypto_simd ata_piix cryptd glue_helper joydev soundcore libata serio_raw pcspkr parport_pc i2c_piix4 parport floppy ip_tables [last unloaded: scsi_debug] [ 138.269956] ---[ end trace f9066920b78098c0 ]--- [ 138.271427] RIP: 0010:assfail+0x34/0x40 [xfs] [ 138.272821] Code: d0 48 c7 c6 d0 73 52 c0 48 89 fa 31 ff e8 54 f9 ff ff 80 3d 11 ca 0e 00 00 75 0f 48 c7 c7 00 74 52 c0 e8 bd d5 c4 ec 0f 0b c3 <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 63 f6 6a 01 [ 138.280369] RSP: 0018:ffffacbbc0d2fe40 EFLAGS: 00010202 [ 138.282278] RAX: 0000000000000000 RBX: ffff8c80f6185c00 RCX: 0000000000000000 [ 138.285382] RDX: 00000000ffffffc0 RSI: 000000000000000a RDI: ffffffffc051980c [ 138.287191] RBP: ffff8c80f5dffd80 R08: 0000000000000000 R09: 0000000000000000 [ 138.290672] R10: ffffacbbc0d2fee0 R11: f000000000000000 R12: ffff8c80facfc000 [ 138.292959] R13: ffff8c80ffc1f000 R14: 0000000000001000 R15: 00007fff24a2ad30 [ 138.296613] FS: 00007fce14a08b40(0000) GS:ffff8c81bfc00000(0000) knlGS:0000000000000000 [ 138.298468] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 138.301665] CR2: 00007fce13b1f000 CR3: 0000000073d3a000 CR4: 00000000000406f0 [ 138.304083] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 138.307384] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 138.309084] Kernel panic - not syncing: Fatal exception [ 138.310862] Kernel Offset: 0x2c000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) Elapsed time: 140 qemu-img create -f qcow2 disk-vm-snb-4G-c7bcc2fa9533-0 256G To reproduce: # build kernel cd linux cp config-5.3.0-rc7-00062-g3878a5a0e442b .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[tcp] 051ba67447: packetdrill.packetdrill/tests/linux/undo_undo-fr-ack-then-dsack-on-ack-below-snd_una.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 051ba67447de1294aaacc59752a37f72091d15ed ("tcp: force a PSH flag on TSO packets") https://kernel.googlesource.com/pub/scm/linux/kernel/git/davem/net-next.git master in testcase: packetdrill with following parameters: on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Running packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt ... 2019-09-14 09:57:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt:25: error handling packet: live packet payload: expected 1000 bytes vs actual 2000 bytes packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt failed Running packetdrill/tests/linux/blocking/blocking-accept.pkt ... 2019-09-14 09:57:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/blocking/blocking-accept.pkt packetdrill/tests/linux/blocking/blocking-accept.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100086 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/blocking/blocking-accept.pkt failed Running packetdrill/tests/linux/blocking/blocking-read.pkt ... 2019-09-14 09:57:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/blocking/blocking-read.pkt packetdrill/tests/linux/blocking/blocking-read.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100084 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/blocking/blocking-read.pkt failed Running packetdrill/tests/linux/close/close-read-data-fin.pkt ... 2019-09-14 09:57:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-read-data-fin.pkt packetdrill/tests/linux/close/close-read-data-fin.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100075 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-read-data-fin.pkt failed Running packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt ... 2019-09-14 09:57:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt:14: error handling packet: bad value outbound TCP option 3 script packet: 0.000141 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000134 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt failed Running packetdrill/tests/linux/close/close-unread-data-rst.pkt ... 2019-09-14 09:57:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-unread-data-rst.pkt packetdrill/tests/linux/close/close-unread-data-rst.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100161 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-unread-data-rst.pkt failed Running packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt ... 2019-09-14 09:57:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100085 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt ... 2019-09-14 09:57:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100174 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt ... 2019-09-14 09:57:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100112 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt ... 2019-09-14 09:57:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100116 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt ... 2019-09-14 09:57:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100181 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt ... 2019-09-14 09:57:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100083 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt ... 2019-09-14 09:57:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100649 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt failed Running packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt ... 2019-09-14 09:57:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100153 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt failed Running packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt ... 2019-09-14 09:57:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt pass Running packetdrill/tests/linux/icmp/icmp-all-types.pkt ... 2019-09-14 09:57:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/icmp/icmp-all-types.pkt packetdrill/tests/linux/icmp/icmp-all-types.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100127 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/icmp/icmp-all-types.pkt failed Running packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt ... 2019-09-14 09:57:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.000045 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000042 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt failed Running packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt ... 2019-09-14 09:57:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.000098 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000093 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt failed Running packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt ... 2019-09-14 09:57:10 packetdrill/packetdrill packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100203 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt failed Running packetdrill/tests/linux/initial_window/iw10-base-case.pkt ... 2019-09-14 09:57:10 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/initial_window/iw10-base-case.pkt packetdrill/tests/linux/initial_window/iw10-base-case.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100116 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/initial_window/iw10-base-case.pkt failed Running packetdrill/tests/linux/initial_window/iw10-short-response.pkt ... 2019-09-14 09:57:10 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/initial_window/iw10-short-response.pkt packetdrill/tests/linux/initial_window/iw10-short-response.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100164 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/initial_window/iw10-short-response.pkt failed Running packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt ... 2019-09-14 09:57:10 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt pass Running packetdrill/tests/linux/listen/listen-incoming-ack.pkt ... 2019-09-14 09:57:11 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-ack.pkt packetdrill/tests/linux/listen/listen-incoming-ack.pkt:17: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200138 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-ack.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt ... 2019-09-14 09:57:11 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt:18: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200143 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-rst.pkt ... 2019-09-14 09:57:11 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-rst.pkt packetdrill/tests/linux/listen/listen-incoming-rst.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200136 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-rst.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt ... 2019-09-14 09:57:12 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt:17: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200121 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt ... 2019-09-14 09:57:12 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200110 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt ... 2019-09-14 09:57:12 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100669 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt ... 2019-09-14 09:57:13 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100427 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt ... 2019-09-14 09:57:13 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.000181 S. 0:0(0) ack 1 <mss 1430,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000173 S. 0:0(0) ack 1 win 64350 <mss 1430,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt ... 2019-09-14 09:57:13 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.000079 S. 0:0(0) ack 1 <mss 1430,sackOK,TS val 0 ecr 0,nop,wscale 6> actual packet: 0.000075 S. 0:0(0) ack 1 win 65228 <mss 1430,sackOK,TS val 0 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt ... 2019-09-14 09:57:13 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt:13: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,sackOK,TS val 100 ecr 100,nop,wscale 6> actual packet: 0.100079 S. 0:0(0) ack 1 win 65160 <mss 1460,sackOK,TS val 100 ecr 100,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt ... 2019-09-14 09:57:13 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100138 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt failed Running packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt:14: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1100,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100459 S 0:0(0) win 64900 <mss 1100,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt failed Running packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1100,nop,wscale 6> actual packet: 0.100130 S. 0:0(0) ack 1 win 64900 <mss 1100,nop,wscale 7> packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt failed Running packetdrill/tests/linux/packetdrill/socket_err.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/packetdrill/socket_err.pkt packetdrill/tests/linux/packetdrill/socket_err.pkt:6: runtime error in socket call: Expected non-negative result but got -1 with errno 93 (Protocol not supported) packetdrill/tests/linux/packetdrill/socket_err.pkt failed Running packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt:4: runtime error in socket call: Expected result -99 but got -1 with errno 93 (Protocol not supported) packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt failed Running packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt:24: parse error at '1': syntax error packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt failed Running packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt:24: parse error at '1': syntax error packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt failed Running packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt ... 2019-09-14 09:57:14 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt:36: error handling packet: timing error: expected outbound packet at 0.300000 sec but happened at 0.340708 sec; tolerance 0.040000 sec script packet: 0.300000 . 1:1(0) ack 3001 <nop,nop,TS val 300 ecr 300> actual packet: 0.340708 . 1:1(0) ack 3001 win 3000 <nop,nop,TS val 340 ecr 300> packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt failed Running packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt ... 2019-09-14 09:57:15 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt:41: error handling packet: timing error: expected outbound packet at 0.300000 sec but happened at 0.340769 sec; tolerance 0.040000 sec script packet: 0.300000 . 1:1(0) ack 3001 actual packet: 0.340769 . 1:1(0) ack 3001 win 3000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt failed Running packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt ... 2019-09-14 09:57:15 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt pass Running packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt ... 2019-09-14 09:57:16 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt ... 2019-09-14 09:57:16 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt ... 2019-09-14 09:57:16 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt ... 2019-09-14 09:57:17 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt ... 2019-09-14 09:57:17 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt pass Running packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt ... 2019-09-14 09:57:17 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt:51: error handling packet: live packet field tcp_psh: expected: 0 (0x0) vs actual: 1 (0x1) script packet: 0.450000 . 11001:21001(10000) ack 1 actual packet: 0.450132 P. 11001:21001(10000) ack 1 win 69 packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt failed Running packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt ... 2019-09-14 09:57:17 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt:40: error handling packet: live packet field tcp_psh: expected: 0 (0x0) vs actual: 1 (0x1) script packet: 0.400000 . 10001:20001(10000) ack 1 actual packet: 0.400833 P. 10001:20001(10000) ack 1 win 69 packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt failed OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv4)] stdout: stderr: Ran 24 tests: 24 passing, 0 failing, 0 timed out (8.03 sec): tcp To reproduce: # build kernel cd linux cp config-5.3.0-rc7-01910-g051ba67447de1 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[md] cd25427701: mdadm-selftests.enchmarks/mdadm-selftests/tests/00multipath.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: cd25427701bbd4a659abf51f7589dd351b79c556 ("[PATCH v3 2/2] md: don't let spare disk become the fresh disk in analyze_sbs()") url: https://github.com/0day-ci/linux/commits/Yufen-Yu/skip-spare-disk-as-fres... in testcase: mdadm-selftests with following parameters: disk: 1HDD test_prefix: 00 on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Welcome to fdisk (util-linux 2.29.2). Changes will remain in memory only, until you decide to write them. Be careful before using the write command. Device does not contain a recognized partition table. Created a new DOS disklabel with disk identifier 0xbda7d249. Command (m for help): Partition type p primary (0 primary, 0 extended, 4 free) e extended (container for logical partitions) Select (default p): Partition number (1-4, default 1): First sector (2048-536870911, default 2048): Last sector, +sectors or +size{K,M,G,T,P} (2048-536870911, default 536870911): Created a new partition 1 of type 'Linux' and of size 5 GiB. Command (m for help): The partition table has been altered. Calling ioctl() to re-read partition table. Syncing disks. 2019-09-14 15:31:13 mkdir -p /var/tmp 2019-09-14 15:31:13 mke2fs -t ext3 -b 1024 -J size=1 -q /dev/vda1 2019-09-14 15:31:24 mount -t ext3 /dev/vda1 /var/tmp sed -e 's/{DEFAULT_METADATA}/1.2/g' \ -e 's,{MAP_PATH},/run/mdadm/map,g' mdadm.8.in > mdadm.8 /usr/bin/install -D -m 644 mdadm.8 /usr/share/man/man8/mdadm.8 /usr/bin/install -D -m 644 mdmon.8 /usr/share/man/man8/mdmon.8 /usr/bin/install -D -m 644 md.4 /usr/share/man/man4/md.4 /usr/bin/install -D -m 644 mdadm.conf.5 /usr/share/man/man5/mdadm.conf.5 /usr/bin/install -D -m 644 udev-md-raid-creating.rules /lib/udev/rules.d/01-md-raid-creating.rules /usr/bin/install -D -m 644 udev-md-raid-arrays.rules /lib/udev/rules.d/63-md-raid-arrays.rules /usr/bin/install -D -m 644 udev-md-raid-assembly.rules /lib/udev/rules.d/64-md-raid-assembly.rules /usr/bin/install -D -m 644 udev-md-clustered-confirm-device.rules /lib/udev/rules.d/69-md-clustered-confirm-device.rules /usr/bin/install -D -m 755 mdadm /sbin/mdadm /usr/bin/install -D -m 755 mdmon /sbin/mdmon Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00linear... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00multipath... FAILED - see /var/tmp/00multipath.log and /var/tmp/fail00multipath.log for details Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00names... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid0... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid1... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid10... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid4... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid5... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00raid6... succeeded Testing on linux-5.3.0-rc8-00009-gcd25427701bbd kernel /lkp/benchmarks/mdadm-selftests/tests/00readonly... succeeded To reproduce: # build kernel cd linux cp config-5.3.0-rc8-00009-gcd25427701bbd .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[tcp] 51ce142de7: packetdrill.packetdrill/tests/linux/undo_undo-fr-ack-then-dsack-on-ack-below-snd_una.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 51ce142de7c1073418b7f6c111fa9d0707e7acd9 ("[PATCH net-next] tcp: force a PSH flag on TSO packets") url: https://github.com/0day-ci/linux/commits/Eric-Dumazet/tcp-force-a-PSH-fla... in testcase: packetdrill with following parameters: on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Running packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt ... 2019-09-14 00:57:56 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt:25: error handling packet: live packet payload: expected 1000 bytes vs actual 2000 bytes packetdrill/tests/bsd/fast_retransmit/fr-4pkt-sack-bsd.pkt failed Running packetdrill/tests/linux/blocking/blocking-accept.pkt ... 2019-09-14 00:57:57 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/blocking/blocking-accept.pkt packetdrill/tests/linux/blocking/blocking-accept.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100094 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/blocking/blocking-accept.pkt failed Running packetdrill/tests/linux/blocking/blocking-read.pkt ... 2019-09-14 00:57:57 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/blocking/blocking-read.pkt packetdrill/tests/linux/blocking/blocking-read.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100698 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/blocking/blocking-read.pkt failed Running packetdrill/tests/linux/close/close-read-data-fin.pkt ... 2019-09-14 00:57:57 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-read-data-fin.pkt packetdrill/tests/linux/close/close-read-data-fin.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100104 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-read-data-fin.pkt failed Running packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt ... 2019-09-14 00:57:58 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt:14: error handling packet: bad value outbound TCP option 3 script packet: 0.000156 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000148 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-so-linger-onoff-1-linger-0-rst.pkt failed Running packetdrill/tests/linux/close/close-unread-data-rst.pkt ... 2019-09-14 00:57:58 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/close/close-unread-data-rst.pkt packetdrill/tests/linux/close/close-unread-data-rst.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100103 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/close/close-unread-data-rst.pkt failed Running packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt ... 2019-09-14 00:57:58 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100075 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/connect/http-get-nonblocking-ts.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt ... 2019-09-14 00:57:58 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100114 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-2pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt ... 2019-09-14 00:57:59 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100128 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt ... 2019-09-14 00:57:59 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100100 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-filled-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt ... 2019-09-14 00:57:59 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100107 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-delayed-get-ack-3pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt ... 2019-09-14 00:58:00 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100095 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-quick-2pkt-sack.pkt failed Running packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt ... 2019-09-14 00:58:00 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100098 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/early_retransmit/er-quick-3pkt-sack.pkt failed Running packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt ... 2019-09-14 00:58:00 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100096 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/fast_recovery/prr-ss-ack-below-snd_una-reno.pkt failed Running packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt ... 2019-09-14 00:58:01 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt packetdrill/tests/linux/fast_retransmit/fr-4pkt-sack-linux.pkt pass Running packetdrill/tests/linux/icmp/icmp-all-types.pkt ... 2019-09-14 00:58:01 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/icmp/icmp-all-types.pkt packetdrill/tests/linux/icmp/icmp-all-types.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100136 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/icmp/icmp-all-types.pkt failed Running packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt ... 2019-09-14 00:58:01 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.000189 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000181 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/inet_diag/inet-diag-ipv4-mapped-ipv6.pkt failed Running packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt ... 2019-09-14 00:58:02 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt:15: error handling packet: bad value outbound TCP option 3 script packet: 0.000160 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000152 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/inet_diag/inet-diag-ipv4.pkt failed Running packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt ... 2019-09-14 00:58:02 packetdrill/packetdrill packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100168 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/init_rto/init_rto_passive_open.pkt failed Running packetdrill/tests/linux/initial_window/iw10-base-case.pkt ... 2019-09-14 00:58:02 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/initial_window/iw10-base-case.pkt packetdrill/tests/linux/initial_window/iw10-base-case.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100138 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/initial_window/iw10-base-case.pkt failed Running packetdrill/tests/linux/initial_window/iw10-short-response.pkt ... 2019-09-14 00:58:02 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/initial_window/iw10-short-response.pkt packetdrill/tests/linux/initial_window/iw10-short-response.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.100151 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/initial_window/iw10-short-response.pkt failed Running packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt ... 2019-09-14 00:58:02 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt packetdrill/tests/linux/ioctl/ioctl-siocinq-fin.pkt pass Running packetdrill/tests/linux/listen/listen-incoming-ack.pkt ... 2019-09-14 00:58:03 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-ack.pkt packetdrill/tests/linux/listen/listen-incoming-ack.pkt:17: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200079 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-ack.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt ... 2019-09-14 00:58:03 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt:18: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200127 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-no-tcp-flags.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-rst.pkt ... 2019-09-14 00:58:04 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-rst.pkt packetdrill/tests/linux/listen/listen-incoming-rst.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200130 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-rst.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt ... 2019-09-14 00:58:04 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt:17: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200079 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-syn-ack.pkt failed Running packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt ... 2019-09-14 00:58:04 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.200000 S. 0:0(0) ack 1 <mss 1460,nop,nop,sackOK,nop,wscale 6> actual packet: 0.200126 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/listen/listen-incoming-syn-rst.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt:11: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100675 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client-ts.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt:10: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.101773 S 0:0(0) win 64240 <mss 1460,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-client.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.000164 S. 0:0(0) ack 1 <mss 1430,nop,nop,sackOK,nop,wscale 6> actual packet: 0.000156 S. 0:0(0) ack 1 win 64350 <mss 1430,nop,nop,sackOK,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ipv4.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt:19: error handling packet: bad value outbound TCP option 3 script packet: 0.000162 S. 0:0(0) ack 1 <mss 1430,sackOK,TS val 0 ecr 0,nop,wscale 6> actual packet: 0.000154 S. 0:0(0) ack 1 win 65228 <mss 1430,sackOK,TS val 0 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-advmss-ts-ipv4.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt:13: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,sackOK,TS val 100 ecr 100,nop,wscale 6> actual packet: 0.100138 S. 0:0(0) ack 1 win 65160 <mss 1460,sackOK,TS val 100 ecr 100,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server-ts.pkt failed Running packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt ... 2019-09-14 00:58:05 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt:12: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1460,nop,wscale 6> actual packet: 0.100121 S. 0:0(0) ack 1 win 64240 <mss 1460,nop,wscale 7> packetdrill/tests/linux/mss/mss-getsockopt-tcp_maxseg-server.pkt failed Running packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt ... 2019-09-14 00:58:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt:14: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S 0:0(0) <mss 1100,sackOK,TS val 100 ecr 0,nop,wscale 6> actual packet: 0.100656 S 0:0(0) win 64900 <mss 1100,sackOK,TS val 100 ecr 0,nop,wscale 7> packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-client.pkt failed Running packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt ... 2019-09-14 00:58:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt:16: error handling packet: bad value outbound TCP option 3 script packet: 0.100000 S. 0:0(0) ack 1 <mss 1100,nop,wscale 6> actual packet: 0.100137 S. 0:0(0) ack 1 win 64900 <mss 1100,nop,wscale 7> packetdrill/tests/linux/mss/mss-setsockopt-tcp_maxseg-server.pkt failed Running packetdrill/tests/linux/packetdrill/socket_err.pkt ... 2019-09-14 00:58:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/packetdrill/socket_err.pkt packetdrill/tests/linux/packetdrill/socket_err.pkt:6: runtime error in socket call: Expected non-negative result but got -1 with errno 93 (Protocol not supported) packetdrill/tests/linux/packetdrill/socket_err.pkt failed Running packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt ... 2019-09-14 00:58:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt:4: runtime error in socket call: Expected result -99 but got -1 with errno 93 (Protocol not supported) packetdrill/tests/linux/packetdrill/socket_wrong_err.pkt failed Running packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt ... 2019-09-14 00:58:06 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt:24: parse error at '1': syntax error packetdrill/tests/linux/pmtu_discovery/pmtud-10pkt-1460-to-1160.pkt failed Running packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt ... 2019-09-14 00:58:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt:24: parse error at '1': syntax error packetdrill/tests/linux/pmtu_discovery/pmtud-1pkt-1460-to-1160.pkt failed Running packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt ... 2019-09-14 00:58:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt:36: error handling packet: timing error: expected outbound packet at 0.300000 sec but happened at 0.340799 sec; tolerance 0.040000 sec script packet: 0.300000 . 1:1(0) ack 3001 <nop,nop,TS val 300 ecr 300> actual packet: 0.340799 . 1:1(0) ack 3001 win 3000 <nop,nop,TS val 341 ecr 300> packetdrill/tests/linux/receiver_rtt/rcv-rtt-with-timestamps-new.pkt failed Running packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt ... 2019-09-14 00:58:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt:41: error handling packet: timing error: expected outbound packet at 0.300000 sec but happened at 0.340780 sec; tolerance 0.040000 sec script packet: 0.300000 . 1:1(0) ack 3001 actual packet: 0.340780 . 1:1(0) ack 3001 win 3000 packetdrill/tests/linux/receiver_rtt/rcv-rtt-without-timestamps-new.pkt failed Running packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt ... 2019-09-14 00:58:07 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt packetdrill/tests/linux/sack/sack-shift-sacked-1-2-3-fack.pkt pass Running packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt ... 2019-09-14 00:58:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt packetdrill/tests/linux/sack/sack-shift-sacked-1-2:6-fack.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt ... 2019-09-14 00:58:08 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt packetdrill/tests/linux/shutdown/shutdown-rd-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt ... 2019-09-14 00:58:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt packetdrill/tests/linux/shutdown/shutdown-rd-wr-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt ... 2019-09-14 00:58:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt packetdrill/tests/linux/shutdown/shutdown-rdwr-close.pkt pass Running packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt ... 2019-09-14 00:58:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt packetdrill/tests/linux/shutdown/shutdown-wr-close.pkt pass Running packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt ... 2019-09-14 00:58:09 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt:51: error handling packet: live packet field tcp_psh: expected: 0 (0x0) vs actual: 1 (0x1) script packet: 0.450000 . 11001:21001(10000) ack 1 actual packet: 0.450062 P. 11001:21001(10000) ack 1 win 69 packetdrill/tests/linux/undo/undo-fr-ack-then-dsack-on-ack-below-snd_una.pkt failed Running packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt ... 2019-09-14 00:58:10 packetdrill/packetdrill --tolerance_usecs=40000 packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt:40: error handling packet: live packet field tcp_psh: expected: 0 (0x0) vs actual: 1 (0x1) script packet: 0.400000 . 10001:20001(10000) ack 1 actual packet: 0.400165 P. 10001:20001(10000) ack 1 win 69 packetdrill/tests/linux/undo/undo-fr-acks-dropped-then-dsack.pkt failed OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/basic.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/batch.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/closed.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-server.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/client.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv4-mapped-v6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/fastopen-client.pkt (ipv6)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/small.pkt (ipv4)] stdout: stderr: OK [/lkp/benchmarks/packetdrill/gtests/net/tcp/zerocopy/maxfrags.pkt (ipv6)] stdout: stderr: Ran 24 tests: 24 passing, 0 failing, 0 timed out (7.34 sec): tcp To reproduce: # build kernel cd linux cp config-5.3.0-rc7-01862-g51ce142de7c10 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[md] b68347ce10: mdadm-selftests.enchmarks/mdadm-selftests/tests/00multipath.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: b68347ce10621403475bfe89040fa7cf868b7b75 ("[PATCH v2] md: don't let spare disk become the fresh disk in analyze_sbs()") url: https://github.com/0day-ci/linux/commits/Yufen-Yu/md-don-t-let-spare-disk... in testcase: mdadm-selftests with following parameters: disk: 1HDD test_prefix: 00 on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Welcome to fdisk (util-linux 2.29.2). Changes will remain in memory only, until you decide to write them. Be careful before using the write command. Device does not contain a recognized partition table. Created a new DOS disklabel with disk identifier 0xe1fedc84. Command (m for help): Partition type p primary (0 primary, 0 extended, 4 free) e extended (container for logical partitions) Select (default p): Partition number (1-4, default 1): First sector (2048-536870911, default 2048): Last sector, +sectors or +size{K,M,G,T,P} (2048-536870911, default 536870911): Created a new partition 1 of type 'Linux' and of size 5 GiB. Command (m for help): The partition table has been altered. Calling ioctl() to re-read partition table. Syncing disks. 2019-09-13 12:21:43 mkdir -p /var/tmp 2019-09-13 12:21:43 mke2fs -t ext3 -b 1024 -J size=1 -q /dev/vda1 2019-09-13 12:21:53 mount -t ext3 /dev/vda1 /var/tmp sed -e 's/{DEFAULT_METADATA}/1.2/g' \ -e 's,{MAP_PATH},/run/mdadm/map,g' mdadm.8.in > mdadm.8 /usr/bin/install -D -m 644 mdadm.8 /usr/share/man/man8/mdadm.8 /usr/bin/install -D -m 644 mdmon.8 /usr/share/man/man8/mdmon.8 /usr/bin/install -D -m 644 md.4 /usr/share/man/man4/md.4 /usr/bin/install -D -m 644 mdadm.conf.5 /usr/share/man/man5/mdadm.conf.5 /usr/bin/install -D -m 644 udev-md-raid-creating.rules /lib/udev/rules.d/01-md-raid-creating.rules /usr/bin/install -D -m 644 udev-md-raid-arrays.rules /lib/udev/rules.d/63-md-raid-arrays.rules /usr/bin/install -D -m 644 udev-md-raid-assembly.rules /lib/udev/rules.d/64-md-raid-assembly.rules /usr/bin/install -D -m 644 udev-md-clustered-confirm-device.rules /lib/udev/rules.d/69-md-clustered-confirm-device.rules /usr/bin/install -D -m 755 mdadm /sbin/mdadm /usr/bin/install -D -m 755 mdmon /sbin/mdmon Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00linear... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00multipath... FAILED - see /var/tmp/00multipath.log and /var/tmp/fail00multipath.log for details Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00names... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid0... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid1... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid10... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid4... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid5... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00raid6... succeeded Testing on linux-5.3.0-rc8-00008-gb68347ce10621 kernel /lkp/benchmarks/mdadm-selftests/tests/00readonly... succeeded To reproduce: # build kernel cd linux cp config-5.3.0-rc8-00008-gb68347ce10621 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[mac80211_hwsim] b697746c62: hwsim.mesh_secure_ocv_mix_ht.fail

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: b697746c62df8cfbaa04b94ae75de7098a08beb7 ("mac80211_hwsim: Register support for HE meshpoint") https://kernel.googlesource.com/pub/scm/linux/kernel/git/jberg/mac80211-n... master in testcase: hwsim with following parameters: group: hwsim-11 on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> 2019-09-13 09:31:14 ./run-tests.py mesh_secure_ocv_mix_ht DEV: wlan0: 02:00:00:00:00:00 DEV: wlan1: 02:00:00:00:01:00 DEV: wlan2: 02:00:00:00:02:00 APDEV: wlan3 APDEV: wlan4 START mesh_secure_ocv_mix_ht 1/1 Test: Mesh network with a VHT STA and a HT STA under OCV Test exception: Couldn't join mesh Traceback (most recent call last): File "./run-tests.py", line 520, in main t(dev, apdev) File "/lkp/benchmarks/hwsim/tests/hwsim/test_wpas_mesh.py", line 466, in test_mesh_secure_ocv_mix_ht run_mesh_secure_ocv_mix_ht(dev, apdev) File "/lkp/benchmarks/hwsim/tests/hwsim/test_wpas_mesh.py", line 486, in run_mesh_secure_ocv_mix_ht check_mesh_joined_connected(dev, connectivity=True) File "/lkp/benchmarks/hwsim/tests/hwsim/test_wpas_mesh.py", line 119, in check_mesh_joined_connected check_mesh_joined2(dev) File "/lkp/benchmarks/hwsim/tests/hwsim/test_wpas_mesh.py", line 110, in check_mesh_joined2 check_mesh_group_added(dev[1]) File "/lkp/benchmarks/hwsim/tests/hwsim/test_wpas_mesh.py", line 88, in check_mesh_group_added raise Exception("Test exception: Couldn't join mesh") Exception: Test exception: Couldn't join mesh FAIL mesh_secure_ocv_mix_ht 14.47313 2019-09-13 09:31:30.634094 passed 0 test case(s) skipped 0 test case(s) failed tests: mesh_secure_ocv_mix_ht To reproduce: # build kernel cd linux cp config-5.3.0-rc5-01132-gb697746c62df8 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

ce6cd6796e: reaim.jobs_per_min -60.5% regression

by kernel test robot

Greeting, FYI, we noticed a -60.5% regression of reaim.jobs_per_min due to commit: commit: ce6cd6796ef5e1a32f598efb4339a28e86e37148 ("[PATCH] Revert "lockless next_positive()"") url: https://github.com/0day-ci/linux/commits/zhengbin/Revert-lockless-next_po... in testcase: reaim on test machine: 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory with following parameters: nr_task: 1600% iterations: 4 test: new_fserver cpufreq_governor: performance ucode: 0x14 test-description: REAIM is an updated and improved version of AIM 7 benchmark. test-url: https://sourceforge.net/projects/re-aim-7/ In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------+ | testcase: change | reaim: reaim.jobs_per_min -59.1% regression | | test machine | 40 threads Skylake-SP with 64G memory | | test parameters | cpufreq_governor=performance | | | nr_task=100% | | | runtime=300s | | | test=five_sec | +------------------+---------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/iterations/kconfig/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-7/performance/4/x86_64-rhel-7.6/1600%/debian-x86_64-2019-05-14.cgz/lkp-hsw-4ex1/new_fserver/reaim/0x14 commit: 3120b9a6a3 (" ipc: fix regressions from y2038 patches") ce6cd6796e ("Revert "lockless next_positive()"") 3120b9a6a3f7487f ce6cd6796ef5e1a32f598efb433 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :4 100% 4:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x :4 100% 4:4 dmesg.WARNING:stack_recursion 2:4 -58% 0:4 perf-profile.children.cycles-pp.error_entry 2:4 -62% 0:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 933.74 ± 7% +572.9% 6283 ± 3% reaim.child_systime 529.30 +12.2% 593.85 reaim.child_utime 679173 ± 2% -60.5% 268608 ± 4% reaim.jobs_per_min 294.78 ± 2% -60.5% 116.58 ± 4% reaim.jobs_per_min_child 92.00 -6.2% 86.31 reaim.jti 697532 -60.0% 279263 ± 3% reaim.max_jobs_per_min 19.97 ± 2% +153.3% 50.59 ± 4% reaim.parent_time 7.49 ± 15% +76.8% 13.24 ± 4% reaim.std_dev_percent 1.38 ± 13% +340.8% 6.06 ± 6% reaim.std_dev_time 88.85 ± 2% +137.8% 211.32 ± 4% reaim.time.elapsed_time 88.85 ± 2% +137.8% 211.32 ± 4% reaim.time.elapsed_time.max 1082186 +245.5% 3738694 reaim.time.involuntary_context_switches 6593 ± 5% +97.5% 13023 reaim.time.percent_of_cpu_this_job_got 3737 ± 7% +572.6% 25136 ± 3% reaim.time.system_time 2117 +12.2% 2375 reaim.time.user_time 5695947 ± 4% -52.7% 2692632 ± 2% reaim.time.voluntary_context_switches 28487616 ± 12% -53.1% 13373483 ± 86% cpuidle.C1.time 3.606e+09 ± 36% -83.5% 5.96e+08 ± 87% cpuidle.C3.time 11711047 ± 17% -83.6% 1923436 ± 80% cpuidle.C3.usage 5179368 ± 32% -43.8% 2909074 ± 14% cpuidle.C6.usage 350810 -52.2% 167753 ± 65% cpuidle.POLL.time 70276 ± 3% -65.8% 24039 ± 33% cpuidle.POLL.usage 19498 ± 20% -41.5% 11403 ± 32% numa-vmstat.node0.nr_kernel_stack 2600 +17.7% 3062 ± 3% numa-vmstat.node0.nr_mapped 10281 ± 24% -49.4% 5200 ± 47% numa-vmstat.node0.nr_page_table_pages 1359 ± 5% +18.9% 1615 ± 5% numa-vmstat.node1.nr_mapped 1365 ± 5% +25.8% 1717 ± 9% numa-vmstat.node2.nr_mapped 1416 ± 7% +43.8% 2036 ± 10% numa-vmstat.node3.nr_mapped 54.25 ± 5% -82.0% 9.75 ± 8% vmstat.cpu.id 29.00 ± 8% +182.8% 82.00 vmstat.cpu.sy 14.75 ± 2% -55.9% 6.50 ± 7% vmstat.cpu.us 64.75 ± 6% +2083.4% 1413 ± 2% vmstat.procs.r 159350 ± 5% -72.2% 44275 ± 2% vmstat.system.cs 288405 +2.5% 295656 vmstat.system.in 19665 ± 21% -41.4% 11520 ± 34% numa-meminfo.node0.KernelStack 10414 +19.4% 12432 ± 4% numa-meminfo.node0.Mapped 41190 ± 25% -49.2% 20918 ± 50% numa-meminfo.node0.PageTables 5325 +22.0% 6499 ± 4% numa-meminfo.node1.Mapped 985884 ± 9% -15.1% 837364 ± 9% numa-meminfo.node1.MemUsed 5316 +24.3% 6610 ± 5% numa-meminfo.node2.Mapped 5328 +45.6% 7757 ± 12% numa-meminfo.node3.Mapped 94488 ± 2% +69.7% 160335 ± 3% meminfo.AnonHugePages 3381044 ± 2% -15.5% 2856191 meminfo.Committed_AS 20435 +21.0% 24727 meminfo.Inactive 20077 +21.3% 24360 meminfo.Inactive(anon) 92782 ± 4% -29.3% 65556 meminfo.KernelStack 26419 +24.8% 32972 ± 2% meminfo.Mapped 211140 ± 3% -33.0% 141381 ± 5% meminfo.PageTables 29971 ± 2% +161.5% 78369 ± 7% meminfo.Shmem 63350 -62.5% 23725 ± 4% meminfo.max_used_kB 1357 ± 5% +93.2% 2623 turbostat.Avg_MHz 47.19 ± 5% +43.6 90.76 turbostat.Busy% 0.22 ± 13% -0.2 0.04 ± 79% turbostat.C1% 1.31 ± 33% -1.1 0.25 ± 78% turbostat.C1E% 11732603 ± 17% -83.6% 1922283 ± 80% turbostat.C3 27.91 ± 37% -26.0 1.93 ± 85% turbostat.C3% 5155166 ± 32% -44.3% 2873848 ± 14% turbostat.C6 23.61 ± 41% -16.5 7.08 ± 23% turbostat.C6% 37.74 ± 5% -87.7% 4.63 ± 13% turbostat.CPU%c1 7.73 ± 42% -92.3% 0.59 ± 93% turbostat.CPU%c3 26358325 ± 2% +138.4% 62831565 ± 3% turbostat.IRQ 5.91 ± 21% -53.0% 2.78 ± 23% turbostat.Pkg%pc2 0.22 ± 93% -94.3% 0.01 ± 66% turbostat.Pkg%pc3 54.50 +7.8% 58.75 turbostat.PkgTmp 474.40 ± 2% +10.2% 522.86 turbostat.PkgWatt 71.38 -14.1% 61.34 turbostat.RAMWatt 267537 -6.4% 250346 proc-vmstat.nr_active_anon 253532 -7.6% 234384 proc-vmstat.nr_anon_pages 81.50 ± 10% +19.9% 97.75 ± 6% proc-vmstat.nr_dirtied 264909 +4.6% 277159 proc-vmstat.nr_file_pages 5018 +21.6% 6102 proc-vmstat.nr_inactive_anon 92595 ± 3% -29.4% 65339 proc-vmstat.nr_kernel_stack 6714 +24.5% 8357 ± 2% proc-vmstat.nr_mapped 53290 ± 4% -33.8% 35278 ± 5% proc-vmstat.nr_page_table_pages 7480 ± 2% +163.4% 19704 ± 7% proc-vmstat.nr_shmem 26997 ± 3% +6.6% 28791 proc-vmstat.nr_slab_reclaimable 81.50 ± 10% +19.9% 97.75 ± 6% proc-vmstat.nr_written 267537 -6.4% 250346 proc-vmstat.nr_zone_active_anon 5018 +21.6% 6102 proc-vmstat.nr_zone_inactive_anon 9374 ± 61% +4806.0% 459914 ± 2% proc-vmstat.numa_hint_faults 5662 ±101% +981.1% 61215 ± 14% proc-vmstat.numa_hint_faults_local 4350 ±139% +9160.3% 402894 ± 2% proc-vmstat.numa_pages_migrated 26909 ± 66% +2016.6% 569553 ± 4% proc-vmstat.numa_pte_updates 7156 +300.6% 28669 ± 3% proc-vmstat.pgactivate 4350 ±139% +9160.3% 402894 ± 2% proc-vmstat.pgmigrate_success 8968 ±137% +837.8% 84113 ± 20% syscalls.sys_close.max 426.00 +55.9% 664.25 syscalls.sys_close.med 372.00 ± 5% +30.2% 484.50 syscalls.sys_close.min 1646 ± 18% -100.0% 0.00 syscalls.sys_dup2.max 466.75 ± 5% -100.0% 0.00 syscalls.sys_dup2.med 390.25 ± 4% -100.0% 0.00 syscalls.sys_dup2.min 1833349 ± 62% -1.8e+06 0.00 syscalls.sys_dup2.noise.100% 6916128 ± 35% -6.9e+06 0.00 syscalls.sys_dup2.noise.2% 6122948 ± 42% -6.1e+06 0.00 syscalls.sys_dup2.noise.25% 6738844 ± 37% -6.7e+06 0.00 syscalls.sys_dup2.noise.5% 4576769 ± 54% -4.6e+06 0.00 syscalls.sys_dup2.noise.50% 2864096 ± 72% -2.9e+06 0.00 syscalls.sys_dup2.noise.75% 7578 ±141% -100.0% 0.00 syscalls.sys_fcntl.max 570.75 ± 8% -100.0% 0.00 syscalls.sys_fcntl.med 419.50 ± 4% -100.0% 0.00 syscalls.sys_fcntl.min 5137656 ±136% -5.1e+06 0.00 syscalls.sys_fcntl.noise.100% 9572386 ± 80% -9.6e+06 0.00 syscalls.sys_fcntl.noise.2% 7843801 ± 99% -7.8e+06 0.00 syscalls.sys_fcntl.noise.25% 9380587 ± 82% -9.4e+06 0.00 syscalls.sys_fcntl.noise.5% 6505687 ±119% -6.5e+06 0.00 syscalls.sys_fcntl.noise.50% 5447410 ±128% -5.4e+06 0.00 syscalls.sys_fcntl.noise.75% 44670 ± 21% -100.0% 0.00 syscalls.sys_open.max 9548 -100.0% 0.00 syscalls.sys_open.med 3150 ± 6% -100.0% 0.00 syscalls.sys_open.min 41310336 ± 53% -4.1e+07 0.00 syscalls.sys_open.noise.100% 1.035e+08 ± 17% -1e+08 0.00 syscalls.sys_open.noise.2% 65484938 ± 34% -6.5e+07 0.00 syscalls.sys_open.noise.25% 1.003e+08 ± 17% -1e+08 0.00 syscalls.sys_open.noise.5% 60190962 ± 37% -6e+07 0.00 syscalls.sys_open.noise.50% 53590559 ± 37% -5.4e+07 0.00 syscalls.sys_open.noise.75% 201742 ± 12% -100.0% 0.00 syscalls.sys_read.max 871.25 ± 9% -100.0% 0.00 syscalls.sys_read.med 721.50 ± 4% -100.0% 0.00 syscalls.sys_read.min 7.958e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.100% 8.041e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.2% 8.027e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.25% 8.041e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.5% 8.014e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.50% 7.997e+08 ± 3% -8e+08 0.00 syscalls.sys_read.noise.75% 144683 +31.1% 189631 slabinfo.dentry.active_objs 3454 +32.2% 4565 slabinfo.dentry.active_slabs 145086 +32.2% 191783 slabinfo.dentry.num_objs 3454 +32.2% 4565 slabinfo.dentry.num_slabs 12580 +14.3% 14378 ± 3% slabinfo.files_cache.active_objs 12580 +14.3% 14378 ± 3% slabinfo.files_cache.num_objs 75879 +14.1% 86603 slabinfo.filp.active_objs 1296 ± 2% +13.3% 1468 slabinfo.filp.active_slabs 82998 ± 2% +13.2% 93993 slabinfo.filp.num_objs 1296 ± 2% +13.3% 1468 slabinfo.filp.num_slabs 68957 ± 4% +35.9% 93680 slabinfo.kmalloc-32.active_objs 538.75 ± 4% +35.8% 731.50 slabinfo.kmalloc-32.active_slabs 69000 ± 4% +35.8% 93702 slabinfo.kmalloc-32.num_objs 538.75 ± 4% +35.8% 731.50 slabinfo.kmalloc-32.num_slabs 18511 ± 2% +12.7% 20866 ± 5% slabinfo.kmalloc-512.active_objs 18624 ± 2% +12.7% 20992 ± 5% slabinfo.kmalloc-512.num_objs 16058 +61.0% 25850 slabinfo.pid.active_objs 250.25 +61.2% 403.50 slabinfo.pid.active_slabs 16058 +61.0% 25850 slabinfo.pid.num_objs 250.25 +61.2% 403.50 slabinfo.pid.num_slabs 41003 +17.5% 48181 slabinfo.shmem_inode_cache.active_objs 894.50 +17.3% 1049 slabinfo.shmem_inode_cache.active_slabs 41170 +17.3% 48300 slabinfo.shmem_inode_cache.num_objs 894.50 +17.3% 1049 slabinfo.shmem_inode_cache.num_slabs 17369 ± 2% +13.6% 19727 slabinfo.signal_cache.active_objs 17585 ± 2% +13.5% 19956 slabinfo.signal_cache.num_objs 10331 -10.8% 9215 slabinfo.skbuff_ext_cache.active_objs 10331 -10.8% 9215 slabinfo.skbuff_ext_cache.num_objs 14479 +74.4% 25257 slabinfo.task_delay_info.active_objs 283.50 +74.7% 495.25 slabinfo.task_delay_info.active_slabs 14479 +74.6% 25280 slabinfo.task_delay_info.num_objs 283.50 +74.7% 495.25 slabinfo.task_delay_info.num_slabs 5825 ± 3% -13.0% 5065 slabinfo.task_struct.active_objs 1980 ± 3% -13.3% 1716 slabinfo.task_struct.active_slabs 5944 ± 3% -13.4% 5150 slabinfo.task_struct.num_objs 1980 ± 3% -13.3% 1716 slabinfo.task_struct.num_slabs 14037 -28.1% 10096 slabinfo.tw_sock_TCP.active_objs 14037 -28.1% 10096 slabinfo.tw_sock_TCP.num_objs 157734 ± 3% -16.4% 131917 slabinfo.vm_area_struct.active_objs 4020 ± 3% -16.2% 3370 slabinfo.vm_area_struct.active_slabs 160833 ± 3% -16.2% 134826 slabinfo.vm_area_struct.num_objs 4020 ± 3% -16.2% 3370 slabinfo.vm_area_struct.num_slabs 860.00 ± 2% -13.5% 744.00 slabinfo.vmap_area.active_slabs 39579 ± 2% -13.5% 34234 slabinfo.vmap_area.num_objs 860.00 ± 2% -13.5% 744.00 slabinfo.vmap_area.num_slabs 8.13 ± 4% -54.4% 3.71 ± 8% perf-stat.i.MPKI 1.20 ± 8% -0.6 0.58 ± 9% perf-stat.i.branch-miss-rate% 2.185e+08 ± 2% -58.2% 91314730 ± 3% perf-stat.i.branch-misses 10.97 +0.5 11.50 perf-stat.i.cache-miss-rate% 88415244 ± 3% -63.9% 31874296 ± 4% perf-stat.i.cache-misses 7.583e+08 ± 2% -63.7% 2.753e+08 ± 2% perf-stat.i.cache-references 165129 ± 5% -73.0% 44512 ± 2% perf-stat.i.context-switches 1.70 ± 2% +99.9% 3.40 perf-stat.i.cpi 1.988e+11 ± 5% +90.7% 3.791e+11 perf-stat.i.cpu-cycles 40268 ± 6% -70.5% 11876 perf-stat.i.cpu-migrations 3497 ± 5% +321.2% 14732 ± 6% perf-stat.i.cycles-between-cache-misses 0.21 ± 10% -0.1 0.09 ± 9% perf-stat.i.dTLB-load-miss-rate% 53936264 ± 8% -64.3% 19264238 ± 9% perf-stat.i.dTLB-load-misses 3.29e+10 ± 5% -18.4% 2.685e+10 perf-stat.i.dTLB-loads 0.16 -0.0 0.14 perf-stat.i.dTLB-store-miss-rate% 14375482 ± 2% -61.6% 5517857 ± 3% perf-stat.i.dTLB-store-misses 9.1e+09 ± 2% -58.3% 3.797e+09 ± 3% perf-stat.i.dTLB-stores 51.03 +5.1 56.10 ± 4% perf-stat.i.iTLB-load-miss-rate% 17065934 ± 3% -55.3% 7627563 ± 5% perf-stat.i.iTLB-load-misses 18226149 ± 2% -63.6% 6641654 ± 7% perf-stat.i.iTLB-loads 1.397e+11 ± 4% -18.1% 1.144e+11 perf-stat.i.instructions 8244 ± 4% +119.6% 18105 ± 2% perf-stat.i.instructions-per-iTLB-miss 0.68 -53.2% 0.32 perf-stat.i.ipc 2073319 ± 2% -58.0% 870637 ± 4% perf-stat.i.minor-faults 84.19 +4.5 88.67 perf-stat.i.node-load-miss-rate% 55594360 ± 4% -63.8% 20129993 ± 4% perf-stat.i.node-load-misses 10032529 ± 4% -73.8% 2627691 ± 3% perf-stat.i.node-loads 60.81 +8.1 68.87 perf-stat.i.node-store-miss-rate% 14203691 ± 4% -56.0% 6248115 ± 4% perf-stat.i.node-store-misses 8355082 ± 3% -66.6% 2788948 ± 3% perf-stat.i.node-stores 2073167 ± 2% -58.0% 870591 ± 4% perf-stat.i.page-faults 5.43 ± 2% -55.7% 2.40 perf-stat.overall.MPKI 0.92 ± 3% -0.6 0.37 ± 2% perf-stat.overall.branch-miss-rate% 1.42 +133.1% 3.32 perf-stat.overall.cpi 2248 ± 3% +430.1% 11918 ± 3% perf-stat.overall.cycles-between-cache-misses 0.16 ± 7% -0.1 0.07 ± 9% perf-stat.overall.dTLB-load-miss-rate% 0.16 -0.0 0.15 perf-stat.overall.dTLB-store-miss-rate% 48.35 +5.1 53.47 ± 5% perf-stat.overall.iTLB-load-miss-rate% 8190 ± 3% +83.8% 15054 ± 5% perf-stat.overall.instructions-per-iTLB-miss 0.70 -57.1% 0.30 perf-stat.overall.ipc 84.70 +3.8 88.45 perf-stat.overall.node-load-miss-rate% 62.95 +6.2 69.13 perf-stat.overall.node-store-miss-rate% 13304117 ± 3% +96.1% 26093128 ± 2% perf-stat.overall.path-length 2.159e+08 ± 2% -57.9% 90825849 ± 3% perf-stat.ps.branch-misses 87320678 ± 3% -63.7% 31687570 ± 4% perf-stat.ps.cache-misses 7.49e+08 ± 2% -63.5% 2.737e+08 ± 2% perf-stat.ps.cache-references 163076 ± 5% -72.9% 44243 ± 2% perf-stat.ps.context-switches 1.963e+11 ± 5% +92.1% 3.772e+11 perf-stat.ps.cpu-cycles 39767 ± 6% -70.3% 11806 perf-stat.ps.cpu-migrations 53276303 ± 8% -64.1% 19151173 ± 9% perf-stat.ps.dTLB-load-misses 3.25e+10 ± 5% -17.8% 2.671e+10 perf-stat.ps.dTLB-loads 14200759 ± 2% -61.4% 5484638 ± 3% perf-stat.ps.dTLB-store-misses 8.989e+09 ± 2% -58.0% 3.775e+09 ± 3% perf-stat.ps.dTLB-stores 16857776 ± 3% -55.0% 7583770 ± 5% perf-stat.ps.iTLB-load-misses 18004349 ± 2% -63.3% 6600023 ± 7% perf-stat.ps.iTLB-loads 1.38e+11 ± 4% -17.6% 1.138e+11 perf-stat.ps.instructions 2047980 ± 2% -57.8% 865232 ± 4% perf-stat.ps.minor-faults 54905653 ± 4% -63.6% 20011140 ± 4% perf-stat.ps.node-load-misses 9909309 ± 4% -73.6% 2611870 ± 3% perf-stat.ps.node-loads 14027230 ± 4% -55.7% 6212402 ± 4% perf-stat.ps.node-store-misses 8251866 ± 3% -66.4% 2772675 ± 3% perf-stat.ps.node-stores 2047829 ± 2% -57.8% 865198 ± 4% perf-stat.ps.page-faults 1.226e+13 ± 3% +96.1% 2.405e+13 ± 2% perf-stat.total.instructions 15134 ±113% +10436.0% 1594628 ± 7% sched_debug.cfs_rq:/.MIN_vruntime.avg 1424659 ±100% +1752.5% 26391701 ± 7% sched_debug.cfs_rq:/.MIN_vruntime.max 143952 ±104% +3880.5% 5730075 ± 5% sched_debug.cfs_rq:/.MIN_vruntime.stddev 13948 ± 6% +486.9% 81859 ± 2% sched_debug.cfs_rq:/.exec_clock.avg 15273 ± 5% +448.3% 83747 ± 2% sched_debug.cfs_rq:/.exec_clock.max 13603 ± 7% +485.8% 79685 ± 2% sched_debug.cfs_rq:/.exec_clock.min 199.02 ± 8% +86.9% 371.88 ± 10% sched_debug.cfs_rq:/.exec_clock.stddev 3892 ± 48% +1254.7% 52729 ± 6% sched_debug.cfs_rq:/.load.avg 279742 ± 92% +245.7% 967089 ± 11% sched_debug.cfs_rq:/.load.max 25525 ± 83% +645.6% 190318 sched_debug.cfs_rq:/.load.stddev 19.40 ± 26% +251.0% 68.09 ± 50% sched_debug.cfs_rq:/.load_avg.avg 657.25 ± 32% +478.7% 3803 ±127% sched_debug.cfs_rq:/.load_avg.max 81.52 ± 33% +323.8% 345.48 ±114% sched_debug.cfs_rq:/.load_avg.stddev 15134 ±113% +10436.0% 1594628 ± 7% sched_debug.cfs_rq:/.max_vruntime.avg 1424659 ±100% +1752.5% 26391701 ± 7% sched_debug.cfs_rq:/.max_vruntime.max 143952 ±104% +3880.5% 5730075 ± 5% sched_debug.cfs_rq:/.max_vruntime.stddev 2791943 ± 7% +746.3% 23628221 sched_debug.cfs_rq:/.min_vruntime.avg 3266423 ± 7% +867.9% 31616401 ± 5% sched_debug.cfs_rq:/.min_vruntime.max 2553742 ± 9% +617.3% 18319180 ± 3% sched_debug.cfs_rq:/.min_vruntime.min 104272 ± 9% +2181.4% 2378890 ± 11% sched_debug.cfs_rq:/.min_vruntime.stddev 0.23 ± 7% +234.5% 0.76 ± 13% sched_debug.cfs_rq:/.nr_running.avg 0.39 ± 3% -36.9% 0.25 ± 6% sched_debug.cfs_rq:/.nr_running.stddev 0.38 ± 27% +2.7e+05% 1019 ± 4% sched_debug.cfs_rq:/.nr_spread_over.avg 17.50 ± 42% +17222.1% 3031 ± 18% sched_debug.cfs_rq:/.nr_spread_over.max 1.56 ± 38% +20694.8% 325.36 ± 19% sched_debug.cfs_rq:/.nr_spread_over.stddev 0.73 ± 12% +1525.7% 11.91 ± 10% sched_debug.cfs_rq:/.runnable_load_avg.avg 10.12 ± 2% +3913.6% 406.38 ± 23% sched_debug.cfs_rq:/.runnable_load_avg.max 2.22 ± 5% +1733.2% 40.65 ± 20% sched_debug.cfs_rq:/.runnable_load_avg.stddev 2938 ± 64% +1684.6% 52446 ± 6% sched_debug.cfs_rq:/.runnable_weight.avg 272596 ± 96% +254.4% 965994 ± 11% sched_debug.cfs_rq:/.runnable_weight.max 24349 ± 88% +681.4% 190266 sched_debug.cfs_rq:/.runnable_weight.stddev -55094 -4088.9% 2197692 ± 55% sched_debug.cfs_rq:/.spread0.avg 418015 ± 39% +2336.3% 10184169 ± 24% sched_debug.cfs_rq:/.spread0.max -293745 +962.1% -3119772 sched_debug.cfs_rq:/.spread0.min 104576 ± 9% +2167.9% 2371657 ± 11% sched_debug.cfs_rq:/.spread0.stddev 507.90 +50.2% 762.88 ± 14% sched_debug.cfs_rq:/.util_avg.avg 1197 ± 5% +25.4% 1501 ± 6% sched_debug.cfs_rq:/.util_avg.max 266.38 ± 6% -25.0% 199.88 ± 20% sched_debug.cfs_rq:/.util_avg.min 188.69 +35.1% 255.01 ± 9% sched_debug.cfs_rq:/.util_avg.stddev 22.15 ± 14% +1579.1% 371.99 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.avg 685.50 ± 3% +122.1% 1522 ± 11% sched_debug.cfs_rq:/.util_est_enqueued.max 83.24 ± 4% +253.6% 294.36 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.stddev 808453 +12.0% 905408 ± 2% sched_debug.cpu.avg_idle.avg 197650 ± 2% -27.3% 143620 ± 12% sched_debug.cpu.avg_idle.stddev 75222 +81.9% 136856 sched_debug.cpu.clock.avg 75322 +82.1% 137129 sched_debug.cpu.clock.max 75120 +81.8% 136577 sched_debug.cpu.clock.min 58.45 +190.7% 169.92 ± 35% sched_debug.cpu.clock.stddev 75222 +81.9% 136856 sched_debug.cpu.clock_task.avg 75322 +82.1% 137129 sched_debug.cpu.clock_task.max 75120 +81.8% 136577 sched_debug.cpu.clock_task.min 58.45 +190.7% 169.91 ± 35% sched_debug.cpu.clock_task.stddev 15729 ± 15% +246.1% 54444 ± 21% sched_debug.cpu.curr->pid.avg 56197 ± 14% +39.6% 78451 ± 19% sched_debug.cpu.curr->pid.max 22361 ± 14% -62.3% 8427 ± 25% sched_debug.cpu.curr->pid.stddev 679039 ± 5% -15.5% 573639 ± 3% sched_debug.cpu.max_idle_balance_cost.max 21639 ± 17% -68.7% 6771 ± 27% sched_debug.cpu.max_idle_balance_cost.stddev 0.00 ± 2% +141.1% 0.00 ± 34% sched_debug.cpu.next_balance.stddev 0.23 ± 8% +3207.2% 7.61 ± 19% sched_debug.cpu.nr_running.avg 1.50 ± 23% +1595.8% 25.44 ± 24% sched_debug.cpu.nr_running.max 0.40 ± 4% +1136.9% 4.95 ± 23% sched_debug.cpu.nr_running.stddev 35594 ± 7% -18.8% 28902 sched_debug.cpu.nr_switches.avg 46758 ± 8% -14.9% 39777 ± 2% sched_debug.cpu.nr_switches.max 33303 ± 8% -30.4% 23179 sched_debug.cpu.nr_switches.min 1576 ± 7% +71.7% 2707 ± 8% sched_debug.cpu.nr_switches.stddev 7.70 ± 2% -56.5% 3.35 ± 24% sched_debug.cpu.nr_uninterruptible.avg 157.25 ± 10% +55.4% 244.44 ± 28% sched_debug.cpu.nr_uninterruptible.max 53.38 ± 4% +26.4% 67.47 ± 14% sched_debug.cpu.nr_uninterruptible.stddev 36022 ± 7% -20.1% 28765 ± 2% sched_debug.cpu.sched_count.avg 34183 ± 8% -31.4% 23450 sched_debug.cpu.sched_count.min 3576 ± 13% +35.6% 4847 ± 15% sched_debug.cpu.sched_count.stddev 13693 ± 7% -83.1% 2317 ± 14% sched_debug.cpu.sched_goidle.avg 15685 ± 9% -72.5% 4319 ± 5% sched_debug.cpu.sched_goidle.max 13057 ± 8% -85.3% 1925 ± 15% sched_debug.cpu.sched_goidle.min 363.81 ± 15% -25.0% 272.70 ± 11% sched_debug.cpu.sched_goidle.stddev 18473 ± 9% -41.5% 10813 sched_debug.cpu.ttwu_count.avg 20813 ± 12% -27.3% 15139 ± 3% sched_debug.cpu.ttwu_count.max 17623 ± 9% -56.1% 7745 ± 5% sched_debug.cpu.ttwu_count.min 424.41 ± 15% +208.2% 1308 ± 9% sched_debug.cpu.ttwu_count.stddev 3260 ± 4% +81.3% 5912 ± 3% sched_debug.cpu.ttwu_local.avg 3511 ± 4% +143.3% 8542 ± 5% sched_debug.cpu.ttwu_local.max 3050 ± 5% +27.9% 3900 sched_debug.cpu.ttwu_local.min 86.20 ± 3% +820.4% 793.38 ± 9% sched_debug.cpu.ttwu_local.stddev 75118 +81.8% 136576 sched_debug.cpu_clk 70993 +86.6% 132451 sched_debug.ktime 79433 +76.2% 139934 sched_debug.sched_clk 47.68 ± 25% -38.9 8.74 ± 90% perf-profile.calltrace.cycles-pp.secondary_startup_64 46.94 ± 26% -38.3 8.68 ± 90% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 46.94 ± 26% -38.3 8.68 ± 90% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 46.94 ± 26% -38.3 8.68 ± 90% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 46.56 ± 26% -38.2 8.35 ± 91% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 45.80 ± 26% -38.0 7.76 ± 93% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 46.21 ± 28% -37.9 8.31 ± 91% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 15.20 ± 67% -15.2 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 15.20 ± 67% -15.2 0.00 perf-profile.calltrace.cycles-pp.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 15.20 ± 67% -15.2 0.00 perf-profile.calltrace.cycles-pp.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe 12.93 ± 94% -12.9 0.00 perf-profile.calltrace.cycles-pp.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.calltrace.cycles-pp.smp_call_function_single.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.calltrace.cycles-pp._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.calltrace.cycles-pp.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64 12.93 ± 94% -12.9 0.00 perf-profile.calltrace.cycles-pp.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl 31.30 ± 26% +50.2 81.50 ± 15% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 31.30 ± 26% +50.2 81.51 ± 15% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 0.00 +70.7 70.72 ± 23% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.next_positive.dcache_readdir.iterate_dir 0.00 +70.9 70.86 ± 23% perf-profile.calltrace.cycles-pp._raw_spin_lock.next_positive.dcache_readdir.iterate_dir.__x64_sys_getdents 0.00 +71.0 71.01 ± 23% perf-profile.calltrace.cycles-pp.next_positive.dcache_readdir.iterate_dir.__x64_sys_getdents.do_syscall_64 0.00 +72.5 72.46 ± 23% perf-profile.calltrace.cycles-pp.dcache_readdir.iterate_dir.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +72.5 72.48 ± 23% perf-profile.calltrace.cycles-pp.iterate_dir.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +72.5 72.48 ± 23% perf-profile.calltrace.cycles-pp.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 47.68 ± 25% -38.9 8.74 ± 90% perf-profile.children.cycles-pp.secondary_startup_64 47.68 ± 25% -38.9 8.74 ± 90% perf-profile.children.cycles-pp.cpu_startup_entry 47.68 ± 25% -38.9 8.74 ± 90% perf-profile.children.cycles-pp.do_idle 47.30 ± 24% -38.9 8.41 ± 91% perf-profile.children.cycles-pp.cpuidle_enter 47.30 ± 24% -38.9 8.41 ± 91% perf-profile.children.cycles-pp.cpuidle_enter_state 46.94 ± 26% -38.3 8.68 ± 90% perf-profile.children.cycles-pp.start_secondary 45.80 ± 26% -38.0 7.82 ± 94% perf-profile.children.cycles-pp.intel_idle 16.88 ± 68% -16.9 0.00 perf-profile.children.cycles-pp.event_function_call 16.88 ± 68% -16.9 0.00 perf-profile.children.cycles-pp.smp_call_function_single 15.20 ± 67% -15.2 0.00 perf-profile.children.cycles-pp.__x64_sys_ioctl 15.20 ± 67% -15.2 0.00 perf-profile.children.cycles-pp.ksys_ioctl 15.20 ± 67% -15.2 0.00 perf-profile.children.cycles-pp.do_vfs_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.children.cycles-pp._perf_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.children.cycles-pp.perf_ioctl 12.93 ± 94% -12.9 0.00 perf-profile.children.cycles-pp.perf_event_for_each_child 10.57 ± 85% -8.8 1.76 ± 71% perf-profile.children.cycles-pp.do_group_exit 10.57 ± 85% -8.8 1.76 ± 71% perf-profile.children.cycles-pp.do_exit 0.00 +0.1 0.05 perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.00 +0.1 0.06 ± 22% perf-profile.children.cycles-pp.__local_bh_enable_ip 0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.__might_fault 0.00 +0.1 0.07 ± 13% perf-profile.children.cycles-pp.do_truncate 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp._copy_to_user 0.00 +0.1 0.07 ± 24% perf-profile.children.cycles-pp.update_rq_clock 0.00 +0.1 0.07 ± 29% perf-profile.children.cycles-pp.new_sync_read 0.00 +0.1 0.07 ± 27% perf-profile.children.cycles-pp.lockref_get_not_dead 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.trailing_symlink 0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.ip_finish_output2 0.00 +0.1 0.08 ± 10% perf-profile.children.cycles-pp.do_dentry_open 0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.lockref_put_or_lock 0.00 +0.1 0.08 ± 21% perf-profile.children.cycles-pp.ftrace_syscall_exit 0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.__might_sleep 0.00 +0.1 0.09 ± 41% perf-profile.children.cycles-pp._cond_resched 0.00 +0.1 0.09 ± 26% perf-profile.children.cycles-pp.ip_output 0.00 +0.1 0.09 ± 34% perf-profile.children.cycles-pp.sched_exec 0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.legitimize_path 0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.clockevents_program_event 0.00 +0.1 0.10 ± 40% perf-profile.children.cycles-pp.ktime_get 0.00 +0.1 0.10 ± 28% perf-profile.children.cycles-pp.__alloc_file 0.00 +0.1 0.10 ± 31% perf-profile.children.cycles-pp.wake_up_new_task 0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.unlazy_walk 0.00 +0.1 0.10 ± 43% perf-profile.children.cycles-pp.pte_alloc_one 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.update_curr 0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.alloc_empty_file 0.00 +0.1 0.11 ± 39% perf-profile.children.cycles-pp.__slab_free 0.00 +0.1 0.12 ± 49% perf-profile.children.cycles-pp.find_vma 0.00 +0.1 0.12 ± 30% perf-profile.children.cycles-pp.update_cfs_group 0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.perf_event_mmap 0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.update_load_avg 0.00 +0.1 0.12 ± 36% perf-profile.children.cycles-pp.alloc_set_pte 0.00 +0.1 0.12 ± 33% perf-profile.children.cycles-pp.rcu_core 0.00 +0.1 0.13 ± 8% perf-profile.children.cycles-pp.do_open_execat 0.00 +0.1 0.13 ± 29% perf-profile.children.cycles-pp.___might_sleep 0.00 +0.1 0.13 ± 33% perf-profile.children.cycles-pp.sock_sendmsg 0.00 +0.1 0.13 ± 33% perf-profile.children.cycles-pp.sock_write_iter 0.00 +0.1 0.14 ± 51% perf-profile.children.cycles-pp.down_write 0.00 +0.2 0.15 ± 46% perf-profile.children.cycles-pp.mmap64 0.00 +0.2 0.15 ± 16% perf-profile.children.cycles-pp.dput 0.00 +0.2 0.16 ± 30% perf-profile.children.cycles-pp.select_task_rq_fair 0.00 +0.2 0.16 ± 55% perf-profile.children.cycles-pp.__vm_munmap 0.00 +0.2 0.17 ± 38% perf-profile.children.cycles-pp.kmem_cache_free 0.00 +0.2 0.17 ± 39% perf-profile.children.cycles-pp._dl_addr 0.00 +0.2 0.17 ± 57% perf-profile.children.cycles-pp.sync 0.00 +0.2 0.17 ± 39% perf-profile.children.cycles-pp.__do_sys_newstat 0.00 +0.2 0.17 ± 35% perf-profile.children.cycles-pp.copy_strings 0.00 +0.2 0.17 ± 58% perf-profile.children.cycles-pp.menu_select 0.00 +0.2 0.18 ± 56% perf-profile.children.cycles-pp.pagevec_lru_move_fn 0.00 +0.2 0.18 ± 20% perf-profile.children.cycles-pp.do_unlinkat 0.00 +0.2 0.18 ± 42% perf-profile.children.cycles-pp.copy_p4d_range 0.00 +0.2 0.18 ± 58% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.00 +0.2 0.19 ± 30% perf-profile.children.cycles-pp.vfs_statx 0.00 +0.2 0.19 ± 40% perf-profile.children.cycles-pp.copy_page_range 0.00 +0.2 0.23 ± 52% perf-profile.children.cycles-pp.unlink_anon_vmas 0.00 +0.2 0.23 ± 52% perf-profile.children.cycles-pp.anon_vma_fork 0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.task_tick_fair 0.00 +0.3 0.27 ± 67% perf-profile.children.cycles-pp.elf_map 0.00 +0.3 0.28 ± 36% perf-profile.children.cycles-pp.__softirqentry_text_start 0.00 +0.3 0.29 ± 56% perf-profile.children.cycles-pp.clear_page_erms 0.00 +0.3 0.30 ± 55% perf-profile.children.cycles-pp.prep_new_page 0.00 +0.3 0.34 ± 59% perf-profile.children.cycles-pp.alloc_pages_vma 0.00 +0.4 0.36 ± 38% perf-profile.children.cycles-pp.setlocale 0.00 +0.4 0.36 ± 13% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.4 0.40 ± 16% perf-profile.children.cycles-pp.filldir 0.00 +0.4 0.43 ± 53% perf-profile.children.cycles-pp.get_page_from_freelist 0.00 +0.5 0.48 ± 12% perf-profile.children.cycles-pp.update_process_times 0.00 +0.5 0.49 ± 13% perf-profile.children.cycles-pp.tick_sched_handle 0.00 +0.5 0.50 ± 54% perf-profile.children.cycles-pp.__alloc_pages_nodemask 0.00 +0.5 0.52 ± 12% perf-profile.children.cycles-pp.tick_sched_timer 0.00 +0.5 0.53 ± 24% perf-profile.children.cycles-pp.move_cursor 0.00 +0.6 0.57 ± 86% perf-profile.children.cycles-pp.vma_link 0.00 +0.6 0.62 ± 44% perf-profile.children.cycles-pp.filemap_map_pages 0.00 +0.7 0.66 ± 14% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.00 +0.7 0.67 ± 67% perf-profile.children.cycles-pp.__libc_fork 0.00 +0.9 0.85 ± 15% perf-profile.children.cycles-pp.hrtimer_interrupt 0.00 +0.9 0.85 ± 83% perf-profile.children.cycles-pp.__vma_adjust 0.00 +1.0 0.99 ± 79% perf-profile.children.cycles-pp.ksys_mmap_pgoff 0.00 +1.0 0.99 ± 72% perf-profile.children.cycles-pp.__x64_sys_brk 0.00 +1.0 1.00 ± 72% perf-profile.children.cycles-pp.unmap_region 0.00 +1.1 1.08 ± 80% perf-profile.children.cycles-pp.mmap_region 0.00 +1.1 1.12 ± 78% perf-profile.children.cycles-pp.do_mmap 0.00 +1.2 1.15 ± 77% perf-profile.children.cycles-pp.vm_mmap_pgoff 0.00 +1.2 1.25 ± 55% perf-profile.children.cycles-pp.execve 0.00 +1.5 1.45 ± 73% perf-profile.children.cycles-pp.__do_munmap 0.00 +1.6 1.60 ± 79% perf-profile.children.cycles-pp.dup_mm 0.71 ±173% +1.9 2.58 ± 59% perf-profile.children.cycles-pp.__do_execve_file 0.00 +1.9 1.86 ± 73% perf-profile.children.cycles-pp.copy_process 0.71 ±173% +1.9 2.59 ± 59% perf-profile.children.cycles-pp.__x64_sys_execve 0.00 +1.9 1.94 ± 89% perf-profile.children.cycles-pp.unlink_file_vma 0.00 +2.0 1.97 ± 71% perf-profile.children.cycles-pp.__x64_sys_clone 0.00 +2.0 1.97 ± 71% perf-profile.children.cycles-pp._do_fork 0.00 +2.3 2.31 ± 85% perf-profile.children.cycles-pp.free_pgtables 0.00 +3.5 3.54 ± 87% perf-profile.children.cycles-pp.osq_lock 0.00 +3.9 3.85 ± 86% perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.00 +4.0 4.04 ± 87% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 42.31 ± 27% +42.4 84.69 ± 12% perf-profile.children.cycles-pp.do_syscall_64 42.31 ± 27% +42.4 84.71 ± 12% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.00 +71.0 71.01 ± 23% perf-profile.children.cycles-pp.next_positive 0.73 ±173% +71.7 72.41 ± 23% perf-profile.children.cycles-pp._raw_spin_lock 0.00 +72.3 72.35 ± 23% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.00 +72.5 72.46 ± 23% perf-profile.children.cycles-pp.dcache_readdir 0.00 +72.5 72.48 ± 23% perf-profile.children.cycles-pp.iterate_dir 0.00 +72.5 72.48 ± 23% perf-profile.children.cycles-pp.__x64_sys_getdents 45.80 ± 26% -38.0 7.81 ± 94% perf-profile.self.cycles-pp.intel_idle 16.88 ± 68% -16.9 0.00 perf-profile.self.cycles-pp.smp_call_function_single 5.21 ± 48% -4.6 0.59 ± 34% perf-profile.self.cycles-pp.do_syscall_64 0.00 +0.1 0.06 ± 26% perf-profile.self.cycles-pp.selinux_inode_permission 0.00 +0.1 0.07 ± 21% perf-profile.self.cycles-pp.update_rq_clock 0.00 +0.1 0.07 ± 31% perf-profile.self.cycles-pp.__might_sleep 0.00 +0.1 0.08 ± 6% perf-profile.self.cycles-pp.update_curr 0.00 +0.1 0.10 ± 36% perf-profile.self.cycles-pp.__slab_free 0.00 +0.1 0.11 ± 29% perf-profile.self.cycles-pp.select_task_rq_fair 0.00 +0.1 0.12 ± 30% perf-profile.self.cycles-pp.update_cfs_group 0.00 +0.1 0.12 ± 26% perf-profile.self.cycles-pp.___might_sleep 0.00 +0.1 0.14 ± 50% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.00 +0.1 0.14 ± 33% perf-profile.self.cycles-pp.next_positive 0.00 +0.2 0.16 ± 38% perf-profile.self.cycles-pp._dl_addr 0.00 +0.2 0.18 ± 58% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.__check_object_size 0.00 +0.3 0.28 ± 57% perf-profile.self.cycles-pp.clear_page_erms 0.00 +0.4 0.45 ± 46% perf-profile.self.cycles-pp.filemap_map_pages 0.00 +3.5 3.50 ± 87% perf-profile.self.cycles-pp.osq_lock 0.00 +71.9 71.86 ± 23% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 32015 ± 3% +104.2% 65384 ± 9% softirqs.CPU0.NET_RX 25750 ± 3% +65.6% 42644 ± 4% softirqs.CPU0.RCU 20328 ± 3% -35.0% 13223 ± 12% softirqs.CPU0.SCHED 37369 ± 7% +133.3% 87171 ± 6% softirqs.CPU0.TIMER 31912 ± 3% +15.8% 36946 ± 3% softirqs.CPU1.NET_RX 25284 ± 3% +30.6% 33020 ± 5% softirqs.CPU1.RCU 13714 ± 6% -49.1% 6980 ± 19% softirqs.CPU1.SCHED 34149 ± 2% +152.8% 86315 ± 7% softirqs.CPU1.TIMER 26399 ± 6% +17.2% 30942 softirqs.CPU10.RCU 12548 ± 2% -55.1% 5632 ± 11% softirqs.CPU10.SCHED 35323 ± 4% +139.7% 84666 ± 5% softirqs.CPU10.TIMER 25143 ± 2% +19.6% 30077 ± 5% softirqs.CPU100.RCU 12459 ± 2% -56.4% 5433 ± 13% softirqs.CPU100.SCHED 32418 ± 2% +151.4% 81493 ± 5% softirqs.CPU100.TIMER 25322 ± 3% +18.6% 30025 ± 4% softirqs.CPU101.RCU 12470 ± 2% -56.1% 5469 ± 14% softirqs.CPU101.SCHED 32399 ± 2% +154.9% 82593 ± 4% softirqs.CPU101.TIMER 25472 ± 2% +20.5% 30684 ± 4% softirqs.CPU102.RCU 12454 ± 3% -55.5% 5547 ± 13% softirqs.CPU102.SCHED 32958 +151.0% 82723 ± 5% softirqs.CPU102.TIMER 25550 ± 3% +22.2% 31225 ± 3% softirqs.CPU103.RCU 12493 ± 2% -56.7% 5409 ± 11% softirqs.CPU103.SCHED 33039 ± 2% +149.2% 82342 ± 5% softirqs.CPU103.TIMER 24923 ± 4% +21.1% 30170 ± 6% softirqs.CPU104.RCU 12243 ± 2% -56.2% 5363 ± 13% softirqs.CPU104.SCHED 32210 ± 2% +153.9% 81777 ± 4% softirqs.CPU104.TIMER 26074 ± 2% +14.7% 29896 ± 6% softirqs.CPU105.RCU 12355 ± 3% -56.4% 5388 ± 15% softirqs.CPU105.SCHED 34417 ± 9% +139.3% 82348 ± 5% softirqs.CPU105.TIMER 25684 ± 4% +25.9% 32344 ± 2% softirqs.CPU106.RCU 12390 -56.5% 5387 ± 13% softirqs.CPU106.SCHED 32790 +151.5% 82464 ± 4% softirqs.CPU106.TIMER 25128 ± 3% +28.8% 32362 ± 5% softirqs.CPU107.RCU 12444 ± 2% -56.9% 5361 ± 13% softirqs.CPU107.SCHED 32345 ± 2% +155.4% 82618 ± 4% softirqs.CPU107.TIMER 23755 ± 3% +32.6% 31496 ± 5% softirqs.CPU108.RCU 12373 ± 2% -55.4% 5517 ± 15% softirqs.CPU108.SCHED 33050 ± 3% +179.8% 92462 ± 12% softirqs.CPU108.TIMER 23516 +31.0% 30814 ± 3% softirqs.CPU109.RCU 12349 ± 2% -55.8% 5460 ± 16% softirqs.CPU109.SCHED 32797 ± 2% +161.3% 85710 ± 5% softirqs.CPU109.TIMER 25703 ± 2% +18.3% 30410 ± 6% softirqs.CPU11.RCU 12474 -54.2% 5708 ± 13% softirqs.CPU11.SCHED 33668 ± 2% +160.5% 87707 ± 7% softirqs.CPU11.TIMER 23038 ± 2% +32.9% 30619 ± 9% softirqs.CPU110.RCU 12336 ± 3% -55.1% 5540 ± 16% softirqs.CPU110.SCHED 32045 ± 2% +164.3% 84710 ± 5% softirqs.CPU110.TIMER 23967 ± 3% +27.2% 30481 ± 7% softirqs.CPU111.RCU 12308 ± 2% -55.1% 5523 ± 15% softirqs.CPU111.SCHED 32611 ± 2% +161.9% 85416 ± 5% softirqs.CPU111.TIMER 25193 ± 3% +28.0% 32255 ± 6% softirqs.CPU112.RCU 12396 ± 2% -55.5% 5510 ± 16% softirqs.CPU112.SCHED 32633 ± 2% +156.9% 83844 ± 4% softirqs.CPU112.TIMER 24743 ± 3% +27.1% 31444 ± 3% softirqs.CPU113.RCU 12375 ± 2% -55.7% 5483 ± 15% softirqs.CPU113.SCHED 32609 ± 2% +159.6% 84657 ± 5% softirqs.CPU113.TIMER 24488 ± 3% +24.9% 30588 ± 7% softirqs.CPU114.RCU 12377 ± 2% -54.2% 5668 ± 19% softirqs.CPU114.SCHED 32643 ± 2% +162.4% 85657 ± 5% softirqs.CPU114.TIMER 24271 ± 3% +28.4% 31164 ± 3% softirqs.CPU115.RCU 12273 ± 2% -53.8% 5667 ± 19% softirqs.CPU115.SCHED 32206 ± 2% +163.9% 84983 ± 5% softirqs.CPU115.TIMER 24903 ± 4% +30.7% 32552 ± 3% softirqs.CPU116.RCU 12353 ± 3% -55.7% 5472 ± 17% softirqs.CPU116.SCHED 32840 ± 4% +158.1% 84768 ± 5% softirqs.CPU116.TIMER 24364 ± 2% +26.4% 30804 ± 6% softirqs.CPU117.RCU 12314 ± 2% -55.5% 5485 ± 15% softirqs.CPU117.SCHED 31930 ± 4% +164.2% 84363 ± 5% softirqs.CPU117.TIMER 24627 ± 3% +27.5% 31404 ± 4% softirqs.CPU118.RCU 12365 ± 2% -55.7% 5473 ± 15% softirqs.CPU118.SCHED 31975 ± 4% +160.6% 83333 ± 5% softirqs.CPU118.TIMER 24825 ± 4% +27.4% 31630 ± 5% softirqs.CPU119.RCU 12266 -53.9% 5650 ± 16% softirqs.CPU119.SCHED 32192 ± 3% +164.3% 85071 ± 5% softirqs.CPU119.TIMER 25821 ± 4% +19.8% 30931 ± 4% softirqs.CPU12.RCU 12707 ± 2% -53.7% 5878 ± 13% softirqs.CPU12.SCHED 34692 ± 2% +145.9% 85306 ± 7% softirqs.CPU12.TIMER 24807 ± 2% +26.0% 31248 ± 10% softirqs.CPU120.RCU 12444 ± 2% -55.3% 5568 ± 15% softirqs.CPU120.SCHED 32428 ± 3% +161.1% 84674 ± 4% softirqs.CPU120.TIMER 24771 +25.4% 31063 ± 9% softirqs.CPU121.RCU 12322 ± 2% -54.7% 5579 ± 15% softirqs.CPU121.SCHED 32272 ± 2% +161.7% 84444 ± 4% softirqs.CPU121.TIMER 24482 ± 2% +31.6% 32230 ± 8% softirqs.CPU122.RCU 12257 ± 2% -55.5% 5457 ± 16% softirqs.CPU122.SCHED 31758 ± 3% +162.0% 83196 ± 4% softirqs.CPU122.TIMER 24645 ± 3% +29.3% 31878 ± 3% softirqs.CPU123.RCU 12390 ± 3% -55.5% 5515 ± 15% softirqs.CPU123.SCHED 32175 ± 4% +183.2% 91115 ± 15% softirqs.CPU123.TIMER 25082 ± 3% +24.5% 31216 ± 8% softirqs.CPU124.RCU 12398 -56.0% 5459 ± 17% softirqs.CPU124.SCHED 32235 ± 3% +160.1% 83841 ± 5% softirqs.CPU124.TIMER 24621 ± 2% +24.8% 30738 ± 7% softirqs.CPU125.RCU 12363 ± 2% -55.6% 5483 ± 16% softirqs.CPU125.SCHED 32171 ± 4% +162.6% 84481 ± 5% softirqs.CPU125.TIMER 31223 ± 5% +20.6% 37645 ± 8% softirqs.CPU126.NET_RX 22603 ± 4% +34.1% 30309 ± 9% softirqs.CPU126.RCU 12355 ± 2% -52.5% 5873 ± 18% softirqs.CPU126.SCHED 37582 ± 11% +164.3% 99336 ± 6% softirqs.CPU126.TIMER 23450 ± 7% +24.2% 29116 ± 10% softirqs.CPU127.RCU 12362 ± 2% -54.6% 5614 ± 15% softirqs.CPU127.SCHED 44154 ± 21% +123.5% 98670 ± 6% softirqs.CPU127.TIMER 23999 ± 3% +35.2% 32438 ± 5% softirqs.CPU128.RCU 12366 ± 2% -55.3% 5523 ± 15% softirqs.CPU128.SCHED 37231 ± 14% +164.0% 98296 ± 7% softirqs.CPU128.TIMER 24373 ± 3% +25.1% 30493 ± 7% softirqs.CPU129.RCU 12634 ± 3% -56.5% 5495 ± 18% softirqs.CPU129.SCHED 37664 ± 13% +162.2% 98750 ± 6% softirqs.CPU129.TIMER 33317 ± 6% -12.6% 29128 ± 7% softirqs.CPU13.NET_RX 26300 ± 8% +16.3% 30595 ± 5% softirqs.CPU13.RCU 13017 ± 5% -55.0% 5858 ± 13% softirqs.CPU13.SCHED 34835 ± 2% +145.0% 85336 ± 6% softirqs.CPU13.TIMER 24219 ± 2% +32.1% 31986 ± 8% softirqs.CPU130.RCU 12431 ± 2% -56.0% 5467 ± 14% softirqs.CPU130.SCHED 37108 ± 13% +162.8% 97520 ± 7% softirqs.CPU130.TIMER 24429 ± 4% +25.6% 30694 ± 3% softirqs.CPU131.RCU 12559 -56.8% 5430 ± 17% softirqs.CPU131.SCHED 36837 ± 15% +166.7% 98253 ± 7% softirqs.CPU131.TIMER 24245 ± 2% +25.4% 30393 ± 9% softirqs.CPU132.RCU 12432 ± 2% -56.2% 5445 ± 13% softirqs.CPU132.SCHED 37438 ± 14% +162.6% 98318 ± 7% softirqs.CPU132.TIMER 24597 ± 2% +27.4% 31326 ± 2% softirqs.CPU133.RCU 12504 ± 3% -56.2% 5482 ± 17% softirqs.CPU133.SCHED 39667 ± 19% +147.3% 98103 ± 7% softirqs.CPU133.TIMER 24311 ± 3% +22.4% 29756 ± 6% softirqs.CPU134.RCU 12547 ± 2% -56.6% 5451 ± 11% softirqs.CPU134.SCHED 37851 ± 14% +159.2% 98094 ± 7% softirqs.CPU134.TIMER 31735 ± 2% -12.8% 27678 ± 7% softirqs.CPU135.NET_RX 24098 ± 3% +21.3% 29232 ± 5% softirqs.CPU135.RCU 12487 ± 2% -55.7% 5527 ± 16% softirqs.CPU135.SCHED 37463 ± 14% +160.5% 97600 ± 7% softirqs.CPU135.TIMER 24440 ± 3% +29.1% 31551 ± 9% softirqs.CPU136.RCU 12594 ± 2% -56.0% 5539 ± 18% softirqs.CPU136.SCHED 38038 ± 12% +157.0% 97762 ± 7% softirqs.CPU136.TIMER 24202 ± 3% +24.9% 30239 ± 6% softirqs.CPU137.RCU 12471 ± 3% -56.2% 5467 ± 14% softirqs.CPU137.SCHED 38252 ± 10% +156.1% 97951 ± 6% softirqs.CPU137.TIMER 24618 ± 4% +24.8% 30724 ± 5% softirqs.CPU138.RCU 12678 ± 4% -55.8% 5607 ± 15% softirqs.CPU138.SCHED 39122 ± 8% +151.0% 98204 ± 8% softirqs.CPU138.TIMER 24681 ± 3% +26.7% 31274 ± 8% softirqs.CPU139.RCU 12576 ± 3% -56.1% 5525 ± 14% softirqs.CPU139.SCHED 38070 ± 13% +157.3% 97959 ± 7% softirqs.CPU139.TIMER 25410 ± 4% +22.6% 31153 ± 2% softirqs.CPU14.RCU 12805 ± 4% -55.1% 5747 ± 14% softirqs.CPU14.SCHED 34196 ± 2% +147.7% 84702 ± 6% softirqs.CPU14.TIMER 24154 ± 3% +26.7% 30593 ± 10% softirqs.CPU140.RCU 12570 ± 2% -57.5% 5337 ± 12% softirqs.CPU140.SCHED 37627 ± 15% +157.9% 97044 ± 7% softirqs.CPU140.TIMER 24882 ± 3% +23.4% 30711 ± 6% softirqs.CPU141.RCU 12759 ± 4% -56.5% 5556 ± 13% softirqs.CPU141.SCHED 38871 ± 16% +152.5% 98160 ± 7% softirqs.CPU141.TIMER 23979 ± 3% +24.2% 29776 ± 5% softirqs.CPU142.RCU 12493 ± 3% -56.9% 5389 ± 12% softirqs.CPU142.SCHED 37695 ± 12% +164.2% 99594 ± 7% softirqs.CPU142.TIMER 23917 ± 2% +25.4% 29999 ± 7% softirqs.CPU143.RCU 12435 ± 2% -56.6% 5391 ± 14% softirqs.CPU143.SCHED 38245 ± 11% +156.5% 98081 ± 7% softirqs.CPU143.TIMER 25269 ± 2% +22.5% 30942 ± 8% softirqs.CPU15.RCU 12326 ± 2% -54.2% 5645 ± 13% softirqs.CPU15.SCHED 34078 +155.9% 87195 ± 9% softirqs.CPU15.TIMER 23649 +25.2% 29615 ± 7% softirqs.CPU16.RCU 12429 ± 2% -54.7% 5624 ± 13% softirqs.CPU16.SCHED 33946 +151.2% 85283 ± 6% softirqs.CPU16.TIMER 24702 ± 4% +18.6% 29299 ± 3% softirqs.CPU17.RCU 12455 -54.6% 5660 ± 11% softirqs.CPU17.SCHED 34325 +148.7% 85357 ± 6% softirqs.CPU17.TIMER 31995 ± 4% +94.3% 62171 ± 5% softirqs.CPU18.NET_RX 26260 ± 4% +59.7% 41930 ± 5% softirqs.CPU18.RCU 12296 ± 3% -57.2% 5265 ± 15% softirqs.CPU18.SCHED 36864 ± 10% +128.0% 84049 ± 4% softirqs.CPU18.TIMER 25159 ± 2% +23.2% 31001 ± 4% softirqs.CPU19.RCU 12367 ± 2% -56.4% 5390 ± 12% softirqs.CPU19.SCHED 33583 ± 2% +148.5% 83469 ± 5% softirqs.CPU19.TIMER 24997 ± 3% +38.4% 34583 ± 12% softirqs.CPU2.RCU 12730 ± 2% -55.1% 5716 ± 21% softirqs.CPU2.SCHED 33676 ± 4% +159.7% 87458 ± 10% softirqs.CPU2.TIMER 24932 ± 4% +28.4% 32003 ± 12% softirqs.CPU20.RCU 12382 ± 3% -56.0% 5444 ± 15% softirqs.CPU20.SCHED 33380 ± 2% +149.2% 83177 ± 6% softirqs.CPU20.TIMER 25467 ± 3% +18.2% 30107 ± 6% softirqs.CPU21.RCU 12395 ± 2% -56.3% 5417 ± 12% softirqs.CPU21.SCHED 33094 ± 2% +153.5% 83880 ± 4% softirqs.CPU21.TIMER 33570 ± 2% -14.3% 28773 ± 9% softirqs.CPU22.NET_RX 25440 ± 4% +16.0% 29506 ± 2% softirqs.CPU22.RCU 12423 ± 2% -56.8% 5362 ± 14% softirqs.CPU22.SCHED 38145 ± 19% +115.3% 82146 ± 5% softirqs.CPU22.TIMER 25340 ± 3% +19.9% 30384 ± 6% softirqs.CPU23.RCU 12412 ± 3% -56.8% 5358 ± 13% softirqs.CPU23.SCHED 33677 ± 2% +149.4% 83976 ± 5% softirqs.CPU23.TIMER 24832 ± 3% +23.2% 30599 ± 4% softirqs.CPU24.RCU 12385 ± 2% -55.6% 5502 ± 12% softirqs.CPU24.SCHED 33469 +152.2% 84414 ± 4% softirqs.CPU24.TIMER 25291 ± 4% +21.0% 30592 ± 3% softirqs.CPU25.RCU 12299 ± 2% -55.1% 5525 ± 13% softirqs.CPU25.SCHED 33236 ± 2% +149.9% 83042 ± 5% softirqs.CPU25.TIMER 25463 ± 2% +17.7% 29976 ± 7% softirqs.CPU26.RCU 12235 ± 2% -55.3% 5469 ± 14% softirqs.CPU26.SCHED 32816 ± 2% +154.5% 83526 ± 4% softirqs.CPU26.TIMER 25346 ± 3% +22.5% 31045 ± 6% softirqs.CPU27.RCU 12225 ± 2% -55.5% 5439 ± 12% softirqs.CPU27.SCHED 33150 +148.3% 82320 ± 5% softirqs.CPU27.TIMER 33575 ± 5% -8.8% 30604 ± 2% softirqs.CPU28.NET_RX 25703 ± 4% +18.8% 30526 ± 5% softirqs.CPU28.RCU 12411 ± 3% -56.5% 5400 ± 14% softirqs.CPU28.SCHED 33620 ± 2% +144.9% 82340 ± 5% softirqs.CPU28.TIMER 25519 ± 2% +22.5% 31271 ± 6% softirqs.CPU29.RCU 12363 ± 2% -55.2% 5535 ± 16% softirqs.CPU29.SCHED 33651 +148.4% 83582 ± 5% softirqs.CPU29.TIMER 25341 ± 3% +17.3% 29728 ± 5% softirqs.CPU3.RCU 12405 -52.4% 5899 ± 10% softirqs.CPU3.SCHED 33678 ± 2% +156.9% 86516 ± 6% softirqs.CPU3.TIMER 25488 ± 2% +20.0% 30592 ± 5% softirqs.CPU30.RCU 12336 -55.7% 5466 ± 13% softirqs.CPU30.SCHED 32846 ± 3% +152.9% 83059 ± 5% softirqs.CPU30.TIMER 25536 ± 2% +26.0% 32173 softirqs.CPU31.RCU 12357 -55.7% 5478 ± 13% softirqs.CPU31.SCHED 33083 ± 2% +152.1% 83413 ± 5% softirqs.CPU31.TIMER 24571 ± 3% +24.1% 30494 ± 9% softirqs.CPU32.RCU 12364 ± 2% -56.1% 5431 ± 13% softirqs.CPU32.SCHED 32769 ± 3% +151.8% 82504 ± 4% softirqs.CPU32.TIMER 24938 ± 3% +19.4% 29771 ± 2% softirqs.CPU33.RCU 12384 ± 2% -55.9% 5458 ± 14% softirqs.CPU33.SCHED 33569 ± 3% +149.0% 83579 ± 4% softirqs.CPU33.TIMER 24812 ± 4% +18.1% 29299 ± 8% softirqs.CPU34.RCU 12384 ± 2% -55.6% 5496 ± 14% softirqs.CPU34.SCHED 33229 ± 2% +151.6% 83602 ± 4% softirqs.CPU34.TIMER 24551 ± 2% +22.5% 30077 ± 2% softirqs.CPU35.RCU 12411 ± 2% -55.5% 5524 ± 14% softirqs.CPU35.SCHED 33771 +146.9% 83367 ± 4% softirqs.CPU35.TIMER 32072 ± 3% +81.5% 58225 ± 8% softirqs.CPU36.NET_RX 25820 ± 2% +59.4% 41152 softirqs.CPU36.RCU 12557 ± 4% -56.5% 5459 ± 14% softirqs.CPU36.SCHED 33668 ± 4% +160.0% 87543 ± 5% softirqs.CPU36.TIMER 24726 ± 2% +32.0% 32645 ± 6% softirqs.CPU37.RCU 12326 ± 2% -54.8% 5570 ± 16% softirqs.CPU37.SCHED 33194 ± 4% +159.6% 86175 ± 5% softirqs.CPU37.TIMER 25066 ± 3% +29.2% 32397 ± 6% softirqs.CPU38.RCU 12283 ± 3% -54.7% 5568 ± 15% softirqs.CPU38.SCHED 33226 ± 2% +157.1% 85426 ± 4% softirqs.CPU38.TIMER 24749 ± 3% +27.2% 31473 ± 5% softirqs.CPU39.RCU 12328 -55.6% 5477 ± 16% softirqs.CPU39.SCHED 32755 ± 3% +162.0% 85811 ± 5% softirqs.CPU39.TIMER 24990 ± 5% +23.5% 30870 ± 6% softirqs.CPU4.RCU 12393 -56.8% 5352 ± 6% softirqs.CPU4.SCHED 32946 ± 5% +153.0% 83346 ± 5% softirqs.CPU4.TIMER 25307 ± 2% +27.7% 32324 ± 3% softirqs.CPU40.RCU 12277 -53.3% 5738 ± 12% softirqs.CPU40.SCHED 32794 ± 3% +159.3% 85027 ± 3% softirqs.CPU40.TIMER 30896 ± 4% +11.1% 34340 ± 5% softirqs.CPU41.NET_RX 24935 ± 2% +34.1% 33448 ± 7% softirqs.CPU41.RCU 12320 ± 2% -54.5% 5608 ± 13% softirqs.CPU41.SCHED 33265 ± 2% +157.2% 85575 ± 4% softirqs.CPU41.TIMER 24661 ± 2% +25.1% 30854 ± 8% softirqs.CPU42.RCU 12278 ± 2% -55.3% 5487 ± 16% softirqs.CPU42.SCHED 32778 ± 3% +161.3% 85661 ± 5% softirqs.CPU42.TIMER 24566 ± 2% +28.1% 31473 ± 3% softirqs.CPU43.RCU 12242 ± 2% -54.4% 5577 ± 19% softirqs.CPU43.SCHED 32626 ± 3% +162.9% 85779 ± 5% softirqs.CPU43.TIMER 30441 ± 2% +11.1% 33834 ± 6% softirqs.CPU44.NET_RX 24563 ± 3% +26.6% 31087 ± 3% softirqs.CPU44.RCU 12313 ± 2% -55.5% 5478 ± 16% softirqs.CPU44.SCHED 32594 ± 3% +162.1% 85414 ± 5% softirqs.CPU44.TIMER 25759 ± 4% +24.2% 31984 ± 4% softirqs.CPU45.RCU 12710 ± 5% -56.7% 5506 ± 15% softirqs.CPU45.SCHED 33873 ± 3% +151.4% 85154 ± 6% softirqs.CPU45.TIMER 25371 ± 2% +28.6% 32621 ± 2% softirqs.CPU46.RCU 12409 ± 2% -55.2% 5557 ± 18% softirqs.CPU46.SCHED 33206 ± 3% +152.8% 83929 ± 5% softirqs.CPU46.TIMER 25293 ± 2% +19.1% 30134 ± 5% softirqs.CPU47.RCU 12304 ± 2% -55.3% 5494 ± 16% softirqs.CPU47.SCHED 33288 ± 2% +155.2% 84939 ± 5% softirqs.CPU47.TIMER 24001 ± 3% +28.3% 30804 ± 6% softirqs.CPU48.RCU 12341 ± 2% -54.5% 5612 ± 14% softirqs.CPU48.SCHED 33479 ± 4% +155.4% 85508 ± 5% softirqs.CPU48.TIMER 24079 ± 3% +31.6% 31700 ± 8% softirqs.CPU49.RCU 12360 -54.6% 5610 ± 15% softirqs.CPU49.SCHED 33434 ± 2% +154.6% 85128 ± 4% softirqs.CPU49.TIMER 24605 ± 2% +26.0% 31012 ± 3% softirqs.CPU5.RCU 12536 ± 2% -51.6% 6071 ± 13% softirqs.CPU5.SCHED 34365 ± 3% +158.0% 88648 ± 10% softirqs.CPU5.TIMER 23755 ± 2% +24.1% 29477 ± 4% softirqs.CPU50.RCU 12394 ± 2% -55.3% 5536 ± 16% softirqs.CPU50.SCHED 33343 +153.2% 84412 ± 4% softirqs.CPU50.TIMER 24374 ± 6% +26.9% 30925 ± 6% softirqs.CPU51.RCU 12405 ± 2% -53.1% 5814 ± 15% softirqs.CPU51.SCHED 33535 ± 2% +163.6% 88395 ± 8% softirqs.CPU51.TIMER 24270 ± 2% +26.2% 30632 ± 6% softirqs.CPU52.RCU 12319 ± 2% -54.8% 5569 ± 16% softirqs.CPU52.SCHED 33518 ± 2% +153.5% 84968 ± 5% softirqs.CPU52.TIMER 30320 ± 3% -8.2% 27849 ± 5% softirqs.CPU53.NET_RX 23715 ± 2% +22.8% 29125 ± 10% softirqs.CPU53.RCU 12397 ± 3% -54.3% 5667 ± 18% softirqs.CPU53.SCHED 33405 ± 2% +156.5% 85693 ± 6% softirqs.CPU53.TIMER 32876 ± 3% +98.1% 65128 ± 9% softirqs.CPU54.NET_RX 25008 ± 4% +66.7% 41693 ± 7% softirqs.CPU54.RCU 12325 -56.7% 5334 ± 15% softirqs.CPU54.SCHED 34551 ± 2% +157.6% 89019 ± 6% softirqs.CPU54.TIMER 32785 ± 4% +11.9% 36680 ± 3% softirqs.CPU55.NET_RX 24005 ± 3% +33.3% 31993 ± 9% softirqs.CPU55.RCU 12510 ± 2% -55.1% 5611 ± 15% softirqs.CPU55.SCHED 39075 ± 12% +155.0% 99633 ± 5% softirqs.CPU55.TIMER 24202 ± 4% +28.5% 31109 ± 2% softirqs.CPU56.RCU 12395 ± 2% -54.8% 5607 ± 13% softirqs.CPU56.SCHED 38231 ± 12% +158.9% 98988 ± 6% softirqs.CPU56.TIMER 24667 ± 3% +26.5% 31198 ± 4% softirqs.CPU57.RCU 12499 ± 3% -55.8% 5519 ± 14% softirqs.CPU57.SCHED 38696 ± 12% +157.4% 99601 ± 5% softirqs.CPU57.TIMER 24866 ± 5% +26.0% 31330 ± 5% softirqs.CPU58.RCU 12374 ± 2% -54.9% 5575 ± 13% softirqs.CPU58.SCHED 38791 ± 12% +153.1% 98188 ± 7% softirqs.CPU58.TIMER 24839 ± 6% +22.8% 30495 ± 4% softirqs.CPU59.RCU 12474 ± 3% -55.8% 5515 ± 14% softirqs.CPU59.SCHED 42078 ± 11% +136.7% 99581 ± 6% softirqs.CPU59.TIMER 25261 ± 3% +20.9% 30550 ± 6% softirqs.CPU6.RCU 12514 ± 2% -55.3% 5598 ± 13% softirqs.CPU6.SCHED 34379 ± 4% +150.5% 86123 ± 7% softirqs.CPU6.TIMER 12439 ± 3% -54.4% 5667 ± 15% softirqs.CPU60.SCHED 38447 ± 11% +158.7% 99446 ± 7% softirqs.CPU60.TIMER 24407 ± 4% +18.9% 29027 ± 5% softirqs.CPU61.RCU 12582 ± 5% -54.6% 5716 ± 16% softirqs.CPU61.SCHED 38922 ± 9% +155.7% 99542 ± 7% softirqs.CPU61.TIMER 24565 ± 4% +21.8% 29930 ± 7% softirqs.CPU62.RCU 12282 ± 2% -55.1% 5519 ± 14% softirqs.CPU62.SCHED 38075 ± 12% +160.8% 99295 ± 7% softirqs.CPU62.TIMER 24648 ± 4% +17.7% 29011 ± 3% softirqs.CPU63.RCU 12544 ± 5% -55.8% 5547 ± 15% softirqs.CPU63.SCHED 38918 ± 10% +152.8% 98394 ± 7% softirqs.CPU63.TIMER 24479 ± 5% +26.7% 31023 ± 13% softirqs.CPU64.RCU 12473 ± 2% -54.3% 5695 ± 15% softirqs.CPU64.SCHED 38474 ± 13% +156.7% 98776 ± 7% softirqs.CPU64.TIMER 24429 ± 4% +23.3% 30129 ± 2% softirqs.CPU65.RCU 12704 ± 4% -56.7% 5497 ± 14% softirqs.CPU65.SCHED 38643 ± 11% +154.9% 98520 ± 6% softirqs.CPU65.TIMER 24787 ± 4% +21.4% 30081 ± 6% softirqs.CPU66.RCU 12588 ± 4% -55.6% 5589 ± 16% softirqs.CPU66.SCHED 39036 ± 10% +158.1% 100735 ± 5% softirqs.CPU66.TIMER 24723 ± 4% +22.6% 30308 ± 9% softirqs.CPU67.RCU 12439 ± 2% -56.1% 5458 ± 15% softirqs.CPU67.SCHED 38821 ± 10% +153.4% 98378 ± 7% softirqs.CPU67.TIMER 24813 ± 4% +20.6% 29934 ± 4% softirqs.CPU68.RCU 12586 ± 2% -55.5% 5599 ± 14% softirqs.CPU68.SCHED 38944 ± 12% +152.3% 98255 ± 7% softirqs.CPU68.TIMER 24697 ± 4% +29.3% 31943 ± 7% softirqs.CPU69.RCU 12509 ± 2% -53.1% 5869 ± 23% softirqs.CPU69.SCHED 38941 ± 10% +156.2% 99753 ± 7% softirqs.CPU69.TIMER 25443 ± 3% +25.4% 31916 ± 7% softirqs.CPU7.RCU 12570 ± 3% -55.7% 5572 ± 13% softirqs.CPU7.SCHED 34146 ± 2% +152.0% 86064 ± 6% softirqs.CPU7.TIMER 32980 ± 3% -14.7% 28128 ± 9% softirqs.CPU70.NET_RX 24157 ± 2% +18.5% 28622 ± 9% softirqs.CPU70.RCU 12383 ± 3% -55.8% 5473 ± 14% softirqs.CPU70.SCHED 38873 ± 10% +155.1% 99169 ± 7% softirqs.CPU70.TIMER 24254 ± 2% +25.8% 30512 ± 7% softirqs.CPU71.RCU 12376 ± 2% -54.8% 5598 ± 15% softirqs.CPU71.SCHED 37906 ± 13% +161.4% 99094 ± 7% softirqs.CPU71.TIMER 31898 ± 3% +23.1% 39263 ± 9% softirqs.CPU72.NET_RX 24278 ± 5% +33.4% 32393 ± 5% softirqs.CPU72.RCU 12465 -54.8% 5631 ± 15% softirqs.CPU72.SCHED 32586 +163.6% 85886 ± 6% softirqs.CPU72.TIMER 27780 ± 9% +16.3% 32314 ± 7% softirqs.CPU73.RCU 12403 ± 2% -53.4% 5785 ± 13% softirqs.CPU73.SCHED 36040 ± 5% +143.7% 87844 ± 5% softirqs.CPU73.TIMER 23989 ± 4% +27.9% 30677 ± 5% softirqs.CPU74.RCU 12300 -49.4% 6223 ± 22% softirqs.CPU74.SCHED 31895 ± 2% +170.7% 86324 ± 7% softirqs.CPU74.TIMER 24332 ± 4% +19.4% 29041 softirqs.CPU75.RCU 12434 -53.9% 5737 ± 13% softirqs.CPU75.SCHED 32669 ± 2% +162.9% 85881 ± 6% softirqs.CPU75.TIMER 25053 ± 4% +24.7% 31240 ± 3% softirqs.CPU76.RCU 12498 ± 2% -48.5% 6440 ± 25% softirqs.CPU76.SCHED 36276 ± 18% +136.1% 85630 ± 8% softirqs.CPU76.TIMER 25060 ± 9% +18.7% 29735 ± 4% softirqs.CPU77.RCU 12479 ± 2% -56.4% 5439 ± 15% softirqs.CPU77.SCHED 32803 ± 2% +157.3% 84404 ± 6% softirqs.CPU77.TIMER 12575 ± 3% -55.4% 5608 ± 14% softirqs.CPU78.SCHED 33039 ± 2% +157.3% 85014 ± 7% softirqs.CPU78.TIMER 25286 ± 5% +18.1% 29867 softirqs.CPU79.RCU 12319 ± 2% -54.1% 5652 ± 13% softirqs.CPU79.SCHED 32309 ± 2% +163.0% 84986 ± 6% softirqs.CPU79.TIMER 25062 ± 3% +22.8% 30769 ± 4% softirqs.CPU8.RCU 12517 -55.0% 5633 ± 15% softirqs.CPU8.SCHED 33490 ± 3% +156.2% 85788 ± 7% softirqs.CPU8.TIMER 24852 ± 4% +30.3% 32388 ± 3% softirqs.CPU80.RCU 12514 ± 2% -51.0% 6136 ± 15% softirqs.CPU80.SCHED 33319 ± 2% +159.1% 86322 ± 4% softirqs.CPU80.TIMER 24972 ± 4% +16.2% 29009 ± 8% softirqs.CPU81.RCU 13857 ± 10% -60.0% 5544 ± 11% softirqs.CPU81.SCHED 35077 ± 5% +137.9% 83463 ± 6% softirqs.CPU81.TIMER 24711 ± 3% +30.2% 32172 ± 8% softirqs.CPU82.RCU 12400 ± 2% -55.2% 5557 ± 14% softirqs.CPU82.SCHED 32519 ± 2% +156.4% 83394 ± 6% softirqs.CPU82.TIMER 13059 ± 6% -54.7% 5912 ± 9% softirqs.CPU83.SCHED 34822 ± 4% +158.2% 89895 ± 11% softirqs.CPU83.TIMER 25100 ± 3% +17.9% 29580 ± 3% softirqs.CPU84.RCU 12535 -55.3% 5607 ± 15% softirqs.CPU84.SCHED 33397 ± 2% +152.9% 84462 ± 7% softirqs.CPU84.TIMER 33036 ± 5% -13.9% 28446 ± 5% softirqs.CPU85.NET_RX 24969 ± 4% +14.9% 28697 ± 2% softirqs.CPU85.RCU 12465 ± 2% -54.0% 5736 ± 14% softirqs.CPU85.SCHED 32993 +155.5% 84309 ± 6% softirqs.CPU85.TIMER 24582 ± 4% +23.7% 30397 ± 2% softirqs.CPU86.RCU 12293 ± 2% -52.5% 5845 ± 16% softirqs.CPU86.SCHED 32198 ± 2% +162.4% 84498 ± 7% softirqs.CPU86.TIMER 32954 ± 5% -12.9% 28697 ± 9% softirqs.CPU87.NET_RX 25088 ± 4% +18.3% 29667 ± 9% softirqs.CPU87.RCU 12446 -54.9% 5608 ± 13% softirqs.CPU87.SCHED 33015 ± 3% +168.8% 88751 ± 13% softirqs.CPU87.TIMER 32693 ± 3% -11.0% 29093 ± 5% softirqs.CPU88.NET_RX 25086 ± 3% +16.9% 29318 ± 7% softirqs.CPU88.RCU 12412 ± 2% -54.9% 5596 ± 14% softirqs.CPU88.SCHED 33007 ± 3% +155.7% 84397 ± 6% softirqs.CPU88.TIMER 24775 ± 4% +25.9% 31189 ± 8% softirqs.CPU89.RCU 12329 -55.4% 5498 ± 13% softirqs.CPU89.SCHED 32786 ± 3% +155.6% 83807 ± 7% softirqs.CPU89.TIMER 33053 ± 3% -10.6% 29547 ± 3% softirqs.CPU9.NET_RX 25107 ± 3% +19.9% 30103 ± 2% softirqs.CPU9.RCU 12470 -55.0% 5606 ± 13% softirqs.CPU9.SCHED 34011 ± 2% +147.4% 84151 ± 6% softirqs.CPU9.TIMER 32164 ± 5% +11.2% 35766 ± 6% softirqs.CPU90.NET_RX 24513 ± 3% +28.7% 31545 ± 4% softirqs.CPU90.RCU 12275 ± 3% -55.5% 5459 ± 14% softirqs.CPU90.SCHED 33136 ± 2% +153.3% 83935 ± 5% softirqs.CPU90.TIMER 32802 ± 3% -12.3% 28754 ± 2% softirqs.CPU91.NET_RX 24498 ± 2% +17.9% 28895 ± 6% softirqs.CPU91.RCU 12376 ± 3% -56.4% 5396 ± 13% softirqs.CPU91.SCHED 32573 ± 2% +154.0% 82744 ± 5% softirqs.CPU91.TIMER 24643 ± 3% +19.6% 29465 ± 3% softirqs.CPU92.RCU 12629 ± 4% -56.7% 5463 ± 13% softirqs.CPU92.SCHED 32498 ± 2% +154.1% 82575 ± 5% softirqs.CPU92.TIMER 24627 ± 4% +20.5% 29665 ± 3% softirqs.CPU93.RCU 12443 ± 2% -55.5% 5538 ± 14% softirqs.CPU93.SCHED 32968 +151.7% 82971 ± 5% softirqs.CPU93.TIMER 34124 ± 2% -14.9% 29023 ± 2% softirqs.CPU94.NET_RX 24500 ± 5% +11.1% 27211 ± 2% softirqs.CPU94.RCU 12331 ± 2% -56.7% 5343 ± 15% softirqs.CPU94.SCHED 31209 ± 5% +161.3% 81554 ± 5% softirqs.CPU94.TIMER 32934 ± 6% -14.7% 28101 ± 3% softirqs.CPU95.NET_RX 25125 ± 4% +15.1% 28927 ± 2% softirqs.CPU95.RCU 12275 ± 3% -56.0% 5405 ± 14% softirqs.CPU95.SCHED 33131 ± 3% +151.2% 83223 ± 5% softirqs.CPU95.TIMER 24832 ± 5% +21.4% 30137 ± 9% softirqs.CPU96.RCU 12301 ± 2% -55.8% 5432 ± 14% softirqs.CPU96.SCHED 32182 ± 2% +158.9% 83322 ± 5% softirqs.CPU96.TIMER 12506 ± 3% -56.2% 5481 ± 13% softirqs.CPU97.SCHED 32882 ± 4% +150.4% 82335 ± 5% softirqs.CPU97.TIMER 33806 -11.9% 29771 ± 3% softirqs.CPU98.NET_RX 25259 ± 4% +16.4% 29414 softirqs.CPU98.RCU 12336 ± 2% -56.2% 5405 ± 15% softirqs.CPU98.SCHED 32285 ± 2% +156.2% 82712 ± 4% softirqs.CPU98.TIMER 25763 ± 9% +17.8% 30347 ± 4% softirqs.CPU99.RCU 12423 ± 2% -55.3% 5558 ± 13% softirqs.CPU99.SCHED 32330 +153.5% 81964 ± 5% softirqs.CPU99.TIMER 3573955 ± 3% +24.8% 4460974 softirqs.RCU 1800999 ± 2% -55.0% 810187 ± 14% softirqs.SCHED 4978716 ± 2% +154.9% 12690950 ± 4% softirqs.TIMER 45.50 ± 3% +133.0% 106.00 ± 2% interrupts.100:PCI-MSI.1572919-edge.eth0-TxRx-55 46.25 ± 4% +127.6% 105.25 ± 3% interrupts.101:PCI-MSI.1572920-edge.eth0-TxRx-56 45.25 ± 3% +135.4% 106.50 ± 7% interrupts.102:PCI-MSI.1572921-edge.eth0-TxRx-57 44.50 +133.1% 103.75 ± 3% interrupts.104:PCI-MSI.1572923-edge.eth0-TxRx-59 45.75 ± 3% +126.8% 103.75 ± 3% interrupts.105:PCI-MSI.1572924-edge.eth0-TxRx-60 45.75 ± 5% +128.4% 104.50 ± 4% interrupts.106:PCI-MSI.1572925-edge.eth0-TxRx-61 45.00 ± 2% +131.1% 104.00 ± 3% interrupts.107:PCI-MSI.1572926-edge.eth0-TxRx-62 97.00 ± 14% +283.2% 371.75 ± 24% interrupts.45:PCI-MSI.1572864-edge.eth0-TxRx-0 51.75 ± 5% +147.8% 128.25 ± 16% interrupts.46:PCI-MSI.1572865-edge.eth0-TxRx-1 59.75 ± 33% +4689.1% 2861 ±164% interrupts.47:PCI-MSI.1572866-edge.eth0-TxRx-2 88.25 ± 73% +8940.2% 7978 ±169% interrupts.48:PCI-MSI.1572867-edge.eth0-TxRx-3 49.50 ± 7% +1902.5% 991.25 ±153% interrupts.49:PCI-MSI.1572868-edge.eth0-TxRx-4 51.00 ± 11% +130.9% 117.75 ± 7% interrupts.50:PCI-MSI.1572869-edge.eth0-TxRx-5 49.00 ± 11% +176.0% 135.25 ± 20% interrupts.51:PCI-MSI.1572870-edge.eth0-TxRx-6 48.75 ± 9% +137.4% 115.75 ± 12% interrupts.53:PCI-MSI.1572872-edge.eth0-TxRx-8 49.25 ± 4% +120.3% 108.50 ± 4% interrupts.54:PCI-MSI.1572873-edge.eth0-TxRx-9 54.75 ± 19% +98.6% 108.75 ± 2% interrupts.55:PCI-MSI.1572874-edge.eth0-TxRx-10 60.75 ± 22% +153.1% 153.75 ± 44% interrupts.56:PCI-MSI.1572875-edge.eth0-TxRx-11 50.50 ± 13% +115.8% 109.00 ± 3% interrupts.57:PCI-MSI.1572876-edge.eth0-TxRx-12 52.00 ± 9% +114.4% 111.50 ± 7% interrupts.58:PCI-MSI.1572877-edge.eth0-TxRx-13 47.00 ± 2% +223.4% 152.00 ± 44% interrupts.59:PCI-MSI.1572878-edge.eth0-TxRx-14 44.50 +146.1% 109.50 ± 5% interrupts.61:PCI-MSI.1572880-edge.eth0-TxRx-16 46.75 ± 5% +133.7% 109.25 interrupts.62:PCI-MSI.1572881-edge.eth0-TxRx-17 45.00 ± 2% +148.9% 112.00 ± 9% interrupts.63:PCI-MSI.1572882-edge.eth0-TxRx-18 44.25 +140.7% 106.50 ± 4% interrupts.64:PCI-MSI.1572883-edge.eth0-TxRx-19 44.75 ± 2% +131.8% 103.75 ± 3% interrupts.65:PCI-MSI.1572884-edge.eth0-TxRx-20 44.25 +134.5% 103.75 ± 3% interrupts.66:PCI-MSI.1572885-edge.eth0-TxRx-21 44.25 +139.5% 106.00 ± 6% interrupts.67:PCI-MSI.1572886-edge.eth0-TxRx-22 45.50 ± 3% +134.1% 106.50 interrupts.68:PCI-MSI.1572887-edge.eth0-TxRx-23 44.25 +134.5% 103.75 ± 3% interrupts.69:PCI-MSI.1572888-edge.eth0-TxRx-24 44.50 +144.4% 108.75 ± 8% interrupts.70:PCI-MSI.1572889-edge.eth0-TxRx-25 56.00 ± 34% +87.1% 104.75 ± 4% interrupts.72:PCI-MSI.1572891-edge.eth0-TxRx-27 44.25 +137.3% 105.00 ± 2% interrupts.73:PCI-MSI.1572892-edge.eth0-TxRx-28 44.25 +135.0% 104.00 ± 3% interrupts.74:PCI-MSI.1572893-edge.eth0-TxRx-29 45.25 ± 4% +130.4% 104.25 ± 4% interrupts.75:PCI-MSI.1572894-edge.eth0-TxRx-30 45.00 ± 3% +213.3% 141.00 ± 47% interrupts.76:PCI-MSI.1572895-edge.eth0-TxRx-31 60.75 ± 26% +77.8% 108.00 ± 5% interrupts.77:PCI-MSI.1572896-edge.eth0-TxRx-32 44.75 +132.4% 104.00 ± 3% interrupts.78:PCI-MSI.1572897-edge.eth0-TxRx-33 49.00 ± 11% +111.7% 103.75 ± 3% interrupts.79:PCI-MSI.1572898-edge.eth0-TxRx-34 45.00 ± 3% +132.8% 104.75 ± 2% interrupts.80:PCI-MSI.1572899-edge.eth0-TxRx-35 77.50 ± 68% +215.8% 244.75 ± 31% interrupts.81:PCI-MSI.1572900-edge.eth0-TxRx-36 45.50 ± 4% +170.9% 123.25 ± 18% interrupts.82:PCI-MSI.1572901-edge.eth0-TxRx-37 45.75 ± 4% +136.6% 108.25 ± 4% interrupts.83:PCI-MSI.1572902-edge.eth0-TxRx-38 45.75 ± 5% +135.5% 107.75 ± 5% interrupts.84:PCI-MSI.1572903-edge.eth0-TxRx-39 44.50 +144.9% 109.00 ± 8% interrupts.85:PCI-MSI.1572904-edge.eth0-TxRx-40 46.50 ± 5% +186.0% 133.00 ± 35% interrupts.86:PCI-MSI.1572905-edge.eth0-TxRx-41 50.50 ± 12% +107.4% 104.75 ± 3% interrupts.87:PCI-MSI.1572906-edge.eth0-TxRx-42 45.00 +130.6% 103.75 ± 3% interrupts.88:PCI-MSI.1572907-edge.eth0-TxRx-43 45.00 ± 2% +132.2% 104.50 ± 3% interrupts.89:PCI-MSI.1572908-edge.eth0-TxRx-44 48.00 ± 10% +129.2% 110.00 ± 5% interrupts.90:PCI-MSI.1572909-edge.eth0-TxRx-45 44.75 +143.0% 108.75 ± 5% interrupts.91:PCI-MSI.1572910-edge.eth0-TxRx-46 45.25 ± 3% +149.2% 112.75 ± 15% interrupts.92:PCI-MSI.1572911-edge.eth0-TxRx-47 46.25 ± 6% +124.3% 103.75 ± 3% interrupts.93:PCI-MSI.1572912-edge.eth0-TxRx-48 44.75 +256.4% 159.50 ± 58% interrupts.94:PCI-MSI.1572913-edge.eth0-TxRx-49 44.25 +136.7% 104.75 ± 2% interrupts.95:PCI-MSI.1572914-edge.eth0-TxRx-50 45.00 +135.6% 106.00 ± 6% interrupts.96:PCI-MSI.1572915-edge.eth0-TxRx-51 50.50 ± 9% +124.8% 113.50 ± 11% interrupts.97:PCI-MSI.1572916-edge.eth0-TxRx-52 45.25 ± 3% +138.7% 108.00 ± 4% interrupts.99:PCI-MSI.1572918-edge.eth0-TxRx-54 303647 ± 3% +15.6% 351165 ± 3% interrupts.CAL:Function_call_interrupts 97.00 ± 14% +283.2% 371.75 ± 24% interrupts.CPU0.45:PCI-MSI.1572864-edge.eth0-TxRx-0 2103 ± 5% +19.6% 2516 ± 6% interrupts.CPU0.CAL:Function_call_interrupts 178949 ± 2% +137.0% 424057 ± 3% interrupts.CPU0.LOC:Local_timer_interrupts 3078 ± 21% +164.6% 8147 ± 12% interrupts.CPU0.RES:Rescheduling_interrupts 731.25 ± 10% -76.9% 169.00 ± 12% interrupts.CPU0.TLB:TLB_shootdowns 51.75 ± 5% +147.8% 128.25 ± 16% interrupts.CPU1.46:PCI-MSI.1572865-edge.eth0-TxRx-1 178545 ± 2% +137.3% 423660 ± 3% interrupts.CPU1.LOC:Local_timer_interrupts 2492 ± 14% +98.1% 4938 ± 9% interrupts.CPU1.RES:Rescheduling_interrupts 724.25 ± 7% -81.6% 133.25 ± 16% interrupts.CPU1.TLB:TLB_shootdowns 54.75 ± 19% +98.6% 108.75 ± 2% interrupts.CPU10.55:PCI-MSI.1572874-edge.eth0-TxRx-10 179172 ± 2% +136.0% 422769 ± 3% interrupts.CPU10.LOC:Local_timer_interrupts 2039 ± 10% +105.9% 4199 ± 3% interrupts.CPU10.RES:Rescheduling_interrupts 758.75 ± 4% -83.5% 125.50 ± 19% interrupts.CPU10.TLB:TLB_shootdowns 2151 ± 3% +16.6% 2509 ± 4% interrupts.CPU100.CAL:Function_call_interrupts 178672 ± 2% +136.9% 423205 ± 3% interrupts.CPU100.LOC:Local_timer_interrupts 2101 ± 10% +107.4% 4357 ± 11% interrupts.CPU100.RES:Rescheduling_interrupts 779.50 ± 5% -84.7% 119.00 ± 9% interrupts.CPU100.TLB:TLB_shootdowns 2166 ± 2% +14.0% 2469 ± 5% interrupts.CPU101.CAL:Function_call_interrupts 177947 ± 2% +137.9% 423334 ± 3% interrupts.CPU101.LOC:Local_timer_interrupts 2046 ± 6% +108.5% 4267 ± 7% interrupts.CPU101.RES:Rescheduling_interrupts 749.25 ± 6% -83.6% 123.00 ± 16% interrupts.CPU101.TLB:TLB_shootdowns 2117 ± 2% +17.9% 2495 ± 2% interrupts.CPU102.CAL:Function_call_interrupts 178507 ± 2% +137.2% 423358 ± 3% interrupts.CPU102.LOC:Local_timer_interrupts 1977 ± 5% +124.3% 4435 ± 9% interrupts.CPU102.RES:Rescheduling_interrupts 760.50 ± 4% -83.5% 125.25 ± 7% interrupts.CPU102.TLB:TLB_shootdowns 2120 ± 3% +18.2% 2506 ± 3% interrupts.CPU103.CAL:Function_call_interrupts 178497 ± 2% +137.0% 423096 ± 3% interrupts.CPU103.LOC:Local_timer_interrupts 0.25 ±173% +1.4e+06% 3573 ± 61% interrupts.CPU103.NMI:Non-maskable_interrupts 0.25 ±173% +1.4e+06% 3573 ± 61% interrupts.CPU103.PMI:Performance_monitoring_interrupts 1934 ± 7% +137.7% 4596 ± 9% interrupts.CPU103.RES:Rescheduling_interrupts 761.25 ± 8% -84.3% 119.75 ± 18% interrupts.CPU103.TLB:TLB_shootdowns 2104 ± 4% +13.4% 2386 ± 2% interrupts.CPU104.CAL:Function_call_interrupts 178180 ± 2% +137.6% 423359 ± 3% interrupts.CPU104.LOC:Local_timer_interrupts 1936 ± 5% +130.4% 4460 ± 13% interrupts.CPU104.RES:Rescheduling_interrupts 741.50 ± 6% -80.9% 141.50 ± 10% interrupts.CPU104.TLB:TLB_shootdowns 2179 ± 2% +14.8% 2501 ± 2% interrupts.CPU105.CAL:Function_call_interrupts 178498 ± 2% +137.1% 423132 ± 3% interrupts.CPU105.LOC:Local_timer_interrupts 0.00 +4.2e+105% 4182 ± 69% interrupts.CPU105.NMI:Non-maskable_interrupts 0.00 +4.2e+105% 4182 ± 69% interrupts.CPU105.PMI:Performance_monitoring_interrupts 2077 ± 6% +100.9% 4171 ± 7% interrupts.CPU105.RES:Rescheduling_interrupts 779.50 ± 8% -79.2% 162.00 ± 15% interrupts.CPU105.TLB:TLB_shootdowns 2099 ± 3% +16.7% 2450 ± 4% interrupts.CPU106.CAL:Function_call_interrupts 178191 ± 2% +137.4% 423101 ± 3% interrupts.CPU106.LOC:Local_timer_interrupts 1954 ± 7% +128.7% 4470 ± 4% interrupts.CPU106.RES:Rescheduling_interrupts 730.50 ± 5% -70.8% 213.50 ± 21% interrupts.CPU106.TLB:TLB_shootdowns 2132 ± 3% +17.8% 2511 ± 4% interrupts.CPU107.CAL:Function_call_interrupts 178459 ± 2% +137.4% 423628 ± 3% interrupts.CPU107.LOC:Local_timer_interrupts 1984 ± 6% +123.9% 4441 ± 8% interrupts.CPU107.RES:Rescheduling_interrupts 704.25 ± 9% -57.7% 297.75 ± 17% interrupts.CPU107.TLB:TLB_shootdowns 2156 ± 4% +12.1% 2417 ± 2% interrupts.CPU108.CAL:Function_call_interrupts 178202 ± 2% +137.5% 423217 ± 3% interrupts.CPU108.LOC:Local_timer_interrupts 2045 ± 9% +123.8% 4577 ± 6% interrupts.CPU108.RES:Rescheduling_interrupts 776.25 ± 10% -82.7% 134.00 ± 12% interrupts.CPU108.TLB:TLB_shootdowns 2186 +14.8% 2510 ± 6% interrupts.CPU109.CAL:Function_call_interrupts 178180 ± 2% +137.8% 423679 ± 4% interrupts.CPU109.LOC:Local_timer_interrupts 2028 ± 11% +122.5% 4513 ± 2% interrupts.CPU109.RES:Rescheduling_interrupts 798.50 ± 6% -82.0% 143.75 ± 4% interrupts.CPU109.TLB:TLB_shootdowns 60.75 ± 22% +153.1% 153.75 ± 44% interrupts.CPU11.56:PCI-MSI.1572875-edge.eth0-TxRx-11 2157 ± 2% +11.0% 2394 ± 4% interrupts.CPU11.CAL:Function_call_interrupts 178135 ± 2% +137.7% 423386 ± 4% interrupts.CPU11.LOC:Local_timer_interrupts 2088 ± 6% +109.9% 4384 ± 9% interrupts.CPU11.RES:Rescheduling_interrupts 768.00 ± 10% -84.1% 121.75 ± 19% interrupts.CPU11.TLB:TLB_shootdowns 178633 ± 2% +137.2% 423697 ± 4% interrupts.CPU110.LOC:Local_timer_interrupts 2208 ± 7% +123.1% 4926 ± 13% interrupts.CPU110.RES:Rescheduling_interrupts 792.25 ± 10% -84.1% 126.25 ± 22% interrupts.CPU110.TLB:TLB_shootdowns 2144 ± 3% +16.9% 2506 ± 6% interrupts.CPU111.CAL:Function_call_interrupts 178495 ± 2% +137.3% 423618 ± 4% interrupts.CPU111.LOC:Local_timer_interrupts 2052 ± 8% +116.1% 4434 ± 9% interrupts.CPU111.RES:Rescheduling_interrupts 789.00 ± 5% -84.2% 125.00 ± 7% interrupts.CPU111.TLB:TLB_shootdowns 2129 +16.6% 2481 ± 2% interrupts.CPU112.CAL:Function_call_interrupts 178520 +137.2% 423400 ± 4% interrupts.CPU112.LOC:Local_timer_interrupts 2080 ± 5% +132.0% 4828 ± 7% interrupts.CPU112.RES:Rescheduling_interrupts 733.00 ± 5% -82.2% 130.25 ± 9% interrupts.CPU112.TLB:TLB_shootdowns 2138 ± 3% +15.4% 2466 ± 2% interrupts.CPU113.CAL:Function_call_interrupts 178258 ± 2% +137.6% 423494 ± 4% interrupts.CPU113.LOC:Local_timer_interrupts 2158 ± 10% +114.3% 4625 ± 3% interrupts.CPU113.RES:Rescheduling_interrupts 739.00 ± 11% -84.4% 115.50 ± 11% interrupts.CPU113.TLB:TLB_shootdowns 2124 ± 3% +15.0% 2442 ± 7% interrupts.CPU114.CAL:Function_call_interrupts 178197 ± 2% +137.6% 423393 ± 4% interrupts.CPU114.LOC:Local_timer_interrupts 2168 ± 9% +102.6% 4393 ± 9% interrupts.CPU114.RES:Rescheduling_interrupts 2166 ± 5% +16.0% 2513 ± 6% interrupts.CPU115.CAL:Function_call_interrupts 178201 ± 2% +137.6% 423405 ± 4% interrupts.CPU115.LOC:Local_timer_interrupts 2266 ± 11% +97.9% 4485 ± 4% interrupts.CPU115.RES:Rescheduling_interrupts 767.75 ± 16% -82.4% 135.00 ± 21% interrupts.CPU115.TLB:TLB_shootdowns 2071 ± 4% +18.2% 2448 ± 5% interrupts.CPU116.CAL:Function_call_interrupts 178263 ± 2% +137.5% 423349 ± 4% interrupts.CPU116.LOC:Local_timer_interrupts 1953 ± 6% +152.8% 4939 ± 3% interrupts.CPU116.RES:Rescheduling_interrupts 719.25 ± 10% -82.2% 128.25 ± 19% interrupts.CPU116.TLB:TLB_shootdowns 2176 ± 4% +13.5% 2470 ± 5% interrupts.CPU117.CAL:Function_call_interrupts 178224 ± 2% +137.7% 423711 ± 4% interrupts.CPU117.LOC:Local_timer_interrupts 2013 ± 7% +127.7% 4584 ± 9% interrupts.CPU117.RES:Rescheduling_interrupts 776.50 ± 9% -82.9% 132.50 ± 12% interrupts.CPU117.TLB:TLB_shootdowns 2092 ± 2% +20.3% 2516 ± 3% interrupts.CPU118.CAL:Function_call_interrupts 178215 ± 2% +137.4% 423073 ± 4% interrupts.CPU118.LOC:Local_timer_interrupts 2030 ± 6% +131.2% 4693 ± 3% interrupts.CPU118.RES:Rescheduling_interrupts 716.75 ± 5% -81.5% 132.75 ± 11% interrupts.CPU118.TLB:TLB_shootdowns 2154 ± 6% +13.4% 2443 ± 5% interrupts.CPU119.CAL:Function_call_interrupts 178326 ± 2% +137.5% 423527 ± 4% interrupts.CPU119.LOC:Local_timer_interrupts 1.50 ±173% +80116.7% 1203 ±171% interrupts.CPU119.NMI:Non-maskable_interrupts 1.50 ±173% +80116.7% 1203 ±171% interrupts.CPU119.PMI:Performance_monitoring_interrupts 1904 ± 8% +135.3% 4482 ± 4% interrupts.CPU119.RES:Rescheduling_interrupts 748.25 ± 7% -84.2% 118.25 ± 12% interrupts.CPU119.TLB:TLB_shootdowns 50.50 ± 13% +115.8% 109.00 ± 3% interrupts.CPU12.57:PCI-MSI.1572876-edge.eth0-TxRx-12 2082 ± 4% +19.3% 2483 ± 4% interrupts.CPU12.CAL:Function_call_interrupts 178217 ± 2% +137.4% 423078 ± 4% interrupts.CPU12.LOC:Local_timer_interrupts 1.00 ±122% +4.1e+05% 4059 ± 58% interrupts.CPU12.NMI:Non-maskable_interrupts 1.00 ±122% +4.1e+05% 4059 ± 58% interrupts.CPU12.PMI:Performance_monitoring_interrupts 1995 ± 8% +116.9% 4326 ± 8% interrupts.CPU12.RES:Rescheduling_interrupts 728.50 ± 11% -82.7% 126.00 ± 8% interrupts.CPU12.TLB:TLB_shootdowns 178200 ± 2% +137.8% 423675 ± 4% interrupts.CPU120.LOC:Local_timer_interrupts 1979 ± 6% +117.2% 4300 ± 11% interrupts.CPU120.RES:Rescheduling_interrupts 731.50 ± 13% -80.3% 144.25 ± 15% interrupts.CPU120.TLB:TLB_shootdowns 2062 ± 7% +20.3% 2480 ± 3% interrupts.CPU121.CAL:Function_call_interrupts 178186 ± 2% +137.8% 423660 ± 4% interrupts.CPU121.LOC:Local_timer_interrupts 2002 ± 3% +119.4% 4393 ± 9% interrupts.CPU121.RES:Rescheduling_interrupts 690.00 ± 13% -77.2% 157.00 ± 11% interrupts.CPU121.TLB:TLB_shootdowns 178255 ± 2% +137.5% 423269 ± 4% interrupts.CPU122.LOC:Local_timer_interrupts 1981 ± 7% +128.2% 4521 ± 11% interrupts.CPU122.RES:Rescheduling_interrupts 771.25 ± 6% -82.9% 131.50 ± 8% interrupts.CPU122.TLB:TLB_shootdowns 2112 ± 5% +18.0% 2494 ± 4% interrupts.CPU123.CAL:Function_call_interrupts 178199 ± 2% +137.8% 423755 ± 4% interrupts.CPU123.LOC:Local_timer_interrupts 2005 ± 9% +129.6% 4603 ± 10% interrupts.CPU123.RES:Rescheduling_interrupts 734.00 ± 8% -80.2% 145.25 ± 19% interrupts.CPU123.TLB:TLB_shootdowns 178292 ± 2% +137.5% 423371 ± 4% interrupts.CPU124.LOC:Local_timer_interrupts 2124 ± 7% +118.7% 4646 ± 11% interrupts.CPU124.RES:Rescheduling_interrupts 779.75 ± 7% -80.3% 153.50 ± 5% interrupts.CPU124.TLB:TLB_shootdowns 2223 ± 3% +14.1% 2537 ± 3% interrupts.CPU125.CAL:Function_call_interrupts 178241 ± 2% +137.7% 423593 ± 4% interrupts.CPU125.LOC:Local_timer_interrupts 1942 ± 6% +133.2% 4530 ± 8% interrupts.CPU125.RES:Rescheduling_interrupts 813.50 ± 7% -70.1% 243.50 ± 10% interrupts.CPU125.TLB:TLB_shootdowns 2169 ± 5% +15.5% 2504 ± 4% interrupts.CPU126.CAL:Function_call_interrupts 178137 ± 2% +137.8% 423546 ± 4% interrupts.CPU126.LOC:Local_timer_interrupts 2229 ± 5% +119.5% 4893 ± 10% interrupts.CPU126.RES:Rescheduling_interrupts 786.00 ± 15% -86.4% 106.75 ± 14% interrupts.CPU126.TLB:TLB_shootdowns 2089 +18.4% 2473 ± 2% interrupts.CPU127.CAL:Function_call_interrupts 178449 ± 2% +137.1% 423056 ± 3% interrupts.CPU127.LOC:Local_timer_interrupts 0.25 ±173% +1.8e+06% 4608 ± 58% interrupts.CPU127.NMI:Non-maskable_interrupts 0.25 ±173% +1.8e+06% 4608 ± 58% interrupts.CPU127.PMI:Performance_monitoring_interrupts 2213 ± 9% +106.2% 4563 ± 7% interrupts.CPU127.RES:Rescheduling_interrupts 733.75 ± 4% -84.6% 112.75 ± 10% interrupts.CPU127.TLB:TLB_shootdowns 178211 ± 2% +137.7% 423602 ± 4% interrupts.CPU128.LOC:Local_timer_interrupts 2157 ± 10% +125.2% 4859 ± 4% interrupts.CPU128.RES:Rescheduling_interrupts 801.25 ± 10% -84.4% 125.00 ± 16% interrupts.CPU128.TLB:TLB_shootdowns 2142 ± 4% +14.1% 2444 ± 2% interrupts.CPU129.CAL:Function_call_interrupts 178362 ± 2% +137.7% 423892 ± 3% interrupts.CPU129.LOC:Local_timer_interrupts 2149 ± 8% +111.4% 4543 ± 10% interrupts.CPU129.RES:Rescheduling_interrupts 758.25 ± 7% -86.8% 100.25 ± 15% interrupts.CPU129.TLB:TLB_shootdowns 52.00 ± 9% +114.4% 111.50 ± 7% interrupts.CPU13.58:PCI-MSI.1572877-edge.eth0-TxRx-13 2065 ± 5% +13.8% 2349 ± 3% interrupts.CPU13.CAL:Function_call_interrupts 177929 ± 2% +137.9% 423249 ± 4% interrupts.CPU13.LOC:Local_timer_interrupts 1929 ± 10% +114.9% 4144 ± 11% interrupts.CPU13.RES:Rescheduling_interrupts 725.50 ± 11% -84.4% 113.50 ± 11% interrupts.CPU13.TLB:TLB_shootdowns 2104 ± 5% +17.4% 2469 ± 4% interrupts.CPU130.CAL:Function_call_interrupts 178392 ± 2% +137.3% 423344 ± 3% interrupts.CPU130.LOC:Local_timer_interrupts 2042 ± 5% +133.8% 4775 ± 9% interrupts.CPU130.RES:Rescheduling_interrupts 722.75 ± 6% -81.5% 134.00 ± 13% interrupts.CPU130.TLB:TLB_shootdowns 2089 ± 7% +19.2% 2490 ± 2% interrupts.CPU131.CAL:Function_call_interrupts 178323 ± 2% +137.3% 423164 ± 4% interrupts.CPU131.LOC:Local_timer_interrupts 2067 ± 7% +117.9% 4505 ± 9% interrupts.CPU131.RES:Rescheduling_interrupts 721.50 ± 13% -82.5% 126.00 ± 16% interrupts.CPU131.TLB:TLB_shootdowns 2125 ± 4% +21.6% 2583 ± 2% interrupts.CPU132.CAL:Function_call_interrupts 178814 ± 2% +136.8% 423411 ± 3% interrupts.CPU132.LOC:Local_timer_interrupts 2062 ± 4% +103.6% 4199 ± 6% interrupts.CPU132.RES:Rescheduling_interrupts 741.75 ± 11% -83.1% 125.25 ± 8% interrupts.CPU132.TLB:TLB_shootdowns 2191 ± 4% +14.8% 2515 ± 4% interrupts.CPU133.CAL:Function_call_interrupts 178736 ± 2% +136.9% 423389 ± 4% interrupts.CPU133.LOC:Local_timer_interrupts 0.00 +4.3e+105% 4255 ± 58% interrupts.CPU133.NMI:Non-maskable_interrupts 0.00 +4.3e+105% 4255 ± 58% interrupts.CPU133.PMI:Performance_monitoring_interrupts 2260 ± 7% +105.8% 4652 ± 6% interrupts.CPU133.RES:Rescheduling_interrupts 809.75 ± 5% -85.0% 121.75 ± 15% interrupts.CPU133.TLB:TLB_shootdowns 2124 ± 4% +19.8% 2546 ± 2% interrupts.CPU134.CAL:Function_call_interrupts 178540 ± 2% +137.4% 423900 ± 3% interrupts.CPU134.LOC:Local_timer_interrupts 2168 ± 7% +104.9% 4441 ± 10% interrupts.CPU134.RES:Rescheduling_interrupts 724.00 ± 6% -81.9% 131.25 ± 18% interrupts.CPU134.TLB:TLB_shootdowns 2117 ± 5% +19.1% 2521 ± 4% interrupts.CPU135.CAL:Function_call_interrupts 178573 ± 2% +137.3% 423811 ± 4% interrupts.CPU135.LOC:Local_timer_interrupts 2087 ± 6% +99.3% 4159 ± 5% interrupts.CPU135.RES:Rescheduling_interrupts 768.25 ± 8% -75.5% 188.50 ± 53% interrupts.CPU135.TLB:TLB_shootdowns 2059 ± 5% +16.5% 2398 ± 3% interrupts.CPU136.CAL:Function_call_interrupts 178499 ± 2% +137.4% 423729 ± 4% interrupts.CPU136.LOC:Local_timer_interrupts 2068 ± 3% +127.5% 4705 ± 13% interrupts.CPU136.RES:Rescheduling_interrupts 711.50 ± 4% -81.8% 129.25 ± 12% interrupts.CPU136.TLB:TLB_shootdowns 2087 ± 4% +19.6% 2497 interrupts.CPU137.CAL:Function_call_interrupts 178530 ± 2% +136.9% 422988 ± 3% interrupts.CPU137.LOC:Local_timer_interrupts 2032 ± 9% +101.6% 4098 ± 11% interrupts.CPU137.RES:Rescheduling_interrupts 744.75 ± 6% -85.2% 110.00 ± 9% interrupts.CPU137.TLB:TLB_shootdowns 2136 ± 2% +18.4% 2530 ± 3% interrupts.CPU138.CAL:Function_call_interrupts 179050 ± 2% +136.5% 423376 ± 3% interrupts.CPU138.LOC:Local_timer_interrupts 1956 ± 8% +128.3% 4466 ± 11% interrupts.CPU138.RES:Rescheduling_interrupts 768.50 ± 4% -82.1% 137.50 ± 17% interrupts.CPU138.TLB:TLB_shootdowns 2162 ± 5% +16.7% 2523 ± 3% interrupts.CPU139.CAL:Function_call_interrupts 178244 ± 2% +137.5% 423394 ± 3% interrupts.CPU139.LOC:Local_timer_interrupts 2022 ± 9% +141.3% 4881 ± 12% interrupts.CPU139.RES:Rescheduling_interrupts 760.25 ± 8% -75.1% 189.00 ± 67% interrupts.CPU139.TLB:TLB_shootdowns 47.00 ± 2% +223.4% 152.00 ± 44% interrupts.CPU14.59:PCI-MSI.1572878-edge.eth0-TxRx-14 178399 ± 2% +137.3% 423397 ± 4% interrupts.CPU14.LOC:Local_timer_interrupts 1965 ± 8% +133.0% 4578 ± 5% interrupts.CPU14.RES:Rescheduling_interrupts 735.00 ± 4% -82.6% 128.25 ± 17% interrupts.CPU14.TLB:TLB_shootdowns 2183 ± 2% +14.8% 2506 ± 3% interrupts.CPU140.CAL:Function_call_interrupts 178839 ± 2% +136.4% 422725 ± 3% interrupts.CPU140.LOC:Local_timer_interrupts 2060 ± 7% +114.9% 4427 ± 11% interrupts.CPU140.RES:Rescheduling_interrupts 784.25 ± 9% -82.7% 136.00 ± 15% interrupts.CPU140.TLB:TLB_shootdowns 2210 ± 2% +15.5% 2553 ± 4% interrupts.CPU141.CAL:Function_call_interrupts 178524 ± 2% +137.3% 423684 ± 3% interrupts.CPU141.LOC:Local_timer_interrupts 2132 ± 8% +118.6% 4661 ± 7% interrupts.CPU141.RES:Rescheduling_interrupts 774.00 ± 5% -80.8% 148.50 ± 14% interrupts.CPU141.TLB:TLB_shootdowns 2153 ± 3% +12.3% 2418 ± 4% interrupts.CPU142.CAL:Function_call_interrupts 178295 ± 2% +137.3% 423040 ± 3% interrupts.CPU142.LOC:Local_timer_interrupts 2035 ± 8% +110.1% 4276 ± 10% interrupts.CPU142.RES:Rescheduling_interrupts 735.75 ± 7% -76.2% 174.75 ± 17% interrupts.CPU142.TLB:TLB_shootdowns 2068 ± 6% +20.9% 2499 ± 4% interrupts.CPU143.CAL:Function_call_interrupts 178871 ± 2% +137.0% 423851 ± 4% interrupts.CPU143.LOC:Local_timer_interrupts 1949 ± 13% +120.9% 4305 ± 14% interrupts.CPU143.RES:Rescheduling_interrupts 730.75 ± 10% -62.1% 277.25 ± 33% interrupts.CPU143.TLB:TLB_shootdowns 2104 ± 3% +17.6% 2475 ± 5% interrupts.CPU15.CAL:Function_call_interrupts 177935 ± 2% +137.9% 423317 ± 3% interrupts.CPU15.LOC:Local_timer_interrupts 1974 ± 5% +120.5% 4353 ± 13% interrupts.CPU15.RES:Rescheduling_interrupts 765.25 ± 6% -78.1% 167.50 ± 51% interrupts.CPU15.TLB:TLB_shootdowns 44.50 +146.1% 109.50 ± 5% interrupts.CPU16.61:PCI-MSI.1572880-edge.eth0-TxRx-16 2096 ± 3% +14.0% 2389 interrupts.CPU16.CAL:Function_call_interrupts 178529 ± 2% +137.1% 423205 ± 3% interrupts.CPU16.LOC:Local_timer_interrupts 0.75 ±110% +3.6e+05% 2685 ±112% interrupts.CPU16.NMI:Non-maskable_interrupts 0.75 ±110% +3.6e+05% 2685 ±112% interrupts.CPU16.PMI:Performance_monitoring_interrupts 2050 ± 4% +122.0% 4552 ± 9% interrupts.CPU16.RES:Rescheduling_interrupts 737.50 ± 7% -80.6% 143.00 ± 20% interrupts.CPU16.TLB:TLB_shootdowns 46.75 ± 5% +133.7% 109.25 interrupts.CPU17.62:PCI-MSI.1572881-edge.eth0-TxRx-17 1972 +21.3% 2391 ± 5% interrupts.CPU17.CAL:Function_call_interrupts 178435 ± 2% +137.1% 423058 ± 3% interrupts.CPU17.LOC:Local_timer_interrupts 1925 ± 5% +137.4% 4571 ± 6% interrupts.CPU17.RES:Rescheduling_interrupts 667.75 ± 6% -80.8% 128.50 ± 12% interrupts.CPU17.TLB:TLB_shootdowns 45.00 ± 2% +148.9% 112.00 ± 9% interrupts.CPU18.63:PCI-MSI.1572882-edge.eth0-TxRx-18 2123 +15.0% 2443 ± 4% interrupts.CPU18.CAL:Function_call_interrupts 178755 ± 2% +136.8% 423347 ± 3% interrupts.CPU18.LOC:Local_timer_interrupts 0.00 +3.2e+105% 3151 ±100% interrupts.CPU18.NMI:Non-maskable_interrupts 0.00 +3.2e+105% 3151 ±100% interrupts.CPU18.PMI:Performance_monitoring_interrupts 2177 ± 6% +201.8% 6569 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts 740.25 ± 4% -80.1% 147.00 ± 7% interrupts.CPU18.TLB:TLB_shootdowns 44.25 +140.7% 106.50 ± 4% interrupts.CPU19.64:PCI-MSI.1572883-edge.eth0-TxRx-19 178217 ± 2% +137.5% 423230 ± 3% interrupts.CPU19.LOC:Local_timer_interrupts 2150 ± 8% +104.6% 4398 ± 6% interrupts.CPU19.RES:Rescheduling_interrupts 767.00 ± 17% -80.0% 153.75 ± 23% interrupts.CPU19.TLB:TLB_shootdowns 59.75 ± 33% +4689.1% 2861 ±164% interrupts.CPU2.47:PCI-MSI.1572866-edge.eth0-TxRx-2 2047 ± 3% +17.3% 2402 ± 6% interrupts.CPU2.CAL:Function_call_interrupts 177943 ± 2% +138.0% 423547 ± 4% interrupts.CPU2.LOC:Local_timer_interrupts 2477 ± 16% +94.2% 4810 ± 6% interrupts.CPU2.RES:Rescheduling_interrupts 760.50 ± 8% -81.7% 139.25 ± 18% interrupts.CPU2.TLB:TLB_shootdowns 44.75 ± 2% +131.8% 103.75 ± 3% interrupts.CPU20.65:PCI-MSI.1572884-edge.eth0-TxRx-20 178282 ± 2% +137.7% 423700 ± 4% interrupts.CPU20.LOC:Local_timer_interrupts 0.25 ±173% +6.5e+05% 1623 ±170% interrupts.CPU20.NMI:Non-maskable_interrupts 0.25 ±173% +6.5e+05% 1623 ±170% interrupts.CPU20.PMI:Performance_monitoring_interrupts 2139 ± 8% +112.9% 4554 ± 12% interrupts.CPU20.RES:Rescheduling_interrupts 798.25 ± 5% -84.2% 126.00 ± 23% interrupts.CPU20.TLB:TLB_shootdowns 44.25 +134.5% 103.75 ± 3% interrupts.CPU21.66:PCI-MSI.1572885-edge.eth0-TxRx-21 2134 ± 4% +12.2% 2395 ± 3% interrupts.CPU21.CAL:Function_call_interrupts 178531 ± 2% +137.0% 423161 ± 3% interrupts.CPU21.LOC:Local_timer_interrupts 2153 ± 12% +98.9% 4281 ± 11% interrupts.CPU21.RES:Rescheduling_interrupts 773.75 ± 10% -84.0% 123.75 ± 7% interrupts.CPU21.TLB:TLB_shootdowns 44.25 +139.5% 106.00 ± 6% interrupts.CPU22.67:PCI-MSI.1572886-edge.eth0-TxRx-22 2014 ± 3% +22.6% 2470 ± 5% interrupts.CPU22.CAL:Function_call_interrupts 178315 ± 2% +137.0% 422667 ± 3% interrupts.CPU22.LOC:Local_timer_interrupts 1924 ± 5% +116.9% 4173 ± 5% interrupts.CPU22.RES:Rescheduling_interrupts 725.50 ± 8% -77.9% 160.25 ± 26% interrupts.CPU22.TLB:TLB_shootdowns 45.50 ± 3% +134.1% 106.50 interrupts.CPU23.68:PCI-MSI.1572887-edge.eth0-TxRx-23 2115 ± 3% +12.7% 2385 ± 7% interrupts.CPU23.CAL:Function_call_interrupts 177888 ± 2% +137.7% 422910 ± 3% interrupts.CPU23.LOC:Local_timer_interrupts 0.50 ±173% +6.3e+05% 3152 ± 96% interrupts.CPU23.NMI:Non-maskable_interrupts 0.50 ±173% +6.3e+05% 3152 ± 96% interrupts.CPU23.PMI:Performance_monitoring_interrupts 1971 ± 10% +108.6% 4112 ± 8% interrupts.CPU23.RES:Rescheduling_interrupts 786.25 ± 8% -83.3% 131.50 ± 13% interrupts.CPU23.TLB:TLB_shootdowns 44.25 +134.5% 103.75 ± 3% interrupts.CPU24.69:PCI-MSI.1572888-edge.eth0-TxRx-24 2105 ± 3% +15.6% 2434 ± 4% interrupts.CPU24.CAL:Function_call_interrupts 177882 ± 2% +138.0% 423386 ± 3% interrupts.CPU24.LOC:Local_timer_interrupts 2125 ± 5% +104.4% 4344 ± 12% interrupts.CPU24.RES:Rescheduling_interrupts 768.75 ± 11% -84.0% 123.25 ± 9% interrupts.CPU24.TLB:TLB_shootdowns 44.50 +144.4% 108.75 ± 8% interrupts.CPU25.70:PCI-MSI.1572889-edge.eth0-TxRx-25 178239 ± 2% +137.7% 423615 ± 3% interrupts.CPU25.LOC:Local_timer_interrupts 2286 ± 11% +84.9% 4226 ± 10% interrupts.CPU25.RES:Rescheduling_interrupts 707.25 ± 6% -82.0% 127.25 ± 25% interrupts.CPU25.TLB:TLB_shootdowns 2074 ± 3% +16.5% 2416 ± 2% interrupts.CPU26.CAL:Function_call_interrupts 177578 ± 2% +138.5% 423443 ± 3% interrupts.CPU26.LOC:Local_timer_interrupts 2001 ± 4% +114.7% 4297 ± 12% interrupts.CPU26.RES:Rescheduling_interrupts 732.00 ± 10% -82.8% 126.00 ± 8% interrupts.CPU26.TLB:TLB_shootdowns 56.00 ± 34% +87.1% 104.75 ± 4% interrupts.CPU27.72:PCI-MSI.1572891-edge.eth0-TxRx-27 2103 ± 3% +15.8% 2436 ± 6% interrupts.CPU27.CAL:Function_call_interrupts 178514 ± 2% +137.1% 423315 ± 3% interrupts.CPU27.LOC:Local_timer_interrupts 1994 ± 5% +119.6% 4380 ± 9% interrupts.CPU27.RES:Rescheduling_interrupts 760.50 ± 8% -81.8% 138.25 ± 6% interrupts.CPU27.TLB:TLB_shootdowns 44.25 +137.3% 105.00 ± 2% interrupts.CPU28.73:PCI-MSI.1572892-edge.eth0-TxRx-28 2129 ± 2% +13.0% 2406 ± 2% interrupts.CPU28.CAL:Function_call_interrupts 178259 ± 2% +137.4% 423196 ± 3% interrupts.CPU28.LOC:Local_timer_interrupts 1.00 ±173% +1.5e+05% 1474 ±171% interrupts.CPU28.NMI:Non-maskable_interrupts 1.00 ±173% +1.5e+05% 1474 ±171% interrupts.CPU28.PMI:Performance_monitoring_interrupts 2027 ± 4% +104.8% 4152 ± 8% interrupts.CPU28.RES:Rescheduling_interrupts 791.75 ± 7% -82.9% 135.75 ± 14% interrupts.CPU28.TLB:TLB_shootdowns 44.25 +135.0% 104.00 ± 3% interrupts.CPU29.74:PCI-MSI.1572893-edge.eth0-TxRx-29 2047 ± 3% +19.1% 2438 ± 3% interrupts.CPU29.CAL:Function_call_interrupts 178436 ± 2% +137.2% 423337 ± 3% interrupts.CPU29.LOC:Local_timer_interrupts 1959 ± 7% +111.9% 4150 ± 11% interrupts.CPU29.RES:Rescheduling_interrupts 742.25 ± 7% -82.6% 129.25 ± 16% interrupts.CPU29.TLB:TLB_shootdowns 88.25 ± 73% +8940.2% 7978 ±169% interrupts.CPU3.48:PCI-MSI.1572867-edge.eth0-TxRx-3 2135 ± 6% +12.6% 2404 ± 6% interrupts.CPU3.CAL:Function_call_interrupts 177783 ± 2% +138.3% 423656 ± 3% interrupts.CPU3.LOC:Local_timer_interrupts 2081 ± 10% +118.4% 4545 ± 11% interrupts.CPU3.RES:Rescheduling_interrupts 766.25 ± 15% -82.4% 134.75 ± 18% interrupts.CPU3.TLB:TLB_shootdowns 45.25 ± 4% +130.4% 104.25 ± 4% interrupts.CPU30.75:PCI-MSI.1572894-edge.eth0-TxRx-30 2045 +18.1% 2414 ± 4% interrupts.CPU30.CAL:Function_call_interrupts 178349 ± 2% +137.4% 423355 ± 3% interrupts.CPU30.LOC:Local_timer_interrupts 2012 ± 11% +108.1% 4187 ± 6% interrupts.CPU30.RES:Rescheduling_interrupts 750.50 ± 7% -83.8% 121.75 ± 6% interrupts.CPU30.TLB:TLB_shootdowns 45.00 ± 3% +213.3% 141.00 ± 47% interrupts.CPU31.76:PCI-MSI.1572895-edge.eth0-TxRx-31 2109 ± 5% +13.3% 2391 ± 3% interrupts.CPU31.CAL:Function_call_interrupts 178458 ± 2% +137.2% 423388 ± 3% interrupts.CPU31.LOC:Local_timer_interrupts 1971 ± 6% +145.0% 4830 ± 4% interrupts.CPU31.RES:Rescheduling_interrupts 739.00 ± 8% -83.2% 124.25 ± 3% interrupts.CPU31.TLB:TLB_shootdowns 60.75 ± 26% +77.8% 108.00 ± 5% interrupts.CPU32.77:PCI-MSI.1572896-edge.eth0-TxRx-32 178502 ± 2% +137.0% 423061 ± 3% interrupts.CPU32.LOC:Local_timer_interrupts 2024 ± 8% +142.9% 4918 ± 16% interrupts.CPU32.RES:Rescheduling_interrupts 776.00 ± 6% -82.2% 138.50 ± 16% interrupts.CPU32.TLB:TLB_shootdowns 44.75 +132.4% 104.00 ± 3% interrupts.CPU33.78:PCI-MSI.1572897-edge.eth0-TxRx-33 2040 +18.9% 2425 ± 4% interrupts.CPU33.CAL:Function_call_interrupts 178192 ± 2% +137.6% 423365 ± 3% interrupts.CPU33.LOC:Local_timer_interrupts 1949 ± 7% +117.0% 4230 ± 8% interrupts.CPU33.RES:Rescheduling_interrupts 734.25 -82.4% 129.50 ± 16% interrupts.CPU33.TLB:TLB_shootdowns 49.00 ± 11% +111.7% 103.75 ± 3% interrupts.CPU34.79:PCI-MSI.1572898-edge.eth0-TxRx-34 2116 ± 3% +16.9% 2474 ± 2% interrupts.CPU34.CAL:Function_call_interrupts 178570 ± 2% +137.1% 423330 ± 3% interrupts.CPU34.LOC:Local_timer_interrupts 0.25 ±173% +4.3e+05% 1069 ±113% interrupts.CPU34.NMI:Non-maskable_interrupts 0.25 ±173% +4.3e+05% 1069 ±113% interrupts.CPU34.PMI:Performance_monitoring_interrupts 2003 ± 8% +120.0% 4408 ± 8% interrupts.CPU34.RES:Rescheduling_interrupts 748.50 ± 9% -83.2% 125.50 ± 10% interrupts.CPU34.TLB:TLB_shootdowns 45.00 ± 3% +132.8% 104.75 ± 2% interrupts.CPU35.80:PCI-MSI.1572899-edge.eth0-TxRx-35 2044 ± 3% +21.7% 2488 ± 5% interrupts.CPU35.CAL:Function_call_interrupts 178122 ± 2% +137.6% 423236 ± 3% interrupts.CPU35.LOC:Local_timer_interrupts 0.25 ±173% +1.1e+06% 2736 ±108% interrupts.CPU35.NMI:Non-maskable_interrupts 0.25 ±173% +1.1e+06% 2736 ±108% interrupts.CPU35.PMI:Performance_monitoring_interrupts 1907 ± 5% +135.6% 4493 ± 2% interrupts.CPU35.RES:Rescheduling_interrupts 730.50 ± 12% -82.1% 131.00 ± 13% interrupts.CPU35.TLB:TLB_shootdowns 77.50 ± 68% +215.8% 244.75 ± 31% interrupts.CPU36.81:PCI-MSI.1572900-edge.eth0-TxRx-36 2096 ± 7% +17.2% 2457 ± 5% interrupts.CPU36.CAL:Function_call_interrupts 178467 ± 2% +137.3% 423492 ± 3% interrupts.CPU36.LOC:Local_timer_interrupts 2008 ± 5% +221.3% 6450 ± 6% interrupts.CPU36.RES:Rescheduling_interrupts 752.75 ± 13% -82.1% 134.75 ± 13% interrupts.CPU36.TLB:TLB_shootdowns 45.50 ± 4% +170.9% 123.25 ± 18% interrupts.CPU37.82:PCI-MSI.1572901-edge.eth0-TxRx-37 2072 ± 5% +16.4% 2411 interrupts.CPU37.CAL:Function_call_interrupts 178212 ± 2% +138.0% 424114 ± 3% interrupts.CPU37.LOC:Local_timer_interrupts 2030 ± 8% +137.9% 4828 ± 9% interrupts.CPU37.RES:Rescheduling_interrupts 736.50 ± 7% -82.7% 127.75 ± 21% interrupts.CPU37.TLB:TLB_shootdowns 45.75 ± 4% +136.6% 108.25 ± 4% interrupts.CPU38.83:PCI-MSI.1572902-edge.eth0-TxRx-38 2038 +19.5% 2436 ± 2% interrupts.CPU38.CAL:Function_call_interrupts 178220 ± 2% +137.9% 424044 ± 3% interrupts.CPU38.LOC:Local_timer_interrupts 2005 ± 5% +133.8% 4688 ± 13% interrupts.CPU38.RES:Rescheduling_interrupts 728.75 ± 4% -82.7% 125.75 ± 24% interrupts.CPU38.TLB:TLB_shootdowns 45.75 ± 5% +135.5% 107.75 ± 5% interrupts.CPU39.84:PCI-MSI.1572903-edge.eth0-TxRx-39 2163 ± 7% +11.1% 2404 ± 3% interrupts.CPU39.CAL:Function_call_interrupts 178377 ± 2% +137.4% 423405 ± 4% interrupts.CPU39.LOC:Local_timer_interrupts 2113 ± 8% +111.5% 4470 ± 4% interrupts.CPU39.RES:Rescheduling_interrupts 810.75 ± 14% -63.7% 294.00 ±103% interrupts.CPU39.TLB:TLB_shootdowns 49.50 ± 7% +1902.5% 991.25 ±153% interrupts.CPU4.49:PCI-MSI.1572868-edge.eth0-TxRx-4 2075 ± 3% +15.2% 2392 ± 6% interrupts.CPU4.CAL:Function_call_interrupts 177915 ± 2% +137.9% 423235 ± 3% interrupts.CPU4.LOC:Local_timer_interrupts 1951 ± 12% +112.2% 4139 ± 6% interrupts.CPU4.RES:Rescheduling_interrupts 742.50 ± 5% -84.3% 116.50 ± 7% interrupts.CPU4.TLB:TLB_shootdowns 44.50 +144.9% 109.00 ± 8% interrupts.CPU40.85:PCI-MSI.1572904-edge.eth0-TxRx-40 2122 ± 6% +14.4% 2427 ± 5% interrupts.CPU40.CAL:Function_call_interrupts 178203 ± 2% +137.7% 423628 ± 4% interrupts.CPU40.LOC:Local_timer_interrupts 1968 ± 7% +136.1% 4648 interrupts.CPU40.RES:Rescheduling_interrupts 784.00 ± 10% -83.2% 131.75 ± 19% interrupts.CPU40.TLB:TLB_shootdowns 46.50 ± 5% +186.0% 133.00 ± 35% interrupts.CPU41.86:PCI-MSI.1572905-edge.eth0-TxRx-41 2075 ± 4% +16.3% 2414 ± 4% interrupts.CPU41.CAL:Function_call_interrupts 178519 +137.3% 423549 ± 4% interrupts.CPU41.LOC:Local_timer_interrupts 1909 ± 6% +160.4% 4971 ± 8% interrupts.CPU41.RES:Rescheduling_interrupts 744.50 ± 5% -83.7% 121.25 ± 13% interrupts.CPU41.TLB:TLB_shootdowns 50.50 ± 12% +107.4% 104.75 ± 3% interrupts.CPU42.87:PCI-MSI.1572906-edge.eth0-TxRx-42 2070 ± 4% +15.1% 2383 interrupts.CPU42.CAL:Function_call_interrupts 178193 ± 2% +137.6% 423405 ± 4% interrupts.CPU42.LOC:Local_timer_interrupts 2149 ± 9% +105.8% 4422 ± 12% interrupts.CPU42.RES:Rescheduling_interrupts 732.00 ± 7% -82.9% 125.50 ± 19% interrupts.CPU42.TLB:TLB_shootdowns 45.00 +130.6% 103.75 ± 3% interrupts.CPU43.88:PCI-MSI.1572907-edge.eth0-TxRx-43 2094 ± 5% +14.8% 2405 ± 4% interrupts.CPU43.CAL:Function_call_interrupts 178207 ± 2% +137.6% 423360 ± 4% interrupts.CPU43.LOC:Local_timer_interrupts 2102 ± 7% +114.3% 4506 ± 4% interrupts.CPU43.RES:Rescheduling_interrupts 760.25 ± 10% -82.6% 132.50 ± 22% interrupts.CPU43.TLB:TLB_shootdowns 45.00 ± 2% +132.2% 104.50 ± 3% interrupts.CPU44.89:PCI-MSI.1572908-edge.eth0-TxRx-44 2097 ± 5% +13.0% 2369 ± 5% interrupts.CPU44.CAL:Function_call_interrupts 178205 ± 2% +137.6% 423396 ± 4% interrupts.CPU44.LOC:Local_timer_interrupts 2049 ± 8% +130.5% 4723 ± 4% interrupts.CPU44.RES:Rescheduling_interrupts 732.00 ± 7% -81.5% 135.75 ± 15% interrupts.CPU44.TLB:TLB_shootdowns 48.00 ± 10% +129.2% 110.00 ± 5% interrupts.CPU45.90:PCI-MSI.1572909-edge.eth0-TxRx-45 2080 ± 2% +15.5% 2402 ± 4% interrupts.CPU45.CAL:Function_call_interrupts 178512 +137.2% 423363 ± 4% interrupts.CPU45.LOC:Local_timer_interrupts 1928 ± 6% +132.0% 4473 ± 6% interrupts.CPU45.RES:Rescheduling_interrupts 768.50 ± 6% -84.4% 119.75 ± 11% interrupts.CPU45.TLB:TLB_shootdowns 44.75 +143.0% 108.75 ± 5% interrupts.CPU46.91:PCI-MSI.1572910-edge.eth0-TxRx-46 2056 ± 6% +16.6% 2398 ± 3% interrupts.CPU46.CAL:Function_call_interrupts 178506 +137.2% 423336 ± 4% interrupts.CPU46.LOC:Local_timer_interrupts 2013 ± 12% +141.7% 4864 ± 7% interrupts.CPU46.RES:Rescheduling_interrupts 724.50 ± 10% -82.4% 127.25 ± 4% interrupts.CPU46.TLB:TLB_shootdowns 45.25 ± 3% +149.2% 112.75 ± 15% interrupts.CPU47.92:PCI-MSI.1572911-edge.eth0-TxRx-47 2109 ± 4% +17.3% 2473 ± 3% interrupts.CPU47.CAL:Function_call_interrupts 178520 ± 2% +137.1% 423278 ± 4% interrupts.CPU47.LOC:Local_timer_interrupts 2005 ± 7% +110.5% 4222 ± 6% interrupts.CPU47.RES:Rescheduling_interrupts 748.00 ± 7% -82.5% 131.00 ± 6% interrupts.CPU47.TLB:TLB_shootdowns 46.25 ± 6% +124.3% 103.75 ± 3% interrupts.CPU48.93:PCI-MSI.1572912-edge.eth0-TxRx-48 178221 ± 2% +137.8% 423828 ± 3% interrupts.CPU48.LOC:Local_timer_interrupts 1917 ± 7% +129.8% 4406 ± 7% interrupts.CPU48.RES:Rescheduling_interrupts 771.00 ± 8% -83.7% 126.00 ± 9% interrupts.CPU48.TLB:TLB_shootdowns 44.75 +256.4% 159.50 ± 58% interrupts.CPU49.94:PCI-MSI.1572913-edge.eth0-TxRx-49 1996 ± 11% +23.4% 2463 ± 3% interrupts.CPU49.CAL:Function_call_interrupts 178543 +137.6% 424129 ± 3% interrupts.CPU49.LOC:Local_timer_interrupts 2026 ± 9% +134.4% 4749 ± 7% interrupts.CPU49.RES:Rescheduling_interrupts 713.00 ± 9% -80.5% 138.75 ± 18% interrupts.CPU49.TLB:TLB_shootdowns 51.00 ± 11% +130.9% 117.75 ± 7% interrupts.CPU5.50:PCI-MSI.1572869-edge.eth0-TxRx-5 2086 ± 3% +14.2% 2382 ± 6% interrupts.CPU5.CAL:Function_call_interrupts 178439 ± 2% +137.1% 423059 ± 3% interrupts.CPU5.LOC:Local_timer_interrupts 1902 ± 6% +135.7% 4484 ± 7% interrupts.CPU5.RES:Rescheduling_interrupts 780.25 ± 6% -84.4% 121.50 ± 9% interrupts.CPU5.TLB:TLB_shootdowns 44.25 +136.7% 104.75 ± 2% interrupts.CPU50.95:PCI-MSI.1572914-edge.eth0-TxRx-50 2153 ± 4% +11.0% 2390 ± 5% interrupts.CPU50.CAL:Function_call_interrupts 178499 +137.3% 423568 ± 4% interrupts.CPU50.LOC:Local_timer_interrupts 2005 ± 8% +122.7% 4466 ± 5% interrupts.CPU50.RES:Rescheduling_interrupts 45.00 +135.6% 106.00 ± 6% interrupts.CPU51.96:PCI-MSI.1572915-edge.eth0-TxRx-51 1951 ± 8% +25.2% 2442 ± 5% interrupts.CPU51.CAL:Function_call_interrupts 178470 ± 2% +137.5% 423866 ± 4% interrupts.CPU51.LOC:Local_timer_interrupts 1933 ± 4% +141.9% 4677 ± 14% interrupts.CPU51.RES:Rescheduling_interrupts 708.75 ± 6% -81.4% 131.50 ± 9% interrupts.CPU51.TLB:TLB_shootdowns 50.50 ± 9% +124.8% 113.50 ± 11% interrupts.CPU52.97:PCI-MSI.1572916-edge.eth0-TxRx-52 2040 ± 3% +22.3% 2494 ± 5% interrupts.CPU52.CAL:Function_call_interrupts 178212 ± 2% +137.8% 423781 ± 4% interrupts.CPU52.LOC:Local_timer_interrupts 1865 ± 9% +147.6% 4619 ± 6% interrupts.CPU52.RES:Rescheduling_interrupts 747.75 ± 12% -83.1% 126.25 ± 24% interrupts.CPU52.TLB:TLB_shootdowns 2044 ± 3% +19.1% 2434 ± 4% interrupts.CPU53.CAL:Function_call_interrupts 178432 ± 2% +137.1% 423067 ± 4% interrupts.CPU53.LOC:Local_timer_interrupts 1960 ± 4% +104.7% 4011 ± 9% interrupts.CPU53.RES:Rescheduling_interrupts 709.00 ± 7% -80.6% 137.25 ± 14% interrupts.CPU53.TLB:TLB_shootdowns 45.25 ± 3% +138.7% 108.00 ± 4% interrupts.CPU54.99:PCI-MSI.1572918-edge.eth0-TxRx-54 1955 ± 10% +21.6% 2377 ± 3% interrupts.CPU54.CAL:Function_call_interrupts 178912 ± 2% +136.5% 423045 ± 4% interrupts.CPU54.LOC:Local_timer_interrupts 2025 ± 9% +249.9% 7086 ± 8% interrupts.CPU54.RES:Rescheduling_interrupts 734.50 ± 9% -80.7% 142.00 ± 7% interrupts.CPU54.TLB:TLB_shootdowns 45.50 ± 3% +133.0% 106.00 ± 2% interrupts.CPU55.100:PCI-MSI.1572919-edge.eth0-TxRx-55 2107 ± 5% +13.7% 2395 ± 6% interrupts.CPU55.CAL:Function_call_interrupts 178634 ± 2% +137.0% 423406 ± 3% interrupts.CPU55.LOC:Local_timer_interrupts 2133 ± 7% +132.4% 4959 ± 9% interrupts.CPU55.RES:Rescheduling_interrupts 744.00 ± 8% -69.8% 224.50 ± 90% interrupts.CPU55.TLB:TLB_shootdowns 46.25 ± 4% +127.6% 105.25 ± 3% interrupts.CPU56.101:PCI-MSI.1572920-edge.eth0-TxRx-56 2089 ± 3% +15.6% 2415 ± 5% interrupts.CPU56.CAL:Function_call_interrupts 178232 ± 2% +137.6% 423559 ± 3% interrupts.CPU56.LOC:Local_timer_interrupts 2090 ± 5% +125.0% 4702 ± 6% interrupts.CPU56.RES:Rescheduling_interrupts 754.50 ± 9% -82.8% 130.00 ± 15% interrupts.CPU56.TLB:TLB_shootdowns 45.25 ± 3% +135.4% 106.50 ± 7% interrupts.CPU57.102:PCI-MSI.1572921-edge.eth0-TxRx-57 2079 ± 2% +17.9% 2452 ± 3% interrupts.CPU57.CAL:Function_call_interrupts 178508 ± 2% +137.2% 423447 ± 3% interrupts.CPU57.LOC:Local_timer_interrupts 2142 ± 4% +114.0% 4586 ± 6% interrupts.CPU57.RES:Rescheduling_interrupts 737.25 ± 8% -76.5% 173.25 ± 40% interrupts.CPU57.TLB:TLB_shootdowns 2041 ± 4% +19.8% 2444 ± 4% interrupts.CPU58.CAL:Function_call_interrupts 178455 ± 2% +137.1% 423086 ± 3% interrupts.CPU58.LOC:Local_timer_interrupts 2074 ± 8% +118.9% 4540 ± 7% interrupts.CPU58.RES:Rescheduling_interrupts 718.00 ± 9% -83.2% 120.50 ± 22% interrupts.CPU58.TLB:TLB_shootdowns 44.50 +133.1% 103.75 ± 3% interrupts.CPU59.104:PCI-MSI.1572923-edge.eth0-TxRx-59 2077 ± 5% +18.7% 2465 ± 5% interrupts.CPU59.CAL:Function_call_interrupts 178721 ± 2% +137.1% 423821 ± 3% interrupts.CPU59.LOC:Local_timer_interrupts 2045 ± 4% +120.1% 4502 ± 4% interrupts.CPU59.RES:Rescheduling_interrupts 714.50 ± 9% -81.1% 135.00 ± 10% interrupts.CPU59.TLB:TLB_shootdowns 49.00 ± 11% +176.0% 135.25 ± 20% interrupts.CPU6.51:PCI-MSI.1572870-edge.eth0-TxRx-6 178222 ± 2% +137.7% 423596 ± 4% interrupts.CPU6.LOC:Local_timer_interrupts 2095 ± 7% +98.5% 4160 interrupts.CPU6.RES:Rescheduling_interrupts 774.00 ± 11% -84.9% 117.25 ± 7% interrupts.CPU6.TLB:TLB_shootdowns 45.75 ± 3% +126.8% 103.75 ± 3% interrupts.CPU60.105:PCI-MSI.1572924-edge.eth0-TxRx-60 2089 ± 6% +12.2% 2344 ± 3% interrupts.CPU60.CAL:Function_call_interrupts 178631 ± 2% +137.1% 423458 ± 3% interrupts.CPU60.LOC:Local_timer_interrupts 2032 ± 10% +99.1% 4046 ± 18% interrupts.CPU60.RES:Rescheduling_interrupts 719.25 ± 14% -81.0% 137.00 ± 19% interrupts.CPU60.TLB:TLB_shootdowns 45.75 ± 5% +128.4% 104.50 ± 4% interrupts.CPU61.106:PCI-MSI.1572925-edge.eth0-TxRx-61 2106 ± 4% +15.1% 2424 ± 5% interrupts.CPU61.CAL:Function_call_interrupts 178374 ± 2% +137.7% 423912 ± 3% interrupts.CPU61.LOC:Local_timer_interrupts 2149 ± 9% +87.9% 4039 ± 5% interrupts.CPU61.RES:Rescheduling_interrupts 769.50 ± 7% -84.7% 117.75 ± 10% interrupts.CPU61.TLB:TLB_shootdowns 45.00 ± 2% +131.1% 104.00 ± 3% interrupts.CPU62.107:PCI-MSI.1572926-edge.eth0-TxRx-62 2002 ± 10% +17.9% 2361 ± 5% interrupts.CPU62.CAL:Function_call_interrupts 178260 ± 2% +137.8% 423816 ± 3% interrupts.CPU62.LOC:Local_timer_interrupts 2080 ± 5% +112.6% 4422 ± 9% interrupts.CPU62.RES:Rescheduling_interrupts 733.00 ± 7% -84.2% 115.75 ± 11% interrupts.CPU62.TLB:TLB_shootdowns 2087 ± 4% +15.0% 2400 ± 4% interrupts.CPU63.CAL:Function_call_interrupts 178196 ± 2% +137.8% 423725 ± 4% interrupts.CPU63.LOC:Local_timer_interrupts 2036 ± 8% +98.3% 4038 ± 5% interrupts.CPU63.RES:Rescheduling_interrupts 720.25 ± 9% -81.5% 133.25 ± 5% interrupts.CPU63.TLB:TLB_shootdowns 2130 ± 3% +17.9% 2511 ± 3% interrupts.CPU64.CAL:Function_call_interrupts 178590 ± 2% +137.5% 424161 ± 3% interrupts.CPU64.LOC:Local_timer_interrupts 2072 ± 8% +119.3% 4545 ± 12% interrupts.CPU64.RES:Rescheduling_interrupts 746.00 ± 7% -83.9% 120.00 ± 9% interrupts.CPU64.TLB:TLB_shootdowns 2113 ± 3% +12.4% 2374 ± 4% interrupts.CPU65.CAL:Function_call_interrupts 178593 ± 2% +136.9% 423054 ± 3% interrupts.CPU65.LOC:Local_timer_interrupts 0.50 ±100% +5.4e+05% 2712 ± 84% interrupts.CPU65.NMI:Non-maskable_interrupts 0.50 ±100% +5.4e+05% 2712 ± 84% interrupts.CPU65.PMI:Performance_monitoring_interrupts 2061 ± 9% +108.3% 4293 ± 6% interrupts.CPU65.RES:Rescheduling_interrupts 741.75 ± 8% -83.7% 121.25 ± 15% interrupts.CPU65.TLB:TLB_shootdowns 2105 ± 4% +13.0% 2379 interrupts.CPU66.CAL:Function_call_interrupts 178513 ± 2% +137.4% 423859 ± 4% interrupts.CPU66.LOC:Local_timer_interrupts 1946 ± 9% +127.2% 4422 ± 9% interrupts.CPU66.RES:Rescheduling_interrupts 765.00 ± 7% -84.8% 116.50 ± 23% interrupts.CPU66.TLB:TLB_shootdowns 2098 ± 3% +12.7% 2365 ± 2% interrupts.CPU67.CAL:Function_call_interrupts 178831 ± 2% +136.7% 423377 ± 3% interrupts.CPU67.LOC:Local_timer_interrupts 1958 ± 6% +143.3% 4766 ± 11% interrupts.CPU67.RES:Rescheduling_interrupts 758.00 ± 7% -83.1% 127.75 ± 9% interrupts.CPU67.TLB:TLB_shootdowns 2096 ± 4% +14.3% 2397 ± 3% interrupts.CPU68.CAL:Function_call_interrupts 178848 ± 2% +136.9% 423713 ± 4% interrupts.CPU68.LOC:Local_timer_interrupts 2073 ± 7% +120.4% 4568 ± 7% interrupts.CPU68.RES:Rescheduling_interrupts 740.75 ± 7% -82.1% 132.50 ± 19% interrupts.CPU68.TLB:TLB_shootdowns 2057 ± 2% +15.7% 2381 interrupts.CPU69.CAL:Function_call_interrupts 178892 ± 2% +137.0% 423928 ± 4% interrupts.CPU69.LOC:Local_timer_interrupts 2069 ± 11% +130.5% 4769 ± 11% interrupts.CPU69.RES:Rescheduling_interrupts 750.00 ± 5% -83.5% 124.00 ± 12% interrupts.CPU69.TLB:TLB_shootdowns 2055 ± 3% +16.4% 2391 ± 6% interrupts.CPU7.CAL:Function_call_interrupts 178371 ± 2% +137.4% 423418 ± 3% interrupts.CPU7.LOC:Local_timer_interrupts 2122 ± 5% +124.1% 4755 ± 9% interrupts.CPU7.RES:Rescheduling_interrupts 746.00 ± 9% -83.3% 124.75 ± 14% interrupts.CPU7.TLB:TLB_shootdowns 2030 ± 5% +22.5% 2488 ± 5% interrupts.CPU70.CAL:Function_call_interrupts 178252 ± 2% +137.3% 422943 ± 3% interrupts.CPU70.LOC:Local_timer_interrupts 1955 ± 10% +108.9% 4083 ± 8% interrupts.CPU70.RES:Rescheduling_interrupts 723.25 ± 11% -81.4% 134.75 ± 17% interrupts.CPU70.TLB:TLB_shootdowns 2117 ± 5% +13.8% 2408 ± 5% interrupts.CPU71.CAL:Function_call_interrupts 178550 ± 2% +137.5% 424117 ± 3% interrupts.CPU71.LOC:Local_timer_interrupts 0.75 ± 57% +3.3e+05% 2504 ±122% interrupts.CPU71.NMI:Non-maskable_interrupts 0.75 ± 57% +3.3e+05% 2504 ±122% interrupts.CPU71.PMI:Performance_monitoring_interrupts 2107 ± 3% +283.0% 8071 ± 3% interrupts.CPU71.RES:Rescheduling_interrupts 765.00 ± 12% -81.7% 140.25 ± 5% interrupts.CPU71.TLB:TLB_shootdowns 2096 ± 5% +16.0% 2431 ± 2% interrupts.CPU72.CAL:Function_call_interrupts 178421 ± 2% +137.7% 424096 ± 3% interrupts.CPU72.LOC:Local_timer_interrupts 2144 ± 4% +129.8% 4926 ± 11% interrupts.CPU72.RES:Rescheduling_interrupts 725.50 ± 10% -81.9% 131.50 ± 8% interrupts.CPU72.TLB:TLB_shootdowns 2140 ± 7% +16.0% 2482 ± 2% interrupts.CPU73.CAL:Function_call_interrupts 178147 ± 2% +138.0% 424075 ± 3% interrupts.CPU73.LOC:Local_timer_interrupts 2083 ± 4% +100.8% 4185 ± 7% interrupts.CPU73.RES:Rescheduling_interrupts 771.50 ± 12% -83.7% 125.50 ± 13% interrupts.CPU73.TLB:TLB_shootdowns 2126 ± 6% +16.7% 2481 interrupts.CPU74.CAL:Function_call_interrupts 177936 ± 2% +138.3% 423994 ± 3% interrupts.CPU74.LOC:Local_timer_interrupts 0.50 ±173% +7.9e+05% 3972 ± 72% interrupts.CPU74.NMI:Non-maskable_interrupts 0.50 ±173% +7.9e+05% 3972 ± 72% interrupts.CPU74.PMI:Performance_monitoring_interrupts 2139 ± 5% +118.6% 4678 ± 7% interrupts.CPU74.RES:Rescheduling_interrupts 753.75 ± 11% -76.5% 177.25 ± 64% interrupts.CPU74.TLB:TLB_shootdowns 2131 ± 5% +17.1% 2495 interrupts.CPU75.CAL:Function_call_interrupts 178256 ± 2% +137.7% 423769 ± 3% interrupts.CPU75.LOC:Local_timer_interrupts 2106 ± 6% +95.8% 4123 ± 5% interrupts.CPU75.RES:Rescheduling_interrupts 763.50 ± 14% -84.8% 116.25 ± 12% interrupts.CPU75.TLB:TLB_shootdowns 2057 ± 7% +15.7% 2381 interrupts.CPU76.CAL:Function_call_interrupts 178746 ± 2% +136.8% 423292 ± 3% interrupts.CPU76.LOC:Local_timer_interrupts 2126 ± 4% +107.7% 4414 ± 7% interrupts.CPU76.RES:Rescheduling_interrupts 764.50 ± 9% -82.7% 132.00 ± 22% interrupts.CPU76.TLB:TLB_shootdowns 178599 ± 2% +136.7% 422665 ± 4% interrupts.CPU77.LOC:Local_timer_interrupts 2169 ± 6% +100.7% 4352 ± 3% interrupts.CPU77.RES:Rescheduling_interrupts 776.25 ± 8% -85.1% 116.00 ± 18% interrupts.CPU77.TLB:TLB_shootdowns 2109 ± 3% +18.9% 2507 interrupts.CPU78.CAL:Function_call_interrupts 178282 ± 2% +137.5% 423375 ± 3% interrupts.CPU78.LOC:Local_timer_interrupts 0.50 ±173% +8e+05% 4017 ± 69% interrupts.CPU78.NMI:Non-maskable_interrupts 0.50 ±173% +8e+05% 4017 ± 69% interrupts.CPU78.PMI:Performance_monitoring_interrupts 2137 ± 7% +89.3% 4046 ± 12% interrupts.CPU78.RES:Rescheduling_interrupts 730.00 ± 3% -83.5% 120.50 ± 10% interrupts.CPU78.TLB:TLB_shootdowns 177829 ± 2% +137.9% 423117 ± 3% interrupts.CPU79.LOC:Local_timer_interrupts 0.50 ±173% +1.1e+06% 5488 ± 27% interrupts.CPU79.NMI:Non-maskable_interrupts 0.50 ±173% +1.1e+06% 5488 ± 27% interrupts.CPU79.PMI:Performance_monitoring_interrupts 2217 ± 5% +104.2% 4526 ± 6% interrupts.CPU79.RES:Rescheduling_interrupts 975.25 ± 39% -87.9% 117.75 ± 12% interrupts.CPU79.TLB:TLB_shootdowns 48.75 ± 9% +137.4% 115.75 ± 12% interrupts.CPU8.53:PCI-MSI.1572872-edge.eth0-TxRx-8 178362 ± 2% +137.6% 423707 ± 3% interrupts.CPU8.LOC:Local_timer_interrupts 2126 ± 6% +104.4% 4346 ± 7% interrupts.CPU8.RES:Rescheduling_interrupts 910.25 ± 20% -88.4% 105.75 ± 13% interrupts.CPU8.TLB:TLB_shootdowns 2146 +16.7% 2504 ± 4% interrupts.CPU80.CAL:Function_call_interrupts 178600 ± 2% +137.5% 424259 ± 3% interrupts.CPU80.LOC:Local_timer_interrupts 2047 ± 9% +119.4% 4493 ± 9% interrupts.CPU80.RES:Rescheduling_interrupts 776.25 ± 10% -84.5% 120.25 ± 10% interrupts.CPU80.TLB:TLB_shootdowns 2126 ± 4% +16.6% 2479 ± 5% interrupts.CPU81.CAL:Function_call_interrupts 178855 ± 2% +136.6% 423237 ± 3% interrupts.CPU81.LOC:Local_timer_interrupts 2135 ± 4% +91.5% 4089 ± 6% interrupts.CPU81.RES:Rescheduling_interrupts 713.50 ± 12% -84.2% 112.50 ± 15% interrupts.CPU81.TLB:TLB_shootdowns 2150 ± 5% +15.8% 2491 ± 3% interrupts.CPU82.CAL:Function_call_interrupts 178151 ± 2% +137.2% 422663 ± 3% interrupts.CPU82.LOC:Local_timer_interrupts 2026 ± 6% +135.9% 4781 ± 11% interrupts.CPU82.RES:Rescheduling_interrupts 757.00 ± 9% -84.7% 116.00 ± 12% interrupts.CPU82.TLB:TLB_shootdowns 2087 ± 4% +13.6% 2370 ± 4% interrupts.CPU83.CAL:Function_call_interrupts 178189 ± 2% +137.6% 423348 ± 3% interrupts.CPU83.LOC:Local_timer_interrupts 1950 ± 7% +119.1% 4272 ± 14% interrupts.CPU83.RES:Rescheduling_interrupts 743.50 ± 7% -80.2% 147.00 ± 7% interrupts.CPU83.TLB:TLB_shootdowns 2105 ± 4% +15.0% 2421 ± 3% interrupts.CPU84.CAL:Function_call_interrupts 178215 ± 2% +137.4% 423120 ± 4% interrupts.CPU84.LOC:Local_timer_interrupts 2028 ± 5% +98.2% 4019 ± 6% interrupts.CPU84.RES:Rescheduling_interrupts 735.50 ± 8% -81.5% 136.25 ± 22% interrupts.CPU84.TLB:TLB_shootdowns 2130 ± 3% +18.5% 2525 ± 2% interrupts.CPU85.CAL:Function_call_interrupts 178050 ± 2% +137.6% 423068 ± 4% interrupts.CPU85.LOC:Local_timer_interrupts 2033 ± 6% +104.3% 4153 ± 5% interrupts.CPU85.RES:Rescheduling_interrupts 739.50 ± 9% -78.4% 160.00 ± 30% interrupts.CPU85.TLB:TLB_shootdowns 2135 ± 6% +13.7% 2428 ± 2% interrupts.CPU86.CAL:Function_call_interrupts 177764 ± 2% +138.1% 423325 ± 4% interrupts.CPU86.LOC:Local_timer_interrupts 2025 ± 4% +122.3% 4501 ± 5% interrupts.CPU86.RES:Rescheduling_interrupts 737.50 ± 11% -81.1% 139.75 ± 24% interrupts.CPU86.TLB:TLB_shootdowns 2146 ± 4% +14.1% 2448 ± 2% interrupts.CPU87.CAL:Function_call_interrupts 178281 ± 2% +137.6% 423547 ± 3% interrupts.CPU87.LOC:Local_timer_interrupts 2079 ± 11% +96.8% 4092 ± 13% interrupts.CPU87.RES:Rescheduling_interrupts 752.25 ± 6% -78.7% 160.50 ± 28% interrupts.CPU87.TLB:TLB_shootdowns 2090 ± 5% +20.2% 2512 ± 5% interrupts.CPU88.CAL:Function_call_interrupts 178228 ± 2% +137.5% 423338 ± 3% interrupts.CPU88.LOC:Local_timer_interrupts 0.25 ±173% +8.0e+05% 2012 ±104% interrupts.CPU88.NMI:Non-maskable_interrupts 0.25 ±173% +8.0e+05% 2012 ±104% interrupts.CPU88.PMI:Performance_monitoring_interrupts 1979 ± 7% +105.6% 4068 ± 8% interrupts.CPU88.RES:Rescheduling_interrupts 726.75 ± 7% -69.2% 223.75 ± 11% interrupts.CPU88.TLB:TLB_shootdowns 2181 ± 2% +12.8% 2459 ± 3% interrupts.CPU89.CAL:Function_call_interrupts 178752 ± 2% +136.8% 423287 ± 3% interrupts.CPU89.LOC:Local_timer_interrupts 0.50 ±173% +3e+05% 1488 ±172% interrupts.CPU89.NMI:Non-maskable_interrupts 0.50 ±173% +3e+05% 1488 ±172% interrupts.CPU89.PMI:Performance_monitoring_interrupts 1986 ± 3% +119.7% 4364 ± 17% interrupts.CPU89.RES:Rescheduling_interrupts 763.75 ± 5% -59.6% 308.50 ± 13% interrupts.CPU89.TLB:TLB_shootdowns 49.25 ± 4% +120.3% 108.50 ± 4% interrupts.CPU9.54:PCI-MSI.1572873-edge.eth0-TxRx-9 178283 ± 2% +137.3% 423036 ± 3% interrupts.CPU9.LOC:Local_timer_interrupts 1916 ± 7% +123.0% 4274 ± 5% interrupts.CPU9.RES:Rescheduling_interrupts 779.75 ± 14% -85.9% 110.00 ± 9% interrupts.CPU9.TLB:TLB_shootdowns 178705 +136.7% 422992 ± 3% interrupts.CPU90.LOC:Local_timer_interrupts 2065 ± 6% +127.0% 4688 interrupts.CPU90.RES:Rescheduling_interrupts 730.00 ± 11% -83.8% 118.25 ± 13% interrupts.CPU90.TLB:TLB_shootdowns 2098 ± 3% +17.9% 2473 ± 3% interrupts.CPU91.CAL:Function_call_interrupts 178261 ± 2% +137.1% 422745 ± 3% interrupts.CPU91.LOC:Local_timer_interrupts 0.50 ±173% +7.2e+05% 3622 ± 61% interrupts.CPU91.NMI:Non-maskable_interrupts 0.50 ±173% +7.2e+05% 3622 ± 61% interrupts.CPU91.PMI:Performance_monitoring_interrupts 2104 ± 7% +99.4% 4196 ± 9% interrupts.CPU91.RES:Rescheduling_interrupts 757.75 ± 12% -83.4% 126.00 ± 17% interrupts.CPU91.TLB:TLB_shootdowns 178249 ± 2% +137.3% 423045 ± 3% interrupts.CPU92.LOC:Local_timer_interrupts 0.50 ±173% +9.1e+05% 4535 ± 61% interrupts.CPU92.NMI:Non-maskable_interrupts 0.50 ±173% +9.1e+05% 4535 ± 61% interrupts.CPU92.PMI:Performance_monitoring_interrupts 2093 ± 7% +101.7% 4222 ± 15% interrupts.CPU92.RES:Rescheduling_interrupts 804.00 ± 12% -85.1% 120.00 ± 17% interrupts.CPU92.TLB:TLB_shootdowns 2096 ± 3% +19.9% 2512 ± 5% interrupts.CPU93.CAL:Function_call_interrupts 178059 ± 2% +138.0% 423834 ± 4% interrupts.CPU93.LOC:Local_timer_interrupts 2045 ± 6% +116.3% 4424 ± 5% interrupts.CPU93.RES:Rescheduling_interrupts 733.25 ± 7% -82.2% 130.25 ± 17% interrupts.CPU93.TLB:TLB_shootdowns 2171 ± 5% +13.4% 2461 ± 3% interrupts.CPU94.CAL:Function_call_interrupts 178165 ± 2% +137.2% 422684 ± 3% interrupts.CPU94.LOC:Local_timer_interrupts 2091 ± 4% +87.4% 3918 ± 5% interrupts.CPU94.RES:Rescheduling_interrupts 766.25 ± 12% -82.8% 131.75 ± 17% interrupts.CPU94.TLB:TLB_shootdowns 178660 ± 2% +136.9% 423266 ± 3% interrupts.CPU95.LOC:Local_timer_interrupts 2123 ± 5% +101.0% 4267 ± 4% interrupts.CPU95.RES:Rescheduling_interrupts 777.75 ± 7% -85.0% 116.75 ± 14% interrupts.CPU95.TLB:TLB_shootdowns 2096 ± 5% +18.2% 2478 interrupts.CPU96.CAL:Function_call_interrupts 178186 ± 2% +137.6% 423346 ± 3% interrupts.CPU96.LOC:Local_timer_interrupts 0.25 ±173% +1.1e+06% 2708 ±100% interrupts.CPU96.NMI:Non-maskable_interrupts 0.25 ±173% +1.1e+06% 2708 ±100% interrupts.CPU96.PMI:Performance_monitoring_interrupts 2199 ± 9% +107.7% 4568 ± 14% interrupts.CPU96.RES:Rescheduling_interrupts 709.75 ± 12% -83.0% 120.50 ± 10% interrupts.CPU96.TLB:TLB_shootdowns 178169 ± 2% +137.6% 423403 ± 3% interrupts.CPU97.LOC:Local_timer_interrupts 2154 ± 6% +73.7% 3743 ± 11% interrupts.CPU97.RES:Rescheduling_interrupts 743.50 ± 8% -83.8% 120.50 ± 9% interrupts.CPU97.TLB:TLB_shootdowns 2131 ± 4% +17.1% 2494 ± 4% interrupts.CPU98.CAL:Function_call_interrupts 178234 ± 2% +137.4% 423113 ± 3% interrupts.CPU98.LOC:Local_timer_interrupts 2017 ± 7% +108.2% 4201 interrupts.CPU98.RES:Rescheduling_interrupts 749.75 ± 8% -82.6% 130.75 ± 11% interrupts.CPU98.TLB:TLB_shootdowns 2048 ± 4% +20.7% 2471 ± 2% interrupts.CPU99.CAL:Function_call_interrupts 178469 ± 2% +137.4% 423707 ± 3% interrupts.CPU99.LOC:Local_timer_interrupts 2055 ± 9% +109.4% 4304 ± 8% interrupts.CPU99.RES:Rescheduling_interrupts 753.25 ± 10% -83.6% 123.75 ± 15% interrupts.CPU99.TLB:TLB_shootdowns 25685095 ± 2% +137.4% 60973273 ± 3% interrupts.LOC:Local_timer_interrupts 18.75 ± 14% +2.2e+06% 417779 ± 19% interrupts.NMI:Non-maskable_interrupts 19.00 ± 12% +2.2e+06% 417779 ± 19% interrupts.PMI:Performance_monitoring_interrupts 297050 ± 6% +120.4% 654785 interrupts.RES:Rescheduling_interrupts 108401 ± 7% -81.3% 20304 ± 13% interrupts.TLB:TLB_shootdowns reaim.time.user_time 2500 +-+------------------------------------------------------------------+ O O O O O O O O O O O O O O O O O O O O O O O O O |..+.+..+..+.+..+..+.+..+..+.+..+..+.+..+.+..+..+.+..+..+.+..+..+ | 2000 +-+ | | | | | 1500 +-+ | | | 1000 +-+ | | | | | 500 +-+ | | | | | 0 +-+-------------------------------------O----O-----------------------+ reaim.time.system_time 30000 +-+-----------------------------------------------------------------+ | | 25000 O-+ O O O O O O O O O O O | O O O O O O O O O O O O | | O | 20000 +-+ | | | 15000 +-+ | | | 10000 +-+ | | | | | 5000 +-++.+..+.+..+..+.+..+..+.+..+.+..+..+.+..+.+..+..+.+..+..+.+..+ | | | 0 +-+------------------------------------O----O-----------------------+ reaim.time.elapsed_time 300 +-+-------------------------------------------------------------------+ | O | 250 +-+ O | | | O O O O O O O O O O O O O O O O 200 +-+O O O O O O O | | | 150 +-+ | | | 100 +-+ | |..+.+..+..+.+..+..+..+.+..+..+.+..+..+.+..+..+.+..+..+..+.+..+..+ | | | 50 +-+ | | | 0 +-+-------------------------------------O-----O-----------------------+ reaim.time.elapsed_time.max 300 +-+-------------------------------------------------------------------+ | O | 250 +-+ O | | | O O O O O O O O O O O O O O O O 200 +-+O O O O O O O | | | 150 +-+ | | | 100 +-+ | |..+.+..+..+.+..+..+..+.+..+..+.+..+..+.+..+..+.+..+..+..+.+..+..+ | | | 50 +-+ | | | 0 +-+-------------------------------------O-----O-----------------------+ reaim.time.voluntary_context_switches 7e+06 +-+-----------------------------------------------------------------+ | | 6e+06 +-++. .+.+.. .+. +.. .+..+.. +.. .+..+.. .+..+.. .+.. | |.. +. +. +.. + + + + + + + | 5e+06 +-+ +..+ + | | | 4e+06 +-+ | | | 3e+06 +-+ O O O O O O O O O O O O O O O O O O O O O O O O O | 2e+06 +-+ | | | 1e+06 +-+ | | | 0 +-+------------------------------------O----O-----------------------+ reaim.time.involuntary_context_switches 4e+06 +-+---------------------------------------------------------------+ O O O O O O O O O O O O O O O O O O O O O 3.5e+06 +-+ O O O O | 3e+06 +-+ | | | 2.5e+06 +-+ | | | 2e+06 +-+ | | | 1.5e+06 +-+ | 1e+06 +-++.+..+.+..+.+..+.+..+.+..+.+..+..+.+..+.+..+.+..+.+..+.+..+ | | | 500000 +-+ | | | 0 +-+-----------------------------------O----O----------------------+ reaim.parent_time 70 +-+-----------O--------------------------------------------------------+ | | 60 +-+ O | | O O O | 50 O-+O O O O O O O O O O O O O O O O O | O O | 40 +-+ | | | 30 +-+ | | | 20 +-++.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+.+..+..+..+.+..+..+..+ | | | 10 +-+ | | | 0 +-+--------------------------------------O----O------------------------+ reaim.child_systime 7000 +-+------------------------------------------------------------------+ O O O O O O O O 6000 +-+O O O O O O O O O O O O O | | O O O O | 5000 +-+ | | | 4000 +-+ | | | 3000 +-+ | | | 2000 +-+ | | | 1000 +-++.+..+..+.+..+..+.+..+..+.+..+..+.+..+.+..+..+.+..+..+.+..+..+ | | | 0 +-+-------------------------------------O----O-----------------------+ reaim.child_utime 600 O-+O-O--O--O-O--O--O--O-O--O--O-O--O--O----O----O--O--O--O-O--O--O-O--O | .+.. .+. .+.. .+.. | 500 +-++ +..+.+..+..+..+.+..+. +..+..+.+. +.+. +..+.+..+..+ | | | | | 400 +-+ | | | 300 +-+ | | | 200 +-+ | | | | | 100 +-+ | | | 0 +-+-------------------------------------O-----O-----------------------+ reaim.jobs_per_min 800000 +-+----------------------------------------------------------------+ | .+.. .+. .+.. .+.. .+.. | 700000 +-++ +.+. +..+..+.+..+ +..+.+..+ +.+. +.+.. .+..+ | | + | 600000 +-+ | 500000 +-+ | | | 400000 +-+ | | | 300000 O-+O O O O O O O O O O O O O O O O O O O O 200000 +-+ O O O O | | | 100000 +-+ | | | 0 +-+------------------------------------O----O----------------------+ reaim.jobs_per_min_child 350 +-+-------------------------------------------------------------------+ | .+.. .+. .+.. .+.. | 300 +-++ +..+.+..+..+..+.+..+. +..+..+.+. +.+. +..+. .+..+ | | +. | 250 +-+ | | | 200 +-+ | | | 150 +-+ | O O O O O O O O O O O O O O O O O O | 100 +-+ O O O O O O O | | 50 +-+ | | | 0 +-+-------------------------------------O-----O-----------------------+ reaim.std_dev_time 12 +-+--------------------------------------------------------------------+ | O | 10 +-+ | | | | | 8 +-+ | | O O | 6 O-+O O O O O O O O O O O O O O | O O O O O O O | 4 +-+ | | | | +.. | 2 +-++.+..+.. .+.+.. .+.+..+..+.. .+..+..+.+.. .. +.+..+..+.. | | +. +..+. + + + | 0 +-+--------------------------------------O----O------------------------+ reaim.max_jobs_per_min 800000 +-+----------------------------------------------------------------+ |.. + .+. .+.. + .+.. + .+.. | 700000 +-++ +.+. +..+..+ + +..+ + +.+. +.+..+.+..+ | | | 600000 +-+ | 500000 +-+ | | | 400000 +-+ | | O O | 300000 O-+O O O O O O O O O O O O O O O O O O O O O O 200000 +-+ | | | 100000 +-+ | | | 0 +-+------------------------------------O----O----------------------+ syscalls.sys_fcntl.max 30000 +-+-----------------------------------------------------------------+ | : | 25000 +-+ : + + | | + : : + + : | | : : : : : :: | 20000 +-+ :: : : : : : : : : | | : : : : : : : : : : | 15000 +-+ : : : : : : : : : : | | : : : : : : : : : : | 10000 +-+ : : : : : : : : : : | | : : : : : : : : : : | | : : : : : : : : : | 5000 +-+ : : : : : : : : : | |..+..+ + +..+..+.+..+ +..+..+.+ +..+..+ +..+..| 0 +-+-----------------------------------------------------------------+ syscalls.sys_fcntl.min 540 +-+-------------------------------------------------------------------+ | + + | 520 +-+ : : | 500 +-+ : : : : | |: : : : : | 480 +-+ : : : : | | : : : : : | 460 +-+ : : : : | | : .+ + : : : : | 440 +-+: .+. : :+ : : .+ : .+ .+.. | 420 +-++.. .+. : : +: +.. .+. +.. .+. + .+. +.. | | +. : : + +. +. +. +..| 400 +-+ :: | | + | 380 +-+-------------------------------------------------------------------+ syscalls.sys_fcntl.med 1400 +-+------------------------------------------------------------------+ 1300 +-+ : : | |: :: : : | 1200 +-+ : : : : | 1100 +-+ : : : : | |: : : : : | 1000 +-+ : : : : | 900 +-+ : : : : | 800 +-+ : : : : | | : : : : : | 700 +-+: : : : : | 600 +-++.. .+..+. : +.. .+.+ +.. .+..+.. .+..+..+..| | +. +..+..+..+ +. +. +..+ | 500 +-+ | 400 +-+------------------------------------------------------------------+ syscalls.sys_fcntl.noise.5_ 2.4e+07 +-+---------------------------------------------------------------+ 2.2e+07 +-+ .+ + | | +. : : | 2e+07 +-+ : : + + :: | 1.8e+07 +-+ : : : : : : | |: : : : : :: : : | 1.6e+07 +-+ : : : : : : : : | 1.4e+07 +-+ : : : : : : : : | 1.2e+07 +-+ + : : : : + : : + : : | | : :: : : : : : : : : : : : : | 1e+07 +-+ : : : : : : : : : : : : : : | 8e+06 +-+ : :: : + : : :: : : : : : | | : : + : + : : + : : +.+..+ : | 6e+06 +-++..+ :+ +.+ +..+ : ..| 4e+06 +-+---------------------------------------------------------------+ syscalls.sys_fcntl.noise.2_ 2.4e+07 +-+---------------------------------------------------------------+ 2.2e+07 +-+ +..+ + | | : : : | 2e+07 +-+ : : + + :: | 1.8e+07 +-+ : : : : : : | |: : : : : :: : : | 1.6e+07 +-+ : : : : : : : : | 1.4e+07 +-+ : : : : : : : : | 1.2e+07 +-+ + : : : : + : : + : : | | : :: : : : : : : : : : : : : | 1e+07 +-+ : : : : : : : : : : : : : : | 8e+06 +-+ : :: : + : : :: : : : : : | | : : + : + : : + : : +.+..+ : | 6e+06 +-++..+ :+ +.+ +..+ : ..| 4e+06 +-+---------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-skl-sp2: 40 threads Skylake-SP with 64G memory ========================================================================================= compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase: gcc-7/performance/x86_64-rhel-7.6/100%/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-sp2/five_sec/reaim commit: 3120b9a6a3 (" ipc: fix regressions from y2038 patches") ce6cd6796e ("Revert "lockless next_positive()"") 3120b9a6a3f7487f ce6cd6796ef5e1a32f598efb433 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 5:4 -93% 2:4 perf-profile.children.cycles-pp.error_entry 2:4 -43% 1:4 perf-profile.self.cycles-pp.error_entry %stddev %change %stddev \ | \ 6.21 +362.6% 28.74 reaim.child_systime 5.48 -2.1% 5.37 reaim.child_utime 606883 -59.1% 248062 reaim.jobs_per_min 15172 -59.1% 6201 reaim.jobs_per_min_child 625263 -59.0% 256221 reaim.max_jobs_per_min 0.39 +144.7% 0.96 reaim.parent_time 2.39 -31.5% 1.64 reaim.std_dev_percent 0.01 +43.6% 0.01 ± 4% reaim.std_dev_time 993615 -30.4% 692002 reaim.time.involuntary_context_switches 1.51e+08 -18.9% 1.224e+08 reaim.time.minor_page_faults 485.75 +135.9% 1146 reaim.time.percent_of_cpu_this_job_got 778.23 +275.0% 2918 reaim.time.system_time 686.71 -20.5% 545.98 reaim.time.user_time 1760695 -25.0% 1321119 reaim.time.voluntary_context_switches 500000 -18.8% 406000 reaim.workload 87.00 -18.7% 70.75 vmstat.cpu.id 6.00 +104.2% 12.25 ± 3% vmstat.procs.r 20310 -27.3% 14759 vmstat.system.cs 13692528 -65.8% 4676111 cpuidle.C1.time 228159 -51.4% 110865 cpuidle.C1.usage 1.029e+10 -42.0% 5.963e+09 ± 44% cpuidle.C1E.time 22780081 -33.9% 15068354 ± 22% cpuidle.C1E.usage 251686 -36.5% 159923 ± 2% cpuidle.POLL.time 33035 -12.4% 28927 ± 6% cpuidle.POLL.usage 1376 -1.4% 1357 proc-vmstat.nr_page_table_pages 8056 +4.3% 8400 ± 3% proc-vmstat.nr_shmem 14329 +3.0% 14761 proc-vmstat.nr_slab_reclaimable 30048 +6.1% 31887 proc-vmstat.nr_slab_unreclaimable 1.45e+08 -18.5% 1.182e+08 proc-vmstat.numa_hit 1.45e+08 -18.5% 1.182e+08 proc-vmstat.numa_local 54216 -24.7% 40827 proc-vmstat.pgactivate 1.489e+08 -18.0% 1.221e+08 proc-vmstat.pgalloc_normal 1.515e+08 -18.9% 1.229e+08 proc-vmstat.pgfault 1.489e+08 -18.1% 1.22e+08 proc-vmstat.pgfree 412.25 +124.1% 923.75 turbostat.Avg_MHz 14.92 +16.7 31.61 ± 2% turbostat.Busy% 225740 -51.6% 109278 turbostat.C1 0.11 -0.1 0.04 turbostat.C1% 22779096 -33.9% 15067706 ± 22% turbostat.C1E 85.01 -36.0 49.01 ± 44% turbostat.C1E% 84.97 -22.9% 65.48 ± 8% turbostat.CPU%c1 51.25 +9.3% 56.00 ± 2% turbostat.PkgTmp 60.42 +18.0% 71.30 turbostat.PkgWatt 17.78 -2.7% 17.29 turbostat.RAMWatt 3184 ± 4% -20.3% 2537 ± 4% slabinfo.files_cache.active_objs 3184 ± 4% -20.3% 2537 ± 4% slabinfo.files_cache.num_objs 12446 +19.9% 14924 slabinfo.filp.active_objs 12978 +23.9% 16084 slabinfo.filp.num_objs 47450 +63.7% 77684 ± 2% slabinfo.kmalloc-32.active_objs 370.50 +63.8% 606.75 ± 2% slabinfo.kmalloc-32.active_slabs 47450 +63.8% 77742 ± 2% slabinfo.kmalloc-32.num_objs 370.50 +63.8% 606.75 ± 2% slabinfo.kmalloc-32.num_slabs 2605 ± 5% -8.9% 2373 slabinfo.mm_struct.active_objs 2606 ± 5% -8.9% 2373 slabinfo.mm_struct.num_objs 486.50 ± 3% -29.2% 344.25 slabinfo.names_cache.active_objs 486.75 ± 3% -29.3% 344.25 slabinfo.names_cache.num_objs 5076 ± 4% +166.5% 13528 ± 5% slabinfo.pid.active_objs 158.25 ± 4% +167.1% 422.75 ± 5% slabinfo.pid.active_slabs 5076 ± 4% +166.9% 13548 ± 5% slabinfo.pid.num_objs 158.25 ± 4% +167.1% 422.75 ± 5% slabinfo.pid.num_slabs 4624 ± 5% +301.1% 18550 ± 3% slabinfo.task_delay_info.active_objs 90.00 ± 5% +304.2% 363.75 ± 3% slabinfo.task_delay_info.active_slabs 4624 ± 5% +301.6% 18572 ± 3% slabinfo.task_delay_info.num_objs 90.00 ± 5% +304.2% 363.75 ± 3% slabinfo.task_delay_info.num_slabs 1146 ± 7% -14.8% 976.25 ± 12% slabinfo.task_group.active_objs 1146 ± 7% -14.8% 976.25 ± 12% slabinfo.task_group.num_objs 713.50 +30.0% 927.50 slabinfo.task_struct.active_objs 716.75 +29.8% 930.25 slabinfo.task_struct.active_slabs 716.75 +29.8% 930.25 slabinfo.task_struct.num_objs 716.75 +29.8% 930.25 slabinfo.task_struct.num_slabs 17708 ± 9% +145.1% 43407 sched_debug.cfs_rq:/.exec_clock.avg 21325 ± 10% +119.5% 46810 ± 2% sched_debug.cfs_rq:/.exec_clock.max 17145 ± 9% +149.5% 42776 sched_debug.cfs_rq:/.exec_clock.min 588309 ± 9% +175.3% 1619391 sched_debug.cfs_rq:/.min_vruntime.avg 655775 ± 8% +154.7% 1670397 sched_debug.cfs_rq:/.min_vruntime.max 574556 ± 9% +177.1% 1591957 sched_debug.cfs_rq:/.min_vruntime.min 32.17 ± 18% -28.2% 23.09 ± 23% sched_debug.cfs_rq:/.nr_spread_over.stddev 19.20 ± 31% -55.6% 8.53 ± 61% sched_debug.cfs_rq:/.removed.load_avg.avg 882.88 ± 31% -55.5% 392.98 ± 61% sched_debug.cfs_rq:/.removed.runnable_sum.avg 1695 ±450% -1019.2% -15588 sched_debug.cfs_rq:/.spread0.avg 69165 ± 19% -48.8% 35410 ± 64% sched_debug.cfs_rq:/.spread0.max -12056 +256.9% -43023 sched_debug.cfs_rq:/.spread0.min 1.13 ± 5% -9.2% 1.02 ± 7% sched_debug.cpu.clock.stddev 1.13 ± 5% -9.1% 1.02 ± 7% sched_debug.cpu.clock_task.stddev 24554 +25.6% 30846 ± 7% sched_debug.cpu.curr->pid.max 0.33 ± 2% -11.2% 0.30 ± 6% sched_debug.cpu.nr_running.stddev 73964 ± 9% -22.5% 57341 sched_debug.cpu.nr_switches.avg 85398 ± 8% -24.0% 64917 sched_debug.cpu.nr_switches.max 70258 ± 8% -25.3% 52450 sched_debug.cpu.nr_switches.min 68.97 ± 7% -55.9% 30.42 ± 18% sched_debug.cpu.nr_uninterruptible.max -68.42 -56.0% -30.12 sched_debug.cpu.nr_uninterruptible.min 32.27 ± 8% -55.9% 14.22 ± 8% sched_debug.cpu.nr_uninterruptible.stddev 72778 ± 9% -20.7% 57702 sched_debug.cpu.sched_count.avg 89752 ± 10% -23.8% 68416 ± 2% sched_debug.cpu.sched_count.max 69237 ± 9% -23.3% 53102 sched_debug.cpu.sched_count.min 3792 ± 11% -21.3% 2983 ± 10% sched_debug.cpu.sched_count.stddev 21324 ± 9% -29.1% 15116 sched_debug.cpu.sched_goidle.avg 26160 ± 7% -32.1% 17764 ± 2% sched_debug.cpu.sched_goidle.max 19490 ± 9% -31.0% 13442 sched_debug.cpu.sched_goidle.min 1319 ± 2% -29.5% 930.01 ± 6% sched_debug.cpu.sched_goidle.stddev 27503 ± 9% -20.6% 21834 sched_debug.cpu.ttwu_count.avg 33061 ± 7% -23.4% 25313 sched_debug.cpu.ttwu_count.max 25691 ± 9% -23.2% 19721 sched_debug.cpu.ttwu_count.min 1370 ± 7% -14.3% 1174 ± 4% sched_debug.cpu.ttwu_count.stddev 14327 ± 9% -24.1% 10870 sched_debug.cpu.ttwu_local.avg 15165 ± 9% -21.1% 11961 sched_debug.cpu.ttwu_local.max 13435 ± 10% -26.3% 9899 sched_debug.cpu.ttwu_local.min 367.56 ± 15% +25.0% 459.31 sched_debug.cpu.ttwu_local.stddev 6.22 +84.3% 11.47 ± 64% perf-stat.i.MPKI 1.981e+09 -9.8% 1.787e+09 perf-stat.i.branch-instructions 41058424 -11.6% 36288062 ± 4% perf-stat.i.branch-misses 85106015 +10.6% 94128146 ± 7% perf-stat.i.cache-references 20503 -27.4% 14879 perf-stat.i.context-switches 1.67 +82.9% 3.05 ± 9% perf-stat.i.cpi 1.614e+10 +127.1% 3.666e+10 perf-stat.i.cpu-cycles 6803 -11.7% 6005 perf-stat.i.cpu-migrations 6752 +127.5% 15358 ± 15% perf-stat.i.cycles-between-cache-misses 5206103 ± 2% -20.6% 4135546 ± 5% perf-stat.i.dTLB-load-misses 2.224e+09 -10.5% 1.991e+09 perf-stat.i.dTLB-loads 0.12 +0.0 0.15 ± 15% perf-stat.i.dTLB-store-miss-rate% 2205811 -18.8% 1790132 perf-stat.i.dTLB-store-misses 1.188e+09 -16.7% 9.894e+08 perf-stat.i.dTLB-stores 28.00 +8.2 36.18 ± 16% perf-stat.i.iTLB-load-miss-rate% 2692461 -18.4% 2198367 ± 3% perf-stat.i.iTLB-load-misses 3320767 -21.6% 2603263 ± 2% perf-stat.i.iTLB-loads 1.278e+10 -13.0% 1.111e+10 perf-stat.i.instructions 12682 -31.6% 8671 ± 38% perf-stat.i.instructions-per-iTLB-miss 0.65 -46.2% 0.35 ± 9% perf-stat.i.ipc 496998 -19.2% 401383 perf-stat.i.minor-faults 466410 -30.4% 324688 perf-stat.i.node-loads 419756 -29.5% 295898 perf-stat.i.node-stores 496999 -19.2% 401383 perf-stat.i.page-faults 6.66 +27.2% 8.47 ± 7% perf-stat.overall.MPKI 2.55 -0.5 2.02 ± 11% perf-stat.overall.cache-miss-rate% 1.26 +161.2% 3.30 perf-stat.overall.cpi 7425 +165.6% 19720 ± 16% perf-stat.overall.cycles-between-cache-misses 0.23 -0.0 0.21 ± 5% perf-stat.overall.dTLB-load-miss-rate% 0.19 -0.0 0.18 perf-stat.overall.dTLB-store-miss-rate% 4747 +6.6% 5060 ± 3% perf-stat.overall.instructions-per-iTLB-miss 0.79 -61.7% 0.30 perf-stat.overall.ipc 7684980 +7.5% 8262051 perf-stat.overall.path-length 1.974e+09 -9.8% 1.781e+09 perf-stat.ps.branch-instructions 40906265 -11.6% 36159180 ± 4% perf-stat.ps.branch-misses 84791137 +10.6% 93793554 ± 7% perf-stat.ps.cache-references 20427 -27.4% 14826 perf-stat.ps.context-switches 1.608e+10 +127.2% 3.653e+10 perf-stat.ps.cpu-cycles 6778 -11.7% 5984 perf-stat.ps.cpu-migrations 5186759 ± 2% -20.6% 4120858 ± 5% perf-stat.ps.dTLB-load-misses 2.216e+09 -10.5% 1.984e+09 perf-stat.ps.dTLB-loads 2197611 -18.8% 1783750 perf-stat.ps.dTLB-store-misses 1.183e+09 -16.7% 9.858e+08 perf-stat.ps.dTLB-stores 2682459 -18.3% 2190536 ± 3% perf-stat.ps.iTLB-load-misses 3308635 -21.6% 2594084 ± 2% perf-stat.ps.iTLB-loads 1.273e+10 -13.0% 1.107e+10 perf-stat.ps.instructions 495153 -19.2% 399950 perf-stat.ps.minor-faults 464678 -30.4% 323528 perf-stat.ps.node-loads 418210 -29.5% 294846 perf-stat.ps.node-stores 495153 -19.2% 399950 perf-stat.ps.page-faults 3.842e+12 -12.7% 3.354e+12 perf-stat.total.instructions 63734 ± 16% -21.9% 49792 ± 5% softirqs.CPU0.RCU 46519 -16.1% 39036 softirqs.CPU0.SCHED 42450 ± 2% -18.0% 34819 ± 2% softirqs.CPU1.SCHED 65763 ± 15% -22.3% 51065 ± 7% softirqs.CPU10.RCU 43353 -19.0% 35114 softirqs.CPU10.SCHED 42057 -17.0% 34895 softirqs.CPU11.SCHED 63554 ± 16% -21.3% 50008 ± 4% softirqs.CPU12.RCU 42395 -17.6% 34924 softirqs.CPU12.SCHED 63281 ± 17% -21.1% 49898 ± 6% softirqs.CPU13.RCU 42563 -17.9% 34926 softirqs.CPU13.SCHED 63278 ± 16% -21.3% 49810 ± 5% softirqs.CPU14.RCU 42453 -17.7% 34928 softirqs.CPU14.SCHED 63170 ± 17% -21.2% 49793 ± 5% softirqs.CPU15.RCU 41968 -16.9% 34895 softirqs.CPU15.SCHED 63817 ± 17% -21.1% 50370 ± 7% softirqs.CPU16.RCU 42588 -18.1% 34891 softirqs.CPU16.SCHED 63631 ± 17% -22.7% 49194 ± 7% softirqs.CPU17.RCU 42529 -17.9% 34907 softirqs.CPU17.SCHED 63840 ± 18% -21.7% 49964 ± 6% softirqs.CPU18.RCU 42811 -18.4% 34921 softirqs.CPU18.SCHED 62828 ± 16% -21.0% 49660 ± 6% softirqs.CPU19.RCU 42357 -17.1% 35111 softirqs.CPU19.SCHED 65453 ± 15% -23.8% 49906 ± 3% softirqs.CPU2.RCU 42636 -17.1% 35366 softirqs.CPU2.SCHED 41198 -16.6% 34347 ± 3% softirqs.CPU20.SCHED 61315 ± 16% -19.7% 49214 ± 3% softirqs.CPU21.RCU 39854 ± 2% -15.7% 33585 ± 3% softirqs.CPU21.SCHED 64447 ± 15% -23.6% 49226 ± 6% softirqs.CPU22.RCU 41590 -17.6% 34289 ± 2% softirqs.CPU22.SCHED 64203 ± 18% -22.5% 49772 ± 6% softirqs.CPU23.RCU 41385 ± 3% -17.1% 34304 ± 2% softirqs.CPU23.SCHED 65704 ± 17% -22.9% 50631 ± 5% softirqs.CPU24.RCU 42436 -17.4% 35049 softirqs.CPU24.SCHED 62465 ± 16% -21.3% 49168 ± 5% softirqs.CPU25.RCU 40628 ± 2% -17.2% 33627 ± 2% softirqs.CPU25.SCHED 63812 ± 16% -24.1% 48412 ± 8% softirqs.CPU26.RCU 42429 -18.0% 34808 softirqs.CPU26.SCHED 63487 ± 16% -22.5% 49197 ± 5% softirqs.CPU27.RCU 40834 -16.0% 34283 ± 4% softirqs.CPU27.SCHED 62157 ± 16% -20.1% 49656 ± 3% softirqs.CPU28.RCU 42204 -17.7% 34737 softirqs.CPU28.SCHED 62331 ± 17% -20.8% 49386 ± 5% softirqs.CPU29.RCU 40874 ± 2% -16.7% 34040 ± 3% softirqs.CPU29.SCHED 60801 ± 10% -16.0% 51064 ± 6% softirqs.CPU3.RCU 41836 -16.4% 34974 softirqs.CPU3.SCHED 61638 ± 17% -20.6% 48944 ± 5% softirqs.CPU30.RCU 41764 -17.2% 34596 ± 2% softirqs.CPU30.SCHED 98840 ± 5% +11.5% 110239 ± 12% softirqs.CPU30.TIMER 62987 ± 15% -24.0% 47887 ± 4% softirqs.CPU31.RCU 40504 -16.6% 33784 ± 4% softirqs.CPU31.SCHED 62846 ± 16% -20.5% 49937 ± 5% softirqs.CPU32.RCU 41945 -16.7% 34952 ± 2% softirqs.CPU32.SCHED 63089 ± 17% -20.6% 50107 ± 4% softirqs.CPU33.RCU 40734 ± 2% -16.2% 34127 ± 2% softirqs.CPU33.SCHED 62158 ± 16% -20.3% 49540 ± 4% softirqs.CPU34.RCU 41629 -16.6% 34737 ± 2% softirqs.CPU34.SCHED 99631 ± 4% +10.9% 110515 ± 12% softirqs.CPU34.TIMER 62401 ± 16% -21.3% 49101 ± 5% softirqs.CPU35.RCU 41234 ± 2% -17.2% 34153 ± 2% softirqs.CPU35.SCHED 42327 -17.0% 35127 ± 2% softirqs.CPU36.SCHED 62779 ± 15% -22.4% 48745 ± 5% softirqs.CPU37.RCU 41503 ± 2% -17.2% 34382 softirqs.CPU37.SCHED 41539 ± 2% -16.3% 34788 ± 2% softirqs.CPU38.SCHED 62224 ± 16% -20.9% 49237 ± 4% softirqs.CPU39.RCU 40994 -16.4% 34262 ± 2% softirqs.CPU39.SCHED 64079 ± 15% -22.3% 49814 ± 7% softirqs.CPU4.RCU 43012 -17.6% 35433 softirqs.CPU4.SCHED 63645 ± 16% -21.6% 49907 ± 4% softirqs.CPU5.RCU 42374 -17.7% 34854 ± 2% softirqs.CPU5.SCHED 64822 ± 16% -21.6% 50849 ± 5% softirqs.CPU6.RCU 43223 -17.9% 35474 softirqs.CPU6.SCHED 42332 -17.7% 34822 softirqs.CPU7.SCHED 64812 ± 16% -23.0% 49875 ± 5% softirqs.CPU8.RCU 42832 -18.4% 34948 softirqs.CPU8.SCHED 65312 ± 18% -24.5% 49303 ± 5% softirqs.CPU9.RCU 42079 -17.3% 34811 softirqs.CPU9.SCHED 2534284 ± 16% -21.3% 1994233 ± 5% softirqs.RCU 1681996 -17.2% 1392052 softirqs.SCHED 138.50 ±120% -92.8% 10.00 ±133% interrupts.38:PCI-MSI.54001668-edge.i40e-eth0-TxRx-3 272412 -28.1% 195997 interrupts.CAL:Function_call_interrupts 6659 -27.5% 4829 ± 2% interrupts.CPU0.CAL:Function_call_interrupts 1304 ± 4% +68.2% 2192 ± 23% interrupts.CPU0.NMI:Non-maskable_interrupts 1304 ± 4% +68.2% 2192 ± 23% interrupts.CPU0.PMI:Performance_monitoring_interrupts 3860 ± 2% -50.8% 1899 ± 4% interrupts.CPU0.TLB:TLB_shootdowns 6827 -27.9% 4925 interrupts.CPU1.CAL:Function_call_interrupts 1273 ± 4% +95.8% 2492 ± 9% interrupts.CPU1.NMI:Non-maskable_interrupts 1273 ± 4% +95.8% 2492 ± 9% interrupts.CPU1.PMI:Performance_monitoring_interrupts 3983 ± 2% -52.0% 1911 interrupts.CPU1.TLB:TLB_shootdowns 6717 ± 2% -26.4% 4941 interrupts.CPU10.CAL:Function_call_interrupts 1117 ± 23% +122.7% 2487 ± 10% interrupts.CPU10.NMI:Non-maskable_interrupts 1117 ± 23% +122.7% 2487 ± 10% interrupts.CPU10.PMI:Performance_monitoring_interrupts 576.75 +64.1% 946.25 interrupts.CPU10.RES:Rescheduling_interrupts 3913 -49.3% 1982 ± 2% interrupts.CPU10.TLB:TLB_shootdowns 6812 -27.4% 4942 interrupts.CPU11.CAL:Function_call_interrupts 1284 ± 5% +93.7% 2487 ± 9% interrupts.CPU11.NMI:Non-maskable_interrupts 1284 ± 5% +93.7% 2487 ± 9% interrupts.CPU11.PMI:Performance_monitoring_interrupts 558.50 ± 2% +69.0% 943.75 ± 5% interrupts.CPU11.RES:Rescheduling_interrupts 3927 ± 2% -49.2% 1993 ± 2% interrupts.CPU11.TLB:TLB_shootdowns 6927 -28.1% 4982 interrupts.CPU12.CAL:Function_call_interrupts 1294 ± 6% +91.8% 2481 ± 9% interrupts.CPU12.NMI:Non-maskable_interrupts 1294 ± 6% +91.8% 2481 ± 9% interrupts.CPU12.PMI:Performance_monitoring_interrupts 651.50 ± 15% +30.0% 846.75 interrupts.CPU12.RES:Rescheduling_interrupts 4034 -50.3% 2003 ± 2% interrupts.CPU12.TLB:TLB_shootdowns 6764 ± 2% -27.5% 4903 ± 3% interrupts.CPU13.CAL:Function_call_interrupts 1273 ± 6% +93.6% 2465 ± 9% interrupts.CPU13.NMI:Non-maskable_interrupts 1273 ± 6% +93.6% 2465 ± 9% interrupts.CPU13.PMI:Performance_monitoring_interrupts 553.75 +73.7% 961.75 ± 5% interrupts.CPU13.RES:Rescheduling_interrupts 3971 ± 3% -50.7% 1959 ± 6% interrupts.CPU13.TLB:TLB_shootdowns 6908 -29.7% 4853 interrupts.CPU14.CAL:Function_call_interrupts 1272 ± 6% +96.4% 2498 ± 9% interrupts.CPU14.NMI:Non-maskable_interrupts 1272 ± 6% +96.4% 2498 ± 9% interrupts.CPU14.PMI:Performance_monitoring_interrupts 589.50 ± 7% +57.7% 929.75 ± 3% interrupts.CPU14.RES:Rescheduling_interrupts 4101 -53.7% 1900 interrupts.CPU14.TLB:TLB_shootdowns 6760 -26.9% 4943 interrupts.CPU15.CAL:Function_call_interrupts 1331 ± 8% +88.4% 2509 ± 11% interrupts.CPU15.NMI:Non-maskable_interrupts 1331 ± 8% +88.4% 2509 ± 11% interrupts.CPU15.PMI:Performance_monitoring_interrupts 609.25 ± 2% +45.8% 888.25 ± 5% interrupts.CPU15.RES:Rescheduling_interrupts 3954 -37.8% 2460 ± 29% interrupts.CPU15.TLB:TLB_shootdowns 6829 -27.1% 4977 interrupts.CPU16.CAL:Function_call_interrupts 1296 ± 7% +91.5% 2482 ± 10% interrupts.CPU16.NMI:Non-maskable_interrupts 1296 ± 7% +91.5% 2482 ± 10% interrupts.CPU16.PMI:Performance_monitoring_interrupts 604.00 ± 12% +55.8% 941.00 ± 2% interrupts.CPU16.RES:Rescheduling_interrupts 3938 ± 2% -49.2% 2000 ± 2% interrupts.CPU16.TLB:TLB_shootdowns 6805 -29.3% 4808 interrupts.CPU17.CAL:Function_call_interrupts 1272 ± 7% +94.3% 2472 ± 9% interrupts.CPU17.NMI:Non-maskable_interrupts 1272 ± 7% +94.3% 2472 ± 9% interrupts.CPU17.PMI:Performance_monitoring_interrupts 605.75 ± 8% +46.3% 886.25 ± 3% interrupts.CPU17.RES:Rescheduling_interrupts 3914 -49.9% 1961 ± 3% interrupts.CPU17.TLB:TLB_shootdowns 6797 -27.4% 4933 ± 2% interrupts.CPU18.CAL:Function_call_interrupts 1285 ± 5% +93.6% 2489 ± 9% interrupts.CPU18.NMI:Non-maskable_interrupts 1285 ± 5% +93.6% 2489 ± 9% interrupts.CPU18.PMI:Performance_monitoring_interrupts 587.00 ± 4% +57.3% 923.50 ± 5% interrupts.CPU18.RES:Rescheduling_interrupts 3999 ± 3% -49.8% 2008 ± 4% interrupts.CPU18.TLB:TLB_shootdowns 6749 ± 3% -27.3% 4906 ± 2% interrupts.CPU19.CAL:Function_call_interrupts 1332 ± 9% +88.6% 2512 ± 7% interrupts.CPU19.NMI:Non-maskable_interrupts 1332 ± 9% +88.6% 2512 ± 7% interrupts.CPU19.PMI:Performance_monitoring_interrupts 628.50 ± 12% +57.1% 987.50 ± 4% interrupts.CPU19.RES:Rescheduling_interrupts 3965 ± 2% -49.0% 2021 ± 3% interrupts.CPU19.TLB:TLB_shootdowns 6965 -29.5% 4908 interrupts.CPU2.CAL:Function_call_interrupts 1273 ± 5% +94.4% 2476 ± 10% interrupts.CPU2.NMI:Non-maskable_interrupts 1273 ± 5% +94.4% 2476 ± 10% interrupts.CPU2.PMI:Performance_monitoring_interrupts 4042 -50.4% 2005 ± 2% interrupts.CPU2.TLB:TLB_shootdowns 6746 ± 2% -27.6% 4883 interrupts.CPU20.CAL:Function_call_interrupts 1306 ± 5% +95.1% 2549 ± 6% interrupts.CPU20.NMI:Non-maskable_interrupts 1306 ± 5% +95.1% 2549 ± 6% interrupts.CPU20.PMI:Performance_monitoring_interrupts 561.00 ± 4% +60.9% 902.75 ± 5% interrupts.CPU20.RES:Rescheduling_interrupts 3826 ± 2% -49.3% 1940 ± 2% interrupts.CPU20.TLB:TLB_shootdowns 6986 ± 2% -30.3% 4867 interrupts.CPU21.CAL:Function_call_interrupts 1281 ± 4% +94.1% 2487 ± 8% interrupts.CPU21.NMI:Non-maskable_interrupts 1281 ± 4% +94.1% 2487 ± 8% interrupts.CPU21.PMI:Performance_monitoring_interrupts 562.50 ± 2% +59.4% 896.75 ± 3% interrupts.CPU21.RES:Rescheduling_interrupts 4077 -52.8% 1925 ± 3% interrupts.CPU21.TLB:TLB_shootdowns 6757 -28.0% 4868 ± 2% interrupts.CPU22.CAL:Function_call_interrupts 1286 ± 3% +94.4% 2499 ± 8% interrupts.CPU22.NMI:Non-maskable_interrupts 1286 ± 3% +94.4% 2499 ± 8% interrupts.CPU22.PMI:Performance_monitoring_interrupts 598.25 ± 8% +49.9% 897.00 ± 14% interrupts.CPU22.RES:Rescheduling_interrupts 3937 ± 2% -50.2% 1960 interrupts.CPU22.TLB:TLB_shootdowns 6788 ± 2% -28.2% 4876 interrupts.CPU23.CAL:Function_call_interrupts 1279 ± 7% +92.5% 2463 ± 9% interrupts.CPU23.NMI:Non-maskable_interrupts 1279 ± 7% +92.5% 2463 ± 9% interrupts.CPU23.PMI:Performance_monitoring_interrupts 575.25 ± 6% +53.6% 883.50 ± 4% interrupts.CPU23.RES:Rescheduling_interrupts 3913 ± 2% -51.1% 1915 interrupts.CPU23.TLB:TLB_shootdowns 6808 ± 2% -28.2% 4889 ± 2% interrupts.CPU24.CAL:Function_call_interrupts 565.75 ± 3% +67.2% 946.00 ± 3% interrupts.CPU24.RES:Rescheduling_interrupts 3898 ± 3% -49.3% 1977 interrupts.CPU24.TLB:TLB_shootdowns 6758 -29.1% 4794 interrupts.CPU25.CAL:Function_call_interrupts 1266 ± 6% +100.5% 2538 ± 11% interrupts.CPU25.NMI:Non-maskable_interrupts 1266 ± 6% +100.5% 2538 ± 11% interrupts.CPU25.PMI:Performance_monitoring_interrupts 580.50 ± 8% +61.5% 937.25 ± 5% interrupts.CPU25.RES:Rescheduling_interrupts 3888 ± 2% -50.9% 1908 ± 5% interrupts.CPU25.TLB:TLB_shootdowns 6707 -26.0% 4962 interrupts.CPU26.CAL:Function_call_interrupts 1369 ± 6% +81.7% 2487 ± 8% interrupts.CPU26.NMI:Non-maskable_interrupts 1369 ± 6% +81.7% 2487 ± 8% interrupts.CPU26.PMI:Performance_monitoring_interrupts 558.25 ± 3% +62.2% 905.25 ± 4% interrupts.CPU26.RES:Rescheduling_interrupts 3873 ± 2% -47.8% 2022 ± 2% interrupts.CPU26.TLB:TLB_shootdowns 6891 -29.5% 4856 interrupts.CPU27.CAL:Function_call_interrupts 1266 ± 5% +94.6% 2464 ± 9% interrupts.CPU27.NMI:Non-maskable_interrupts 1266 ± 5% +94.6% 2464 ± 9% interrupts.CPU27.PMI:Performance_monitoring_interrupts 574.50 ± 3% +58.6% 911.00 ± 3% interrupts.CPU27.RES:Rescheduling_interrupts 3972 ± 2% -52.6% 1883 ± 4% interrupts.CPU27.TLB:TLB_shootdowns 6759 -28.1% 4859 interrupts.CPU28.CAL:Function_call_interrupts 1275 ± 5% +94.1% 2475 ± 9% interrupts.CPU28.NMI:Non-maskable_interrupts 1275 ± 5% +94.1% 2475 ± 9% interrupts.CPU28.PMI:Performance_monitoring_interrupts 571.00 ± 7% +62.0% 924.75 ± 2% interrupts.CPU28.RES:Rescheduling_interrupts 3977 -50.8% 1956 ± 3% interrupts.CPU28.TLB:TLB_shootdowns 6864 -28.6% 4902 interrupts.CPU29.CAL:Function_call_interrupts 1319 ± 8% +87.9% 2479 ± 9% interrupts.CPU29.NMI:Non-maskable_interrupts 1319 ± 8% +87.9% 2479 ± 9% interrupts.CPU29.PMI:Performance_monitoring_interrupts 565.00 ± 2% +62.2% 916.25 ± 4% interrupts.CPU29.RES:Rescheduling_interrupts 4034 ± 2% -51.9% 1940 ± 2% interrupts.CPU29.TLB:TLB_shootdowns 6912 -28.0% 4973 interrupts.CPU3.CAL:Function_call_interrupts 1279 ± 5% +93.3% 2473 ± 9% interrupts.CPU3.NMI:Non-maskable_interrupts 1279 ± 5% +93.3% 2473 ± 9% interrupts.CPU3.PMI:Performance_monitoring_interrupts 590.50 ± 4% +65.5% 977.25 ± 2% interrupts.CPU3.RES:Rescheduling_interrupts 4034 -49.2% 2048 ± 4% interrupts.CPU3.TLB:TLB_shootdowns 6787 -27.7% 4909 interrupts.CPU30.CAL:Function_call_interrupts 1285 ± 4% +93.7% 2488 ± 10% interrupts.CPU30.NMI:Non-maskable_interrupts 1285 ± 4% +93.7% 2488 ± 10% interrupts.CPU30.PMI:Performance_monitoring_interrupts 568.50 ± 3% +65.0% 938.25 ± 5% interrupts.CPU30.RES:Rescheduling_interrupts 3876 ± 2% -49.2% 1968 interrupts.CPU30.TLB:TLB_shootdowns 6727 ± 2% -27.8% 4854 interrupts.CPU31.CAL:Function_call_interrupts 1290 ± 6% +92.7% 2486 ± 9% interrupts.CPU31.NMI:Non-maskable_interrupts 1290 ± 6% +92.7% 2486 ± 9% interrupts.CPU31.PMI:Performance_monitoring_interrupts 611.00 ± 6% +45.7% 890.25 ± 6% interrupts.CPU31.RES:Rescheduling_interrupts 4687 ± 30% -58.8% 1929 ± 2% interrupts.CPU31.TLB:TLB_shootdowns 6812 -28.6% 4861 ± 2% interrupts.CPU32.CAL:Function_call_interrupts 1112 ± 24% +122.5% 2476 ± 9% interrupts.CPU32.NMI:Non-maskable_interrupts 1112 ± 24% +122.5% 2476 ± 9% interrupts.CPU32.PMI:Performance_monitoring_interrupts 538.00 ± 3% +76.3% 948.75 ± 2% interrupts.CPU32.RES:Rescheduling_interrupts 3924 -49.9% 1964 ± 3% interrupts.CPU32.TLB:TLB_shootdowns 6809 ± 2% -28.0% 4902 interrupts.CPU33.CAL:Function_call_interrupts 1259 ± 5% +96.2% 2471 ± 9% interrupts.CPU33.NMI:Non-maskable_interrupts 1259 ± 5% +96.2% 2471 ± 9% interrupts.CPU33.PMI:Performance_monitoring_interrupts 547.00 ± 5% +75.1% 958.00 ± 12% interrupts.CPU33.RES:Rescheduling_interrupts 5199 ± 42% -62.0% 1974 interrupts.CPU33.TLB:TLB_shootdowns 6834 -28.3% 4899 interrupts.CPU34.CAL:Function_call_interrupts 1276 ± 7% +94.9% 2487 ± 9% interrupts.CPU34.NMI:Non-maskable_interrupts 1276 ± 7% +94.9% 2487 ± 9% interrupts.CPU34.PMI:Performance_monitoring_interrupts 594.75 ± 2% +55.7% 925.75 ± 5% interrupts.CPU34.RES:Rescheduling_interrupts 3996 -51.0% 1959 ± 5% interrupts.CPU34.TLB:TLB_shootdowns 6813 -28.7% 4859 interrupts.CPU35.CAL:Function_call_interrupts 1346 ± 9% +85.0% 2491 ± 10% interrupts.CPU35.NMI:Non-maskable_interrupts 1346 ± 9% +85.0% 2491 ± 10% interrupts.CPU35.PMI:Performance_monitoring_interrupts 568.00 ± 6% +53.2% 870.00 ± 5% interrupts.CPU35.RES:Rescheduling_interrupts 3993 -51.2% 1947 ± 3% interrupts.CPU35.TLB:TLB_shootdowns 6841 -28.7% 4875 ± 2% interrupts.CPU36.CAL:Function_call_interrupts 1135 ± 22% +118.9% 2485 ± 10% interrupts.CPU36.NMI:Non-maskable_interrupts 1135 ± 22% +118.9% 2485 ± 10% interrupts.CPU36.PMI:Performance_monitoring_interrupts 582.75 ± 5% +57.9% 920.25 ± 5% interrupts.CPU36.RES:Rescheduling_interrupts 3981 -50.8% 1958 ± 3% interrupts.CPU36.TLB:TLB_shootdowns 6850 ± 2% -29.2% 4852 ± 4% interrupts.CPU37.CAL:Function_call_interrupts 1274 ± 6% +94.1% 2474 ± 8% interrupts.CPU37.NMI:Non-maskable_interrupts 1274 ± 6% +94.1% 2474 ± 8% interrupts.CPU37.PMI:Performance_monitoring_interrupts 557.50 ± 7% +66.6% 929.00 ± 3% interrupts.CPU37.RES:Rescheduling_interrupts 3956 ± 3% -50.7% 1948 ± 5% interrupts.CPU37.TLB:TLB_shootdowns 6788 -27.0% 4954 interrupts.CPU38.CAL:Function_call_interrupts 1296 ± 5% +91.8% 2486 ± 9% interrupts.CPU38.NMI:Non-maskable_interrupts 1296 ± 5% +91.8% 2486 ± 9% interrupts.CPU38.PMI:Performance_monitoring_interrupts 560.75 ± 2% +79.6% 1007 ± 7% interrupts.CPU38.RES:Rescheduling_interrupts 3922 ± 2% -47.8% 2047 ± 2% interrupts.CPU38.TLB:TLB_shootdowns 6756 -27.0% 4929 interrupts.CPU39.CAL:Function_call_interrupts 1330 ± 9% +89.9% 2526 ± 8% interrupts.CPU39.NMI:Non-maskable_interrupts 1330 ± 9% +89.9% 2526 ± 8% interrupts.CPU39.PMI:Performance_monitoring_interrupts 545.25 ± 4% +69.9% 926.25 ± 5% interrupts.CPU39.RES:Rescheduling_interrupts 3911 -49.1% 1991 ± 4% interrupts.CPU39.TLB:TLB_shootdowns 6644 -25.7% 4939 ± 2% interrupts.CPU4.CAL:Function_call_interrupts 1290 ± 4% +90.8% 2461 ± 9% interrupts.CPU4.NMI:Non-maskable_interrupts 1290 ± 4% +90.8% 2461 ± 9% interrupts.CPU4.PMI:Performance_monitoring_interrupts 582.00 ± 2% +87.6% 1092 ± 25% interrupts.CPU4.RES:Rescheduling_interrupts 3847 -48.3% 1988 ± 5% interrupts.CPU4.TLB:TLB_shootdowns 6799 -28.3% 4874 interrupts.CPU5.CAL:Function_call_interrupts 1264 ± 5% +96.9% 2490 ± 9% interrupts.CPU5.NMI:Non-maskable_interrupts 1264 ± 5% +96.9% 2490 ± 9% interrupts.CPU5.PMI:Performance_monitoring_interrupts 619.50 ± 8% +47.8% 915.50 interrupts.CPU5.RES:Rescheduling_interrupts 3922 -49.1% 1998 ± 5% interrupts.CPU5.TLB:TLB_shootdowns 6730 ± 3% -26.8% 4923 interrupts.CPU6.CAL:Function_call_interrupts 1327 +86.1% 2469 ± 9% interrupts.CPU6.NMI:Non-maskable_interrupts 1327 +86.1% 2469 ± 9% interrupts.CPU6.PMI:Performance_monitoring_interrupts 3896 ± 2% -48.8% 1993 ± 2% interrupts.CPU6.TLB:TLB_shootdowns 6969 ± 2% -28.9% 4953 ± 2% interrupts.CPU7.CAL:Function_call_interrupts 1271 ± 5% +95.8% 2489 ± 9% interrupts.CPU7.NMI:Non-maskable_interrupts 1271 ± 5% +95.8% 2489 ± 9% interrupts.CPU7.PMI:Performance_monitoring_interrupts 4066 -50.0% 2032 interrupts.CPU7.TLB:TLB_shootdowns 6814 -27.9% 4910 ± 2% interrupts.CPU8.CAL:Function_call_interrupts 1288 ± 3% +93.8% 2495 ± 9% interrupts.CPU8.NMI:Non-maskable_interrupts 1288 ± 3% +93.8% 2495 ± 9% interrupts.CPU8.PMI:Performance_monitoring_interrupts 577.50 +73.3% 1001 ± 25% interrupts.CPU8.RES:Rescheduling_interrupts 3947 -49.4% 1999 ± 5% interrupts.CPU8.TLB:TLB_shootdowns 6928 ± 2% -29.1% 4912 ± 2% interrupts.CPU9.CAL:Function_call_interrupts 1373 ± 13% +80.1% 2473 ± 10% interrupts.CPU9.NMI:Non-maskable_interrupts 1373 ± 13% +80.1% 2473 ± 10% interrupts.CPU9.PMI:Performance_monitoring_interrupts 598.25 ± 6% +48.0% 885.50 ± 4% interrupts.CPU9.RES:Rescheduling_interrupts 4038 ± 2% -50.9% 1984 ± 4% interrupts.CPU9.TLB:TLB_shootdowns 51259 ± 4% +92.9% 98855 ± 9% interrupts.NMI:Non-maskable_interrupts 51259 ± 4% +92.9% 98855 ± 9% interrupts.PMI:Performance_monitoring_interrupts 25339 ± 2% +51.7% 38432 interrupts.RES:Rescheduling_interrupts 160209 -50.5% 79274 interrupts.TLB:TLB_shootdowns 23.39 -12.7 10.69 ± 17% perf-profile.calltrace.cycles-pp.secondary_startup_64 22.83 -12.4 10.44 ± 18% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 22.83 -12.4 10.44 ± 18% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 22.82 -12.4 10.43 ± 18% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 21.45 -11.7 9.75 ± 17% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 21.17 -11.5 9.64 ± 17% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 18.49 -10.2 8.32 ± 14% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 12.20 -8.1 4.07 ± 7% perf-profile.calltrace.cycles-pp.add_short.add_short 7.83 ± 2% -5.5 2.30 ± 9% perf-profile.calltrace.cycles-pp.brk 7.64 -5.2 2.43 ± 8% perf-profile.calltrace.cycles-pp.execve 7.54 -5.1 2.40 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.execve 7.54 -5.1 2.40 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 7.54 -5.1 2.40 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 7.45 -5.1 2.38 ± 8% perf-profile.calltrace.cycles-pp.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe.execve 5.92 ± 3% -4.3 1.67 ± 8% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.brk 5.90 ± 3% -4.2 1.66 ± 8% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 5.95 ± 2% -4.1 1.89 ± 4% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 5.86 -4.0 1.88 ± 10% perf-profile.calltrace.cycles-pp.page_test 5.43 -3.8 1.65 ± 6% perf-profile.calltrace.cycles-pp.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.41 -3.8 1.64 ± 6% perf-profile.calltrace.cycles-pp.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve.do_syscall_64 5.12 ± 4% -3.8 1.37 ± 9% perf-profile.calltrace.cycles-pp.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 4.20 ± 2% -3.0 1.22 ± 4% perf-profile.calltrace.cycles-pp.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.20 ± 2% -3.0 1.22 ± 4% perf-profile.calltrace.cycles-pp.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.20 ± 2% -3.0 1.22 ± 4% perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.26 ± 2% -2.8 1.41 ± 6% perf-profile.calltrace.cycles-pp.page_fault 4.07 ± 2% -2.7 1.34 ± 6% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault 4.00 ± 2% -2.7 1.31 ± 6% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault 3.52 ± 3% -2.4 1.15 ± 5% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault 3.24 ± 3% -2.3 0.90 ± 5% perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64 3.23 ± 3% -2.3 0.90 ± 4% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.__x64_sys_exit_group 3.00 ± 4% -2.3 0.69 ± 10% perf-profile.calltrace.cycles-pp.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 3.33 ± 3% -2.3 1.03 ± 11% perf-profile.calltrace.cycles-pp.page_fault.page_test 3.30 ± 3% -2.3 1.03 ± 11% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault.page_test 3.42 ± 3% -2.3 1.16 ± 7% perf-profile.calltrace.cycles-pp.kill 2.90 ± 4% -2.2 0.65 ± 9% perf-profile.calltrace.cycles-pp.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.20 ± 3% -2.2 0.99 ± 12% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault.page_test 3.86 ± 4% -2.0 1.89 ± 2% perf-profile.calltrace.cycles-pp.filldir.dcache_readdir.iterate_dir.__x64_sys_getdents.do_syscall_64 2.77 ± 2% -2.0 0.79 ± 7% perf-profile.calltrace.cycles-pp.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file.__x64_sys_execve 2.94 ± 2% -2.0 0.98 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.kill 2.92 ± 3% -2.0 0.97 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.kill 2.74 ± 3% -1.9 0.84 ± 12% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.page_test 2.66 ± 2% -1.9 0.76 ± 8% perf-profile.calltrace.cycles-pp.mmput.flush_old_exec.load_elf_binary.search_binary_handler.__do_execve_file 2.65 ± 2% -1.9 0.76 ± 8% perf-profile.calltrace.cycles-pp.exit_mmap.mmput.flush_old_exec.load_elf_binary.search_binary_handler 2.58 ± 8% -1.9 0.71 ± 13% perf-profile.calltrace.cycles-pp.do_anonymous_page.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault 2.12 ± 5% -1.7 0.41 ± 58% perf-profile.calltrace.cycles-pp.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk.do_syscall_64 2.11 ± 5% -1.7 0.41 ± 58% perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.unmap_region.__do_munmap.__x64_sys_brk 2.69 ± 2% -1.5 1.22 ± 28% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 2.08 ± 2% -1.4 0.68 ± 2% perf-profile.calltrace.cycles-pp.setlocale 1.79 ± 2% -1.3 0.44 ± 57% perf-profile.calltrace.cycles-pp.do_brk_flags.__x64_sys_brk.do_syscall_64.entry_SYSCALL_64_after_hwframe.brk 1.59 ± 6% -1.3 0.26 ±100% perf-profile.calltrace.cycles-pp.filemap_map_pages.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault 2.40 ± 3% -1.3 1.09 ± 30% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 1.67 ± 2% -1.3 0.40 ± 57% perf-profile.calltrace.cycles-pp.__libc_fork 1.73 ± 4% -1.2 0.53 perf-profile.calltrace.cycles-pp._do_fork.__x64_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.73 ± 4% -1.2 0.53 perf-profile.calltrace.cycles-pp.__x64_sys_clone.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.74 ± 2% -1.2 0.58 ± 5% perf-profile.calltrace.cycles-pp.sighandler 1.52 ± 6% -0.8 0.70 ± 28% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.91 ± 4% -0.2 0.73 ± 2% perf-profile.calltrace.cycles-pp._copy_to_user.filldir.dcache_readdir.iterate_dir.__x64_sys_getdents 15.18 +54.1 69.27 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 15.12 +54.1 69.25 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.49 ± 5% +61.3 65.80 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.46 ± 5% +61.3 65.79 ± 2% perf-profile.calltrace.cycles-pp.iterate_dir.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.38 ± 5% +61.4 65.73 ± 2% perf-profile.calltrace.cycles-pp.dcache_readdir.iterate_dir.__x64_sys_getdents.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +62.1 62.13 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.next_positive.dcache_readdir.iterate_dir 0.00 +62.8 62.75 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock.next_positive.dcache_readdir.iterate_dir.__x64_sys_getdents 0.00 +62.8 62.84 ± 2% perf-profile.calltrace.cycles-pp.next_positive.dcache_readdir.iterate_dir.__x64_sys_getdents.do_syscall_64 23.41 -12.7 10.70 ± 17% perf-profile.children.cycles-pp.do_idle 23.39 -12.7 10.69 ± 17% perf-profile.children.cycles-pp.secondary_startup_64 23.39 -12.7 10.69 ± 17% perf-profile.children.cycles-pp.cpu_startup_entry 22.83 -12.4 10.44 ± 18% perf-profile.children.cycles-pp.start_secondary 21.98 -12.0 10.00 ± 16% perf-profile.children.cycles-pp.cpuidle_enter_state 21.98 -12.0 10.00 ± 16% perf-profile.children.cycles-pp.cpuidle_enter 18.81 -10.3 8.54 ± 14% perf-profile.children.cycles-pp.intel_idle 12.20 -8.1 4.07 ± 7% perf-profile.children.cycles-pp.add_short 11.29 -7.7 3.59 ± 4% perf-profile.children.cycles-pp.page_fault 9.84 -6.7 3.13 ± 4% perf-profile.children.cycles-pp.do_page_fault 9.62 ± 2% -6.6 3.04 ± 4% perf-profile.children.cycles-pp.__do_page_fault 8.62 -5.9 2.71 ± 4% perf-profile.children.cycles-pp.handle_mm_fault 8.21 -5.6 2.58 ± 4% perf-profile.children.cycles-pp.__handle_mm_fault 7.89 ± 2% -5.6 2.32 ± 9% perf-profile.children.cycles-pp.brk 7.66 ± 2% -5.2 2.44 ± 8% perf-profile.children.cycles-pp.execve 7.56 -5.1 2.48 ± 4% perf-profile.children.cycles-pp.__x64_sys_execve 7.48 -5.0 2.45 ± 4% perf-profile.children.cycles-pp.__do_execve_file 6.80 -4.6 2.19 ± 11% perf-profile.children.cycles-pp.page_test 5.91 -4.2 1.68 ± 5% perf-profile.children.cycles-pp.mmput 5.88 -4.2 1.68 ± 5% perf-profile.children.cycles-pp.exit_mmap 5.43 -3.7 1.69 ± 3% perf-profile.children.cycles-pp.search_binary_handler 5.42 -3.7 1.68 ± 3% perf-profile.children.cycles-pp.load_elf_binary 5.14 ± 4% -3.7 1.43 ± 4% perf-profile.children.cycles-pp.__x64_sys_brk 4.15 ± 3% -3.2 0.99 ± 5% perf-profile.children.cycles-pp.__do_munmap 4.29 ± 3% -3.0 1.25 ± 5% perf-profile.children.cycles-pp.__x64_sys_exit_group 4.29 ± 2% -3.0 1.25 ± 5% perf-profile.children.cycles-pp.do_group_exit 4.28 ± 3% -3.0 1.25 ± 4% perf-profile.children.cycles-pp.do_exit 3.87 ± 4% -2.9 0.98 ± 6% perf-profile.children.cycles-pp.tlb_finish_mmu 3.84 ± 4% -2.9 0.96 ± 6% perf-profile.children.cycles-pp.tlb_flush_mmu 3.68 ± 4% -2.8 0.85 ± 5% perf-profile.children.cycles-pp.unmap_region 3.46 ± 3% -2.3 1.18 ± 6% perf-profile.children.cycles-pp.kill 2.71 ± 3% -2.1 0.57 ± 5% perf-profile.children.cycles-pp.release_pages 2.35 ± 5% -2.1 0.28 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 2.99 ± 3% -2.1 0.92 ± 2% perf-profile.children.cycles-pp.__x64_sys_clone 2.99 ± 3% -2.1 0.92 ± 2% perf-profile.children.cycles-pp._do_fork 2.97 ± 3% -2.1 0.91 ± 5% perf-profile.children.cycles-pp.filemap_map_pages 3.01 ± 3% -2.0 0.97 ± 6% perf-profile.children.cycles-pp.do_anonymous_page 2.91 -2.0 0.92 ± 5% perf-profile.children.cycles-pp.unmap_vmas 3.89 ± 4% -2.0 1.92 ± 2% perf-profile.children.cycles-pp.filldir 2.77 ± 2% -2.0 0.81 ± 4% perf-profile.children.cycles-pp.flush_old_exec 2.78 -1.9 0.86 ± 4% perf-profile.children.cycles-pp.unmap_page_range 2.69 ± 5% -1.9 0.83 ± 3% perf-profile.children.cycles-pp.copy_process 3.49 ± 3% -1.8 1.67 ± 19% perf-profile.children.cycles-pp.apic_timer_interrupt 3.14 ± 4% -1.6 1.50 ± 20% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 1.98 ± 3% -1.6 0.36 ± 11% perf-profile.children.cycles-pp.pagevec_lru_move_fn 2.10 -1.5 0.58 ± 2% perf-profile.children.cycles-pp.vm_mmap_pgoff 2.33 -1.5 0.85 ± 2% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode 2.15 -1.4 0.72 ± 6% perf-profile.children.cycles-pp.__alloc_pages_nodemask 2.08 ± 2% -1.4 0.68 ± 2% perf-profile.children.cycles-pp.setlocale 1.94 -1.4 0.53 ± 2% perf-profile.children.cycles-pp.do_mmap 1.98 ± 3% -1.4 0.59 ± 4% perf-profile.children.cycles-pp.dup_mm 1.90 -1.3 0.63 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist 1.92 ± 3% -1.3 0.66 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop 1.70 -1.3 0.45 perf-profile.children.cycles-pp.mmap_region 1.85 ± 2% -1.2 0.60 perf-profile.children.cycles-pp.do_brk_flags 1.83 ± 2% -1.2 0.65 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64 1.71 ± 3% -1.2 0.53 ± 5% perf-profile.children.cycles-pp.__libc_fork 1.74 ± 2% -1.2 0.58 ± 5% perf-profile.children.cycles-pp.sighandler 1.59 ± 2% -1.1 0.44 ± 2% perf-profile.children.cycles-pp.ksys_mmap_pgoff 1.65 ± 4% -1.1 0.56 ± 2% perf-profile.children.cycles-pp.do_signal 1.62 -1.1 0.55 ± 5% perf-profile.children.cycles-pp.do_sys_open 1.23 ± 5% -1.0 0.18 ± 11% perf-profile.children.cycles-pp.lru_add_drain_cpu 1.21 ± 5% -1.0 0.18 ± 10% perf-profile.children.cycles-pp.lru_add_drain 1.56 -1.0 0.58 ± 3% perf-profile.children.cycles-pp.syscall_return_via_sysret 1.20 ± 20% -1.0 0.22 ± 3% perf-profile.children.cycles-pp.sync 1.65 ± 2% -1.0 0.67 ± 9% perf-profile.children.cycles-pp.do_filp_open 1.18 ± 21% -1.0 0.22 ± 5% perf-profile.children.cycles-pp.__x64_sys_sync 1.18 ± 21% -1.0 0.22 ± 5% perf-profile.children.cycles-pp.ksys_sync 1.63 ± 2% -1.0 0.67 ± 9% perf-profile.children.cycles-pp.path_openat 1.49 ± 2% -0.9 0.54 ± 3% perf-profile.children.cycles-pp.native_irq_return_iret 1.97 ± 6% -0.9 1.04 ± 17% perf-profile.children.cycles-pp.hrtimer_interrupt 1.28 ± 2% -0.9 0.36 ± 9% perf-profile.children.cycles-pp.free_pgtables 1.11 ± 22% -0.9 0.19 ± 4% perf-profile.children.cycles-pp.iterate_supers 1.38 ± 4% -0.9 0.48 ± 5% perf-profile.children.cycles-pp.flush_tlb_mm_range 1.35 ± 3% -0.9 0.48 ± 2% perf-profile.children.cycles-pp._dl_addr 1.35 ± 3% -0.9 0.48 ± 8% perf-profile.children.cycles-pp.alloc_pages_vma 1.40 ± 6% -0.9 0.53 ± 3% perf-profile.children.cycles-pp.prepare_exit_to_usermode 1.27 ± 5% -0.8 0.44 ± 4% perf-profile.children.cycles-pp.flush_tlb_func_common 1.22 ± 5% -0.8 0.42 ± 4% perf-profile.children.cycles-pp.native_flush_tlb_one_user 1.20 ± 2% -0.8 0.40 ± 3% perf-profile.children.cycles-pp.copy_strings 1.09 ± 4% -0.8 0.32 ± 4% perf-profile.children.cycles-pp.__vma_adjust 1.16 ± 3% -0.8 0.40 ± 10% perf-profile.children.cycles-pp.prep_new_page 1.08 ± 2% -0.7 0.35 ± 3% perf-profile.children.cycles-pp.perf_event_mmap 0.99 ± 3% -0.7 0.28 ± 6% perf-profile.children.cycles-pp.page_remove_rmap 1.16 ± 5% -0.7 0.46 ± 4% perf-profile.children.cycles-pp.__check_object_size 1.02 ± 4% -0.7 0.33 ± 2% perf-profile.children.cycles-pp.link_path_walk 1.06 ± 3% -0.7 0.38 ± 12% perf-profile.children.cycles-pp.clear_page_erms 0.93 ± 2% -0.7 0.26 ± 6% perf-profile.children.cycles-pp.elf_map 0.85 ± 2% -0.6 0.21 ± 9% perf-profile.children.cycles-pp.__lru_cache_add 0.91 ± 6% -0.6 0.27 ± 5% perf-profile.children.cycles-pp.do_mprotect_pkey 0.91 ± 6% -0.6 0.28 ± 4% perf-profile.children.cycles-pp.__x64_sys_mprotect 1.11 ± 9% -0.6 0.47 ± 14% perf-profile.children.cycles-pp.write 0.93 -0.6 0.29 ± 5% perf-profile.children.cycles-pp.do_wp_page 0.91 ± 4% -0.6 0.28 ± 6% perf-profile.children.cycles-pp.mprotect_fixup 0.87 ± 2% -0.6 0.24 ± 5% perf-profile.children.cycles-pp.__split_vma 0.97 ± 4% -0.6 0.35 ± 20% perf-profile.children.cycles-pp.irq_exit 0.82 ± 7% -0.6 0.24 ± 7% perf-profile.children.cycles-pp.copy_page_range 0.88 ± 6% -0.6 0.30 ± 4% perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn 0.83 -0.6 0.26 ± 4% perf-profile.children.cycles-pp.wp_page_copy 0.79 ± 7% -0.6 0.23 ± 5% perf-profile.children.cycles-pp.copy_p4d_range 0.85 ± 2% -0.6 0.30 ± 4% perf-profile.children.cycles-pp.__sched_text_start 0.83 -0.5 0.29 ± 5% perf-profile.children.cycles-pp.copy_user_generic_unrolled 0.82 ± 11% -0.5 0.28 ± 8% perf-profile.children.cycles-pp.ktime_get 0.76 ± 5% -0.5 0.23 ± 9% perf-profile.children.cycles-pp.alloc_set_pte 0.77 ± 7% -0.5 0.24 ± 10% perf-profile.children.cycles-pp.unlink 0.80 ± 2% -0.5 0.27 perf-profile.children.cycles-pp.___might_sleep 0.94 ± 11% -0.5 0.42 ± 17% perf-profile.children.cycles-pp.ksys_write 0.70 ± 2% -0.5 0.18 ± 2% perf-profile.children.cycles-pp.vma_link 0.77 ± 4% -0.5 0.25 ± 3% perf-profile.children.cycles-pp.filename_lookup 0.92 ± 12% -0.5 0.41 ± 18% perf-profile.children.cycles-pp.vfs_write 0.78 ± 3% -0.5 0.27 ± 5% perf-profile.children.cycles-pp.__x64_sys_kill 0.85 ± 2% -0.5 0.34 ± 20% perf-profile.children.cycles-pp.__softirqentry_text_start 0.74 ± 3% -0.5 0.24 ± 4% perf-profile.children.cycles-pp.mmap64 0.74 ± 3% -0.5 0.24 ± 3% perf-profile.children.cycles-pp.path_lookupat 0.69 ± 6% -0.5 0.19 ± 11% perf-profile.children.cycles-pp.__vm_munmap 0.77 -0.5 0.27 ± 4% perf-profile.children.cycles-pp.sync_regs 0.80 ± 5% -0.5 0.30 ± 10% perf-profile.children.cycles-pp.ret_from_fork 0.87 ± 12% -0.5 0.40 ± 17% perf-profile.children.cycles-pp.new_sync_write 0.70 ± 4% -0.5 0.23 ± 3% perf-profile.children.cycles-pp.__xstat64 0.53 ± 5% -0.5 0.07 ± 27% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 0.68 ± 3% -0.4 0.23 ± 7% perf-profile.children.cycles-pp.kill_something_info 0.49 ± 5% -0.4 0.07 ± 28% perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.61 ± 5% -0.4 0.19 ± 6% perf-profile.children.cycles-pp.walk_component 0.91 ± 7% -0.4 0.49 ± 34% perf-profile.children.cycles-pp.menu_select 0.55 ± 4% -0.4 0.13 ± 6% perf-profile.children.cycles-pp.unlink_file_vma 0.68 ± 7% -0.4 0.27 ± 11% perf-profile.children.cycles-pp.clockevents_program_event 0.61 ± 2% -0.4 0.20 ± 5% perf-profile.children.cycles-pp.find_vma 0.60 ± 9% -0.4 0.19 ± 7% perf-profile.children.cycles-pp.do_unlinkat 0.55 ± 3% -0.4 0.14 ± 8% perf-profile.children.cycles-pp.vma_interval_tree_insert 0.60 ± 2% -0.4 0.20 ± 10% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 1.03 ± 6% -0.4 0.63 ± 27% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.59 ± 3% -0.4 0.20 ± 6% perf-profile.children.cycles-pp.kill_pid_info 0.56 ± 7% -0.4 0.17 ± 11% perf-profile.children.cycles-pp.unlink_anon_vmas 0.64 ± 6% -0.4 0.26 ± 9% perf-profile.children.cycles-pp.kthread 0.55 ± 3% -0.4 0.17 ± 8% perf-profile.children.cycles-pp.kmem_cache_free 0.56 ± 5% -0.4 0.19 ± 2% perf-profile.children.cycles-pp.perf_iterate_sb 0.56 ± 4% -0.4 0.19 ± 5% perf-profile.children.cycles-pp.strnlen_user 0.54 ± 3% -0.4 0.18 ± 14% perf-profile.children.cycles-pp.kmem_cache_alloc 0.50 ± 3% -0.4 0.14 ± 5% perf-profile.children.cycles-pp.anon_vma_fork 0.54 ± 3% -0.4 0.19 ± 4% perf-profile.children.cycles-pp.restore_sigcontext 0.51 ± 3% -0.4 0.16 ± 5% perf-profile.children.cycles-pp.down_write 0.49 ± 6% -0.3 0.14 ± 12% perf-profile.children.cycles-pp.link 0.52 ± 3% -0.3 0.17 ± 6% perf-profile.children.cycles-pp.vfs_statx 0.51 ± 4% -0.3 0.17 ± 4% perf-profile.children.cycles-pp.get_unmapped_area 0.51 ± 3% -0.3 0.17 ± 2% perf-profile.children.cycles-pp.__do_sys_newstat 0.47 ± 4% -0.3 0.14 ± 11% perf-profile.children.cycles-pp.pte_alloc_one 0.50 ± 4% -0.3 0.17 ± 9% perf-profile.children.cycles-pp.__send_signal 0.50 ± 2% -0.3 0.17 ± 9% perf-profile.children.cycles-pp.security_inode_permission 0.53 ± 7% -0.3 0.21 ± 7% perf-profile.children.cycles-pp.copy_fpstate_to_sigframe 0.71 ± 25% -0.3 0.38 ± 26% perf-profile.children.cycles-pp.console_unlock 0.48 ± 5% -0.3 0.16 ± 6% perf-profile.children.cycles-pp.__clear_user 0.49 ± 2% -0.3 0.17 ± 9% perf-profile.children.cycles-pp.__perf_sw_event 0.48 ± 8% -0.3 0.16 ± 10% perf-profile.children.cycles-pp.__do_sys_wait4 0.47 ± 9% -0.3 0.16 ± 9% perf-profile.children.cycles-pp.kernel_wait4 0.47 ± 8% -0.3 0.16 ± 10% perf-profile.children.cycles-pp.do_wait 0.50 ± 3% -0.3 0.19 ± 3% perf-profile.children.cycles-pp.mem_cgroup_try_charge_delay 0.47 -0.3 0.16 ± 9% perf-profile.children.cycles-pp.selinux_inode_permission 0.56 ± 5% -0.3 0.26 ± 38% perf-profile.children.cycles-pp.start_kernel 0.47 ± 2% -0.3 0.17 ± 20% perf-profile.children.cycles-pp.rcu_core 0.46 ± 3% -0.3 0.15 ± 11% perf-profile.children.cycles-pp.creat 0.44 ± 7% -0.3 0.14 ± 9% perf-profile.children.cycles-pp.lookup_fast 0.45 ± 6% -0.3 0.15 ± 7% perf-profile.children.cycles-pp.do_send_sig_info 0.42 ± 8% -0.3 0.12 ± 12% perf-profile.children.cycles-pp.do_linkat 0.43 ± 5% -0.3 0.14 ± 11% perf-profile.children.cycles-pp.fpu__clear 0.41 -0.3 0.12 ± 9% perf-profile.children.cycles-pp.anon_vma_clone 0.65 ± 17% -0.3 0.35 ± 31% perf-profile.children.cycles-pp.vprintk_emit 0.43 ± 5% -0.3 0.14 ± 6% perf-profile.children.cycles-pp.vma_merge 0.41 ± 8% -0.3 0.12 ± 12% perf-profile.children.cycles-pp.__x64_sys_link 0.43 ± 7% -0.3 0.14 ± 5% perf-profile.children.cycles-pp.security_vm_enough_memory_mm 0.43 ± 5% -0.3 0.15 ± 2% perf-profile.children.cycles-pp.__fpu__restore_sig 0.43 ± 4% -0.3 0.15 ± 8% perf-profile.children.cycles-pp.__check_heap_object 0.53 ± 3% -0.3 0.25 ± 30% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.38 ± 3% -0.3 0.11 ± 10% perf-profile.children.cycles-pp.page_add_file_rmap 0.43 ± 5% -0.3 0.15 ± 5% perf-profile.children.cycles-pp.create_elf_tables 0.39 ± 11% -0.3 0.12 ± 7% perf-profile.children.cycles-pp.do_faccessat 0.61 ± 26% -0.3 0.34 ± 27% perf-profile.children.cycles-pp.wait_for_xmitr 0.53 ± 22% -0.3 0.27 ± 27% perf-profile.children.cycles-pp._fini 0.53 ± 22% -0.3 0.27 ± 27% perf-profile.children.cycles-pp.devkmsg_write 0.53 ± 22% -0.3 0.27 ± 27% perf-profile.children.cycles-pp.devkmsg_emit 0.44 ± 2% -0.3 0.17 ± 6% perf-profile.children.cycles-pp.schedule 0.38 ± 5% -0.3 0.12 ± 16% perf-profile.children.cycles-pp.getname_flags 0.46 ± 10% -0.3 0.20 ± 4% perf-profile.children.cycles-pp.load_balance 0.42 ± 5% -0.3 0.15 ± 8% perf-profile.children.cycles-pp.wait4 0.40 ± 3% -0.3 0.14 ± 6% perf-profile.children.cycles-pp.___perf_sw_event 0.45 ± 8% -0.3 0.19 ± 6% perf-profile.children.cycles-pp.pick_next_task_fair 0.35 ± 4% -0.3 0.10 ± 4% perf-profile.children.cycles-pp.get_signal 0.38 ± 7% -0.3 0.12 ± 11% perf-profile.children.cycles-pp.free_unref_page_list 0.36 ± 4% -0.3 0.11 ± 11% perf-profile.children.cycles-pp.up_write 0.57 ± 28% -0.3 0.32 ± 28% perf-profile.children.cycles-pp.serial8250_console_putchar 0.39 ± 4% -0.3 0.14 ± 8% perf-profile.children.cycles-pp._copy_from_user 0.37 ± 3% -0.2 0.12 ± 8% perf-profile.children.cycles-pp.task_work_run 0.35 ± 4% -0.2 0.10 ± 14% perf-profile.children.cycles-pp.__slab_free 0.42 ± 6% -0.2 0.18 ± 8% perf-profile.children.cycles-pp.dput 0.36 ± 18% -0.2 0.12 ± 15% perf-profile.children.cycles-pp.vfs_read 0.42 ± 3% -0.2 0.18 ± 11% perf-profile.children.cycles-pp.smpboot_thread_fn 0.37 ± 2% -0.2 0.14 ± 8% perf-profile.children.cycles-pp.__might_sleep 0.37 ± 3% -0.2 0.14 ± 12% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.34 ± 3% -0.2 0.11 ± 17% perf-profile.children.cycles-pp.try_to_wake_up 0.64 ± 7% -0.2 0.41 ± 19% perf-profile.children.cycles-pp.tick_sched_timer 0.34 ± 4% -0.2 0.10 ± 10% perf-profile.children.cycles-pp.time 0.32 ± 13% -0.2 0.09 ± 13% perf-profile.children.cycles-pp.__x64_sys_munmap 0.33 ± 3% -0.2 0.11 ± 8% perf-profile.children.cycles-pp.get_user_pages_remote 0.33 ± 4% -0.2 0.10 ± 8% perf-profile.children.cycles-pp.__pte_alloc 0.30 ± 4% -0.2 0.07 ± 5% perf-profile.children.cycles-pp.down_read 0.42 ± 4% -0.2 0.19 ± 29% perf-profile.children.cycles-pp.tick_nohz_next_event 0.33 ± 4% -0.2 0.11 ± 8% perf-profile.children.cycles-pp.__get_user_pages 0.32 ± 6% -0.2 0.11 ± 8% perf-profile.children.cycles-pp.select_task_rq_fair 0.33 ± 6% -0.2 0.11 ± 10% perf-profile.children.cycles-pp.__x64_sys_rt_sigaction 0.32 ± 6% -0.2 0.10 ± 7% perf-profile.children.cycles-pp._cond_resched 0.33 ± 7% -0.2 0.12 ± 9% perf-profile.children.cycles-pp.__list_del_entry_valid 0.29 ± 12% -0.2 0.08 ± 29% perf-profile.children.cycles-pp.free_pages_and_swap_cache 0.33 ± 3% -0.2 0.12 ± 5% perf-profile.children.cycles-pp.mem_cgroup_try_charge 0.30 ± 3% -0.2 0.09 ± 7% perf-profile.children.cycles-pp.__fxstat64 0.31 ± 7% -0.2 0.11 ± 4% perf-profile.children.cycles-pp.unlock_page 0.30 ± 2% -0.2 0.10 ± 15% perf-profile.children.cycles-pp.enqueue_task_fair 0.28 ± 5% -0.2 0.09 ± 13% perf-profile.children.cycles-pp.copy_page 0.57 ± 5% -0.2 0.37 ± 4% perf-profile.children.cycles-pp.__might_fault 0.29 ± 5% -0.2 0.10 ± 5% perf-profile.children.cycles-pp.__get_free_pages 0.30 ± 5% -0.2 0.10 ± 10% perf-profile.children.cycles-pp.__fput 0.28 ± 6% -0.2 0.08 perf-profile.children.cycles-pp.vmacache_find 0.28 ± 7% -0.2 0.08 ± 17% perf-profile.children.cycles-pp.strncpy_from_user 0.32 ± 4% -0.2 0.12 ± 10% perf-profile.children.cycles-pp.generic_file_write_iter 0.29 ± 5% -0.2 0.10 ± 17% perf-profile.children.cycles-pp.do_notify_parent 0.44 ± 27% -0.2 0.25 ± 28% perf-profile.children.cycles-pp.io_serial_in 0.33 ± 5% -0.2 0.14 ± 26% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.28 ± 15% -0.2 0.09 ± 8% perf-profile.children.cycles-pp.strlen 0.27 ± 9% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.__rb_insert_augmented 0.27 ± 13% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.selinux_vm_enough_memory 0.29 ± 4% -0.2 0.11 ± 7% perf-profile.children.cycles-pp.__generic_file_write_iter 0.24 ± 5% -0.2 0.07 ± 6% perf-profile.children.cycles-pp.dequeue_signal 0.26 ± 6% -0.2 0.08 ± 10% perf-profile.children.cycles-pp.__d_lookup_rcu 0.21 ± 7% -0.2 0.04 ± 58% perf-profile.children.cycles-pp.anon_vma_interval_tree_insert 0.26 ± 5% -0.2 0.09 ± 7% perf-profile.children.cycles-pp.remove_vma 0.24 ± 20% -0.2 0.07 ± 12% perf-profile.children.cycles-pp.wake_up_new_task 0.25 ± 4% -0.2 0.08 ± 19% perf-profile.children.cycles-pp.enqueue_entity 0.24 ± 6% -0.2 0.08 ± 6% perf-profile.children.cycles-pp.get_user_arg_ptr 0.19 ± 6% -0.2 0.03 ±100% perf-profile.children.cycles-pp.memcpy_erms 0.25 ± 4% -0.2 0.08 ± 10% perf-profile.children.cycles-pp.setup_arg_pages 0.25 ± 2% -0.2 0.09 ± 19% perf-profile.children.cycles-pp.activate_task 0.25 ± 3% -0.2 0.09 ± 9% perf-profile.children.cycles-pp.avc_has_perm_noaudit 0.24 ± 15% -0.2 0.08 ± 10% perf-profile.children.cycles-pp.read 0.23 ± 7% -0.2 0.07 ± 6% perf-profile.children.cycles-pp.sched_exec 0.27 ± 5% -0.2 0.11 ± 11% perf-profile.children.cycles-pp.generic_perform_write 0.23 -0.2 0.07 perf-profile.children.cycles-pp.copy_strings_kernel 0.24 ± 10% -0.2 0.08 ± 10% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown 0.23 ± 16% -0.2 0.08 ± 10% perf-profile.children.cycles-pp.ksys_read 0.28 ± 9% -0.2 0.12 ± 11% perf-profile.children.cycles-pp.find_busiest_group 0.24 ± 10% -0.2 0.09 ± 17% perf-profile.children.cycles-pp.read_tsc 0.22 ± 5% -0.2 0.06 ± 6% perf-profile.children.cycles-pp.__pmd_alloc 0.23 ± 14% -0.2 0.07 ± 14% perf-profile.children.cycles-pp.new_sync_read 0.23 ± 8% -0.2 0.08 ± 5% perf-profile.children.cycles-pp.filename_parentat 0.48 ± 6% -0.2 0.33 ± 19% perf-profile.children.cycles-pp.tick_sched_handle 0.47 ± 6% -0.2 0.32 ± 15% perf-profile.children.cycles-pp.update_process_times 0.22 ± 8% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.path_parentat 0.21 ± 9% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.__sigqueue_alloc 0.21 ± 12% -0.1 0.06 perf-profile.children.cycles-pp.lookup_slow 0.21 ± 10% -0.1 0.06 ± 28% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.26 ± 9% -0.1 0.11 ± 7% perf-profile.children.cycles-pp.update_sd_lb_stats 0.20 ± 6% -0.1 0.05 perf-profile.children.cycles-pp.__dequeue_signal 0.17 ± 2% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__list_add_valid 0.23 ± 9% -0.1 0.09 ± 12% perf-profile.children.cycles-pp.change_protection 0.22 ± 12% -0.1 0.07 ± 15% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.19 ± 8% -0.1 0.04 ± 63% perf-profile.children.cycles-pp.close 0.21 ± 5% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.perf_event_mmap_output 0.21 ± 8% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.security_mmap_addr 0.22 ± 11% -0.1 0.08 ± 16% perf-profile.children.cycles-pp.__lock_text_start 0.28 ± 7% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.native_write_msr 0.20 ± 5% -0.1 0.05 ± 63% perf-profile.children.cycles-pp.ttwu_do_activate 0.20 ± 7% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.__strcasecmp 0.21 ± 13% -0.1 0.07 ± 5% perf-profile.children.cycles-pp.cred_has_capability 0.21 ± 9% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.vma_interval_tree_remove 0.21 ± 6% -0.1 0.08 ± 11% perf-profile.children.cycles-pp.ptep_clear_flush 0.22 ± 6% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.alloc_empty_file 0.27 ± 6% -0.1 0.13 ± 13% perf-profile.children.cycles-pp.lapic_next_deadline 0.16 ± 6% -0.1 0.03 ±100% perf-profile.children.cycles-pp.mark_page_accessed 0.26 ± 5% -0.1 0.13 ± 10% perf-profile.children.cycles-pp.__virt_addr_valid 0.21 ± 19% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.worker_thread 0.21 ± 5% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.__alloc_file 0.19 ± 16% -0.1 0.06 ± 17% perf-profile.children.cycles-pp.__waitpid 0.20 ± 10% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.readdir64 0.17 ± 11% -0.1 0.04 ± 60% perf-profile.children.cycles-pp.filename_create 0.21 ± 5% -0.1 0.08 ± 12% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.22 ± 5% -0.1 0.10 ± 33% perf-profile.children.cycles-pp.__next_timer_interrupt 0.19 ± 9% -0.1 0.07 ± 36% perf-profile.children.cycles-pp.find_next_bit 0.18 ± 6% -0.1 0.06 ± 14% perf-profile.children.cycles-pp.count 0.15 ± 21% -0.1 0.03 ±100% perf-profile.children.cycles-pp.kernel_read 0.18 ± 9% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.__pud_alloc 0.17 ± 8% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.dequeue_task_fair 0.19 ± 9% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.vma_compute_subtree_gap 0.18 ± 5% -0.1 0.06 ± 6% perf-profile.children.cycles-pp.mm_init 0.17 ± 13% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__lookup_slow 0.15 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.shift_arg_pages 0.16 ± 13% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.malloc 0.21 ± 5% -0.1 0.10 ± 29% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.15 ± 9% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__mod_lruvec_state 0.17 ± 4% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.__vma_link_rb 0.16 ± 12% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.inode_permission 0.18 ± 10% -0.1 0.06 ± 20% perf-profile.children.cycles-pp.signal_wake_up_state 0.15 ± 7% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.vfs_unlink 0.19 ± 10% -0.1 0.07 ± 15% perf-profile.children.cycles-pp.do_task_dead 0.18 ± 8% -0.1 0.07 ± 7% perf-profile.children.cycles-pp.do_dentry_open 0.15 ± 13% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.wait_consider_task 1.05 ± 3% -0.1 0.94 ± 3% perf-profile.children.cycles-pp._copy_to_user 0.14 ± 6% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__put_user_4 0.14 ± 6% -0.1 0.03 ±100% perf-profile.children.cycles-pp.cap_vm_enough_memory 0.15 ± 10% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__set_current_blocked 0.15 ± 12% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.vfprintf 0.15 ± 7% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.up_read 0.14 ± 3% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__wake_up_common_lock 0.18 ± 20% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.process_one_work 0.16 ± 2% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.pgd_alloc 0.17 ± 13% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.memset_erms 0.15 ± 5% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.__dentry_kill 0.16 ± 13% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.16 ± 11% -0.1 0.06 ± 16% perf-profile.children.cycles-pp.terminate_walk 0.14 ± 18% -0.1 0.04 ±106% perf-profile.children.cycles-pp.rebalance_domains 0.13 ± 11% -0.1 0.03 ±100% perf-profile.children.cycles-pp.sched_clock_cpu 0.14 ± 38% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__vmalloc_node_range 0.13 ± 9% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__account_scheduler_latency 0.18 ± 18% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.update_load_avg 0.17 ± 4% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.try_charge 0.14 ± 7% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.find_get_entry 0.14 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.__get_user_8 0.12 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.generic_file_read_iter 0.15 ± 5% -0.1 0.05 ± 8% perf-profile.children.cycles-pp._IO_file_open 0.12 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.sched_clock 0.14 ± 3% -0.1 0.04 ± 58% perf-profile.children.cycles-pp.group_send_sig_info 0.12 ± 5% -0.1 0.03 ±100% perf-profile.children.cycles-pp.free_pgd_range 0.12 ± 6% -0.1 0.03 ±102% perf-profile.children.cycles-pp.complete_walk 0.14 ± 6% -0.1 0.04 ± 59% perf-profile.children.cycles-pp.shmem_write_begin 0.12 ± 10% -0.1 0.03 ±102% perf-profile.children.cycles-pp.update_blocked_averages 0.12 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.12 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.native_sched_clock 0.15 ± 2% -0.1 0.06 ± 20% perf-profile.children.cycles-pp.shmem_getpage_gfp 0.14 ± 8% -0.1 0.05 ± 9% perf-profile.children.cycles-pp.mem_cgroup_throttle_swaprate 0.12 ± 12% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.update_curr 0.14 ± 20% -0.1 0.06 ± 17% perf-profile.children.cycles-pp.lseek64 0.17 ± 23% -0.1 0.09 ± 28% perf-profile.children.cycles-pp.delay_tsc 0.14 ± 5% -0.1 0.06 ± 11% perf-profile.children.cycles-pp.open_exec 0.11 ± 6% -0.1 0.03 ±102% perf-profile.children.cycles-pp.run_rebalance_domains 0.12 ± 3% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.down_write_killable 0.16 -0.1 0.09 ± 16% perf-profile.children.cycles-pp.run_ksoftirqd 0.21 ± 10% -0.1 0.16 ± 18% perf-profile.children.cycles-pp.scheduler_tick 0.08 ± 5% -0.1 0.03 ±102% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.11 ± 9% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.lockref_put_or_lock 0.00 +0.5 0.46 ± 3% perf-profile.children.cycles-pp.move_cursor 41.35 +36.1 77.45 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 41.23 +36.2 77.40 ± 2% perf-profile.children.cycles-pp.do_syscall_64 2.72 ± 8% +60.7 63.44 ± 2% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 4.49 ± 5% +61.3 65.80 ± 2% perf-profile.children.cycles-pp.__x64_sys_getdents 4.46 ± 5% +61.3 65.79 ± 2% perf-profile.children.cycles-pp.iterate_dir 4.38 ± 5% +61.4 65.73 ± 2% perf-profile.children.cycles-pp.dcache_readdir 0.31 ± 15% +62.5 62.85 ± 2% perf-profile.children.cycles-pp.next_positive 1.63 ± 17% +62.5 64.18 ± 2% perf-profile.children.cycles-pp._raw_spin_lock 18.81 -10.3 8.54 ± 14% perf-profile.self.cycles-pp.intel_idle 12.10 -8.1 4.04 ± 7% perf-profile.self.cycles-pp.add_short 3.20 -2.0 1.21 ± 2% perf-profile.self.cycles-pp.do_syscall_64 2.02 ± 6% -1.4 0.64 ± 3% perf-profile.self.cycles-pp.filldir 1.84 ± 4% -1.3 0.56 ± 3% perf-profile.self.cycles-pp.filemap_map_pages 1.68 ± 2% -1.1 0.60 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64 1.55 -1.0 0.58 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret 1.48 ± 2% -0.9 0.54 ± 3% perf-profile.self.cycles-pp.native_irq_return_iret 1.31 ± 3% -0.9 0.44 ± 3% perf-profile.self.cycles-pp.unmap_page_range 1.33 ± 3% -0.9 0.47 ± 2% perf-profile.self.cycles-pp._dl_addr 1.38 ± 6% -0.9 0.52 ± 4% perf-profile.self.cycles-pp.prepare_exit_to_usermode 1.22 ± 5% -0.8 0.42 ± 4% perf-profile.self.cycles-pp.native_flush_tlb_one_user 1.14 ± 3% -0.8 0.37 ± 10% perf-profile.self.cycles-pp.page_test 1.04 ± 5% -0.7 0.35 ± 5% perf-profile.self.cycles-pp.clear_page_erms 0.93 -0.7 0.25 ± 3% perf-profile.self.cycles-pp.release_pages 0.90 ± 3% -0.6 0.25 ± 7% perf-profile.self.cycles-pp.page_remove_rmap 0.94 ± 5% -0.6 0.32 perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode 0.77 ± 2% -0.5 0.27 ± 3% perf-profile.self.cycles-pp.___might_sleep 0.76 -0.5 0.27 ± 4% perf-profile.self.cycles-pp.sync_regs 0.73 ± 2% -0.5 0.26 ± 4% perf-profile.self.cycles-pp.copy_user_generic_unrolled 0.55 ± 2% -0.4 0.14 ± 8% perf-profile.self.cycles-pp.vma_interval_tree_insert 0.59 ± 4% -0.4 0.18 ± 10% perf-profile.self.cycles-pp.__handle_mm_fault 0.61 ± 13% -0.4 0.20 ± 10% perf-profile.self.cycles-pp.ktime_get 0.47 ± 6% -0.3 0.16 ± 4% perf-profile.self.cycles-pp.strnlen_user 0.41 ± 7% -0.3 0.14 ± 11% perf-profile.self.cycles-pp.get_page_from_freelist 0.42 ± 4% -0.3 0.15 ± 5% perf-profile.self.cycles-pp.__check_heap_object 0.39 ± 5% -0.3 0.12 ± 10% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.36 ± 3% -0.2 0.11 ± 4% perf-profile.self.cycles-pp.down_write 0.35 ± 4% -0.2 0.10 ± 14% perf-profile.self.cycles-pp.__slab_free 0.35 ± 4% -0.2 0.11 ± 12% perf-profile.self.cycles-pp.up_write 0.40 ± 11% -0.2 0.16 ± 2% perf-profile.self.cycles-pp.__check_object_size 0.37 ± 8% -0.2 0.14 ± 6% perf-profile.self.cycles-pp.copy_fpstate_to_sigframe 0.32 ± 4% -0.2 0.08 ± 13% perf-profile.self.cycles-pp.page_add_file_rmap 0.36 ± 3% -0.2 0.14 ± 11% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.34 -0.2 0.12 ± 9% perf-profile.self.cycles-pp.__might_sleep 0.34 ± 3% -0.2 0.12 ± 11% perf-profile.self.cycles-pp.___perf_sw_event 0.31 ± 15% -0.2 0.09 ± 7% perf-profile.self.cycles-pp.next_positive 0.31 ± 7% -0.2 0.09 ± 7% perf-profile.self.cycles-pp.copy_p4d_range 0.33 ± 8% -0.2 0.11 ± 7% perf-profile.self.cycles-pp.kmem_cache_alloc 0.32 ± 8% -0.2 0.11 ± 13% perf-profile.self.cycles-pp.__list_del_entry_valid 0.28 ± 12% -0.2 0.07 ± 17% perf-profile.self.cycles-pp.free_pages_and_swap_cache 0.32 ± 9% -0.2 0.11 ± 9% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 0.36 ± 8% -0.2 0.15 ± 21% perf-profile.self.cycles-pp.cpuidle_enter_state 0.32 ± 5% -0.2 0.12 perf-profile.self.cycles-pp.__fpu__restore_sig 0.26 -0.2 0.06 ± 7% perf-profile.self.cycles-pp.down_read 0.31 ± 6% -0.2 0.11 ± 4% perf-profile.self.cycles-pp.unlock_page 0.28 ± 5% -0.2 0.09 ± 13% perf-profile.self.cycles-pp.copy_page 0.30 ± 4% -0.2 0.11 ± 8% perf-profile.self.cycles-pp.find_vma 0.44 ± 27% -0.2 0.25 ± 28% perf-profile.self.cycles-pp.io_serial_in 0.28 ± 6% -0.2 0.09 ± 7% perf-profile.self.cycles-pp.handle_mm_fault 0.27 ± 6% -0.2 0.08 perf-profile.self.cycles-pp.vmacache_find 0.29 ± 5% -0.2 0.10 ± 4% perf-profile.self.cycles-pp.perf_iterate_sb 0.26 ± 5% -0.2 0.08 ± 8% perf-profile.self.cycles-pp.perf_event_mmap 0.27 ± 4% -0.2 0.10 ± 9% perf-profile.self.cycles-pp.selinux_inode_permission 0.26 ± 14% -0.2 0.08 ± 10% perf-profile.self.cycles-pp.__do_page_fault 0.21 ± 5% -0.2 0.04 ± 58% perf-profile.self.cycles-pp.anon_vma_interval_tree_insert 0.25 ± 6% -0.2 0.08 ± 10% perf-profile.self.cycles-pp.__d_lookup_rcu 0.24 ± 15% -0.2 0.08 ± 11% perf-profile.self.cycles-pp.alloc_set_pte 0.24 ± 11% -0.2 0.08 ± 10% perf-profile.self.cycles-pp.__rb_insert_augmented 0.23 ± 12% -0.2 0.07 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair 0.25 ± 5% -0.2 0.09 ± 9% perf-profile.self.cycles-pp.avc_has_perm_noaudit 0.18 ± 7% -0.2 0.03 ±100% perf-profile.self.cycles-pp.memcpy_erms 0.28 ± 7% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.native_write_msr 0.20 ± 6% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.__sigqueue_alloc 0.17 ± 3% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__list_add_valid 0.23 ± 10% -0.1 0.09 ± 14% perf-profile.self.cycles-pp.read_tsc 0.21 ± 11% -0.1 0.07 ± 5% perf-profile.self.cycles-pp.vma_interval_tree_remove 0.21 ± 7% -0.1 0.07 ± 10% perf-profile.self.cycles-pp.fpu__clear 0.16 ± 9% -0.1 0.03 ±100% perf-profile.self.cycles-pp.mark_page_accessed 0.19 ± 7% -0.1 0.06 ± 16% perf-profile.self.cycles-pp.__alloc_pages_nodemask 0.16 ± 13% -0.1 0.04 ±107% perf-profile.self.cycles-pp.find_next_bit 0.19 ± 11% -0.1 0.07 ± 13% perf-profile.self.cycles-pp.readdir64 0.20 ± 6% -0.1 0.08 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.19 ± 21% -0.1 0.07 ± 10% perf-profile.self.cycles-pp.strlen 0.18 ± 10% -0.1 0.06 perf-profile.self.cycles-pp.__vma_adjust 0.18 ± 4% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.kmem_cache_free 0.15 ± 10% -0.1 0.03 ±100% perf-profile.self.cycles-pp.up_read 0.19 ± 9% -0.1 0.07 ± 15% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.24 ± 5% -0.1 0.12 ± 6% perf-profile.self.cycles-pp.__virt_addr_valid 0.18 ± 10% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.vma_compute_subtree_gap 0.15 ± 4% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.link_path_walk 0.20 ± 10% -0.1 0.10 ± 9% perf-profile.self.cycles-pp.update_sd_lb_stats 0.17 ± 4% -0.1 0.06 ± 11% perf-profile.self.cycles-pp.do_signal 0.13 ± 9% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__get_user_8 0.16 ± 14% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.memset_erms 0.15 ± 19% -0.1 0.05 ± 9% perf-profile.self.cycles-pp.__x64_sys_rt_sigreturn 0.17 ± 5% -0.1 0.07 ± 13% perf-profile.self.cycles-pp.try_charge 0.17 ± 14% -0.1 0.07 ± 14% perf-profile.self.cycles-pp.__lock_text_start 0.12 ± 11% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__perf_sw_event 0.11 ± 14% -0.1 0.03 ±100% perf-profile.self.cycles-pp.malloc 0.12 ± 4% -0.1 0.04 ± 57% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.11 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.native_sched_clock 0.12 -0.1 0.04 ± 57% perf-profile.self.cycles-pp.mem_cgroup_throttle_swaprate 0.17 ± 23% -0.1 0.09 ± 28% perf-profile.self.cycles-pp.delay_tsc 0.12 ± 6% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.do_brk_flags 0.10 ± 15% -0.1 0.03 ±100% perf-profile.self.cycles-pp.do_idle 0.15 ± 15% -0.1 0.07 ± 10% perf-profile.self.cycles-pp.__might_fault 0.11 ± 17% -0.1 0.04 ± 58% perf-profile.self.cycles-pp.__x64_sys_brk 0.10 ± 8% -0.1 0.04 ± 60% perf-profile.self.cycles-pp.__next_timer_interrupt 0.10 ± 11% +0.5 0.57 ± 6% perf-profile.self.cycles-pp._copy_to_user 2.70 ± 7% +60.5 63.18 ± 2% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[xfs] 73a16a2894: aim7.jobs-per-min -31.6% regression

by kernel test robot

Greeting, FYI, we noticed a -31.6% regression of aim7.jobs-per-min due to commit: commit: 73a16a2894549c9e544ef61aad3c30a60019a2cb ("xfs: parallelize inode inactivation") https://kernel.googlesource.com/pub/scm/linux/kernel/git/djwong/xfs-linux... rough-fixes in testcase: aim7 on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory with following parameters: disk: 4BRD_12G md: RAID0 fs: xfs test: disk_src load: 3000 cpufreq_governor: performance test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase: gcc-7/performance/4BRD_12G/xfs/x86_64-rhel-7.6/3000/RAID0/debian-x86_64-2019-05-14.cgz/lkp-ivb-ep01/disk_src/aim7 commit: 6298ae61d2 ("xfs: force inactivation before fallocate when space is low") 73a16a2894 ("xfs: parallelize inode inactivation") 6298ae61d2ecd22d 73a16a2894549c9e544ef61aad3 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | 3:4 -75% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x :4 50% 2:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x %stddev %change %stddev \ | \ 28682 -31.6% 19623 aim7.jobs-per-min 628.00 +46.1% 917.77 aim7.time.elapsed_time 628.00 +46.1% 917.77 aim7.time.elapsed_time.max 32590 ± 6% -35.9% 20896 ± 6% aim7.time.file_system_inputs 21342 +51.1% 32253 aim7.time.involuntary_context_switches 3491 +58.6% 5538 aim7.time.system_time 122.28 +8.1% 132.16 aim7.time.user_time 7211143 +64.6% 11870679 ± 2% aim7.time.voluntary_context_switches 1285 -1.2% 1269 boot-time.idle 6590 ± 70% +98.0% 13046 numa-numastat.node1.other_node 1.549e+10 ± 10% +43.6% 2.224e+10 ± 9% cpuidle.C6.time 26014805 ± 17% +61.0% 41883750 ± 19% cpuidle.C6.usage 365519 +66.2% 607360 cpuidle.POLL.time 23959 ± 3% +60.6% 38475 cpuidle.POLL.usage 84.05 -3.7% 80.90 iostat.cpu.idle 15.38 +21.3% 18.66 iostat.cpu.system 1296 -24.8% 975.49 iostat.md0.w/s 28242 -22.7% 21842 iostat.md0.wkB/s 2265 ± 41% +92.7% 4364 ± 28% numa-vmstat.node0.nr_shmem 479835 -94.1% 28115 ± 2% numa-vmstat.node0.nr_slab_reclaimable 323938 ± 2% -92.3% 24986 ± 32% numa-vmstat.node0.nr_slab_unreclaimable 488494 -95.4% 22470 ± 3% numa-vmstat.node1.nr_slab_reclaimable 315962 ± 2% -89.7% 32671 ± 24% numa-vmstat.node1.nr_slab_unreclaimable 255.50 +8.4% 277.00 ± 2% turbostat.Avg_MHz 20.01 +3.0 23.04 ± 2% turbostat.Busy% 26010933 ± 17% +61.0% 41879491 ± 19% turbostat.C6 51358007 +44.5% 74196457 turbostat.IRQ 1.18 ± 18% -36.8% 0.74 ± 11% turbostat.Pkg%pc2 50370 +46.0% 73540 turbostat.SMI 83.50 -3.9% 80.25 vmstat.cpu.id 27381 -22.8% 21144 vmstat.io.bo 4984658 -73.7% 1313263 vmstat.memory.cache 6.00 +16.7% 7.00 vmstat.procs.r 38725 +5.5% 40838 vmstat.system.cs 81494 -1.0% 80660 vmstat.system.in 3872245 -94.8% 202334 meminfo.KReclaimable 13158326 -61.0% 5130076 meminfo.Memused 101553 ± 5% +14.5% 116292 ± 8% meminfo.PageTables 3872245 -94.8% 202334 meminfo.SReclaimable 2558865 -91.0% 230631 meminfo.SUnreclaim 31509 +11.1% 35010 meminfo.Shmem 6431111 -93.3% 432966 meminfo.Slab 338337 -16.4% 282859 meminfo.VmallocUsed 37848 -78.1% 8278 meminfo.max_used_kB 1918514 -94.1% 112464 ± 2% numa-meminfo.node0.KReclaimable 6329865 ± 6% -58.8% 2610379 ± 6% numa-meminfo.node0.MemUsed 1918514 -94.1% 112464 ± 2% numa-meminfo.node0.SReclaimable 1295259 ± 2% -92.3% 99946 ± 32% numa-meminfo.node0.SUnreclaim 9059 ± 41% +92.7% 17459 ± 28% numa-meminfo.node0.Shmem 3213774 -93.4% 212411 ± 15% numa-meminfo.node0.Slab 1953128 -95.4% 89882 ± 3% numa-meminfo.node1.KReclaimable 6827591 ± 5% -63.1% 2519244 ± 5% numa-meminfo.node1.MemUsed 1953128 -95.4% 89882 ± 3% numa-meminfo.node1.SReclaimable 1263297 ± 2% -89.7% 130693 ± 24% numa-meminfo.node1.SUnreclaim 3216425 -93.1% 220576 ± 14% numa-meminfo.node1.Slab 9520889 +2.1% 9721313 proc-vmstat.nr_dirty_background_threshold 19065060 +2.1% 19466397 proc-vmstat.nr_dirty_threshold 95762281 +2.1% 97769457 proc-vmstat.nr_free_pages 5062 +2.5% 5191 proc-vmstat.nr_inactive_anon 25386 ± 5% +14.5% 29072 ± 8% proc-vmstat.nr_page_table_pages 7877 +11.1% 8752 proc-vmstat.nr_shmem 968099 -94.8% 50584 proc-vmstat.nr_slab_reclaimable 639746 -91.0% 57656 proc-vmstat.nr_slab_unreclaimable 5062 +2.5% 5191 proc-vmstat.nr_zone_inactive_anon 5050595 -3.7% 4861550 proc-vmstat.numa_hit 5037460 -3.8% 4848364 proc-vmstat.numa_local 1324 ± 11% +32.0% 1748 ± 9% proc-vmstat.pgactivate 7847951 -22.1% 6117074 proc-vmstat.pgalloc_normal 1764564 +39.9% 2469500 proc-vmstat.pgfault 2388604 +99.2% 4758851 proc-vmstat.pgfree 16475 ± 5% -35.5% 10624 ± 8% proc-vmstat.pgpgin 17259303 +12.8% 19464058 proc-vmstat.pgpgout 1879 +1.5% 1907 proc-vmstat.unevictable_pgs_culled 48666 +76.8% 86051 sched_debug.cfs_rq:/.exec_clock.avg 135393 -33.2% 90412 sched_debug.cfs_rq:/.exec_clock.max 26618 +215.6% 84021 sched_debug.cfs_rq:/.exec_clock.min 14312 -91.0% 1289 ± 9% sched_debug.cfs_rq:/.exec_clock.stddev 393911 ± 4% +96.7% 774700 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg 579123 ± 2% +57.0% 909216 ± 2% sched_debug.cfs_rq:/.min_vruntime.max 159226 ± 10% +355.1% 724696 ± 4% sched_debug.cfs_rq:/.min_vruntime.min 65888 ± 12% -40.6% 39155 ± 30% sched_debug.cfs_rq:/.min_vruntime.stddev 1.12 ± 12% +49.9% 1.67 ± 32% sched_debug.cfs_rq:/.nr_spread_over.avg 0.45 +75.3% 0.80 ± 12% sched_debug.cfs_rq:/.nr_spread_over.min 18.27 ± 15% +72.7% 31.55 ± 8% sched_debug.cfs_rq:/.runnable_load_avg.avg 241590 ± 29% -43.5% 136534 ± 14% sched_debug.cfs_rq:/.spread0.max -178307 -73.1% -48028 sched_debug.cfs_rq:/.spread0.min 65886 ± 12% -40.6% 39156 ± 30% sched_debug.cfs_rq:/.spread0.stddev 157.45 +17.3% 184.66 ± 3% sched_debug.cfs_rq:/.util_avg.stddev 23.29 ± 9% +71.3% 39.90 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.avg 78.72 ± 7% +46.0% 114.96 ± 11% sched_debug.cfs_rq:/.util_est_enqueued.stddev 93948 ± 9% +146.0% 231107 ± 6% sched_debug.cpu.avg_idle.min 343542 +44.8% 497596 sched_debug.cpu.clock.avg 343569 +44.8% 497627 sched_debug.cpu.clock.max 343513 +44.8% 497564 sched_debug.cpu.clock.min 343542 +44.8% 497596 sched_debug.cpu.clock_task.avg 343569 +44.8% 497627 sched_debug.cpu.clock_task.max 343513 +44.8% 497564 sched_debug.cpu.clock_task.min 11973 +31.8% 15786 sched_debug.cpu.curr->pid.max 2293 +20.8% 2771 ± 2% sched_debug.cpu.curr->pid.stddev 291435 +59.6% 465252 sched_debug.cpu.nr_switches.avg 3322828 -84.8% 506717 sched_debug.cpu.nr_switches.max 123943 ± 6% +243.8% 426081 ± 2% sched_debug.cpu.nr_switches.min 485747 -96.4% 17504 ± 4% sched_debug.cpu.nr_switches.stddev 154.41 ± 6% +25.5% 193.75 ± 9% sched_debug.cpu.nr_uninterruptible.max 45.66 ± 15% +44.5% 65.97 ± 9% sched_debug.cpu.nr_uninterruptible.stddev 289211 +60.1% 462992 sched_debug.cpu.sched_count.avg 3319749 -84.8% 503177 sched_debug.cpu.sched_count.max 121121 ± 7% +249.9% 423747 ± 2% sched_debug.cpu.sched_count.min 485550 -96.5% 17224 ± 4% sched_debug.cpu.sched_count.stddev 129527 +68.6% 218367 ± 2% sched_debug.cpu.sched_goidle.avg 1495010 -84.2% 236513 ± 2% sched_debug.cpu.sched_goidle.max 56307 ± 7% +256.6% 200766 ± 2% sched_debug.cpu.sched_goidle.min 218759 -96.4% 7832 ± 5% sched_debug.cpu.sched_goidle.stddev 146549 +59.7% 233968 sched_debug.cpu.ttwu_count.avg 1376890 -81.6% 253020 ± 2% sched_debug.cpu.ttwu_count.max 66441 ± 5% +221.1% 213322 sched_debug.cpu.ttwu_count.min 197195 -95.6% 8696 ± 3% sched_debug.cpu.ttwu_count.stddev 14892 +23.4% 18370 sched_debug.cpu.ttwu_local.avg 3035 ± 15% +355.4% 13824 ± 2% sched_debug.cpu.ttwu_local.min 4226 ± 3% -39.2% 2569 ± 6% sched_debug.cpu.ttwu_local.stddev 343511 +44.8% 497561 sched_debug.cpu_clk 339915 +45.3% 493967 sched_debug.ktime 343869 +44.8% 497922 sched_debug.sched_clk 3715816 -98.4% 61244 slabinfo.dmaengine-unmap-16.active_objs 88703 -97.7% 2027 slabinfo.dmaengine-unmap-16.active_slabs 3725580 -97.7% 85200 slabinfo.dmaengine-unmap-16.num_objs 88703 -97.7% 2027 slabinfo.dmaengine-unmap-16.num_slabs 933.75 ± 6% -8.5% 854.75 ± 7% slabinfo.file_lock_cache.active_objs 933.75 ± 6% -8.5% 854.75 ± 7% slabinfo.file_lock_cache.num_objs 11739 -10.7% 10482 slabinfo.filp.num_objs 3550 ± 3% +187.1% 10192 slabinfo.kmalloc-128.active_objs 110.25 ± 3% +189.8% 319.50 slabinfo.kmalloc-128.active_slabs 3550 ± 3% +188.6% 10244 slabinfo.kmalloc-128.num_objs 110.25 ± 3% +189.8% 319.50 slabinfo.kmalloc-128.num_slabs 3699063 -97.6% 89992 slabinfo.kmalloc-16.active_objs 14449 -97.3% 384.75 slabinfo.kmalloc-16.active_slabs 3699207 -97.3% 98606 slabinfo.kmalloc-16.num_objs 14449 -97.3% 384.75 slabinfo.kmalloc-16.num_slabs 4338 ± 2% +33.2% 5779 ± 2% slabinfo.kmalloc-1k.active_objs 4357 ± 2% +32.7% 5780 ± 2% slabinfo.kmalloc-1k.num_objs 129558 -85.0% 19424 ± 6% slabinfo.kmalloc-32.active_objs 1011 -84.9% 152.75 ± 6% slabinfo.kmalloc-32.active_slabs 129579 -84.8% 19638 ± 6% slabinfo.kmalloc-32.num_objs 1011 -84.9% 152.75 ± 6% slabinfo.kmalloc-32.num_slabs 3138133 -98.7% 41306 slabinfo.kmalloc-512.active_objs 98102 -98.1% 1906 slabinfo.kmalloc-512.active_slabs 3139296 -98.1% 61014 slabinfo.kmalloc-512.num_objs 98102 -98.1% 1906 slabinfo.kmalloc-512.num_slabs 288.50 ± 9% +46.0% 421.25 slabinfo.nfs_read_data.active_objs 288.50 ± 9% +46.0% 421.25 slabinfo.nfs_read_data.num_objs 83301 -70.8% 24296 slabinfo.radix_tree_node.active_objs 2981 -70.5% 878.50 slabinfo.radix_tree_node.active_slabs 83509 -70.5% 24607 slabinfo.radix_tree_node.num_objs 2981 -70.5% 878.50 slabinfo.radix_tree_node.num_slabs 15967 +19.7% 19115 slabinfo.vmap_area.active_objs 16696 +17.5% 19610 slabinfo.vmap_area.num_objs 324.00 ± 19% +49.7% 485.00 ± 3% slabinfo.xfrm_state.active_objs 324.00 ± 19% +49.7% 485.00 ± 3% slabinfo.xfrm_state.num_objs 116536 -93.7% 7313 ± 3% slabinfo.xfs_buf.active_objs 2774 -93.5% 180.25 ± 3% slabinfo.xfs_buf.active_slabs 116547 -93.5% 7597 ± 3% slabinfo.xfs_buf.num_objs 2774 -93.5% 180.25 ± 3% slabinfo.xfs_buf.num_slabs 9169 -35.4% 5923 slabinfo.xfs_buf_item.active_objs 310.25 -35.4% 200.50 slabinfo.xfs_buf_item.active_slabs 9315 -35.3% 6028 slabinfo.xfs_buf_item.num_objs 310.25 -35.4% 200.50 slabinfo.xfs_buf_item.num_slabs 1966 ± 4% +226.1% 6411 ± 5% slabinfo.xfs_efd_item.active_objs 52.75 ± 4% +230.3% 174.25 ± 5% slabinfo.xfs_efd_item.active_slabs 1966 ± 4% +228.8% 6464 ± 5% slabinfo.xfs_efd_item.num_objs 52.75 ± 4% +230.3% 174.25 ± 5% slabinfo.xfs_efd_item.num_slabs 3715508 -98.4% 60982 slabinfo.xfs_inode.active_objs 116415 -97.7% 2626 slabinfo.xfs_inode.active_slabs 3725291 -97.7% 84066 slabinfo.xfs_inode.num_objs 116415 -97.7% 2626 slabinfo.xfs_inode.num_slabs 16.65 ± 2% -36.6% 10.55 ± 5% perf-stat.i.MPKI 1.507e+09 +28.4% 1.935e+09 perf-stat.i.branch-instructions 3.14 -0.6 2.54 perf-stat.i.branch-miss-rate% 15.46 ± 2% -2.1 13.36 ± 4% perf-stat.i.cache-miss-rate% 17898559 ± 3% -34.4% 11746315 ± 7% perf-stat.i.cache-misses 1.131e+08 ± 2% -21.2% 89131641 ± 5% perf-stat.i.cache-references 38840 +5.3% 40916 perf-stat.i.context-switches 1.60 ± 2% -20.5% 1.27 ± 3% perf-stat.i.cpi 561.37 +65.4% 928.27 ± 7% perf-stat.i.cpu-migrations 669.68 ± 2% +43.5% 961.21 ± 5% perf-stat.i.cycles-between-cache-misses 0.62 ± 5% -0.3 0.28 ± 3% perf-stat.i.dTLB-load-miss-rate% 11040116 ± 5% -40.3% 6594857 ± 4% perf-stat.i.dTLB-load-misses 1.823e+09 +42.1% 2.59e+09 perf-stat.i.dTLB-loads 0.15 ± 4% -0.1 0.07 ± 7% perf-stat.i.dTLB-store-miss-rate% 1176632 ± 3% -34.2% 773684 ± 9% perf-stat.i.dTLB-store-misses 7.961e+08 ± 2% +48.9% 1.185e+09 ± 5% perf-stat.i.dTLB-stores 41.74 ± 2% +1.8 43.58 perf-stat.i.iTLB-load-miss-rate% 1680621 ± 2% -9.0% 1529900 ± 3% perf-stat.i.iTLB-load-misses 2421937 ± 4% -14.1% 2079312 ± 2% perf-stat.i.iTLB-loads 7.145e+09 +33.7% 9.555e+09 perf-stat.i.instructions 4232 ± 2% +46.3% 6193 ± 3% perf-stat.i.instructions-per-iTLB-miss 0.65 +27.9% 0.83 ± 3% perf-stat.i.ipc 2724 -3.7% 2622 perf-stat.i.minor-faults 42.83 +1.5 44.34 perf-stat.i.node-load-miss-rate% 6361451 -47.5% 3336831 perf-stat.i.node-load-misses 9312635 -55.1% 4185756 ± 2% perf-stat.i.node-loads 2772972 -25.5% 2064781 perf-stat.i.node-store-misses 4138412 -27.1% 3017312 perf-stat.i.node-stores 2724 -3.7% 2622 perf-stat.i.page-faults 15.83 ± 2% -41.1% 9.33 ± 4% perf-stat.overall.MPKI 2.96 -0.6 2.33 perf-stat.overall.branch-miss-rate% 15.82 ± 2% -2.7 13.17 ± 4% perf-stat.overall.cache-miss-rate% 1.52 -22.3% 1.18 ± 2% perf-stat.overall.cpi 608.08 ± 2% +58.9% 966.12 ± 5% perf-stat.overall.cycles-between-cache-misses 0.60 ± 6% -0.3 0.25 ± 4% perf-stat.overall.dTLB-load-miss-rate% 0.15 ± 4% -0.1 0.07 ± 7% perf-stat.overall.dTLB-store-miss-rate% 4253 ± 2% +47.0% 6251 ± 3% perf-stat.overall.instructions-per-iTLB-miss 0.66 +28.7% 0.85 ± 2% perf-stat.overall.ipc 40.59 +3.8 44.36 perf-stat.overall.node-load-miss-rate% 40.12 +0.5 40.63 perf-stat.overall.node-store-miss-rate% 1.505e+09 +28.5% 1.933e+09 perf-stat.ps.branch-instructions 17869714 ± 3% -34.3% 11733432 ± 7% perf-stat.ps.cache-misses 1.129e+08 ± 2% -21.1% 89033383 ± 5% perf-stat.ps.cache-references 38777 +5.4% 40870 perf-stat.ps.context-switches 560.48 +65.4% 927.25 ± 7% perf-stat.ps.cpu-migrations 11022157 ± 5% -40.2% 6587600 ± 4% perf-stat.ps.dTLB-load-misses 1.82e+09 +42.1% 2.587e+09 perf-stat.ps.dTLB-loads 1174725 ± 3% -34.2% 772840 ± 9% perf-stat.ps.dTLB-store-misses 7.948e+08 ± 2% +48.9% 1.184e+09 ± 5% perf-stat.ps.dTLB-stores 1677919 ± 2% -8.9% 1528226 ± 3% perf-stat.ps.iTLB-load-misses 2418014 ± 4% -14.1% 2077000 ± 2% perf-stat.ps.iTLB-loads 7.134e+09 +33.8% 9.544e+09 perf-stat.ps.instructions 2720 -3.7% 2620 perf-stat.ps.minor-faults 6351137 -47.5% 3333134 perf-stat.ps.node-load-misses 9297533 -55.0% 4181124 ± 2% perf-stat.ps.node-loads 2768483 -25.5% 2062498 perf-stat.ps.node-store-misses 4131727 -27.1% 3013998 perf-stat.ps.node-stores 2720 -3.7% 2620 perf-stat.ps.page-faults 4.486e+12 +95.4% 8.766e+12 perf-stat.total.instructions 1494 +15.6% 1727 ± 2% interrupts.10:IR-IO-APIC.10-edge.ipmi_si 792.50 ± 13% +36.3% 1080 ± 14% interrupts.39:IR-PCI-MSI.524289-edge.eth0-TxRx-0 366.50 ± 3% +4427.7% 16594 ±166% interrupts.40:IR-PCI-MSI.524290-edge.eth0-TxRx-1 523.25 ± 26% +3155.0% 17032 ± 57% interrupts.45:IR-PCI-MSI.524295-edge.eth0-TxRx-6 204268 +43.9% 293848 interrupts.CAL:Function_call_interrupts 4733 ± 2% +46.0% 6909 interrupts.CPU0.CAL:Function_call_interrupts 1258857 +46.1% 1838720 interrupts.CPU0.LOC:Local_timer_interrupts 5356 ± 6% +38.4% 7416 ± 4% interrupts.CPU1.CAL:Function_call_interrupts 1258156 +46.1% 1838261 interrupts.CPU1.LOC:Local_timer_interrupts 4926 ± 8% +60.7% 7918 interrupts.CPU10.CAL:Function_call_interrupts 1258344 +46.1% 1838592 interrupts.CPU10.LOC:Local_timer_interrupts 164.50 ±151% +376.6% 784.00 ± 2% interrupts.CPU10.NMI:Non-maskable_interrupts 164.50 ±151% +376.6% 784.00 ± 2% interrupts.CPU10.PMI:Performance_monitoring_interrupts 4305 ± 32% +103.6% 8764 ± 4% interrupts.CPU10.RES:Rescheduling_interrupts 4914 ± 6% +53.7% 7556 ± 7% interrupts.CPU11.CAL:Function_call_interrupts 1258282 +46.1% 1838248 interrupts.CPU11.LOC:Local_timer_interrupts 5243 ± 8% +45.5% 7629 ± 7% interrupts.CPU12.CAL:Function_call_interrupts 1258363 +46.1% 1838546 interrupts.CPU12.LOC:Local_timer_interrupts 4884 ± 6% +56.6% 7646 ± 6% interrupts.CPU13.CAL:Function_call_interrupts 1258209 +46.1% 1838551 interrupts.CPU13.LOC:Local_timer_interrupts 4984 ± 7% +42.6% 7109 ± 8% interrupts.CPU14.CAL:Function_call_interrupts 1258516 +46.1% 1838593 interrupts.CPU14.LOC:Local_timer_interrupts 5286 ± 5% +33.5% 7057 ± 5% interrupts.CPU15.CAL:Function_call_interrupts 1258314 +46.1% 1838531 interrupts.CPU15.LOC:Local_timer_interrupts 4737 ± 3% +56.5% 7413 ± 7% interrupts.CPU16.CAL:Function_call_interrupts 1258679 +46.1% 1838447 interrupts.CPU16.LOC:Local_timer_interrupts 4237 ± 36% +73.6% 7356 ± 23% interrupts.CPU16.RES:Rescheduling_interrupts 4806 +57.5% 7572 ± 5% interrupts.CPU17.CAL:Function_call_interrupts 1257486 +46.2% 1838428 interrupts.CPU17.LOC:Local_timer_interrupts 4968 ± 7% +57.9% 7847 ± 3% interrupts.CPU18.CAL:Function_call_interrupts 1258427 +46.1% 1838038 interrupts.CPU18.LOC:Local_timer_interrupts 4864 ± 39% +87.5% 9119 ± 8% interrupts.CPU18.RES:Rescheduling_interrupts 4956 ± 4% +43.7% 7120 ± 4% interrupts.CPU19.CAL:Function_call_interrupts 1257616 +46.2% 1838487 interrupts.CPU19.LOC:Local_timer_interrupts 4973 ± 6% +57.3% 7820 ± 2% interrupts.CPU2.CAL:Function_call_interrupts 1258621 +46.1% 1838386 interrupts.CPU2.LOC:Local_timer_interrupts 165.75 ±138% +487.3% 973.50 ± 32% interrupts.CPU2.NMI:Non-maskable_interrupts 165.75 ±138% +487.3% 973.50 ± 32% interrupts.CPU2.PMI:Performance_monitoring_interrupts 4318 ± 35% +96.7% 8494 ± 2% interrupts.CPU2.RES:Rescheduling_interrupts 5505 +44.5% 7952 interrupts.CPU20.CAL:Function_call_interrupts 1258218 +46.1% 1838462 interrupts.CPU20.LOC:Local_timer_interrupts 4940 ± 5% +42.3% 7028 ± 8% interrupts.CPU21.CAL:Function_call_interrupts 1257717 +46.2% 1838448 interrupts.CPU21.LOC:Local_timer_interrupts 5320 ± 7% +28.8% 6853 interrupts.CPU22.CAL:Function_call_interrupts 1257738 +46.2% 1838357 interrupts.CPU22.LOC:Local_timer_interrupts 792.75 ± 32% -88.4% 91.75 ±106% interrupts.CPU22.NMI:Non-maskable_interrupts 792.75 ± 32% -88.4% 91.75 ±106% interrupts.CPU22.PMI:Performance_monitoring_interrupts 5453 ± 3% +33.8% 7297 ± 5% interrupts.CPU23.CAL:Function_call_interrupts 1257399 +46.2% 1838017 interrupts.CPU23.LOC:Local_timer_interrupts 5133 ± 7% +43.9% 7386 ± 7% interrupts.CPU24.CAL:Function_call_interrupts 1257560 +46.2% 1838381 interrupts.CPU24.LOC:Local_timer_interrupts 4539 ± 33% +50.1% 6813 ± 18% interrupts.CPU24.RES:Rescheduling_interrupts 5308 ± 10% +35.9% 7214 ± 9% interrupts.CPU25.CAL:Function_call_interrupts 1258418 +46.1% 1838405 interrupts.CPU25.LOC:Local_timer_interrupts 5124 ± 7% +40.3% 7188 ± 6% interrupts.CPU26.CAL:Function_call_interrupts 1258415 +46.1% 1838409 interrupts.CPU26.LOC:Local_timer_interrupts 5248 ± 8% +43.1% 7512 ± 6% interrupts.CPU27.CAL:Function_call_interrupts 1258222 +46.1% 1838381 interrupts.CPU27.LOC:Local_timer_interrupts 5114 ± 8% +42.8% 7305 ± 5% interrupts.CPU28.CAL:Function_call_interrupts 1258628 +46.0% 1838215 interrupts.CPU28.LOC:Local_timer_interrupts 4114 ± 47% +64.9% 6786 ± 22% interrupts.CPU28.RES:Rescheduling_interrupts 4910 ± 7% +52.7% 7501 ± 5% interrupts.CPU29.CAL:Function_call_interrupts 1258603 +46.1% 1838647 interrupts.CPU29.LOC:Local_timer_interrupts 4737 ± 3% +53.9% 7289 ± 7% interrupts.CPU3.CAL:Function_call_interrupts 1258257 +46.1% 1838143 interrupts.CPU3.LOC:Local_timer_interrupts 792.50 ± 13% +36.3% 1080 ± 14% interrupts.CPU30.39:IR-PCI-MSI.524289-edge.eth0-TxRx-0 5271 ± 5% +40.0% 7381 ± 6% interrupts.CPU30.CAL:Function_call_interrupts 1258798 +46.1% 1838480 interrupts.CPU30.LOC:Local_timer_interrupts 5050 ± 37% +38.1% 6973 ± 25% interrupts.CPU30.RES:Rescheduling_interrupts 5266 ± 6% +33.7% 7041 ± 7% interrupts.CPU31.CAL:Function_call_interrupts 1258115 +46.1% 1838307 interrupts.CPU31.LOC:Local_timer_interrupts 366.50 ± 3% +4427.7% 16594 ±166% interrupts.CPU32.40:IR-PCI-MSI.524290-edge.eth0-TxRx-1 4706 ± 3% +50.6% 7088 ± 5% interrupts.CPU32.CAL:Function_call_interrupts 1258290 +46.0% 1837663 interrupts.CPU32.LOC:Local_timer_interrupts 3612 ± 57% +79.6% 6488 ± 20% interrupts.CPU32.RES:Rescheduling_interrupts 5301 ± 7% +31.2% 6957 ± 7% interrupts.CPU33.CAL:Function_call_interrupts 1258353 +46.1% 1838459 interrupts.CPU33.LOC:Local_timer_interrupts 5273 ± 5% +46.0% 7697 ± 5% interrupts.CPU34.CAL:Function_call_interrupts 1258565 +46.0% 1838076 interrupts.CPU34.LOC:Local_timer_interrupts 5048 ± 5% +49.0% 7520 ± 7% interrupts.CPU35.CAL:Function_call_interrupts 1258233 +46.1% 1838319 interrupts.CPU35.LOC:Local_timer_interrupts 5447 ± 3% +36.0% 7409 ± 6% interrupts.CPU36.CAL:Function_call_interrupts 1258484 +46.0% 1837980 interrupts.CPU36.LOC:Local_timer_interrupts 5440 ± 3% +29.5% 7047 ± 8% interrupts.CPU37.CAL:Function_call_interrupts 1258540 +46.1% 1838267 interrupts.CPU37.LOC:Local_timer_interrupts 5299 ± 5% +30.1% 6896 interrupts.CPU38.CAL:Function_call_interrupts 1258420 +46.1% 1837968 interrupts.CPU38.LOC:Local_timer_interrupts 5023 ± 9% +44.8% 7273 ± 10% interrupts.CPU39.CAL:Function_call_interrupts 1258243 +46.1% 1838310 interrupts.CPU39.LOC:Local_timer_interrupts 143058 ±163% -95.5% 6406 ± 16% interrupts.CPU39.RES:Rescheduling_interrupts 523.25 ± 26% +3155.0% 17032 ± 57% interrupts.CPU4.45:IR-PCI-MSI.524295-edge.eth0-TxRx-6 5110 ± 8% +43.8% 7346 ± 7% interrupts.CPU4.CAL:Function_call_interrupts 1258092 +46.1% 1838428 interrupts.CPU4.LOC:Local_timer_interrupts 5054 ± 7% +45.3% 7341 ± 6% interrupts.CPU5.CAL:Function_call_interrupts 1258423 +46.1% 1838142 interrupts.CPU5.LOC:Local_timer_interrupts 5153 ± 7% +47.1% 7580 ± 8% interrupts.CPU6.CAL:Function_call_interrupts 1258463 +46.1% 1838103 interrupts.CPU6.LOC:Local_timer_interrupts 4679 ± 44% +65.2% 7732 ± 21% interrupts.CPU6.RES:Rescheduling_interrupts 4876 ± 5% +47.2% 7178 ± 6% interrupts.CPU7.CAL:Function_call_interrupts 1258508 +46.1% 1838410 interrupts.CPU7.LOC:Local_timer_interrupts 5121 ± 5% +48.9% 7623 ± 8% interrupts.CPU8.CAL:Function_call_interrupts 1258614 +46.1% 1838880 interrupts.CPU8.LOC:Local_timer_interrupts 5307 ± 5% +30.4% 6922 ± 8% interrupts.CPU9.CAL:Function_call_interrupts 1258499 +46.1% 1838174 interrupts.CPU9.LOC:Local_timer_interrupts 50331699 +46.1% 73533674 interrupts.LOC:Local_timer_interrupts 768133 -62.9% 285162 ± 4% interrupts.RES:Rescheduling_interrupts 1532 ± 6% +45.9% 2234 ± 10% interrupts.TLB:TLB_shootdowns 141788 ± 6% +41.9% 201238 ± 4% softirqs.CPU0.RCU 89538 ± 7% +50.5% 134779 softirqs.CPU0.SCHED 237443 ± 6% +37.1% 325641 ± 11% softirqs.CPU0.TIMER 146251 ± 3% +41.1% 206410 ± 5% softirqs.CPU1.RCU 92026 ± 3% +45.0% 133455 ± 3% softirqs.CPU1.SCHED 224949 ± 10% +38.3% 310998 ± 8% softirqs.CPU1.TIMER 154233 +33.6% 206060 ± 3% softirqs.CPU10.RCU 90504 ± 2% +46.3% 132452 ± 2% softirqs.CPU10.SCHED 242657 ± 6% +33.8% 324585 ± 11% softirqs.CPU10.TIMER 148976 ± 4% +39.3% 207517 ± 4% softirqs.CPU11.RCU 90739 +48.1% 134427 softirqs.CPU11.SCHED 249720 ± 4% +26.7% 316341 ± 10% softirqs.CPU11.TIMER 93965 ± 3% +41.6% 133035 softirqs.CPU12.SCHED 248423 ± 6% +32.4% 328906 ± 11% softirqs.CPU12.TIMER 149906 ± 4% +40.2% 210201 ± 6% softirqs.CPU13.RCU 90989 +49.6% 136105 softirqs.CPU13.SCHED 251792 ± 4% +42.1% 357900 ± 19% softirqs.CPU13.TIMER 152226 ± 2% +35.9% 206915 ± 3% softirqs.CPU14.RCU 92046 +44.6% 133104 softirqs.CPU14.SCHED 244799 ± 7% +34.3% 328652 ± 11% softirqs.CPU14.TIMER 153485 ± 2% +37.2% 210539 ± 4% softirqs.CPU15.RCU 91285 +47.8% 134965 softirqs.CPU15.SCHED 252238 ± 4% +32.8% 335030 ± 12% softirqs.CPU15.TIMER 147988 ± 2% +40.2% 207451 ± 5% softirqs.CPU16.RCU 93079 ± 2% +43.5% 133600 softirqs.CPU16.SCHED 146479 ± 4% +42.1% 208082 ± 7% softirqs.CPU17.RCU 91037 +48.3% 134972 softirqs.CPU17.SCHED 254044 ± 4% +33.6% 339310 ± 12% softirqs.CPU17.TIMER 150731 ± 2% +35.3% 203892 ± 4% softirqs.CPU18.RCU 92163 +45.1% 133721 ± 2% softirqs.CPU18.SCHED 139984 ± 9% +48.0% 207167 ± 6% softirqs.CPU19.RCU 87051 ± 8% +55.4% 135288 softirqs.CPU19.SCHED 256404 ± 3% +31.0% 335908 ± 12% softirqs.CPU19.TIMER 153581 +33.5% 205065 ± 3% softirqs.CPU2.RCU 91389 ± 4% +44.5% 132091 ± 2% softirqs.CPU2.SCHED 252327 ± 16% +28.5% 324205 ± 11% softirqs.CPU2.TIMER 91204 ± 5% +44.1% 131392 ± 2% softirqs.CPU20.SCHED 233549 ± 5% +38.4% 323275 ± 11% softirqs.CPU20.TIMER 147747 ± 2% +42.2% 210110 ± 6% softirqs.CPU21.RCU 91321 ± 3% +45.1% 132530 ± 3% softirqs.CPU21.SCHED 261236 ± 13% +19.5% 312199 ± 9% softirqs.CPU21.TIMER 152947 +36.4% 208566 ± 4% softirqs.CPU22.RCU 90046 ± 4% +46.4% 131871 softirqs.CPU22.SCHED 217967 ± 9% +50.4% 327721 ± 11% softirqs.CPU22.TIMER 151811 ± 3% +39.3% 211522 ± 6% softirqs.CPU23.RCU 91204 +48.4% 135364 ± 3% softirqs.CPU23.SCHED 250031 ± 3% +19.2% 297969 ± 9% softirqs.CPU23.TIMER 158314 +33.2% 210939 ± 3% softirqs.CPU24.RCU 89110 ± 2% +48.1% 131999 ± 2% softirqs.CPU24.SCHED 228849 ± 3% +42.3% 325682 ± 11% softirqs.CPU24.TIMER 157157 +36.5% 214446 ± 5% softirqs.CPU25.RCU 90115 +47.5% 132882 ± 3% softirqs.CPU25.SCHED 246845 ± 4% +27.7% 315332 ± 10% softirqs.CPU25.TIMER 157705 +33.4% 210455 ± 3% softirqs.CPU26.RCU 89991 ± 2% +46.7% 132047 ± 2% softirqs.CPU26.SCHED 229330 ± 5% +42.3% 326286 ± 11% softirqs.CPU26.TIMER 154583 ± 2% +33.7% 206619 ± 2% softirqs.CPU27.RCU 90397 +47.6% 133442 ± 3% softirqs.CPU27.SCHED 247821 ± 4% +27.8% 316809 ± 10% softirqs.CPU27.TIMER 150252 ± 9% +39.8% 209980 ± 2% softirqs.CPU28.RCU 88703 ± 8% +48.2% 131470 softirqs.CPU28.SCHED 229069 ± 12% +43.5% 328754 ± 11% softirqs.CPU28.TIMER 155740 +37.8% 214536 ± 5% softirqs.CPU29.RCU 90612 +48.1% 134168 ± 3% softirqs.CPU29.SCHED 248694 ± 4% +41.4% 351652 ± 20% softirqs.CPU29.TIMER 149921 ± 3% +40.5% 210592 ± 4% softirqs.CPU3.RCU 91270 ± 2% +48.0% 135072 ± 3% softirqs.CPU3.SCHED 247492 ± 4% +40.2% 347080 ± 21% softirqs.CPU3.TIMER 153901 +35.8% 209011 ± 3% softirqs.CPU30.RCU 90334 ± 2% +46.3% 132136 ± 2% softirqs.CPU30.SCHED 243300 ± 6% +34.8% 327959 ± 11% softirqs.CPU30.TIMER 149985 ± 3% +41.2% 211733 ± 6% softirqs.CPU31.RCU 90682 +47.7% 133945 softirqs.CPU31.SCHED 249462 ± 4% +27.5% 318038 ± 9% softirqs.CPU31.TIMER 215.00 ± 4% +4426.2% 9731 ±167% softirqs.CPU32.NET_RX 130036 ± 4% +36.9% 177992 ± 3% softirqs.CPU32.RCU 87420 ± 9% +52.8% 133544 ± 3% softirqs.CPU32.SCHED 248459 ± 7% +34.4% 333827 ± 9% softirqs.CPU32.TIMER 131167 ± 2% +36.7% 179367 ± 5% softirqs.CPU33.RCU 90830 +49.0% 135292 softirqs.CPU33.SCHED 253786 ± 5% +22.5% 310907 ± 13% softirqs.CPU33.TIMER 134361 +31.8% 177135 softirqs.CPU34.RCU 92004 +43.8% 132280 softirqs.CPU34.SCHED 244369 ± 7% +33.7% 326841 ± 11% softirqs.CPU34.TIMER 137605 ± 2% +30.7% 179816 ± 3% softirqs.CPU35.RCU 91052 +47.2% 134057 softirqs.CPU35.SCHED 252092 ± 4% +32.2% 333240 ± 12% softirqs.CPU35.TIMER 137204 +31.4% 180221 ± 2% softirqs.CPU36.RCU 93058 ± 2% +42.6% 132667 softirqs.CPU36.SCHED 236948 ± 13% +39.1% 329695 ± 12% softirqs.CPU36.TIMER 138811 ± 2% +31.6% 182739 ± 4% softirqs.CPU37.RCU 90951 +46.7% 133448 ± 2% softirqs.CPU37.SCHED 253893 ± 4% +33.7% 339581 ± 13% softirqs.CPU37.TIMER 138263 +28.9% 178202 softirqs.CPU38.RCU 92003 +43.7% 132213 ± 2% softirqs.CPU38.SCHED 257946 ± 3% +28.0% 330201 ± 11% softirqs.CPU38.TIMER 93241 ± 3% +43.2% 133556 softirqs.CPU39.SCHED 254720 ± 4% +32.1% 336502 ± 13% softirqs.CPU39.TIMER 292.50 ± 24% +3105.5% 9376 ± 56% softirqs.CPU4.NET_RX 156349 +34.9% 210934 ± 3% softirqs.CPU4.RCU 89535 ± 2% +48.3% 132816 ± 2% softirqs.CPU4.SCHED 229314 ± 3% +43.5% 329036 ± 10% softirqs.CPU4.TIMER 155921 ± 2% +35.7% 211534 ± 4% softirqs.CPU5.RCU 90416 +47.4% 133232 ± 2% softirqs.CPU5.SCHED 247319 ± 4% +27.7% 315787 ± 10% softirqs.CPU5.TIMER 156332 +32.8% 207536 ± 3% softirqs.CPU6.RCU 90409 ± 2% +46.2% 132144 ± 2% softirqs.CPU6.SCHED 229623 ± 4% +41.8% 325539 ± 10% softirqs.CPU6.TIMER 154113 ± 2% +34.4% 207084 ± 2% softirqs.CPU7.RCU 90560 +47.7% 133733 ± 2% softirqs.CPU7.SCHED 248302 ± 4% +47.4% 365894 ± 16% softirqs.CPU7.TIMER 94614 ± 3% +39.0% 131538 softirqs.CPU8.SCHED 261763 ± 13% +24.2% 325131 ± 11% softirqs.CPU8.TIMER 154317 +34.8% 208035 ± 4% softirqs.CPU9.RCU 90493 +48.3% 134160 ± 2% softirqs.CPU9.SCHED 248684 ± 4% +22.7% 305256 ± 11% softirqs.CPU9.TIMER 6073358 +33.6% 8111475 ± 4% softirqs.RCU 3637411 +46.7% 5335018 ± 2% softirqs.SCHED 9847530 ± 3% +33.2% 13112728 ± 10% softirqs.TIMER 61.94 ± 2% -6.5 55.44 perf-profile.calltrace.cycles-pp.secondary_startup_64 6.08 ± 32% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_inodes.xfs_inactive_worker.process_one_work.worker_thread.kthread 6.08 ± 32% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_ici_walk_fns.xfs_inactive_inodes.xfs_inactive_worker.process_one_work.worker_thread 6.08 ± 32% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_ici_walk_ag.xfs_ici_walk_fns.xfs_inactive_inodes.xfs_inactive_worker.process_one_work 6.06 ± 32% -6.1 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_inode.xfs_ici_walk_ag.xfs_ici_walk_fns.xfs_inactive_inodes.xfs_inactive_worker 6.02 ± 33% -6.0 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inactive_inode.xfs_ici_walk_ag.xfs_ici_walk_fns.xfs_inactive_inodes 6.00 ± 33% -6.0 0.00 perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_ici_walk_ag.xfs_ici_walk_fns 60.89 ± 2% -5.5 55.40 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 60.89 ± 2% -5.5 55.40 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 60.84 ± 2% -5.5 55.37 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 55.86 ± 2% -4.3 51.52 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 55.48 ± 2% -4.2 51.25 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 7.39 ± 4% -2.8 4.58 ± 9% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 6.97 ± 4% -2.7 4.29 ± 10% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 3.90 ± 9% -1.6 2.30 ± 9% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 2.49 ± 6% -1.3 1.20 ± 8% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 2.60 ± 11% -1.1 1.51 ± 7% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 2.75 ± 4% -0.7 2.02 ± 13% perf-profile.calltrace.cycles-pp.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink 2.21 ± 12% -0.7 1.51 ± 19% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 2.39 ± 6% -0.6 1.79 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat.do_filp_open 1.41 ± 13% -0.5 0.87 ± 11% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt 1.59 ± 5% -0.5 1.07 ± 9% perf-profile.calltrace.cycles-pp.xfs_dir2_block_addname.xfs_dir_createname.xfs_create.xfs_generic_create.path_openat 0.97 ± 12% -0.5 0.47 ± 59% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt 1.77 ± 15% -0.5 1.28 ± 21% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state 7.51 ± 4% -0.5 7.04 ± 2% perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 1.13 ± 12% -0.5 0.68 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt 1.23 ± 4% -0.4 0.82 ± 8% perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_addname.xfs_dir_createname.xfs_create.xfs_generic_create 1.21 ± 4% -0.4 0.80 ± 8% perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_addname.xfs_dir_createname.xfs_create 4.24 ± 3% -0.4 3.87 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat 1.38 ± 2% -0.4 1.03 ± 16% perf-profile.calltrace.cycles-pp.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink 1.20 ± 8% -0.3 0.85 ± 10% perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink 1.18 ± 9% -0.3 0.84 ± 10% perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove 1.20 ± 2% -0.3 0.90 ± 17% perf-profile.calltrace.cycles-pp.__xfs_dir3_data_check.xfs_dir3_data_check.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename 1.21 ± 2% -0.3 0.92 ± 16% perf-profile.calltrace.cycles-pp.xfs_dir3_data_check.xfs_dir2_block_lookup_int.xfs_dir2_block_removename.xfs_dir_removename.xfs_remove 2.18 ± 6% -0.3 1.90 ± 3% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat.do_filp_open 2.09 ± 5% -0.3 1.81 ± 3% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_create.xfs_generic_create.path_openat 0.87 ± 2% -0.1 0.76 ± 2% perf-profile.calltrace.cycles-pp.__xstat64 0.77 ± 4% -0.1 0.67 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__xstat64 0.77 ± 4% -0.1 0.67 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64 0.67 ± 3% -0.1 0.58 ± 4% perf-profile.calltrace.cycles-pp.__do_sys_newstat.do_syscall_64.entry_SYSCALL_64_after_hwframe.__xstat64 0.59 ± 9% +0.3 0.88 ± 8% perf-profile.calltrace.cycles-pp.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate 0.26 ±100% +0.3 0.59 ± 9% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule_idle.do_idle.cpu_startup_entry.start_secondary 0.27 ±100% +0.3 0.60 ± 10% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.46 ± 58% +0.3 0.80 ± 5% perf-profile.calltrace.cycles-pp.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink 0.74 ± 8% +0.3 1.08 ± 9% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending 0.78 ± 8% +0.3 1.12 ± 10% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry 0.78 ± 8% +0.3 1.12 ± 10% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary 0.77 ± 8% +0.3 1.11 ± 10% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending.do_idle 0.40 ± 58% +0.3 0.75 ± 10% perf-profile.calltrace.cycles-pp.arch_stack_walk.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair 0.90 ± 8% +0.4 1.25 ± 10% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 0.42 ± 58% +0.4 0.78 ± 9% perf-profile.calltrace.cycles-pp.stack_trace_save_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.activate_task 1.92 ± 6% +0.4 2.36 ± 6% perf-profile.calltrace.cycles-pp.rwsem_spin_on_owner.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open 1.02 ± 7% +0.4 1.47 ± 6% perf-profile.calltrace.cycles-pp.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove.xfs_vn_unlink.vfs_unlink 0.12 ±173% +0.5 0.64 ± 4% perf-profile.calltrace.cycles-pp.xfs_dir2_leafn_lookup_for_entry.xfs_da3_node_lookup_int.xfs_dir2_node_removename.xfs_dir_removename.xfs_remove 0.95 ± 32% +0.6 1.57 ± 18% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt 1.08 ± 35% +0.6 1.72 ± 14% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode 0.59 ± 5% +0.7 1.27 ± 3% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag 0.99 ± 36% +0.7 1.67 ± 17% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree 12.23 ± 2% +0.7 12.95 ± 3% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 0.61 ± 6% +0.7 1.33 ± 3% perf-profile.calltrace.cycles-pp.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc 0.46 ±104% +0.8 1.21 ± 14% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt 1.01 ± 27% +0.8 1.81 ± 4% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open 1.32 ± 29% +0.8 2.15 ± 17% perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree 1.33 ± 35% +0.9 2.26 ± 16% perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree 0.00 +0.9 0.92 ± 2% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag 0.81 ± 5% +1.0 1.78 ± 3% perf-profile.calltrace.cycles-pp.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc 0.86 ± 6% +1.0 1.87 ± 2% perf-profile.calltrace.cycles-pp.xfs_btree_increment.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc 0.76 ± 8% +1.0 1.79 ± 6% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64 2.95 ± 12% +1.2 4.19 ± 5% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_open 3.28 ± 2% +1.2 4.52 ± 6% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.18 ± 12% +1.3 4.45 ± 4% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_open.do_syscall_64 3.54 +1.3 4.83 ± 5% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 10.09 ± 3% +1.4 11.45 perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_open.do_syscall_64 9.80 ± 3% +1.5 11.25 perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_open 0.55 ± 64% +1.5 2.01 ± 9% perf-profile.calltrace.cycles-pp.__xfs_btree_check_sblock.xfs_btree_check_sblock.xfs_btree_get_rec.xfs_inobt_get_rec.xfs_check_agi_freecount 1.32 ± 3% +1.6 2.92 perf-profile.calltrace.cycles-pp.xfs_inobt_get_rec.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc 4.81 ± 3% +2.4 7.18 perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open 4.76 ± 3% +2.4 7.16 perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat 3.62 ± 4% +2.4 6.03 perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create 4.14 ± 3% +2.5 6.65 perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create 3.67 ± 35% +2.5 6.19 ± 15% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree 15.05 ± 4% +2.6 17.61 ± 2% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 15.15 ± 4% +2.6 17.71 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 15.14 ± 4% +2.6 17.70 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 3.91 ± 34% +2.6 6.48 ± 15% perf-profile.calltrace.cycles-pp.xfs_difree_inobt.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive 14.85 ± 5% +2.6 17.43 ± 2% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 14.82 ± 5% +2.6 17.41 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 15.41 ± 4% +2.6 18.03 ± 2% perf-profile.calltrace.cycles-pp.creat 4.11 ± 34% +2.7 6.83 ± 16% perf-profile.calltrace.cycles-pp.xfs_difree.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode 2.67 ± 4% +2.8 5.46 perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc 4.75 ± 32% +3.0 7.71 ± 16% perf-profile.calltrace.cycles-pp.xfs_ifree.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_ici_walk_ag 6.08 ± 32% +3.7 9.80 ± 16% perf-profile.calltrace.cycles-pp.xfs_inactive_worker.process_one_work.worker_thread.kthread.ret_from_fork 6.85 ± 29% +3.8 10.61 ± 15% perf-profile.calltrace.cycles-pp.ret_from_fork 6.85 ± 29% +3.8 10.61 ± 15% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork 6.58 ± 29% +3.8 10.34 ± 15% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork 6.56 ± 29% +3.8 10.32 ± 15% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork 0.00 +9.7 9.67 ± 16% perf-profile.calltrace.cycles-pp.xfs_inactive_ifree.xfs_inactive.xfs_inactive_inode.xfs_ici_walk_ag.xfs_inactive_worker 0.00 +9.7 9.70 ± 16% perf-profile.calltrace.cycles-pp.xfs_inactive.xfs_inactive_inode.xfs_ici_walk_ag.xfs_inactive_worker.process_one_work 0.00 +9.8 9.77 ± 16% perf-profile.calltrace.cycles-pp.xfs_inactive_inode.xfs_ici_walk_ag.xfs_inactive_worker.process_one_work.worker_thread 0.00 +9.8 9.80 ± 16% perf-profile.calltrace.cycles-pp.xfs_ici_walk_ag.xfs_inactive_worker.process_one_work.worker_thread.kthread 61.96 ± 2% -6.5 55.45 perf-profile.children.cycles-pp.do_idle 61.94 ± 2% -6.5 55.44 perf-profile.children.cycles-pp.secondary_startup_64 61.94 ± 2% -6.5 55.44 perf-profile.children.cycles-pp.cpu_startup_entry 6.08 ± 32% -6.1 0.00 perf-profile.children.cycles-pp.xfs_inactive_inodes 6.08 ± 32% -6.1 0.00 perf-profile.children.cycles-pp.xfs_ici_walk_fns 60.89 ± 2% -5.5 55.40 perf-profile.children.cycles-pp.start_secondary 56.85 ± 2% -5.3 51.56 ± 2% perf-profile.children.cycles-pp.cpuidle_enter 56.81 ± 2% -5.3 51.55 ± 2% perf-profile.children.cycles-pp.cpuidle_enter_state 8.15 ± 4% -2.7 5.42 ± 11% perf-profile.children.cycles-pp.apic_timer_interrupt 7.68 ± 4% -2.6 5.07 ± 11% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 4.43 ± 8% -1.5 2.89 ± 10% perf-profile.children.cycles-pp.hrtimer_interrupt 2.56 ± 4% -1.3 1.22 ± 7% perf-profile.children.cycles-pp.menu_select 3.00 ± 9% -1.0 1.97 ± 9% perf-profile.children.cycles-pp.__hrtimer_run_queues 4.76 ± 3% -0.8 3.97 ± 4% perf-profile.children.cycles-pp.__xfs_dir3_data_check 4.77 ± 3% -0.8 3.99 ± 4% perf-profile.children.cycles-pp.xfs_dir3_data_check 2.75 ± 4% -0.7 2.02 ± 13% perf-profile.children.cycles-pp.xfs_dir2_block_removename 2.35 ± 12% -0.7 1.68 ± 19% perf-profile.children.cycles-pp.irq_exit 2.39 ± 6% -0.6 1.79 ± 4% perf-profile.children.cycles-pp.xfs_dir_createname 0.88 ± 5% -0.6 0.29 ± 17% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 1.59 ± 5% -0.5 1.07 ± 9% perf-profile.children.cycles-pp.xfs_dir2_block_addname 7.51 ± 4% -0.5 7.05 ± 2% perf-profile.children.cycles-pp.vfs_unlink 1.65 ± 11% -0.5 1.19 ± 15% perf-profile.children.cycles-pp.tick_sched_timer 0.66 ± 8% -0.5 0.21 ± 21% perf-profile.children.cycles-pp.tick_nohz_next_event 1.89 ± 16% -0.4 1.46 ± 20% perf-profile.children.cycles-pp.__softirqentry_text_start 1.35 ± 10% -0.4 0.97 ± 18% perf-profile.children.cycles-pp.tick_sched_handle 4.24 ± 3% -0.4 3.87 ± 4% perf-profile.children.cycles-pp.xfs_dir_removename 1.58 ± 3% -0.4 1.23 ± 22% perf-profile.children.cycles-pp.xfs_dir2_block_lookup_int 0.67 ± 8% -0.3 0.35 ± 9% perf-profile.children.cycles-pp.irq_enter 1.20 ± 9% -0.3 0.89 ± 19% perf-profile.children.cycles-pp.update_process_times 0.36 ± 11% -0.3 0.06 ± 65% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.40 ± 7% -0.3 0.14 ± 6% perf-profile.children.cycles-pp.xfs_dialloc_ag_update_inobt 0.48 ± 8% -0.2 0.24 ± 13% perf-profile.children.cycles-pp.tick_irq_enter 0.24 ± 2% -0.2 0.03 ±102% perf-profile.children.cycles-pp.__next_timer_interrupt 0.48 ± 11% -0.2 0.29 ± 3% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.37 ± 12% -0.2 0.19 ± 24% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 0.54 ± 19% -0.2 0.37 ± 22% perf-profile.children.cycles-pp.run_rebalance_domains 0.30 ± 11% -0.2 0.14 ± 5% perf-profile.children.cycles-pp.native_irq_return_iret 0.24 ± 8% -0.2 0.08 ± 16% perf-profile.children.cycles-pp.__slab_alloc 0.38 ± 7% -0.1 0.23 ± 12% perf-profile.children.cycles-pp.read_tsc 0.32 ± 7% -0.1 0.17 ± 22% perf-profile.children.cycles-pp.__remove_hrtimer 0.40 ± 10% -0.1 0.26 ± 21% perf-profile.children.cycles-pp.native_write_msr 0.22 ± 3% -0.1 0.08 ± 14% perf-profile.children.cycles-pp.___slab_alloc 0.41 ± 11% -0.1 0.27 ± 19% perf-profile.children.cycles-pp.kmem_zone_alloc 0.21 ± 17% -0.1 0.07 ± 19% perf-profile.children.cycles-pp.__hrtimer_next_event_base 0.62 ± 13% -0.1 0.49 ± 8% perf-profile.children.cycles-pp.console_unlock 0.26 ± 7% -0.1 0.13 ± 27% perf-profile.children.cycles-pp.timerqueue_del 0.31 ± 4% -0.1 0.18 ± 33% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.49 ± 11% -0.1 0.36 ± 11% perf-profile.children.cycles-pp.kmem_cache_alloc 0.32 ± 20% -0.1 0.20 ± 13% perf-profile.children.cycles-pp.exit_to_usermode_loop 0.88 ± 3% -0.1 0.76 ± 2% perf-profile.children.cycles-pp.__xstat64 0.50 ± 2% -0.1 0.38 ± 11% perf-profile.children.cycles-pp.close 0.33 ± 16% -0.1 0.22 ± 18% perf-profile.children.cycles-pp.lapic_next_deadline 0.32 ± 6% -0.1 0.21 ± 19% perf-profile.children.cycles-pp.__lock_text_start 0.18 ± 7% -0.1 0.07 ± 12% perf-profile.children.cycles-pp.find_next_bit 0.71 ± 7% -0.1 0.60 ± 11% perf-profile.children.cycles-pp.xfs_da_read_buf 0.82 ± 3% -0.1 0.72 ± 3% perf-profile.children.cycles-pp.xfs_dir_ino_validate 0.32 ± 18% -0.1 0.22 ± 17% perf-profile.children.cycles-pp.xfs_dir3_block_read 0.23 ± 2% -0.1 0.14 ± 19% perf-profile.children.cycles-pp.enqueue_hrtimer 0.65 ± 5% -0.1 0.56 ± 9% perf-profile.children.cycles-pp.link_path_walk 0.34 ± 15% -0.1 0.25 ± 7% perf-profile.children.cycles-pp.destroy_inode 0.19 ± 13% -0.1 0.10 ± 9% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.59 -0.1 0.49 ± 5% perf-profile.children.cycles-pp.xfs_verify_ino 0.67 ± 3% -0.1 0.58 ± 4% perf-profile.children.cycles-pp.__do_sys_newstat 0.30 ± 7% -0.1 0.22 ± 19% perf-profile.children.cycles-pp.xfs_dabuf_map 0.11 ± 20% -0.1 0.03 ±100% perf-profile.children.cycles-pp.pm_qos_request 0.28 ± 8% -0.1 0.20 ± 7% perf-profile.children.cycles-pp.__kmalloc 0.25 ± 4% -0.1 0.17 ± 11% perf-profile.children.cycles-pp.run_timer_softirq 0.14 ± 16% -0.1 0.06 ± 63% perf-profile.children.cycles-pp.__hrtimer_get_next_event 0.19 ± 9% -0.1 0.11 ± 20% perf-profile.children.cycles-pp.timerqueue_add 0.23 ± 16% -0.1 0.15 ± 12% perf-profile.children.cycles-pp.delay_tsc 0.17 ± 4% -0.1 0.10 ± 18% perf-profile.children.cycles-pp.xfs_inode_alloc 0.10 ± 11% -0.1 0.03 ±100% perf-profile.children.cycles-pp.xfs_btree_del_cursor 0.19 ± 14% -0.1 0.12 ± 12% perf-profile.children.cycles-pp.kmem_alloc_large 0.17 ± 14% -0.1 0.10 ± 15% perf-profile.children.cycles-pp.note_gp_changes 0.30 ± 7% -0.1 0.23 ± 6% perf-profile.children.cycles-pp.kmem_alloc 0.28 ± 9% -0.1 0.21 ± 5% perf-profile.children.cycles-pp.sched_clock_cpu 0.10 ± 4% -0.1 0.03 ±102% perf-profile.children.cycles-pp.get_cpu_device 0.18 ± 20% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.22 ± 11% -0.1 0.16 ± 17% perf-profile.children.cycles-pp.xfs_bmapi_read 0.18 ± 17% -0.1 0.12 ± 12% perf-profile.children.cycles-pp.xfs_default_hashname 0.15 ± 13% -0.1 0.10 ± 22% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.24 ± 14% -0.1 0.18 ± 7% perf-profile.children.cycles-pp.sched_clock 0.23 ± 12% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.native_sched_clock 0.11 ± 25% -0.1 0.05 ± 8% perf-profile.children.cycles-pp.rb_next 0.10 ± 14% -0.1 0.05 perf-profile.children.cycles-pp.__x64_sys_close 0.08 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.xfs_trans_brelse 0.35 ± 9% -0.1 0.30 ± 2% perf-profile.children.cycles-pp.xfs_dir3_data_get_ftype 0.09 ± 8% -0.0 0.04 ± 63% perf-profile.children.cycles-pp.perf_event_task_tick 0.10 ± 14% -0.0 0.05 ± 59% perf-profile.children.cycles-pp.tick_nohz_tick_stopped 0.14 ± 13% -0.0 0.09 ± 20% perf-profile.children.cycles-pp.__destroy_inode 0.14 ± 25% -0.0 0.09 ± 23% perf-profile.children.cycles-pp.rcu_eqs_enter 0.11 ± 24% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.account_process_tick 0.12 ± 4% -0.0 0.08 ± 15% perf-profile.children.cycles-pp.rb_erase 0.09 ± 17% -0.0 0.04 ± 59% perf-profile.children.cycles-pp.pm_qos_read_value 0.10 ± 15% -0.0 0.06 ± 20% perf-profile.children.cycles-pp.rcu_irq_enter 0.07 ± 7% -0.0 0.03 ±100% perf-profile.children.cycles-pp._xfs_buf_ioapply 0.08 ± 5% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.xfs_buf_item_put 0.11 ± 10% -0.0 0.07 ± 26% perf-profile.children.cycles-pp.d_instantiate 0.10 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.brd_make_request 0.11 ± 7% -0.0 0.09 ± 12% perf-profile.children.cycles-pp.nr_iowait_cpu 0.10 ± 8% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.dput 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.brd_do_bvec 0.07 ± 12% +0.0 0.10 ± 11% perf-profile.children.cycles-pp.___perf_sw_event 0.20 ± 9% +0.0 0.24 ± 6% perf-profile.children.cycles-pp.xfs_inobt_update 0.11 ± 17% +0.0 0.15 ± 12% perf-profile.children.cycles-pp.xfs_btree_check_block 0.03 ±100% +0.0 0.07 ± 12% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.11 ± 17% +0.0 0.16 ± 11% perf-profile.children.cycles-pp.xfs_log_done 0.11 ± 10% +0.1 0.16 ± 15% perf-profile.children.cycles-pp.xfs_iextents_copy 0.07 ± 14% +0.1 0.13 ± 12% perf-profile.children.cycles-pp.xfs_btree_ptr_to_daddr 0.00 +0.1 0.06 ± 15% perf-profile.children.cycles-pp.check_preempt_curr 0.03 ±100% +0.1 0.09 ± 26% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.07 ± 17% +0.1 0.14 ± 35% perf-profile.children.cycles-pp.xfs_iunlink_map_prev 0.03 ±100% +0.1 0.09 ± 44% perf-profile.children.cycles-pp.xfs_iunlink_map_ino 0.15 ± 19% +0.1 0.21 ± 12% perf-profile.children.cycles-pp.xfs_dir3_leaf_check_int 0.14 ± 22% +0.1 0.21 ± 22% perf-profile.children.cycles-pp.select_task_rq_fair 0.08 ± 60% +0.1 0.15 ± 14% perf-profile.children.cycles-pp.stack_trace_consume_entry_nosched 0.11 ± 30% +0.1 0.19 ± 20% perf-profile.children.cycles-pp.kernel_text_address 0.27 ± 7% +0.1 0.35 ± 10% perf-profile.children.cycles-pp.dequeue_task_fair 0.08 ± 27% +0.1 0.16 ± 16% perf-profile.children.cycles-pp.xfs_inobt_rec_freecount 0.04 ±100% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.__module_text_address 0.04 ±100% +0.1 0.13 ± 23% perf-profile.children.cycles-pp.is_module_text_address 0.40 ± 11% +0.1 0.49 ± 7% perf-profile.children.cycles-pp.wake_up_q 0.13 ± 23% +0.1 0.22 ± 19% perf-profile.children.cycles-pp.unwind_get_return_address 0.04 ±100% +0.1 0.13 ± 17% perf-profile.children.cycles-pp.xfs_inobt_key_diff 0.23 ± 6% +0.1 0.32 ± 18% perf-profile.children.cycles-pp.xfs_imap_to_bp 0.11 ± 33% +0.1 0.21 ± 20% perf-profile.children.cycles-pp.__kernel_text_address 0.23 ± 7% +0.1 0.33 ± 11% perf-profile.children.cycles-pp.__orc_find 0.20 ± 9% +0.1 0.30 ± 10% perf-profile.children.cycles-pp.xfs_btree_rec_offset 0.07 ± 14% +0.1 0.18 ± 17% perf-profile.children.cycles-pp.xfs_btree_readahead 0.33 ± 12% +0.1 0.43 ± 12% perf-profile.children.cycles-pp.pick_next_task_fair 0.29 ± 12% +0.1 0.39 ± 6% perf-profile.children.cycles-pp.orc_find 0.49 ± 10% +0.1 0.60 ± 10% perf-profile.children.cycles-pp.schedule_idle 0.38 ± 7% +0.1 0.50 ± 5% perf-profile.children.cycles-pp.xfs_ialloc_read_agi 0.16 ± 19% +0.1 0.29 ± 7% perf-profile.children.cycles-pp.xfs_btree_get_block 0.18 ± 25% +0.1 0.32 ± 23% perf-profile.children.cycles-pp.xfs_difree_finobt 0.65 ± 21% +0.2 0.84 ± 8% perf-profile.children.cycles-pp.xfs_buf_unlock 0.74 ± 20% +0.2 0.94 ± 7% perf-profile.children.cycles-pp.xfs_buf_item_release 0.63 ± 7% +0.2 0.84 ± 4% perf-profile.children.cycles-pp.unwind_next_frame 0.44 ± 13% +0.2 0.65 ± 3% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry 0.55 ± 23% +0.2 0.77 ± 9% perf-profile.children.cycles-pp.up 0.28 ± 31% +0.2 0.51 ± 7% perf-profile.children.cycles-pp.xfs_inobt_btrec_to_irec 0.79 ± 11% +0.3 1.04 ± 7% perf-profile.children.cycles-pp.xfs_da3_node_lookup_int 1.25 ± 12% +0.3 1.54 ± 10% perf-profile.children.cycles-pp.__sched_text_start 0.97 ± 16% +0.3 1.27 ± 6% perf-profile.children.cycles-pp.try_to_wake_up 0.93 ± 7% +0.4 1.29 ± 9% perf-profile.children.cycles-pp.sched_ttwu_pending 0.92 ± 11% +0.4 1.29 ± 6% perf-profile.children.cycles-pp.arch_stack_walk 0.96 ± 11% +0.4 1.36 ± 6% perf-profile.children.cycles-pp.stack_trace_save_tsk 1.07 ± 10% +0.4 1.51 ± 5% perf-profile.children.cycles-pp.__account_scheduler_latency 1.02 ± 7% +0.4 1.47 ± 6% perf-profile.children.cycles-pp.xfs_dir2_node_removename 1.36 ± 9% +0.5 1.86 ± 7% perf-profile.children.cycles-pp.enqueue_entity 1.41 ± 10% +0.5 1.92 ± 7% perf-profile.children.cycles-pp.enqueue_task_fair 1.43 ± 10% +0.5 1.94 ± 7% perf-profile.children.cycles-pp.ttwu_do_activate 1.43 ± 10% +0.5 1.94 ± 7% perf-profile.children.cycles-pp.activate_task 0.62 ± 41% +0.6 1.17 ± 9% perf-profile.children.cycles-pp.xfs_verify_agino 0.80 ± 15% +0.6 1.36 ± 10% perf-profile.children.cycles-pp.xfs_errortag_test 4.44 ± 3% +0.7 5.09 ± 6% perf-profile.children.cycles-pp.rwsem_spin_on_owner 12.23 ± 2% +0.7 12.95 ± 3% perf-profile.children.cycles-pp.do_unlinkat 1.14 ± 18% +0.9 2.05 ± 12% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs 10.09 ± 3% +1.4 11.45 perf-profile.children.cycles-pp.xfs_generic_create 9.80 ± 3% +1.4 11.25 perf-profile.children.cycles-pp.xfs_create 2.21 ± 16% +1.8 4.05 ± 9% perf-profile.children.cycles-pp.xfs_btree_get_rec 1.79 ± 16% +1.9 3.65 ± 5% perf-profile.children.cycles-pp.osq_lock 2.27 ± 20% +2.0 4.24 ± 8% perf-profile.children.cycles-pp.xfs_btree_increment 2.40 ± 19% +2.0 4.43 ± 8% perf-profile.children.cycles-pp.__xfs_btree_check_sblock 4.81 ± 3% +2.4 7.18 perf-profile.children.cycles-pp.xfs_dir_ialloc 4.76 ± 3% +2.4 7.16 perf-profile.children.cycles-pp.xfs_ialloc 3.62 ± 3% +2.4 6.03 perf-profile.children.cycles-pp.xfs_dialloc_ag 4.14 ± 3% +2.5 6.65 perf-profile.children.cycles-pp.xfs_dialloc 6.28 ± 6% +2.5 8.79 ± 5% perf-profile.children.cycles-pp.rwsem_optimistic_spin 15.09 ± 4% +2.6 17.64 ± 2% perf-profile.children.cycles-pp.do_sys_open 6.72 ± 6% +2.6 9.28 ± 4% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 3.91 ± 34% +2.6 6.48 ± 15% perf-profile.children.cycles-pp.xfs_difree_inobt 14.88 ± 5% +2.6 17.45 perf-profile.children.cycles-pp.do_filp_open 14.85 ± 5% +2.6 17.43 perf-profile.children.cycles-pp.path_openat 15.43 ± 4% +2.6 18.05 ± 2% perf-profile.children.cycles-pp.creat 4.11 ± 34% +2.7 6.83 ± 16% perf-profile.children.cycles-pp.xfs_difree 3.28 ± 19% +2.8 6.09 ± 9% perf-profile.children.cycles-pp.xfs_btree_check_sblock 29.22 ± 3% +2.9 32.14 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 29.19 ± 3% +2.9 32.12 ± 2% perf-profile.children.cycles-pp.do_syscall_64 4.75 ± 32% +3.0 7.71 ± 16% perf-profile.children.cycles-pp.xfs_ifree 3.55 ± 22% +3.0 6.56 ± 8% perf-profile.children.cycles-pp.xfs_inobt_get_rec 6.00 ± 33% +3.7 9.67 ± 16% perf-profile.children.cycles-pp.xfs_inactive_ifree 6.02 ± 33% +3.7 9.70 ± 16% perf-profile.children.cycles-pp.xfs_inactive 6.06 ± 32% +3.7 9.77 ± 16% perf-profile.children.cycles-pp.xfs_inactive_inode 6.08 ± 32% +3.7 9.80 ± 16% perf-profile.children.cycles-pp.xfs_inactive_worker 6.08 ± 32% +3.7 9.80 ± 16% perf-profile.children.cycles-pp.xfs_ici_walk_ag 6.86 ± 29% +3.8 10.61 ± 15% perf-profile.children.cycles-pp.ret_from_fork 6.85 ± 29% +3.8 10.61 ± 15% perf-profile.children.cycles-pp.kthread 6.58 ± 29% +3.8 10.34 ± 15% perf-profile.children.cycles-pp.worker_thread 6.56 ± 29% +3.8 10.32 ± 15% perf-profile.children.cycles-pp.process_one_work 6.42 ± 20% +5.4 11.80 ± 8% perf-profile.children.cycles-pp.xfs_check_agi_freecount 1.24 ± 4% -0.6 0.69 ± 8% perf-profile.self.cycles-pp.menu_select 2.15 ± 4% -0.4 1.70 ± 6% perf-profile.self.cycles-pp.__xfs_dir3_data_check 0.71 ± 8% -0.3 0.43 ± 17% perf-profile.self.cycles-pp.cpuidle_enter_state 0.30 ± 11% -0.2 0.14 ± 5% perf-profile.self.cycles-pp.native_irq_return_iret 0.36 ± 6% -0.1 0.21 ± 15% perf-profile.self.cycles-pp.read_tsc 0.40 ± 9% -0.1 0.26 ± 21% perf-profile.self.cycles-pp.native_write_msr 0.19 ± 15% -0.1 0.07 ± 17% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.16 ± 9% -0.1 0.06 ± 20% perf-profile.self.cycles-pp.find_next_bit 0.22 ± 14% -0.1 0.12 ± 13% perf-profile.self.cycles-pp.__hrtimer_run_queues 0.20 ± 21% -0.1 0.10 ± 25% perf-profile.self.cycles-pp.hrtimer_interrupt 0.12 ± 20% -0.1 0.03 ±100% perf-profile.self.cycles-pp.clockevents_program_event 0.29 ± 13% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.do_idle 0.11 ± 20% -0.1 0.03 ±100% perf-profile.self.cycles-pp.pm_qos_request 0.15 ± 17% -0.1 0.08 ± 16% perf-profile.self.cycles-pp.tick_nohz_next_event 0.36 ± 17% -0.1 0.29 ± 18% perf-profile.self.cycles-pp.io_serial_in 0.14 ± 15% -0.1 0.07 ± 61% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.10 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.irq_exit 0.10 ± 5% -0.1 0.03 ±102% perf-profile.self.cycles-pp.get_cpu_device 0.25 ± 10% -0.1 0.19 ± 8% perf-profile.self.cycles-pp.xfs_verify_ino 0.49 ± 5% -0.1 0.43 ± 5% perf-profile.self.cycles-pp.xfs_log_commit_cil 0.16 ± 15% -0.1 0.10 ± 12% perf-profile.self.cycles-pp.xfs_default_hashname 0.22 ± 15% -0.1 0.16 ± 13% perf-profile.self.cycles-pp.native_sched_clock 0.19 ± 7% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.run_timer_softirq 0.33 ± 8% -0.1 0.28 ± 2% perf-profile.self.cycles-pp.xfs_dir3_data_get_ftype 0.09 ± 8% -0.0 0.04 ± 63% perf-profile.self.cycles-pp.perf_event_task_tick 0.12 ± 4% -0.0 0.08 ± 19% perf-profile.self.cycles-pp.rb_erase 0.11 ± 24% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.account_process_tick 0.20 ± 9% -0.0 0.15 ± 12% perf-profile.self.cycles-pp.delay_tsc 0.13 ± 23% -0.0 0.09 ± 23% perf-profile.self.cycles-pp.rcu_eqs_enter 0.12 ± 12% -0.0 0.08 ± 13% perf-profile.self.cycles-pp.timerqueue_add 0.08 ± 5% -0.0 0.05 ± 61% perf-profile.self.cycles-pp.native_apic_mem_write 0.10 ± 7% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.07 ± 10% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.tick_nohz_tick_stopped 0.09 ± 23% -0.0 0.06 ± 17% perf-profile.self.cycles-pp.rcu_core 0.07 ± 7% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.xfs_buf_item_put 0.11 ± 4% -0.0 0.09 ± 12% perf-profile.self.cycles-pp.nr_iowait_cpu 0.08 ± 19% +0.0 0.11 ± 17% perf-profile.self.cycles-pp.select_task_rq_fair 0.13 ± 12% +0.0 0.17 ± 5% perf-profile.self.cycles-pp.update_load_avg 0.04 ± 59% +0.0 0.09 ± 15% perf-profile.self.cycles-pp.xfs_btree_check_block 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.xfs_btree_ptr_to_daddr 0.14 ± 18% +0.1 0.20 ± 10% perf-profile.self.cycles-pp.xfs_dir3_leaf_check_int 0.03 ±105% +0.1 0.11 ± 20% perf-profile.self.cycles-pp.xfs_inobt_key_diff 0.05 ± 62% +0.1 0.14 ± 19% perf-profile.self.cycles-pp.xfs_inobt_rec_freecount 0.14 ± 8% +0.1 0.22 ± 8% perf-profile.self.cycles-pp.xfs_btree_get_block 0.07 ± 20% +0.1 0.16 ± 18% perf-profile.self.cycles-pp.xfs_btree_readahead 0.23 ± 7% +0.1 0.33 ± 10% perf-profile.self.cycles-pp.__orc_find 0.15 ± 19% +0.1 0.25 ± 7% perf-profile.self.cycles-pp.xfs_check_agi_freecount 0.19 ± 8% +0.1 0.29 ± 13% perf-profile.self.cycles-pp.xfs_btree_rec_offset 0.15 ± 28% +0.1 0.27 ± 13% perf-profile.self.cycles-pp.xfs_ag_block_count 0.26 ± 29% +0.2 0.46 ± 6% perf-profile.self.cycles-pp.xfs_inobt_btrec_to_irec 0.21 ± 29% +0.2 0.42 ± 8% perf-profile.self.cycles-pp.xfs_verify_agino 0.50 ± 17% +0.2 0.74 ± 7% perf-profile.self.cycles-pp.xfs_agino_range 0.26 ± 18% +0.3 0.55 ± 13% perf-profile.self.cycles-pp.xfs_btree_check_sblock 0.34 ± 32% +0.3 0.67 ± 9% perf-profile.self.cycles-pp.xfs_btree_get_rec 0.40 ± 17% +0.3 0.74 ± 11% perf-profile.self.cycles-pp.xfs_inobt_get_rec 0.42 ± 13% +0.4 0.80 ± 9% perf-profile.self.cycles-pp.xfs_btree_increment 0.73 ± 19% +0.5 1.25 ± 11% perf-profile.self.cycles-pp.xfs_errortag_test 4.36 ± 3% +0.6 4.97 ± 5% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.95 ± 14% +0.8 1.77 ± 13% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs 1.20 ± 22% +1.0 2.20 ± 7% perf-profile.self.cycles-pp.__xfs_btree_check_sblock 1.75 ± 16% +1.8 3.59 ± 5% perf-profile.self.cycles-pp.osq_lock aim7.jobs-per-min 32000 +-+-----------------------------------------------------------------+ |.+. +.+.+. .++.+.+.++.+.+.+.++.+. .+. .+. .+. +.+ | 30000 +-+ + + + ++ + ++.+.+.+ : | | : .+.++.+.| 28000 +-+ + | | | 26000 +-+ | | | 24000 +-+ | | | 22000 +-+ | | | 20000 +-+ O OO O O O O | O O OO O O OO O O | 18000 +-+-----------------------------------------------------------------+ aim7.time.system_time 6000 +-+------------------------------------------------------------------+ O | 5500 +-O OO O O O O OO O O OO O | | O O | | | 5000 +-+ | | | 4500 +-+ | | | 4000 +-+ | | | | +. | 3500 +-+.++.+.+.+.+.++.+.+.+.++.+.+.+.+.++.+.+.+.++.+.+.+.++.+.+.+.+.+ +.| | | 3000 +-+------------------------------------------------------------------+ aim7.time.elapsed_time 950 +-+-------------------------------------------------------------------+ O O O OO O O O O OO O O O O OO | 900 +-+ | 850 +-+ | | | 800 +-+ | | | 750 +-+ | | | 700 +-+ | 650 +-+ | | +.++.+.+.| 600 +-+ .+. .+. .+.+ .+. .+.+.++. + | |.+.+.++.+ +.+.++.+.+.+.+.++.+.+ + + + +.+.+ | 550 +-+-------------------------------------------------------------------+ aim7.time.elapsed_time.max 950 +-+-------------------------------------------------------------------+ O O O OO O O O O OO O O O O OO | 900 +-+ | 850 +-+ | | | 800 +-+ | | | 750 +-+ | | | 700 +-+ | 650 +-+ | | +.++.+.+.| 600 +-+ .+. .+. .+.+ .+. .+.+.++. + | |.+.+.++.+ +.+.++.+.+.+.+.++.+.+ + + + +.+.+ | 550 +-+-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0

[refcount] 26d2e0d5df: WARNING:at_lib/refcount.c:#refcount_warn_saturate

by kernel test robot

FYI, we noticed the following commit (built with gcc-7): commit: 26d2e0d5df5b9aab517d8327743e66fcb38e8136 ("refcount: Consolidate implementations of refcount_t") https://kernel.googlesource.com/pub/scm/linux/kernel/git/will/linux.git refcount/full in testcase: ocfs2test with following parameters: disk: 1SSD test: test-mkfs on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): +-----------------------------------------------------------------------------+------------+------------+ | | 90c6af41d2 | 26d2e0d5df | +-----------------------------------------------------------------------------+------------+------------+ | boot_successes | 0 | 0 | | boot_failures | 24 | 24 | | BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/rwsem.c | 24 | 24 | | kernel_BUG_at_mm/slub.c | 2 | | | invalid_opcode:#[##] | 2 | | | RIP:kfree | 2 | | | RIP:native_safe_halt | 2 | | | Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 2 | | | WARNING:at_lib/refcount.c:#refcount_warn_saturate | 0 | 9 | | RIP:refcount_warn_saturate | 0 | 9 | | BUG:unable_to_handle_page_fault_for_address | 0 | 1 | | Oops:#[##] | 0 | 1 | | RIP:__kmalloc | 0 | 1 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 2 | | general_protection_fault:#[##] | 0 | 1 | | RIP:kmem_cache_alloc_trace | 0 | 1 | +-----------------------------------------------------------------------------+------------+------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> [ 72.121725] BUG: sleeping function called from invalid context at kernel/locking/rwsem.c:1499 [ 72.126078] in_atomic(): 1, irqs_disabled(): 0, pid: 2466, name: mount.ocfs2 [ 72.128523] CPU: 1 PID: 2466 Comm: mount.ocfs2 Not tainted 5.3.0-rc3-00008-g26d2e0d5df5b9 #1 [ 72.130522] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 72.132522] Call Trace: [ 72.134024] dump_stack+0x5c/0x7b [ 72.135106] ___might_sleep+0xf1/0x110 [ 72.136280] down_write+0x1c/0x50 [ 72.137349] configfs_depend_item+0x3a/0xb0 [ 72.138597] o2hb_region_pin+0xf9/0x180 [ocfs2_nodemanager] [ 72.140103] ? inode_init_always+0x120/0x1d0 [ 72.141368] o2hb_register_callback+0xc6/0x2a0 [ocfs2_nodemanager] [ 72.143016] dlm_join_domain+0xbd/0x7a0 [ocfs2_dlm] [ 72.144441] ? dlm_alloc_ctxt+0x50a/0x580 [ocfs2_dlm] [ 72.145880] dlm_register_domain+0x31f/0x440 [ocfs2_dlm] [ 72.147395] ? enqueue_entity+0x109/0x6c0 [ 72.148658] ? _cond_resched+0x19/0x30 [ 72.149870] o2cb_cluster_connect+0x132/0x2c0 [ocfs2_stack_o2cb] [ 72.151524] ocfs2_cluster_connect+0x14b/0x220 [ocfs2_stackglue] [ 72.153237] ocfs2_dlm_init+0x2f1/0x4b0 [ocfs2] [ 72.154647] ? ocfs2_init_node_maps+0x50/0x50 [ocfs2] [ 72.156167] ocfs2_fill_super+0xcfc/0x12b0 [ocfs2] [ 72.157640] ? ocfs2_initialize_super+0x1030/0x1030 [ocfs2] [ 72.159395] mount_bdev+0x173/0x1b0 [ 72.160627] legacy_get_tree+0x27/0x40 [ 72.161900] vfs_get_tree+0x25/0xf0 [ 72.163138] do_mount+0x691/0x9c0 [ 72.164343] ksys_mount+0x80/0xd0 [ 72.165536] __x64_sys_mount+0x21/0x30 [ 72.166828] do_syscall_64+0x5b/0x1f0 [ 72.168124] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 72.169649] RIP: 0033:0x7f9aec59148a [ 72.170904] Code: 48 8b 0d 11 fa 2a 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d de f9 2a 00 f7 d8 64 89 01 48 [ 72.175696] RSP: 002b:00007ffc97973af8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a5 [ 72.177764] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f9aec59148a [ 72.179756] RDX: 00005630f7e3b3ee RSI: 00005630f988a0b0 RDI: 00005630f988a310 [ 72.181768] RBP: 00007ffc97973ca0 R08: 00005630f988a2b0 R09: 0000000000000020 [ 72.183776] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffc97973b90 [ 72.185795] R13: 0000000000000000 R14: 00005630f988b000 R15: 00007ffc97973b10 [ 72.193593] o2dlm: Joining domain 87608FBB69A6455A927DB6EE644FA256 [ 72.193593] ( [ 72.195534] 1 [ 72.196744] ) 1 nodes [ 72.201889] JBD2: Ignoring recovery information on journal [ 72.211850] ocfs2: Mounting device (8,0) on (node 1, slot 0) with ordered data mode. [ 72.261789] mount /dev/sda /mnt/ocfs2 /dev/sda 16515072 243712 16271360 2% /mnt/ocfs2 [ 72.261792] [ 72.268799] OK [ 72.268801] [ 72.273936] create testdir /mnt/ocfs2/20190907_114755 [ 72.273938] [ 72.286732] create 15890 files . [ 72.286734] [ 72.290339] [ 76.331476] o2dlm: Leaving domain 87608FBB69A6455A927DB6EE644FA256 [ 76.402235] blk_update_request: I/O error, dev fd0, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [ 76.406909] floppy: error 10 while reading block 0 [ 78.260271] ocfs2: Unmounting device (8,0) on (node 1) [ 78.264188] ------------[ cut here ]------------ [ 78.267624] refcount_t: underflow; use-after-free. [ 78.271193] WARNING: CPU: 1 PID: 2531 at lib/refcount.c:28 refcount_warn_saturate+0x95/0xe0 [ 78.275787] Modules linked in: ocfs2_stack_o2cb ocfs2_dlm ocfs2 ocfs2_nodemanager ocfs2_stackglue jbd2 bochs_drm sr_mod cdrom ata_generic drm_vram_helper pata_acpi ttm intel_rapl_msr sd_mod sg intel_rapl_common drm_kms_helper crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ppdev syscopyarea sysfillrect sysimgblt fb_sys_fops drm snd_pcm aesni_intel ata_piix crypto_simd snd_timer libata joydev snd cryptd glue_helper soundcore pcspkr serio_raw virtio_scsi i2c_piix4 floppy parport_pc parport ip_tables [ 78.294615] CPU: 1 PID: 2531 Comm: umount Tainted: G W 5.3.0-rc3-00008-g26d2e0d5df5b9 #1 [ 78.297253] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014 [ 78.299697] RIP: 0010:refcount_warn_saturate+0x95/0xe0 [ 78.301533] Code: 05 13 c8 37 01 01 e8 3a fd c1 ff 0f 0b c3 80 3d 01 c8 37 01 00 75 aa 48 c7 c7 c8 79 d1 aa c6 05 f1 c7 37 01 01 e8 1b fd c1 ff <0f> 0b c3 80 3d e3 c7 37 01 00 75 8b 48 c7 c7 98 79 d1 aa c6 05 d3 [ 78.306840] RSP: 0018:ffffad0540413e20 EFLAGS: 00010282 [ 78.308741] RAX: 0000000000000000 RBX: ffff96be3da63000 RCX: 0000000000000000 [ 78.311011] RDX: ffff96beffd27200 RSI: ffff96beffd17778 RDI: ffff96beffd17778 [ 78.313311] RBP: ffff96be3baf6000 R08: 00000000000004ff R09: 0000000000aaaaaa [ 78.315620] R10: ffff96bedf05eec0 R11: ffff96bedc6ee950 R12: ffffad0540413e34 [ 78.317899] R13: ffff96be3da63240 R14: ffff96be3da630c8 R15: 0000000000000000 [ 78.320192] FS: 00007fb431b58e40(0000) GS:ffff96beffd00000(0000) knlGS:0000000000000000 [ 78.322666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 78.324751] CR2: 00000000004216d0 CR3: 000000007cf4c000 CR4: 00000000000406e0 [ 78.327003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 78.329278] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 78.331517] Call Trace: [ 78.332928] ocfs2_dismount_volume+0x342/0x400 [ocfs2] [ 78.334790] generic_shutdown_super+0x6c/0x120 [ 78.336521] kill_block_super+0x21/0x50 [ 78.338131] deactivate_locked_super+0x3f/0x70 [ 78.339858] cleanup_mnt+0xb8/0x150 [ 78.341396] task_work_run+0xa3/0xe0 [ 78.342965] exit_to_usermode_loop+0xeb/0xf0 [ 78.344679] do_syscall_64+0x1c1/0x1f0 [ 78.346272] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 78.348112] RIP: 0033:0x7fb43143cd77 [ 78.349647] Code: 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 31 f6 e9 09 00 00 00 66 0f 1f 84 00 00 00 00 00 b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 00 2b 00 f7 d8 64 89 01 48 [ 78.353636] RSP: 002b:00007ffc671b3ad8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 [ 78.355313] RAX: 0000000000000000 RBX: 0000558a27aef080 RCX: 00007fb43143cd77 [ 78.356858] RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000558a27aef260 [ 78.358382] RBP: 0000558a27aef260 R08: 0000558a27af0600 R09: 0000000000000015 [ 78.359939] R10: 00000000000006b4 R11: 0000000000000246 R12: 00007fb43193ee64 [ 78.361625] R13: 0000000000000000 R14: 0000000000000000 R15: 00007ffc671b3d60 [ 78.363256] ---[ end trace 06b247ab8ebf3051 ]--- To reproduce: # build kernel cd linux cp config-5.3.0-rc3-00008-g26d2e0d5df5b9 .config make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email Thanks, Rong Chen

8 months, 3 weeks

2
1
0 / 0

[xfs] 1aabb011bf: aim7.jobs-per-min -17.8% regression

by kernel test robot

Greeting, FYI, we noticed a -17.8% regression of aim7.jobs-per-min due to commit: commit: 1aabb011bfba5a8942d3e0d0c84a4ac7cad277b1 ("xfs: deferred inode inactivation") https://kernel.googlesource.com/pub/scm/linux/kernel/git/djwong/xfs-linux... rough-fixes in testcase: aim7 on test machine: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory with following parameters: disk: 4BRD_12G md: RAID0 fs: xfs test: disk_rw load: 3000 cpufreq_governor: performance test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system. test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/ In addition to that, the commit also has significant impact on the following tests: +------------------+-----------------------------------------------------------------------+ | testcase: change | aim7: aim7.jobs-per-min -35.7% regression | | test machine | 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory | | test parameters | cpufreq_governor=performance | | | disk=4BRD_12G | | | fs=xfs | | | load=3000 | | | md=RAID0 | | | test=disk_cp | +------------------+-----------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <rong.a.chen(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase: gcc-7/performance/4BRD_12G/xfs/x86_64-rhel-7.6/3000/RAID0/debian-x86_64-2019-05-14.cgz/lkp-ivb-ep01/disk_rw/aim7 commit: d515962b00 ("xfs: pass around xfs_inode_ag_walk iget/irele helper functions") 1aabb011bf ("xfs: deferred inode inactivation") d515962b00d64454 1aabb011bfba5a8942d3e0d0c84 ---------------- --------------------------- %stddev %change %stddev \ | \ 139763 -17.8% 114843 aim7.jobs-per-min 129.25 +21.6% 157.23 aim7.time.elapsed_time 129.25 +21.6% 157.23 aim7.time.elapsed_time.max 31367 ± 3% -39.2% 19066 ± 11% aim7.time.involuntary_context_switches 2862 -7.1% 2659 aim7.time.system_time 798.18 -5.9% 751.02 aim7.time.user_time 1049629 -21.6% 822793 aim7.time.voluntary_context_switches 1.016e+09 ± 12% +111.5% 2.149e+09 ± 11% cpuidle.C6.time 1873251 ± 7% +86.0% 3483843 ± 18% cpuidle.C6.usage 2956 ± 10% +25.2% 3701 ± 17% cpuidle.POLL.usage 29.00 +15.7 44.70 ± 2% mpstat.cpu.all.idle% 55.41 -12.2 43.21 ± 2% mpstat.cpu.all.sys% 15.55 -3.5 12.07 mpstat.cpu.all.usr% 30.00 +51.2% 45.35 ± 2% iostat.cpu.idle 54.65 -21.8% 42.72 ± 2% iostat.cpu.system 15.34 -22.2% 11.93 iostat.cpu.user 42.06 ± 11% +139.1% 100.59 ± 7% iostat.md0.w/s 115553 +14.5% 132340 ± 3% meminfo.AnonHugePages 95312 +20.4% 114787 meminfo.KReclaimable 95312 +20.4% 114787 meminfo.SReclaimable 261148 +13.4% 296269 meminfo.Slab 31512 -16.2% 26409 ± 2% meminfo.max_used_kB 2740 ± 44% +108.3% 5707 ± 11% numa-vmstat.node0.nr_shmem 10048 ± 35% +81.5% 18236 ± 11% numa-vmstat.node0.nr_slab_reclaimable 16555 ± 52% +74.7% 28924 ± 28% numa-vmstat.node0.nr_slab_unreclaimable 3417 ± 16% -20.1% 2730 ± 20% numa-vmstat.node1.nr_mapped 4555 ± 27% -66.3% 1533 ± 53% numa-vmstat.node1.nr_shmem 29.50 +52.5% 45.00 ± 2% vmstat.cpu.id 54.25 -22.6% 42.00 ± 2% vmstat.cpu.sy 15.00 -26.7% 11.00 vmstat.cpu.us 27.50 -22.7% 21.25 ± 2% vmstat.procs.r 17205 -9.9% 15509 vmstat.system.cs 40194 ± 35% +81.5% 72950 ± 11% numa-meminfo.node0.KReclaimable 40194 ± 35% +81.5% 72950 ± 11% numa-meminfo.node0.SReclaimable 66241 ± 52% +74.7% 115712 ± 28% numa-meminfo.node0.SUnreclaim 10965 ± 44% +108.3% 22838 ± 11% numa-meminfo.node0.Shmem 106435 ± 44% +77.3% 188663 ± 18% numa-meminfo.node0.Slab 13273 ± 15% -18.7% 10793 ± 18% numa-meminfo.node1.Mapped 18226 ± 27% -66.3% 6135 ± 53% numa-meminfo.node1.Shmem 346095 -2.0% 339002 proc-vmstat.nr_dirty 346482 -2.0% 339409 proc-vmstat.nr_inactive_file 23834 +20.4% 28691 proc-vmstat.nr_slab_reclaimable 41519 +9.2% 45351 proc-vmstat.nr_slab_unreclaimable 346482 -2.0% 339409 proc-vmstat.nr_zone_inactive_file 346479 -2.0% 339510 proc-vmstat.nr_zone_write_pending 509175 +14.6% 583653 proc-vmstat.pgfault 871.00 -19.2% 703.50 ± 3% turbostat.Avg_MHz 71.90 -15.1 56.80 turbostat.Busy% 1869906 ± 7% +86.1% 3479825 ± 19% turbostat.C6 19.42 ± 12% +14.4 33.80 ± 11% turbostat.C6% 22.63 ± 2% +44.9% 32.79 ± 7% turbostat.CPU%c1 4.42 ± 34% +114.8% 9.50 ± 30% turbostat.CPU%c6 47.42 -4.3% 45.40 ± 2% turbostat.CorWatt 10614698 +20.8% 12819724 turbostat.IRQ 65.00 ± 3% +3.8% 67.50 turbostat.PkgTmp 73.99 -2.8% 71.95 turbostat.PkgWatt 34.29 -4.1% 32.90 turbostat.RAMWatt 10450 +21.5% 12696 turbostat.SMI 2930 ± 5% +309.5% 12001 slabinfo.dmaengine-unmap-16.active_objs 73.00 ± 7% +626.0% 530.00 ± 4% slabinfo.dmaengine-unmap-16.active_slabs 3088 ± 7% +621.4% 22279 ± 4% slabinfo.dmaengine-unmap-16.num_objs 73.00 ± 7% +626.0% 530.00 ± 4% slabinfo.dmaengine-unmap-16.num_slabs 2663 ± 3% +28.7% 3427 ± 6% slabinfo.kmalloc-128.active_objs 2663 ± 3% +28.7% 3427 ± 6% slabinfo.kmalloc-128.num_objs 19529 +129.5% 44820 ± 4% slabinfo.kmalloc-16.active_objs 75.75 +141.9% 183.25 ± 4% slabinfo.kmalloc-16.active_slabs 19529 +140.8% 47025 ± 4% slabinfo.kmalloc-16.num_objs 75.75 +141.9% 183.25 ± 4% slabinfo.kmalloc-16.num_slabs 2850 ± 3% +19.0% 3391 ± 3% slabinfo.kmalloc-2k.active_objs 2905 ± 3% +17.8% 3423 ± 3% slabinfo.kmalloc-2k.num_objs 769.75 +33.0% 1023 ± 3% slabinfo.kmalloc-4k.active_objs 782.75 +34.1% 1049 ± 3% slabinfo.kmalloc-4k.num_objs 6379 +151.9% 16067 slabinfo.kmalloc-512.active_objs 209.25 +187.8% 602.25 slabinfo.kmalloc-512.active_slabs 6712 +187.4% 19289 slabinfo.kmalloc-512.num_objs 209.25 +187.8% 602.25 slabinfo.kmalloc-512.num_slabs 453.75 +41.7% 643.00 slabinfo.kmalloc-8k.active_objs 469.50 +49.6% 702.25 slabinfo.kmalloc-8k.num_objs 923.25 ± 14% +22.9% 1135 ± 7% slabinfo.task_group.active_objs 923.25 ± 14% +22.9% 1135 ± 7% slabinfo.task_group.num_objs 1201 +79.2% 2152 ± 2% slabinfo.xfs_buf_item.active_objs 1201 +79.2% 2152 ± 2% slabinfo.xfs_buf_item.num_objs 1264 +51.1% 1909 ± 13% slabinfo.xfs_efd_item.active_objs 1264 +51.1% 1909 ± 13% slabinfo.xfs_efd_item.num_objs 2437 ± 2% +375.6% 11590 slabinfo.xfs_inode.active_objs 84.25 ± 3% +688.7% 664.50 ± 4% slabinfo.xfs_inode.active_slabs 2710 ± 3% +685.2% 21283 ± 4% slabinfo.xfs_inode.num_objs 84.25 ± 3% +688.7% 664.50 ± 4% slabinfo.xfs_inode.num_slabs 40593 -23.2% 31163 ± 2% sched_debug.cfs_rq:/.exec_clock.avg 42413 -22.9% 32721 ± 2% sched_debug.cfs_rq:/.exec_clock.max 40001 -23.7% 30528 ± 2% sched_debug.cfs_rq:/.exec_clock.min 21776 ± 22% +54.6% 33663 ± 23% sched_debug.cfs_rq:/.load.avg 131390 ±112% +327.1% 561113 ± 52% sched_debug.cfs_rq:/.load.max 26684 ± 79% +269.6% 98631 ± 45% sched_debug.cfs_rq:/.load.stddev 508.00 ± 37% +133.3% 1185 ± 39% sched_debug.cfs_rq:/.load_avg.max 9.00 ± 17% -44.4% 5.00 ± 33% sched_debug.cfs_rq:/.load_avg.min 120.95 ± 40% +94.6% 235.39 ± 32% sched_debug.cfs_rq:/.load_avg.stddev 1315047 -37.2% 825488 ± 4% sched_debug.cfs_rq:/.min_vruntime.avg 1467409 ± 3% -35.8% 941380 ± 2% sched_debug.cfs_rq:/.min_vruntime.max 1271354 -38.8% 777738 ± 4% sched_debug.cfs_rq:/.min_vruntime.min 0.62 ± 5% -30.4% 0.43 ± 10% sched_debug.cfs_rq:/.nr_running.avg 35.08 ± 9% +449.6% 192.83 ± 63% sched_debug.cfs_rq:/.runnable_load_avg.max 10.30 +221.3% 33.10 ± 54% sched_debug.cfs_rq:/.runnable_load_avg.stddev 20216 ± 22% +48.6% 30046 ± 29% sched_debug.cfs_rq:/.runnable_weight.avg 120127 ±125% +287.7% 465751 ± 60% sched_debug.cfs_rq:/.runnable_weight.max 25146 ± 87% +234.5% 84116 ± 53% sched_debug.cfs_rq:/.runnable_weight.stddev 14472 ±135% -101.5% -211.35 sched_debug.cfs_rq:/.spread0.avg 166817 ± 25% -30.7% 115662 ± 20% sched_debug.cfs_rq:/.spread0.max -28876 +66.0% -47942 sched_debug.cfs_rq:/.spread0.min 757.34 ± 2% -27.9% 545.98 ± 4% sched_debug.cfs_rq:/.util_avg.avg 1299 ± 11% -14.5% 1111 sched_debug.cfs_rq:/.util_avg.max 397.33 ± 17% -38.5% 244.17 ± 17% sched_debug.cfs_rq:/.util_avg.min 103.73 ± 13% -38.5% 63.79 ± 13% sched_debug.cfs_rq:/.util_est_enqueued.avg 204770 ± 4% -10.9% 182535 ± 3% sched_debug.cpu.avg_idle.stddev 1795 ± 10% -27.6% 1300 ± 17% sched_debug.cpu.curr->pid.avg 1336 +18.0% 1576 ± 5% sched_debug.cpu.curr->pid.stddev 0.64 ± 5% -28.8% 0.45 ± 10% sched_debug.cpu.nr_running.avg 27275 -10.7% 24364 sched_debug.cpu.nr_switches.avg 34560 ± 3% +68.3% 58168 ± 4% sched_debug.cpu.nr_switches.max 24872 -31.7% 16990 sched_debug.cpu.nr_switches.min 2128 ± 7% +328.5% 9122 ± 2% sched_debug.cpu.nr_switches.stddev 25106 -11.7% 22178 sched_debug.cpu.sched_count.avg 27859 ± 2% +89.0% 52655 ± 3% sched_debug.cpu.sched_count.max 23769 -32.1% 16139 sched_debug.cpu.sched_count.min 874.04 ± 15% +856.0% 8355 sched_debug.cpu.sched_count.stddev 11954 -10.8% 10660 sched_debug.cpu.sched_goidle.avg 13338 ± 2% +93.1% 25761 ± 3% sched_debug.cpu.sched_goidle.max 11339 -32.5% 7653 sched_debug.cpu.sched_goidle.min 420.12 ± 13% +887.8% 4149 sched_debug.cpu.sched_goidle.stddev 12641 -12.2% 11095 sched_debug.cpu.ttwu_count.avg 14696 +73.7% 25527 sched_debug.cpu.ttwu_count.max 12080 -33.3% 8056 sched_debug.cpu.ttwu_count.min 598.46 ± 9% +580.7% 4073 sched_debug.cpu.ttwu_count.stddev 470.25 ± 2% +23.9% 582.47 ± 3% sched_debug.cpu.ttwu_local.avg 883.75 ± 10% +23.9% 1094 ± 9% sched_debug.cpu.ttwu_local.max 91.75 ± 12% +68.5% 154.59 ± 7% sched_debug.cpu.ttwu_local.stddev 3.867e+09 -14.4% 3.312e+09 perf-stat.i.branch-instructions 2.08 ± 2% -0.1 1.95 ± 3% perf-stat.i.branch-miss-rate% 55566907 -12.0% 48886699 ± 2% perf-stat.i.branch-misses 26.51 -1.7 24.84 ± 2% perf-stat.i.cache-miss-rate% 37534712 -23.4% 28761515 perf-stat.i.cache-misses 1.407e+08 -16.4% 1.176e+08 ± 2% perf-stat.i.cache-references 17417 -9.9% 15689 perf-stat.i.context-switches 2.05 -6.7% 1.91 ± 3% perf-stat.i.cpi 3.442e+10 -19.1% 2.784e+10 ± 4% perf-stat.i.cpu-cycles 2461 -48.3% 1271 perf-stat.i.cpu-migrations 898.31 +4.4% 937.81 ± 4% perf-stat.i.cycles-between-cache-misses 1.176e+08 ± 9% -22.4% 91285096 ± 2% perf-stat.i.dTLB-load-misses 6.032e+09 -14.2% 5.174e+09 perf-stat.i.dTLB-loads 17987322 ± 3% -17.7% 14796811 ± 3% perf-stat.i.dTLB-store-misses 4.184e+09 -15.1% 3.553e+09 perf-stat.i.dTLB-stores 6915996 ± 2% -5.9% 6510336 perf-stat.i.iTLB-load-misses 2586772 ± 8% -18.9% 2098325 ± 13% perf-stat.i.iTLB-loads 1.945e+10 -14.3% 1.667e+10 perf-stat.i.instructions 2785 ± 3% -10.5% 2492 perf-stat.i.instructions-per-iTLB-miss 0.55 +7.4% 0.59 ± 2% perf-stat.i.ipc 3723 -5.1% 3534 perf-stat.i.minor-faults 2160613 -24.3% 1634850 ± 2% perf-stat.i.node-load-misses 4136129 -22.3% 3213515 perf-stat.i.node-loads 23.00 -1.2 21.79 ± 3% perf-stat.i.node-store-miss-rate% 8687009 -31.6% 5940686 ± 2% perf-stat.i.node-store-misses 29184014 -26.3% 21502342 perf-stat.i.node-stores 3723 -5.1% 3534 perf-stat.i.page-faults 7.23 -2.5% 7.05 perf-stat.overall.MPKI 26.68 -2.2 24.47 perf-stat.overall.cache-miss-rate% 1.77 -5.7% 1.67 ± 2% perf-stat.overall.cpi 917.20 +5.6% 968.21 ± 4% perf-stat.overall.cycles-between-cache-misses 2814 ± 2% -9.0% 2560 perf-stat.overall.instructions-per-iTLB-miss 0.57 +6.1% 0.60 ± 2% perf-stat.overall.ipc 34.31 -0.6 33.71 perf-stat.overall.node-load-miss-rate% 22.94 ± 2% -1.3 21.65 perf-stat.overall.node-store-miss-rate% 3.835e+09 -14.2% 3.291e+09 perf-stat.ps.branch-instructions 55111206 -11.9% 48573654 ± 2% perf-stat.ps.branch-misses 37224107 -23.2% 28577554 perf-stat.ps.cache-misses 1.395e+08 -16.3% 1.168e+08 ± 2% perf-stat.ps.cache-references 17274 -9.8% 15588 perf-stat.ps.context-switches 3.414e+10 -19.0% 2.766e+10 ± 4% perf-stat.ps.cpu-cycles 2441 -48.2% 1263 perf-stat.ps.cpu-migrations 1.166e+08 ± 9% -22.2% 90699316 ± 2% perf-stat.ps.dTLB-load-misses 5.983e+09 -14.1% 5.141e+09 perf-stat.ps.dTLB-loads 17837008 ± 3% -17.6% 14701867 ± 3% perf-stat.ps.dTLB-store-misses 4.149e+09 -14.9% 3.53e+09 perf-stat.ps.dTLB-stores 6858348 ± 2% -5.7% 6468604 perf-stat.ps.iTLB-load-misses 2565117 ± 8% -18.7% 2084894 ± 13% perf-stat.ps.iTLB-loads 1.929e+10 -14.1% 1.656e+10 perf-stat.ps.instructions 3714 -5.4% 3513 perf-stat.ps.minor-faults 2142679 -24.2% 1624370 ± 2% perf-stat.ps.node-load-misses 4101979 -22.2% 3192920 perf-stat.ps.node-loads 8614251 -31.5% 5902590 ± 2% perf-stat.ps.node-store-misses 28939527 -26.2% 21364553 perf-stat.ps.node-stores 3714 -5.4% 3513 perf-stat.ps.page-faults 2.506e+12 +4.5% 2.619e+12 perf-stat.total.instructions 145.25 ± 16% +54.9% 225.00 ± 18% interrupts.39:IR-PCI-MSI.524289-edge.eth0-TxRx-0 103.00 ± 49% +1794.7% 1951 ±161% interrupts.44:IR-PCI-MSI.524294-edge.eth0-TxRx-5 1380 ± 11% +21.4% 1676 ± 5% interrupts.CPU0.CAL:Function_call_interrupts 260369 +21.4% 316051 interrupts.CPU0.LOC:Local_timer_interrupts 2090 ± 11% -32.7% 1407 ± 6% interrupts.CPU0.RES:Rescheduling_interrupts 259956 +21.7% 316451 interrupts.CPU1.LOC:Local_timer_interrupts 259976 +21.4% 315572 interrupts.CPU10.LOC:Local_timer_interrupts 1869 ± 22% -56.8% 808.50 ± 12% interrupts.CPU10.RES:Rescheduling_interrupts 1382 ± 9% +15.6% 1598 ± 7% interrupts.CPU11.CAL:Function_call_interrupts 260390 +21.4% 316071 interrupts.CPU11.LOC:Local_timer_interrupts 1514 ± 7% -45.4% 827.00 ± 31% interrupts.CPU11.RES:Rescheduling_interrupts 1218 ± 6% +36.8% 1665 ± 12% interrupts.CPU12.CAL:Function_call_interrupts 260198 +21.7% 316720 interrupts.CPU12.LOC:Local_timer_interrupts 1484 ± 8% -37.2% 932.50 ± 16% interrupts.CPU12.RES:Rescheduling_interrupts 1309 ± 10% +25.9% 1648 ± 11% interrupts.CPU13.CAL:Function_call_interrupts 260491 +21.6% 316752 interrupts.CPU13.LOC:Local_timer_interrupts 1435 ± 7% -35.7% 923.00 ± 23% interrupts.CPU13.RES:Rescheduling_interrupts 260090 +21.6% 316365 interrupts.CPU14.LOC:Local_timer_interrupts 2335 ± 33% -60.6% 920.75 ± 57% interrupts.CPU14.NMI:Non-maskable_interrupts 2335 ± 33% -60.6% 920.75 ± 57% interrupts.CPU14.PMI:Performance_monitoring_interrupts 1534 ± 7% -43.3% 870.50 ± 27% interrupts.CPU14.RES:Rescheduling_interrupts 260275 +21.2% 315386 interrupts.CPU15.LOC:Local_timer_interrupts 1533 ± 7% -40.2% 916.50 ± 28% interrupts.CPU15.RES:Rescheduling_interrupts 259511 +21.3% 314731 interrupts.CPU16.LOC:Local_timer_interrupts 1530 ± 6% -47.6% 802.50 ± 13% interrupts.CPU16.RES:Rescheduling_interrupts 260066 +21.7% 316545 interrupts.CPU17.LOC:Local_timer_interrupts 260096 +21.0% 314637 interrupts.CPU18.LOC:Local_timer_interrupts 1502 ± 8% -48.9% 767.75 ± 18% interrupts.CPU18.RES:Rescheduling_interrupts 260276 +21.4% 315940 interrupts.CPU19.LOC:Local_timer_interrupts 1540 ± 7% -33.4% 1025 ± 24% interrupts.CPU19.RES:Rescheduling_interrupts 103.00 ± 49% +1794.7% 1951 ±161% interrupts.CPU2.44:IR-PCI-MSI.524294-edge.eth0-TxRx-5 260077 +21.7% 316607 interrupts.CPU2.LOC:Local_timer_interrupts 1696 ± 22% -49.0% 865.00 ± 17% interrupts.CPU2.RES:Rescheduling_interrupts 260201 +21.8% 316819 interrupts.CPU20.LOC:Local_timer_interrupts 446.50 ±141% +283.6% 1712 ± 32% interrupts.CPU20.NMI:Non-maskable_interrupts 446.50 ±141% +283.6% 1712 ± 32% interrupts.CPU20.PMI:Performance_monitoring_interrupts 260321 +21.6% 316575 interrupts.CPU21.LOC:Local_timer_interrupts 260161 +21.1% 315079 interrupts.CPU22.LOC:Local_timer_interrupts 1533 ± 8% -21.8% 1198 ± 23% interrupts.CPU22.RES:Rescheduling_interrupts 1356 ± 10% +19.9% 1626 ± 4% interrupts.CPU23.CAL:Function_call_interrupts 259884 +21.6% 316144 interrupts.CPU23.LOC:Local_timer_interrupts 1332 ± 5% -43.3% 755.00 interrupts.CPU23.RES:Rescheduling_interrupts 260225 +21.2% 315429 interrupts.CPU24.LOC:Local_timer_interrupts 1388 ± 4% -47.4% 730.25 ± 19% interrupts.CPU24.RES:Rescheduling_interrupts 259779 +21.8% 316330 interrupts.CPU25.LOC:Local_timer_interrupts 1468 ± 8% -29.7% 1033 ± 31% interrupts.CPU25.RES:Rescheduling_interrupts 1376 ± 11% +22.5% 1687 ± 10% interrupts.CPU26.CAL:Function_call_interrupts 260128 +21.2% 315219 interrupts.CPU26.LOC:Local_timer_interrupts 259346 +22.3% 317098 interrupts.CPU27.LOC:Local_timer_interrupts 1465 ± 7% -42.2% 846.25 ± 31% interrupts.CPU27.RES:Rescheduling_interrupts 260225 +21.0% 314795 interrupts.CPU28.LOC:Local_timer_interrupts 1459 ± 7% -42.3% 842.00 ± 17% interrupts.CPU28.RES:Rescheduling_interrupts 260085 +21.5% 316006 interrupts.CPU29.LOC:Local_timer_interrupts 1379 ± 4% -47.2% 727.75 ± 16% interrupts.CPU29.RES:Rescheduling_interrupts 260259 +21.7% 316731 interrupts.CPU3.LOC:Local_timer_interrupts 1567 ± 9% -39.8% 943.25 ± 30% interrupts.CPU3.RES:Rescheduling_interrupts 145.25 ± 16% +54.9% 225.00 ± 18% interrupts.CPU30.39:IR-PCI-MSI.524289-edge.eth0-TxRx-0 260074 +21.1% 314955 interrupts.CPU30.LOC:Local_timer_interrupts 1390 ± 4% -50.9% 682.50 ± 14% interrupts.CPU30.RES:Rescheduling_interrupts 1358 ± 11% +18.5% 1609 ± 14% interrupts.CPU31.CAL:Function_call_interrupts 260132 +21.7% 316628 interrupts.CPU31.LOC:Local_timer_interrupts 1392 ± 10% -31.4% 955.75 ± 17% interrupts.CPU31.RES:Rescheduling_interrupts 1360 ± 11% +15.9% 1576 ± 11% interrupts.CPU32.CAL:Function_call_interrupts 260317 +20.9% 314826 interrupts.CPU32.LOC:Local_timer_interrupts 1464 ± 11% -45.5% 798.25 ± 18% interrupts.CPU32.RES:Rescheduling_interrupts 260012 +21.4% 315686 interrupts.CPU33.LOC:Local_timer_interrupts 1486 ± 10% -48.4% 767.00 ± 14% interrupts.CPU33.RES:Rescheduling_interrupts 1265 ± 18% +25.0% 1582 ± 12% interrupts.CPU34.CAL:Function_call_interrupts 260359 +21.0% 315007 interrupts.CPU34.LOC:Local_timer_interrupts 1603 ± 27% -52.0% 770.00 ± 27% interrupts.CPU34.RES:Rescheduling_interrupts 1390 ± 8% +16.0% 1612 ± 10% interrupts.CPU35.CAL:Function_call_interrupts 260282 +21.7% 316652 interrupts.CPU35.LOC:Local_timer_interrupts 1434 ± 11% -42.3% 827.50 ± 14% interrupts.CPU35.RES:Rescheduling_interrupts 260380 +20.8% 314555 interrupts.CPU36.LOC:Local_timer_interrupts 1343 ± 10% -38.3% 829.25 ± 9% interrupts.CPU36.RES:Rescheduling_interrupts 260230 +21.1% 315199 interrupts.CPU37.LOC:Local_timer_interrupts 1346 ± 12% +21.2% 1631 ± 13% interrupts.CPU38.CAL:Function_call_interrupts 259976 +21.8% 316532 interrupts.CPU38.LOC:Local_timer_interrupts 1481 ± 6% -51.1% 724.25 ± 9% interrupts.CPU38.RES:Rescheduling_interrupts 260061 +20.9% 314458 interrupts.CPU39.LOC:Local_timer_interrupts 1436 ± 8% -44.9% 791.00 ± 34% interrupts.CPU39.RES:Rescheduling_interrupts 1359 ± 13% +22.9% 1671 ± 12% interrupts.CPU4.CAL:Function_call_interrupts 260201 +21.7% 316705 interrupts.CPU4.LOC:Local_timer_interrupts 1668 ± 20% -43.6% 941.00 ± 10% interrupts.CPU4.RES:Rescheduling_interrupts 1385 ± 9% +12.1% 1552 ± 8% interrupts.CPU5.CAL:Function_call_interrupts 260181 +21.7% 316657 interrupts.CPU5.LOC:Local_timer_interrupts 1164 ± 55% -74.2% 300.25 ±173% interrupts.CPU5.NMI:Non-maskable_interrupts 1164 ± 55% -74.2% 300.25 ±173% interrupts.CPU5.PMI:Performance_monitoring_interrupts 1464 ± 9% -42.8% 838.00 ± 15% interrupts.CPU5.RES:Rescheduling_interrupts 260255 +21.7% 316804 interrupts.CPU6.LOC:Local_timer_interrupts 1497 ± 6% -50.5% 741.00 ± 19% interrupts.CPU6.RES:Rescheduling_interrupts 1372 ± 9% +19.6% 1642 ± 4% interrupts.CPU7.CAL:Function_call_interrupts 259919 +21.5% 315765 interrupts.CPU7.LOC:Local_timer_interrupts 1481 ± 10% -26.4% 1089 ± 29% interrupts.CPU7.RES:Rescheduling_interrupts 1339 ± 13% +17.6% 1575 ± 11% interrupts.CPU8.CAL:Function_call_interrupts 260401 +21.6% 316700 interrupts.CPU8.LOC:Local_timer_interrupts 1861 ± 33% -53.3% 869.50 ± 19% interrupts.CPU8.RES:Rescheduling_interrupts 1426 ± 6% +18.8% 1695 ± 9% interrupts.CPU9.CAL:Function_call_interrupts 259391 +22.2% 316922 interrupts.CPU9.LOC:Local_timer_interrupts 1551 -18.5% 1264 ± 3% interrupts.CPU9.NMI:Non-maskable_interrupts 1551 -18.5% 1264 ± 3% interrupts.CPU9.PMI:Performance_monitoring_interrupts 1646 ± 14% -47.5% 864.75 ± 8% interrupts.CPU9.RES:Rescheduling_interrupts 10404571 +21.5% 12638118 interrupts.LOC:Local_timer_interrupts 61340 ± 2% -39.7% 37011 ± 2% interrupts.RES:Rescheduling_interrupts 265.00 ± 6% +76.1% 466.75 ± 12% interrupts.TLB:TLB_shootdowns 21780 ± 3% +34.1% 29206 ± 4% softirqs.CPU0.RCU 19352 ± 2% +14.7% 22198 softirqs.CPU0.SCHED 50306 ± 4% +17.8% 59258 ± 8% softirqs.CPU0.TIMER 23163 ± 8% +21.3% 28089 ± 6% softirqs.CPU1.RCU 16179 +20.8% 19547 softirqs.CPU1.SCHED 48867 ± 5% +16.5% 56934 ± 3% softirqs.CPU1.TIMER 21339 ± 2% +31.5% 28064 ± 4% softirqs.CPU10.RCU 15492 ± 2% +21.8% 18872 softirqs.CPU10.SCHED 48447 ± 2% +16.0% 56208 ± 2% softirqs.CPU10.TIMER 21278 ± 5% +31.9% 28067 ± 5% softirqs.CPU11.RCU 15581 +20.5% 18770 softirqs.CPU11.SCHED 48567 +17.7% 57140 ± 4% softirqs.CPU11.TIMER 22261 ± 3% +36.5% 30385 ± 9% softirqs.CPU12.RCU 15644 +20.3% 18824 ± 2% softirqs.CPU12.SCHED 49536 ± 2% +32.3% 65518 ± 21% softirqs.CPU12.TIMER 21724 ± 2% +27.9% 27794 ± 4% softirqs.CPU13.RCU 15508 +21.1% 18776 ± 2% softirqs.CPU13.SCHED 48945 +19.2% 58366 ± 4% softirqs.CPU13.TIMER 21297 ± 3% +35.0% 28761 ± 3% softirqs.CPU14.RCU 15583 +23.0% 19162 ± 5% softirqs.CPU14.SCHED 48772 ± 2% +17.2% 57154 ± 4% softirqs.CPU14.TIMER 21231 ± 3% +35.4% 28746 ± 8% softirqs.CPU15.RCU 15571 +21.9% 18985 ± 2% softirqs.CPU15.SCHED 48486 +17.6% 57020 ± 3% softirqs.CPU15.TIMER 21571 ± 7% +31.7% 28415 softirqs.CPU16.RCU 15314 +23.3% 18884 ± 2% softirqs.CPU16.SCHED 49988 ± 4% +15.1% 57561 ± 3% softirqs.CPU16.TIMER 21326 ± 4% +31.0% 27927 ± 4% softirqs.CPU17.RCU 15434 +22.8% 18960 ± 3% softirqs.CPU17.SCHED 48588 ± 2% +17.1% 56905 ± 2% softirqs.CPU17.TIMER 21212 ± 2% +31.8% 27968 ± 4% softirqs.CPU18.RCU 15571 +20.9% 18827 ± 3% softirqs.CPU18.SCHED 49151 ± 2% +33.3% 65535 ± 15% softirqs.CPU18.TIMER 21490 ± 4% +27.9% 27490 ± 5% softirqs.CPU19.RCU 15550 +20.6% 18747 ± 2% softirqs.CPU19.SCHED 50252 ± 8% +13.4% 57009 ± 2% softirqs.CPU19.TIMER 23244 ± 11% +32.3% 30747 ± 6% softirqs.CPU2.RCU 15982 +30.8% 20905 softirqs.CPU2.SCHED 50703 ± 5% +22.8% 62276 ± 4% softirqs.CPU2.TIMER 21304 ± 2% +45.9% 31089 ± 7% softirqs.CPU20.RCU 15409 ± 2% +23.2% 18988 ± 3% softirqs.CPU20.SCHED 22317 ± 4% +28.2% 28608 ± 5% softirqs.CPU21.RCU 50492 ± 3% +18.6% 59868 ± 8% softirqs.CPU21.TIMER 21099 ± 4% +32.6% 27983 ± 3% softirqs.CPU22.RCU 15607 +21.3% 18935 ± 2% softirqs.CPU22.SCHED 20953 ± 2% +36.0% 28492 ± 6% softirqs.CPU23.RCU 15463 +22.4% 18924 ± 6% softirqs.CPU23.SCHED 49790 ± 2% +17.2% 58355 ± 4% softirqs.CPU23.TIMER 21424 ± 2% +33.5% 28607 ± 4% softirqs.CPU24.RCU 15603 +19.8% 18692 softirqs.CPU24.SCHED 49433 ± 4% +18.7% 58682 ± 4% softirqs.CPU24.TIMER 21527 ± 2% +34.8% 29025 ± 4% softirqs.CPU25.RCU 15413 +22.6% 18891 ± 2% softirqs.CPU25.SCHED 48601 ± 2% +17.9% 57281 ± 3% softirqs.CPU25.TIMER 21284 ± 3% +31.1% 27898 ± 2% softirqs.CPU26.RCU 15979 ± 4% +18.2% 18888 softirqs.CPU26.SCHED 50363 ± 3% +12.6% 56721 ± 4% softirqs.CPU26.TIMER 21307 ± 2% +34.4% 28646 ± 5% softirqs.CPU27.RCU 15342 +23.2% 18905 ± 3% softirqs.CPU27.SCHED 48693 ± 3% +19.5% 58194 ± 2% softirqs.CPU27.TIMER 21278 +30.1% 27694 ± 3% softirqs.CPU28.RCU 15623 +20.2% 18773 softirqs.CPU28.SCHED 49220 ± 2% +14.4% 56308 ± 3% softirqs.CPU28.TIMER 21511 ± 4% +30.1% 27979 ± 5% softirqs.CPU29.RCU 15816 ± 2% +18.4% 18725 softirqs.CPU29.SCHED 48698 +17.7% 57323 ± 3% softirqs.CPU29.TIMER 21335 ± 2% +36.2% 29048 ± 6% softirqs.CPU3.RCU 15763 ± 2% +20.0% 18917 softirqs.CPU3.SCHED 21413 ± 2% +32.4% 28350 ± 3% softirqs.CPU30.RCU 15489 ± 2% +21.6% 18831 ± 2% softirqs.CPU30.SCHED 48627 ± 2% +16.2% 56482 ± 2% softirqs.CPU30.TIMER 21314 ± 4% +32.2% 28181 ± 5% softirqs.CPU31.RCU 15542 +21.2% 18844 ± 3% softirqs.CPU31.SCHED 49740 ± 6% +14.4% 56918 ± 3% softirqs.CPU31.TIMER 19067 ± 11% +19.3% 22739 ± 2% softirqs.CPU32.RCU 15786 ± 3% +19.3% 18839 ± 2% softirqs.CPU32.SCHED 51277 ± 4% +12.1% 57503 ± 4% softirqs.CPU32.TIMER 17283 ± 3% +28.4% 22185 ± 4% softirqs.CPU33.RCU 15463 ± 2% +20.5% 18635 softirqs.CPU33.SCHED 48637 ± 2% +32.4% 64412 ± 18% softirqs.CPU33.TIMER 17794 ± 3% +29.8% 23103 ± 4% softirqs.CPU34.RCU 15838 +19.2% 18886 softirqs.CPU34.SCHED 49140 ± 2% +16.2% 57109 ± 4% softirqs.CPU34.TIMER 17452 ± 2% +28.5% 22432 ± 3% softirqs.CPU35.RCU 15466 +19.9% 18543 ± 2% softirqs.CPU35.SCHED 48547 +16.8% 56684 ± 3% softirqs.CPU35.TIMER 17422 ± 4% +36.2% 23721 ± 5% softirqs.CPU36.RCU 15474 +22.9% 19016 ± 3% softirqs.CPU36.SCHED 18024 ± 5% +25.0% 22537 ± 3% softirqs.CPU37.RCU 15591 ± 2% +21.2% 18892 ± 2% softirqs.CPU37.SCHED 49241 ± 2% +15.7% 56982 ± 3% softirqs.CPU37.TIMER 18270 ± 6% +23.0% 22468 ± 2% softirqs.CPU38.RCU 15698 +18.2% 18555 ± 2% softirqs.CPU38.SCHED 17354 ± 2% +29.0% 22393 ± 3% softirqs.CPU39.RCU 15582 +18.3% 18430 ± 4% softirqs.CPU39.SCHED 48135 ± 2% +35.5% 65242 ± 18% softirqs.CPU39.TIMER 21472 +30.6% 28049 softirqs.CPU4.RCU 15684 +20.5% 18896 ± 4% softirqs.CPU4.SCHED 49567 ± 2% +14.5% 56732 ± 4% softirqs.CPU4.TIMER 21886 +33.1% 29122 ± 8% softirqs.CPU5.RCU 15912 ± 4% +19.3% 18983 ± 4% softirqs.CPU5.SCHED 49334 ± 4% +17.3% 57889 ± 4% softirqs.CPU5.TIMER 22759 ± 12% +28.1% 29150 ± 3% softirqs.CPU6.RCU 15561 +23.0% 19144 softirqs.CPU6.SCHED 50896 +15.8% 58936 ± 3% softirqs.CPU6.TIMER 21754 ± 5% +26.8% 27588 ± 4% softirqs.CPU7.RCU 15439 +22.1% 18851 ± 3% softirqs.CPU7.SCHED 51023 ± 3% +12.0% 57169 ± 4% softirqs.CPU7.TIMER 21768 ± 3% +28.9% 28061 ± 3% softirqs.CPU8.RCU 15680 +24.5% 19522 ± 5% softirqs.CPU8.SCHED 48977 ± 2% +17.5% 57545 ± 3% softirqs.CPU8.TIMER 20951 +32.1% 27683 ± 4% softirqs.CPU9.RCU 15426 +20.8% 18638 ± 3% softirqs.CPU9.SCHED 48306 ± 3% +18.3% 57152 ± 3% softirqs.CPU9.TIMER 834261 ± 2% +31.2% 1094511 ± 3% softirqs.RCU 629022 +20.9% 760517 ± 2% softirqs.SCHED 2001302 +16.7% 2335824 ± 3% softirqs.TIMER 63.72 -11.9 51.82 perf-profile.calltrace.cycles-pp.write 54.54 -10.4 44.19 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 54.05 -10.3 43.78 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 45.97 -9.1 36.91 ± 2% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 44.57 -8.8 35.77 ± 2% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 38.87 -7.6 31.22 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 36.73 -7.1 29.68 ± 3% perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 29.28 -5.2 24.09 ± 3% perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 29.00 -5.1 23.86 ± 3% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write 21.42 -4.1 17.29 ± 2% perf-profile.calltrace.cycles-pp.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 9.82 -2.0 7.84 ± 2% perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 10.19 -1.6 8.57 ± 4% perf-profile.calltrace.cycles-pp.lseek64 3.70 -1.5 2.15 ± 4% perf-profile.calltrace.cycles-pp.close 3.64 -1.5 2.13 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close 3.64 -1.5 2.13 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 3.62 -1.5 2.11 ± 3% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 3.60 -1.5 2.10 ± 3% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 3.60 -1.5 2.11 ± 3% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 3.48 -1.5 1.99 ± 4% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 3.46 -1.5 1.98 ± 3% perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop 7.25 ± 2% -1.5 5.77 perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 6.93 -1.4 5.53 perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply 4.82 ± 2% -1.2 3.59 ± 4% perf-profile.calltrace.cycles-pp.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 4.07 ± 2% -0.9 3.16 perf-profile.calltrace.cycles-pp.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 5.73 -0.8 4.89 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.lseek64 3.46 ± 2% -0.8 2.65 perf-profile.calltrace.cycles-pp.copyin.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply.iomap_file_buffered_write 5.57 ± 2% -0.8 4.76 ± 7% perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 4.54 ± 3% -0.8 3.74 ± 3% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 3.36 ± 3% -0.8 2.57 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.iov_iter_copy_from_user_atomic.iomap_write_actor.iomap_apply 4.53 -0.8 3.74 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.write 5.46 -0.8 4.69 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.lseek64 2.63 -0.7 1.91 ± 3% perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.__dentry_kill.dput.__fput 2.65 -0.7 1.93 ± 3% perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run 2.48 ± 4% -0.7 1.79 ± 8% perf-profile.calltrace.cycles-pp.file_update_time.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write 3.72 ± 2% -0.7 3.06 ± 2% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write 2.42 ± 4% -0.6 1.83 ± 8% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 4.57 ± 3% -0.6 3.98 ± 9% perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 2.68 ± 2% -0.6 2.10 perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 1.69 ± 7% -0.5 1.18 ± 10% perf-profile.calltrace.cycles-pp.xfs_vn_update_time.file_update_time.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write 1.52 ± 17% -0.5 1.03 ± 17% perf-profile.calltrace.cycles-pp.xfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 1.93 -0.4 1.49 ± 4% perf-profile.calltrace.cycles-pp.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.72 ± 6% -0.4 1.30 ± 6% perf-profile.calltrace.cycles-pp.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.92 ± 2% -0.4 1.51 ± 4% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 1.80 ± 5% -0.4 1.40 ± 7% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64 1.19 ± 2% -0.4 0.82 ± 12% perf-profile.calltrace.cycles-pp.__xfs_trans_commit.xfs_vn_update_time.file_update_time.xfs_file_aio_write_checks.xfs_file_buffered_aio_write 0.70 ± 24% -0.4 0.33 ±104% perf-profile.calltrace.cycles-pp.xfs_bmbt_to_iomap.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 1.13 ± 3% -0.4 0.77 ± 13% perf-profile.calltrace.cycles-pp.xfs_log_commit_cil.__xfs_trans_commit.xfs_vn_update_time.file_update_time.xfs_file_aio_write_checks 1.45 -0.4 1.10 ± 4% perf-profile.calltrace.cycles-pp.memset_erms.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply 1.84 -0.3 1.49 ± 5% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.lseek64 2.22 ± 2% -0.3 1.88 ± 4% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.lseek64 1.12 ± 3% -0.3 0.79 ± 3% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill 1.14 ± 3% -0.3 0.81 ± 3% perf-profile.calltrace.cycles-pp.__pagevec_release.truncate_inode_pages_range.evict.__dentry_kill.dput 0.71 ± 2% -0.3 0.40 ± 57% perf-profile.calltrace.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin 1.11 ± 4% -0.3 0.85 ± 7% perf-profile.calltrace.cycles-pp.xas_load.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 1.34 -0.3 1.08 ± 3% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 1.06 ± 2% -0.2 0.84 ± 3% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 0.66 ± 3% -0.2 0.43 ± 57% perf-profile.calltrace.cycles-pp.disk_rw 1.08 ± 4% -0.2 0.88 ± 5% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 0.76 -0.2 0.57 ± 5% perf-profile.calltrace.cycles-pp.__lru_cache_add.add_to_page_cache_lru.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin 1.87 ± 3% -0.2 1.68 ± 4% perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.14 ± 6% -0.2 0.95 ± 3% perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 0.94 ± 6% -0.2 0.76 ± 4% perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 0.78 ± 9% -0.2 0.61 ± 5% perf-profile.calltrace.cycles-pp.xfs_iext_lookup_extent.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write 0.72 ± 7% -0.2 0.56 ± 3% perf-profile.calltrace.cycles-pp.xfs_break_layouts.xfs_file_aio_write_checks.xfs_file_buffered_aio_write.new_sync_write.vfs_write 0.69 ± 6% -0.2 0.53 ± 4% perf-profile.calltrace.cycles-pp.__set_page_dirty.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply 0.94 ± 5% -0.2 0.79 ± 7% perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply 0.78 ± 6% -0.2 0.62 ± 4% perf-profile.calltrace.cycles-pp.down_write.xfs_ilock.xfs_file_buffered_aio_write.new_sync_write.vfs_write 0.86 ± 2% +0.4 1.23 ± 3% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_open 0.89 ± 2% +0.4 1.25 ± 2% perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_open.do_syscall_64 1.59 ± 2% +0.5 2.13 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 1.58 ± 2% +0.5 2.13 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 1.57 +0.5 2.12 ± 5% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 1.54 ± 2% +0.6 2.09 ± 5% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.61 +0.6 2.17 ± 5% perf-profile.calltrace.cycles-pp.creat 1.54 ± 2% +0.6 2.10 ± 5% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 0.00 +0.6 0.57 ± 10% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 0.00 +0.6 0.62 ± 5% perf-profile.calltrace.cycles-pp.xfs_check_agi_freecount.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc 0.00 +0.7 0.69 ± 4% perf-profile.calltrace.cycles-pp.xfs_dialloc_ag.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create 0.00 +0.7 0.74 ± 3% perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create 0.00 +0.8 0.79 ± 2% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open 0.00 +0.8 0.79 ± 2% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat 0.00 +1.1 1.08 ± 7% perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle 0.00 +1.1 1.15 ± 7% perf-profile.calltrace.cycles-pp.apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 16.68 ± 2% +11.8 28.47 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 16.49 ± 4% +12.5 29.02 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 16.51 ± 4% +12.6 29.09 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 16.96 ± 4% +12.9 29.88 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 16.96 ± 4% +12.9 29.89 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 16.96 ± 4% +12.9 29.89 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 17.71 +13.0 30.74 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64 67.26 -12.2 55.10 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 66.62 -12.1 54.57 ± 2% perf-profile.children.cycles-pp.do_syscall_64 64.32 -12.0 52.29 perf-profile.children.cycles-pp.write 45.98 -9.1 36.93 ± 2% perf-profile.children.cycles-pp.ksys_write 44.63 -8.8 35.81 ± 2% perf-profile.children.cycles-pp.vfs_write 38.90 -7.7 31.25 ± 2% perf-profile.children.cycles-pp.new_sync_write 36.78 -7.1 29.72 ± 3% perf-profile.children.cycles-pp.xfs_file_buffered_aio_write 29.30 -5.2 24.10 ± 3% perf-profile.children.cycles-pp.iomap_file_buffered_write 29.06 -5.2 23.91 ± 4% perf-profile.children.cycles-pp.iomap_apply 21.54 -4.2 17.38 ± 2% perf-profile.children.cycles-pp.iomap_write_actor 9.86 -2.0 7.88 ± 2% perf-profile.children.cycles-pp.iomap_write_begin 10.49 -1.7 8.81 ± 4% perf-profile.children.cycles-pp.lseek64 3.70 -1.5 2.15 ± 4% perf-profile.children.cycles-pp.close 3.63 -1.5 2.12 ± 3% perf-profile.children.cycles-pp.exit_to_usermode_loop 3.60 -1.5 2.10 ± 3% perf-profile.children.cycles-pp.__fput 3.60 -1.5 2.11 ± 3% perf-profile.children.cycles-pp.task_work_run 3.48 -1.5 2.00 ± 4% perf-profile.children.cycles-pp.dput 7.29 ± 2% -1.5 5.80 perf-profile.children.cycles-pp.grab_cache_page_write_begin 3.46 -1.5 1.98 ± 3% perf-profile.children.cycles-pp.__dentry_kill 6.98 -1.4 5.57 perf-profile.children.cycles-pp.pagecache_get_page 4.87 ± 2% -1.2 3.63 ± 5% perf-profile.children.cycles-pp.xfs_file_aio_write_checks 6.78 -1.1 5.67 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64 6.23 -1.1 5.12 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret 4.10 ± 2% -0.9 3.17 perf-profile.children.cycles-pp.iov_iter_copy_from_user_atomic 3.49 ± 2% -0.8 2.67 perf-profile.children.cycles-pp.copyin 5.63 ± 2% -0.8 4.82 ± 7% perf-profile.children.cycles-pp.xfs_file_iomap_begin 4.58 ± 3% -0.8 3.77 ± 3% perf-profile.children.cycles-pp.iomap_write_end 3.38 ± 2% -0.8 2.59 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 2.65 -0.7 1.93 ± 3% perf-profile.children.cycles-pp.evict 2.63 -0.7 1.92 ± 4% perf-profile.children.cycles-pp.truncate_inode_pages_range 2.50 ± 4% -0.7 1.81 ± 8% perf-profile.children.cycles-pp.file_update_time 4.65 ± 3% -0.6 4.04 ± 10% perf-profile.children.cycles-pp.xfs_file_iomap_begin_delay 2.44 ± 4% -0.6 1.84 ± 8% perf-profile.children.cycles-pp.security_file_permission 2.71 ± 2% -0.6 2.12 perf-profile.children.cycles-pp.find_get_entry 1.69 ± 7% -0.5 1.18 ± 10% perf-profile.children.cycles-pp.xfs_vn_update_time 1.53 ± 17% -0.5 1.04 ± 18% perf-profile.children.cycles-pp.xfs_file_write_iter 1.94 -0.4 1.50 ± 4% perf-profile.children.cycles-pp.iomap_read_page_sync 1.76 ± 6% -0.4 1.33 ± 5% perf-profile.children.cycles-pp.iomap_set_page_dirty 1.20 ± 2% -0.4 0.77 ± 8% perf-profile.children.cycles-pp._raw_spin_lock 0.89 -0.4 0.46 ± 8% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 1.83 ± 5% -0.4 1.42 ± 7% perf-profile.children.cycles-pp.selinux_file_permission 1.92 ± 2% -0.4 1.52 ± 4% perf-profile.children.cycles-pp.add_to_page_cache_lru 2.17 ± 5% -0.4 1.81 ± 3% perf-profile.children.cycles-pp.xfs_ilock 1.84 -0.4 1.48 ± 14% perf-profile.children.cycles-pp.xfs_log_commit_cil 1.19 ± 3% -0.3 0.85 ± 3% perf-profile.children.cycles-pp.release_pages 1.47 -0.3 1.13 ± 4% perf-profile.children.cycles-pp.memset_erms 1.81 ± 5% -0.3 1.47 ± 6% perf-profile.children.cycles-pp.down_write 1.14 ± 3% -0.3 0.81 ± 3% perf-profile.children.cycles-pp.__pagevec_release 1.34 ± 4% -0.3 1.05 ± 5% perf-profile.children.cycles-pp.xas_load 1.36 ± 2% -0.3 1.11 ± 4% perf-profile.children.cycles-pp.__alloc_pages_nodemask 2.25 ± 4% -0.3 2.00 ± 4% perf-profile.children.cycles-pp.iomap_set_range_uptodate 1.08 ± 2% -0.2 0.86 ± 4% perf-profile.children.cycles-pp.get_page_from_freelist 0.77 -0.2 0.57 ± 4% perf-profile.children.cycles-pp.__lru_cache_add 1.10 ± 4% -0.2 0.90 ± 5% perf-profile.children.cycles-pp.__add_to_page_cache_locked 0.73 -0.2 0.53 ± 7% perf-profile.children.cycles-pp.pagevec_lru_move_fn 1.35 ± 3% -0.2 1.18 ± 6% perf-profile.children.cycles-pp.___might_sleep 0.80 ± 8% -0.2 0.62 ± 5% perf-profile.children.cycles-pp.xfs_iext_lookup_extent 0.81 ± 4% -0.2 0.63 ± 6% perf-profile.children.cycles-pp.__might_sleep 0.75 ± 7% -0.2 0.58 ± 3% perf-profile.children.cycles-pp.xfs_break_layouts 0.62 ± 5% -0.2 0.45 ± 4% perf-profile.children.cycles-pp.free_unref_page_list 0.70 ± 6% -0.2 0.53 ± 4% perf-profile.children.cycles-pp.__set_page_dirty 0.56 ± 3% -0.2 0.39 ± 7% perf-profile.children.cycles-pp.truncate_cleanup_page 0.59 ± 7% -0.2 0.43 ± 5% perf-profile.children.cycles-pp.generic_write_checks 1.16 ± 5% -0.2 1.00 ± 5% perf-profile.children.cycles-pp.xfs_iunlock 0.46 ± 4% -0.1 0.32 ± 9% perf-profile.children.cycles-pp.__cancel_dirty_page 0.53 ± 10% -0.1 0.39 ± 11% perf-profile.children.cycles-pp.xas_start 0.60 ± 5% -0.1 0.46 ± 6% perf-profile.children.cycles-pp.delete_from_page_cache_batch 0.50 ± 5% -0.1 0.36 ± 8% perf-profile.children.cycles-pp.__pagevec_lru_add_fn 0.72 ± 10% -0.1 0.59 ± 6% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.44 ± 5% -0.1 0.30 ± 7% perf-profile.children.cycles-pp.free_pcppages_bulk 0.78 ± 5% -0.1 0.65 ± 3% perf-profile.children.cycles-pp.up_write 0.74 ± 3% -0.1 0.61 ± 3% perf-profile.children.cycles-pp._cond_resched 0.39 ± 8% -0.1 0.27 ± 15% perf-profile.children.cycles-pp.__mod_lruvec_state 0.47 ± 2% -0.1 0.35 ± 6% perf-profile.children.cycles-pp.current_time 0.71 ± 3% -0.1 0.58 ± 7% perf-profile.children.cycles-pp.disk_rw 0.57 ± 8% -0.1 0.46 ± 6% perf-profile.children.cycles-pp.xas_store 0.42 ± 13% -0.1 0.30 ± 9% perf-profile.children.cycles-pp.xfs_trans_reserve 0.61 ± 15% -0.1 0.49 ± 6% perf-profile.children.cycles-pp.__inode_security_revalidate 0.44 ± 4% -0.1 0.33 ± 3% perf-profile.children.cycles-pp.account_page_dirtied 0.43 ± 5% -0.1 0.33 ± 13% perf-profile.children.cycles-pp.iov_iter_advance 0.42 ± 3% -0.1 0.33 ± 7% perf-profile.children.cycles-pp.__list_del_entry_valid 0.34 ± 6% -0.1 0.24 ± 9% perf-profile.children.cycles-pp.account_page_cleaned 0.43 ± 9% -0.1 0.35 ± 5% perf-profile.children.cycles-pp.xfs_break_leased_layouts 0.22 ± 11% -0.1 0.14 ± 11% perf-profile.children.cycles-pp.xlog_grant_add_space 0.35 ± 5% -0.1 0.27 perf-profile.children.cycles-pp.file_remove_privs 0.38 ± 9% -0.1 0.30 ± 5% perf-profile.children.cycles-pp.file_modified 0.32 ± 15% -0.1 0.24 ± 3% perf-profile.children.cycles-pp.generic_write_check_limits 0.35 ± 5% -0.1 0.28 ± 9% perf-profile.children.cycles-pp.unlock_page 0.44 ± 6% -0.1 0.36 ± 10% perf-profile.children.cycles-pp.__x64_sys_write 0.17 ± 4% -0.1 0.11 ± 20% perf-profile.children.cycles-pp.__mod_memcg_state 0.24 ± 8% -0.1 0.19 ± 14% perf-profile.children.cycles-pp.__x64_sys_lseek 0.11 ± 22% -0.1 0.05 ± 70% perf-profile.children.cycles-pp.xfs_find_daxdev_for_inode 0.36 ± 4% -0.1 0.31 perf-profile.children.cycles-pp.rcu_all_qs 0.24 ± 6% -0.1 0.19 ± 15% perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry 0.12 ± 4% -0.1 0.07 ± 17% perf-profile.children.cycles-pp.xfs_isilocked 0.23 ± 10% -0.0 0.18 ± 12% perf-profile.children.cycles-pp.node_dirty_ok 0.16 ± 12% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.timespec64_trunc 0.18 ± 9% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.find_get_entries 0.18 ± 9% -0.0 0.14 ± 5% perf-profile.children.cycles-pp.pagevec_lookup_entries 0.22 ± 5% -0.0 0.17 ± 16% perf-profile.children.cycles-pp.percpu_counter_add_batch 0.16 ± 9% -0.0 0.12 ± 15% perf-profile.children.cycles-pp.__xa_set_mark 0.30 ± 2% -0.0 0.26 ± 9% perf-profile.children.cycles-pp.page_mapping 0.14 ± 15% -0.0 0.10 ± 17% perf-profile.children.cycles-pp.wake_up_q 0.19 ± 12% -0.0 0.15 ± 5% perf-profile.children.cycles-pp.fpregs_assert_state_consistent 0.18 ± 6% -0.0 0.14 ± 10% perf-profile.children.cycles-pp.__mod_node_page_state 0.12 ± 15% -0.0 0.08 ± 19% perf-profile.children.cycles-pp.unaccount_page_cache_page 0.22 ± 3% -0.0 0.19 ± 10% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.11 ± 10% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.ktime_get_coarse_real_ts64 0.08 ± 6% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.xfs_mod_fdblocks 0.08 ± 6% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.xfs_bmap_add_extent_hole_delay 0.07 ± 17% -0.0 0.06 ± 15% perf-profile.children.cycles-pp.__mark_inode_dirty 0.09 ± 9% +0.0 0.12 ± 14% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.03 ±100% +0.1 0.08 ± 20% perf-profile.children.cycles-pp.run_timer_softirq 0.09 ± 28% +0.1 0.14 ± 9% perf-profile.children.cycles-pp.rcu_core 0.06 ± 13% +0.1 0.12 ± 7% perf-profile.children.cycles-pp.xfs_iunlink 0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.__remove_hrtimer 0.04 ± 59% +0.1 0.12 ± 16% perf-profile.children.cycles-pp.update_blocked_averages 0.05 ± 61% +0.1 0.12 ± 22% perf-profile.children.cycles-pp.rebalance_domains 0.05 ± 58% +0.1 0.12 ± 18% perf-profile.children.cycles-pp.run_rebalance_domains 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.tick_nohz_next_event 0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.irq_enter 0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.46 ± 6% +0.1 0.58 ± 6% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.11 ± 17% +0.1 0.23 ± 17% perf-profile.children.cycles-pp.ktime_get 0.12 ± 21% +0.1 0.25 ± 23% perf-profile.children.cycles-pp.clockevents_program_event 0.00 +0.1 0.15 ± 72% perf-profile.children.cycles-pp.xfs_verify_agino 0.04 ± 60% +0.2 0.26 ± 71% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs 0.11 ± 4% +0.2 0.34 ± 17% perf-profile.children.cycles-pp.menu_select 0.15 ± 42% +0.3 0.41 ± 21% perf-profile.children.cycles-pp.osq_lock 0.26 ± 33% +0.3 0.52 ± 11% perf-profile.children.cycles-pp.__softirqentry_text_start 0.64 ± 33% +0.3 0.92 ± 6% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.30 ± 29% +0.3 0.59 ± 9% perf-profile.children.cycles-pp.irq_exit 0.76 ± 10% +0.3 1.08 ± 12% perf-profile.children.cycles-pp.rwsem_down_write_slowpath 0.63 ± 12% +0.4 0.99 ± 11% perf-profile.children.cycles-pp.rwsem_optimistic_spin 0.86 ± 2% +0.4 1.23 ± 3% perf-profile.children.cycles-pp.xfs_create 0.89 ± 2% +0.4 1.25 ± 2% perf-profile.children.cycles-pp.xfs_generic_create 0.34 ± 6% +0.4 0.74 ± 3% perf-profile.children.cycles-pp.xfs_dialloc 0.28 ± 7% +0.4 0.69 ± 4% perf-profile.children.cycles-pp.xfs_dialloc_ag 0.38 ± 6% +0.4 0.79 ± 2% perf-profile.children.cycles-pp.xfs_dir_ialloc 0.38 ± 6% +0.4 0.79 ± 2% perf-profile.children.cycles-pp.xfs_ialloc 0.12 ± 19% +0.4 0.55 ± 68% perf-profile.children.cycles-pp.xfs_btree_get_rec 0.12 ± 7% +0.4 0.55 ± 70% perf-profile.children.cycles-pp.xfs_btree_increment 0.10 ± 27% +0.4 0.55 ± 70% perf-profile.children.cycles-pp.__xfs_btree_check_sblock 0.88 ± 27% +0.5 1.33 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt 1.67 +0.5 2.20 ± 5% perf-profile.children.cycles-pp.do_sys_open 1.61 ± 2% +0.6 2.16 ± 5% perf-profile.children.cycles-pp.do_filp_open 1.61 +0.6 2.17 ± 5% perf-profile.children.cycles-pp.creat 1.61 ± 2% +0.6 2.16 ± 5% perf-profile.children.cycles-pp.path_openat 0.15 ± 23% +0.6 0.76 ± 69% perf-profile.children.cycles-pp.xfs_btree_check_sblock 0.20 ± 6% +0.7 0.89 ± 70% perf-profile.children.cycles-pp.xfs_inobt_get_rec 1.25 ± 27% +0.8 2.07 ± 8% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 1.36 ± 26% +0.9 2.23 ± 8% perf-profile.children.cycles-pp.apic_timer_interrupt 0.41 ± 4% +1.1 1.54 ± 68% perf-profile.children.cycles-pp.xfs_check_agi_freecount 0.06 ± 64% +1.6 1.62 ±107% perf-profile.children.cycles-pp.worker_thread 0.06 ± 64% +1.6 1.62 ±107% perf-profile.children.cycles-pp.process_one_work 0.07 ± 59% +1.6 1.66 ±105% perf-profile.children.cycles-pp.kthread 0.07 ± 59% +1.6 1.66 ±105% perf-profile.children.cycles-pp.ret_from_fork 16.80 ± 2% +11.7 28.49 ± 2% perf-profile.children.cycles-pp.intel_idle 17.24 +12.7 29.90 ± 2% perf-profile.children.cycles-pp.cpuidle_enter_state 17.24 +12.7 29.91 ± 2% perf-profile.children.cycles-pp.cpuidle_enter 16.96 ± 4% +12.9 29.89 perf-profile.children.cycles-pp.start_secondary 17.71 +13.0 30.74 ± 2% perf-profile.children.cycles-pp.do_idle 17.71 +13.0 30.74 ± 2% perf-profile.children.cycles-pp.secondary_startup_64 17.71 +13.0 30.74 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry 11.21 -1.7 9.51 ± 3% perf-profile.self.cycles-pp.do_syscall_64 6.22 -1.1 5.11 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret 6.11 -1.0 5.14 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64 3.33 ± 3% -0.8 2.53 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.47 ± 18% -0.5 1.00 ± 18% perf-profile.self.cycles-pp.xfs_file_write_iter 0.89 -0.4 0.46 ± 8% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 1.10 ± 8% -0.4 0.75 ± 6% perf-profile.self.cycles-pp.xfs_file_buffered_aio_write 1.46 -0.3 1.11 ± 3% perf-profile.self.cycles-pp.memset_erms 1.53 ± 3% -0.3 1.21 ± 2% perf-profile.self.cycles-pp.find_get_entry 1.18 ± 5% -0.3 0.87 ± 8% perf-profile.self.cycles-pp.selinux_file_permission 2.19 ± 4% -0.2 1.96 ± 3% perf-profile.self.cycles-pp.iomap_set_range_uptodate 0.83 ± 5% -0.2 0.65 ± 5% perf-profile.self.cycles-pp.iomap_apply 1.31 ± 3% -0.2 1.13 ± 7% perf-profile.self.cycles-pp.___might_sleep 0.60 ± 6% -0.2 0.42 ± 10% perf-profile.self.cycles-pp.security_file_permission 0.77 ± 9% -0.2 0.60 ± 5% perf-profile.self.cycles-pp.xfs_iext_lookup_extent 0.81 ± 5% -0.2 0.65 ± 6% perf-profile.self.cycles-pp.xas_load 0.84 ± 6% -0.2 0.69 ± 9% perf-profile.self.cycles-pp.xfs_file_iomap_begin 0.72 ± 3% -0.2 0.57 ± 4% perf-profile.self.cycles-pp.write 0.71 ± 4% -0.1 0.56 ± 5% perf-profile.self.cycles-pp.__might_sleep 0.49 ± 11% -0.1 0.36 ± 11% perf-profile.self.cycles-pp.xas_start 0.76 ± 3% -0.1 0.63 ± 7% perf-profile.self.cycles-pp.down_write 0.66 ± 8% -0.1 0.54 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.72 ± 6% -0.1 0.60 ± 4% perf-profile.self.cycles-pp.up_write 0.65 -0.1 0.53 ± 4% perf-profile.self.cycles-pp.iomap_write_end 0.60 ± 8% -0.1 0.48 ± 8% perf-profile.self.cycles-pp.iov_iter_copy_from_user_atomic 0.58 ± 4% -0.1 0.48 ± 10% perf-profile.self.cycles-pp.vfs_write 0.65 ± 3% -0.1 0.55 ± 5% perf-profile.self.cycles-pp.iov_iter_fault_in_readable 0.52 ± 8% -0.1 0.42 ± 5% perf-profile.self.cycles-pp.pagecache_get_page 0.41 ± 6% -0.1 0.31 ± 11% perf-profile.self.cycles-pp.iov_iter_advance 0.28 ± 6% -0.1 0.18 ± 11% perf-profile.self.cycles-pp.generic_write_checks 0.42 ± 3% -0.1 0.32 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid 0.31 ± 9% -0.1 0.22 ± 5% perf-profile.self.cycles-pp.free_pcppages_bulk 0.50 ± 4% -0.1 0.41 ± 7% perf-profile.self.cycles-pp.disk_rw 0.29 ± 5% -0.1 0.20 ± 9% perf-profile.self.cycles-pp.__pagevec_lru_add_fn 0.22 ± 11% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.xlog_grant_add_space 0.34 ± 5% -0.1 0.27 ± 8% perf-profile.self.cycles-pp.unlock_page 0.41 ± 8% -0.1 0.33 ± 5% perf-profile.self.cycles-pp.xfs_break_leased_layouts 0.42 ± 13% -0.1 0.34 ± 17% perf-profile.self.cycles-pp.new_sync_write 0.33 ± 7% -0.1 0.25 ± 2% perf-profile.self.cycles-pp.file_remove_privs 0.36 -0.1 0.28 ± 7% perf-profile.self.cycles-pp.lseek64 0.30 ± 17% -0.1 0.23 ± 4% perf-profile.self.cycles-pp.generic_write_check_limits 0.23 ± 9% -0.1 0.16 ± 5% perf-profile.self.cycles-pp.xfs_break_layouts 0.22 ± 8% -0.1 0.15 ± 7% perf-profile.self.cycles-pp.__fdget_pos 0.33 ± 10% -0.1 0.26 ± 5% perf-profile.self.cycles-pp.file_update_time 0.17 ± 13% -0.1 0.10 ± 12% perf-profile.self.cycles-pp.__mod_lruvec_state 0.40 ± 3% -0.1 0.34 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist 0.25 ± 10% -0.1 0.19 ± 2% perf-profile.self.cycles-pp.xas_store 0.43 ± 2% -0.1 0.37 ± 9% perf-profile.self.cycles-pp._raw_spin_lock 0.22 ± 3% -0.1 0.17 ± 12% perf-profile.self.cycles-pp.current_time 0.21 ± 8% -0.1 0.16 ± 11% perf-profile.self.cycles-pp.__x64_sys_lseek 0.21 ± 10% -0.1 0.16 ± 8% perf-profile.self.cycles-pp.release_pages 0.28 ± 9% -0.1 0.22 perf-profile.self.cycles-pp.rcu_all_qs 0.37 ± 7% -0.1 0.32 ± 10% perf-profile.self.cycles-pp.__x64_sys_write 0.35 ± 6% -0.1 0.30 ± 3% perf-profile.self.cycles-pp._cond_resched 0.16 ± 5% -0.0 0.11 ± 20% perf-profile.self.cycles-pp.__mod_memcg_state 0.14 ± 5% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.account_page_cleaned 0.07 ± 11% -0.0 0.03 ±100% perf-profile.self.cycles-pp.alloc_pages_current 0.22 ± 3% -0.0 0.17 ± 7% perf-profile.self.cycles-pp.__add_to_page_cache_locked 0.21 ± 13% -0.0 0.16 ± 10% perf-profile.self.cycles-pp.ksys_lseek 0.37 ± 5% -0.0 0.33 ± 6% perf-profile.self.cycles-pp.ksys_write 0.30 ± 4% -0.0 0.26 ± 10% perf-profile.self.cycles-pp.page_mapping 0.18 ± 12% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.xfs_log_commit_cil 0.14 ± 17% -0.0 0.10 ± 15% perf-profile.self.cycles-pp.account_page_dirtied 0.15 ± 10% -0.0 0.11 ± 7% perf-profile.self.cycles-pp.find_get_entries 0.17 ± 6% -0.0 0.13 ± 10% perf-profile.self.cycles-pp.__mod_node_page_state 0.11 ± 7% -0.0 0.07 ± 17% perf-profile.self.cycles-pp.xfs_isilocked 0.07 ± 14% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__mark_inode_dirty 0.09 ± 12% -0.0 0.05 ± 60% perf-profile.self.cycles-pp.__cancel_dirty_page 0.09 ± 11% -0.0 0.06 ± 58% perf-profile.self.cycles-pp.__x86_indirect_thunk_r15 0.17 ± 13% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.fpregs_assert_state_consistent 0.13 ± 11% -0.0 0.09 ± 20% perf-profile.self.cycles-pp.workingset_update_node 0.14 ± 7% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.timespec64_trunc 0.11 ± 9% -0.0 0.08 ± 19% perf-profile.self.cycles-pp.truncate_inode_pages_range 0.10 ± 15% -0.0 0.07 ± 12% perf-profile.self.cycles-pp.iomap_read_page_sync 0.07 ± 12% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.mem_cgroup_commit_charge 0.10 ± 8% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.ktime_get_coarse_real_ts64 0.09 ± 8% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.delete_from_page_cache_batch 0.09 ± 9% -0.0 0.07 ± 16% perf-profile.self.cycles-pp.xfs_dir3_data_entsize 0.11 ± 4% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.copyin 0.00 +0.1 0.11 ± 14% perf-profile.self.cycles-pp.cpuidle_enter_state 0.06 ± 58% +0.1 0.16 ± 22% perf-profile.self.cycles-pp.ktime_get 0.07 ± 5% +0.1 0.19 ± 15% perf-profile.self.cycles-pp.menu_select 0.45 ± 5% +0.1 0.57 ± 6% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.04 ± 60% +0.2 0.22 ± 72% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs 0.04 ± 58% +0.2 0.29 ± 68% perf-profile.self.cycles-pp.__xfs_btree_check_sblock 0.14 ± 36% +0.3 0.41 ± 22% perf-profile.self.cycles-pp.osq_lock 16.78 ± 2% +11.7 28.46 ± 2% perf-profile.self.cycles-pp.intel_idle aim7.jobs-per-min 160000 +-+----------------------------------------------------------------+ 155000 +-+ + | | : + | 150000 +-+ :: :: | 145000 +-+ : : : : | | : : .+. : : .+.| 140000 +-+.+.++.+.+.+.+.+ +.+.+ +.+.+.++.+.+. .+.+.++.+. .+ +.++.+ | 135000 +-+ + + | 130000 +-+ | | | 125000 +-+ | 120000 +-+ | | O | 115000 O-O O OO O O O O O OO O O O O O O | 110000 +-+----------------------------------------------------------------+ aim7.time.elapsed_time 165 +-+-------------------------------------------------------------------+ 160 O-O O O O O O O O OO O | | O O O O O O | 155 +-+ O | 150 +-+ | | | 145 +-+ | 140 +-+ | 135 +-+ | |.+. .+.+. .+.+.+. .+. .+.+.+.+.+.++. | 130 +-+ + + + +.+.+.+.+.+.+.+.+ + + +.+.+.+.+.| 125 +-+ : : : : | | :: : : | 120 +-+ :: + | 115 +-+-------------------------------------------------------------------+ aim7.time.elapsed_time.max 165 +-+-------------------------------------------------------------------+ 160 O-O O O O O O O O OO O | | O O O O O O | 155 +-+ O | 150 +-+ | | | 145 +-+ | 140 +-+ | 135 +-+ | |.+. .+.+. .+.+.+. .+. .+.+.+.+.+.++. | 130 +-+ + + + +.+.+.+.+.+.+.+.+ + + +.+.+.+.+.| 125 +-+ : : : : | | :: : : | 120 +-+ :: + | 115 +-+-------------------------------------------------------------------+ aim7.time.voluntary_context_switches 1.1e+06 +-+--------------------------------------------------------------+ | | 1.05e+06 +-+.++.+.+.+.++.+.+.+.++.+.+.+.+.++.+.+.+.++.+.+.+.++.+.+.+.++.+.| | | 1e+06 +-+ | | | 950000 +-+ | | | 900000 +-+ | | | 850000 O-+ O O O | | O OO O O O O O O OO O O O | 800000 +-+ O | | | 750000 +-+--------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-ivb-ep01: 40 threads Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz with 384G memory ========================================================================================= compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase: gcc-7/performance/4BRD_12G/xfs/x86_64-rhel-7.6/3000/RAID0/debian-x86_64-2019-05-14.cgz/lkp-ivb-ep01/disk_cp/aim7 commit: d515962b00 ("xfs: pass around xfs_inode_ag_walk iget/irele helper functions") 1aabb011bf ("xfs: deferred inode inactivation") d515962b00d64454 1aabb011bfba5a8942d3e0d0c84 ---------------- --------------------------- %stddev %change %stddev \ | \ 204959 -35.7% 131770 ± 3% aim7.jobs-per-min 88.12 +55.7% 137.19 ± 3% aim7.time.elapsed_time 88.12 +55.7% 137.19 ± 3% aim7.time.elapsed_time.max 72330 ± 3% +12.2% 81167 ± 4% aim7.time.involuntary_context_switches 151188 +6.4% 160846 ± 2% aim7.time.minor_page_faults 2437 +33.6% 3257 ± 3% aim7.time.system_time 305.87 +45.8% 446.05 ± 5% aim7.time.user_time 737855 -13.0% 642174 ± 3% aim7.time.voluntary_context_switches 22.63 +9.0 31.68 mpstat.cpu.all.idle% 68.59 -8.5 60.06 mpstat.cpu.all.sys% 61676265 ± 55% +177.3% 1.711e+08 ± 18% cpuidle.C1.time 612540 ± 47% +231.9% 2032764 ± 14% cpuidle.C1.usage 5.694e+08 ± 13% +157.5% 1.466e+09 ± 6% cpuidle.C6.time 872994 ± 2% +116.8% 1892610 ± 6% cpuidle.C6.usage 23.75 ± 3% +34.7% 32.00 ± 2% vmstat.cpu.id 66.75 -11.6% 59.00 vmstat.cpu.sy 1534 ± 26% +87.2% 2873 ± 8% vmstat.io.bo 17277 ± 2% -14.2% 14823 vmstat.system.cs 24.17 +34.6% 32.54 iostat.cpu.idle 67.23 -11.8% 59.31 iostat.cpu.system 8.60 -5.2% 8.15 iostat.cpu.user 46.02 ± 5% +114.0% 98.46 ± 3% iostat.md0.w/s 1601 ± 25% +86.8% 2991 ± 7% iostat.md0.wkB/s 81296 ± 2% +47.8% 120146 ± 2% meminfo.AnonHugePages 16049 ± 7% -14.2% 13766 meminfo.Dirty 16741 ± 6% -13.7% 14450 ± 2% meminfo.Inactive(file) 91250 +22.9% 112105 meminfo.KReclaimable 109853 ± 5% -7.0% 102116 ± 8% meminfo.PageTables 91250 +22.9% 112105 meminfo.SReclaimable 36157 ± 2% -12.9% 31489 ± 4% meminfo.Shmem 255575 +14.2% 291816 meminfo.Slab 27539 -34.1% 18158 ± 4% meminfo.max_used_kB 2265 -45.2% 1241 ± 7% turbostat.Avg_MHz 77.95 -8.8 69.19 turbostat.Busy% 2905 -38.3% 1793 ± 7% turbostat.Bzy_MHz 608401 ± 47% +233.6% 2029542 ± 15% turbostat.C1 3.84 ± 73% -3.2 0.68 ± 7% turbostat.C3% 868860 ± 2% +117.3% 1888276 ± 6% turbostat.C6 15.87 ± 13% +10.5 26.42 ± 2% turbostat.C6% 14.37 ± 8% +46.5% 21.05 turbostat.CPU%c1 6.78 ± 20% +41.9% 9.62 ± 4% turbostat.CPU%c6 121.47 -44.3% 67.72 ± 8% turbostat.CorWatt 7419316 +52.0% 11279514 ± 4% turbostat.IRQ 3.43 ± 19% -31.4% 2.35 ± 19% turbostat.Pkg%pc2 71.50 -4.0% 68.67 turbostat.PkgTmp 148.87 -36.5% 94.53 ± 6% turbostat.PkgWatt 36.86 -5.5% 34.83 turbostat.RAMWatt 7146 +55.8% 11133 ± 3% turbostat.SMI 623.50 ±105% +220.2% 1996 ± 37% numa-meminfo.node0.Active(file) 8186 ± 3% -17.1% 6789 numa-meminfo.node0.Dirty 15459 ± 10% -26.0% 11435 ± 5% numa-meminfo.node0.Inactive 7151 ± 19% -41.4% 4190 ± 21% numa-meminfo.node0.Inactive(anon) 8307 ± 3% -12.8% 7245 ± 4% numa-meminfo.node0.Inactive(file) 1057156 ± 15% +30.0% 1374548 ± 4% numa-meminfo.node0.MemUsed 27710 ±145% +258.8% 99419 ± 8% numa-meminfo.node0.PageTables 65500 ± 45% +93.9% 126976 numa-meminfo.node0.SUnreclaim 113557 ± 26% +57.4% 178704 ± 6% numa-meminfo.node0.Slab 1849 ± 35% -72.2% 513.33 ±141% numa-meminfo.node1.Active(file) 8087 ± 6% -14.6% 6906 numa-meminfo.node1.Dirty 8654 ± 9% -17.9% 7105 ± 7% numa-meminfo.node1.Inactive(file) 43179 ± 16% +39.7% 60339 ± 13% numa-meminfo.node1.KReclaimable 38009 ± 50% -89.6% 3961 ± 9% numa-meminfo.node1.KernelStack 1284978 ± 12% -21.8% 1004429 ± 4% numa-meminfo.node1.MemUsed 81947 ± 54% -96.7% 2695 numa-meminfo.node1.PageTables 43179 ± 16% +39.7% 60339 ± 13% numa-meminfo.node1.SReclaimable 156.25 ±105% +218.3% 497.33 ± 37% numa-vmstat.node0.nr_active_file 16205972 ± 2% +14.6% 18577156 numa-vmstat.node0.nr_dirtied 2062 ± 3% -17.9% 1694 ± 3% numa-vmstat.node0.nr_dirty 1788 ± 19% -41.2% 1051 ± 21% numa-vmstat.node0.nr_inactive_anon 2090 ± 7% -13.2% 1814 ± 4% numa-vmstat.node0.nr_inactive_file 6975 ±145% +255.1% 24766 ± 8% numa-vmstat.node0.nr_page_table_pages 16397 ± 45% +93.3% 31699 numa-vmstat.node0.nr_slab_unreclaimable 156.25 ±105% +218.3% 497.33 ± 37% numa-vmstat.node0.nr_zone_active_file 1788 ± 19% -41.2% 1051 ± 21% numa-vmstat.node0.nr_zone_inactive_anon 2093 ± 7% -13.2% 1816 ± 4% numa-vmstat.node0.nr_zone_inactive_file 16642980 ± 3% +14.9% 19130375 numa-vmstat.node0.numa_hit 16605490 ± 2% +14.9% 19079593 numa-vmstat.node0.numa_local 461.25 ± 35% -72.2% 128.33 ±141% numa-vmstat.node1.nr_active_file 2046 -15.2% 1735 numa-vmstat.node1.nr_dirty 2184 ± 5% -18.2% 1786 ± 6% numa-vmstat.node1.nr_inactive_file 37823 ± 50% -89.5% 3960 ± 9% numa-vmstat.node1.nr_kernel_stack 20375 ± 54% -96.7% 672.67 numa-vmstat.node1.nr_page_table_pages 10793 ± 16% +39.7% 15083 ± 13% numa-vmstat.node1.nr_slab_reclaimable 461.25 ± 35% -72.2% 128.33 ±141% numa-vmstat.node1.nr_zone_active_file 2183 ± 5% -18.3% 1785 ± 6% numa-vmstat.node1.nr_zone_inactive_file 91478 -2.1% 89547 proc-vmstat.nr_active_anon 617.75 +1.5% 627.00 proc-vmstat.nr_active_file 4045 ± 2% -15.8% 3405 proc-vmstat.nr_dirty 5069 -3.6% 4888 proc-vmstat.nr_inactive_anon 4217 ± 2% -15.4% 3567 proc-vmstat.nr_inactive_file 53612 -1.9% 52592 proc-vmstat.nr_kernel_stack 6369 -3.5% 6149 proc-vmstat.nr_mapped 9055 ± 2% -13.1% 7871 ± 4% proc-vmstat.nr_shmem 22808 +22.8% 28015 proc-vmstat.nr_slab_reclaimable 41043 +9.4% 44903 proc-vmstat.nr_slab_unreclaimable 91478 -2.1% 89547 proc-vmstat.nr_zone_active_anon 617.75 +1.5% 627.00 proc-vmstat.nr_zone_active_file 5069 -3.6% 4888 proc-vmstat.nr_zone_inactive_anon 4217 ± 2% -15.4% 3567 proc-vmstat.nr_zone_inactive_file 3453 ± 2% -8.4% 3163 proc-vmstat.nr_zone_write_pending 1737 ±142% +716.8% 14190 ± 3% proc-vmstat.numa_hint_faults 2731 ±113% +389.5% 13370 ± 3% proc-vmstat.numa_pages_migrated 4460 ± 7% -39.5% 2697 ± 14% proc-vmstat.pgactivate 402077 +31.0% 526544 ± 2% proc-vmstat.pgfault 2731 ±113% +389.5% 13370 ± 3% proc-vmstat.pgmigrate_success 139264 ± 25% +188.9% 402269 ± 12% proc-vmstat.pgpgout 2856 +360.5% 13152 ± 3% slabinfo.dmaengine-unmap-16.active_objs 77.75 +589.0% 535.67 ± 3% slabinfo.dmaengine-unmap-16.active_slabs 3292 +584.1% 22520 ± 3% slabinfo.dmaengine-unmap-16.num_objs 77.75 +589.0% 535.67 ± 3% slabinfo.dmaengine-unmap-16.num_slabs 2332 ± 7% +39.7% 3257 slabinfo.kmalloc-128.active_objs 2332 ± 7% +39.7% 3257 slabinfo.kmalloc-128.num_objs 19136 +126.1% 43271 ± 3% slabinfo.kmalloc-16.active_objs 74.75 +139.5% 179.00 ± 3% slabinfo.kmalloc-16.active_slabs 19136 +140.5% 46024 ± 3% slabinfo.kmalloc-16.num_objs 74.75 +139.5% 179.00 ± 3% slabinfo.kmalloc-16.num_slabs 741.00 +24.5% 922.67 ± 2% slabinfo.kmalloc-4k.active_objs 751.25 +24.4% 934.67 ± 2% slabinfo.kmalloc-4k.num_objs 6130 +175.2% 16869 ± 2% slabinfo.kmalloc-512.active_objs 202.00 +207.8% 621.67 ± 2% slabinfo.kmalloc-512.active_slabs 6484 +207.0% 19906 ± 2% slabinfo.kmalloc-512.num_objs 202.00 +207.8% 621.67 ± 2% slabinfo.kmalloc-512.num_slabs 461.50 ± 2% +43.6% 662.67 slabinfo.kmalloc-8k.active_objs 476.25 ± 2% +54.5% 735.67 slabinfo.kmalloc-8k.num_objs 1160 +72.2% 1998 ± 2% slabinfo.xfs_buf_item.active_objs 1160 +72.2% 1998 ± 2% slabinfo.xfs_buf_item.num_objs 1186 +64.4% 1950 slabinfo.xfs_efd_item.active_objs 1186 +64.4% 1950 slabinfo.xfs_efd_item.num_objs 2168 +487.1% 12729 ± 3% slabinfo.xfs_inode.active_objs 87.50 +676.8% 679.67 ± 4% slabinfo.xfs_inode.active_slabs 2819 +671.9% 21761 ± 4% slabinfo.xfs_inode.num_objs 87.50 +676.8% 679.67 ± 4% slabinfo.xfs_inode.num_slabs 13.63 ± 4% -8.1% 12.53 perf-stat.i.MPKI 4.74e+09 -32.0% 3.224e+09 ± 4% perf-stat.i.branch-instructions 59710263 -29.8% 41920989 ± 3% perf-stat.i.branch-misses 24239162 ± 2% -29.6% 17056459 ± 6% perf-stat.i.cache-misses 2.448e+08 -32.9% 1.644e+08 ± 4% perf-stat.i.cache-references 17563 ± 2% -14.8% 14962 perf-stat.i.context-switches 3.90 ± 2% -22.0% 3.04 ± 3% perf-stat.i.cpi 9.031e+10 -45.5% 4.926e+10 ± 8% perf-stat.i.cpu-cycles 3006 -59.5% 1218 ± 2% perf-stat.i.cpu-migrations 3432 -23.3% 2633 perf-stat.i.cycles-between-cache-misses 1.64 ± 12% -0.4 1.25 ± 2% perf-stat.i.dTLB-load-miss-rate% 1.328e+08 ± 13% -50.8% 65422884 ± 5% perf-stat.i.dTLB-load-misses 7.404e+09 -31.8% 5.052e+09 ± 4% perf-stat.i.dTLB-loads 16794433 ± 5% -37.4% 10521517 ± 3% perf-stat.i.dTLB-store-misses 4.914e+09 -32.9% 3.3e+09 ± 4% perf-stat.i.dTLB-stores 87.61 -3.8 83.84 perf-stat.i.iTLB-load-miss-rate% 7267620 -33.6% 4828701 ± 2% perf-stat.i.iTLB-load-misses 2.391e+10 -31.8% 1.63e+10 ± 4% perf-stat.i.instructions 0.28 ± 2% +28.8% 0.36 ± 2% perf-stat.i.ipc 4279 -14.3% 3669 perf-stat.i.minor-faults 45.88 +0.6 46.48 perf-stat.i.node-load-miss-rate% 13857418 ± 2% -33.2% 9253829 ± 7% perf-stat.i.node-load-misses 15830808 ± 2% -33.8% 10483641 ± 7% perf-stat.i.node-loads 5925929 -28.2% 4252744 ± 5% perf-stat.i.node-store-misses 7451625 -27.1% 5432276 ± 5% perf-stat.i.node-stores 4279 -14.3% 3669 perf-stat.i.page-faults 1.26 +0.0 1.30 perf-stat.overall.branch-miss-rate% 9.90 +0.5 10.37 ± 2% perf-stat.overall.cache-miss-rate% 3.78 -20.1% 3.02 ± 3% perf-stat.overall.cpi 3726 -22.6% 2884 perf-stat.overall.cycles-between-cache-misses 1.76 ± 12% -0.5 1.28 ± 2% perf-stat.overall.dTLB-load-miss-rate% 0.34 ± 5% -0.0 0.32 perf-stat.overall.dTLB-store-miss-rate% 87.44 -3.8 83.60 perf-stat.overall.iTLB-load-miss-rate% 3290 +2.6% 3374 perf-stat.overall.instructions-per-iTLB-miss 0.26 +25.4% 0.33 ± 3% perf-stat.overall.ipc 4.685e+09 -31.7% 3.199e+09 ± 4% perf-stat.ps.branch-instructions 59020206 -29.5% 41606551 ± 3% perf-stat.ps.branch-misses 23958401 ± 2% -29.3% 16929391 ± 6% perf-stat.ps.cache-misses 2.42e+08 -32.6% 1.631e+08 ± 4% perf-stat.ps.cache-references 17359 ± 2% -14.5% 14848 perf-stat.ps.context-switches 8.926e+10 -45.2% 4.89e+10 ± 8% perf-stat.ps.cpu-cycles 2971 -59.3% 1208 ± 2% perf-stat.ps.cpu-migrations 1.313e+08 ± 13% -50.5% 64933807 ± 5% perf-stat.ps.dTLB-load-misses 7.318e+09 -31.5% 5.014e+09 ± 4% perf-stat.ps.dTLB-loads 16598516 ± 5% -37.1% 10442914 ± 3% perf-stat.ps.dTLB-store-misses 4.857e+09 -32.6% 3.275e+09 ± 4% perf-stat.ps.dTLB-stores 7182997 -33.3% 4792440 ± 2% perf-stat.ps.iTLB-load-misses 2.363e+10 -31.5% 1.618e+10 ± 4% perf-stat.ps.instructions 4233 -14.0% 3642 perf-stat.ps.minor-faults 13695799 ± 2% -32.9% 9184667 ± 7% perf-stat.ps.node-load-misses 15646175 ± 2% -33.5% 10405160 ± 7% perf-stat.ps.node-loads 5856803 -27.9% 4221222 ± 5% perf-stat.ps.node-store-misses 7364898 -26.8% 5392052 ± 5% perf-stat.ps.node-stores 4233 -14.0% 3642 perf-stat.ps.page-faults 2.091e+12 +6.2% 2.221e+12 perf-stat.total.instructions 21578 +80.2% 38887 sched_debug.cfs_rq:/.exec_clock.avg 23353 +75.3% 40945 ± 2% sched_debug.cfs_rq:/.exec_clock.max 21322 +79.5% 38269 sched_debug.cfs_rq:/.exec_clock.min 304.37 ± 8% +41.5% 430.55 ± 25% sched_debug.cfs_rq:/.exec_clock.stddev 632.50 ± 12% +29.7% 820.11 ± 12% sched_debug.cfs_rq:/.load_avg.max 780200 +60.8% 1254863 sched_debug.cfs_rq:/.min_vruntime.avg 872093 +58.1% 1378898 ± 3% sched_debug.cfs_rq:/.min_vruntime.max 762295 +57.2% 1198056 sched_debug.cfs_rq:/.min_vruntime.min 17394 ± 5% +57.7% 27431 ± 14% sched_debug.cfs_rq:/.min_vruntime.stddev 0.40 ± 5% +15.0% 0.46 ± 8% sched_debug.cfs_rq:/.nr_running.stddev 0.13 ± 38% +111.6% 0.28 ± 18% sched_debug.cfs_rq:/.nr_spread_over.avg 0.31 ± 29% +63.8% 0.50 ± 13% sched_debug.cfs_rq:/.nr_spread_over.stddev -1508 -590.1% 7393 ± 78% sched_debug.cfs_rq:/.spread0.avg -19404 +154.1% -49302 sched_debug.cfs_rq:/.spread0.min 17422 ± 5% +57.4% 27431 ± 14% sched_debug.cfs_rq:/.spread0.stddev 777.17 -15.3% 658.55 ± 11% sched_debug.cfs_rq:/.util_avg.avg 1497 ± 8% -16.1% 1256 ± 15% sched_debug.cfs_rq:/.util_avg.max 123.49 ± 11% -31.9% 84.04 ± 20% sched_debug.cfs_rq:/.util_est_enqueued.avg 473039 ± 7% +37.9% 652433 ± 2% sched_debug.cpu.avg_idle.avg 236058 ± 12% -18.6% 192130 ± 4% sched_debug.cpu.avg_idle.stddev 71615 +43.2% 102524 sched_debug.cpu.clock.avg 71626 +43.2% 102548 sched_debug.cpu.clock.max 71600 +43.2% 102498 sched_debug.cpu.clock.min 7.20 ± 22% +102.5% 14.59 ± 12% sched_debug.cpu.clock.stddev 71615 +43.2% 102524 sched_debug.cpu.clock_task.avg 71626 +43.2% 102548 sched_debug.cpu.clock_task.max 71600 +43.2% 102498 sched_debug.cpu.clock_task.min 7.20 ± 22% +102.5% 14.59 ± 12% sched_debug.cpu.clock_task.stddev 1820 ± 11% -18.6% 1482 ± 14% sched_debug.cpu.curr->pid.avg 3837 ± 8% +37.7% 5283 sched_debug.cpu.curr->pid.max 0.00 ± 3% +32.7% 0.00 ± 15% sched_debug.cpu.next_balance.stddev 0.42 ± 8% +17.3% 0.49 ± 4% sched_debug.cpu.nr_running.stddev 14410 ± 2% +63.7% 23596 sched_debug.cpu.nr_switches.avg 20732 +148.7% 51565 ± 9% sched_debug.cpu.nr_switches.max 12235 +29.2% 15807 ± 2% sched_debug.cpu.nr_switches.min 1916 ± 5% +373.8% 9082 ± 8% sched_debug.cpu.nr_switches.stddev 37.10 +17.6% 43.62 ± 4% sched_debug.cpu.nr_uninterruptible.avg -42.25 -35.6% -27.22 sched_debug.cpu.nr_uninterruptible.min 12279 ± 2% +74.6% 21437 sched_debug.cpu.sched_count.avg 14279 ± 2% +231.0% 47258 ± 10% sched_debug.cpu.sched_count.max 11249 ± 2% +31.0% 14739 sched_debug.cpu.sched_count.min 621.89 ± 12% +1268.2% 8508 ± 10% sched_debug.cpu.sched_count.stddev 5282 ± 3% +80.1% 9514 sched_debug.cpu.sched_goidle.avg 6253 ± 2% +253.4% 22097 ± 10% sched_debug.cpu.sched_goidle.max 4834 ± 2% +32.4% 6403 sched_debug.cpu.sched_goidle.min 301.81 ± 13% +1275.2% 4150 ± 10% sched_debug.cpu.sched_goidle.stddev 6298 ± 2% +69.2% 10658 sched_debug.cpu.ttwu_count.avg 7777 +200.5% 23368 ± 10% sched_debug.cpu.ttwu_count.max 5825 ± 3% +23.6% 7199 sched_debug.cpu.ttwu_count.min 379.64 ± 7% +1010.1% 4214 ± 11% sched_debug.cpu.ttwu_count.stddev 526.01 +69.8% 893.13 ± 2% sched_debug.cpu.ttwu_local.avg 773.75 ± 8% +125.6% 1745 ± 9% sched_debug.cpu.ttwu_local.max 424.12 +40.9% 597.78 ± 3% sched_debug.cpu.ttwu_local.min 68.72 ± 10% +219.5% 219.59 ± 10% sched_debug.cpu.ttwu_local.stddev 71601 +43.1% 102497 sched_debug.cpu_clk 68011 +45.4% 98899 sched_debug.ktime 71961 +42.9% 102856 sched_debug.sched_clk 13240 ± 4% +36.2% 18033 ± 3% softirqs.CPU0.RCU 12004 ± 3% +24.9% 14997 ± 3% softirqs.CPU0.SCHED 35478 ± 3% +57.3% 55794 softirqs.CPU0.TIMER 9817 ± 7% +18.1% 11592 ± 7% softirqs.CPU1.SCHED 38872 ± 3% +42.3% 55318 softirqs.CPU1.TIMER 13094 ± 5% +33.8% 17518 ± 5% softirqs.CPU10.RCU 8546 ± 8% +35.4% 11568 ± 6% softirqs.CPU10.SCHED 33896 ± 3% +59.6% 54082 ± 2% softirqs.CPU10.TIMER 12959 ± 4% +33.4% 17288 ± 4% softirqs.CPU11.RCU 8569 +32.8% 11380 ± 4% softirqs.CPU11.SCHED 34467 ± 2% +56.0% 53759 softirqs.CPU11.TIMER 14180 ± 12% +52.6% 21643 ± 4% softirqs.CPU12.RCU 8429 ± 3% +36.6% 11515 ± 6% softirqs.CPU12.SCHED 36338 ± 7% +59.4% 57933 ± 6% softirqs.CPU12.TIMER 13213 ± 5% +33.5% 17641 ± 5% softirqs.CPU13.RCU 8630 +33.2% 11498 ± 4% softirqs.CPU13.SCHED 38830 ± 17% +40.0% 54352 softirqs.CPU13.TIMER 12844 +39.2% 17877 ± 3% softirqs.CPU14.RCU 8556 +37.5% 11765 ± 4% softirqs.CPU14.SCHED 39110 ± 16% +38.8% 54296 ± 3% softirqs.CPU14.TIMER 13167 ± 4% +35.0% 17771 ± 3% softirqs.CPU15.RCU 8742 +29.3% 11303 ± 4% softirqs.CPU15.SCHED 35002 ± 2% +53.5% 53737 softirqs.CPU15.TIMER 13022 +35.7% 17668 ± 5% softirqs.CPU16.RCU 8456 ± 2% +37.4% 11616 ± 3% softirqs.CPU16.SCHED 35793 ± 3% +52.5% 54602 ± 2% softirqs.CPU16.TIMER 13010 ± 2% +36.1% 17702 ± 10% softirqs.CPU17.RCU 8813 ± 4% +26.7% 11168 ± 3% softirqs.CPU17.SCHED 35279 +53.4% 54103 softirqs.CPU17.TIMER 8652 ± 2% +29.9% 11243 softirqs.CPU18.SCHED 35157 ± 4% +55.9% 54825 ± 5% softirqs.CPU18.TIMER 13004 +44.6% 18807 ± 12% softirqs.CPU19.RCU 8658 +28.9% 11159 ± 2% softirqs.CPU19.SCHED 34629 +55.5% 53864 softirqs.CPU19.TIMER 8765 ± 7% +35.4% 11871 ± 3% softirqs.CPU2.SCHED 35122 ± 6% +53.9% 54041 ± 2% softirqs.CPU2.TIMER 12585 +54.3% 19421 ± 14% softirqs.CPU20.RCU 8327 ± 2% +40.1% 11666 softirqs.CPU20.SCHED 33760 ± 2% +59.5% 53863 ± 2% softirqs.CPU20.TIMER 12746 ± 2% +45.1% 18498 ± 10% softirqs.CPU21.RCU 8471 ± 4% +41.3% 11968 ± 4% softirqs.CPU21.SCHED 35143 ± 2% +73.9% 61115 ± 7% softirqs.CPU21.TIMER 13098 +34.9% 17671 ± 4% softirqs.CPU22.RCU 8566 +30.3% 11165 ± 6% softirqs.CPU22.SCHED 34415 ± 2% +60.1% 55110 softirqs.CPU22.TIMER 13351 ± 5% +31.5% 17556 ± 5% softirqs.CPU23.RCU 9174 ± 8% +26.7% 11622 ± 6% softirqs.CPU23.SCHED 37855 ± 13% +54.2% 58371 ± 4% softirqs.CPU23.TIMER 13334 ± 4% +35.3% 18035 ± 9% softirqs.CPU24.RCU 9011 ± 9% +28.1% 11546 ± 11% softirqs.CPU24.SCHED 35153 ± 5% +56.0% 54856 softirqs.CPU24.TIMER 13056 +35.1% 17633 ± 5% softirqs.CPU25.RCU 8668 +31.9% 11435 ± 6% softirqs.CPU25.SCHED 34832 ± 2% +56.5% 54499 softirqs.CPU25.TIMER 13612 ± 6% +31.1% 17846 ± 4% softirqs.CPU26.RCU 8564 +33.0% 11392 ± 5% softirqs.CPU26.SCHED 34752 ± 3% +67.9% 58356 ± 9% softirqs.CPU26.TIMER 13063 +38.7% 18123 ± 5% softirqs.CPU27.RCU 8692 +24.6% 10831 ± 4% softirqs.CPU27.SCHED 34964 ± 2% +57.0% 54889 softirqs.CPU27.TIMER 12612 +37.8% 17376 ± 4% softirqs.CPU28.RCU 8625 ± 2% +34.5% 11605 ± 7% softirqs.CPU28.SCHED 34376 ± 3% +59.0% 54672 softirqs.CPU28.TIMER 12943 ± 4% +33.9% 17333 ± 6% softirqs.CPU29.RCU 8678 ± 2% +28.6% 11158 ± 5% softirqs.CPU29.SCHED 36977 ± 14% +47.1% 54377 softirqs.CPU29.TIMER 12972 +42.8% 18526 ± 14% softirqs.CPU3.RCU 9119 ± 5% +25.9% 11481 ± 6% softirqs.CPU3.SCHED 35879 +75.6% 63012 ± 17% softirqs.CPU3.TIMER 12581 +39.8% 17591 ± 5% softirqs.CPU30.RCU 8255 +31.4% 10844 ± 7% softirqs.CPU30.SCHED 33406 ± 3% +58.7% 53003 ± 3% softirqs.CPU30.TIMER 13201 ± 5% +32.6% 17503 ± 5% softirqs.CPU31.RCU 8582 +30.9% 11232 ± 5% softirqs.CPU31.SCHED 34045 +57.9% 53746 softirqs.CPU31.TIMER 10821 ± 8% +37.8% 14913 softirqs.CPU32.RCU 8508 ± 3% +37.7% 11712 ± 4% softirqs.CPU32.SCHED 34901 ± 3% +59.6% 55704 ± 3% softirqs.CPU32.TIMER 10359 +34.3% 13912 ± 5% softirqs.CPU33.RCU 8624 +29.3% 11149 ± 3% softirqs.CPU33.SCHED 35940 ± 5% +51.3% 54362 ± 2% softirqs.CPU33.TIMER 10512 ± 2% +36.5% 14346 ± 6% softirqs.CPU34.RCU 8604 +28.7% 11077 ± 3% softirqs.CPU34.SCHED 34636 ± 2% +53.5% 53154 ± 3% softirqs.CPU34.TIMER 10444 ± 2% +35.0% 14100 ± 7% softirqs.CPU35.RCU 8547 +27.7% 10915 ± 5% softirqs.CPU35.SCHED 34476 +55.8% 53719 softirqs.CPU35.TIMER 10196 ± 2% +44.4% 14724 ± 4% softirqs.CPU36.RCU 8427 ± 2% +34.3% 11321 ± 3% softirqs.CPU36.SCHED 34764 ± 2% +56.2% 54288 ± 3% softirqs.CPU36.TIMER 10273 ± 2% +33.6% 13728 ± 5% softirqs.CPU37.RCU 8527 ± 2% +27.6% 10885 ± 3% softirqs.CPU37.SCHED 34727 +54.0% 53489 softirqs.CPU37.TIMER 10103 ± 2% +44.2% 14571 ± 2% softirqs.CPU38.RCU 8356 ± 2% +37.1% 11454 ± 4% softirqs.CPU38.SCHED 35884 ± 9% +68.3% 60394 ± 12% softirqs.CPU38.TIMER 10341 ± 3% +32.3% 13681 ± 5% softirqs.CPU39.RCU 8556 +27.0% 10868 ± 6% softirqs.CPU39.SCHED 34267 +56.6% 53654 softirqs.CPU39.TIMER 13012 +35.5% 17627 ± 5% softirqs.CPU4.RCU 8735 ± 2% +27.5% 11142 ± 5% softirqs.CPU4.SCHED 38127 ± 18% +44.2% 54976 softirqs.CPU4.TIMER 12911 +35.8% 17529 ± 4% softirqs.CPU5.RCU 8699 +38.2% 12025 ± 13% softirqs.CPU5.SCHED 34819 ± 2% +61.8% 56335 ± 2% softirqs.CPU5.TIMER 12740 ± 2% +35.8% 17297 ± 5% softirqs.CPU6.RCU 8761 ± 2% +27.0% 11124 ± 4% softirqs.CPU6.SCHED 35057 ± 3% +74.8% 61271 ± 16% softirqs.CPU6.TIMER 12939 +36.1% 17608 ± 7% softirqs.CPU7.RCU 8556 ± 2% +28.7% 11015 ± 4% softirqs.CPU7.SCHED 35488 ± 4% +54.8% 54918 softirqs.CPU7.TIMER 12719 ± 2% +37.1% 17432 ± 2% softirqs.CPU8.RCU 8648 +32.3% 11438 ± 6% softirqs.CPU8.SCHED 34507 ± 2% +58.6% 54712 softirqs.CPU8.TIMER 12769 ± 3% +35.1% 17249 ± 7% softirqs.CPU9.RCU 8597 ± 3% +33.3% 11461 ± 2% softirqs.CPU9.SCHED 38857 ± 19% +40.5% 54604 softirqs.CPU9.TIMER 503590 +36.6% 688115 ± 4% softirqs.RCU 349541 +31.1% 458229 ± 4% softirqs.SCHED 1420004 +56.1% 2216175 softirqs.TIMER 77.00 ± 51% +3025.1% 2406 ±130% interrupts.40:IR-PCI-MSI.524290-edge.eth0-TxRx-1 77.00 ± 39% +71.4% 132.00 ± 30% interrupts.43:IR-PCI-MSI.524293-edge.eth0-TxRx-4 54.75 ± 8% +64.4% 90.00 ± 21% interrupts.46:IR-PCI-MSI.524296-edge.eth0-TxRx-7 38565 +40.0% 54002 ± 4% interrupts.CAL:Function_call_interrupts 983.50 ± 4% +36.0% 1338 ± 8% interrupts.CPU0.CAL:Function_call_interrupts 177382 +55.8% 276400 ± 3% interrupts.CPU0.LOC:Local_timer_interrupts 4852 ± 66% -87.6% 601.33 ±141% interrupts.CPU0.NMI:Non-maskable_interrupts 4852 ± 66% -87.6% 601.33 ±141% interrupts.CPU0.PMI:Performance_monitoring_interrupts 177458 +55.6% 276134 ± 3% interrupts.CPU1.LOC:Local_timer_interrupts 2399 ± 34% -39.3% 1456 ± 8% interrupts.CPU1.RES:Rescheduling_interrupts 1007 +38.4% 1394 ± 7% interrupts.CPU10.CAL:Function_call_interrupts 175614 ± 2% +57.4% 276332 ± 4% interrupts.CPU10.LOC:Local_timer_interrupts 4849 ± 33% -54.8% 2193 ± 27% interrupts.CPU10.NMI:Non-maskable_interrupts 4849 ± 33% -54.8% 2193 ± 27% interrupts.CPU10.PMI:Performance_monitoring_interrupts 2487 ± 31% -33.4% 1655 ± 15% interrupts.CPU10.RES:Rescheduling_interrupts 1005 ± 2% +33.0% 1337 ± 3% interrupts.CPU11.CAL:Function_call_interrupts 177053 +56.1% 276460 ± 3% interrupts.CPU11.LOC:Local_timer_interrupts 3695 ± 9% -52.1% 1768 ± 4% interrupts.CPU11.NMI:Non-maskable_interrupts 3695 ± 9% -52.1% 1768 ± 4% interrupts.CPU11.PMI:Performance_monitoring_interrupts 972.00 ± 5% +41.8% 1378 ± 2% interrupts.CPU12.CAL:Function_call_interrupts 175821 ± 2% +57.2% 276353 ± 4% interrupts.CPU12.LOC:Local_timer_interrupts 1947 ± 5% -23.8% 1483 ± 16% interrupts.CPU12.RES:Rescheduling_interrupts 922.25 ± 6% +42.0% 1309 interrupts.CPU13.CAL:Function_call_interrupts 176892 +55.9% 275829 ± 3% interrupts.CPU13.LOC:Local_timer_interrupts 979.25 ± 5% +31.0% 1282 ± 4% interrupts.CPU14.CAL:Function_call_interrupts 176168 ± 2% +56.8% 276178 ± 3% interrupts.CPU14.LOC:Local_timer_interrupts 955.75 ± 3% +40.3% 1341 ± 6% interrupts.CPU15.CAL:Function_call_interrupts 176793 ± 2% +56.1% 276062 ± 3% interrupts.CPU15.LOC:Local_timer_interrupts 1858 ± 4% -19.4% 1497 ± 13% interrupts.CPU15.RES:Rescheduling_interrupts 969.50 ± 3% +35.7% 1315 ± 6% interrupts.CPU16.CAL:Function_call_interrupts 176054 ± 2% +56.8% 276087 ± 3% interrupts.CPU16.LOC:Local_timer_interrupts 1927 ± 5% -24.2% 1461 ± 8% interrupts.CPU16.RES:Rescheduling_interrupts 937.25 ± 2% +39.8% 1310 ± 9% interrupts.CPU17.CAL:Function_call_interrupts 176586 ± 2% +55.6% 274709 ± 3% interrupts.CPU17.LOC:Local_timer_interrupts 972.00 ± 4% +41.1% 1371 ± 9% interrupts.CPU18.CAL:Function_call_interrupts 175927 ± 2% +56.9% 275969 ± 3% interrupts.CPU18.LOC:Local_timer_interrupts 2285 ± 18% -42.0% 1325 ± 7% interrupts.CPU18.RES:Rescheduling_interrupts 958.25 ± 4% +37.9% 1321 ± 6% interrupts.CPU19.CAL:Function_call_interrupts 176354 ± 2% +56.0% 275068 ± 4% interrupts.CPU19.LOC:Local_timer_interrupts 1007 ± 4% +34.8% 1357 ± 11% interrupts.CPU2.CAL:Function_call_interrupts 176971 +56.1% 276231 ± 3% interrupts.CPU2.LOC:Local_timer_interrupts 948.00 ± 5% +46.7% 1390 ± 6% interrupts.CPU20.CAL:Function_call_interrupts 176878 +56.1% 276171 ± 3% interrupts.CPU20.LOC:Local_timer_interrupts 970.25 ± 4% +33.5% 1295 ± 3% interrupts.CPU21.CAL:Function_call_interrupts 177571 +55.5% 276093 ± 4% interrupts.CPU21.LOC:Local_timer_interrupts 1893 -34.6% 1237 ± 6% interrupts.CPU21.RES:Rescheduling_interrupts 963.50 ± 2% +34.6% 1296 ± 2% interrupts.CPU22.CAL:Function_call_interrupts 176684 +56.3% 276201 ± 3% interrupts.CPU22.LOC:Local_timer_interrupts 1975 ± 2% -35.7% 1270 ± 12% interrupts.CPU22.RES:Rescheduling_interrupts 949.50 ± 3% +32.7% 1260 ± 2% interrupts.CPU23.CAL:Function_call_interrupts 177742 +55.1% 275624 ± 3% interrupts.CPU23.LOC:Local_timer_interrupts 1937 ± 4% -34.9% 1261 ± 9% interrupts.CPU23.RES:Rescheduling_interrupts 968.75 ± 5% +41.5% 1370 ± 7% interrupts.CPU24.CAL:Function_call_interrupts 176809 +56.1% 275962 ± 3% interrupts.CPU24.LOC:Local_timer_interrupts 1893 -30.5% 1316 ± 14% interrupts.CPU24.RES:Rescheduling_interrupts 949.00 ± 2% +41.6% 1344 ± 4% interrupts.CPU25.CAL:Function_call_interrupts 177584 +55.4% 275974 ± 4% interrupts.CPU25.LOC:Local_timer_interrupts 922.50 ± 9% +43.9% 1327 ± 4% interrupts.CPU26.CAL:Function_call_interrupts 177144 +55.9% 276093 ± 3% interrupts.CPU26.LOC:Local_timer_interrupts 4881 ± 35% -76.1% 1165 ±141% interrupts.CPU26.NMI:Non-maskable_interrupts 4881 ± 35% -76.1% 1165 ±141% interrupts.CPU26.PMI:Performance_monitoring_interrupts 961.75 ± 5% +32.1% 1270 ± 7% interrupts.CPU27.CAL:Function_call_interrupts 177543 +55.6% 276207 ± 4% interrupts.CPU27.LOC:Local_timer_interrupts 1920 -39.2% 1167 ± 7% interrupts.CPU27.RES:Rescheduling_interrupts 948.25 ± 3% +43.4% 1359 ± 10% interrupts.CPU28.CAL:Function_call_interrupts 176358 ± 2% +56.6% 276170 ± 3% interrupts.CPU28.LOC:Local_timer_interrupts 926.25 ± 2% +52.0% 1408 ± 3% interrupts.CPU29.CAL:Function_call_interrupts 177193 +56.0% 276457 ± 3% interrupts.CPU29.LOC:Local_timer_interrupts 1014 ±112% +163.8% 2677 ± 24% interrupts.CPU29.NMI:Non-maskable_interrupts 1014 ±112% +163.8% 2677 ± 24% interrupts.CPU29.PMI:Performance_monitoring_interrupts 1927 ± 2% -30.8% 1334 ± 9% interrupts.CPU29.RES:Rescheduling_interrupts 983.25 ± 4% +43.7% 1413 interrupts.CPU3.CAL:Function_call_interrupts 177682 +55.6% 276520 ± 3% interrupts.CPU3.LOC:Local_timer_interrupts 1974 ± 2% -27.2% 1436 ± 9% interrupts.CPU3.RES:Rescheduling_interrupts 924.75 ± 2% +54.0% 1424 ± 3% interrupts.CPU30.CAL:Function_call_interrupts 176131 ± 2% +56.7% 276051 ± 3% interrupts.CPU30.LOC:Local_timer_interrupts 1888 ± 3% -35.4% 1221 interrupts.CPU30.RES:Rescheduling_interrupts 960.50 ± 4% +42.4% 1367 ± 6% interrupts.CPU31.CAL:Function_call_interrupts 177002 +56.1% 276368 ± 3% interrupts.CPU31.LOC:Local_timer_interrupts 1939 -29.2% 1373 ± 14% interrupts.CPU31.RES:Rescheduling_interrupts 77.00 ± 51% +3025.1% 2406 ±130% interrupts.CPU32.40:IR-PCI-MSI.524290-edge.eth0-TxRx-1 914.25 ± 14% +51.8% 1388 ± 8% interrupts.CPU32.CAL:Function_call_interrupts 176087 ± 2% +56.7% 276010 ± 3% interrupts.CPU32.LOC:Local_timer_interrupts 1947 ± 2% -27.7% 1407 ± 11% interrupts.CPU32.RES:Rescheduling_interrupts 994.25 ± 3% +39.9% 1390 ± 5% interrupts.CPU33.CAL:Function_call_interrupts 176835 +56.1% 276100 ± 3% interrupts.CPU33.LOC:Local_timer_interrupts 1923 ± 2% -32.0% 1308 ± 15% interrupts.CPU33.RES:Rescheduling_interrupts 976.75 ± 3% +43.2% 1398 ± 7% interrupts.CPU34.CAL:Function_call_interrupts 175901 ± 2% +56.8% 275892 ± 3% interrupts.CPU34.LOC:Local_timer_interrupts 1920 ± 3% -35.9% 1230 ± 6% interrupts.CPU34.RES:Rescheduling_interrupts 995.75 ± 3% +35.5% 1349 ± 2% interrupts.CPU35.CAL:Function_call_interrupts 176626 +56.4% 276218 ± 3% interrupts.CPU35.LOC:Local_timer_interrupts 2002 ± 6% -34.0% 1322 ± 4% interrupts.CPU35.RES:Rescheduling_interrupts 977.75 ± 3% +41.3% 1381 ± 5% interrupts.CPU36.CAL:Function_call_interrupts 175681 ± 2% +57.0% 275759 ± 3% interrupts.CPU36.LOC:Local_timer_interrupts 1944 -35.9% 1245 ± 3% interrupts.CPU36.RES:Rescheduling_interrupts 967.00 ± 5% +42.5% 1378 ± 4% interrupts.CPU37.CAL:Function_call_interrupts 176570 ± 2% +55.7% 274976 ± 3% interrupts.CPU37.LOC:Local_timer_interrupts 4719 ± 35% -74.9% 1184 ± 67% interrupts.CPU37.NMI:Non-maskable_interrupts 4719 ± 35% -74.9% 1184 ± 67% interrupts.CPU37.PMI:Performance_monitoring_interrupts 1897 -31.3% 1302 ± 13% interrupts.CPU37.RES:Rescheduling_interrupts 77.00 ± 39% +71.4% 132.00 ± 30% interrupts.CPU38.43:IR-PCI-MSI.524293-edge.eth0-TxRx-4 953.50 ± 2% +42.8% 1361 interrupts.CPU38.CAL:Function_call_interrupts 175461 ± 3% +57.2% 275862 ± 4% interrupts.CPU38.LOC:Local_timer_interrupts 1919 ± 3% -32.3% 1300 ± 10% interrupts.CPU38.RES:Rescheduling_interrupts 977.75 ± 4% +34.6% 1316 ± 6% interrupts.CPU39.CAL:Function_call_interrupts 176475 ± 2% +56.5% 276208 ± 3% interrupts.CPU39.LOC:Local_timer_interrupts 1884 -33.0% 1263 ± 7% interrupts.CPU39.RES:Rescheduling_interrupts 897.00 ± 12% +56.3% 1402 ± 8% interrupts.CPU4.CAL:Function_call_interrupts 176870 +56.2% 276260 ± 3% interrupts.CPU4.LOC:Local_timer_interrupts 2133 ± 10% -36.2% 1361 ± 20% interrupts.CPU4.RES:Rescheduling_interrupts 995.00 ± 3% +36.3% 1356 ± 5% interrupts.CPU5.CAL:Function_call_interrupts 177709 +55.3% 275932 ± 4% interrupts.CPU5.LOC:Local_timer_interrupts 5802 ± 33% -62.7% 2163 ± 72% interrupts.CPU5.NMI:Non-maskable_interrupts 5802 ± 33% -62.7% 2163 ± 72% interrupts.CPU5.PMI:Performance_monitoring_interrupts 54.75 ± 8% +64.4% 90.00 ± 21% interrupts.CPU6.46:IR-PCI-MSI.524296-edge.eth0-TxRx-7 931.75 ± 3% +46.4% 1364 ± 7% interrupts.CPU6.CAL:Function_call_interrupts 176814 +56.1% 275995 ± 3% interrupts.CPU6.LOC:Local_timer_interrupts 1.25 ± 66% +1.4e+05% 1764 ± 77% interrupts.CPU6.NMI:Non-maskable_interrupts 1.25 ± 66% +1.4e+05% 1764 ± 77% interrupts.CPU6.PMI:Performance_monitoring_interrupts 2020 ± 4% -26.1% 1493 ± 21% interrupts.CPU6.RES:Rescheduling_interrupts 951.50 ± 3% +42.3% 1353 ± 5% interrupts.CPU7.CAL:Function_call_interrupts 177433 +55.7% 276226 ± 4% interrupts.CPU7.LOC:Local_timer_interrupts 1961 -39.5% 1187 ± 2% interrupts.CPU7.RES:Rescheduling_interrupts 958.00 ± 4% +46.1% 1400 ± 3% interrupts.CPU8.CAL:Function_call_interrupts 176160 ± 2% +56.6% 275946 ± 3% interrupts.CPU8.LOC:Local_timer_interrupts 2051 ± 3% -33.9% 1356 ± 5% interrupts.CPU8.RES:Rescheduling_interrupts 1045 ± 2% +26.9% 1326 ± 6% interrupts.CPU9.CAL:Function_call_interrupts 177126 +55.9% 276223 ± 3% interrupts.CPU9.LOC:Local_timer_interrupts 4878 ± 34% -63.5% 1780 ± 80% interrupts.CPU9.NMI:Non-maskable_interrupts 4878 ± 34% -63.5% 1780 ± 80% interrupts.CPU9.PMI:Performance_monitoring_interrupts 7069159 +56.2% 11041322 ± 3% interrupts.LOC:Local_timer_interrupts 118316 ± 7% -46.4% 63378 ± 17% interrupts.NMI:Non-maskable_interrupts 118316 ± 7% -46.4% 63378 ± 17% interrupts.PMI:Performance_monitoring_interrupts 79699 -24.7% 60027 ± 2% interrupts.RES:Rescheduling_interrupts 176.75 ± 10% +71.8% 303.67 ± 10% interrupts.TLB:TLB_shootdowns 58.95 -15.1 43.86 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 59.10 -15.1 44.02 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 54.72 -14.7 39.98 ± 4% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 54.25 -14.7 39.52 ± 4% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 61.93 -14.6 47.29 ± 3% perf-profile.calltrace.cycles-pp.read 45.30 -12.1 33.15 ± 2% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 38.88 -10.1 28.73 ± 2% perf-profile.calltrace.cycles-pp.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 36.45 ± 2% -9.5 26.96 perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read 20.84 -5.5 15.37 ± 3% perf-profile.calltrace.cycles-pp.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read 9.89 ± 4% -3.2 6.69 ± 7% perf-profile.calltrace.cycles-pp.touch_atime.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read 9.80 ± 4% -3.2 6.62 ± 8% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.generic_file_read_iter.xfs_file_buffered_aio_read.xfs_file_read_iter 9.55 ± 6% -2.6 6.97 ± 5% perf-profile.calltrace.cycles-pp.down_read.xfs_ilock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read 9.61 ± 7% -2.6 7.04 ± 5% perf-profile.calltrace.cycles-pp.xfs_ilock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read 5.55 ± 10% -1.7 3.83 ± 11% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.80 ± 5% -1.5 4.32 perf-profile.calltrace.cycles-pp.up_read.xfs_iunlock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read 5.86 ± 5% -1.4 4.41 perf-profile.calltrace.cycles-pp.xfs_iunlock.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read 4.33 ± 4% -1.4 2.96 ± 3% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64 2.97 ± 4% -1.0 2.01 perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_read.ksys_read 2.46 ± 3% -0.5 2.00 ± 3% perf-profile.calltrace.cycles-pp.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 1.56 ± 21% -0.4 1.20 ± 9% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.08 ± 3% -0.3 1.78 ± 6% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.14 ± 2% -0.3 1.84 ± 6% perf-profile.calltrace.cycles-pp.close 2.09 ± 3% -0.3 1.79 ± 6% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 2.11 ± 3% -0.3 1.81 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.close 2.11 ± 2% -0.3 1.81 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 2.09 ± 3% -0.3 1.79 ± 6% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe.close 2.05 ± 3% -0.3 1.75 ± 6% perf-profile.calltrace.cycles-pp.__dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop 2.06 ± 3% -0.3 1.77 ± 6% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64 1.39 ± 3% -0.3 1.10 ± 5% perf-profile.calltrace.cycles-pp.iomap_set_page_dirty.iomap_write_end.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.97 ± 6% -0.3 1.70 ± 5% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open 2.28 ± 6% -0.2 2.07 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_open.do_syscall_64 2.22 ± 6% -0.2 2.03 ± 3% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.path_openat.do_filp_open.do_sys_open 0.59 ± 2% +0.1 0.69 ± 5% perf-profile.calltrace.cycles-pp.memset_erms.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply 0.87 ± 2% +0.1 0.97 ± 3% perf-profile.calltrace.cycles-pp.iomap_read_page_sync.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 0.79 ± 5% +0.1 0.89 ± 4% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor 1.19 +0.1 1.32 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.write 1.15 ± 5% +0.1 1.28 perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.read 1.56 ± 2% +0.2 1.72 ± 6% perf-profile.calltrace.cycles-pp.evict.__dentry_kill.dput.__fput.task_work_run 1.55 ± 2% +0.2 1.71 ± 6% perf-profile.calltrace.cycles-pp.truncate_inode_pages_range.evict.__dentry_kill.dput.__fput 1.40 ± 3% +0.2 1.59 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.read 1.38 ± 2% +0.2 1.61 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.write 3.72 ± 2% +0.3 3.97 perf-profile.calltrace.cycles-pp.pagecache_get_page.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply 3.86 ± 2% +0.3 4.15 perf-profile.calltrace.cycles-pp.grab_cache_page_write_begin.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write 1.72 ± 2% +0.4 2.12 perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin_delay.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 2.90 ± 5% +0.4 3.31 ± 3% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe 2.91 ± 5% +0.4 3.31 ± 3% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 2.92 ± 5% +0.4 3.33 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.creat 2.92 ± 5% +0.4 3.32 ± 3% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 2.92 ± 5% +0.4 3.33 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.creat 2.94 ± 5% +0.4 3.35 ± 2% perf-profile.calltrace.cycles-pp.creat 5.01 ± 2% +0.5 5.47 perf-profile.calltrace.cycles-pp.iomap_write_begin.iomap_write_actor.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write 0.00 +0.6 0.58 ± 5% perf-profile.calltrace.cycles-pp.xfs_dialloc.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create 2.00 ± 2% +0.6 2.59 ± 2% perf-profile.calltrace.cycles-pp.xfs_file_iomap_begin.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write 0.00 +0.6 0.62 ± 3% perf-profile.calltrace.cycles-pp.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.00 +0.6 0.62 ± 3% perf-profile.calltrace.cycles-pp.xfs_remove.xfs_vn_unlink.vfs_unlink.do_unlinkat.do_syscall_64 0.00 +0.6 0.63 ± 3% perf-profile.calltrace.cycles-pp.xfs_ialloc.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat 0.00 +0.6 0.63 ± 3% perf-profile.calltrace.cycles-pp.xfs_dir_ialloc.xfs_create.xfs_generic_create.path_openat.do_filp_open 0.00 +0.6 0.65 ± 3% perf-profile.calltrace.cycles-pp.vfs_unlink.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 0.77 ± 4% +0.7 1.45 ± 2% perf-profile.calltrace.cycles-pp.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 0.78 ± 5% +0.7 1.46 ± 3% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.unlink 0.78 ± 5% +0.7 1.46 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 0.00 +0.7 0.70 ± 4% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.81 ± 5% +0.7 1.51 ± 2% perf-profile.calltrace.cycles-pp.unlink 0.00 +0.7 0.74 ± 3% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.do_unlinkat.do_syscall_64.entry_SYSCALL_64_after_hwframe.unlink 12.46 ± 2% +0.8 13.22 perf-profile.calltrace.cycles-pp.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write 12.37 ± 2% +0.8 13.13 perf-profile.calltrace.cycles-pp.iomap_apply.iomap_file_buffered_write.xfs_file_buffered_aio_write.new_sync_write.vfs_write 0.13 ±173% +0.9 1.02 perf-profile.calltrace.cycles-pp.xfs_generic_create.path_openat.do_filp_open.do_sys_open.do_syscall_64 0.00 +1.0 1.00 ± 2% perf-profile.calltrace.cycles-pp.xfs_create.xfs_generic_create.path_openat.do_filp_open.do_sys_open 15.73 ± 4% +1.3 17.05 perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_write.new_sync_write.vfs_write.ksys_write.do_syscall_64 22.72 ± 3% +1.5 24.18 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 22.86 ± 3% +1.5 24.35 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 16.41 ± 3% +1.5 17.94 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 18.33 ± 3% +1.7 19.99 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 18.75 ± 3% +1.7 20.47 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 25.76 ± 3% +1.9 27.68 perf-profile.calltrace.cycles-pp.write 5.47 ± 15% +10.7 16.19 ± 8% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 5.55 ± 15% +11.2 16.79 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary 5.56 ± 15% +11.3 16.82 ± 9% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 5.89 ± 12% +11.5 17.42 ± 8% perf-profile.calltrace.cycles-pp.secondary_startup_64 5.69 ± 14% +11.6 17.25 ± 9% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64 5.69 ± 14% +11.6 17.26 ± 9% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64 5.69 ± 14% +11.6 17.26 ± 9% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64 54.73 -14.7 40.00 ± 4% perf-profile.children.cycles-pp.ksys_read 54.28 -14.7 39.56 ± 4% perf-profile.children.cycles-pp.vfs_read 62.12 -14.6 47.49 ± 3% perf-profile.children.cycles-pp.read 87.70 -12.8 74.92 ± 2% perf-profile.children.cycles-pp.do_syscall_64 87.98 -12.8 75.22 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 45.31 -12.1 33.16 ± 2% perf-profile.children.cycles-pp.new_sync_read 38.88 -10.1 28.74 ± 2% perf-profile.children.cycles-pp.xfs_file_read_iter 36.47 ± 2% -9.5 26.98 perf-profile.children.cycles-pp.xfs_file_buffered_aio_read 20.86 -5.5 15.39 ± 3% perf-profile.children.cycles-pp.generic_file_read_iter 9.89 ± 4% -3.2 6.70 ± 7% perf-profile.children.cycles-pp.touch_atime 9.80 ± 4% -3.2 6.63 ± 8% perf-profile.children.cycles-pp.atime_needs_update 9.60 ± 6% -2.6 7.02 ± 4% perf-profile.children.cycles-pp.down_read 10.44 ± 7% -2.5 7.95 ± 5% perf-profile.children.cycles-pp.xfs_ilock 6.35 ± 9% -1.7 4.67 ± 9% perf-profile.children.cycles-pp.security_file_permission 5.81 ± 5% -1.5 4.34 perf-profile.children.cycles-pp.up_read 6.41 ± 5% -1.5 4.93 perf-profile.children.cycles-pp.xfs_iunlock 4.94 ± 4% -1.3 3.60 ± 3% perf-profile.children.cycles-pp.selinux_file_permission 3.17 ± 3% -0.9 2.27 perf-profile.children.cycles-pp.__inode_security_revalidate 2.47 ± 3% -0.5 2.02 ± 3% perf-profile.children.cycles-pp.iomap_write_end 1.75 ± 18% -0.3 1.41 ± 7% perf-profile.children.cycles-pp.fsnotify 2.14 ± 2% -0.3 1.84 ± 6% perf-profile.children.cycles-pp.close 2.09 ± 3% -0.3 1.79 ± 6% perf-profile.children.cycles-pp.task_work_run 2.08 ± 3% -0.3 1.79 ± 6% perf-profile.children.cycles-pp.__fput 2.06 ± 3% -0.3 1.77 ± 6% perf-profile.children.cycles-pp.dput 2.10 ± 3% -0.3 1.81 ± 6% perf-profile.children.cycles-pp.exit_to_usermode_loop 2.05 ± 3% -0.3 1.76 ± 6% perf-profile.children.cycles-pp.__dentry_kill 1.40 ± 3% -0.3 1.12 ± 5% perf-profile.children.cycles-pp.iomap_set_page_dirty 0.74 ± 7% -0.2 0.53 ± 8% perf-profile.children.cycles-pp.rw_verify_area 0.34 ± 3% -0.2 0.17 ± 7% perf-profile.children.cycles-pp.page_mapping 0.43 ± 9% -0.1 0.36 ± 3% perf-profile.children.cycles-pp.up_write 0.22 ± 7% -0.0 0.20 ± 8% perf-profile.children.cycles-pp.unlock_page 0.07 -0.0 0.06 ± 8% perf-profile.children.cycles-pp.xfs_btree_lookup 0.10 ± 4% +0.0 0.12 ± 6% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics 0.09 ± 4% +0.0 0.11 perf-profile.children.cycles-pp.workingset_update_node 0.07 ± 10% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.xfs_lookup 0.07 ± 14% +0.0 0.10 ± 8% perf-profile.children.cycles-pp.xfs_vn_lookup 0.18 ± 7% +0.0 0.21 ± 6% perf-profile.children.cycles-pp.mem_cgroup_commit_charge 0.13 ± 5% +0.0 0.16 perf-profile.children.cycles-pp.xfs_dir2_leafn_lookup_for_entry 0.16 +0.0 0.19 ± 7% perf-profile.children.cycles-pp.__x64_sys_read 0.07 ± 7% +0.0 0.10 ± 9% perf-profile.children.cycles-pp.xfs_buf_item_format 0.66 ± 2% +0.0 0.69 perf-profile.children.cycles-pp.down_write 0.17 ± 9% +0.0 0.20 ± 6% perf-profile.children.cycles-pp.disk_cp 0.38 ± 2% +0.0 0.41 ± 4% perf-profile.children.cycles-pp.xas_store 0.21 ± 3% +0.0 0.25 ± 9% perf-profile.children.cycles-pp.rcu_all_qs 0.05 ± 8% +0.0 0.09 ± 9% perf-profile.children.cycles-pp.unwind_next_frame 0.04 ± 57% +0.0 0.08 ± 12% perf-profile.children.cycles-pp.kmem_cache_alloc 0.21 ± 3% +0.0 0.25 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid 0.18 ± 4% +0.0 0.22 ± 2% perf-profile.children.cycles-pp.xfs_dir3_data_check 0.18 ± 4% +0.0 0.22 ± 2% perf-profile.children.cycles-pp.__xfs_dir3_data_check 0.35 ± 3% +0.0 0.39 ± 3% perf-profile.children.cycles-pp.delete_from_page_cache_batch 0.44 ± 2% +0.0 0.48 ± 5% perf-profile.children.cycles-pp._cond_resched 0.03 ±100% +0.0 0.07 ± 6% perf-profile.children.cycles-pp.kmem_zone_alloc 0.05 ± 58% +0.1 0.10 ± 8% perf-profile.children.cycles-pp.xfs_get_extsz_hint 0.04 ± 57% +0.1 0.09 ± 9% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.read_tsc 0.21 ± 6% +0.1 0.27 ± 8% perf-profile.children.cycles-pp.xfs_da3_node_lookup_int 0.00 +0.1 0.06 ± 8% perf-profile.children.cycles-pp.native_irq_return_iret 0.08 ± 10% +0.1 0.14 ± 11% perf-profile.children.cycles-pp.stack_trace_save_tsk 0.11 ± 9% +0.1 0.17 ± 20% perf-profile.children.cycles-pp.wait_for_xmitr 0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.xlog_space_left 0.10 ± 9% +0.1 0.15 ± 11% perf-profile.children.cycles-pp.__account_scheduler_latency 0.08 ± 5% +0.1 0.14 ± 12% perf-profile.children.cycles-pp.arch_stack_walk 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.lapic_next_deadline 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__remove_hrtimer 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__update_load_avg_se 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.xfs_verify_ino 0.27 ± 5% +0.1 0.33 perf-profile.children.cycles-pp.xfs_dir2_node_removename 0.11 ± 4% +0.1 0.17 ± 19% perf-profile.children.cycles-pp.serial8250_console_putchar 0.06 ± 14% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.sched_ttwu_pending 0.11 ± 7% +0.1 0.17 ± 20% perf-profile.children.cycles-pp.uart_console_write 0.45 ± 4% +0.1 0.52 ± 3% perf-profile.children.cycles-pp.__might_sleep 0.28 ± 5% +0.1 0.34 ± 2% perf-profile.children.cycles-pp.xfs_dir_removename 0.08 ± 58% +0.1 0.14 ± 10% perf-profile.children.cycles-pp.xlog_ungrant_log_space 0.01 ±173% +0.1 0.08 perf-profile.children.cycles-pp.xfs_iunlink 0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.rcu_sched_clock_irq 0.12 ± 10% +0.1 0.19 ± 8% perf-profile.children.cycles-pp.enqueue_entity 0.30 ± 4% +0.1 0.38 ± 6% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.12 ± 10% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.enqueue_task_fair 0.10 ± 58% +0.1 0.18 ± 9% perf-profile.children.cycles-pp.xfs_log_done 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.native_write_msr 0.00 +0.1 0.08 ± 12% perf-profile.children.cycles-pp.xfs_agino_range 0.12 ± 10% +0.1 0.20 ± 12% perf-profile.children.cycles-pp.ttwu_do_activate 0.12 ± 10% +0.1 0.20 ± 12% perf-profile.children.cycles-pp.activate_task 0.12 ± 8% +0.1 0.21 ± 20% perf-profile.children.cycles-pp.console_unlock 0.08 ± 8% +0.1 0.17 ± 10% perf-profile.children.cycles-pp.update_load_avg 0.12 ± 8% +0.1 0.21 ± 17% perf-profile.children.cycles-pp.irq_work_run_list 0.35 ± 8% +0.1 0.44 ± 5% perf-profile.children.cycles-pp.xfs_file_iomap_end 0.00 +0.1 0.09 ± 50% perf-profile.children.cycles-pp.xfs_inobt_get_maxrecs 0.11 ± 11% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.irq_work_interrupt 0.11 ± 11% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.smp_irq_work_interrupt 0.11 ± 11% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.irq_work_run 0.11 ± 11% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.printk 0.11 ± 11% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.vprintk_emit 0.04 ± 57% +0.1 0.13 ± 25% perf-profile.children.cycles-pp.clockevents_program_event 0.60 +0.1 0.69 ± 4% perf-profile.children.cycles-pp.memset_erms 0.88 ± 2% +0.1 0.98 ± 3% perf-profile.children.cycles-pp.iomap_read_page_sync 0.14 ± 9% +0.1 0.26 ± 6% perf-profile.children.cycles-pp.task_tick_fair 0.71 ± 2% +0.1 0.82 ± 2% perf-profile.children.cycles-pp.___might_sleep 0.00 +0.1 0.12 ± 26% perf-profile.children.cycles-pp.ktime_get 0.11 ± 61% +0.1 0.24 ± 12% perf-profile.children.cycles-pp.xlog_grant_add_space 0.42 ± 8% +0.1 0.55 ± 13% perf-profile.children.cycles-pp.xfs_file_write_iter 0.06 ± 11% +0.1 0.20 ± 47% perf-profile.children.cycles-pp.xfs_btree_increment 0.10 ± 15% +0.1 0.24 ± 24% perf-profile.children.cycles-pp.__softirqentry_text_start 0.06 ± 6% +0.2 0.22 ± 35% perf-profile.children.cycles-pp.xfs_btree_get_rec 0.06 ± 7% +0.2 0.22 ± 41% perf-profile.children.cycles-pp.__xfs_btree_check_sblock 1.56 ± 2% +0.2 1.72 ± 6% perf-profile.children.cycles-pp.evict 0.17 ± 8% +0.2 0.34 ± 6% perf-profile.children.cycles-pp.scheduler_tick 1.55 ± 2% +0.2 1.71 ± 6% perf-profile.children.cycles-pp.truncate_inode_pages_range 0.11 ± 14% +0.2 0.29 ± 25% perf-profile.children.cycles-pp.irq_exit 0.00 +0.2 0.18 ± 27% perf-profile.children.cycles-pp.menu_select 0.43 ± 3% +0.2 0.62 ± 3% perf-profile.children.cycles-pp.xfs_vn_unlink 0.43 ± 3% +0.2 0.62 ± 3% perf-profile.children.cycles-pp.xfs_remove 0.23 ± 41% +0.2 0.42 ± 11% perf-profile.children.cycles-pp.xfs_trans_reserve 0.21 ± 46% +0.2 0.40 ± 11% perf-profile.children.cycles-pp.xfs_log_reserve 0.45 ± 2% +0.2 0.65 ± 3% perf-profile.children.cycles-pp.vfs_unlink 0.34 ± 5% +0.2 0.55 ± 4% perf-profile.children.cycles-pp.rwsem_spin_on_owner 0.08 ± 5% +0.2 0.29 ± 42% perf-profile.children.cycles-pp.xfs_btree_check_sblock 0.28 ± 36% +0.2 0.50 ± 9% perf-profile.children.cycles-pp.xfs_trans_alloc 0.26 ± 4% +0.3 0.51 perf-profile.children.cycles-pp.update_process_times 0.26 ± 3% +0.3 0.52 ± 2% perf-profile.children.cycles-pp.tick_sched_handle 0.10 ± 8% +0.3 0.36 ± 36% perf-profile.children.cycles-pp.xfs_inobt_get_rec 2.49 ± 6% +0.3 2.75 ± 3% perf-profile.children.cycles-pp.rwsem_optimistic_spin 3.88 ± 2% +0.3 4.17 perf-profile.children.cycles-pp.grab_cache_page_write_begin 0.29 ± 3% +0.3 0.59 ± 4% perf-profile.children.cycles-pp.tick_sched_timer 2.61 ± 2% +0.3 2.94 perf-profile.children.cycles-pp.syscall_return_via_sysret 0.12 ± 8% +0.4 0.52 ± 4% perf-profile.children.cycles-pp.xfs_dialloc_ag 3.00 ± 5% +0.4 3.40 ± 2% perf-profile.children.cycles-pp.do_sys_open 2.97 ± 5% +0.4 3.37 ± 2% perf-profile.children.cycles-pp.path_openat 2.97 ± 5% +0.4 3.37 ± 3% perf-profile.children.cycles-pp.do_filp_open 0.20 ± 8% +0.4 0.61 ± 37% perf-profile.children.cycles-pp.xfs_check_agi_freecount 1.75 ± 2% +0.4 2.15 perf-profile.children.cycles-pp.xfs_file_iomap_begin_delay 2.94 ± 5% +0.4 3.35 ± 2% perf-profile.children.cycles-pp.creat 0.15 ± 10% +0.4 0.58 ± 5% perf-profile.children.cycles-pp.xfs_dialloc 0.39 ± 3% +0.4 0.83 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues 2.79 ± 2% +0.4 3.23 perf-profile.children.cycles-pp.entry_SYSCALL_64 0.18 ± 7% +0.4 0.63 ± 3% perf-profile.children.cycles-pp.xfs_ialloc 0.18 ± 7% +0.5 0.63 ± 3% perf-profile.children.cycles-pp.xfs_dir_ialloc 5.03 ± 2% +0.5 5.49 perf-profile.children.cycles-pp.iomap_write_begin 0.45 ± 7% +0.6 1.00 perf-profile.children.cycles-pp.xfs_create 0.46 ± 7% +0.6 1.02 perf-profile.children.cycles-pp.xfs_generic_create 0.50 ± 4% +0.6 1.08 ± 3% perf-profile.children.cycles-pp.hrtimer_interrupt 2.02 ± 2% +0.6 2.62 perf-profile.children.cycles-pp.xfs_file_iomap_begin 0.77 ± 4% +0.7 1.45 ± 2% perf-profile.children.cycles-pp.do_unlinkat 0.81 ± 5% +0.7 1.51 ± 2% perf-profile.children.cycles-pp.unlink 12.39 ± 2% +0.8 13.15 perf-profile.children.cycles-pp.iomap_apply 12.46 ± 2% +0.8 13.22 perf-profile.children.cycles-pp.iomap_file_buffered_write 0.64 ± 5% +0.8 1.46 ± 8% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.69 ± 4% +0.9 1.56 ± 8% perf-profile.children.cycles-pp.apic_timer_interrupt 15.75 ± 4% +1.3 17.07 perf-profile.children.cycles-pp.xfs_file_buffered_aio_write 16.43 ± 3% +1.5 17.95 perf-profile.children.cycles-pp.new_sync_write 18.36 ± 3% +1.7 20.02 perf-profile.children.cycles-pp.vfs_write 18.77 ± 3% +1.7 20.48 perf-profile.children.cycles-pp.ksys_write 25.94 ± 3% +2.0 27.92 perf-profile.children.cycles-pp.write 5.65 ± 12% +10.7 16.35 ± 7% perf-profile.children.cycles-pp.intel_idle 5.75 ± 13% +11.2 16.98 ± 7% perf-profile.children.cycles-pp.cpuidle_enter_state 5.75 ± 13% +11.2 16.98 ± 8% perf-profile.children.cycles-pp.cpuidle_enter 5.89 ± 12% +11.5 17.42 ± 8% perf-profile.children.cycles-pp.secondary_startup_64 5.89 ± 12% +11.5 17.42 ± 8% perf-profile.children.cycles-pp.cpu_startup_entry 5.89 ± 12% +11.5 17.42 ± 8% perf-profile.children.cycles-pp.do_idle 5.69 ± 14% +11.6 17.26 ± 9% perf-profile.children.cycles-pp.start_secondary 9.36 ± 3% -3.2 6.20 ± 7% perf-profile.self.cycles-pp.atime_needs_update 9.38 ± 6% -2.6 6.74 ± 5% perf-profile.self.cycles-pp.down_read 7.04 ± 2% -2.2 4.82 ± 3% perf-profile.self.cycles-pp.generic_file_read_iter 6.34 -2.0 4.32 ± 6% perf-profile.self.cycles-pp.new_sync_read 5.76 ± 5% -1.5 4.27 perf-profile.self.cycles-pp.up_read 2.93 ± 4% -1.0 1.96 perf-profile.self.cycles-pp.__inode_security_revalidate 7.79 -0.6 7.14 perf-profile.self.cycles-pp.do_syscall_64 1.73 ± 6% -0.5 1.27 ± 6% perf-profile.self.cycles-pp.selinux_file_permission 1.73 ± 18% -0.4 1.36 ± 8% perf-profile.self.cycles-pp.fsnotify 0.72 ± 7% -0.2 0.51 ± 9% perf-profile.self.cycles-pp.rw_verify_area 0.34 ± 3% -0.2 0.17 ± 10% perf-profile.self.cycles-pp.page_mapping 0.42 ± 4% -0.1 0.30 ± 6% perf-profile.self.cycles-pp.iomap_write_end 0.24 ± 6% -0.1 0.16 ± 10% perf-profile.self.cycles-pp.iomap_set_page_dirty 0.16 ± 11% -0.1 0.08 ± 20% perf-profile.self.cycles-pp.rwsem_optimistic_spin 0.42 ± 8% -0.1 0.34 ± 5% perf-profile.self.cycles-pp.up_write 0.33 ± 2% -0.0 0.29 ± 2% perf-profile.self.cycles-pp._raw_spin_lock 0.28 ± 5% -0.0 0.24 ± 5% perf-profile.self.cycles-pp.iov_iter_copy_from_user_atomic 0.08 +0.0 0.10 ± 4% perf-profile.self.cycles-pp.workingset_update_node 0.05 ± 8% +0.0 0.07 ± 17% perf-profile.self.cycles-pp.__lock_text_start 0.14 ± 3% +0.0 0.17 ± 2% perf-profile.self.cycles-pp.__x64_sys_read 0.22 +0.0 0.25 ± 6% perf-profile.self.cycles-pp.read 0.16 +0.0 0.19 ± 9% perf-profile.self.cycles-pp.rcu_all_qs 0.18 ± 2% +0.0 0.21 ± 7% perf-profile.self.cycles-pp._cond_resched 0.11 ± 4% +0.0 0.15 ± 9% perf-profile.self.cycles-pp.xfs_file_aio_write_checks 0.32 ± 5% +0.0 0.35 perf-profile.self.cycles-pp.xfs_file_buffered_aio_write 0.14 ± 6% +0.0 0.17 ± 10% perf-profile.self.cycles-pp.ksys_write 0.04 ± 57% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.copyin 0.41 ± 4% +0.0 0.45 ± 3% perf-profile.self.cycles-pp.__might_sleep 0.20 ± 4% +0.0 0.25 ± 3% perf-profile.self.cycles-pp.__list_del_entry_valid 0.20 ± 7% +0.0 0.25 ± 6% perf-profile.self.cycles-pp.iomap_write_begin 0.03 ±100% +0.1 0.08 ± 16% perf-profile.self.cycles-pp.xfs_get_extsz_hint 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.read_tsc 0.27 ± 6% +0.1 0.32 ± 6% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.17 ± 13% +0.1 0.23 ± 10% perf-profile.self.cycles-pp.new_sync_write 0.00 +0.1 0.06 ± 8% perf-profile.self.cycles-pp.native_irq_return_iret 0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.memcpy_erms 0.01 ±173% +0.1 0.07 ± 17% perf-profile.self.cycles-pp.xlog_space_left 0.20 ± 4% +0.1 0.26 perf-profile.self.cycles-pp.write 0.10 ± 25% +0.1 0.16 ± 18% perf-profile.self.cycles-pp.xfs_log_commit_cil 0.08 ± 58% +0.1 0.14 ± 10% perf-profile.self.cycles-pp.xlog_ungrant_log_space 0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.update_load_avg 0.25 ± 4% +0.1 0.32 ± 5% perf-profile.self.cycles-pp.xfs_file_iomap_end 0.23 ± 9% +0.1 0.30 ± 8% perf-profile.self.cycles-pp.pagecache_get_page 0.00 +0.1 0.08 ± 30% perf-profile.self.cycles-pp.ktime_get 0.00 +0.1 0.08 ± 22% perf-profile.self.cycles-pp.native_write_msr 0.00 +0.1 0.08 ± 53% perf-profile.self.cycles-pp.xfs_inobt_get_maxrecs 0.59 +0.1 0.68 ± 4% perf-profile.self.cycles-pp.memset_erms 0.17 ± 9% +0.1 0.26 ± 7% perf-profile.self.cycles-pp.xfs_iunlock 0.00 +0.1 0.09 ± 44% perf-profile.self.cycles-pp.menu_select 0.68 ± 2% +0.1 0.79 ± 3% perf-profile.self.cycles-pp.___might_sleep 0.40 ± 10% +0.1 0.52 ± 13% perf-profile.self.cycles-pp.xfs_file_write_iter 0.00 +0.1 0.12 ± 38% perf-profile.self.cycles-pp.__xfs_btree_check_sblock 0.11 ± 61% +0.1 0.24 ± 12% perf-profile.self.cycles-pp.xlog_grant_add_space 0.24 ± 7% +0.2 0.40 perf-profile.self.cycles-pp.xfs_file_iomap_begin 0.31 ± 6% +0.2 0.53 ± 4% perf-profile.self.cycles-pp.rwsem_spin_on_owner 0.32 ± 12% +0.2 0.57 perf-profile.self.cycles-pp.xfs_file_iomap_begin_delay 2.60 ± 2% +0.3 2.94 perf-profile.self.cycles-pp.syscall_return_via_sysret 2.52 ± 2% +0.4 2.91 perf-profile.self.cycles-pp.entry_SYSCALL_64 5.65 ± 12% +10.7 16.34 ± 7% perf-profile.self.cycles-pp.intel_idle Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen

8 months, 3 weeks

1
0
0 / 0